I think the speaker (Person A) means, that he feels disrespected by his friend (Person B), because Person B is comparing his life to Person A. Just because A doesn't have a "so called" perfect life, doesn't mean that he's a bad person or unhappy.
I hope that helps!