To be comfortable with someone is to be on the same page as that person. To be comfortable with yourself is to be unconflicted in your perceptions and identity.