I kinda know what you mean. I love my boyfriend. He does some things that annoy me (and I know I do things that annoy him) but I would never change them, because they're part of what makes him the man I love.

Now, I know there are situations (like addictions) where you can't live with the problem but still love the person. That is the only occasion when you can ask them to change.