I love the in-ear style when they are finally in-ear, but the pain of having to take them out every time someone needs to talk to you is a deal breaker. Particularly at work (although the aesthetic of over-the-ear headphones at work isn't ideal either), it's in, out, in, out, in... until I just leave them out.

I feel like I'm abusing my ear each time I twist and plug them in.

Also, if I'm doing anything even slightly strenuous (like walking), perspiration loosens the seal and they fall out.