There are some oddities with selections because of layering, but this is something I often notice in native PDF viewers. Have you seen any particular patterns which cause this?
The only pattern that I can recognize is that it's impossible to select an entire line character-by-character with the mouse- I can do it by triple-clicking the line, though.
