I wouldn't get too hung up on this...unless you are into running flea powered amps.
This is a common misconception that the only consequence of lower sensitivity is the amount of power required. There are physical reasons why low sensitivity speakers can sound different than high sensitivity speakers. The following is a generalization (there are many exceptions), but it should give an indication of the factors involved.
All speakers demonstrate a spectral shift in their frequency response as power levels and output increase - they only differ by degree. Certain frequencies become attenuated relative to others with increased power causing the overall frequency response to change. The culprit is dynamic compression and it tends to plague low sensitivity speakers much more than their high sensitivity counterparts.
In a moving coil loudspeaker, dynamic compression results from a number of factors - the most significant of which is heat. Since the moving coil is a resistive electrical element, it gives off heat. Put more power to it, and you generate more heat. This heat will cause a reduction in strength of the permanent magnetic field and changes in coil impedance that all act to reduce output. This has a two-fold effect. Dynamic range (the difference between the loudest and softest sounds) becomes restricted as output increases. In a multi-way speaker, each driver has differing levels of dynamic compression causing the previously mentioned spectral shift.
Distortion levels can also become a factor related to sensitivity. The interaction of the current in a moving coil loudspeaker and the permanent magnetic field of the motor results in flux modulation or constant variation in the strength of the permanent field. This translates into 2nd order harmonic distortion. The greater the current, the greater the flux modulation, and hence, the greater the distortion
All things being equal (and they never are) the high sensitivity speaker will exhibit lower levels of dynamic compression and lower levels of distortion than a low sensitivity counterpart. With the high sensitivity speaker, the drivers are operating at lower current levels, generating less heat and flux modulation. This makes it easier to engineer dynamic compression and distortion to very low levels. The sonic result is that high sensitivity speakers are generally asserted to have a more effortless sound and freedom from strain. Adjectives such as “lively”, “visceral” and “rhythmic” are often used to describe such speakers.
To put all of this in perspective, there are valid engineering reasons for designing high efficiency speakers beyond reducing power requirements. However, they are not absolute. It is possible to engineer a low efficiency speaker to have very low dynamic compression and minimal flux modulation. It is very expensive and few manufacturers are willing to bear these costs. That is why my preference leans towards high efficiency speakers. However, it is also true that it is very easy to engineer a high efficiency speaker that sounds bad so that sensitivity should never be the sole arbiter of what sounds best. That’s the job for your ears.