I think there a several varibles as to the need for a crossover. But most of the time, you need one.
If it's a smaller driver, then driving it full range you are going to get more motion and increasing distortions as the level gets higher. So with a single 4" in a BLH cabinet and modest levels, maybe acceptable depending on your music preferences. In my listens, it didnt' do it for me. But a line level crossover, biamping with a seperate sub would lift these restrictions. But if you don't push it...you might maybe prefer the single driver, no augmentation and no filtering.
In my case, I tried 6 8" drivers in about a 22" wide folded back baffle. Total Q's of I think around .8. It really had LF drive, pop, and measured to be pretty flat below 40hz. If those cheaper drivers in that situation went high enough and had enough clarity, I'd have called it a day. Only the extremes of a few situations or movie tracks efx would have wanted for more.
With multiple Tang Bands run full range and bi-amped augmentation, I only start to hear negative effects when I get above my normal louder levels. My clarity is enough I don't have to go to extreme levels to get life...others might push it more. Which even when I do start to get some distortion starting to show up, could then be amps running out of steam as much as the drivers trying to do too much. I've went back and forth with inserting a line level crossover and think I have minor negative effects. Ultimately, as setup now, I settle for a crossover rolling in the bass and leaving alone the full range driver. I don't think that'd be typical.
EV3