The research shows that listeners want the familiarity. We all say we want variety, and we want radio to take chances, but then here in lies the problem.
Let's take three music formats that demonstrate this: AAA, Classic Rock and CHR.
With a CHR outlet, you likely only have the listener for 20 minutes to a half hour on the drive home. And they want to hear the current hot hit. So that same Calvin Harris or Rihanna song the driver heard this morning, will be played to keep the listener. Play those familiar hits, or else you lose them for that twenty minutes. You can't afford to break hits anymore. So those new song showdowns, or make it or break it type features don't work at CHR any more (those that do it just play a snippet of the song, because they can't afford to miss a listener with a "bad song").
So who breaks the new song? You Tube, and radio has accepted that. CHR only plays proven hits.
Now over at Classic Rock, we could use some variety there right? Every rock fan agrees we should. So why does the format churn out the same Pink Floyd, Led Zeppelin, Lynyrd Skynyrd and Janis Joplin ad nauseum? Because we can all agree on the first tested 100 songs: we all like them. Now the next 100 songs we test will score 4 out of 5 listeners. So when we come to Floyd, we can afford to spin "Hey You", but but just a little less than "Comfortably Numb".
But when we test the next two to four hundred songs, only a few score beyond 3 out of 5 listeners. So playing Floyd's "Run Like Hell" isn't as safe a bet as playing "...Numb". Three listeners really likes it, but two tune out - uh oh! And by the time we get to Skynyrd's "Working For MCA" or Deep Purple's "Lazy", we getting into abysmal ratings territory. Both people that are left listening really like it, but the other 500 listeners wanted "Smoke on the Water". Advertisers want the larger audience if they are going to buy.
The issue over at AAA is that people like to say "Oh it's great that Mark Knophler, Sting and Springsteen are putting out new records", but these artists are no longer in their prime (there are great new songs by all of these classic artists), but two things: younger artists seem to have a more energetic and aggressive presentation (in the rock and folk genre I mean), and the other issue for AAA (and I hate to say it): it's largely an aging male dominated audience. Advertisers chase the 25 to 54 year old woman. Males appear set in their ways (so says the research) and they don't embrace consumerism as much as energetic and fashionable women. It's sounds so chauvinist, but the research seems to prove it, so the mindset won't likely change.