Love this topic!
I have this "problem" too. I love all kinds of music so much I can't choose what to narrow down to. I like to try bits and pieces of different generes and stich them togetter to see what it sounds like. So this question came to me too, but then ... well. If I was handsome eighteen y/o teenager aspiring to sky rocket to the startom, I'd probably kill this experimentation off right away as it really does disctract your followers. But as I'm not (with a very little chance in becoming one at 25

), I figured out that there's not much to lose.
Also, there are experimentators that were/are popular for it. Look at good old Moby or Chemical Brothers for example. Or guy I admire like crazy, Ramesses B. He makes all sorts of styles. Some of those guys are even on this forum. Listen to for example Matt Lange's or Mat Zo's variety.
It's true that there is a big gap between generes like progressive and neurofunk, but I think that doesn't mean we should be affraid of experimentation. Even if it costs follower or two.

(...or more exactly, I hope we shouldn't be.)