Well, I'm also a native speaker for what little it's worth ;-). I can't agree at all that the first one sounds better. But maybe it sounds superficially like "drunk driving" (or I suppose the UK expression is "drink driving").
You wouldn't say "is fast going allowed here?" either (here "going" still meaning "to drive").
I think the second one is better, but not completely natural. But I could still see somebody using it. I can't imagine anybody saying the first sentence. It sounds as if there's this concept of "fast driving" (which is called "speeding" if over the limit) instead of simply driving fast.
Maybe "are we allowed to drive fast here?" or even "can we go fast here?". Or some other expression completely like "what's the speed limit here?".
I have to admit, I can't quote any rule for how it works, but sometimes you can say "fast driving". E.g.,"are fast driving vehicles allowed here?" or "to permit fast driving". But they're being used in somewhat different senses.