The darker the gravel the more believeable brightly colored fish will be. I know Jim won't give us any of that glow-in-the-dark neon yellow stuff.
Jim, I really like the look of "lace rock" in tanks, have you considered that at all? It can even be an interesting focal point of the entire tank if you find a large elaborate piece. Like this one: