Anyone who has experimented with mind-altering substances will tell you that most of them enhance (or at least affect) the experience of listening to music.  Those who play music well enough to do so under the influence will often tell you that drugs enhance your creativity and ability to dream up new music, too.  In particular, you often see bands or people who write incredibly inventive music during periods of drug abuse, and then become incredibly boring and stale when they sober up (although there are a lot of reasons that might happen).  At any rate, I don’t think many people will argue that drugs have no affect whatsoever on making music, or on your experience listening to it.