Sounds about right. I think the operative factor is that (at least for me), when I was in my late teens and early 20s, I was really immersed in music. I listened to it all the time, took it very seriously, dissected lyrics, argued about bands with my friends, etc. Music was a huge part of my life. A huge part of my identity, even. So the music I grew up with got embedded in my spirit in a way that music that came later did not.
As I got older, I gradually lost interest in music. Other things (e.g., career) took priority. Music went to the back seat. At this point, it's an afterthought. My old music is stored away. I occasionally listen to a bit of it on a bike ride, but for the most part I don't bother. It takes my full attention, and I usually would rather put my full attention elsewhere. When I listen to music now, it's ambient stuff as background, and my focus is somewhere else (e.g., reading).
If you asked me what I consider the best music, I'd still say that old stuff I grew up with, though. Partly because I got into it so much, I learned to deeply appreciate some of it. Mostly because I'm out of touch with modern music, so I can't come up with good alternatives. What I hear coming out of car speakers usually sounds mediocre, and I think to myself, "What happened to music?" and then I think, "You sound like an old man." Which I may be. I'm sure there is good stuff out there, but it's probably not on the radio. Just like back in my day, you had to search for it -- and I don't have the inclination to go searching. So I'm not aware of it.
I realize my judgment about "best music" is subjective, but that's okay. My relationship with music is very subjective.
edit: The same is not true for games, though. That's because I wasn't into games when I was a young adult. I only got into them much later in life.