Well if I've learned one thing from living in the world of professional musicians and musical scholars, there's always someone who's put in more work, is more naturally talented, or a combination of both. In this particular example of "random music knowledge", I know at least two people with an encyclopedic knowledge of virtually every piece of recorded music in the past century - one is a production professor with 40 years of experience touring, running live sound, and producing albums for everyone from Dave Matthews to the Tallis Scholars, the other is a music historian and jazz pianist who makes it a habit to listen to every version of a piece he's going to play (along with the full discography of that artist just so he can have an "informed background" on why they did it that way) while keeping up to date with everything from post-hardcore prog rock to alt-pop and hip hop because "you never know what'll help."

If you haven't met anyone yet who can challenge your knowledge, just go out and meet more people - you'll find them eventually.