Yeah, backer rod is what I was thinking. It's basically the same thing as the weather strip tubes, different sections of the store for sure.

I guess I grew up using caulk as a general term for anything that covered a joint, be it silicon or traditional stuff. OP should choose their goop for their situation.