Dark Eden https://en.m.wikipedia.org/wiki/Dark_Eden_(novel) was a fun read, one of the random ones I've borrowed from the library, it's not that heavy on the sci fi unfortunately it's more a human book about the highly inbred descendants of a crew that crashed on a rogue planet, but the author does a fair job of describing his idea of a frozen planet with pockets of geothermal heat that is channeled through the trunks of giant trees and various life forms most of which are bioluminescent in some way, pretty cool read actually I did enjoy it.

That's the only one I can personally remember reading specifically about rogue planets but Wikipedia has a page im gonna bookmark https://en.m.wikipedia.org/wiki/Category:Rogue_planets_in_fiction