Looking into some Neanderthal culture, it is debated over how much culture they had. Art and other things from them were scarce compared to our cave paintings and jewelry. Some believed they lacked the mental ability to make these and that they copied humans, though the scarcity may have had other factors.

https://australian.museum/learn/science/human-evolution/homo-neanderthalensis/