You have this survey about ML for Combinatorial Optimization from Bengio, Lodi, and Provost.

OpenAI's paper about a robot hand learning to solve a rubik's cube

Also check-out anything mentioning neurosymbolic AI, which aims to combine neural network learning with logic-based reasoning.

Gary Marcus wrote an extensive note on the subject that I recommend as well