I write little summaries of each reading session, key plot and character developments and my thoughts on them. When I need to refresh, say because a sequel comes out a year later, I reread my notes.

Doesnt need to be long or expansive, a short paragraph or two every time you put the book down will do it.