One thing to add to the other answers: The color-receptors (cones) and the black/white-receptors (rods) do not have the same sensitivity towards light. The rods are much more sensitive and they are basically what we rely on in the dark. That is why in sufficient darkness there are no colors for you to see. They are there, but your receptors do not see them.

edit: wording