Well, there are some transit lines in several parts of the state. But it is not great coverage, it doesn't always work overnight, and it may not even be straightforward to get between two points without traveling to a hub like Newark or Hoboken first.

NJ Transit is the system. Here's the train and light rail line maps

Here's a list of bus routes with links in the reference section to unofficial bus maps and the NJ Transit query system.