I'm male, which might matter, but I walk this path pretty frequently. I live dead-center downtown and walk on either Cathedral or Charles as far north as Mi Comalito/Baltimore Eagle. I've never had any trouble or even really been worried–those passages are pretty dead at night. Sometimes I take the bus, but at night when it's running infrequently I often just walk.