In a duplex, each unit should have its own water heater. There is an exception, but that wouldn't apply here if you are paying for all of the utilities.

The exception would be if water and heat were both paid by the landlord and the hot water came from the boiler for radiant heat.