Actually, the term information is a bit misleading, as it carries different meanings to different people. The information being used in this sense is a physical, measurable thing which ties very closely with entropy and even has conservation laws associated with it.