Phosphorus. It's critical to life, and yet so incredibly rare. We actually have quite a lot of it given the size of our planet.

It's so rare that low availability of phosphorus galaxy-wide is seen as one possible explanation for the Fermi paradox.