Population Crisis This, Population Shrinkage There. What's the actual negative?

I keep reading constant fear-mongering about population decline yet none of them explain why a population reduction of percents is a "crisis". Is this just misdirection to keep the labor pool oversaturated in order to keep wages low?

Edit: extraneous sentence.