Poll workers are almost entirely volunteers. One of the only demographics with enough free time to sit at a polling station the entire day is the elderly and retired. Covid-19 was most lethal to the elderly and people with underlying conditions. Most of the people you remember from your polling place are probably dead.