+1 scarves are great. I have a Cashmere one (not that cost effective but oh so comfy) that I’ve been using for years and it’s the best for keeping warm.

Though if it’s really windy, Gore-Tex makes a wind-stopper material you can get face masks out of and it’s like magic. I used those on my motorcycle to keep my neck from freezing and they worked so well!