honestly I've had good luck with men's sweaters at TJ Maxx. I got one from this company many years ago. It is similar to this one https://www.weatherproofvintage.com/collections/men/products/fisherman-shawl-sweater-in-dark-moss and 100% cotton. They have some women's ones as well, but it says they are acrylic which I hate the feel of. My other one is a H&M mens sweater I picked up second hand. Also 100% cotton. I find that most comfortable.

Basically the average men's clothing is so much more durable than the average women's option, if you can wear a men's small I'd start there.

Also I never wash my sweaters with something that has metal zippers to avoid snags. And I dry them on low heat. or actually lay them on a drying rack to dry.