I get what you’re saying, but I’m thinking in more of an abstract manner here. Maybe the color thing is a bad example but you can still in theory talk about half of a hole as a concept.

It can in theory, say if someone says “the first half of the hole is yellow and the other half is brown” then there ya go, you’re talking about half a hole

Whole is a concept meaning “all of” something so a hole can be a whole hole if you’re just focusing on the hole itself