It sounds like a good idea in general. But, I could see VR causing a lot of bad decisions. I can practically hear some CEO saying "I thought it would be fine" or "the model didn't look like that".

You can easily lose details like acoustic properties, sense of scale, etc.

AR might be better. Harder to do, but worth it.