Medieval houses often used lots of whitewash, including the interiors, which would have made them look a fair bit better than the usual shit-brown huts, and we're finding new evidence of more extensive use of light colours for interiors, including things like distemper which were naturally yellow, or yellow-ish. This would also help the interiors look better when interior lighting was much more limited.

Clothes could easily be dyed bright colours, but colour fade would have been a much more important factor, and of course they tended to see far more wear and tear. There would be vast differences between the clothes of the different classes, with some colours/shades only being available to the wealthy, but even disregarding that, the workmanship and quality of the clothes (and in some times and styles, the sheer quantity of cloth), not to mention the dyeing itself, would be worlds apart.