As I believed, the house does feast on emotions too. Bob was likely feeling completely shattered and different when his father hit him, killing part of him, the innocent part. The house consumed that part, as it was essentially dead.