The way I heard it was good first family got the constantly working, touring version, which I imagine wouldn't have been easy for anyone, while his second family had him after he'd largely stepped away from performing and was semi-retired, which I imagine was less stressful for everyone.