Fusion will damage and activate the shielding. To do it on mass scale the costs of storing the activated shielding and replacing the shielding could be high. Even fast nuclear reactors have a similar issue where burner/breeder reactors have a much shorter expected operational life compared to the light water reactors that are expected to operate for 80 years.