You would need to make an acoustic panel in your basement at least around the wall where the vent and duct is. You could use acoustic foam around the duct to prevent sound to some degree. But it sounds like you have a vent that is having sound transferred through it.

Since you cannot block the ventilation you will need to create barriers that prevent sound from entering closer to the sound source or at least a little ways away from the vent.