To expand a bit, aside from the early universe point in terms of how we get anything smaller than a gas giant for dark matter. One thing that is possible even for hard to detect ordinary matter is that even non-detection sets limits for the size and quantity of those objects. So, surveys watching for occultations and gravitational lensing events on stars in Andromeda or distant galaxies or quasar by these objects if they made up the Milky Way's dark matter halo set limits on the size and quantity of planet sized objects and even planet mass primordial black holes. I believe the current boundaries for size and quantity of objects that have not been eliminated as significant dark matter contribitors is pretty small right now.