Small groups of fans can become large groups of fans. They also can remain small groups, or even diminish. And the general principle of everything is that successes are much more rare than failures, and the majority of media that didn't catch immediate attention will... just die unknown.

If you gave a chance to every movie that might become popular, you'd be throwing huge piles of money on nothing. Which is not the best business strategy