I would have built one decades ago if I knew how much difference it made, it was the biggest bang for the buck improvement so far, much bigger than other pieces of gear I paid thousands for, and it only costs peanuts.
There is little difference in the ultimate noise performance in passive and active summing. While the passive mixer does of course not amplify, unless the resulting attenuated level is sufficient as the ultimate level there will be a following active stage. I presume you plug your passive mixer into something? There you go.
We could do a detailed analysis of the noise performance of passive and active summing if you like . . . probably the biggest disadvantage to passive summing is a shunt resistor is generally used to achieve the required output impedance, which results in larger network loss than would be achieved by an inverting summing amplifier. Therefore, since the resulting signal level to the following amplifier is lower than it would be with a summing network directly feeding an inverting input of an opamp, the overall noise performance of the passive mixer would be worse.
This can be avoided by locating the makeup gain stage as close to the passive summing network as possible so that a higher output impedance is not troublesome. Ultimately, that becomes the same practical circuit as the active summing network, with almost the same performance. But that is not what most people build as a DIY passive mixer.
Also, if you are building a true mixer and not just a passive summing box, you will have significant additional loss to the panpot. That could require the ultimate makeup gain to be greater than 40dB, perhaps much more. That further harms the noise performance vs. an active mixer that would buffer the fader and panpot individually, thus avoiding too large a drop at any one point. The same is true of the EQ section, if present.
Ultimately, the selection of passive vs. active vs. digital summing is probably one of the least important aspects of the signal chain. I can demonstrate that handily if you have some source files you would like mixed.
None of that has much to do with the OP's question. A passive mixer is only a good first project if someone actually needs a passive mixer. If one needs a microphone amplifier it is entirely useless.