The default pistol never runs out. The special pickups do, so a heavy machine gun is something you use up rather than an upgrade you own. Decide which stretch of the stage deserves the extra firepower before you’re back to the pistol.