I believe that your booster gets one stat point for each racer in that go, except if there's a Special Mii. I may be wrong, I've never had a Special Mii and I've only played once or twice with three or more Miis in my races.