Possibly you have nested for loops, or even nested-in-nested for loops (or worse). This means that your execution time might go O(N^3) or higher, meaning that more players add waaaay more cpu time.
Possibly best to upgrade to a vps/server with some beefy single-threaded performance. I can recommend buyvm.net's KVM slices, starting at 3.5 usd/month.