The vast majority of server performance comes down to factors like:
- mod-pack
- players' builds on the server
- server hardware
- Internet bandwidth
- other processes running on the server
- Ubuntu (uses Debian as a core)
- Debian (without Ubuntu)
- SUSE
- etc.