I can't really think of anything the players did on the server, it was never laggy and suddenly people time out every 2-5 minutes.
The server has a custom modpack:
I could catch an opis screenshot, but I don't think I can actually take a lot from that. Just the ping is high...