Could you email me your config file. I might be able to help you then, because I also have a FTB server, and I could compare the two. My email is
[email protected], if not, try putting one or two people on at a time until you get lag to see where the lag zone is.