Problem Server Out of Memory and Crash

[Tomasu]

Hi, just started having issues yesterday with my FTB DW20 server.

• What OS are you running?

Debian GNU Linux 3.2

• Are you using minecraft hosting provider or a dedicated/local server not designed for minecraft?

Local server

• What version of FTB are you using? (Dont just say latest tell us the version)

DW20 v3 1.4.6

• Did you add any mods to the server pack?

No

• What are your server specs?

Intel(R) Xeon(R) CPU E31230 @ 3.20GHz
16GB DDR3 1333MHZ ECC
Main HDD: 2x500GB Seagate Baracuda in Raid 1
Local GbE Networking, 50/3mbps internet

• A good detailed paragraph about the problem

Late last night the FTB server locked up and crashed with Out of Memory errors. I've assigned FTB 3GB ram (there is plenty of free memory for FTB to use). I also just tried upping it to 4GB, and it dies with an Out of Memory error within 10 minutes of startup. The server only has a few active players, and it was only started up a couple weeks ago max. FTB normally only uses ~2GB ram, so something odd is going on.
ForgeModLoader server log: http://strangesoft.net/ForgeModLoader-server-0.log.crashlog-2013-01-08
Crash Log: http://strangesoft.net/crash-2013-01-08_21.16.26-server.txt
Post Memory Increase logs:
http://strangesoft.net/ForgeModLoader-server-0.log.crashlog-2013-01-09.0
http://strangesoft.net/crash-2013-01-09_04.20.09-server.txt
I am currently unable to start the server at this point as it dies within minutes of starting. Thanks for any help

 

[Tomasu]

I Just tried uping the memory for FTB to 6GB, and it gets a lot further, but its stuck using anywhere from 100% to 400% cpu (1-4 cores), client's can't ping the server, and after attempting to 'save-all' the console stopped responding for quite a while, but I just saw this pop up:

2013-01-09 05:26:48 [INFO] [Minecraft] An unknown error occurred while attempting to perform this command
2013-01-09 05:26:48 [INFO] [STDERR] java.lang.OutOfMemoryError: Java heap space
2013-01-09 05:26:48 [INFO] [STDERR]    at bq.a(SourceFile:57)
2013-01-09 05:26:48 [INFO] [STDERR]    at ur.b(SourceFile:106)
2013-01-09 05:26:48 [INFO] [STDERR]    at com.eloraam.redpower.core.TubeItem.writeToNBT(TubeItem.java:31)
2013-01-09 05:26:48 [INFO] [STDERR]    at com.eloraam.redpower.core.TubeFlow.writeToNBT(TubeFlow.java:141)
2013-01-09 05:26:48 [INFO] [STDERR]    at com.eloraam.redpower.machine.TileTube.b(TileTube.java:393)
2013-01-09 05:26:48 [INFO] [STDERR]    at aam.a(AnvilChunkLoader.java:311)
2013-01-09 05:26:48 [INFO] [STDERR]    at aam.a(AnvilChunkLoader.java:127)
2013-01-09 05:26:48 [INFO] [STDERR]    at im.b(ChunkProviderServer.java:232)
2013-01-09 05:26:48 [INFO] [STDERR]    at im.a(ChunkProviderServer.java:284)
2013-01-09 05:26:48 [INFO] [STDERR]    at in.a(WorldServer.java:844)
2013-01-09 05:26:48 [INFO] [STDERR]    at hf.b(SourceFile:34)
2013-01-09 05:26:48 [INFO] [STDERR]    at x.a(CommandHandler.java:82)
2013-01-09 05:26:48 [INFO] [STDERR]    at ho.al(DedicatedServer.java:309)
2013-01-09 05:26:48 [INFO] [STDERR]    at ho.r(DedicatedServer.java:271)
2013-01-09 05:26:48 [INFO] [STDERR]    at net.minecraft.server.MinecraftServer.q(MinecraftServer.java:598)
2013-01-09 05:26:48 [INFO] [STDERR]    at net.minecraft.server.MinecraftServer.run(MinecraftServer.java:497)
2013-01-09 05:26:48 [INFO] [STDERR]    at fy.run(SourceFile:849)

And after that, it seems to let me connect, but memory use is over 5GB, cpu use is over 100% (often over 200%), and the lag is quite bad.

 

[Tomasu]

Ok, It has to be a leak of some kind. I've tried 8GB now, and its using it all up. Rest of the symptoms are the same. Tons of CPU use, and eventually it dies.

 

[Tomasu]

I've figured out its being caused by /something/ in a certain Mystcraft age, but I haven't figured out what yet.

Someone built a massive redpower frame machine, but it was turned off, and he broke a bunch of the red power blocks that may have been buffering stuff. Also had players go in and remove all of the chunk loaders they could find. Nothing helped. The only thing that's worked so far is to move that mystcraft age out of the way before starting the server.

I'm saving it just in case someone wants to take a look at it.. It'd be nice to figure out what exactly was causing it.

 

[Stengel]

I'm having the same problem. We don't have mystcraft, so I assume it's alot of machines eating up the server.
Did you find the thing causing it yet?

 

[Nessiroj]

I've figured out its being caused by /something/ in a certain Mystcraft age, but I haven't figured out what yet.

Someone built a massive redpower frame machine, but it was turned off, and he broke a bunch of the red power blocks that may have been buffering stuff. Also had players go in and remove all of the chunk loaders they could find. Nothing helped. The only thing that's worked so far is to move that mystcraft age out of the way before starting the server.

I'm saving it just in case someone wants to take a look at it.. It'd be nice to figure out what exactly was causing it.

i could test it on my testserver if you whould send me the mystcraftage where the problems are, can prob debug whats causeing it

 

[Yourdogsdead]

I am having the same issue

java.lang.OutOfMemoryError: GC overhead limit exceeded
    at java.util.HashMap.createEntry(HashMap.java:869)
    at java.util.HashMap.addEntry(HashMap.java:856)
    at java.util.HashMap.put(HashMap.java:484)
    at bq.a(SourceFile:53)
    at com.eloraam.redpower.core.TubeItem.writeToNBT(TubeItem.java:35)
    at com.eloraam.redpower.core.TubeBuffer.writeToNBT(TubeBuffer.java:99)
    at com.eloraam.redpower.machine.TileTranspose.b(TileTranspose.java:300)
    at com.eloraam.redpower.machine.TileFilter.b(TileFilter.java:211)
    at aam.a(AnvilChunkLoader.java:311)
    at aam.a(AnvilChunkLoader.java:127)
    at im.b(ChunkProviderServer.java:232)
    at im.b(ChunkProviderServer.java:328)
    at in.b(WorldServer.java:166)
    at net.minecraft.server.MinecraftServer.r(MinecraftServer.java:668)
    at ho.r(DedicatedServer.java:270)
    at net.minecraft.server.MinecraftServer.q(MinecraftServer.java:598)
    at net.minecraft.server.MinecraftServer.run(MinecraftServer.java:497)
    at fy.run(SourceFile:849)

If I could disable redpower to get on, I could disable machines. That is the only thing I could think of that could be causing it.

 

[nallar]

Someone may have created a tube system which is filling up with (possibly corrupted?) items.

edit: Someone's using a filter or transposer for infinite item storage.

 

[Yourdogsdead]

Someone may have created a tube system which is filling up with (possibly corrupted?) items.

edit: Someone's using a filter or transposer for infinite item storage.

It happened again after I rolled the map back. Is there anyway to prevent this?

 

[Nessiroj]

The only way is to tell your member to fix their tubes systems i reckon

 

[UgLounge]

The only way is to tell your member to fix their tubes systems i reckon

But if the server is unable to boot? I find it rather impractical that players can crash a whole server by screwing up piping.
Is there a way to fix the piping without rolling back the world?

 

[Nessiroj]

There are programs that allow editing of worldfiles, although i never like those. If you have direct acces to the worldsaves you could download them and install them on your localmachine and try if you can fix them in single player. If you can fix it you can just reupload them to the server.

Otherwise download the rollback to localclient - see where the machines are, fix them and then upload the rollback.

Piping can't be fixed in configs orso, you are really reliable on the knowhow of your members to use them the way it should (and hope they make failovers)