Managing AE storage.

  • The FTB Forum is now read-only, and is here as an archive. To participate in our community discussions, please join our Discord! https://ftb.team/discord

myrddraall

Active Member
Jul 29, 2019
13
0
26
All drives in my system are formatted. I then use 4-8 crystal chests with storage busses for anything without a drive. This allows me to see when an item is building up and needs its own drive. I format a new cell and insert into a drive. Each chest is hooked up to a second chest and when I press a button all items in the storage chests are moved to their respective tmp chests. Once all items are moved to tmp storage they are piped into my main import chest causing them to be resorted into the appropriate places in the network. Finally i have trash cans with storage busses set to a lower priority than the drives but higher than the chests configured with items that i don't want in the chests once the drives are full
 
Last edited:

GreenZombie

New Member
Jul 29, 2019
2,402
-1
0
My AE "Server Room" has 312 drives, multiple chests, etc (room for 3120+ disks) [i need to take pictures sometime soon]. So the scale on which I plan my sorting is a little larger than what you need, but hopefully the basic strategy will be the same :).

http://forum.feed-the-beast.com/thr...and-guide-collection.42664/page-2#post-587528

Thanks for the detail. I officially hate RHN's ability to make his AE setup look like a 60's computer. I am not happy with this idea of voiding anything however. You never know when you might need that bit of cobble again. Or that damaged bow from the mob grinder...
 

Staxed

New Member
Jul 29, 2019
1,019
-2
0
Thanks for the detail. I officially hate RHN's ability to make his AE setup look like a 60's computer. I am not happy with this idea of voiding anything however. You never know when you might need that bit of cobble again. Or that damaged bow from the mob grinder...

lol, I'm the exact same way.
 
  • Like
Reactions: Not_Steve

Iluvalar

New Member
Jul 29, 2019
223
0
0
Here is what I use. I have 2 chests beside my AE system. On with exporting itemduct and one one standard mode itemduct. I import from the receiving chest. At this point it's just a loop. But then I send another side of the itemduct in my basement and I set that link to vaccuum mode. From the I build a wall of barrels and filing cabinet in my basement. It's just a wall, so it's very esily expendable and you can export new items into new barels when needed. keep an access to the back so you can swith the itemducts to export into your AE system at will. You'll only have to manualy keep stacked your AE with some cobblestone and sand.
 

immibis

New Member
Jul 29, 2019
884
0
0
Is it possible to attach a StorageBus to a ME chest on a different ME network (is is possible to power a ME chest without a ME controller?)?

Then I can put the 64kb memory module in the external chest, and populate it with cobble / quartz / 62 stacks of other items. Then I can just stock the drives in my principal network with 4kb/16kb modues.
This would have the same effect as preformatting your storage cell and attaching the chest directly to the network.
 

WuffleFluffy

New Member
Jul 29, 2019
402
0
0
I generally break storage into two separate categories.

Those items which are auto produced, mined, processed.
Those items which are found or crafted

I put anything which is produced by farming, mining, processing etc into a DSU, attach that to the ME network via a storage bus and then put a ME storage monitor in front of the DSU so i can see what is being stored.

I have found that 4k cells are very versatile, if ever I get more than a few hundred of a given item, it goes into a DSU.

One thing to watch out for though if you adopt mob farms/grinders is mob drops need to be managed (I put them into DSU's), but things like armor with enchants etc I tend to send to a trashcan (I wish there was a block which would let me break armor bits into raw materials!).

This way you get the convenience of the ME system without having to worry about filling up endless ME drives, a DSU (DW10 1.6.4, 10.0.20 pack/version) can store 2 billion items of any given type.

-Wuffle
 

ShneekeyTheLost

Too Much Free Time
Dec 8, 2012
3,728
3,004
333
Lost as always
When setting up my AE system, I ask myself this: Do I foresee obtaining more than 64 stacks of this item?

If the answer is 'yes', then I start building DSU's and hook them up to Storage Buses. Otherwise, I format a disk to store them. I have precisely one disk unformatted as a 'misc stuff' disk, mostly used for subcombines and temporary storage. Consider it the RAM disk, if you will.

Why the 'price break' of 64 stacks? Well, it's a matter of cost investment and price of storage per tic.

A storage disk, after a certain point, becomes exponentially expensive. However, a DSU is relatively cheap and has a static cost. I've got more ender pearls coming out of my mob grinder than I will ever possibly use in the near future, and there's not many other things I am spending ender pearls on. However, disks are going to be a continuously expanding cost as you put more and more items into it and you need to keep upgrading it. I figure if I'm going to be storing more than 64 stacks, I might as well just bump it up to a DSU and trade off space for efficiency.

Besides, with a Dolly, you can move the DSU over and plug it straight into the quest receiver when you have a quest like '10k of this thing', and be done with it. So things that I know are going to be part of a massive item quest go straight into a DSU.
 

belgabor

New Member
Jul 29, 2019
574
0
0
Don't forget Extra Cell's block storage cells. They pretty much work like a barrel in storing a 64k cell worth of items of only one type and are dirt cheap (1k cell + chest).
In my current world I use a pretty haphazard varied storage =)
  • Lots of block storage cells for specific large quantity items
  • 1.5 drives full of unformatted 4k cells for various items
  • Jabba barrels with storage bus for special items, mostly stuff I want to auto-produce a certain amount of to have available (machines pipe directly into those barrels), stuff I need/produce in remote locations (via bspace upgraded barrels) and items with tricky oreDict conversions not playing well with my unifier (currently that's steel and aluminium for me)
  • Filing cabinets for my pokeball safari net collection and mystcraft pages
  • Advanced filing cabinet for enchanted books
  • And my favourite, one advanced filing cabinet for misc unstackable items
 

epidemia78

New Member
Jul 29, 2019
1,810
-4
0
Im not yet hugely experienced with setting up complicated AE systems but in my latest world I tried something a little different.



Thats four subnetworks with the main one in the center. One network is for valuables like ingots and gems, one for building blocks, one for blocks that "do stuff" and one for misc items. New items go into the ME chest which I occasionally need to sort manually.
 

MacAisling

Popular Member
Apr 25, 2013
1,084
612
128
Kearneysville, West Virginia
Several mods include a way to reclaim materials from armor, but the less cheaty ones require it to be fully repaired 1st. I personally hate having junk chests everywhere, so I use a drive full of 4k's for everything, then start setting up DSU's for anything coming in in large volumes when the lights start going red. I usually only need a drive & a half by mid-game, but I've also cut the DW20 pack in half to help get rid of some of the worldgen clutter (& some of the lag on my laptop). Originally I'd use pipe routing to sort & process materials before sending it to my ME system, but then I discovered the ME system could handle everything much faster even keeping all the dirt & cobble than the piping system could after voiding all the dirt & cobble. I was turning the excess into scrap boxes & having a party every once in a while, but now I've cut IC2 from the pack. I just made my 1st 64k for the singularity compressor so I can clear some excess without feeling too wasteful. I'll also use enderchests for interfacing with remote set ups instead of running cables.
 

Bagman817

New Member
Jul 29, 2019
832
0
0
It's perfectly viable to just spam 16k cells. Make 1 intially, make a 2nd as resources allow, then make more as needed so you always have one blank cell. When you see an item at/around 10k units (or you know it'll get there like dirt/cobble), throw it in a DSU with a storage bus. As long as you aren't foolish with storage (a single clay flower pot probably makes more sense in a 'misc' chest, than the ME system), you shouldn't run into problems. Maximizing efficiency via pre-formatting can be a fun challenge for some, I suppose, but don't think it's required.

Yeah, I'm a rebel.
 

MacAisling

Popular Member
Apr 25, 2013
1,084
612
128
Kearneysville, West Virginia
I have a new favorite trick for managing the amount of produced goods in my ME: ME -- storage bus -- enderchest (--) enderchests -- item translocators -- chests -- farms. Set up the farms to stop when the chest is full, set the translocators to keep 1 stack of each item in the chest. Keeps a ready supply on hand without flooding me with more than I will ever use, especially all at once.
 

Wisq

New Member
Jul 29, 2019
14
0
0
The matter energy storage system in AE is rather odd and it imposes some kind of exponential cost to storing large stacks of items on small memory units.

Actually, it's the reverse. AE cells are more efficient at storing large quantities of stuff, not less. A cell with only one item type in it can store roughly twice as many stacks in total as a cell with all 63 item types used. See ME-Storage-Math.

I find my main problem when making a brand new ME system (for general storage and inventory) is typically that I don't have enough slots for all the hundreds of small stacks of minor items, not that I don't have enough space for the huge stacks of cobble/dirt/etc. So I'll spam a bunch of 1k or 4k cells to get enough slots. As the more populous item types look like they're going to start to become a burden, I'll take some of those cells out, purge them into the system (using an ME IO Port), and turn them into the next higher cell.

Remember: it only takes 3x of a cell to make the next higher version, but you get 4x the storage. So in fact, it's not exponentially more expensive to store large quantities, it's less expensive the higher capacity you go. A single 64k cell holds 64x as much as a 1k cell (naturally), but only takes 27 1k cells to make. You probably wouldn't shoot for 64k as your first cell, but if you upgrade to it slowly, you're gaining "free" storage every time you combine cells and upgrade to the next level.

I'm not saying it's a cheap way to store things, mind you. And storing more stuff will always cost more in general. But you do get a "bulk discount" in that the more of a particular item you store, the less you're paying per stack to store it.



Edit: Ah, did a reread and I sorta see what you're saying now — with a mix of sizes, it's happy to put large stacks of items on small cells and exhaust them.

I believe the ME sorting logic is that, when sorting an item, it always prefers cells that already have the given item type on them, or that are preformatted to accept that item type. So if you preformat something and put it in, it may not start putting items on that cell until all the other cells containing that item are full.

The solution to this is to make an IO Port. Stick your formatted cell in the IO Port and tell it to take items from the network. It'll rapidly slurp everything up and put it into your formatted cell.

Now, the above works great so long as nobody/nothing puts that item into the network in the period between when you pull it out of the IO Port and put it back into the ME Drive. If the item is being actively produced (e.g. by a farm), it may manage to get some stuff onto a non-preformatted cell before you can put your preformatted one in and "claim" that item type.

Three ways to solve that:

One, turn off whatever is producing that item briefly. If possible, that's the easiest way.

Two, find what cell(s) have that item on them, put them into the IO Port, and empty them into the network; it'll sort that item into other matching cells. If you do this for every cell that contains the item, eventually it'll put them all into the preformatted one.

Or three, you can make a small preformatted cell (say, 1k) to hold the item temporarily. Put that in the network, then take your bigger cell and slurp the item out of the network with the IO Port. In the time it takes you to put it back into the network, any of that item that shows up should go into your tiny preformatted cell. Then, once you've put the big preformatted one back in, you can take out the small one and use the IO Port to dump it into the network; it should all go into the big preformatted cell.

You can also use IO Ports to "defrag" your network. If you have rare items that are getting spread across a bunch of cells (because the cell fills up and then you add another one), you're wasting a lot of space by having more item type "slots" used than is strictly necessary. Once you get the popular items out into their own preformatted cells, then you can put cells into IO Ports and slurp / dump things from / into the network as needed in order to condense items into as few slots as possible.
 
Last edited:

belgabor

New Member
Jul 29, 2019
574
0
0
I believe the ME sorting logic is that, when sorting an item, it always prefers cells that already have the given item type on them, or that are preformatted to accept that item type. So if you preformat something and put it in, it may not start putting items on that cell until all the other cells containing that item are full.
Yes, this even tops configured storage priority. IIrc it's "already has item">priority>preconfigured>nothing. This can really trip you off in voiding setups as usually a voider has no items.