Sorting system mod for already generated world

  • Please make sure you are posting in the correct place. Server ads go here and modpack bugs go here
  • The FTB Forum is now read-only, and is here as an archive. To participate in our community discussions, please join our Discord! https://ftb.team/discord

asiekierka

Over-Achiever
Mod Developer
Dec 24, 2013
555
1,086
213
Any pipe system will lag given enough items. Some just make it easier to not fail at designing the logistics.
 
  • Like
Reactions: Type1Ninja

Azzanine

New Member
Jul 29, 2019
2,706
-11
0
Tbh my only real beef with BC pipes is they have waaay to many variations. Cobble, stone, gold, wood, sandstone, clay, emerald, diamond, obsidian, iron... I feel like I'm missing a bunch.
There's a good reason I call them clown pipes.
Also fine control with gates comes too late for me.

Sent from my GT-I9100 using Tapatalk
 

asiekierka

Over-Achiever
Mod Developer
Dec 24, 2013
555
1,086
213
Tbh my only real beef with BC pipes is they have waaay to many variations. Cobble, stone, gold, wood, sandstone, clay, emerald, diamond, obsidian, iron... I feel like I'm missing a bunch.
There's a good reason I call them clown pipes.
Also fine control with gates comes too late for me.

Sent from my GT-I9100 using Tapatalk

Each type serves a purpose and in complex systems I do actually see most of them being used. And their "clown factor" allows easy visibility of what each part roughly does.
 
  • Like
Reactions: Type1Ninja

GreenZombie

New Member
Jul 29, 2019
2,402
-1
0
Tbh my only real beef with BC pipes is they have waaay to many variations. Cobble, stone, gold, wood, sandstone, clay, emerald, diamond, obsidian, iron... I feel like I'm missing a bunch.
There's a good reason I call them clown pipes.
Also fine control with gates comes too late for me.

Sent from my GT-I9100 using Tapatalk

I always thought BC pipes would be a lot more usable if they cut down on the recipes - made the speeds more uniform, and used a paintbrush / dye mechanisim to prevent pipe interconnection. Are we really pretending that cobble vs stone is a balancing decision such that one is faster than the other?
 

asiekierka

Over-Achiever
Mod Developer
Dec 24, 2013
555
1,086
213
I always thought BC pipes would be a lot more usable if they cut down on the recipes - made the speeds more uniform, and used a paintbrush / dye mechanisim to prevent pipe interconnection. Are we really pretending that cobble vs stone is a balancing decision such that one is faster than the other?

1. We already have a paintbrush/dye mechanism. Since October 2014, in fact. It was the first thing I added!

2. Yes, yes we are. Especially on fluid/power pipes. Though Quartz needs a change...
 

czaderak

New Member
Jul 29, 2019
6
0
0
Details? I've always been looking for someone to have something to prove that one. I'd like to look into it personally, on the server if possible.

It seems to be the network-based problem, I think our server's upload is too low for the amount of data sent by BC pipes. Our server is just a PC working 24/7 at my friends home. He's upload reaches not more then 20 Mbps.
Therefore, the problem doesn't occure at my friends computer since he's connecting to the server via LAN. However, it occures on everyone else's computers ;)

For me it works that way:
at my home I have about 15 chests connected to one long stone pipe, with diamond pipes as filters. At front there's a chest with two wooden pipes connected to it and redstone engines for power. The wooden pipes are then connected through an iron pipe to this one long filtering pipe. Engines are just working all the time and doesn't seem to cause any problem, but when I put items in the chest to get sorted out I get lags which I can notice by the time it takes for me to for example open a chest (I click on it, and it opens after about 10-20 seconds). When this happens I can't see items in pipes and it doesn't stop until I turn off the engines and let the pipes empty themselves.

PM me if you want any further information.

edit
--------------
I took some screenshots to show you the whole system. (Ok maybe there are more then 15 chests, but it's still not very complicated).
 

Attachments

  • 2015-08-05_12.19.10.png
    2015-08-05_12.19.10.png
    600 KB · Views: 48
  • 2015-08-05_12.19.23.png
    2015-08-05_12.19.23.png
    678.9 KB · Views: 49
  • 2015-08-05_12.19.33.png
    2015-08-05_12.19.33.png
    473.2 KB · Views: 44
  • 2015-08-05_12.19.38.png
    2015-08-05_12.19.38.png
    539.8 KB · Views: 41
  • 2015-08-05_12.19.49.png
    2015-08-05_12.19.49.png
    385.2 KB · Views: 47
  • 2015-08-05_12.19.52.png
    2015-08-05_12.19.52.png
    503.7 KB · Views: 39
  • 2015-08-05_12.20.02.png
    2015-08-05_12.20.02.png
    560.7 KB · Views: 45
  • 2015-08-05_12.20.06.png
    2015-08-05_12.20.06.png
    398.7 KB · Views: 41
Last edited:

GreenZombie

New Member
Jul 29, 2019
2,402
-1
0
This for me is the current undisclosed source of lag: which mods are - for whatever reason - pushing unreasonable quantities of data between the client and server. There don't seem to be any profiling tools - or options in Opis - to profile the traffic by channel to try and answer the question - "hey, why is mod-x trying to transmit 20MB/s right now?"
 
  • Like
Reactions: Type1Ninja

asiekierka

Over-Achiever
Mod Developer
Dec 24, 2013
555
1,086
213
This is in the BC wiki?

What BC wiki? We don't have any official wiki. There's one in the works but there's little time to work on it (see our GitHub - contributions welcome), and both the FTB wiki and the two Wikia wikis are highly outdated.

It seems to be the network-based problem, I think our server's upload is too low for the amount of data sent by BC pipes

Increase updateFactor in buildcraft/main.cfg. This will make BuildCraft (as a whole!) send packets less often.

This for me is the current undisclosed source of lag: which mods are - for whatever reason - pushing unreasonable quantities of data between the client and server. There don't seem to be any profiling tools - or options in Opis - to profile the traffic by channel to try and answer the question - "hey, why is mod-x trying to transmit 20MB/s right now?"

WAILA <1.5.10 and WAWLA <1.2.0 definitely do, as well as some older WAILA addons not updated to the API changes in 1.5.10+, when looking at blocks with large NBTs (such as Zone Planners or Fillers/Builders).
 

czaderak

New Member
Jul 29, 2019
6
0
0
Increase updateFactor in buildcraft/main.cfg. This will make BuildCraft (as a whole!) send packets less often.

Checked it up -> I've set update factor to 100 and long update factor to 200 and restarted the server

I still get lags as soon as sorting engines reach their yellow state.
 

GreenZombie

New Member
Jul 29, 2019
2,402
-1
0
What BC wiki? We don't have any official wiki. There's one in the works but there's little time to work on it (see our GitHub - contributions welcome), and both the FTB wiki and the two Wikia wikis are highly outdated.

NEI? The in game Buildcraft handbook? Ok. I was being facetious. My point is, how the hell am I/are we supposed to know about the excellently cool things that have been added to buildcraft without meticulous reading of reams of patch notes?

WAILA <1.5.10 and WAWLA <1.2.0 definitely do, as well as some older WAILA addons not updated to the API changes in 1.5.10+, when looking at blocks with large NBTs (such as Zone Planners or Fillers/Builders).

What? walia shows nbt sizes? That certainly would contribute, and I am not an accomplished modder but it was my understanding that mods can (And do) use a forge api to create channels through which the client and server part can communicate. Independent of minecraft trying to keep the world updated - which large nbt bits would certainly impact - how many bytes/s are mods trying to send? Or do mods mostly not use that?
 

asiekierka

Over-Achiever
Mod Developer
Dec 24, 2013
555
1,086
213
Checked it up -> I've set update factor to 100 and long update factor to 200 and restarted the server

I still get lags as soon as sorting engines reach their yellow state.

Then it must be something else. Try Graphics: Fast?

NEI? The in game Buildcraft handbook? Ok. I was being facetious. My point is, how the hell am I/are we supposed to know about the excellently cool things that have been added to buildcraft without meticulous reading of reams of patch notes?

The in-game BuildCraft handbook? We're working on it. NEI? Eww.

But yeah, generally, the three main methods of finding out what's new is lurk the BC forums for new player builds (or IRC), read patch notes or watch LPs. We don't have other methods simply because we don't have the time or resources to make them in a reasonable timeframe.
 
  • Like
Reactions: Type1Ninja

Type1Ninja

New Member
Jul 29, 2019
1,393
-7
0
Then it must be something else. Try Graphics: Fast?



The in-game BuildCraft handbook? We're working on it. NEI? Eww.

But yeah, generally, the three main methods of finding out what's new is lurk the BC forums for new player builds (or IRC), read patch notes or watch LPs. We don't have other methods simply because we don't have the time or resources to make them in a reasonable timeframe.
You know, NEI IS pretty handy as a guide to BC. Even people with no knowledge of tech mods whatsoever wouldn't have trouble figuring out the pipes, at least once you'd shown them how to power a wooden pipe. Tooltips are a beautiful thing. :)
Man, you guys need to - like - get some kind of merchandise going. Make a kickstarter page to raise the funds to commission/print some BC t-shirts, then use the (hopefully large enough) sales money to sell more shirts. I know *I'd* buy an "I use cobble pipes" t-shirt. :p
Seriously, though, that would be awesome. :D
 

Renton Terrace

New Member
Jul 29, 2019
147
0
0
Storage Drawers have a Drawer Controller Block that interfaces with all connected Storage Drawers within 12 blocks and can be hooked up to one pipe connection for the whole group
 

b0bst3r

New Member
Jul 29, 2019
2,195
0
1
Load up opis and see what that says when it's lagging, is it actually lagging or just your FPS that takes a nosedive?
 

asiekierka

Over-Achiever
Mod Developer
Dec 24, 2013
555
1,086
213
Man, you guys need to - like - get some kind of merchandise going. Make a kickstarter page to raise the funds to commission/print some BC t-shirts, then use the (hopefully large enough) sales money to sell more shirts. I know *I'd* buy an "I use cobble pipes" t-shirt. :p
Seriously, though, that would be awesome. :D

T-Shirts are lame.
 

lenscas

Over-Achiever
Jul 31, 2013
2,015
1,801
248
Especially the "I use cobble stone pipes" thing as they can be very useful in combination with the stone ones as they don't connect unless you want to spam pipe plugs everywhere.(or don't build like me :p).
 

Type1Ninja

New Member
Jul 29, 2019
1,393
-7
0
T-Shirts are lame.
T-shirts are cool! They're good for showing to other people. I mean, when was the last time you *showed* someone a coffee mug? Stuff like that is kept at home, where you can use it. T-shirts are something I can show to people without actually needing to make an effort to bring them out and showcase them.
As for an actual phrase: I have no idea. The "I use cobble pipes" was just a crappy, off-the-top-of-my-head example. I'm not very good at t-shirt stuff. :p
Maybe a picture of a pump labeled "Pump It Up!" or a BC wrench labeled "Old School."
I may edit in more ideas as I think of them, but I can't guarantee they'll be good. ;)

Hmmm... I may start a thread asking if people would buy merchandise for mods, and if so, which mods and what witty phrases would be used.