To answer the original question, you can use Pam's Fish Trap. Just set it in a pool of water, add fish bait and wait a couple Minecraft days. Yes, it collect lots of Pam's fish, but as you discovered, those can be freely converted to normal vanilla fish (which makes them easier to stack and...