Maybe, maybe not. Having a renewable source of odd things (prismarine for building blocks, redstone, glowstone, etc) can be as useful in late game, if not more than early. Again, if you have other methods to obtain them, it might not have the same appeal.
For oh so long, the answer to, "How...