i think the reason you cant build it is to encourage exploration and rarity, however on that note, I think a great compromise would have a controller block that the portal needs to function, much like the blueprints, to be gotten as a drop then you can use that to craft where needed.