Try client side only first. When you're choosing a modpack to launch, there's a button near the top that says "Edit modpack". Just go there, find Journeymap and click "Disable"
E: I'm not sure if Journeymap nowadays requires both client and serverside, and if it does, disable it temporarily...