Bug FTB Infinity Evolvoled Framerate issues

[Single Core]

Pc Specs:

• I7 4770k
• AMD R9 Fury
• 16GB Ram

Problem:

• Extremely low framerate on every 1.7.10 ftb modpack.

Clean install of the modpack provides me with 20 - 25 fps. When I install optifine the framerate drops to 2 - 4 fps.

Solutions I've tried so far:

• Reinstalled my GPU driver.
• Delete every java version and installed the lastest.
• Changed the java GC when running the modpack.
• Yes, I am using 64bit java.
• Tried different modpacks
• Vanilla Minecraft 1.10.2 and 1.7.10 provides 400+ fps. Which functions perfectly fine.
• Variable amounts of ram, 4, 8, 12 ... Nothing changes.

My hopes:

• Could someone provide me with a solution?

Note: All modpacks from 1.6.4(Tested out FTBMonster) AND lower work perfectly fine! The main issue seems to be located around 1.7.10 modpacks.

Doublenote: When I press ESC. My fps counter(F3) increases to 150 - 160 fps instantly, when playing the game it drops back to 20 - 25 fps.

GPU usage seems to be jumping from 1 to 99% usage constantly. When I am in the ESC pause menu the usage stablizes around 20 - 30% usage.