Fortune is...a bit complicated. I'll just quote the relevant info from Minecraft Wiki:
So, for doubling, Fortune III would be reliable enough, but for anything beyond that, you'd likely be better off using silk touch, since you'll be guaranteed 3+ diamonds per ore, instead of having to rely...