How to get rid of permanent mining fatigue?

Me and my friend started a Minecraft game based on dawncraft and added a few other mods like blood magic and other magic mods. But after we died a few times we got permanent mining fatigue that gets worse each death to a maximum of 4. Milk doesn’t get rid of it and won’t even go away when we try to cheat remove it. Any help or experience on the matter would be appreciated.