How can I prevent my penis from “turtling” during exercise?

During exercise, or oftentimes just driving or moving around, my penis will sometimes recoil into the shaft skin. I’m circumcised so it’s not foreskin, it’s mostly just the shaft skin. I’ve seen another post in this subreddit where a lot people (mainly growers) have experienced this and acknowledged how it can be quite uncomfortable, but no one offered any tips to prevent it from happening.

NSFW edit: For those asking why it’s uncomfortable, when it’s in this “turtled” state, it’s quite short and stiffens because it’s so compressed and sticks straight out from my body rather than being a semi-short soft blob hanging to the side that can naturally move and flow with my legs.