On very light trails that are mostly just loose dirt and small rocks how frowned upon would it be if I safely were to do some light “rally” driving?

To clarify I would only push my car if I KNEW there was nobody ahead or close behind, and if there wasn’t an established speed limit, but if just a little pushing my car is frowned upon then I wouldn’t.

I really just need a dirt road to drive a little aggressively (but controlled) on in SoCal