Soft vs. distance balls?

Next spring will be my 3rd season. I've been using "soft" balls as much as possible, thinking I need all the help I can get with accuracy, and who cares if my drive only goes 50 yards instead of the jaw-dropping 75 a "distance" ball would get me. How much difference is there really? If I switched to all "distance" balls would I see a lot more yardage, and a lot more trips into the woods?