Has living off Disability affected your dating life?

I'm rated 100% and single but I've had a few women cancel dates on me in the past after telling them that VA benefits were my primary source of income and occasionally take up a part time job after they ask what I do for work. It's like I immediately get put into unemployed, lazy, or food stamp territory, despite the fact that I have my own place in a nice part of town and my own car. I'm also working on a business on the side, but that doesn't seem to matter to them unless I've provided concrete results.