My doctor said something that deeply upset me

When screening me for mental illnesses a few months ago, I told them about my home situation and how things were very rough with experiencing verbal abuse for over a decade.

They said "don't you think you are causing that by still living at home in your 20s and not amounting to much?". I felt very hurt from that because i don't know any of my friends who do live away from home unless it's for university temporarily. I did live away for some months for school, and this verbal abuse has gone on no matter how successful I am in school. My sister and I were straight A students and still got yelled at/belittled nearly every night from children to now.

It's made me never want to go back, and it's bad because I'm having problems with using the bathroom and I broke my toe but I am still avoiding the doctor. I need to call someone and see if I can see another one :(