Quitting in this market: bad idea?

I'm a mid-level designer. Have always had imposter syndrome, but my current job sucks. My manager thinks I'm incompetent, leadership acts like I don't exist (they value ux but just not me personally). I've given up. I don't even trust myself at this point. My job is too stressful and everyone thinks I'm incapable. I have some savings but I don't want to give up a decent financial setup. I don't feel cut out for this.