How do I get over insecurity about being seen as gay / feeling like everybody is homophobic

Let me clarify that I’m not insecure about being bi. In the company of people who I trust, people who are also gay/bi, or both, I have no issues with sharing my feelings, being or expressing myself in a gay-coded way, or discussing parts of my life that involve me being gay. I don’t code switch necessarily (being gay already weighs very little on how I express myself), but outside of that group of people, I’m really insecure about being seen as or suspected as being not straight.

The truth is I don’t really trust anybody who isn’t actually gay/bi, or someone I’m not already close with, of not being homophobic to some extent, and having that form assumptions about me or shape a more negative image of me than otherwise.

If someone was overtly homophobic and made it a point to make that known I’d be less hurt or upset by that, but if people knowing I’ve been with or like guys is the difference between being closer friends or a relationship going further without it ever being said, just the possibility of that happening is extremely upsetting.

It’s probably irrational to assume this could be something weighing in the background as pervasively, or to assume that everyone is homophobic somewhere on a scale between 0% and 100%, but I feel like it’s the feeling I operate on, and it’s made me being not straight extremely privileged information. I don’t consciously try to dress, sound, or look straight, but things that would point towards the contrary that might pop up I typically avoid.

I know this is probably some form of social anxiety run rampant, but I wish I knew how to make whatever this is stop so I could live a little less on guard over what people think.