Anyone else bad with iron sights?

I play KB&M and I’m fairly good. But god I can not use iron sights on any gun. Even if it looks clean with little blocking your pov it’s just hard to keep track of when in a gun fight. I’m not sure if it’s the visual recoil but my accuracy triples with a red dot. Sucks because it takes an attachment