From my experience, it seems Libertarians are seen as “conservatives with a twist” from both the left and right. Why?

Title. It’s so weird to me how people just see us this way. I hate being associated with conservatives. (Not saying that I would want to be associated with leftists) I think often times people forget that libertarianism is a political ideology distinct from the left and right, featuring a wide range of views none of which being “conservative.” We’re simply anti-authoritarian.