Teams Rooms with glass walls

Glass walls are a popular choice for meeting and conference rooms. I am surprised how little talk there is about this problem. AI tracking (Speaker/Group/Presenter focus) will identify folks outside of the room.

Our cameras constantly find folks walking by the glass walls and think they are a participant in the meeting. Even in smaller office spaces, it even finds folks sitting nearby, but NOT IN THE ROOM!, and pans to them. It's a complaint I don't know how to deal with.

How have you been able to circumvent this problem? Of course, tracking is not something they are willing to sacrifice either.