Can a second user interfere with the panel interaction?

Yes, a second user can put his hand over a panel and interfere with the interaction of a first legitimate user. This does not require the interfering user to wear any glasses. However, the interfering user will not see the UI shown to the legitimate user and his interference is thus limited.