I think the root issue is your first two words: “Apple wants”. I have and use mostly Apple devices but I will say that often when I’m feeling friction it’s because of a difference between what Apple wants and what I want and them having set things up so I don’t have a choice.

This feels like one of those things. Apple wants AV to be something in particular but because XR offers so many possibilities I fear their limits are going to feel extra limiting.