Sounds like you want ‘magic window’ or to use the device orientation to move the camera.
Another forum user has tried this in this thread Updating WebVR to WebXR: Magic Window (Single View VR)
But I think it’s missing the permission request for the sensor data.