MAJOR AI 3d performance improvement! 😈
Special thanks to https://github.com/Gilleece for releasing https://github.com/Gilleece/moonlight-android-xr a few days ago, by testing it and using it as a basis I was able to troubleshoot my own ai 3d pipeline which was actually very broken.
The AI 3D mode now has a very striking and immediate impact when using it. I would recommend using the "Auto" setting, as this will ensure that the 3d AI conversion always hits the FPS target at 72fps (at the expense of lowering resolution), but you do have manual options if you want to push the effect.
AI 3D Depth (MiDaS)
- Real occlusion-aware, joint-bilateral-upsampled depth warp (ported from Gilleece/moonlight-android-xr), replacing the old single-sample parallax shift
- Fixed a quantization bug in the depth model that was silently producing garbage depth data - this was the actual root cause of the weak/broken 3D effect
- New 3D Quality setting: Auto / Fastest / Fast / Standard - Auto automatically picks a tier from your stream resolution and passthrough state to hit the 72fps target
- Resolution/bitrate handling for the lower quality tiers fixed to be aspect-ratio-correct and not silently starve video quality
- Fixed AI 3D/SBS silently resetting to 2D after every stream restart
Also fixed
- Cursor floating/misaligned in AI 3D mode
- Resolution button sizing inconsistency in the settings UI