If you’re looking to process the RAW 5.7K 180º video footage of the Vuze XR without using the pretty buggy and no longer supported Vuze VR Studio software there’s a way to do it with ffmpeg. For now Vuze VR Studio still works on Mac (check out Vuze XR camera software download – on Apple Silicon you can actually relink the used ffmpeg for some speed gains), but both on Windows and Mac the software is prone to crashes.
Vuze VR Studio has a bit more processing options, such as placing an image over the middle section where normally your tripod would be and on the edges where you would be able to see a lens. There’s also color adjustment (which ffmpeg can do just fine as far as I know, it’s just harder to do) and lens alignment. Still, processing the video directly with ffmpeg is a lot more reliable and future proof.
Fish eye output
The following ffmpeg command will result in an mp4 file that can be played back but requires you to setting the VR player to fish eye mode.
ffmpeg -i input.mp4 -crf 17 -pix_fmt yuv420p -filter_complex "[v:1][v:0]hstack" -c:a copy output_fisheye.mp4
Speed it up on Apple Silicon
The following command is what I use on my Macs. This uses videotoolbox for hardware rendering and is really fast. It also converts the fish eye view. It uses the h265 encoder because of smaller files size, but you could change the encoder as well. I’ve found that setting the quality to 65 to 75 gives the best results (65 is good enough). Above that and the video’s no longer play on my Pico 4 VR headset.
ffmpeg -i input.mp4 -c:v hevc_videotoolbox -q:v 65 -pix_fmt yuv420p -filter_complex "[v:1][v:0]hstack[SBS];[SBS]v360=dfisheye:equirect:yaw=-90" output.mp4
Extracting left and right eye as lossless videos
If you plan on extracting the two video feeds (left and right eye) for more advanced processing ffmpeg can help out with that as well.
ffmpeg -i input.mp4 -map 0:1 -map 0:3 -c copy output-left.mp4
ffmpeg -i input.mp4 -map 0:0 -map 0:2 -c copy output-right.mp4