Sponsored By

Owlchemy Labs is changing the way viewers watch VR gameplay

The developer behind Job Simulator is working on a new way to place VR users seamlessly into virtual environments without the need for external editing software.

Alissa McAloon, Publisher

October 3, 2016

2 Min Read

Job Simulator and Rick and Morty Simulator: Virtual Rick-ality developer Owlchemy Labs is working on a way to fuse VR gameplay and green screen footage in-engine and without the need for any video editing. Known as depth-based realtime in-app mixed reality compositing, the process uses a stereo depth camera, custom shader, custom plugin, and green screen to place users directly and seamlessly into a VR environment. 

Typically, watching someone play a VR game is a strange and jittery second hand experience. Viewers either experience the game through a shaky first-person perspective or watch someone else experience VR against a flat, and clearly green screened environment. Technology like this in-engine mixed reality process aims to change that and show potential users a smoother and more immersive side of virtual reality. 

Owlchemy Labs’ mixed reality tech is able to sense depth and show users moving throughout the environment naturally.  Anyone viewing the footage sees the VR player moving behind and under objects in real time, without the need for any external programs or editing. 

The process uses a stereo depth camera to record video and depth data of a user against a green screen. The data is then sent through a custom Unity plugin and shader, which produces the in-engine footage of the user in the game environment. 

Owlchemy Labs notes that using the technology with its game Job Simulator was a particularly difficult application. “Essentially, Job Simulator is the worst case scenario for mixed reality, as we can’t get away with simple foreground / background sorting where the player is essentially static and all the action happens in front of them (a la Space Pirate Trainer). If a solution can work for Job Simulator, it can likely be a universal solution for all content.”

It isn’t quite ready to make its way out into the wild yet, but Owlchemy Labs is still in the process of developing their take on mixed reality and has plans to share some of the technology in the future. 

About the Author(s)

Alissa McAloon

Publisher, GameDeveloper.com

As the Publisher of Game Developer, Alissa McAloon brings a decade of experience in the video game industry and media. When not working in the world of B2B game journalism, Alissa enjoys spending her time in the worlds of immersive sandbox games or dabbling in the occasional TTRPG.

Daily news, dev blogs, and stories from Game Developer straight to your inbox

You May Also Like