Using Zero Density Reality Engine™ with AW-UE150 for Virtual Studio applications

Update:

Zero Density have implemented the V-Log function into the latest release of Reality Engine (version 2.9), and increases the picture quality acquisition from Panasonic cameras including the UE150, UC4000 and VariCam LT. The above cameras have the ability to output V-Log, meaning that the video signal can be processed more natively within Zero Density Reality Engine, providing a better output in the keyer, and increases the overall quality in the virtual studio production.

Using Zero Density Reality Engine™ with AW-UE150 for Virtual Studio applications

The AW-UE150 is the first PTZ on the market to provide Position Data Notification (PTZF). Thanks to the adoption of the FreeD protocol, the AW-UE150 is compatible with Virtual Studios and Augmented Reality applications. Thanks to this feature, the AW-UE150 provides real-time positioning to the virtual reality engine™. The camera is then “tracked” and the FreeD data is sent over serial or IP links.

Lens node

The lens of the camera is already calibrated in the Zero Density system and simply needs to be selected in the Lens node. The camera can of course be used both in Full HD or 4K. In short, using the AW-UE150 in combination with Zero Density Reality Engine™ allows many more users to get access to the AR and VR world thanks to this powerful, high-quality and affordable solution.

Tracking node

Reality Engine™ from Zero Density is the ultimate real-time node-based compositor enabling real-time visual effects pipelines featuring video I/O, keying, compositing and rendering in one single software in real-time. As the most photo-realistic virtual studio production solution, Reality Engine™ provides its client the tools to create the most immersive content possible and revolutionize story-telling in broadcasting, media or cinema industry

Reality Nodegraph Pipeline

Reality Engine™ uses Unreal Engine by Epic Games, the most photo-realistic real-time game engine, as the 3D renderer. With the advanced real-time visual effects capabilities, Reality ensures the most photo-realistic composite output possible.

Reality Keyer™ provides spectacular results for keying of contact shadows, transparent objects and sub-pixel details like hair.

As a unique approach in the industry, Zero Density’s Reality Engine™ composites images by using 16 bit floating point arithmetics. Having the control of full compositing pipeline, all gamma and color space conversions are handled correctly. By using this technology, the real world and the virtual elements are blended perfectly.

Having the tracked camera feed as an input image, Reality Engine™ is able to render reflections and refractions of the real environment onto the virtual objects. Real-time 3D reflections and the shadows of the virtual objects are also composited over the incoming camera feed.