NVIDIA is making VR more immersive, and VR development easier with the new VR audio and 360-degree video stitching as part of the VRWorks software development kit (SDK).
Released at the GPU Technology Conference, the VRWorks Audio SDK provides real-time ray tracing of audio in virtual environments, and is supported in Epic’s Unreal Engine 4.
Traditional VR audio provides an accurate 3D position of the audio source within a virtual environment. However, sound in the real world reflects more than just the location of the source — it is also a function of the dimensions and material properties of the physical environment, explains NVIDIA in a blog post.
NVIDIA VRWorks Audio helps create a truly immersive environment by modelling sound propagation phenomena, such as reflection, refraction and diffraction. Using NVIDIA OptiX ray-tracing technology, VRWorks Audio traces the path of sound in real time, delivering physically accurate audio that reflects the size, shape and material properties of the virtual environment.
According to the NVIDIA blog post, the solution is the only hardware-accelerated and path-traced audio solution that creates a complete acoustic image of the environment in real time without requiring any “pre-baked” knowledge of the scene. As the scene is loaded by the application, the acoustic model is built and updated on the fly. Audio effect filters are generated and applied on the sound source waveforms.
The software release consists of a set of C-APIs for integration into any engine or application, and an integration for Epic’s Unreal Engine 4 that is available on GitHub.
At GTC, NVIDIA is also releasing the first public beta of the VRWorks 360 Video SDK, which addresses the challenge of real-time video stitching through enabling real-time 4K 360 video capture, stitching and streaming.
Two Quadro P6000 GPUs enables the SDK to stitch eight 4K cameras in stereo with Z CAM’s V1 PRO VR camera system in a demonstration at the event.
“The fact that NVIDIA manages to stitch 4K 360 stereoscopic video in real time, making livestreaming possible, changes the production pipeline and enables entirely new use cases in VR,” said Kinson Loo, CEO of Z CAM.
Interested?
The NVIDIA VRWorks 360 Video and Audio SDKs are available for all developers to download from developer.nvidia.com/vr. The VRWorks 360 Video SDK for mono is available now as a public beta, with the stereo support to be released soon.
Hashtag: #GTC17
Released at the GPU Technology Conference, the VRWorks Audio SDK provides real-time ray tracing of audio in virtual environments, and is supported in Epic’s Unreal Engine 4.
Traditional VR audio provides an accurate 3D position of the audio source within a virtual environment. However, sound in the real world reflects more than just the location of the source — it is also a function of the dimensions and material properties of the physical environment, explains NVIDIA in a blog post.
NVIDIA VRWorks Audio helps create a truly immersive environment by modelling sound propagation phenomena, such as reflection, refraction and diffraction. Using NVIDIA OptiX ray-tracing technology, VRWorks Audio traces the path of sound in real time, delivering physically accurate audio that reflects the size, shape and material properties of the virtual environment.
According to the NVIDIA blog post, the solution is the only hardware-accelerated and path-traced audio solution that creates a complete acoustic image of the environment in real time without requiring any “pre-baked” knowledge of the scene. As the scene is loaded by the application, the acoustic model is built and updated on the fly. Audio effect filters are generated and applied on the sound source waveforms.
The software release consists of a set of C-APIs for integration into any engine or application, and an integration for Epic’s Unreal Engine 4 that is available on GitHub.
At GTC, NVIDIA is also releasing the first public beta of the VRWorks 360 Video SDK, which addresses the challenge of real-time video stitching through enabling real-time 4K 360 video capture, stitching and streaming.
Two Quadro P6000 GPUs enables the SDK to stitch eight 4K cameras in stereo with Z CAM’s V1 PRO VR camera system in a demonstration at the event.
“The fact that NVIDIA manages to stitch 4K 360 stereoscopic video in real time, making livestreaming possible, changes the production pipeline and enables entirely new use cases in VR,” said Kinson Loo, CEO of Z CAM.
Interested?
The NVIDIA VRWorks 360 Video and Audio SDKs are available for all developers to download from developer.nvidia.com/vr. The VRWorks 360 Video SDK for mono is available now as a public beta, with the stereo support to be released soon.
Hashtag: #GTC17
posted from Bloggeroid
No comments:
Post a Comment