Enabling Stereoscopic and 3D Views Using MV-HEVC in NVIDIA Video Codec SDK 13.0
NVIDIA announces the implementation of Multi-View High Efficiency Video Coding (MV-HEVC) encoder in the latest NVIDIA Video Codec SDK release, version 13.0. This significant update marks a major leap forward in hardware-accelerated, multi-view video compression. It offers enhanced compression efficiency and quality for stereoscopic and 3D video applications as compared to simulcast encoding.
Understanding MV-HEVC
MV-HEVC is an extension of the High Efficiency Video Coding (HEVC) standard, designed to efficiently compress multiple video views of the same scene captured from different vantage points. It addresses the limitations of traditional video-coding methods such as simulcast encoding, which often resulted in high bitrates for multi-view content and lacked efficient inter-view prediction.
Figure 1. MV-HEVC for 3D content
Key features in NVIDIA Video Codec SDK 13.0 MV-HEVC
The MV-HEVC implementation in the Video Codek SDK 13.0 includes the following features:
Support for two views
8-bit and 10-bit 4:2:0 color sampling
Lookahead functionality
Delta-QP support
Separate bitrate allocation for secondary views
These features provide you with flexible options for encoding multi-view content while maintaining high quality and efficiency.
Technical implementation
The MV-HEVC implementation uses advanced techniques to achieve superior compression:
Inter-view prediction
: Reuses data from different views for maximum compression.
Coding tools
: Employs motion-compensated prediction and disparity estimation.
Scalability
: Implements a base layer for backward compatibility and enhancement layers for improved quality.
Bitrate allocation
: Implements separate allocation for secondary views, allowing application developers to experiment and fine-tune quality.
For more information about implementation, see the
NVIDIA Video Codec SDK documentation
.
Quality gains
The addition of MV-HEVC support has resulted in significant quality improvements, with bitrate savings of up to 27% as compared to simulcast encoding of two views.
Figure 2. Shark 1920×1088 600 frames (Camera 1 and Camera 5) 30fps Preset P7
Figure 3 shows the VMAF bit rate savings for the same clip.
Figure 3. Shark 1920×1088 600 frames (Camera 1 and Camera 5) 30fps Preset P7
Real-world applications
MV-HEVC is particularly useful for the following applications:
3D movies
: Enhancing the viewing experience with efficient bit distribution between left– and right-eye views.
AR/VR
: Creating immersive environments with reduced data requirements.
Spatial video
: Supporting new technologies for capturing and viewing immersive 3D videos using advanced smartphones and specialized headsets.
Auto:
Process and compress multi-camera views for tasks such as objection detection and tracking.
The \Samples\AppEncode\AppEncCuda sample application  in the
Video Codec SDK
now supports MV-HEVC encoding, providing you with a powerful tool for implementing multi-view video compression. For more information about implementation details for MV-HEVC support in AppEncCuda, see the
NVIDIA Video Codec SDK documentation
.
Backward compatibility
The NVIDIA implementation ensures backward compatibility, supporting two views with identical GOP structures for efficient random access and seeking. This approach lays the foundation for future expansion, as it can be readily adapted to accommodate more views in more complex multi-view applications. By maintaining consistent GOP structures across both views, we optimize synchronization and facilitate seamless navigation within the video content.
Conclusion
The addition of MV-HEVC support in NVIDIA VIDEO CODEC SDK 13.0 marks a significant milestone in multi-view video coding capabilities. With impressive BD-Rate gains and no performance overhead, this update provides you with a powerful tool for creating high-quality stereoscopic and 3D video experiences.
We encourage you to explore this new feature and integrate MV-HEVC encoding into your applications to take advantage of the improved compression efficiency and quality.
在 NVIDIA 视频编解码器 SDK 13.0 中使用 MV-HEVC 启用立体和 3D 视图
NVIDIA 宣布在最新的 NVIDIA 视频编解码器 SDK 版本 13.0 中实施多视图高效视频编码 (MV-HEVC) 编码器。这一重要更新标志着硬件加速的多视图视频压缩技术实现了重大飞跃。与 simulcast 编码相比，它为立体和 3D 视频应用提供了更高的压缩效率和质量。
了解 MV-HEVC
MV-HEVC 是高效视频编码 (HEVC) 标准的扩展，旨在高效压缩从不同有利位置拍摄的同一场景的多个视频视图。它解决了传统视频编码方法 (如 simulcast 编码) 的局限性，这些方法通常会导致多视图内容的高比特率，并且缺乏高效的视图间预测。
图 1、适用于 3D 内容的 MV-HEVC
NVIDIA 视频编解码器 SDK 13.0 MV-HEVC 的主要特性
Video Codek SDK 13.0 中的 MV-HEVC 实现包括以下功能：
支持两种视图
8 位和 10 位 4:2:0 颜色采样
前瞻性功能
Delta-QP 支持
为辅助视图单独分配比特率
这些功能为您提供灵活的多视图内容编码选项，同时保持高质量和高效率。
技术实施
MV-HEVC 实现使用高级技术实现出色的压缩：
视图间预测：
重复使用来自不同视图的数据，以实现最大压缩。
编码工具：
采用运动补偿预测和差异估计。
可扩展性
：实现用于向后兼容性的基础层，以及用于提高质量的增强层。
比特率分配：
实现对辅助视图的单独分配，允许应用程序开发者实验和微调质量。
有关实施的更多信息，请参阅
NVIDIA Video Codec SDK 文档
。
质量提升
添加的 MV-HEVC 支持显著提高了质量，与两个视图的同步广播编码相比，可节省高达 27% 的比特率。
图 2、Shark 1920 × 1088 600 帧 (Camera 1 和 Camera 5) 30fps 预设 P7
图 3 显示了同一片段节省的 VMAF 比特率。
图 3、Shark 1920 × 1088 600 帧 (Camera 1 和 Camera 5) 30fps 预设 P7
真实应用
MV-HEVC 尤其适用于以下应用：
3D 电影
：通过在左眼和右眼视图之间进行高效位分布来增强观看体验。
AR/VR：创建具有更低数据要求的沉浸式环境。
空间视频：支持使用先进的智能手机和专用头显设备捕捉和观看沉浸式 3D 视频的新技术。
自动：处理和压缩多摄像头视图，以执行物体检测和追踪等任务。
Video Codec SDK
中的 Samples\AppEncode\AppEncCuda 示例应用现在支持 MV-HEVC 编码，为您提供用于实现多视图视频压缩的强大工具。如需详细了解 AppEncCuda 中 MV-HEVC 支持的实现详情，请参阅
NVIDIA Video Codec SDK 文档
。
向后兼容性
NVIDIA 实施可确保向后兼容性，支持具有相同 GOP 结构的两个视图，以实现高效的随机访问和查找。这种方法为未来的扩展奠定了基础，因为它可以轻松进行调整，以在更复杂的多视图应用中适应更多视图。通过在两个视图中保持一致的 GOP 结构，我们优化了同步，并促进了视频内容内的无缝导航。
结束语
NVIDIA VIDEO CODEC SDK 13.0 中新增的 MV-HEVC 支持标志着多视图视频编码功能的重要里程碑。带来了令人惊叹的 BD-Rate 获益且无性能开销，为您提供了一款用于创建高质量立体和 3D 视频体验的强大工具。
我们建议您探索这项新功能，并将 MV-HEVC 编码集成到您的应用中，以利用改进后的压缩效率和质量。