NVIDIA Maxine is an AI-powered platform that offers developers pretrained models for deploying augmented reality, audio, and video quality features. It includes accelerated and optimized AI features for real-time inference on GPUs, resulting in low-latency audio, video, and AR effects with high network resilience. The platform provides a complete AI pipeline for video decode, transcode, encode, conversational AI, computer vision, video streaming, and analytics. Developers can integrate the Audio Effects SDK and Video Effects SDK into standalone Windows and Linux applications to process microphone and speaker audio or webcam input, respectively. The Augmented Reality SDK offers AI-powered, real-time 3D face tracking and body pose estimation based on a standard webcam feed.
NVIDIA Maxine Features
- Pretrained AI models: Offers pretrained models for augmented reality, audio and video quality features.
- Real-time AI performance: Includes accelerated and optimized AI features for low-latency audio, video, and AR effects with high network resilience.
- Complete AI pipeline: Offers video decode, transcode, encode, conversational AI, computer vision, video streaming, and analytics to complete your AI pipeline.
- Multi-cloud, customizable deployment: Allows for flexible, fast deployment and updates with cloud-native microservices.
- Audio Effects SDK: Delivers multi-effect, low-latency audio quality enhancement algorithms for processing microphone and speaker audio, with features such as Audio Super Resolution, Acoustic Echo Cancellation, Noise Removal, Room Echo Removal, and Speaker Focus.
- Video Effects SDK: Enables AI-based visual effects with features such as Virtual Background, Super Resolution, Upscaler, Artifact Reduction, and Video Noise Removal.
- Augmented Reality SDK: Offers AI-powered, real-time 3D face tracking and body pose estimation based on a standard webcam feed, with features such as Face Expression Estimation, Eye Contact, Face Tracking, Face Landmark Tracking, Face Mesh, and Body Pose Estimation.
