China’s 4DV AI Launches 4D Gaussian Splatting With Sound, Camera Angle Control, and Apple Vision Pro Support

Chinese AI company 4DV AI has introduced a new technology called 4D Gaussian Splatting that transforms traditional 2D videos into immersive 4D environments with sound. This innovation allows users to manipulate the video perspective by changing camera angles, zooming in and out, and shifting viewpoints in real time, similar to navigating a 3D game engine. The technology represents scenes by decomposing them into clouds of 3D Gaussian splats, enabling a free viewpoint experience. Demonstrations have shown this capability on devices such as the Apple Vision Pro, highlighting its potential applications in entertainment, including watching shows and concerts from multiple angles in virtual spaces like the Metaverse. The development marks a notable advancement in video and AI technology, offering a new way to interact with visual content.