
Eric Jang discusses the challenges of evaluating humanoid AI before home deployment. Unlike self-driving models that can be tested on public roads with QA drivers or user trips, robots in private settings require a different approach. A 'World model' is needed to simulate robot actions. 1X's World Model acts as a virtual simulator, predicting how robots will interact with their environment, simulating a range of tasks and complex object interactions without manual setup. This approach involves learning a simulator directly from raw sensor data to evaluate policies across millions of scenarios. The generative interactive simulation by 1X addresses the issue of policy network degradation over time due to subtle environmental changes, providing a scalable solution for reproducible evaluations in multi-agent settings. Multi-day evaluations in customer homes are impractical to confirm model reliability and safety for hundreds of tasks.