Recent advancements in robotics and artificial intelligence have significantly improved robot dexterity and manipulation skills. Combining existing sensors with machine learning algorithms enhances robots' intrinsic sense of touch. Google DeepMind introduced DemoStart, an auto-curriculum reinforcement learning method for multi-fingered manipulation using sparse rewards in simulation. This method achieved a 98% success rate with 100 times fewer demonstrations and enabled zero-shot sim2real transfer from raw pixels and proprioception. Additionally, the PALO approach, which learns new robot manipulation skills from as few as five demonstrations, utilizes a VLM (GPT-4o) to search for the best of several semantically-equivalent language subtask decompositions for the given demonstrations. These innovations highlight the potential for robots to perform complex tasks that require dextrous movement.
Google DeepMind unveils new AI systems that advance robot dexterity, enabling machines to perform complex tasks that require dextrous movement https://t.co/U6405I2wHS
1/ Our PALO approach learns new robot manipulation skills from as few as five demonstrations! The key insight is that we can use a VLM (GPT-4o) to search for the best of several semantically-equivalent language subtask decompositions for the given demonstrations. #corl2024 https://t.co/26rqe27pVL
Google DeepMind introduced DemoStart, an auto-curriculum RL method for multi-fingered manipulation using sparse rewards in simulation, achieving 98% success with 100× fewer demos and enabling zero-shot sim2real transfer from raw pixels & proprioception. https://t.co/ijVLGX0vcg https://t.co/qnWAZfcRlZ