The Massachusetts Institute of Technology (MIT) has unveiled a pioneering method for training robots that leverages generative artificial intelligence (AI) models. This innovative approach, detailed in a recent announcement, focuses on integrating data from diverse domains and modalities, creating a shared language that large language models (LLMs) can process. The researchers assert that this technique can facilitate the development of general-purpose robots capable of performing a wide array of tasks without the need for extensive individual training for each skill.
The complexity of the current level of robotic intelligence lies in the need to train the robot with a lot of simulated and real-life datasets which could take a long time. The underlying issue is that during the training phases, the robot is made to learn how to perform a task in its environment and this may have scope for improvement when learning new tasks.
The consequence of such was that whenever a new task was given, a new range of datasets to cover every potential simulation and real environmental extremes had to be obtained. Repeated approximations of continuous actions are usually associated with the robot’s training period, corrected during this, incorrect actions deploying strategies. So far, the robots’ operations have been mostly reduced to devices designed for one function and have therefore never approached the multi-functional abilities of fiction machines.
Nonetheless, researchers from MIT offer a new technique that can help. In a report shared on the arXiv preprint server, the scientists described how generative AI facilitates robot training in a faster and more efficient manner. In their method, they combine information from multiple sources including, but not limited to simulated environments and real robots interacting, and multiple input types such as vision sensors and robotic arm position encoders. To assist in this unification, they also developed a new architecture which they termed Heterogeneous Pretrained Transformers (HPT).
According to Lirui Wang, the primary author of the paper and a graduate student of electrical engineering and computer science EECS, the basic idea behind this method was to use AI models available in the public domain such as GPT-4 by OpenAI. The introduction of an LLM model known as a transformer allowed the fellows in their setup to process two other inputs whatsoever: vision and proprioception, which is critical for a robot’s way of self-movement and self-location.
The new method proposed could have substantial implications. Results of the study suggest that the new method is quicker to deploy and cost-effective in training robots in comparison with traditional methods. The scientists noticed that in this technique, less data of a task-specific nature is needed, and as a result, such robots can be trained in more tasks efficiently. Additionally, the new technique met the expectations stated in earlier tests: it was proved to be more effective in simulations as well as in real conditions by 20% in regard to the traditional training approach.
This is a major advancement towards constructing advanced robots meant to be deployed in a multitude of functions and different conditions.
