Combining next-token prediction and video diffusion in ... - MIT …
5 days ago · The result: a flexible, reliable sequence model that resulted in higher-quality artificial videos and more precise decision-making for robots and AI agents. By sorting through noisy data and reliably predicting the next steps in a task, Diffusion Forcing can aid a robot in ignoring visual distractions to complete manipulation tasks.
Robotics | MIT News | Massachusetts Institute of Technology
6 days ago · Combining next-token prediction and video diffusion in computer vision and robotics. A new method can train a neural network to sort corrupted data while anticipating next steps. It can make flexible plans for robots, generate high-quality video, and help AI agents navigate digital environments. October 16, 2024.
AI helps robots manipulate objects with their whole bodies
Aug 24, 2023 · A new AI technique enables a robot to develop complex plans for manipulating an object using its entire hand, not just fingertips. This model can generate effective plans in about a minute using a standard laptop.
A technique for more effective multipurpose robots - MIT News
Jun 3, 2024 · But robots trained this way, with a relatively small amount of task-specific data, are often unable to perform new tasks in unfamiliar environments. In an effort to train better multipurpose robots, MIT researchers developed a technique to combine multiple sources of data across domains, modalities, and tasks using a type of generative AI known ...
The new wave of robotic automation - MIT News
Jun 16, 2021 · Realtime Robotics has developed a combination of proprietary software and hardware that reduces system deployment time by 70 percent or more, reduces deployment costs by 30 percent or more, and reduces the programming component of building a robotic system in the industrial robot space by upwards of 90 percent. Image courtesy of Realtime Robotics.
Artificial intelligence | MIT News | Massachusetts Institute of …
6 days ago · Combining next-token prediction and video diffusion in computer vision and robotics. A new method can train a neural network to sort corrupted data while anticipating next steps. It can make flexible plans for robots, generate high-quality video, and help AI agents navigate digital environments. October 16, 2024.
Multiple AI models help robots execute complex plans more
Jan 8, 2024 · MIT's HiP system helps robots complete long-horizon goals using three foundation models: a large language model, a video diffusion model, and an egocentric action model. Iterative refinement improves the plan at each step …
A better way to control shape-shifting soft robots - MIT News
May 10, 2024 · A new machine-learning technique can train and control a reconfigurable soft robot that can dynamically change its shape to complete a task. The researchers, from MIT and elsewhere, also built a simulator that can evaluate control algorithms for …
New AI model could streamline operations in a robotic warehouse
Feb 27, 2024 · For instance, in a warehouse with 800 robots, decongesting a group of 40 robots requires holding the other 760 robots as constraints. Other approaches require reasoning about all 800 robots once per group in each iteration. Instead, the researchers’ approach only requires reasoning about the 800 robots once across all groups in each iteration.
A system for designing and training intelligent soft robots
Dec 7, 2021 · Scientists from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have designed “Evolution Gym,” a large-scale testing system for co-optimizing the design and control of soft robots, taking inspiration from nature and evolutionary processes.