First, the researchers fine-tuned stable Diffusion to let them overlay data from robot sensors onto images captured by its cameras. The system renders the desired action, like opening a box ...

They’ve developed a new system, called Genima, that fine-tunes the image-generating AI model Stable Diffusion to draw robots’ movements, helping guide them both in simulations and in the real ...

The robot’s name is Frida, and it’s a drawing robot. It’s one of the latest creations from CMU’s Robotics Institute. PhD student Peter Schaldenbrand has worked on Frida for four years.