First, the researchers fine-tuned stable Diffusion to let them overlay data from robot sensors onto images captured by its cameras. The system renders the desired action, like opening a box ...

They’ve developed a new system, called Genima, that fine-tunes the image-generating AI model Stable Diffusion to draw robots’ movements, helping guide them both in simulations and in the real ...

The robot’s name is Frida, and it’s a drawing robot. It’s one of the latest creations from CMU’s Robotics Institute. PhD student Peter Schaldenbrand has worked on Frida for four years.

The robot’s LED-adorned head hides a vision system based on a Livox Mid-360 lidar camera and an Intel RealSense D435 depth camera, allowing the G1 to see the world in 3D.