You can play with the Franka Panda robot directly in your browser. It runs on Gemini Robotics Embodied Reasoning 1.5.
Currently, the functionality is basic - two actions: Detect (find objects) and Pickup (lift). You type "red cubes" - Gemini analyzes the 2D image, finds the red cubes, and calculates the coordinates for manipulation.
But according to the scientific work, this is just the beginning. Spatial reasoning for robotics in action, and the demo lets you play with it right now.
🔗 aistudio.google.com/apps/bundled/robotics_franka_pick_and_place
