Robot Perception and Control

Foundation Models for Robotics

Last updated: Jul / 25 /2024
Kashu Yamazaki
kyamazak@andrew.cmu.edu

Datasets

BridgeData V2 arxiv page

Kashu Yamazaki, 2024

Open X-Embodiment

#center

A large-scale collection of datasets from 22 different robots collected through a collaboration between 21 institutions, demonstrating 527 skills (160266 tasks). The dataset follows the RLDS format.

Kashu Yamazaki, 2024

DROID

DROID uses the same hardware setup using Panda robot across all 13 institutions to streamline data collection while maximizing portability and flexibility.

Kashu Yamazaki, 2024

Models

RT1

Kashu Yamazaki, 2024

RT2

Kashu Yamazaki, 2024

RT-X

Kashu Yamazaki, 2024

Octo arxiv

#center

Kashu Yamazaki, 2024

OpenVLA arxiv

#center

Kashu Yamazaki, 2024