Ego-Pi: VLA Fine-Tuning for Ego-Centric Human and Robot Data

Ji Woong (Brian) Kim*, Ke Wang*, Sirui Chen, Zipeng Fu, Cong Gao, Jeff Lai, Chelsea Finn (* Equal contribution)

paper   website   code

Intro

Robotic manipulation is fundamentally limited by data scarcity. We leverage egocentric human data to improve learning for humanoid robots with dexterous hands, bridging the embodiment gap through visual guiding keypoints and a shared action representation. Our approach enables better generalization and the acquisition of new skills without additional robot data.

EgoPi framework
Figure 1. Overview of the EgoPi framework.

Video

EgoPi intro video.