Motion Capture to Action: Contact-Aware Teleoperation for Robot Demonstrations (Mocap2Act)
PI: Uddhav BhattaraiĀ
Mocap2Act is a collaboration with Microsoft to deploy their Rho-alpha vision-language-action model on PNNL's Trossen robotic platforms, generating operational data to assist with further model training. The project focuses on building agentic workflows that drive the robotic system to perform meaningful tasks, contributing training data back to improve the model's capabilities.