Aibase logo

RT-Trajectory

Robot task generalization based on trajectory sketches

CommonProductImageRoboticsTask Generalization
RT-Trajectory is a robot control strategy based on rough trajectory sketches, enabling effective generalization to new tasks through trajectory sketches. It can generate trajectory sketches through manual drawing, video demonstrations, or image generation models. RT-Trajectory has been widely evaluated in various real-world robotics tasks and demonstrates broader task execution capabilities compared to language- and goal-based strategies.
RT-Trajectory
Visit

RT-Trajectory Visit Over Time

Monthly Visits

1474

Bounce Rate

66.19%

Page per Visit

1.0

Visit Duration

00:00:00

RT-Trajectory Visit Trend

RT-Trajectory Visit Geography

RT-Trajectory Traffic Sources

RT-Trajectory Alternatives

Universal Manipulation Interface

Universal Manipulation Interface — The Universal Manipulation Interface (UMI) is a data collection and strategy learning framework that enables the direct transfer of skills from human demonstrations on-site to deployable robot strategies. UMI combines handheld grips with meticulous interface design to achieve portable, low-cost, and informative data collection for challenging two-handed and dynamic operation demonstrations. To promote deployable strategy learning, UMI incorporates well-designed strategy interfaces with real-time delay matching and relative trajectory action representation. As a result, the learning strategies are hardware-agnostic and deployable on multiple robot platforms. With these features, the UMI framework unlocks new robot manipulation capabilities, allowing for generalized dynamic, two-handed, precise, and long-duration behaviors, achievable with zero adjustments. We have demonstrated the versatility and effectiveness of UMI through comprehensive real-world experiments, where strategies trained with various human demonstrations achieved zero-shot generalization in new environments and with new objects.

Others•Education•Robotics
1152