Siddhant Haldar
haldarsiddhant.bsky.social
Siddhant Haldar
@haldarsiddhant.bsky.social
Excited about generalizing AI | PhD student @NYU
We have open-sourced the code. Try out Point Policy on your robots!

Project page: point-policy.github.io
Arxiv: arxiv.org/abs/2502.20391
Code:
Point Policy: Unifying Observations and Actions with Key Points for Robot Manipulation
Point Policy: Unifying Observations and Actions with Key Points for Robot Manipulation
point-policy.github.io
February 28, 2025 at 11:35 PM
Further, reasoning about key points instead of raw pixels allows Point Policy to generalize to novel object instances and exhibit robustness to heavy scene variations, all while requiring at most 30 demonstrations per task.
February 28, 2025 at 11:35 PM
Despite having no access to robot demonstrations, Point Policy exhibits an 88% success rate across 8 real-world tasks, a 75% improvement over baselines.
February 28, 2025 at 11:35 PM
Point Policy uses sparse key points to represent both human demonstrators and robots, bridging the morphology gap. The scene is encoded through semantically meaningful key points from minimal human annotations.
February 28, 2025 at 11:35 PM
All our code and task rollouts have been made public at: point-priors.github.io
Arxiv: arxiv.org/abs/2412.06784

Do try it out on your robots!
P3-PO: Prescriptive Point Priors for Visuo-Spatial Generalization of Robot Policies
Developing generalizable robot policies that can robustly handle varied environmental conditions and object instances remains a fundamental challenge in robot learning. While considerable efforts have...
arxiv.org
December 11, 2024 at 8:04 AM