Eureka! NVIDIA Research Breakthrough Puts New Spin on Robot Learning
- Thread starter bnew
- Start date
1/11
@watneyrobotics
FOLD! FOLD! FOLD!
An overnight timelapse of one of our live deployments teleoperated from over 7000 miles away. Our robots fold 24/7/365 with no human intervention, handling long-tail edge cases with no downtime.
https://video.twimg.com/ext_tw_video/1861138021095219204/pu/vid/avc1/1280x720/sLlF9tfyreiiETtr.mp4
2/11
@watneyrobotics
Teleoperation is hard. Teleoperation with high packet loss, variable latency, and constrained bandwidth is almost impossible. We built our system from the ground up (in Rust) to perform dynamic tasks with unprecedented dexterity in real world environments.
3/11
@watneyrobotics
We are extending our teleoperation infrastructure to enable remote inference for cloud-hosted robot foundation models. Robot policies that had to be invoked on edge can now be run from the cloud with no performance loss.
4/11
@watneyrobotics
We've also collected the world's largest dataset of cloth manipulation in a real world environment... Stay tuned!
5/11
@pranaysuyash
then what does tele operated mean if not human intervention? both of which in the post together don't make sense
6/11
@ziademarcus
which third world country do you use for slave labor to “teleoperate” these “without human intervention”
rust, btw
7/11
@Bunagayafrost
i think you're saying, it's being monitored by humans for safety and edge cases, but it handled folding autonomously without any intervention, right?
8/11
@MikeBravoCharly
How do they fold without a chin.
9/11
@MaxRovensky
> teleoperated
> with no human intervention
bruh
10/11
@NaturallyDragon
"teleoperated" "with no human intervention"
11/11
@sweepwhale
it's coming
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
@watneyrobotics
FOLD! FOLD! FOLD!
An overnight timelapse of one of our live deployments teleoperated from over 7000 miles away. Our robots fold 24/7/365 with no human intervention, handling long-tail edge cases with no downtime.
https://video.twimg.com/ext_tw_video/1861138021095219204/pu/vid/avc1/1280x720/sLlF9tfyreiiETtr.mp4
2/11
@watneyrobotics
Teleoperation is hard. Teleoperation with high packet loss, variable latency, and constrained bandwidth is almost impossible. We built our system from the ground up (in Rust) to perform dynamic tasks with unprecedented dexterity in real world environments.
3/11
@watneyrobotics
We are extending our teleoperation infrastructure to enable remote inference for cloud-hosted robot foundation models. Robot policies that had to be invoked on edge can now be run from the cloud with no performance loss.
4/11
@watneyrobotics
We've also collected the world's largest dataset of cloth manipulation in a real world environment... Stay tuned!
5/11
@pranaysuyash
then what does tele operated mean if not human intervention? both of which in the post together don't make sense
6/11
@ziademarcus
which third world country do you use for slave labor to “teleoperate” these “without human intervention”
rust, btw
7/11
@Bunagayafrost
i think you're saying, it's being monitored by humans for safety and edge cases, but it handled folding autonomously without any intervention, right?
8/11
@MikeBravoCharly
How do they fold without a chin.
9/11
@MaxRovensky
> teleoperated
> with no human intervention
bruh
10/11
@NaturallyDragon
"teleoperated" "with no human intervention"
11/11
@sweepwhale
it's coming
To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
