Permanence
A robot that remembers objects, even when they disappear from view.
1st overall · NVIDIA · Hugging Face
Out of sight. Still in memory.
Permanence gives a rover a persistent 3D memory of its surroundings. The team combined an iPhone's camera and depth data with vision models on an NVIDIA Jetson Orin Nano to track objects through occlusion.
From perception to action
A language request identifies a target, while a tracker maintains its identity and position. The rover can use that remembered world state when the target is no longer visible to its camera.