Natura-1 benchmark results

Natura-1 is evaluated on dexterous hands. GPT-6-Astra and π0.5 tested on the same robotic platform produced no measurable score, so their results on the ARX AC One dual-arm gripper platform are shown alongside.

Overall score

Percent, grouped by the robotic platform each model ran on

Dexterous hands
Gripper
59.1%
53.4%
No result
No result

Tested on dexterous hands, but no measurable score

16.7%
13.5%
Natura-1
Agentic
Natura-1
Base
GPT-6-Astraπ0.5
GPT-6-Astraπ0.5

Average execution time

Seconds on one linear scale, fastest first. Further left is better

Natura-1 Base dexterous hands63.16 s

43.3× faster than GPT-6-Astra, 4.6× faster than π0.5

Natura-1 Agentic dexterous hands139.31 s

19.6× faster than GPT-6-Astra, 2.1× faster than π0.5

π0.5 grippers289.11 s
GPT-6-Astra grippers2,734.56 s

Scores by dimension

Natura-1 Agentic has the highest score, or ties for it, in all 12 dimensions. Each block lists the six rows in the order of the key. “No result” means the model was tested on that hardware but produced no measurable score.

Dexterous handsNatura-1 AgenticNatura-1 BaseGPT-6-Astraπ0.5
GripperGPT-6-Astraπ0.5
Dexterous control

Control contact, coordinate both hands, and use tools.

Pose control & Contact
Natura-1 Agentic, dexterous hands: 63.2%
Natura-1 Base, dexterous hands: 56.9%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 14.4%
π0.5, ARX AC One dual-arm gripper platform: 8.6%
Bimanual coordination
Natura-1 Agentic, dexterous hands: 61.5%
Natura-1 Base, dexterous hands: 50.0%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 0.0%
π0.5, ARX AC One dual-arm gripper platform: 0.0%
In-hand manipulation
Natura-1 Agentic, dexterous hands: 16.7%
Natura-1 Base, dexterous hands: 16.7%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: Not scored
π0.5, ARX AC One dual-arm gripper platform: Not scored
Tool use
Natura-1 Agentic, dexterous hands: 66.7%
Natura-1 Base, dexterous hands: 57.3%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 10.8%
π0.5, ARX AC One dual-arm gripper platform: 0.0%
Instruction following

Preserve intent across changes in scenes, objects, and actions.

Goal-directed reasoning
Natura-1 Agentic, dexterous hands: 35.4%
Natura-1 Base, dexterous hands: 32.8%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 15.5%
π0.5, ARX AC One dual-arm gripper platform: 10.4%
Spatial & scene generalization
Natura-1 Agentic, dexterous hands: 100.0%
Natura-1 Base, dexterous hands: 90.9%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 39.3%
π0.5, ARX AC One dual-arm gripper platform: 20.6%
Tool & object generalization
Natura-1 Agentic, dexterous hands: 100.0%
Natura-1 Base, dexterous hands: 100.0%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 40.8%
π0.5, ARX AC One dual-arm gripper platform: 10.6%
New-action generalization
Natura-1 Agentic, dexterous hands: 64.3%
Natura-1 Base, dexterous hands: 29.4%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 13.8%
π0.5, ARX AC One dual-arm gripper platform: 7.8%
Compositional generalization
Natura-1 Agentic, dexterous hands: 77.8%
Natura-1 Base, dexterous hands: 73.7%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 65.1%
π0.5, ARX AC One dual-arm gripper platform: 36.2%
Long-horizon execution

Organize actions, retain progress, and retry after failure.

Planning
Natura-1 Agentic, dexterous hands: 55.6%
Natura-1 Base, dexterous hands: 38.5%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 20.6%
π0.5, ARX AC One dual-arm gripper platform: 25.0%
Memory
Natura-1 Agentic, dexterous hands: 70.0%
Natura-1 Base, dexterous hands: 57.7%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 37.5%
π0.5, ARX AC One dual-arm gripper platform: 10.9%
Recovery
Natura-1 Agentic, dexterous hands: 83.3%
Natura-1 Base, dexterous hands: 68.6%
GPT-6-Astra, dexterous hands: No result
π0.5, dexterous hands: No result
GPT-6-Astra, ARX AC One dual-arm gripper platform: 75.0%
π0.5, ARX AC One dual-arm gripper platform: 44.6%