Every task, every embodiment all at once.
Technology
In our previous blogs we announced our mission of brining physical AI to existing assets in production built with copper-rs, an open-source Physical AI OS. In this blog we share our embodiment agnostic hardware design philosophy central to Spatial Intelligence Kit (SIK), that made this mission possible.
But first: Why does SIK exist at all ?
Tens of millions of machines are already in production and deployed across a vast swath of industry verticals, but there is one problem. They lack intelligence. They can’t sense, think and act autonomously. These assets need a human operator, f.ex pallet jacks, forklifts, wheel loaders, street cleaning vehicles, class B vehicles and port terminal trucks.
Our first thought: Let’s just add intelligence.
On a closer look, a hard requirement surfaced: We need an embodiment agnostic hardware that serves as both as a data collection and inference silicon, in the field, in diverse conditions, in power constrained environments and limited connectivity.
This lead us down the path of crafting a field tested Spatial Intelligence Kit (SIK). SIK is already deployed on 100 assets in 30 locations. Streaming multimodal data from the target environment continuously, with over 810,000 hours of operational uptime.
Spatial Intelligence Kit can be paired with any physical assets in couple of hours, after which the asset can be operated normally in the field.
When the asset is operated nominally by operators or drivers, SIK captures rich multimodal data, in the field and specially in the target environment where they will be deployed as autonomous workers. The multi-cam setup captures rich visual data, high precision GNSS captures positioning and it reads actuation data through our custom wire-harness connected to all the CAN interface(s) and control interfaces.
SIK logs the actuation data from asset during the operations, these are the operator’s input on the physical asset, f.ex throttle, steering, vertical fork position, excavator arm movement. In the background our spatial intelligence learns the task from the multimodal data. F.ex moving pallets, digging in quarries, cleaning streets and driving passengers. It pings the operator when its ready to be part of the fleet as an autonomous worker.
Every task, every embodiment, all at once.