The Data Layer for Physical AI

The data primitives to build, understand, and improve your data loop. Designed for multi-rate, multimodal data, from the first recording to massive scale.

Visualize everything

Review datasets, debug detail-level issues, and extend with your own views and tools for every stage of the pipeline.

Query and transform

Full dataframe or SQL queries over any robotics data. Extend with post-processing or annotations as easily as adding columns to a table.

Log, store, and convert

Store multi-rate, multimodal data as column-chunks in rrd files. Either log directly or easily convert from any other format.

Infrastructure that powers your data loop

The production backend for the Rerun data layer. Catalog, byte-range indexing, and retrieval that turns your object stores into a queryable, streamable foundation. Run transforms on the edge or close to the data.

Query into your recordings with SQL

Run any SQL or dataframe query across your catalog, down into the columns, time ranges, and values inside your recordings, not just their metadata.

Refine your data without copies

Add derived columns and evolve schemas without breaking history. You run the transforms with the SDK; Hub keeps the derived data and your raw recordings organized together.

Train without an export step

Express a dataset mix as a query and stream it to your GPUs. The dataloader is column-aware and video-codec-aware, so you train directly on your recordings.

Everyone works from the same data

One viewer, the same recordings, shared across the team. Explore, annotate, and trace a failure back to the data that caused it.

LeRobot

Hugging Face's state-of-the-art robotics project uses Rerun as an integrated part of their visualization tools to inspect and debug training runs.

Brush

A 3D reconstruction engine using Gaussian splatting from DeepMind. Written in Rust, portable, flexible, fast, with Rerun visualizing training.

PyCuVSLAM

The official Python wrapper for NVIDIA's cuVSLAM library. GPU-accelerated visual SLAM and camera tracking for real-time localization.

Project Aria

Meta Reality Labs Research's egocentric AI platform. Rerun visualizes sequences in the Aria Dataset Explorer.

For ongoing developments and user experiences with Rerun, many users have shared their feedback detailing how it enhances their robotics data visualization workflows.