News | Rerun

Getting Started

The fastest way to get started is with a quick start guide for C++, Python or Rust. If you are looking for other language support, search for an open issue on GitHub to find the...

Troubleshooting

You can set RUST_LOG=debug before running to get some verbose logging output. If you run into any issues don't hesitate to open a ticket or join our Discord.

Examples

The examples serve to showcase the Rerun logging SDK, and demonstrate the usage of Rerun to create visual walkthroughs of papers. To run these examples, make sure you have the...

Archetypes

Rerun comes with built-in support for a number of different types that can be logged via the Python and Rust Logging APIs and then visualized in the Viewer. The top-level types...


Spotlight: Better labels for 3D reconstruction
Are ARKitScenes' labels good enough to train on? We build a phone-only pseudo-label layer for dense depth and normals, then use the available laser data to decide what still needs measuring.

Spotlight: 3D reconstruction is a data layer problem
3D reconstruction runs on multimodal, multi-rate data, and handling that data is most of the work. This is a worked example of what Rerun's data layer removes from a real project: all 5,015 ARKitScenes scans converted into recordings that the viewer, the dataframe API, and the PyTorch dataloader read directly, no export step in between.

A new data layer for robot learning
With the 0.32 SDK release Rerun becomes a unified data layer for physical data, covering visualization, querying, transformation, and training of multi-rate, multimodal robotics data. This post walks through the architecture, tours the new capabilities, and introduces Rerun Hub, our commercial data catalog and storage engine.

The data layer tax for robot learning
Robotics teams are trying to scale end-to-end learning without the mature data infrastructure that made it work for LLMs. This post is a map of where the tax comes from, walking backwards from evaluation to collection.

Rerun 0.27 - Flexible transforms, Python server management, and improved time controls
Rerun 0.27 includes experimental coordinate frame hierarchies, Python APIs for server management, blueprint controls for 3D views, and time panel improvements.

Rerun 0.26 - ROS2 reflection, transform performance and more
Rerun 0.26 brings major performance improvements, reflection-based ROS2 MCAP support, experimental lenses, and continued polish across the viewer and SDK.

Sharing in Rerun - from web to native viewer
Learn how Rerun's URL-based architecture and open source design make sharing Physical AI visualizations effortless, from command line to web viewer to native apps.

Introducing Experimental MCAP Support
In Rerun 0.25, we're adding experimental MCAP support to Rerun to make it easier to visualize your existing robot data.

Rerun 0.25 - transparency, table filtering, experimental MCAP support and more
Rerun 0.25 includes a number of new features and improvements, including table filtering, experimental MCAP support, and more!

Light mode, streaming video and data model improvements
Our feature packed 0.24 release comes with streaming video, light mode, tagged components, multi-sink Support, URDF logging, and more!

Backwards compatibility of .rrd files
We are finally starting to support backwards compatibility for our .rrd data format!

The Missing Data Infrastructure for Physical AI
Rerun has raised $17 million in seed funding to build out the data stack for Physical AI. In a addition to the open source project for logging and visualizing multimodal data, we're building a database for Physical AI.

Entity Filtering & Partial Update APIs
This release brings powerful new tools for discovering entities in the Viewer, much improved partial update APIs for Python/C++/Rust and many more improvements.

Graphs, drag & drop and undo
Rerun 0.21 brings our first iteration on supporting general graphs in Rerun with a new graph view. It also comes with a host of UX improvements like drag & drop of entities, undo & redo, grids for 3D views and more.

Geospatial data and full H.264 support
Rerun 0.20 adds early support for geospatial data with the new GeoPoints and GeoLineStrings archetypes and a new map view. It also adds H.264 support to the native viewer together with many performance and stability improvements for video in Rerun.

Dataframes from multimodal logs
Rerun 0.19 brings two huge new features; the ability to view and query back Rerun data as dataframes, and part one of supporting encoded video data.

Exploiting column chunks for faster ingestion and lower memory use
To enable working with more kinds of datasets in Rerun, the 0.18 release introduces a new column oriented API and performance improvements to help handle larger time-series.

Defaults and overrides for any data
Rerun 0.17 introduces blueprint defaults and overrides, bringing a massive step up in user control. For any visualizer input, you can now use the blueprint to set default values or override the data you logged.

Rerun 0.16 gives you more blueprint control from code
You can now specify some blueprint properties through the Python log API. Among other things this lets you control the visible time range query per view from code.

Introducing the Rerun Blueprint APIs
Rerun 0.15 introduces Blueprint Python APIs for controlling the layout and contents of views in the Rerun Viewer. It also introduces the ability to save and load blueprints from file.

How we sped up time series by 20-30x
This is a follow up post that dives into how we managed to achieve such huge performance gains for time series (among other things), and why it was so hard in the first place.

Real-time kHz time series in a multimodal visualizer
The 0.13 release means teams can now correlate kHz resolution motion and perception data in Rerun. Seeing all your data and state together, correlated over time, is the most powerful thing you can do to understand your systems better.

Introducing plugins for loading any file to Rerun
Rerun should be able to open any file containing data you want to see, whether it's highly complex, rare, or proprietary to your team. With the new plugin system for loading arbitrary files in Rerun's 0.12 release that is now starting to become possible.

Rerun 0.11 brings all SDKs to parity
The Rerun C++ SDK is now fully on par with our two other SDKs in Python and Rust. Thanks to some great community feedback we've added more options for integrating Rerun in your CMake projects.

Introducing the Rerun SDK for C++
The ability to log streams of multimodal data from C++ and visualize it live in Rerun has been our most requested feature since before our public launch in February. The C++ SDK is finally out, but getting here the right way has been a long road.

Rerun 0.9 gives access to the underlying ECS
We're releasing Rerun 0.9.0 with a completely revamped API that gives more control over the underlying data model, a hierarchical and time aware Entity Component System (ECS).

Rerun OSS beta is released
Today we're making the the Rerun open source project public. Rerun is now installable as pip install rerun-sdk for Python users and cargo add rerun for Rust users.

Computer vision for tennis
Computer vision is revolutionizing the way we solve problems in the real world. At Rerun, we have the opportunity to work with developers who are creating innovative computer vision products. One company we want to highlight is PlayReplay.

From the Evolution of Rosbag to the Future of AI Tooling
Thirteen years ago, Willow Garage released ROS (the Robot Operating System) and established one of the standard productivity tools for the entire robotics industry.

Computer vision for the blind
Computer vision is a powerful technology solving real problems in the real world, already today. It holds the potential to significantly improve life on earth over the next decades. At Rerun we have the privilege to work directly with developers that are building that future. From time to time we will introduce companies building computer vision products for the real world. The first company we want to introduce is biped.

Inspired by Bret Victor
In his 2014 talk Seeing Spaces, Bret Victor envisioned an environment where technology becomes transparent, where you effortlessly see inside the minds of robots as you build them. This is the dream of everyone building computer vision for the physical world, and is at the core of what we're building at Rerun.

Why Rust?
I've been a programmer for 20+ years, and few things excite me as much as Rust. My background is mostly in C++, though I have also worked in Python and Lua, and dabbled in many more languages. I started writing Rust around 2014, and since 2018 I've been writing Rust full time. In my spare time I've developed a popular Rust GUI crate, egui.

Starting Rerun