Aria Synthetic Environments

Introduced by Avetisyan et al. in SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Model

Aria Synthetic Environments is a large-scale, fully simulated dataset created by Project Aria¹1. It consists of procedurally-generated interior layouts filled with 3D objects, simulated with the sensor characteristics of Aria glasses¹1. Here are some key features of this dataset:

  • 100,000 unique multi-room interior scenes: These scenes are procedurally generated to produce a diverse set of interior scenes. Each scene has a unique room graph connecting multiple rooms, and unique placement of architectural features, such as windows, doors, and pillars¹1.
  • Populated with high-quality 3D objects: Each of the 100,000 unique scenes is filled with objects from a digital library, each with high-quality materials and geometry¹1.
  • Simulated sensor data per sequence: This includes 1 x outward-facing RGB camera stream simulated with Aria camera & lens characteristics¹1.
  • Ground Truth Annotations: These include 6DoF camera trajectory, 3D floor plan, 2D instance segmentation, and 2D depth map¹1.
  • Realistic simulated trajectory within each environment: Device trajectories are simulated within each environment according to a set of rules that mirror how users walk while wearing Project Aria glasses¹1.

This dataset sets a new precedent for the scale of indoor environment datasets and surfaces exciting new research opportunities for tasks related to 3D scene reconstruction, and object detection and tracking¹1. It's designed to provide the wider research community with a dataset large enough to surface new challenges and research opportunities²2.

(1) Aria Synthetic Environments Dataset | Project Aria. https://www.projectaria.com/datasets/ase/. (2) Aria Synthetic Environments Dataset | Project Aria Tools. https://facebookresearch.github.io/projectaria_tools/docs/open_datasets/aria_synthetic_environments_dataset. (3) Project Aria Research | Project Aria. https://www.projectaria.com/research/.

Papers


Paper Code Results Date Stars

Dataset Loaders


No data loaders found. You can submit your data loader here.

Tasks


License


  • Unknown

Modalities


Languages