Monaco4D Dataset

Outdoor, exocentric, streaming 4D benchmark

Monaco4D modalities: depth, dense scene flow, RGB, instance masks, and surface normals, across five illumination conditions, captured from trackside and drone cameras around a mapped circuit

Six sections of a to-scale Monaco Grand Prix replica, rendered in Unreal Engine 5, under five illumination conditions, with dense multi-modal ground truth.

Comparison with prior datasets

No existing dataset covers the combination needed for immersive watching of F1.

 OutdoorExocentricMulti-modal GT
Driving datasets
Indoor multi-view
Sports free-viewpoint
Monaco4D

Camera rig

The rig follows real F1 broadcast coverage rather than a generic camera array.

Illumination conditions

Most photometric reconstruction methods assume illumination changes slowly across a sequence. Every sequence in Monaco4D is rendered under five conditions, plus in-clip transitions such as tunnels, building shade, and streetlamps, which violate that assumption.

That gives 30 sequence and illumination combinations, before car-count variation.

Ground truth annotations

Every frame includes path-traced RGB, surface normals, metric depth, and per-instance segmentation masks.

Engine release

A single fixed release cannot cover every use case, so we are also releasing the data engine that renders Monaco4D, for selective data generation. No Unreal Engine experience is required to run it.

Configurable capture matrix

Vary circuit zone, weather, camera rig, and traffic density independently.

Two render modes

Fast Deferred rendering for bulk generation, or Path Tracing for high-quality output.

Fine controls

Adjust frame rates, resolution, motion blur, headless mode from the UI.

Deterministic by design

Auto-exposure and motion blur are explicitly controlled, so sequences are reproducible.

Dataset Statistics

4,850
Hand-authored camera sequences
30
Unique environments
6 zones · 5 illumination
5
Ground-truth modalities
Including dense 3D scene flow
30M
Frames
13 zone/traffic combos with ∼227 frames each

BibTeX

Citation available upon publication.