Challenges

Expanding sensor simulation requires asset and environment creation by technical artists
Log re-simulation offers scale and realism, but pose divergence invalidates sensor data
Scaling behavioral simulation requires manual updates to rule-based behaviors
AI-powered simulators are often black boxes not suitable for safety-critical systems
OEMs struggle with a lack of scalable, realistic, closed-loop simulation solutions

Why Neural Sim?

Neural Sim utilizes AI to reconstruct digital twins, model dynamic agents, and run realistic sensor simulations. This scalable and realistic closed-loop simulator meets the large-scale training and validation requirements for next-generation advanced driver-assistance systems (ADAS) and automated driving (AD) systems.
Reconstruct digital twins from log data and synthesize novel views with automated AI-powered pipelines
Augment logs with dynamic agents that leverage ML-based behaviors and realistic 3D assets
Run closed-loop sensor simulations with camera, lidar, and radar while preserving details, including lighting and textures
Train models with reinforcement learning using a highly scalable and performant simulation engine
Integrate neural simulations into verification and validation by linking to operational design domains (ODDs) and requirements and by including them as evidence in safety cases

Benefits

Develop end-to-end ADAS

Build end-to-end ADAS with a neural simulator that supports closed-loop simulation at scale.

Accelerate development

Improve developer efficiency with automated pipelines that transform drive logs into virtual scenarios in hours, not weeks.

Reduce on-road testing

“Shift left” testing from on-road driving to neural simulation that models real-world performance and can test perception, planning, and end-to-end systems.

Key components

Neural reconstruction

Reconstruct maps, worlds, and scenarios in simulation automatically from collected drive logs. Transform a manual artist process into an automated workflow with neural reconstruction. Reduce complex scenario creation timelines from weeks to hours.

Novel view synthesis

View recorded real-world data from entirely new perspectives. Enable log re-simulation with pose divergence (novel agent positioning). Transfer collected logs to entirely new sensor suites and vehicles (e.g., log data collected on a sedan vehicle can be used by a truck with different sensors).

Intelligent behaviors

Utilize intelligent behavior models that leverage drive data to learn and emulate real-world driving patterns. Built-in driving models simulate physics-based dynamics for cars, trucks, tractor-trailers, and more.

Train, test, and validate with AI

Train end-to-end systems with a performant, scalable, closed-loop simulator suitable for high-throughput reinforcement learning. Test and validate using neural simulations that can be linked to requirements, ODDs, and safety case trees.

Get started with Neural Sim

Accelerate ADAS and AD development with AI-powered neural simulation.
Contact us