Why is autonomous driving difficult?
Uncertainty and complexity: autonomous driving requires handling uncertainty within a complex system.
Uncertainty comes from the physical world: observations can be incomplete, and other participants' behaviour cannot be fully predicted.
Complexity comes from the many elements of a driving environment and their interactions. They increase the dimensions of the problem and the number of scenarios that need to be understood and validated, leading to Bellman's “curse of dimensionality”:
- Static space: road boundaries, road geometry and drivable areas.
- Semantic rules: lane attributes, travel directions and right of way.
- Dynamic objects: vehicles, pedestrians, their movement and their interactions.
Why is map-free driving even harder?
An additional dimension of uncertainty: the road structure itself must be understood and assessed in real time.
Systems that depend on HD maps typically treat the road structure supplied by the map as known, effectively removing that dimension of uncertainty from the design. A map-free system must infer the road structure while driving and deal with the incompleteness and uncertainty of that understanding.
On your first drive in Shanghai, elevated roads branch repeatedly, signs are dense and turning lanes may not be where you expect them. Approaching a junction, the vehicle ahead may also hide the lane arrows. Even with a navigation route, you must interpret the road connections and lane destinations from incomplete information and choose in time.
How did we address complexity?
System architecture and engineering: this became the foundation for how I built the R&D organisation and systems engineering structure, with three elements:
- High cohesion, low coupling: clear module boundaries and interfaces allow specialists to develop their domains while reducing the complexity they need to handle outside them. Dedicated systems experts take responsibility for cross-domain integration.
- Engineering accumulation: build reusable units of capability and standardise interfaces within a clear division of responsibilities. Deployment and feedback continually add benchmarks, testing capabilities, understanding and engineering know-how that can inform later work.
- Reliability through redundancy: prepare alternative information sources and responses for missing information or limited capabilities, allowing the system to continue working when a local source or capability is unavailable.
Replacing a household appliance within the rated supply and load limits only requires connecting it through a standard interface. Its internal power and control circuits handle its own operating requirements, while development and testing can be organised around the agreed interface. This makes it possible to replace a component without redesigning the building’s power system, and to combine and reuse encapsulated capabilities.
How did we solve the map-free problem?
Multi-source information fusion: to address the additional uncertainty about road structure, we combined three sources:
- Lane markings: their positions and directions provide direct evidence of road structure.
- Other vehicles' behaviour: when vehicles obscure the markings, surrounding trajectories help infer the road's direction.
- Road boundaries: when clear markings and nearby vehicles are both absent, boundaries help identify drivable space.
Roadworks cover the original lane markings, while vehicles ahead obscure part of the road. The system can still combine surrounding vehicle trajectories, road edges and temporary barriers to infer the current drivable space. These sources complement one another when individual observations are missing.
How can a system make good decisions in an uncertain environment?
Defensive driving: assess the feasible action space while accounting for uncertain observations and the uncertain behaviour of others when predicting consequences.
On narrow streets in Puxi, parked vehicles and building corners can block the view. A pedestrian may be about to cross, or a bicycle may emerge from an unseen area. The system needs to include these unobserved possibilities in its predictions, evaluate the consequences of different actions and retain room to respond.
- Action space: identify the feasible actions and include them in the evaluation.
- Uncertain observations: a blind spot may contain a vehicle or pedestrian that has not yet been observed; consider both possibilities.
- Uncertain behaviour: another vehicle may or may not cut in; a pedestrian may step out or remain still.
- Consequences across possible futures: combine these uncertainties to anticipate multiple ways the world could evolve, evaluate each feasible action under those possibilities, and then choose an action.
What did this work achieve?
Technical deployment and commercial outcomes:
- Deployment: I was responsible for China's first deployed map-free driving system, delivered in 2020, three years ahead of the wider industry.
- Commercial outcome: we secured China's first major autonomous-driving contract: a million-unit order for Volkswagen's RHP programme, contributing an important business result for the company.