Lane Keeping

Drifting across the desert for a music video: cool. Drifting around a test track in an autonomous car: also cool. Drifting out of your lane on the highway: not cool. Carmakers have been warning drivers not to leave their lanes since 2001, with subtle hints such as audible beeps or vibrating steering wheels. These early systems used cameras to track lane lines painted on the road. A decade ago, Toyota’s first lane-keeping system took over the steering wheel and nudged wayward cars back into line when the driver would not. But because these systems relied on cameras and early image-processing algorithms, they worked only where the lines were clear and in good visibility.

Today’s lane-keeping systems are evolving. The Volkswagen Touareg can track a single lane stripe, and the company claims that the car can track lanes in the dark and in the fog. It manages the feat with a single camera, unlike some systems that use stereoscopic cameras or include information from a radar or other additional sensor.

That choice reveals some sophistication on the part of the image-processing software. Stereo vision would give the car’s processors depth perception to a certain distance, and radar might help it work when the sun is low, blinding the camera. Yet Volkswagen claims its single lane-keeping camera has, enough range for highway driving. It does not, however, work below 65 kilometers per hour (40 miles per hour), which may be a strategic decision to prevent drivers from trying to use the system in more dangerous and complex urban settings. Local roads have less-continuous lane markings than highways and are more likely to have obstructions blocking the car’s field of view and nearby obstacles. Bringing control to lower-speed lane-keeping systems would also require exerting more torque on the steering wheel than highway-speed lane-keeping systems do. The company would not provide further details on how its image-processing system works, but it is a safe bet that it was developed in conjunction with a third-party supplier and customized for Volkswagen.

Image processing is just the start, however: Senior research scientist Eddy Llaneras, at the Virginia Tech Transportation Institute, in Blacksburg, Va., says that a more interesting technical problem is the transition from warning to active control. It also defines the major divide between existing commercial systems. Some are just lane-departure warning systems; the best also nudge the wheel or brakes to help keep a car in its lane. The latter rely on already-existing stability control systems that prevent drivers from overcorrecting, for example, and which are part of today’s lane-keeping assistants.

Lane keeping requires the crucial latitudinal axis of car motion. Werner Huber, BMW’s head of driver assistance and perception, told IEEE Spectrum last year that “the big jump is now to take over control of the car in the longitudinal and latitudinal direction.” For cars that already have advanced cruise control, the temptation to let the car handle both axes is so great that carmakers, including BMW and Volkswagen, deactivate their driver assistance systems if the driver’s hands leave the wheel for more than a few seconds. Someday, the opposite may be true: The car may squawk if the driver tries to take the wheel.

Car Manufacturers

Maker Lane-Departure Warning Lane Keeping
Audi/Volkswagen
BMW
Ford
GM
Honda/Acura
Mercedes-Benz
Toyota/Lexus
Volvo

Automotive parts suppliers

Bosch
Continental
Delphi
TRW
Valeo

First published by IEEE Spectrum as part of an online special report:

Feature: How Self-Driving Cars Will Sneak Onto Our Roads [pdf]
Related story 1: Adaptive Cruise Control and Traffic-Jam Assistants [pdf]
Related story 2: Self-Parking [pdf]
Related story 3: Lane Keeping [pdf]
Related story 4: Autonomous Emergency Braking [pdf]