Designing a new language for cars
Lights, sounds or screens with messages: how can self-driving cars interact with humans to make their intentions clear?
Autonomous driving promises to bring lots of benefits, ranging from more safety to increased mobility. However, the introduction of self-driving cars also means that we have to come up with means to communicate the intentions of these vehicles, when there is no longer a driver to look at. 黑料福利网 researcher Debargha Dey is one of the researchers at 黑料福利网 who is developing a new language for cars. Something that is much more difficult than it seems.
Picture this: it鈥檚 2030. You鈥檙e sitting in your self-driving car on a wide road. While minding your own business, the car - programmed to bring you to your destination without any interaction on your part - wants to turn left into a narrow road. However, you鈥檙e stuck: the narrow road is blocked by a car that is waiting for you, as you have right of way. In a fully automated world, with no humans ready to intervene, this would be a possibly unending impasse.
Fortunately, there are so-called external Human-Machine Interfaces coming our way that use light, sound or any other means to indicate to the other road user that they can go first. Impasse solved!
eHMIs, as they are called in the world of smart mobility, are part of a relatively new and exciting research field that helps automated vehicles negotiate the outside world. One of the researchers involved in this field is Indian-born , part of the Future Everyday group in the department of Industrial Design. Dey, who is just about to finish his PhD and will continue to stay on as a post doc at 黑料福利网, has a very personal motivation for his involvement in this field.
CAR CRASH
鈥淚鈥檝e always been fascinated by cars, making sketches of them as a child, but I鈥檇 never expected that working with cars would one day be a full-time job. One of the reasons that I decided to get involved in this field is a car accident I had some eight years ago, when I was working in the US as a software engineer. A car crashed into me at a T-junction. Although I suffered only slight injuries, the incident had a deep effect on me. Not only was I afraid to drive for some time, I also found out that the other driver had been distracted by his satnav. This kindled a deep interest in me for the interaction between humans and cars.鈥
鈥淎fter attending a conference on Automotive UI, I decided to apply for a PDEng research position here at 黑料福利网 with professor Jacques Terken and I never looked back. It was one of the best decisions of my life!鈥
Understanding the self-driving car
Up till a few years ago most researchers in smart mobility were primarily interested in the interaction between drivers, or between car and driver. Dey and his colleagues in the NWO funded program, on the other hand, focus on situations where the driver is no longer in control, and the person in the car no longer represents the intention of the car.
鈥淥f course, we are some way from a situation where automated cars can do most of the driving (known as ), but we believe that eHMIs can play a crucial role in getting there. Once autonomous cars are able to automatically and effectively signal their intentions to other road users, drivers can finally sit back and fully enjoy the benefits of autonomous driving.鈥
Bumper lights and more
A good example of Dey鈥檚 research, is the he and his colleagues did into distance-dependent eHMIs. 鈥淗ere we looked at the way people interact with a car when it approaches. From eye-tracking tests we did, we observed that people tend to look at a car not necessarily to make eye contact with the driver, but to assess its intentions.鈥
鈥淎s a car approaches, they first look at a car鈥檚 bumper, then move up to the grill and the hood, and finally on the windshield, looking for information about the situational awareness or intention of the driver. This inspired us to design an interface that dynamically communicates the car鈥檚 intentions through lights on the bumper and the windshield, depending how far it is away from the pedestrian鈥.
As we speak, Dey is involved in exciting new research that looks into using more abstract animal-based signals to communicate intention. 鈥淲hen a cat or a hedgehog is angry, or aggressive, it puffs up, or makes itself bigger. Animal behavior like this shows the way to a more nuanced interactive language, that goes beyond directive symbols like stop signs, or text, that may be not visible or understandable to everyone.鈥
Proof-of-concept
Based on an Dey and his colleagues recently did of the research field, there are currently some 70 eHMI concepts for automated vehicles. They range from displaying text messages on external displays, over laser projections on the street, to personalized messages for smart and wearable devices. Often, these concepts are limited to demonstrations for promotion purposes, proof-of-concept prototypes, or purely virtual solutions.
One of the few eHMI concepts that has gone beyond the drawing board, is Drive.ai, a small company founded in 2015 by students at Stanford University and now owned by Apple. As a pilot, in 2018 it tested a that use four external screens to communicate messages to other road users. Another example is concept, that includes a standardized communication system enabling other road users and autonomous vehicles to understand what it will do next.
Challenges
Standardization is one of the main challenges of eHMIs for self-driving cars. Automated cars will only be able to express themselves, if they speak a language that is understood by all other road users. It is one of the reasons why Dey鈥檚 supervisor at 黑料福利网, professor Marieke Martens, is actively involved with industry to develop common standards.
Standardization will also help acceptance of eHMI-equipped cars by the public. Dey sees this as one of the main goals of his work. There appears to be quite some hesitation and mistrust in the public perception of driving automation technology. Early protoypes of automated vehicles on the road have been met with , and even antipathy 鈥 with some people even at the cars.
鈥淯p till now, experiments with self-driving cars have met with quite some pushback from other road users, with some people even throwing stones at them. It shows that people need to understand a new technology before they can accept it. I believe an effective eHMI that is clear and understandable can help in this.鈥
Finding the right balance
But, warns Dey, there are trade-offs. 鈥淎utomated vehicles will never be perfect. Nor should they be. A self-driving car that is 100% safe won鈥檛 be able to drive. It will forever be condemned to stand still, waiting for the elusive guarantee that no-one will be hurt by its actions. Of course, that would defeat the whole purpose of the self-driving cars, which are supposed to bring more mobility for more people. Finding the ideal balance between perfect safety and calculated risk is critical, and good communication is key in this interaction. This is where eHMIs can help.鈥
This also means that at times automated vehicles should be able to ignore traffic rules, to avoid being stuck at a busy crossing, waiting for all the priority traffic to pass by. 鈥淣avigating a self-driving car means negotiating. Everyone has to give and take. Part of our work is designing an eHMI that helps express not only the intention of the car (鈥淚 want to pass鈥), but also the urgency of that wish (鈥淚 have been waiting here for 5 minutes now, so please make some room鈥).
Smart mobility revolution
The movieclip showing the traffic in Amsterdam is also a good illustration of another challenge for Dey and his colleagues. 鈥淭raditionally, research has focused on One person 鈥 One car, but in real situation it鈥檚 never like that. There will be plenty of people, with different intentions and different right of ways,鈥 says Dey. 鈥淚f the car says, please feel free to go, it鈥檚 not clear whom the car is talking to. It鈥檚 very difficult to direct the message to one person, or only talk to the person who has right of way.鈥
Still, the young researcher is convinced that science, together with industry, will be able to solve these problems. 鈥淲hile there is no golden egg, and it鈥檚 still early stages, I鈥檓 hopeful that human-centered design of car interfaces can play an essential role in bringing about the smart mobility revolution.鈥
More info
For more info about the work of Debargha Dey and his colleagues, check out the webpage of the Future Everyday research group. Research in the field of smart moblility is presented on this page.
Media contact
Interaction with smart machines
Are you interested in research on the house as a caregiver? Would you like to work with our scientists on interactions between humans and machines? Take a look at what Eindhoven University of Technology has to offer.