M. Ehsan Hoque, 35 Computer scientist University of Rochester
A growing band of digital characters that converse, read faces and track body language is helping humans to communicate better with one another. While virtual helpers that perform practical tasks, such as dealing with customer service issues, are becoming ubiquitous, computer scientist M. Ehsan Hoque is at the forefront of a more emotionally savvy movement. He and his team at the University of Rochester in New York create software for digital agents that recognize when a person is succeeding or failing in specific types of social interactions. Data from face-to-face conversations and feedback from professional counselors and interviewers with relevant expertise inform this breed of computer advisers.
One of Hoque’s digital helpers grooms people to be better public speakers. With words on a screen, this attentive app notes, for example, how many times in a practice talk a person says “um,” gestures inappropriately or awkwardly shifts vocal tone. With the help of Google Glass, the app even offers useful reminders during actual speeches. Another computerized helper, this one in the form of an avatar, helps people hone their job interviewing skills, flagging long-winded responses or inconsistent eye contact in practice interviews. In the works are computerized conversation coaches that can improve speech and communication skills among people with developmental conditions such as autism and mediate business meetings in ways that encourage everyone to participate in decision making.
“There has been some progress in artificial intelligence, but not much in developing emotional aspects of AI,” Hoque says. “We’re just cracking through the surface at this point.”