Google Duplex guide: How the lifelike AI will work - and when it's rolling out

The pros and cons of Google's latest AI breakthrough

A guide to Google Duplex

Earlier this year, Google CEO Sundar Pichai showed off an advanced application of the company's AI called Google Duplex, a feature which helps make phone calls from a Google Home or phone on your behalf. No, it’s not going to send someone your pre-recorded message – it’s going to actually have a conversation with someone else for you.

When first unveiled at Google I/O, we saw two different demos showing how Assistant could call small businesses to book appointments on behalf of the user - the first for a hair salon appointment and the second to book a table at a restaurant. Google’s Assistant not only managed to follow basic conversational maxims, but even used “umms” and pauses to emulate human speech patterns. It was impressive, yet creepy, amazing and still questionable. And we now know Google is preparing Duplex for rollout at the start of November.

But there's plenty more to delve into here, with the arrival of Duplex raising more questions than answers. Google Home VP Rishi Chandra told The Ambient back in May that the company still doesn’t know how some of this will work in practice, and there are both legal and ethical considerations at play here.

What’s actually happening here?

Duplex brings together various AI technologies that Google's been working on for years, culminating in its most human application yet. The aim of Duplex, says Google, is to automate calls to businesses and book appointments on your behalf, so you don't have to pick up the phone. In the first demo we saw, Google Assistant called a hair salon to book an appointment, while the receptionist was apparently unaware that she was speaking to an algorithm.

This isn't something you'll be using to call your friends and family, but for offloading the task of making bookings. Pichai said that 60% of small business in the US don't have an online booking system – and Google sees an opportunity.

Google Duplex explainer

Duplex is powered by Google’s WaveNet natural speech generator and has been trained on what Google calls "closed domains". Essentially, Duplex doesn't know how to talk to your parents, but it knows how to speak naturally when booking a haircut or ordering a plumber.

Duplex also has a self-monitoring capability, which means that should it get into a more complex exchange that it can't handle, it can tag in a human operator to do the job. Whether or not the Assistant will be supervised come the time Duplex goes public remains to be seen, but Google's keeping a human eye on it during its training.

Is this legal? Is it ethical?

The legality depends on how Duplex actually shakes out. Certainly, in some US states, it’s illegal to record a phone conversation without the other party giving their consent. It’s unclear what this could mean for Duplex; even if it’s not recording the entire conversation, would information taken and stored by Google suffice as a “recording”?

Google has clearly been listening to these concerns. In June, it published the below video, which shows Duplex calling a restaurant to make a reservation. However in this demonstration, Duplex announces itself first and tells the host that the call will be recorded. It also interjects with some "Uhhs" and "Mmhmms" to make it sound more human. Take a look - it paints a clearer picture of Duplex than the I/O demo.

But there's also the obvious question of whether businesses will be happy dealing with a robot. We can’t see any scenario where this technology will be perfect from day one; we can only imagine how frustrating a scrimmage with a confused Assistant could be for someone whose day is busy enough without having to wrestle with AI. Furthermore, even if the person knows they’re talking to a robot, who’s to say they’ll want to, no matter how human-like it sounds?

But there are positives to remember too. For people who are elderly or disabled, Duplex is an entirely new assistive technology that could be incredibly helpful.

When will Duplex roll out?

After going through beta testing this summer, Google now says that Duplex will be coming at the start of November, beginning with the company's Pixel smartphones.

After speaking with Google, seeing the demonstrations earlier this year and simply seeing how advanced the technology is, this feels like somewhat of a surprise. After all, there's still quite a lot we don't know - what if it reaches an automated responder and suddenly it's a robot face-off? What about the potential for abuses of this technology? There's a lot to think about.

"We're still developing this technology and we actually want to work hard to get this right, get the user experience and the expectation right for both businesses and users," said Pichai at I/O. "But done correctly, it will save time for people and generate a lot of value for businesses."

Perhaps unsurprisingly, then, Duplex won’t be standalone to begin with, and will be folded into Google Assistant. It will also be rolling out on a city-by-city basis, with the first places receiving the technology being New York, Atlanta, Phoenix, and the San Francisco Bay Area. Google states that more areas will follow later.

Businesses in these cities and future ones will also have the choice to opt out of Duplex, as the bot will announce it is a bot at the beginning of the call. Google naturally thinks businesses will embrace Duplex, though, and it appears to be on a charge to get it out into the wild.

A report by The Information from July claims Google is deep in talks with commercial users over Duplex, and that one major insurance company is in that conversation. Duplex may replace some of the jobs currently done by humans in call centers, though someone would be on hand to take over should matters get too complex for Duplex to handle.

TAGGED   google

Recent stories

google How to view and delete your Google Assistant voice recordings
google The best Google Home compatible devices for your smart home
google Google Assistant Smart Displays: Your need-to-know on the touchscreen speakers

What do you think?

Reply to
Your comment