Amazon Is Working on a Device That Can Read Human Emotions




 

(Bloomberg) -- Amazon.com Inc. is developing a voice-activated wearable device that can recognize human emotions.

The wrist-worn gadget is described as a health and wellness product in internal documents reviewed by Bloomberg. It's a collaboration between Lab126, the hardware development group behind Amazon's Fire phone and Echo smart speaker, and the Alexa voice software team.

Designed to work with a smartphone app, the device has microphones paired with software that can discern the wearer's emotional state from the sound of his or her voice, according to the documents and a person familiar with the program. Eventually the technology could be able to advise the wearer how to interact more effectively with others, the documents show.

It's unclear how far along the project is, or if it will ever become a commercial device. Amazon gives teams wide latitude to experiment with products, some of which will never come to market. Work on the project, code-named Dylan, was ongoing recently, according to the documents and the person, who requested anonymity to discuss an internal matter. A beta testing program is underway, this person said, though it's unclear whether the trial includes prototype hardware, the emotion-detecting software or both.

Amazon declined to comment.

The notion of building machines that can understand human emotions has long been a staple of science fiction, from stories by Isaac Asimov to Star Trek's android Data. Amid advances in machine learning and voice and image recognition, the concept has recently marched toward reality. Companies including Microsoft Corp., Alphabet Inc.'s Google and IBM Corp., among a host of other firms, are developing technologies designed to derive emotional states from images, audio data and other inputs. Amazon has discussed publicly its desire to build a more lifelike voice assistant.

The technology could help the company gain insights for potential health products or be used to better target advertising or product recommendations. The concept is likely to add fuel to the debate about the amount and type of personal data scooped up by technology giants, which already collect reams of information about their customers. Earlier this year, Bloomberg reported that Amazon has a team listening to and annotating audio clips captured by the company's Echo line of voice-activated speakers.

A U.S. patent filed in 2017 describes a system in which voice software uses analysis of vocal patterns to determine how a user is feeling, discerning among "joy, anger, sorrow, sadness, fear, disgust, boredom, stress, or other emotional states." The patent, made public last year, suggests Amazon could use knowledge of a user's emotions to recommend products or otherwise tailor responses.

A diagram in the patent filing says the technology can detect an abnormal emotional condition and shows a sniffling woman telling Alexa she's hungry. The digital assistant, picking up that she has a cold, asks the woman if she would like a recipe for chicken soup.

A second patent awarded to Amazon mentions a system that uses techniques to distinguish the wearer's speech from background noises. Amazon documents reviewed by Bloomberg say the wearable device will take advantage of such technology.

Amazon's work on a wearable device underscores its ambitions of becoming a leading maker of both cutting-edge speech recognition software and consumer electronics. The Echo smart speaker line and embedded Alexa voice software have popularized the use of voice commands in the home. The company has also added voice control to Fire-branded video streaming devices for television, as well as tablets.

But Amazon's efforts to create smartphone software to rival Apple Inc. or Google have failed. So the company is trying to make Alexa ubiquitous in other ways. Bloomberg reported earlier this year that Amazon was developing wireless earbuds, similar to Apple AirPods, that are expected to include the Alexa voice software. The company has begun distributing Echo Auto, a dashboard-mounted speaker and microphone array designed to pair with a smartphone, and says it received 1 million pre-orders.

Amazon has also been working on a domestic robot, Bloomberg reported last year. Codenamed "Vesta," after the Roman goddess of the hearth, home and family, the bot could be a kind of mobile Alexa, according to people familiar with the project. Prototypes of the robot can navigate through homes like a self-driving car.

(A previous version of this story corrected the spelling of Asimov.)

--With assistance from Mark Gurman.

To contact the reporter on this story: Matt Day in Seattle at mday63@bloomberg.net

To contact the editors responsible for this story: Robin Ajello at rajello@bloomberg.net, Emily Biuso

For more articles like this, please visit us at bloomberg.com

©2019 Bloomberg L.P.

COMMENTS

More Related News

WeWork Is Likely to Delay IPO After Valuation Plummets
WeWork Is Likely to Delay IPO After Valuation Plummets

WeWork, with its estimated valuation crashing, is likely to postpone its public listing until at least October, according to people familiar with the matter. No final decision has been made and the timing could still change, said the people, who asked not to be identified because the deliberations weren't public. Representatives for New York-based WeWork didn't respond to a request for comment.

India
India's Reliance Communications' Unit Files for Bankruptcy

A unit of Reliance Communications Ltd., Anil Ambani's distressed telecom firm, has filed for bankruptcy protection. GCX Ltd., which owns the world's largest private undersea cable system, is the latest company owned by the tycoon to stumble. The former billionaire's Reliance Communications itself fell back into bankruptcy earlier this year.

The Oil Market
The Oil Market's Reaction to Saudi Arabian Attack in Five Charts

It surpasses the loss of Kuwaiti and Iraqi supply during the Gulf War in August 1990, and the hit to Iranian output in 1979 from the Islamic Revolution, according to the International Energy Agency. The price gap between Brent for delivery this November and December 2020 doubled from $3.57 a barrel at the close of trading Friday to more than $7 on Monday. Calls on West Texas Intermediate crude futures are pricier than puts for the first time since 2018.

U.S. Stock Index Futures Slide After Oil Jumps on Drone Attack
U.S. Stock Index Futures Slide After Oil Jumps on Drone Attack

S&P 500 Index futures expiring in December dropped as much as 0.8% as of 9:25 a.m. in Singapore. Brent crude soared as much as 19.5% and West Texas Intermediate added 15.5% after the news of the attack on the world's largest crude exporter. The Saudi Arabia attacks will likely hurt Asian stock markets today with the S&P e-mini futures already lower, Jeffrey Halley, a market analyst at Oanda Asia Pacific Pte, wrote in an email.

Oil Soars, Yen Gains After Saudi Oil Field Attacks: Markets Wrap
Oil Soars, Yen Gains After Saudi Oil Field Attacks: Markets Wrap

(Bloomberg) -- Oil surged along with the yen and Treasury futures after a strike on the heart of Saudi Arabia's oil production increased geopolitical risk concern. U.S. equity futures declined, while shares in Asia opened flat.Brent crude soared 13% and West Texas Intermediate added 12%. News of the

Leave a Comment

Your email address will not be published. Required fields are marked with *

Cancel reply

Comments

Top News: Economy

facebook
Hit "Like"
Don't miss any important news
Thanks, you don't need to show me this anymore.