The Google app, featuring Now cards and voice commands | |
Original author(s) | |
---|---|
Developer(s) | |
Initial release | July 9, 2012; 7 years ago |
Stable release | |
Operating system | Android 4.1+ ('Jelly Bean'), iOS 6.0+ and Chrome OS Limited functionality in Microsoft Windows, OS X, Linux (via Google Chrome and the Google app)[1][2] |
Available in | English |
Type | Intelligent personal assistant |
Website | www.google.com/search/about/ |
Issue How to program “Okay Google”. How to activate “OK Google” voice command on any Samsung Galaxy including Galaxy S4, Note 3, Galaxy ace, Galaxy core duo and more. Solution To program the Ok google voice command into a Samsung smartphone if it isn’t working, you must follow these steps: Open your “Google” app and tap →.
Google Now was a feature of Google Search of the Google app for Android and iOS. Google Now proactively delivered information to users to predict (based on search habits and other factors) information they may need in the form of informational cards. Google Now branding is no longer used, but the functionality continues in the Google app and its feed.[3]
Google first included Google Now in Android 4.1 ('Jelly Bean'), which launched on July 9, 2012, and the Galaxy Nexus smartphone was first to support it. The service became available for iOS on April 29, 2013, without most of its features. In 2014, Google added Now cards to the notification center in Chrome OS and in the Chrome browser. Later, however they removed the notification center entirely from Chrome.[4]Popular Science named Google Now the 'Innovation of the Year' for 2012.[5]
Since 2015, Google gradually phased out reference to 'Google Now' in the Google app, largely removing remaining use of 'Now' in October 2016, including replacing Now cards with Feed.[6] At Google I/O 2016, Google showcased its new intelligent personal assistant Google Assistant, in some ways an evolution of Google Now. Unlike Google Now, however, Assistant can engage in two-way dialogue with the user.
In late 2011, reports surfaced that Google was enhancing its product Google Voice Search for the next version of Android. It was originally codenamed 'Majel' after Majel Barrett, the wife of Gene Roddenberry and the voice of computer systems in the Star Trek franchise; it was also codenamed 'assistant'.[7]
On June 27, 2012, Google unveiled Google Now as part of the premier demonstration of Android 4.1 Jelly Bean at Google I/O 2012.[8]
On October 29, 2012, Google Now received an update through the Google Play Store bringing the addition of Gmail cards.[9] Google Now displays cards with information pulled from the user's Gmail account, such as flight information, package tracking information, hotel reservations and restaurant reservations (as long as the Gmail account is not a Google Apps account[10]). Other additions were movie, concert, stock and news cards based on the users location and search history. Also included was the facility to create calendar events using voice input, for instance 'Make a new appointment for dinner with Steve next Thursday at 7pm'.
On December 5, 2012, an update to the Google Search application brought several new features to Google Now, including cards for nearby events, searching by camera when at a museum or shop, airplane boarding passes found from e-mail (United Airlines in the first instance, more airlines followed). In addition Google Now would show cards for the weather for upcoming travel destinations, birthday reminders; and monthly summaries of biking and walking activities. New voice action features included with this update include the ability to post to Google+, song recognition capabilities, and the ability to scan bar codes.[11] However, when the Search 2.5 update hit, Google removed the 'Search With Camera' feature.
On March 21, 2013, the executive Chairman of Google, Eric Schmidt, stated that Google had submitted an iOS version of Google Now to Apple for review and that the app was awaiting approval, but he later said that this was not true[12] after Apple denied this was the case. Despite this, on April 29, 2013, Google Now was made available for iOS in an update to the operating system's Google Search application.[13]
Based on Google Chrome code review on December 2012, Google Now was expected to be integrated into the desktop version of Google Chrome.[14] According to Seth Rosenblatt of CNET, it is rumored that Google Now will also serve as iGoogle's replacement in November 2013.[15] On May 15, 2013, at Google I/O 2013, Google announced the upcoming release of Google Now on desktop platforms—the feature would be accessible only via Google Chrome or Google Chrome OS.[16] On January 16, 2014, an alpha version of the Google Now was made available on desktop through the Google Chrome Canary release although this app lacks some of the cards available on mobile version of Google Now such as public alerts, nearby photos, activity summary and stocks.[1] On March 24, 2014, Google started rolling out Google Now for Google Chrome users who are signed into their Google account on the browser.[17]
Google Now was implemented as an aspect of the Google Search application. It recognized repeated actions that a user performs on the device (common locations, repeated calendar appointments, search queries, etc.) to display more relevant information to the user in the form of 'cards'. The system leveraged Google's Knowledge Graph project, a system used to assemble more detailed search results by analyzing their meaning and connections.[8][18]
Specialized cards currently comprise:[19][20][21]
In January 2015, Google introduced the ability for participating, installed third-party apps to generate cards; on launch, this included apps such as Airbnb, eBay, The Guardian, Pandora Radio and Lyft among others.[22]
On Android 6.0 'Marshmallow', Google Now supported an additional feature known as Now On Tap, which lets a user perform searches within the context of information currently displayed in an app. When a user activates the feature, by holding the 'Home' button or using a voice command, the text content of the current screen is parsed for keywords and other information (names of people, television programs and films, etc.)—which then generate cards that display related information, suggestions, and actions. Users can also voice questions related to the subjects of these cards.[23]
Scott Webster of CNET praised Google Now for its ability to remind users of events based on past location histories and check-ins, and further commended it for providing 'information instantly in a clean, intuitive manner' without the user's requesting it.[24] A review by Ryan Paul of Ars Technica claims that like most other voice activated apps, including Siri, voice recognition is a major issue, but notes that the ability to type queries provides users with alternatives.[25] Some commentators noted that Google Now's predictive power[26] reveals 'exactly how much data and information Google actually has about [users'] routines and daily lives.'[27] An October 2014 review on Android Central showed Google Now outperforming its competition, Siri and Cortana.[28]
Google today defended its practice of having workers listen to users' Google Assistant queries, following the leak of 1,000 voice recordings to a media outlet. Google also said it will try to prevent future leaks of its users' voice recordings.
VRT NWS, a news organization run by a public broadcaster in the Flemish region of Belgium, said it 'was able to listen to more than a thousand [Google Assistant] recordings' that it received from a Google subcontractor.
Google Assistant is used on Google Home smart speakers, Android devices, and Chromebooks.
'In these recordings, we could clearly hear addresses and other sensitive information,' the VRT article said. 'This made it easy for us to find the people involved and confront them with the audio recordings.'
VRT said it 'let ordinary Flemish people hear some of their own recordings' and that these people confirmed that the recordings contained their voices.
Google Home is supposed to record only when users say the 'OK Google' or 'Hey Google' trigger phrases. But VRT NWS said that 153 of the 1,000 recordings it listened to 'were conversations that should never have been recorded and during which the command 'OK Google' was clearly not given.' Recorded voices leaked to VRT included 'bedroom conversations, conversations between parents and their children, but also blazing rows and professional phone calls containing lots of private information.'
Google has previously disclosed that it hires language experts to listen to recordings, and it defended the practice in today's blog post.
'As part of our work to develop speech technology for more languages, we partner with language experts around the world who understand the nuances and accents of a specific language,' Google wrote. 'These language experts review and transcribe a small set of queries to help us better understand those languages. This is a critical part of the process of building speech technology and is necessary to creating products like the Google Assistant.'
We asked Google today if its internal employees also listen to the recordings. A company spokesperson answered 'yes' and added that 'we apply a wide range of safeguards to protect user privacy throughout the entire review process (both internally and with our affiliates).'
Amazon, Apple, and Google all have workers listen to smart-assistant recordings, Bloomberg wrote in April. Google acknowledged to Business Insider at the time that 'We conduct a very limited fraction of audio transcription to improve speech-recognition systems.'
Amazon recently confirmed that it stores Alexa conversations until customers delete them.
Google's blog post today said it uses 'a wide range of safeguards to protect user privacy throughout the entire review process.'
Google users can disable the saving of voice activity and other types of personal information at Google's activity controls site, where they can also delete past recordings. More information on how to manage and delete Google Assistant data can be found at this Google help page.
'Language experts only review around 0.2 percent of all audio snippets,' Google said. 'Audio snippets are not associated with user accounts as part of the review process, and reviewers are directed not to transcribe background conversations or other noises and only to transcribe snippets that are directed to Google.'
The company also said that Google Assistant 'only sends audio to Google after your device detects that you're interacting with the Assistant.' But Google acknowledged that sometimes its software 'misinterprets noise or words in the background,' leading to 'false accepts' in which people's voices are recorded when they aren't trying to use Google Assistant.
Google told Ars that the storing of voice and audio activity is set to 'off' by default when people create Google accounts.
'You must opt in to have your audio recordings stored to your account, and Voice and Audio Activity is not required to use the Google Assistant,' Google said. 'We disclose that Voice & Audio Activity (VAA) can be used to improve speech systems and in Google's privacy policy, we also explain that we provide personal information to trusted businesses to process for us. If you do opt in, you can set your account to auto-delete Assistant history after every 3 months or every 18 months. Or you can manually delete it yourself.'