Do our phones listen to us for ads?

Do our phones listen to us for ads?
Photo: Morning Brew/Unsplash

onths ago, before lock-down started, I had a friend round for dinner. He was on the keto diet; a high-fat, low-carb regime, mainly consisting of meat and cheese. Also fine, he told me, are Shirataki Noodles. I didn’t know what to cook. Shirataki…

The scene plays out like a thriller: you pull out your phone, and you see an ad for AirPods.

Wait a minute, you think. Didn’t I just have a conversation about AirPods with my friend? Like, a real conversation, spoken aloud? Is my phone… listening to me?

Why, yes, it probably is. When you use your default settings, everything you say may be recorded through your device’s onboard microphone. Our phones routinely collect our voice data, store it in a distant server, and use it for marketing purposes. This fact was kept quiet for some time, but this kind of targeted ad is gradually becoming common knowledge.

As a “prime” example, tap or click here to see what Amazon does with the voice data it harvests and how you can stop Alexa from listening.

Your phone isn't the only device that's watching and listening to you. The FBI warns hackers can take over your smart TV if you don't secure it. Tap or click to learn how to take control of your privacy on your TV before it’s too late.

Before you ask, yes, it’s perfectly legal, and developers claim not to abuse this practice. But that doesn’t mean you have to like it; many people are startled to see ads for things they have only spoken about, not search for on their browsers. Luckily, there are ways to stop your devices from eavesdropping on you.

When you think about it, smartphones are equipped with an arsenal of monitoring equipment: multiple microphones and cameras are designed to absorb audio and video. While these tools may be useful for creating media, they are also a goldmine for advertisers.

In mid-2018, a reporter for Vice experimented to see just how closely smartphones listen to our conversations. To test his phone, the journalist spoke pre-selected phrases twice a day for five days in a row. Meanwhile, he monitored his Facebook feed to see if any changes occurred.

Sure enough, the changes seemed to arrive overnight. One of his test phrases involved going “back to university,” and by the next morning, the reporter saw ads for summer courses. He then changed up his test phrase to "cheap shirts," and quickly saw advertisements for low-cost apparel on his Facebook feed.

This report triggered a wave of studies on the surveillance effects of social media platforms.

While not every study provided clear answers, a general sense of agreement on the matter was reached due to hints in the User Agreements of several apps and social media platforms. Tap or click for an easy way to spot what’s hiding in the User Agreement of your favorite platforms.

These user agreements explicitly state recorded audio may be used for targeted advertising purposes. Interestingly, such practices aren't against the law. This action allows tech companies to push the privacy boundaries even further to encourage us to buy things we don't need.

If you’re not comfortable with targeted ads, there are ways to mitigate your smartphone’s spy power. That said, you may lose access to some handy features like wake words and voice assistants, so you’ll have to decide whether these features are worth sacrificing your privacy.

The biggest vulnerability comes from the "always-on" feature of most voice assistants. To pick up wake words like "Hey Siri," the mic needs to remain on at all times – which means your phone is always listening.

The best place to start taking your privacy back is by turning off the "always-on" microphone features on your handset. Here's how to do it.

Apple has come under fire for transcribing audio recordings of Siri users. The data is locally stored on your device and is uploaded once Siri is activated, so disabling this feature will at least make your Siri inputs shorter and more specific to your requests.

To turn off “Hey Siri,” navigate to your iOS device’s Settings, followed by Siri & Search. Then, toggle Listen for ‘Hey Siri to Off.

Disable “OK Google”

Every time you use "OK Google," or use another voice-controlled function, your query is recorded, and the transcripts are saved to your Google account. Tap or click here to learn how to remove these recordings and other info you don’t want Google to store.

If you use Google Assistant on Android, open the Google Assistant Settings. Say, "OK Google" or hold down the phone's home button, then tap the file drawer icon found on the upper right-hand corner, and tap the three-dot menu. Select More and choose Settings.

From this point, you’ll want to scroll down to the devices category and select your phone, then in the Google Assistant section near the top, tap the blue slider button to change it gray, which turns off Google Assistant.

Disable mic access for apps

Disabling the always-on microphone features from your phone isn’t enough for some apps like Facebook. The social site makes exceptions to the rule and will keep on listening unless you make the change.

This is just one of the many privacy settings you really should be using if you have a Facebook account. Tap or click for more ways to lock down your profile.

Here’s how you can turn audio recording off for Facebook, but the same steps apply for any app that uses the microphone:

iPhone

Go to Settings >> Facebook >> Settings in the sub-menu. Slide the Microphone switch to the left, so it turns from green to white. That turns it off. Alternatively, you can go to Settings >> Privacy >> Microphone then look for Facebook to do the same. Note that you can toggle the mic on and off for other apps, too.

Android

Open Settings, then choose Applications and Application Manager. Look for Facebook, and tap App Permissions, then toggle the microphone off.

Keep in mind, turning off Facebook’s microphone access will affect and disable certain features like Live Video. If you’re going to use these features, you will have to toggle the mic back on. Follow the same steps above, but make sure the toggle is set to On, and you’ll be good to go.

Bonus Tip for More Know-How:

Amazon has previously come under fire for violating the privacy of its users with Alexa. The famous voice assistant was revealed to be recording users’ inquiries and storing the recordings for human reviewers to analyze. The exposure caused Amazon to make several drastic changes to its products and privacy policy.

Tap or click here for 3 new Alexa privacy settings you need to know about.

What digital lifestyle questions do you have? Call Kim’s national radio show and tap or click here to find it on your local radio station. You can listen to or watch the Kim Komando Show on your phone, tablet, television or computer. Or tap or click here for Kim’s free podcasts.

Copyright 2020, WestStar Multimedia Entertainment. All rights reserved.

Learn about all the latest technology on the Kim Komando Show, the nation's largest weekend radio talk show. Kim takes calls and dispenses advice on today's digital lifestyle, from smartphones and tablets to online privacy and data hacks. For her daily tips, free newsletters and more, visit her website at Komando.com.

Bangkok, Thailand - September 25, 2014 : Apple iPhone5s held in one hand showing its screen with ... [+] Siri application icons.

Getty

If Apple’s apology about employees snooping on private Siri conversations is any indication, our devices are listening to us in more ways than we realize. 

Compared to previous eras, nearly everything today is recorded and stored for posterity. Computer science academics at Northeastern University conducted research with 17,000 of the most popular apps on Android and as Gizmodo reported, apps were found to be “recording the phone’s screen and sending that information out to third parties.” 

To be fair, the likelihood of audio files of every conversation you have being transmitted and transcribed in full and then analyzed by an actual person is low. However, there are plenty of ways for algorithms and artificial intelligence to “listen” to you — and then use that data to target ads to you. While we’re aware of popular audio triggers like “Hey Siri” or “Alexa”, these sites and apps may also have hundreds or thousands of their own triggers used to store data points when you say what you like and where you go.

Over the past few decades, what used to require tedious sleuthing has become automated, as users have unwittingly given their information away freely. Nobody reads the terms and conditions, we just want to log in and share with our friends. 

According to Gallup Research, 80% of millennials place “some” or “a lot” of trust in companies to keep their data secure, and are the generation most likely to say they think that their data is kept private. The truth is you have no right to privacy — and you probably never did. 

Your data is already “out there”

Perhaps you downloaded FaceApp in the heat of the #OldAgeChallenge, then deleted the app out of concerns it would take your photos and data. Once you’ve downloaded and authorized the app, however, its creators have access to whatever data they want. Deleting it afterward does very little to protect your privacy. Some companies even acquire defunct apps simply to access user data.

Steve Wozniak said about private data: “I’m worried about everything. I don’t think we can stop it though.” His advice to anyone who cares about their privacy is to “figure out a way to get off Facebook." The problem is “leaving” any social platform doesn’t erase the data you or your network has shared — and it opens the door for a lot of other sacrifices, too. 

There’s little recourse considering none of what is happening is illegal. The entire system of social media supported by ads is flawed since it’s all geared to benefit advertisers and not users. And the results range from effective advertising boosting shareholder profits to swinging elections. Unless the laws or online advertising ecosystem are changed, then these tactics will only become more refined.

Big data, AI and algorithms deliver more than just ads

Technology companies use algorithms to target ads more effectively, and the more data they have, the more precise the campaigns are. This makes these ads much more influential than ads meant for a general public. Technosociologist Zeynep Tufekci explains it this way: machine learning has enabled algorithms to learn, adjust and improve advertising targeting to the point that no human would understand or know exactly how it is targeting users. More disturbing than that is the possibility that “a platform like that could decide to turn out voters for one side or another,” Tufekci said, “and how would we even know about it?”  

The Netflix documentary “The Great Hack” also suggests that the data being collected is just allowing ads to predict our behavior extremely accurately, rather than simply listening to our microphones. Even if one of your friends authorized an app on their Facebook, that app still managed to harvest a lot of your data — and with enough data points you can scale this to impact elections and policy in entire countries, not to mention the consumer behavior of people in certain vulnerable demographics. 

Ways to protect your online privacy

Despite the fact that it might seem hopeless, you should still care about your privacy even if you have nothing to hide. So what can you do if most of your data is already available and there’s always a better way to track and capture the rest? 

One step you could take is to use some services based in countries with more strict privacy laws.

If you’re looking for anonymity, you’d use the Tor browser for any web browsing. You’d only want to use a search engine that respects your privacy like Duck Duck Go, StartPage, or searx, and use an encrypted email provider based in Switzerland like ProtonMail, or one based in Norway like Runbox. For your phone and devices you can use screen protectors and camera covers. You can turn off your phone's microphone and for private messaging you'd use apps like Dust or Signal to send encrypted texts. You can find more digital privacy tools here. And for apps connected to Facebook, you can make sure to log in and remove their permissions. 

Your phone and the apps within it are collecting signals based on many different data points. These signals can and will influence how advertisers can target you. As other people can access this data in very easy ways, you should be mindful and prudent about what technology you use, and whether the benefits you get from it outweigh the loss of privacy. 

Because unless you use a flip phone and a typewriter, your tech will want to track, analyze and sell to you for the foreseeable future.