• Home
  • About Us
  • Contact Us
  • Privacy Policy
  • Special Offers
Business Intelligence Info
  • Business Intelligence
    • BI News and Info
    • Big Data
    • Mobile and Cloud
    • Self-Service BI
  • CRM
    • CRM News and Info
    • InfusionSoft
    • Microsoft Dynamics CRM
    • NetSuite
    • OnContact
    • Salesforce
    • Workbooks
  • Data Mining
    • Pentaho
    • Sisense
    • Tableau
    • TIBCO Spotfire
  • Data Warehousing
    • DWH News and Info
    • IBM DB2
    • Microsoft SQL Server
    • Oracle
    • Teradata
  • Predictive Analytics
    • FICO
    • KNIME
    • Mathematica
    • Matlab
    • Minitab
    • RapidMiner
    • Revolution
    • SAP
    • SAS/SPSS
  • Humor

NortonLifeLock’s AI-powered smartphone app blurs out sensitive information in photos

February 25, 2021   Big Data

With some regularity, sensitive information finds its way into smartphones and other mobile devices. Much of it comes from the estimated 3.2 billion images uploaded every day — people screenshot documents like tickets, tax forms, and medical prescriptions without thinking twice. This makes them susceptible to risks like identity theft and ransomware, among other problems. In 2019 alone, 14.4 million consumers became victims of identity fraud, or about 1 in 15 people.

In an effort to address this, data scientists at NortonLifeLock Labs, the R&D division of antivirus vendor NortonLifeLock, released an AI-powered iOS app designed to protect sensitive photos of passports, Social Security cards, passwords, credit cards, and more. Called Xposure, it identifies sensitive images, copies them to a secure vault, and either deletes the originals or replaces them with blurred-out placeholders.

“Depending on the device and types of photos, we can scan about 1,000 pictures per minute with minimal false positives,” Dan Marino, technical director at NortonLifeLock, told VentureBeat via email. “Xposure’s main problem to solve is privacy, which includes privacy from Norton as well. That is the main reason why the machine learning models we have trained run on the user’s device and user’s images and data are never shared with us.”

 NortonLifeLock’s AI powered smartphone app blurs out sensitive information in photos

NortonLifeLock’s research team had to tackle four main challenges while developing Xposure, according to Marino. The AI models powering the app had to be trained on stock images that didn’t contain any personally identifiable information, a difficult task given that there wasn’t a sufficient number images to train the models from scratch. For privacy reasons, all AI inferencing had to be done on users’ devices as opposed to in the cloud. And most importantly, the models had to achieve high processing speeds and accuracy. Because most AI-based image classifiers work on low-resolution images, they tend to flag any image with the same general characteristics, leading to false positives.

At the heart of Xposure is its on-device detection engine, which determines whether an image is sensitive or not using a combination of classifiers based on convolutional neural networks and optical character recognition (OCR). In machine learning, convolutional neural networks are a class of algorithm most commonly applied to analyzing visual imagery.

“The convolutional neural network separates images into sensitive and non-sensitive categories based on general visual features,” Marino explained. “We built [it] using transfer learning, a technique that takes a neural network built to solve one task and retrains it slightly, often with much less data, to do a different task. Synthetic data augmentation helped to create more training data by the varying angles, brightness, and zoom of the stock images [that we used to train the model].”

 NortonLifeLock’s AI powered smartphone app blurs out sensitive information in photos

Meanwhile, the OCR component of Xposure’s engine identifies the text in images and keywords that correspond to documents like “Passport,” “Date of Issue,” and “Date of Birth.” In contrast to a visual classifier, OCR requires higher-definition images, which causes a slowdown not only due to increased processing but because phones often store only low-resolution copies of images to save space. In order to apply OCR, Xposure has to download the high-resolution original from the cloud, which is why the engine only leverages OCR if the convolutional neural network detects an image is likely to be sensitive.

“OCR doesn’t perform accurately if the image is tilted or upside down and Xposure uses smarts to identify when OCR needs to be run from different orientations,” Marino said.

In one final check, Xposure presents images flagged as sensitive by the classifier but not OCR to users for review as potentially sensitive, so they can manually add them to the vault. Original images can only be accessed through the vault, which is password-protected and encrypted, or by selecting the placeholder and unblurring it via a special app extension.

 NortonLifeLock’s AI powered smartphone app blurs out sensitive information in photos

Marino says that Xposure’s hybrid approach achieves a low false positive rate — around 0.75% — while mitigating the OCR component’s sensitivity to languages it doesn’t recognize.

Separate from the vault, Xposure offers a feature called PhotoBlur, which creates a blurred version of a photo when a user comes across it in their photo library. Tapping and holding on the screen reveals the original, unblurred photo, offering a balance between protection and ease of use.

“We urgently need a solution that detects sensitive and private images on our phones and hides them away from curious onlookers, hackers, and buggy apps. The situation has only gotten worse during the pandemic, because most business is conducted online, and people are forced to click and share sensitive documents through their phones,” Marino said. “We believe Xposure delivers on NortonLifeLock’s vision to protect and empower people to live their digital lives safely and provides customers with an innovative solution to help keep their private photos private.”

VentureBeat

VentureBeat’s mission is to be a digital town square for technical decision-makers to gain knowledge about transformative technology and transact.

Our site delivers essential information on data technologies and strategies to guide you as you lead your organizations. We invite you to become a member of our community, to access:

  • up-to-date information on the subjects of interest to you
  • our newsletters
  • gated thought-leader content and discounted access to our prized events, such as Transform
  • networking features, and more

Become a member

Let’s block ads! (Why?)

Big Data – VentureBeat

AIPowered, blurs, information, NortonLifeLock’s, photos, Sensitive, smartphone
  • Recent Posts

    • Accelerate Your Data Strategies and Investments to Stay Competitive in the Banking Sector
    • SQL Server Security – Fixed server and database roles
    • Teradata Named a Leader in Cloud Data Warehouse Evaluation by Independent Research Firm
    • Derivative of a norm
    • TODAY’S OPEN THREAD
  • Categories

  • Archives

    • April 2021
    • March 2021
    • February 2021
    • January 2021
    • December 2020
    • November 2020
    • October 2020
    • September 2020
    • August 2020
    • July 2020
    • June 2020
    • May 2020
    • April 2020
    • March 2020
    • February 2020
    • January 2020
    • December 2019
    • November 2019
    • October 2019
    • September 2019
    • August 2019
    • July 2019
    • June 2019
    • May 2019
    • April 2019
    • March 2019
    • February 2019
    • January 2019
    • December 2018
    • November 2018
    • October 2018
    • September 2018
    • August 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • February 2017
    • January 2017
    • December 2016
    • November 2016
    • October 2016
    • September 2016
    • August 2016
    • July 2016
    • June 2016
    • May 2016
    • April 2016
    • March 2016
    • February 2016
    • January 2016
    • December 2015
    • November 2015
    • October 2015
    • September 2015
    • August 2015
    • July 2015
    • June 2015
    • May 2015
    • April 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
© 2021 Business Intelligence Info
Power BI Training | G Com Solutions Limited