• Home
  • About Us
  • Contact Us
  • Privacy Policy
  • Special Offers
Business Intelligence Info
  • Business Intelligence
    • BI News and Info
    • Big Data
    • Mobile and Cloud
    • Self-Service BI
  • CRM
    • CRM News and Info
    • InfusionSoft
    • Microsoft Dynamics CRM
    • NetSuite
    • OnContact
    • Salesforce
    • Workbooks
  • Data Mining
    • Pentaho
    • Sisense
    • Tableau
    • TIBCO Spotfire
  • Data Warehousing
    • DWH News and Info
    • IBM DB2
    • Microsoft SQL Server
    • Oracle
    • Teradata
  • Predictive Analytics
    • FICO
    • KNIME
    • Mathematica
    • Matlab
    • Minitab
    • RapidMiner
    • Revolution
    • SAP
    • SAS/SPSS
  • Humor

The Future of Analytics: The Revolution Will Be Unstructured

June 5, 2017   FICO
Osvaldo Driollet The Future of Analytics: The Revolution Will Be Unstructured

Although there has been much speculation over this statistic’s origin, most industry experts agree that 80% to 90% of the world’s data is unstructured data, and about 90% of it has been produced over the last two years alone. Of these unthinkably vast stores, only 0.5% is effectively analyzed and used today.

In the business world, most unstructured data lies in customer-related text, which is abundant and available. However, most organizations don’t know how to efficiently extract predictive elements from unstructured customer data. They’re not sure how to reap the value of these insights by using them to boost the performance of predictive analytics, and make better operational customer decisions. But, done right, extracting valuable predictive insights from huge quantities of text takes just seconds.

The Future Is Unstructured

The tech industry is full of predictions, but in this one, I have high confidence: The future is unstructured –– because unstructured data holds the key to the next generation of intelligent systems, which will be largely based on cognitive analytics and artificial intelligence (AI)-based applications.

How do I know? I’ve spent most of my career as a data scientist at FICO, an analytics company perhaps best known for the FICO® Score, and software solutions that help financial institutions to optimize credit originations and fight financial fraud.

All of these solutions, which are pervasive in the banking world, have structured data as their foundation. But for the past several years, I’ve been exploring new frontiers for FICO, developing novel intelligence analytics across complex networks—the forefront of the analytics revolution.

Specifically, my active research includes knowledge discovery and behavior prediction using supervised and unsupervised machine learning methods, as well as relational learning and network probabilistic inference methods. For those of you who aren’t data scientists that translates into using unstructured data analysis and relational learning to drive predictive analytics solutions for applications as diverse as:

  • Credit originations
  • Fraud, waste and abuse detection
  • Insurance prediction and modeling
  • Risk stratification and minimization
  • Anticipating of resource demands
  • Improving marketing campaigns and customer retention management strategies.

I’ve also been responsible for several exciting proof-of-concept initiatives that have both commercial and public sector applications. In all of these endeavors, I’ve been excited by a common thread: the predictive power of text analytics and graph-based methods to improve classical machine learning recipes.

What Is Text Analytics?

Text analytics helps to deliver fresh intelligence by mining a major category of unstructured data, the massive stores of customer data many organizations currently have on hand. Here are several important benefits:

  • Discovery through machine learning: Text in email messages, call center logs, CRM applications and collection agent notes is readily understood by people, but it’s meaningless to traditional predictive models. Machine learning methods, however, can determine what textual data is about and classify it for further analysis. These methods can discover customer characteristics and transform them into structured numerical inputs that, in turn, can be used in predictive models and traditional analytic algorithms.
  • Handling complexity: Unstructured and semi-structured text (e.g.., XML files, Excel spreadsheets, weblogs) is inherently complex since it may contain a wide range of content on a broad array of topics. Moreover, the potential value of text analysis is often increased by combining text of different types from multiple sources. Such a comprehensive approach may reveal complex, subtle customer behavior patterns not evident in smaller, more homogeneous document sets.But the task of collating, regularizing and organizing diverse data would be impossible without today’s advanced technologies. We now have the analytic techniques and data infrastructures to essentially merge disparate varieties of text into one “document” for analysis.
  • Facilitating engineering, deployment, management and regulatory compliance: While text and the process of analyzing it can be quite complex, the results need to be simple to understand and use. Today we can bring new insights from text analysis into predictive scorecards, for example, maintaining all the advantages they provide.

The resulting scorecard has higher predictive power, but can still be engineered to meet specific business needs and regulatory requirements. It’s easily deployed into rules-driven decision processes and operational workflows. It’s easy to manage, including tracking performance, automating updates and measuring the impact of change. The contribution of text analysis is transparent, explainable to regulators, and documentable through automated audit trails and regular validation and compliance reporting.

In my next blog I’ll take a deeper dive into how text analytics are used to boost the predictive power of scorecard models. In the meantime, if you’d like to learn more about FICO’s latest research in unstructured data, read my scientific paper published by IEEE, “Mining and Visualizing Associations of Concepts on a Large-scale Unstructured Data.” Follow me on Twitter @odriollet … and ¡viva la revolución analítica!

Let’s block ads! (Why?)

FICO

analytics, future, Revolution, Unstructured
  • Recent Posts

    • Accelerate Your Data Strategies and Investments to Stay Competitive in the Banking Sector
    • SQL Server Security – Fixed server and database roles
    • Teradata Named a Leader in Cloud Data Warehouse Evaluation by Independent Research Firm
    • Derivative of a norm
    • TODAY’S OPEN THREAD
  • Categories

  • Archives

    • April 2021
    • March 2021
    • February 2021
    • January 2021
    • December 2020
    • November 2020
    • October 2020
    • September 2020
    • August 2020
    • July 2020
    • June 2020
    • May 2020
    • April 2020
    • March 2020
    • February 2020
    • January 2020
    • December 2019
    • November 2019
    • October 2019
    • September 2019
    • August 2019
    • July 2019
    • June 2019
    • May 2019
    • April 2019
    • March 2019
    • February 2019
    • January 2019
    • December 2018
    • November 2018
    • October 2018
    • September 2018
    • August 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • February 2017
    • January 2017
    • December 2016
    • November 2016
    • October 2016
    • September 2016
    • August 2016
    • July 2016
    • June 2016
    • May 2016
    • April 2016
    • March 2016
    • February 2016
    • January 2016
    • December 2015
    • November 2015
    • October 2015
    • September 2015
    • August 2015
    • July 2015
    • June 2015
    • May 2015
    • April 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
© 2021 Business Intelligence Info
Power BI Training | G Com Solutions Limited