• Home
  • About Us
  • Contact Us
  • Privacy Policy
  • Special Offers
Business Intelligence Info
  • Business Intelligence
    • BI News and Info
    • Big Data
    • Mobile and Cloud
    • Self-Service BI
  • CRM
    • CRM News and Info
    • InfusionSoft
    • Microsoft Dynamics CRM
    • NetSuite
    • OnContact
    • Salesforce
    • Workbooks
  • Data Mining
    • Pentaho
    • Sisense
    • Tableau
    • TIBCO Spotfire
  • Data Warehousing
    • DWH News and Info
    • IBM DB2
    • Microsoft SQL Server
    • Oracle
    • Teradata
  • Predictive Analytics
    • FICO
    • KNIME
    • Mathematica
    • Matlab
    • Minitab
    • RapidMiner
    • Revolution
    • SAP
    • SAS/SPSS
  • Humor

Initiative targets Hadoop data management, better data policies

January 31, 2015   BI News and Info

People looking to track Hadoop advocate Hortonworks’ moves in the wake of its recent IPO will mull news that the company is pushing better Hadoop data management. The move takes the form of a data governance initiative that includes Aetna, Merck and others. The week also saw news of a Forrester Research survey showing many data management professionals looking toward a day when SQL and NoSQL run together on one platform.

Hortonworks taps Aetna, Merck to join Hadoop governance initiative

Fresh off raising $ 100 million in a December IPO filing, Hadoop platform distributor Hortonworks, Inc. said it was forming a data governance initiative with customers Aetna, Merck and Target, as well as technology partner SAS. The ultimate goal is to provide a higher level of Hadoop data management, and in turn to move Hadoop deeper into enterprise computing.

Data governance is one of the key elements that Hadoop lacks as it seeks to move out of the proof-of-concept stage and deeper into operations at mainstream companies. Data governance is a critical issue for big data, particularly in financial companies, where compliance regulations are strict.

The company is working with end-users to create a flexible rules engine able to enforce data workflows that meet the needs of compliance rules, said Andrew Ahn, director of governance at Hortonworks. Software developed as part of the initiative will include Apache Falcon life-cycle management, the Apache Ranger security framework and a new policy rules engine that includes an audit data store that can hold pertinent metadata.

Ahn is familiar with the ins and outs of financial big data and knows its requirements based on his stints in application development at the New York Stock Exchange and the Pacific Exchange. A lot of the big data effort there is “custodial,” he said.

“We had critical issues between governance and big data,” he said, pointing to the need to comply with U.S. Securities and Exchange Commission (SEC) strictures. Large enterprises face similar challenges as they move advanced Hadoop implementations into production, he said.

The SEC and other regulators require firms to maintain auditable trails of transactional data. While Falcon can set some systems’ policy, a finer level of policy processing is needed for many enterprises; thus, the new initiative.

Hortonworks anticipates a software release as early as this quarter, said Ahn. The plan is to follow up with a formal proposal to become an incubation project within the Apache Software Foundation.

SQL to NoSQL: ‘Someday we’ll be together?’

More than a few folks have dismissed the surge in NoSQL databases that has risen to challenge incumbent SQL. After all, SQL fought off incursions before — object-oriented databases in the 1990s are a prime example — by adding capabilities.

SQL databases continue to add capabilities today. One clear area is Javascript Object Notation (JSON). Much of the NoSQL rise was on the back of JSON. But relational databases from IBM, Oracle, Microsoft, Teradata, EnterpriseDB Corp. and others have added support in recent months.

One driver for trying to consolidate SQL and NoSQL operations into one database is support. The idea of building out a whole new infrastructure for two distinct database types — SQL and NoSQL — garners mixed reactions. That notion is backed up by a survey Forrester Research did for PostgreSQL maker EnterpriseDB. The study combined material from Forrester’s Business Technographics and other research as well as data from a custom survey of 50 U.S.-based IT decision makers responsible for enterprise architecture or application development.

The Forrester data shows that 42% of all survey respondents want to integrate NoSQL databases with relational ones. Meanwhile, 36% of respondents want to store structured and unstructured data together in their standard database. It could be a long time before full-fledged offerings come about, but it is fair to say that vendors are working now to try and absorb the most popular traits of NoSQL databases.

Recommended article: Chomsky: We Are All – Fill in the Blank.
This entry passed through the Full-Text RSS service – if this is your content and you’re reading it on someone else’s site, please read the FAQ at fivefilters.org/content-only/faq.php#publishers.


SearchBusinessAnalytics: BI, CPM and analytics news, tips and resources

Better, data, Hadoop, Initiative, Management, policies, targets
  • Recent Posts

    • “Without Data, Nothing” — Building Apps That Last With Data
    • SO MUCH FOR GLOBAL WARMING, EH?
    • Important Changes to Microsoft Dynamics 365 Field Service Mobile App
    • Syncing Dynamics 365 User Permissions with SharePoint
    • solve for variable in iterator limit
  • Categories

  • Archives

    • January 2021
    • December 2020
    • November 2020
    • October 2020
    • September 2020
    • August 2020
    • July 2020
    • June 2020
    • May 2020
    • April 2020
    • March 2020
    • February 2020
    • January 2020
    • December 2019
    • November 2019
    • October 2019
    • September 2019
    • August 2019
    • July 2019
    • June 2019
    • May 2019
    • April 2019
    • March 2019
    • February 2019
    • January 2019
    • December 2018
    • November 2018
    • October 2018
    • September 2018
    • August 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • February 2017
    • January 2017
    • December 2016
    • November 2016
    • October 2016
    • September 2016
    • August 2016
    • July 2016
    • June 2016
    • May 2016
    • April 2016
    • March 2016
    • February 2016
    • January 2016
    • December 2015
    • November 2015
    • October 2015
    • September 2015
    • August 2015
    • July 2015
    • June 2015
    • May 2015
    • April 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
© 2021 Business Intelligence Info
Power BI Training | G Com Solutions Limited