• Home
  • About Us
  • Contact Us
  • Privacy Policy
  • Special Offers
Business Intelligence Info
  • Business Intelligence
    • BI News and Info
    • Big Data
    • Mobile and Cloud
    • Self-Service BI
  • CRM
    • CRM News and Info
    • InfusionSoft
    • Microsoft Dynamics CRM
    • NetSuite
    • OnContact
    • Salesforce
    • Workbooks
  • Data Mining
    • Pentaho
    • Sisense
    • Tableau
    • TIBCO Spotfire
  • Data Warehousing
    • DWH News and Info
    • IBM DB2
    • Microsoft SQL Server
    • Oracle
    • Teradata
  • Predictive Analytics
    • FICO
    • KNIME
    • Mathematica
    • Matlab
    • Minitab
    • RapidMiner
    • Revolution
    • SAP
    • SAS/SPSS
  • Humor

Data Management and Integration Using Data Entities – Part 3

February 9, 2018   Microsoft Dynamics CRM
Feature Image 2 300x225 Data Management and Integration Using Data Entities – Part 3

In part 3 of our blog series on Dynamics 365 Finance and Operations data management and integration, we continue to explore various integration types using data entities. Dynamics 365 for Finance and Operations provides standard out of the box data entities across the modules that can be used as is or with applying extensions. However, you can also build custom entities to address your specific modification needs. The custom data entities need to be created within your development model and extensions.

Asynchronous integrations are used in business scenarios where very large amounts of data need to be imported / exported via files or in the case of recurring periodic jobs without compromising the performance of the system. Data entities support asynchronous integration through Data Management Framework (DMF). It enables asynchronous high-performing data insertion and extraction, and is used for:

  • Interactive file-based import/export (Using DMF)
  • Recurring integrations (file, queue, and so on) (Using DMF / OData)

To access the Dynamics 365 Data Management Framework:

  • Click on your Dynamics 365 URLàSystem administrationàData Management

020818 2109 DataManagem1 Data Management and Integration Using Data Entities – Part 3

The Data Management Framework components for performing the Asynchronous Integration are specified below:

Data Import Export Framework is responsible for uploading files from shared folders, transform the data to populate them into staging tables, validate and map the data to the destination tables. This type of integration is particularly useful for doing the Bulk Data upload and will be considered for doing the one-time full load.

For One-time Full Load – Using the Data Import / Export Framework:

ERP Data Management and Integration Using Data Entities – Part 3
 Data Management and Integration Using Data Entities – Part 3

The above diagram depicts the overall architecture of the framework. The Data Import / Export Framework creates a staging table for each entity in the Microsoft Dynamics Finance and Operations database where the target table resides. Data that is being migrated is first moved to the staging table. Business users / decision makers can verify the data and perform any cleanup or conversion that is required. Post validation and approval of the data can be moved to the target table or exported.

The data flow goes through three phases:

  • Source – These are inbound data files or messages in the queue. Data formats include CSV, XML, and tab-delimited.
  • Staging – Staging tables are generated to provide intermediary storage, this enables the framework to do high-volume file parsing, transformation, and some validations.
  • Target – This is the actual data entity where data will be imported into target table.

ODataAuth

OData Integration uses a secure REST application programming interface (APIs) and an authorization mechanism to receive and send back data to the integration system, which is consumed by the data entity and DIXF. It supports single record and batch records. This type of integration is useful for doing the incremental / recurring uploads as it enables transfer of document files between Dynamics 365 and any other third party application or service further it can be reused / automated at the specified interval.

For Incremental / Recurring Integration – Using OData Framework:

020818 2109 DataManagem2 Data Management and Integration Using Data Entities – Part 3

You need to follow these setups to configure the asynchronous one time and recurring integration jobs in Dynamics 365:

1. Create data project:

  • On the main dashboard, click the Data management tile to open the data management workspace.
  • Click the Import or Export tile to create a new data project.
  • Enter a valid job name, data source, and entity name.
  • Upload a data file for one or more entities. Make sure that each entity is added, and that no errors occur.
  • Click Save.

020818 2109 DataManagem3 Data Management and Integration Using Data Entities – Part 3

2. Create recurring data job

  • On the Data project page, click Create recurring data job.
  • Enter a valid name and a description for the recurring data job.
  • On the Set up authorization policy tab, enter the application ID that was generated for your application, and mark it as enabled.

020818 2109 DataManagem4 Data Management and Integration Using Data Entities – Part 3

  • Expand Advanced options, and specify either File or Data package.
  • Specify File to indicate that your external integration will push individual files for processing via this recurring data job.
  • Specify Data package to indicate that you can push only data package files for processing. A data package is a new format for submitting multiple data files as a single unit that can be used in integration jobs.
  • Click Set processing recurrence, and set a valid recurrence for your data job.
    020818 2109 DataManagem5 Data Management and Integration Using Data Entities – Part 3
  • Click Set monitoring recurrence, and provide a monitoring recurrence.
  • Click OK, and then click Yes in the confirmation dialog box.

There you have it! Stay tuned as we will continue to cover other the Data Entity Management and Integration scenarios around Business Intelligence, Common Data services and Application Life Cycle Management.

Subscribe to our blog for more guides to Dynamics 365 for Finance and Operations!

Happy Dynamics 365’ing!

Let’s block ads! (Why?)

PowerObjects- Bringing Focus to Dynamics CRM

data, Entities, Integration, Management, Part, using
  • Recent Posts

    • New Customer Experience Needs and Commerce Trends for 2021
    • A data transformation problem in SQL and Scala: Dovetailing declarative solutions
    • George Wallace Joins Laverne Cox For Comedy Titled ‘Clean Slate’
    • How Microsoft Azure DevOps and Dynamics 365 CRM Work Together to Improve Service Responsiveness
    • The Benefits of Dynamics 365 Online Versus On-Premise
  • Categories

  • Archives

    • February 2021
    • January 2021
    • December 2020
    • November 2020
    • October 2020
    • September 2020
    • August 2020
    • July 2020
    • June 2020
    • May 2020
    • April 2020
    • March 2020
    • February 2020
    • January 2020
    • December 2019
    • November 2019
    • October 2019
    • September 2019
    • August 2019
    • July 2019
    • June 2019
    • May 2019
    • April 2019
    • March 2019
    • February 2019
    • January 2019
    • December 2018
    • November 2018
    • October 2018
    • September 2018
    • August 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • February 2017
    • January 2017
    • December 2016
    • November 2016
    • October 2016
    • September 2016
    • August 2016
    • July 2016
    • June 2016
    • May 2016
    • April 2016
    • March 2016
    • February 2016
    • January 2016
    • December 2015
    • November 2015
    • October 2015
    • September 2015
    • August 2015
    • July 2015
    • June 2015
    • May 2015
    • April 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
© 2021 Business Intelligence Info
Power BI Training | G Com Solutions Limited