Using Bulk Processing
The Dynamics 365 Bulk API feature allows you to fine-tune the performance of your Dynamics 365 target connection. When using Dynamics 365 as a target, you can use the Bulk Processing section of the Settings dialog box for the Adapter for Dynamics 365 and CRM to:
- Adjust the number of threads that your system uses to process records.
- Select Use Dynamics 365 Bulk API to group records into batches of 200.
Tip: Using the bulk API can provide higher throughput when dealing with large volumes of records, and may result in performance improvements.
For more information about using the Bulk Processing settings, see Additional Adapter Settings.
Before you Begin
The Dynamics 365 Bulk API feature works in conjunction with Insight Bulk Mode to optimize performance. There are many factors to consider when using Insight Bulk Mode and the Dynamics 365 Bulk API. It is important that you understand how Insight Bulk Mode works before using Dynamics 365 Bulk API. See Using Bulk Operations in the TIBCO Scribe® Insight Help to learn about bulk operations.
How Insight Bulk Mode and the Dynamics 365 Bulk API Work Together
As with Insight Bulk Mode operations, Dynamics 365 Bulk API functionality is available on a per-step basis. That is, if Insight Bulk Mode is turned off for a step, the Dynamics 365 Bulk API is also disabled for that step.
For any step in the TIBCO Scribe® Insight Target pane:
- If Insight Bulk Mode is off, the Use Bulk mode check box is not selected, one record is processed or sent to the Adapter for Dynamics 365 and CRM in a single transaction.
- If Insight Bulk Mode and the Dynamics 365 Bulk API are both selected:
- For each step, TIBCO Scribe® Insight processes the number of records specified for Insight Bulk Mode in a single transaction.
- Additionally, the Dynamics 365 Bulk API functionality is enabled, which allows you to:
- Specify the number of threads for Dynamics 365 to use to process records received from TIBCO Scribe® Insight.
- Group records received from Insight into batches of up to 200 records per thread.
The following table shows the relationship of the Insight Bulk Mode and the Dynamics 365 Bulk APIfunctionality.
| Insight Bulk Mode | Dynamics 365 Bulk API | Dynamics 365 Bulk API | Multi-threading |
|---|---|---|---|
|
Off |
Off | Disabled | Disabled |
|
On
|
On | Enabled | Enabled |
| Off | Disabled |
About Bulk Processing
The Dynamics 365 Bulk API feature provides two settings to adjust Adapter for Dynamics 365 and CRM performance. When correctly adjusted, these settings can optimize the performance of Dynamics 365 to match the performance capabilities of your system.
You have the option to use one or both of the following:
- Thread count — Allows you to set the number of threaded calls to the Dynamics 365 API, multi-threading. Thread Count specifies the number of threads, 1-64, to use to process the records the Adapter for Dynamics 365 and CRM receives from TIBCO Scribe® Insight. Each thread handles one record, or batch of records, at a time. For example, if the Dynamics 365 Adapter Thread Count is set to 20 with the Dynamics 365 Bulk API off, and the Adapter for Dynamics 365 and CRM receives 400 records from TIBCO Scribe® Insight to process, the Adapter for Dynamics 365 and CRM processes 20 records at a time, and takes 20 iterations to complete.
- Use Dynamics 365 Bulk API — Allows you to enable or disable use of the Dynamics 365 Bulk API. The Dynamics 365 Bulk API groups records that the Adapter for Dynamics 365 and CRM receives into batches of up to 200 records at a time. Each batch uses one of the threads set in Thread Count. For example, if the Dynamics 365 Bulk API is on, with the Thread Count set to 20, and Dynamics 365 receives 400 records to process, it groups the records into two batches of 200 records, and uses two of the 20 available threads.
See also