Reprocessing Replicated Data Records
Replication Solutions copy data from a source datastore to a target datastore. If records have not been replicated properly due to a network or server outage, or an incorrect server time, you may need to reprocess records that already exist in your target datastore.
When a Replication Solution executes, TIBCO Scribe® Online locates new or updated source records, based on a datetime field, and only replicates those records. The source Connector specifies the datetime field to be used for the Last Modified Date for each table.
These date fields are used each time a Replication Solution executes to select only new or updated source records for replication. When the Replication Solution executes, TIBCO Scribe® Online checks the target datastore for the most recent date in the date fields specified by the Connector. TIBCO Scribe® Online uses that date to filter records in the source datastore. Records selected for replication include only records newer than the most recent date in any target record in the selected table.
If there is a Fatal Exception during replication, the next time the Replication Solution executes TIBCO Scribe® Online subtracts 500 milliseconds from the date/time field found in the target table where the failure occurred. This ensures that no records are missed, however, a few records may be reprocessed unnecessarily.
If you need to reprocess records, you have the following options:
- Modify the data in the source again. This updates the datetime field forcing the record to be replicated in the target datastore.
- Delete any affected records in the target datastore. For example, assume you want to reprocess all records modified since August 15th. You must open the target datastore and delete any records that are set to August 15th or newer. The next time the Solution is executed it replicates records from August 15th to the present.
- Delete the entire target datastore and replicate all of the records again.
Related Topics
Managing TIBCO Scribe® Online RS Solutions
