Operations
On this page
Operations allows to manage and troubleshoot the data pipeline, control the synchronization process, and handle the schema changes.
Select the following according to your requirements.
-
On/Off toggle: Turns the scheduler on or off.
When the scheduler is disabled, Ingest stops looking for changes in the source database. If the scheduler state changes either manually or automatically (e.
g. , after a service restart or user change to the toggle), a message appears next to the it explaining the reason for the state change (e. g. , "Manual on", "Restore on startup"). Same as the On/Off toggle in the Schedule section of the dashboard.
-
Full Extract: Trigger the initial bulk load for all the selected tables, except those marked as Skip Initial Extract.
Every Ingest pipeline must undergo a full extract at least once to begin with. -
Sync New Tables: Trigger the initial bulk load for tables marked as Redo Initial Extract and newly added tables in an ongoing replication.
This operation cannot replace a full extract. -
Sync Struct: Compare and fix the table structure in the destination database.
Load fails if the schema changes. The operator identifies when the load started failing and rolls back to a point just before the initial failure. During this operation, Ingest compares and updates the structure of the destination table without losing data. If a significant amount of time has passed or the log file is unavailable, triggers a Redo Initial Extract to sync the table. -
Rollback: Replay logs from a specific point to reapply changes to the destination.
If the primary key columns are correctly selected, there should be no duplicates in the destination table. Rollback affects all tables in the selected list. -
Manual Delta : Triggers a manual delta extract to process incremental changes.
Rollback
In the event of unexpected issues, such as intermittent source database outages or network connectivity problems, you can rollback Ingest to a point in time before the issue occurred and replay the changes.
To perform the rollback:
-
Navigate to the Schedule tab.
-
Select Rollback.
-
The rollback screen appears, displaying a list of available rollback points in descending order, depending on the source database log retention policy.
-
Select the desired date (radio button) and Select.
-
Select Rollback to initiate the rollback.
-
Ingest automatically catches up from the selected point in time to the current time that replays all log entries and applies them to the destination.
Last modified: June 18, 2025