Configuration of XL Ingest
Warning
SingleStore 9.0 gives you the opportunity to preview, evaluate, and provide feedback on new and upcoming features prior to their general availability. In the interim, SingleStore 8.9 is recommended for production workloads, which can later be upgraded to SingleStore 9.0.
On this page
You can configure XL Ingest through the Web console.
The screen displays the following tabs:
Dashboard
Navigate to the Dashboard tab.
Configuration
Navigate to the Configuration tab.
Location of CDC Installation |
Enter the path for Ingest. |
Web Port |
Enter the port of XL Ingest ( |
No. |
Enter the number of source threads. |
No. |
Enter the number of destination threads. |
Product Id |
By default, the product ID is the field. |
Licence Key |
Enter the license key. |
Expiry |
Displays the expiration date of your license. |
Delete on Sync |
Enable or disable as per your requirements. |
Select Save to save the settings.
Table Setup
Table setup allows you to configure the tables.
-
Navigate to the Table Setup tab.
-
Select the tables from the list on the left to be processed in XL Ingest.
-
In the Table Settings page, choose the slicing column (typically the primary key).
For partitioned tables, slicing is automatically handled by XL Ingest. -
Select the Auto-slice button to automatically generate slices for large tables.
Select the Schedule Count button to retrieve the number of records in the table, then enter the following auto-slice parameters: -
No.
of Slices: Number of slices to split the table into. -
Round-off: Number of trailing significant digits to ignore when estimating the slice size.
Simplifies the calculation by focusing only on the most significant digits of the total record count.
-
-
The Schedule Slice button is enabled only after the count is determined.
Table Status
After selecting and configuring the tables, the tables appear in the Table Status page.
-
Navigate to the Table Status tab.
It displays the status of each table and a bar graph indicating the amount of data transferred.
-
Select a table to view its slicing status and progress.
Table Slicing Status
The Table Slicing Status page displays the list of all slices or partitions of the table.
-
The following are the buttons for each slice to schedule:
-
Compare: Schedules a comparison of the slice between the source and destination database.
-
Force Compare: If compared earlier, forces a comparison of the slice between the source and destination databases.
-
Sync.
Schedules the transfer of data between source and destination databases. -
Force Sync: If the data has been synced previously, forces the transfer of the data between the source and destination databases.
-
-
The color of each button indicates the state of the respective task as follows:
-
Dark blue: Task can be scheduled and is recommended.
-
Light blue: Task can be scheduled but no urgent action is required.
-
Red: Task is scheduled and can be canceled before it runs, as required.
-
Grey: Task is in progress.
-
Schedule Tasks
XL Ingest tasks are long-running and cannot be executed immediately.
-
Select Schedule Compare for the slice to start the slice comparison between the source and destination databases.
-
Select Schedule Sync for the slice to start the synchronization of data between the source and destination databases.
-
View the status of scheduled tasks in the Task Status page.
Task Status
The Task Status page displays the list of the tasks in the last 24 hours.
-
Navigate to the Task Status tab.
-
Tasks are categorized as follows:
-
Completed
-
Scheduled
-
Running
-
Failed
-
-
Tasks can be filtered and monitored for progress.
You can cancel scheduled tasks before they start, as required.
Last modified: January 24, 2025