Load Data with SingleStore Flow
On this page
Overview
SingleStore Flow (or, "Flow") is SingleStore's data migration and change data capture (CDC) solution which is comprised of two primary components:
-
SingleStore Ingest, also referred to as "Ingest," transfers the schema for all tables, moves table data for tables up to 10GB in size, and handles ongoing CDC for all tables into SingleStore.
-
SingleStore XL Ingest, also referred to as "XL Ingest," handles the initial transfer of large tables by breaking them into smaller logical partitions.
It then copies multiple partitions from the source to the target in parallel. This helps transfer large tables in a reasonable amount of time.
Flow supports the following source databases for transfer to SingleStore:
-
Oracle
-
Microsoft SQL Server
-
MySQL
-
PostgreSQL
Prerequisites
While the database prerequisites will vary based on the source, the following are the minimum requirements for using both Ingest and XL Ingest.
Component |
Requirements |
Virtual Machine (VM) |
A minimum of 2 vCPUs, 8 GB RAM, and 100 GB of free disk space -- or -- twice the size of the largest table you plan to extract with Ingest or XL Ingest The VM must be close to the source database to minimize latency. |
Browser |
A Chromium-based browser, such as Google Chrome or Microsoft Edge, installed on the VM |
Java |
Amazon Corretto Java 21, a no-cost distribution of the Open Java Development Kit (OpenJDK), installed on the VM |
Get Started Using SingleStore Flow
Click on a link to download the desired guide(s) to start using SingleStore Flow.
Last modified: January 8, 2025