Sign inTry Free

Install SingleStore Flow

On this page

Overview

The SingleStore Flow ("Flow") system allows you to migrate data and do continuous change data capture (CDC). Flow has two primary components:

  • Ingest: Ingest transfers the schema for all tables, moves table data for small tables (typically up to 10GB in size), and handles ongoing CDC of changes for all tables into SingleStore.

  • XL Ingest: XL Ingest handles the initial transfer of large tables by breaking these tables into smaller logical partitions. It then copies multiple partitions from the source to the target in parallel. This helps transfer large tables in a reasonable amount of time.

To use Ingest and XL Ingest, install the products and, once installed, provide the product IDs to either team@singlestore.com or your account representative to obtain either a paid license or a Developer trial license.

Prerequisites

System Requirements

  • VM requirements: Minimum of 2 vCPUs, 8 GB RAM, and 100 GB of free disk space (or twice the size of the largest table you plan to extract with Ingest or XL Ingest). The VM must be close to the source database system to minimize latency.

Browser Requirements

Java Installation

Prerequisites for Supported Source Databases

Prerequisites for SingleStore Destination

Grant the following privileges to non-admin or service users of the SingleStore database:

GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, DROP ON <database_name>.* TO <user_name>;

Refer to GRANT for more information.

For information about creating new users, refer to CREATE USER.

In this section

Last modified: March 13, 2025

Was this article helpful?

On this page

Was this article helpful?

Verification instructions

Note: You must install cosign to verify the authenticity of the SingleStore file.

Use the following steps to verify the authenticity of singlestoredb-server, singlestoredb-toolbox, singlestoredb-studio, and singlestore-client SingleStore files that have been downloaded.

You may perform the following steps on any computer that can run cosign, such as the main deployment host of the cluster.

  1. (Optional) Run the following command to view the associated signature files.

    curl undefined

  2. Download the signature file from the SingleStore release server.

    • Option 1: Click the Download Signature button next to the SingleStore file.

    • Option 2: Copy and paste the following URL into the address bar of your browser and save the signature file.

    • Option 3: Run the following command to download the signature file.

      curl -O undefined

  3. After the signature file has been downloaded, run the following command to verify the authenticity of the SingleStore file.

    echo -n undefined |
        cosign verify-blob --certificate-oidc-issuer https://oidc.eks.us-east-1.amazonaws.com/id/CCDCDBA1379A5596AB5B2E46DCA385BC \
          --certificate-identity https://kubernetes.io/namespaces/freya-production/serviceaccounts/job-worker \
          --bundle undefined \
          --new-bundle-format -
    Verified OK