Moving Data Between Databases

There are ways to move your data between databases depending on whether SingleStore Helios or SingleStore Self-Managed is where the data is being accessed.

  • SELECT ... INTO OUTFILE , then LOAD DATA INFILE.

    SELECT * FROM table_name_1 INTO OUTFILE '/home/username/file_name.csv'
    FIELDS TERMINATED BY ','
    LINES TERMINATED BY '\n';
    LOAD DATA INFILE '/home/username/file_name.csv'
    INTO TABLE table_name_2;
  • mysqldump with or without filters.

    mysqldump -uroot -p db_name table_name [--where='id<1000000']
  • SELECT ... INTO , CREATE PIPELINE AS LOAD DATA, then START PIPELINE. The following example uses S3, but this will work for HDFS, GCS, KAFKS, FS, and AZURE as well.

    SELECT * FROM table_name_1
    INTO S3 bucket/target
    CONFIG configuration_json
    CREDENTIALS credentials_json
    CREATE PIPELINE pipeline_name AS LOAD DATA S3 'bucket-name' | '<bucket-name/path>'
    [CONFIG '<configuration_json>']
    CREDENTIALS '<credentials_json>'
    INTO TABLE table_name_2;
    START PIPELINE pipeline_name;

Last modified: April 19, 2024

Was this article helpful?

Verification instructions

Note: You must install cosign to verify the authenticity of the SingleStore file.

Use the following steps to verify the authenticity of singlestoredb-server, singlestoredb-toolbox, singlestoredb-studio, and singlestore-client SingleStore files that have been downloaded.

You may perform the following steps on any computer that can run cosign, such as the main deployment host of the cluster.

  1. (Optional) Run the following command to view the associated signature files.

    curl undefined
  2. Download the signature file from the SingleStore release server.

    • Option 1: Click the Download Signature button next to the SingleStore file.

    • Option 2: Copy and paste the following URL into the address bar of your browser and save the signature file.

    • Option 3: Run the following command to download the signature file.

      curl -O undefined
  3. After the signature file has been downloaded, run the following command to verify the authenticity of the SingleStore file.

    echo -n undefined |
    cosign verify-blob --certificate-oidc-issuer https://oidc.eks.us-east-1.amazonaws.com/id/CCDCDBA1379A5596AB5B2E46DCA385BC \
    --certificate-identity https://kubernetes.io/namespaces/freya-production/serviceaccounts/job-worker \
    --bundle undefined \
    --new-bundle-format -
    Verified OK