SingleStore Replicate

Note

This product is no longer supported.

Overview

SingleStore Replicate is a tool for transferring data from a wide variety of heterogeneous databases into SingleStore Helios. It provides a number of features and functions to tailor how the data is replicated, and offers:

  • A command-line interface for installation, configuration, and use

  • Importing data from certain sources, notably Oracle, via a transaction-consistent point-in-time snapshot

  • Customizable filters and maps to tailor the replicated data

  • SQL 2017, 2016, and 2014 standards compliance

To best take advantage of SingleStore Helios’s flexibility and scalability, data in existing databases can now be moved into SingleStore Helios, allowing data-driven applications to work with minimal changes to either code or data. This capability is especially important when the requirements of the original application have grown beyond the ability to scale the current database, or the database system product hosting the original database has simply become too costly to scale.

Supported Data Sources

SingleStore Replicate supports data transfer from the following sources into SingleStore Helios:

  • AWS Aurora

  • Cassandra

  • DB2 (IBM)

  • Hana (SAP)

  • MemSQL v6.0 and later

  • MongoDB®

  • MySQL

  • Netezza

  • Oracle Enterprise Edition (EE) including Compression and Partitioning and Real Application Workspaces (RAC)

  • PostgreSQL v9.4 and later

  • Salesforce

  • SQL Server (Microsoft)

  • Teradata

  • Vertica

Capabilities and Benefits

Replicate supports high-performance ingest using a parallel, distributed architecture that reduces labor and speeds data transfer, which decreases the time it takes to complete complex data transfer jobs from weeks down to days. Replicate’s benefits grow as the complexity of the data transfer increases.

System Requirements

Physical or virtual machines configured for high performance will make Replicate achieve maximum scaling and replication throughput. An example hardware configuration that typically works well for Replicate consists of:

  • A multi-core 32/64-bit CPU with 128GB memory

  • A minimum of 400-500GB (SSDs/NVMe) of free storage

  • A current Linux version (Red Hat/CentOS/Ubuntu)

  • Java 8 or later installed (via the JRE or JDK)

A fast network connection with provisioned redundancies at all points of failure will offer the best performance, reliability, and lowest latency for replication.

As Replicate is Java-based, it may be possible, though not guaranteed, to work on other operating systems that can run Java SE Runtime Environment 8. Support for other operating systems is planned for future releases.

Obtain Replicate Software and Documentation

SingleStore Replicate is available to all customers who have purchased the SingleStore Helios database or SingleStore Helios. To obtain the SingleStore Replicate software and full documentation, contact your SingleStore sales representative, or SingleStore support.

Last modified: January 4, 2024

Was this article helpful?

Verification instructions

Note: You must install cosign to verify the authenticity of the SingleStore file.

Use the following steps to verify the authenticity of singlestoredb-server, singlestoredb-toolbox, singlestoredb-studio, and singlestore-client SingleStore files that have been downloaded.

You may perform the following steps on any computer that can run cosign, such as the main deployment host of the cluster.

  1. (Optional) Run the following command to view the associated signature files.

    curl undefined
  2. Download the signature file from the SingleStore release server.

    • Option 1: Click the Download Signature button next to the SingleStore file.

    • Option 2: Copy and paste the following URL into the address bar of your browser and save the signature file.

    • Option 3: Run the following command to download the signature file.

      curl -O undefined
  3. After the signature file has been downloaded, run the following command to verify the authenticity of the SingleStore file.

    echo -n undefined |
    cosign verify-blob --certificate-oidc-issuer https://oidc.eks.us-east-1.amazonaws.com/id/CCDCDBA1379A5596AB5B2E46DCA385BC \
    --certificate-identity https://kubernetes.io/namespaces/freya-production/serviceaccounts/job-worker \
    --bundle undefined \
    --new-bundle-format -
    Verified OK