Load Data

SingleStore provides several options for loading data from various sources such as files, cloud repositories, external databases, and third-party ETL or CDC tools.

Data Loading Methods Available in SingleStore

  • SingleStore Flow: A GUI-based tool designed for database migration and change data capture (CDC) replication. It supports a wide range of enterprise databases.

  • SingleStore Pipelines: A built-in, real-time ingestion mechanism ideal for streaming and ETL scenarios, allowing continuous loading and transformation of data from file storages and streaming platforms.

  • LOAD DATA SQL Command: A SQL-based method for directly loading data from local or remote files into SingleStore tables.

Supported File Formats

SingleStore supports loading data from the following file formats:

Data Sources And the Corresponding Loading Methods in SingleStore

Note: Click a check mark (✓) to view the associated guide.

Data Sources

SingleStore Flow

Pipelines

LOAD DATA Command

Notes/Special Features

FIle Systems

Amazon Web Services (AWS) S3

✓

✓

Azure Blob Storage

✓

✓

Google Cloud Storage (GCS)

✓

✓

Hadoop Distributed File System (HDFS)

✓

Apache Iceberg

✓

Filesystem paths (local or network drives)

✓

✓

Streaming Systems

Kafka

✓

Database Sources

Oracle & Oracle RAC

✓

Microsoft SQL Server

✓

MySQL

✓

✓

When using pipelines; there is a cap of 16 pipelines for the MySQL source.

Also supports mysqlimport utility.

PostgreSQL

✓

Snowflake

✓

Data migration only.

Any JDBC-compliant database

✓

Limited to non-production preview, available for testing.

MongoDB®

✓

✓

When using pipelines; there is a cap of 16 pipelines for MongoDB® source.

Third-party Integration Tools

Apache Beam/Flink, AWS Glue, Azure Data Factory, Estuary, dbt, Fivetran, Informatica, Qlik, StreamSets and similar platforms.

Supports JDBC, ODBC, REST APIs.

Refer to Third-party and Custom Connectors.

In this section

Last modified:

Was this article helpful?