Pipeline Data Sources and Formats
Pipelines support the following data sources and formats.
Supported Data Sources
Data Source | Data Source Version | MemSQL/SingleStore DB Version |
|---|---|---|
Apache Kafka | 0.8.2.2 or newer | 5.5.0 or newer |
Amazon S3 | N/A | 5.7.1 or newer |
Filesystem Extractor | N/A | 5.8.5 or newer |
Azure Blob | N/A | 5.8.5 or newer |
HDFS | 2.2.x or newer | 6.5.2 or newer |
Google Cloud Storage | N/A | 7.0.14 or newer |
Supported File Formats
Pipelines support the JSON, Avro, Parquet, and CSV data formats.