Load Data from Spark
You can use SingleStoreDB and Spark together to accelerate workloads by taking advantage of computational power of Spark in tandem with the fast ingest and persistent storage SingleStoreDB has to offer.
The connector is implemented as a native Spark SQL plugin, and supports Spark’s DataSource API.
In addition, the connector is a true Spark data source; it integrates with the Catalyst query optimizer, supports robust SQL pushdown, and leverages SingleStoreDB
LOAD DATA to accelerate ingest from Spark via compression.
In this section
Last modified: September 27, 2023