Load Data from Spark
You can use SingleStore and Spark together to accelerate workloads by taking advantage of computational power of Spark in tandem with the fast ingest and persistent storage SingleStore has to offer.
The connector is implemented as a native Spark SQL plugin, and supports Spark’s DataSource API.
In addition, the connector is a true Spark data source; it integrates with the Catalyst query optimizer, supports robust SQL pushdown, and leverages SingleStore LOAD DATA
to accelerate ingest from Spark via compression.
In this section
Last modified: September 27, 2023