Migrate between SingleStore Spark Connector Versions
On this page
The SingleStore Spark Connector versions 2.
The following sections describe the differences in configuration and functionality between the SingleStore Spark Connector versions.
Update the SingleStore JDBC driver to version 1.
Update the JDBC driver to use the SingleStore JDBC driver instead of MariaDB JDBC driver.
See The SingleStore JDBC Driver for more information.
The SingleStore Spark Connector now reads in parallel from aggregators, and added support for following parallel read features: readFromAggregators, readFromLeaves, and readFromAggregatorsMaterialized.
See Parallel Read Support for more information.
The SingleStore Spark Connector is rebranded from
The Spark data source format is changed from
The configuration prefix is changed from
datasource. memsql. <config_ name>
datasource. singlestore. <config_ name>
You can still use the previous variants of the configuration prefix, but the names of all the internal classes are updated.
If you use these classes, you must update them in your code.
The connector uses the MariaDB JDBC driver.
Last modified: August 23, 2022