Migrate between SingleStore Spark Connector Versions

Version 4.0 > 4.1

Update the JDBC driver to use the SingleStore JDBC driver instead of MariaDB JDBC driver. See The SingleStore JDBC Driver for more information.

The SingleStore Spark Connector now reads in parallel from aggregators, and added support for following parallel read features: readFromAggregators, readFromLeaves, and readFromAggregatorsMaterialized. See Parallel Read Support for more information.

The SingleStore Spark Connector is rebranded from memsql-spark-connector to singlestore-spark-connector.
The Spark data source format is changed from memsql to singlestore.
The configuration prefix is changed from spark.datasource.memsql.<config_name> to spark.datasource.singlestore.<config_name>.

Note

You can still use the previous variants of the configuration prefix, but the names of all the internal classes are updated. If you use these classes, you must update them in your code.
The connector uses the MariaDB JDBC driver.