SingleStore Managed Service

Debugging
SQL Pushdown Debugging

If you want to know whether your queries are pushed down, df.explain() can show what parts of the query were pushed down and can also be used for debugging if you encounter an issue. Additionally, if you pass the argument true, you will get a lot more output that includes pre- and post-optimization passes.

Other

In addition, the singlestore-spark-connector outputs a lot of helpful information when the TRACE log level is enabled for the com.singlestore.spark package. You can do this in your log4j configuration by adding the following line: log4j.logger.com.singlestore.spark=TRACE Make sure not to leave it in place since it generates a huge amount of tracing output.