AI agents/LLMs: Fetch /llms.txt first to access the documentation index. Remove the trailing slash and append .md to any URL to access lighter, easier-to-parse Markdown pages instead of HTML (this page is accessible at https://docs.singlestore.com/db/v9.0/load-data/integrate-with-singlestore/load-data-from-spark/debugging.md).
Use df.explain() to show which parts of a query are being pushed down. It can also be used for debugging if you encounter an issue. Additionally, if you pass the argument true, you get more information in the output, including pre- and post-optimization passes.
Other
In addition, the singlestore-spark-connector outputs a lot of helpful information when the TRACE log level is enabled for the com.singlestore.spark package. You can do this in your log4j configuration by adding the following line: log4j.logger.com.singlestore.spark=TRACE. Make sure not to leave it in place since it generates a huge amount of tracing output.