Important

The SingleStore 9.0 release candidate (RC) gives you the opportunity to preview, evaluate, and provide feedback on new and upcoming features prior to their general availability. In the interim, SingleStore 8.9 is recommended for production workloads, which can later be upgraded to SingleStore 9.0.

Connect with Collibra Platform

Collibra is a data intelligence platform that helps organizations streamline data management, governance, and collaboration. It enables businesses to discover, understand, and trust their data by providing tools for data cataloging, data lineage, and policy management. Collibra enhances decision-making by ensuring data quality, security, and compliance across various data sources.

You can connect your SingleStore deployments to Collibra Platform using the SingleStore JDBC driver ("the driver"). The driver enables Catalog to register database information and extract the structure of the source into its schemas, tables, and columns. The driver can retrieve the following SingleStore database components:

Schemas
Tables
Views
Columns
Primary keys

Prerequisites

Access to an Edge site or a Collibra Cloud site.
Global System administration and Manage connections and capabilities permissions.
An active SingleStore deployment.
SingleStore JDBC driver version 1.2.6+ .jar file.

Configure the Connection to SingleStore

To connect using the SingleStore JDBC driver, perform the following tasks:

Create a JDBC connection.
Register a data source.

1. Create a JDBC Connection

Refer to Create a JDBC connection for information on creating a JDBC connection to SingleStore in Collibra Platform.

Specify the following connection settings while configuring the JDBC connection:

Name: Specify SingleStore.
Driver class name: Specify com.singlestore.jdbc.Driver.
Driver jar: Download the SingleStore JDBC driver .jar file from its GitHub repository, and upload the JAR file.
Connection String: Enter jdbc:singlestore://{host}:{port}/{db}, where:
- host: IP address or the hostname of the SingleStore deployment.
- port: Default is 3306.
- db: Name of the SingleStore database to connect with.

Specify the following connection properties to configure the connection to your SingleStore deployment:

User: Username of the SingleStore database user with which to access the database.
Password: Password for the SingleStore database user.

Note

SingleStore does not support foreign keys. Hence, you must set the foreign-keys-strategy property to SKIP under Catalog JDBC Ingestion Edge capability.

2. Register a Data Source

Use the JDBC connection created earlier to register a data source. Refer to Register a data source via Edge for more information.

View Technical Lineage

You can also view the technical lineage graph for SingleStore to visualize the journey of the data objects in your data sources and data transformation details. Refer to Technical Lineage for more information.

Here are a few sample queries:

Visualize pipeline metadata for external functions:

SQL

SELECT PIPELINE_NAME, CONFIG_JSON, STATE, CREATE_TIME
FROM information_schema.PIPELINES
WHERE DATABASE_NAME = '<database_name>';

Select and parse executed queries from history for internal relations:

SQL

SELECT QUERY_TEXT FROM information_schema.MV_QUERIES
WHERE ACTIVITY_NAME LIKE 'InsertSelect%';