Connecting Qlik Replicate and SingleStore
Qlik Replicate allows its users to “accelerate data replication, ingestion and streaming across a wide variety of heterogeneous databases, data warehouses, and Big Data platforms”. This document provides a brief overview of integrating Qlik Replicate with SingleStore. For purposes of illustration, MySQL is used as a source database, and SingleStore (SingleStore Managed Service or SingleStore DB) is the target for replication. For detailed instructions on how to configure Qlik Replicate for your particular use case, please refer to the user guide provided by Qlik or visit their online help center. Note that SingleStore can be used as a target database but not as a source.
The certification matrix below shows the latest versions of the database, driver, and connector verified to work together in a replication task:
|SingleStore DB||7.1 and newer|
Using Qlik Replicate
Download and install Qlik Replicate Software. (e.g.
sudo rpm -i areplicate-6.6.0-488.x86_64.rpm)
Enable Web UI access. To enable access to the Web UI, run
./repctl SETSERVERPASSWORD <your_password>. Make sure to follow the requirements for the password described here.
Make sure your environment satisfies the prerequisites for the Source Endpoint (MySQL in our example). MySQL prerequisites can be found here. For our example, the following commands were used to download and install the necessary software:
sudo yum install -y mysql-community*5.7.32*
sudo yum -y install https://dev.mysql.com/get/Downloads/Connector-ODBC/5.3/mysql-connector-odbc-5.3.11-1.el7.x86_64.rpm
sudo yum install unixODBC
Make sure your environment satisfies the prerequisites for the Target Endpoint (SingleStore in our example). SingleStore prerequisites are the same as MySQL, and can be found here.
Check the corresponding section of the Qlik Replicate user guide to find out what additional configuration steps are needed and what limitations exist for a particular data source and target.
You should be able to open a Qlik Replicate Web Console as described here.
You can add a replication task as described here.
Note that if you are using a SingleStore Managed Service cluster as the target, you will need to specify the database access credentials (host, port, user, database) available via the SingleStore Customer Portal.
In the Portal, the host is the Endpoint, the port is 3306, the user/password is the “admin” user you were prompted for when you created the cluster. The database name is the database you are using.
Now you can run the task as described here.