Load Data from Azure Data Factory (ADF)

SingleStore can be configured as a Linked service in Azure Data Factory (ADF), which allows it to be used as a source or sink for ETL data flows.

Prerequisites

This integration supports SingleStore and SingleStore version 7.1 and later.

You will also need an Azure account with access to ADF.

Create an ADF Factory and Add a SingleStore Datasource

  1. Open the ADF main page. In the search bar, enter "Data factories", and then select "Data factories" from the drop down list. You will be taken to the Data factories page.

  2. Click Create new factory on the Data factories page.

  3. On the Basics tab on the Create Data Factory page, click Create new and create a new resource group.

  4. Click Next: Git configuration to move to the Git configuration tab.

  5. Configure your Git repo or click Configure Git later.

  6. Continue through the tabs (you may need to wait for validation) until you get to the Review + create tab. Review your settings and click Create.

  7. Once your data factory is deployed, click Go to resource.

  8. In your Data factory window, click Author & Monitor (near the center of the page).

  9. Open the Manage tab, click Linked services on the left, and then click + New.

  10. In the "New linked service" window, search for and select "Azure Database for MySQL".

  11. Enter your database connection info and credentials, then click Test connection.

  12. If your connection is successful, click Create.

You’ve created a connection to SingleStore, which can be used in ADF activities as a data source or data sink.

Last modified: September 27, 2023

Was this article helpful?

Verification instructions

Note: You must install cosign to verify the authenticity of the SingleStore file.

Use the following steps to verify the authenticity of singlestoredb-server, singlestoredb-toolbox, singlestoredb-studio, and singlestore-client SingleStore files that have been downloaded.

You may perform the following steps on any computer that can run cosign, such as the main deployment host of the cluster.

  1. (Optional) Run the following command to view the associated signature files.

    curl undefined
  2. Download the signature file from the SingleStore release server.

    • Option 1: Click the Download Signature button next to the SingleStore file.

    • Option 2: Copy and paste the following URL into the address bar of your browser and save the signature file.

    • Option 3: Run the following command to download the signature file.

      curl -O undefined
  3. After the signature file has been downloaded, run the following command to verify the authenticity of the SingleStore file.

    echo -n undefined |
    cosign verify-blob --certificate-oidc-issuer https://oidc.eks.us-east-1.amazonaws.com/id/CCDCDBA1379A5596AB5B2E46DCA385BC \
    --certificate-identity https://kubernetes.io/namespaces/freya-production/serviceaccounts/job-worker \
    --bundle undefined \
    --new-bundle-format -
    Verified OK