SHOW CREATE PIPELINE

You can use the SHOW CREATE PIPELINE clause to output a CREATE PIPELINE statement that can be used to duplicate the configuration and state of an existing pipeline.

For more information about creating a pipeline, see CREATE PIPELINE.

Syntax

SHOW CREATE PIPELINE pipeline_name [EXTENDED]

Remarks

Note

The SHOW CREATE PIPELINE command hides all the sensitive data, such as credentials, URLs, etc, in the output for users without SUPER permissions. For users with SUPER permission, the sensitive information is visible in the output of the SHOW CREATE PIPELINE command. For more information about permissions, refer to Permissions Matrix.

Example

SHOW CREATE PIPELINE mypipeline EXTENDED;
+------------+-------------------------
| Pipeline | Create Pipeline
+------------+-------------------------
| mypipeline | CREATE PIPELINE `mypipeline`
AS LOAD DATA KAFKA '127.0.0.1/my-topic'
BATCH_INTERVAL 0
IGNORE
INTO TABLE `t`
FIELDS TERMINATED BY ',' ENCLOSED BY '' ESCAPED BY '\\'
LINES TERMINATED BY '\n' STARTING BY ''
(`data`,`col1`,`col2`) |
| ALTER TABLE | ALTER PIPELINE `mypipeline` SET OFFSETS
'{\"8\":5}'

In the example above, the first column contains the name of the pipeline. The second column contains the CREATE PIPELINE statement used to create a new pipeline with the same configuration. The third and fourth column only appear when the EXTENDED clause is added to the statement. These columns contain the ALTER statements that can be used to set a new pipeline’s offsets to the same state as the current pipeline, namely to start reading from the most recently loaded offset.

Related Topics

Last modified: August 21, 2024

Was this article helpful?

Verification instructions

Note: You must install cosign to verify the authenticity of the SingleStore file.

Use the following steps to verify the authenticity of singlestoredb-server, singlestoredb-toolbox, singlestoredb-studio, and singlestore-client SingleStore files that have been downloaded.

You may perform the following steps on any computer that can run cosign, such as the main deployment host of the cluster.

  1. (Optional) Run the following command to view the associated signature files.

    curl undefined
  2. Download the signature file from the SingleStore release server.

    • Option 1: Click the Download Signature button next to the SingleStore file.

    • Option 2: Copy and paste the following URL into the address bar of your browser and save the signature file.

    • Option 3: Run the following command to download the signature file.

      curl -O undefined
  3. After the signature file has been downloaded, run the following command to verify the authenticity of the SingleStore file.

    echo -n undefined |
    cosign verify-blob --certificate-oidc-issuer https://oidc.eks.us-east-1.amazonaws.com/id/CCDCDBA1379A5596AB5B2E46DCA385BC \
    --certificate-identity https://kubernetes.io/namespaces/freya-production/serviceaccounts/job-worker \
    --bundle undefined \
    --new-bundle-format -
    Verified OK