Verify Pipeline Success

Query the pipelines_files information schema view to inspect the progress of the pipelines. For example, run the following command to check whether the tpch_100_lineitem pipeline has finished ingesting data.

SELECT * FROM information_schema.pipelines_files 
WHERE pipeline_name = "tpch_100_lineitem";

You can also run the pipelines in foreground to easily verify that all the data has been ingested.

START PIPELINE <pipeline_name> FOREGROUND;