SHOW PROFILE PIPELINE

Provides detailed execution profiling information for pipelines. It acts as a wrapper around SHOW PROFILE PLAN <plan_id>, aggregating and presenting profiles for all plans associated with a given pipeline. Provides easy access to performance metrics and execution details for all plans in a pipeline, that helps users analyze and optimize workload behavior.

Syntax

SQL

SHOW PROFILE [JSON | UI]
  [PLAN <plan_id>]
  [PROCESS <process_id>]
  [PIPELINE <pipeline_name>]
  [INTO OUTFILE <file_name>][ON NODE <node_id>];

Arguments

plan_id: Plan ID whose profile information is displayed.
process_id: Process ID whose profile information is displayed.
pipeline_name: Name of the pipeline whose profile information is displayed.
file_name (Optional): Name of the file where profiling output is saved.
node_id (Optional): Node ID on which profiling output is restricted. By default, if no node is specified, the query is forwarded to the Master Aggregator (MA).

Return Type

SHOW PROFILE PIPELINE <pipeline_name> [INTO OUTFILE <file_name>]
- Returns multiple rows.
- Each group of rows corresponds to a plan profile, with a row labeled Plan id <plan_id> serving as a delimiter.
SHOW PROFILE JSON PIPELINE <pipeline_name> [INTO OUTFILE <file_name>]
- Returns a single row containing a JSON array.
- Each JSON object in the array represents the profile of an individual plan.
SHOW PROFILE UI PIPELINE <pipeline_name> [INTO OUTFILE <file_name>]
- Returns multiple rows.
- Each row contains a URL for accessing a profile in the user interface, grouped by pipeline.

Remarks

When run:
- The pipeline ID is retrieved.
- Plans are collected based on their associated activities.
- Activities are filtered where the activity tracking ID belongs to the pipeline.
- Profiles from all matching plans are extracted and combined.
This allows convenient access to profiling data for all plans within a pipeline in a single command.
This command causes implicit commits. Refer to COMMIT for more information.
SHOW PROFILE PIPELINE profiles the active foreground batches of a pipeline. Foreground batches are the tasks that the pipeline processes while actively running in the foreground. Run the pipeline in the foreground before using this command. The number of foreground batches can also be configured.
Refer to the Permission Matrix for the required permissions.

Examples

This example shows detailed profile information for every plan in the SalesData_Pipeline. The system returns multiple rows, with each row showing profile data for a pipeline batch or its processing plan. This enables analysis of performance metrics such as resource usage, timing, and execution details for each plan in the pipeline.

SQL

SHOW PROFILE PIPELINE SalesData_Pipeline;

+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| PROFILE                                                                                                                                                                                                                                                                                                                                                                                            |
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Plan id: 15                                                                                                                                                                                                                                                                                                                                                                                        |
| Gather partitions:all est_rows:15,000,000 alias:remote_0 actual_rows: 106 exec_time: 0ms                                                                                                                                                                                                                                                                                                           |
| SegmentMerge segments: 106 exec_time: 0ms start_time: [00:00:00.000, 00:00:59.608] Segment Compress: 0ms Segment Merge: 0ms Auto Stats: 0ms Segment Decompression: 0ms                                                                                                                                                                                                                             |
| InsertInto sales.SalesData [r0.Date, r0.Store_ID, r0.ProductID, r0.Product_Name, r0.Product_Category, r0.Quantity_Sold, r0.Price, r0.Total_Sales] local:yes est_rows:15,000,000 actual_rows: 15,000,000 exec_time: 0ms start_time: [00:00:00.000, 00:00:02.175] Segment Count: 90 Segment Sort: 0ms Dup Check: 0ms Segment Compress: 0ms Auto Stats: 0ms In-memory Queue: 0ms In-memory Flush: 0ms |
| TableScan r0 storage:list stream:yes table_type:sharded  exec_time: 0ms                                                                                                                                                                                                                                                                                                                            |
| Repartition [SalesData_src.Date, SalesData_src.Store_ID, SalesData_src.ProductID, SalesData_src.Product_Name, SalesData_src.Product_Category, SalesData_src.Quantity_Sold, SalesData_src.Price, SalesData_src.Total_Sales, RAND() AS rand_0] AS r0 shard_key:[rand_0] est_rows:15,000,000 actual_rows: 15,000,000 exec_time: 0ms network_traffic: 1,278,954.375000 KB network_time: 0ms            |
| ExternalIngest pipeline:SalesData_Pipeline table_type:sharded_columnstore                                                                                                                                                                                                                                                                                                                          |
| |---FileParse actual_rows: 15,000,002 exec_time: 0ms start_time: [00:00:00.000, 00:00:00.156] end_time: [00:00:00.000, 00:00:59.498]                                                                                                                                                                                                                                                               |
| |---Extract streamed_bytes: 885,843.562500 KB exec_time: 0ms start_time: [00:00:00.000, 00:00:00.156]                                                                                                                                                                                                                                                                                              |
| +---PopulateRow actual_rows: 15,000,000 exec_time: 0ms start_time: [00:00:00.000, 00:00:00.767] end_time: [00:00:00.000, 00:00:59.498]                                                                                                                                                                                                                                                             |
| Compile Total Time: 28ms                                                                                                                                                                                                                                                                                                                                                                           |
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

This example returns the profile information formatted as a JSON array. This output structures the data for programmatic use, so it is easy to ingest results for automation, further analysis, or integration with monitoring tools. Each array element contains profiling data for one plan or batch, which allows flexible parsing and use in custom workflows.shows detailed profile information for a specific pipeline in a structured JSON format:

SQL

SHOW PROFILE JSON PIPELINE SalesData_Pipeline;

+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| PROFILE                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| [
{
    "plan_warnings": {
},
    "execution_warnings": {
},
    "mpl_path":"\/data\/master\/plancache\/2fb\/RunPipeline_SalesData_Pipeline_profile_partial_SalesData__et_al_2fb8e3cdb8969265d6d413d578806f5d507e469b75281f9e4d2321078758394b_4b7cde3ad5871f6f",
    "profile":[
        {
            "executor":"Gather",
            "keyId":4295163904,
            "partitions":"all",
            "est_rows":"15000000",
            "est_rows_source":"JOIN",
            "query":"INSERT INTO `sales_0`.`SalesData` (`SalesData`.`Date`, `SalesData`.`Store_ID`, `SalesData`.`ProductID`, `SalesData`.`Product_Name`, `SalesData`.`Product_Category`, `SalesData`.`Quantity_Sold`, `SalesData`.`Price`, `SalesData`.`Total_Sales`)SELECT `r0`.`Date` AS `Date`, `r0`.`Store_ID` AS `Store_ID`, `r0`.`ProductID` AS `ProductID`, `r0`.`Product_Name` AS `Product_Name`, `r0`.`Product_Category` AS `Product_Category`, `r0`.`Quantity_Sold` AS `Quantity_Sold`, `r0`.`Price` AS `Price`, `r0`.`Total_Sales` AS `Total_Sales` FROM @ `sales`.REMOTE(:: `sales`.`r0`(0) AS SELECT (1!:>text CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL) AS `Date`,(1!:>bigint(20) NULL) AS `Store_ID`,(1!:>text CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL) AS `ProductID`,(1!:>text CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL) AS `Product_Name`,(1!:>text CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL) AS `Product_Category`,(1!:>bigint(20) NULL) AS `Quantity_Sold`,(1!:>float NULL) AS `Price`,(1!:>float NULL) AS `Total_Sales`,(1!:>double NOT NULL) AS `rand_0`) as `r0` WITH (takeover_conn = TRUE) \/*!90623 OPTION(NO_QUERY_REWRITE=1, INTERPRETER_MODE=INTERPRET_FIRST, AUTO_PROFILE='SMART')*\/",
            "alias":"remote_0",
            "actual_row_count":{ "value":106, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
            "actual_total_time":{ "value":0 },
            "mbc_emission":{ "value":7, "avg":7.000000, "stddev":0.000000, "max":7, "maxPartition":0 },
            "create_mbc_context":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
            "optimizer_query_rewrites":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
            "optimizer_setting_up_subselect":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
            "optimizer_distributed_optimizations":{ "value":6, "avg":6.000000, "stddev":0.000000, "max":6, "maxPartition":0 },
            "optimizer_enumerate_temporary_tables":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
            "ppc_check":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
            "parse_query":{ "value":17, "avg":17.000000, "stddev":0.000000, "max":17, "maxPartition":0 },
            "persistence_mpl":{ "value":4, "avg":4.000000, "stddev":0.000000, "max":4, "maxPartition":0 },
            "generating_query_mpl":{ "value":5, "avg":5.000000, "stddev":0.000000, "max":5, "maxPartition":0 },
            "generating_user_function_mpl":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
            "total":{ "value":30, "avg":30.000000, "stddev":0.000000, "max":30, "maxPartition":0 },
            "inputs":[
                {
                    "executor":"SegmentMerge",
                    "keyId":196968,
                    "actual_row_count":{ "value":106, "avg":53.000000, "stddev":0.000000, "max":53, "maxPartition":0 },
                    "actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                    "start_time":{ "value":0, "avg":59605.000000, "stddev":0.000000, "max":59608, "maxPartition":0 },
                    "PostSortCompress":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                    "PostSortMergeTime":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                    "PostSortAutoStats":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                    "PostSortDecompression":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                    "inputs":[
                        {
                            "executor":"InsertInto",
                            "keyId":196912,
                            "db":"sales",
                            "table":"SalesData",
                            "out":[
                                {
                                    "alias":"",
                                    "projection":"r0.Date"
                                    },
                                {
                                    "alias":"",
                                    "projection":"r0.Store_ID"
                                    },
                                {
                                    "alias":"",
                                    "projection":"r0.ProductID"
                                    },
                                {
                                    "alias":"",
                                    "projection":"r0.Product_Name"
                                    },
                                {
                                    "alias":"",
                                    "projection":"r0.Product_Category"
                                    },
                                {
                                    "alias":"",
                                    "projection":"r0.Quantity_Sold"
                                    },
                                {
                                    "alias":"",
                                    "projection":"r0.Price"
                                    },
                                {
                                    "alias":"",
                                    "projection":"r0.Total_Sales"
                                    }
                                ],
                            "local":"yes",
                            "est_rows":"15000000",
                            "est_rows_source":"JOIN",
                            "subselects":[],
                            "actual_row_count":{ "value":15000000, "avg":7500000.000000, "stddev":2937.000000, "max":7502937, "maxPartition":0 },
                            "actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                            "start_time":{ "value":0, "avg":2175.000000, "stddev":0.000000, "max":2175, "maxPartition":0 },
                            "SegmentCount":{ "value":90, "avg":45.000000, "stddev":0.000000, "max":45, "maxPartition":0 },
                            "SegmentSort":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                            "DupCheckInStager":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                            "SegmentCompress":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                            "AutoStats":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                            "InMemoryInsertQueue":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                            "InMemoryInsertFlush":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                            "inputs":[
                                {
                                    "executor":"TableScan",
                                    "keyId":4295229440,
                                    "table":"r0",
                                    "alias":"r0",
                                    "storage":"list",
                                    "stream":"yes",
                                    "table_type":"sharded",
                                    "actual_row_count":{ "value":15000000, "avg":7500000.000000, "stddev":2937.000000, "max":7502937, "maxPartition":0 },
                                    "actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                    "inputs":[
                                        {
                                            "executor":"Repartition",
                                            "keyId":328008,
                                            "out":[
                                                {
                                                    "alias":"",
                                                    "projection":"SalesData_src.Date"
                                                    },
                                                {
                                                    "alias":"",
                                                    "projection":"SalesData_src.Store_ID"
                                                    },
                                                {
                                                    "alias":"",
                                                    "projection":"SalesData_src.ProductID"
                                                    },
                                                {
                                                    "alias":"",
                                                    "projection":"SalesData_src.Product_Name"
                                                    },
                                                {
                                                    "alias":"",
                                                    "projection":"SalesData_src.Product_Category"
                                                    },
                                                {
                                                    "alias":"",
                                                    "projection":"SalesData_src.Quantity_Sold"
                                                    },
                                                {
                                                    "alias":"",
                                                    "projection":"SalesData_src.Price"
                                                    },
                                                {
                                                    "alias":"",
                                                    "projection":"SalesData_src.Total_Sales"
                                                    },
                                                {
                                                    "alias":"rand_0",
                                                    "projection":"RAND()"
                                                    }
                                                ],
                                            "est_rows_source":"JOIN",
                                            "alias":"r0",
                                            "shard_key":[
                                                "rand_0"
                                                ],
                                            "destination_database":"sales",
                                            "context_database":"sales",
                                            "est_rows":"15000000",
                                            "query":"CREATE RESULT TABLE `r0` PARTITION BY (`rand_0`) WITH (DEST_DB=`sales`, TAKEOVER_CONN=TRUE) AS SELECT `SalesData_src`.`Date` AS `Date`, `SalesData_src`.`Store_ID` AS `Store_ID`, `SalesData_src`.`ProductID` AS `ProductID`, `SalesData_src`.`Product_Name` AS `Product_Name`, `SalesData_src`.`Product_Category` AS `Product_Category`, `SalesData_src`.`Quantity_Sold` AS `Quantity_Sold`, `SalesData_src`.`Price` AS `Price`, `SalesData_src`.`Total_Sales` AS `Total_Sales`,  RAND() AS `rand_0` FROM `sales_0`.`SalesData` as `SalesData_src`  LOAD EXTRACTOR 12 ('[[\\\"SalesData\/sales_data.csv\\\",0,1],[]]')  FROM `sales`.`SalesData_Pipeline`(1, '595b3090c58cb0a9c46a8f9455e0cf5a0dfe2bb4', '{\\\"latestKey\\\":\\\"SalesData\/sales_data.csv\\\",\\\"cursorKey\\\":\\\"\\\",\\\"offset_gc_timestamp\\\":0,\\\"fuzz\\\":0,\\\"scan_start_time\\\":0,\\\"first_scan_done\\\":true}') 2  (`Date`,`Store_ID`,`ProductID`,`Product_Name`,`Product_Category`,`Quantity_Sold`,`Price`,`Total_Sales`)  \/*!90623 OPTION(NO_QUERY_REWRITE=1, INTERPRETER_MODE=INTERPRET_FIRST, AUTO_PROFILE='SMART')*\/",
                                            "actual_row_count":{ "value":15000000, "avg":7500000.000000, "stddev":7500000.000000, "max":15000000, "maxPartition":0 },
                                            "actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                            "network_traffic":{ "value":1278954409, "avg":639477204.500000, "stddev":639477204.500000, "max":1278954409, "maxPartition":0 },
                                            "mbc_emission":{ "value":10, "avg":10.000000, "stddev":0.000000, "max":10, "maxPartition":0 },
                                            "create_mbc_context":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                            "optimizer_query_rewrites":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                            "optimizer_setting_up_subselect":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                            "optimizer_distributed_optimizations":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                            "optimizer_enumerate_temporary_tables":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                            "ppc_check":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                            "parse_query":{ "value":6, "avg":6.000000, "stddev":0.000000, "max":6, "maxPartition":0 },
                                            "persistence_mpl":{ "value":5, "avg":5.000000, "stddev":0.000000, "max":5, "maxPartition":0 },
                                            "generating_query_mpl":{ "value":5, "avg":5.000000, "stddev":0.000000, "max":5, "maxPartition":0 },
                                            "generating_user_function_mpl":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                            "total":{ "value":28, "avg":28.000000, "stddev":0.000000, "max":28, "maxPartition":0 },
                                            "network_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                            "wait_for_reader_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                            "inputs":[
                                                {
                                                    "executor":"ExternalIngest",
                                                    "keyId":393559,
                                                    "pipeline":"SalesData_Pipeline",
                                                    "table_type":"sharded_columnstore",
                                                    "columnstore_in_memory_scan_type":"TableScan",
                                                    "columnstore_in_memory_scan_index":"SORT KEY __UNORDERED ()",
                                                    "inputs":[
                                                        {
                                                            "executor":"FileParse",
                                                            "keyId":393567,
                                                            "actual_row_count":{ "value":15000002, "avg":15000002.000000, "stddev":0.000000, "max":15000002, "maxPartition":0 },
                                                            "actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                                            "start_time":{ "value":0, "avg":156.000000, "stddev":0.000000, "max":156, "maxPartition":0 },
                                                            "end_time":{ "value":0, "avg":59498.000000, "stddev":0.000000, "max":59498, "maxPartition":0 },
                                                            "inputs":[]
                                                            },
                                                        {
                                                            "executor":"Extract",
                                                            "keyId":393561,
                                                            "actual_row_count":{ "value":885843591, "avg":885843591.000000, "stddev":0.000000, "max":885843591, "maxPartition":0 },
                                                            "actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                                            "start_time":{ "value":0, "avg":156.000000, "stddev":0.000000, "max":156, "maxPartition":0 },
                                                            "inputs":[]
                                                            },
                                                        {
                                                            "executor":"PopulateRow",
                                                            "keyId":393564,
                                                            "actual_row_count":{ "value":15000000, "avg":15000000.000000, "stddev":0.000000, "max":15000000, "maxPartition":0 },
                                                            "actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
                                                            "start_time":{ "value":0, "avg":767.000000, "stddev":0.000000, "max":767, "maxPartition":0 },
                                                            "end_time":{ "value":0, "avg":59498.000000, "stddev":0.000000, "max":59498, "maxPartition":0 },
                                                            "inputs":[]
                                                            }
                                                        ]
                                                    }
                                                ]
                                            }
                                        ]
                                    }
                                ]
                            }
                        ]
                    }
                ]
            }
        ],
    "version":"4",
    "warning":"requires compile",
    "info":{
        "memsql_version":"9.1.1",
        "memsql_version_hash":"448d219d3dd11aba42ae8f31fb2227b0370b09e5",
        "num_online_leaves":"1",
        "num_online_aggs":"1",
        "context_database":"sales"
        },
    "query_info":{
        "query_text":"INSERT INTO `sales`.`SalesData` SELECT with(force_random_reshuffle=true)  `Date`, `Store_ID`, `ProductID`, `Product_Name`, `Product_Category`, `Quantity_Sold`, `Price`, `Total_Sales` FROM `sales`.`SalesData` `SalesData_src` LOAD EXTRACTOR @ (^)  FROM `sales`.`SalesData_Pipeline`(1, '595b3090c58cb0a9c46a8f9455e0cf5a0dfe2bb4', ^) @",
        "total_runtime_ms":"68769",
        "agg_node":"127.0.0.1",
        "text_profile":"Gather partitions:all est_rows:15,000,000 alias:remote_0 actual_rows: 106 exec_time: 0ms\nSegmentMerge segments: 106 exec_time: 0ms start_time: [00:00:00.000, 00:00:59.608] Segment Compress: 0ms Segment Merge: 0ms Auto Stats: 0ms Segment Decompression: 0ms\nInsertInto sales.SalesData [r0.Date, r0.Store_ID, r0.ProductID, r0.Product_Name, r0.Product_Category, r0.Quantity_Sold, r0.Price, r0.Total_Sales] local:yes est_rows:15,000,000 actual_rows: 15,000,000 exec_time: 0ms start_time: [00:00:00.000, 00:00:02.175] Segment Count: 90 Segment Sort: 0ms Dup Check: 0ms Segment Compress: 0ms Auto Stats: 0ms In-memory Queue: 0ms In-memory Flush: 0ms\nTableScan r0 storage:list stream:yes table_type:sharded  exec_time: 0ms\nRepartition [SalesData_src.Date, SalesData_src.Store_ID, SalesData_src.ProductID, SalesData_src.Product_Name, SalesData_src.Product_Category, SalesData_src.Quantity_Sold, SalesData_src.Price, SalesData_src.Total_Sales, RAND() AS rand_0] AS r0 shard_key:[rand_0] est_rows:15,000,000 actual_rows: 15,000,000 exec_time: 0ms network_traffic: 1,278,954.375000 KB network_time: 0ms\nExternalIngest pipeline:SalesData_Pipeline table_type:sharded_columnstore\n|---FileParse actual_rows: 15,000,002 exec_time: 0ms start_time: [00:00:00.000, 00:00:00.156] end_time: [00:00:00.000, 00:00:59.498]\n|---Extract streamed_bytes: 885,843.562500 KB exec_time: 0ms start_time: [00:00:00.000, 00:00:00.156]\n+---PopulateRow actual_rows: 15,000,000 exec_time: 0ms start_time: [00:00:00.000, 00:00:00.767] end_time: [00:00:00.000, 00:00:59.498]\nCompile Total Time: 28ms\n",
        "compile_time_stats":{
            "mbc_emission":"5",
            "create_mbc_context":"0",
            "optimizer_query_rewrites":"0",
            "optimizer_stats_analyze":"0",
            "optimizer_stats_other":"0",
            "optimizer_setting_up_subselect":"0",
            "optimizer_distributed_optimizations":"3",
            "optimizer_enumerate_temporary_tables":"0",
            "optimizer_singlebox_optimizations_agg":"0",
            "optimizer_stats_autostats":"1",
            "ppc_check":"0",
            "parse_query":"4",
            "persistence_mpl":"7",
            "generating_query_mpl":"2",
            "generating_user_function_mpl":"0",
            "total":"28"
            },
        "optimizer_optree_memory":"6272",
        "optimizer_dstree_memory":"0",
        "optimizer_pin_used":"0",
        "optimizer_pin_set":"0"
        },
    "task_stats_info":{
        "total_task_memory_bs":"6053799775",
        "total_task_cpu_time_ms":"49632",
        "total_task_network_time_ms":"169243",
        "agg_task_memory_bs":"9004914",
        "agg_task_cpu_time_ms":"4",
        "agg_task_network_time_ms":"68735"
        }
    },
 
] |
+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

This example returns a URL that links to user interface views for interactive inspection of profile reports. The URL opens a graphical profile page with detailed, visual representations of pipeline runs, that makes performance analysis more intuitive.

SQL

SHOW PROFILE UI PIPELINE SalesData_Pipeline;

+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| PROFILE                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| https://explain.labs.singlestore.com/#json=eJztHG17mzjy%2B%2F4Krb%2FU2XMdXg34eXLPpol762saZ2339vaJcwSDnHDF4PKSNO31v58kQBZgDHYcp%2BmddtsaaTQzGo2k0czA158AKo2FY7j6veG7tnsTNLrg60%2FfWnEL%2FAzNKLS9kub5wtEXRnjb6DYmh5YRGpPDuRGE0J8cYpymYd7CyaEwm04Oh5F7YS%2BgY7tQHxkODE4RuE6rFr43sx30r%2BGHtuEwIDoMdVSBkKhQNK2pqnU0oSNbHUviRUtWVJXrzGRL5hQodbSpIgsqP9OgZAmiwHOKqsiqqElTXZoqpgVFw5JVhZ91Zo1kDAnlRveSPOPylf5ihOD5aJR%2FQ4OFftKVAnyED32r0ZUETeY7osZJuXYyKCxFJL2G4Tj5%2FjAIdd%2B7x628zJFSBqIHXuSbiNvG3wf98zzUpwj6D6itfz7qDcegfz4egOsAi1LnrtvXVKjXoMk8tK%2FRP%2FC6BTJ1IzRiqPdP8%2FUXvmdFZljaoJ8b8wKytO0EEbrx%2FId8%2B%2B%2BR4SIRPegjz7GKnW2zgHHshamaXB%2BMeme9kzG49rl0MOB4BOiwSDUdD2liR0eal8Mi7ZlRsgDx8FgYOuAMGB1pBpQdPwHPDpzAFmSR4MVCSJAl8iANrCBIc6bi7XDwHvyaKMF1e9h7Pxj3mt0urcFImtwB7plIscn%2F3P1rCD%2BH4OS34%2BHxybg3RE1jEIUzdT6VwMng7Ox43Euf9RvoQh9RNG1w%2FuHs7IARPUE1tW9sN2wKiMiyfSn%2FnZBjpmuX%2BJKp3SnKpQqUSyenAgRw5nhGmMFHtGBlG6sCMYTlRVMHgvPBmAHzDddCG8MBMAKiTOCP%2Fvg30AyNj9C7g75ueq4LjsB4%2BKF3ACaHv%2FyscR1BBIOLcX9w3jwf6L9%2F6A3%2F1Ie9P4b9ce%2BIb%2BEdpze8GPbQ3%2Fr7wWnviFbob%2FvD0bgFjj%2BMB%2FrFcPC2f9Y7ejV6fzwcvzr4ZXKY38oMxzbwhujDuRdCvbAhGmYYoTGiPRGxGblho%2FsVNO4MJ0J7I891Wgji7qbR5drxfoqeg9Cy4F2mam58Rs%2Fxj4t0k0Y14NtqaiGRa2jPIUuuCD6fmjqc20FA0C0hlZQtpZotpQZbpg%2BRNumYHJorrKEZvnYsBG%2BBRm5%2FQYpBzhndh%2Fe%2BHcJgPzQDGIbIANGjhR5E0wA60NzTaC07CH17GoXQ0pNaIznNl%2BSpxnWqyXc2Ig%2FdaI62EzTPIZwvPN9Aog8NtJqfVPCLBdKpW2h%2BfFIihh9APbFamPVL1wlfY6HwdVbKAvoBmkbommi5LByWmpQSk6ppSTVIxbs%2F0dV4neToySk9uZqevBm9KED6Motck5jsObq7njyyGbIEREpBrEFCrEPDdhdRGLC2eVq%2BFmpIB8ZWH8GbOXTD99C%2FgbnTg4InljuP7hQdtQSm5kkjizWmU6wec55uyZmz28mkRIMQQZVTk7UOV0dtEZi6AdULLwhHnh%2BeePOFD4On3NgKNIl%2BjPck3pToMdLRUWiEex3pKTQT%2BebMkqciXL5607J6FVMEzGruu2hvC%2Ftu6JWsZdqJWdO8UAFrTRFqchOqwkpOXLyrpHfQqg5eFK4beVrWS4BiS83hCqoUfuF7%2F4ZmPEENn2vj%2B1ijVteSyWTLnnhO74gvjW96GX2hjJNb70vlPb1evzT%2BM1f%2Bl8Y88UW8NKYZJ0lN1iuhrirOBMczscnceKg%2Bb6p9wqVd1vqIC73oZRof1FUDWGsLy9RSiH0c8XPRpBA0UclZFQgW19a3LfIc7dVKXspuvbUs8EoNYxlDbUE7ud6c5KdBo%2BSlGsSlR5DGNuU%2BpX0aLU6wR6LvItP5Bvr7pE2lvbcLCiW9z7sCJdp338M5OkZjs%2Fv3CEZ7XVhZ8m%2BdKLjdJ%2Fnqi0taap5VzEVmjC8SI9Nw655bTHRREDRJ4mr2S28sftXBQXtQn3vtHgEaE1qKqI9jB2H9Xj405rXOQdqHjEYPHxaYWHBr%2BBa0ao%2Frezu18pw9y%2BlFmaiv7Wmpp%2FWUAKP9Q0iD4TVnj2JJ1oEoqBxX4qsr7VvzMp4vm42TUtvQMi30z1iqy0yIwDc3uMfnS01tYMv3N%2FzNXAL58kOIYEPvQr78SDLYwFGRLz%2BUGDbzeeTLDyGKLdwn%2BfJDyGEDT0y%2B%2FBDj39ipky%2F7l0KchbMTWQyPz0%2BbB1sOfONeFc6ifNnOP1XAsvElhfYktwYdmZHbmILpND25lCwkJtslCSY6TqmdGgGsGaQq4EqSgh6NZ3NnZAFFmpp6MuzhVLlhb%2FThbAzGx2%2FOenHu2cXxcNzHiWXgzZ%2BgucxNi3PSTnujsX765ihJW2yhnu96g3%2F0hvrJ4Pz8KE5RW%2BYwXmd2hZVJoXmI8vzQPOS6VNES2DVZo2U9qhNI8z3r5JIWqRXTSvMwazNMWwDEuw6bURinna7OPMa5hlkKAJwNjk9B759jnFs5GAJeAM1Xl5eTyWS5u08OY2xYldtmcIcbW1yLv2pdXl29OgAsSZYgTTG%2FbvIt8ErW5KnIaZwpq%2BaUMzRT6hjqTJNkGXLmTDY4awaF6VR6hWC%2FYhoOEngQvoMP%2BKFbzRL%2By4z8wPPZPrTJm80CGOo3JrntB6ExXxAgjrTOoi9fmMfANFx96WNmAW0fLUnSbnlu3BL6EfyGJCEAtHxiLWfUmFXTnA6uUK684qTKkU27BntOCq3cZHbi6Ck0xFlmMvu8jZ8lz%2BWzOn0oMy4M7z3%2Fox76xmxmmxmJCYqqyZLEaTS3UdQkRRE4qS3neVvRFMuNRfJYZsvyankqNb6G2PhdyG2vqbeV3DxDau4GPO05dXcDzmql9j4fe8%2BS%2BlvJ3z5Sg6uZWJ06vOM07Go2yvOKd5znW8nKnvOON%2BFnn3nJlXwV8pYFlQbs1Rrh%2Bg0SW0t5oKfuM5%2F%2B94Yd6jPPRweGYaE5em5%2BNg9FpWVLJwwTmup9DqHvGk7fvYG1Y5kFhGmUShNlWdvWp5NcWTLerfQesy1jqwKoyHRxormLo7hb42VQ6DZa3CRuH19NEmKbRrw3IWG7FvyM5TQYjsG73p9A1z%2BcD4anvWHvFDQPtqW4vR6mZTt9pAwwevnWduAFPu22HAzFyahmR3kkrho3LYHa5MlzDct82fORO0kZw9%2FFpavAXEUeGS%2FXsGYQ0BNwBl1r3dsgklbjxCRgT8AbXaRXj8LzCDZ2t8jR4eMjFd3lEuefcImrqqxKoqzxqSrQimp1YPv%2Bf5V%2FF6v8R1pJF94iwk7boXe%2Fy9UkPf2ByeUOzDqurJ15JcsYfpFLSenUecG%2B84jMvVLO%2FhcOzK17b0d3i8j0Rj3q46%2BHt8Z7Imshyvuv7leEz8It25NYdOMOe61IxoCUfgYp%2Bb4T%2BeLGp8j2YQDw26L4y0gJhO3OPKTVFFkD3cOCT46%2BRKa1%2BTbPbLo5CP3WwGncDUlSLYHXLNGyeN6YGpJgQHUm8rOpIAjKlBMVbsppUGYxudFc91zyqSgHGneQhKJLAIybm0JzaSScgqTftIp9Z4XBxtWxn3%2FF95WyMc4kCn1vh7fNmeebUMeBUW%2BuI7HeRrOZA49wtO4AMOFoJuCciSjn48WrIsGFMC%2BN5RY%2FBrSK33xANheP%2FRU0%2F%2FUUEVaE9Fd2kuKzxkenI9pA9TmexI6qdDQWBk2u7noWnkBeQLs8%2Bi8z0WSW6Te9kg92geUXuLqG44A0nwGdny2876I%2FgOSVdNPPzYDleR10Ac91ADYxyM7eBdw8mLjs5wVAED%2BsBAXLw6oLLjmuS%2F5vk%2F0%2BfpK1dodTr0CCEqRvmcTd01pCKa7Cr4QA8k5IFiTzhnfC5%2FLFaUCmrk0nDlwmLwa3APO2LXmgGsg%2BERXMVKQ6SCozSpiAIS0kvxg1vALkLbjuA9phVs5DRvDL%2Bk2FygltXpFZoSK96gKNozX4%2FaUY2Wm0AOTVoqw4s%2FOQF3rffR17ogB5PSZfSV5aSeaAesCQLEDyzkQXvzEB4lchiDCWDrpu4p4DBaVj0ufBZTEzvAVWp0vn65npLU%2BsLWtbTvqaFMxiZ6IKpcl6LSaLJE4iuSI%2FkbjSrK3uZdrwCLXJhbsRaEtQ1JYmS22RBP7BuzeA9c4ngs86h0Hqoe0Wd8EV88i6WSfuf16%2Ffk19eiV8C5urO9oH5Q6STWJ%2Flm81yLa8irlInA6JEiI%2Bpw8hRGygG3oLXdHbckeQY4lsyc3E%2FQsiw9zIdre6uTay3%2BsP9yS2ZQBROTAmPQQVz2zWSiBQBCNOvCHv3GVsqVwKQkPO3TFX5gU0Cl8vK4%2FXr4MlHOkGUsOHL7AOqEe%2BVrkecGVsfl2PNTHzhljebV0sey2DiDsHTr3PWWLYyqslLbRrJzOZsQgJMBPJLmLKRJipobxszkd%2BG0oeZHVEtiGsgVsRKS1ylkQwG4KaTUdl7oeMHNAvH8IkaoJNKkFhOWBnNshCcqvBFraL%2BbTWQyDFIgAFAzs0go%2FJ5BSs7MTbgCGSKM%2BUWIGcLCqapihy0VwkwOYi0pdGo6R1RKEEkt3bY2i%2BowmSmLcxCzxoHCdpvLQSLkd%2BJUyRMLJtRZmRD%2Fn17b9WkdL7  |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

This example saves the profile information of a specific pipeline to a file:

SQL

SHOW PROFILE PIPELINE SalesData_Pipeline INTO OUTFILE '/tmp/output.csv';