SHOW PROFILE PIPELINE
On this page
Provides detailed execution profiling information for pipelines.SHOW PROFILE PLAN <plan_, aggregating and presenting profiles for all plans associated with a given pipeline including any stored procedures associated with the pipeline.
Syntax
SHOW PROFILE [JSON | UI][PLAN <plan_id>][PROCESS <process_id>][PIPELINE <pipeline_name>][INTO OUTFILE <file_name>][ON NODE <node_id>];
Arguments
-
plan_: Plan ID whose profile information is displayed.id -
process_: Process ID whose profile information is displayed.id -
pipeline_: Name of the pipeline whose profile information is displayed.name -
file_(Optional): Name of the file where profiling output is saved.name -
node_(Optional): Node ID on which profiling output is restricted.id By default, if no node is specified, the query is forwarded to the Master Aggregator (MA).
Return Type
-
SHOW PROFILE PIPELINE <pipeline_name> [INTO OUTFILE <file_ name>] -
Returns multiple rows.
-
Each group of rows corresponds to a plan profile, with a row labeled
Plan id <plan_serving as a delimiter.id>
-
-
SHOW PROFILE JSON PIPELINE <pipeline_name> [INTO OUTFILE <file_ name>] -
Returns a single row containing a JSON array.
-
Each JSON object in the array represents the profile of an individual plan.
-
-
SHOW PROFILE UI PIPELINE <pipeline_name> [INTO OUTFILE <file_ name>] -
Returns multiple rows.
-
Each row contains a URL for accessing a profile in the user interface, grouped by pipeline.
-
Remarks
-
When run:
-
The pipeline ID is retrieved.
-
Plans are collected based on their associated activities.
-
Activities are filtered where the activity tracking ID belongs to the pipeline.
-
Profiles from all matching plans are extracted and combined.
-
-
This allows convenient access to profiling data for all plans within a pipeline in a single command.
-
This command causes implicit commits.
Refer to COMMITfor more information. -
SHOW PROFILE PIPELINEprofiles the active foreground batches of a pipeline.Foreground batches are the tasks that the pipeline processes while actively running in the foreground. Run the pipeline in the foreground before using this command. The number of foreground batches can also be configured. -
Refer to the Permission Matrix for the required permissions.
Examples
This example shows detailed profile information for every plan in the SalesData_.
SHOW PROFILE PIPELINE SalesData_Pipeline;
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| PROFILE |
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Plan id: 15 |
| Gather partitions:all est_rows:15,000,000 alias:remote_0 actual_rows: 106 exec_time: 0ms |
| SegmentMerge segments: 106 exec_time: 0ms start_time: [00:00:00.000, 00:00:59.608] Segment Compress: 0ms Segment Merge: 0ms Auto Stats: 0ms Segment Decompression: 0ms |
| InsertInto sales.SalesData [r0.Date, r0.Store_ID, r0.ProductID, r0.Product_Name, r0.Product_Category, r0.Quantity_Sold, r0.Price, r0.Total_Sales] local:yes est_rows:15,000,000 actual_rows: 15,000,000 exec_time: 0ms start_time: [00:00:00.000, 00:00:02.175] Segment Count: 90 Segment Sort: 0ms Dup Check: 0ms Segment Compress: 0ms Auto Stats: 0ms In-memory Queue: 0ms In-memory Flush: 0ms |
| TableScan r0 storage:list stream:yes table_type:sharded exec_time: 0ms |
| Repartition [SalesData_src.Date, SalesData_src.Store_ID, SalesData_src.ProductID, SalesData_src.Product_Name, SalesData_src.Product_Category, SalesData_src.Quantity_Sold, SalesData_src.Price, SalesData_src.Total_Sales, RAND() AS rand_0] AS r0 shard_key:[rand_0] est_rows:15,000,000 actual_rows: 15,000,000 exec_time: 0ms network_traffic: 1,278,954.375000 KB network_time: 0ms |
| ExternalIngest pipeline:SalesData_Pipeline table_type:sharded_columnstore |
| |---FileParse actual_rows: 15,000,002 exec_time: 0ms start_time: [00:00:00.000, 00:00:00.156] end_time: [00:00:00.000, 00:00:59.498] |
| |---Extract streamed_bytes: 885,843.562500 KB exec_time: 0ms start_time: [00:00:00.000, 00:00:00.156] |
| +---PopulateRow actual_rows: 15,000,000 exec_time: 0ms start_time: [00:00:00.000, 00:00:00.767] end_time: [00:00:00.000, 00:00:59.498] |
| Compile Total Time: 28ms |
+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+This example returns the profile information formatted as a JSON array.
SHOW PROFILE JSON PIPELINE SalesData_Pipeline;
+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| PROFILE |
+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| [
{
"plan_warnings": {
},
"execution_warnings": {
},
"mpl_path":"\/data\/master\/plancache\/2fb\/RunPipeline_SalesData_Pipeline_profile_partial_SalesData__et_al_2fb8e3cdb8969265d6d413d578806f5d507e469b75281f9e4d2321078758394b_55ca0d824f34339a",
"profile":[
{
"executor":"Gather",
"keyId":4295163904,
"partitions":"all",
"est_rows":"15000000",
"est_rows_source":"JOIN",
"query":"INSERT INTO `sales_0`.`SalesData` (`SalesData`.`Date`, `SalesData`.`Store_ID`, `SalesData`.`ProductID`, `SalesData`.`Product_Name`, `SalesData`.`Product_Category`, `SalesData`.`Quantity_Sold`, `SalesData`.`Price`, `SalesData`.`Total_Sales`)SELECT `r0`.`Date` AS `Date`, `r0`.`Store_ID` AS `Store_ID`, `r0`.`ProductID` AS `ProductID`, `r0`.`Product_Name` AS `Product_Name`, `r0`.`Product_Category` AS `Product_Category`, `r0`.`Quantity_Sold` AS `Quantity_Sold`, `r0`.`Price` AS `Price`, `r0`.`Total_Sales` AS `Total_Sales` FROM @ `sales`.REMOTE(:: `sales`.`r0`(0) AS SELECT (1!:>text CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL) AS `Date`,(1!:>bigint(20) NULL) AS `Store_ID`,(1!:>text CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL) AS `ProductID`,(1!:>text CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL) AS `Product_Name`,(1!:>text CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NULL) AS `Product_Category`,(1!:>bigint(20) NULL) AS `Quantity_Sold`,(1!:>float NULL) AS `Price`,(1!:>float NULL) AS `Total_Sales`,(1!:>double NOT NULL) AS `rand_0`) as `r0` WITH (takeover_conn = TRUE) \/*!90623 OPTION(NO_QUERY_REWRITE=1, INTERPRETER_MODE=INTERPRET_FIRST, AUTO_PROFILE='SMART')*\/",
"alias":"remote_0",
"actual_row_count":{ "value":106, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"actual_total_time":{ "value":0 },
"mbc_emission":{ "value":8, "avg":8.000000, "stddev":0.000000, "max":8, "maxPartition":0 },
"create_mbc_context":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"optimizer_query_rewrites":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"optimizer_setting_up_subselect":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"optimizer_distributed_optimizations":{ "value":6, "avg":6.000000, "stddev":0.000000, "max":6, "maxPartition":0 },
"optimizer_enumerate_temporary_tables":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"ppc_check":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"parse_query":{ "value":22, "avg":22.000000, "stddev":0.000000, "max":22, "maxPartition":0 },
"persistence_mpl":{ "value":8, "avg":8.000000, "stddev":0.000000, "max":8, "maxPartition":0 },
"generating_query_mpl":{ "value":5, "avg":5.000000, "stddev":0.000000, "max":5, "maxPartition":0 },
"generating_user_function_mpl":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"total":{ "value":35, "avg":35.000000, "stddev":0.000000, "max":35, "maxPartition":0 },
"inputs":[
{
"executor":"SegmentMerge",
"keyId":196968,
"actual_row_count":{ "value":106, "avg":53.000000, "stddev":0.000000, "max":53, "maxPartition":0 },
"actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"start_time":{ "value":0, "avg":391423.500000, "stddev":0.000000, "max":391424, "maxPartition":0 },
"PostSortCompress":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"PostSortMergeTime":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"PostSortAutoStats":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"PostSortDecompression":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"inputs":[
{
"executor":"InsertInto",
"keyId":196912,
"db":"sales",
"table":"SalesData",
"out":[
{
"alias":"",
"projection":"r0.Date"
},
{
"alias":"",
"projection":"r0.Store_ID"
},
{
"alias":"",
"projection":"r0.ProductID"
},
{
"alias":"",
"projection":"r0.Product_Name"
},
{
"alias":"",
"projection":"r0.Product_Category"
},
{
"alias":"",
"projection":"r0.Quantity_Sold"
},
{
"alias":"",
"projection":"r0.Price"
},
{
"alias":"",
"projection":"r0.Total_Sales"
}
],
"local":"yes",
"est_rows":"15000000",
"est_rows_source":"JOIN",
"subselects":[],
"actual_row_count":{ "value":15000000, "avg":7500000.000000, "stddev":2118.000000, "max":7502118, "maxPartition":1 },
"actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"start_time":{ "value":0, "avg":6749.500000, "stddev":0.000000, "max":6779, "maxPartition":0 },
"SegmentCount":{ "value":90, "avg":45.000000, "stddev":0.000000, "max":45, "maxPartition":0 },
"SegmentSort":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"DupCheckInStager":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"SegmentCompress":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"AutoStats":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"InMemoryInsertQueue":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"InMemoryInsertFlush":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"inputs":[
{
"executor":"TableScan",
"keyId":4295229440,
"table":"r0",
"alias":"r0",
"storage":"list",
"stream":"yes",
"table_type":"sharded",
"actual_row_count":{ "value":15000000, "avg":7500000.000000, "stddev":2118.000000, "max":7502118, "maxPartition":1 },
"actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"inputs":[
{
"executor":"Repartition",
"keyId":328008,
"out":[
{
"alias":"",
"projection":"SalesData_src.Date"
},
{
"alias":"",
"projection":"SalesData_src.Store_ID"
},
{
"alias":"",
"projection":"SalesData_src.ProductID"
},
{
"alias":"",
"projection":"SalesData_src.Product_Name"
},
{
"alias":"",
"projection":"SalesData_src.Product_Category"
},
{
"alias":"",
"projection":"SalesData_src.Quantity_Sold"
},
{
"alias":"",
"projection":"SalesData_src.Price"
},
{
"alias":"",
"projection":"SalesData_src.Total_Sales"
},
{
"alias":"rand_0",
"projection":"RAND()"
}
],
"est_rows_source":"JOIN",
"alias":"r0",
"shard_key":[
"rand_0"
],
"destination_database":"sales",
"context_database":"sales",
"est_rows":"15000000",
"query":"CREATE RESULT TABLE `r0` PARTITION BY (`rand_0`) WITH (DEST_DB=`sales`, TAKEOVER_CONN=TRUE) AS SELECT `SalesData_src`.`Date` AS `Date`, `SalesData_src`.`Store_ID` AS `Store_ID`, `SalesData_src`.`ProductID` AS `ProductID`, `SalesData_src`.`Product_Name` AS `Product_Name`, `SalesData_src`.`Product_Category` AS `Product_Category`, `SalesData_src`.`Quantity_Sold` AS `Quantity_Sold`, `SalesData_src`.`Price` AS `Price`, `SalesData_src`.`Total_Sales` AS `Total_Sales`, RAND() AS `rand_0` FROM `sales_0`.`SalesData` as `SalesData_src` LOAD EXTRACTOR 12 ('[[],[\\\"SalesData\/sales_data.csv\\\",0,1]]') FROM `sales`.`SalesData_Pipeline`(1, '595b3090c58cb0a9c46a8f9455e0cf5a0dfe2bb4', '{\\\"latestKey\\\":\\\"SalesData\/sales_data.csv\\\",\\\"cursorKey\\\":\\\"\\\",\\\"offset_gc_timestamp\\\":0,\\\"fuzz\\\":0,\\\"scan_start_time\\\":0,\\\"first_scan_done\\\":true}') 2 (`Date`,`Store_ID`,`ProductID`,`Product_Name`,`Product_Category`,`Quantity_Sold`,`Price`,`Total_Sales`) \/*!90623 OPTION(NO_QUERY_REWRITE=1, INTERPRETER_MODE=INTERPRET_FIRST, AUTO_PROFILE='SMART')*\/",
"actual_row_count":{ "value":15000000, "avg":7500000.000000, "stddev":7500000.000000, "max":15000000, "maxPartition":1 },
"actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"network_traffic":{ "value":1278954409, "avg":639477204.500000, "stddev":639477204.500000, "max":1278954409, "maxPartition":1 },
"mbc_emission":{ "value":11, "avg":11.000000, "stddev":0.000000, "max":11, "maxPartition":0 },
"create_mbc_context":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"optimizer_query_rewrites":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"optimizer_setting_up_subselect":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"optimizer_distributed_optimizations":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"optimizer_enumerate_temporary_tables":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"ppc_check":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"parse_query":{ "value":6, "avg":6.000000, "stddev":0.000000, "max":6, "maxPartition":0 },
"persistence_mpl":{ "value":7, "avg":7.000000, "stddev":0.000000, "max":7, "maxPartition":0 },
"generating_query_mpl":{ "value":7, "avg":7.000000, "stddev":0.000000, "max":7, "maxPartition":0 },
"generating_user_function_mpl":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"total":{ "value":33, "avg":33.000000, "stddev":0.000000, "max":33, "maxPartition":0 },
"network_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"wait_for_reader_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"inputs":[
{
"executor":"ExternalIngest",
"keyId":393559,
"pipeline":"SalesData_Pipeline",
"table_type":"sharded_columnstore",
"columnstore_in_memory_scan_type":"TableScan",
"columnstore_in_memory_scan_index":"SORT KEY __UNORDERED ()",
"inputs":[
{
"executor":"FileParse",
"keyId":393567,
"actual_row_count":{ "value":15000002, "avg":15000002.000000, "stddev":0.000000, "max":15000002, "maxPartition":1 },
"actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"start_time":{ "value":0, "avg":152.000000, "stddev":0.000000, "max":152, "maxPartition":1 },
"end_time":{ "value":0, "avg":391302.000000, "stddev":0.000000, "max":391302, "maxPartition":1 },
"inputs":[]
},
{
"executor":"Extract",
"keyId":393561,
"actual_row_count":{ "value":885843591, "avg":885843591.000000, "stddev":0.000000, "max":885843591, "maxPartition":1 },
"actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"start_time":{ "value":0, "avg":152.000000, "stddev":0.000000, "max":152, "maxPartition":1 },
"inputs":[]
},
{
"executor":"PopulateRow",
"keyId":393564,
"actual_row_count":{ "value":15000000, "avg":15000000.000000, "stddev":0.000000, "max":15000000, "maxPartition":1 },
"actual_total_time":{ "value":0, "avg":0.000000, "stddev":0.000000, "max":0, "maxPartition":0 },
"start_time":{ "value":0, "avg":787.000000, "stddev":0.000000, "max":787, "maxPartition":1 },
"end_time":{ "value":0, "avg":391302.000000, "stddev":0.000000, "max":391302, "maxPartition":1 },
"inputs":[]
}
]
}
]
}
]
}
]
}
]
}
]
}
],
"version":"4",
"warning":"requires compile",
"info":{
"memsql_version":"9.1.1",
"memsql_version_hash":"448d219d3dd11aba42ae8f31fb2227b0370b09e5",
"num_online_leaves":"1",
"num_online_aggs":"1",
"context_database":"sales"
},
"query_info":{
"query_text":"INSERT INTO `sales`.`SalesData` SELECT with(force_random_reshuffle=true) `Date`, `Store_ID`, `ProductID`, `Product_Name`, `Product_Category`, `Quantity_Sold`, `Price`, `Total_Sales` FROM `sales`.`SalesData` `SalesData_src` LOAD EXTRACTOR @ (^) FROM `sales`.`SalesData_Pipeline`(1, '595b3090c58cb0a9c46a8f9455e0cf5a0dfe2bb4', ^) @",
"total_runtime_ms":"400618",
"agg_node":"127.0.0.1",
"text_profile":"Gather partitions:all est_rows:15,000,000 alias:remote_0 actual_rows: 106 exec_time: 0ms\nSegmentMerge segments: 106 exec_time: 0ms start_time: [00:00:00.000, 00:06:31.424] Segment Compress: 0ms Segment Merge: 0ms Auto Stats: 0ms Segment Decompression: 0ms\nInsertInto sales.SalesData [r0.Date, r0.Store_ID, r0.ProductID, r0.Product_Name, r0.Product_Category, r0.Quantity_Sold, r0.Price, r0.Total_Sales] local:yes est_rows:15,000,000 actual_rows: 15,000,000 exec_time: 0ms start_time: [00:00:00.000, 00:00:06.779] Segment Count: 90 Segment Sort: 0ms Dup Check: 0ms Segment Compress: 0ms Auto Stats: 0ms In-memory Queue: 0ms In-memory Flush: 0ms\nTableScan r0 storage:list stream:yes table_type:sharded exec_time: 0ms\nRepartition [SalesData_src.Date, SalesData_src.Store_ID, SalesData_src.ProductID, SalesData_src.Product_Name, SalesData_src.Product_Category, SalesData_src.Quantity_Sold, SalesData_src.Price, SalesData_src.Total_Sales, RAND() AS rand_0] AS r0 shard_key:[rand_0] est_rows:15,000,000 actual_rows: 15,000,000 exec_time: 0ms network_traffic: 1,278,954.375000 KB network_time: 0ms\nExternalIngest pipeline:SalesData_Pipeline table_type:sharded_columnstore\n|---FileParse actual_rows: 15,000,002 exec_time: 0ms start_time: [00:00:00.000, 00:00:00.152] end_time: [00:00:00.000, 00:06:31.302]\n|---Extract streamed_bytes: 885,843.562500 KB exec_time: 0ms start_time: [00:00:00.000, 00:00:00.152]\n+---PopulateRow actual_rows: 15,000,000 exec_time: 0ms start_time: [00:00:00.000, 00:00:00.787] end_time: [00:00:00.000, 00:06:31.302]\nCompile Total Time: 38ms\n",
"compile_time_stats":{
"mbc_emission":"6",
"create_mbc_context":"0",
"optimizer_query_rewrites":"0",
"optimizer_stats_analyze":"0",
"optimizer_stats_other":"0",
"optimizer_setting_up_subselect":"0",
"optimizer_distributed_optimizations":"6",
"optimizer_enumerate_temporary_tables":"0",
"optimizer_singlebox_optimizations_agg":"0",
"optimizer_stats_autostats":"3",
"ppc_check":"0",
"parse_query":"7",
"persistence_mpl":"6",
"generating_query_mpl":"3",
"generating_user_function_mpl":"0",
"total":"38"
},
"optimizer_optree_memory":"6272",
"optimizer_dstree_memory":"0",
"optimizer_pin_used":"0",
"optimizer_pin_set":"0"
},
"task_stats_info":{
"total_task_memory_bs":"34018608170",
"total_task_cpu_time_ms":"64437",
"total_task_network_time_ms":"1159858",
"agg_task_memory_bs":"52498498",
"agg_task_cpu_time_ms":"25",
"agg_task_network_time_ms":"400561"
}
},
] |
+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+This example returns a URL that links to user interface views for interactive inspection of profile reports.
SHOW PROFILE UI PIPELINE SalesData_Pipeline;
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| PROFILE |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| https://explain.labs.singlestore.com/#json=eJztHG17mzjy%2B%2F4Krb%2FU2XMdXg34eXLPpol762saZ2339vaJcwSDnHDF4PKSNO31v58kQBZgDHYcp%2BmddtsaaTQzGo2k0czA158AKo2FY7j6veG7tnsTNLrg60%2FfWnEL%2FAzNKLS9kub5wtEXRnjb6DYmh5YRGpPDuRGE0J8cYpymYd7CyaEwm04Oh5F7YS%2BgY7tQHxkODE4RuE6rFr43sx30r%2BGHtuEwIDoMdVSBkKhQNK2pqnU0oSNbHUviRUtWVJXrzGRL5hQodbSpIgsqP9OgZAmiwHOKqsiqqElTXZoqpgVFw5JVhZ91Zo1kDAnlRveSPOPylf5ihOD5aJR%2FQ4OFftKVAnyED32r0ZUETeY7osZJuXYyKCxFJL2G4Tj5%2FjAIdd%2B7x628zJFSBqIHXuSbiNvG3wf98zzUpwj6D6itfz7qDcegfz4egOsAi1LnrtvXVKjXoMk8tK%2FRP%2FC6BTJ1IzRiqPdP8%2FUXvmdFZljaoJ8b8wKytO0EEbrx%2FId8%2B%2B%2BR4SIRPegjz7GKnW2zgHHshamaXB%2BMeme9kzG49rl0MOB4BOiwSDUdD2liR0eal8Mi7ZlRsgDx8FgYOuAMGB1pBpQdPwHPDpzAFmSR4MVCSJAl8iANrCBIc6bi7XDwHvyaKMF1e9h7Pxj3mt0urcFImtwB7plIscn%2F3P1rCD%2BH4OS34%2BHxybg3RE1jEIUzdT6VwMng7Ox43Euf9RvoQh9RNG1w%2FuHs7IARPUE1tW9sN2wKiMiyfSn%2FnZBjpmuX%2BJKp3SnKpQqUSyenAgRw5nhGmMFHtGBlG6sCMYTlRVMHgvPBmAHzDddCG8MBMAKiTOCP%2Fvg30AyNj9C7g75ueq4LjsB4%2BKF3ACaHv%2FyscR1BBIOLcX9w3jwf6L9%2F6A3%2F1Ie9P4b9ce%2BIb%2BEdpze8GPbQ3%2Fr7wWnviFbob%2FvD0bgFjj%2BMB%2FrFcPC2f9Y7ejV6fzwcvzr4ZXKY38oMxzbwhujDuRdCvbAhGmYYoTGiPRGxGblho%2FsVNO4MJ0J7I891Wgji7qbR5drxfoqeg9Cy4F2mam58Rs%2Fxj4t0k0Y14NtqaiGRa2jPIUuuCD6fmjqc20FA0C0hlZQtpZotpQZbpg%2BRNumYHJorrKEZvnYsBG%2BBRm5%2FQYpBzhndh%2Fe%2BHcJgPzQDGIbIANGjhR5E0wA60NzTaC07CH17GoXQ0pNaIznNl%2BSpxnWqyXc2Ig%2FdaI62EzTPIZwvPN9Aog8NtJqfVPCLBdKpW2h%2BfFIihh9APbFamPVL1wlfY6HwdVbKAvoBmkbommi5LByWmpQSk6ppSTVIxbs%2F0dV4neToySk9uZqevBm9KED6Motck5jsObq7njyyGbIEREpBrEFCrEPDdhdRGLC2eVq%2BFmpIB8ZWH8GbOXTD99C%2FgbnTg4InljuP7hQdtQSm5kkjizWmU6wec55uyZmz28mkRIMQQZVTk7UOV0dtEZi6AdULLwhHnh%2BeePOFD4On3NgKNIl%2BjPck3pToMdLRUWiEex3pKTQT%2BebMkqciXL5607J6FVMEzGruu2hvC%2Ftu6JWsZdqJWdO8UAFrTRFqchOqwkpOXLyrpHfQqg5eFK4beVrWS4BiS83hCqoUfuF7%2F4ZmPEENn2vj%2B1ijVteSyWTLnnhO74gvjW96GX2hjJNb70vlPb1evzT%2BM1f%2Bl8Y88UW8NKYZJ0lN1iuhrirOBMczscnceKg%2Bb6p9wqVd1vqIC73oZRof1FUDWGsLy9RSiH0c8XPRpBA0UclZFQgW19a3LfIc7dVKXspuvbUs8EoNYxlDbUE7ud6c5KdBo%2BSlGsSlR5DGNuU%2BpX0aLU6wR6LvItP5Bvr7pE2lvbcLCiW9z7sCJdp338M5OkZjs%2Fv3CEZ7XVhZ8m%2BdKLjdJ%2Fnqi0taap5VzEVmjC8SI9Nw655bTHRREDRJ4mr2S28sftXBQXtQn3vtHgEaE1qKqI9jB2H9Xj405rXOQdqHjEYPHxaYWHBr%2BBa0ao%2Frezu18pw9y%2BlFmaiv7Wmpp%2FWUAKP9Q0iD4TVnj2JJ1oEoqBxX4qsr7VvzMp4vm42TUtvQMi30z1iqy0yIwDc3uMfnS01tYMv3N%2FzNXAL58kOIYEPvQr78SDLYwFGRLz%2BUGDbzeeTLDyGKLdwn%2BfJDyGEDT0y%2B%2FBDj39ipky%2F7l0KchbMTWQyPz0%2BbB1sOfONeFc6ifNnOP1XAsvElhfYktwYdmZHbmILpND25lCwkJtslCSY6TqmdGgGsGaQq4EqSgh6NZ3NnZAFFmpp6MuzhVLlhb%2FThbAzGx2%2FOenHu2cXxcNzHiWXgzZ%2BgucxNi3PSTnujsX765ihJW2yhnu96g3%2F0hvrJ4Pz8KE5RW%2BYwXmd2hZVJoXmI8vzQPOS6VNES2DVZo2U9qhNI8z3r5JIWqRXTSvMwazNMWwDEuw6bURinna7OPMa5hlkKAJwNjk9B759jnFs5GAJeAM1Xl5eTyWS5u08OY2xYldtmcIcbW1yLv2pdXl29OgAsSZYgTTG%2FbvIt8ErW5KnIaZwpq%2BaUMzRT6hjqTJNkGXLmTDY4awaF6VR6hWC%2FYhoOEngQvoMP%2BKFbzRL%2By4z8wPPZPrTJm80CGOo3JrntB6ExXxAgjrTOoi9fmMfANFx96WNmAW0fLUnSbnlu3BL6EfyGJCEAtHxiLWfUmFXTnA6uUK684qTKkU27BntOCq3cZHbi6Ck0xFlmMvu8jZ8lz%2BWzOn0oMy4M7z3%2Fox76xmxmmxmJCYqqyZLEaTS3UdQkRRE4qS3neVvRFMuNRfJYZsvyankqNb6G2PhdyG2vqbeV3DxDau4GPO05dXcDzmql9j4fe8%2BS%2BlvJ3z5Sg6uZWJ06vOM07Go2yvOKd5znW8nKnvOON%2BFnn3nJlXwV8pYFlQbs1Rrh%2Bg0SW0t5oKfuM5%2F%2B94Yd6jPPRweGYaE5em5%2BNg9FpWVLJwwTmup9DqHvGk7fvYG1Y5kFhGmUShNlWdvWp5NcWTLerfQesy1jqwKoyHRxormLo7hb42VQ6DZa3CRuH19NEmKbRrw3IWG7FvyM5TQYjsG73p9A1z%2BcD4anvWHvFDQPtqW4vR6mZTt9pAwwevnWduAFPu22HAzFyahmR3kkrho3LYHa5MlzDct82fORO0kZw9%2FFpavAXEUeGS%2FXsGYQ0BNwBl1r3dsgklbjxCRgT8AbXaRXj8LzCDZ2t8jR4eMjFd3lEuefcImrqqxKoqzxqSrQimp1YPv%2Bf5V%2FF6v8R1pJF94iwk7boXe%2Fy9UkPf2ByeUOzDqurJ15JcsYfpFLSenUecG%2B84jMvVLO%2FhcOzK17b0d3i8j0Rj3q46%2BHt8Z7Imshyvuv7leEz8It25NYdOMOe61IxoCUfgYp%2Bb4T%2BeLGp8j2YQDw26L4y0gJhO3OPKTVFFkD3cOCT46%2BRKa1%2BTbPbLo5CP3WwGncDUlSLYHXLNGyeN6YGpJgQHUm8rOpIAjKlBMVbsppUGYxudFc91zyqSgHGneQhKJLAIybm0JzaSScgqTftIp9Z4XBxtWxn3%2FF95WyMc4kCn1vh7fNmeebUMeBUW%2BuI7HeRrOZA49wtO4AMOFoJuCciSjn48WrIsGFMC%2BN5RY%2FBrSK33xANheP%2FRU0%2F%2FUUEVaE9Fd2kuKzxkenI9pA9TmexI6qdDQWBk2u7noWnkBeQLs8%2Bi8z0WSW6Te9kg92geUXuLqG44A0nwGdny2876I%2FgOSVdNPPzYDleR10Ac91ADYxyM7eBdw8mLjs5wVAED%2BsBAXLw6oLLjmuS%2F5vk%2F0%2BfpK1dodTr0CCEqRvmcTd01pCKa7Cr4QA8k5IFiTzhnfC5%2FLFaUCmrk0nDlwmLwa3APO2LXmgGsg%2BERXMVKQ6SCozSpiAIS0kvxg1vALkLbjuA9phVs5DRvDL%2Bk2FygltXpFZoSK96gKNozX4%2FaUY2Wm0AOTVoqw4s%2FOQF3rffR17ogB5PSZfSV5aSeaAesCQLEDyzkQXvzEB4lchiDCWDrpu4p4DBaVj0ufBZTEzvAVWp0vn65npLU%2BsLWtbTvqaFMxiZ6IKpcl6LSaLJE4iuSI%2FkbjSrK3uZdrwCLXJhbsRaEtQ1JYmS22RBP7BuzeA9c4ngs86h0Hqoe0Wd8EV88i6WSfuf16%2Ffk19eiV8C5urO9oH5Q6STWJ%2Flm81yLa8irlInA6JEiI%2Bpw8hRGygG3oLXdHbckeQY4lsyc3E%2FQsiw9zIdre6uTay3%2BsP9yS2ZQBROTAmPQQVz2zWSiBQBCNOvCHv3GVsqVwKQkPO3TFX5gU0Cl8vK4%2FXr4MlHOkGUsOHL7AOqEe%2BVrkecGVsfl2PNTHzhljebV0sey2DiDsHTr3PWWLYyqslLbRrJzOZsQgJMBPJLmLKRJipobxszkd%2BG0oeZHVEtiGsgVsRKS1ylkQwG4KaTUdl7oeMHNAvH8IkaoJNKkFhOWBnNshCcqvBFraL%2BbTWQyDFIgAFAzs0go%2FJ5BSs7MTbgCGSKM%2BUWIGcLCqapihy0VwkwOYi0pdGo6R1RKEEkt3bY2i%2BowmSmLcxCzxoHCdpvLQSLkd%2BJUyRMLJtRZmRD%2Fn17b9WkdL7 |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+This example saves the profile information of a specific pipeline to a file:
SHOW PROFILE PIPELINE SalesData_Pipeline INTO OUTFILE '/tmp/output.csv';
Last modified: October 16, 2025