Troubleshoot Your Monitoring Setup
On this page
Pipelines
Check the Monitoring Tables for Data
-
Connect to the database.
-
Run the following SQL.
The default database name is metrics
.If your database name is different from the default name, replace metrics
with your database name.USE metrics;SELECT * FROM metrics LIMIT 10;Optional, run
SELECT * FROM
on all of the monitoring tables.If these queries return an empty set, review the pipelines error tables using the next step.
-
Review the monitoring pipelines.
SHOW PIPELINES; -
If a monitoring pipeline (with a name resembling
*_
andmetrics *_
) is in a state other thanblobs running
, start the pipeline.START PIPELINE <pipeline-name>; -
Check the
information_
table for errors.schema. pipelines_ errors SELECT * FROM information_schema.pipelines_errors;
Resolve Pipeline Errors
If you receive an Cannot extract data for the pipeline error
in the pipelines_
, perform the following steps.
-
Confirm that port
9104
is accessible from all hosts in the cluster.This is the default port used for monitoring. To test this, run the following command at the Linux command line and review the output. curl http://<endpoint>:9104/cluster-metricsFor example:
curl http://192.168.1.100:9104/cluster-metrics -
If the hostname of the Master Aggregator is
localhost
, and a pipeline was created usinglocalhost
, use the following SQL commands to recreate the pipeline with the Master Aggregator host’s IP addresses.For example: metrics
pipeline:CREATE OR REPLACE PIPELINE `metrics` AS LOAD DATA prometheus_exporter"http://<host-ip-address>:9104/cluster-metrics" CONFIG '{"is_memsql_internal":true}'INTO PROCEDURE `load_metrics` FORMAT JSON;START PIPELINE IF NOT RUNNING metrics;blobs
pipeline:CREATE OR REPLACE PIPELINE `blobs` AS LOAD DATA prometheus_exporter"http://<host-ip-address>:9104/samples" CONFIG '{"is_memsql_internal":true, "download_type":"samples"}'INTO PROCEDURE `load_blobs` FORMAT JSON;START PIPELINE IF NOT RUNNING blobs;
Last modified: April 17, 2023