Upload Metrics to Kafka

Warning

SingleStore 9.0 gives you the opportunity to preview, evaluate, and provide feedback on new and upcoming features prior to their general availability. In the interim, SingleStore 8.9 is recommended for production workloads, which can later be upgraded to SingleStore 9.0.

Users may declare a memsqlPusherSpec inside of a monitoringSpec to configure uploading data to Kafka.

YAML

monitoringSpec:
  memsqlPusherSpec:
    enable: true
    mode: Cluster
    organizationName: <org_name>
    kafkaBootstrapServer: <server_address>
    kafkaProtocol: <kafka_protocol>
    pusherSecretName: <pusher_secret_name>

The <org_name> is the prefix for the two Kafka topics that the monitoring data will be pushed to, specifically:

<org_name>_metrics
<org_name>_blobs

These two topics must be created if they don’t exist.

The Kubernetes secret with pusher_secret_name must contain the following two keys in its data section:

KAFKA_USER
KAFKA_PASSWORD

Last modified: April 17, 2023

Was this article helpful?

Verification instructions

Note: You must install cosign to verify the authenticity of the SingleStore file.

Use the following steps to verify the authenticity of singlestoredb-server, singlestoredb-toolbox, singlestoredb-studio, and singlestore-client SingleStore files that have been downloaded.

You may perform the following steps on any computer that can run cosign, such as the main deployment host of the cluster.

(Optional) Run the following command to view the associated signature files.
Shell
```
curl undefined
```
Download the signature file from the SingleStore release server.
- Option 1: Click the Download Signature button next to the SingleStore file.
- Option 2: Copy and paste the following URL into the address bar of your browser and save the signature file.
- Option 3: Run the following command to download the signature file.
  Shell
```
curl -O undefined
```

After the signature file has been downloaded, run the following command to verify the authenticity of the SingleStore file.

Shell

echo -n undefined |
    cosign verify-blob --certificate-oidc-issuer https://oidc.eks.us-east-1.amazonaws.com/id/CCDCDBA1379A5596AB5B2E46DCA385BC \
      --certificate-identity https://kubernetes.io/namespaces/freya-production/serviceaccounts/job-worker \
      --bundle undefined \
      --new-bundle-format -

Verified OK