SingleStore DB

memsql-cluster.yaml

Create a MemSQLCluster definition file to specify the configuration settings for your cluster.

apiVersion: memsql.com/v1alpha1
kind: MemsqlCluster
metadata:
  name: memsql-cluster
spec:
  license: LICENSE_KEY
  adminHashedPassword: "HASHED_PASSWORD"
  nodeImage:
    repository: memsql/node
    tag: 6.8.9-24b9cbd386

  redundancyLevel: 1

  serviceSpec:
    objectMetaOverrides:
      labels:
        custom: label
      annotations:
        custom: annotations

  aggregatorSpec:
    count: 3
    height: 0.5
    storageGB: 256
    storageClass: standard

    objectMetaOverrides:
      annotations:
        optional: annotation
      labels:
        optional: label

  leafSpec:
    count: 1
    height: 1
    storageGB: 1024
    storageClass: standard

    objectMetaOverrides:
      annotations:
        optional: annotation
      labels:
        optional: label

You must edit the following placeholders in this file to properly set up your cluster:

  • Change the name value to the cluster name of your choice.

  • Specify your license key and a hashed version of a secure password for the admin database user on the cluster. The admin user is the default user you can use when logging into your cluster. The account is created by the Operator during cluster deployment and has an explicit set of grants (defined at the end of this step) to reduce the scope of this user.

    Note that, as of SingleStore DB 7.1.4, license checks are now cgroup-aware and respect container resource boundaries for containerized deployments. While this does not change how license checks are performed, nor does it change how capacity is allocated, it does change how the resources allocated to the container are checked.

    To include the license key and hashed password, you have the following two options:

    • Replace LICENSE_KEY with your license key from the SingleStore Customer Portal and change HASHED_PASSWORD to a hashed version of a secure password for the admin database user on the cluster. The following python script shows how to create a hashed password. Note that the asterisk (*) must be included in the final password.

      from hashlib import sha1
      print("*" + sha1(sha1('secretpass'.encode('utf-8')).digest()).hexdigest().upper())
      
    • Use Kubernetes secrets to pass in the license key and hashed passwords. You will need one or two secrets (they can be separate or the same secret) with the keys set to the correct values. Note: The password still needs to be hashed inside the secret. It cannot be a bare password.

      licenseSecret:
        name: "my-secret"
        key: "license"
      adminHashedPasswordSecret:
        name: "my-secret"
        key: "password"
      
  • Under nodeImage, tag specifies the version of memsql/node that will be deployed in your cluster. This value aligns with the version number of the SingleStore DB database engine that is running in the container (e.g. 6.8.9-24b9cbd386 contains the 6.8.9 version of MemSQL).

    You can use different versions of the engine by going to the Docker Hub page for memsql/node and selecting a different tag. Because of recent updates to the memsql/node container, you should select a tag that is 6.8.9-24b9cbd386 or newer. Also, running different versions of the SingleStore DB engine in one cluster is not supported, so you must ensure that each node in your Kubernetes cluster has the same tag value.

  • Change redundancyLevel to 2 if you want to enable high availability. It is highly recommended you set this value to 2 for production deployments. Note: You must have an even number of leaf nodes to enable high availability. Refer to Managing High Availability for more information.

  • The objectMetaOverrides sections are optional. By including these sections, you can override the metadata annotations and labels at either the node or service layer (objectMetaOverrides).

  • Change count to alter the number of aggregator or leaf nodes in your cluster.

  • The height value specifies the vCPU and RAM size of an aggregator or leaf node where a height of 1 equals 8 vCPU cores and 32 GB of RAM. The smallest value you can set is 0.5 (4 vCPU cores, 16 GB of RAM).

  • The storageGB value corresponds to the amount of storage each aggregator or leaf should request for their persistent data volume.

  • The storageClass value specifies which storage class to use for the PersistedVolume in the Kubernetes cluster. You should change this value to align with the default (or custom) storage class available to your cluster.

  • Users may declare an envVariables section. This is an optional section that allows environment variables to be specified. The currently supported environment variables include:

    • MALLOC_ARENA_MAX

    envVariables:
      MALLOC_ARENA_MAX: 4
    

Once you have finished creating your definition files, you can deploy your cluster.

The admin user has the following database permissions:

  • USAGE

  • SELECT

  • INSERT

  • UPDATE

  • DELETE

  • CREATE

  • DROP

  • PROCESS

  • INDEX

  • ALTER

  • SHOW METADATA

  • CREATE TEMPORARY TABLES

  • LOCK TABLES

  • CREATE VIEW

  • ALTER VIEW

  • DROP VIEW

  • SHOW VIEW

  • DROP DATABASE

  • CREATE DATABASE

  • CREATE ROUTINE

  • ALTER ROUTINE

  • EXECUTE

  • CREATE PIPELINE

  • DROP PIPELINE

  • START PIPELINE

  • ALTER PIPELINE

  • SHOW PIPELINE