CLI Online Deployment - Debian Distribution

Prerequisites

For this tutorial you will need:

• One (for single-host cluster-in-a-box for development) or four physical or virtual machines (hosts) with the following:

  • Each SingleStore node requires at least four (4) x86_64 CPU cores and eight (8) GB of RAM per host

  • Eight (8) vCPU and 32 GB of RAM are recommended for leaf nodes to align with license unit calculations

  • Running a 64-bit version of RHEL/AlmaLinux 7 or later, or Debian 8 or later, with kernel 3.10 or later

  • Port 3306 open on all hosts for intra-cluster communication. Based on the deployment method, this default can be changed either from the command line or via cluster file.

  • Port 8080 open on the main deployment host for the cluster

  • A non-root user with sudo privileges available on all hosts in the cluster that be used to run SingleStore services and own the corresponding runtime state

• SSH access to all hosts

  • Installing and using ssh-agent is recommended for SSH keys with passwords. Refer to ssh-agent and ssh-add and Use ssh-agent to Manage Private Keys for more information.

  • If your environment does not support the use of ssh-agent , make sure the identity key used on the main deployment host can be used to log in to each host in the cluster. Refer to How to Setup Passwordless SSH Login for more information.

• A connection to the Internet to download required packages

If running this in a production environment, it is highly recommended that you follow our host configuration recommendations for optimal cluster performance.

✘ Host check failed.host 172.26.212.166 has the same ssh
host keys as 172.16.212.165, toolbox doesn't support
registering the same host twice

sudo root
ls -al /etc/ssh/
rm /etc/ssh/<your-ssh-host-keys>
ssh-keygen -f /etc/ssh/<ssh-host-key-filename> -N '' -t rsa1
ssh-keygen -f /etc/ssh/<ssh-host-rsa-key-filename> -N '' -t rsa
ssh-keygen -f /etc/ssh/<ssh-host-dsa-key-filename> -N '' -t dsa

Online Installation - Debian Distribution

1. Verify you have apt-transport-https installed.

   Shell

   Copy

   apt-cache policy apt-transport-https

   If apt-transport-https is not installed, you must install it before proceeding.

   Shell

   Copy

   sudo apt -y install apt-transport-https

2. SingleStore packages are signed to ensure integrity, so the GPG key needs to be added to this machine.

   Shell

   Copy

   wget -O - 'https://release.memsql.com/release-aug2018.gpg' 2>/dev/null | sudo apt-key add - && apt-key list

   Without using apt-key:

   Shell

   Copy

   wget -q -O - 'https://release.memsql.com/release-aug2018.gpg' | sudo tee /etc/apt/trusted.gpg.d/memsql.asc 1>/dev/null

3. Add the SingleStore repository to retrieve its packages.

   Shell

   Copy

   echo "deb [arch=amd64] https://release.memsql.com/production/debian memsql main" | sudo tee /etc/apt/sources.list.d/memsql.list

4. Run the following to install SingleStore Tools.

   Shell

   Copy

   sudo apt update && sudo apt -y install singlestoredb-toolbox singlestore-client

Prerequisites

CLI Online Deployment

You can deploy SingleStore onto each host from the main deployment host and create the SingleStore nodes for your cluster.

From the main deployment host, deploy the SingleStore on all of your hosts using the setup-cluster command. Hosts are specified via the --master-host, --aggregator-hosts, and --leaf-hosts flags as comma-separated host names. The --password flag specifies the password for the root database user.

Other than the main deployment host being specified as the --master-host, the other hosts in your cluster can be used as hosts for the child aggregator or leaf nodes.

sdb-deploy setup-cluster -i /path/to/yourSSHkey \
    --license <license> \
    --master-host <main_IP_address_or_hostname> \
    --aggregator-hosts <child_agg_IP_address_or_hostname> \
    --leaf-hosts <leaf1_IP_address_or_hostname>,<leaf2_IP_address_or_hostname> \
    --password <secure_password> \
    --version 7.3

For large clusters with many hosts, it may be inconvenient to have to input all the host names in the command line. In place of the individual flags, you may instead use a cluster file. See the Cluster File Deployment for more information.

Note: If your license is not shown in the code block above, you can retrieve it from the Cloud Portal.

The setup-cluster command does several things for you:

• Installs the latest singlestoredb-server package on all hosts in your cluster.

• Deploys SingleStore engine across all of the hosts in your cluster.

• Creates the master aggregator. In this tutorial, the master aggregator resides on the main deployment host.

• Creates any child aggregators specified in either the host file or in the command-line.

• Creates leaf nodes for your cluster. Note: The setup-cluster command only creates one node per host. If your host is NUMA capable and has more than one NUMA node, you can install additional leaf nodes.

• By default, the setup-cluster command will also enable High Availability. To disable High Availability, use the flag --high-availability=false in the setup-cluster command.

After you have deployed your cluster, run sdb-admin optimize. This command checks your current cluster configuration against a set of best practices and either makes changes to maximize performance or provides recommendations for you. For hosts with NUMA support, this command will bind the leaf nodes to specific NUMA nodes.

sdb-admin optimize

If you encounter errors running either of these commands, verify that your deployment environment satisfies the following conditions:

• You can SSH to every host in the cluster using the IPs or hostnames specified in the setup-cluster step above.

• Your deployment user has root or sudo privileges in order to install packages on all hosts:

  Shell

  Copy

  sudo apt-get install ...

• Port 3306 on all hosts is open to all other hosts in the cluster.