SingleStore Managed Service

Database Storage

SingleStore stores data remotely in an object store (unlimited storage database) or locally in a SingleStore cluster, depending on the cloud provider you have chosen for the cluster deployment. AWS clusters store data remotely in an object store, whereas Google Cloud Platform (GCP) and Azure clusters store data locally within the cluster. When you deploy a cluster using one of these cloud providers and create databases, the databases will automatically use the storage method defined for the cluster.

AWS Cluster - Unlimited Storage Databases

AWS clusters use unlimited storage, where databases are stored in object storage. The use of object storage separates where data is stored (in an object store external to the SingleStore compute) from where the data is processed (in a SingleStore compute cluster). Because unlimited storage databases are stored remotely, their size is not limited by the size of the persistent cluster cache, but rather only by available external object storage. On public cloud object stores, this is for all practical purposes unlimited.

In an unlimited storage database:

  • All columnstore data is stored externally in an object store. Recently accessed columnstore data objects are also cached locally in the compute cluster's persistent cluster cache.

  • All rowstore data is stored locally in compute cluster memory and externally in object storage.

  • Data updates made on the cluster are flushed to the object store asynchronously. Typically, the object store will be no more than one minute behind the latest update on the cluster.

When you run the CREATE DATABASE command on AWS clusters, it automatically creates an unlimited storage database. BACKUP DATABASE and RESTORE DATABASE commands can be used for database backup and restore respectively. Data will be automatically restored into unlimited storage databases on AWS clusters.

GCP and Azure Clusters - Local Storage Databases

GCP and Azure clusters use local storage, where databases are stored in your SingleStore cluster.

When you run the CREATE DATABASE command on GCP and Azure clusters, it automatically creates a local storage database. BACKUP DATABASE and RESTORE DATABASE commands can be used for database backup and restore respectively. Data will be automatically restored into local storage databases on GCP and Azure clusters.