Setting the Blob Cache

The blob cache is a disk cache of data in a remote object store.

Its size is controlled by the following engine variables:

When the disk space on the disk it’s mounted on starts getting filled up and stored files/objects need more space, the blob cache starts shrinking itself. The blob cache can shrink down to 70% of its maximum size.  Anything that uses disk space (logs, trace logs, plancache, audit logs) even things outside the engine can steal space from the blob cache.

Changing maximum_blob_cache_size_percent changes maximum_blob_cache_size_mb but then you can reset maximum_blob_cache_size_mb again. Essentially, maximum_blob_cache_size_mb is the 'source of truth' and maximum_blob_cache_size_percent can be 'out of date' if you reset maximum_blob_cache_size_mb after setting maximum_blob_cache_size_percent. However, on a restart, maximum_blob_cache_size_percent will take priority and set maximum_blob_cache_size_mb to the corresponding value.

Example:

//Assume you are using a 1 TB disk and

maximum_blob_cache_size_mb = 800GB  // for example
maximum_blob_cache_size_percent = 0
maximum blob cache size = 800GB

SET maximum_blob_cache_size_percent = 0.50;

//Now

maximum_blob_cache_size_mb = 500GB
maximum_blob_cache_size_percent = 0.50
maximum blob cache size = 500GB

SET maximum_blob_cache_size_mb = 800GB;

maximum_blob_cache_size_mb = 800GB
maximum_blob_cache_size_percent = 0.50
maximum blob cache size = 800GB

// On restarting the node

maximum_blob_cache_size_mb = 500GB
maximum_blob_cache_size_percent = 0.50
maximum blob cache size = 500GB

SingleStore does not recommend using both variables at the same time, only one or the other.

Details related to the blob cache are found in the information schema tables mv_cached_blobs and mv_blob_cache_events.

Last modified: March 8, 2024

Was this article helpful?

Verification instructions

Note: You must install cosign to verify the authenticity of the SingleStore file.

Use the following steps to verify the authenticity of singlestoredb-server, singlestoredb-toolbox, singlestoredb-studio, and singlestore-client SingleStore files that have been downloaded.

You may perform the following steps on any computer that can run cosign, such as the main deployment host of the cluster.

  1. (Optional) Run the following command to view the associated signature files.

    curl undefined
  2. Download the signature file from the SingleStore release server.

    • Option 1: Click the Download Signature button next to the SingleStore file.

    • Option 2: Copy and paste the following URL into the address bar of your browser and save the signature file.

    • Option 3: Run the following command to download the signature file.

      curl -O undefined
  3. After the signature file has been downloaded, run the following command to verify the authenticity of the SingleStore file.

    echo -n undefined |
    cosign verify-blob --certificate-oidc-issuer https://oidc.eks.us-east-1.amazonaws.com/id/CCDCDBA1379A5596AB5B2E46DCA385BC \
    --certificate-identity https://kubernetes.io/namespaces/freya-production/serviceaccounts/job-worker \
    --bundle undefined \
    --new-bundle-format -
    Verified OK