Sign inTry Free

MV_BOTTOMLESS_STATUS_EXTENDED

This view provides more diagnostic information compared to MV_BOTTOMLESS_STATUS, such as more detailed LSN, upload statistics, API statistics, and logchunk/snapshot information.

Columns CLEANUP_LSN, REMOTE_LOG_CHUNKS, REMOTE_SNAPSHOTS, LOCAL_LOG_FILES, LOG_FILE_LIST, SNAPSHOT_FILE_LIST, query the remote storage and could slow down the information_schema.

Column name

Description

DATABASE_NAME

Name of the database.

STORAGE_ID

Storage ID of the database.

COMPUTE_ID

Compute ID of the database.

STORAGE_DIRECTORY

Remote storage directory path for the database.

BUCKET

Remote storage bucket located for the database.

ROLE

Current role of the database (primary / secondary / offline).

TERM

A unique identifier of the current master instance of the database.

LOG_PERSISTED_LSN

Log sequence number below which all log chunks have been permanently stored to remote storage.

LOG_ENQUEUED_LSN

Log sequence number below which all blob files have been enqueued for permanent storage to remote storage.

BLOB_PERSISTED_LSN

Log sequence number below which all log chunks have been enqueued for permanent storage to remote storage.

BLOB_ENQUEUED_LSN

Log sequence number below which all blob files have been enqueued for persistence to remote storage.

COMMIT_LSN

Position in the log before which all pages have been committed. All content is committed in the pages that are in the log before this log sequence number.

HARDENED_LSN

Position in the log before which all pages have been written to the disk.

REPLAY_LSN

Position in the log before which all pages have been replayed into memory.

TAIL_LSN

Position in the log before which all pages have been reserved for transactions. The next transaction to reserve space from the log will start writing at this log sequence number.

CLEANUP_LSN

The log sequence number of the highest cleanup file in the remote snapshot directory.

OLDEST_VALID_LSN

Log content below this log sequence number is invalid and must not be referenced by anyone.

LOG_PERSISTED_END_TAG_VERSION

EndTag version below which all log chunks have been persisted stored to remote storage.

UPLOAD_QUEUE_WAIT_SECS

Number of seconds by which the uploads to remote storage are lagging behind.

UPLOADED_BYTES

Number of bytes uploaded.

SECS_SINCE_LAST_UPLOAD

The number of seconds since the last attempted upload.

LAST_UPLOAD_RESULT

The result of the last attempted upload.

BLOB_CACHE_DOWNLOAD_MB_PER_SEC

Rate at which the blob cache is downloading files from remote storage.

BLOB_CACHE_EVICTION_MB_PER_SEC

Rate at which the blob cache is evicting files.

BLOB_CACHE_DOWNLOADED_BYTES

Number of bytes downloaded by the blob cache.

BLOB_CACHE_EVICTED_BYTES

Number of bytes evicted by the blob cache.

BLOB_CACHE_DOWNLOADED_FILES

Number of files downloaded by the blob cache.

BLOB_CACHE_EVICTED_FILES

Number of files evicted by the blob cache.

BACKGROUND_THREAD_UPLOADS

Number of uploads made by the background thread. These uploads are responsible for ensuring that the data is consistently and periodically uploaded to remote storage without direct user intervention. Some examples of tasks performed by the background threads are :

  • Uploading recent changes (such as newly created or updated blobs/files) from local disk to the object store in the background.

  • Ensuring catch-up uploads in scenarios where the ingest thread was unable to keep the object store fully up to date due to throttling, failures, or intentional batching.

  • Performing maintenance uploads (e.g., for segments that become eligible for upload after retention or compaction policies).

INGEST_THREAD_UPLOADS

Number of uploads made by an ingest thread. Ingest threads handle the processing and uploading of data coming into the system. This metric indicates how much ingest has been throttled to keep unlimited storage uploads up to date.

OLDEST_DATA_UNIX_TIMESTAMP

Timestamp when the oldest piece of data became garbage collectable. If this value is near the current timestamp minus the bottomless_gc_retention_period_minutes, then unlimited garbage collection (gc) is keeping up.

NUM_GET_REQUESTS

Number of GET requests made to remote storage.

GET_REQUESTS_PER_SEC

Rate of GET requests made to remote storage.

NUM_POST_REQUESTS

Number of POST requests made to remote storage.

POST_REQUESTS_PER_SEC

Rate of POST requests made to remote storage.

NUM_PUT_REQUESTS

Number of PUT requests made to remote storage.

PUT_REQUESTS_PER_SEC

Rate of PUT requests made to remote storage.

NUM_HEAD_REQUESTS

Number of HEAD requests made to remote storage.

HEAD_REQUESTS_PER_SEC

Rate of HEAD requests made to remote storage.

NUM_DELETE_REQUESTS

Number of DELETE requests made to remote storage.

DELETE_REQUESTS_PER_SEC

Rate of DELETE requests made to remote storage.

NUM_OUTSTANDING_REQUESTS

Number of outstanding API requests to be made to remote storage.

NUM_RETRIED_REQUESTS

Number of retried API requests made to remote storage.

IS_BEING_RATE_LIMITED

Whether API requests to remote storage are being rate limited. On S3, rate limiting starts when we receive 503 SLOWDOWN errors.

REMOTE_LOG_CHUNKS

List of tuples of log chunk beginLSN and endLSN.

REMOTE_SNAPSHOTS

List of log sequence numbers of valid remote snapshots.

LOCAL_LOG_FILES

List of begin log sequence numbers of local log files on disk.

LOG_FILE_LIST

List of begin log sequence numbers of files listed in the log.

SNAPSHOT_FILE_LIST

List of snapshot log sequence numbers of files listed in the log.

NODE_ID

ID of the node where the database is located.

HOST

Host of the node where the database is located.

PORT

Port of the node where the database is located.

ORDINAL

Ordinal of the database if it is a partition database, NULL for reference database.

FAILED_BOTTLE_SERVICE_API_PER_SECOND

Number of failed bottle service api calls per second over the last 30 seconds.the last 30 seconds.

Example:

SELECT * FROM information_schema.MV_BOTTOMLESS_STATUS_EXTENDED;
+---------------+------------------------+------------------------+---------------+----------------------------------------------+----------+---------+------------------+-------------------+------------------+--------------------+-------------------+------------+--------------+------------+----------+-------------+------------------+-------------------------------+------------------------+-------------------+----------------+------------------------+--------------------+--------------------------------+--------------------------------+-----------------------------+--------------------------+-----------------------------+--------------------------+---------------------------+-----------------------+----------------------------+------------------+----------------------+-------------------+-----------------------+------------------+----------------------+-------------------+-----------------------+---------------------+-------------------------+--------------------------+----------------------+-----------------------+-------------------+------------------+-----------------+---------------+--------------------+---------+-----------+-------+---------+
| DATABASE_NAME | STORAGE_ID             | COMPUTE_ID             | COMPUTE_STATE | STORAGE_DIRECTORY                            | BUCKET   | ROLE    | TERM             | LOG_PERSISTED_LSN | LOG_ENQUEUED_LSN | BLOB_PERSISTED_LSN | BLOB_ENQUEUED_LSN | COMMIT_LSN | HARDENED_LSN | REPLAY_LSN | TAIL_LSN | CLEANUP_LSN | OLDEST_VALID_LSN | LOG_PERSISTED_END_TAG_VERSION | UPLOAD_QUEUE_WAIT_SECS | UPLOAD_MB_PER_SEC | UPLOADED_BYTES | SECS_SINCE_LAST_UPLOAD | LAST_UPLOAD_RESULT | BLOB_CACHE_DOWNLOAD_MB_PER_SEC | BLOB_CACHE_EVICTION_MB_PER_SEC | BLOB_CACHE_DOWNLOADED_BYTES | BLOB_CACHE_EVICTED_BYTES | BLOB_CACHE_DOWNLOADED_FILES | BLOB_CACHE_EVICTED_FILES | BACKGROUND_THREAD_UPLOADS | INGEST_THREAD_UPLOADS | OLDEST_DATA_UNIX_TIMESTAMP | NUM_GET_REQUESTS | GET_REQUESTS_PER_SEC | NUM_POST_REQUESTS | POST_REQUESTS_PER_SEC | NUM_PUT_REQUESTS | PUT_REQUESTS_PER_SEC | NUM_HEAD_REQUESTS | HEAD_REQUESTS_PER_SEC | NUM_DELETE_REQUESTS | DELETE_REQUESTS_PER_SEC | NUM_OUTSTANDING_REQUESTS | NUM_RETRIED_REQUESTS | IS_BEING_RATE_LIMITED | REMOTE_LOG_CHUNKS | REMOTE_SNAPSHOTS | LOCAL_LOG_FILES | LOG_FILE_LIST | SNAPSHOT_FILE_LIST | NODE_ID | HOST      | PORT  | ORDINAL |
+---------------+------------------------+------------------------+---------------+----------------------------------------------+----------+---------+------------------+-------------------+------------------+--------------------+-------------------+------------+--------------+------------+----------+-------------+------------------+-------------------------------+------------------------+-------------------+----------------+------------------------+--------------------+--------------------------------+--------------------------------+-----------------------------+--------------------------+-----------------------------+--------------------------+---------------------------+-----------------------+----------------------------+------------------+----------------------+-------------------+-----------------------+------------------+----------------------+-------------------+-----------------------+---------------------+-------------------------+--------------------------+----------------------+-----------------------+-------------------+------------------+-----------------+---------------+--------------------+---------+-----------+-------+---------+
| x_db          | 10930645997319398241:1 | 10930645997319398241:1 | Legacy        |  cadccdac/10930645997319398241_1/ref         | s3bucket | master  | 2251799813685329 | 0                 | 0                | 0                  | 0                 | 3          | 3            | NULL       | 3        | 0           | 0                | NULL                          | 0                      | 0                 | 0              | NULL                   | NULL               | 0                              | 0                              | 0                           | 0                        | 0                           | 0                        | 0                         | 0                     | NULL                       | 10               | 0.3333333555555548   | 0                 | 0                     | 5                | 0.16666669444444351  | 1                 | 0.03333336555555448   | 0                   | 0                       | 0                        | 0                    | 0                     | []                | []               | [0,4096]        | [0,4096]      | [0]                | 1       | 127.0.0.1 | 10000 | NULL    |
| x_db          | 10930645997319398241:1 | 10930645997319398241:1 | Legacy        |  cadccdac/10930645997319398241_1/ref         | s3bucket | replica | 2251799813685329 | 0                 | NULL             | 0                  | NULL              | 2          | 3            | 2          | 3        | 0           | 0                | NULL                          | 0                      | NULL              | 0              | NULL                   | NULL               | 0                              | 0                              | 0                           | 0                        | 0                           | 0                        | 0                         | 0                     | NULL                       | 10               | 0.3333333555555548   | 0                 | 0                     | 0                | 0                    | 1                 | 0.03333336555555448   | 0                   | 0                       | 0                        | 0                    | 0                     | []                | []               | [0,4096]        | [0,4096]      | [0]                | 2       | 127.0.0.1 | 10001 | NULL    |
| x_db          | 10930645997319398241:1 | 10930645997319398241:1 | Legacy        |  acdcadcc/10930645997319398241_1/partition_0 | s3bucket | master  | 2251799813685330 | 0                 | 0                | 0                  | 0                 | 2          | 2            | NULL       | 2        | 0           | 0                | NULL                          | 0                      | 0                 | 0              | NULL                   | NULL               | 0                              | 0                              | 0                           | 0                        | 0                           | 0                        | 0                         | 0                     | NULL                       | 10               | 0.3333333555555548   | 0                 | 0                     | 1                | 0.03333336555555448  | 1                 | 0.03333336555555448   | 0                   | 0                       | 0                        | 0                    | 0                     | []                | []               | [0,4096]        | [0,4096]      | [0]                | 2       | 127.0.0.1 | 10001 | 0       |
| x_db          | 10930645997319398241:1 | 10930645997319398241:1 | Legacy        |  abcdcddd/10930645997319398241_1/partition_1 | s3bucket | replica | 2251799813685331 | 0                 | NULL             | 0                  | NULL              | 1          | 2            | 1          | 2        | 0           | 0                | NULL                          | 0                      | NULL              | 0              | NULL                   | NULL               | 0                              | 0                              | 0                           | 0                        | 0                           | 0                        | 0                         | 0                     | NULL                       | 11               | 0.36666668777777706  | 0                 | 0                     | 0                | 0                    | 1                 | 0.03333336555555448   | 0                   | 0                       | 0                        | 0                    | 0                     | []                | []               | [0,4096]        | [0,4096]      | [0]                | 2       | 127.0.0.1 | 10001 | 1       |
| x_db          | 10930645997319398241:1 | 10930645997319398241:1 | Legacy        |  cadccdac/10930645997319398241_1/ref         | s3bucket | replica | 2251799813685329 | 0                 | NULL             | 0                  | NULL              | 2          | 3            | 2          | 3        | 0           | 0                | NULL                          | 0                      | NULL              | 0              | NULL                   | NULL               | 0                              | 0                              | 0                           | 0                        | 0                           | 0                        | 0                         | 0                     | NULL                       | 10               | 0.3333333555555548   | 0                 | 0                     | 0                | 0                    | 1                 | 0.03333336555555448   | 0                   | 0                       | 0                        | 0                    | 0                     | []                | []               | [0,4096]        | [0,4096]      | [0]                | 3       | 127.0.0.1 | 10002 | NULL    |
| x_db          | 10930645997319398241:1 | 10930645997319398241:1 | Legacy        |  acdcadcc/10930645997319398241_1/partition_0 | s3bucket | replica | 2251799813685330 | 0                 | NULL             | 0                  | NULL              | 1          | 2            | 1          | 2        | 0           | 0                | NULL                          | 0                      | NULL              | 0              | NULL                   | NULL               | 0                              | 0                              | 0                           | 0                        | 0                           | 0                        | 0                         | 0                     | NULL                       | 11               | 0.36666668777777706  | 0                 | 0                     | 0                | 0                    | 1                 | 0.03333336555555448   | 0                   | 0                       | 0                        | 0                    | 0                     | []                | []               | [0,4096]        | [0,4096]      | [0]                | 3       | 127.0.0.1 | 10002 | 0       |
| x_db          | 10930645997319398241:1 | 10930645997319398241:1 | Legacy        |  abcdcddd/10930645997319398241_1/partition_1 | s3bucket | master  | 2251799813685331 | 0                 | 0                | 0                  | 0                 | 2          | 2            | NULL       | 2        | 0           | 0                | NULL                          | 0                      | 0                 | 0              | NULL                   | NULL               | 0                              | 0                              | 0                           | 0                        | 0                           | 0                        | 0                         | 0                     | NULL                       | 10               | 0.3333333555555548   | 0                 | 0                     | 1                | 0.03333336555555448  | 1                 | 0.03333336555555448   | 0                   | 0                       | 0                        | 0                    | 0                     | []                | []               | [0,4096]        | [0,4096]      | [0]                | 3       | 127.0.0.1 | 10002 | 1       |
+---------------+------------------------+------------------------+---------------+----------------------------------------------+----------+---------+------------------+-------------------+------------------+--------------------+-------------------+------------+--------------+------------+----------+-------------+------------------+-------------------------------+------------------------+-------------------+----------------+------------------------+--------------------+--------------------------------+--------------------------------+-----------------------------+--------------------------+-----------------------------+--------------------------+---------------------------+-----------------------+----------------------------+------------------+----------------------+-------------------+-----------------------+------------------+----------------------+-------------------+-----------------------+---------------------+-------------------------+--------------------------+----------------------+-----------------------+-------------------+------------------+-----------------+---------------+--------------------+---------+-----------+-------+---------+

Last modified: May 8, 2025

Was this article helpful?

Was this article helpful?

Verification instructions

Note: You must install cosign to verify the authenticity of the SingleStore file.

Use the following steps to verify the authenticity of singlestoredb-server, singlestoredb-toolbox, singlestoredb-studio, and singlestore-client SingleStore files that have been downloaded.

You may perform the following steps on any computer that can run cosign, such as the main deployment host of the cluster.

  1. (Optional) Run the following command to view the associated signature files.

    curl undefined

  2. Download the signature file from the SingleStore release server.

    • Option 1: Click the Download Signature button next to the SingleStore file.

    • Option 2: Copy and paste the following URL into the address bar of your browser and save the signature file.

    • Option 3: Run the following command to download the signature file.

      curl -O undefined

  3. After the signature file has been downloaded, run the following command to verify the authenticity of the SingleStore file.

    echo -n undefined |
        cosign verify-blob --certificate-oidc-issuer https://oidc.eks.us-east-1.amazonaws.com/id/CCDCDBA1379A5596AB5B2E46DCA385BC \
          --certificate-identity https://kubernetes.io/namespaces/freya-production/serviceaccounts/job-worker \
          --bundle undefined \
          --new-bundle-format -
    Verified OK