MV_BOTTOMLESS_STATUS_EXTENDED

This view provides more diagnostic information compared to MV_BOTTOMLESS_STATUS, such as more detailed LSN, upload statistics, API statistics, and logchunk/snapshot information.

Columns CLEANUP_LSN, REMOTE_LOG_CHUNKS, REMOTE_SNAPSHOTS, LOCAL_LOG_FILES, LOG_FILE_LIST, SNAPSHOT_FILE_LIST, query the remote storage and could slow down the information_schema.

Column name

Description

DATABASE_NAME

Name of the database.

STORAGE_ID

Storage ID of the database.

COMPUTE_ID

Compute ID of the database.

COMPUTE_STATE

Values can be 'Legacy', 'Broken', or 'Full' which indicates: none, unhealthy, or healthy.

STORAGE_DIRECTORY

Remote storage directory path for the database.

BUCKET

Remote storage bucket located for the database.

ROLE

Current role of the database (primary / secondary / offline).

TERM

A unique identifier of the current master instance of the database.

LOG_PERSISTED_LSN

Log sequence number below which all log chunks have been permanently stored to remote storage.

LOG_ENQUEUED_LSN

Log sequence number below which all blob files have been enqueued for permanent storage to remote storage.

BLOB_PERSISTED_LSN

Log sequence number below which all log chunks have been enqueued for permanent storage to remote storage.

BLOB_ENQUEUED_LSN

Log sequence number below which all blob files have been enqueued for persistence to remote storage.

COMMIT_LSN

Position in the log before which all pages have been committed. All content is committed in the pages that are in the log before this log sequence number.

HARDENED_LSN

Position in the log before which all pages have been written to the disk.

REPLAY_LSN

Position in the log before which all pages have been replayed into memory.

TAIL_LSN

Position in the log before which all pages have been reserved for transactions. The next transaction to reserve space from the log will start writing at this log sequence number.

CLEANUP_LSN

The log sequence number of the highest cleanup file in the remote snapshot directory.

OLDEST_VALID_LSN

Log content below this log sequence number is invalid and must not be referenced by anyone.

LOG_PERSISTED_END_TAG_VERSION

EndTag version below which all log chunks have been persisted stored to remote storage.

UPLOAD_QUEUE_WAIT_SECS

Number of seconds by which the uploads to remote storage are lagging behind.

UPLOADED_BYTES

Number of bytes uploaded.

SECS_SINCE_LAST_UPLOAD

The number of seconds since the last attempted upload.

LAST_UPLOAD_RESULT

The result of the last attempted upload.

BLOB_CACHE_DOWNLOAD_MB_PER_SEC

Rate at which the blob cache is downloading files from remote storage.

BLOB_CACHE_EVICTION_MB_PER_SEC

Rate at which the blob cache is evicting files.

BLOB_CACHE_DOWNLOADED_BYTES

Number of bytes downloaded by the blob cache.

BLOB_CACHE_EVICTED_BYTES

Number of bytes evicted by the blob cache.

BLOB_CACHE_DOWNLOADED_FILES

Number of files downloaded by the blob cache.

BLOB_CACHE_EVICTED_FILES

Number of files evicted by the blob cache.

BACKGROUND_THREAD_UPLOADS

Number of uploads made by the background thread.

INGEST_THREAD_UPLOADS

Number of uploads made by an ingest thread. This indicates whether and how much ingest has been throttled to keep bottomless uploads up to date.

OLDEST_DATA_UNIX_TIMESTAMP

Timestamp when the oldest piece of data became garbage collectable. If this value is near the current timestamp minus the bottomless_gc_retention_period_minutes, then unlimited garbage collection (gc) is keeping up.

NUM_GET_REQUESTS

Number of GET requests made to remote storage.

GET_REQUESTS_PER_SEC

Rate of GET requests made to remote storage.

NUM_POST_REQUESTS

Number of POST requests made to remote storage.

POST_REQUESTS_PER_SEC

Rate of POST requests made to remote storage.

NUM_PUT_REQUESTS

Number of PUT requests made to remote storage.

PUT_REQUESTS_PER_SEC

Rate of PUT requests made to remote storage.

NUM_HEAD_REQUESTS

Number of HEAD requests made to remote storage.

HEAD_REQUESTS_PER_SEC

Rate of HEAD requests made to remote storage.

NUM_DELETE_REQUESTS

Number of DELETE requests made to remote storage.

DELETE_REQUESTS_PER_SEC

Rate of DELETE requests made to remote storage.

NUM_OUTSTANDING_REQUESTS

Number of outstanding API requests to be made to remote storage.

NUM_RETRIED_REQUESTS

Number of retried API requests made to remote storage.

IS_BEING_RATE_LIMITED

Whether API requests to remote storage are being rate limited. On S3, rate limiting starts when we receive 503 SLOWDOWN errors.

NUM_SUCCESS_API_REQUESTS

Total number of successful api calls to remote storage.

NUM_FAILED_API_REQUESTS

Total number of failed api calls to remote storage.

SUCCESS_API_PER_SECOND

Number of successful remote storage api calls per second over the last 30 seconds.

FAILED_API_PER_SECOND

Number of failed remote storage api calls per second over the last 30 seconds.

AVERAGE_API_EVENT_LATENCY_US

Average latency to complete a remote storage api event over the past 30 seconds. Includes time taken on retries or waiting for rate limiting.

AVERAGE_API_RESPONSE_LATENCY_US

Average latency of receiving a response for a remote storage api request. Excludes waiting for rate limiting or retries. NOTE: this is relevant only for S3. Otherwise this field is identical to AVERAGE_API_EVENT_LATENCY_US.

IS_GC_RUNNING

Whether unlimited storage GC is running currently.

NUM_REMOTE_FILES_DELETED

Total number of remote files deleted.

NUM_SLOW_DOWNS

Number of rate limiting slow downs on api calls to remote storage.

REMOTE_LOG_CHUNKS

List of tuples of log chunk beginLSN and endLSN.

REMOTE_SNAPSHOTS

List of log sequence numbers of valid remote snapshots.

LOCAL_LOG_FILES

List of begin log sequence numbers of local log files on disk.

LOG_FILE_LIST

List of begin log sequence numbers of files listed in the log.

SNAPSHOT_FILE_LIST

List of snapshot log sequence numbers of files listed in the log.

NODE_ID

ID of the node where the database is located.

HOST

Host of the node where the database is located.

PORT

Port of the node where the database is located.

ORDINAL

Ordinal of the database if it is a partition database, NULL for reference database.

FAILED_BOTTLE_SERVICE_API_PER_SECOND

Number of failed bottle service api calls per second over the last 30 seconds.the last 30 seconds.

Example:

SELECT * FROM information_schema.MV_BOTTOMLESS_STATUS_EXTENDED;
+---------------+---------------+---------------+---------------+-----------------------+------------+--------+------+-------------------+------------------+--------------------+-------------------+------------+--------------+------------+----------+-------------+------------------+-------------------------------+------------------------+-----------------------+----------------+------------------------+--------------------+--------------------------------+--------------------------------+-----------------------------+--------------------------+-----------------------------+--------------------------+---------------------------+-----------------------+----------------------------+-------------------+-------------------+-----------------------+------------------------+------------------------+------------------+----------------------+-------------------+-----------------------+------------------+----------------------+-------------------+-----------------------+---------------------+-------------------------+--------------------------+----------------------+-----------------------+--------------------------+-------------------------+-------------------------+------------------------+---------------+--------------------------+----------------+-------------------+------------------+-----------------+---------------+--------------------+---------+-----------+-------+---------+
| DATABASE_NAME | STORAGE_ID    | COMPUTE_ID    | COMPUTE_STATE | STORAGE_DIRECTORY     | BUCKET     | ROLE   | TERM | LOG_PERSISTED_LSN | LOG_ENQUEUED_LSN | BLOB_PERSISTED_LSN | BLOB_ENQUEUED_LSN | COMMIT_LSN | HARDENED_LSN | REPLAY_LSN | TAIL_LSN | CLEANUP_LSN | OLDEST_VALID_LSN | LOG_PERSISTED_END_TAG_VERSION | UPLOAD_QUEUE_WAIT_SECS | UPLOAD_MB_PER_SEC     | UPLOADED_BYTES | SECS_SINCE_LAST_UPLOAD | LAST_UPLOAD_RESULT | BLOB_CACHE_DOWNLOAD_MB_PER_SEC | BLOB_CACHE_EVICTION_MB_PER_SEC | BLOB_CACHE_DOWNLOADED_BYTES | BLOB_CACHE_EVICTED_BYTES | BLOB_CACHE_DOWNLOADED_FILES | BLOB_CACHE_EVICTED_FILES | BACKGROUND_THREAD_UPLOADS | INGEST_THREAD_UPLOADS | OLDEST_DATA_UNIX_TIMESTAMP | NEXT_DEADLINE_LSN | LAST_DEADLINE_LSN | NEXT_DEADLINE_VERSION | VH_OF_OLDEST_VALID_LSN | VL_OF_OLDEST_VALID_LSN | NUM_GET_REQUESTS | GET_REQUESTS_PER_SEC | NUM_POST_REQUESTS | POST_REQUESTS_PER_SEC | NUM_PUT_REQUESTS | PUT_REQUESTS_PER_SEC | NUM_HEAD_REQUESTS | HEAD_REQUESTS_PER_SEC | NUM_DELETE_REQUESTS | DELETE_REQUESTS_PER_SEC | NUM_OUTSTANDING_REQUESTS | NUM_RETRIED_REQUESTS | IS_BEING_RATE_LIMITED | NUM_SUCCESS_API_REQUESTS | NUM_FAILED_API_REQUESTS | LATEST_API_FAILURE_RATE | AVERAGE_API_LATENCY_US | IS_GC_RUNNING | NUM_REMOTE_FILES_DELETED | NUM_SLOW_DOWNS | REMOTE_LOG_CHUNKS | REMOTE_SNAPSHOTS | LOCAL_LOG_FILES | LOG_FILE_LIST | SNAPSHOT_FILE_LIST | NODE_ID | HOST      | PORT  | ORDINAL |
+---------------+---------------+---------------+---------------+-----------------------+------------+--------+------+-------------------+------------------+--------------------+-------------------+------------+--------------+------------+----------+-------------+------------------+-------------------------------+------------------------+-----------------------+----------------+------------------------+--------------------+--------------------------------+--------------------------------+-----------------------------+--------------------------+-----------------------------+--------------------------+---------------------------+-----------------------+----------------------------+-------------------+-------------------+-----------------------+------------------------+------------------------+------------------+----------------------+-------------------+-----------------------+------------------+----------------------+-------------------+-----------------------+---------------------+-------------------------+--------------------------+----------------------+-----------------------+--------------------------+-------------------------+-------------------------+------------------------+---------------+--------------------------+----------------+-------------------+------------------+-----------------+---------------+--------------------+---------+-----------+-------+---------+
| x_db          | 1789...990118 | 1169...1454:1 | Full          | cabd/1755_10...18/ref | bottomless | master | 3    | 8                 | 8                | 10                 | 10                | 10         | 10           | NULL       | 10       | 0           | 0                | 2199023255496                 | 0                      | 0.0009117126161257436 | 32784          | 21.3                   | Success            | 0                              | 0                              | 0                           | 0                        | 0                           | 0                        | 3                         | 0                     | NULL                       | NULL              | NULL              | NULL                  | 1                      | 1                      | 22               | 0.100000029999999    | 0                 | 0                     | 5                | 0.03333336555555448  | 4                 | 0                     | 0                   | 0                       | 0                        | 1                    | 0                     | 25                       | 6                       | 0                       | 35317                  | 0             | 0                        | 0              | [[0,1],[1,8]]     | [0,1]            | [0,4096]        | [0,4096]      | [0,1]              | 1       | 127.0.0.1 | 10000 | NULL    |
+---------------+---------------+---------------+---------------+-----------------------+------------+--------+------+-------------------+------------------+--------------------+-------------------+------------+--------------+------------+----------+-------------+------------------+-------------------------------+------------------------+-----------------------+----------------+------------------------+--------------------+--------------------------------+--------------------------------+-----------------------------+--------------------------+-----------------------------+--------------------------+---------------------------+-----------------------+----------------------------+-------------------+-------------------+-----------------------+------------------------+------------------------+------------------+----------------------+-------------------+-----------------------+------------------+----------------------+-------------------+-----------------------+---------------------+-------------------------+--------------------------+----------------------+-----------------------+--------------------------+-------------------------+-------------------------+------------------------+---------------+--------------------------+----------------+-------------------+------------------+-----------------+---------------+--------------------+---------+-----------+-------+---------+

Last modified: October 8, 2024

Was this article helpful?