MV_BOTTOMLESS_STATUS_EXTENDED

This view provides more diagnostic information compared to MV_BOTTOMLESS_STATUS, such as more detailed LSN, upload statistics, API statistics, and logchunk/snapshot information.

Columns CLEANUP_LSN, REMOTE_LOG_CHUNKS, REMOTE_SNAPSHOTS, LOCAL_LOG_FILES, LOG_FILE_LIST, SNAPSHOT_FILE_LIST, query the remote storage and could slow down the information_schema.

Column name	Description
`DATABASE_NAME`	Name of the database.
`STORAGE_ID`	Storage ID of the database.
`COMPUTE_ID`	Compute ID of the database.
`COMPUTE_STATE`	Values can be 'Legacy', 'Broken', or 'Full' which indicates: none, unhealthy, or healthy.
`STORAGE_DIRECTORY`	Remote storage directory path for the database.
`BUCKET`	Remote storage bucket located for the database.
`ROLE`	Current role of the database (primary / secondary / offline).
`TERM`	A unique identifier of the current master instance of the database.
`LOG_PERSISTED_LSN`	Log sequence number below which all log chunks have been permanently stored to remote storage.
`LOG_ENQUEUED_LSN`	Log sequence number below which all blob files have been enqueued for permanent storage to remote storage.
`BLOB_PERSISTED_LSN`	Log sequence number below which all log chunks have been enqueued for permanent storage to remote storage.
`BLOB_ENQUEUED_LSN`	Log sequence number below which all blob files have been enqueued for persistence to remote storage.
`COMMIT_LSN`	Position in the log before which all pages have been committed. All content is committed in the pages that are in the log before this log sequence number.
`HARDENED_LSN`	Position in the log before which all pages have been written to the disk.
`REPLAY_LSN`	Position in the log before which all pages have been replayed into memory.
`TAIL_LSN`	Position in the log before which all pages have been reserved for transactions. The next transaction to reserve space from the log will start writing at this log sequence number.
`CLEANUP_LSN`	The log sequence number of the highest cleanup file in the remote snapshot directory.
`OLDEST_VALID_LSN`	Log content below this log sequence number is invalid and must not be referenced by anyone.
`LOG_PERSISTED_END_TAG_VERSION`	EndTag version below which all log chunks have been persisted stored to remote storage.
`UPLOAD_QUEUE_WAIT_SECS`	Number of seconds by which the uploads to remote storage are lagging behind.
`UPLOADED_BYTES`	Number of bytes uploaded.
`SECS_SINCE_LAST_UPLOAD`	The number of seconds since the last attempted upload.
`LAST_UPLOAD_RESULT`	The result of the last attempted upload.
`BLOB_CACHE_DOWNLOAD_MB_PER_SEC`	Rate at which the blob cache is downloading files from remote storage.
`BLOB_CACHE_EVICTION_MB_PER_SEC`	Rate at which the blob cache is evicting files.
`BLOB_CACHE_DOWNLOADED_BYTES`	Number of bytes downloaded by the blob cache.
`BLOB_CACHE_EVICTED_BYTES`	Number of bytes evicted by the blob cache.
`BLOB_CACHE_DOWNLOADED_FILES`	Number of files downloaded by the blob cache.
`BLOB_CACHE_EVICTED_FILES`	Number of files evicted by the blob cache.
`BACKGROUND_THREAD_UPLOADS`	Number of uploads made by the background thread.
`INGEST_THREAD_UPLOADS`	Number of uploads made by an ingest thread. This indicates whether and how much ingest has been throttled to keep bottomless uploads up to date.
`OLDEST_DATA_UNIX_TIMESTAMP`	Timestamp when the oldest piece of data became garbage collectable. If this value is near the current timestamp minus the `bottomless_gc_retention_period_minutes`, then unlimited garbage collection (gc) is keeping up.
`NUM_GET_REQUESTS`	Number of GET requests made to remote storage.
`GET_REQUESTS_PER_SEC`	Rate of GET requests made to remote storage.
`NUM_POST_REQUESTS`	Number of POST requests made to remote storage.
`POST_REQUESTS_PER_SEC`	Rate of POST requests made to remote storage.
`NUM_PUT_REQUESTS`	Number of PUT requests made to remote storage.
`PUT_REQUESTS_PER_SEC`	Rate of PUT requests made to remote storage.
`NUM_HEAD_REQUESTS`	Number of HEAD requests made to remote storage.
`HEAD_REQUESTS_PER_SEC`	Rate of HEAD requests made to remote storage.
`NUM_DELETE_REQUESTS`	Number of DELETE requests made to remote storage.
`DELETE_REQUESTS_PER_SEC`	Rate of DELETE requests made to remote storage.
`NUM_OUTSTANDING_REQUESTS`	Number of outstanding API requests to be made to remote storage.
`NUM_RETRIED_REQUESTS`	Number of retried API requests made to remote storage.
`IS_BEING_RATE_LIMITED`	Whether API requests to remote storage are being rate limited. On S3, rate limiting starts when we receive 503 SLOWDOWN errors.
`NUM_SUCCESS_API_REQUESTS`	Total number of successful api calls to remote storage.
`NUM_FAILED_API_REQUESTS`	Total number of failed api calls to remote storage.
`SUCCESS_API_PER_SECOND`	Number of successful remote storage api calls per second over the last 30 seconds.
`FAILED_API_PER_SECOND`	Number of failed remote storage api calls per second over the last 30 seconds.
`AVERAGE_API_EVENT_LATENCY_US`	Average latency to complete a remote storage api event over the past 30 seconds. Includes time taken on retries or waiting for rate limiting.
`AVERAGE_API_RESPONSE_LATENCY_US`	Average latency of receiving a response for a remote storage api request. Excludes waiting for rate limiting or retries. NOTE: this is relevant only for S3. Otherwise this field is identical to `AVERAGE_API_EVENT_LATENCY_US`.
`IS_GC_RUNNING`	Whether unlimited storage GC is running currently.
`NUM_REMOTE_FILES_DELETED`	Total number of remote files deleted.
`NUM_SLOW_DOWNS`	Number of rate limiting slow downs on api calls to remote storage.
`REMOTE_LOG_CHUNKS`	List of tuples of log chunk beginLSN and endLSN.
`REMOTE_SNAPSHOTS`	List of log sequence numbers of valid remote snapshots.
`LOCAL_LOG_FILES`	List of begin log sequence numbers of local log files on disk.
`LOG_FILE_LIST`	List of begin log sequence numbers of files listed in the log.
`SNAPSHOT_FILE_LIST`	List of snapshot log sequence numbers of files listed in the log.
`NODE_ID`	ID of the node where the database is located.
`HOST`	Host of the node where the database is located.
`PORT`	Port of the node where the database is located.
`ORDINAL`	Ordinal of the database if it is a partition database, NULL for reference database.
`NUM_SUCCESS_BOTTLE_SERVICE_API_REQUESTS`	Total number of successful bottle service api calls
`NUM_FAILED_BOTTLE_SERVICE_API_REQUESTS`	Total number of failed bottle service api calls
`SUCCESS_BOTTLE_SERVICE_API_PER_SECOND`	Number of successful bottle service api calls per second over the last 30 seconds.
`FAILED_BOTTLE_SERVICE_API_PER_SECOND`	Number of failed bottle service api calls per second over the last 30 seconds.the last 30 seconds.
`AVERAGE_BOTTLE_SERVICE_API_EVENT_LATENCY_US`	Average latency to complete a bottle service api event over the past 30 seconds. Includes time taken on retries or waiting for rate limiting.
`BOTTLE_SERVICE_AVAILABILITY`	Number of successful bottle service api calls per second to the total number of bottle service api calls per second (success + failed) over the last 30 seconds. It is calculated as: `BOTTLE_SERVICE_AVAILABILITY = SUCCESS_BOTTLE_SERVICE_API_PER_SECOND / (SUCCESS_BOTTLE_SERVICE_API_PER_SECOND + FAILED_BOTTLE_SERVICE_API_PER_SECOND)`
`OBJECT_STORE_AVAILABILITY`	Number of successful bottomless api calls per second to the total number of bottomless api calls per second (success + failed) over the last 30 seconds. It is calculated as: `OBJECT_STORE_AVAILABILITY = SUCCESS_API_PER_SECOND / (SUCCESS_API_PER_SECOND + FAILED_API_PER_SECOND)`

Example:

SQL

SELECT * FROM information_schema.MV_BOTTOMLESS_STATUS_EXTENDED;

+---------------+---------------+---------------+---------------+-----------------------+------------+--------+------+-------------------+------------------+--------------------+-------------------+------------+--------------+------------+----------+-------------+------------------+-------------------------------+------------------------+-----------------------+----------------+------------------------+--------------------+--------------------------------+--------------------------------+-----------------------------+--------------------------+-----------------------------+--------------------------+---------------------------+-----------------------+----------------------------+-------------------+-------------------+-----------------------+------------------------+------------------------+------------------+----------------------+-------------------+-----------------------+------------------+----------------------+-------------------+-----------------------+---------------------+-------------------------+--------------------------+----------------------+-----------------------+--------------------------+-------------------------+-------------------------+------------------------+---------------+--------------------------+----------------+-------------------+------------------+-----------------+---------------+--------------------+---------+-----------+-------+---------+
| DATABASE_NAME | STORAGE_ID    | COMPUTE_ID    | COMPUTE_STATE | STORAGE_DIRECTORY     | BUCKET     | ROLE   | TERM | LOG_PERSISTED_LSN | LOG_ENQUEUED_LSN | BLOB_PERSISTED_LSN | BLOB_ENQUEUED_LSN | COMMIT_LSN | HARDENED_LSN | REPLAY_LSN | TAIL_LSN | CLEANUP_LSN | OLDEST_VALID_LSN | LOG_PERSISTED_END_TAG_VERSION | UPLOAD_QUEUE_WAIT_SECS | UPLOAD_MB_PER_SEC     | UPLOADED_BYTES | SECS_SINCE_LAST_UPLOAD | LAST_UPLOAD_RESULT | BLOB_CACHE_DOWNLOAD_MB_PER_SEC | BLOB_CACHE_EVICTION_MB_PER_SEC | BLOB_CACHE_DOWNLOADED_BYTES | BLOB_CACHE_EVICTED_BYTES | BLOB_CACHE_DOWNLOADED_FILES | BLOB_CACHE_EVICTED_FILES | BACKGROUND_THREAD_UPLOADS | INGEST_THREAD_UPLOADS | OLDEST_DATA_UNIX_TIMESTAMP | NEXT_DEADLINE_LSN | LAST_DEADLINE_LSN | NEXT_DEADLINE_VERSION | VH_OF_OLDEST_VALID_LSN | VL_OF_OLDEST_VALID_LSN | NUM_GET_REQUESTS | GET_REQUESTS_PER_SEC | NUM_POST_REQUESTS | POST_REQUESTS_PER_SEC | NUM_PUT_REQUESTS | PUT_REQUESTS_PER_SEC | NUM_HEAD_REQUESTS | HEAD_REQUESTS_PER_SEC | NUM_DELETE_REQUESTS | DELETE_REQUESTS_PER_SEC | NUM_OUTSTANDING_REQUESTS | NUM_RETRIED_REQUESTS | IS_BEING_RATE_LIMITED | NUM_SUCCESS_API_REQUESTS | NUM_FAILED_API_REQUESTS | LATEST_API_FAILURE_RATE | AVERAGE_API_LATENCY_US | IS_GC_RUNNING | NUM_REMOTE_FILES_DELETED | NUM_SLOW_DOWNS | REMOTE_LOG_CHUNKS | REMOTE_SNAPSHOTS | LOCAL_LOG_FILES | LOG_FILE_LIST | SNAPSHOT_FILE_LIST | NODE_ID | HOST      | PORT  | ORDINAL |
+---------------+---------------+---------------+---------------+-----------------------+------------+--------+------+-------------------+------------------+--------------------+-------------------+------------+--------------+------------+----------+-------------+------------------+-------------------------------+------------------------+-----------------------+----------------+------------------------+--------------------+--------------------------------+--------------------------------+-----------------------------+--------------------------+-----------------------------+--------------------------+---------------------------+-----------------------+----------------------------+-------------------+-------------------+-----------------------+------------------------+------------------------+------------------+----------------------+-------------------+-----------------------+------------------+----------------------+-------------------+-----------------------+---------------------+-------------------------+--------------------------+----------------------+-----------------------+--------------------------+-------------------------+-------------------------+------------------------+---------------+--------------------------+----------------+-------------------+------------------+-----------------+---------------+--------------------+---------+-----------+-------+---------+
| x_db          | 1789...990118 | 1169...1454:1 | Full          | cabd/1755_10...18/ref | bottomless | master | 3    | 8                 | 8                | 10                 | 10                | 10         | 10           | NULL       | 10       | 0           | 0                | 2199023255496                 | 0                      | 0.0009117126161257436 | 32784          | 21.3                   | Success            | 0                              | 0                              | 0                           | 0                        | 0                           | 0                        | 3                         | 0                     | NULL                       | NULL              | NULL              | NULL                  | 1                      | 1                      | 22               | 0.100000029999999    | 0                 | 0                     | 5                | 0.03333336555555448  | 4                 | 0                     | 0                   | 0                       | 0                        | 1                    | 0                     | 25                       | 6                       | 0                       | 35317                  | 0             | 0                        | 0              | [[0,1],[1,8]]     | [0,1]            | [0,4096]        | [0,4096]      | [0,1]              | 1       | 127.0.0.1 | 10000 | NULL    |
+---------------+---------------+---------------+---------------+-----------------------+------------+--------+------+-------------------+------------------+--------------------+-------------------+------------+--------------+------------+----------+-------------+------------------+-------------------------------+------------------------+-----------------------+----------------+------------------------+--------------------+--------------------------------+--------------------------------+-----------------------------+--------------------------+-----------------------------+--------------------------+---------------------------+-----------------------+----------------------------+-------------------+-------------------+-----------------------+------------------------+------------------------+------------------+----------------------+-------------------+-----------------------+------------------+----------------------+-------------------+-----------------------+---------------------+-------------------------+--------------------------+----------------------+-----------------------+--------------------------+-------------------------+-------------------------+------------------------+---------------+--------------------------+----------------+-------------------+------------------+-----------------+---------------+--------------------+---------+-----------+-------+---------+

MV_BOTTOMLESS_STATUS_EXTENDED

Was this article helpful?

Was this article helpful?