Sign inTry Free

PIPELINES_FILES

On this page

This view stores information about files that have been extracted from a file system-like data source, such as Amazon S3. Each row represents a single file.

information_schema.PIPELINES_FILES Schema

Column Name

Description

DATABASE_NAME

The name of the database associated with the file.

PIPELINE_NAME

The name of the pipeline associated with the file.

SOURCE_TYPE

The name of the pipeline’s data source, such as S3.

FILE_NAME

The name of the file.

FILE_SIZE

The size of the file in bytes.

FILE_STATE

Shows the state of the file, which is one of the following values:

  • Unloaded: The pipeline has not yet loaded the data in the file into any tables.

  • Loaded: The pipeline has successfully processed the file. The data in the file has been loaded into one or more tables.

  • Skipped: The pipeline encountered an error while processing the file; the file is skipped and no data in the file has been loaded into any tables.

Note

Monitor the information_schema.pipelines_files table. It stores data for the duration of the pipeline’s lifetime, resulting in a large number of files referenced in the table. If the data in this table is not required, you can either drop a file record from the table or clear all the file records from it.

Last modified: August 1, 2024

Was this article helpful?

On this page

Was this article helpful?