Stage Storage Service

Connecting to Stage

Every Workspace Group has a Stage attached. You can connect to a Stage by using a pipeline. Just specify the path of the file to be loaded.

CREATE PIPELINE <pipeline_name>
AS LOAD DATA STAGE <file_name>

Ingesting a File into a Database

1. Click on the Upload New File button.

2. Drag and drop a file or click the Browse File link.

3. Once the file is loaded, click the Upload File button.

4. Click on the three dots next to the file you just loaded and select Load To Database.

5. Choose a Workspace from the dropdown menu.

6. Choose a Database from the dropdown menu.

7. Select an existing table or enter a new table name.

8. Click the Generate Notebook button.

9. The next window will show a breakdown of all the queries that may be loaded with the notebook.

   1. This is also where the queries may be edited, to include different column names, column types, etc.

10. Click on Run and select Run All Cells.

11. Verify the data loaded in the Check that the data has loaded section by clicking the Run (triangle) button.

Export SQL Results to a Stage

SQL results may be exported into a Stage by using a specified path. Use the GROUP BY 1 to avoid getting multiple fields from each leaf node.

SELECT * FROM <table_name> GROUP BY 1 INTO STAGE '<table_results.csv>';

Supported Files

Files for uploading should be in one of the following formats:

• CSV

• SQL

• JSON

• Parquet

• GZ

• Zstd

• Snappy

Storage Limits

Each stage can have up to 10GB of storage for free.