Managed Container Service
On this page
Note
Containers and the medium/GPU pool are currently in private preview.
SingleStore’s Managed Container Service (SingleStore Aura service) is a serverless platform designed to provide instant access to pre-warmed containers for running custom applications with minimal latency.
Key Features
-
Instant Container Availability: The platform maintains a pool of pre-warmed containers, enabling sub-second container acquisition times for your applications.
This eliminates the traditional wait times associated with container startup and initialization. -
Enhanced Security: The platform implements the gVisor container runtime for robust security isolation, allowing you to safely execute untrusted code, LLM-generated content, or third-party applications without compromising the host system.
-
GPU Support: Pre-configured container images come with NVIDIA drivers pre-installed, making it seamless to run GPU-accelerated workloads without additional setup.
-
Simplified Developer Experience: The platform abstracts away the complexity of Docker and Kubernetes management and handles all container orchestration automatically, allowing developers to focus on their code rather than infrastructure concerns.
How It Works
Container Pool Management
The platform automatically maintains and manages a pool of warm containers, ensuring immediate availability when requested.
Streamlined Workflow
Traditional container deployment typically involves:
-
Spinning up a new container
-
Configuring the environment
-
Installing required dependencies
-
Starting application services
With the Managed Container Service, this process is simplified to:
-
Request a container
-
Connect to a pre-configured environment
-
Begin working immediately
Container Sizing and Node Type
|
Node |
Node Type |
Container |
|
CPU Pool |
r6i. (16 vCPU, 128 RAM, 400 GB) |
Small (1750m vCPU, 14 RAM, 40 GB) |
|
Medium (3750m vCPU, 29 RAM, 40 GB) |
||
|
GPU Pool |
g4dn. (1 GPU 8 vCPU, 32 RAM, 100 GB) |
GPU - T4 (1 GPU, 6500m vCPU, 29 RAM, 40 GB) |
Rate Limits
To prevent abuse, either accidental or intentional, SingleStore enforces limits on the number of containers that can be created in an organization, which can be increased upon request.
By default, the following quotas are applied:
|
Workload |
Maximum Number of Active Sessions per Organization |
Maximum Number of Containers Created in 1 Minute per Organization |
|
Any |
50 |
20 |
|
Scheduled Jobs |
- |
5 |
In this section
Last modified: January 9, 2025