✌️How to Create a container?
Using GUI
Notice: Each tenant can only have a maximum of 10 containers. If you have reached this limit, please delete unused container to create a new one.
Select GPU Container in the Side menu and click button “Create New Container”
Give your container a name using Container Name field.
Select a GPU Instance (we currently support NVIDIA GPU H100 and H200)
Template: Users can either choose to use built-in templates or use their own images. We highly recommend that our customers to use built-in templates for faster deployment.
a. Built-in templates: Click “Change Template” and choose the template.
b. Custom template: Bring your own template by using the feature “Custom Template”.
Access container
a. Ports
This feature significantly enhances the flexibility of your containerized applications, allowing a single container to serve diverse functionalities on different ports.
Both HTTP and TCP ports are supported, with a maximum of 10 ports per type for each container.
b. SSH
Add SSH keys to enable remote access to your container. Each container supports a maximum of 10 SSH keys. These keys will be injected into the container at runtime, allowing you to SSH into the container using any of the provided keys.
Notice: Currently, v1.1.2 GPU Container only Ubuntu, Pytorch, CUDA, Tensorflow template already includes SSH configuration. If you want to connect via SSH in other templates, please install OpenSSH-server before using.
To add an SSH key, please follow the instructions:
Ensure you have an SSH key pair generated on your local machine. If you haven’t done this, you can generate one using this command on your local terminal:
ssh-keygen -t ed25519 -C [[email protected]](mailto:[email protected])
To retrieve your public SSH key, run this command:
cat ~/.ssh/id_ed25519.pub
This will output something similar to this:
ssh-ed25519 AAAAC4NzaC1lZDI1JTE5AAAAIGP+L8hnjIcBqUb8NRrDiC32FuJBvRA0m8jLShzgq6BQ [email protected]
Copy and paste the output into the SSH Public Keys field when you create the container.
Advanced Settings (Optional)
a. Persistent Disk: specify the amount of storage that users need to store training weights, models, etc. Read more about Storage here
b. Environment Variables: key-value pairs injected into the container at runtime.
c. Startup Command: command and arguments to run at the start of container
Click “Create New Container” to create and start your container.
In case your balance is not enough to create a new container (lower cost of using the container for 1 hour), please follow these instructions to add credit to your account
Importing YAML file
For quick deployment, or when you already have a configuration file prepared, use this feature to create a container rather than configuring it through the user interface.
Step 1: Open Import Configuration modal
Navigate to GPU Container from the side menu.
Click Import Configuration located on the top right of the container list page.
Step 2: Provide configuration file in YAML format
You can import the configuration in two ways:
Paste YAML directly into the YAML editor.
Upload a YAML file by clicking the Upload file button. Currently, GPU Container supports YAML files only.
A sample YAML template can be downloaded by clicking Download template.
Field
Data type
Sample data
Description
name
string
my-container
Name of your container. Must be unique per tenant
instance_type
string
GPU-H100-1
Vietnam site supports 1xH100 -> 8xH100; Japan site supports 1xH200 -> 8xH200
image_setting
Since a container can only have 1 image, please provide either template_name or image_url + image_tag
template_name
string
Jupyter Notebook
Built-in template name. Provides this in case you want to use built-in template provided by FPT. Please input an exact name in the list: Jupyter Notebook, Code Server, vllm-openai, vllm-openai-v0.10.1, ollama, ollama-openwebui, Ubuntu 24.04, Tensorflow 2.19.0, Nvidia Cuda 12.9.1, NVIDIA Pytorch 25.03.
image_url
string
registry/myimage:latest
(Optional) Custom image URL. Leave blank if using the built-in template.
image_tag
string
v1.0
(Optional) Tag for custom image.
image_user
string
admin
(Optional) Username for private image registry.
image_password
string
password123
(Optional) Password for private image registry
access_container
tcp_ports
list[int]
[22, 33]
TCP ports exposed by the container
http_ports
list[int]
[8888, 6006]
HTTP ports exposed by the container
ssh_keys
Provide each pair of name-key SSH keys. Allow a maximum of 10 keys
name
string
key01
Name of the SSH key
key
string
"ssh-rsa AAAAB3..."
SSH public key
advanced_settings
persistent_disk
mount_capacity
int (GB)
20
Amount of persistent storage to attach.
mount_path
string
/workspace
Path where persistent disk will be mounted inside the container.
environment_variables
key
string
USERNAME
Environment variables injected at runtime.
value
string
admin
startup_commands
cmds
list[string]
Startup commands (optional).
args
list[string]
Startup command arguments (optional).
Step 3: Review Configuration
Notice: The button “Review" will only be enabled when all the validations within the YAML editor have passed.
Click Review to continue. On this screen, you can:
Verify container configuration, including template, GPU, CPU, RAM, and disk allocation.
Check the pricing summary to view the estimated hourly cost.
Step 4: Create Container
Once confirmed, click Create Container to start deployment. The system will automatically create and launch your container based on the provided configuration file.
Export Container Configuration
For later reuse, the Export Configuration feature allows you to save a container’s configuration and download it into a YAML file.
From the List Containers screen, click the Action (3-dot) menu and select Export Configuration.
Alternatively, open the Container Details page and click Export Configuration.
A YAML file will be automatically downloaded with the name format: container-name.yaml
Last updated