✌️How to Manage template?

Templates are used to launch images as containers and define the required container disk size, volume, volume paths, and ports needed. You can also define environment variables and startup commands within the template.

Built-in Templates

These templates are created and maintained by FPT AI Factory. We now offer 6 built-in templates:

1. Jupyter Notebook

• Intended Use: This template provides Jupyter Notebook to adopt remote development for AI/Data Scientists without local hardware limitations.

• Environment Variables

Some more useful environment variables are provided for container customization.

Variable	Type	Default	Description
USERNAME	string	admin	Username to access Jupyter Notebook
PASSWORD	string		Password to access Jupyter Notebook Generate by system

• Port

Type	Port
HTTP	8000
TCP	22

1. Ollama WebUI

• Intended Use: This template supports running various large language model (LLM) programs, including Ollama and APIs compatible with OpenAI, making it easy for users to customize based on workflow.

• Port:

Type	Port
HTTP	8080
TCP	22

1. Ollama

• Intended Use: This template enables high-throughput inference using GPU resources with a state-of-the-art engine.

• Environment Variables

Some more useful environment variables are provided for container customization.

Variable	Type	Default	Description
API_TOKEN	string		Auto-authenticate with external services Generate by system

• Port:

1. vLLM

• Intended Use: This vLLM container image is built and maintained by AI Factory. This template enables high-throughput model inference using GPU resources with a state-of-the-art engine.

• Environment Variables

Some more useful environment variables are provided for container customization.

Variable	Type	Default	Description
HUGGING_FACE_HUB_TOKEN	string		Your Hugging Face User Access Token

• Port:

Type	Port
HTTP	8000

1. Code Server

• Intended Use: This template offers cloud-based VS Code with GPU to train, test, and debug AI models remotely with full IDE capabilities.

• Environment Variables

Some more useful environment variables are provided for container customization.

Variable	Type	Default	Description
PUID	int	0	UserID
PGID	int	0	GroupID
TZ	string	Etc/UTC	Your timezone
PROXY_DOMAIN	string	code-server.my.domain	The domain will be proxied for subdomain proxying
DEFAULT_WORKSPACE	string	/	Default folder opened when accessing code-server
PASSWORD	string		Generate by system

• Port:

Type	Port
HTTP	8443
TCP	22

1. Ubuntu

Type	Port
TCP	22

• Intended Use: This is a minimal Ubuntu CLI virtual machine with several useful additions to improve your user experience. While the root account is available as usual, we have created a normal system user for your convenience.

• Development tools pre-installed: SSH access.

Custom Templates

You can use your own Docker image by clicking Custom Template and overriding your own image:tag. If your image is from a private Docker repository, make sure to provide your username and password for authentication.