HTTP Service
Connecting to a container using HTTP is convenient, quick, and secure via HTTPS. To connect using the HTTP Service:
Step 1: Once the container is running, navigate to Container Details Page.
Step 2: Find Access container Section, open HTTP Endpoint.
Step 3: Follow the guide that matches your template.
Template
Jupyter, Code Server
Ollama WebUI
Ollama
Vllm
Pre-condition
None
None
None
Hugging Face Token (*)Before creating a new container, you must fill your Hugging Face Token in Enviroment Variable section.
Next steps
Open the endpoint in your browser
Use the Username and Password fields in the Environment Variables section of the Container Details page to access your container
Open the endpoint in your browser
Create a new Open WebUI account or use your existing account.
Select a model to pull and test the model.
Testing your container using Postman (**)
Testing your container using Postman (**)
(*) Hugging Face Token: Hugging Face Token in Environment Variable section is required when using Ollama template. If you do not have Hugging Face Token yet, please follow this guide User access tokens.
(**) Testing container by using Postman: Append /v1/models to your endpoint, then provide your API_TOKEN in the Authorization. If you're using the vLLM template, also include HUGGING_FACE_HUB_TOKEN in the request parameters to test your container.
Last updated
Was this helpful?
