HTTP Service

Connecting to a container using HTTP is convenient, quick, and secure via HTTPS. To connect using the HTTP Service:

Step 1: Once the container is running, navigate to Container Details Page.

Step 2: Find Access container Section, open HTTP Endpoint.

Step 3: Follow the guide that matches your template.

Template

Jupyter, Code Server

Ollama WebUI

Ollama

Vllm

Pre-condition

None

None

None

Hugging Face Token (*)Before creating a new container, you must fill your Hugging Face Token in Enviroment Variable section.

Next steps

  • Open the endpoint in your browser

  • Use the Username and Password fields in the Environment Variables section of the Container Details page to access your container

  • Open the endpoint in your browser

  • Create a new Open WebUI account or use your existing account.

  • Select a model to pull and test the model.

Testing your container using Postman (**)

Testing your container using Postman (**)

(*) Hugging Face Token: Hugging Face Token in Environment Variable section is required when using Ollama template. If you do not have Hugging Face Token yet, please follow this guide User access tokensarrow-up-right.

(**) Testing container by using Postman: Append /v1/models to your endpoint, then provide your API_TOKEN in the Authorization. If you're using the vLLM template, also include HUGGING_FACE_HUB_TOKEN in the request parameters to test your container.

Last updated

Was this helpful?