Access a Pre-Trained LLM with Docker and Node.js | Easy Setup Tutorial
Docker Image url -: https://hub.docker.com/r/ollama/ollama
CLI Command to pull the image -: docker pull ollama/ollama:rocm
Creating the container -:
docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama:rocm
Start the container -: docker start -ai ollama
Run the model -: docker exec -it ollama ollama run llama3
** To delete the downloaded model -
1. First run the container
2. Then go to ollama
3. Files -- root -- .ollama -- models -- blobs -- entire model information gets stored here. Right click on files and select delete action from the context menu.
#llm
#docker
#nodejs
Download
0 formats
No download links available.
Access a Pre-Trained LLM with Docker and Node.js | Easy Setup Tutorial #llm #docker #nodejs | NatokHD