Run Local LLMs with Docker Model Runner. GenAI for your containers
Docker launched “Docker Model Runner” to run LLMs through llama.cpp with a single “docker model” command. I’m going to detail when you should use it, how the internals work, and how get started using Open WebUI for a private ChatGPT-like expirence.
Get started with Docker Model Runner
===============================
Model Runner Docs https://docs.docker.com/desktop/features/mo…Read more
DevOps and Docker Talk: Cloud Native Interviews and Tooling
I'm Bret Fisher, a Docker Captain and online DevOps and Docker course creator. I'm also a DevOps consultant, and help in tech communities like the Docker Captains and local tech meetups in Virginia, USA. This podcast is supplemental to my courses and YouTube videos and is full of interviews and...
View Profile