Docker Model Runner

DevOps and Docker Talk: Cloud Native Interviews and Tooling

Nội dung được cung cấp bởi Bret Fisher. Tất cả nội dung podcast bao gồm các tập, đồ họa và mô tả podcast đều được Bret Fisher hoặc đối tác nền tảng podcast của họ tải lên và cung cấp trực tiếp. Nếu bạn cho rằng ai đó đang sử dụng tác phẩm có bản quyền của bạn mà không có sự cho phép của bạn, bạn có thể làm theo quy trình được nêu ở đây https://vi.player.fm/legal.

8M ago 14:44

MP3•Trang chủ episode

Fetch error

Hmmm there seems to be a problem fetching this series right now. Last successful fetch was on October 09, 2025 17:11 (2M ago)

What now? This series will be checked again in the next day. If you believe it should be working, please verify the publisher's feed link below is valid and includes actual episode links. You can contact support to request the feed be immediately fetched.

Docker launched "Docker Model Runner" to run LLMs through llama.cpp with a single "docker model" command. In this episode Bret details examples and some useful use cases for using this way to run LLMs. He breaks down the internals. How it works, when you should use it or not use it; and, how to get started using Open WebUI for a private ChatGPT-like experience.

🙌 My next course is coming soon! I've opened the waitlist for those wanting to go deep in GitHub Actions for DevOps and AI automation in 2025. I'm so thrilled to announce this course. The waitlist allows you to quickly sign up for some content updates, discounts, and more as I finish building the course. https://learn.bretfisher.com/waitlist🍾

★Topics★
Model Runner Docs
Hub Models
OCI Artifacts
Open WebUI
My Open WebUI Compose file

Creators & Guests

Cristi Cotovan - Editor
Beth Fisher - Producer
Bret Fisher - Host

(00:00) - Intro
(02:23) - Model Runner Elevator Pitch
(03:05) - Enabling Docker Model Runner
(06:05) - Self Promotion! Is that an ad? For me?
(06:40) - Downloading Models
(08:48) - Architectrure of Model Runner
(12:26) - ORAS
(12:46) - What's next for Model Runner?
(13:50) - Troubleshooting

You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

Grab the best coupons for my Docker and Kubernetes courses.
Join my cloud native DevOps community on Discord.
Grab some merch at Bret's Loot Box
Homepage bretfisher.com

189 tập