Generative AI on Kubernetes

Kubernetes Bytes

Nội dung được cung cấp bởi Kubernetes Bytes, Ryan Wallner, and Bhavin Shah. Tất cả nội dung podcast bao gồm các tập, đồ họa và mô tả podcast đều được Kubernetes Bytes, Ryan Wallner, and Bhavin Shah hoặc đối tác nền tảng podcast của họ tải lên và cung cấp trực tiếp. Nếu bạn cho rằng ai đó đang sử dụng tác phẩm có bản quyền của bạn mà không có sự cho phép của bạn, bạn có thể làm theo quy trình được nêu ở đây https://vi.player.fm/legal.

1+ y ago 1:15:56

MP3•Trang chủ episode

Fetch error

Hmmm there seems to be a problem fetching this series right now. Last successful fetch was on March 03, 2025 17:11 (9M ago)

What now? This series will be checked again in the next day. If you believe it should be working, please verify the publisher's feed link below is valid and includes actual episode links. You can contact support to request the feed be immediately fetched.

In this episode of the Kubernetes Bytes podcast, Ryan and Bhavin sit down with Janakiram MSV - an advisor, analyst and architect to talk about how users can run Generative AI models on Kubernetes. The discussion revolves around Jani's home lab and his experimentation with different LLM models and how to get them running on NVIDIA GPUs. Jani has spent the past year becoming a subject matter expert in GenAI, and this discussion highlights all the different challenges he faced and what lessons he learnt from them.

Check out our website at https://kubernetesbytes.com/

Episode Sponsor: Elotl

https://elotl.co/luna
https://www.elotl.co/luna-free-trial

Timestamps:

02:02 Cloud Native News
15:31 Interview with Jani
01:11:00 Key takeaways

Cloud Native News:

https://www.techerati.com/press-release/octopus-deploy-acquires-codefresh-to-boost-kubernetes-and-cloud-native-delivery/
https://www.civo.com/blog/kubefirst-joins-civo
https://cast.ai/kubernetes-cost-benchmark
https://www.techradar.com/pro/vmware-customers-are-jumping-ship-as-broadcom-sales-continue-heres-where-theyre-moving-to
https://cloudonair.withgoogle.com/events/techbyte-making-ai-ml-scalable-cost-effective-gke
https://dok.community/dok-events/dok-day-kubecon-paris/
https://training.linuxfoundation.org/certification/certified-argo-project-associate-capa

Show Links:

https://www.youtube.com/janakirammsv
https://www.linkedin.com/in/janakiramm/
- NVIDIA Container Toolkit - https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/index.html
NVIDIA Device Plugin - https://github.com/NVIDIA/k8s-device-plugin
NVIDIA Feature Discovery - https://github.com/NVIDIA/gpu-feature-discovery
Hugging Face Text Gen Inference - https://huggingface.co/docs/text-generation-inference/index
Hugging Face Text Embeddings Inference - https://huggingface.co/docs/text-embeddings-inference/index
ChromaDB - https://www.trychroma.com/

88 tập

#Tech #Bhavin Shah #Ryan Wallner #Kubernetes Bytes #Kuberentes #Cloud IT #CONTAIN #Cloud Native #Software