# Generative AI on Kubernetes

Canonical: https://www.bookquiver.com/roland-huss/generative-ai-on-kubernetes

JSON version (same data): https://www.bookquiver.com/roland-huss/generative-ai-on-kubernetes.json

![Generative AI on Kubernetes](https://quivercdn.com/covers/oreilly-media/roland-huss/generative-ai-on-kubernetes_978-10-9817-192-6-9e338015.webp?v=2026-11-08%2003%3A11%3A42)

- Authors: [Roland Huß](https://www.bookquiver.com/roland-huss), [Daniele Zonca](https://www.bookquiver.com/daniele-zonca)
- Language: en_US
- Published: 2026-03-13
- Genres: Computing and Information Technology, Computer networking and communications

## Description

Generative AI is revolutionizing industries, and Kubernetes has fast become the backbone for deploying and managing these resource-intensive workloads. This book serves as a practical, hands-on guide for MLOps engineers, software developers, Kubernetes administrators, and AI professionals ready to combine AI innovation with the power of cloud native infrastructure. Authors Roland Huß and Daniele Zonca provide a clear road map for training, fine-tuning, deploying, and scaling GenAI models on Kubernetes, addressing challenges like resource optimization, automation, and security along the way. With actionable insights with real-world examples, readers will learn to tackle the opportunities and complexities of managing GenAI applications in production environments. Whether you're experimenting with large-scale language models or facing the nuances of AI deployment at scale, you'll uncover expertise you need to operationalize this exciting technology effectively. - Learn how to deploy LLMs more efficiently with optimized inference runtimes - Get hands-on with GPU scheduling, including hardware detection and multinode scaling - Monitor and understand LLM-specific metrics like Time to First Token and token throughput - Know when to fine-tune a model or when retrieval augmentation is the better choice - Discover how to evaluate models with standardized benchmarks before committing GPU resources - Learn to run agentic applications with secure tool integration, identity management, and persistent state

## Editions

### Generative AI on Kubernetes

- Publisher: O'Reilly Media
- ISBN: 978-10-9817-192-6
- Pages: 250
- Published: 2026-03-13
- Language: en_US