Module 6 — Production AI Systems
Local model serving, packaging, evaluation frameworks, and shipping AI products — from personal tools to products others use.
Topics
What's inside this module
- Local model serving
Ollama, vLLM — cost optimization, privacy, fine-tuning experiments.
- Packaging & deployment
CLI tools, web UIs (Streamlit/FastAPI), Docker.
- Evaluation frameworks
Systematic prompt testing, A/B evaluation, quality scoring.
- Shipping AI products
From personal infrastructure to products others use.