Tag: vLLM

Jun, 25 2026

Retrieval Augmentation on Open-Source LLMs: Tooling and Best Practices

Emily Fies

A practical guide to implementing Retrieval-Augmented Generation (RAG) with open-source LLMs. Covers core architecture, essential tools like LangChain and vLLM, vector databases, and best practices for reducing hallucinations.

Jun, 20 2026

Latency vs Throughput in LLM Deployments: A Practical Guide for Production

Emily Fies

Master the latency vs throughput tradeoff in LLM deployments. Learn how batching, vLLM, and GPU selection impact performance and costs in production environments.

Apr, 14 2026

Request Prioritization and SLAs for Enterprise LLM Endpoints

Emily Fies

Learn how to manage LLM request prioritization and maintain strict SLAs in enterprise environments using vLLM, AI gateways, and tail-latency optimization.

Mar, 14 2026

vLLM vs TGI: Which LLM Serving Framework Delivers More Power for Your API?

Emily Fies

vLLM and TGI are two leading frameworks for serving large language models. vLLM delivers higher throughput and memory efficiency, while TGI offers easier deployment and better observability. Choose based on your traffic, model size, and team workflow.

Oct, 5 2025

Cost-Performance Tuning for Open-Source LLM Inference: How to Slash Costs Without Losing Quality

Emily Fies

Learn how to cut LLM inference costs by 70-90% using open-source tools like vLLM, quantization, and Multi-LoRA-without sacrificing performance. Real-world strategies for startups and enterprises.