LLM Inference Engineering: Quantization, KV-Cache Optimization, and High-Throughput Serving: A Production Engineer's Guide to INT4/INT8 Quantization, ... (Production AI Engineering Series)

Similar products

• 

  LLM Inference in C++: Building High-Throughput Engines with PagedAttention and CUDA Kernels (High-Performance C++ Engineering)

  From 22,61 EUR
• 

  LLM Inference in C++: Building High-Throughput Engines with PagedAttention and CUDA Kernels (High-Performance C++ Engineering)

  From 25,52 EUR
• 

  GGUF Model Packaging: Managing Quantized LLM Artifacts for Local Inference

  From 30,31 EUR
• 

  AI Inference Optimization Engineering: Quantization, Speculative Decoding, and Hardware-Specific LLM Deployment (Production AI Engineering Series)

  From 7,42 EUR
• 

  vLLM Serving: High‑Throughput LLM APIs with PagedAttention and KV Cache Tuning

  From 30,31 EUR
• 

  TurboQuant for Local LLMs: Reduce KV Cache Memory, Run Longer Context Windows, and Accelerate Private AI Inference on Consumer Hardware

  From 20,80 EUR