Speculative Decoding: 3× Faster LLM Inference with Zero Quality Loss
7:40
Speculative Decoding: 3× Faster LLM Inference with Zero Quality L…
271 views2 months ago
YouTubeTales Of Tensors
Practical Strategies for Optimizing LLM Inference Sizing and Performance | NVIDIA Technical Blog
Practical Strategies for Optimizing LLM Inference Sizing and Perform…
Aug 21, 2024
nvidia.com
Speculative Decoding Turbocharge Your LLM Inference! #ai, #llm, #inference, #optimization
0:46
Speculative Decoding Turbocharge Your LLM Inference! #ai, #llm, #inf…
25 views3 weeks ago
YouTubeThe Code Architect
Context Optimization vs LLM Optimization
Context Optimization vs LLM Optimization
Nov 21, 2024
ibm.com
LLM inference optimization: Model Quantization and Distillation
45:11
LLM inference optimization: Model Quantization and Distillation
1.2K viewsSep 22, 2024
YouTubeYanAITalk
EP5: Speculative Decoding with Nadav Timor
1:02:23
EP5: Speculative Decoding with Nadav Timor
5 months ago
YouTubeThe Information Bottleneck
Optimize Your AI - Quantization Explained
12:10
Optimize Your AI - Quantization Explained
370.3K viewsDec 28, 2024
YouTubeMatt Williams
36:43
Primer on LLM Inference: Optimization with Prefill and Decode
218 views4 months ago
YouTubeAI Papers Podcast Daily
17:52
AI Optimization Lecture 01 - Prefill vs Decode - Mastering LLM Techni…
10.2K views8 months ago
YouTubeFaradawn Yang
58:43
LLMs Quantization Crash Course for Beginners
5.7K viewsMay 19, 2024
YouTubeAI Anytime
36:12
Deep Dive: Optimizing LLM inference
44.6K viewsMar 11, 2024
YouTubeJulien Simon
22:54
FriendliAI: High-Performance LLM Serving and Inference Optimizatio…
14.2K views4 months ago
YouTubeProduct Grade
33:39
Mastering LLM Inference Optimization From Theory to Cost …
31.7K viewsJan 1, 2025
YouTubeAI Engineer
19:46
Quantization vs Pruning vs Distillation: Optimizing NNs for Inf…
49.6K viewsJun 30, 2023
YouTubeEfficient NLP
45:44
Efficient LLM Inference (vLLM KV Cache, Flash Decoding & Lookahe…
9.2K viewsMar 1, 2024
YouTubeNoble Saji Mathews
47:51
Scaling LLM Batch Inference: Ray Data & vLLM for High Throughput
944 views11 months ago
YouTubeInfoQ
26:23
Estimate Memory Consumption of LLMs for Inference and Fine-Tuning
2.5K viewsApr 26, 2024
YouTubeAI Anytime
12:01
Inference Optimization (Technical Walkthrough of NVIDIA’s Blog)
1 views4 weeks ago
YouTubeAsim Munawar
6:28
LLM in a flash: Efficient Large Language Model Inference with Li…
4.8K viewsDec 23, 2023
YouTubeAI Papers Academy
18:32
Faster LLM Inference: Speeding up Falcon 7b (with QLoRA adapter) P…
10.2K viewsJun 11, 2023
YouTubeVenelin Valkov
10:21
Context Optimization vs LLM Optimization: Choosing the Right …
9.7K viewsNov 13, 2024
YouTubeIBM Technology
10:54
Boost Your AI Predictions: Maximize Speed with vLLM Library for Larg…
9.4K viewsNov 27, 2023
YouTubeVenelin Valkov
34:14
Understanding the LLM Inference Workload - Mark Moyou, NVIDIA
22K viewsOct 1, 2024
YouTubePyTorch
8:42
Master LLMs: Top Strategies to Evaluate LLM Performance
8.4K viewsOct 29, 2023
YouTubeWhat's AI by Louis-François Bouchard
12:52
LLM Inference Explained: How AI Predicts Tokens and How to Make …
1 views3 months ago
YouTubeBinary Verse AI
48:22
Building Custom LLMs for Production Inference Endpoints - …
623 viewsOct 31, 2024
YouTubeMicrosoft Reactor
39:35
LLM Inference Performance and Optimization on NVIDIA GB200 NV…
11 months ago
nvidia.com
10:47
LLMLingua: Speed up LLM's Inference and Enhance Performan…
6.5K viewsJan 2, 2024
YouTubeWorldofAI
15:19
vLLM: Easily Deploying & Serving LLMs
28.6K views5 months ago
YouTubeNeuralNine
33:21
Deploy LLMs More Efficiently with vLLM and Neural Magic
2.4K viewsJul 15, 2024
YouTubeNeural Magic
See more videos
Static thumbnail place holder