DefTruth / Awesome-LLM-Inference📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.Repo URL |
👀47 🍴76 ⭐1075#D20240331 #D20240331_Unknown #Unknown
GitHub
GitHub - DefTruth/Awesome-LLM-Inference: 📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming…
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc. - DefTruth/Awesome-...
via Github Trending - Telegram Channel