Search Results for author:
Found 2 papers, 0 papers with code
Combining multiple post-training techniques to achieve most efficient quantized LLMs
Large Language Models (LLMs) have distinguished themselves with outstanding performance in complex language modeling tasks, yet they come with significant computational and storage challenges.
Self-Selected Attention Span for Accelerating Large Language Model Inference
We demonstrate that using this custom CUDA kernel improves the throughput of LLM inference by 28%.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
