Search Results for author:
Found 1 papers, 0 papers with code
Edge Intelligence Optimization for Large Language Model Inference with Batching and Quantization
Specifically, with the deployment of the batching technique and model quantization on resource-limited edge devices, we formulate an inference model for transformer decoder-based LLMs.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
