LLMs as On-demand Customizable Service

no code implementations • 29 Jan 2024 • Souvika Sarkar, Mohammad Fakhruddin Babar, Monowar Hasan, Shubhra Kanti Karmaker

To address these issues, we introduce a concept of hierarchical, distributed LLM architecture that aims at enhancing the accessibility and deployability of LLMs across heterogeneous computing platforms, including general-purpose computers (e. g., laptops) and IoT-style devices (e. g., embedded systems).

Processing Natural Language on Embedded Devices: How Well Do Transformer Models Perform?

2 code implementations • 23 Apr 2023 • Souvika Sarkar, Mohammad Fakhruddin Babar, Md Mahadi Hassan, Monowar Hasan, Shubhra Kanti Karmaker Santu

This paper presents a performance study of transformer language models under different hardware configurations and accuracy requirements and derives empirical observations about these resource/accuracy trade-offs.

Sentiment Analysis Sentiment Classification