Search Results for author: Souvika Sarkar

Found 6 papers, 1 papers with code

Benchmarking LLMs on the Semantic Overlap Summarization Task

no code implementations26 Feb 2024 John Salvador, Naman Bansal, Mousumi Akter, Souvika Sarkar, Anupam Das, Shubhra Kanti Karmaker

While recent advancements in Large Language Models (LLMs) have achieved superior performance in numerous summarization tasks, a benchmarking study of the SOS task using LLMs is yet to be performed.

Benchmarking Document Summarization +1

Prompting LLMs to Compose Meta-Review Drafts from Peer-Review Narratives of Scholarly Manuscripts

no code implementations23 Feb 2024 Shubhra Kanti Karmaker Santu, Sanjeev Kumar Sinha, Naman Bansal, Alex Knipper, Souvika Sarkar, John Salvador, Yash Mahajan, Sri Guttikonda, Mousumi Akter, Matthew Freestone, Matthew C. Williams Jr

One of the most important yet onerous tasks in the academic peer-reviewing process is composing meta-reviews, which involves understanding the core contributions, strengths, and weaknesses of a scholarly manuscript based on peer-review narratives from multiple experts and then summarizing those multiple experts' perspectives into a concise holistic overview.

LLMs as On-demand Customizable Service

no code implementations29 Jan 2024 Souvika Sarkar, Mohammad Fakhruddin Babar, Monowar Hasan, Shubhra Kanti Karmaker

To address these issues, we introduce a concept of hierarchical, distributed LLM architecture that aims at enhancing the accessibility and deployability of LLMs across heterogeneous computing platforms, including general-purpose computers (e. g., laptops) and IoT-style devices (e. g., embedded systems).

Processing Natural Language on Embedded Devices: How Well Do Transformer Models Perform?

2 code implementations23 Apr 2023 Souvika Sarkar, Mohammad Fakhruddin Babar, Md Mahadi Hassan, Monowar Hasan, Shubhra Kanti Karmaker Santu

This paper presents a performance study of transformer language models under different hardware configurations and accuracy requirements and derives empirical observations about these resource/accuracy trade-offs.

Sentiment Analysis Sentiment Classification

Zero-Shot Multi-Label Topic Inference with Sentence Encoders

no code implementations14 Apr 2023 Souvika Sarkar, Dongji Feng, Shubhra Kanti Karmaker Santu

Sentence encoders have indeed been shown to achieve superior performances for many downstream text-mining tasks and, thus, claimed to be fairly general.

Sentence

On Evaluation of Bangla Word Analogies

no code implementations10 Apr 2023 Mousumi Akter, Souvika Sarkar, Shubhra Kanti Karmaker

This paper presents a high-quality dataset for evaluating the quality of Bangla word embeddings, which is a fundamental task in the field of Natural Language Processing (NLP).

Benchmarking Word Embeddings

Cannot find the paper you are looking for? You can Submit a new open access paper.