Search Results for author:
Found 7 papers, 6 papers with code
VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos
Recently, many long video-language understanding approaches have leveraged the reasoning capabilities of Large Language Models (LLMs) to perform long video QA, transforming videos into densely sampled frame captions, and asking LLMs to respond to text queries over captions.
Ranked #1 on
Zero-Shot Video Question Answer
on IntentQA
RACCooN: Remove, Add, and Change Video Content with Auto-Generated Narratives
This paper proposes RACCooN, a versatile and user-friendly video-to-paragraph-to-video generative framework that supports multiple video editing capabilities such as removal, addition, and modification, through a unified pipeline.
STAR: A Benchmark for Situated Reasoning in Real-World Videos
This paper introduces a new benchmark that evaluates the situated reasoning ability via situation abstraction and logic-grounded question answering for real-world videos, called Situated Reasoning in Real-World Videos (STAR Benchmark).
CREMA: Multimodal Compositional Video Reasoning via Efficient Modular Adaptation and Fusion
Furthermore, we propose a fusion module designed to compress multimodal queries, maintaining computational efficiency in the LLM while combining additional modalities.
Ranked #1 on
Question Answering
on SQA3D
A Simple LLM Framework for Long-Range Video Question-Answering
Furthermore, we show that a specialized prompt that asks the LLM first to summarize the noisy short-term visual captions and then answer a given input question leads to a significant LVQA performance boost.
Ranked #1 on
Zero-Shot Video Question Answer
on NExT-GQA
Self-Chained Image-Language Model for Video Localization and Question Answering
SeViLA framework consists of two modules: Localizer and Answerer, where both are parameter-efficiently fine-tuned from BLIP-2.
Ranked #3 on
Video Question Answering
on STAR Benchmark
Regularity Learning via Explicit Distribution Modeling for Skeletal Video Anomaly Detection
Different from pixel-based anomaly detection methods, pose-based methods utilize highly-structured skeleton data, which decreases the computational burden and also avoids the negative impact of background noise.
Anomaly Detection In Surveillance Videos
Optical Flow Estimation
+1
