Document Summary Evaluation

BLANC is an automatic estimation approach for document summary quality. The goal is to measure the functional performance of a summary with an objective, reproducible, and fully automated method. BLANC achieves this by measuring the performance boost gained by a pre-trained language model with access to a document summary while carrying out its language understanding task on the document's text.

Source: Fill in the BLANC: Human-free quality estimation of document summaries

Papers


Paper Code Results Date Stars

Tasks


Task Papers Share
Language Modelling 3 50.00%
Multi-Task Learning 1 16.67%
Question Answering 1 16.67%
Reading Comprehension 1 16.67%

Components


Component Type
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories