Shared Task on Evaluating Accuracy

Ehud Reiter; Craig Alexander Thomson

Shared Task on Evaluating Accuracy

Ehud Reiter
, Craig Alexander Thomson

Research output: Contribution to conference › Conference presentation (Unpublished paper) › peer-review

6 Citations (Scopus)

11 Downloads (Pure)

Abstract

We propose a shared task on methodologies and algorithms for evaluating the accuracy of generated texts, specifically summaries of basketball games produced from basketball box score and other game data. We welcome submissions based on protocols for human evaluation, automatic metrics, as well as combinations of human evaluations and metrics

Original language	English
Pages	227-231
Number of pages	5
Publication status	Published - Dec 2020
Event	Proceedings of the 13th International Conference on Natural Language Generation - Held online Dublin City University, Dublin, Ireland Duration: 15 Dec 2020 → 18 Dec 2020 Conference number: 13 https://www.inlg2020.org/

Conference

Conference	Proceedings of the 13th International Conference on Natural Language Generation
Abbreviated title	INLG 2020
Country/Territory	Ireland
City	Dublin
Period	15/12/20 → 18/12/20
Internet address	https://www.inlg2020.org/

Access to Document

Reiter_et_al_ACL_SharedTaskOn_VoR
Materials published in or after 2016 are licensed on a Creative Commons Attribution 4.0 International License. https://creativecommons.org/licenses/by/4.0/
Final published version, 137 KBLicence: CC BY

https://www.aclweb.org/anthology/2020.inlg-1.28/Licence: CC BY

Cite this

@conference{cd0e75f898304b5fa76932993e0ac610,

title = "Shared Task on Evaluating Accuracy",

abstract = "We propose a shared task on methodologies and algorithms for evaluating the accuracy of generated texts, specifically summaries of basketball games produced from basketball box score and other game data. We welcome submissions based on protocols for human evaluation, automatic metrics, as well as combinations of human evaluations and metrics",

author = "Ehud Reiter and Thomson, \{Craig Alexander\}",

year = "2020",

month = dec,

language = "English",

pages = "227--231",

note = "Proceedings of the 13th International Conference on Natural Language Generation, INLG 2020 ; Conference date: 15-12-2020 Through 18-12-2020",

url = "https://www.inlg2020.org/",

}

TY - CONF

T1 - Shared Task on Evaluating Accuracy

AU - Reiter, Ehud

AU - Thomson, Craig Alexander

N1 - Conference code: 13

PY - 2020/12

Y1 - 2020/12

N2 - We propose a shared task on methodologies and algorithms for evaluating the accuracy of generated texts, specifically summaries of basketball games produced from basketball box score and other game data. We welcome submissions based on protocols for human evaluation, automatic metrics, as well as combinations of human evaluations and metrics

AB - We propose a shared task on methodologies and algorithms for evaluating the accuracy of generated texts, specifically summaries of basketball games produced from basketball box score and other game data. We welcome submissions based on protocols for human evaluation, automatic metrics, as well as combinations of human evaluations and metrics

M3 - Conference presentation (Unpublished paper)

SP - 227

EP - 231

T2 - Proceedings of the 13th International Conference on Natural Language Generation

Y2 - 15 December 2020 through 18 December 2020

ER -

Shared Task on Evaluating Accuracy

Abstract

Conference

Access to Document

Fingerprint

Cite this