What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review

Research output: Contribution to conferencePaperResearch

Standard

What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review. / Jakobsen, Terne Sasha Thorn; Rogers, Anna.

2022. 4810-4823 Paper presented at Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Seattle, United States.

Research output: Contribution to conferencePaperResearch

Harvard

Jakobsen, TST & Rogers, A 2022, 'What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review', Paper presented at Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Seattle, United States, 10/07/2022 - 15/07/2022 pp. 4810-4823. https://doi.org/10.18653/v1/2022.naacl-main.354

APA

Jakobsen, T. S. T., & Rogers, A. (2022). What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review. 4810-4823. Paper presented at Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Seattle, United States. https://doi.org/10.18653/v1/2022.naacl-main.354

Vancouver

Jakobsen TST, Rogers A. What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review. 2022. Paper presented at Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Seattle, United States. https://doi.org/10.18653/v1/2022.naacl-main.354

Author

Jakobsen, Terne Sasha Thorn ; Rogers, Anna. / What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review. Paper presented at Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Seattle, United States.

Bibtex

@conference{1a87fefc8b014a4398bb54e8da376bcc,
title = "What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review",
abstract = "Both scientific progress and individual researcher careers depend on the quality of peer review, which in turn depends on paper-reviewer matching. Surprisingly, this problem has been mostly approached as an automated recommendation problem rather than as a matter where different stakeholders (area chairs, reviewers, authors) have accumulated experience worth taking into account. We present the results of the first survey of the NLP community, identifying common issues and perspectives on what factors should be considered by paper-reviewer matching systems. This study contributes actionable recommendations for improving future NLP conferences, and desiderata for interpretable peer review assignments.",
author = "Jakobsen, {Terne Sasha Thorn} and Anna Rogers",
year = "2022",
doi = "10.18653/v1/2022.naacl-main.354",
language = "English",
pages = "4810--4823",
note = "null ; Conference date: 10-07-2022 Through 15-07-2022",

}

RIS

TY - CONF

T1 - What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review

AU - Jakobsen, Terne Sasha Thorn

AU - Rogers, Anna

PY - 2022

Y1 - 2022

N2 - Both scientific progress and individual researcher careers depend on the quality of peer review, which in turn depends on paper-reviewer matching. Surprisingly, this problem has been mostly approached as an automated recommendation problem rather than as a matter where different stakeholders (area chairs, reviewers, authors) have accumulated experience worth taking into account. We present the results of the first survey of the NLP community, identifying common issues and perspectives on what factors should be considered by paper-reviewer matching systems. This study contributes actionable recommendations for improving future NLP conferences, and desiderata for interpretable peer review assignments.

AB - Both scientific progress and individual researcher careers depend on the quality of peer review, which in turn depends on paper-reviewer matching. Surprisingly, this problem has been mostly approached as an automated recommendation problem rather than as a matter where different stakeholders (area chairs, reviewers, authors) have accumulated experience worth taking into account. We present the results of the first survey of the NLP community, identifying common issues and perspectives on what factors should be considered by paper-reviewer matching systems. This study contributes actionable recommendations for improving future NLP conferences, and desiderata for interpretable peer review assignments.

U2 - 10.18653/v1/2022.naacl-main.354

DO - 10.18653/v1/2022.naacl-main.354

M3 - Paper

SP - 4810

EP - 4823

Y2 - 10 July 2022 through 15 July 2022

ER -

ID: 384348345