[UPDATE] CODI-CRAC 2021 Shared-Task: Anaphora Resolution in Dialogues (EMNLP 2021)

SK
Sopan Khosla
Wed, Jul 21, 2021 7:34 PM

CODI-CRAC 2021 Shared-Task: Anaphora Resolution in Dialogues

Coreference and anaphora resolution is a long-studied problem in
computational linguistics and NLP. The goal of this shared task is to
bring together researchers from disciplines like discourse analysis,
dialogue systems, machine learning, and linguistics for the purpose of
paving the way to advances in the area of coreference and anaphora
resolution. Participants in the shared task are finishing up the
technical part of their work, but there is also still an opportunity
for others to participate!

One unique aspect of this shared task is that we are inviting two
types of submissions, first System descriptions (Due August 3), and
then Analysis papers (Due September 6).

All shared task participants who have participated in at least one
track are invited to submit a system description of up to 5 pages plus
2 extra pages for additional tracks (Gold and Pred phases will be
considered as a single track) plus references. Therefore, participants
who have participated in multiple tasks may add additional pages
(i.e., 2 extra pages for 2 tracks, or 4 extra pages for 3 tracks).
Submissions may also add up to 2 pages per track for error analysis.
This is optional, but very highly encouraged.  Submissions should
conform to the EMNLP 21 format
(https://2021.emnlp.org/call-for-papers/style-and-formatting
https://signaltk.online/click?redirect=https%3A%2F%2F2021.emnlp.org%2Fcall-for-papers%2Fstyle-and-formatting&dID=1626896051767&linkName=https://2021.emnlp.org/call-for-papers/style-and-formatting).
Submissions of system descriptions are due on August 3 to the shared
task softconf site:
https://signaltk.online/click?redirect=https%3A%2F%2Fwww.softconf.com%2Femnlp2021%2FCODICRAC2021%2F&dID=1626896051767https://www.softconf.com/emnlp2021/
https://signaltk.online/click?redirect=https%3A%2F%2Fwww.softconf.com%2Femnlp2021%2F&dID=1626896051767&linkName=https://www.softconf.com/emnlp2021/CODICRAC2021/.
Note that submitted drafts will be made publicly available to author
teams participating in the Analysis paper call.

We are also making an open call for what we are calling Analysis
Papers.  The purpose of these papers is to present a vision statement
for the field based on a cross-cutting comparison across systems
submitted or a critique of the shared task itself, pointing to gaps in
the field not addressed in this shared task.  Analysis papers may
focus on just one track or multiple tracks.  By August 10, we will
provide the submitted system descriptions and performance tables that
report the output on each instance for each of the participating
systems (apart from the raw eval submission files).  Submissions of
analysis papers can be between 4 and 6 pages and should conform to the
EMNLP 21 format.  Submissions of analysis papers are due on September
6 to the shared task softconf site:
https://signaltk.online/click?redirect=https%3A%2F%2Fwww.softconf.com%2Femnlp2021%2FCODICRAC2021%2F&dID=1626896051767https://www.softconf.com/emnlp2021/
https://signaltk.online/click?redirect=https%3A%2F%2Fwww.softconf.com%2Femnlp2021%2F&dID=1626896051767&linkName=https://www.softconf.com/emnlp2021/CODICRAC2021/.

Please feel free to reach out if you have questions or concerns:
sharedtask-codicrac-emnlp2021@googlegroups.com

Official Codalab Website:
https://signaltk.online/click?redirect=http%3A%2F%2Fbit.ly%2Fcodi-crac-2021-sharedtask&dID=1626896051767http://bit.ly/codi-crac-2021-
https://signaltk.online/click?redirect=http%3A%2F%2Fbit.ly%2Fcodi-crac-2021-&dID=1626896051767&linkName=http://bit.ly/codi-crac-2021-sharedtask

*CODI-CRAC 2021 Shared-Task: Anaphora Resolution in Dialogues* Coreference and anaphora resolution is a long-studied problem in computational linguistics and NLP. The goal of this shared task is to bring together researchers from disciplines like discourse analysis, dialogue systems, machine learning, and linguistics for the purpose of paving the way to advances in the area of coreference and anaphora resolution. Participants in the shared task are finishing up the technical part of their work, but there is *also* still an opportunity for others to participate! One unique aspect of this shared task is that we are inviting two types of submissions, first *System descriptions* (Due August 3), and then *Analysis papers* (Due September 6). All shared task participants who have participated in at least one track are invited to submit a system description of up to 5 pages plus 2 extra pages for additional tracks (Gold and Pred phases will be considered as a single track) plus references. Therefore, participants who have participated in multiple tasks may add additional pages (i.e., 2 extra pages for 2 tracks, or 4 extra pages for 3 tracks). Submissions may also add up to 2 pages per track for error analysis. This is optional, but very highly encouraged. Submissions should conform to the EMNLP 21 format (https://2021.emnlp.org/call-for-papers/style-and-formatting <https://signaltk.online/click?redirect=https%3A%2F%2F2021.emnlp.org%2Fcall-for-papers%2Fstyle-and-formatting&dID=1626896051767&linkName=https://2021.emnlp.org/call-for-papers/style-and-formatting>). Submissions of system descriptions are due on August 3 to the shared task softconf site: <https://signaltk.online/click?redirect=https%3A%2F%2Fwww.softconf.com%2Femnlp2021%2FCODICRAC2021%2F&dID=1626896051767>https://www.softconf.com/emnlp2021/ <https://signaltk.online/click?redirect=https%3A%2F%2Fwww.softconf.com%2Femnlp2021%2F&dID=1626896051767&linkName=https://www.softconf.com/emnlp2021/>CODICRAC2021/. Note that submitted drafts will be made publicly available to author teams participating in the Analysis paper call. We are also making an open call for what we are calling Analysis Papers. The purpose of these papers is to present a vision statement for the field based on a cross-cutting comparison across systems submitted or a critique of the shared task itself, pointing to gaps in the field not addressed in this shared task. Analysis papers may focus on just one track or multiple tracks. By August 10, we will provide the submitted system descriptions and performance tables that report the output on each instance for each of the participating systems (apart from the raw eval submission files). Submissions of analysis papers can be between 4 and 6 pages and should conform to the EMNLP 21 format. Submissions of analysis papers are due on September 6 to the shared task softconf site: <https://signaltk.online/click?redirect=https%3A%2F%2Fwww.softconf.com%2Femnlp2021%2FCODICRAC2021%2F&dID=1626896051767>https://www.softconf.com/emnlp2021/ <https://signaltk.online/click?redirect=https%3A%2F%2Fwww.softconf.com%2Femnlp2021%2F&dID=1626896051767&linkName=https://www.softconf.com/emnlp2021/>CODICRAC2021/. Please feel free to reach out if you have questions or concerns: sharedtask-codicrac-emnlp2021@googlegroups.com Official Codalab Website: <https://signaltk.online/click?redirect=http%3A%2F%2Fbit.ly%2Fcodi-crac-2021-sharedtask&dID=1626896051767>http://bit.ly/codi-crac-2021- <https://signaltk.online/click?redirect=http%3A%2F%2Fbit.ly%2Fcodi-crac-2021-&dID=1626896051767&linkName=http://bit.ly/codi-crac-2021->sharedtask