Humanist Discussion Group

Humanist Archives: March 24, 2025, 6:02 a.m. Humanist 38.419 - events cfp: Arabic NLP (Suzhou); Evaluation Forum (Madrid)

				
              Humanist Discussion Group, Vol. 38, No. 419.
        Department of Digital Humanities, University of Cologne
                      Hosted by DH-Cologne
                       www.dhhumanist.org
                Submit to: humanist@dhhumanist.org


    [1]    From: Wajdi Zaghouani <wajdiz@gmail.com>
           Subject: 2nd Call for Shared Tasks Proposals - ArabicNLP 2025 (co-located with EMNLP 2025) (74)

    [2]    From: Wajdi Zaghouani <wajdiz@gmail.com>
           Subject: CLEF-2025 CheckThat! Lab -- 3rd Call for Participation (70)


--[1]------------------------------------------------------------------------
        Date: 2025-03-22 10:56:47+00:00
        From: Wajdi Zaghouani <wajdiz@gmail.com>
        Subject: 2nd Call for Shared Tasks Proposals - ArabicNLP 2025 (co-located with EMNLP 2025)

The Third Arabic Natural Language Processing Conference (ArabicNLP 2025)
Co-located with EMNLP 2025 in Suzhou, China, November 5-9, 2025.

We invite proposals for shared tasks related to Arabic NLP to be included
in the ArabicNLP 2025 conference. Proposals should include the following
details:

   1.   Overview of the proposed task
   2.   Motivation for the task
   3.   Data/Resource Collection and Creation (please specify the current status
   of the data: planned, in progress, or ready)
   4.   Task Description
   5.   Pilot Run Details (if available)
   6.   Tentative Timeline
   7.   Task Organizers (name, email, and affiliation)

Proposals should be submitted in PDF format and can be up to 4 pages long.
Shared Task Proposal Submission Link: https://forms.gle/3bWWBFV42cYNYaUP9


Selection Process

The proposals will be reviewed by the organizing committee and selected
based on multiple factors such as the novelty of the task, the expected
interest from the community, how convincing the data collection plans are,
the soundness of the evaluation method, and the expected impact of the task.

Task Organization

Upon acceptance, the task organizers are expected to verify that the task
organization and data delivery to participants are happening in a timely
manner, provide the participants with all needed resources related to the
task, create a mailing list, and maintain communication and support to
participants, create and manage CodaLab or similar competition website,
manage submissions to CodaLab, write a task description paper, manage
participants submissions of system description papers, and review and
maintain the quality of submitted system description papers.

Shared Task Proposal Submission

All deadlines are 11:59 pm UTC -12h
<https://www.timeanddate.com/time/zone/timezone/utc-12> (“Anywhere on
Earth”).


April 6th, 2025: Shared task proposals due
April 20th, 2025: Notification of shared task proposal acceptance

Important Dates for Shared Task Proposals:
Proposals should target the following dates when planning their calls

June 1, 2025: Release of training, dev and dev-test data, and evaluation
scripts
July 20, 2025: Registration deadline and release of test data
July 25, 2025: End of evaluation cycle (test set submission closes)
July 30, 2025: Final results released
August 15, 2025: System description paper submissions due
August 25, 2025: Notification of acceptance
September 5, 2025: Camera-ready versions due
November 5-9, 2025: Main Conference

For any questions, please contact the Shared Task Chairs:
arabicnlp-shared-task-chair@sigarab.org

Wajdi Zaghouani and Sakhar Alkhereyf
ArabicNLP 2025 Shared Tasks Chairs

----

Wajdi Zaghouani, Ph.D.
Associate Professor,
Communication Program
Northwestern Qatar | Education City
T +974 4454 5232  | M +974 3345 4992

--[2]------------------------------------------------------------------------
        Date: 2025-03-22 10:53:11+00:00
        From: Wajdi Zaghouani <wajdiz@gmail.com>
        Subject: CLEF-2025 CheckThat! Lab -- 3rd Call for Participation

Conference and Labs of the Evaluation Forum (CLEF 2025)

Dear colleague,

We invite you to participate in the 2025 edition of the CheckThat! Lab at
CLEF 2025. This year, we feature four tasks ---one follow-up and three
new--- that correspond to important components within and around the full
fact-checking pipeline in multiple languages:

Task 1 Subjectivity in news articles. to spot text that should be processed
with specific strategies; benefiting the fact-checking pipeline. Available
in Arabic, English, Bulgarian,  German, Italian, and Multilingual.

Task 2 Claim Normalization. to simplify the primary claim made in the
social media post into a concise form. This task is offered in 20
languages: English, Arabic, Bengali, Czech, German, Greek, French, Hindi,
Korean, Marathi, Indonesian, Dutch, Punjabi, Polish, Portuguese, Romanian,
Spanish, Tamil, Telugu, Thai.

Task 3 Fact-Checking Numerical Claims. to verify claims with numerical
quantities and temporal expressions. Available in Arabic, English and
Spanish.

Task 4 Scientific Web Discourse Processing (SciWeb). to (a) classify
different forms of science-related online discourse and (b) retrieve the
scientific paper that serves as the source for the claim from a given pool
of candidate scientific papers. Available in English.


Register and participate:
https://clef2025-labs-registration.dei.unipd.it/registrationForm.php

Further information: https://checkthat.gitlab.io/
Datasets: https://gitlab.com/checkthat_lab/clef2025-checkthat-lab



Important Dates

---------------------

- November 2024: Lab registration opens
- December 2024: Release of the training materials
- 25 April 2025: Lab registration closes
- 30 April 2025: Beginning of the evaluation cycle (test sets release)
- 10 May 2025 (23:59 AOE): End of the evaluation cycle (run submission)
- 30 May 2025: Deadline for the submission of working notes [CEUR-WS]
- 30 May – 27 June 2025: Review process of participant papers
- 9 June 2025: Submission of Condensed Lab Overviews [LNCS]
- 16 June 2025: Notification of Acceptance for Condensed Lab Overviews
[LNCS]
- 23 June 2025: Camera Ready Copy of Condensed Lab Overviews [LNCS] due
- 27 June 2025: Notification of Acceptance for Participant Papers [CEUR-WS]
- 7 July 2025: Camera Ready Copy of Participant Papers and Extended Lab
Overviews [CEUR-WS] due
- 21-25 July 2025: CEUR-WS Working Notes Preview for Checking by Authors
and Lab Organizers
- 9-12 September 2025: CLEF 2025 Conference in Madrid, Spain


Best regards,
The CLEF-2025 CheckThat! Lab Shared Task Organizers

----

Wajdi Zaghouani, Ph.D.
Associate Professor,
Communication Program
Northwestern Qatar | Education City
T +974 4454 5232  | M +974 3345 4992


_______________________________________________
Unsubscribe at: http://dhhumanist.org/Restricted
List posts to: humanist@dhhumanist.org
List info and archives at at: http://dhhumanist.org
Listmember interface at: http://dhhumanist.org/Restricted/
Subscribe at: http://dhhumanist.org/membership_form.php