Skip to content

Commit

Permalink
Add competition data, update info.
Browse files Browse the repository at this point in the history
  • Loading branch information
johann-petrak committed Jun 7, 2024
1 parent dbfc863 commit 650f43c
Show file tree
Hide file tree
Showing 5 changed files with 7 additions and 4 deletions.
Binary file added site/data/germeval-competition-test.jsonl.gz
Binary file not shown.
Binary file added site/data/germeval-competition-traindev.jsonl.gz
Binary file not shown.
5 changes: 4 additions & 1 deletion site/download.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,5 +18,8 @@ All files are made available under a [CC BY-NC-SA 4.0 License](https://creativec
* [Testing Data](data/germeval-development-test.jsonl.gz)



## Competition Phase

* [Training Data](data/germeval-competition-traindev.jsonl.gz)
* [Testing Data](data/germeval-competition-test.jsonl.gz)

4 changes: 2 additions & 2 deletions site/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -82,8 +82,8 @@ become available.
* **Competition phase**: June 7 - June 25, 2024
* During this phase, the training data will consist of the training data of the previous phase plus the labeled test data of the previous phase
and a new unlabeled test set is made available. You can upload the labels for
the test set to the competition site and your latest submission will be the one that will be used for ranking. During that phase, the leaderboard is not shown. Please note that only submissions which adhere to all terms and rules are considered for the final ranking.
* A preliminary leaderboard/ranking is shown after the end of the competition phase.
the test set to the competition site and your latest submission will be the one that will be used for ranking. Please note that only submissions which adhere to all terms and rules are considered for the final ranking.
* A preliminary final leaderboard/ranking is shown after the end of the competition phase.
* The final leaderboard/ranking will be available once paper review and final submission is completed, on July 21th 2024.
* **Paper submission due**: July 1, 2024
* **Camera ready due**: July 20, 2024
Expand Down
2 changes: 1 addition & 1 deletion site/terms.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ and the codabench user who made the submission also matches the codabench user n

**Submission of system description papers**: Participants having made at least one submission the Competition Phase will be able to submit a paper describing their system. For the closed track paper submission the open-source code of their solution has to be accessible to the public. We also stronly encourage providing open source solutions for the open track submissions as far as possible.

**Final Competition Ranking**: the final rankings for subtask 1 and subtask 2 are determined after the paper review and camera ready submission have ended.
**Final Competition Ranking**: the final rankings for subtask 1 and subtask 2 are determined after the paper review and camera ready submission have ended. The final ranking may deviate from what is shown on the leaderboard if participants did not adhere to the rules or if the algorithm for scoring submissions had to be updated.
Only submissions for which a paper describing the solution has been submitted and an open source solution is available will be considered in the ranking.

**Acknowledgements**: This shared task was created by OFAI with funding from the FFG project EKIP.

0 comments on commit 650f43c

Please sign in to comment.