Skip to content

Commit

Permalink
Update sharedtasks.html
Browse files Browse the repository at this point in the history
  • Loading branch information
dli1 authored Feb 18, 2025
1 parent 7f4ca61 commit 5436437
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion 2025/sharedtasks.html
Original file line number Diff line number Diff line change
Expand Up @@ -221,7 +221,10 @@ <h2 id="scihal25">SciHal2025: Hallucination Detection for Scientific Content </h
<p>
This shared task invites participants to develop and evaluate systems that detect hallucinations in automatically generated scientific answers. The dataset comprises research-oriented questions sourced from subject matter experts, along with corresponding answers and references. These answers are produced by various well-performing retrieval-augmented generation (RAG) systems indexing approximately millions of published academic abstracts. Each answer is annotated to indicate whether it includes unsupported claims that are not grounded in the provided references. Two levels of labeling will be provided: a three-class scheme (entailment, neutral, contradiction) and a more detailed scheme encompassing 10+ fine-grained categories (to be specified later). Teams are challenged to classify claims into the appropriate categories, with evaluation metrics focusing on the precision and recall of detecting unsupported claims.
</p>


<p>
More information is available on <a href=scihal.html>the shared task page</a>.
</p>

<h3>Organizers</h3>

Expand Down

0 comments on commit 5436437

Please sign in to comment.