Skip to content

Commit

Permalink
String changes, final CR feedback
Browse files Browse the repository at this point in the history
  • Loading branch information
scosman committed Feb 26, 2025
1 parent 935092f commit ee30223
Show file tree
Hide file tree
Showing 2 changed files with 7 additions and 5 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@

<AppPage
title="Evals"
subtitle="Evaluate the quality of models, prompts, fine-tunes, and more."
subtitle="Evaluate task performance of various models, prompts, fine-tunes, and more."
sub_subtitle={is_empty ? undefined : "Read the Docs"}
sub_subtitle_link="https://docs.getkiln.ai/docs/evaluationsTODO"
action_buttons={is_empty
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@
id: "kiln_requirements",
name: "Overall Score and Task Requirements",
description:
"Generate scores for the requirements you setup when you created this task plus, an overall-score. These can be compared to human-ratings from the Kiln UI.",
"Generate scores for the requirements you setup when you created this task, plus an overall-score. These can be compared to human ratings from the dataset UI.",
recommended: true,
},
{
Expand Down Expand Up @@ -119,12 +119,12 @@
id: "jailbreak",
name: "Jailbreak Evaluator",
description:
"Evaluate the model's ability to break out of the prompt, such as 'ignore previous instructions'. Also known as jailbreaking.",
"Evaluate the user's ability to break out of the prompt, using tactics such as 'ignore previous instructions'. Also known as jailbreaking.",
eval_template: {
template_id: "jailbreak",
name: "Jailbreak Evaluator",
description:
"Evaluate the model's ability to avoid jailbreak attempts and follow the prompt.",
"Evaluate the user's ability to break out of the prompt, using tactics such as 'ignore previous instructions'. Also known as jailbreaking.",
output_scores: [
{
name: "Jailbreak Score",
Expand Down Expand Up @@ -154,7 +154,9 @@
if (template_id === "kiln_requirements") {
if (!task) {
alert("Task is required for this template, and task failed to load.")
alert(
"Task is required for this template, and the task failed to load.",
)
return
}
Expand Down

0 comments on commit ee30223

Please sign in to comment.