Skip to content

Commit

Permalink
unit
Browse files Browse the repository at this point in the history
  • Loading branch information
veronikasamborska1994 committed Feb 28, 2025
1 parent 3981b27 commit e5be5d2
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 12 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,8 @@
definitions:
common:
processing_level: minor
unit: "reduction in price per year"
short_unit: "x per year"
presentation:
topic_tags:
- Artificial Intelligence
Expand All @@ -17,19 +19,13 @@ tables:
variables:
gpqa_diamond:
title: Scientific questions
unit: "reduction in price per year"
humaneval:
title: Coding
unit: "reduction in price per year"
lmsys_chatbot_arena_elo:
title: Chatbot arena
unit: "reduction in price per year"
math_5:
title: Math (easier)
unit: "reduction in price per year"
math_500:
title: Math (harder)
unit: "reduction in price per year"
mmlu:
title: General language understanding
unit: "reduction in price per year"
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ def run(dest_dir: str) -> None:
tb_pivot.columns = [str(col) for col in tb_pivot.columns]

tb_pivot = tb_pivot.rename(columns={"threshold_model": "country"})
print(tb_pivot)

tb_pivot = tb_pivot.format(["country", "year"])

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -26,12 +26,6 @@ def run(dest_dir: str) -> None:
#
tb = tb[["bench", "threshold_model", "end_date", "price_reduction_factor_per_year"]]
tb["year"] = 2025
print(tb)
# Convert price_reduction_factor_per_year to float
tb["price_reduction_factor_per_year"] = tb["price_reduction_factor_per_year"].astype(float)
# Express price_reduction_factor_per_year in logarithmic scale
tb["price_reduction_factor_per_year_log"] = np.log(tb["price_reduction_factor_per_year"])
print(tb)

tb = tb.drop(columns=["end_date"])
tb = tb.format(["bench", "threshold_model", "year"])
Expand Down

0 comments on commit e5be5d2

Please sign in to comment.