Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

📊 Update OECD ODA snapshots #4028

Merged
merged 5 commits into from
Feb 25, 2025
Merged

📊 Update OECD ODA snapshots #4028

merged 5 commits into from
Feb 25, 2025

Conversation

paarriagadap
Copy link
Contributor

@paarriagadap paarriagadap commented Feb 25, 2025

Update snapshots for the ODA data from OECD. There was an error in DAC2a, but it seems that they updated all the other files as well.

@owidbot
Copy link
Contributor

owidbot commented Feb 25, 2025

Quick links (staging server):

Site Dev Site Preview Admin Wizard Docs

Login: ssh owid@staging-site-data-dac2a-oda-update

chart-diff: ✅
  • 1/1 reviewed charts
  • Modified: 1/1
  • New: 0/0
  • Rejected: 0
  • Data changes: 1
  • Metadata changes: 1
data-diff:
2025-02-25 16:10:34 [error    ] Traceback (most recent call last):

  File "/home/owid/etl/etl/datadiff.py", line 446, in cli
    lines = future.result()

  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 458, in result
    return self.__get_result()

  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
    raise self._exception

  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)

  File "/home/owid/etl/etl/datadiff.py", line 439, in func
    differ.summary()

  File "/home/owid/etl/etl/datadiff.py", line 265, in summary
    self._diff_tables(self.ds_a, self.ds_b, table_name)

  File "/home/owid/etl/etl/datadiff.py", line 248, in _diff_tables
    out = _data_diff(

  File "/home/owid/etl/etl/datadiff.py", line 597, in _data_diff
    both = samp_a.merge(samp_b, on=dims, suffixes=(" -", " +"))

  File "/home/owid/etl/lib/catalog/owid/catalog/tables.py", line 710, in merge
    return merge(left=self, right=right, *args, **kwargs)

  File "/home/owid/etl/lib/catalog/owid/catalog/tables.py", line 1435, in merge
    tb[new_column].metadata = variables.combine_variables_metadata([left[column]], operation="merge", name=column)

  File "/home/owid/etl/lib/catalog/owid/catalog/variables.py", line 555, in combine_variables_metadata
    metadata.processing_level = combine_variables_processing_level(variables=variables_only)

  File "/home/owid/etl/lib/catalog/owid/catalog/variables.py", line 499, in combine_variables_processing_level
    assert len(unknown_processing_levels) == 0, f"Unknown processing levels: {unknown_processing_levels}"

AssertionError: Unknown processing levels: {'<% if sector == "Non-humanitarian aid" %>\nmajor\n<% else %>\nminor\n<%- endif -%>'}


⚠ Found errors, create an issue please

Legend: +New  ~Modified  -Removed  =Identical  Details
Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2025-02-25 16:15:18 UTC
Execution time: 5.66 seconds

@paarriagadap paarriagadap changed the title 📊 Update DAC2a from ODA 📊 Update OECD ODA snapshots Feb 25, 2025
@paarriagadap paarriagadap marked this pull request as ready for review February 25, 2025 16:09
@paarriagadap paarriagadap merged commit 2baa7c8 into master Feb 25, 2025
8 checks passed
@paarriagadap paarriagadap deleted the data-dac2a-oda-update branch February 25, 2025 16:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants