Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

📊 Update social expenditure in the long run dataset #4079

Open
wants to merge 11 commits into
base: master
Choose a base branch
from

Conversation

paarriagadap
Copy link
Contributor

@paarriagadap paarriagadap commented Mar 6, 2025

@owidbot
Copy link
Contributor

owidbot commented Mar 6, 2025

Quick links (staging server):

Site Dev Site Preview Admin Wizard Docs

Login: ssh owid@staging-site-data-social-expenditure-data

chart-diff: ❌
  • 3/4 reviewed charts
  • Modified: 3/3
  • New: 0/1
  • Rejected: 0
  • Data changes: 0
  • Metadata changes: 0
data-diff: ❌ Found differences
= Dataset garden/cdc/latest/measles_cases
  = Table measles_cases
    ~ Column cases (changed metadata)
-       -     date_accessed: '2025-03-07'
        ?                              ^
+       +     date_accessed: '2025-03-06'
        ?                              ^
    ~ Column outbreaks_n (changed metadata)
-       -     date_accessed: '2025-03-07'
        ?                              ^
+       +     date_accessed: '2025-03-06'
        ?                              ^
    ~ Column states_with_cases (changed metadata)
-       -     date_accessed: '2025-03-07'
        ?                              ^
+       +     date_accessed: '2025-03-06'
        ?                              ^
= Dataset garden/health/2025-03-04/diphtheria_deaths
  = Table diphtheria_deaths
    ~ Column death_rate (changed metadata)
-       -       * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1946/compendia/statab/67ed.html)
        ?                                                                                                                                   -
+       +       * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1934/compendia/statab/67ed.html)
        ?                                                                                                                                  +
-       -       * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1947/compendia/statab/68ed.html)
        ?                                                                                                                                  ^^
+       +       * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1935/compendia/statab/68ed.html)
        ?                                                                                                                                  ^^
-       -       * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1948/compendia/statab/69ed.html)
        ?                                                                                                                                  ^^
+       +       * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1936/compendia/statab/69ed.html)
        ?                                                                                                                                  ^^
-       -       * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1949/compendia/statab/70ed.html)
        ?                                                                                                                                  ^^
+       +       * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1938/compendia/statab/70ed.html)
        ?                                                                                                                                  ^^
-       -       * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1950/compendia/statab/71ed.html)
        ?                                                                                                                                  ^^
+       +       * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1939/compendia/statab/71ed.html)
        ?                                                                                                                                  ^^
    ~ Column deaths (changed metadata)
-       -       * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1946/compendia/statab/67ed.html)
        ?                                                                                                                                   -
+       +       * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1934/compendia/statab/67ed.html)
        ?                                                                                                                                  +
-       -       * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1947/compendia/statab/68ed.html)
        ?                                                                                                                                  ^^
+       +       * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1935/compendia/statab/68ed.html)
        ?                                                                                                                                  ^^
-       -       * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1948/compendia/statab/69ed.html)
        ?                                                                                                                                  ^^
+       +       * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1936/compendia/statab/69ed.html)
        ?                                                                                                                                  ^^
-       -       * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1949/compendia/statab/70ed.html)
        ?                                                                                                                                  ^^
+       +       * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1938/compendia/statab/70ed.html)
        ?                                                                                                                                  ^^
-       -       * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1950/compendia/statab/71ed.html)
        ?                                                                                                                                  ^^
+       +       * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1939/compendia/statab/71ed.html)
        ?                                                                                                                                  ^^
= Dataset garden/health/latest/measles_long_run
  = Table measles_long_run
    ~ Column case_rate (changed metadata)
-       -     date_accessed: '2025-03-07'
        ?                              ^
+       +     date_accessed: '2025-03-06'
        ?                              ^
    ~ Column case_rate_static (changed metadata)
-       -     date_accessed: '2025-03-07'
        ?                              ^
+       +     date_accessed: '2025-03-06'
        ?                              ^
    ~ Column cases (changed metadata)
-       -     date_accessed: '2025-03-07'
        ?                              ^
+       +     date_accessed: '2025-03-06'
        ?                              ^
    ~ Column cases_static (changed metadata)
-       -     date_accessed: '2025-03-07'
        ?                              ^
+       +     date_accessed: '2025-03-06'
        ?                              ^
= Dataset garden/health_expenditure/2025-03-04/health_expenditure_omm
  = Table health_expenditure_omm
    ~ Column share_gdp (changed metadata)
-       -       Lindert, P. H. (1994). The Rise of Social Spending, 1880-1930. Explorations in Economic History, 31(1), 1-37. https://doi.org/10.1006/exeh.1994.1001
+       +       Lindert, P. H. (1994). The Rise of Social Spending, 1880-1930. Table 1D. Explorations in Economic History, 31(1), 1-37. https://doi.org/10.1006/exeh.1994.1001
        ?                                                                     ++++++++++
= Dataset garden/health_expenditure/2025-03-04/lindert
  = Table lindert
    ~ Column share_gdp (changed metadata)
-       -       Lindert, P. H. (1994). The Rise of Social Spending, 1880-1930. Explorations in Economic History, 31(1), 1-37. https://doi.org/10.1006/exeh.1994.1001
+       +       Lindert, P. H. (1994). The Rise of Social Spending, 1880-1930. Table 1D. Explorations in Economic History, 31(1), 1-37. https://doi.org/10.1006/exeh.1994.1001
        ?                                                                     ++++++++++
= Dataset garden/oecd/2025-02-25/social_expenditure
  = Table social_expenditure
+   + Column share_gdp
+   + Column share_gov_expenditure
-   - Column share_of_gdp
-   - Column share_of_gov_expenditure
+ Dataset garden/oecd/2025-03-07/social_expenditure_1985
+ + Table social_expenditure_1985
+   + Column share_gdp
+ Dataset garden/social_expenditure/2025-03-07/lindert
+ + Table lindert
+   + Column share_gdp
+ Dataset garden/social_expenditure/2025-03-07/social_expenditure_omm
+ + Table social_expenditure_omm
+   + Column share_gdp
= Dataset garden/space/2025-03-04/near_earth_asteroids
  = Table near_earth_asteroids
~ Dataset garden/us_census_bureau/2025-03-04/diphtheria_deaths
-   -   * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1946/compendia/statab/67ed.html)
    ?                                                                                                                               -
+   +   * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1934/compendia/statab/67ed.html)
    ?                                                                                                                              +
-   -   * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1947/compendia/statab/68ed.html)
    ?                                                                                                                              ^^
+   +   * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1935/compendia/statab/68ed.html)
    ?                                                                                                                              ^^
-   -   * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1948/compendia/statab/69ed.html)
    ?                                                                                                                              ^^
+   +   * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1936/compendia/statab/69ed.html)
    ?                                                                                                                              ^^
-   -   * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1949/compendia/statab/70ed.html)
    ?                                                                                                                              ^^
+   +   * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1938/compendia/statab/70ed.html)
    ?                                                                                                                              ^^
-   -   * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1950/compendia/statab/71ed.html)
    ?                                                                                                                              ^^
+   +   * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1939/compendia/statab/71ed.html)
    ?                                                                                                                              ^^
  ~ Table diphtheria_deaths (changed metadata)
-     -   * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1946/compendia/statab/67ed.html)
      ?                                                                                                                               -
+     +   * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1934/compendia/statab/67ed.html)
      ?                                                                                                                              +
-     -   * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1947/compendia/statab/68ed.html)
      ?                                                                                                                              ^^
+     +   * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1935/compendia/statab/68ed.html)
      ?                                                                                                                              ^^
-     -   * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1948/compendia/statab/69ed.html)
      ?                                                                                                                              ^^
+     +   * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1936/compendia/statab/69ed.html)
      ?                                                                                                                              ^^
-     -   * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1949/compendia/statab/70ed.html)
      ?                                                                                                                              ^^
+     +   * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1938/compendia/statab/70ed.html)
      ?                                                                                                                              ^^
-     -   * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1950/compendia/statab/71ed.html)
      ?                                                                                                                              ^^
+     +   * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1939/compendia/statab/71ed.html)
      ?                                                                                                                              ^^
    ~ Column deaths (changed metadata)
-       -       * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1946/compendia/statab/67ed.html)
        ?                                                                                                                                   -
+       +       * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1934/compendia/statab/67ed.html)
        ?                                                                                                                                  +
-       -       * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1947/compendia/statab/68ed.html)
        ?                                                                                                                                  ^^
+       +       * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1935/compendia/statab/68ed.html)
        ?                                                                                                                                  ^^
-       -       * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1948/compendia/statab/69ed.html)
        ?                                                                                                                                  ^^
+       +       * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1936/compendia/statab/69ed.html)
        ?                                                                                                                                  ^^
-       -       * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1949/compendia/statab/70ed.html)
        ?                                                                                                                                  ^^
+       +       * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1938/compendia/statab/70ed.html)
        ?                                                                                                                                  ^^
-       -       * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1950/compendia/statab/71ed.html)
        ?                                                                                                                                  ^^
+       +       * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1939/compendia/statab/71ed.html)
        ?                                                                                                                                  ^^
    ~ Column source (changed metadata)
-       -       * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1946/compendia/statab/67ed.html)
        ?                                                                                                                                   -
+       +       * 1944: [US Census Bureau “Statistical Abstract of the United States: 1946”](https://www.census.gov/library/publications/1934/compendia/statab/67ed.html)
        ?                                                                                                                                  +
-       -       * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1947/compendia/statab/68ed.html)
        ?                                                                                                                                  ^^
+       +       * 1945: [US Census Bureau “Statistical Abstract of the United States: 1947”](https://www.census.gov/library/publications/1935/compendia/statab/68ed.html)
        ?                                                                                                                                  ^^
-       -       * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1948/compendia/statab/69ed.html)
        ?                                                                                                                                  ^^
+       +       * 1946: [US Census Bureau “Statistical Abstract of the United States: 1948”](https://www.census.gov/library/publications/1936/compendia/statab/69ed.html)
        ?                                                                                                                                  ^^
-       -       * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1949/compendia/statab/70ed.html)
        ?                                                                                                                                  ^^
+       +       * 1947: [US Census Bureau “Statistical Abstract of the United States: 1949”](https://www.census.gov/library/publications/1938/compendia/statab/70ed.html)
        ?                                                                                                                                  ^^
-       -       * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1950/compendia/statab/71ed.html)
        ?                                                                                                                                  ^^
+       +       * 1948: [US Census Bureau “Statistical Abstract of the United States: 1950”](https://www.census.gov/library/publications/1939/compendia/statab/71ed.html)
        ?                                                                                                                                  ^^


Legend: +New  ~Modified  -Removed  =Identical  Details
Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet

Automatically updated datasets matching weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk are not included

Edited: 2025-03-07 16:35:20 UTC
Execution time: 5.34 seconds

@paarriagadap paarriagadap marked this pull request as ready for review March 7, 2025 16:31
@paarriagadap
Copy link
Contributor Author

paarriagadap commented Mar 7, 2025

@spoonerf Hi! This works the same as the health expenditure OMM, that's why I ask you to review again. Most of the code is the same, so feel free to skim. Thanks!

@paarriagadap paarriagadap requested a review from spoonerf March 7, 2025 16:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants