Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Privacy Sql Tracking Detection Using Easylist Adservers #3730

Merged
merged 41 commits into from
Aug 16, 2024
Merged

Privacy Sql Tracking Detection Using Easylist Adservers #3730

merged 41 commits into from
Aug 16, 2024

Conversation

hadiamjad
Copy link
Contributor

New queries added for this year's chapter

  • easylist_tracker_detection.sql

New util added for this year's chapter

  • populate_easylist_adserver.py

tunetheweb and others added 30 commits June 10, 2024 16:03
@tunetheweb
Add GA4 fields to match documentation (#3679)
1fcf6a5 
* Add standard GA4 web-vital fields

* Add value
@github-actions @tunetheweb
Update Timestamps (#3680)
523ae0d 
Co-authored-by: tunetheweb <[email protected]>
@dependabot
Bump web-vitals from 4.1.0 to 4.1.1 in /src (#3681)
312ef27 
Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.1.0 to 4.1.1.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.1.0...v4.1.1)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump puppeteer from 22.10.0 to 22.10.1 in /src (#3682)
d215f0a 
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.10.0 to 22.10.1.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.10.0...puppeteer-v22.10.1)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump prettier from 3.3.1 to 3.3.2 in /src (#3683)
0cdf408 
Bumps [prettier](https://github.com/prettier/prettier) from 3.3.1 to 3.3.2.
- [Release notes](https://github.com/prettier/prettier/releases)
- [Changelog](https://github.com/prettier/prettier/blob/main/CHANGELOG.md)
- [Commits](prettier/prettier@3.3.1...3.3.2)

---
updated-dependencies:
- dependency-name: prettier
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump puppeteer from 22.10.1 to 22.11.0 in /src (#3684)
5e008a6 
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.10.1 to 22.11.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.10.1...puppeteer-v22.11.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@ksakae1216
Translation of security chapter to Japanese (#3685)
91a5fb9
@dependabot
Bump puppeteer from 22.11.0 to 22.11.2 in /src (#3688)
a610110 
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.11.0 to 22.11.2.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.11.0...puppeteer-v22.11.2)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump web-vitals from 4.1.1 to 4.2.0 in /src (#3690)
7a71ed2 
Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.1.1 to 4.2.0.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.1.1...v4.2.0)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump puppeteer from 22.11.2 to 22.12.0 in /src (#3689)
0974d6b 
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.11.2 to 22.12.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.11.2...puppeteer-v22.12.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@github-actions @tunetheweb
Update Timestamps (#3691)
1a8586a 
Co-authored-by: tunetheweb <[email protected]>
@tunetheweb
Remove deploy.zip step of deployment (#3692)
5107c81 
* Remove deploy.zip

* Remove from ignore files
@dependabot
Bump puppeteer from 22.12.0 to 22.12.1 in /src (#3694)
795caeb 
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.12.0 to 22.12.1.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.12.0...puppeteer-v22.12.1)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot @tunetheweb
Bump treosh/lighthouse-ci-action from 11.4.0 to 12.1.0 (#3693)
4219fbc 
* Bump treosh/lighthouse-ci-action from 11.4.0 to 12.1.0

Bumps [treosh/lighthouse-ci-action](https://github.com/treosh/lighthouse-ci-action) from 11.4.0 to 12.1.0.
- [Release notes](https://github.com/treosh/lighthouse-ci-action/releases)
- [Commits](treosh/lighthouse-ci-action@11.4.0...12.1.0)

---
updated-dependencies:
- dependency-name: treosh/lighthouse-ci-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* Upgrade to Node 20

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Barry Pollard <[email protected]>
@dependabot
Bump web-vitals from 4.2.0 to 4.2.1 in /src (#3695)
28488e8 
Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.2.0 to 4.2.1.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.2.0...v4.2.1)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump actions/setup-python from 5.1.0 to 5.1.1 (#3699)
2fb6060 
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 5.1.0 to 5.1.1.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](actions/setup-python@v5.1.0...v5.1.1)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump puppeteer from 22.12.1 to 22.13.0 in /src (#3698)
dd0fafc 
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.12.1 to 22.13.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.12.1...puppeteer-v22.13.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@ksakae1216
Translation of mobile-web chapter to Japanese (#3700)
e0c67bd
@dependabot
Bump puppeteer from 22.13.0 to 22.15.0 in /src (#3711)
61b52d5 
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.13.0 to 22.15.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.13.0...puppeteer-v22.15.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump jsdom from 24.1.0 to 24.1.1 in /src (#3707)
eeb98b2 
Bumps [jsdom](https://github.com/jsdom/jsdom) from 24.1.0 to 24.1.1.
- [Release notes](https://github.com/jsdom/jsdom/releases)
- [Changelog](https://github.com/jsdom/jsdom/blob/main/Changelog.md)
- [Commits](jsdom/jsdom@24.1.0...24.1.1)

---
updated-dependencies:
- dependency-name: jsdom
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump web-vitals from 4.2.1 to 4.2.2 in /src (#3706)
43a2ac9 
Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.2.1 to 4.2.2.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.2.1...v4.2.2)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump prettier from 3.3.2 to 3.3.3 in /src (#3702)
48d86da 
Bumps [prettier](https://github.com/prettier/prettier) from 3.3.2 to 3.3.3.
- [Release notes](https://github.com/prettier/prettier/releases)
- [Changelog](https://github.com/prettier/prettier/blob/main/CHANGELOG.md)
- [Commits](prettier/prettier@3.3.2...3.3.3)

---
updated-dependencies:
- dependency-name: prettier
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump web-vitals from 4.2.2 to 4.2.3 in /src (#3715)
0b4e6ff 
Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.2.2 to 4.2.3.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.2.2...v4.2.3)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@github-actions @rviscomi
Update Timestamps (#3716)
90e7e8a 
Co-authored-by: rviscomi <[email protected]>
tracking detection using easylist adservers
b637da1
easylist_adserver tracking detection and query
f7b1283
@HakaCode
2022 cdn portuguese (#3725)
f428a3e 
* add file to translation

* done translation cdn.md

Makes progress on #505
@dependabot
Bump puppeteer from 22.15.0 to 23.0.2 in /src (#3719)
2c361dd 
Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.15.0 to 23.0.2.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.15.0...puppeteer-v23.0.2)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@github-actions @tunetheweb
Update Timestamps (#3726)
74330d7 
Co-authored-by: tunetheweb <[email protected]>
@tunetheweb
Replace <object> with <iframe> for embedded SVG (#3727)
5b7997e 
* Replace object with iframe for embedded SVG

* Translations
tunetheweb and others added 2 commits August 14, 2024 15:50
@tunetheweb
Fix the build to ignore 2024 chapters (for now) (#3728)
da71b3e 
* Fix the build to ignore 2024 chapters (for now)

* Remove test line
@github-actions @tunetheweb
Update Timestamps (#3729)
6e01d17 
Co-authored-by: tunetheweb <[email protected]>
github-advanced-security[bot]
github-advanced-security bot found potential problems Aug 14, 2024
View reviewed changes
sql/util/populate_easylist_adserver.py Outdated
import requests
import pandas as pd
from google.cloud import bigquery
import os

Check notice

Code scanning / CodeQL

Unused import Note

Import of 'os' is not used.
@max-ostapenko
Copy link
Contributor

Before pushing the changes, you can lint the code in your branch:

python3 -m venv src/.venv
source src/.venv/bin/activate
pip install -r src/requirements.txt
sqlfluff fix sql/2024/privacy/

@max-ostapenko max-ostapenko mentioned this pull request Aug 14, 2024
Merged
40 tasks
@max-ostapenko max-ostapenko changed the base branch from main to privacy-sql-2024 August 15, 2024 09:14
@max-ostapenko
Copy link
Contributor

@hadiamjad FYI I pointed this PR base to the Privacy chapter PR, so that we can merge all chapter in one step eventually.
Looking forward to your linting adjustments to merge this.

@HTTPArchive HTTPArchive deleted a comment from github-actions bot Aug 15, 2024
@HTTPArchive HTTPArchive deleted a comment from github-actions bot Aug 15, 2024
@HTTPArchive HTTPArchive deleted a comment from github-actions bot Aug 15, 2024
@HTTPArchive HTTPArchive deleted a comment from github-actions bot Aug 15, 2024
@HTTPArchive HTTPArchive deleted a comment from github-actions bot Aug 15, 2024
@HTTPArchive HTTPArchive deleted a comment from github-actions bot Aug 15, 2024
@tunetheweb
Copy link
Member

@hadiamjad FYI I pointed this PR base to the Privacy chapter PR, so that we can merge all chapter in one step eventually. Looking forward to your linting adjustments to merge this.

@max-ostapenko you might wanna update the Privacy chapter PR to latest version of main to hide the irrelevant changes in this PR (and stop those annoying diff comments being added to this PR, which happens when it thinks you're changing certain things).

@max-ostapenko
Copy link
Contributor

@max-ostapenko you might wanna update the Privacy chapter PR to latest version of main to hide the irrelevant changes in this PR (and stop those annoying diff comments being added to this PR, which happens when it thinks you're changing certain things).

@tunetheweb would you suggest to do it with merge commit or rebase to make it clean?

@tunetheweb
Copy link
Member

I think a merge commit on the privacy-sql-2024 branch will be fine. I hate rebasing :-)

@max-ostapenko
Copy link
Contributor

I think a merge commit on the privacy-sql-2024 branch will be fine. I hate rebasing :-)

I merged main into Privacy PR and then also here - the diff was only growing 🤔
Seems I still need to learn about git behavior :)

@max-ostapenko max-ostapenko merged commit baf490d into privacy-sql-2024 Aug 16, 2024
9 checks passed
@max-ostapenko max-ostapenko deleted the privacy-sql-tracking-detection-easylist branch August 16, 2024 21:49
max-ostapenko added a commit that referenced this pull request Nov 3, 2024
@max-ostapenko @dependabot
@ksakae1216 @github-actions @tunetheweb @rviscomi @borisschapira @ChrisBeeti @Yash-Vekaria @bstandaert-wustl @hadiamjad @HakaCode @Zuckjet
Privacy 2024 queries (#3653)
324d22b 
* readme

* copied 2022 SQLs over to update/review

* fixed link

* origin trials

* Bump puppeteer from 22.7.1 to 22.8.0 in /src (#3655)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.7.1 to 22.8.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.7.1...puppeteer-v22.8.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* notebook + readme (#3652)

* Bump pytest from 8.1.1 to 8.2.0 in /src (#3651)

Bumps [pytest](https://github.com/pytest-dev/pytest) from 8.1.1 to 8.2.0.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](pytest-dev/pytest@8.1.1...8.2.0)

---
updated-dependencies:
- dependency-name: pytest
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Translation of privacy chapter to Japanese (#3654)

* Update Timestamps (#3657)

Co-authored-by: tunetheweb <[email protected]>

* 2023 Performance (#3525)

* cp 2022->2023

* 2023ify

* 2023/perf

* lint

* lint

* fix initiator

* null initiators

* Bump puppeteer from 22.8.0 to 22.9.0 in /src (#3662)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.8.0 to 22.9.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.8.0...puppeteer-v22.9.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Upgrade to web-vitals v4 (#3661)

* Upgrade to web-vitals v4

* Update src/static/js/send-web-vitals.js

Co-authored-by: Barry Pollard <[email protected]>

---------

Co-authored-by: Barry Pollard <[email protected]>

* Bump pytest from 8.2.0 to 8.2.1 in /src (#3664)

Bumps [pytest](https://github.com/pytest-dev/pytest) from 8.2.0 to 8.2.1.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](pytest-dev/pytest@8.2.0...8.2.1)

---
updated-dependencies:
- dependency-name: pytest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* --- (#3665)

updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump puppeteer from 22.9.0 to 22.10.0 in /src (#3668)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.9.0 to 22.10.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.9.0...puppeteer-v22.10.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump jsdom from 24.0.0 to 24.1.0 in /src (#3669)

Bumps [jsdom](https://github.com/jsdom/jsdom) from 24.0.0 to 24.1.0.
- [Release notes](https://github.com/jsdom/jsdom/releases)
- [Changelog](https://github.com/jsdom/jsdom/blob/main/Changelog.md)
- [Commits](jsdom/jsdom@24.0.0...24.1.0)

---
updated-dependencies:
- dependency-name: jsdom
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Typofix (#3670)

Seems like "desktop" is mentioned twice and according to the data, the second mention is related to mobile https://docs.google.com/spreadsheets/d/1JvJMiRsL6T9m_NEBHFh-rrQmU5a-ufdOKriSJbrEN8M/edit#gid=1472139207

* SQL and MD folders the 2024 Web Almanac (#3666)

* upload 2024

* change mds

* Test update

* Revert test update

* Fix line endings

---------

Co-authored-by: Barry Pollard <[email protected]>

* Bump prettier from 3.2.5 to 3.3.0 in /src (#3672)

Bumps [prettier](https://github.com/prettier/prettier) from 3.2.5 to 3.3.0.
- [Release notes](https://github.com/prettier/prettier/releases)
- [Changelog](https://github.com/prettier/prettier/blob/main/CHANGELOG.md)
- [Commits](prettier/prettier@3.2.5...3.3.0)

---
updated-dependencies:
- dependency-name: prettier
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump pytest from 8.2.1 to 8.2.2 in /src (#3673)

Bumps [pytest](https://github.com/pytest-dev/pytest) from 8.2.1 to 8.2.2.
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](pytest-dev/pytest@8.2.1...8.2.2)

---
updated-dependencies:
- dependency-name: pytest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump prettier from 3.3.0 to 3.3.1 in /src (#3674)

Bumps [prettier](https://github.com/prettier/prettier) from 3.3.0 to 3.3.1.
- [Release notes](https://github.com/prettier/prettier/releases)
- [Changelog](https://github.com/prettier/prettier/blob/main/CHANGELOG.md)
- [Commits](prettier/prettier@3.3.0...3.3.1)

---
updated-dependencies:
- dependency-name: prettier
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Fix loaf monitoring bug (#3675)

* Fix LoAF monitoring bug

* Add semi colon

* Update Timestamps (#3677)

Co-authored-by: tunetheweb <[email protected]>

* Bump web-vitals from 4.0.1 to 4.1.0 in /src (#3678)

Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.0.1 to 4.1.0.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.0.1...v4.1.0)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* fixed link

* remove unreviewed sql

* lint test

* lint

* ads supply graph

* lint

* close file

* lint

* top_direct_sellers

* ads_txt_lines_histogram

* ads_txt_seller_accounts_by_type

* top_ads_variables

* format

* tcf2

* rename

* lint

* using custom_metrics

* most_common_cname_domains

* adguard list

* gpc

* referrer policy

* usp

* iab frameworks

* lint

* bounce trackers

* Added privacy sandbox related queries

* lint

* missed lint

* dnt

* client hints

* whotracksme update

* lint

* referrer policy

* rank filter removed

* trackers

* util deps

* limits

* Privacy 2024 queries - CCPA, fingerprinting, cookies (#3720)

* CCPA metrics

* fingerprinting metrics

* cookie metrics

* lint

* bq to sheets updates

* query optimisation

* downgrade for python 3.8

* more categories

* more categories and columns reordered

* forms and formatted logs

* Refactoring queries to produce output for queries only

* lint

* lint

* Privacy Sql Tracking Detection Using Easylist Adservers (#3730)

* Add GA4 fields to match documentation (#3679)

* Add standard GA4 web-vital fields

* Add value

* Update Timestamps (#3680)

Co-authored-by: tunetheweb <[email protected]>

* Bump web-vitals from 4.1.0 to 4.1.1 in /src (#3681)

Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.1.0 to 4.1.1.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.1.0...v4.1.1)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump puppeteer from 22.10.0 to 22.10.1 in /src (#3682)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.10.0 to 22.10.1.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.10.0...puppeteer-v22.10.1)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump prettier from 3.3.1 to 3.3.2 in /src (#3683)

Bumps [prettier](https://github.com/prettier/prettier) from 3.3.1 to 3.3.2.
- [Release notes](https://github.com/prettier/prettier/releases)
- [Changelog](https://github.com/prettier/prettier/blob/main/CHANGELOG.md)
- [Commits](prettier/prettier@3.3.1...3.3.2)

---
updated-dependencies:
- dependency-name: prettier
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump puppeteer from 22.10.1 to 22.11.0 in /src (#3684)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.10.1 to 22.11.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.10.1...puppeteer-v22.11.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Translation of security chapter to Japanese (#3685)

* Bump puppeteer from 22.11.0 to 22.11.2 in /src (#3688)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.11.0 to 22.11.2.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.11.0...puppeteer-v22.11.2)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump web-vitals from 4.1.1 to 4.2.0 in /src (#3690)

Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.1.1 to 4.2.0.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.1.1...v4.2.0)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump puppeteer from 22.11.2 to 22.12.0 in /src (#3689)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.11.2 to 22.12.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.11.2...puppeteer-v22.12.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Update Timestamps (#3691)

Co-authored-by: tunetheweb <[email protected]>

* Remove deploy.zip step of deployment (#3692)

* Remove deploy.zip

* Remove from ignore files

* Bump puppeteer from 22.12.0 to 22.12.1 in /src (#3694)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.12.0 to 22.12.1.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.12.0...puppeteer-v22.12.1)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump treosh/lighthouse-ci-action from 11.4.0 to 12.1.0 (#3693)

* Bump treosh/lighthouse-ci-action from 11.4.0 to 12.1.0

Bumps [treosh/lighthouse-ci-action](https://github.com/treosh/lighthouse-ci-action) from 11.4.0 to 12.1.0.
- [Release notes](https://github.com/treosh/lighthouse-ci-action/releases)
- [Commits](treosh/lighthouse-ci-action@11.4.0...12.1.0)

---
updated-dependencies:
- dependency-name: treosh/lighthouse-ci-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* Upgrade to Node 20

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Barry Pollard <[email protected]>

* Bump web-vitals from 4.2.0 to 4.2.1 in /src (#3695)

Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.2.0 to 4.2.1.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.2.0...v4.2.1)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump actions/setup-python from 5.1.0 to 5.1.1 (#3699)

Bumps [actions/setup-python](https://github.com/actions/setup-python) from 5.1.0 to 5.1.1.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](actions/setup-python@v5.1.0...v5.1.1)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump puppeteer from 22.12.1 to 22.13.0 in /src (#3698)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.12.1 to 22.13.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.12.1...puppeteer-v22.13.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Translation of mobile-web chapter to Japanese (#3700)

* Bump puppeteer from 22.13.0 to 22.15.0 in /src (#3711)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.13.0 to 22.15.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.13.0...puppeteer-v22.15.0)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump jsdom from 24.1.0 to 24.1.1 in /src (#3707)

Bumps [jsdom](https://github.com/jsdom/jsdom) from 24.1.0 to 24.1.1.
- [Release notes](https://github.com/jsdom/jsdom/releases)
- [Changelog](https://github.com/jsdom/jsdom/blob/main/Changelog.md)
- [Commits](jsdom/jsdom@24.1.0...24.1.1)

---
updated-dependencies:
- dependency-name: jsdom
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump web-vitals from 4.2.1 to 4.2.2 in /src (#3706)

Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.2.1 to 4.2.2.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.2.1...v4.2.2)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump prettier from 3.3.2 to 3.3.3 in /src (#3702)

Bumps [prettier](https://github.com/prettier/prettier) from 3.3.2 to 3.3.3.
- [Release notes](https://github.com/prettier/prettier/releases)
- [Changelog](https://github.com/prettier/prettier/blob/main/CHANGELOG.md)
- [Commits](prettier/prettier@3.3.2...3.3.3)

---
updated-dependencies:
- dependency-name: prettier
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump web-vitals from 4.2.2 to 4.2.3 in /src (#3715)

Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 4.2.2 to 4.2.3.
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v4.2.2...v4.2.3)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Update Timestamps (#3716)

Co-authored-by: rviscomi <[email protected]>

* tracking detection using easylist adservers

* easylist_adserver tracking detection and query

* 2022 cdn portuguese (#3725)

* add file to translation

* done translation cdn.md

Makes progress on #505

* Bump puppeteer from 22.15.0 to 23.0.2 in /src (#3719)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 22.15.0 to 23.0.2.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v22.15.0...puppeteer-v23.0.2)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Update Timestamps (#3726)

Co-authored-by: tunetheweb <[email protected]>

* Replace `<object>` with `<iframe>` for embedded SVG (#3727)

* Replace object with iframe for embedded SVG

* Translations

* auto upload easylist data to table

* Fix the build to ignore 2024 chapters (for now) (#3728)

* Fix the build to ignore 2024 chapters (for now)

* Remove test line

* Update Timestamps (#3729)

Co-authored-by: tunetheweb <[email protected]>

* liniting

* liniting

* linting

* linting

* linting

* linting

* fixes of Simplified Chinese translation for 2020 Performance (#3734)

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: Barry Pollard <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: tunetheweb <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sakae Kotaro <[email protected]>
Co-authored-by: rviscomi <[email protected]>
Co-authored-by: Hadi Amjad <[email protected]>
Co-authored-by: William Constantinov <[email protected]>
Co-authored-by: Zuckjet <[email protected]>
Co-authored-by: Max Ostapenko <[email protected]>

* log query errors

* Fixed privacy sandbox attestation query bug

* maximum_bytes_billed parameter

* moved to chapter root

* postpone dryrun check

* fingerprinting_most_common_apis: improve resilience to malformed JSON (#3737)

* optional maximum_bytes_billed parameter

* formatting

* queries and notebook updates

* queries to rerun

* origin trials function fix

* optimised sellers count

* apps included in ads.txt lines

* another rerun

* lint

* no origins

* optimized perf

* more optimized perf

* graph optimization and OT expiration

* earlier grouping for performance

* graph fixes

* cookies, ccpa, fingerprinting: calculate percent of total pages

* query for top third-party cookie names

* bq writer module

* add grouping

* domain suffixes and regexes removed

* add comments

* review

* add PR link

* lint

* remove mobile filter

* lint

* lint

* disable import-error rule

* adguard not used

* linting

* pages_pct in query

* lint

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sakae Kotaro <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: tunetheweb <[email protected]>
Co-authored-by: Rick Viscomi <[email protected]>
Co-authored-by: Barry Pollard <[email protected]>
Co-authored-by: Boris Schapira <[email protected]>
Co-authored-by: ChrisBeeti <[email protected]>
Co-authored-by: Yash Vekaria <[email protected]>
Co-authored-by: Ben Standaert <[email protected]>
Co-authored-by: Hadi Amjad <[email protected]>
Co-authored-by: rviscomi <[email protected]>
Co-authored-by: Hadi Amjad <[email protected]>
Co-authored-by: William Constantinov <[email protected]>
Co-authored-by: Zuckjet <[email protected]>
Co-authored-by: bstandaert-wustl <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@max-ostapenko max-ostapenko max-ostapenko approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@hadiamjad @max-ostapenko @tunetheweb @ksakae1216 @HakaCode @Zuckjet