Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to latest #4

Open
wants to merge 55 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
55 commits
Select commit Hold shift + click to select a range
155e40d
Ensure callback map is rebuilt after reply_to topics are created (#510)
richardhundt Jun 14, 2023
0531715
Fix set operations in `ChangeloggedSet` (#521)
richardhundt Jun 22, 2023
ada6429
Implement OAuthbearer auth mechanism (#525)
cbcoutinho Jun 25, 2023
f79cc16
Fix for current_event not in context during periodic flush (#522)
richardhundt Jun 26, 2023
600d0ae
Update CI/CD workflows, setup config files, and build wheels for Pyth…
wbarnha Jun 26, 2023
7eea54a
Enable PyPy testing (#530)
wbarnha Jun 29, 2023
236516d
Topic: Remove topic with active_partitions from Conductor after (#531)
ostetsenko Jun 30, 2023
ddf27f5
Bump actions/upload-pages-artifact from 1 to 2 (#533)
dependabot[bot] Jul 11, 2023
4a23420
Use rocksdict version >= v0.3.11 (#538)
GodTamIt Jul 27, 2023
87a80a9
Update python-package.yml to test for Python 3.12 (#540)
wbarnha Aug 9, 2023
b5db8a0
fix: ensure aiokafka commit is called with kafka.structs.TopicPartiti…
dada-engineer Aug 14, 2023
e900e54
Bump actions/checkout from 3 to 4 (#546)
dependabot[bot] Sep 5, 2023
648d506
Bump codecov/codecov-action from 3 to 4 (#547)
dependabot[bot] Sep 14, 2023
da90c7c
Revert to codecov/codecov-action@v3 in python-package.yml
wbarnha Sep 29, 2023
3fb3180
Add Python ~3.13 for testing in python-package.yml (#561)
wbarnha Nov 5, 2023
5e3cecc
Bump venusian from 3.0.0 to 3.1.0 in /requirements (#562)
dependabot[bot] Nov 7, 2023
ccc062f
Add a TTL for RocksDB store for removing outdated WAL files (#567)
YiuRULE Nov 16, 2023
e31974f
fix: docs Autodetect for schemas (#563)
IbrahimBagalwa Nov 20, 2023
448a7a4
Fix potential NoneType access in aiokafka driver (#569)
GodTamIt Nov 21, 2023
c629e72
Temporarily fix breaking build with setuptools v69 (#571)
somnam Nov 21, 2023
ad8dd0e
Fix AccessType assigninment in rocksdb.py (#575)
wbarnha Nov 27, 2023
58b18a1
Fix races in conductor with dynamic agents (#568)
GodTamIt Nov 27, 2023
ddef30e
Consolidate dynamic attributes for setuptools v69.0.0 and move some m…
wbarnha Nov 27, 2023
2eba690
Fix sdist builds (#577)
wbarnha Nov 29, 2023
6714156
Add project.scripts to fix faust CLI usage (#580)
wbarnha Nov 29, 2023
310eb66
Add description field to pyproject.toml
wbarnha Nov 29, 2023
223b114
Add FastAPI example (#581)
wbarnha Nov 30, 2023
2f59442
Bump actions/deploy-pages from 2 to 3 (#582)
dependabot[bot] Dec 5, 2023
8a5576e
Rename kafka to aiokafka (#565)
AntonOfTheWoods Dec 5, 2023
73be0a2
Lint aiokafka driver
wbarnha Dec 7, 2023
53dfd18
Replace called_once_with test_objects.py for 3.12 support (#586)
wbarnha Dec 8, 2023
3554266
Add official support for Python 3.12 (#587)
wbarnha Dec 9, 2023
1f68fa2
Update aiokafka requirement from <0.9.0,>=0.8.0 to >=0.8.0,<0.10.0 in…
dependabot[bot] Dec 9, 2023
a0de373
Bump actions/setup-python from 4 to 5 (#585)
dependabot[bot] Dec 9, 2023
df20a17
Bump github/codeql-action from 2 to 3 (#588)
dependabot[bot] Dec 14, 2023
0628117
Bump actions/download-artifact from 3 to 4 (#589)
dependabot[bot] Dec 14, 2023
73fe3e1
Bump actions/upload-artifact from 3 to 4 (#590)
dependabot[bot] Dec 14, 2023
66fd6ba
Bump actions/deploy-pages from 3 to 4 (#592)
dependabot[bot] Dec 19, 2023
3812158
Bump actions/upload-pages-artifact from 2 to 3 (#593)
dependabot[bot] Dec 19, 2023
6588a97
Add example for medium/large projects in FastAPI (#595)
hgalytoby Dec 28, 2023
1f1f759
Use `loop.create_task()` for agent tasks (#598)
samtx Jan 3, 2024
e91c55f
Revert to upload-artifact v3 in python-package.yml
wbarnha Jan 3, 2024
4a09533
enable kafka static-partition-assignment (KIP-345) (#600)
Mopsgeschwindigkeit Jan 11, 2024
6d248bf
Run black and fix setup.cfg to add E701 and E704 to flake8 ignore (#609)
Tim-Thomas Feb 16, 2024
ebf66ae
bugfix: Fix cython stream_event_in to match python impl (#608)
Tim-Thomas Feb 16, 2024
5330c45
fix: serialize (named)tuple when using orjson (#612)
zevisert Mar 1, 2024
34ae8ec
Fix prometheus registry (#613)
krzysieksulejczak Mar 4, 2024
11505bc
Rollback upload and download artifacts to v3 in python-package.yml
wbarnha Mar 17, 2024
ed85356
Fix imports from updates in mode-streaming~=0.4.0 (#618)
wbarnha Mar 29, 2024
adcbc81
Pull in hopping window table fix (#412)
wbarnha Mar 30, 2024
3d737c7
remove humanization conversion
wbarnha Apr 1, 2024
13e7ef1
Fix disabled aiokafka unit tests (#610)
wbarnha Apr 1, 2024
2c4c8bb
Pin pytest<8 to fix Python 3.11 tests (#619)
wbarnha Apr 1, 2024
a489db3
Skip some PyPy tests and revert breaking poll_at timestamp change (#621)
wbarnha Apr 2, 2024
e5f44dd
Merge branch 'master' into update-to-latest
owen-zora Apr 3, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 16 additions & 20 deletions .github/workflows/codeql-analysis.yml
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
---
# For most projects, this workflow file will not need changing; you simply need
# to commit it to your repository.
#
Expand All @@ -9,17 +10,15 @@
# the `language` matrix defined below to confirm you have the correct set of
# supported CodeQL languages.
#
name: "CodeQL"

name: CodeQL
on:
push:
branches: [ master ]
branches: [master]
pull_request:
# The branches below must be a subset of the branches above
branches: [ master ]
branches: [master]
schedule:
- cron: '19 10 * * 6'

- cron: 19 10 * * 6
jobs:
analyze:
name: Analyze
Expand All @@ -28,33 +27,31 @@ jobs:
actions: read
contents: read
security-events: write

strategy:
fail-fast: false
matrix:
language: [ 'python' ]
language: [python]
# CodeQL supports [ 'cpp', 'csharp', 'go', 'java', 'javascript', 'python' ]
# Learn more:
# https://docs.github.com/en/free-pro-team@latest/github/finding-security-vulnerabilities-and-errors-in-your-code/configuring-code-scanning#changing-the-languages-that-are-analyzed

steps:
- name: Checkout repository
uses: actions/checkout@v3
- name: Checkout repository
uses: actions/checkout@v4

# Initializes the CodeQL tools for scanning.
- name: Initialize CodeQL
uses: github/codeql-action/init@v2
with:
languages: ${{ matrix.language }}
- name: Initialize CodeQL
uses: github/codeql-action/init@v3
with:
languages: ${{ matrix.language }}
# If you wish to specify custom queries, you can do so here or in a config file.
# By default, queries listed here will override any specified in a config file.
# Prefix the list here with "+" to use these queries and those in the config file.
# queries: ./path/to/local/query, your-org/your-repo/queries@main

# Autobuild attempts to build any compiled languages (C/C++, C#, or Java).
# If this step fails, then you should remove it and run the build manually (see below)
- name: Autobuild
uses: github/codeql-action/autobuild@v2
- name: Autobuild
uses: github/codeql-action/autobuild@v3

# ℹ️ Command-line programs to run using the OS shell.
# 📚 https://git.io/JvXDl
Expand All @@ -66,6 +63,5 @@ jobs:
#- run: |
# make bootstrap
# make release

- name: Perform CodeQL Analysis
uses: github/codeql-action/analyze@v2
- name: Perform CodeQL Analysis
uses: github/codeql-action/analyze@v3
73 changes: 0 additions & 73 deletions .github/workflows/dist.yml

This file was deleted.

50 changes: 25 additions & 25 deletions .github/workflows/gh-pages.yml
Original file line number Diff line number Diff line change
@@ -1,47 +1,47 @@
---
name: Pages

on:
push:
branches: ["master"]
branches: [master]
pull_request:
branches: ["master"]
branches: [master]
release:
types: [created]
branches:
- 'master'

branches: [master]
jobs:
build:
name: "Build docs"
name: Build docs
runs-on: ubuntu-latest
steps:
- uses: actions/setup-python@v4
- uses: actions/checkout@v3
with:
fetch-depth: 0 # otherwise, you will failed to push refs to dest repo
- name: "Install runtime dependencies"
run: "scripts/install"
- name: "Install doc build deps and build with Sphinx"
run: make docs
- name: "Upload artifacts"
uses: actions/upload-pages-artifact@v1
with:
- uses: actions/setup-python@v5
- uses: actions/checkout@v4
with:
fetch-depth: 0 # otherwise, you will failed to push refs to dest repo
- name: Install runtime dependencies
run: |
pip install .
pip install -r requirements/docs.txt
- name: Install doc build deps and build with Sphinx
run: make docs
- name: Upload artifacts
uses: actions/upload-pages-artifact@v3
with:
# Upload built docs
path: "./Documentation"
path: ./Documentation
deploy:
name: "Deploy docs"
name: Deploy docs
if: github.event_name == 'release' && github.event.action == 'created'
needs: build
runs-on: ubuntu-latest
# Grant GITHUB_TOKEN the permissions required to make a Pages deployment
permissions:
pages: write # to deploy to Pages
id-token: write # to verify the deployment originates from an appropriate source
pages: write # to deploy to Pages
id-token: write # to verify the deployment originates from an appropriate source
# Deploy to the github-pages environment
environment:
name: github-pages
url: ${{ steps.deployment.outputs.page_url }}
steps:
- uses: actions/deploy-pages@v2
id: deployment
name: "Deploy to GitHub Pages"
- uses: actions/deploy-pages@v4
id: deployment
name: Deploy to GitHub Pages
157 changes: 128 additions & 29 deletions .github/workflows/python-package.yml
Original file line number Diff line number Diff line change
@@ -1,44 +1,143 @@
# This workflow will install Python dependencies, run tests and lint with a variety of Python versions
# For more information see: https://help.github.com/actions/language-and-framework-guides/using-python-with-github-actions

name: Python package

---
name: CI/CD
on:
push:
branches: ["master"]
branches: [master]
pull_request:
branches: ["master"]
branches: [master]
release:
types: [created]
branches: [master]
env:
FORCE_COLOR: '1' # Make tools pretty.
PIP_DISABLE_PIP_VERSION_CHECK: '1'
PIP_NO_PYTHON_VERSION_WARNING: '1'
PYTHON_LATEST: '3.12'

# For re-actors/checkout-python-sdist
sdist-artifact: python-package-distributions
jobs:
tests:
name: "Python ${{ matrix.python-version }}/Cython: ${{ matrix.use-cython }}"
runs-on: "ubuntu-latest"

lint:
name: Check linting
runs-on: ubuntu-latest
steps:
- name: Checkout project
uses: actions/checkout@v4
with:
fetch-depth: 0
- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: ${{ env.PYTHON_LATEST }}
cache: pip
- run: |
python -m pip install build
python -m pip install -r requirements/test.txt
name: Install core libraries for build and install
- name: Run linting checks
run: scripts/check
test-pytest:
name: 'Python ${{ matrix.python-version }}/Cython: ${{ matrix.use-cython }}'
runs-on: ubuntu-latest
timeout-minutes: 10 # Maybe we should remove this someday but the PyPy tests are acting strange
strategy:
# Complete all jobs even if one fails, allows us to see
# for example if a test fails only when Cython is enabled
fail-fast: false
matrix:
python-version: ["3.8", "3.9", "3.10", "3.11"]
use-cython: ["true", "false"]
python-version: ['3.8', '3.9', '3.10', '3.11', '3.12']
use-cython: ['true', 'false']
experimental: [false]
include:
- python-version: 'pypy3.9'
use-cython: false
experimental: true
- python-version: ~3.13.0-0
experimental: true
use-cython: false
env:
USE_CYTHON: ${{ matrix.use-cython }}

continue-on-error: ${{ matrix.experimental }}
steps:
- uses: "actions/checkout@v3"
with:
# You need to include this or setuptools_scm in GitHub runners won't detect the version
fetch-depth: 0
- uses: "actions/setup-python@v4"
with:
python-version: "${{ matrix.python-version }}"
- name: "Install dependencies"
run: "scripts/install"
- name: "Run linting checks"
run: "scripts/check"
- name: "Run tests"
run: "scripts/tests"
- name: "Enforce coverage"
- uses: actions/checkout@v4
with:
fetch-depth: 0
- uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
cache: pip
cache-dependency-path: requirements/test.txt
- name: Install dependencies
run: |
pip install -r requirements/test.txt
pip install .
- name: Run tests
run: scripts/tests
- name: Enforce coverage
uses: codecov/codecov-action@v3
with:
token: ${{ secrets.CODECOV_TOKEN }}
token: ${{ secrets.CODECOV_TOKEN }}
check: # This job does nothing and is only used for the branch protection
name: ✅ Ensure the required checks passing
if: always()
needs: [lint, test-pytest]
runs-on: ubuntu-latest
steps:
- name: Decide whether the needed jobs succeeded or failed
uses: re-actors/alls-green@release/v1
with:
jobs: ${{ toJSON(needs) }}
build_wheels:
name: 📦 Build wheels on ${{ matrix.os }}
runs-on: ${{ matrix.os }}
needs: check
if: github.event_name == 'release' && github.event.action == 'created'
strategy:
matrix:
os: [ubuntu-20.04, macos-11]
steps:
- uses: actions/checkout@v4
with:
fetch-depth: 0
- name: Build wheels
uses: pypa/[email protected]
- uses: actions/upload-artifact@v3
with:
path: ./wheelhouse/*.whl
build_sdist:
name: 📦 Build the source distribution
runs-on: ubuntu-latest
needs: check
if: github.event_name == 'release' && github.event.action == 'created'
steps:
- uses: actions/checkout@v4
name: Checkout source repository
with:
fetch-depth: 0
- uses: actions/setup-python@v5
- name: Build sdist
run: >
pip3 install pkgconfig cython --upgrade &&
python3 setup.py sdist
- uses: actions/upload-artifact@v3
name: Upload build artifacts
with:
path: dist/*.tar.gz
publish:
name: 📦 Publish to PyPI
runs-on: ubuntu-latest
needs: [build_wheels, build_sdist]
permissions:
id-token: write
environment: pypi
if: github.event_name == 'release' && github.event.action == 'created'
steps:
- name: Download the sdist artifact
uses: actions/download-artifact@v3
with:
name: artifact
path: dist
- name: Publish package to PyPI
uses: pypa/gh-action-pypi-publish@release/v1
with:
password: ${{ secrets.PYPI_API_TOKEN }}
Loading
Loading