Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Petra runtime release #5165

Merged
merged 78 commits into from
Jun 17, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
78 commits
Select commit Hold shift + click to select a range
abd17d2
WIP: argo bridge
freakstatic Apr 22, 2024
37f3d91
WIP: argo bridge
freakstatic Apr 22, 2024
69263df
change Argo Bridge configs
freakstatic May 29, 2024
299ecf8
tests: improve Argo Bridge tests
freakstatic May 29, 2024
5330221
fix: use the right destination account on finalize_inbound_transfer
freakstatic May 29, 2024
cbde78c
fix: Argo Bridge - add new error (OperatorAccountNotSet)
freakstatic May 29, 2024
c649652
add const for number of max remote chains
freakstatic May 30, 2024
6fe1642
Add Argo Bridge benchmark tests
freakstatic May 30, 2024
60830b1
change RemoteAccount comment
freakstatic May 30, 2024
8f3c830
bump spec version to 2004
freakstatic May 30, 2024
76ebd71
ci: :green_heart: mac os checks
ignazio-bovo May 30, 2024
9f42316
ci: :green_heart: ci test install setuptools
ignazio-bovo May 30, 2024
d5c585e
ci: :green_heart: use hombrew instead
ignazio-bovo May 30, 2024
c55889e
ci: :green_heart: try to install python setup tools directly in the w…
ignazio-bovo May 30, 2024
2e878f3
ci: :green_heart: install setup tools before proceeding with mac_os c…
ignazio-bovo May 30, 2024
a7ff94b
ci: :green_heart: add setuptools on run-network-test workflow
ignazio-bovo May 30, 2024
bfe1832
ci: :green_heart: remove runtime ugrade test
ignazio-bovo May 30, 2024
e1db690
add Argo Bridge pallet to benchmarks definition
freakstatic May 31, 2024
a8890f2
Merge branch 'feature/argo-bridge' into fix/petra-ci-checks
ignazio-bovo May 31, 2024
d983069
build: :arrow_up: generate types for petra 2004
ignazio-bovo May 31, 2024
3c20a1f
tests: add benchmarking tests to Argo Bridge pallet
freakstatic May 31, 2024
afedc96
update Argo Bridge weights
freakstatic May 31, 2024
0faf5ec
Update Proposals Codex benchmarking to include Argo Bridge constraint…
freakstatic May 31, 2024
0fb0b20
small improvements on Argo Bridge benchmarking
freakstatic May 31, 2024
004bd9c
fix: :art: integration test issuess
ignazio-bovo Jun 2, 2024
bed43b0
fix clippy warnings
kdembler Jun 2, 2024
07bffe1
build: :arrow_up: graphql-codegen to 5.0.0
ignazio-bovo Jun 2, 2024
ac48824
feat: :art: network test create proposal fixture add new proposals
ignazio-bovo Jun 2, 2024
0f48abc
Merge pull request #2 from kdembler/argo-clippy
freakstatic Jun 2, 2024
1cb93ad
fix: :white_check_mark: add missing update token constraint proposals
ignazio-bovo Jun 2, 2024
94ebc04
ci: :green_heart: formatting
ignazio-bovo Jun 2, 2024
b278c08
fix: add missing argo bridge configs to project codex pallet
freakstatic Jun 3, 2024
9d0f3b7
Merge pull request #5155 from freakstatic/feature/argo-bridge
kdembler Jun 4, 2024
137e386
add revert_outbound_transfer extrinsic
kdembler Jun 2, 2024
e193904
Merge pull request #5158 from kdembler/argo-revert
kdembler Jun 4, 2024
1a1ef75
tests: add benchmarking test of revert_outbound_transfer
freakstatic Jun 3, 2024
770d3a2
fix: :art: adjust funding proposal parameters
ignazio-bovo Jun 4, 2024
8ebb196
fix: :sparkles: use joy macro for readability
ignazio-bovo Jun 4, 2024
14420b3
limit size of revert_outbound_transfer rationale
freakstatic Jun 4, 2024
0e611ec
update Argo Bridge weights
freakstatic Jun 4, 2024
7ba4ffb
fix: decrease revert_outbound_transfer rationale to 200
freakstatic Jun 4, 2024
03c80bb
Merge pull request #5162 from freakstatic/argo-limit-revert-rationale
kdembler Jun 4, 2024
f46aead
Merge pull request #5161 from ignazio-bovo/fix/higher-funding-proposa…
kdembler Jun 4, 2024
710b0bd
add helper functions, require bridge to be paused to start thawn
kdembler Jun 4, 2024
c9e4269
add overflow protection to request_outbound_transfer
kdembler Jun 4, 2024
67b6d36
add bridge paused tests for finalize and revert extrinsics
kdembler Jun 4, 2024
4bcc058
Merge pull request #5160 from kdembler/argo-overflow
kdembler Jun 4, 2024
7cb5b84
update chain metadata and types package
kdembler Jun 3, 2024
1c4806f
bump all packages versions
kdembler Jun 3, 2024
0d33fff
add QN support for Argo proposal
kdembler Jun 3, 2024
3bf569a
fix funding proposal config
kdembler Jun 4, 2024
0fb2457
update metadata and types after latest changes
kdembler Jun 4, 2024
da00cb6
fix Argo tests with BoundedVec
kdembler Jun 4, 2024
ed71937
fix QN formatting
kdembler Jun 4, 2024
a276a5f
fix: :lipstick: remove any unwrap() from option
ignazio-bovo Jun 5, 2024
9e75c8f
fix: :art: misc CI checks
ignazio-bovo Jun 5, 2024
7d5493c
Merge pull request #5159 from kdembler/argo-types
kdembler Jun 5, 2024
a460aed
Merge branch 'petra' into fix/higher-funding-proposal-cap
ignazio-bovo Jun 5, 2024
3452fbc
Merge pull request #5163 from ignazio-bovo/fix/higher-funding-proposa…
kdembler Jun 5, 2024
34766e6
Merge branch 'petra' into fix/petra-ci-checks
ignazio-bovo Jun 5, 2024
bd424de
chore: :package: remove file
ignazio-bovo Jun 5, 2024
ade6617
build: :arrow_up: bump to petra
ignazio-bovo Jun 5, 2024
05f7e4b
fix: :fire: regenerate chain metadata and types
ignazio-bovo Jun 5, 2024
b965362
remove npm package-lock
kdembler Jun 5, 2024
a59729b
Merge pull request #5157 from ignazio-bovo/fix/petra-ci-checks
kdembler Jun 5, 2024
c6d94c7
update default argo bridge status
kdembler Jun 5, 2024
2d9eac9
Merge pull request #5166 from kdembler/argo-default-status
kdembler Jun 5, 2024
167d52e
argo bridge pallet weights generated on reference hardware
mnaamani Jun 6, 2024
cb7fd90
bump joystream-node version to v8.7.0
mnaamani Jun 6, 2024
87e2e24
Merge pull request #5167 from mnaamani/argo-bridge-weights
kdembler Jun 6, 2024
9f50b35
fix: :art: babel traverse
ignazio-bovo Jun 10, 2024
f543a08
feat: :art: add update argo bridge constraints check
ignazio-bovo Jun 10, 2024
f0a6420
revert: :rewind: package.json same as master branch
ignazio-bovo Jun 10, 2024
a4aa87e
revert: :rewind: changes on yarn lock
ignazio-bovo Jun 10, 2024
a26e092
revert: :rewind: dependencies on joystream js
ignazio-bovo Jun 10, 2024
ed52b91
Merge pull request #5170 from ignazio-bovo/fix/graphql-codegen
kdembler Jun 12, 2024
916bee8
[QN] fix handling of proposal details between spec versions 2003 and …
kdembler Jun 13, 2024
4fcb2e6
Merge pull request #5174 from kdembler/petra-qn-proposal-details
mnaamani Jun 13, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .github/workflows/joystream-cli.yml
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,8 @@ jobs:
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: python setuptools
run: brew install python-setuptools
- name: checks
run: |
yarn install --frozen-lockfile --network-timeout 120000
Expand Down
62 changes: 32 additions & 30 deletions .github/workflows/joystream-types.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,21 +9,21 @@ jobs:
matrix:
node-version: [18.x]
steps:
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: checks
run: |
yarn install --frozen-lockfile
yarn workspace @joystream/types build
- name: npm pack test
run: |
cd types
npm pack | tail -1 | xargs tar xzf
cd package && npm install
node ./lib/cjs/index.js
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: checks
run: |
yarn install --frozen-lockfile
yarn workspace @joystream/types build
- name: npm pack test
run: |
cd types
npm pack | tail -1 | xargs tar xzf
cd package && npm install
node ./lib/cjs/index.js

types_checks_osx:
name: MacOS Checks
Expand All @@ -32,18 +32,20 @@ jobs:
matrix:
node-version: [18.x]
steps:
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: checks
run: |
yarn install --frozen-lockfile --network-timeout 120000
yarn workspace @joystream/types build
- name: npm pack test
run: |
cd types
npm pack | tail -1 | xargs tar xzf
cd package && npm install
node ./lib/cjs/index.js
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: python setuptools
run: brew install python-setuptools
- name: checks
run: |
yarn install --frozen-lockfile --network-timeout 120000
yarn workspace @joystream/types build
- name: npm pack test
run: |
cd types
npm pack | tail -1 | xargs tar xzf
cd package && npm install
node ./lib/cjs/index.js
38 changes: 20 additions & 18 deletions .github/workflows/lint-typescript.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,15 +9,15 @@ jobs:
matrix:
node-version: [18.x]
steps:
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: lint
run: |
yarn build
yarn lint
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: lint
run: |
yarn build
yarn lint

lint_osx:
name: MacOS Checks
Expand All @@ -26,12 +26,14 @@ jobs:
matrix:
node-version: [18.x]
steps:
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: lint
run: |
yarn build
yarn lint
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: python setuptools
run: brew install python-setuptools
- name: lint
run: |
yarn build
yarn lint
50 changes: 26 additions & 24 deletions .github/workflows/query-node.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,18 +9,18 @@ jobs:
matrix:
node-version: [18.x]
steps:
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: checks
run: |
yarn install --frozen-lockfile
yarn workspace @joystream/types build
yarn workspace @joystream/metadata-protobuf build
yarn workspace @joystream/js build
yarn workspace query-node-root build
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: checks
run: |
yarn install --frozen-lockfile
yarn workspace @joystream/types build
yarn workspace @joystream/metadata-protobuf build
yarn workspace @joystream/js build
yarn workspace query-node-root build

query_node_build_osx:
name: MacOS Checks
Expand All @@ -29,15 +29,17 @@ jobs:
matrix:
node-version: [18.x]
steps:
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: checks
run: |
yarn install --frozen-lockfile --network-timeout 120000
yarn workspace @joystream/types build
yarn workspace @joystream/metadata-protobuf build
yarn workspace @joystream/js build
yarn workspace query-node-root build
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: python setuptools
run: brew install python-setuptools
- name: checks
run: |
yarn install --frozen-lockfile --network-timeout 120000
yarn workspace @joystream/types build
yarn workspace @joystream/metadata-protobuf build
yarn workspace @joystream/js build
yarn workspace query-node-root build
117 changes: 22 additions & 95 deletions .github/workflows/run-network-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,14 +14,14 @@ jobs:
matrix:
node-version: [18.x]
steps:
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: checks
run: |
yarn build
- uses: actions/checkout@v4
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v4
with:
node-version: ${{ matrix.node-version }}
- name: checks
run: |
yarn build

tests_build_osx:
name: MacOS Checks
Expand All @@ -30,14 +30,16 @@ jobs:
matrix:
node-version: [18.x]
steps:
- uses: actions/checkout@v3
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v3
with:
node-version: ${{ matrix.node-version }}
- name: checks
run: |
yarn build
- uses: actions/checkout@v4
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v4
with:
node-version: ${{ matrix.node-version }}
- name: python setuptools
run: brew install python-setuptools
- name: checks
run: |
yarn build

build_images:
name: Build joystream/node
Expand All @@ -54,8 +56,8 @@ jobs:
sudo rm -rf /opt/ghc
sudo rm -rf "/usr/local/share/boost"
sudo rm -rf "$AGENT_TOOLSDIRECTORY"
- uses: actions/checkout@v3
- uses: actions/setup-node@v3
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with:
node-version: '18.x'

Expand Down Expand Up @@ -159,8 +161,8 @@ jobs:
- scenario: 'setupNewChainMultiStorage'
no_storage: 'true'
steps:
- uses: actions/checkout@v3
- uses: actions/setup-node@v3
- uses: actions/checkout@v4
- uses: actions/setup-node@v4
with:
node-version: '18.x'
- name: Get artifacts
Expand All @@ -181,78 +183,3 @@ jobs:
export RUNTIME=${{ needs.build_images.outputs.runtime }}
export NO_STORAGE=${{ matrix.no_storage }}
tests/network-tests/run-tests.sh ${{ matrix.scenario }}

runtime_upgrade:
name: Runtime Upgrade from production runtime
needs: build_images
runs-on: ubuntu-latest
# Disabling until we find a workaround
# as it is no longer practical to start the node
# while importing huge state from production network in genesis block.
# if: github.ref != 'refs/heads/master'
if: false
steps:
# Checkout master branch
- name: check out master repo
uses: actions/checkout@v3
with:
repository: Joystream/joystream
ref: master

- name: pull base runtime image
id: pull_base_image
env:
RUNTIME_PROFILE: 'TESTING'
run: |
export RUNTIME=`scripts/runtime-code-shasum.sh`
echo "::set-output name=shasum::${RUNTIME}"
docker pull joystream/node:$RUNTIME
docker images

# Get new runtime built for this workflow (target runtime)
# tagged in local repo as joystream/node:latest
- name: Get artifacts
uses: actions/download-artifact@v3
with:
name: ${{ needs.build_images.outputs.use_artifact }}
- name: Install artifacts
run: |
docker load --input joystream-node-docker-image.tar.gz
docker images

# Checkout workflow's branch/tag/commit
- name: checkout workflow branch
uses: actions/checkout@v3

# Look only for changes that would indicate possible change in runtime version
# This is not the best way to check. Ideally the script "run-runtime-upgrade-tests.sh" should
# look for the change of `spec_version`, and exit gracefully.
- name: Check for runtime version change
uses: technote-space/get-diff-action@v3
with:
PREFIX_FILTER: |
runtime
runtime-modules
SUFFIX_FILTER: |
.rs
- name: setup node
uses: actions/setup-node@v3
with:
node-version: '18.x'
- name: Install packages and dependencies
if: env.GIT_DIFF
run: |
yarn build
- name: Ensure tests are runnable
if: env.GIT_DIFF
run: yarn workspace network-tests build
- name: Execute network tests
if: env.GIT_DIFF
env:
TARGET_RUNTIME: ${{ needs.build_images.outputs.runtime }}
RUNTIME: ${{ steps.pull_base_image.outputs.shasum }}
run: |
export HOME=${PWD}
mkdir -p ${HOME}/.local/share/joystream-cli
yarn joystream-cli api:setUri ws://localhost:9944
tests/network-tests/run-runtime-upgrade-tests.sh
Loading
Loading