Feature/adding new rolebooks al (#18)

* try to add prometheus installation

* still trying

* feat(setup_install_prometheus): add Prometheus restart handler

* changing prometheus version and update nginx template

* trying to make haproxy playbooks

* adding playbooks for haproxy container

* adding haproxy-bkk07 configurations

* all haproxy&prometheus playbooks need to reviewed again

* fix ports & ip for rpc-kusama-01

* remove prometheus and haproxy from inventory

removed them so it'll not got auto updated

* commented so it'll not auto update haproxy & prometheus

* commented out broken ct & adding build-node07

* add buildnode,haproxy,prometheus to inventory

* adding rpc-polkadot-01 to bkk06 & fix rpc-westend-02

* tidying up

* adding rpc-westend-01 to bkk06

* adding interbtc for frontend

* chore: add new proxy-bkk07

* chore: add --expand flags for nginx

when i try to update ct's, they give me errror and needs to include this
flags -al

* chore: removing unused ports rules & fix ports

* chore: interbtc->dockers

* chore: update validator templates & add haproxy-bkk06

* chore: added extra flags for validator & endpoint .service templates

* chore: remove --private-ip flag

* chore: parameterized in/out-peers & inpeers for val = 64

* chore: update out-peers =64 for ksm & dot val

* chore: added new configs

* chore: added new ct configs

* chore: added new ct configs

* chore: fixing ansiblelater

* chore: remove parameterized inpeers outpeers for validator

* chore: migrate from the wrong naming ct ->correct one

* chore: add ansible port

* chore: update service.template

* chore: update rpc, rpc-kusama-01 not ready

* chore: update encointer template

* chore: updater paseo relay fallback

* chore: added new rpc & modified hydration group_vars

update hydration download_url & version
added rpc-paseo-01, rpc-hydration-polkadot-01

* chore: update relay rpc to rpc-polkadot-01

* chore: update rpc-*-westend-02 relay_rpc

* chore: update paseo rpc relay_rpc's

* chore: update configuration for rpc-relaychain

* chore: updated ports & bkk06 inventory

* chore: change kusama rpc relay_rpc to rpc-kusama-01

* chore: update inventory

* chore: update ports

* chore: update bridge-hub-paseo chain-specs and -01 ports

* chore: update & add ct configs

* chore: update polkadot version and validator template

* Update Polkadot and Cumulus versions

* chore: change asset-hub-paseo-01 to zfs

* chore: update val-polkadot-03 name

* feat: added basic template for penumbra & cometbft download_url

* feat: improve penumbra playbooks & fix linting

* chore: fix for ansiblelint & ansiblelater

* chore: update penumbra playbook & polkachu version

* chore: fix lint

* chore: added penumbra02 & slight adjustment for systemd service

* feat: update penumbra configuration and services

* fix: update penumbra container name

* chore: debugging playbooks

* refactor: update Penumbra service configuration

* chore: fix ansiblelater

* chore: improve the playbook

pls check it again

* chore: improve methods to download polkachu playbook

* chore: fix kilt playbooks & the host_vars

* chore: add host_vars rpc-kilt-polkadot-02

* chore: update endpoint templates & kilt/hydration configs

* chore: update hydration configs

* chore: fix moonbeam playbooks

* chore: added rpc-moonbeam-polkadot-01

* chore: added bootnode port

* chore: add moonbeam & ajuna to playbooks with the endpoints accordingly

* chore: add polimec ct and fix ip&vmid asigning

* chore: deploy unique ct

* chore: deployed bifrost ct

* fix: fixed ansiblelint&later

* feat: added invarch and fix hyperbridge/nexus playbooks a little bit

* feat: added acala, but tasks need to be checked again

---------

Co-authored-by: Al <[email protected]>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

bkk06

@@ -12,15 +12,34 @@ encointer
 hydration
 kilt
 polkadot
+moonbeam
+ajuna
+polimec
+unique
+bifrost
 
 [routers]
 bkk50
 
 [haproxy]
 haproxy-bkk06
 
+[ajuna]
+rpc-ajuna-polkadot-01
+
+[unique]
+rpc-unique-polkadot-01
+
+[polimec]
+rpc-polimec-polkadot-01
+
+[bifrost]
+rpc-bifrost-polkadot-01
+
+[moonbeam]
+rpc-moonbeam-polkadot-01
+
 [hydration]
-hdx26
 rpc-hydration-polkadot-01
 
 [polkadot]

bkk07

@@ -12,6 +12,11 @@ polkadot
 hydration
 cumulus
 kilt
+moonbeam
+ajuna
+polimec
+unique
+bifrost
 
 [prometheus]
 ibp-bkk07
@@ -38,9 +43,26 @@ talosctl0701
 [routers]
 bkk50
 
+[unique]
+rpc-unique-polkadot-02
+
+[bifrost]
+rpc-bifrost-polkadot-02
+
+[ajuna]
+rpc-ajuna-polkadot-02
+
+[polimec]
+rpc-polimec-polkadot-02
+
 [hydration]
 rpc-hydration-polkadot-02
-hdx27
+
+[kilt]
+rpc-kilt-polkadot-02
+
+[penumbra]
+penumbra-02
 
 [kilt]
 rpc-kilt-polkadot-02
@@ -56,6 +78,10 @@ rpc-paseo-02
 pso07
 val-polkadot-02
 val-kusama-02
+val-paseo-01
+
+[moonbeam]
+rpc-moonbeam-polkadot-02
 
 [cumulus]
 mint27

group_vars/acala.yaml

@@ -0,0 +1,25 @@
+---
+default_base_path: /opt/acala
+default_src_path: "{{ default_base_path }}/src"
+default_client_version: 3.0.1
+default_database: rocksdb
+default_database_path: "{{ default_base_path }}/chains"
+#TODO: we need to compile acala ourselves
+default_download_base_url: https://github.com/AcalaNetwork/acala-node
+default_download_url: "{{ default_download_base_url }}/archive/refs/tags/{{ default_client_version }}.tar.gz"
+default_group: "{{ service_users['acala'] }}"
+default_user: "{{ service_users['acala'] }}"
+default_log_level: info
+default_network: acala
+default_node_type: endpoint
+default_service: acala
+default_storage: "{{ default_base_path }}/chains"
+default_telemetry_url: wss://telemetry-backend.w3f.community/submit/ 1
+default_p2p_port_ws: 30434
+default_p2p_port_wss: 30435
+default_bootnode_p2p_port_ws: 30434
+default_bootnode_p2p_port_wss: 30435
+default_prom_port: 7400
+default_rpc_port: 9400
+default_secure_rpc_port: 42400
+zabbix_ext_port: 10400

group_vars/ajuna.yaml

@@ -1,24 +1,27 @@
 ---
 default_base_path: /opt/ajuna
-default_client_version: v0.7.7
+default_client_version: v0.8.3
 default_database: rocksdb
 default_database_path: "{{ default_base_path }}/chains"
 default_download_base_url: https://github.com/ajuna-network/ajuna-parachain/releases/download/
 default_download_url: "{{ default_download_base_url }}{{ default_client_version }}/ajuna-node"
+default_chain_spec: "{{ default_base_path }}/ajuna-raw.json"
+default_chain_spec_dl_url: "https://raw.githubusercontent.com/ajuna-network/ajuna-parachain/refs/heads/develop/resources/ajuna/ajuna-raw.json"
+default_user: "{{ service_users['ajuna'] }}"
 default_group: "{{ service_users['ajuna'] }}"
 default_log_level: info
 default_network: ajuna
 #havent touch below
 #NOTE: please check it
 default_node_type: endpoint
-default_p2p_port: 33800
-default_p2p_port_ws: 34800
-default_p2p_port_wss: 35800
-default_prom_port: 7800
-default_rpc_port: 9800
+default_p2p_port_ws: 30434
+default_p2p_port_wss: 30435
+default_bootnode_p2p_port_ws: 30434
+default_bootnode_p2p_port_wss: 30435
+default_prom_port: 7400
+default_rpc_port: 9400
 default_secure_rpc_port: 42800
 default_service: ajuna
 default_storage: "{{ default_base_path }}/chains"
 default_telemetry_url: wss://telemetry-backend.w3f.community/submit/ 1
-default_user: "{{ service_users['ajuna'] }}"
 zabbix_ext_port: 10800

group_vars/all/all.yaml

@@ -163,9 +163,11 @@ proxmox_defaults:
 
 # Service users named after clients
 service_users:
+  ajuna: "ajuna"
   arbitrum: "arbitrum"
   avalanche: "avalanche"
   binance: "binance"
+  bifrost: "bifrost"
   cumulus: "cumulus"
   erigon: "erigon"
   ethereum: "ethereum"
@@ -181,5 +183,5 @@ service_users:
   interlay: "interlay"
   unique: "unique"
   polimec: "polimec"
-  ajuna: "ajuna"
   penumbra: "penumbra"
+  invarch: "invarch"

group_vars/bifrost.yaml

@@ -1,24 +1,25 @@
 ---
 default_base_path: /opt/bifrost
-default_client_version: v1.3.0
+default_client_version: v0.16.1
 default_database: rocksdb
 default_database_path: "{{ default_base_path }}/chains"
-default_download_base_url: https://github.com/bifrost-platform/bifrost-node/releases/download/
-default_download_url: "{{ default_download_base_url }}{{ default_client_version }}/bifrost-node"
+default_download_base_url: https://github.com/bifrost-io/bifrost/releases/download
+default_download_url: "{{ default_download_base_url }}/bifrost-{{ default_client_version }}/bifrost"
+default_user: "{{ service_users['bifrost'] }}"
 default_group: "{{ service_users['bifrost'] }}"
 default_log_level: info
 default_network: bifrost
 default_node_type: endpoint
 #havent touch below
 #NOTE: please check it
-default_p2p_port: 33800
-default_p2p_port_ws: 34800
-default_p2p_port_wss: 35800
-default_prom_port: 7800
-default_rpc_port: 9800
+default_p2p_port_ws: 30434
+default_p2p_port_wss: 30435
+default_bootnode_p2p_port_ws: 30434
+default_bootnode_p2p_port_wss: 30435
+default_prom_port: 7400
+default_rpc_port: 9400
 default_secure_rpc_port: 42800
 default_service: bifrost
 default_storage: "{{ default_base_path }}/chains"
 default_telemetry_url: wss://telemetry-backend.w3f.community/submit/ 1
-default_user: "{{ service_users['bifrost'] }}"
 zabbix_ext_port: 10800

group_vars/hyperbridge.yaml

@@ -0,0 +1,23 @@
+---
+default_base_path: /opt/hyperbridge
+default_client_version: v1.0.0
+default_database: rocksdb
+default_database_path: "{{ default_base_path }}/chains"
+default_download_base_url: https://github.com/polytope-labs/hyperbridge/releases/download
+default_download_url: "{{ default_download_base_url }}/hyperbridge-{{ default_client_version }}/hyperbridge-x86_64-unknown-linux-gnu.tar.gz"
+default_user: "{{ service_users['hyperbridge'] }}"
+default_group: "{{ service_users['hyperbridge'] }}"
+default_log_level: info
+default_network: hyperbridge
+default_node_type: endpoint
+default_p2p_port_ws: 30434
+default_p2p_port_wss: 30435
+default_bootnode_p2p_port_ws: 30434
+default_bootnode_p2p_port_wss: 30435
+default_prom_port: 7400
+default_rpc_port: 9400
+default_secure_rpc_port: 42800
+default_service: hyperbridge
+default_storage: "{{ default_base_path }}/chains"
+default_telemetry_url: wss://telemetry-backend.w3f.community/submit/ 1
+zabbix_ext_port: 10800

group_vars/invarch.yaml

@@ -0,0 +1,23 @@
+---
+default_base_path: /opt/invarch
+default_client_version: v1.2.3
+default_database: paritydb
+default_database_path: "{{ default_base_path }}/chains"
+default_download_base_url: https://github.com/AbstractedCo/InvArch/releases/download
+default_download_url: "{{ default_download_base_url }}/{{ default_client_version }}-InvArch/invarch-collator"
+default_group: "{{ service_users['invarch'] }}"
+default_user: "{{ service_users['invarch'] }}"
+default_log_level: info
+default_network: invarch
+default_node_type: endpoint
+default_p2p_port_ws: 30434
+default_p2p_port_wss: 30435
+default_bootnode_p2p_port_ws: 30434
+default_bootnode_p2p_port_wss: 30435
+default_prom_port: 7400
+default_rpc_port: 9400
+default_secure_rpc_port: 42800
+default_service: invarch
+default_storage: "{{ default_base_path }}/chains"
+default_telemetry_url: wss://telemetry-backend.w3f.community/submit/ 1
+zabbix_ext_port: 10800

group_vars/kilt.yaml

@@ -7,8 +7,8 @@ default_client_version: 1.14.5
 default_database: rocksdb
 default_database_path: "{{ default_base_path }}/chains"
 #TODO: we need to compile KILT ourselves
-default_download_base_url: https://github.com/KILTprotocol/kilt-node/archive/refs/tags/
-default_download_url: "{{ default_download_base_url }}{{ default_client_version }}.tar.gz"
+default_download_base_url: https://github.com/KILTprotocol/kilt-node/archive/refs/tags
+default_download_url: "{{ default_download_base_url }}/{{ default_client_version }}.tar.gz"
 default_group: "{{ service_users['kilt'] }}"
 default_log_level: info
 default_network: kilt

group_vars/moonbeam.yaml

@@ -1,16 +1,18 @@
 ---
-moonbeam_version: 0.30.3
-moonbeam_download_url: https://github.com/PureStake/moonbeam/releases/download/v{{ moonbeam_version }}/moonbeam
+default_client_version: 0.42.1
+default_download_url: https://github.com/moonbeam-foundation/moonbeam/releases/download/v{{ default_client_version }}/moonbeam
 
-moonbeam_service: moonbeam
-moonbeam_user: "{{ service_users['moonbeam'] }}"
-moonbeam_base: /opt/moonbeam
-moonbeam_log_level: info
-moonbeam_base_port: 30333
-moonbeam_base_rpc_port: 9933
-moonbeam_base_ws_port: 9944
-moonbeam_blockchain: moonbeam
-moonbeam_chain_port: 30334
-moonbeam_chain_rpc_port: 9934
-moonbeam_chain_ws_port: 9945
-moonbeam_pruning: archive
+default_service: moonbeam
+default_user: "{{ service_users['moonbeam'] }}"
+default_group: "{{ service_users['moonbeam'] }}"
+default_base_path: /opt/moonbeam
+default_database_path: /opt/moonbeam/chains
+default_log_level: info
+default_base_port: 30333
+default_base_rpc_port: 9400
+default_base_ws_port: 9944
+default_blockchain: moonbeam
+default_chain_port: 30334
+default_chain_rpc_port: 9934
+default_chain_ws_port: 9945
+default_pruning: archive

group_vars/polimec.yaml

@@ -3,21 +3,21 @@ default_base_path: /opt/polimec
 default_client_version: v0.8.0
 default_database: rocksdb
 default_database_path: "{{ default_base_path }}/chains"
-default_download_base_url: https://github.com/Polimec/polimec-node/releases/download/
-default_download_url: "{{ default_download_base_url }}{{ default_client_version }}/polimec-node"
+default_download_base_url: https://github.com/Polimec/polimec-node/releases/download
+default_download_url: "{{ default_download_base_url }}/{{ default_client_version }}/polimec-node"
+default_user: "{{ service_users['polimec'] }}"
 default_group: "{{ service_users['polimec'] }}"
 default_log_level: info
 default_network: polimec
 default_node_type: endpoint
-#NOTE: i havent touched below this
-default_p2p_port: 33800
-default_p2p_port_ws: 34800
-default_p2p_port_wss: 35800
-default_prom_port: 7800
-default_rpc_port: 9800
+default_p2p_port_ws: 30434
+default_p2p_port_wss: 30435
+default_bootnode_p2p_port_ws: 30434
+default_bootnode_p2p_port_wss: 30435
+default_prom_port: 7400
+default_rpc_port: 9400
 default_secure_rpc_port: 42800
 default_service: polimec
 default_storage: "{{ default_base_path }}/chains"
 default_telemetry_url: wss://telemetry-backend.w3f.community/submit/ 1
-default_user: "{{ service_users['polimec'] }}"
 zabbix_ext_port: 10800

group_vars/unique.yaml

@@ -3,22 +3,23 @@ default_base_path: /opt/unique
 default_client_version: v10030070
 default_database: rocksdb
 default_database_path: "{{ default_base_path }}/chains"
-default_download_base_url: https://github.com/UniqueNetwork/unique-chain/releases/download/
-default_download_url: "{{ default_download_base_url }}{{ default_client_version }}/unique-collator-{{ default_client_version }}"
+default_download_base_url: https://github.com/UniqueNetwork/unique-chain/releases/download
+default_download_url: "{{ default_download_base_url }}/{{ default_client_version }}/unique-collator-{{ default_client_version }}"
+default_user: "{{ service_users['unique'] }}"
 default_group: "{{ service_users['unique'] }}"
 default_log_level: info
 default_network: unique
 default_node_type: endpoint
 #havent touch below
 #NOTE: please check it
-default_p2p_port: 33800
-default_p2p_port_ws: 34800
-default_p2p_port_wss: 35800
-default_prom_port: 7800
-default_rpc_port: 9800
+default_p2p_port_ws: 30434
+default_p2p_port_wss: 30435
+default_bootnode_p2p_port_ws: 30434
+default_bootnode_p2p_port_wss: 30435
+default_prom_port: 7400
+default_rpc_port: 9400
 default_secure_rpc_port: 42800
 default_service: unique
 default_storage: "{{ default_base_path }}/chains"
 default_telemetry_url: wss://telemetry-backend.w3f.community/submit/ 1
-default_user: "{{ service_users['unique'] }}"
 zabbix_ext_port: 10800