Skip to content

Latest commit

 

History

History
731 lines (529 loc) · 21.9 KB

electrs.md

File metadata and controls

731 lines (529 loc) · 21.9 KB
title parent grand_parent nav_exclude has_children has_toc layout
Electrs
+ Bitcoin
Bonus Section
true
false
false
title description tableOfContents outline pagination
visible
true
visible
visible
true
visible
true
visible
true

Electrs

Electrs is an efficient re-implementation of Electrum Server in Rust, inspired by ElectrumX, Electrum Personal Server, and bitcoincore-indexd.

{% hint style="warning" %} Difficulty: Medium {% endhint %}

Requirements

Preparations

-> Make sure that you have followed the Activate mempool & reduce 'dbcache' after a full sync section.

Install dependencies

  • With user admin, update the packages and upgrade to keep up to date with the OS
sudo apt update && sudo apt full-upgrade
  • Make sure that all necessary software packages are installed. Press "y" and enter or directly enter

{% code overflow="wrap" %}

sudo apt install clang cmake build-essential librocksdb-dev=7.8.3-2

{% endcode %}

Install Rustc (Cargo included)

  • Check if you already have Rustc installed
rustc --version

Expected output:

rustc 1.71.0 (8ede3aae2 2023-07-12)
  • And cargo installed
cargo -V

Expected output:

cargo 1.71.0 (cfd3bbd8f 2023-06-08)

{% hint style="warning" %} If you obtain "command not found" outputs, you need to follow the Rustup + Cargo bonus section to install it and then come back to continue with the guide {% endhint %}

Reverse proxy & Firewall

In the Security section, we already set up Nginx as a reverse proxy. Now we can add the Electrs configuration.

  • With user admin, create the reverse proxy configuration
sudo nano /etc/nginx/streams-available/electrs-reverse-proxy.conf
  • Paste the complete following configuration. Save and exit
upstream electrs {
  server 127.0.0.1:50021;
}
server {
  listen 50022 ssl;
  proxy_pass electrs;
}
  • Create the symbolic link that points to the directory streams-enabled

{% code overflow="wrap" %}

sudo ln -s /etc/nginx/streams-available/electrs-reverse-proxy.conf /etc/nginx/streams-enabled/

{% endcode %}

  • Test the Nginx configuration
sudo nginx -t

Expected output:

nginx: the configuration file /etc/nginx/nginx.conf syntax is ok
nginx: configuration file /etc/nginx/nginx.conf test is successful
  • Reload the Nginx configuration to apply changes
sudo systemctl reload nginx
  • Configure the firewall to allow incoming requests to the SSL and TCP ports
sudo ufw allow 50022/tcp comment 'allow Electrs SSL from anywhere'
sudo ufw allow 50021/tcp comment 'allow Electrs TCP from anywhere'

Installation

There are no precompiled binaries available for Electrs, so we should compile the application ourselves.

Build from the source code

  • With user admin, go to the temporary folder
cd /tmp
  • Set a temporary version environment variable to the installation
VERSION=0.10.8
  • Download the source code and go to the electrs folder
git clone --branch v$VERSION https://github.com/romanz/electrs.git && cd electrs
  • To avoid using bad source code, verify that the release has been properly signed by the main developer Roman Zeyde
curl https://romanzey.de/pgp.txt | gpg --import

Expected output:

>   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
>                                    Dload  Upload   Total   Spent    Left  Speed
> 100  1255  100  1255    0     0   3562      0 --:--:-- --:--:-- --:--:--  3555
> gpg: key 87CAE5FA46917CBB: public key "Roman Zeyde <[email protected]>" imported
> gpg: Total number processed: 1
> gpg:               imported: 1
  • Verify the release
git verify-tag v$VERSION

Expected output:

gpg: Signature made Thu 03 Nov 2022 03:37:23 PM UTC
gpg:                using ECDSA key 15C8C3574AE4F1E25F3F35C587CAE5FA46917CBB
gpg:                issuer "[email protected]"
gpg: Good signature from "Roman Zeyde <[email protected]>" [unknown]
gpg:                 aka "Roman Zeyde <[email protected]>" [unknown]
gpg: WARNING: This key is not certified with a trusted signature!
gpg:          There is no indication that the signature belongs to the owner.
Primary key fingerprint: 15C8 C357 4AE4 F1E2 5F3F  35C5 87CA E5FA 4691 7CBB
  • Now compile the source code into an executable binary

{% code overflow="wrap" %}

ROCKSDB_INCLUDE_DIR=/usr/include ROCKSDB_LIB_DIR=/usr/lib cargo build --locked --release

{% endcode %}

Example of expected output 🔽
info: syncing channel updates for '1.63.0-aarch64-unknown-linux-gnu'
info: latest update on 2022-08-11, rust version 1.63.0 (4b91a6ea7 2022-08-08)
info: downloading component 'cargo'
info: downloading component 'clippy'
info: downloading component 'rust-docs'
info: downloading component 'rust-std'
info: downloading component 'rustc'
info: downloading component 'rustfmt'
info: installing component 'cargo'
info: installing component 'clippy'
info: installing component 'rust-docs'
info: installing component 'rust-std'
info: installing component 'rustc'
info: installing component 'rustfmt'
    Updating crates.io index
  Downloaded hex_lit v0.1.1
  Downloaded humantime v2.1.0
  Downloaded bitflags v1.3.2
  Downloaded getrandom v0.2.10
  Downloaded rand_chacha v0.3.1
  Downloaded is-terminal v0.4.7
  Downloaded lock_api v0.4.10
  Downloaded libloading v0.7.4
  Downloaded jsonrpc v0.14.1
  Downloaded jobserver v0.1.26
  Downloaded thiserror-impl v1.0.40
  Downloaded autocfg v1.1.0
  Downloaded dirs-sys-next v0.1.2
  Downloaded dirs-next v2.0.0
  Downloaded httpdate v1.0.2
  Downloaded configure_me v0.4.0
  Downloaded lazycell v1.3.0
  Downloaded num_cpus v1.16.0
[...]

{% hint style="info" %} This process can take quite a long time, 10-15 minutes or more, depending on the performance of your device. Please be patient until the prompt shows again {% endhint %}

  • Install it

{% code overflow="wrap" %}

sudo install -m 0755 -o root -g root -t /usr/local/bin ./target/release/electrs

{% endcode %}

  • Check the correct installation
electrs --version

Example of expected output:

v0.10.0
  • (Optional) Delete the temporal electrs folder
sudo rm -r /tmp/electrs

{% hint style="success" %} If you come to update this is the final step {% endhint %}

Create the electrs user & group

  • Create the electrs user
sudo adduser --disabled-password --gecos "" electrs
  • Make to the electrs user a member of the "bitcoin" group
sudo adduser electrs bitcoin
  • Create the Electrs data directory
sudo mkdir /data/electrs
  • Assign as the owner to the electrs user
sudo chown electrs:electrs /data/electrs

Configuration

  • Switch to the electrs user
sudo su - electrs
  • Create the electrs config file
nano /data/electrs/electrs.conf
  • Enter the complete next content
# RaMiX: electrs configuration
# /data/electrs/electrs.conf

# Bitcoin Core settings
network = "bitcoin"
cookie_file= "/data/bitcoin/.cookie"

# Electrs settings
electrum_rpc_addr = "0.0.0.0:50021"
db_dir = "/data/electrs/db"
server_banner = "Welcome to electrs (Electrum Rust Server) running on a RaMiX node!"
skip_block_download_wait = true

# Logging
log_filters = "INFO"
  • Exit electrs user session to return to the admin user session
exit

Create systemd service

  • As user admin, create the Electrs systemd unit
sudo nano /etc/systemd/system/electrs.service
  • Enter the complete following configuration. Save and exit
# RaMiX: systemd unit for electrs
# /etc/systemd/system/electrs.service

[Unit]
Description=Electrs
Requires=bitcoind.service
After=bitcoind.service

[Service]
ExecStart=/usr/local/bin/electrs --conf /data/electrs/electrs.conf --skip-default-conf-files

# Process management
####################
Type=simple
TimeoutSec=300
KillMode=process

# Directory creation and permissions
####################################
RuntimeDirectory=electrs
RuntimeDirectoryMode=0710
User=electrs
Group=electrs

# Hardening Measures
####################
PrivateTmp=true
ProtectSystem=full
ProtectHome=true
PrivateDevices=true
MemoryDenyWriteExecute=true

[Install]
WantedBy=multi-user.target
  • Enable autoboot (optional)
sudo systemctl enable electrs
  • Prepare "electrs" monitoring by the systemd journal and check log logging output. You can exit monitoring at any time with Ctrl-C
journalctl -fu electrs

Run

To keep an eye on the software movements, start your SSH program (eg. PuTTY) a second time, connect to the RaMiX node, and log in as admin

  • Start the service
sudo systemctl start electrs
  • Monitor the systemd journal at the first session created to check if everything works fine
Example of expected output on the first terminal with journalctl -fu electrs ⬇️
Starting electrs 0.10.0 on aarch64 linux with Config { network: Bitcoin, db_path: "/data/electrs/db/bitcoin", daemon_dir: "/data/bitcoin", daemon_auth: CookieFile("/data/bitcoin/.cookie"), daemon_rpc_addr: 127.0.0.1:8332, daemon_p2p_addr: 127.0.0.1:8333, electrum_rpc_addr: 0.0.0.0:50021, monitoring_addr: 127.0.0.1:4224, wait_duration: 10s, jsonrpc_timeout: 15s, index_batch_size: 10, index_lookup_limit: None, reindex_last_blocks: 0, auto_reindex: true, ignore_mempool: false, sync_once: false, disable_electrum_rpc: false, server_banner: "Welcome to electrs (Electrum Rust Server) running on a RaMiX node!", args: [] }
[2021-11-09T07:09:42.744Z INFO  electrs::metrics::metrics_impl] serving Prometheus metrics on 127.0.0.1:4224
[2021-11-09T07:09:42.744Z INFO  electrs::server] serving Electrum RPC on 0.0.0.0:50021
[2021-11-09T07:09:42.812Z INFO  electrs::db] "/data/electrs/db/bitcoin": 0 SST files, 0 GB, 0 Grows
[2021-11-09T07:09:43.174Z INFO  electrs::index] indexing 2000 blocks: [1..2000]
[2021-11-09T07:09:44.665Z INFO  electrs::chain] chain updated: tip=00000000dfd5d65c9d8561b4b8f60a63018fe3933ecb131fb37f905f87da951a, height=2000
[2021-11-09T07:09:44.986Z INFO  electrs::index] indexing 2000 blocks: [2001..4000]
[2021-11-09T07:09:46.191Z INFO  electrs::chain] chain updated: tip=00000000922e2aa9e84a474350a3555f49f06061fd49df50a9352f156692a842, height=4000
[2021-11-09T07:09:46.481Z INFO  electrs::index] indexing 2000 blocks: [4001..6000]
[2021-11-09T07:09:47.581Z INFO  electrs::chain] chain updated: tip=00000000dbbb79792303bdd1c6c4d7ab9c21bba0667213c2eca955e11230c5a5, height=6000
[2021-11-09T07:09:46.481Z INFO  electrs::index] indexing 2000 blocks: [6001..8000]
[2021-11-09T07:09:47.581Z INFO  electrs::chain] chain updated: tip=00000000dbbb79792303bdd1c6c4d7ab9c21bba0667213c2eca955e11230c5a6, height=8000
[2021-11-09T07:09:46.481Z INFO  electrs::index] indexing 2000 blocks: [8001..10000]
[2021-11-09T07:09:47.581Z INFO  electrs::chain] chain updated: tip=00000000dbbb79792303bdd1c6c4d7ab9c21bba0667213c2eca955e11230c5a7, height=10000
[...]
[2021-11-09T07:09:46.481Z INFO  electrs::index] indexing 65 blocks: [756001..756065]
[2021-11-09T07:09:47.581Z INFO  electrs::chain] chain updated: tip=00000000dbbb79792303bdd1c6c4d7ab9c21bba0667213c2eca955e11230c510, height=756065
[2021-11-09T07:09:47.581Z INFO  electrs::db] starting config compaction
[2021-11-09T07:09:47.581Z INFO  electrs::db] starting headers compaction
[2021-11-09T07:09:47.581Z INFO  electrs::db] starting txid compaction
[2021-11-09T07:09:47.581Z INFO  electrs::db] starting funding compaction
[2021-11-09T07:09:47.581Z INFO  electrs::db] starting spending compaction
[...]

{% hint style="success" %} Congrats! Now you have a self-hosted Electrum Server on your node. Now you can process installing the Blockchain Explorer: BTC RPC Explorer or connect your Desktop signing app: Sparrow Wallet or Electrum Wallet Desktop {% endhint %}

Validation

  • Ensure electrs service is working and listening at the default TCP 50021 port and the monitoring 14224 port (not used on RaMiX)
sudo ss -tulpn | grep electrs

Expected output:

tcp   LISTEN 0      128          0.0.0.0:50021      0.0.0.0:*    users:(("electrs",pid=54749,fd=4))
tcp   LISTEN 0      128        127.0.0.1:14224      0.0.0.0:*    users:(("electrs",pid=54749,fd=3))
  • And the SSL 50022 port
sudo ss -tulpn | grep 50022

Expected output:

tcp   LISTEN 0   511   0.0.0.0:50022   0.0.0.0:*    users:(("nginx",pid=719,fd=5),("nginx",pid=718,fd=5),("nginx",pid=717,fd=5),("nginx",pid=716,fd=5),("nginx",pid=715,fd=5))

{% hint style="info" %} Electrs must first fully index the blockchain and compact its database before you can connect to it with your wallets. This can take a few hours. Only proceed with the next section once Electrs is ready {% endhint %}

Extras (optional)

Remote access over Tor

To use your Electrum server when you're on the go, you can easily create a Tor hidden service. This way, you can connect the BitBoxApp or Electrum wallet remotely, or even share the connection details with friends and family. Note that the remote device needs to have Tor installed as well.

  • With the user admin, edit the torrc file
sudo nano +63 /etc/tor/torrc --linenumbers
  • Add the following lines in the "location hidden services" section, below "## This section is just for location-hidden services ##" in the torrc file. Save and exit
# Hidden Service Electrs TCP & SSL
HiddenServiceDir /var/lib/tor/hidden_service_electrs_tcp_ssl/
HiddenServiceVersion 3
HiddenServicePoWDefensesEnabled 1
HiddenServicePort 50021 127.0.0.1:50021
HiddenServicePort 50022 127.0.0.1:50022
  • Reload the Tor configuration to apply changes
sudo systemctl reload tor
  • Get your Onion address
sudo cat /var/lib/tor/hidden_service_electrs_tcp_ssl/hostname

Expected output:

abcdefg..............xyz.onion

{% hint style="info" %} You should now be able to connect to your Electrs server remotely via Tor using your hostname and port 50022 (SSL) or 50021 (TCP) {% endhint %}

Migrate BTC RPC Explorer to Electrs API connection

To get address balances, either an Electrum server or an external service is necessary. Your local Electrs server can provide address transaction lists, balances, and more.

  • As user admin, open the btcrpcexplorer service
sudo nano /etc/systemd/system/btcrpcexplorer.service
  • Replace the fulcrum.service with the electrs.service. Save and exit
Requires=bitcoind.service electrs.service
After=bitcoind.service electrs.service
  • Restart the BTC RPC Explorer service to apply the changes
sudo systemctl restart btcrpcexplorer

Upgrade

sudo systemctl restart electrs
  • Check logs and pay attention to the next log if that attends to the new version installed and no error logs
journalctl -fu electrs
Example of expected output ⬇️
Starting electrs 0.10.0 on aarch64 linux with Config { network: Bitcoin, db_path: "/data/electrs/db/bitcoin", daemon_dir: "/data/bitcoin", daemon_auth: CookieFile("/data/bitcoin/.cookie"), daemon_rpc_addr: 127.0.0.1:8332, daemon_p2p_addr: 127.0.0.1:8333, electrum_rpc_addr: 0.0.0.0:50021, monitoring_addr: 127.0.0.1:4224, wait_duration: 10s, jsonrpc_timeout: 15s, index_batch_size: 10, index_lookup_limit: None, reindex_last_blocks: 0, auto_reindex: true, ignore_mempool: false, sync_once: false, disable_electrum_rpc: false, server_banner: "Welcome to electrs (Electrum Rust Server) running on a RaMiX node!", args: [] }
[2021-11-09T07:09:42.744Z INFO  electrs::metrics::metrics_impl] serving Prometheus metrics on 127.0.0.1:4224
[2021-11-09T07:09:42.744Z INFO  electrs::server] serving Electrum RPC on 0.0.0.0:50021
[2021-11-09T07:09:42.812Z INFO  electrs::db] "/data/electrs/db/bitcoin": 0 SST files, 0 GB, 0 Grows
[2021-11-09T07:09:43.174Z INFO  electrs::index] indexing 2000 blocks: [1..2000]
[2021-11-09T07:09:44.665Z INFO  electrs::chain] chain updated: tip=00000000dfd5d65c9d8561b4b8f60a63018fe3933ecb131fb37f905f87da951a, height=2000
[2021-11-09T07:09:44.986Z INFO  electrs::index] indexing 2000 blocks: [2001..4000]
[2021-11-09T07:09:46.191Z INFO  electrs::chain] chain updated: tip=00000000922e2aa9e84a474350a3555f49f06061fd49df50a9352f156692a842, height=4000
[2021-11-09T07:09:46.481Z INFO  electrs::index] indexing 2000 blocks: [4001..6000]
[2021-11-09T07:09:47.581Z INFO  electrs::chain] chain updated: tip=00000000dbbb79792303bdd1c6c4d7ab9c21bba0667213c2eca955e11230c5a5, height=6000
[2021-11-09T07:09:46.481Z INFO  electrs::index] indexing 2000 blocks: [6001..8000]
[2021-11-09T07:09:47.581Z INFO  electrs::chain] chain updated: tip=00000000dbbb79792303bdd1c6c4d7ab9c21bba0667213c2eca955e11230c5a6, height=8000
[2021-11-09T07:09:46.481Z INFO  electrs::index] indexing 2000 blocks: [8001..10000]
[2021-11-09T07:09:47.581Z INFO  electrs::chain] chain updated: tip=00000000dbbb79792303bdd1c6c4d7ab9c21bba0667213c2eca955e11230c5a7, height=10000
[...]
[2021-11-09T07:09:46.481Z INFO  electrs::index] indexing 65 blocks: [756001..756065]
[2021-11-09T07:09:47.581Z INFO  electrs::chain] chain updated: tip=00000000dbbb79792303bdd1c6c4d7ab9c21bba0667213c2eca955e11230c510, height=756065
[2021-11-09T07:09:47.581Z INFO  electrs::db] starting config compaction
[2021-11-09T07:09:47.581Z INFO  electrs::db] starting headers compaction
[2021-11-09T07:09:47.581Z INFO  electrs::db] starting txid compaction
[2021-11-09T07:09:47.581Z INFO  electrs::db] starting funding compaction
[2021-11-09T07:09:47.581Z INFO  electrs::db] starting spending compaction
[...]

Uninstall

Uninstall service

  • With the user admin, stop electrs
sudo systemctl stop electrs
  • Disable autoboot (if eneabled)
sudo systemctl disable electrs
  • Delete the service
sudo rm /etc/systemd/system/electrs.service

Delete user & group

  • Ensure you are logged in with the user admin. Delete the electrs user.
    Don't worry about userdel: electrs mail spool (/var/mail/electrs) not found output, the uninstall has been successful
sudo userdel -rf electrs

Delete data directory

  • Delete electrs directory
sudo rm -rf /data/electrs

Uninstall Tor hidden service

  • Ensure that you are logged in with the user admin , edit the torrc config file
sudo nano +63 /etc/tor/torrc --linenumbers
  • Delete or comment on the following lines in the "location hidden services" section, below "## This section is just for location-hidden services ##" in the torrc file. Save and exit
# Hidden Service Electrs TCP & SSL
#HiddenServiceDir /var/lib/tor/hidden_service_electrs_tcp_ssl/
#HiddenServiceVersion 3
#HiddenServicePoWDefensesEnabled 1
#HiddenServicePort 50021 127.0.0.1:50021
#HiddenServicePort 50022 127.0.0.1:50022
  • Reload the Tor configuration to apply changes
sudo systemctl reload tor

Uninstall reverse proxy & FW configuration

  • Ensure you are logged in with the user admin, delete the reverse proxy config file
sudo rm /etc/nginx/sites-available/electrs-reverse-proxy.conf
  • Delete the simbolic link
sudo rm /etc/nginx/sites-enabled/electrs-reverse-proxy.conf
  • Test Nginx configuration
sudo nginx -t

Expected output:

nginx: the configuration file /etc/nginx/nginx.conf syntax is ok
nginx: configuration file /etc/nginx/nginx.conf test is successful
  • Reload the Nginx configuration to apply changes
sudo systemctl reload nginx
  • Display the UFW firewall rules, and note the numbers of the rules for Electrs (e.g., X and Y below)
sudo ufw status numbered

Expected output:

[Y] 50021       ALLOW IN    Anywhere          # allow Electrs TCP from anywhere
[X] 50022       ALLOW IN    Anywhere          # allow Electrs SSL from anywhere
  • Delete the rule with the correct number and confirm with "yes" and enter
sudo ufw delete X

Port reference

PortProtocolUse
50021TCPDefault port
50022SSLEncrypted port