Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve reported statistics #553

Merged
merged 16 commits into from
Nov 3, 2023
Merged

Improve reported statistics #553

merged 16 commits into from
Nov 3, 2023

Conversation

lexnv
Copy link
Contributor

@lexnv lexnv commented Oct 19, 2023

This PR adds several improvements that aim to report more insightful statistical data.

Memory Buckets

Most reported systems by our telemetry endpoint have at least 64GiB of ram. To provide more insights into the RAM of the nodes, an extra bucket is added that contains values in the range [64; 128) GiB of ram.

Kernel Version

The linux kernel version is a string of the following format: 5.10.0-8-02354235.

The propagated version from the backend now includes only the kernel version, major version and minor version.
The patch (- 8 -) and specific identified ( - 02354235) are omitted for better grouping of the available versions.

CPU Vendor

To provide more insights into the specific number of CPUs of the substrate nodes, another entry is added which groups CPUs by vendor (intel / amd).

Package lock

Update the NPM package lock in response to updating vulnerable dependencies.

With this PR

Deployment in staging:

Screenshot 2023-11-03 at 15 12 29
6-e6bb5330fa88)

Next Steps

  • Check if providing all information from the backend to the frontend is a viable option (ie letting the frontend do the parsing)

Closes #535.

cc @paritytech/subxt-team

Signed-off-by: Alexandru Vasile <[email protected]>
Signed-off-by: Alexandru Vasile <[email protected]>
The linux kernel version string is parsed to include only
the kernel version, major version and minor version.
Ignoring the patch number and kernel specific info leads to
a better aggregation of data.

Signed-off-by: Alexandru Vasile <[email protected]>
Signed-off-by: Alexandru Vasile <[email protected]>
Copy link
Collaborator

@jsdw jsdw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

I think there is a way to deploy a specific branch to staging to test it. Let's see if that's possible before merging this to master, just to see what it's like (which might not be very informative on rococo, but just in case it shows that we should to tweak any other buckets)

@lexnv lexnv merged commit 4378fd2 into master Nov 3, 2023
10 checks passed
@lexnv lexnv deleted the lexnv/stats-buckets branch November 3, 2023 13:13
Rose2161 pushed a commit to Cryptob3auty/mtsubstrate-telemen that referenced this pull request Apr 15, 2024
* frontend: Update package lock

Signed-off-by: Alexandru Vasile <[email protected]>

* frontend/stats: Format linux kernel version

Signed-off-by: Alexandru Vasile <[email protected]>

* backend: Add [64; 128) RAM bucket

Signed-off-by: Alexandru Vasile <[email protected]>

* backend: Parse kernel string to include only version numbers

The linux kernel version string is parsed to include only
the kernel version, major version and minor version.
Ignoring the patch number and kernel specific info leads to
a better aggregation of data.

Signed-off-by: Alexandru Vasile <[email protected]>

* backend: Fix typo

Signed-off-by: Alexandru Vasile <[email protected]>

* core: Add CPU vendor to reported chain stats

Signed-off-by: Alexandru Vasile <[email protected]>

* frontend: Propagate CPU vendor to UI

Signed-off-by: Alexandru Vasile <[email protected]>

* backend: Parse kernel version by `+`

Signed-off-by: Alexandru Vasile <[email protected]>

* backend: Add CPU vendors and ignore ascii case

Signed-off-by: Alexandru Vasile <[email protected]>

* Revert "frontend/stats: Format linux kernel version"

This reverts commit 411b9a4.

* backend: Fix plus sign test

Signed-off-by: Alexandru Vasile <[email protected]>

* backend: Trim kernel versions

Signed-off-by: Alexandru Vasile <[email protected]>

* backend: Modify cpu_vendor

Signed-off-by: Alexandru Vasile <[email protected]>

---------

Signed-off-by: Alexandru Vasile <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update telemetry buckets
3 participants