v1.0.0

What's Changed

• working on pgbench wrapper by @dustinblack in #2
• syntax fix by @dustinblack in #3
• syntax fix by @dustinblack in #4
• syntax fix by @dustinblack in #5
• reworking summary output of config by @dustinblack in #6
• fix regular expresstion by @dustinblack in #7
• pgbench enhancements for output and indexing by @dustinblack in #8
• add uuid to summary by @dustinblack in #9
• adding wrapper for fio by @aakarshg in #10
• split reporting of raw output and convert data to correct types by @dustinblack in #12
• pgbench: convert duration and transactions to integer by @dustinblack in #14
• Adding YCSB wrapper code by @jtaleric in #13
• Adding error checking for failed loading by @jtaleric in #17
• Adding error control to fio indexing by @aakarshg in #19
• fix indexing for conditions where keys are in global instead of job s… by @dustinblack in #20
• running multiple samples by @aakarshg in #22
• Add uperf nthrs by @jeniferh in #23
• Adding reusable redis PUBSUB scripts by @chawlanikhil24 in #18
• Post process fio result data by @acalhounRH in #25
• Added wrapper script for backpack by @dry923 in #27
• Fix indexing analyzed rsults even if not passing es var by @aakarshg in #28
• introduce indexing of pgbench periodic latency data by @dustinblack in #21
• Output parse fix by @jtaleric in #31
• Put each module from backpack/snafu to its own index by @dry923 in #29
• Added common logging and py_es_bulk by @aakarshg in #33
• updating default index to send results to by @aakarshg in #34
• added conditional and log statemenet for yielding fio analyzer by @acalhounRH in #35
• Update README by @jtaleric in #37
• changed dash to underscore for fio wrapper by @acalhounRH in #36
• implement run snafu fio wrapper by @acalhounRH in #38
• fix for snafu/ripsaw index by @acalhounRH in #42
• Smallfile run snafu by @bengland2 in #41
• Adding dockerfiles from magazine into snafu by @aakarshg in #45
• fixing adding snafu by @aakarshg in #46
• Development by @aakarshg in #47
• Fs drift run snafu by @bengland2 in #43
• Smallfile dockerfile by @bengland2 in #50
• Fs drift dockerfile by @bengland2 in #51
• document run_snafu.py by @bengland2 in #53
• do not return intervals where no IOPS happened by @bengland2 in #54
• hammerdb specifics by @mkarg75 in #58
• Add Latency numbers to Uperf results by @mohit-sheth in #59
• document how to run your workload with run_snafu.py by @bengland2 in #56
• Initial restructure by @aakarshg in #61
• ignore .pyc files by @bengland2 in #62
• corrected the evaluation of start time by @acalhounRH in #63
• Fixed es indexing for hosts with auth by @aakarshg in #65
• fixing incorrect variable naming by @aakarshg in #69
• removing type for docs indexing in pyesbulk by @aakarshg in #70
• do not report rsptime stats on interval with 0 iops by @bengland2 in #66
• update fio wrapper to support greater than 1 numjobs by @acalhounRH in #74
• add optype field to response time documents by @bengland2 in #77
• fix for issue #75 - failed to account for ramp time by @acalhounRH in #78
• add ceph osd drop cache trigger at the beginning of the fio sample by @dustinblack in #79
• Smf per thread results by @bengland2 in #80
• make it easier to see ES docs when debugging wrapper by @bengland2 in #81
• fix cache issues while building images by @aakarshg in #82
• produce 1 ES result document per thread by @bengland2 in #83
• can support non-K8S env, how to debug, additional benchmarks by @bengland2 in #84
• addign resource type to uperf docs by @aakarshg in #93
• Add client_node and server_node metadata by @mohit-sheth in #100
• adding cluster loader to snafu by @aakarshg in #94
• Adding requirements to requirements.txt by @aakarshg in #101
• Adding CI testing by @dry923 in #97
• Additional changes to the hammerdb addition by @mkarg75 in #64
• Improve logic with checking for es by @aakarshg in #109
• fixed minor syntax errors by @aakarshg in #110
• Skip not present CI tests by @rsevilla87 in #107
• updating ycsb version to 0.17 by @aakarshg in #89
• Revert "updating ycsb version to 0.17" by @jtaleric in #114
• Revert "Revert "updating ycsb version to 0.17"" by @jtaleric in #115
• Improve image build & push reliability by @rsevilla87 in #113
• Smf statvfs by @bengland2 in #85
• No es index smf fsd by @bengland2 in #99
• rewinding ycsb back to 0.15 by @aakarshg in #117
• Fixing ambiguous master error by @dry923 in #118
• dont use cache for building images by @aakarshg in #122
• fix bug trimming last char in test dir by @aakarshg in #121
• Python3 and ubi8 migration by @rsevilla87 in #108
• using the full url for ubi8 image by @aakarshg in #124
• Fixed printing results for hammerdb by @SzymonZebrowski in #127
• Allow other location account by @bengland2 in #104
• Enhancement for HammerDB doc generation/indexing by @mkarg75 in #120
• Migrate ycsb to ubi8 & python3 by @rsevilla87 in #125
• setting python var for ycsb by @aakarshg in #132
• generate new index showing fs-drift throughput rates as a function of time by @bengland2 in #67
• Re-enabling metadata collection by @dry923 in #137
• Verify number of arguments on check_es by @rsevilla87 in #135
• fixed code style errors with flake8 by @amitsagtani97 in #130
• Add depends on to CI by @aakarshg in #140
• hammerd wrapper fixes for some loops by @mkarg75 in #142
• Converting datetime objects to str when dumping by @aakarshg in #145
• Add missing es indices to tests for ycsb/pgbench by @aakarshg in #149
• Adding stalebot by @dry923 in #147
• CI code improvements by @rsevilla87 in #123
• Fixing ci tests by @dry923 in #153
• Clean out minikube's images prior to testing by @dry923 in #154
• Add debugging tools by @rsevilla87 in #151
• Install python libraries through requirements by @aakarshg in #155
• Adding podman prune to ensure we don't fill local disk again by @dry923 in #156
• Fixing full test trigger to properly handle file changes in the root dir by @dry923 in #157
• Synchronize parallel smallfile operations and samples using ripsaw redis sidecar by @rsevilla87 in #102
• Calculate redis timeout from last operation duration by @rsevilla87 in #160
• added ycsb to run from run_snafu --tool by @amitsagtani97 in #139
• Fixed dockerfile for pgbench by @aakarshg in #162
• Migrate hammerdb to run from run_snafu --tool by @amitsagtani97 in #148
• Use multi-stage Dockerfile to build Fio by @rsevilla87 in #164
• Document size tracking by @acalhounRH in #163
• added uperf to run from run_snafu --tool by @amitsagtani97 in #138
• Added pgbench to run from run_snafu --tool by @amitsagtani97 in #143
• Bump to fio-3.19 by @rsevilla87 in #166
• update uuid and user from list by @aakarshg in #170
• Added git to fio dockerfile for debug purposes by @acalhounRH in #171
• Skip TLS cert verify by @rsevilla87 in #169
• Improve and clean-up Fio code by @rsevilla87 in #168
• Adding Linpack by @jtaleric in #175
• flake8 ignore E741 by @aakarshg in #178
• Fix tests paths by @rsevilla87 in #184
• uperf cleanup by @rsevilla87 in #177
• Better error handling for clusterloader by @smalleni in #189
• Uperf samples by @rsevilla87 in #183
• Add vegeta wrapper by @rsevilla87 in #190
• Add python-dateutil to requirements for vegeta by @smalleni in #191
• Add simple method to pass vegeta result json by @jtaleric in #193
• Fixing bug of loading vegeta output by @jtaleric in #194
• Replace pbench-uperf by epel's uperf by @rsevilla87 in #192
• Updating environment for new CI systems by @dry923 in #195
• Fix depends-on by @rsevilla87 in #197
• Packaging snafu to run from binary by @amitsagtani97 in #179
• Avoid rebuilding operator and checking ES twice by @rsevilla87 in #187
• Disable native CPU detection by @rsevilla87 in #200
• Fixing the FIPS problem by @jtaleric in #202
• Drop cache by @bengland2 in #196
• Add get prometheus data to run snafu by @acalhounRH in #173
• Reorganize snafu by @rsevilla87 in #198
• extensions for mysql and postgresql added by @mkarg75 in #203
• Add -f flag to prune by @rsevilla87 in #204
• updated fio analyzer to handle test when bsrange is used instead of bs by @acalhounRH in #207
• corrected if statement on bs||bsrange check by @acalhounRH in #210
• Adding cluster scaling by @dry923 in #205
• Update CI test scripts by @dry923 in #212
• put delay after cache dropping to let system recover from it by @bengland2 in #209
• Add determining if scale up/down and gather initial worker count by @dry923 in #211
• Implementation of stressng by @mkarg75 in #214
• add pairs and multus_client to es by @mohit-sheth in #215
• Add optional passing of a choice of what test to run with -t by @dry923 in #208
• Add cyclictest image by @smalleni in #220
• Install dumb-init through rpm by @smalleni in #221
• updated fio wrapper to trigger prom collection by @acalhounRH in #206
• Adding upgrading of openshift clusters by @dry923 in #216
• Fully implement cyclictest_wrapper by @smalleni in #222
• Small README nit by @jtaleric in #226
• Smf cache drop fix by @bengland2 in #225
• Add wrapper for oslat by @smalleni in #227
• Set workdir for stressng benchmark by @martineg in #224
• Add additional try in case the env is openstack by @dry923 in #230
• add run_id to es docs by @whitleykeith in #229
• need to add realpath to resolve relative path to util scripts. by @acalhounRH in #231
• removed / from path in order to resolve relative path to utils by @acalhounRH in #232
• Remove util from prometheus include path by @acalhounRH in #233
• Capture networkpolicy status in output by @smalleni in #235
• Adding support for clusters (like ROSA) that are labeled differently by @dry923 in #237
• ppc64le specific additions for a few workloads by @piyushgupta1551 in #238
• Update uperf metrics for asymmetric workload by @rsevilla87 in #236
• [Scale Job] Changed worker machineset query to use name by @dry923 in #239
• run_id should be optional by @jtaleric in #241
• Remove es_port and prom_port variables by @rsevilla87 in #219
• Default to ssl based on port by @jtaleric in #242
• Simple fix to handle case where there is no es server specified by @smalleni in #245
• Fix rt-tests package location by @smalleni in #244
• remove the part which alters the test duration by @mohit-sheth in #248
• Uperf scale variables by @mrbojangles3 in #250
• add a case where additional params are not passed by @mohit-sheth in #252
• Handle case where some values don't exist gracefully by @smalleni in #251
• Add support to upgrade to the latest version by @chaitanyaenr in #253
• Set the desired upgrade version dynamically by @chaitanyaenr in #255
• TRex wrapper script for testpmd workload by @mukrishn in #249
• Fixing Scale Kubernetes Client Configuration by @whitleykeith in #256
• flent-workload by @jaredoconnell in #213
• es_verify_cert is expected to be a lowercase string by @sarahbx in #259
• Adding log generator script and container file by @dry923 in #254
• Add delay before checking for desired upgrade version by @chaitanyaenr in #258
• Add init.py to log_generator_wrapper by @sarahbx in #261
• Replaced flake8 with pre-commit hooks and fixed code-style issues [PEP8] by @amitsagtani97 in #262
• Adding image_pull test by @dry923 in #264
• Use GitHub actions for code lint CI by @amitsagtani97 in #265
• Add kafka backend for log verification by @smalleni in #270
• Add kafka python dependency by @dry923 in #271
• Use different group_ids per log generator pod by @smalleni in #272
• Disable SNAFU logging by @smalleni in #273
• Send messages received by kafka to ES by @smalleni in #274
• Improvements to kafka checks by @smalleni in #276
• Minor refactoring by @smalleni in #277
• Added functionality for running sysbench by @acalhounRH in #278
• fix ceph cachedrop URL and env. var. name by @bengland2 in #269
• disabled ofed check by @mukrishn in #275
• Added functionality for creating and processing archive file by @acalhounRH in #279
• Add DNS performance workload wrapper by @chaitanyaenr in #267
• update Dockerfile for fio to support newer version of FIO by @ekuric in #280
• Correct license in setup.cfg (mit -> apache2) by @learnitall in #281
• update hammerdb 3.3 to 4.0 and adapt the result parsing to hammerdb4.0 by @ebattat in #268
• Update gitignore with more Python and IDE files. by @learnitall in #282
• Create Initial Skeleton Documentation by @learnitall in #284
• Add Link to Documentation in README by @learnitall in #285
• Extend Object-Orientated Structure (Uperf POC) by @learnitall in #283
• [FIO] Per OSD Metric Query Updates by @kdvalin in #289
• pinning ci to use v0.1 of benchmark-operator by @whitleykeith in #292
• Deprecate cluster-loader by @rsevilla87 in #294
• so we know which metrics are being pulled by @bengland2 in #303
• Bump es version by @learnitall in #302
• Fix sysbench's Dockerfile by @ewchong in #309
• Fix sysbench path by @ewchong in #310
• Change linpack URL to latest Intel bits, change LINPACK_DAT so no need to be root by @mnmehta in #307
• changing snafu to use latest version of ripsaw by @whitleykeith in #301
• Downgrade elasticsearch-py version due to incompatibility issues by @rsevilla87 in #311
• Delete dead uperf_wrapper code by @learnitall in #313
• Fix ImportError on dead uperf code by @learnitall in #315
• Fix Uperf Parsing of Connect Type Workload (via #297) by @learnitall in #314
• Add Unit and Documentation Build Tests by @learnitall in #306
• Remove unused podman push by @rsevilla87 in #312
• Fix failing docs by @learnitall in #318
• add support for rosa machinepools on scale wrapper by @morenod in #291
• add support for rosa machinepools on scale wrapper by @morenod in #320
• Improve error handling by @rsevilla87 in #322
• common code for redis pod synchronization by @bengland2 in #328
• parallel kernel cache drops, kernel drop before OSD by @bengland2 in #329
• Revamp pre-commit CI by @learnitall in #317
• Fix Failing pre-commit Hooks by @learnitall in #331
• Add pre-commit badge to README by @learnitall in #333
• Update pre-commit Config by @learnitall in #335
• IOPS floating-point truncation to int results in significant fio errors by @bengland2 in #336
• Remove LiveProcess Wrapper by @learnitall in #330
• fix sysbench docker for aarch64 by @ewchong in #316
• log stdout from uperf command by @whitleykeith in #332
• Add Requirement Files to Pin Dependency Versions by @learnitall in #323
• Add missing install for snafu in readthedocs config by @learnitall in #340
• Add Automated Image Build System by @learnitall in #319
• Fix Various Bugs in GHA Build Workflow by @learnitall in #342
• Put fio local timezone data in UTC+0 timezone to es by @inevity in #338
• Fix Tagging and Push Logic in GHA Build Workflow by @learnitall in #344
• add directory on container because it cannot be created on runtime by @morenod in #345
• Redis timeout threshold 200 pct by @bengland2 in #341
• add directory on container because it cannot be created on runtime by @morenod in #348
• When counting workers, we need to skip workload and infra nodes by @morenod in #351
• upgrade comparison patch by @mukrishn in #321
• fs-drift touchup by @bengland2 in #343
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #352
• Determine CPU architecture with $basearch by @rsevilla87 in #350
• (CI chore): Update Requirements Files by @github-actions in #339
• add host/pod to ES doc for analysis by @bengland2 in #358
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #357
• (CI chore): Update Requirements Files by @github-actions in #356
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #361
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #364
• added systemd-analyze by @acalhounRH in #363
• (CI chore): Update Requirements Files by @github-actions in #359
• Add coremark-pro by @ewchong in #365
• (CI chore): Update Requirements Files by @github-actions in #368
• fix sysbench arm64 build by @ewchong in #371
• Add pip3 upgrade command to smallfile and fix smallfile variable cases by @dry923 in #375
• Fix uperf by @dry923 in #377
• Fix uperf again by @dry923 in #379
• [fio] Adding pip upgrade and missing dependencies by @chentex in #380
• [stressng] Adding pip upgrade and missing dependencies by @chentex in #381
• [flent] Adding pip upgrade and missing dependencies by @chentex in #382
• [fs-drift] Adding pip upgrade and missing dependencies by @chentex in #383
• [hammerdb] Adding pip upgrade and missing dependencies by @chentex in #384
• [pgbench] Adding pip upgrade and missing dependencies by @chentex in #385
• [scale-openshift] Adding pip upgrade and missing dependencies by @chentex in #386
• [smallfile] Adding pip upgrade and missing dependencies by @chentex in #387
• [upgrade-openshift] Adding pip upgrade and missing dependencies by @chentex in #388
• [vegeta] Adding pip upgrade and missing dependencies by @chentex in #389
• Adding pip upgrade and missing dependencies for test without CI tests by @chentex in #391
• Update sed command for additional workloads by @dry923 in #393
• [log_generator] Adding missing dependencies by @chentex in #395
• [image-pull] Adding pip upgrade and missing dependencies by @chentex in #392
• Adding missing dependencies for ycsb by @chentex in #397
• Standardize all images to use latest tag by @chentex in #396
• handle a case where 1st sample for uperf norm_ops is not 0 by @mohit-sheth in #401
• Fix readthedocs link in README by @learnitall in #403
• Add summary output for uperf by @jtaleric in #404
• (CI chore): Update Requirements Files by @github-actions in #373
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #374
• Change pre-commit and version workflow to run monthly by @learnitall in #366
• Uperf workload to support nodeport or loadbalancer type svc by @mukrishn in #402
• updates to coremark-pro and sysbench by @ewchong in #410
• Update for centos 8-stream by @dry923 in #417
• Assume sysbench is in path by @ewchong in #412
• Change git:// links to https:// in pre-commit by @learnitall in #418
• get fs-drift to pass CI again by @bengland2 in #414
• Index uperf timestamp field by @rsevilla87 in #424
• Add timestamp field to dataclass by @rsevilla87 in #425
• Bump notebook from 6.4.7 to 6.4.10 in /requirements/py37-reqs by @dependabot in #422
• Bump notebook from 6.4.7 to 6.4.10 in /requirements/py36-reqs by @dependabot in #421
• Bump notebook from 6.4.7 to 6.4.10 in /requirements/py39-reqs by @dependabot in #420
• Bump notebook from 6.4.7 to 6.4.10 in /requirements/py38-reqs by @dependabot in #419
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #411
• Assign uperf server port as an option by @smalleni in #426
• add ocp platform and networktype in scale index by @amitsagtani97 in #427
• Revert "add ocp platform and networktype in scale index" by @rsevilla87 in #428
• Revert "Revert "add ocp platform and networktype in scale index"" by @rsevilla87 in #430
• Added exit status for uperf failures by @vishnuchalla in #439
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #431
• Bump notebook from 6.4.10 to 6.4.12 in /requirements/py39-reqs by @dependabot in #436
• Bump notebook from 6.4.10 to 6.4.12 in /requirements/py37-reqs by @dependabot in #434
• Bump notebook from 6.4.10 to 6.4.12 in /requirements/py38-reqs by @dependabot in #435

New Contributors

• @dustinblack made their first contribution in #2
• @aakarshg made their first contribution in #10
• @jtaleric made their first contribution in #13
• @jeniferh made their first contribution in #23
• @chawlanikhil24 made their first contribution in #18
• @acalhounRH made their first contribution in #25
• @dry923 made their first contribution in #27
• @bengland2 made their first contribution in #41
• @mkarg75 made their first contribution in #58
• @mohit-sheth made their first contribution in #59
• @rsevilla87 made their first contribution in #107
• @SzymonZebrowski made their first contribution in #127
• @amitsagtani97 made their first contribution in #130
• @smalleni made their first contribution in #189
• @martineg made their first contribution in #224
• @whitleykeith made their first contribution in #229
• @piyushgupta1551 made their first contribution in #238
• @mrbojangles3 made their first contribution in #250
• @chaitanyaenr made their first contribution in #253
• @mukrishn made their first contribution in #249
• @jaredoconnell made their first contribution in #213
• @sarahbx made their first contribution in #259
• @ekuric made their first contribution in #280
• @learnitall made their first contribution in #281
• @ebattat made their first contribution in #268
• @kdvalin made their first contribution in #289
• @ewchong made their first contribution in #309
• @mnmehta made their first contribution in #307
• @morenod made their first contribution in #291
• @inevity made their first contribution in #338
• @pre-commit-ci made their first contribution in #352
• @github-actions made their first contribution in #339
• @chentex made their first contribution in #380
• @dependabot made their first contribution in #422
• @vishnuchalla made their first contribution in #439

Full Changelog: https://github.com/cloud-bulldozer/benchmark-wrapper/commits/v1.0.0