Skip to content
Python CI

Implements feature based perf instrumentation comparision #2962

Sign in to view logs

Implements feature based perf instrumentation comparision

Implements feature based perf instrumentation comparision #2962

Triggered via pull request July 9, 2023 20:33
@vuldervulder
synchronize #806
f-StaticAnalysisMotivatedSynthBenchmarksImpl
Status Failure
Total duration 7m 31s
Artifacts –
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention

ci.yml

on: pull_request
Matrix: build
Fit to window
Zoom out
Zoom in

Annotations

45 errors and 33 warnings
[mypy] varats-core/varats/report/tef_report.py#L172: varats-core/varats/report/tef_report.py#L172
error: Function is missing a return type annotation [no-untyped-def]
[mypy] varats-core/varats/report/tef_report.py#L172: varats-core/varats/report/tef_report.py#L172
note: Use "-> None" if function does not return a value
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L52: varats/varats/experiments/vara/feature_perf_precision.py#L52
error: Class cannot subclass "ProjectStep" (has type "Any") [misc]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L56: varats/varats/experiments/vara/feature_perf_precision.py#L56
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L120: varats/varats/experiments/vara/feature_perf_precision.py#L120
error: Argument 2 to "__init__" of "MultiPatchReport" has incompatible type "type[PerfInfluenceTraceReportAggregate]"; expected "type[TEFReportAggregate]" [arg-type]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L123: varats/varats/experiments/vara/feature_perf_precision.py#L123
error: Class cannot subclass "ProjectStep" (has type "Any") [misc]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L143: varats/varats/experiments/vara/feature_perf_precision.py#L143
error: Class cannot subclass "ProjectStep" (has type "Any") [misc]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L180: varats/varats/experiments/vara/feature_perf_precision.py#L180
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L241: varats/varats/experiments/vara/feature_perf_precision.py#L241
error: Non-overlapping identity check (left operand type: "str", right operand type: "Literal[ProjectDomains.TEST]") [comparison-overlap]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L353: varats/varats/experiments/vara/feature_perf_precision.py#L353
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L489: varats/varats/experiments/vara/feature_perf_precision.py#L489
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L555: varats/varats/experiments/vara/feature_perf_precision.py#L555
error: Non-overlapping identity check (left operand type: "str", right operand type: "Literal[ProjectDomains.TEST]") [comparison-overlap]
[mypy] varats/varats/experiments/vara/feature_perf_precision.py#L658: varats/varats/experiments/vara/feature_perf_precision.py#L658
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/tables/feature_perf_precision.py#L265: varats/varats/tables/feature_perf_precision.py#L265
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "PerfInfluenceTraceReportAggregate" [attr-defined]
[mypy] varats/varats/tables/feature_perf_precision.py#L316: varats/varats/tables/feature_perf_precision.py#L316
error: Module "varats.experiments.vara.feature_perf_precision" does not explicitly export attribute "TimeReportAggregate" [attr-defined]
[mypy] varats/varats/tables/feature_perf_precision.py#L480: varats/varats/tables/feature_perf_precision.py#L480
error: Function is missing a type annotation for one or more arguments [no-untyped-def]
[mypy] varats/varats/tables/feature_perf_precision.py#L489: varats/varats/tables/feature_perf_precision.py#L489
error: Incompatible return value type (got "floating[Any]", expected "float") [return-value]
[mypy] varats/varats/tables/feature_perf_precision.py#L492: varats/varats/tables/feature_perf_precision.py#L492
error: Incompatible return value type (got "floating[Any]", expected "float") [return-value]
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L154 <301>: varats/varats/experiments/vara/feature_perf_precision.py#L154
Line too long (104/80) (line-too-long)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L463 <301>: varats/varats/experiments/vara/feature_perf_precision.py#L463
Line too long (81/80) (line-too-long)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L52 <115>: varats/varats/experiments/vara/feature_perf_precision.py#L52
Missing class docstring (missing-class-docstring)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L71 <115>: varats/varats/experiments/vara/feature_perf_precision.py#L71
Missing class docstring (missing-class-docstring)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L99 <115>: varats/varats/experiments/vara/feature_perf_precision.py#L99
Missing class docstring (missing-class-docstring)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L107 <115>: varats/varats/experiments/vara/feature_perf_precision.py#L107
Missing class docstring (missing-class-docstring)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L115 <115>: varats/varats/experiments/vara/feature_perf_precision.py#L115
Missing class docstring (missing-class-docstring)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L123 <115>: varats/varats/experiments/vara/feature_perf_precision.py#L123
Missing class docstring (missing-class-docstring)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L143 <115>: varats/varats/experiments/vara/feature_perf_precision.py#L143
Missing class docstring (missing-class-docstring)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L233 <116>: varats/varats/experiments/vara/feature_perf_precision.py#L233
Missing function or method docstring (missing-function-docstring)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L546 <116>: varats/varats/experiments/vara/feature_perf_precision.py#L546
Missing function or method docstring (missing-function-docstring)
[pylint] varats/varats/data/metrics.py#L251 <325>: varats/varats/data/metrics.py#L251
Unnecessary parens after '=' keyword (superfluous-parens)
[pylint] varats/varats/data/metrics.py#L252 <325>: varats/varats/data/metrics.py#L252
Unnecessary parens after '=' keyword (superfluous-parens)
[pylint] varats/varats/tables/feature_perf_precision.py#L66 <325>: varats/varats/tables/feature_perf_precision.py#L66
Unnecessary parens after 'if' keyword (superfluous-parens)
[pylint] varats/varats/tables/feature_perf_precision.py#L68 <325>: varats/varats/tables/feature_perf_precision.py#L68
Unnecessary parens after 'elif' keyword (superfluous-parens)
[pylint] varats/varats/tables/feature_perf_precision.py#L445 <301>: varats/varats/tables/feature_perf_precision.py#L445
Line too long (155/80) (line-too-long)
[pylint] varats/varats/tables/feature_perf_precision.py#L113 <103>: varats/varats/tables/feature_perf_precision.py#L113
Variable name "gt" doesn't conform to snake_case naming style (invalid-name)
[pylint] varats/varats/tables/feature_perf_precision.py#L357 <914>: varats/varats/tables/feature_perf_precision.py#L357
Too many local variables (25/20) (too-many-locals)
[pylint] varats/varats/tables/feature_perf_precision.py#L478 <115>: varats/varats/tables/feature_perf_precision.py#L478
Missing class docstring (missing-class-docstring)
[pylint] varats/varats/tables/feature_perf_precision.py#L520 <116>: varats/varats/tables/feature_perf_precision.py#L520
Missing function or method docstring (missing-function-docstring)
[pylint] varats/varats/tables/feature_perf_precision.py#L567 <914>: varats/varats/tables/feature_perf_precision.py#L567
Too many local variables (21/20) (too-many-locals)
[pylint] varats/varats/tables/feature_perf_precision.py#L567 <915>: varats/varats/tables/feature_perf_precision.py#L567
Too many statements (57/50) (too-many-statements)
build (3.10)
Process completed with exit code 1.
build (3.9)
The job was canceled because "_3_10" failed.
build (3.9)
The operation was canceled.
build (3.11)
The job was canceled because "_3_10" failed.
build (3.11)
The operation was canceled.
[pylint] varats/varats/projects/perf_tests/feature_perf_cs_collection.py#L202 <511>: varats/varats/projects/perf_tests/feature_perf_cs_collection.py#L202
TODO: fix with commit after merge (fixme)
[pylint] varats/varats/projects/perf_tests/feature_perf_cs_collection.py#L264 <511>: varats/varats/projects/perf_tests/feature_perf_cs_collection.py#L264
TODO: fix with commit after merge (fixme)
[pylint] varats/varats/projects/perf_tests/feature_perf_cs_collection.py#L329 <511>: varats/varats/projects/perf_tests/feature_perf_cs_collection.py#L329
TODO: fix with commit after merge (fixme)
[pylint] varats/varats/projects/perf_tests/feature_perf_cs_collection.py#L392 <511>: varats/varats/projects/perf_tests/feature_perf_cs_collection.py#L392
TODO: fix with commit after merge (fixme)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L80 <511>: varats/varats/experiments/vara/feature_perf_precision.py#L80
TODO: clean up (fixme)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L52 <223>: varats/varats/experiments/vara/feature_perf_precision.py#L52
Method '__call__' is abstract in class 'ProjectStep' but is not overridden in child class 'AnalysisProjectStepBase' (abstract-method)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L180 <246>: varats/varats/experiments/vara/feature_perf_precision.py#L180
Useless parent or super() delegation in method '__init__' (useless-parent-delegation)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L12 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L12
Unused Step imported from benchbuild.utils.actions (unused-import)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L12 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L12
Unused Compile imported from benchbuild.utils.actions (unused-import)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L12 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L12
Unused Clean imported from benchbuild.utils.actions (unused-import)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L25 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L25
Unused ExperimentHandle imported from varats.experiment.experiment_util (unused-import)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L25 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L25
Unused VersionExperiment imported from varats.experiment.experiment_util (unused-import)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L37 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L37
Unused RunVaRATracedWorkloads imported from varats.experiments.vara.feature_experiment (unused-import)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L37 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L37
Unused RunVaRATracedXRayWorkloads imported from varats.experiments.vara.feature_experiment (unused-import)
[pylint] varats/varats/experiments/vara/feature_perf_precision.py#L48 <611>: varats/varats/experiments/vara/feature_perf_precision.py#L48
Unused TEFReport imported from varats.report.tef_report (unused-import)
[pylint] varats/varats/tables/feature_perf_precision.py#L141 <511>: varats/varats/tables/feature_perf_precision.py#L141
TODO: double check ttest handling (fixme)
[pylint] varats/varats/tables/feature_perf_precision.py#L236 <511>: varats/varats/tables/feature_perf_precision.py#L236
TODO: check, maybe we need a "very small value cut off" (fixme)
[pylint] varats/varats/tables/feature_perf_precision.py#L244 <511>: varats/varats/tables/feature_perf_precision.py#L244
TODO: how to handle this? (fixme)
[pylint] varats/varats/tables/feature_perf_precision.py#L290 <511>: varats/varats/tables/feature_perf_precision.py#L290
TODO: same for TEF (fixme)
[pylint] varats/varats/tables/feature_perf_precision.py#L296 <511>: varats/varats/tables/feature_perf_precision.py#L296
TODO: check, maybe we need a "very small value cut off" (fixme)
[pylint] varats/varats/tables/feature_perf_precision.py#L304 <511>: varats/varats/tables/feature_perf_precision.py#L304
TODO: how to handle this? (fixme)
[pylint] varats/varats/tables/feature_perf_precision.py#L384 <511>: varats/varats/tables/feature_perf_precision.py#L384
TODO: multiple patch cycles (fixme)
[pylint] varats/varats/tables/feature_perf_precision.py#L489 <108>: varats/varats/tables/feature_perf_precision.py#L489
Lambda may not be necessary (unnecessary-lambda)
[pylint] varats/varats/tables/feature_perf_precision.py#L493 <108>: varats/varats/tables/feature_perf_precision.py#L493
Lambda may not be necessary (unnecessary-lambda)
[pylint] varats/varats/tables/feature_perf_precision.py#L498 <212>: varats/varats/tables/feature_perf_precision.py#L498
Access to a protected member __mean_time of a client class (protected-access)
[pylint] varats/varats/tables/feature_perf_precision.py#L503 <212>: varats/varats/tables/feature_perf_precision.py#L503
Access to a protected member __mean_ctx_switches of a client class (protected-access)
[pylint] varats/varats/tables/feature_perf_precision.py#L484 <238>: varats/varats/tables/feature_perf_precision.py#L484
Unused private member `OverheadData.__profiler` (unused-private-member)
[pylint] varats/varats/tables/feature_perf_precision.py#L3 <611>: varats/varats/tables/feature_perf_precision.py#L3
Unused import shutil (unused-import)
[pylint] varats/varats/tables/feature_perf_precision.py#L4 <611>: varats/varats/tables/feature_perf_precision.py#L4
Unused import tempfile (unused-import)
[pylint] varats/varats/tables/feature_perf_precision.py#L7 <611>: varats/varats/tables/feature_perf_precision.py#L7
Unused Path imported from pathlib (unused-import)
[pylint] varats/varats/tables/feature_perf_precision.py#L11 <611>: varats/varats/tables/feature_perf_precision.py#L11
Unused NoEscape imported from pylatex (unused-import)
[pylint] varats/varats/tables/feature_perf_precision.py#L17 <611>: varats/varats/tables/feature_perf_precision.py#L17
Unused FeaturePerfRunner imported from varats.experiments.vara.feature_perf_runner (unused-import)
[pylint] varats/varats/tables/feature_perf_precision.py#L18 <611>: varats/varats/tables/feature_perf_precision.py#L18
Unused load_tef_report imported from varats.jupyterhelper.file (unused-import)