perf test: Add metric value validation test
authorWeilin Wang <weilin.wang@intel.com>
Tue, 20 Jun 2023 17:00:25 +0000 (10:00 -0700)
committerNamhyung Kim <namhyung@kernel.org>
Thu, 22 Jun 2023 05:23:32 +0000 (22:23 -0700)
commit3ad7092f5145aab4118f575b57f0ab1707b1cd36
tree6d0070fada45e02147dfaa8deccaf02fe1c5516d
parent362f9c907fd8c2be3d5c5686ea787bca25443cdc
perf test: Add metric value validation test

Add metric value validation test to check if metric values are with in
correct value ranges. There are three types of tests included: 1)
positive-value test checks if all the metrics collected are non-negative;
2) single-value test checks if the list of metrics have values in given
value ranges; 3) relationship test checks if multiple metrics follow a
given relationship, e.g. memory_bandwidth_read + memory_bandwidth_write =
memory_bandwidth_total.

Signed-off-by: Weilin Wang <weilin.wang@intel.com>
Tested-by: Namhyung Kim <namhyung@kernel.org>
Cc: ravi.bangoria@amd.com
Cc: Ian Rogers <irogers@google.com>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Adrian Hunter <adrian.hunter@intel.com>
Cc: Caleb Biggers <caleb.biggers@intel.com>
Cc: Perry Taylor <perry.taylor@intel.com>
Cc: Samantha Alt <samantha.alt@intel.com>
Cc: Arnaldo Carvalho de Melo <acme@kernel.org>
Cc: Jiri Olsa <jolsa@kernel.org>
Cc: Kan Liang <kan.liang@linux.intel.com>
Cc: Ingo Molnar <mingo@redhat.com>
Link: https://lore.kernel.org/r/20230620170027.1861012-2-weilin.wang@intel.com
Signed-off-by: Namhyung Kim <namhyung@kernel.org>
tools/perf/tests/shell/lib/perf_metric_validation.py [new file with mode: 0644]
tools/perf/tests/shell/lib/perf_metric_validation_rules.json [new file with mode: 0644]
tools/perf/tests/shell/stat_metrics_values.sh [new file with mode: 0755]