perf test: Rerun failed metrics with longer workload
authorWeilin Wang <weilin.wang@intel.com>
Tue, 20 Jun 2023 17:00:27 +0000 (10:00 -0700)
committerNamhyung Kim <namhyung@kernel.org>
Thu, 22 Jun 2023 05:24:26 +0000 (22:24 -0700)
commit1203a63da0461d0081ea6e3d5e52893985bfed42
tree492b6f9d34281124952f30a3da8e3f5700d3fd4e
parenta0f1cc18f91faf75a321135ac08385a4f260a87d
perf test: Rerun failed metrics with longer workload

Rerun failed metrics with longer workload to avoid false failure because
sometimes metric value test fails when running in very short amount of
time. Skip rerun if equal to or more than 20 metrics fail.

Signed-off-by: Weilin Wang <weilin.wang@intel.com>
Tested-by: Namhyung Kim <namhyung@kernel.org>
Cc: ravi.bangoria@amd.com
Cc: Ian Rogers <irogers@google.com>
Cc: Peter Zijlstra <peterz@infradead.org>
Cc: Adrian Hunter <adrian.hunter@intel.com>
Cc: Caleb Biggers <caleb.biggers@intel.com>
Cc: Perry Taylor <perry.taylor@intel.com>
Cc: Samantha Alt <samantha.alt@intel.com>
Cc: Arnaldo Carvalho de Melo <acme@kernel.org>
Cc: Jiri Olsa <jolsa@kernel.org>
Cc: Kan Liang <kan.liang@linux.intel.com>
Cc: Ingo Molnar <mingo@redhat.com>
Link: https://lore.kernel.org/r/20230620170027.1861012-4-weilin.wang@intel.com
Signed-off-by: Namhyung Kim <namhyung@kernel.org>
tools/perf/tests/shell/lib/perf_metric_validation.py