The tool can be used to diff the results of two commits on a set of builders.
The user has to pick the revisions to ensure that both of them have results for the given revisions.
Unfortunately it currently seems to also give false-positive because of flaky tests.
Usage:
sdk % dart tools/diff_results.dart -b 'vm-*' 6cf71022a8 \
7df88e5755
...
language_2/control_flow_collections/if_promotion_test/none null -> (expected: Pass, actual: CompileTimeError)
on vm-dartkb-linux-{debug,release}-x64
on vm-kernel-asan-linux-release-x64
on vm-kernel-checked-linux-release-x64
on vm-kernel-linux-release-{simarm,simarm64}
on vm-kernel-optcounter-threshold-linux-release-{ia32,x64}
on vm-kernel-precomp-android-release-arm
on vm-kernel-precomp-bare-linux-release-{x64,simarm,simarm64}
on vm-kernel-precomp-linux-release-simarm
on vm-kernel-precomp-linux-{debug,release,product}-x64
on vm-kernel-precomp-obfuscate-linux-release-x64
on vm-kernel-precomp-win-release-x64
on vm-kernel-precomp-{mac,linux,win}-release-simarm64
on vm-kernel-reload-linux-{debug,release}-x64
on vm-kernel-reload-mac-{debug,release}-simdbc64
on vm-kernel-reload-rollback-linux-{debug,release}-x64
on vm-kernel-{linux,win}-{debug,release}-ia32
on vm-kernel-{mac,linux,win}-{debug,release,product}-x64
on vm-kernel-{mac,linux}-{debug,release}-simdbc64
Change-Id: Ibd3a0bdcec238c1fc0d147147b6fe4a7bb74819d
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/93954
Commit-Queue: Martin Kustermann <kustermann@google.com>
Reviewed-by: Siva Annamalai <asiva@google.com>
