Zulip Chat Archive

Stream: lean4

Topic: benchmark bot: Found no runs to compare against.


Scott Morrison (Aug 05 2023 at 10:57):

I am frequently finding that !bench reports: Found no runs to compare against.. e.g. see #6298. Does anyone have advice on what to do?

Sebastian Ullrich (Aug 05 2023 at 11:14):

Previous discussion: https://leanprover.zulipchat.com/#narrow/stream/270676-lean4/topic/speedcenter.20runs.20on.20master/near/379110179

Eric Wieser (Aug 05 2023 at 12:50):

One easy way to avoid this is to always start your branches from a master commit that has been benchmarked, rather than from HEAD

Kevin Buzzard (Aug 05 2023 at 15:35):

I was bumping branches to a recent master commit which has been benchmarked (e.g. by searching for mathlib in the speedcenter and then choosing the most recent commit to master which had been benchmarked) and then bumping my branch to that commit; this also seemed to work (although it might all depend on your merge algorithm...)


Last updated: Dec 20 2023 at 11:08 UTC