Zulip Chat Archive

Stream: new members

Topic: Mahlib CI: time limit on test? Tactic running forever?


Adomas Baliuka (Oct 29 2023 at 22:04):

My current PR has its testing running now since almost an hour. Is there a time limit in place? (I hope there is)

I'm not sure why it's running so long. The new differentiability tactic I'm trying to build (based on Aesop) seems to run forever on a certain example. I'm assuming it runs into an endless loop somewhere but don't know how to debug it because it never ends. Usually, in such a situation I get either a stack overflow or the number of heartbeats runs out. I don't understand why this doesn't happen there and how to debug it.

Ruben Van de Velde (Oct 29 2023 at 22:05):

I checked my latest build and there it took 51 seconds, so that does seem like a long time

Ruben Van de Velde (Oct 29 2023 at 22:06):

Have you run the tests locally? CI does make -j 8 test

Adomas Baliuka (Oct 29 2023 at 22:09):

I canceled it now. It does not finish on my machine either (which might mean I shouldn't have pushed it in the first place, sorry about that, was hoping to get oleans). The real question though is: What is the time limit (assuming there is one) and how to debug something that just doesn't terminate?

Alex J. Best (Oct 29 2023 at 22:10):

Normally you would add some logInfo or dbg_trace statements to try and work out where it is looping I guess

Adomas Baliuka (Oct 29 2023 at 22:11):

It's an Aesop ruleset. Does that mean I should put these into the aesop sources while debugging?

Alex J. Best (Oct 30 2023 at 00:25):

If turning on aesop traces (it should have some built in) isn't enough to track it down then yes, but maybe you can just add the traces into your aesop rules as well?
(Normally in that situation I would copy paste the bits of the tactic i'm trying to debug into a new file. If you modify aesop directly you'll probably have to spend a lot of time waiting for all the files that depend on aesop to recompile. So making a copy that is only used for differentiability is usually faster. This sounds like quite a tricky thing to track down though)

Adomas Baliuka (Oct 30 2023 at 13:23):

The issue with the built-in traces is that they are only displayed (as far as I can tell) once the tactic either fails or succeeds.


Last updated: Dec 20 2023 at 11:08 UTC