Zulip Chat Archive

Stream: general

Topic: Better Mathlib build scaling on v4.19.0-rc2


Jannis Limperg (Apr 08 2025 at 07:57):

PSA: @Sebastian Ullrich's work on theorem-level parallelism speeds up Mathlib builds substantially on systems with many cores. Here are Mathlib build times on AWS c8g instances with different numbers of cores:

Instance type cores v4.19.0-rc2 v4.18.0
c8g 16 30m17s 30m15s
c8g 32 17m58s 19m36s
c8g 64 12m49s 16m1s
c8g 96 11m38s
c8g 192 12m51s

So we have no difference on 16 cores, but 32 got somewhat faster and on 64 there's a big difference. 96 and 192 are still not worth it.

I also tested different AWS instance types. c8g (Gravitron, ARM64) seems to be consistently the fastest. For x86, c7a (AMD) is much faster than c7i (Intel) or any of the other c* instances.

(Disclosure: I work for AWS now.)


Last updated: May 02 2025 at 03:31 UTC