Zulip Chat Archive
Stream: general
Topic: Better Mathlib build scaling on v4.19.0-rc2
Jannis Limperg (Apr 08 2025 at 07:57):
PSA: @Sebastian Ullrich's work on theorem-level parallelism speeds up Mathlib builds substantially on systems with many cores. Here are Mathlib build times on AWS c8g
instances with different numbers of cores:
Instance type | cores | v4.19.0-rc2 | v4.18.0 |
---|---|---|---|
c8g | 16 | 30m17s | 30m15s |
c8g | 32 | 17m58s | 19m36s |
c8g | 64 | 12m49s | 16m1s |
c8g | 96 | 11m38s | |
c8g | 192 | 12m51s |
So we have no difference on 16 cores, but 32 got somewhat faster and on 64 there's a big difference. 96 and 192 are still not worth it.
I also tested different AWS instance types. c8g
(Gravitron, ARM64) seems to be consistently the fastest. For x86, c7a
(AMD) is much faster than c7i
(Intel) or any of the other c*
instances.
(Disclosure: I work for AWS now.)
Last updated: May 02 2025 at 03:31 UTC