Memorizing transformers

Stream: Machine Learning for Theorem Proving

[Jason Rute]

Also, see this talk by @Yuhuai Tony Wu on Memorizing Tranformers at the New Tech in Math seminar: https://www.youtube.com/watch?v=5AoOpFFjW28. He lays out a good case for how it could be used for theorem proving (and the challenges still to be solved to make it usable for that case).

[Jason Rute]

@Adam Topaz Maybe we should move the discussion on Memorizing Transformers to its own topic.

[Adam Topaz]

@Jason Rute Done!