Zulip Chat Archive
Stream: lean-gptf
Topic: Asynchronous prediction handling
Jesse Michael Han (Jan 29 2021 at 21:37):
New feature: gptf
will now use tactic.run_async
to test the model's predictions simultaneously, which should lead to a faster overall response time.
Last updated: Dec 20 2023 at 11:08 UTC