Search engine indexing

Stream: Zulip meta

[Jason Rute]

I’ve noticed that Google doesn’t seem to index this Zulip, even the public channels. For Lean, this makes it hard to search for Lean content? (I haven’t done extensive experiments or tried Bing or DuckDuckGo.) Does anyone know why? Is it intentional (because data is really valuable to AI companies like Google)? Is it a decision by the Lean community? By Zulip? Or is it just bad SEO?

[Jason Rute]

I just did more testing, even with “site:zulipchat.com”, I can’t get Google/Bing/DuckDuckGo to link to a public Lean channel.

[Jason Rute]

The mirror https://leanprover-community.github.io/archive/ is indexed, but that hasn’t been used in a year.

[Floris van Doorn]

Yes, this is really annoying.
Previous discussion: https://leanprover.zulipchat.com/#narrow/channel/236604-Zulip-meta/topic/web.20public.20streams/near/263532499

[Floris van Doorn]

Zulip issue: https://github.com/zulip/zulip/issues/21881