Zsh Mailing List Archive
Messages sorted by: Reverse Date, Date, Thread, Author

Re: Why prevent the mailing list from being indexed?

2019-05-20 11:04:09 +0000, Daniel Shahaf:
> Stephane Chazelas wrote on Mon, 20 May 2019 10:30 +00:00:
> > I was surprised when a google search on the zsh mailing list
> > archives turned up nothing when I knew it should (site:zsh.org
> > ZSH_XTRACEFD) and then saw:
> > 
> > https://www.zsh.org/robots.txt
[...]
> > Disallow: /mla/zsh-workers/
[...]
> Note that it only disallows the directories that contain the raw rfc822
> files.  The rendered HTML indexes at /mla/workers/ aren't disallowed,
> so they should be implicitly allowed, shouldn't they?
[...]

Sorry, my bad. I missed that.

I can see now they are indexed indeed.

Like enteiser@xxxxxxxxx says, it's probably just that  they're
recent.

Cheers,
Stephane
Messages sorted by: Reverse Date, Date, Thread, Author