[LINK] The Internet Archive

[Carl Makin]

On Fri, 26 Oct 2001, Robin Whittle wrote:

> This article:
>
> > http://www.latimes.com/business/la-000085039oct25.story
>
> is clueless because it does not mention the URL of the site:
>
>    http://www.archive.org
>
>
> I took a quick glimpse and it seems most impressive.  My sites are
> archived, with graphics - with quite snapshots every month or two, with

Even more impressive is they are respecting robots.txt.  I tried my main
site and got;

-----------------------------------
Error 13 -- Robots.txt Query Exclusion.

We're sorry, access to http://offprompt.stagecraft.cx/ has been blocked by
the site owner via robots.txt.
-----------------------------------

I think I'll modify my robots.txt file and let them in.


Carl.