[LINK] Latency in indexing robots

Antony Barry tony at tony-barry.emu.id.au
Wed Dec 6 13:49:38 AEDT 2006


As I think I mentioned I've been playing around with pmwiki <http:// 
www.pmwiki.org/> on my web site.

By default it adds a meta tag to each page.

<meta name='robots' content='noindex,nofollow' />

to each page. I've now got to the stage where I _want_ my new pages  
to be indexed but not the pmwiki documentation which comes with the  

I changed the section with my pages to

<meta name='robots' content='index,follow' />

About 36 hours ago but so far no robots are picking up -


and it's linked pages.

I've triple checked that the pages have the right meta tags.

Does anybody have any idea of the sort of delay before the robots  
will come back and try the pages again??


phone : 02 6241 7659 | mailto:me at Tony-Barry.emu.id.au
mobile: 04 1242 0397 | mailto:tony.barry at alianet.alia.org.au

More information about the Link mailing list