Test version... (Features)
Hello
OK but what exactly do you hope to achieve by this?
... what’s the use of crawling the site a couple of times (like following the link to 'User', etc.)? It just increases traffic.
I think, that's the only relevant question. Is it necessary to index a concrete page? If the answer is no, the page itself and any other pages should be prepared to ensure the non indexing of the page (robots.txt, meta elements, rel-attribute, ...).
Tschö, Auge