Item1477: googlebot keeps trying to go to WebCreateNewTopic
Priority: Normal
Current State: No Action Required
Released In: n/a
Target Release: n/a
googlebot still hits the *.WebCreateNewTopic every couple of minutes due to this line in
PatternSkin that does not contain a
rel="nofollow"
:
./_default/WebLeftBar.txt: * [[%SCRIPTURLPATH{"view"}%/%BASEWEB%/WebCreateNewTopic?topicparent=%BASETOPIC%][ %ICON{"newtopic"}% %MAKETEXT{"Create New Topic"}%]]
(and in all of the other webs, too, of course)
--
WillNorris - 20 Apr 2009
I had actually edited the left bars and was about to check in the update when I wanted to double check the rel="nofollow" status.
Please read:
http://en.wikipedia.org/wiki/Nofollow#Interpretation_by_the_individual_search_engines
Their conclusion is that rel="nofollow" will prevent indexing but Google and many others will still follow the link causing the trouble with extra load.
If this is true then there is no point in adding this. We should use some other countermeasure then.
--
KennethLavrsen - 14 Jun 2009
No action
--
KennethLavrsen - 16 Jun 2009
sounds like the solution is to add
WebCreateNewTopic restrictions to
robots.txt
--
WillNorris - 17 Jun 2009