Item1477: googlebot keeps trying to go to WebCreateNewTopic

Priority:	CurrentState:	AppliesTo:	Component:	WaitingFor:
Normal	New	Extension	PatternSkin	Main.WillNorris

googlebot still hits the *.WebCreateNewTopic every couple of minutes due to this line in PatternSkin that does not contain a rel="nofollow":

./_default/WebLeftBar.txt:   * [[%SCRIPTURLPATH{"view"}%/%BASEWEB%/WebCreateNewTopic?topicparent=%BASETOPIC%][ %ICON{"newtopic"}% %MAKETEXT{"Create New Topic"}%]]

(and in all of the other webs, too, of course)

-- WillNorris - 20 Apr 2009

I had actually edited the left bars and was about to check in the update when I wanted to double check the rel="nofollow" status.

Please read: http://en.wikipedia.org/wiki/Nofollow#Interpretation_by_the_individual_search_engines

Their conclusion is that rel="nofollow" will prevent indexing but Google and many others will still follow the link causing the trouble with extra load.

If this is true then there is no point in adding this. We should use some other countermeasure then.

-- KennethLavrsen - 14 Jun 2009

No action

-- KennethLavrsen - 16 Jun 2009

sounds like the solution is to add WebCreateNewTopic restrictions to robots.txt

-- WillNorris - 17 Jun 2009