Some of our topics are hardly ever hit by real humans but robots hit these things occupying a noticeable amount of CPU time.

bots and spiders are easy to deal with. the overview:

• make a simpler skin
• publish a static version of the pages using PublishPlugin
• use apache rewrites to send them to the published version

-- irc:pharvey, SvenDowideit, WillNorris (ed.)
( from http://irclogs.foswiki.org/bin/irclogger_log/foswiki?date=2009-06-03,Wed&sel=290#l286 )

---

so far everyone's resisted the urge to write docco on that. please help expand the details i can envision this setup information added to ApacheConfigGenerator at some point, as well

---

This topic: Support > SupplementalDocuments > PerformanceSupplement > ManagingServerLoadFromSpiders
Topic revision: 06 Jun 2009, WillNorris

---