# robots.txt 4 codespinners.com /// pgibson @ codespinners.com /// for constructive criticism # /// I_LOVE_SPAM@127.0.0.1 /// spamalot /// User-agent: * .....Disallow: 21* ## ////////////// ## ## // 04012003 // ## ## ////////////// ## Disallow: *.xls Disallow: *.mdb Disallow: *.pdf Disallow: *.doc Disallow: *.zip Disallow: *.txt Disallow: *.java Disallow: *.inc Disallow: *.class Disallow: *.gif Disallow: *.bmp Disallow: *.jpg Disallow: *.swf Disallow: *.mp3 Disallow: *.css Disallow: admin/ Disallow: ad*/ # Disallow: uptime.txt Disallow: images/ Disallow: doc/ Disallow: shared/ Disallow: css/ Disallow: inc/ Disallow: swf/ Disallow: xmltest/ Disallow: set* Disallow: _*/ Disallow: dat*/ Disallow: club.*/ Disallow: !* Disallow: my* Disallow: mail* Disallow: email* Disallow: log* Disallow: club* Disallow: task* Disallow: 7* Disallow: 21* ## ////////////// ## ## // 04012003 // ## ## ////////////// ##