# Robots.txt for www.Do-Clan.de # by Do_Checkor, 2007-08-03 # we only allow a very few spiders to scan the sites because of server load. # if you want to contact me: mail robots.txt AT descentforum.de User-agent: Googlebot Disallow: /cam/ Disallow: /database/ Disallow: /dev/ Disallow: /guestbook/ Disallow: /lan_* Disallow: /newpage/ Disallow: /oldpage/ Disallow: /pix_* Disallow: /taunts/ User-agent: w3index Disallow: /cam/ Disallow: /database/ Disallow: /dev/ Disallow: /guestbook/ Disallow: /img/ Disallow: /lan_* Disallow: /newpage/ Disallow: /oldpage/ Disallow: /pix_* Disallow: /taunts/ User-agent: Lycos/x.x Disallow: /cam/ Disallow: /database/ Disallow: /dev/ Disallow: /guestbook/ Disallow: /img/ Disallow: /lan_* Disallow: /newpage/ Disallow: /oldpage/ Disallow: /pix_* Disallow: /taunts/ User-agent: Lycos_Spider_(T-Rex) Disallow: /cam/ Disallow: /database/ Disallow: /dev/ Disallow: /guestbook/ Disallow: /img/ Disallow: /lan_* Disallow: /newpage/ Disallow: /oldpage/ Disallow: /pix_* Disallow: /taunts/ User-agent: * Disallow: /cam/ Disallow: /database/ Disallow: /dev/ Disallow: /guestbook/ Disallow: /img/ Disallow: /lan_* Disallow: /newpage/ Disallow: /oldpage/ Disallow: /pix_* Disallow: /taunts/