User-agent: * # directed to all spiders Disallow: /generateditems/ Disallow: /css Disallow: /logs Disallow: webpfleger_bitte_lesen.txt Disallow: /x_tests/