# Disallow all crawlers access to certain pages. User-agent: * Disallow: /images Disallow: /books Disallow: /directory Disallow: /stats Disallow: /services Disallow: /top10 Disallow: /front Disallow: /magazines Allow: /