# PAGES AND DIRECTORIES THAT SHOULD NOT BE PARSED. User-agent: * Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /wp-content/ Disallow: /wp-includes/ Disallow: /brycedaniel/ Disallow: /delmendo/ Disallow: /evangerard/ Disallow: /gfx/ Disallow: /images/ Disallow: /media/ Disallow: /test/ Disallow: /xxx/ Disallow: /mt-static/ # STOPS GOOGLE FROM CACHING IMAGES. User-agent: Googlebot-Image Disallow: / # PREVENTS ARCHIVE.ORG FROM RETAINING OLD VERSIONS. User-agent: ia_archiver Disallow: /