# ALL SEARCH ENGINES ALLOWED User-agent: * Allow: / # FULL DIRECTORIES BLOCKED Disallow: /page/ Disallow: /20081111/ Disallow: /live/ # GOOGLE ONLY User-agent: Googlebot # BLOCK GOOGLEBOT FROM CRAWLING ANY URL THAT INCLUDES A QUESTION MARK (?) # MORE SPECIFICALLY, ANY URL THAT BEGINS WITH YOUR DOMAIN NAME, FOLLOWED BY ANY STRING, FOLLOWED BY A QUESTION MARK, FOLLOWED BY ANY STRING Disallow: /*?