# robots.txt # #Replace all leading / with your shop directory name #Remove the # to activate additional blocks # User-agent: * Disallow: /uploads/ User-agent: Googlebot Disallow: /*.mp3 Disallow: /*.wma Disallow: /1*.asp Disallow: /2*.asp Disallow: /3*.asp Disallow: /4*.asp Disallow: /5*.asp Disallow: /6*.asp Disallow: /7*.asp Disallow: /8*.asp Disallow: /9*.asp Disallow: /1.asp Disallow: /2.asp Disallow: /3.asp Disallow: /4.asp Disallow: /5.asp Disallow: /6.asp Disallow: /7.asp Disallow: /8.asp Disallow: /9.asp Disallow: /payslip1.jpg Disallow: /payslip2.jpg Disallow: /payslip3.jpg # IF YOU DO NOT WISH TO HAVE THE GOOGLE IMAGE BOT SCAN YOUR DOMAIN FOR IMAGES # THEN YOU CAN INCLUDE THE FOLLOWING IN YOUR ROBOTS FILE. # I FOUND THAT MY BANDWIDTH USAGE DROPPED BY A MASSIVE AMOUNT AFTER I GOT RID # OF THE GOOGLE IMAGE BOT. ALL I HAD WAS IMAGE HUNTERS STEALING PRODUCT SHOTS # AND NOT EVEN BROWSING THE SITE. User-agent: Googlebot-Image Disallow: /