User-agent: * Disallow: /image.php Disallow: /*.pdf Disallow: /*.doc Disallow: /*.xls