User-agent: * Disallow: admin Disallow: cgi-bin Disallow: core Disallow: images Disallow: js