User-Agent: * Disallow: /scripts/ Disallow: /modules/ Disallow: /styles/ Disallow: /lib/ Disallow: /layouts/ Disallow: /core/ Disallow: /cgi-bin/ Disallow: /3rdparty/