User-agent: * Allow: /html/ Disallow: /test/ Disallow: /asp/ Disallow: /assets/