User-agent: * Disallow: /assets Disallow: /*.php$ Disallow: /webfiles