chore(code.angularjs.org): fix robots.txt

- allow all-versions-data.js in snapshot, which is used by docs.angularjs.org
- disallow access to folders like docs-0.9.2 etc which are used by early versions
This commit is contained in:
Martin Staffa
2018-02-05 12:38:44 +01:00
committed by Martin Staffa
parent fbe679dfbc
commit ea04dbb229
@@ -1,5 +1,6 @@
User-agent: *
Disallow: /*docs/
Disallow: /*docs*/
Disallow: /*i18n/
Disallow: /*.zip$
Allow: /snapshot/docs/js/all-versions-data.js