Update robots.txt for better indexing

smith558 · smith558 · commit f416c085bf24 · 2022-05-12T13:09:20.000+01:00
diff --git a/docs/robots.txt b/docs/robots.txt
@@ -1,4 +1,3 @@
 User-agent: *
-Allow: /
 
 Sitemap: https://learnyouahaskell.github.io/sitemap.xml

Original file line number	Diff line number	Diff line change
`@@ -1,4 +1,3 @@`
`1`	`1`	`User-agent: *`
`2`		`-Allow: /`
`3`	`2`
`4`	`3`	`Sitemap: https://learnyouahaskell.github.io/sitemap.xml`