robots.txt do not crawl: (fixes pmt #74726)

zmustapha · Aug 9, 2011 · 4f9ff26 · 4f9ff26
1 parent 281c9a2
commit 4f9ff26
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/media/robots.txt b/media/robots.txt
@@ -0,0 +1,2 @@
+User-agent: *
+Disallow: /