Commit 22998197 authored Nov 22, 2011 by John Crepezzi

Added robots.txt

parent 5b66695c

TODO

+0 −1

Original line number	Diff line number	Diff line
		@@ -6,7 +6,6 @@ add link to about page
		allow power users to force highlight lang - by supplying an extension!!!!!!
		maybe start serving highlighting on the other end to save transfer on highlight.js
		start using CDNs for most assets
		robots.txt nofollow
		kick expiration back by increment on each view

		# shared version only

static/robots.txt

0 → 100644

+2 −0

Original line number	Diff line number	Diff line
		User-agent: *
		Disallow: /