http://www.gojdhl.com/seo-blog Internet Marketing Blog Mon, 06 Feb 2012 20:25:16 +0000 en hourly 1 http://wordpress.org/?v=3.3.1 http://www.gojdhl.com/seo-blog/googles-maximum-allowed-urls-in-robotstxt http://www.gojdhl.com/seo-blog/googles-maximum-allowed-urls-in-robotstxt#comments Fri, 16 May 2008 07:47:13 +0000 Jared Blake http://www.gojdhl.com/seo-blog/?p=24 I went searching for the answer to this question and the only thing I found was a comment on Matt Cutt’s blog in 2006 by a user stating he read somewhere inside Google sitemaps that the standard only allows 2000 characters. I don’t believe this to be the case now, as most of my files have been found and disallowed by Google and because of my recent site restructure, I currently have 4394 characters in my robots.txt file. Does anyone out there have the exact answer on this? I will try to post the question again to Matt Cutts.

]]> http://www.gojdhl.com/seo-blog/googles-maximum-allowed-urls-in-robotstxt/feed 0