Google’s maximum allowed url’s in robots.txt?

I went searching for the answer to this question and the only thing I found was a comment on Matt Cutt’s blog in 2006 by a user stating he read somewhere inside Google sitemaps that the standard only allows 2000 characters. I don’t believe this to be the case now, as most of my files have been found and disallowed by Google and because of my recent site restructure, I currently have 4394 characters in my robots.txt file. Does anyone out there have the exact answer on this? I will try to post the question again to Matt Cutts.

Filed under SEO Info by on #

Leave a Comment

Fields marked by an asterisk (*) are required.

*
To prove you're a person (not a spam script), type the security word shown in the picture. Click on the picture to hear an audio file of the word.
Click to hear an audio file of the anti-spam word