I do not think robot.txt file has anything to do with keywords, it just used to instruct robots about what part of your site they should crawl and what part should be left alone.
Regarding keywords, in what sense do you mean, are you talking about keywords in meta tags or keywords content of a page?
|