Website Architecture For Better SEO
The following articles discuss ways in which your website’s overall structure can help – or hinder your SEO efforts.
Markus Sobek The Effect of the Number of Pages
Shari Thurow SEO and Successful Site Architecture
Digital Road Consulting Site Architecture Optimizing Tips
The main source for information on the robots.txt
Martijn Koster A Standard for Robot Exclusion
W3C Recommendation The robots.txt file
Jagdeep. S. Pannu Working With The robots.txt File
Daria Goetsch Site Maps and Hypertext Links – Spider Food for Search Engine Robots
