Main menu:

Site search

February 2012
M T W T F S S
« Apr    
 12345
6789101112
13141516171819
20212223242526
272829  

Categories

Tags

Tag: Index

To disallow or to not disallow search result pages

So far no, depending on how your website is optimised but if the search pages pass flat links into your product pages then I think removing search result pages in the index is likely to remove product detail pages from the index.  Thats what experiements so far with client websites have shown.  But that this [...]

Google Webmaster Tools – Tools

Some great stuff if you’re not a natural sys admin or don’t know your way round a robots.txt:
Analyze robots.txt – See whether your robots.txt file blocks specific URLs as is, or with modifications you make. Test against various Google user-agents, too.  This will usually get picked up once a day, and the crawl rule as [...]

Google Webmaster Tools – Sitemaps

The surefire way to get more pages added to the index.  You can do this by uploading an xml file with options for web, mobile, code search (why anyone would I don’t know) and video. Just let Google know where it is.