Main menu:

Site search

March 2010
M T W T F S S
« Nov    
1234567
891011121314
15161718192021
22232425262728
293031  

Categories

Tags

Tag: Index

To disallow or to not disallow search result pages

So far no, depending on how your website is optimised but if the search pages pass flat links into your product pages then I think removing search result pages in the index is likely to remove product detail pages from the index.  Thats what experiements so far with client websites have shown.  But that this [...]

Google Webmaster Tools – Tools

Some great stuff if you’re not a natural sys admin or don’t know your way round a robots.txt:
Analyze robots.txt – See whether your robots.txt file blocks specific URLs as is, or with modifications you make. Test against various Google user-agents, too.  This will usually get picked up once a day, and the crawl rule as [...]

Google Webmaster Tools – Sitemaps

The surefire way to get more pages added to the index.  You can do this by uploading an xml file with options for web, mobile, code search (why anyone would I don’t know) and video. Just let Google know where it is.