Avoiding duplicate search pages in Google

I have a website with a search on it with 4 drop downs. Each of these drop downs redirects back to the page in question but with a url parameter to tell it how to sort the results. The first drop down has 13 options and the other three have 4 options each. Of course Google sees duplicate content and eats my SEO for it.

I have been able to get the duplicated content down a little since the drop down containing the 13 options was a category sorter so I have used that to change the title on each page to help stop the whole duplicated thing, however the other 3 are pure sorters and cannot really be used to change the title of the page (and shouldn't be).

So I have come up with a solution:

  • Disallow the page (/search) in robots.txt
  • Add the 13 pages (from category sorter) to sitemap.xml, since they have separate titles it should work nicely.

The question is should I add a nofollow to the sorter links to stop Google from taking them or can the sitemap just index that url and not follow other links inside of it?

Or is there a better way?

Also as a side note:

If I have a URL in sitemaps.xml like:


But I have a robots.txt line like:

Disallow: /user/view

Can Google still index the sitemap url and is it a good practice to block access to dynamic pages like that?



A better way to handle this would be to use canonical URLs. This will tell Google which page is the "main" page and to include it in its index and that the other pages that are duplicates of it should be considered the same page (and not included in the search results). This prevents you from having to block pages or, worse, use nofollow on internal pages. In fact, in the blog post I linked to the examples they give are almost identical to your use case.

Use rel="canonical"

Need Your Help

system.linq to sum rows with same ID in gridview

c# linq datagridview

I have an issue with the same problem again but this time its with summing rows of the same ID in a gridview. I have two columns in my gridview named ID and quantity. the agenda is that i have to t...

CocoaPods: Installing a library that contains an embedded framework


When installing a library that contains an embedded framework, it seems that the framework needs to be linked to the application target manually.

About UNIX Resources Network

Original, collect and organize Developers related documents, information and materials, contains jQuery, Html, CSS, MySQL, .NET, ASP.NET, SQL, objective-c, iPhone, Ruby on Rails, C, SQL Server, Ruby, Arrays, Regex, ASP.NET MVC, WPF, XML, Ajax, DataBase, and so on.