Comments on: Removing Supplementals in Wordpress or Other Sites

By: Horoscop

Horoscop — Thu, 25 Oct 2007 17:48:57 +0000

@Ant Eksiler
@Stuart

If on your’s 19300 pages you put some simple content,some comments and the image page has got his own title and links point to some pages from your site/blog.. your traffic will grow a lot

By: Stuart

Stuart — Sun, 15 Apr 2007 23:18:08 +0000

It depends, how much traffic do you get from Google Images & is it more beneficial to get that sort of traffic or organic traffic to your main pages?

Excluding the gallery pages will increase rankings for your main pages.

By: Ant Eksiler

Ant Eksiler — Sun, 15 Apr 2007 17:22:58 +0000

on my website, I have about 19,300 pages index and most of it is from the galleries which have no real content only images.

ps: my galleries are domain.com/gallery/subgallery/picname.html

should I exclude them from the index? Will this result in higher google traffic? what about google image traffic?

By: Stuart

Stuart — Thu, 22 Mar 2007 11:30:43 +0000

Normally within 24 hours

By: TJP @ Investor Trip

TJP @ Investor Trip — Thu, 22 Mar 2007 10:22:30 +0000

I made the changes to my robots.txt file, but for some reason my file disappears from my server. I don’t know what’s going on.

How long does it take for Google to read your robots.txt again?

By: Stuart

Stuart — Sun, 18 Feb 2007 10:34:47 +0000

Well I use a tagging system & it uses the index.php string. Not entirely sure if that would have an adverse effect on the other listings though.

By: infonote

infonote — Sun, 18 Feb 2007 09:35:30 +0000

” User-Agent: Googlebot
Disallow: /index.php
Disallow: /category/
Disallow: /feed/
Disallow: /feed

User-agent: *
Disallow: /wp-
Disallow: /trackback/
”

I cannot understand why you disallowed the index.php?

Can you please explain why?

TIA

By: How to Stay Out of Google Supplemental Results (or Pull Yourself Out) | Blog Posts

Thu, 15 Feb 2007 16:32:04 +0000

[...] Check out and dig the massive SEM flavor of Removing Supplementals in Wordpress or Other Sites. [...]

By: Samuel

Samuel — Thu, 15 Feb 2007 12:19:38 +0000

Since you say that, so can I say that the robots.txt that you gave us will still allow our feedburner links to be indexed?

By: Stuart

Stuart — Wed, 14 Feb 2007 03:51:57 +0000

No way, use your feedburner page to your advantage. They rank pretty well

By: Samuel

Samuel — Wed, 14 Feb 2007 03:18:32 +0000

Thanks again!

I use feedburner, should I restrict feedburner links from begin indexed?

With regards to:
http://www.earnersblog.com/methods/rss-feeds-for-backlinks

By: Stuart

Stuart — Tue, 13 Feb 2007 10:12:42 +0000

Needs to be in the root domain.com

Then you tell it in the robots.txt to restrict stuff in the /blog/ directory.

By: Samuel

Samuel — Tue, 13 Feb 2007 09:24:02 +0000

If my blog is domain.com/blog, do I upload the robots.txt on domain.com/blog or domain.com?

By: Samuel

Samuel — Tue, 13 Feb 2007 09:18:24 +0000

Thanks!

By: Stuart

Stuart — Tue, 13 Feb 2007 08:06:20 +0000

Robots.txt should be in the root of your domain.

If your blog is in a sub directory say http://www.yourdomain.com/blog/ then you need to put /blog/ infront of each of the queries in robots.txt

Stu

By: Samuel

Samuel — Tue, 13 Feb 2007 07:38:43 +0000

Just a quick question from a not-so-technically-savy guy…..

So I copy the text given above, save it as robots.txt, then which folder do I upload it to?

Thanks in advance

By: Garrett

Garrett — Sat, 10 Feb 2007 14:24:59 +0000

My site isn’t in Wordpress, but I think I can still incorporate/test a lot of the suggestions. Thanks.

By: Clarke

Clarke — Sat, 10 Feb 2007 05:40:30 +0000

Thanks for the great tip. I am going to make sure to put it in place on my blog.

By: Stuart

Stuart — Sat, 10 Feb 2007 01:19:06 +0000

Hi Garrett, there's loads of other ways to help the spiders find your other pages without Category Pages. Check out this post on Internal Linking Structures for Wordpress.

By: Garrett

Garrett — Fri, 09 Feb 2007 19:06:18 +0000

I think I’ve got a fairly similar setup to the one you described (several category pages), but I’m a little confused. Here’s what I got:

Homepage (with links to category pages) > Category pages (with links to individual product pages)

If I disallow my category pages won’t that stop the bot from finding my item pages (since item pages are only linked to from the category pages)? I’ve got too many items to link them from the homepage (thus the need for category pages in the middle).

Thanks.

By: Ben Cruikshank

Ben Cruikshank — Fri, 09 Feb 2007 13:39:20 +0000

Cool, thanks for the tip. I had noticed recently that I’ve been getting supplemental results so this was great timing. I have implemented this robots.txt with a couple tweaks, so we’ll see how quickly I get out of supplemental.

Ben
http//idleprofit.com