Sebastian's Pamphlets

If you've read my articles somewhere on the Internet, expect something different here.

MOVED TO SEBASTIANS-PAMPHLETS.COM

Please click the link above to read actual posts, this archive will disappear soon!

Stay tuned...

Monday, May 21, 2007

No search, more fun: Netscape spamming Google

Google dislikes crawlable SERPs. But Google still indexes huge chunks of SERPs, and to make it worse, these disliked URLs sometimes rank above other useless webspam from Amazon, Ebay, and cohorts on the very first search result page.

For example Netscape is still flooding Google's search index with crap as per the quality guidelines, which clearly state:
Use robots.txt to prevent crawling of search results pages [...] that don't add much value for users coming from search engines.
Netscape.com lacks a robots.txt, but how many patterns does it need to identify these pages as SERPs? Next search.netscape.com has a robots.txt, but it lacks a Disallow: / directive, respectively Disallow's of all their scripts generating search results.

Is it that simple to get gazillions of useless autogenerated pages ranking at Google? Indeed. Following the Netscape precedent every assclown out there can buy a SE-script, can crawl the Web for a bunch of niche keywords, and will earn free Google traffic just because he has "forgotten" to upload a proper robots.txt file and Google isn't capable of detecting SERPs. I mean when they don't run a few tests with Netscape-SERPs, where's the point of an unenforced no-crawlable-SERPs policy?

I just found another interesting snippet in Google's quality guidelines:
If a site doesn't meet our quality guidelines, it may be blocked from the index.
I certainly will not miss 1,360,000 URLs from a spamming site ;)

Labels: , , ,

Share this post at StumbleUpon
Stumble It!
    Share this post at del.icio.us
Post it to
del.icio.us
 


-->

3 Comments:

  • At Tuesday, May 22, 2007, Anonymous Anonymous said…

    Check this one: http://www.google.com/search?q=site%3Asearch.netscape.com%2Fsearch&num=100 - Netscape is filling Google's index with Google's index. Tsk Tsk!

     
  • At Friday, May 25, 2007, Blogger TopRank said…

    Hey Sebastian, you made the BIGLIST of search engine marketing blogs over at Online Marketing Blog :)

    Congrats and thanks for the original content!

     
  • At Friday, May 25, 2007, Blogger Sebastian said…

    Thank you Lee! And thanks for the compliment :)

     

Post a Comment

Links to this post:

Create a Link

<< Home