Sebastian's Pamphlets

If you've read my articles somewhere on the Internet, expect something different here.


Please click the link above to read actual posts, this archive will disappear soon!

Stay tuned...

Thursday, August 11, 2005

Yahoo's Site Explorer

There is a lot of interesting reading in the SES coverage by Search Engine Roundable. Currently I'm a little sitemap addicted, thus Tim Mayer's announcement got my attention:
Tim announces a new product named Site Explorer, where you can get your linkage data. It is a place for people to go to see which pages Yahoo indexed and to let Yahoo know about URLs Yahoo has not found as of yet .... He showed an example, you basically type in a URL into it (this is also supported via an API...), then you hit explore URL and it spits out the number of pages found in Yahoo's index and also shows you the number of inbound links. You can sort pages by "depth" (how deep pages are buried) and you can also submit URLs here. You can also quickly export the results to TSV format.

Sounds like a pretty comfortable tool to do manual submissions, harvest data for link development etc. etc. Unfortunately it's not yet life, I'd love to read more about the API. The concept outlined above makes me think that I may get an opportunity to shove my fresh content into Yahoo's index way faster than today, because in comparison to other crawlers Yahoo! Slurp is a little lethargic:
Crawler stats
(tiny site)
Page Fetchesrobots.txt Fetches
Googlebot 775530 73.34 MB 11 Aug 2005 - 00:03
MSNBot16279839.86 MB10 Aug 2005 - 23:38
Yahoo! Slurp38520413.61 MB10 Aug 2005 - 23:53

I may be misleaded here, but Yahoo's Site Explorer announcement could indicate that Yahoo will not implement Google's Sitemap Protocol. That'll be a shame.

Tim Mayer in another SES session:
Q: "Is there a way to do the Google sitemaps type system at Yahoo?"
Tim: We just launched the feed to be able to do that. We will be expanding the products into the future.

Tags: ()
Share this post at StumbleUpon
Stumble It!
    Share this post at
Post it to



Post a Comment

Links to this post:

Create a Link

<< Home