Comments on: Search Engines: Three to Beware

By: Jonathan Bailey

Jonathan Bailey — Wed, 23 Apr 2008 14:22:55 +0000

Cybele: Let me know if it disappears. That will be one down at least!

By: cybele

cybele — Tue, 22 Apr 2008 19:03:11 +0000

After a second note to URL Fan, they say that they’ve removed my content. (But it hasn’t been 24 hours yet to see if there are any cached bits lying around.)

By: cybele

cybele — Tue, 22 Apr 2008 19:03:11 +0000

After a second note to URL Fan, they say that they’ve removed my content. (But it hasn’t been 24 hours yet to see if there are any cached bits lying around.)

By: Jonathan Bailey

Jonathan Bailey — Fri, 18 Apr 2008 19:55:55 +0000

Squirrel: Sadly, no. I can find out the IP address pretty trivially but I do not know the user-agent. I don’t think anyone has sought out that information. Since I use FeedBurner, I would not have access to it. If anyone out there with local feeds and is able to glean this information, it would be a huge help!

By: Jonathan Bailey

Jonathan Bailey — Fri, 18 Apr 2008 19:55:55 +0000

By: Squirrel

Squirrel — Fri, 18 Apr 2008 05:31:16 +0000

I’ve been feeding faux content to sploggers/scrapers using their “User Agent”. Are the user agents for these “questionable” search engines known?

By: Squirrel

Squirrel — Fri, 18 Apr 2008 05:31:16 +0000

I’ve been feeding faux content to sploggers/scrapers using their “User Agent”. Are the user agents for these “questionable” search engines known?

By: Jonathan Bailey

Jonathan Bailey — Thu, 17 Apr 2008 13:19:17 +0000

Cybele: I agree on all fronts. Blogdimension needs a great deal of work and so does URLFan. However, like you, I actually think they might have a valuable service buried in there somewhere. The problem is that you can't see it because the actual tool stinks and the infringement is kind of blinding.I don't really know if we need another blog search engine, but URLFan at least has something original, if they can clean up their act…

By: Jonathan Bailey

Jonathan Bailey — Thu, 17 Apr 2008 13:19:17 +0000

By: cybele

cybele — Thu, 17 Apr 2008 13:16:41 +0000

Blogdimension needs some sort of a copyright notice page and maybe some better About info. (Like the fact that it's in France would be good to know.)I did send them a request to be removed and much of my content is already gone (it's been about 24 hours). I still see some of my images in their image search, I don't know if that requires a separate request because they're hosted on flickr and not specifically on my site. URLFan has not responded to my request after 24 hours. (But I do kind of like the stats they show for individual posts.)