Tineye: Protecting Images, Preventing Orphans

One of the greatest challenges facing artists when it comes to protecting their work is finding infringements.

This is difficult because search engines, including image search engines, are designed to look for text, not pixels. Though you can look up the title of an image, the filename or even metadata within the image, if that information was changed by a site reusing your work, it has traditionally escaped detection.

Though the technology has existed in various forms, there has never been a search engine available to the public that could take an image and look for other ones like it. That is, until Tineye.

Tineye works differently than any other image search engine. It doesn’t ask you for words or even a description. Instead, you upload an image and it returns results similar to that picture. It is fast, easy to use and, most importantly, effective.

However, there are limitations to Tineye, especially in its current form. Though artists have many reasons to celebrate, the dancing likely won’t commence for some time.

How Tineye Works

For the purpose of this demonstration, I am going to use a standard Google Logo, specifically, this image:

First, after accessing your Tineye account, you upload the image from your computer to the service.

Tineye then converts the image into a fingerprint and begins matching that fingerprint against others in its database, which currently has over 700 million images.

After it is done, Tineye returns the results, starting with the images most similar to the one you submitted, for example, the image to the left. In this case, Tineye found over 3000 matching images, the first one being an exact copy of the image I had used.

Tineye Results

However, the real magic of Tineye is not in its ability to detect images that are identical, but to detect those that are similar, but altered. This includes images that have been resized, cropped, edited or otherwise changed. As long as enough of the original work is left behind for Tineye to understand what it is, it can report the altered version.

As you can see below, in a screen capture from page 23 of the results, that often includes very heavily altered versions of the original work.

In addition to helping you find altered version of your original image, Tineye also helps you see what was changed. For each image you see, you’re able to do a comparison where you can flip back and forth between your image and the one on the Web, noting both similarities and differences easily.

Also, from the search results, you can visit the URL the image is located on, making it easy to follow through and, if appropriate, take action against any infringement.

The site also offers a Firefox/IE plugin that allows users to perform Tineye searches from any page on the Web, thus eliminating the need to download the image first.

Why this is Important

To be fair, Tineye is not the first to attempt and succeed at this kind of matching. Other companies, including both Digimarc and Picscout, have long offered similar matching services that work without text.

However, Tineye is the first to offer a robust image matching service that is free for everyone (at least as of this writing) and is simple enough to use so that artists can take advantage of it on a whim. There is no watermarking, no technology to apply to your images, just a simple upload and search.

As I see it, this has three potential implications that are both very large and very welcome:

  1. Copyright Protection: The most clear use is for artists to punch their images into the service and receive results, thus enabling them to track down potential infringements of their work. They can then take action to secure removal of the images or request attribution.
  2. Image Tracking: Some images, including buttons and banners, are put on the Web with the intention of them being shared and passed around. Tineye can track the effectiveness of such a campaign and determine how many sites are displaying the image in question.
  3. Orphan Works Protection: Assuming that the current orphan works legislation gets passed either as is or with only a few modifications, finding a way to search for visual work is critical. Tineye can do that. If one found a work that they thought might be an orphan, they could run it through Tineye, even scanning it in if necessary, and search for copies of it on the Web, letting them track down the copyright holder. If such a tool were effective, any qualifying search would almost certainly require such an effort be made.

In short, Tineye can help bring visual artists up on par with writers in tracking their content and being able to have their work easily searched. For this reason, Tineye has already garnered several big name clients, including the Associated Press, Digg and more.

Limitations

Of course, as with any new service, there are limitations to how effective it is. However, in Tineye’s case, those limitations appear to only be temporary and should be fixed as the service grows in size and adds features.

  1. Limited Index Size: Currently, the Tineye database is at about 700 million images. While that is an impressive number, one has to remember that Photobucket alone has over 5 billion images according to their numbers. The site does not seem to detect duplications on Photobucket, Flickr or other popular image sharing sites, focusing instead on blogs. Thus, many images that are known to have many copies return no results. Though Tineye has stated that they are growing their database, the number in the index has not moved in the weeks I have been using the service and no indication was given as to when they would start indexing new images.
  2. No Case Tracking: Currently, with Tineye, there is no way to track cases of plagiarism or copying so that they are not acted upon a second time. Though the site does a respectable job finding duplicate images, it does little to help the artist sort through the mess. The good news is that this is a feature Tineye has expressed a willingness to implement later.
  3. No Alerts System: Where writers have Google Alerts and even CopyAlerts, there is currently no system in Tineye that will alert artists to new copies of their work being posted. Once again, this is a feature Tineye has expressed an interest and willingness in adding later.

In short, Tineye is not the system artists have been waiting for today, but it definitely has the potential to be that system in the near future.

If Tineye can continue growing and improving its service, it can easily solve a problem that has had artists struggling to protect their work for well over a decade.

Conclusion

Even though Tineye is a great service with tons of potential, in its current format with the existing limitations, it is little more than a preview of what is to come.

Though you should definitely consider registering for the Tineye beta, if nothing else than to pass along your thoughts to the creators, you should realize that the searches you perform will, for the most part, be ineffective. That will hopefully change soon though.

Tineye, right now, is not intended to be the solution to the problem, but rather, a preview of the solution. So if you want to search for your images and immediately find out who has copied all of your work, Tineye, right now, is not for you.

But if you want to see what might be coming down the pipe, definitely check it out.

Related Links

Arstechnica – Another test case
The Inquisitr – An overview of Tineye
Anniebee’s Posterous – An example where Tineye worked)
Daily Tech Report – Another Tineye overview

Further Discussion

  1. How will you use Tineye?
  2. What features would you like to see added?
  3. How do you think image rippers will respond to this kind of search?

Video

28 Responses to Tineye: Protecting Images, Preventing Orphans

  1. cybele says:

    I’ve not found much that’s actionable via TinEye so far. I’d love a batch feature, or some sort of synergy with Flickr that it could give me alerts when photos in my public stream have matches.

    Well, and I’d like them to spider Flickr, Photobucket and Blogger as those are huge image reservoirs.

    I do like the firefox extension that allows me to right click on any image to search.

  2. I have to agree that I didn’t find much actionable either. I ran through images created by both my wife and several friends with no matches found. Not a shock though, Tineye admits they have a long way to go in indexing images.

    Hopefully they can get on that, there is a lot of potential here!

  3. MacBros says:

    I’ve been using this since it opened up awhile back. I was invited to be a tester sorta’.

    I have the FF plugin that allows you to right click an image and select Tineye search on the image you’re looking up.

    I’ve only found 1 photo shop image I made get stolen. The other person put a watermark image of their URL as if they were the one who made it.

    I took a screen shot of the original Photoshop image open in Photoshop. For some reason they stopped e-mailing me and their post had dissipated.

    I must have scared them into removing it. LOL :p

  4. [...] This is a useful method for a photographer who posts images on the web to check if there have been any copyright infringements. TinEye is currently in beta thus their database is still rather small though it will probably grow exponentially with time. TinEye could prove to be a worthwhile tool in the near future. A more detailed overview and analysis of TinEye can be found here. [...]

  5. Must have freaked them out pretty hard. It seems that text plagiarists almost expect to get caught in the era of Google, however, for image plagiarists, this is kind of a new thing.

    The reactions will be most interesting…

    Thank you for sharing your story!

  6. Excellently written, and yes they have a long way to go, but so far we're getting more rips reported and removed on deviantART because of TinEye. They do need to work on more sites where images are posted (deviantART, Photobucket, Flickr, etc…), and think about adding in a time stamp so the user can see what images are older.

    The Firefox add-on is a lot of fun, I don't even have to leave sites anymore.

    I don't know how the thieves will react, but I'm sure it will be Encyclopedia Dramatica worthy. :)

  7. Glad you liked the post. They have a long way to go but they have already come a long way as well. All in all, I think there's a lot of reason to be optimistic about this site.

    But yes, I do agree, the reaction will be Encyclopedia Dramatica worthy when it is said and done.

    Speaking of which, I need to do my post about plagiarist reactions.

  8. Khawla says:

    I remember discussing the possibility of having a search engine that looks for similar images to the one we upload to it. I will try the Tineye service and see.

  9. Definitely give it a try and let me know what you think!

  10. Stevo says:

    Amazing! Thanks for the info, I'll have to look into this.

  11. [...] Bailey at PlagiarismToday posted a great review of the possibilities and current limitations of TinEye. This is technology that all photographers [...]

  12. Hope it works out well for you!

  13. SAMDEL says:

    Thank you for this insightful article. I've been aware of Digimarc, but it's not really affordable. The Orphan Works issue can have devastating results for artists, particularly those that are new and have little resources to stay abreast of infringements. To date, the Orphan Works bills have not addressed a viable solution that would take into account an evergrowing threat to artistic integrity and copyright protection.

    While I have issues with government intervention, as an artist this is one situation where I believe the governement needs to step in and be the “clearinghouse” to registration. We can't very well expect technology to offer a free solution for artists, but companies like Tineye might afford the services to government that artists need. As noted, Tineye is not there yet, and by that we shouldn't assume that the evolution of technology won't eventually solve the “identification” and “tracking” challenges. However, by that point they would have invested resources for which they should be duly compensated. The question then is whether or not at that point it will be affordable…

  14. I agree that the orphan works bill is worrisome for many reasons and that the government needs to do more to prevent works from becoming orphaned. However, I think that Tineye is proof that technology is catching up to the problem faster than we previously thought it would. This actually a very positive sign.

    Since Tineye is already sharing its technology with other companies, I see little reason why it couldn't partner with the USCO to help with the orphan works issue. I grant, it isn't a perfect solution, but there is a serious problem with orphan works and though such a solution might not be an elegant one, it's better than what we have.

    I'm going to be very interested to see what this company does over the next few months…

  15. [...] Plagiarism Today has a post on Tineye: Protecting Images, Prevening Orphans [...]

  16. [...] Tineye impressed me with its technology but disappointed me with its database (Note: Tineye has added 200 million more images since the first review was written), I was excited [...]

  17. [...] In this prediction I said that 2008 will be the year that “image search grows up and we can actually detect duplicate images on the Web even if the file has been renamed, has had the EXIF data changed or has been altered.” Indeed, that did happen in 2008, one needs look no farther than Tineye. [...]

  18. david says:

    There's a neat way to use tineye to find your avatar's identical twin:http://www.ehow.com/how_4875324_avatar-twin.htmlNot quite protecting the world from plagiarism, but still, it's kind of funny.

  19. [...] appears that, despite its limitations, Tineye is still the clear winner in detecting image [...]

  20. [...] a major step in the right direction on that front but its limited database, about 1.2 billion has hindered its ability to be comprehensive (Facebook, Photobucket and Flickr alone combine for over 18 billion [...]

  21. [...] Though somewhat limited, Tineye is the best visual search engine available and definitely the best free search. Great for [...]

  22. [...] an impressive sample. Tineye has over a billion images and is growing very rapidy and, even then, it doesn’t escape criticism from me for not catching all infringements. While it is true that the Image IRC database doesn’t have to be as large as Tineye’s [...]

  23. [...] Plagium (previous coverage). If you want to check your images for plagiarism, there’s Tineye (previous coverage).But what about your Twitter stream? Up until now there has been precious little.However, Robby [...]

  24. Tony says:

    Today found a stolen image of mine on a management consultancy website. Respectable looking UK outfit. The Wayback Machine shows use since 2007. RESULT!!!!!! I am a stock photographer (not micro) and it must have been lifted from one of my Agencies. Hopefully a nice payment will be coming my way.

  25. [...] have come online for the express purpose of tracking duplicate images. Though, most notably, this has included Tineye, other search engines, including Google, have gotten in on the act as [...]

  26. [...] Search, for example has a tool to track similar images based on appearance and services such as Tineye have tracked duplicate images on the Web for [...]

  27. […] searching for duplicate images has been effective online and much more recent that services like Tineye and Google Image Search have brought that technology to a point where individuals can use it from a […]

  28. […] Your Content: Though most photographers know to watch Google Image Search, Plaghunter or Tineye for their images, it’s important to look at text too. Tooks like Copyscape and PlagSpotter […]

Leave a Reply

STAY CONNECTED