Tag: amazon remembers

  • Kooaba and the Future of Image Recognition

    Kooaba and the Future of Image Recognition

    Recently I had the opportunity to talk to colleges and clients about an iPhone app called Kooaba. Kooaba is a visual image recognition platform, that has the ability to recognize real world objects, much like Google Goggles.

    I think that image recognition technology like this may become more prevalent… someday. One current, real world example of this is the Amazon Remembers feature in Amazon’s iPhone app – although it’s not live object recognition, users can still take pictures of products, and then have the collective group intelligence of Amazon’s Mechanical Turk network recognize the object, and return relevant shopping information.

    For live recognition, I don’t think that camera/image recognition/processing power/software development will advance fast enough to allow the US to completely leapfrog over the use high-res barcodes, like QR. QR will come to the US eventually, however when it does make it here, it may be a bit more evolved than when it initially gained traction in Japan. Live object recognition will come with the help of companies like Kooaba and Google, but it may take a bit for the reliability to be good enough for everyday usage. Other technologies such as RFID will also contribute.

    Finally, advances in MEMS technology has allowed manufacturers to build in more “world sensing” capabilities into their devices. This includes tilt sensors, gyros, compasses, and GPS chips. As these technologies develop even more, phone will be able to more accurately sense where, and what they’re looking at.

    Some related reading….

  • Amazon iPhone App’s “Amazon Remembers” Feature Works

    Amazon iPhone App’s “Amazon Remembers” Feature Works

    After installing Amazon’s new iPhone app, the first thing I tried was using the “Amazon Remembers” feature. The feature is supposed to allow users to snap pictures of stuff they need to remember – kind of like an ad-hoc scrap book or shopping list, and then have amazon keep the pics, to look through later. Additionally, Amazon performs some object recognition, and attempts to find the product in it’s catalog.

    I took a picture of a tube of Zicam on my desk at work, and, lo and behold, 10 mintutes later Amazon emailed me a link to the Zicam product page – both as an iPhone link, and as a normal browser link. The direct link to the product page, coupled with Amazon 1-click buying proved to be the perfect combo – I hit “Buy it with 1-Click”, and just like that, a box of Zicam tubes is being shipped to me tomorrow. Success!

    To shed some more light on how Amazon Remembers works – According to the blurb in the “What happens to my photos” screen in the iPhone App –

    When you take a photo using Amazon remembers, it is saved for you in the following places:

    • this application [sic]
    • your Amazon.com homepage [sic]
    • Your Lists (link available at the top right of any page on the Amazon.com site)

    We also use a community of real people to research your photo and try to match it to a similar product on Amazon.com.

    If we find a product similar to your photos within a day or two, the results will be associated with your photo. A numbered red circle will appear on the Remembers tab to let you know that a similar product is ready for you to view.

    In addition, we’ll notify you by sending you an e-mail to the address on file for your Amazon.com account. If you would like to stop receiving these e-mails, you may turn off Amazon Remembers e-mail notification from Your Account in this application.

    Amazon is apparently using a panel of real people to manually comb through the photos and assign product pages to them. Given how low-contrast my Zicam photo was, I’m not surprised that a real person had to take a look at the photo to figure out what it was. Perhaps this would be (or is.. no confirmation on that yet…) a great application of Amazon’s Mechanical Turk platform, which uses a form of crowdsourcing to grind through tasks only a human brain can handle. Amazon calls these tasks HITs – Human Intelligence Tasks.

    Now if the Zicam would only make this cold go away…