|Description||Visual Search and Data Mining|
What is KaaM?
KaaM is a video / image-based search technology for mobile devices. Unlike â€œvisual searchâ€ tools that simply upload a picture from the phone to the web and return standard search results, KaaM idetifies objects and overlays information on top of the video or image in real time – much like the heads-up display (HUD) systems used fighter jets.
How does KaaM work?
KaaM has 2 parts â€“ a mobile client (an â€œappâ€), and a server-based search system. KaaM leverages the powerful CPUs and graphics processor units (GPUs) present (but under-utilized) in the majority of modern smartphones. As video is shot, the KaaM client identifies objects within the image using a variety of techniques (color, size, shape, etc., etc.).
To perform the real time information overlay, rather than streaming the entire video to the server, KaaM merely sends subset of reference data about the objects. This data is captured by the KaaM server, and turned into a complete search, which is then returned to the client and laid on top of the video itself. Because the KaaM reference data is only a tiny fraction the size of the video itself, the overlaid information can be made fully interactive (i.e., â€œtap for more infoâ€) with a near imperceptible delay.
How can KaaM be used?
Start the KaaM app on your smartphone and point the camera at something. As you sweep the scene, KaaM identifies the location and the objects (buildings, trees, cars, bottles, etc.), overlaying that information on top of the screen in real time. Stop sweeping and focus the camera on a single object, KaaM will highlight the object and produce more details on it.
For example, letâ€™s say you want to know about real estate in a particular city. Simply pan your smartphoneâ€™s camera across the area in which youâ€™re interested. KaaM will identify the city and the objects within it as you move the camera. Stop your camera on a building and KaaM will highlight the object and deliver more information â€“ the building (Riverview Condominium High Rise), address & directions, things nearby (schools, retail, restaurants), real estate prices and listings within the building, etc. Tapping the additional information on the videoâ€™s KaaM overlay will open your phoneâ€™s browser and take you to that information on the Internet.