Augmented and Virtual Reality

The Yesari virtual tour guide is a mobile app which runs on any platform (iOS, Android and Windows) and can be launched by any user who downloads it after scanning the appropriate QR code.

After that the app is installed and can be used to trigger specific pre-defined markers to launch audio, video or 3D content. The user can interact with the content by waving hands and hovering them around the object (marker) or by touching the mobile screen.

This app is fully functional in terms of Google Glass and similar products and provides and Augmented Reality experience which can be utilized in marketing, publishing, tourism and education.

Our current application of the technology is present in Kuala Lumpur, Malaysia; Sarajevo, Bosnia and Herzegovina and Istanbul, Turkey. Our implementations have been aplauded all over Europe and Asia and have attracted tens of thousand of users and tourists. The users select a language (5 in Sarajevo, and 20 in Istanbul) and can walk around the city or museum looking for our markers and starting educational content such as videos of the locations taken decades ago, or explanations or 3D virtual reality models presented over the images captured by the camera.

In terms of Google Glass our users can experience much more and immerse themselves into a new level of reality fully.

Functionality description

 – Video playback on the image surface

YesariGuide utilizes augmented reality to project related videos on top of the printed pictures inside the newspaper articles. The user points their smartphone camera at a particular AR-enabled page in a magazine, newspaper, or real-life trigger, the smartphone camera scans the target, recognizes the images, and the corresponding video is played directly on the image surface. In this way, the user can watch static images come alive in full motion video, right there in the newspaper article or on the museum wall.

The interactive side of this AR video playback exists since the user can control the playback of the video and full-screen preferences using the “virtual buttons” that will be projected (also on the target surface) right below the video. The user can “click” (or tap) on that particular area on the actual target, and the corresponding event will be triggered (video pauses, or full-screen mode is activated). Therefore, even the buttons exist as a part of augmented reality, which enhances the experience even further.

 – Projection of 3D objects

Besides video playback, the pictures in the magazine article or on the museum wall can be used for projection of certain 3D objects relevant to that particular target. This feature was generally intended for displaying 3D objects on top of advertisements in newspaper. The 3D object would increase the value of the ad. For instance, if an advertiser is a furniture company, and their newspaper ad contains all the necessary information, they can extend that so the readers can see one or several pieces of their furniture augmented in 3D on top of that ad. That way, readers can, not only see the furniture model, but they can also move it, rotate it and observe it as if it were there in front of them.

 – Virtual Buttons as a part of augmented reality

One of the features of YesariGuide is a “Virtual Button”. Virtual Buttons are small rectangular marked areas on the target itself that can trigger certain events once the user puts their finger on them (on actual paper or on the wall). They contribute to the experience of augmented reality concept employed throughout the application. The target surface becomes a sort of a display with augmented buttons, videos and 3D objects on top of the real surface and images that can also be seen at the runtime.

 – Cloud recognition of image targets

The Cloud Recognition is a feature that enables image targets to be retrieved from an external web server at runtime using cloud recognition, instead of being kept in the local database for recognition purposes. It allows users to point the device at a newspaper article to retrieve the target picture from the cloud. The target’s metadata is then augmented on top of the picture of the corresponding surface. This feature requires an active internet connection at runtime.