Once a user selects a book using any of the previously described methods, they are taken to a new screen where the downloading process for all of the book’s augmentations automatically begins (Figure 65).

Figure 65: Loading Book Augmentations

Upon completion of the download, the phone’s camera activates and initiates a search for trigger images within the book. As the camera recognizes specific areas of the book, it displays the relevant augmentation over the identified trigger image (Figure 66). For sound-type augmentations, audio playback begins automatically. In the case of video augmentations, the video plays directly over the trigger image, seamlessly integrating with the book’s content. Similarly, for 3D model augmentations, the model appears to stand on top of the trigger image, creating an interactive and engaging experience.

Figure 66: Augmentation on Trigger Image

Augment types: These icons are shown depending on what kind of augment is currently active.

Interactive Buttons: Depending on the type of augmentation that is currently active, a set of interactive icons will appear. These buttons are not only clickable but also equipped with specific functionalities tailored to the active augmentation.

The Placement button is one such feature that boasts advanced functionality. Designed to accurately position augmentations on flat surfaces, it activates the mobile device’s camera upon selection. The application then scans for a suitable surface, and upon identification, it visually marks the area with a yellow square as a placement guide (Figure 67). Users can then tap on the screen where the yellow square appears positioning the augmentation exactly on the detected surface (Figure 68).

Place Augmentation Button.

       Figure 67: Flat Surface Detected.                 Figure 68: AR Code Found.

The Information Window is readily accessible through the pressing of the ’i’ button.  Once opened, it provides a detailed overview of the current book’s augmentations, including essential information like the image triggers, corresponding page numbers, and the specific types of augmentations present (Figure 69).

Information Button.

Figure 69: Book Augmentations

If an augmentation is associated with specific GPS coordinates, a GPS pin icon will be displayed next to its type. Upon tapping this pin, it turns green, indicating activation (Figure 70). Simultaneously, the screen will display both the distance to the targeted location and a compass, guiding users toward their desired destination (Figure 71).

Figure 70: Green GPS                                     Figure 71: GPS

Compaspin Activation                                                              .

As the user approaches within 5 meters of the target, a cube will materialize, signifying the proximity to the augmentation’s location. This cube not only displays the augmentation type but also rotates in place (Figure 72). By tapping on the cube, users can prompt the augmentation to manifest directly in front of them, seamlessly bridging the gap between the virtual and real-world environments (Figure 73).

Figure 72: GPS Augmentation                 Figure 73: GPS Augmentation

         in Radius                                                          Opened

When a complex augmentation appears on the screen, users have the capability to interact with individual objects within the scene. By tapping on a specific object, it becomes the focus of all subsequent controls, allowing for targeted manipulation (Figure 74). These controls, consistent with those used for singular augmentations, may vary based on the characteristics of the selected object. Users can rotate and resize the chosen object to their preference or opt to deselect it, thereby reverting control back to the entire complex augmentation. If the user taps the ’hand’ button associated with an object, it triggers the object’s designated OnClick action, providing an interactive layer to the augmentation experience (Figure 75).

Hand Pointer Button.

  Figure 74: Complex                                     Figure 75: Object’s

Augmentation Object Selected                           OnClick Activated