Exploring Dual-Camera-Based Augmented Reality for Cultural Heritage Sites

Abstract

Context: Augmented Reality (AR) provides a novel approach for presenting cultural heritage content. Recent advances in AR research and the uptake of powerful mobile devices means AR is a viable option for heritage institutions, but there are challenges that must be overcome before high-quality AR is commonplace.

Aims: This project details the development of an AR “magic camera” system featuring novel dual-camera marker-based tracking, allowing users to take AR photos at outdoor heritage sites using a tablet computer. The aims of the project were to assess the feasibility of the tracking method, evaluate the usability of the AR system, and explore implications for the heritage sector.

Method: A prototype system was developed. A user study was designed, where participants had to recreate reference images as closely as possible using an iPad and the AR system around the University grounds. Data, such as completion time and error rates, were collected for analysis. The images produced were rated for quality by three experts.

Results: Participants responded positively to the system, and the new tracking method was used successfully. The usability study uncovered a number of issues, most of which are solvable in future software versions. However, some issues, such as difficulty orientating objects, rely on improving hardware and software before they can be fixed, but these problems did not affect the quality of the images produced. Participants completed each task more quickly after initial slowness, and while the system was frustrating for some, most found the experience enjoyable.

Conclusion: The study successfully uncovered usability problems. The dual-camera tracking element was successful, but the marker-based element encountered lighting problems and high false-positive rates. Orientating objects using inertial sensors was not intuitive; more research in this area would be beneficial. The heritage sector must consider development, maintenance and training costs, and site modification issues.