Experiences with AR plots: design issues and recommendations for augmented reality based mobile games

Abstract

Digital games have the potential for changing attitudes towards social issues such as climate change and sustainability. This paper presents the experience of developing a prototype locative game with an augmented reality interface that is designed to fit in with the fractured nature of travel time on public transport. We discuss the technical challenges, usability issues and game design approaches used to work within these constraints.

Introduction

This paper outlines the early stage results of developing a location‐based game with an augmented reality (AR) interface^a. The game’s system architecture is shown in Figure 1. The game ‘AR Plots’ is intended to be played on local, intra‐city bus trips and carry a message about climate change and sustainability. This is part of a wider project to examine how technology can instrumentally affect people’s attitudes towards climate change and sustainability issues.

Figure 1

System architecture. System design and interaction between Layar browser and server, game server and the Android application.

In AR Plots the players grow plants alongside bus routes, watering their own and friends’ plots. Virtual gardens grow up by bus stops and traffic lights. When the bus stops for a length of time, empty plots are created that they or other players can plant in. A player can plant a seed in a plot and then ‘owns’ it with their plant. Plants need watering, however the amount of water they have is limited. Plants only bear fruit or flowers if other players also water them. A simple one‐click ‘check in’ mechanism is used for the players to water their own or other’s plant. Figures 2 and 3 show snapshots of the game’s graphical interface. Augmented reality is the basis for the graphical interface and has been prototyped and tested on Android smart phones, using a background service and the Layar AR browser [1]. The game is designed to work on Bristol, UK, based buses intended for a commuter audience.

Figure 2

In‐game snapshot. In‐game snapshot showcasing two plants in various stages of growth.

Figure 3

In‐game snapshot. Geographic distribution of plants along a bus route.

The game design and interaction faced a number of constraints due to limitations in software and hardware platform as far as interactive AR gaming is concerned. The GPS accuracy is variable and effects placements of digital artefacts in the virtual world and also the detection of stoppages and movements of the device. Different device screen sizes affect the quality of interactive experience of users. Moreover, Layar limits the actions that can be performed by interacting with the digital objects in the augmented reality view i.e. actions are predefined on the central server and cannot be modified dynamically based on user actions.

Interface constraints and context for use

To understand the issues for designing a game with Layar as the platform, a PACT analysis framework [2] was used to evaluate the application in the context that the game will be played; on local buses in Bristol. The small‐scale project utilised discount usability [3] and iterative design. Early stage prototypes were evaluated in live situations by the extended project team, which highlighted the following key issues:

Motion sickness whilst using an AR browser

All participants reported a feeling of motion sickness whilst interacting with the Layar based game, including those who didn’t normally feel motion sick whilst reading or using devices in vehicles. It appears that the overlay of information in Layar’s camera view brings about the feelings of nausea, which quickly subside when not using Layar. Motion sickness is still a poorly understood physiological phenomenon but the stimuli that cause it are well documented. These causes are usually isolated to either inertial motion sickness or visually induced sickness [4, 5].

Social issues of camera use

Another observation was that when the phone is held up, people in front of the camera are very aware of being photographed or filmed. The pointing of cameras raises two interrelated issues of privacy [6] and the claiming of personal social space [7]. The user can be seen to be claiming a particular, indeterminate space and bringing in‐view people into a one way, non‐negotiated relationship. This makes the users uncomfortable, as well as other people on the bus, creating a very difficult situation for the use of this technology whilst on any forms of public transport.

Device and interface issues

There are two specific device issues that came up during testing. First, the lighting on a bus is highly variable, based on the internal lighting and the level of sunlight coming in from the outside, and can affect the experience. Secondly, there is a lag between movement and updating of the GPS data, so the application does not show an entirely accurate representation of where the user is. The variability of the bus speed and irregular starts and stops means that the users’ location can not be corrected for statistically. This leads to a disrupted and broken experience.

Game design recommendations

Based on our experiences and original design directions, which intended the game to be both seamful and ambient, we list the following game design recommendations:

Seamful design

Chalmers sets out a design strategy called Seamful Design[8] for dealing with ubiquitous computing applications. [8]. This involves designing to fit the inevitable problems such as sensor unreliability and connectivity loss into the game’s design rather than assuming that the infrastructure is robust and reliable. This approach allows us to deal with the technical constraints rather than try to overcome them.

Ambience

Ambient games run in the background and don’t require constant attention [9] and we envisaged a game that does not take over the travel experience, but works with the fractured nature of public transport. Research has shown that people on public transport tend not to focus on one task for the duration, and will probably engage in a number of activities on a journey [10]. This design direction is reinforced by the findings that extended use of AR on a bus may induce motion sickness, so a design constraint is to create a game that is only interacted with occasionally via the AR interface and functions primarily in the background.

Dynamic generation of locations

The game dynamically generates empty plots in places where the bus stops, and these will be maintained through planting and water. We have made this decision because of GPS lag, motion related sickness in the AR and the fact that the bus can speed by Layar locations making them difficult to interact with. The plots will be generated on either side of the bus so that there is always a plot outside the window that the player is seated nearest. This leads to a reduced need to point the phone camera at people to see plants that might located at the other side of the bus.

Simple interaction mechanic

The game interaction is designed to be simple as the game is intended to be ambient, and not distract from other activities on the bus, or simply the enjoyment of the journey. The system is also limited in the types and amount of interaction that can be achieved via Layar. So we will use an interaction that is similar to the ‘check‐in’ mechanic used in location based services such as Foursquare (http://www.foursquare.com). The AR interface will present the user with icons or objects that can be interacted with a ‘one‐click’ manner. The player’s only decision will be to interact or not.

Conclusion

Discount usability techniques and early stage testing have delivered a variety of insights, which have impacted the game design. The contextual issues of motion sickness, embarrassment around camera use, usability problems and application aesthetics can be addressed through simple, seamful and ambient design. Even though we were aware of these design philosophies the findings presented in this paper have helped to reiterate the usefulness of these approaches for locative games.

Endnote

^aThis work is funded by the Bridging the Gaps in Health, Environment and Technology programme at the University of the West of England, which is an EPSRC project for kick‐starting interdisciplinary research.