Prototyping an AR Application

The purpose of this bachelor's thesis is to demonstrate how prototyping can be used in the development process of an AR application. In doing so, the thesis aims to meet high usability requirements and take into account the specific characteristics of AR applications (e.g., spatial projection).

10/01/2021 - 03/14/2022

Prototyping an AR Application

Degree Program

ET - Discontinued

Project Description

Computer applications, including augmented reality (AR) applications, are not standalone systems but interact with their users—they are interactive. For this reason, users should always be viewed as part of a software project and involved early in the development process.

One method for involving users in the development of new products is prototyping. This process simulates the functionality and appearance of the final product, often without actually implementing them.

This bachelor’s thesis aims to demonstrate how prototyping can be used in the development process of an AR application. In doing so, it seeks to meet high usability requirements and take into account the specific characteristics of AR applications (e.g., spatial projection).

People Involved

Student Group: Maximilian Renz

Advisor: Prof. Dr.-Ing. Claudia Meitinger

Course

Bachelor’s Thesis

Duration

Winter Semester 2021/22

Requirements

To achieve a high level of usability, user requirements are defined, and design solutions are then developed and evaluated.

In the development of “traditional” 2D computer software, so-called paper prototyping is often used to develop and compare different design solutions. In this process, a version of the future program is sketched on paper. Functionality can be simulated by switching or modifying the current representation. This allows users to be involved early in the development process, enabling the design solutions to be tested for their ability to meet user requirements.

With augmented reality, it is no longer just humans and computers that interact; the environment now plays a role as well. Content is placed within the space, and the user’s interaction flows seamlessly between real and virtual objects. These circumstances mean that a paper prototype is no longer suitable for either displaying AR content or interacting with it.

Implementation

The following table lists typical criteria that generally help achieve high usability in software applications:

CriterionExplanation
VisibilityDirecting attention to make relevant parts of an action visible
FeedbackClear feedback to confirm that the current input has been processed
AffordanceThe nature of an (virtual) object that indicates how it can be interacted with based on its characteristics
Control OptionsSufficient control elements for feasible actions

These are also relevant for AR prototyping.

To illustrate these findings, an application is being developed for Microsoft’s Hololens 2 AR headset. The app is designed to provide appropriate instructions for each step required to change materials on the “Ultimaker 3” 3D printer.

The following is an example of how an action for selection in the printer menu is indicated. The affordance is clarified by using a virtual hand model to suggest the necessary action for pressing a button. Additionally, the frame is used to direct the user’s attention to the display. For comparison, the second image shows the corresponding part of the future AR application.

Uses

The video shows the prototype development of an application for augmented reality smart glasses. It illustrates how virtual content is displayed in space and how users can interact with the overlaid holograms.

Sources

[1] C. Snyder, *Paper Prototyping*, 2003.
[2] ISO 9241-210 Human-Centered Design of Interactive Systems, 2019.
[3] D. A. Norman, *The Design of Everyday Things*, 2008.
[4] J. Nielsen, *Usability Engineering*, 1993.

Other Projects at THA

A man wearing a helmet and carrying a leather shoulder bag is riding a bicycle

07/01/2026 - 06/30/2029

A2W

Active to Work - Active Commuting: Effects on Mental Health and the Role of Urban Environmental Factors

Discover project
Students wearing VR headsets

04/01/2026 - 04/30/2029

Gesellschaft • KI

AI-Supported, VR-Based German Language Learning for Future Professionals

The project “AI-Supported, VR-Based Skills Competition for Future Professionals in the Field of German as a Technical and Professional Language” addresses the ongoing shortage of skilled workers

Discover project

02/01/2026 - 01/31/2027

GeWo-Bay Study

An exploratory field study is examining health care for homeless people in Bavaria.

Discover project

02/01/2026 - 01/31/2029

Digitalisierung • Robotik

BOSDra

BOSDra is developing an automated first-response drone system for law enforcement and other organizations with security responsibilities (BOS).

Discover project
Ambulance Image

01/01/2026 - 12/31/2027

WARM Study

Effects of Environmental Factors on Acute and Chronic Wounds, Mental Health Conditions, and Social Factors Among People Experiencing Housing Crises in Augsburg

Discover project
Two field workers use an app on a construction site to install fiber-optic cables

01/01/2026 - 06/30/2027

Digitalisierung

DocPilot

Digital Data Management for Fiber-Optic Network Expansion

Discover project

01/01/2025 - 12/31/2026

Ressourceneffizienz • Wasser

Cost-Effective Upgrades to Wastewater Treatment Plants

Cost-Effective Upgrading of Wastewater Treatment Plants by Improving the Settling Properties of Activated Sludge

Discover project
Cover photo: DiPukS

08/01/2024 - 06/30/2027

Digitalisierung

DiPukS

Digital Planning Support for Climate-Neutral Urban Development

Discover project