Multi-modal Interface Design: Communicating Design Through Presentation and Review

Peter Lusch
Assistant Professor of Graphic Design
College of Arts and Architecture
Penn State

Danielle Oprean
Post-Doctoral Research Scholar
Stuckeman Center for Design Computing
Penn State

Multi-modal visualization has long been considered important for design communication through representation and presentation, yet it has not been explored through an interface. In this presentation we discuss the outline for our test of use of a new interface designed to provide a multi-modal experience of design representations through the presentation and review processes. This interface is being developed for use in an immersive environments lab, a unique presentation space that allows for large-screen display and virtual reality. Before implementing a new interface, testing needs to be done to identify issues and perceptions of how well it works. We aim to test the feasibility of using a multi-modal interface with advanced-level undergraduate students in the design disciplines (architecture, landscape architecture, and graphic design) as a way for them to communicate design through presentation and review. In this presentation we talk about how usability testing allows for the results of actual use of an interface to feed back into improving the overall design. Specifically, we will provide an overview of our application of usability testing in design disciplines to address our hypothesis that being able to view different modalities of design representation at one time is more meaningful to communicate design both during presentation and in the review process. Success of the meaningfulness of the interface will be explored through the TAM model (Davis 1992) of usefulness, ease of use, and behavioral intention. We will also present the primary end point goals for this study, including our human factors study, and our self-report measurement of actual use of the multi-modal interface through questionnaires measuring usefulness, ease of use, and behavioral intention.

Designing Immersive Experiences with Empathy

Ed Johnston
Assistant Professor
Michael Graves College
Robert Busch School of Design
Kean University

One essential component in the vast majority of design thinking methodologies is the importance of empathy. As designers, we have the opportunity to understand and share the feelings of another, articulate pain points within a situation and develop solutions to those pain points.

With the emergence of mobile virtual reality and augmented reality, designers can begin to develop novel solutions to some daunting and exciting questions. What if we could help someone travel through time to the past and see things as they once were? What if we could transport someone into a space, which they cannot reach? What if we could help distract someone from feeling chronic pain or loneliness?

I have been working with students and creative researchers on projects to respond to some of these questions. In my Liberty Hall 360 research initiative, I have been using immersive technologies, including 360-degree video and augmented reality, to address a variety of needs within Liberty Hall Museum. These needs include accessibility and enrichment of the museumgoer’s experience to feel a stronger sense of presence within historic moments.
In this presentation, I will share the development of my collaborative projects and some inspirational projects by other creative researchers, which are establishing the experiential and therapeutic significance of the application of immersive technologies. In addition, I will put forth an argument for the importance of incorporating immersive technologies into design education curricula.

Membit: A Magic Time Machine

Jay Van Buren
Artist, Designer
CEO and Founder, Early-Adopter.com LLC
Co-Founder and CEO, Membit Inc.

Places are part of our identity. Our memories and experiences are tied to places, and yet in a world where we increasingly use digital means for everything, there’s no good way to mark a place as special to us, or to connect with the other people for whom that place matters. GPS is insufficiently precise and computer-vision-based augmented reality depends upon some kind of physical marker, a poster, a plaque, or other demarcation.

Membit allows people to annotate a location with precisely placed, augmented content without using computer vision. It uses the patented “human positioning system” which works anywhere.