Evaluating NYSCA Mobile Experiences for Tourism Project

In early December of 2013, seventeen fifth-grade school students from Allendale Columbia School were invited to experience the New York State Council on the Arts (NYSCA), Mobile Experiences for Tourism Project mobile prototype. Each student was between the ages of 10-11 years old and had been to Genesee Country Village & Museum  in the past. Before the evaluation the 17 students were selected to be in groups averaging 2-3 students. Before the evaluation students were given a brief UI tutorial. During the evaluation, researchers shadowed the student groups. After the evaluation a short survey followed by a short interview was given.

The survey contained 27 questions with a Likert scale from “strongly disagree” to “strongly agree” based on our design strategy. We presented statements relating to the heritage story, digital characters and user interfaces navigation. Our goal was to assess the school student’s enjoyment and if our interaction design strategy and decisions were substantiated.

Our evaluation shows that our strategy, not only aided our researchers to think hard about the careful transitions between digital and physical space, but also gave us an opportunity uncover new methods of mobile heritage storytelling in the process. After the evaluation, the school students were very eager for more heritage storytelling. School students thought that:

  1.  the heritage story was fun and engaging (100%),
  2. they could easily navigate pioneer settlement with the information provided in the story (82%),
  3. they felt the digital characters added mystery and made the entire field trip more interesting compared to a normal GCVM tour guide (88%) and,
  4. they would be interested in repeat visits if the mobile application gave seasonal narrations during the year (94%).

Our evaluation also provided areas for design improvement. School students were mainly natural when taking the time to explore the individual locations e.g. Blacksmith Shop. The majority of students spent too much time looking at the mobile device while moving from location to location. These areas of improvement will help shape the next design iterations as we evaluate our strategy and heritage stories at GCVM.

Future Work
The results showed that school students would like to create their own heritage story (88%). We are collaborating with Allendale Columbia School students to deploy their own heritage stories at GCVM spring 2014. We have conducted workshops to investigate, design and evaluate mobile experiences for heritage storytelling. We will continue to evaluate the mobile prototype to inform our mobile user experience design decisions.

 Special Thanks to the students and faculty of Allendale Columbia for participating in the evaluation, and as always, thank you Genesee Country Village and Museum and Edinburgh Napier University.

Summary of Blended Interactions Workshop 10.3.13

About:
On October 3rd, the Blended Interactions Studio at RIT conducted its first interaction design workshop. The topic of the workshop was mobile user experience design for digital tourism services. Over 50 designers, practitioners and researchers arrived for presentations, focus groups and pizza while learning, using and participating in interaction design principles derived from Blended Theory.

Presentations:
Professor David Benyon from Edinburgh Napier University presented foundational topics in blended theory to inform the Interaction Design process for mix reality experiences. Senior Research Fellow Oli Mival, also from Edinburgh Napier University, showcased his project prototype called the “Jupiter Art Land Project”. Their mobile strategy used geo trigger events to deliver contextually relevant information to the visitor, while seeking to deliver art works from present and past installations. UX Director Brian O’Keefe, from the Blended Interactions Studio, showcased the latest prototype from the Mobile Experiences for Tourism Project funded by New York Council on the Arts. The demo showcased how geo-fences, photography and digital way finding supplemented educational content to historical locations.  Stephen Mokey presented his successfully defended MS HCI thesis. His research evaluated audio methodologies to the touring visitors at Genesee Country Village Museum. Also, three other RIT MS HCI candidates presented their in-progress capstone proposals in blended spaces and interactions design.

Workshop:
Professors David Benyon and Brian O’Keefe led the workshop, working with five student groups to practice blended theory using the new I Love New York, Haunted History Trail (HHT) as our domain and domain. Key stakeholders from Genesee Chamber of Commerce Tourism Professional Association were invited to give further context and insight of this project from a local and state level. The project wrapped up with five student groups presenting their interaction ideations around embedding technology into haunted history locations in New York State.