In late May 2014, Gaurav Chandwani, successfully defending his MS IST Capstone at GCCIS Rochester Institute of Technology. Gaurav was a Graduate Research Assistant (GRA) working under two grants, NYSCA’s Mobile Experiences for Tourism Project and RIT’s Brick City Tours. Not only did Gaurav play a major role in developing front end interfaces, but he also help mentor newer GRAs as they joined the Blended Interactions Studio. Gaurav’s capstone is a combination of Information Sciences (e.g. front end iOS programming) and Human Computer Interaction (e.g. evaluation/usability testing). The summation of his MS capstone is a great example of Mobile User Experience Design.
Collaborative system to share pictures among groups for souvenir generation
Collaborative photo sharing while visiting designations can be problematic for the visitors. Sometimes the best photo is on another person’s device. This MS IST/HCI capstone developed, designed and evaluated a mobile application prototype to explore location-based photo sharing for souvenir generation at heritage designations. Using user centered design methods, the application and its content catered to visitors on the Rochester Institute of Technology’s campus. Application modules were developed to easily sync group photo collections together while friends were on a tour together. After the tour was complete, digital photo souvenirs were created to represent the group visit. Evaluations concluded that although automatic photo sharing was very positive utilitarian approach to group photo-sharing, the aesthetics of the souvenir prototype needed more iteration to represent the destination rather the group’s activities alone.
On Wednesday May 7th, RIT MS HCI and Allendale Columbia School students and faculty ran our mobile pilot test at Genesee Country Village Museum. As pilot tests go, we ran into a few bugs. In particular, we run into bugs at geo-fences (a geo fence is a GPS coordinate with a mathematical virtual radius drawn around a latitude and longitude). When the physical visitor collides with this digital artifact, we deliver contextually relevant digital content to the visitor.
We were not sure why our video content wasn’t playing correctly at the geo-located schoolhouse. We took the opportunity to use the 19th century schoolhouse as a schoolhouse. The Allendale Columbia students sat with their 19th century tablets (hand held chalk boards) while RIT faculty began to explain the notion of the Geo-Fences and why we may be running into problems. After about fifteen minutes we came up with a number of reasons why our video content wasn’t playing with our hand-held chalk boards. Some potential bugs could be related to:
- 4G video streaming issues
- distance from 4G towers
- AS servers may have been slower
- GPS coordinate was off 15-20 feet
- problems with the iOS code
- Geo-Fence was too small, etc
- Video mp4 format could be corrupted,
After collecting these possibilities we brought them to our development team at RIT the next day. Out of all the potential problems it was “problems with the iOS code”. The development teams fixed the bugs to have a successful usability test on May 14th with school students from Syracuse, NY.
The Western New York Chapter of HFES is glad to invite you to attend a special meeting on May 5th entitled Mobile Experiences for Tourism. This is a project directed by Brian O’Keefe Ph.D. and conducted with his graduate assistants under a grant from the New York Council on the Arts.
Broadly speaking, digital tourism is concerned with the use of digital technologies to enhance the visitor experience. This may be as mundane as posting recommendations on a tourist Website, but increasingly, it concerns the mixing of the real world with digital content designed to enhance the visitor experience. These mixed reality technologies have been around for over 10 years, but it is only with the proliferation of smartphones and tablet devices that mixed and augmented reality interaction is reaching the mass market. This presentation showcases the cross section of mixed reality and visitor experience design by:
- designing at a level of physical place rather than product,
- showcasing how an interaction design method (Blended Theory) informed the design process and strategy,
- demonstrating mobile user interface that guide visitors rather than direct them,
- presenting our production process of augmented reality characters,
- presenting our technologies of geo-locating augmentations and,
- evaluating the impact of our design decisions with a series of usability tests with schoolchildren.
Brian O’Keefe Ph.D. is a Assistant Professor in the Interaction Design Program at SUNY Farmingdale State College. Brian is a interaction design researcher and visual artist with a focus on implementing and evaluating user experiences within mixed reality spaces. Brian is also the Founder and User Experience Director of the Blended Interactions Studio, which represents a group of researchers funded by New York State Council on the Arts, RIT and VisitRochester. The studio specializes in mobile technologies as pervasive/ubiquitous solutions to curate heritage destinations with the aid of school children and educational storytelling. Brian’s industrial skills have been utilized by Verizon Wireless, Walmart, Fujifilm and Eastman Kodak Company, winning awards and patents in digital photography and geo-location services. Brian’s Post Doctorate was held at the Centre for Interaction Design at Edinburgh Napier University where he designed conversational interfaces for the internet via photography, machine learning and natural language processing systems. Brian completed his Ph.D. from the University of Florence, Italy in the sciences of Human Computer Interaction and holds a BFA in Interactive and Graphic Arts from Tyler School of Art, Temple University, USA.
On April 10th 2014, Rochester Institute of Technology (RIT) faculty and students, with a history specialist from Genesee Country Village & Museum (GCVM) met at Allendale Columbia School (ACS) to teach augmented reality production skills to schoolchildren. The goal of this workshop was to have schoolchildren produce their Heritage Stories they wrote from the previous workshop “Schoolchildren Design Mobile Visitor Experiences“.
Schoolchildren were directed by RIT students from the School of Photography Arts and Sciences (SPAS). Film directors and photographers from SPAS recorded each schoolchild in front of a green screen so they could act out their individual role in each Heritage Story. For example, a child dressed as a blacksmith or a school teacher. GCVM provided 19th century clothing, so the schoolchildren would be contextually and aesthetically appropriate when we geo-locate their videos in our next workshop. RIT Interaction Design students and Allendale Columbia School faculty prepped and couched the schoolchildren before and during each augmented reality video shoot. This workshop gave schoolchildren hands on experiences in the augmented realty production process.
In our next workshop, RIT and ACS students will process and geo-locate each individual video to curate physical locations with their Heritage Stories.
On April 3rd 2014, Rochester Institute of Technology (RIT) faculty and students, with a history specialist from Genesee Country Village & Museum (GCVM) met at Allendale Columbia School to teach Interaction Design methods to schoolchildren. The students were also introduced to basic principles of production assets and evaluation methods. These methods will be covered in later workshops in April and May of 2014.
The goal of this workshop was to teach schoolchildren strategic Interaction Design methods to curate physical locations with digital content. These principles are similar to what RIT MS Human Computer Interaction students learn. All students were tasked with creating a contextual wrapper around why a visitor would go from location to location at a heritage destination. These wrappers, or Heritage Stories, enabled students to balance and consider properties of physical locations e.g. 19th century buildings, artifacts etc., with digital technologies, e.g. geo-fences, augmented reality etc., to create new mixed reality experiences for visitors at GCVM. The historical specialist from GCVM was able to provide key insights into 19th culture and customs, which gave the Heritage Stories historical accuracy. At the end of the workshop, student groups presented their Heritage Story scripts/storyboards, strategically detailing why a visitor would go from location to location to learn about 19th century living, while reinforcing 21st century morals.
Schoolchildren Designing Mobile Visitor Experiences at Heritage Destinations is a collaborative mobile user experience design project between Allendale Columbia School, Genesee Country Village & Museum and Rochester Institute of Technology (RIT). The goal of this project is to give schoolchildren the oppertunity to be designers of mobile technologies instead of consumers of mobile technologies.
RIT students and faculty from the Human Computer Interaction Program and Collage of Imaging, Arts and Sciences Department are teaching basic Interaction Design and multimedia asset production principles to fifth and eighth grade students. Allendale Columbia School is leading learning objectives and outcomes, while Genesee Country Village and Museum provides ninetieth century curation education. The format of the project is in four distinct collaborative workshop stages:
- Collaboration – Ideation Phase, Heritage Storytelling, Design Strategy
- Design – User Center Design, Geo/Location-Based Interaction Design
- Multimedia Production – Asset Creation, Video, Audio, Photo, Scripting/Creative Writing
- Evaluation – Mobile Usability Testing, Public Schoolchildren Feedback
The mobile user experiences designed by the schoolchildren of Allendale Columbia School, will be evaluated by other schoolchildren participating in annual field trip events to Genesee Country Village and Museum in late spring 2014.
This project leverages the mobile technologies designed and developed under a 2013 New York Council on the Arts Grant, Mobile Experiences for Tourism Project.
In early December of 2013, seventeen fifth-grade school students from Allendale Columbia School were invited to experience the New York State Council on the Arts (NYSCA), Mobile Experiences for Tourism Project mobile prototype. Each student was between the ages of 10-11 years old and had been to Genesee Country Village & Museum in the past. Before the evaluation the 17 students were selected to be in groups averaging 2-3 students. Before the evaluation students were given a brief UI tutorial. During the evaluation, researchers shadowed the student groups. After the evaluation a short survey followed by a short interview was given.
The survey contained 27 questions with a Likert scale from “strongly disagree” to “strongly agree” based on our design strategy. We presented statements relating to the heritage story, digital characters and user interfaces navigation. Our goal was to assess the school student’s enjoyment and if our interaction design strategy and decisions were substantiated.
Our evaluation shows that our strategy, not only aided our researchers to think hard about the careful transitions between digital and physical space, but also gave us an opportunity uncover new methods of mobile heritage storytelling in the process. After the evaluation, the school students were very eager for more heritage storytelling. School students thought that:
- the heritage story was fun and engaging (100%),
- they could easily navigate pioneer settlement with the information provided in the story (82%),
- they felt the digital characters added mystery and made the entire field trip more interesting compared to a normal GCVM tour guide (88%) and,
- they would be interested in repeat visits if the mobile application gave seasonal narrations during the year (94%).
Our evaluation also provided areas for design improvement. School students were mainly natural when taking the time to explore the individual locations e.g. Blacksmith Shop. The majority of students spent too much time looking at the mobile device while moving from location to location. These areas of improvement will help shape the next design iterations as we evaluate our strategy and heritage stories at GCVM.
The results showed that school students would like to create their own heritage story (88%). We are collaborating with Allendale Columbia School students to deploy their own heritage stories at GCVM spring 2014. We have conducted workshops to investigate, design and evaluate mobile experiences for heritage storytelling. We will continue to evaluate the mobile prototype to inform our mobile user experience design decisions.
Special Thanks to the students and faculty of Allendale Columbia for participating in the evaluation, and as always, thank you Genesee Country Village and Museum and Edinburgh Napier University.
“Please no running…” School students sprinting to uncover the next clue.
School students finds “Jamie’s Hammer”, an essential clue in the Heritage Story.
Evaluation table aka break room at GCVM.
Searching for clues in the Campbell House.
An augmented reality digital character named Ms Krabapple, she is the protagonist in the Heritage Story
Alice (leading digital character) leads the school children to the farm shed.
Compass navigating school children through grassy knolls.
Found Mr. Campbell!