Interactive Prototype 2 and User Testing

Due: Thursday, May 5, 11:59PM
Point Total: ~15% of your TA grade (6.8% overall)

Assignment Overview
In this assignment, you will continue implementing your mid-fi prototypes and design ideas in code. In the first interactive prototype assignment (TA05), you implemented two tasks and received feedback during in-class critiques. Here, you must implement the remaining two tasks, revise the other two tasks based on the critiques (as well as your own ideas/reflections), and perform usability studies with four participants. Please pay specific attention to applying the IxD and graphic design principles we are learning in class.

Again, as before, focus on the UI and user experience. Fake the rest. We fully expect that you will have to use dummy data or other creative approaches to simplify backend headaches (we've seen a few clever hacks already from some teams in TA05).

Make sure that you continue to use github for development. We will be checking commits and expect to see contributions from each team member.

User Testing

As with TA04, recruit four independent users to test your prototype. These users should be representative of your target population. If this is not possible, then find reasonable alternatives. You cannot reuse users from your mid-fi prototypes; however, you can use members from class. For the testing protocol, I want you to follow a similar approach to TA04. Before running the study protocol, you must pilot test with one or more team members. Two students must be present for all user tests (one will be the 'experimenter' running the session and the other will be a 'observer' recording notes).
  1. Download and modify this IRB "informed consent" template to fit your project [link]. At the beginning of the user testing session, read the "Purpose of this Study" section of the consent form out loud to your participants. Make sure to explain to the participant that s/he will be using an early interactive prototype and that you are looking for honest feedback to improve your design.

  2. Collect background/demographic information as necessary.

  3. Begin testing your prototype using the 'think-aloud' method. Each participant should try to complete each of the four implemented tasks. Task order should fit your project goals and flow (i.e., it is not necessary to try and counter balance tasks). One experimenter should record notes about how the participant was using the prototype, the problems/successes encountered, and comments made during the testing sessions. Scan in and include these raw notes in your appendix for each user testing session.

  4. Provide a brief post-activity survey asking about the tasks.

  5. End the study with a brief semi-structured interview soliciting feedback about the project, design ideas, and criticisms.

  6. After user testing, analyze your collected data and write-up a report

The Report

Submit a report of no more than 5 pages of text. Images, tables, figures, etc. are strongly encouraged, do not count against the page limit, and are thus free. Please use the following full section headers (style Headings 1) in your report; it makes it easier for us to grade. So, for example, you should literally have headings with Section 1: Abstract and Section 2: Task Descriptions in your report.

Title Page

At the top of the report, please include a title (centered and bold) followed by the names of each team member. For each person listed, include 1-2 sentences on their primary role/accomplishments on this assignment.

Section 1: Abstract

The abstract should provide a 5-7 sentence overview of your report including: (i) a description of your application, (ii) a description of your four primary tasks, (iii) a high-level description of the interactive prototype including how it was implemented, (iv) a description of your evaluation method, and (v) a summary of your primary findings.

Section 2: Interactive Prototype

Describe your four primary tasks along with ample use of supporting screenshots. Each task should be in its own sub-heading (Heading 2 style).
If the tasks changed from the previous assignment, please describe these changes and why they were made (e.g., was it based on your own design reflections, was it based on experiences building TA05, was it based on feedback from in-class critiques, etc.). You should use figure descriptions, annotations, and other guides (e.g., the use of multiple explanatory screenshots) to help explain the interactions of your prototype to the reader.


Section 3: User Testing
This section should have four sub-sections focused on:
  • Pilot testing the paper-prototypes among your group and the resulting changes that were made either to the study protocol or to the paper prototypes themselves
  • Participant recruitment and demographics, which includes a description of how you recruited participants and demographics relevant to your project. Justify why these participants were appropriate for your project.
  • Study method, which details how you performed your study including the study protocol, the location, the length of the study, and a description of the data collection instruments (e.g.,the post-study survey).
  • Analysis, which describes how you analyzed the data you collected.

Section 4: Results from User Testing

This section should detail the primary results from user testing. Please specifically note which two team members ran each participant.
  • What did users generally think of your application idea?
  • How did they react to the web vs. mobile?
  • Were there some features of each prototype that were more promising than others? Could they be consolidated into one design?
  • How might you change your design based on the user testing?

Section 5: Learnings from this Project Assignment

This section should offer reflections on what you learned from this project assignment and you would do differently if you had to do the assignment again.

Section 6: Appendix

The appendix should include:
  • A scan of the four signed informed consent forms
  • Raw notes from four user testing sessions (notes should be clearly marked with a timestamp and session number)
  • A scan of the post-study paper survey responses (these should also have session numbers)

Submission

Please submit a PDF of your report to Canvas.

Rubric

We will evaluate your submission based on the depth of your analysis, your application of IxD and graphic design principles from class in your critiques, and the overall clarity and elegance of your submission.

You can download the rubric here (a screenshot below, which you can click to enlarge, is included for your convenience):



TA06-InteractivePrototype2-GradingRubric_v1_MLM_Cropped_650w.png