Your team will test your robot prototype and product website with people outside your team to evaluate whether the robot and website are useful, easy to use, and effective. Receiving constructive feedback will allow you to improve them before the public presentation.

You’ll need to recruit a total of 6-10 participants for this user testing:

• 3-5 participants should individually evaluate the robot

• A different set of 3-5 participants should individually evaluate the website

As a reminder, here are instructions for conducting user testing. For the robot prototype, the user testing will be slightly different because the participant will observe the robot completing tasks (rather than the participant completing tasks themselves).

You’ll also ask each participant to respond to a brief online survey after the user testing session. The surveys for the robot and product website will be slightly different. These two surveys have already been created as Google Forms:

1. Create a new folder called “Solution Evaluations” in your team’s Google Drive folder.

2. Save one copy of each survey in that new folder. (Links to both surveys are below.)

3. When you’re ready to administer a survey to a participant, open the specific survey, and click the preview icon in the upper right, which will allow the participant to respond.

Evaluation of Robot Prototype

The user testing of your robot prototype will require each participant to observe 1-3 task scenarios demonstrated by the robot. You'll ask the participant to "think aloud" as they observe the robot, in order to provide feedback.

Start each testing session by using your value proposition to summarize the robot's purpose. Briefly introduce the first task scenario, and then have the robot demonstrate the task. Be sure to record notes on the participant's feedback. Repeat for the remaining task scenarios.

• Evaluation Findings: Use this template to summarize your findings from the user testing.

• Post-Testing Survey: Have the participant respond to this survey after the user testing.

Evaluation of Product Website

The user testing of your product website will require each participant to find answers to specific content questions. Use these questions as the tasks for the website:

1. What does the product do?

2. Who is the product designed for?

3. What benefits does the product provide?

4. Evaluation Findings: Use this template to summarize your findings from the user testing.

5. Post-Testing Survey: Have the participant respond to this survey after the user testing.

Analyze Survey Data

After all the participant evaluations are completed, you’ll analyze the data from each survey.

Open one of the surveys in your team’s Google Drive folder. At the top of the survey form, click on the "Responses" tab, which should default to showing the summary data for all responses.

For each survey question, the summary data will display a histogram (similar to bar chart) of the response distribution:

• Responses categorized as 4 or 5 are positive because they indicate the participant either agreed or strongly agreed with the statement.

• Responses categorized as 3 are neutral because they indicate the participant neither agreed or disagreed with the statement.

• Responses categorized as 1 or 2 are negative because they indicate the participant either disagreed or strongly disagreed with the statement.

After each chart, you’ll see the written responses submitted by the participants to explain their ratings. You can compare these explanations against your team’s findings from the user testing to see if the survey responses revealed any new issues that might need to be addressed. If so, add these new issues to your evaluation findings document.

Create a summary document for each survey that shows the histogram charts (in order) of your team’s survey data. If you hover over the upper right corner of a chart, you can click a copy icon, and then paste that chart into the document.

In the next assignment, you’ll use the evaluation results to make refinements to your robot prototype and product website before the public presentation event.

❏ Deliverables

Submit all of the following:

• Evaluation findings for robot prototype

• Evaluation findings for product website

• Summary of survey data for robot prototype

• Summary of survey data for product website

Your team will explain and demonstrate your project solution to a public audience, which might include professionals from industry, college, and your school – as well as parents and fellow students. Some audience members might be acting as judges reviewing the team projects. Many audience members may be learning about the project for the first time.

Your team's presentation needs to tell a complete story (with a beginning, middle, and end) in just a few minutes. The presentation should be clear, concise, engaging, and professional.

• Plan and practice your team’s presentation and demonstration

• When helpful, refer to your poster and product website during the presentation

• Be sure to allow the audience to examine and interact with your project solution

• Be prepared to answer questions from the audience

• Be prepared to adapt if a technical issue occurs during the demonstration

❏ Deliverable

Participate in your team's presentation and demonstration at the public event

As an individual, you'll respond to these project reflection questions.

Your teacher might also have you participate in group reflections: your team could reflect on its performance, and the entire class could reflect on the project.

❏ Deliverable

Submit your project reflection responses

Your team will use your evaluation findings to implement refinements to your robot prototype and product website. Focus on the highest priority design changes first. Implement as many refinements as possible depending on the available time and resources prior to the public presentation.

If possible, test your robot or website again with new participants to verify whether the refinements resolved the issues.

❏ Deliverable

Submit a list briefly describing each refinement that your team implemented

You'll create a slide presentation that summarizes the evaluation and refinement of your team’s robot prototype and product website. Practice your presentation before delivering it to your class. This will be an opportunity for other project teams to ask questions and provide constructive feedback to help your team prepare for the public presentation.

Your team's presentation should include the following (in this order):

• Project Team: product name, team name, team members & their roles

• Value Proposition: Be sure the value proposition is clear and compelling.

• Persona: Be sure the persona is useful for understanding the target users that the solution was designed for.

• Solution Evaluation: Briefly describe the participants (number, gender, age, etc.) involved in the user testing of the robot prototype and product website. Briefly summarize the evaluation findings, including the survey results.

• Solution Refinements: Briefly describe the refinements that were made to the robot prototype, product website, and/or product demo video. If helpful, you can include “before” and “after” images to better show certain types of changes.

• Project Poster: Show a preview of the team’s project poster, and briefly explain what information is included on the poster.

The presentation should have 6-10 slides and take 5-10 minutes to deliver.

❏ Deliverable

Submit your team’s slide presentation

You'll create a poster that helps explain and show how your team researched, designed, prototyped, and evaluated your robot solution for your targeted problem.

The poster will be a visual reference to supplement the explanation and demonstration that your team gives during the public presentation event. Even though a poster won't explain or show everything about your team's project, a person should be able to understand the key aspects of your team's project just by reviewing your poster.

The goal is for the poster to be clear, concise, engaging, and professional in terms of its content and visual design.

The standard size for a large poster is 36 inches wide by 24 inches tall (your teacher will clarify if a different poster size will be used). Print-quality materials typically use a resolution of 300 pixels per inch. Your teacher will have the posters printed prior to the public presentation.

1. Determine the content to be included on the poster. Gather text and images from your team's previous project deliverables. You may need to modify certain content to make it more suitable for a poster (e.g., text might need to be summarized or simplified, images might require labels or captions, etc.).

2. Determine the layout of the content by sketching a small-scale poster mockup on a regular sheet of paper. Be sure the layout will be easy to understand and follow.

3. Create a full-scale digital version of the poster using a drawing/illustration tool, such as Google Drawing, Pixlr Editor, Adobe Illustrator, etc. Be sure the visual design of the poster reinforces the concept behind your team's robot solution.

4. Save or download the final poster as a PDF file that your teacher will have printed.

POSTER TEMPLATE

• You can use this Google Drawing template which is set to 36 inches wide by 24 inches tall. Zoom in or out as needed to add text, images, etc. – but do not change the canvas size. (To use the template, select "Make a copy" from the File menu, and save it to your shared team folder in Google Drive.)

• If you're using a different drawing/illustration tool, create your own blank canvas sized to 36 inches wide by 24 inches tall at 300 pixels per inch (10800 pixels wide by 7200 pixels tall).

• If your teacher has specified a different size for the poster, use that instead.

❏ Deliverable

Submit a PDF of your team's poster for printing

This shows a generic layout for the typical content that would be included in a project poster. However, you can modify the layout and appearance as necessary.

An important part of celebrating the completion of a project is expressing gratitude and appreciation towards people for their help and work on the project.

You'll create a list of people that you want to recognize:

• Thank people who provided help to you or your team

• Recognize exceptional work done by someone on your team or another team

Your list could include any people inside or outside the class that helped during the project. Be specific when describing the help or work done by the other person.

During your class celebration, share some of the recognitions publicly.

❏ Deliverable

Submit your list of recognitions