top of page

Evaluation plan

Introduction, Funcionality evaluation, experience evaluation, requirement evaluation

Full evaluation plan can be found here!

Introduction

Since the prototype is made in close collaboration with the co-designer, the product needs to be evaluated in order to test the functionality. The focus is on functionality, while the user experience is closely observed as well. The prototype is not dishwasher proof due to the 3d-printed design, so this will not be tested. The main testing should be conducted by the co-designer; however, the main principles can be tested by the design team as well. The following plan structures the evaluation and the steps that need to be taken. During this evaluation process, the tester and product should be closely observed, based on user behavior and response.  

Functionality evaluation

Putting the lid on

Putting the lid on the mug is the first step in the process of transporting the drink safely. In theory, the conical shape seals the mug/cup, while the grippers make sure the lid does not fall off. For this first step, the easiness of putting the lid on the mug is going to be evaluated. It is important that the co-designer can easily guide the lid onto the mug, and the grippers should be easy to operate. While it is important that the grippers are easy to operate, the clamping should be sufficient so that the lid does not fall off. The following assessment scheme is used for the evaluation, the values should be filled in by the co-designer. One to five points are given per topic, where one point is the worst, and five points is the best rating. 

Walking with the product

The second step in the sequence is walking with the mug and product. The lid should prevent the drink from spilling while the co-designer is walking with the mug. Because of the loss in balance, walking with a mug causes the mug to bump a lot. In order to test if the product works, the co-designer needs to walk with the mug and lid and test if the lid does not fall of and if the drink does not spill. The following questions need to be observed: 

  • Does the lid seal the mug while the co-designer is walking? 

  • Does the lid stay in place while walking? 

Removal of the product

When the co-designer has arrived at the seating location, the lid can be taken off. It is important that the lid can be taken off without spilling the drink. Besides that, it should be comfortable to place the lid somewhere else for future use. To conclude this, the following questions are of importance: 

  • Can the lid be taken off without spilling the drink? 

Since it is important that the co-designer can comfortably remove the lid from the drink and place the lid somewhere else, this should be rated by the co-designer using the following table where one point is the lowest and five points is the highest. 

Experience evaluation

The user experience is extremely important, since the user interacts with the product on a daily basis. The following questionnaire is meant as a basis for the experience evaluation, with room to discuss the different topics. 

Appearance
  • If you (co-designer) would rate the overall appearance of the product on a scale from one to five, what would you give? 

  • Could you elaborate on this rating? What are things you like/dislike about the product? 

Functionality
  • Purely based on comfortability, would you increase or decrease the spring strength? 

  • Are the handles of the gripper comfortable to use? Is there any way you would modify these, and why? 

  • Are there any functionality aspects you would like to see changed or modified in any way? 

  • Do you have any additional remarks on the product? 

Requirements evaluation

The material requirements are not applicable for this prototype since it’s focused on functionality and made with the materials available. The design and functionality requirements can be checked using the a table in cooperation with the co-designer. 

Test preparation

The (almost finished) prototype is tested with the co-designer according to the evaluation plan. Since the 3d-printed plastic does not seal the mug from liquid, an alternative sealing method is used in order to test the theory. The following pictures show the process of preparing the prototype for testing.

WhatsApp Image 2022-04-11 at 11.40.17 AM.jpeg
WhatsApp Image 2022-04-11 at 11.40.17 AM (3).jpeg
WhatsApp Image 2022-04-11 at 11.40.17 AM (4).jpeg

Two sealing methods have been tried: thin foam and foam stickeres. Around both of these methods a balloon was attached in order to create a water tight seal. The thin foam was not thick enough, so the stickers have been chosen as the final sealing method, after which the balloon was applied, which can be seen in the picture to the right.

Co-designer testing

The following pictures show the test sequence of the test conducted with the co-designer.

Evaluation_step01.png
Evaluation_step02.png
Evaluation_step03.png
Evaluation_step04.png

Co-designer results

Pinching the grippers

Pincing the grippers was extremely easy for Jack, the spring could even be stronger if necessary.

Putting the product on a mug

Jack needed two hands in order to put the product on the mug. The problem was the main conical shape which was not "free floating" such that if always faces down. Adding simple bearings would reolve this issue.

Performance while walking

Jack tried the prototype with his three sizes cups and a glass, all filled with water. None of mugs or the glass spilled any water while Jack walked with him, this would've never worked without a product on top. The pictures above visualize Jack walking with one of the mugs.

Taking the product off

Taking the product of was very easy and could be done with one hand.

Putting the product away

Putting the product away was the main problem with this design. Still a lot of water stayed onto the lid and dripped on the table. To use this design, a coaster or saucer was needed to prevent the spilling of liquid on a table.

Additional comments

Aditionally, Jack suggested to shorten the handles up top to lower the profile. Aesthetically this is way nicer, and it makes transportation easier. The following pictures shows the final concept with the comments taken in mind (although note that the sillicon or foam is not added, a solution for this still has to be found).

WhatsApp Image 2022-04-12 at 1.49.44 PM.jpeg
WhatsApp Image 2022-04-12 at 1.49.43 PM.jpeg

Requirement evaluation

Although not all requirements could be evaluated, still a lot of requirements were met. The most important ones will be discussed here. First of all, the prototype is usable for the co-designer and it is usable on multiple size mugs. Also, this design is usable in later stages of Ataxia. As the co-designer stated in the second co-design session, a lid like this is also usable when in his wheelchair, this way he can use both hands to move the wheels.

 

bottom of page