Saturday, March 21, 2015

Technical user evaluation

Nontechnical user evaluation

Breakdowns identified after the paper prototype evaluation

Image1
Image2
Image3
Image4


#
Prototype Screen
Reference
User’s feedback/ critical incidence/ problem
Reason for negative feedback/ breakdown
Scope
Severity (high/medium/low) and justification for giving it that rating
Ways to rectify and any tradeoffs (i.e why the fix might not work)
1
See Picture 1
7-14
The user mentions that it is difficult to find the save button and takes a considerable time. And at last, randomly guesses the correct option.
Since the user is non-technical, she did not identify the download icon straight away.
This specific screen.
Low (Because most users are able to identify the download icon)
Can have a caption with the icon so that the user won’t get confused.
2
See Picture 2
17-18
The user mentions that the letters are too small and there is no white space. And the user takes time in trying to perform and fails.
The number of post views is displayed on top of the post. Since it is just displayed as a number and with a small chart next to it, user couldn’t identify it.
This specific screen.
Low (Because most users are able identify as it is a common way of depicting the number of views.
Can have a caption so that the user will not get confused.
3
See Picture 3
19-20
The user takes time to find the icon where it will navigate to advertisements of the site. Finally, after considerable time, User is able to succeed.
The user takes time and searches the site to find the advertisements of the site. Since it is displayed at the very top, the user was unable to straight away identify it.
This specific screen and the screen that appears after the user presses the advertisement icon.
Low (Because the advertisement icon is clearly visible at the top of the screen)
The user can check the top to find the advertisement icon, since usually other options are mostly displayed at the top of the page.
4
See Picture 4
21-22
The user gets confused and shows the published date of the news post instead of the current date and time.
The current date and time is displayed at the top left corner of the page. The user was unable to see the date and time straight away as the user was concentrating on elsewhere.
This specific screen.
Low (Because most users would straight away be able to identify as it is quite visible)
Since it is quite visible, the user can properly check and understand.

Contextual inquiry for prototype

Tasks
1.      Find older news articles.
2.      Find a way to go to the chat room.
3.      How to view the full description of a news post.
4.      How to view the local song list.
5.      Find the current date and time.
6.      Find out the number of views for a post
7.      Find the author of a news post.
8.      Find the published date of the news post.
9.      How to download a news post.
10.  How to view the advertisements of the site?

Description of the technical user.
Our technical user is Mr.Fernando and he is 22 years old. He is currently reading for his degree in Information Technology. Hence, he is well accustomed with IT and its applications. So, the team decided to do the evaluation with him as our technical user as he is an experienced user in IT. 2:55 Minutes were taken by the user to complete the tasks and he was capable of successfully performing all the given tasks by the team. He did not encounter any difficulty while performing.


Transcript (with technical user)
1.      Evaluator: Can you find older news articles?
2.      User: <presses on the correct option to view the older news articles>
3.      Evaluator: okay.
4.      Evaluator: Then, can you find the place to go to the chat room?
5.      User: Can you repeat?
6.      Evaluator: Can you find the place to go to the chat room?
7.      User: <presses on the correct button to go to the chat room>
8.      Evaluator: okay.
9.      Evaluator: There is a place to view the full description of a news post. Can you find that place?
10.  User: Full description of the post?
11.  User: <presses on the correct link to view the full description>
12.  Evaluator: Okay. Then, there is a place to go to the local song list. Can you find it?
13.  User: Here! <presses on the correct button to get the local song list>
14.  Evaluator: Okay, can you find current date and time?
15.  User: <shows the correct location of the current date and time>
16.  Evaluator: Okay. There is a place that has number of post views. Can you find it?
17.  User: Number of post views? <Searches through> There!! <shows the correct location of views of a post>
18.  Evaluator: Can you find the author of a news post?
19.  User: There! <shows the correct place where the name of the author is stated>
20.  Evaluator: Then, there is the date in a news post that has the published date, can you find that?
21.  User: This! <shows the correct place where the published date is displayed>
22.  Evaluator: Then, there is a place to download a news post?
23.  User: Here! <presses on the correct button in order to download a news post>
24.  Evaluator: There is a place to go to advertisements of the site. Can you find it?
25.  User: There! <presses on the correct button to view the advertisements featured by the site>
26.  Evaluator: Okay. Thank you.
Description of the non-technical user.
Our non-technical user is Ms.Fonseka and she is 21 years old. The team decided to evaluate her as the non-technical user. 4:10 Minutes were taken by the user to complete the given tasks. The user took more time than the technical user to complete the same tasks which were given to the technical user. She was able to perform certain tasks successfully and had some difficulties in performing the other tasks. She was confused while performing certain tasks, therefore, was unable to complete them.


Transcript (with non-technical user)
1.      Evaluator: Can you find older news articles?
2.      User: I’ll click on this to view older news. <presses on the correct option to view the older news articles>
3.      Evaluator: Okay. Then, can you navigate to chat room?
4.      User: Chat room? It is here! <presses on the correct button to go to the chat room>
5.      Evaluator: Okay. Then, can you find the full description of a post?
6.      User: I’ll click on this, ‘Read’! <presses on the correct link to view the full description>
7.      Evaluator: Okay. Then, if you want to save a post, can you find a place to do that?
8.      User: To save a post?
9.      Evaluator: Yes!
10.  User: <takes time to perform the task>
11.  Evaluator: Is it difficult to find?
12.  User: Yes, it is difficult!
13.  Evaluator: Okay.
14.  User: May be, I can click on this! <finally, after some time, presses on the correct button in order to save a news post>
15.  Evaluator: Okay.
16.  User: I’m not sure. <confused>
17.  Evaluator: Can you find how many post views are there?
18.  User: Post views? The letter are too small. There’s no white space. It is difficult to find. I’m sorry, I can’t find. <User is unable to perform the task>
19.  Evaluator: Okay. There is a place to go to advertisements in the site. Can you find that place?
20.  User: Advertisements? Emm, ah this one! <takes time to perform and finally presses on the correct button to view the advertisements featured by the site>
21.  Evaluator: Then, can you find current date and time?
22.  User: These! <gets confused and shows the news post’s date>
23.  Evaluator: There is an author for a news post. Can you find the name of that author?
24.  User: I think it’s this! <shows the correct place where the name of the author is stated>
25.  Evaluator: Then, there is a place to go to local song list
26.  User: Local?
27.  Evaluator: Local song list
28.  User: Okay, ah this one! <presses on the correct button to get the local song list>
29.  Evaluator: A place to find local jobs? Can you find it?
30.  User: <presses on the correct button>
31.  Evaluator: Then, can you find the date of a post?
32.  User: This is the date of the post! <shows the correct place where the published date is displayed>

33.  Evaluator: Okay. Thank you.