Process: Usability Testing
Periodically I conduct usability testing sessions with members of the XWiki community in order to evaluate the changes we made inside the product. XWiki is an extensible open source platform for developing collaborative applications on top of the wiki paradigm.

View research    |    View proposals   

I create scenarios focused on gathering data about how different personas use and understand XWiki concepts like: wiki, space, page, application and also how they use the product without prior knowledge of it. The participants can be remote or on location.

Tasks samples:    Survey #6    |    Survey #4    |    Tasks #5

​​​​​​​Report status shows the success/fail rate of tasks for the participants. This allows rapid identification of problematic tasks. Issues can occur if users are unable to complete the task or if the duration to complete the task exceeds the initial estimation.

Status samples:    Scenario #6    |    Scenario #5    |    Scenario #4

For some participants, an extensive analysis can be performed, identifying points of confusion, minor or critical issues, successes, etc. Some users can also participate in a task prioritisation process (mandatory, optional, etc.)

Analysis samples:    Scenario #5    |    Scenario #4

​​​​​​​At the end of the interviews, a report is made that is presented in front of the developers, discussing issues found.

Reports samples:    Scenario #6    |    Scenario #4    |    Scenario #1

Having the user's approval, videos can be recorded in order to further analyse the behaviour together with the development team. Research notes are a great resource, but seeing video can have a greater impact on planning and solving the issues found. Here are some video sample sections from the Scenario #4 interviews:
Playlist of 4 recordings for Task 3.2 from Scenario 4

The most important part of the usability test is identifying and reporting issues, but also providing proposals and solutions for the issues found. If a problem occurs with multiple participants, it needs to be formulated into an issue. Depending on the severity of the issue, solutions are brainstormed or at least held in the backlog.

Issues and proposals samples:    Scenario #6    |    Issues Selection    |    Cycle Analysis
These design proposals and investigations are discussed inside the XWiki Community, which is an Open Source community around the XWiki platform.
Process: Usability Testing

Process: Usability Testing

Usability testing process from scenario creation to data collecting, analysis, issues reporting and solutions proposals.
Copyright Info

Attribution, Non-commercial

Read More