Usability testing still has an aura of complexity around it people think of it as time and cost-consuming, and often dispensable. Why test this, we should know whats best, after all, we are the experts and it will add cost! Truth is: people who conceive applications usually dont know whats going on in the users minds, because: they are not the users. No matter how sure we are about our design and concept, the users will always surprise us. Secondly, you will see further down how usability testing can actually save significant amount of cost if done early enough in the process.
The new way of testing: quick and collaborative
Over the past couple of years, there has been a clear trend towards what could be called agile usability testing: out go the 20+ page reports written by a usability test engineer and often just put on the shelves by the developers. Instead, we test with fewer users 5 is a good number encourage team members to come and observe, and have a debrief immediately after the tests. These debriefs are working sessions where everybody will contribute their observations, ideally on sticky notes which are then classified into overall issue categories. During these working sessions, its important to stay away from too much thinking about technical or design solutions,- they will come in the next step.
Testing as early on as possible
Another myth: you can only test once you have a running application on your testing environment
wrong again. Testing is the most useful and efficient when it is done early on in the process. As soon as you have some kind of screen and it can even be hand-drawn on paper you can do usability testing. The timing is important because you have not invested days, weeks and months of development time at that point and you can still make radical changes at an extremely low cost.
One example recently with a client: We convinced the business owners to test the concept we had been working on to
a) test the new navigation concept and
b) verify whether the task flow we had assumed based on the business requirements was correct.
The testing was an eye opener to everybody involved: while the navigation was understood and appreciated, it turned out that there was a need to create different profiles even amongst a user group to allow a high degree of personalization. In addition, we found out that some fundamental assumptions turned out to be wrong, and we got comments such as if you do this, you are going to get hung by the feet! - a threat no project owner can ignore! Fortuntely testing was done this early!
Interested to find out more?
Check out this interesting article by Jared Spool: http://www.uie.com/articles/usabilitytesting_dc/
Also, the legendary book Dont make me think by Steven Krug has an interesting section on quick usability testing. http://www.sensible.com/