User testing / Focus Groups
From Digital-JumpStart
Contents |
User Research, User Testing, and Design
Major Questions
- When should we conduct a focus group?
- What is the difference between a focus group and user testing?
- How many participants should be in a focus group?
Findings
User testing, including focus groups, questionnaires, polls, and usability testing, can range from complex multi-phase evaluations to simple “test the water” style studies. The type you select will depend on your schedule, your budget and your end goals. Keep in mind that while it might seem like a good idea to conduct user testing when a project is complete and they can fully engage with the features and tools, implementing changes at that stage is costly and might leave you over budget, over schedule, and possibly, really discouraged!
The best way to conduct user testing is to break it into two smaller testing sessions:
1) “Storyboard” Stage: When developing a website or a tool, you will always start with a basic plan. By identifying all of the possible features you want, how they should function, what types of content you will feature, and the way it will all look. At this stage you will also be planning the intended user’s experience with the digital project. To validate that your target audience will interact with your product in the way you intend, the best thing to do is to sit down with a small sample and ask them!
Simple explanations of what features you will provide, a small sample of your content and a basic graphic mock-up are often enough to generate important feedback at a stage when you are still able to do really revise your plans.
2) “Prototype” Stage: Creating a basic product (website, tour, etc.) with sample features and some content is a second level testing technique that can really pay off in later versions of the project. To figure out where there are potential usability issues, provide a small group (6-7) of people from your target audience with a scenario to follow, and see who they navigate the product. Keep instructions to a minimum – remember you won’t be there with most users when they enter your site of kiosk! After the group has completed the scenario you have provided, have them record their comments. You may be surprise by what they say, both positive and negative.
Since you have consulted your audience, you won’t be stuck wondering what their reaction will be. You will avoid having to go back to the drawing board when you have almost completed you project. (Kristy Martin, Idéeclic)
Resources
- http://www.useit.com/papers/focusgroups.html
- User/usability testing demo by Steve Krug
- Steve Krug's website: Advanced Common Sense, includes links to user testing scripts and the very good chapters from the first addition of Don't Make Me Think.
