Joan Doe is walking through the mall one day when she’s approached by someone with a clipboard. She has some free time, so she answers a few questions and gives them her email address. “Cool!”, she thinks to herself, ” £50 for turning up to a focus group and eating free pizza for an hour. Easy money!”. A few weeks pass and one day she gets an email inviting her to participate in some research. So, she picks a time slot and books herself in.
On the day she manages to find the offices in the center of town and presses the buzzer. A garbled voice invites her onto the second floor, and she finds herself sitting in a waiting room. “This reminds me of a job interview” she thinks to herself. “I can’t believe I’m feeling so nervous.” The receptionist tells her she’ll have to wait 5 minutes because the researcher needs to finish their current test session. “Researcher? Test? This is getting weird.”
Finally she is invited through by a tired looking man. It’s a small room with one table and two chairs. This is not what she expected. “Um, where are the other people for the focus group?” Joan asks timidly. The man gives her a quizzical look and explains it’s a one-to-one depth interview. She notices that one of the walls has a big mirror on it. A bit like in those police dramas. In fact, just like in those police dramas.
The researcher starts droning through a script. She feels like she’s having her rights read to her. He gestures for her to sign some kind of contract. This does not feel right. Not one bit. Joan starts to rationalise. “£50 for an hour. I can do this. Just answer the man’s questions. Almost a pound a minute. Just act normal and it’ll be over soon…”
When you’re used to running the show, it’s easy to forget what it’s like to be a research participant. It’s also easy to create a stressful situation, where the participant can’t concentrate and their only real care is to get through the session, get paid and get out.
At a company I worked at a few years ago, one of the Directors stored a load of their belongings in one of the labs while they were moving house. We ended up with well worn sofa, coffee table, stereo, rug, books, and even a pile of logs next to the fireplace. It was only meant to be temporary, but it turned out to be so inviting, we kept it like that. I admit, refurbishing your own lab might not be possible, so here are some practical tips for relaxed lab sessions:
- Spend the first few minutes building rapport. Don’t even refer to the session or the paperwork.
- Don’t use labs with two-way mirrors unless the research requires it. If you must, cover the mirrors with curtains when not in use.
- Make the lab feel homely. Put up some art. Remove any unused cameras or microphones. Use discrete kit if possible.
- Never say “This is not a test” or “We are not testing you”. It sounds like doublespeak. Also, don’t mention the word “task”, say “activity” instead, it’s less threatening.
- If you are compelled to use an awkward research technique (e.g. eye tracking or timed tasks), then spend 5 minutes doing a dummy task to warm up. Be honest and admit that it might feel a little awkward at first.
- Tell the participant they are considered an ideal customer by your client who wants to design their product to perfect for them. Mention that right now, it’s a little rough around the edges.
- Take a leaf out of the ethnography book: dress in a similar manner to your participants.
- Sessions should not be rushed, otherwise you will be continuously interrupting them and telling them to move on – another source of stress. Reduce the number of tasks if possible
- You become less friendly when you’re tired, so don’t schedule too many tests in one day. 4 x 90 minute sessions in one day should be your maximum.
Have you got any other tips you’d like to share? Add them in the comments, maybe together we can come up with an über-list!
Dress in a similar manner to your participants?
I can really see that one backfiring!
Well obviously without cross dressing :-) I meant in terms of formality (e.g. suits or jeans).
Or you can forget about the 9 rules and use remote usability testing instead.
What you mention above is one of the reasons we developed our remote usability testing tool, Webnographer. The participant is in their natural environment, and they don’t have to travel to get to any lab.
By the way where did you get the picture from? It is brilliant.
The photo is a still from “The Lives of Others”. Fantastic film! BTW Does Feralabs have any plans to put out a screencast or a screengrab walkthrough? Looking forward to finding out more.
Hmm, the Director’s stuff in the lab…methinks I worked for that company too….
I do a fair bit of remote usability testing, I’ve also done a lot of lab-based stuff, and research in situ. Frankly I think the ‘user’s real environment’ thing is a little over-don (usually by people who don’t have labs) whilst the usefulness of labs has also been over-egged (probably by the people who DO have them!)
Your 9 points sound like the argument for decent facilitators above all else ;-) Feeling like you’re speaking to a real person who is sympathetic and above all transparent about what they’re up to is paramount, surely?
Rob – Very true! A good facilitator can make an interrogation room seem like a pleasant setting. It’s all about the rapport, really.
Nice tips, Harry.
Rob’s right about the importance of good facilitation. I find that a well prepared meeter-and-greeter can be a big help too; checking that the participant’s OK, answering questions, getting them a drink, hanging their coat up etc. Little things, but it all helps to create a more relaxed feel and makes establishing that crucial rapport much easier.
+1 for the formal labs thing too (though you know that I prefer to do usability tests out in the field).
Perhaps it’s something to do with the name or labs being seen as more ‘scientific’, but they often tend to be very sterile places. One of the best examples of a lab done right that I’ve seen is at Nokia in Huntingdon. It’s set up to mimic a sitting room (think of an Ikea display) for testing their consumer products. The lab in your story sounds great too, though I imagine the Director had a bit of a hard time explaining re-imbursement for personal belongings on the company expenses. He didn’t go on to become an MP did he?
Pingback: ОдноÑтороннее зеркало в юзабилити лаборатории | Usability.by
I’m with Rob – there’s no substitute for a good moderator/facilitator.
One/Two way mirrored facilities are not worth the hassle/expense. Apart from making the participants hyper aware that they are being observed, the people observing need to be quiet and can’t engage with the research team. How many of us have seen their participants turn to the mirror and wave at the observers?
Eye tracking (non-headmounted) is the most natural way to test users. Modern systems are far from being ‘awkward’ as you put it. Participants are not forced to think out aloud (which is highly un-natural), they just get on with tasks on their own and then the moderator plays back the eye tracking at the end of the test to discuss the session. Research has shown that users find this style of testing least stressful.
Pingback: Our Bookmarks: Jun 22 - Jun 28, 2009