A few weeks ago, I left my previous position, where I left behind a great view of Boston and some great friends. As I was going through the entire interviewing/give notice/start new job process, I felt like it was a breakup.
For example, it all starts with going on the interview elsewhere. You have to tell a white lie about your whereabouts - and you ultimately feel like you are sneaking around. You look over your shoulder and make sure no one sees you (don't you feel dirty?). Next, you have may get the offer, you weigh the pros and cons of each - or in some cases, you are so fed up with this thing, you are already out the door. In my case, I was leaning towards, the "it's not you thing, I need to spread my wings and see what else is out there type of thing".
Now you made up your mind - the old relationship is just not working anymore. Now you have to have that awkward breakup talk with your boss, which no one enjoys. For me, I hate that. The employer may try to get you to stay, try to work things out, or maybe they realize you are too far removed to even try to convince. You might even consider staying, because change is never easy. Always easier to know what to expect, then to make that leap.
OK, so now you move on to your new relationship. You may take some time to yourself coming out of that former relationship. Maybe you try some yoga, go skiing, or just relax. Now you start your new gig and it is a whole new game. You are on your best behavior - in the honey moon stage and just trying to feel everything out.
Thursday, March 18, 2010
Thursday, March 4, 2010
Is There an Art to Usability Test Moderation?
Recently, I have been rapidly teaching non-user experience professionals about usability studies and eye tracking studies. Due to the limited time, I have really been focusing on the tools and have not had the chance to delve deeper into the exact art of moderation. And in my opinion, moderating usability and eye-tracking tests is a skill that can only be perfected in time. You can teach someone a tool to generate data, but it takes more effort and experience to teach someone how to moderate. Good moderators know when to probe, when to be quiet, and when to look beyond verbal communication.
Being a good moderator also means knowing when to use think-aloud protocol. Think aloud protocol was first seen at IBM, and then refined by Ericsson and Simon. Most versions of think aloud protocol we use today is a variation of the Ericsson and Simon version where there is more active listening and more of a dialogue between moderator and participants. The more recent version encourages the use of certain acknowledgement tokens, such as “Mm hmm” rather than Ericsson and Simon’s token of “keep talking”. Some acknowledgement tokens can influence changes in speakership between the participant and the moderator.
When using think aloud protocol you have to be able to explain to the participant how to think aloud and keep reminding him or her to do so throughout the session. There are instances where you may not want to think aloud – eye-tracking studies or formative studies where you are concerned with just finding out critical problems that prevent users from completing their tasks. This past Monday, at my HF750 Testing and Assessment class at Bentley, we watched sessions of usability tests and analyzed moderators. We even watched a famous author of a usability book moderate a remote test and observed mistakes he made. It is clear that it takes years of experience, and even then, the experts can make mistakes.
Moderation is so important because the better the moderation, the better the data. Isn’t getting accurate data the point of testing? People are easily influenced, so moderator bias is a real concern. The way you ask the questions is crucial and the vibe you give off is equally as important.
Tweet
Being a good moderator also means knowing when to use think-aloud protocol. Think aloud protocol was first seen at IBM, and then refined by Ericsson and Simon. Most versions of think aloud protocol we use today is a variation of the Ericsson and Simon version where there is more active listening and more of a dialogue between moderator and participants. The more recent version encourages the use of certain acknowledgement tokens, such as “Mm hmm” rather than Ericsson and Simon’s token of “keep talking”. Some acknowledgement tokens can influence changes in speakership between the participant and the moderator.
When using think aloud protocol you have to be able to explain to the participant how to think aloud and keep reminding him or her to do so throughout the session. There are instances where you may not want to think aloud – eye-tracking studies or formative studies where you are concerned with just finding out critical problems that prevent users from completing their tasks. This past Monday, at my HF750 Testing and Assessment class at Bentley, we watched sessions of usability tests and analyzed moderators. We even watched a famous author of a usability book moderate a remote test and observed mistakes he made. It is clear that it takes years of experience, and even then, the experts can make mistakes.
Moderation is so important because the better the moderation, the better the data. Isn’t getting accurate data the point of testing? People are easily influenced, so moderator bias is a real concern. The way you ask the questions is crucial and the vibe you give off is equally as important.
Tweet
Subscribe to:
Posts (Atom)
