Categories
Best Practices blog Deep Thoughts Events Presentations and talks

Giving Great Talks: A Mashup

Spool vs Tufte: Giving Great Talks.

I had the privilege of Jared Spool attending and critiquing some of my recent talks, and in preparation for a UIE webinar I’m giving, he took time to rip me apart give me some awesome feedback. His advice reminded me of notes I took almost ten years ago at an Edward Tufte seminar about giving great talks, and so the next logical step was to make old-timey boxing photos of them both and write a mashup of their talking tips. RIGHT? Both Jared Spool and Edward Tufte are known to be kick-ass speakers in the technology field – Tufte is all up in the freaking white house, and Jared speaks roughly 400 days a year around the world. I think we can learn a lot from their advice, and despite the artificial conflict introduced with boxing pictures, their tips are mostly complimentary.

– by Nate Bolt

tufte-respect

1. Show Up Early and Finish Early

Tufte would simply like everyone who gives a talk to be ready on-time and finish early. Simple right? He thinks nobody ever complained at having an extra few minutes for questions at the end. He also makes the point that we have a tendency to dumb down information too much, and feels that this is disrespectful to the audience. He says that just because people show up for your talk, they are not all of a sudden stupid. So speak to them like you would a trusted colleague, and finish a few minutes early. You’ll leave people feeling grateful and they can always come talk to you with any burning questions. This shows respect for peoples’ time, in addition to their intellect.

spool-content

2. Don’t Be The “Fun Cool Guy” at The Expense of Content

Jared’s first feedback for me was that I sacrificed content in previous talks to seem fun and cool, and still did this a little in my most recent talk at Interactions ’10 in Savannah. I tend to agree, so this one is pretty straightforward. I concentrated more on creating fun slides and jokes, which meant sacrificing some focus on the serious meat of the talk. I’m sure nobody would look at this blog post here with 4000px of photos and 945 words and make the same criticism. But I would add that doing the opposite – putting your content at the expense of audience engagement –  also sucks. Ever been to CHI?

spool-intro 3. Your Intro was Seven Minutes. Stop That.

As long as you have a somewhat established background in what you’re giving your talk about, skip the introduction and dive into the material right away. Jared timed my introduction and it came out to seven minutes. He suggested that was “way too fucking long,” and that I could have given contextual background information at the relevant parts of my talk. For example, when I mention how we did remote card sorting for Oracle, say that it took over 8 years and 200 studies to experiment with these methods. If you consider this paragraph analogous to the structure of a talk, I just nailed this very principle. Oh, and I’m Nate Bolt. This coincides almost perfectly with what Tufte calls the “Particular-General-Particular” strategy. Speaking of which…

tufte-pgp4. Particular General Particular (PGP)

The first thing you do in your talk, before you even say hello, is to give your audience a nugget of information – something of value. Say right away that less than 5% of user research is conducted remotely, to give people an information pay-off right away. Then explain it in general. Repeat. This point is so crystal clear it’s almost ridiculous, but I dare you to remove your boring intro slides and canned spiel about who you are. It feels wrong. But it works great.

spool-examples 5. Reference Specific Work Examples

Jared said that the most interesting points of my talk were when I referenced research we did for Princess Cruises as a success, or Habbo Games as a failure. For Princess, we were able to recruit groups of family members to conduct research with them about their cruise-planning process, and it turned out that their behavior (emailing each other and not talking) didn’t match their description of the planning process (we all talk about it). Are you wondering about Habbo now? See what I just did there?

tufte-sorry26. Giving a Talk Means Never Having to Apologize

Don’t call attention to the meta-structure of your talk and thus take focus away from the content. A friend of mine, Steve Dodson, calls this “editorializing” during a talk. For example, avoid the temptation to say “Sorry this slide is a little hard to understand, but I’ll explain it.” That is a huge mistake. Nobody will notice anything wrong with your slide, and if they do, let them silently judge you and keep going. For the 90% of people that didn’t notice your mistake, you will have never interrupted their experience.

spool-telegraphing 7. No Telegraphing

Jared pointed out that in my most recent talk I told the audience three times that I was going to “cover this more in detail later,” and he was quick to make it clear that this was a really bad idea. It pulls the audience right out of the talk. It’s also a form of editorializing from the last point, and it starts people thinking right away about something else that will happen in the future. This means they stop paying attention to what you are currently saying because it has suddenly become less interesting and important. My tendency is to want to assure people that I’ll cover everything they might be wondering about, but the truth is if I respected my audience more I would know they have the patience to at least wait until the talk is finished to judge me. So don’t be afraid to be judged at the end of the talk, instead of during the middle.

spool---monomyth8. It’s a Story, Stupid

If there is any possible way to construct a traditional Hero’s Journey, or Monomyth, do it. Don’t skimp on the story in your talk. Even something as mind-numbingly boring as remote user research can have a story built around it. Jared’s suggestion was to tell how we begin looking at this vast world of UX tools and methods, whittle it down to one, what successes and failures we ran into with that method, and how in the end we triumphed helping our clients build some amazing experience. I’ve since created a character named “Marv,” inspired by our stop-motion animation studio, to use in presentations:Screen shot 2010-06-23 at 12.29.06 PM

spool-qa 9. Leave Something For the Q&A, Bro

If you neurotically anticipate every question your audience could possibly have, and include answers in your slides as a desperate attempt at seeming wise, there will only be silence at the end. Think about a few potential common questions about your talk, and leave room for the audience to ask those questions. You know what’s coming, and they get to ask. This is also called “Winning.”

Watch Me Fuck Up and Learn

Now for the most embarrassing part. I make almost every single one of these mistakes in my talk at the IxDA conference “Interactions” in February of 2010. It’s gut-wrenching for me to watch this and see how badly I violate most of these rules, but maybe you can learn from my mistakes. MAYBE. Got any tips of your own? Think you’re tough enough to take on Tufte and Spool with a disagreement? Drop it all in the comments.

And the updated slides by themselves:

Categories
Best Practices blog Deep Thoughts Moderator Strategies

Stop Bullshit Research in Five Easy Steps

Anyone in the UX field who’s worked for a few companies will recognize a type of moderated research that gives off a reek of inauthenticity. Tell me if this sounds familiar: one moderator and six users sit around a table in a converted meeting room. The moderator tells the users, each of whom have been prescheduled and screened through a recruiting agency, to go to a prototype website and pretend they’re looking for a 20 GB googlydooter, or whatever. The users go into their cubicles, where the prototype is brought up on six identical, factory-default computers. Some of the users finish in five minutes, some don’t finish at all, but everyone gets exactly fifteen minutes to finish their task. (The early finishers drum their fingers in boredom, waiting for the moderator to call time.) Finally, the moderator brings up a projection of the prototype, and asks the users to voice their opinions, one-at-a-time, keeping their responses brief, to give everyone time to speak. The process lasts about 1-2 hours, making everyone kind of tired. The participants are paid their incentives, and the moderator drives home, wiping bitter tears from his eyes as he pulls into his driveway.

How could that possibly have been useful? he thinks to himself. What has my life come to?

Categories
Best Practices blog B|P Livin' HCI

So you wanna be a UX researcher?

It’s May! Time for graduations and job hunts, and while B|P isn’t hiring right this minute (we have an awesome team and are busy refining our practices) we will be again, before too long. It seemed like a good time for a post on what I look for when hiring user experience researchers, so here goes, in reverse order of importance:

#4: Education. If you have less than 3 or 4 years of experience, I’m looking for a degree in a related field, and that really can be anything from cognitive science to anthropology to HCI to…well, surprise me, I can be convinced. If it’s from a top school in our field, that’s cool, but it’s no big deal if it’s not. A Master’s is nice for showing a commitment to the field, but doesn’t tell me much about you as a practicing researcher. And whether you do or don’t have a related degree, you’ll definitely grab my attention with interesting people-oriented research projects during your education. (If you have more than 3 or 4 years of experience, I don’t much care where you went to school or what you studied—I’ll be evaluating your professional record exclusively.)

Categories
Best Practices blog Moderator Strategies

HOW-TO Take Time-Stamped Collaborative Notes

One thing we’ve always wanted to have is a way to allow multiple people watching one of our research sessions to take automatically time-stamped, collaborative notes–everyone working in the same document, live, with entries labeled by author. Then I realized that it’s been under our noses the whole time: IM chat rooms! With a simple piece of free software, you’ve got a time-stamping, notetaking powerhouse at your disposal. And it even supports smileys. All it takes is a little ingenuity!

Categories
Best Practices blog Moderator Strategies Remote Research

Remote is Better, pt. 1: Getting Clients’ Hands Dirty

In this inaugural entry in our B|P continuing series “Remote is Better”, we discuss how separating the moderator and the user eliminates the need for “two-way mirrors”–now you can get your clients into the driver’s seat with you (metaphorically). We show you how!

Lots of people think of remote research as a trade-off or a compromise–a cheap, quick alternative for when you can’t get users in the lab face-to-face. What often gets overlooked are the many, many qualitative benefits of testing remotely: if done properly, remote research can give you all kinds of data and insight that would be impossible to get otherwise. Of course, doing it properly means you need to know what you’re doing. Wouldn’t it be nice if there were people around with years of remote research experience, who were nice (or dumb) enough to give away all their best practices on their official blog?

Categories
Best Practices blog Remote Research

HOW-TO Use UserVue Internationally

At the clubs, people are always asking the same thing: “I love UserVue for remote user research, but I hate that I can’t use it internationally!” For those unhappy party people, here is a guide to dialing internationally with UserVue.

WHAT YOU NEED:

  • Desk phone
  • Computer w/ Skype and UserVue
  • Microphone headset for the computer
  • Moderator
  • Twix brand chocolate bar

LET’S DO THIS:

STEP 1:

Download and register for an account.

STEP 2: Login to Skype and start a UserVue session, like normal.




STEP 3:

Click “Call” in UserVue.


STEP 4:

Put your desk phone number in as Your Phone Number put the Skype call-in number as Participant’s Phone Number, and then click “Dial”.



STEP 5: Have the first Twix bar (there are two to a package). You’ll need the energy for the next few steps.


STEP 6:

Pick up your desk phone when it rings, and then dial “1” when the cold mechanical voice prompts you.

STEP 7:

Answer the call in Skype. Your desk phone will be connected to your Skype line.

STEP 8:

Mute and silence the desk phone. You won’t be speaking through it at all.

STEP 9:

In Skype, click Add Caller, and enter the participant’s number. If the built-in nternational line menu doesn’t work for any reason, then try setting the country to US and then typing in 011, the desired country code, then the participant’s number. Click Call.

STEP 10:

When the user picks up, you win. Direct him/her through the UserVue process like normal.

STEP 11:

Consume the second Twix bar–you’ve earned it. (There should be no more Twix bars. If you still have a Twix bar remaining by the end of this study, then you did it wrong, and the police will already be on their way to your house.)

(OR JAIL)

A WORD OF WARNING

Though it works and you can usually talk to your users just fine, there is a drop in the sound quality of the UserVue recordings. Also, the usual caveats apply when calling internationally with Skype, i.e. it drops out sometimes. You have been warned.

Categories
Best Practices blog

Product Detail is King

Just this week, we’ll be presenting the same usability finding that has come out of three separate studies. We’ve been calling the finding “Product Detail is King.”

Crown!It may sound obvious, but when users are looking at products online — whether it’s software, healthcare, or crockpots – detailed information about the products is of utmost importance. And a user’s success in finding that fine level of detail can truly make or break whether they have a positive experience on the site.