Categories
blog Research innovation

A Native Language Approach

It’s becoming increasingly common to want to talk to users of technologies in other countries other than your own.  Often times, this means communicating with people who are not native speakers of your language.  This can be a very challenging aspect to a project, especially when it comes to recruiting, and it is something that we at Bolt | Peters have had to deal with a number of times.  During a recent study of Japanese early adopters, we noticed a very interesting thing – When we tried recruiting Japanese participants over the phone, voicemails in english yielded a 0% response rate.  Upon having a Japanese speaker leave the exact same message to the same potential recruits, we received a 50% response rate. The interviews were still in English.

It is critical that you, as a researcher, make the recruiting process as familiar to these international participants as possible. Even if they do speak your native language, they may not be strong speakers of it, and subsequently will feel embarrassed or nervous that they might not understand everything that is initially trying to be conveyed.  This will make people not want to participate in the study, and that’s just bad news for everyone involved. Once they are more comfortable and settled into the study, it is much easier to continue doing the study in your native language.

What we did to improve response rates was translate a number of the services that we normally use into Japanese.  Below is an example of the Ethnio privacy policy translated into Japanese.

And recruiting isn’t the only place where translation is helpful.  Consider card sorts and other forms of unmoderated research.  If there isn’t an English speaker there to guide the participant, the participant may get confused and abandon the task halfway.  It’s super easy to get services like OptimalSort and Usabilla translated into other languages.  You can contact the makers of these tools and inquire how you can help translate them into other languages, and they will usually provide you with a spreadsheet of some sort that contains all the text that needs to be translated.  For a fairly cheap price, you can get all of the information in those translated by an agency, and voila – you’ve just contributed to making UX a more global practice.  Here’s what OptimalSort looks like in Japanese.


Have you had any experiences trying to conduct UX research in other countries using the native language of the population you are recruiting from?  Let us know, we’d love to hear how you do global research.

Categories
blog Misc

B|P Goes to London

Hello, chaps! I’m writing this from the future… ooooooo! Well, not really – but I have moved across the globe to London. Cool your jets, I’m still working for Bolt | Peters as your friendly Captain Ethnio. We figured, if we want to brag about how remote our methodologies are, we might as well walk the walk. So here I am – drop me a line if you’re in the neighborhood. Cheerio!

Categories
blog Conferencery

UPA, Y’all

I’m in Austin, Texas attending the UPA (Usability Professionals Association) conference. Last night there was a “Birds of a Feather” group for folks interested in remote usability testing. The discussion was moderator by Aaron Marcus and about 30-40 people showed up. It was great to hear how excited and passionate this small group was about these fairly bleeding-edge methodologies, both qualitative and quantitative.

A recurring theme at UPA has been combining qualitative and quantitative methods for more effective analysis. Catriona Campbell from Foviance is giving a talk dedicated to the topic. We’ve seen a lot of interest from clients lately in running these kinds of studies. We’ve conducted a bunch of these combined studies recently and seen exciting results that have helped us understand users better than if we used one method in isolation.

Categories
blog HCI Presentations and talks

Bolt | Peters Goes Back to College!

Last week, Nate and I had the honor to speak with a bunch of Cognitive Science students down at our alma mater, UCSD. Almost every year we send Nate and others down to talk to a Cognitive Engineering class about how much our HCI degrees mean to us in our professional lives (shocker: it’s a lot). It’s always a lot of fun and we get to meet a bunch of great people and chat it up with our mentors Dr. Jim Hollan and Dr. Ed Hutchins of the Distributed Cognition and Human Computer Interaction lab. We were joined this year by Kathy Seyama from Qualcomm‘s Usability Group, Ed Langstroth from the Volkswagen Electronics Research Laboratory, and Rod Ebrahimi from Do The Right Thing. Stay classy, San Diego.

Categories
blog Conferencery

The Booth that Gives Back!

For the sake of humanity, let me bullet point the B|P booth methodology.

  • Find a local salvation army thrift store.
  • Buy a van-full of the (best/tackiest) furniture you can get your hands on.
  • (Optional) buy a slew of records from the 1970s (to play on the turntable you brought).
  • Create your virtual living room.
  • Donate all of your bounty back to salvation army at the end of the conference (except that amazing red clock – that’s a keeper).



After walking the CHI2007 circuit that called for heavy duty shmoozin & recruitin, it took visitors a second to figure out what to make of the remote usability living room. We co-hosted with our pal Steve August from Revelation.

Since we love talking to users in their most natural, laid back state, we thought it only fitting to provide a retro lounge for our CHI friends, where they could take a break from thinking too hard. People got into it — takin a load off in a recliner, listenin to pat benatar on vinyl, and smokin candy cigarettes.

Which bring us to the second most popular question we heard: where in the world did you get those candy cigs? Nothing but retro candy at groovycandies.com.

See more photos of our CHI 2007 booth here.

Categories
blog ethnio

Stemming Mediocrity

“Mediocre?” you may say, “But it works great and we love it…most of the time.” Well, as they say, there’s the rub. It can work, but it can also suck. Bugs abound, features break randomly or are absent altogether. Basically, Interweb gremlins feast on the fatty innards of the Ethnio beast. (Meaning: our system architecture is broken and we really, really want to re-build it.)

Ethnio started as a home-spun solution to help us run remote usability interviews. We patched it together from a collection of PHP scripts and a quick and dirty implementation of the VNC screen sharing protocol. Learning as we went along, we moved from developer to developer and the web application backend grew and grew, making bug fixes and additional features more and more treacherous.

So here we are, three years since Ethnio, the first remote moderated research app ever, became a reality. It’s just Nate and I working on maintaining, supporting, and developing the product – in addition to doing interesting research and the (wonderful) chaos of running a really keen research practice. Since we first started selling Ethnio, about a year ago, the time we’ve been able to spend fixing bugs and developing new features has diminished as we spend more and more time supporting existing customers and chatting with new ones. All the while we’ve been talking about new and exciting features, without the people power or people time to implement them – without the availability to even fix many of the existing bugs and quirks.

We don’t want Ethnio to be relegated to the status of a first-run product that faded, like WordStar or the Diamond Rio. We’re not satisfied with an okay product that mostly works. We are convinced we can make Ethnio an elegant, exceptional solution – and we’re dedicating the next 4 to 6 months to just that. Yes, it does mean that we’re going to stop selling Ethnio and giving trials in the meantime, but we promise it will be so much better for everyone in the long run.

We are still just as passionate about creating a technology that helps people understand people – we just don’t want our technology to get in the way of that ideal.

We’ll post updates on our progress along the way. Watch this space.

Categories
blog ethnio

Working on More Free Trials

We’re doing everything we can do to free up more trial spots for everyone who’s been requesting them. We’d rather your first experience with ethnio was successful then have you see a bunch of bugs, so bear with us as we work out the scalability of our tool. One surefire way to get your name to the top of the list is to email us your experience and desires for remote testing.