In this BusinessWeek article, Jakob Nielsen calls the OLPC UI design approach “reckless” because they have done no user testing so far. Meanwhile, John Maeda bizzarely praises process as “…the Steve Jobs method. […] You don’t use focus groups. You just do it right.”
You just do it right? …You just do it right? … That’s a little overconfident don’t you think? You are talking about children’s lives and huge chunks of the education budgets of governments that don’t have money to spare. And no self-respecting UCD practitioner would use focus groups in this context anyway. Imagine trying to explain the UI to a bunch of kids in a room. The only way to test it is to put it in the target environment, and look at the way it’s adopted.
What exactly would the UI designers have had to loose from doing a bit of field testing every month from the outset? They had everything to gain and nothing to loose. After all, the UI is hugely adventurous:
- There are no windows, all the applications run in “full screen mode”.
- On the “desktop”, you don’t just see icons of your own files, you can see icons of your friends, and you do thinks with them like chat, draw, browse the web or study together.
- There’s a special button on the keyboard that lets you view and (allegedly) edit the sourcecode of the program you are using at any time.
Innovation is a wonderful thing but you have to reality check: are these concepts really the best approach for the user requirements? And have they been implemented in the best possible way? They are making a lot of assumptions – it’s a big gamble.
I’ve yet to hear about the plans they have for releasing UI updates for the OLPC. Since when in the history of computing did version 1 of anything turn out to be the panacea of good design? At least when you buy version 1 of something, you know what you’re in for. The kids wont have a choice.
“Meanwhile, John Maeda bizzarely praises process as “…the Steve Jobs method. […] You don’t use focus groups. You just do it right.†”
This touches on something that I’ve been meaning to post about myself: Focus Groups are NOT THE SAME THING as usability tests. Anyone who does not know the difference really doesn’t understand that data that comes out of usability tests.
On one hand Maeda’s statement can sound absolutely stupid, but on the other, if you assume he knows the difference between a Usability test and a focus group, then perhaps there’s wisdom there.
Anyway you look at the first part of the comment, the second part — “you just do it right” — is completely idiotic no matter how you spin it. It’s like asking a football coach what their team’s strategy is and having him/her reply “Our strategy is to win.”
Could you comment on this OLPC article?
http://news.zdnet.com/2100-9590_22-6165189.html?tag=nl.e589
The OLPC (one laptop per child) project has been described as the first complete rethinking of the computer user interface in more than 30 years. The target audience is described as hundreds of millions of poor kids all over the world. In my opinion that makes it a very significant project. While proper evaluation is necessary for the success of projects of such enourmous magnatude, careful choices must be made from the large number of evaluation possibilities based on several determining factors (i.e. stage of design, number of expected users, time available, funds available for testing, etc.). This particular project also has the added complexity of geographical location of the user.
Usability tests have been shown to provide important feedback to guide designers during the design phase. They not only speed up projects but can also produced dramatic cost savings. Despite the importance of usability testing, there are a couple of serious limitations.
1. Usability tests are usually one to three hours long. This is not long enough to predict how performance will be after a week or month of regular usage.
2. Within the short time of a usability test, the participants may get to use only a small fraction of the system’s features.
Because of these shortcomings, other varied forms of expert reviews have been used to supplement. Longer term testing in more realistic test environments are necessary to fully understand adoption and learning processes.
The distribution of 2500 beta 2 machines to the target audience will provide far more valuable feedback although later in the design process. The release of the code as open source will also provide valuable feedback. This design team seems to have made some very good evaluation choices under the circumstances.
Hi Garrett.
You have posted some very well considered comments here. I agree with you on most points, but I’m a little hesitant on others…
Agreed:
* Usability tests can be expensive, and usually only provide a snapshot of use (often first-time use).
* Expert reviews are rarely a bad idea in any case
* For this product, it’s all about the long game. How will things really pan out?
Not so sure:
* Even though it’s all about the long game, does it therefore follow that short game stuff should not be done at the early stages? – Like developing paper prototypes and running user tests on them?
* Once the beta machines are deployed, doesn’t this mean that the code has been already written to run on these low power machines? Developing the Sugar UI in this way was probably very hard work. So by this stage, they’ve done all this work, but can’t be sure whether the new interaction models (like being full screen, social features, etc), are the best they can be in terms of usability nor usefulness.
* In other words, it’s a bit of a gamble – things may turn out fine, they may not. But wouldn’t it just have been good practice to NOT gamble in this situation? I’m not that clued up on how much re-development is going to take place during this beta phase, nor what’s going to happen after version 1 is shipped, but it’s never a bad idea to involve your users when things are still on the drawing board.
I’m interested to know your further thoughts on these points so please do reply to these comments.
Pingback: Mike’s Journal » Blog Archive » olpc goes to mass manufacturing
Pingback: One Laptop per Child hos IAllenkelhet - Fagblogg om brukervennlighet skrevet av NetLife Research
Pingback: One Laptop per Child — iAllenkelhet