Thanks for the write up about Chalkmark. Your observations of its limitations are very astute! We definitely have all of those constraints under current consideration. In fact, we hope to be implementing some of those new features very soon.

As for recruitment, we currently envisage most users will be doing adhoc testing by using friends, co-workers, family etc for some informal testing. But for representative end users, yes, we definitely Ethnio. We’ve been talking to them about how we can perhaps work more closely together to make that recruitment process more invisible.

Any feedback at all, please, love to hear it both good and bad.

Cheers from a sunny Wellington morning.
Sam

Optimal Workshop

the thought had occurred to me. There’s no reason why you can’t add a questionnaire to the task and gather some profiling information.

It would definitely be fun, quick and fairly cheap – but I would worry about the match between the turkers and your real user-base.

Just read your post about ChalkMark and I think it looks pretty cool. Wondered what you thought about using Amazon Mechanical Turk to recruit a some testers?