This is a hot topic as can be seen here: http://talk.maemo.org/showthread.php?t=41179

A lot of members, especially senior ones, recognize the value in improving our testing process. I'm not experienced enough yet to address details or offer advice but for now there are knowledgeable and passionate people pushing hard to lower the entry bar for users and make sure the process steps are useful and the results meaningful. They have been offering a lot of guidance here lately, in the thread above and elsewhere.

I am working on designing a framework I think would significantly help in this matter. The goal is to get as much of the experience directly on/from the device and minimize the hurdles testers have to join. Keep an eye on the User Experience Brainstorm proposal for further developments there!