Pros
- Unmoderated studies can be good for tight timeframes: users can complete sessions on their own schedules and even simultaneously, rather than trying to fit into scheduled time slots.
- Remote studies are great for gathering data for seeing the impact of a relatively minor change that may not justify a full moderated user test.
- Some platforms have AI interpret tones and topics of the user's transcript which can alleviate some of the work of a researcher (just make sure to review as the AI is not always correct).
Cons
- Users don’t have real-time support if they have a question, need clarification, or can’t get the technology to work
- You don’t know what the session was like until it’s finished. If a user did run into a problem, skipped tasks, or failed to complete what was asked, you don’t know until it’s over. Some sessions may end up being unusable or less valuable, depending on the issue.
- Unmoderated tests can also be quieter than moderated tests. Facilitators don't have the opportunity to nudge participants to think-aloud and encourage explanations.