Usability Test Plan

Test Objectives:

• Assess how easily users can schedule, reschedule, and cancel events using the assistant.
  
• Identify any confusion around time zone detection and calendar syncing.
  
• Evaluate perceived ease-of-use and clarity of the interface.
  

Success Metrics:

• 85% task completion rate without moderator assistance
  
• Average user satisfaction score of 4/5
  
• Time-on-task under 3 minutes for core scheduling flow
  
• No more than 1 critical usability issue per session
  

Participant Criteria:

• Age 25–55
  
• Self-employed or small business owner
  
• Owns a smartphone and actively uses at least one digital calendar tool (e.g., Google Calendar, Outlook)
  
• Mix of iOS and Android users
  

Task Scenarios:

• Connect your Google Calendar and schedule a 30-minute meeting with a client in another time zone.
  
• Reschedule the meeting for tomorrow and update the duration to 60 minutes.
  
• Cancel the event and verify the calendar updates across platforms.
  
• Add a recurring meeting every Monday at 9am.
  

Session Structure:

• Introduction (5 minutes): Welcome, consent form, test purpose
  
• Warm-up (5 minutes): Background questions on scheduling habits
  
• Task Walkthrough (30–40 minutes): Users perform tasks unaided
  
• Debrief & Feedback (10 minutes): Open discussion + survey
  

Testing Environment Setup:

• Remote via Zoom + screen sharing
  
• Moderator script + time-tracking sheet
  
• Backup recording via Loom or OBS
  
• Screen recorder and note-taker in each session
  

Handling Edge Scenarios:

• App crashes: Restart app and resume test; note incident for review
  
• Calendar integration failure: Mark as test blocker and skip task
  
• Abandoned task: Ask follow-up to understand cause (confusion, friction, lack of trust?)
  

Feedback Protocols:

• Post-task rating: “How confident were you in completing this task?” (1–5 scale)
  
• Targeted questions on UI clarity, labeling, and satisfaction
  
• Use post-test form with open-ended Qs like: “What would you change?” 

Data Analysis Methods:

• Quantitative: Time-on-task, completion rates, user ratings
  
• Qualitative: Thematic coding from observer notes and transcripts
  
• Session replays used to identify usability friction points
  

Contingency Plans:

• Participant no-show: Have backup participants on standby
  
• Device issues: Offer alternative browser/app version
  
• Internet issues: Switch to audio-only protocol or reschedule
  
• Script deviation: Realign using task prompts; skip only if absolutely necessary