Considerations for testing different types of digital experiences
Let's talk about considerations for testing different types of digital experiences. First, requirements for each type of digital experience you test differ, so it's key to keep that in mind.
When it comes to testing live products, there are a few things to note in particular:
Make sure the link or app you are sharing is accessible to the participant. Sounds like a no-brainer but you are likely sharing from your work environment which has pre-set protections and permissions so check the link in an incognito window!
Plan whether you will ask the participants to download the app before or during the session. NOTE: This takes time and can introduce some technical complexity so consider both of these aspects.
If the live product is behind a paywall, requires registration, or both, think through how each participant will access it.
For example, will you need to create test account names and passwords? Can the participants all share the same name and password or will they each need their own test account name and password? Also contemplate whether you will need to save their session activities, or not, as this will impact how you set up the test account names and passwords ;)
Consider whether you are testing the live product or app on a specific operating system (e.g. iOS or Windows) or with a browser (e.g. Chrome, Safari, etc.)
Make sure to both screen AND recruit participants with the right operating system(s), device(s), and browser configuration(s) BEFORE you schedule them. And note who has which in your planning documents. You'll also want to accommodate these variations in your discussion guides, tasks and scenarios, and other activities.
Other things to think about:
Will you need to have pop-up windows disabled or enabled? If so, how and when you will provide this level of instruction to participants? Make sure to have this scripted out for each device and browser type.
Have you confirmed the client/team will NOT make any revisions or release any updates to the live product right before or during the testing sessions that may impact the study? THIS IS A BIG ONE.
Testing live products requires planning and preparation, but with the above in mind, you'll be on your way to successful testing sessions. Happy testing!
PS. Pic for attention because not following these tips can result in horror. LOL
