User acceptance testing (UAT) is a critical practice to employ for a multitude of products and processes. For the purpose of this article most of my examples will be within the context of migrating or merging instances for Atlasssian products. Nonetheless, these tips can be used for other avenues: I actually picked up these habits working as a QA tester for a video game publisher.
When testing a product or a process, such as a migration or a merger of two instances, if you come across any issues, the most important thing you can do is provide as much context as possible so the developer or admin whose responsibility it is to correct the issue can have as best of an understanding as possible of how the issue came about. The best way to achieve this is by telling them what you did (repro steps), telling them what you expected to happen (expected result), and then telling them what actually happened (actual result). By providing the steps you took and giving the context of what you expected from those steps, followed by what actually happened, it paints a better picture for the team in charge of dealing with it.
Speaking of pictures, we used to have a saying on the QA team I worked with: “Screenshot or it didn’t happen.” If you can provide a screenshot of your issue, you increase the chance that the person responsible for resolving the issue will be able to address it without any back and forth. Screenshots of any errors you see on pages, or incorrect configurations of data, help identify the exact issue, with no room for interpretation. If you’re doing user acceptance testing, a screenshot of the UAT instance where the issue lives and what it looks like in production is even better. Again we’re trying to establish context for what your expectation was and what you actually saw.
Often during migrations or mergers, the individuals who are performing the work do not have the context of what the content is and what it should look like. This is why user acceptance testing is such a valuable tool: It gives the users a chance to scope out the changes and see if anything looks wrong. So it is the tester’s job to provide as much information as possible to resolve any issues. Here’s an example of an issue related to a migration:
The most important thing to remember when doing testing of any kind is providing context. Always assume you can’t… assume anything! Treat it like the person you’re explaining the issue to has no idea what you’re talking about. And if you have any questions regarding UAT, or how it can make the most of your processes, drop us a line, we'd love to help you out!