Choosing the Appropriate Significance Test
To choose the appropriate significance test, you should first consider the type of data you have, whether it is discrete or continuous. If you’re looking to compare data, you need to determine if you’re comparing data from two or more groups or to a benchmark, or if you’re just looking for an estimate of precision. For the former, it’s important to consider whether the groups of data come from the same or different users, and whether there are two groups or more than two groups to compare.
Then you can use decision maps, such as the ones proposed by Sauro and Lewis (2016).
Sauro, J., and Lewis, J. R., (2016). Quantifying the user experience: Practical statistics for user research: Morgan Kaufmann.