Prioritizing the devices to test your app on: A case study of android game apps

Authors: Hammad Khalid Meiyappan Nagappan Emad Shihab Ahmed E. Hassan

Venue: FSE   22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE), pp. 610--620, 2014

Year: 2014

Abstract: Star ratings that are given by the users of mobile apps directly impact the revenue of its developers. At the same time, for popular platforms like Android, these apps must run on hundreds of devices increasing the chance for device-specific problems. Device-specific problems could impact the rating assigned to an app, given the varying capabilities of devices (e.g., hardware and software). To fix device-specific problems developers must test their apps on a large number of Android devices, which is costly and inefficient. Therefore, to help developers pick which devices to test their apps on, we propose using the devices that are mentioned in user reviews. We mine the user reviews of 99 free game apps and find that, apps receive user reviews from a large number of devices: between 38 to 132 unique devices. However, most of the reviews (80%) originate from a small subset of devices (on average, 33%). Furthermore, we find that developers of new game apps with no reviews can use the review data of similar game apps to select the devices that they should focus on first. Finally, among the set of devices that generate the most reviews for an app, we find that some devices tend to generate worse ratings than others. Our findings indicate that focusing on the devices with the most reviews (in particular the ones with negative ratings), developers can effectively prioritize their limited Quality Assurance (QA) efforts, since these devices have the greatest impact on ratings.

Preprint: PDF

BibTeX:

@inproceedings{hammadkhalid2014ptdttyaoacsoaga,
    author = "Hammad Khalid and Meiyappan Nagappan and Emad Shihab and Ahmed E. Hassan",
    title = "Prioritizing the devices to test your app on: A case study of android game apps",
    year = "2014",
    pages = "610--620",
    booktitle = "Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering
        "
}

Plain Text:

Hammad Khalid, Meiyappan Nagappan, Emad Shihab, and Ahmed E. Hassan, "Prioritizing the devices to test your app on: A case study of android game apps," 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE), pp. 610--620