Towards more accurate retrieval of duplicate bug reports

Authors: Chengnian Sun David Lo Siau-Cheng Khoo Jing Jiang

Venue: ASE   2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011) , pp. 253-262, 2011

Year: 2011

Abstract: In a bug tracking system, different testers or users may submit multiple reports on the same bugs, referred to as duplicates, which may cost extra maintenance efforts in triaging and fixing bugs. In order to identify such duplicates accurately, in this paper we propose a retrieval function (REP) to measure the similarity between two bug reports. It fully utilizes the information available in a bug report including not only the similarity of textual content in summary and description fields, but also similarity of non-textual fields such as product, component, version, etc. For more accurate measurement of textual similarity, we extend BM25F - an effective similarity formula in information retrieval community, specially for duplicate report retrieval. Lastly we use a two-round stochastic gradient descent to automatically optimize REP for specific bug repositories in a supervised learning manner. We have validated our technique on three large software bug repositories from Mozilla, Eclipse and OpenOffice. The experiments show 10-27% relative improvement in recall rate@k and 17-23% relative improvement in mean average precision over our previous model. We also applied our technique to a very large dataset consisting of 209,058 reports from Eclipse, resulting in a recall rate@k of 37-71% and mean average precision of 47%.

BibTeX:

@inproceedings{chengniansun2011tmarodbr,
    author = "Chengnian Sun and David Lo and Siau-Cheng Khoo and Jing Jiang",
    title = "Towards more accurate retrieval of duplicate bug reports",
    year = "2011",
    pages = "253-262",
    booktitle = "Proceedings of 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE
            2011)
        "
}

Plain Text:

Chengnian Sun, David Lo, Siau-Cheng Khoo, and Jing Jiang, "Towards more accurate retrieval of duplicate bug reports," 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011)
        , pp. 253-262