REMI: Defect prediction for efficient API testing

Abstract

Quality assurance for common APIs is important since the the reliability of APIs affects the quality of other systems using the APIs. Testing is a common practice to ensure the quality of APIs, but it is a challenging and laborious task especially for industrial projects. Due to a large number of APIs with tight time constraints and limited resources, it is hard to write enough test cases for all APIs. To address these challenges, we present a novel technique, Remi that predicts high risk APIs in terms of producing potential bugs. Remi allows developers to write more test cases for the high risk APIs. We evaluate Remi on a real-world industrial project, Tizen-wearable, and apply Remi to the API development process at Samsung Electronics. Our evaluation results show that Remi predicts the bug-prone APIs with reasonable accuracy (0.681 f-measure on average). The results also show that applying Remi to the Tizen-wearable development process increases the number of bugs detected, and reduces the resources required for executing test cases.