How effective are maintainability metrics in estimating maintenance efforts? An empirical study

B. Ramachandra Reddy () and Aparajita Ojha ()
Additional contact information
B. Ramachandra Reddy: Madanapalle Institute of Technology & Science
Aparajita Ojha: Madanapalle Institute of Technology & Science

International Journal of System Assurance Engineering and Management, 2019, vol. 10, issue 5, No 10, 984-1001

Abstract: Abstract Software maintainability is often estimated by software developers and experts at the design phase to reduce maintenance efforts of software products. It is believed that the maintainability metrics help in throwing some light on the maintenance efforts of a software system. This paper studies the effectiveness of metrics of two maintainability components, namely modifiability and understandability in assessing maintenance efforts at the early design phase. To perform the empirical study, first of all, modifiability and understandability are estimated using certain design level metrics. A dataset of 776 class hierarchies from 20 different Java open source projects is considered with 12 different design level metrics as the independent variables and modifiability and understandability metrics as the dependent variables. Homogeneous as well as heterogeneous ensembles of MLR, MLP, ANN, and M5P methods are employed to predict maintainability of class hierarchies using design level metric dataset and the metric dataset of the two maintainability metrics. The concept of ROC curve for regression, ROC space and AOC introduced recently by Hernández-Orallo (Pattern Recogn 46:3395–3411, 2013) is used to determine the under/overestimation of individual models and their ensembles. It is concluded that most of the methods underestimate software maintainability that may lead to higher maintenance cost at a later stage and may also adversely affect the reputation of software companies. While modifiability is mostly underestimated, nothing could be concluded for understandability. The study is validated with the help of two available real datasets QUES and UIMS containing records of actual maintenance efforts and design level metrics dataset. These studies suggest that the definition of software modifiability metric needs a review.

Keywords: Object oriented software; Design level metrics; Maintainability; Understandability; Modifiability; Ensemble methods (search for similar items in EconPapers)
Date: 2019
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s13198-019-00828-3 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:ijsaem:v:10:y:2019:i:5:d:10.1007_s13198-019-00828-3

Ordering information: This journal article can be ordered from
http://www.springer.com/engineering/journal/13198

DOI: 10.1007/s13198-019-00828-3

Access Statistics for this article

International Journal of System Assurance Engineering and Management is currently edited by P.K. Kapur, A.K. Verma and U. Kumar

More articles in International Journal of System Assurance Engineering and Management from Springer, The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().