Productivity Metrics for an Agile Software Development Team: A Systematic Review

Keywords: Agile software development, Software development management, performance metrics, productivity metrics, agile process

Abstract

Agile methodologies have been frequently adopted in software development. In the literature, multiple metrics have been used as tools for continuous improvement in Agile Software Development (ADS). However, there is a limited number of studies into specialized metrics for measuring a team’s productivity. This article presents a systematic review of the literature on metrics that assess the productivity of teams that create software implementing ADS. In total, 822 articles were identified, out of which 10 were selected applying the protocol described in this article. The results include 21 team productivity metrics, most of which focus on measuring the timely and frequent delivery of software and the value that tasks add to the software product. The classification of the metrics revealed that they are mainly oriented to organizational performance and project management and use numeric and comparative scales for measurements. These metrics reflect new trends in agile methodologies that encourage reflection-experimentation.

Author Biographies

Giovanni Hernández*, Universidad Mariana, Colombia

MSc. en Docencia Universitaria, Universidad Mariana, San Juan de Pasto-Colombia, gihernandez@umariana.edu.co

Álvaro Martínez, Universidad Mariana, Colombia

MSc. en Docencia Universitaria y Análisis y visualización de Datos Masivos, Universidad Mariana, San Juan de Pasto-Colombia, amartinez@umariana.edu.co

Robinson Jiménez, Universidad Mariana, Colombia

MSc. en Docencia Universitaria, Universidad Mariana, San Juan de Pasto-Colombia, rjimenez@umariana.edu.co

Franklin Jiménez, Universidad Mariana, Colombia

MSc. en Software Libre, Universidad Mariana, San Juan de Pasto-Colombia, fjimenez@umariana.edu.co

References

E. Oliveira, T. Conte, M. Cristo, y E. Mendes, “Software Project Managers' Perceptions of Productivity Factors: Findings from a Qualitative Study,” en Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement - ESEM ’16, Ciudad Real 2016. https://doi.org/10.1145/2961111.2962626

D. A. Guerrero-Peña, “Estrategias didácticas y plan de actividades para el diseño curricular del curso básico de la enseñanza de la "ingeniería del software" a partir del proyecto Swebok,” TecnoLógicas, no. 18, pp. 187–219, Jun. 2007. https://doi.org/10.22430/22565337.483

D. Guerrero-Peña, H. Trefftz-Gómez, y R. Anaya, “Juegos en la Enseñanza de la Ingeniería del Software,” TecnoLógicas, no. 22, pp. 43- 60, Jul. 2009. https://doi.org/10.22430/22565337.228

T. Dingsøyr, S. Nerur, V. Balijepally, y N. B. Moe, “A decade of agile methodologies: Towards explaining agile software development,” J. Syst. Softw., vol. 85, no. 6, pp. 1213–1221, Jun. 2012. https://doi.org/10.1016/j.jss.2012.02.033

K. Beck et al., “Manifesto for Agile Software Development,” 2001. Disponible en: https://agilemanifesto.org/

G. Hernández, Á. Martínez, R. Jiménez, y F. Jiménez, “Scrum y Peopleware : elementos clave para la gestión en la construcción de software,” Iber. J. Inf. Syst. Technol., no. E19, pp. 265–277, 2019. Disponible en: https://search.proquest.com/openview/3f3e68e1956185242a4fe1252d9f481e/1?pq-origsite=gscholar&cbl=1006393

S. Yamada y R. Kii, “Software quality analysis for agile development,” en 2015 4th International Conference on Reliability, Infocom Technologies and Optimization (ICRITO) (Trends and Future Directions), Noida, 2015. pp. 1–5. https://doi.org/10.1109/ICRITO.2015.7359201

C. W. H. Davis, Agile Metrics in Action: Measuring and Enhancing the Performance of Agile Teams, 1st ed. New York: Manning Publications Co, 2015. Disponible en: https://dl.acm.org/citation.cfm?id=2846423

P. Rodríguez, J. Markkula, M. Oivo, y K. Turula, “Survey on agile and lean usage in finnish software industry,” en Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement - ESEM ’12, Lund-Sweden, 2012, pp. 139-148. https://doi.org/10.1145/2372251.2372275

G. M. Kapitsaki y M. Christou, “Learning from the Current Status of Agile Adoption,” en International Conference on Evaluation of Novel Approaches to Software Engineering, vol. 551, Switzerland. 2015, pp. 18–32. https://doi.org/10.1007/978-3-319-27218-4_2

G. Hernández, Á. Martínez, I. Argote, y D. Coral, “Metodología adaptativa basada en Scrum : Caso empresas de la Industria de Software en San Juan de Pasto - Colombia,” Rev. Tecnológica ESPOL, vol. 28, no. 5, pp. 211–223, Dic. 2015. Disponible en: https://pdfs.semanticscholar.org/bf69/ee9c57f199af4fc4e0d10d98a3598dc3b12d.pdf?_ga=2.104494272.1793080084.1574094862-157729077.1571259895

K. Schwaber y J. Sutherland, “The Scrum Guide - The Definitive Guide to Scrum: The Rules of the Game,” 2017. Disponible en: https://www.scrumguides.org/docs/scrumguide/v2017/2017-Scrum-Guide-US.pdf

L. Bass, P. Clements, y R. Kazman, “Software Architecture in Practice SEI Series in Software Engineering,” 3rd ed., Addison-Wesley Professional, 2013. Disponible en: https://www.pearson.com/us/search-results-higher-education.html?_charset_=UTF-8&q=Software+Architecture+in+Practice

A. Cockburn, “The Heart of Agile,” 2018. Disponible en: http://www.les-traducteurs-agiles.org/assets/alistair_cockburn/2018.10.23-DK-fr.pdf

M. Staron y W. Meding, Software Development Measurement Program: Development, Management and Evolution, 1st ed. Cham: Springer International Publishing, 2018. https://doi.org/10.1007/978-3-319-91836-5

E. Kupiainen, M. V Mäntylä, y J. Itkonen, “Using metrics in Agile and Lean Software Development – A systematic literature review of industrial studies,” Inf. Softw. Technol., vol. 62, no. 1, pp. 143–163, Jun. 2015. https://doi.org/10.1016/j.infsof.2015.02.005

S. L. Ramírez-Mora y H. Oktaba, “Productivity in Agile Software Development: A Systematic Mapping Study,” en 2017 5th International Conference in Software Engineering Research and Innovation (CONISOFT), Mérida, 2017. pp. 44–53. https://doi.org/10.1109/CONISOFT.2017.00013

P. Ram, P. Rodriguez, y M. Oivo, “Software Process Measurement and Related Challenges in Agile Software Development: A Multiple Case Study,” en Product-Focused Software Process Improvement 19th International Conference, PROFES 2018, vol. 11271, Wolfsburg, 2018, pp. 272–287. https://doi.org/10.1007/978-3-030-03673-7_20

E. Kupiainen, M. V Mäntylä, y J. Itkonen, “Why are industrial agile teams using metrics and how do they use them?,” en Proceedings of the 5th International Workshop on Emerging Trends in Software Metrics - WETSoM 2014, Hyderabad, 2014, pp. 23–29. https://doi.org/10.1145/2593868.2593873

K. V. Jeeva-Padmini, H. M. N. Dilum Bandara y I. Perera, “Use of software metrics in agile software development process,” en 2015 Moratuwa Engineering Research Conference (MERCon), Moratuwa, 2015, pp. 312–317. https://doi.org/10.1109/MERCon.2015.7112365

B. A. Kitchenham, D. Budgen y P. Brereton, Evidence-Based Software Engineering and Systematic Reviews, 1st ed. New York: Chapman and Hall/CRC, 2015. https://doi.org/10.1201/b19467

I. Kayes, M. Sarker y J. Chakareski, “Product backlog rating: a case study on measuring test quality in scrum,” Innov. Syst. Softw. Eng., vol. 12, no. 4, pp. 303–317, Dec. 2016. https://doi.org/10.1007/s11334-016-0271-0

A. Tarhan y S. G. Yilmaz, “Systematic analyses and comparison of development performance and product quality of Incremental Process and Agile Process,” Inf. Softw. Technol., vol. 56, no. 5, pp. 477–494, May. 2014. https://doi.org/10.1016/j.infsof.2013.12.002

C. J. Torrecilla-Salinas, J. Sedeño, M. J. Escalona y M. Mejías, “Estimating, planning and managing Agile Web development projects under a value-based perspective,” Inf. Softw. Technol., vol. 61, pp. 124–144, May. 2015. https://doi.org/10.1016/j.infsof.2015.01.006

C. J. Torrecilla-Salinas, J. Sedeño, M. J. Escalona, y M. Mejías, “Estimating, planning and managing Agile Web development projects under a value-based perspective,” Inf. Softw. Technol., vol. 61, pp. 124–144, May. 2015. https://doi.org/10.1016/j.infsof.2015.01.006

R. Berntsson Svensson, “Measuring Team Innovativeness: A Multiple Case Study of Agile and Lean Software Developing Companies,” en International Conference on Product-Focused Software Process Improvement-PROFES 2017: Product-Focused Software Process Improvement, 2017, pp. 37–51. https://doi.org/10.1007/978-3-319-69926-4_4

E. Scott y D. Pfahl, “Exploring the Individual Project Progress of Scrum Software Developers,” en International Conference on Product-Focused Software Process Improvement PROFES 2017: Product-Focused Software Process Improvement, 2017, pp. 341–348. https://doi.org/10.1007/978-3-319-69926-4_24

M. Pacheco, A.-L. Mesquida y A. Mas, “Being Agile While Coaching Teams Using Their Own Data,” en Communications in Computer and Information Science, vol. 896, 2018, pp. 426–436. https://doi.org/10.1007/978-3-319-97925-0_36

C. Arumugam, S. Vaidayanthan y H. Karuppuchamy, “Global Software Development: Key Performance Measures of Team in a SCRUM Based Agile Environment,” en International Conference on Computational Science and Its Applications - Computational Science and Its Applications – ICCSA 2018, Springer International Publishing, 2018, pp. 672–682. https://doi.org/10.1007/978-3-319-95171-3_53

J. Heidenberg, M. Weijola, K. Mikkonen y I. Porres, “A Metrics Model to Measure the Impact of an Agile Transformation in Large Software Development Organizations,” en International Conference on Agile Software Development-XP 2013: Agile Processes in Software Engineering and Extreme Programming, vol. 149, 2013, pp. 165–179. https://doi.org/10.1007/978-3-642-38314-4_12

N. E. Fenton y J. Bieman, Software metrics : a rigorous and practical approach, 3rd ed. London: CRC Press. Taylor & Francis Group, 2015. Disponible en: https://www.crcpress.com/Software-Metrics-A-Rigorous-and-Practical-Approach-Third-Edition/Fenton-Bieman/p/book/9781439838228

J. Kerievsky, “Modern Agile,” Modern Agile. Disponible en: http://modernagile.org/

How to Cite
Hernández, G., Martínez, Álvaro, Jiménez, R., & Jiménez, F. (2019). Productivity Metrics for an Agile Software Development Team: A Systematic Review. TecnoLógicas, 22, 63-81. https://doi.org/10.22430/22565337.1510

Downloads

Download data is not yet available.
Published
2019-12-05
Section
Review Article