Instrumentos de evaluación del pensamiento computacional: una revisión sistemática
Resumen
El pensamiento computacional (PC) es una nueva forma de alfabetización y se considera como una competencia clave para los ciudadanos de la era actual. Es un constructo compuesto que tiene relación con la resolución de problemas, el pensamiento matemático, el pensamiento crítico, la creatividad y la comunicación. La investigación sobre la evaluación del PC se encuentra en consolidación, sin embargo, se evidencia ausencia de agrupación sistemática de instrumentos de medición del PC en diferentes niveles educativos. El objetivo de esta revisión consistió en identificar los instrumentos usados como herramientas para medir el PC, las habilidades evaluadas y las propiedades psicométricas de los instrumentos. Esta revisión sistemática presentó el análisis de 52 artículos encontrados del 2012 al 2022. Los resultados de la revisión demostraron un crecimiento significativo en las publicaciones relacionadas con el diseño y la validación de instrumentos de medición del PC en los últimos años. Se encontró que más del 80 % de los instrumentos presentaron evidencia de validez y confiabilidad, destacando la validez de contenido, la validez de constructo y la consistencia interna. Así mismo, en algunos instrumentos se consideraron la evaluación de habilidades afectivas, sociales y actitudes, lo cual enriquecía la valoración de las habilidades cognitivas. Sin embargo, se evidenció la ausencia de los países de Centro y Sur América en los artículos analizados sobre esta temática, al igual que la escasez de instrumentos dirigidos a la primera infancia y a los docentes. Estos hallazgos resaltan la necesidad de continuar investigando el PC desde la perspectiva de la evaluación en poblaciones específicas.
Referencias bibliográficas
H. Arranz de la Fuente, and A. Pérez García, “Evaluación del pensamiento computacional en educación primaria,” Rev. Interuniv. Investig. en Tecnol. Educ. Educ., no. 3, pp. 25–39, 2017. http://dx.doi.org/10.6018/riite/2017/267411
C. Fadel, M. Bialik, and B. Trilling, Educación en cuatro dimensiones: las competencias que los estudiantes necesitan para su realización, Santiago, Chile: Grafhika Impresores, 2016. [Online]. Available: https://www.educarchile.cl/recursos-para-el-aula/educacion-en-cuatro-dimensiones
C. L. Scott, “El futuro del aprendizaje 2 ¿Qué tipo de aprendizaje se necesita para el siglo XXI?,” Organización de las Naciones Unidas para la Educación, la Ciencia y la Cultura, París, Rep. ERF No. 14, 2015. [Online]. Available: https://repositorio.minedu.gob.pe/bitstream/handle/20.500.12799/4661/El%20futuro%20del%20aprendizaje%202%20Qu%c3%a9%20tipo%20de%20aprendizaje%20se%20necesita%20para%20el%20siglo%20XXI.pdf?sequence=1&isAllowed=y
J. M. Wing, “Computational thinking and thinking about computing,” Philos. Trans. R. Soc. A Math. Phys. Eng. Sci., vol. 366, no. 1881, pp. 3717–3725, Oct. 2008. https://doi.org/10.1098/rsta.2008.0118
M. Román-González, “Codigoalfabetización y pensamiento computacional en educación primaria y secundaria: validación de un instrumento y evaluación de programas,” Ph.D. dissertation, Escuela Internacional de Doctorado, Universidad Nacional de Educación a Distancia, España, 2016. [Online]. Available: http://e-spacio.uned.es/fez/view/tesisuned:Educacion-Mroman
X. Tang, Y. Yin, Q. Lin, R. Hadad, and X. Zhai, “Assessing computational thinking: A systematic review of empirical studies,” Comput. Educ., vol. 148, p. 103798, Apr. 2020. https://doi.org/10.1016/j.compedu.2019.103798
K. Brennan, and M. Resnick, “New frameworks for studying and assessing the development of computational thinking,” in Proceedings of the 2012 annual meeting of the American educational research association, Vancouver, Canada, Apr. 2012, p. 25. [Online]. Available: https://scratched.gse.harvard.edu/ct/files/AERA2012.pdf
D. Weintrop et al., “Defining Computational Thinking for Mathematics and Science Classrooms,” J. Sci. Educ. Technol., vol. 25, pp. 127–147, Feb. 2016. https://doi.org/10.1007/s10956-015-9581-5
L. Werner, J. Denner, and S. Campe, “Children programming games: A strategy for measuring computational learning,” ACM Trans. Comput. Educ., vol. 14, no. 4, pp. 1-22, Dec. 2014. https://doi.org/10.1145/2677091
ISTE, and CSTA, “Operational definition of computational thinking for K-12 education.,” National Science Foundation, 2011. [Online]. Available: https://cdn.iste.org/www-root/Computational_Thinking_Operational_Definition_ISTE.pdf
C. Selby, and J. Woollard, “Computational thinking: the developing definition,” University of Southampton, Inglaterra, Rep. Soton356481, Oct. 2013. [Online]. Available: http://eprints.soton.ac.uk/id/eprint/356481
A. Yadav, C. Mayfield, N. Zhou, S. Hambrusch, and J. T. Korb, “Computational thinking in elementary and secondary teacher education,” ACM Trans. Comput. Educ., vol. 14, no. 1, pp. 1–16, Mar. 2014. https://doi.org/10.1145/2576872
E. Relkin, L. de Ruiter, and M. U. Bers, “TechCheck: Development and Validation of an Unplugged Assessment of Computational Thinking in Early Childhood Education,” J. Sci. Educ. Technol., vol. 29, no. 4, pp. 482–498, Aug. 2020. https://doi.org/10.1007/s10956-020-09831-x
E. Relkin, and M. Bers, “TechCheck-K: A measure of computational thinking for kindergarten children,” in 2021 IEEE Global Engineering Education Conference, Vienna, Austria, 2021, pp. 1696-1702. https://doi.org/10.1109/EDUCON46332.2021.9453926
L. El-Hamamsy et al., “Comparing the psychometric properties of two primary school Computational Thinking (CT) assessments for grades 3 and 4: The Beginners’ CT test (BCTt) and the competent CT test (cCTt),” Front. Psychol., vol. 13, Dec. 2022. https://doi.org/10.3389/fpsyg.2022.1082659
L. Wang, F. Geng, X. Hao, D. Shi, T. Wang, and Y. Li, “Measuring coding ability in young children: relations to computational thinking, creative thinking, and working memory,” Curr. Psychol., vol. 42, no. 10, pp. 8039-8050, Apr. 2021. https://doi.org/10.1007/s12144-021-02085-9
K. Kanaki, and M. Kalogiannakis, “Assessing Algorithmic Thinking Skills in Relation to Gender in Early Childhood,” Educ. Process Int. J., vol. 11, no. 2, pp. 44–59, Jun. 2022. https://doi.org/10.22521/edupij.2022.112.3
M. Cutumisu, C. Adams, and C. Lu, “A Scoping Review of Empirical Research on Recent Computational Thinking Assessments,” J. Sci. Educ. Technol., vol. 28, no. 6, pp. 651–676, Dec. 2019. https://doi.org/10.1007/s10956-019-09799-3
C. Lu, R. Macdonald, B. Odell, and V. Kokhan, “A scoping review of computational thinking assessments in higher education,” J. Comput. High. Educ., vol. 34, no. 2, pp. 416–461, Aug. 2022. https://doi.org/10.1007/s12528-021-09305-y
K. I. McCormick, and J. A. Hall, “Computational thinking learning experiences, outcomes, and research in preschool settings: a scoping review of literature,” Educ. Inf. Technol., vol. 27, no. 3, pp. 3777–3812, Apr. 2022. https://doi.org/10.1007/s10639-021-10765-z
N. Da Cruz Alves, C. Gresse Von Wangenheim, and J. C. R. Hauck, “Approaches to assess computational thinking competences based on code analysis in K-12 education: A systematic mapping study,” Informatics Educ., vol. 18, no. 1, pp. 17–39, Apr. 2019. https://doi.org/10.15388/infedu.2019.02
M. Tekdal, “Trends and development in research on computational thinking,” Educ. Inf. Technol., vol. 26, no. 5, pp. 6499–6529, Sep. 2021. https://doi.org/10.1007/s10639-021-10617-w
E. Bakala, A. Gerosa, J. P. Hourcade, and G. Tejera, “Preschool children, robots, and computational thinking: A systematic review,” Int. J. Child-Computer Interact., vol. 29, p. 100337, Sep. 2021. https://doi.org/10.1016/j.ijcci.2021.100337
N. O. Ezeamuzie, J. S. C. Leung, and F. S. T. Ting, “Unleashing the Potential of Abstraction From Cloud of Computational Thinking: A Systematic Review of Literature,” J. Educ. Comput. Res., vol. 60, no. 4, pp. 877–905, Dec. 2022. https://doi.org/10.1177/07356331211055379
H. İ. Haseki, and U. Ilic, “An Investigation of the Data Collection Instruments Developed to Measure Computational Thinking,” Informatics Educ., vol. 18, no. 2, pp. 297–319, Oct. 2019. https://doi.org/10.15388/infedu.2019.14
P. Kakavas, and F. C. Ugolini, “Computational thinking in primary education : a systematic literature review,” Research on Education and Media, vol. 11, no. 2. Dec. 2019. https://doi.org/10.2478/rem-2019-0023
N. O. Ezeamuzie, and J. S. C. Leung, “Computational Thinking Through an Empirical Lens: A Systematic Review of Literature,” J. Educ. Comput. Res., vol. 60, no. 2, pp. 481–511, Apr. 2022. https://doi.org/10.1177/07356331211033158
E. Taslibeyaz, E. Kursun, and S. Karaman, “How to Develop Computational Thinking: A Systematic Review of Empirical Studies,” Informatics Educ., vol. 19, no. 4, pp. 701–719, Dec. 2020. https://doi.org/10.15388/infedu.2020.30
C. Tikva, and E. Tambouris, “Mapping Computational Thinking through Programming in K-12 Education: A Conceptual Model based on a Systematic Literature Review,” Comput. Educ., vol. 162, p. 104083, Mar. 2020. https://doi.org/10.1016/j.compedu.2020.104083
H. Lei, M. M. Chiu, F. Li, X. Wang, and G. Ya-Jing, “Computational thinking and academic achievement: A meta-analysis among students,” Child. Youth Serv. Rev., vol. 118, p. 105439, Nov. 2020. https://doi.org/10.1016/j.childyouth.2020.105439
L. Sun, L. Hu, and D. Zhou, “Which way of design programming activities is more effective to promote K‐12 students’ computational thinking skills? A meta‐analysis,” J. Comput. Assist. Learn., vol. 37, no. 4, pp. 1048–1062, Aug. 2021. https://doi.org/10.1111/jcal.12545
L. Sun, L. Hu, and D. Zhou, “The bidirectional predictions between primary school students’ STEM and language academic achievements and computational thinking: The moderating role of gender,” Think. Ski. Creat., vol. 44, p. 101043, Jun. 2022. https://doi.org/10.1016/j.tsc.2022.101043
A. C. Tricco et al., “PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation,” Ann. Intern. Med., vol. 169, no. 7, pp. 467–473, Sep. 2018. https://doi.org/10.7326/M18-0850
J. M. Wing, “Computational thinking,” Commun. ACM, vol. 49, no. 3, pp. 33–35, Mar. 2006. https://dl.acm.org/doi/pdf/10.1145/1118178.1118215
G. Urrútia, and X. Bonfill, “PRISMA declaration: A proposal to improve the publication of systematic reviews and meta-analyses,” Medicina Clínica, vol. 135, no. 11, pp. 507–511, Oct. 2010. https://doi.org/10.1016/j.medcli.2010.01.015
Y. Li, S. Xu, and J. Liu, “Development and Validation of Computational Thinking Assessment of Chinese Elementary School Students,” J. Pacific Rim Psychol., vol. 15, Aug. 2021. https://doi.org/10.1177/18344909211010240
M. Román-González, J. C. Pérez-González, J. Moreno-León, and G. Robles, “Can computational talent be detected? Predictive validity of the Computational Thinking Test,” Int. J. Child-Computer Interact., vol. 18, pp. 47–58, Nov. 2018. https://doi.org/10.1016/j.ijcci.2018.06.004
M. Román-González, J. C. Pérez-González, and C. Jiménez-Fernández, “Which cognitive abilities underlie computational thinking? Criterion validity of the Computational Thinking Test,” Comput. Human Behav., vol. 72, pp. 678–691, Jul. 2017. https://doi.org/10.1016/j.chb.2016.08.047
K. Lee, and J. Cho, “Computational Thinking Evaluation Tool Development for Early Childhood Software Education,” JOIV Int. J. Informatics Vis., vol. 5, no. 3, p. 313, Sep. 2021. https://doi.org/10.30630/joiv.5.3.672
Y. Lee, and J. Cho, “Toward Developing a Real-World Computational Thinking Test Tool from Existing Models,” Int. J. Recent Technol. Eng., vol. 8, no. 2S6, pp. 389–393, Jul. 2019. https://doi.org/10.35940/ijrte.B1073.0782S619
S. Sovey, K. Osman, and M. E. E. M. Matore, “Gender differential item functioning analysis in measuring computational thinking disposition among secondary school students,” Front. Psychiatry, vol. 13, Nov. 2022. https://doi.org/10.3389/fpsyt.2022.1022304
S. Sovey, K. Osman, and M. E. E. Mohd-Matore, “Exploratory and Confirmatory Factor Analysis for Disposition Levels of Computational Thinking Instrument Among Secondary School Students,” Eur. J. Educ. Res., vol. 11, no. 2, pp. 639–652, Apr. 2022. https://doi.org/10.12973/eu-jer.11.2.639
S. C. Kong, and Y. Q. Wang, “Item response analysis of computational thinking practices: Test characteristics and students’ learning abilities in visual programming contexts,” Comput. Human Behav., vol. 122, p. 106836, Sep. 2021. https://doi.org/10.1016/j.chb.2021.106836
K. Siu-Cheung, and M. Lai, “Effects of a teacher development program on teachers’ knowledge and collaborative engagement, and students’ achievement in computational thinking concepts,” Br. J. Educ. Technol., vol. 54, no. 2, pp. 489–512, Mar. 2023. https://doi.org/10.1111/bjet.13256
L. El-Hamamsy, M. Zapata-Cáceres, E. M. Barroso, F. Mondada, J. D. Zufferey, and B. Bruno, “The Competent Computational Thinking Test: Development and Validation of an Unplugged Computational Thinking Test for Upper Primary School,” J. Educ. Comput. Res., vol. 60, no. 7, pp. 1818–1866, May. 2022. https://doi.org/10.1177/07356331221081753
Ö. Korkmaz, R. Çakir, and M. Y. Özden, “A validity and reliability study of the computational thinking scales (CTS),” Comput. Human Behav., vol. 72, pp. 558–569, Jul. 2017. https://doi.org/10.1016/j.chb.2017.01.005
Ö. Korkmaz, and X. Bai, “Adapting Computational Thinking Scale (CTS) for Chinese High School Students and Their Thinking Scale Skills Level,” Particip. Educ. Res., vol. 6, no. 1, pp. 10–26, Jun. 2019. https://doi.org/10.17275/per.19.2.6.1
E. Çoban, and Ö. Korkmaz, “An alternative approach for measuring computational thinking: Performance-based platform,” Think. Ski. Creat., vol. 42, p. 100929, Dec. 2021. https://doi.org/10.1016/j.tsc.2021.100929
M. Lafuente Martínez, O. Lévêque, I. Benítez, C. Hardebolle, and J. D. Zufferey, “Assessing Computational Thinking: Development and Validation of the Algorithmic Thinking Test for Adults,” J. Educ. Comput. Res., vol. 60, no. 6, pp. 1436–1463, Feb. 2022. https://doi.org/10.1177/07356331211057819
J. Guggemos, S. Seufert, and M. Román-González, “Computational Thinking Assessment – Towards More Vivid Interpretations,” Technol. Knowl. Learn., vol. 28, no. 2, pp. 539–568, Jun. 2023. https://doi.org/10.1007/s10758-021-09587-2
D. E. Sondakh, K. Osman, and S. Zainudin, “A Proposal for Holistic Assessment of Computational Thinking for Undergraduate: Content Validity,” Eur. J. Educ. Res., vol. 9, no. 1, pp. 33–50, Jan. 2020. https://doi.org/10.12973/eu-jer.9.1.33
D. E. Sondakh, K. Osman, and S. Zainudin, “A Pilot Study of an Instrument to Assess Undergraduates’ Computational thinking Proficiency,” Int. J. Adv. Comput. Sci. Appl., vol. 11, no. 11, 2020. https://doi.org/10.14569/IJACSA.2020.0111134
E. Polat, S. Hopcan, S. Kucuk, and B. Sisman, “A comprehensive assessment of secondary school students’ computational thinking skills,” Br. J. Educ. Technol., vol. 52, no. 5, pp. 1965–1980, Sep. 2021. https://doi.org/10.1111/bjet.13092
L. Sun, L. Hu, D. Zhou, and W. Yang, “Evaluation and developmental suggestions on undergraduates’ computational thinking: a theoretical framework guided by Marzano’s new taxonomy,” Interact. Learn. Environ., vol. 31, no. 10, pp. 6588–6610, Mar. 2023. https://doi.org/10.1080/10494820.2022.2042311
M. Junpho, A. Songsriwittaya, and P. Tep, “Reliability and Construct Validity of Computational Thinking Scale for Junior High School Students: Thai Adaptation,” Int. J. Learn. Teach. Educ. Res., vol. 21, no. 9, pp. 154–173, Sep. 2022. https://doi.org/10.26803/ijlter.21.9.9
H. Nakahara et al., “Development of the Japanese Version of the Computational Thinking Scales for First-Year University Students in Humanities,” Japan J. Educ. Technol., vol. 46, no. 1, 2022. https://doi.org/10.15077/jjet.45089
L. Mujica De Statzewitch, “Evaluación del Desarrollo del Pensamiento Computacional en Estudiantes de Educación Primaria y Media General.,” Rev. Digit. del Dr. en Educ. la Univ. Cent. Venez., vol. 7, no. 13, pp. 35–56, Jan-Jun. 2021. http://saber.ucv.ve/ojs/index.php/rev_arete/article/view/21327/144814487622
İ. Çetin, T. Otu, and A. Oktaç, “Adaption of the Computational Thinking Test into Turkish,” Turkish J. Comput. Math. Educ., vol. 11, no. 2, May. 2020. https://doi.org/10.16949/turkbilmat.643709
C. Shiau-Wei, L. Chee-Kit, and B. Sumintono, “Assessing computational thinking abilities among Singapore secondary students: a Rasch model measurement analysis,” J. Comput. Educ., vol. 8, no. 2, pp. 213–236, Jun. 2021. https://doi.org/10.1007/s40692-020-00177-2
A. Dolmaci, and N. E. Akhan, “The Development of Computational Thinking Skills Scale: Validity and Reliability Study,” İnsan ve Toplum Bilim. Araştırmaları Derg., vol. 9, no. 3, pp. 1970–1991, Sep. 2020. https://doi.org/10.15869/itobiad.698736
B. Ertugrul-Akyol, “Development of Computational Thinking Scale: Validity and Reliability Study,” Int. J. Educ. Methodol., vol. 5, no. 3, pp. 421–432, Aug. 2019. https://doi.org/10.12973/ijem.5.3.421
K. Bati, and M. İkbal Yetişir, “Examination of Turkish Middle School STEM Teachers’ Knowledge about Computational Thinking and Views Regarding Information and Communications Technology,” Comput. Sch., vol. 38, no. 1, pp. 57–73, Mar. 2021. https://doi.org/10.1080/07380569.2021.1882206
D. C. Boulden, A. Rachmatullah, K. M. Oliver, and E. Wiebe, “Measuring in-service teacher self-efficacy for teaching computational thinking: development and validation of the T-STEM CT,” Educ. Inf. Technol., vol. 26, no. 4, pp. 4663–4689, Jul. 2021. https://doi.org/10.1007/s10639-021-10487-2
P. J. Rich, R. A. Larsen, and S. L. Mason, “Measuring teacher beliefs about coding and computational thinking,” J. Res. Technol. Educ., vol. 53, no. 3, pp. 296–316, Jul. 2021. https://doi.org/10.1080/15391523.2020.1771232
J. Sung, “Assessing young Korean children’s computational thinking: A validation study of two measurements,” Educ. Inf. Technol., vol. 27, no. 9, pp. 12969–12997, Nov. 2022. https://doi.org/10.1007/s10639-022-11137-x
M. Zapata-Cáceres, “Enseñanza, evaluación y análisis de habilidades de pensamiento computacional en etapas tempranas,” Ph.D. dissertation, Universidad Rey Juan Carlos, Madrid, España, 2022. [Online]. Available: https://burjcdigital.urjc.es/handle/10115/19965?show=full
S. Grover, and R. D. Pea, “"Systems of Assessments" for Deeper Learning of Computational Thinking in K-12,” in Annual Meeting of the American Educational Research Association, Chicago, IL, USA, Apr. 15-20, 2015. [Online]. Available: https://www.researchgate.net/publication/275771253
K. Siu-Cheung, and H. Abelson, Eds., Computational Thinking Education, 1st. ed. Gateway East, Singapore: Springer Singapore, 2019. https://doi.org/10.1007/978-981-13-6528-7
M. del M. Sánchez Vera, “Computational Thinking in Educational Environments: An Approach from Educational Technology,” Research in Education and Learning Innovation Archives, no. 23, p. 24-39, Jul-Dec. 2019. https://doi.org/10.7203/realia.23.15635
Descargas
Derechos de autor 2024 TecnoLógicas
Esta obra está bajo una licencia internacional Creative Commons Atribución-NoComercial-CompartirIgual 4.0.
Métricas
Datos de los fondos
-
Universidad del Quindío
Números de la subvención 1187
