Education, Science, Technology, Innovation and Life
Open Access
Sign In

A Systematic Literature Review on How to Evaluate Educational Games in K-12

Download as PDF

DOI: 10.23977/aetp.2021.59011 | Downloads: 38 | Views: 977

Author(s)

Xinran Wang 1, Jinbo Tan 1

Affiliation(s)

1 Faculty of Education, Shandong Normal University, Jinan, China

Corresponding Author

Xinran Wang

ABSTRACT

Educational games as an emerging strategy for evaluation and learning, have received widespread attention. How to evaluate educational games has become a hot topic in the field of educational technology in recent years. Therefore, the purpose of this article is to introduce the evaluation of the development of educational games in primary and secondary schools in the past five years. We selected three commonly used English databases, searched the papers for the past five years according to keywords, and identified 14 papers from them, describing the different methods (including emerging technology and traditional evaluation) used in the evaluation of educational games. And introduced the dimensions of different evaluation methods. We also describe the tools and methods used in collecting and analyzing data. Most of the papers will use traditional evaluation methods, even if they use emerging technology evaluation methods, they will still use traditional evaluation methods as supplements. Nevertheless, most of the evaluation methods used in the paper are highly targeted, and there are various choices according to different evaluation dimensions. The author finally suggests that the evaluation dimension of educational games can be classified by Bloom's teaching objective classification, and can refer to the educational game evaluation methods proposed in other higher education.

KEYWORDS

Educational game, k-12, evaluate

CITE THIS PAPER

Xinran Wang, Jinbo Tan. A Systematic Literature Review on How to Evaluate Educational Games in K-12. Advances in Educational Technology and Psychology (2021) 5: 82-92. DOI: http://dx.doi.org/10.23977/aetp.2021.59011

REFERENCES

[1]Dempsey, J. V., and Johnson, R. B. (1998).The development of an ARCS gaming scale. Journal of 
Instructional Psychology, 25,215–221.
Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., and Boyle, J. M. (2012).A systematic literature review of empirical evidence on computer games and serious games. Computers & Education,59(2),661–686.
[3]WANG Wenjing, ZHAO Xiaochen, XIE Huixin and XIE Qiukui.(2019). A Review on the Evaluation of Digital Educational Games Abroad. International and Comparative Education,41(03),101-108.
[4]Petri, G., von Wangenheim, C. G. (2017). How games for computing education are evaluated? A systematic literature review. Computers & Education, 107, 68-90.
[5]Tahir, R., Wang, A. I. (2017). State of the art in game based learning: Dimensions for evaluating educational games. Paper presented at the European Conference on Games Based Learning.
[6]Yeni, S., Cagiltay, K. (2017). A heuristic evaluation to support the instructional and enjoyment aspects of a math game. Program-Electronic Library and Information Systems, 51(4), 406-423.
[7]Su, C., Hsaio, K. (2015). Developing and Evaluating Gamifying Learning System by Using Flow-Based Model. Eurasia Journal of Mathematics Science and Technology Education, 11(6), 1283-1306.
[8]Legris, P., Ingham, J., & Collerette, P. (2003). Why do people use information technology? A critical review of the technology acceptance model. Information Management, 40, 191–204.
[9]Duh, E. S., Koceska, N., Koceski, S. (2017). Game-based learning: educational game Azbuka to help young children learn writing Cyrillic letters. Multimedia Tools and Applications, 76(12), 14091-14105.
[10]Evans, M. A., Nino, M., Deater-Deckard, K., Chang, M. (2015). School-Wide Adoption of a Mathematics Learning Game in a Middle School Setting: Using the TPACK Framework to Analyze Effects on Practice. The Asia-Pacific Education Researcher, 24(3), 495-504.
[11]Ke, F. (2019). Mathematical problem solving and learning in an architecture-themed epistemic game. Educational Technology Research and Development, 67(5), 1085-1104.
[12]Hulse, T., Daigle, M., Manzo, D., Braith, L., Harrison, A., Ottmar, E. (2019). From here to there! Elementary: a game-based approach to developing number sense and early algebraic understanding. Educational Technology Research and Development, 67(2), 423-441.
[13]Hooshyar, D., Ahmad, R. B., Wang, M., Yousefi, M., Fathi, M., Lim, H. (2018). Development and Evaluation of a Game-Based Bayesian Intelligent Tutoring System for Teaching Programming. Journal of  Educational Computer Research, 56(6), 775-801.
[14]Jakos, F., Verber, D. (2017). Learning Basic Programing Skills With Educational Games: A Case of Primary Schools in Slovenia. Journal of Educational Computer Research, 55(5), 673-698.
[15]Chaudy, Y., Connolly, T. (2019). Specification and evaluation of an assessment engine for educational games: Integrating learning analytics and providing an assessment authoring tool. ENTERTAINMENT COMPUTING, 30(UNSP 100294).
[16]Mavridis, A., Katmada, A., Tsiatsos, T. (2017). Impact of online flexible games on students’ attitude towards mathematics. Educational Technology Research and Development, 65(6), 1451-1470.
[17]Kiili, K., Ketamo, H. (2018). Evaluating Cognitive and Affective Outcomes of a Digital Game-Based Math Test. IEEE Transactions on Learning Technologies, 11(2), 255-263.
[18]Cheng, M.-T., Lin, Y.-W., She, H.-C., & Kuo, P.-C. (2016). Is immersion of any value? Whether, and to what extent, game immersion experience during serious gaming affects science learning. British Journal of Educational Technology, 48(2), 246–263. 
[19]Giannakoulas, A., Xinogalos, S. (2018). A pilot study on the effectiveness and acceptance of an educational game for teaching programming concepts to primary school students. Education and Information Technologies, 23(5), 2029-2052.
[20]Zhou, Y., Xu, T., Li, S., Shi, R. (2019). Beyond engagement: an EEG-based methodology for assessing user's confusion in an educational game. Universal Access In The Information Society, 18(3SI), 551-563.
[21]Petri, G., von Wangenheim, C. G. (2016). How to Evaluate Educational Games: a Systematic Literature Review. Journal of Universal Computer Science, 22(7), 992-1021.
[22]Ninaus, M., Kiili, K., McMullen, J., Moeller, K. (2017). Assessing fraction knowledge by a digital game. Computer In Human Behavior, 70, 197-206.

All published work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2016 - 2031 Clausius Scientific Press Inc. All Rights Reserved.