Access the full text.
Sign up today, get DeepDyve free for 14 days.
Loading next page...
/lp/springer-journals/serious-games-analytics-guidelines-for-the-design-and-implementation-RV8KCnn7uE
References (64)
-
Irvin Katz, C. James (1997)
TOWARD ASSESSMENT OF DESIGN SKILL IN ENGINEERINGETS Research Report Series, 1997
-
L. Kyriakides, B. Creemers, C. Teddlie, D. Muijs (2010)
International encyclopedia of education (3rd ed.) -
M. Mayrath, Jody Clarke-Midura, D. Robinson (2012)
Technology Based Assessment for 21st Century Skills: Theoretical and Practical Implications from Modern Research -
M. Peters, D. Araya (2011)
Transforming American Education: Learning Powered by TechnologyE-Learning and Digital Media, 8
-
R. Baker, K. Yacef (2009)
The State of Educational Data Mining in 2009: A Review and Future Visions., 1
-
E. Baker (1997)
Model‐based performance assessmentTheory Into Practice, 36
-
C. Romero, Sebastián Ventura (2010)
Educational Data Mining: A Review of the State of the ArtIEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 40
-
E. Quellmalz, Jodi Davenport, Michael Timms, G. DeBoer, K. Jordan, Chun-Wei Huang, Barbara Buckley (2013)
Next-Generation Environments for Assessing and Promoting Complex Science Learning.Journal of Educational Psychology, 105
-
T. Little (2013)
The Oxford Handbook of Quantitative Methods in Psychology, Vol. 1 -
S. Tobias, J. Fletcher, D. Dai, Alexander Wind (2011)
Review of research on computer games. -
Deirdre Kerr, Gregory Chung (2012)
Identifying Key Features of Student Performance in Educational Video Games and Simulations through Cluster Analysis, 4
-
Deirdre Kerr, Gregory Chung (2012)
The Mediation Effect of In-Game Performance between Prior Knowledge and Posttest Score. CRESST Report 819.National Center for Research on Evaluation, Standards, and Student Testing
-
Deirdre Kerr, Gregory Chung, Markus Iseli (2011)
The Feasibility of Using Cluster Analysis to Examine Log Data from Educational Video Games. CRESST Report 790.National Center for Research on Evaluation, Standards, and Student Testing
-
F. James, C. McCulloch (1990)
MULTIVARIATE ANALYSIS IN ECOLOGY AND SYSTEMATICS: PANACEA OR PANDORA'S BOX?Annual Review of Ecology, Evolution, and Systematics, 21
-
B. Weber, Michael Mateas, A. Jhala (2011)
Using Data Mining to Model Player Experience -
Deirdre Kerr, Gregory Chung (2013)
Identifying Learning Trajectories in an Educational Video Game -
Gregory Chung, L. Vries, Alicia Cheak, Ronald Stevens, W. Bewley (2002)
Cognitive process validation of an online problem solving assessmentComput. Hum. Behav., 18
-
L. Werner, Charles McDowell, J. Denner (2013)
A First Step in Learning Analytics: Pre-processing Low-Level Alice Logging Data of Middle School Students, 5
-
Laila Shoukry, S. Göbel, R. Steinmetz (2014)
Learning Analytics and Serious Games: Trends and Considerations -
M. Bienkowski, Mingyu Feng, B. Means (2012)
Enhancing Teaching and Learning Through Educational Data Mining and Learning Analytics: An Issue Brief -
P. Berkhin (2006)
A Survey of Clustering Data Mining Techniques -
C. Girard, J. Écalle, A. Magnan (2013)
Serious games as new educational tools: how effective are they? A meta-analysis of recent studiesJ. Comput. Assist. Learn., 29
-
S. Santhosh, M. Vaden (2013)
Telemetry and Analytics Best Practices and Lessons Learned -
C. Romero, J. Romero, Sebastián Ventura (2014)
A Survey on Pre-Processing Educational Data -
Kenneth Hullett, Nachiappan Nagappan, Eric Schuh, J. Hopson (2012)
Empirical analysis of user data in game software developmentProceedings of the 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
-
Gregory Chung, Deirdre Kerr (2012)
A Primer on Data Logging to Support Extraction of Meaningful Information from Educational Games: An Example from Save Patch. CRESST Report 814.National Center for Research on Evaluation, Standards, and Student Testing
-
R. Mislevy (2011)
Evidence-centered design for simulation-based assessment.Military medicine, 178 10 Suppl
-
C. Romero, Sebastián Ventura, Mykola Pechenizkiy, R. Baker (2010)
Handbook of Educational Data Mining -
André Gagné, M. El-Nasr, C. Shaw (2012)
Analysis of telemetry data from a real-time strategy game: A case studyComput. Entertain., 10
-
R. Bakeman, J. Gottman (1986)
Observing Interaction: An Introduction to Sequential Analysis -
R. Bennett, H. Persky, Andrew Weiss, Frank Jenkins (2007)
Problem Solving in Technology-Rich Environments. A Report from the NAEP Technology-Based Assessment Project, Research and Development Series. NCES 2007-466.National Center for Education Statistics
-
T. Connolly, Elizabeth Boyle, E. MacArthur, T. Hainey, J. Boyle (2012)
A systematic literature review of empirical evidence on computer games and serious gamesComput. Educ., 59
-
Anders Drachen, Christian Thurau, J. Togelius, Georgios Yannakakis, C. Bauckhage (2013)
Game Data Mining -
E. Baker, Gregory Chung, C. Girlie (2007)
Design and Validation of Technology-Based Performance Assessments -
Gregory Chung (2014)
Toward the Relational Management of Educational Measurement DataTeachers College Record: The Voice of Scholarship in Education, 116
-
Girlie Delacruz (2012)
Impact of Incentives on the Use of Feedback in Educational Videogames. CRESST Report 813.National Center for Research on Evaluation, Standards, and Student Testing
-
M. El-Nasr, Anders Drachen, Alessandro Canossa (2013)
Game Analytics -
C. Loh, Yanyan Sheng (2014)
Maximum Similarity Index (MSI): A metric to differentiate the performance of novices vs. multiple-experts in serious gamesComput. Hum. Behav., 39
-
Jun Kim, D. Gunn, Eric Schuh, Bruce Phillips, R. Pagulayan, Dennis Wixon (2008)
Tracking real-time user experience (TRUE): a comprehensive instrumentation solution for complex systemsProceedings of the SIGCHI Conference on Human Factors in Computing Systems
-
S. Bittick, Gregory Chung (2011)
The Use of Narrative: Gender Differences and Implications for Motivation and Learning in a Math Game. CRESST Report 804.National Center for Research on Evaluation, Standards, and Student Testing
-
J. Spector, M. Merrill, Jan Elen, M. Bishop, Yougun Ren, Brian Belland, Jennifer Hamilton, Patricia Young, Eunjung Oh, Melissa James (2012)
Handbook of Research on Educational Communications and Technology, 3rd Edition -
David Williamson, I. Bejar, R. Mislevy (2006)
Automated scoring of complex tasks in computer-based testing -
Jinok Kim, Gregory Chung (2012)
Use of a Survival Analysis Technique in Understanding Game Performance in Instructional Games. CRESST Report 812.National Center for Research on Evaluation, Standards, and Student Testing
-
Deirdre Kerr, Gregory Chung (2012)
Using Cluster Analysis to Extend Usability Testing to Instructional Content. CRESST Report 816.National Center for Research on Evaluation, Standards, and Student Testing
-
C. Loh (2012)
Information Trails: In-Process Assessment of Game-Based Learning -
Gregory Chung, Kilchan Choi, E. Baker, Li Cai (2014)
The Effects of Math Video Games on Learning: A Randomized Evaluation Study with Innovative Impact Estimation Techniques. CRESST Report 841.National Center for Research on Evaluation, Standards, and Student Testing
-
R. Levy (2014)
Dynamic Bayesian Network Modeling of Game Based Diagnostic Assessments. CRESST Report 837.National Center for Research on Evaluation, Standards, and Student Testing
-
B. Plake, L. Wise (2014)
What Is the Role and Importance of the Revised AERA, APA, NCME Standards for Educational and Psychological Testing ?Educational Measurement: Issues and Practice, 33
-
A. Merceron, K. Yacef (2004)
Mining Student Data Captured from a Web-Based Tutoring Tool: Initial Exploration and ResultsThe Journal of Interactive Learning Research, 15
-
S. Mohamad, Z. Tasir (2013)
Educational data mining: A reviewProcedia - Social and Behavioral Sciences, 97
-
B. Junker (2010)
Modeling Hierarchy and Dependence among Task Responses in Educational Data Mining -
R. Levy (2013)
Psychometric and Evidentiary Advances, Opportunities, and Challenges for Simulation-Based AssessmentEducational Assessment, 18
-
Deirdre Kerr, Gregory Chung (2013)
The Effect of In-Game Errors on Learning Outcomes. CRESST Report 835.National Center for Research on Evaluation, Standards, and Student Testing
-
Gregory Chung, E. Baker (2003)
An Exploratory Study to Examine the Feasibility of Measuring Problem-Solving Processes Using a Click-Through Interface, 2
-
V. Shute, Fengfeng Ke (2012)
Games, Learning, and Assessment -
C. Romero, P. González, Sebastián Ventura, M. Jesús, F. Herrera (2009)
Evolutionary algorithms for subgroup discovery in e-learning: A practical application using Moodle dataExpert Syst. Appl., 36
-
C. Romero, Sebastián Ventura (2007)
Educational data mining: A survey from 1995 to 2005Expert Syst. Appl., 33
-
S. Messick (1994)
Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning. Research Report RR-94-45. -
Nabila Bousbia, I. Belamri (2014)
Which Contribution Does EDM Provide to Computer-Based Learning Environments? -
Alan Koenig, Markus Iseli, Richard Wainess, John Lee (2013)
Assessment methodology for computer-based instructional simulations.Military medicine, 178 10 Suppl
-
Anders Drachen, Alessandro Canossa, Janus Sørensen (2013)
Gameplay Metrics in Game User Research: Examples from the Trenches -
R. Mislevy, J. Behrens, K. DiCerbo, R. Levy (2012)
Design and Discovery in Educational Assessment: Evidence-Centered Design, Psychometrics, and Educational Data Mining, 4
-
Dirk Ifenthaler, Deniz Eseryel, Xun Ge (2012)
Assessment in Game-Based Learning: Foundations, Innovations, and Perspectives -
Li Cai (2013)
Potential applications of latent variable modeling for the psychometrics of medical simulation.Military medicine, 178 10 Suppl
- Publisher
- Springer International Publishing
- Copyright
- © Springer International Publishing Switzerland 2015
- ISBN
- 978-3-319-05833-7
- Pages
- 59 –79
- DOI
- 10.1007/978-3-319-05834-4_3
- Publisher site
- See Chapter on Publisher Site
Abstract
[The design of game telemetry requires careful attention to the chain of reasoning that connects low-level behavioral events to inferences about players’ learning and performance. Measuring performance in serious games is often difficult because seldom do direct measures of the desired outcome exist in the game. Game telemetry is conceived as the fundamental element from which measures of player performance are developed. General psychometric issues are raised for game-based measurement, and data issues are raised around format, context, and increasing the meaningfulness of the data itself. Practical guidelines for the design of game telemetry are presented, including targeting in-game behaviors that reflect cognitive demands, recoding data at the finest usable grain size, representing the data in a format usable by the largest number of people, and recording descriptions of behavior and not inferences with as much contextual information as practical. A case study is presented on deriving measures in a serious game intended to teach fraction concepts.]
Published: Mar 13, 2015
Keywords: Game telemetry; Behavioral observations; Construct validity; Game-based learning; Embedded assessment; Serious games