Access the full text.
Sign up today, get DeepDyve free for 14 days.
Wenchao Ma, J. Torre (2020)
An empirical Q-matrix validation method for the sequential generalized DINA model.The British journal of mathematical and statistical psychology
Shuai Zhao, Xiaoting Huang (2019)
Identifying Cognitive Attributes Using Deep Learning Classification TechniquesProceedings of the International Workshop on Artificial Intelligence and Education
Dongbo Tu, Jin Chiu, Wenchao Ma, Daxun Wang, Yan Cai, Xueyuan Ouyang (2022)
A multiple logistic regression-based (MLR-B) Q-matrix validation method for cognitive diagnosis models:A confirmatory approachBehavior Research Methods, 55
Xiaofeng Yu, Ying Cheng (2019)
Data-driven Q-matrix validation using a residual-based statistic in cognitive diagnostic assessment.The British journal of mathematical and statistical psychology
Gongjun Xu (2016)
Identifiability of restricted latent class models with binary responsesarXiv: Methodology
Hongli Li, H. Suen (2013)
Constructing and Validating a Q-Matrix for Cognitive Diagnostic Analyses of a Reading TestEducational Assessment, 18
G. Schwarz (1978)
Estimating the Dimension of a ModelAnnals of Statistics, 6
Mengta Chung (2019)
A Gibbs sampling algorithm that estimates the Q-matrix for the DINA modelJournal of Mathematical Psychology, 93
J de la Torre, JA Douglas (2004)
Higher-order latent trait models for cognitive diagnosisPsychometrika, 69
M. Gao, M. Miller, Ren Liu (2017)
The Impact of Q-matrix Misspecification and Model Misuse on Classification Accuracy in the Generalized DINA ModelJournal of Measurement and Evaluation in Education and Psychology, 8
Seongah Im, J. Corter (2011)
Statistical Consequences of Attribute Misspecification in the Rule Space MethodEducational and Psychological Measurement, 71
Albert Maydeu-Olivares (2013)
Goodness-of-Fit Assessment of Item Response Theory ModelsMeasurement: Interdisciplinary Research and Perspectives, 11
John Sessoms, R. Henson (2018)
Applications of Diagnostic Classification Models: A Literature Review and Critical CommentaryMeasurement: Interdisciplinary Research and Perspectives, 16
Hamdollah Ravand, A. Robitzsch (2018)
Cognitive diagnostic model of best choice: a study of reading comprehensionEducational Psychology, 38
P. Nájera, M. Sorrel, F. Abad (2019)
Reconsidering Cutoff Points in the General Method of Empirical Q-Matrix ValidationEducational and Psychological Measurement, 79
Edward Haertel (1989)
Using restricted latent class models to map the skill structure of achievement itemsJournal of Educational Measurement, 26
Wen-yi Wang, Li-hong Song, Shu-liang Ding, Yaru Meng, Canxi Cao, Yongjing Jie (2018)
An EM-Based Method for Q-Matrix ValidationApplied Psychological Measurement, 42
M. Davier (2005)
A GENERAL DIAGNOSTIC MODEL APPLIED TO LANGUAGE TESTING DATAETS Research Report Series, 2005
P. Nájera, F. Abad, M. Sorrel (2021)
Determining the Number of Attributes in Cognitive Diagnosis ModelingFrontiers in Psychology, 12
Chia-Yi Chiu (2013)
Statistical Refinement of the Q-Matrix in Cognitive DiagnosisApplied Psychological Measurement, 37
Rohaifa Khaldi, R. Chiheb, A. Afia (2018)
Feedforward and Recurrent Neural Networks for Time Series Forecasting: Comparative Study
J. Torre, Chia-Yi Chiu (2015)
A General Method of Empirical Q-matrix ValidationPsychometrika, 81
Kang Xue, Laine Bradshaw (2021)
A Semi-supervised Learning-Based Diagnostic Classification Method Using Artificial Neural NetworksFrontiers in Psychology, 11
Wenchao Ma, C. Iaconangelo, J. Torre (2016)
Model Similarity, Model Selection, and Attribute ClassificationApplied Psychological Measurement, 40
D Goretzko, M Bühner (2020)
One model to rule them all? Using machine learning algorithms to determine the number of factors in exploratory factor analysisPsychological Methods, 6
D McFadden, P Zarembka (1974)
Conditional logit analysis of qualitative choice behaviorFrontiers in economics
K. Tatsuoka (1983)
RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORYJournal of Educational Measurement, 20
J. Torre (2008)
An Empirically Based Method of Q‐Matrix Validation for the DINA Model: Development and ApplicationsJournal of Educational Measurement, 45
A. Rupp, J. Templin (2008)
The Effects of Q-Matrix Misspecification on Parameter Estimates and Classification Accuracy in the DINA ModelEducational and Psychological Measurement, 68
J. Torre (2011)
Erratum to: The Generalized DINA Model FrameworkPsychometrika, 76
L Breiman (2001)
Random forestsMachine Learning, 45
P. Nájera, M. Sorrel, J. Torre, F. Abad (2020)
Balancing fit and parsimony to improve Q-matrix validation.The British journal of mathematical and statistical psychology
Guanhua Fang, Jingchen Liu, Z. Ying (2017)
On the Identifiability of Diagnostic Classification ModelsPsychometrika, 84
Yinghan Chen, S. Culpepper, Yuguo Chen, J. Douglas (2018)
Bayesian Estimation of the DINA Q matrixPsychometrika, 83
Huilin Chen, Jinsong Chen (2016)
Exploring reading comprehension skill relationships through the G-DINA modelEducational Psychology, 36
Yanlou Liu, Wei Tian, Tao Xin (2016)
An Application of M2 Statistic to Evaluate the Fit of Cognitive Diagnostic ModelsJournal of Educational and Behavioral Statistics, 41
RA Henson, JL Templin, JT Willse (2009)
Defining a family of cognitive diagnosis models using log-linear models with latent variablesPsychometrika, 74
C-Y Chiu, J Douglas, X Li (2009)
Cluster analysis for cognitive diagnosis: Theory and applicationsPsychometrika, 74
U. Lorenzo-Seva, M. Timmerman, H. Kiers (2011)
The Hull Method for Selecting the Number of Common FactorsMultivariate Behavioral Research, 46
X. Zhai, Kevin Haudek, Wenchao Ma (2022)
Assessing Argumentation Using Machine Learning and Cognitive Diagnostic ModelingResearch in Science Education, 53
Mark Gierl, H. Lai, S. Turner (2012)
Using automatic item generation to create multiple‐choice test itemsMedical Education, 46
K. Hornik, M. Stinchcombe, H. White (1989)
Multilayer feedforward networks are universal approximatorsNeural Networks, 2
The Q-matrix, which specifies the relationship between items and attributes, is a crucial component of cognitive diagnostic models (CDMs). A precisely specified Q-matrix allows for valid cognitive diagnostic assessments. In practice, a Q-matrix is usually developed by domain experts, and noted as being subjective and potentially containing misspecifications which can decrease the classification accuracy of examinees. To overcome this, some promising validation methods have been proposed, such as the general discrimination index (GDI) method and the Hull method. In this article, we propose four new methods for Q-matrix validation based on random forest and feed-forward neural network techniques. Proportion of variance accounted for (PVAF) and coefficient of determination (i.e., the McFadden pseudo-R2) are used as input features for developing the machine learning models. Two simulation studies are carried out to examine the feasibility of the proposed methods. Finally, a sub-dataset of the PISA 2000 reading assessment is analyzed as illustration.
Behavior Research Methods – Springer Journals
Published: May 25, 2023
Keywords: Cognitive diagnosis; Q-matrix validation; Machine learning; G-DINA; Classification
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.