認知診斷模式三種Q矩陣修正方法之比較__臺灣人文及社會科學引文索引資料庫

:::

詳目顯示

第 1 筆 / 總合 1 筆

/1頁

論文基本資料
摘要
外文摘要
參考文獻

題名：	認知診斷模式三種Q矩陣修正方法之比較
作者：	楊雅惠
作者(外文)：	Ya-Huei Yang
校院名稱：	國立臺南大學
系所名稱：	教育學系測驗統計碩博士班
指導教授：	鄒慧英林娟如
學位類別：	博士
出版日期：	2015
主題關鍵詞：	DINA模式；DINO模式；G-DINA模式；逐步篩選法；最小化殘差和平方法；DINA；DINO；G-DINA；sequential delta methods；minimum residual sum of squares methods
原始連結：	連回原系統網址
相關次數：	被引用次數:期刊(1) 博士論文(0) 專書(0) 專書論文(0) 排除自我引用:1 共同引用:0 點閱:0

本研究的目的在探討三種Q矩陣修正方法，逐步篩選法(sequential delta method)、最小化殘差平方和法(minimum residual sum of squares， RSS)以及本研究所提出的Q矩陣修正方法，在不同的樣本大小、特質剖面分佈、答題反應模式和Q矩陣錯誤情境下，修正表現的比較。研究中，模擬三種Q矩陣修正方法在三種樣本大小(100、500、1000人)、兩種特質剖面分佈(齊一分佈與higher-order分佈)、三種答題反應模式(DINA、DINO和G-DINA)下，在不同的Q矩陣錯誤情境中，修正後的Q矩陣與原始Q矩陣的一致性，結果以兩個指標呈現：特質一致性指標(attribute-wise agreement rate, AAR)與剖面模式一致性指標(pattern-wise agreement rate, PAR)指標的表現。
研究結果顯示，三種Q矩陣修正方法PAR指標都低於AAR指標，在不同樣本大小下，三種方法的表現類似，都是樣本人數越多AAR與PAR指標的數值越高。在不同的特質剖面分佈下，三種方法都是在齊一分佈下的表現優於higher-order分佈，其中RSS法在相同模式下，當剖面由齊一分佈轉換成higher-order分佈後，AAR與PAR指標下降最多，顯示RSS法較其他兩方法易受特質剖面分佈的影響。在不同答題模式下，逐步篩選法在G-DINA模式的AAR與PAR指標表現明顯低於其他兩方法，而本研究提出之新法則在DINO模式的AAR與PAR指標最差。在不同的Q矩陣錯誤情境下，三種方法都能進行修正，相同趨勢為錯誤率或錯誤題數越多，AAR與PAR指標會逐漸降低。

以文找文

The purpose of the study was to investigate the modification performance of the three Q-matrix modification methods: sequential delta method, minimum residual sum of squares (RSS), and the new method proposed in this study, under the conditions of different sample sizes, attribute profile distributions, cognitive diagnostic models, and Q-matrix missspecifications. In this study, three sample sizes (100, 500, 1000), two profile distributions (uniform and higher-order), three cognitive diagnostic models (DINA, DINO, and G-DINA), and 11 Q-matrix misspecifications were manipulated. The results were summarized with two indices reflecting the agreements between the obtained and the known true Q-matrix. The first is attribute-wise agreement rate (AAR), and the second is pattern-wise agreement rate (PAR).
Under three different sample sizes, the results showed that the PAR indices were lower than AAR indices; the AAR increased as the sample size increased, and the same with the PAR indices. In two attribute profile distribution conditions, the three modification methods showed coincident result that the AAR and PAR indices in uniform distribution were higher than in higher-order distribution. This phenomenon was particularly apparent in RSS modification method. Under three CDMs, in G-DINA case, sequential delta modification method got the lowest AAR and PAR; in DINO case, the new method proposed in this study got the lowest AAR and PAR. Under different Q-matrix misspecifications, the three methods show the same trends that as the misspecification rates raised, the AAR and PAR decreased.

以文找文

Chiu, C.Y. (2013).Statistical refinement of the Q-Matrix in cognitive diagnosis. Applied Psychological Measurement, 37(8), 598-618.
Chiu, C.-Y., & Douglas, J. (2013). A nonparametric approach to cognitive diagnosis by proximity to ideal response patterns. Journal of Classification, 30(2), 225-250.
de la Torre, J. (2008). An empirically based method of Q-matrix validation for the DINA model: Development and applications. Journal of Educational Measurement, 45(4), 343-362.
de la Torre, J. (2009). DINA model and parameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34(1), 115-130.
de la Torre, J. (2011). The generalized DINA model framework. Psychometrika, 76(2), 179-199.
de la Torre, J., & Douglas, J. (2004). Higher-order latent trait models for cognitive diagnosis. Psychometrika, 69(3), 333-353.
DeCarlo, L. T. (2012).Recognizing uncertainty in the Q-matrix via a bayesian extension of the DINA model. Applied Psychological Measurement. 36(6), 447-468.
Desmarais, M. C. and Naceur, R.(2013, July). A matrix factorization method for mapping items to skills and for enhancing expert-based Q-Matrices. In 6th International Conference, AIED 2013, Memphis, TN, USA, pages 441–450.
DiBello, L. V., Stout, W. F., & Roussos, L. A. (1995). Unified cognitive/psychometric diagnostic assessment likelihood-based classification techniques. Cognitively Diagnostic Assessment, 361-389.
Embretson, S. E. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179-197.
Henson, R., Templin, J., & Willse, J. (2009). Defining a family of cognitive diagnosis models using log-linear models with latent variables. Psychometrika, 74(2), 191-210.
Jang, E. E. (2009). Cognitive diagnostic assessment of L2 reading comprehension ability: Validity arguments for fusion model application to LanguEdge assessment. Language Testing, 26(1), 031-073.
Junker, B. W., & Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25(3), 258-272.
Liu, J., Xu, G., Ying, Z. (2012). Data-Driven Learning of Q-Matrix. Applied Psychological Measurement, 36(7), 548-564.
Roberts, M., & Gierl, M. J. (2009, April). Development of a framework for diagnostic score reporting. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.
Roussos, L. A., DiBello, L. V., Stout, W., Hartz, S. M., Henson, R. A., & Templin, J. (2007). The fusion model skills diagnosis system. Cognitive diagnostic assessment for education: Theory and applications (pp. 275-318). New York, NY: Cambridge University Press.
Rupp, A. A., & Templin, J. (2008). The effects of Q-matrix misspecification on parameter estimates and classification accuracy in the DINA model. Educational and Psychological Measurement, 68(1), 78-96.
Rupp, A. A., Templin, J., Henson, R. A.(2010). Diagnostic measurement: Theory, methods, and applications. NY: Guilford Press
Tatsuoka, K. K. (1983). Rule space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20(4), 345-354.
Templin, J. L., & Henson, R. A. (2006). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11(3), 287.
von Davier, M. (2008). A general diagnostic model applied to language testing data. British Journal of Mathematical and Statistical Psychology, 61(2), 287-307.

推文
推薦
引用網址
引用嵌入語法
轉寄

top

:::

相關期刊
相關論文
相關專書
相關著作
熱門點閱

1.	認知診斷模式之理論與實務

無相關博士論文

無相關書籍

無相關著作

無相關點閱

QR Code

臺灣人文及社會科學引文索引資料庫系統

詳目顯示

臺灣人文及社會科學引文索引資料庫