:::

詳目顯示

回上一頁
題名:Mantel-Haenszel DIF程序之第一類型錯誤率和DIF嚴重度分類結果研究
書刊名:測驗年刊
作者:盧雪梅 引用關係
作者(外文):Lu, Sheue-mei
出版日期:2000
卷期:47:1
頁次:頁57-71
主題關鍵詞:差別試題功能Mantel-Haenszel法第一類型錯誤率ETS DIF分類系統Differential item functioningDIFMantel-Haenszel procedureType Ⅰ errorETS DIF classification
原始連結:連回原系統網址new window
相關次數:
  • 被引用次數被引用次數:期刊(5) 博士論文(1) 專書(0) 專書論文(0)
  • 排除自我引用排除自我引用:2
  • 共同引用共同引用:0
  • 點閱點閱:41
     本研究調查Mantel-Haenszel(MH) DIF 程序在數種模擬情境中之實徵第一類型錯誤率和其在ETS DIF分類系統中各類DIF的分類結果。本研究以Monte Carlo法進行,操弄的因子包括:參照組和焦點組受試者的樣本數(2個水準)、兩組受試者能力的分配(3個水準)、測驗長度(3個水準)、受評試題的鑑別度(6個水準)和難度(5個水準),採交叉設計,共模擬了540種情況,每種情況各重覆100次,所有試題均模擬為無DIF試題,本研究主要發現如下:在大多數的模擬情況下,MH DIF程序第一類型錯誤率的控制力令人滿意,惟在兩組受試者能力分配有明顯差異且測驗信度偏低的情況下,鑑別度較極端的試題產生之實徵第一類型錯誤率有偏高的傾向,又以高鑑別力試題特別嚴重,這種現象在受試樣本人數多的情形下尤其明顯,就ETS DIF嚴重度分類結果而言,MH的表現大致上令人滿意,在本研究模擬的情況中,B和C類DIF的出現率低於5%。最後,研究者根據研究結果提出建議供實務工作者在解釋和運用MH DIF分析結果時的參考。
      This study investigated the empirical Type I error rates and ETS DIF classification results for the Mantel-Haenszel (MH) DIF procedure under various simulated conditions. Monte Carlo simulations were conducted to investigate the effects of several manipulated factors on the performance of the MH. The factors manipulated in this study included sample size (2 levels) and ability distribution (3 levels) for the reference and focal groups, the test length (3 levels), item discrimination (6 levels) and difficulty (5 levels) for the studied items. By crossing these factors, there were 540 conditions simulated, and 100 replications were conducted in each condition. All studied items were simulated as non-DIF items. The results indicated that the performance of the type I error control of the MH was generally satisfactory except for few conditions. Specifically, when the ability difference for the two comparison groups was substantial, test was less reliable and sample size for two groups was large, the MH tended to produce inflated Type I error rates for highly or extremely low discriminating items. In terms of the ETS DIF classification results, the MH generally performed well. The empirical results for the Categories B and C items were less than 5% across simulated conditions. Finally, the implications of the findings in this work for the interpretation and practical use of the MH DIF results were suggested.
期刊論文
1.Clauser, B. E.、Mazor, K. M.(1998)。Using statistical procedures to identify differentially functioning test items。Educational Measurement: Issues and Practice,17(1),31-44。  new window
2.Rogers, H. J.、Swaminathan, H.(1993)。A comparison of logistic regression and Mantel-Haenszel procedures for detecting differential item functioning。Applied Psychological Measurement,17,105-116。  new window
3.Roussos, L.、Stout, W.(1996)。Simulation studies of effects of small sample size and studied item parameters on SIBTEST and Mantel-Haenszel Type I error performance。Journal of Educational Measurement,33,215-230。  new window
4.Shealy, R.、Stout, W.(1993)。A Model-based Standardization Approach that Separates True Bias/DIF from Group Ability Differences and Detects Test Bias/DTF as Well as Bias/DIF。Psychometrika,58,159-194。  new window
5.Mantel, N.、Haenszel, W.(1959)。Statistical Aspects of the Analysis of Data from Retrospective Studies of Disease。Journal of the National Cancer Institute,22(4),719-748。  new window
6.Millsap, R. E.、Everson, H. T.(1993)。Methodology review: statistical approaches for assessing Measurement Bias。Applied Psychological Measurement,17,297-334。  new window
7.Narayanan, P.、Swaminathan, H.(1994)。Performance of the Mantel-Haenszel and simultaneous item bias procedures for detecting differential item functioning。Applied Psychological Measurement,18,315-328。  new window
8.Zwick, R.(1990)。When do item response fiction and Mantel-Haenszel definitions of differential item function coincide?。Journal of Educational Statistics,15,185-197。  new window
會議論文
1.Lu, S.、Dunbar, S. B.(1997)。The effects of item characteristics on the Mantel-Haenszel and Standardization DIF statistics。0。  new window
圖書
1.Lord, Frederic M.、Novick, Melvin R.、Birnbaum, Allan(1968)。Statistical Theories of Mental Test Scores。Addison-Wesley Publishing Company。  new window
2.Camilli, G.、Shepard, L. A.(1994)。Methods for identifying biased test items。Thousand Oaks, CA。  new window
3.Lord, Frederic M.(1980)。Applications of Item Response Theory to Practical Testing Problems。Lawrence Erlbaum Associates, Inc.。  new window
4.Hoover, H. D.、Hieronymus, A. N.、Frisbie, D. A.、Dunbar, S. B.(1993)。Iowa Tests of Basic Skills, Forms K and L。Iowa Tests of Basic Skills, Forms K and L。Chicago, IL:The Riverside Publishing Company。  new window
圖書論文
1.Donoghue, J. R.、Holland, P. W.、Thayer, D. T.(1993)。A Monte Carlo study of factors that affect the Mantel-Haenszel and standardization measures of differential item functioning。Differential item functioning。Hillsdale, NJ:Lawrence Erlbaum Associates。  new window
2.Dorans, Neil J.、Holland, Paul W.(1993)。DIF detection and description: Mantel-Haenszel and standardization。Differential item functioning。Lawrence Erlbaum Associates。  new window
3.Holland, P. W.、Thayer, D. T.、Holland, W. P.(1988)。Differential Item Performance and the Mantel-Haenszel Procedure。Test Validity。Hillsdale, NJ:Lawrence Erlbaum Associates, Inc.。  new window
4.Zieky, M.(1993)。Practical questions in the use of DIF statistics in test development。Differential item functioning。Hillsdale, NJ:Erlbaum。  new window
 
 
 
 
第一頁 上一頁 下一頁 最後一頁 top