:::

詳目顯示

回上一頁
題名:Effects of Changes in the Examinees' Ability Distribution on the Exposure Control Methods in CAT
書刊名:測驗年刊
作者:章舜雯 引用關係涂柏原
作者(外文):Chang, Shun-wenTwu, Bor-yaun
出版日期:2001
卷期:48:1
頁次:頁167-190
主題關鍵詞:Computerized adaptive testingItem exposure rateExposure control methodAbility distribution電腦適性測驗試題曝光率曝光控制法能力分配
原始連結:連回原系統網址new window
相關次數:
  • 被引用次數被引用次數:期刊(0) 博士論文(0) 專書(0) 專書論文(0)
  • 排除自我引用排除自我引用:0
  • 共同引用共同引用:1
  • 點閱點閱:161
     試題機密是電腦適性測驗界極度關心的眾多實際問題之一。為了要達到試題機密的要求,專家們藉著在試題選擇的過程中加入試題曝光控制法,以直接控制熱門試題的曝光程度。這些試題曝光控制法通常在正式使用前建立試題曝光控制參數,作為正式進行適性測驗時控制試題曝光率的標準。然而,正式施測的情境與建立試題曝光控制參數所擬定的情境中,考生能力分配改變的因素對the Sympson and Hetter method t(SH法)he Dayey and Parshall method(DP法)的影響,以及確認 the Stocking and Lewis conditional multinomial method(SLC條件多項式法)是否不受正式施測時考生能力分配因素所影響。本研究採用不同的考生能力分配的改變對SH與DP法在控制試題最大曝光觀察值上產生影響,並以SH法所受的影響較為嚴重。研究結果技持SLC法在控制試題曝光率的表現上,不會受到正式參與適性測驗考生的能力分配所影響。
     Item security is one of the practical issues that substantially concern the makers of high stakes tests for the continuous testing context of CATs. To satisfy the security requirements of CATs, efforts have been made to directly control the exposure rates of optimal items by incorporating statistical methods into the item selection procedure. Most methods of exposure control employ exposure control parameters derived in advance of the operational CAT situations. Since differences likely occur between the exposure methods may not fully accomplish the goal of controlling item exposure. This study explored the effects of the distribution changes on the performance of the Sympson and Hetter (SH) and the Davey and Parshall (DP) procedures and provided an examination function independently of any real examinee population. Simulations were carried out for this study using various combinations of the intended and real ability distributions. The results showed that the changes in the examinees' ability distribution affected both SH and DP procedures in their control of the observed maximum exposure rates and the effects were more profound for the SH method. The performance of the SLC method was demonstrated to be independent of the examinees' ability distributions in the operational CAT administrations.
期刊論文
1.Kingsbury, G. G.、Zara, A. R.(1989)。Procedures for selecting items for computerized adaptive tests。Applied Measurement in Education,2(4),359-375。  new window
2.Owen, R. J.(1975)。A Bayesian sequential procedure for quantal response in the context of adaptive mental testing。Journal of the American Statistical Association,70(350),351-356。  new window
3.Mills, C. N.、Stocking, M. L.(1996)。Practical issues in large-scale computerized adaptive testing。Applied Measurement in Education,9(4),287-304。  new window
4.Stocking, M. L.、Lewis, C.(1998)。Controlling item exposure conditional on ability in computerized adaptive testing。Journal of Educational and Behavioral Statistics,23(1),57-75。  new window
會議論文
1.Davey, T.、Parshall, C. G.(1995)。New Algorithms for Item Selection and Exposure Control with Computerized Adaptive Testing。The Annual Meeting of the American Educational Research Association。San Francisco, CA。  new window
2.章舜雯、Ansley, T. N.、Lin, S. H.(2000)。Performance of item exposure control methods in computerized adaptive testing: Further explorations。New Orleans, LA。new window  new window
3.Davey, T.、Fan, M.(2000)。Specific information item selection for adaptive testing。The Annual meeting of the National Council on Measurement in Education。New Orleans, LA。  new window
4.Parshall, C. G.、Davey, T.、Nering, M. L.(1998)。Test development exposure control for adaptive testing。San Diego。  new window
5.Pastor, D. A.、Dodd, B. G.、Chang, H. H.(2000)。A comparison of item selection techniques and exposure control mechanisms in CATs using the generalized partial credit model。New Orleans, LA。  new window
6.Sympson, J. B.、Hetter, R. D.(1985)。Controlling item exposure rates in computerized adaptive testing。San Diego, CA:Navy Personnel Research and Development Center。  new window
7.Way, W. D.(1997)。Protecting the intergrity of computerized testing item pools。Chicago, IL。  new window
研究報告
1.Stocking, M. L.(1993)。Controlling item exposure rates in a realistic adaptive testing paradigm。Princeton, NJ:Educational Testing Service。  new window
2.Stocking, M. L.、Lewis, C.(1995)。A new method of controlling item exposure in computerized adaptive testing。Princeton, NJ。  new window
學位論文
1.章舜雯(1998)。A comparative study of item exposure control methods in computerized adaptive testing(博士論文)。The University of Iowa。  new window
圖書
1.Birnbaum, A.(1968)。Some latent trait models and their user in inferring an examinee’s ability。Statistical theories of mental rest scores。Reading, MA:Addison-Wesley。  new window
2.Mislevy, R. J.、Bock, R. D.(1990)。BILOG-3: Item analysis and test scoring with binary logistic models。Mooresville, IN:Scientific Software International。  new window
3.Hetter, R. D.、Sympson, J. B.(1997)。Item exposure control in CAT-ASVAB。Computerized adaptive testing: From inquiry to operation。Washington, DC。  new window
 
 
 
 
第一頁 上一頁 下一頁 最後一頁 top
QR Code
QRCODE