:::

詳目顯示

回上一頁
題名:以常態混組模型討論書籤標準設定法對英語聽讀基本能力標準設定有效性之輻合證據
書刊名:教育心理學報
作者:吳毓瑩 引用關係陳彥名張郁雯 引用關係陳淑惠何東憲 引用關係林俊吉
作者(外文):Wu, Yuh-yinChen, Yan-mingChang, YuwenChen, Eileen Shu-huiHe, Tung-hsienLin, Jyun-ji
出版日期:2009
卷期:41:1
頁次:頁69-89
主題關鍵詞:英語聽讀能力效度之輻合證據常態混組模型書籤標定法標準設定Bookmark standard setting methodConvergent evidence of validityEnglish reading and listening abilityNormal mixture modelStandard setting
原始連結:連回原系統網址new window
相關次數:
  • 被引用次數被引用次數:期刊(6) 博士論文(0) 專書(0) 專書論文(0)
  • 排除自我引用排除自我引用:6
  • 共同引用共同引用:0
  • 點閱點閱:42
本研究旨在探討書籤標準設定法(簡稱書籤標定法)應用於2005年台灣學生學習成就資料庫(TASA, Taiwan Assessment of Student Achievement)中之「英語文學習成就評量」的英語聽讀基本能力標準設定(Standard Setting)的判斷歷程,以及所判斷結果之輻合證據的有效性。研究樣本有10101名小六學生,分層抽樣自全台各地,施測方式採取平衡不完全區塊設計(Balanced Incomplete Block Design),將70個聽與讀的題目設計成6個40題組成的題本。書籤標定法標準設定會議由十三位專家(七位學科內容教授、三位測驗教授、以及三位英語專家教師)組成,會中共識設一切分點(Ө=-0.57),通過組學生佔全體72.9%。本研究利用常態混組模型(normal mixture model)之計量模式結果作為書籤標定法有效程度的輻合證據(convergent evidence),其估計的切分點(Ө=-0.40)與專家設定的分類結果達到 .87之Kappa一致性。文末研究者提出實務使用上以及理論上的討論議題。
This study investigated convergent validity of the bookmark standard setting method used for English reading and listening ability. The data set was obtained from 2005 Taiwan Assessment of Student Achievement (TASA) data bank. A total of 10101 sixth graders from different areas of Taiwan were cluster sampled and tested by a 40-item scale. The scale was developed through balanced incomplete block design out of 70 items. Thirteen experts formed bookmark standard setting seminar. Among them, 7 were university professors in the English-as-a-Foreign-Language (EFL) field, 3 were professors in measurement, and 3 were elementary school English master teachers. They attained the consensus of cut score Ө=-.57 with 72.7% of students were classified as passed. The result from normal mixture model (Ө=-.40) was consistent with the result from the bookmark standard setting method with classification consistency Kappa=.87, indicating convergent validity evidence. In line with this finding, issues on how to implement bookmark standard setting approach were further explored and discussed.
期刊論文
1.Buckendahl, C. W.、Smith, R. W.、Impara, J. C.、Plake, B. S.(2002)。A comparison of Angoff and Bookmark standard setting methods。Journal of Educational Measurement,39(3),253-263。  new window
2.Green, D. R.、Trimble, C. S.、Lewis, D. M.(2003)。Interpreting the Results of Three Different Standard Setting Procedures。Educational Measurement: Issues and Practice,22(1),22-32。  new window
3.Huynh, H.(2006)。A Clarification on the Response Probability Criterion RP67 for Standard Settings Based on Bookmark and Item Mapping。Educational Measurement, Issues and Practice,25(2),19-20。  new window
4.Karantonis, A.、Sireci, S. G.(2006)。The Bookmark Standard-setting Method: A Literature Review。Educational Measurement: Issues and Practice,25(1),4-12。  new window
5.Shrout, P. E.(1998)。Measurement reliability and agreement in psychiatry。Statistical Methods in Medical Research,7(3),301-317。  new window
6.Sim, J.、Wright, C. C.(2005)。The Kappa Statistic in Reliability Studies: Use, Interpretation, and Sample Size Requirements。Physical Therapy,85(3),257-268。  new window
7.Akaike, H.(1987)。Factor analysis and AIC。Psychometrika,52(3),317-332。  new window
8.Campbell, Donald T.、Fiske, Donald W.(1959)。Convergent and Discriminant Validation by Multitrait-Multimethod Matrix。Psychological Bulletin,56(2),81-105。  new window
9.Huynh, H.(1998)。On Score Locations of Binary and Partial Credit Items and Their Applications to Item Mapping and Criterion-referenced Interpretation。Journal of Educational and Behavioral Statistics,23(1),35-56。  new window
10.Basford, K. E.、McLachlan, G. J.(1985)。Likelihood Estimation with Normal Mixture Models。Applied Statistics,34,282-289。  new window
11.Eckhout, T. J.、Plake, B. S.、Smith, D. L.、Larsen, A.(2007)。Aligning a State's Alternative Standards to Regular Core Content Standards in Reading and Mathematics: A Case Study。Applied Measurement in Education,20(1),79-100。  new window
12.Jaeger, R. M.(1982)。An Iterative Structured Judgment Process for Establishing Standards on Competency Tests: Theory and Application。Educational Evaluation and Policy Analysis,4,461-476。  new window
13.Kaplan, D.(1995)。The Impact of BIB Spiraling-induced Missing Data Patterns on Goodness-of-fit Tests in Factor Analysis。Journal of Educational and Behavioral Statistics,20(1),69-82。  new window
14.Koffler, S. L.(1980)。A Comparison of Approaches for Setting Proficiency Standards。Journal of Educational Measurement,17,167-178。  new window
15.Koski, W. S.、Weis, H. A.(2004)。What Educational Resources Do Students Need to Meet California's Educational Content Standards? A Textual Analysis of California's Educational Content Standards and Their Implications for Basic Educational Conditions and Resources。Teachers College Record,106(10),1907-1935。  new window
16.Linn, R. L.(2000)。Assessments and Accountability。Educational Researcher,29(2),4-16。  new window
17.Linn, R. L.(2003)。The Bookmark Standard Setting Procedure: Strengths and Weaknesses。Language Learning,52(3),537-564。  new window
18.Reckase, M. D.(2006)。A Conceptual Framework for a Psychometric Theory for Standard Setting with Examples of Its Use for Evaluating the Functioning of Two Standard Setting Methods。Educational Measurement, Issues and Practice,25(2),4-18。  new window
19.Swaminathan, H.、Hambleton, R. K.、Algina, J.(1974)。Reliability of Criterion-referenced Tests: A Decision-theoretic Formulation。Journal of Educational Measurement,11(4),263-268。  new window
會議論文
1.Lewis, D. M.、Mitzel, H. C.、Green, D. R.(1996)。Standard Setting: A Bookmark Approach。  new window
2.Perie, M.(2005)。Angoff and Bookmark Methods。  new window
3.Skaggs, G.、Tessema, A.(2001)。Item Disordinality with the Bookmark Standard Setting Procedural。  new window
4.Yin, P.、Schulz, E. M.(2005)。A Comparison of Cut Scores and Cut Score Variability from Angoff-based and Bookmark-based Procedures in Standard Setting。Annual Meeting of the National Council on Measurement in Education。Montreal, Canda。  new window
研究報告
1.陳淑惠、吳毓瑩、何東憲、張郁雯、陳錦芬(2005)。臺灣學生學習成就評量資料庫2005年臺灣學生英語學習成就之趨勢調查研究期中報告。臺北縣。  延伸查詢new window
2.陳淑惠、吳毓瑩、張郁雯、何東憲(2006)。臺灣學生學習成就評量資料庫2005年臺灣學生英語學習成就之趨勢調查研究技術報告。臺北縣。  延伸查詢new window
圖書
1.Vermunt, Jeroen K.、Jay Magidson(2005)。Technical Guide for Latent Gold 4.0 : Basic and Advanced。Belmont, MA:Statistical Innovations Inc.。  new window
2.Ebel, R. L.(1972)。Essentials of educational measurement。Prentice-Hall。  new window
3.Crocker, L.、Algina, J.(1986)。Introduction to Classical and Modern Test Theory。Holt, Rinehart & Winston。  new window
4.American Psychological Association、American Educational Research Association、National Council on Measurement in Education(1999)。Standards for educational and psychological testing。Washington, DC:American Psychological Association。  new window
5.歐滄和(2002)。教育測驗與評量。台北:心理出版社。  延伸查詢new window
6.Hambleton, R. K.、Swaminathan, H.(1985)。Item Response Theory: Principles and Applications。Boston, Massachusetts:Kluwer-Nijhoff。  new window
7.張郁雯(2004)。信度。教育測驗與評量。臺北。  延伸查詢new window
8.教育部(2004)。英語文學習領域能力指標解讀與示例手冊。英語文學習領域能力指標解讀與示例手冊。臺北。  延伸查詢new window
9.Cizek, G. J.(2001)。Conjectures on the Rise and Call of Standard Setting: An Introduction to Context and Practice。Setting Performance Standards: Concepts, Methods, and Perspectives。Mahwah, NJ。  new window
10.Everitt, B. S.、Hand, D. J.(1981)。Finite Mixture Distributions。Chapman and Hall Press。  new window
11.Flanagan, J. C.(1951)。Units, Scores, and Norms。Educational Measurement。Washing, DC。  new window
12.Jaeger, R. M.(1989)。Certification of Student Competence。Educational Measurement。New York, NY。  new window
13.Lewis, D. M.、Mitzel, H. C.、Green, D. R.、Patz, R. J.(1999)。The Bookmark Standard Setting Procedure。Monterey, CA:McGraw-Hill。  new window
14.Lindsay, B. G.(1995)。Mixture Models: Theory, Geometry, and Applications。Mixture Models: Theory, Geometry, and Applications。Hayward, CA。  new window
15.U. S. Department of Education(1996)。Goals 2000: Progress Report。Goals 2000: Progress Report。Washington, DC。  new window
其他
1.National Center for Education Statistics(2008)。The NAEP Writing Achievement Levels,http://nces.ed.gov/nationsreportcard/writing/achieve.asp。  new window
2.Vinovskis, M. A.(1998)。Overseeing the Nation's Report Card: The Creation and Evolution of the National Assessment Governing Board (NAGB)。  new window
圖書論文
1.Hambleton, R. K.(2001)。Setting performance standards on educational assessments and criteria for evaluating the process。Standard setting: Concepts, methods and perspectives。Mahwah, NJ:Lawrence Erlbaum Associates。  new window
2.Angoff, William H.(1971)。Scales, norms, and equivalent scores。Educational measurement。Washington, DC:American Council on Education。  new window
 
 
 
 
第一頁 上一頁 下一頁 最後一頁 top