:::

詳目顯示

回上一頁
題名:檔案評量信度與效度的分析--以國小寫作檔案為例
書刊名:教育與心理研究
作者:張麗麗
作者(外文):Chang, Lily
出版日期:2002
卷期:25(上)
頁次:頁1-34
主題關鍵詞:檔案評量實作評量寫作檔案檔案信度檔案效度Portfolio assessmentPerformance assessmentWriting portfoliosPortfolio reliabilityPortfolio validity
原始連結:連回原系統網址new window
相關次數:
  • 被引用次數被引用次數:期刊(9) 博士論文(3) 專書(0) 專書論文(0)
  • 排除自我引用排除自我引用:9
  • 共同引用共同引用:25
  • 點閱點閱:57
近年來檔案評量為教學與學習開展了無限的契機,但它是否真能不負眾望達到如推動者所宣稱與預期的目的?本研究即在以國小寫作檔案為例。進行檔案評量信度與效度的分析與討論。研究由高雄市七所國小四、五年級共十個班的教師與學生參與,其中六個班為實驗組,實施為期一學期的寫作檔案,四個班為控制組,未接受任何形式的檔案評量。 在檔案信度方面,結果顯示透過明確的計分規準及嚴謹的評分者訓練可以提高評分者一致性及信度至相當的水準,但其程度仍受特定評分者及檔案層面的影響。概括性研究結果顯示雖然檔案分數的變異大部分來自受試者的差異,且評分者變異在大多數情形下所佔的比例並不高,但仍有相當比例的變異來自受試者與評分者之交互作用及其它誤差。 在檔案效度方面,研究者透過界定明確的檔案目標,再直接根據檔案目標設計檔案活動、檔案項目及計分規準的評量模式能有效的提昇檔案與所測特質間的關聯性。在實施成效上,雖然實驗組的學生在寫作態度上有顯著的提昇,且師生均認為寫作檔案對其教學與學習有正向的影響,但當測驗前測之影響力被排除後,接受與未接受檔案評量的學生在寫作態度及作文表現上均無顯著的差異存在。另外,研究結果大致支持寫作檔案具斂效度與區辨效度及檔案資料符合學生寫作能力之發展理論。 最後,本文就檔案的信效度及影響與提高檔案整體效度的一些相關議題與可行方法提出討論。
The major purpose of this study was to examine the reliability and validity of writing portfolios. The students from ten classes of seven elementary schools in Taiwan participated in this study. Six of the ten classes received writing portfolio assessment and four classes the traditional writing assessment. This study shows that with well-defined scoring rubrics and proper rater training, an acceptable level of rater consistency and reliability could be achieved. However, the degree of consistency varied among portfolio dimensions and raters. Results obtained from generalizability study showed that the largest proportion of variation was due to person and, in most cases, only a small amount of variation was due to rater. However, a considerable amount of variance was due to person and rater interaction, indicating that the rankings of individual students were different from rater to rater. In regard to portfolio validity, the degree of content relevance could be increased through defining the portfolio criteria, and then through constructing portfolio tasks and rating rubrics according to the criteria. Although there were significant increases in students’ attitudes towards writing for those in the experimental group, the differences between the experimental group and the control group on both a standardized writing test and attitudes toward writing were not statistically significant after the initial differences had been adjusted. Both students and teachers reported positive effects of writing portfolios on their learning and teaching. The convergent validity of the writing portfolios was generally supported by the moderate correlation between portfolio scores and other writing measures. In addition, the results were also in accordance with the developmental stages of children’s writing ability.
期刊論文
1.張麗麗(20001000)。「什麼樣的檔案才值得...?」--談自主學習檔案的基本要素。屏縣教育季刊,4,5-12。  延伸查詢new window
2.Collins, A.(1992)。Portfolios for science education: Issues in purpose, structure, and authenticity。Science Education,76(4),451-463。  new window
3.Knight, P.(1992)。How I use portfolios in mathematics。Educational Leadership,49(8),71-72。  new window
4.Frazier, D. M.、Paulson, F. L.(1992)。How portfolios motivate reluctant writers。Educational Leadership,49(8),61-65。  new window
5.張美玉(19960600)。歷程檔案評量在建構教學之應用:一個科學的實徵研究。教學科技與媒體,27,31-46。new window  延伸查詢new window
6.Wolf, Dennie Palmer(1989)。Portfolio Assessment: Sampling Student Work。Educational Leadership,46(7),35-39。  new window
7.Lane, S.、Liu, M.、Ankenmann, R. D.、Stone, C. A.(1996)。Generalizability and validity of a mathematics performance assessment。Journal of Educational Measurement,33(1),71-92。  new window
8.Messick, Samuel(1994)。The Interplay of Evidence and Consequences in the Validation of Performance Assessments。Educational Researcher,23(2),13-23。  new window
9.Clauser, Brian E.(2000)。Recurrent issues and recent advances in scoring performance assessment。Applied Psychological Measurement,24(4),310-324。  new window
10.Herman, J. L.、Gearhart, M.、Baker, E. L.(1993)。Assessing writing portfolios: Issues in the validity and meaning of scores。Educational Assessment,1(3),201-224。  new window
11.Messick, S.(1995)。Validation of inferences from persons' responses and performances as scientific inquiry into score meaning。American Psychologist,50(9),741-749。  new window
12.Shavelson, R. J.、Baxter, G. P.、Gao, X.(1993)。Sampling variability of performance assessments。Journal of Educational Measurement,30(3),215-232。  new window
13.Pine, J.、Goldman, S. R.、Baxter, G. P.、Shavelson, R. J.(1992)。Evaluation of procedure-based scoring for hands-on science assessment。Journal of Educational Measurement,29(1),1-17。  new window
14.林玉珮(1998)。寧靜革命起校園。天下雜誌,23(教育特刊),37-40。  延伸查詢new window
15.吳英長、蔡涵如(1998)。建立個人的教學檔案。國教之聲,31(1),36-49。  延伸查詢new window
16.Banerji, M.(1999)。Validation of scores/ measures from a K-2 developmental assessment in mathematics。Educational and Psychological Measurement,59(4),694-715。  new window
17.Brennan, Robert L.(2000)。Performance assessments from the perspective of generalizability theory。Applied Psychological Measurement,24(4),339-353。  new window
18.Callahan, S.(1997)。Tests worth taking?: Using portfolios for accountability in Kentucky。Research in the Teaching of English,31(3),295-336。  new window
19.Czarra, F.(1999)。Breaking new ground: The Comprehensive Social Studies Assessment Project (CSSAP)。Social Education,63(6),360-364。  new window
20.Harwell, M.(1999)。Evaluating the validity of educational rating data。Educational and Psychological Measurement,59(1),25-37。  new window
21.Klein, S. P.、McCaffrey, D.、Stecher, D.、Koretz, D.(1995)。The reliability of mathematics portfolio scores: Lessons from the Vermont experience。Applied Measurement in Education,8(3),243-260。  new window
22.Koretz, D.(1998)。Large scale portfolio assessments in the US: Evidence pertaining to the quality of measurement。Assessment in Education,5(3),309-334。  new window
23.Miller, M. D.、Linn, R. L.(2000)。Validation of performance-based assessments。Applied Psychological Measurement,24(4),367-378。  new window
24.Moening, A. A.、Bhavnagri, N. P.(1996)。Effects of the showcase writing portfolio: process on first graders' writing。Early Education and Development,7(2),179-196。  new window
25.Naizer, G. L.(1997)。Validity and reliability issues of performance-portfolio assessment。Action in Teacher Education,18(4),1-9。  new window
26.Swartz, C. W.、Hooper, S. R.、Montgomery, J. W.、Wakely, M. B.(1999)。Using generalizability theory to estimate the reliability of writing scores derived from holistic and analytical scoring methods。Educational and Psychological Measurement,59,492-506。  new window
27.Viechnicki, K. J.、Barbour, N.、Shaklee, B.、Rohrer, J.、Ambrose, R.(1993)。The impact of portfolio assessment on teacher classroom activities。Journal of Teacher Education,44(5),371-377。  new window
會議論文
1.徐守濤、張麗麗、蔡雅泰(1994)。創造性思考與啟發式作文教學在國小實施成效的研究。香港。  延伸查詢new window
2.張麗麗、蔡清華(1996)。「教學檔案」及其在國小教師實習制度上的應用。臺東。  延伸查詢new window
3.蔡清華、張麗麗(1997)。「教學檔案」在國小實習教師專業成長及評鑑上的應用。沒有紀錄。133-176。  延伸查詢new window
4.Ladd, P. L.、Hatton, S. C.(1997)。One district's approach to improving student writing: A study of fourth grade 1991-92 and 1994-95 Kentucky writing portfolios。沒有紀錄。  new window
5.Reckase, M. D.(1997)。Constructs assessed by portfolios: How do they differ from those assessed by other educational tests。沒有紀錄。  new window
6.Clauser, P.、Stevens, J. J.(1996)。Longitudinal examination of a writing portfolio and the ITBS。Annual Meeting of the American Educational Research Association。  new window
7.Wolfe, E. W.(1996)。A report on the reliability of a large-scale portfolio assessment for language arts, mathematics, and science。沒有紀錄。  new window
研究報告
1.張麗麗(2000)。檔案評量模式之建構及其實施成效與信、效度之探討:以國小寫作檔案為例。沒有紀錄。  延伸查詢new window
2.Gao, X.、Colton, D. A.(1997)。Evaluating measurement precision of performance assessment with multiple forms, raters, and tasks。Iowa City, IA。  new window
圖書
1.American Educational Research Association、American Psychological Association、National Council on Measurement in Education(1985)。Standards for educational and Psychological testing。Standards for educational and Psychological testing。Washington, DC:American Psychological Association。  new window
2.Shavelson, Richard J.、Webb, Noreen M.(1991)。Generalizability Theory: A Primer。Newbury Park, California:Sage。  new window
3.Stiggins, Richard J.(1994)。Student-centered classroom assessment。New York, NY:Macmillan Publishing Company。  new window
4.張新仁(1992)。寫作教學研究--認知心理學取向。高雄:復文圖書有限公司。  延伸查詢new window
5.Brennan, R. L.(1992)。Elements of Generalizability Theory。Iowa, IA:The American College Testing Program。  new window
6.張麗麗(1999)。小作家檔案評量工作坊手冊。小作家檔案評量工作坊手冊。0。  延伸查詢new window
7.Angoff, W. H.(1988)。Validity: An evolving concept。Test validity。Hillsdale, NJ。  new window
8.Guskey, T. R.(1994)。High stakes performance assessment: Perspectives on Kentucky's educational reform。High stakes performance assessment: Perspectives on Kentucky's educational reform。Thousand Oaks, CA。  new window
9.Larson, R. L.(1991)。Using portfolios in the assessment of writing in the academic disciplines。Portfolios: Process and Product。Portsmouth, NH。  new window
10.Wile, J. M.、Tierney, R. J.(1996)。Tensions in assessment: The battle over portfolios, curriculum, and control。Writing portfolios in the classroom: Policy and practice, promise and peril。Mahwah, NJ。  new window
單篇論文
1.Owing, C. A.,Follo, E.(1992)。Effects of portfolio assessment on students' attitudes and goal setting abilities in mathematics(352394)。  new window
其他
1.Gearhart, M.,Herman, J. L.,Baker, E. L.,Whittaker, A. K.(1992)。Writing portfolios at the elementary level: A study of methods for writing assessment,0。  new window
2.Koretz, D.,Barron, S.,Mitchell, K. J.,Stecher, B. M.(1996)。Perceived effects of the Kentucky Instructional Results Information System (KIRIS),0。  new window
3.Koretz, D.,Klein, S.,McCaffrey, D.,Stecher, B.(1994)。The reliability of Vermont portfolio scores in the 1992-1993 school year,0。  new window
4.Baker, E. L.,Linn, R. L.(1992)。Writing portfolios: Potential for large scale assessment,0。  new window
5.Vermont State Department of Education(1992)。'This is my best': The report of Vermont's writing assessment program, Pilot year 1990-1991,0。  new window
圖書論文
1.Messick, S.(1989)。Validity。Educational measurement。New York:Macmillan。  new window
 
 
 
 
第一頁 上一頁 下一頁 最後一頁 top
:::
無相關著作
 
QR Code
QRCODE