:::

詳目顯示

回上一頁
題名:心理學研究中的可重復性問題:從危機到契機
書刊名:心理科學進展
作者:胡傳鵬王非過繼成思宋夢迪隋潔彭凱平
作者(外文):Hu, ChuanpengWang, FeiGuo, JichengsiSong, MengdiSui, JiePeng, Kaiping
出版日期:2016
卷期:2016(9)
頁次:1504-1518
主題關鍵詞:可重復性假陽性基於估計的統計開放科學革新ReplicabilityFalse positiveEstimate-based statisticOpen scienceReform
原始連結:連回原系統網址new window
相關次數:
  • 被引用次數被引用次數:期刊(0) 博士論文(0) 專書(0) 專書論文(0)
  • 排除自我引用排除自我引用:0
  • 共同引用共同引用:0
  • 點閱點閱:4
可重復性問題是當前科學界面臨的共同問題。最近,心理學研究領域的可重復性問題也受到廣泛關注,引起了研究者的積極討論與探索。通過對2008年發表的100項研究結果進行大規模重復實驗,研究者發現,心理學研究的成功重復率約為39%,但該研究仍然存在著巨大的爭議,不同的研究者對其結果的解讀不盡相同。針對可重復性問題,研究者通過數據模擬、元分析以及調查等多種方法來分析和探索其原因,這些研究表明,可重復性問題本質上可能是發表的研究假陽性過高,可疑研究操作是假陽性過高的直接原因,而出版偏見和過度依賴虛無假設檢驗則是更加深層的原因。面對可重復性問題,研究者從統計方法和研究實踐兩個方面提出了相應的解決方案,這些方法與實踐正在成為心理學研究的新標準。然而,要解決可重復性問題,還需要心理學研究領域的多方參與,尤其是在政策上鼓勵公開、透明和開放的研究取向,避免出版偏見。心理學研究者為解決可重復性問題做出的努力,不僅會加強心理學研究的可靠性,也為其他學科解決可重復問題提供了借鑒,推動科學界可重復問題的解決。
The recent replication crisis in psychology has raised increasing concerns. Given that it is important for psychologists to understand the replication crisis and the consequent changes in the field, the present review aimed at providing an overview of the relevant events and highlighting the methodological reforms in psychology. First, we briefly recapitulated the events that raised doubt about reliability of psychological research. Then, we focused on a recent large-scale replication study(Reproducible Project: Psychology) and the following debates. In addition, three underlying causes of the replication crisis were examined: 1) the overabundance of false positive results, which is mainly caused by the prevalence of questionable research practices, 2) publication bias, and 3) the over-reliance on Null-Hypothesis Significant Testing(NHST) and misunderstanding of p-values, which was confirmed by our survey among Chinese psychology students and academics. More importantly, the proposed solutions provided in the literature were also reviewed, e.g., shifting from NHST to alternative statistical methods and adopting new ways to enhance research integrity(i.e., pre-registration, full disclosure, and open data and materials of studies). Finally, we call for joint efforts by policy makers, researchers and educators to solve the replication crisis.
期刊論文
1.Sterling, T. D.、Rosenbaum, W. L.、Weinkam, J. J.(1995)。Publication decisions revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa。The American Statistician,49(1),108-112。  new window
2.Franco, A.、Malhotra, N.、Simonovits, G.(2014)。Publication bias in the social sciences: Unlocking the file drawer。Science,345(6203),1502-1505。  new window
3.Cohen, J.(1962)。The statistical power of abnormal-social psychological research: A review。Journal of Abnormal and Social Psychology,65(3),145-153。  new window
4.Kelley, K.、Preacher, K. J.(2012)。On effect size。Psychological Methods,17(2),137-152。  new window
5.鄭昊敏、溫忠麟、吳豔(2011)。心理學常用效應量的選用與分析。心理科學進展,19(12),1868-1878。  延伸查詢new window
6.Wasserstein, R. L.、Lazar, N. A.(2016)。The ASA's statement on p-values: context, process, and purpose。The American Statistician,70(2),129-133。  new window
7.Wilkinson, L.(1999)。Statistical Methods in Psychology Journals: Guidelines and Explanations。American Psychologist,54(8),594-604。  new window
8.Cohen, J.(1994)。The earth is round (p<.05)。American Psychologist,49(12),997-1003。  new window
9.焦璨、張敏強(2014)。迷失的邊界:心理學虛無假設檢驗方法探究。中國社會科學,2014(2),148-163+207。  延伸查詢new window
10.Rosenthal, R.(1979)。The 'File-Drawer Problem' and Tolerance for Null Results。Psychological Bulletin,86(3),638-641。  new window
11.Bakan, D.(1966)。The test of significance in psychological research。Psychological Bulletin,66(6),423-437。  new window
12.Kieffer, K. M.、Reese, R. J.、Thompson, B.(2001)。Statistical techniques employed in AERJ and JCP articles from 1988 to 1997: A methodological review。The Journal of Experimental Education,69(3),280-309。  new window
13.Fritz, C. O.、Morris, P. E.、Richler, J. J.(2012)。Effect size estimates: Current use, calculations, and interpretation。Journal of Experimental Psychology: General,141(1),2-18。  new window
14.Erceg-Hurn, D. M.、Mirosevich, V. M.(2008)。Modern robust statistical methods: an easy way to maximize the accuracy and power of your research。American Psychologist,63(7),591-601。  new window
15.Schmidt, Stefan(2009)。Shall we really do it again? The powerful concept of replication is neglected in the social sciences。Review of General Psychology,13(2),90-100。  new window
16.胡傳鵬、鄧曉紅、周治金、鄧小剛(2011)。神經法學:年輕的認知神經科學與古老的法學聯姻。科學通報,56(36),3041-3053。  延伸查詢new window
17.胡傳鵬、邸新、李佳蔚、隋潔、彭凱平(2015)。神經成像數據的元分析。心理科學進展,23(7),1118-1129。  延伸查詢new window
18.胡竹菁(2010)。平均數差異顯著性檢驗統計檢驗力和效果大小的估計原理與方法。心理學探新,30(1),68-73。  延伸查詢new window
19.胡竹菁、戴海琦(2011)。方差分析的統計檢驗力和效果大小的常用方法比較。心理學探新,31(3),254-259。  延伸查詢new window
20.胡竹菁、董聖鴻、張闊(2013)。《心理統計學》教學內容的新探索。心理學探新,33(5),402-408。  延伸查詢new window
21.盧謝峰、唐源鴻、曾凡梅(2011)。效應量:估計、報告和解釋。心理學探新,31(3),260-264。  延伸查詢new window
22.朱瀅(2016)。「開放科學 數據共享 軟件共享」,你準備好了嗎?。心理科學進展,24(6),995-996。new window  延伸查詢new window
23.Alberts, B.(2011)。Editorial expression of concern。Science,334(6057),760。  new window
24.Anderson, C. J.、Bahník, Š.、Barnett-Cowan, M.、Bosco, F. A.、Chandler, J.、Chartier, C. R.、Zuni, K.(2016)。Response to comment on "Estimating the reproducibility of psychological science"。Science,351(6277),1037。  new window
25.Asendorpf, J. B.、Conner, M.、De Fruyt, F.、De Houwer, J.、Denissen, J. J. A.、Fiedler, K.、Wicherts, J. M.(2013)。Recommendations for Increasing replicability in psychology。European Journal of Personality,27(2),108-119。  new window
26.Baker, M.(2016)。1,500 scientists lift the lid on reproducibility。Nature,553,452-454。  new window
27.Bakker, M.、van Dijk, A.、Wicherts, J. M.(2012)。The rules of the game called psychological science。Perspectives on Psychological Science,7(6),543-554。  new window
28.Barch, D. M.、Yarkoni, T.(2013)。Introduction to the special issue on reliability and replication in cognitive and affective neuroscience research。Cognitive, Affective, & Behavioral Neuroscience,13(4),687-689。  new window
29.Begley, C. G.、Ellis, L. M.(2012)。Drug development: Raise standards for preclinical cancer research。Nature,483(7391),531-533。  new window
30.Bem, D. J.(2011)。Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect。Journal of Personality and Social Psychology,100(3),407-425。  new window
31.Brandt, M. J.、IJzerman, H.、Dijksterhuis, A.、Farach, F. J.、Geller, J.、Giner-Sorolla, R.、van't Veer, A.(2014)。The replication recipe: What makes for a convincing replication?。Journal of Experimental Social Psychology,50,217-224。  new window
32.Brown, S. D.、Furrow, D.、Hill, D. F.、Gable, J. C.、Porter, L. P.、Jacobs, W. J.(2014)。A duty to describe: Better the devil you know than the devil you don't。Perspectives on Psychological Science,9(6),626-640。  new window
33.Carp, J.(2013)。Better living through transparency: Improving the reproducibility of fMRI results through comprehensive methods reporting。Cognitive, Affective, & Behavioral Neuroscience,13(3),660-666。  new window
34.Chambers, C. D.、Dienes, Z.、McIntosh, R. D.、Rotshtein, P.、Willmes, K.(2015)。Registered reports: Realigning incentives in scientific publishing。Cortex,66,A1-A2。  new window
35.Chin, J. M.(2014)。Psychological science's replicability crisis and what it means for science in the courtroom。Psychology, Public Policy, and Law,20(3),225-238。  new window
36.Coulson, M.、Healey, M.、Fidler, F.、Cumming, G.(2010)。Confidence intervals permit, but do not guarantee, better inference than statistical significance testing。Frontiers in Psychology,1,26。  new window
37.Cumming, G.(2008)。Replication and p intervals: P values predict the future only vaguely, but confidence intervals do much better。Perspectives on Psychological Science,3(4),286-300。  new window
38.Cumming, G.(2014)。The new statistics: Why and how。Psychological Science,25(1),7-29。  new window
39.Cumming, G.、Fidler, F.、Leonard, M.、Kalinowski, P.、Christiansen, A.、Kleinig, A.、Wilson, S.(2007)。Statistical reform in psychology: Is anything changing?。Psychological Science,18(3),230-232。  new window
40.Cumming, G.、Maillardet, R.(2006)。Confidence intervals and replication: Where will the next mean fall?。Psychological Methods,11(3),217-227。  new window
41.Doyen, S.、Klein, O.、Pichon, C.-L.、Cleeremans, A.(2012)。Behavioral priming: It's all in the mind, but whose mind?。PLoS One,7(1),e29081。  new window
42.Earp, B. D.、Trafimow, D.(2015)。Replication, falsification, and the crisis of confidence in social psychology。Frontiers in Psychology,6,621。  new window
43.(20111222)。Ten for 2011 [Editorial]。Nature,480(7378),414。  new window
44.Eich, E.(2014)。Business not as usual。Psychological Science,25(1),3-6。  new window
45.Eickhoff, S.、Nichols, T. E.、van Horn, J. D.、Turner, J. A.(2016)。Sharing the wealth: Neuroimaging data repositories。NeuroImage,124(Pt B),1065-1068。  new window
46.Enserink, M.(2012)。Final report on Stapel also blames field as a whole。Science,338(6112),1270-1271。  new window
47.Errington, T. M.、Iorns, E.、Gunn, W.、Tan, F. E.、Lomax, J.、Nosek, B. A.(2014)。An open investigation of the reproducibility of cancer biology research。eLife,3。  new window
48.Etz, A.、Vandekerckhove, J.(2016)。A bayesian perspective on the reproducibility project: Psychology。PLoS One,11(2),e0149794。  new window
49.Fanelli, D.(2010)。"Positive" results increase down the hierarchy of the sciences。PLoS One,5(4),e10068。  new window
50.Ferguson, C. J.、Heene, M.(2012)。A vast graveyard of undead theories: Publication bias and psychological science's aversion to the null。Perspectives on Psychological Science,7(6),555-561。  new window
51.Fox, P. T.、Lancaster, J. L.、Laird, A. R.、Eickhoff, S. B.(2014)。Meta-analysis in human neuroimaging: Computational modeling of large-scale databases。Annual Review of Neuroscience,37(1),409-434。  new window
52.Franco, A.、Malhotra, N.、Simonovits, G.(2016)。Underreporting in psychology experiments: Evidence from a study registry。Social Psychological and Personality Science,7(1),8-12。  new window
53.Gadbury, G. L.、Allison, D. B.(2012)。Inappropriate fiddling with statistical analyses to obtain a desirable p-value: Tests to detect its presence in published literature。PLoS One,7(10),e46363。  new window
54.Galak, J.、LeBoeuf, R. A.、Nelson, L. D.、Simmons, J. P.(2012)。Correcting the past: Failures to replicate psi。Journal of Personality and Social Psychology,103(6),933-948。  new window
55.Gigerenzer, G.(2004)。Mindless statistics。The Journal of Socio-Economics,33(5),587-606。  new window
56.Gilbert, D. T.、King, G.、Pettigrew, S.、Wilson, T. D.(2016)。Comment on "Estimating the reproducibility of psychological science"。Science,351(6277),1037。  new window
57.Haller, H.、Krauss, S.(2002)。Misinterpretations of significance: A problem students share with their teachers。Methods of Psychological Research Online,7(1),1-20。  new window
58.Halsey, L. G.、Curran-Everett, D.、Vowler, S. L.、Drummond, G. B.(2015)。The fickle P value generates irreproducible results。Nature Methods,12(3),179-185。  new window
59.Ioannidis, J. P. A.(2005)。Why most published research findings are false。PLoS Medicine,2(8)。  new window
60.Ioannidis, J. P. A.(2008)。Why most discovered true associations are inflated。Epidemiology,19(5),640-648。  new window
61.Ioannidis, J. P. A.、Fanelli, D.、Dunne, D. D.、Goodman, S. N.(2015)。Meta-research: Evaluation and improvement of research methods and practices。PLoS Biology,13(10),e1002264。  new window
62.Ioannidis, J. P. A.、Munafò, M. R.、Fusar-Poli, P.、Nosek, B. A.、David, S. P.(2014)。Publication and other reporting biases in cognitive sciences: Detection, prevalence, and prevention。Trends in Cognitive Sciences,18(5),235-241。  new window
63.John, L. K.、Loewenstein, G.、Prelec, D.(2012)。Measuring the prevalence of questionable research practices with incentives for truth telling。Psychological Science,23(5),524-532。  new window
64.Joober, R.、Schmitz, N.、Annable, L.、Boksa, P.(2012)。Publication bias: What are the challenges and can they be overcome?。Journal of Psychiatry & Neuroscience,37(3),149-152。  new window
65.Kühberger, A.、Fritz, A.、Scherndl, T.(2014)。Publication bias in psychology: A diagnosis based on the correlation between effect size and sample size。PLoS One,9(9),e105825。  new window
66.Kahneman, D.(2014)。A new etiquette for replication。Social Psychology,45(4),310-311。  new window
67.Kaplan, R. M.、Irvin, V. L.(2015)。Likelihood of null effects of large NHLBI clinical trials has increased over time。PLoS One,10(8),e0132382。  new window
68.Kidwell, M. C.、Lazarevi, L. B.、Baranski, E.、Hardwicke, T. E.、Piechowski, S.、Falkenberg, L.-S.、Nosek, B. A.(2016)。Badges to acknowledge open practices: A simple, low-cost, effective method for increasing transparency。PLoS Biology,14(5),e1002456。  new window
69.Klein, R. A.、Ratliff, K. A.、Vianello, M.、Adams, R. B.、Bahník, Š.、Bernstein, M. J.、Nosek, B. A.(2014)。Investigating variation in replicability: A "many labs" replication project。Social Psychology,45(3),142-152。  new window
70.Lakens, D.(2013)。Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs。Frontiers in Psychology,4,863。  new window
71.LeBel, E. P.、Borsboom, D.、Giner-Sorolla, R.、Hasselman, F.、Peters, K. R.、Ratliff, K. A.、Smith, C. T.(2013)。PsychDisclosure.org: Grassroots support for reforming reporting standards in psychology。Perspectives on Psychological Science,8(4),424-432。  new window
72.Lindsay, D. S.(2015)。Replication in psychological science。Psychological Science,26(12),1827-1832。  new window
73.Lurquin, J. H.、Michaelson, L. E.、Barker, J. E.、Gustavson, D. E.、von Bastian, C. C.、Carruth, N. P.、Miyake, A.(2016)。No evidence of the ego-depletion effect across task characteristics and individual differences: A preregistered study。PLoS One,11(2),e0147770。  new window
74.Makel, M. C.、Plucker, J. A.、Hegarty, B.(2012)。Replications in psychology research: How often do they really occur?。Perspectives on Psychological Science,7(6),537-542。  new window
75.Maxwell, Scott E.、Lau, Michael Y.、Howard, George S.(2015)。Is psychology suffering from a replication crisis? What does "failure to replicate" really mean?。American Psychologist,70(6),487-498。  new window
76.McNutt, M.(2014)。Journals unite for reproducibility。Science,346(6210),679。  new window
77.McNutt, M.(2016)。Taking up TOP。Science,352(6290),1147。  new window
78.Miguel, E.、Camerer, C.、Casey, K.、Cohen, J.、Esterling, K. M.、Gerber, A.、van der Laan, M.(2014)。Promoting transparency in social science research。Science,343(6166),30-31。  new window
79.Miller, G.(2011)。ESP paper rekindles discussion about statistics。Science,331(6015),272-273。  new window
80.Nature News(2015)。365 days: Nature's 10。Nature,528(7583),459-467。  new window
81.Nosek, B. A.、Alter, G.、Banks, G. C.、Borsboom, D.、Bowman, S. D.、Breckler, S. J.、Yarkoni, T.(2015)。Promoting an open research culture。Science,348(6242),1422-1425。  new window
82.Nosek, B. A.、Lakens, D.(2014)。Registered reports: A method to increase the credibility of published results。Social Psychology,45(3),137-141。  new window
83.Nuzzo, R.(2015)。How scientists fool themselves--and how they can stop。Nature,526(7572),182-185。  new window
84.Open Science Collaboration(2015)。Estimating the reproducibility of psychological science。Science,349(6251),943。  new window
85.Pashler, H.、Wagenmakers, E. J.(2012)。Editors' introduction to the special section on replicability in psychological science: A crisis of confidence?。Perspectives on Psychological Science,7(6),528-530。  new window
86.Peng, R. D.(2009)。Reproducible research and biostatistics。Biostatistics,10(3),405-408。  new window
87.Poldrack, R. A.、Gorgolewski, K. J.(2014)。Making big data open: Data sharing in neuroimaging。Nature Neuroscience,17(11),1510-1517。  new window
88.Ritchie, S. J.、Wiseman, R.、French, C. C.(2012)。Failing the future: Three unsuccessful attempts to replicate Bem's 'retroactive facilitation of recall' effect。PLoS One,7(3),e33423。  new window
89.Schooler, J. W.(2014)。Metascience could rescue the 'replication crisis'。Nature,515,9。  new window
90.Schweinsberg, M.、Madan, N.、Vianello, M.、Sommer, S. A.、Jordan, J.、Tierney, W.、Uhlmann, E. L.(2016)。The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline。Journal of Experimental Social Psychology,66,55-67。  new window
91.Science News Staff(2015)。Science's Breakthrough of the Year 2015: Runners-up。Science,350(6267),1458-1463。  new window
92.Simonsohn, U.、Nelson, L. D.、Simmons, J. P.(2014)。P-curve: A key to the file-drawer。Journal of Experimental Psychology: General,143(2),534-547。  new window
93.Simonsohn, U.、Simmons, J. P.、Nelson, L. D.(2015)。Better P-curves: Making P-curve analysis more robust to errors, fraud, and ambitious P-hacking, a reply to Ulrich and Miller (2015)。Journal of Experimental Psychology: General,144(6),1146-1152。  new window
94.Sloman, S. A.(2015)。Opening editorial: The changing face of Cognition。Cognition,135,1-3。  new window
95.Spellman, B. A.(2012)。Introduction to the special section on research practices。Perspectives on Psychological Science,7(6),655-656。  new window
96.Spellman, B. A.(2013)。Introduction to the special section on advancing science。Perspectives on Psychological Science,8(4),412-413。  new window
97.Spellman, B. A.(2015)。A short (personal) future history of revolution 2.0。Perspectives on Psychological Science,10(6),886-899。  new window
98.Stroebe, W.、Strack, F.(2014)。The alleged crisis and the illusion of exact replication。Perspectives on Psychological Science,9(1),59-71。  new window
99.Tajika, A.、Ogawa, Y.、Takeshima, N.、Hayasaka, Y.、Furukawa, T. A.(2015)。Replication and contradiction of highly cited research papers in psychiatry: 10-year follow-up。The British Journal of Psychiatry,207(4),357-362。  new window
100.Trafimow, D.、Marks, M.(2015)。Editorial。Basic and Applied Social Psychology,37(1),1-2。  new window
101.Tuk, M. A.、Zhang, K.、Sweldens, S.(2015)。The propagation of self-control: Self-control in one domain simultaneously improves self-control in other domains。Journal of Experimental Psychology: General,144(3),639-354。  new window
102.van Bavel, J. J.、Mende-Siedlecki, P.、Brady, W. J.、Reinero, D. A.(2016)。Contextual sensitivity in scientific reproducibility。Proceedings of the National Academy of Sciences of the United States of America,113(23),6454-6459。  new window
103.van Elk, M.、Matzke, D.、Gronau, Q. F.、Guang, M.、Vandekerckhove, J.、Wagenmakers, E.-J.(2015)。Metaanalyses are no substitute for registered replications: A skeptical perspective on religious priming。Frontiers in Psychology,6,1365。  new window
104.Vankov, I.、Bowers, J.、Munafò, M. R.(2014)。On the persistence of low power in psychological science。The Quarterly Journal of Experimental Psychology,67(5),1037-1040。  new window
105.Wagenmakers, E.-J.、Wetzels, R.、Borsboom, D.、van der Maas, H. L. J.(2011)。Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011)。Journal of Personality and Social Psychology,100(3),426-432。  new window
106.Wagenmakers, E.-J.、Wetzels, R.、Borsboom, D.、van der Maas, H. L. J.、Kievit, R. A.(2012)。An agenda for purely confirmatory research。Perspectives on Psychological Science,7(6),632-638。  new window
107.Yong, E.(2012)。Replication studies: Bad copy。Nature,485(7398),298-300。  new window
108.Zuo, X.-N.、Anderson, J. S.、Bellec, P.、Birn, R. M.、Biswal, B. B.、Blautzik, J.、Milham, M. P.(2014)。An open science resource for establishing reliability and reproducibility in functional connectomics。Scientific Data,1,140049。  new window
109.Simmons, J. P.、Nelson, L. D.、Simonsohn, U.(2011)。False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant。Psychological Science,22(11),1359-1366。  new window
圖書
1.Cumming, G.(2012)。Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis。New York:Routledge。  new window
2.Grissom, R. J.、Kim, J. J.(2012)。Effect sizes for research: Univariate and multivariate applications。New York:Routledge。  new window
3.American Psychological Association(2010)。Publication manual of the American Psychological Association。Washington, DC:American Psychological Association。  new window
4.Cooper, H.、Hedges, L. V.、Valentine, J. C.(2009)。The handbook of research synthesis and meta-analysis。New York:Sage。  new window
5.Oakes, M.(1986)。Statistical inference: A commentary for the social and behavioural sciences。Chichester:Wiley。  new window
6.Wilcox, R.(2011)。Modern statistics for the social and behavioral sciences: A practical introduction。Boca Raton, FL:CRC Press。  new window
7.Cohen, Jacob(1988)。Statistical power analysis for the behavioral sciences。Routledge Academic。  new window
其他
1.Bem, D. J.,Tressoldi, P. E.,Rabeyron, T.,Duggan, M.(2015)。Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events [version 1; referees: 2 approved],http://f1000research.com/articles/4-1188/v2。  new window
2.Chang, A. C.,Li, P.(2015)。Is economics research replicable? sixty published papers from thirteen Journals say "usually not",Washington。,https://www.federalreserve.gov/econresdata/feds/2015/files/2015083pap.pdf。  new window
3.Ebersole, C. R.,Atherton, O. E.,Belanger, A. L.,Skulborstad, H. M.,Allen, J. M.,Banks, J. B.,Nosek, B. A.(2016)。Many Labs 3: Evaluating participant pool quality across the academic semester via replication,https://osf.io/csygd。  new window
4.Schimmack, U.(2014)。Quantifying statistical research integrity: The Replicabilty-Index,http://www.r-index.org/uploads/3/5/6/7/3567479/introduction_to_the_r-index__14-12-01.pdf。  new window
5.Smaldino, P. E.,McElreath, R.(2016)。The natural selection of bad science,http://arxiv.org/abs/1605.09511。  new window
6.Van't Veer, A. E.,Giner-Sorolla, R.(2015)。Public template for pre-registration,https://osf.io/k5wns/。  new window
圖書論文
1.Kirk, R. E.(2008)。The importance of effect magnitude。Handbook of research methods in experimental psychology。Oxford:Blackwell Publishing Ltd.。  new window
2.Kline, R. B.(2004)。What's wrong with statistical tests: and where we go from here。Beyond significance testing: Reforming data analysis methods in behavioral research。Washington, DC:American Psychological Association。  new window
 
 
 
 
第一頁 上一頁 下一頁 最後一頁 top