:::

詳目顯示

回上一頁
題名:使用影片教學時加入情緒辨識的效果研究--情緒回饋對互動式解謎影片學習之影響
作者:蔡尚秦
作者(外文):Tsai,Shang-Chin
校院名稱:國立臺南大學
系所名稱:數位學習科技學系碩博士班
指導教授:林豪鏘
學位類別:博士
出版日期:2022
主題關鍵詞:情緒辨識解謎影片學習成效情緒回饋學習滿意度emotion recognitionpuzzle filmLearning effectivenessemotion feedbacklearning satisfaction
原始連結:連回原系統網址new window
相關次數:
  • 被引用次數被引用次數:期刊(0) 博士論文(0) 專書(0) 專書論文(0)
  • 排除自我引用排除自我引用:0
  • 共同引用共同引用:0
  • 點閱點閱:4
摘要:
本研究係利用科學議題《彗星的故事》互動式解謎影片作為案例來實施科學故事教學,引導學生來找到正確答案,藉以培養學習和思考判斷的能力,教學過程當中,實驗組加入了臉部情緒辨識系統來偵測辨識受測者當下的情緒反應,當受測者在各關卡答題答錯答案之時會被偵測情緒,而當臉部產生了"厭惡"或"悲傷"或者是"喜悅"的表情時,系統就會給予四個關卡的各個關卡專有的、不同的正面鼓勵文字字幕卡,用來鼓勵受測者能夠順利完成互動式解謎影片的學習過程程序。實驗對象以國民小學五年級和六年級的高年級學生為主,研究者有製作家長同意書,請高雄市參與本次研究的四所國民小學和台南市參與本次研究的三所國民小學的導師協助發放家長同意書,總計共有130人參與實驗,隨機分派成二個組,即對照組(無情緒辨識組,沒有加入情緒辨識的偵測系統)和實驗組(有情緒辨識組,有加入情緒辨識的偵測系統),二組均先施以學習成效的前測測驗,然後在施作完《彗星的故事》互動式解謎影片科學故事教學之後,對照組和實驗組均會施以"學習成效"的後測測驗,還有"學習滿意度"問卷調查、"系統可用性"問卷調查和"系統滿意度"問卷調查。分析二組受測者的測驗和問卷結果:比較分析顯示在互動教學之後兩組在選擇題作答上有統計顯著差異,實驗組選擇題後測答對題數平均數為5.86題比前測進步2.48題,對照組選擇題後測答對題數平均數為4.74題比前測進步1.47題;在學習滿意度及教學系統滿意度比較分析,由統計分析說明實驗組高於對照組。
ABSTRACT:
In this study, the scientific interactive puzzle film “Story of the Comet” is taken as a case to implement scientific story teaching to guide students to find the correct answers, through which, it can train their learning and judging abilities. The students in the experimental group received the scientific story teaching guiding system of the interactive puzzle film “Story of the Comet” with the facial emotion recognition system to recognize the emotional reaction of the subjects at the moment. According to their facial expression of “disgust”, “sadness”, or “joy” appeared at the moment, the system presented different captioned positive encouragement cards particularly designed for 4 different levels, when the subjects answered the questions wrong at different levels and their emotions would be detected at the same time. Furthermore, those positive encouragement cards encourage the subjects to complete the interactive puzzle film learning process.
The subjects are students in the higher grades of Grade 5 and Grade 6 in elementary schools. The researcher has prepared a parental consent form. The teachers of the four elementary schools in Kaohsiung City and the three elementary schools in Tainan City that participated in this research are asked to assist in issuing the parental consent forms.
A total of 130 students participated in this experiment and were randomly divided into two groups. Both the control group (i.e. the group without emotion recognition) and experiment group (i.e. the group with emotion recognition) received a before-watching test of learning effectiveness. After implementing the scientific story teaching of the interactive puzzle film “Story of the Comet”, both the control group and the experimental group were also received a after-watching test of learning effectiveness. Finally, the subjects filled out “learning satisfaction” questionnaire, “system availability” questionnaire and “system satisfaction” questionnaire.
The analysis of the results of the two groups’ tests and questionnaires: For comparative analysis of learning effectiveness, it indicates that there is statistically significant difference between the choice answers of the two groups after the interactive teaching; for the experimental group, the average right answers of choice questions in after-watching test is 5.86, which is 2.48 more than the before-watching test; that of the control group is 4.74, which is 1.47 more than the before -watching test. For comparative analysis of questionnaires for “learning satisfaction” and “system satisfaction”, those of the statistical data analysis indicates that the experimental group is better than the control group.
參考文獻:
中文部份:

中天新聞。記錄台灣。https://www.youtube.com/watch?v=M7FryY7DlRU,2013
年10月13日。

王政揚(2010)。〈喂 我打個岔!〉互動裝置藝術之創作與研究。國立台灣藝術大學碩士論文。

李主冠(2009)。互動媒體設計方法之探討。元智大學碩士論文。

李銘峰(2016)。以資料探勘模式分析學習者情緒與色彩之關係架構。國立臺中教育大學教育資訊與測驗統計研究所博士論文。

李勇輝(2017)。學習動機、學習策略與學習成效關係之研究-以數位學習為例。經營管理學刊,第十四期,68-86。

吳明隆(2000)。SPSS統計應用實務。台北市:五南。

林勇、粘錦成(2000)。能力本位教育與傳統教育差異。能力培訓專刊,89年2月,20-24。

林進財(2000)。有效教學:理論與策略。台北市:五南。

林進財(2000)。教學理論與方法。台北市:五南。

林佩璇(1992)。台灣省高級職業學校合作學習教學法實驗研究。國立台灣師範大學教育研究所碩士論文。

郭芳娥(2014)。多媒體展示模式融入教學之研究。國立中正大學資訊工程研究所博士論文。

許晉懷(2006)。結合影像及語音之雙模情緒辨識系統。國立交通大學電機與控制工程學系碩士論文。

教育部國民及學前教育署(2021)。十二年國教。108課綱資訊網。
https://12basic.edu.tw/12about.php

陳箴(2020)。情緒辨識AI技術介紹。台灣人工智慧行動網。
https://ai.iias.sinica.edu.tw

維基百科(2016)。愛德蒙•哈雷。
https://zh.wikipedia.org/wiki/%E6%84%9B%E5%BE%B7%E8%92%99%C2%B7% E5%93%88%E9%9B%B7

維基百科(2016)。艾薩克•牛頓。
https://zh.wikipedia.org/wiki/%E8%89%BE%E8%90%A8%E5%85%8B%C2%B7% E7%89%9B%E9%A1%BF

維基百科(2016)。羅伯特•胡克。https://zh.wikipedia.org/wiki/%E7%BD%97%E4%BC%AF%E7%89%B9%C2%B7%E8%83%A1%E5%85%8B

維基百科(2016)。克里斯多夫•雷恩。https://zh.wikipedia.org/wiki/%E5%85%8B%E9%87%8C%E6%96%AF%E5%A4%9A%E4%BD%9B%C2%B7%E9%9B%B7%E6%81%A9

維基百科(2016)。約翰•福藍斯迪。https://zh.wikipedia.org/wiki/%E7%B4%84%E7%BF%B0%C2%B7%E4%BD%9B%E8%98%AD%E6%96%AF%E8%92%82%E5%BE%B7

維基百科(2016)。哈雷彗星。https://zh.wikipedia.org/wiki/%E5%93%88%E9%9B%B7%E5%BD%97%E6%98%9F

蔡子瑋、王兆華、黃國峰(2013)。情意運算運用於互動遊戲之設計模式研究。NSC 99-2221-E-025-007-MY2;p10-p11。

蔡振昆(2001)。傳統教學與網路教學之比較研究--從教學媒體、班級經營及教學評量來探討。國立中山大學資訊管理研究所碩士在職專班碩士論文。

劉學燕(2010)。基於小腦神經與模糊方法之情緒辨識研究。中華大學電機工程學系碩士班碩士論文。

賴源泰(2015)。以特徵為基礎的人臉辨識之可規劃計算機系統。國立成功大學教授、副教授休假研究計畫書。

翻轉教育。親子天下。教與學的對話。https://flipedu.parenting.com.tw/article/139,
2021。


西文部份:

Ageenko, E., & La Russa, G. (2005). A visualization toolkit for teaching, learning, and experimentation in image processing. Proceedings of 2005 IEEE Annual Conference on Frontiers in Education, F2H-21-F2H26.

Alavi, M., Wheeler, B.C., & Valacich, J.S. (1995). Using IT to reengineer business eduaction: An exploratory investigation of collaborative telelearning. MIS Quarterly, 19(3), 293-312.

Azcarate, A., Hageloh, F., van de Sande, K., & Valenti, R. (2005). Automatic facial emotion recognition. Universiteit van Amsterdam.

Bruning, M. J. (1992). VIS: Technology for Multicultural Teacher Education,
TechTrends, 37(1), 13-14.

Bruner, J. (1960). The process of education. Cambridge. MA: Harvard University Press.

Bernhaupt, R., Boldt, A., Mirlacher, T., Wilfinger, D., & Tscheligi, M. (2007). Using emotion in games: emotional flowers.

Boehner, K., Chen, M., & Liu, Z. (2003). The vibe reflector: an emergent impression of collective experience.

Cheng-Hung Wang, Hao-Chiang Koong Lin, (2018). Emotional Design Tutoring
System Based on Multimodal Affective Computing Techniques, International Journal
of Distance Education Technologies, 16(1), DOI: 10.4018/IJDET.2018010106.

Dongsong Zhang, Lina Zhou, Robert O. Briggs, Jay F. Nunamaker (2006).
Instructional video in e-learning: Assessing the impact of interactive video on
learning effectiveness. Information and Management, 43(1), 15-27.

Duhaney, D. (2000). Technology and the educational process: Transforming
classroom activities, International Journal of Instructional Media, 27(1), 67-72.

Devellis, R. F. (1991). Scale development: Theory and applications. Newbury
Park, CA: Sage.

Darwin, C. (1965). The expression of the emotions in man and animals. Chicago:
University of Chicago Press .

Elias, M.J. & Weissberg, R.P. (2000). Primary Prevention: Educational
Approaches to Enhance Social and Emotional Learning. Journal of School Health,
70 (5), 186-190.

Ekman, P. (2004). Emotions Revealed: Understanding Faces and Feelings: Phoenix.

Elizabeth Molloy, Francesc Borrell-Carrió, Ron Epstein (2012). Feedback in Higher and Professional Education, The impact of emotions in feedback, 1st Edition, Pages 22.

Fu-Hsing Tsai, Kuang-Chao Yu, & Hsien-Sheng Hsiao, (2012). Exploring the Factors
Influencing Learning Effectiveness in Digital Gamebased Learning, Journal of
Educational Technology & Society, 15(3), 240–250.
http://www.jstor.org/stable/jeductechsoci.15.3.240

Farivar, S. H.(1985)﹒Developing and implementing a cooperative learning program in a middle elementary classroom﹒Disseration abstracts internation, 46,1823, 6-10﹒

Guay, F., Ratelle, C. F., & Chanal, J. (2008). Optimal learning in optimal contexts: The role of selfdetermination in education. Canadian Psychology/Psychologie Canadienne, 49(3), 233.

Hutchinson, J. A., Cissna, K. N., Hall, M. E., Backlund, P. E., & Tolhuizen, J. H. (1978). Videotape self-confrontation as a technique to enhance interpersonal
communication effectiveness, Communication Education, 27, 245-250.

Hung, C.Y., Chang, T.W., Yu, P.T. & Cheng, P.J. (2012). The problem-solving skills and learning performance in learning multi-touch interactive jigsaw game using digital scaffolds, In 4th IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning (pp.33-38). New York, NY: IEEE.

Hao-Chiang Koong Lin, Mei-Chi Chen, and Chih-Kai Chang, (2015). Assessing the
effectiveness of learning solid geometry by using an augmented reality-assisted
learning system, Interactive Learning Environments, 23(6), 799-810.

Han, Tuan-Yung, Hong-Ren Chen, and Hao-Chiang Koong Lin, (2021). Using Flipped
Classroom to Improve the Learning Effectiveness of Digital Logic Courses,
Electronics, 10(13) : 1602. https://doi.org/10.3390/electronics10131602

Johnson, S.D., Aragon, S.R., & Shaik, N. (2000). Comparative analysis of learning satisfaction and learning outcomes in online and face-to-face learning environments. Journal of Interactive Learning Research, 11(1), 29-49.

Knowles, M.S. (1970). The modern practice of adult education. New York, NY:
Association Press.

Liping Shen, Minjuan Wang,and Ruimin Shen , Affective e-Learning: Using
“Emotional” Data to Improve Learning in Pervasive Learning Environment,Journal
of Educational Technology & Society, 2009.

Long, H.B. (1985). Contradictory expectations achievement and satisfaction in adult learning. Journal of continuing Higher Education, 33(3), 10-12.

Lankes M., Mirlacher T. (2012) Affective Game Dialogues. In: van den Herik H.J.,
Plaat A. (eds) Advances in Computer Games. ACG 2011. Lecture Notes in Computer
Science, vol 7168. Springer, Berlin, Heidelberg.
https://doi.org/10.1007/978-3-642-31866-5_28

Lipnevich, A.A., Smith, J.K. (2009). “I really need feedback to learn:” students’ perspectives on the effectiveness of the differential feedback messages. Educational Assessment, Evaluation and Accountability, 21, 347.
https://doi.org/10.1007/s11092-009-9082-2

Lin, Hao-Chiang K., Yu-Chun Ma, and Min Lee. (2021). "Constructing Emotional
Machines: A Case of a Smartphone-Based Emotion System" Electronics 10, no. 3:
306. https://doi.org/10.3390/electronics10030306

McLean, G. F., Graham, E. D., & Jernigan, M. E. (1992). A software environment
for teaching image processing, Proceedings of 1992 IEEE International
conference on Acoustics, Speech, and Signal Processing, 101-104.

M. Wegmuller, J. P. von der Weid, P. Oberson, and N. Gisin, High resolution fiber distributed measurements with coherent OFDR,in Proc. ECOC’00, 2000, paper
11.3.4, p. 109.

Mary E. Pritchard, Gregory S. Wilson, Vaughn, Using Emotional and Social
Factors to Predict Student Success,Journal of College Student Development,
January/February 2003.

Marta Arguedas, Thanasis Daradoumis, Fatos Xhafa, Analyzing the effects of
emotion management on time and self-management in computer-based learning,
Computers in Human Behavior,2016.

Müzeyyen Bulut Özek, The effects of merging student emotion recognition with
learning management systems on learners and academic achievements, Computer
Applications in Engineering,14 May 2018.

Mayer, R. E. (2001). Mutimedia Learning. New York, Cambridge University Press.

Mayer, R. E. (2005). The Cambridge Handbook of Multimedia Learning.
New York: Cambridge university press.

Mayer, R. E. (2009). Multimedia Learning Cambridge University Press; 2nd.

Mayer, R. E. and Anderson, R. B. (1991). Animations Need Narrations: An
Experimental Test of a Dual-Coding Hypothesis. Journal of Educational
Psychology, 83, 484-490.

Mayer, R.E. and Gallini, J.K. (1990). “When is an illustration worth ten thousand words?” Journal of Educational Psychology, 82, 715-726.

Mayer, R.E. (1993). “Comprehension of graphics in texts: An overview,” Learning
and Instruction, 3, 239-245.

Mayer, R.E. and Sims, K. (1994). “For whom is a picture worth a thousand
words? Extensions of a dual-coding theory of multimedia learning,” Journal of
Educational Psychology, 86(3), 389-401.

Mayer, R.E. (1997). “Multimedia learning: Are we asking the right questions?”
Educational Psychologist, 32(1), 1-19.

Maki, R.H., Maki, W.S., Patterson, M., & Whittaker, P.D. (2000). Evaluation of a
web-based introductory psychology course: I. Learning and satisfaction in on-line versus lecture courses. Behavior Research Methods, Instruments, & Computers, 32(2), 230-239.

Minsky, M. (1986). The society of mind. New York : Simon and Schuster.
Ammar, M. B., Neji, M., Alimi, A. M., & Gouardères, G. (2010). The affective
tutoring system. Expert Systems with Applications, 37(4), 3013-3023.

Minsky, Marvin Lee (2006). The Emotion Machine: Commonsense Thinking, Artificial
Intelligence, and the Future of the Human Mind. New York: Simon & Schuster.

Nattiv, A.(1986)﹒The effects of cooperative learning instruction strategies on achievement among sixth grads social studies﹒University of California, Sants
Barbara, 19-20﹒

Nunnally, J. C. 1978, Psychometric Theory, New York:McGraw-Hill.

Pike, G. R., Smart, J. C., & Ethington, C. A. (2012). The mediating effects of student engagement on the relationships between academic disciplines and learning outcomes: An extension of Holland’s theory. Research in Higher Education, 53(5), 550-575.

Payton, J.W., Wardlaw, D.M., Graczyk, P. A., Bloody, M.R., Trompsett, C. J. &
Weissberg, R.P. (2000). Social and Emotional Learning: A Framework For
Promoting Mental Health and Reducing Risk Behaviour in Children and Youth.
Journal of School Health, 70 (5), 179-184.

Paivio, A (1971). Imagery and verbal processes. New York: Holt, Rinehart, and
Winston.

Paivio, A. and Begg, I. (1981). Psychology of Language. Englewood Cliffs, NJ:
Prentice-Hall, Inc.

Paivio, A., Mental representations: A dual coding approach. Oxford, England:
Oxford University Press, 1986.

Piccoli, G., Ahmad, R., & Ives, B. (2001). Web-based virtual learning environments: A research framework and a preliminary assessment of effectiveness in basic IT skills training. MIS Quarterly, 25(4), 401-426.

Picard, R. W. (1995). Affective computing.

P. Ekman and W. V. Friesen, “Constants across cultures in the face and emotion,”
Journal of Personality and Social Psychology, vol. 17, pp. 124-129, 1971.

P.Ekman and W.V. Friesen, The Facial Action Coding System: A Technique for The
Measurement of Facial Movement, San Francisco, Consulting Psychologists
Press,1978.

Richardson, A.(1977).“Verbalizer-visualizer: A cognitive style dimension,”Journal of Mental Imagery,1(1),109-126.

Sweller, J. and Chandler, P. (1994). “Why some material is difficult to learn,”
Cognition and Instruction, 12(3), 185-233.

Sweller, J., Van Merrienboer, J.J.G., and Paas, F.G.W.C. (1998). “Cognitive
architecture and instructional design,” Educational Psychology Review, 10(3),
251-297.

Shih, Y.C., Huang, P.R., Hsu, Y.C., & Chen, S.Y. (2012). A complete understanding of disorientation problems in Web-based learning. The Turkish Online Journal of Educational Technology, 11(3), 1-13.

Shugrina, M., Betke, M., & Collomosse, J. (2006). Empathic painting: interactive
stylization through observed emotional state.

Shuzo, M., & Yamada, I. (2010). SHOJI: A communication terminal for sending and
receiving ambient information. Emotional Engineering: Service Development, 21.

Scott A. Schartel, (2012). Giving feedback – An integral part of education, Best Practice & Research Clinical Anaesthesiology, 26(1), 77-87.

Sarsar, Firat (2017). Student and Instructor Responses to Emotional Motivational
Feedback Messages in an Online Instructional Environment, Turkish Online Journal
of Educational Technology, v16, n1, p115-127.

Signe Schack Noesgaard, Rikke Ørngreen, (2015). The Effectiveness of E‑Learning: An Explorative and Integrative Review of the Definitions, Methodologies and Factors that Promote e-Learning Effectiveness, The Electronic Journal of e-Learning, Vol. 13 No. 4

Tsutsui, M. (2004). Multimedia as a means to enhance feedback, Computer
Assisted Language Learning, 17(3-4), 377-402.

Tough, A. (1982). The adult learning projects (2nd Ed.). Ontario: The Ontario Institute for Studies in Education.

Tsetserukou, D., Neviarouskaya, A., Prendinger, H., Ishizuka, M., & Tachi, S. (2010). iFeel_IM: innovative real-time communication system with rich emotional and haptic channels.

Tao-Hua Wang, Hao-Chiang Koong Lin, Hong-Ren Chen, Yueh-Min Huang, Wei-Ting
Yeh, Cheng-Tsung Li (2021). Usability of an Affective Emotional Learning Tutoring System for Mobile Devices, Sustainability, 13, no. 14: 7890.
https://doi.org/10.3390/su13147890

Vasileios Terzis, Christos N.Moridis & Anastasios A.Economides (2012). The effect of emotional feedback on behavioral intention to use computer based assessment. Computers & Education, 59(2), 710-721.

Yu-Chen Liang, Hao-Chiang Koong Lin, Cheng-Tsung Li, (2021). Employing STEAM
6E Teaching Methods to Analyze the Academic Emotions of the Digital Video
Practice Course, International Conference on Innovative Technologies and
Learning, Innovative Technologies and Learning, p584-592.

Yulong Bian, Chenglei Yang, Dongdong Guan, Sa Xiao, Fengqiang Gao, Chia Shen,
Xiangxu Meng, (2016). Effects of Pedagogical Agent's Personality and Emotional
Feedback Strategy on Chinese Students' Learning Experiences and Performance: A
Study Based on Virtual Tai Chi Training Studio, Proceedings of the 2016 Conference on Human Factors in Computing Systems, p433–444.
https://doi.org/10.1145/2858036.2858351

Zhang, D., Zhou, L., Briggs, R. O., & Nunamaker, J. F. (2006). Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information & Management, 43(1), 15-27.

 
 
 
 
第一頁 上一頁 下一頁 最後一頁 top
:::
無相關書籍
 
無相關著作
 
QR Code
QRCODE