:::

詳目顯示

回上一頁
題名:自然語言處理應用於興趣評量:分析策略與操作模型
作者:屠珺楠
作者(外文):TU, JUN-NAN
校院名稱:輔仁大學
系所名稱:心理學系
指導教授:王思峯
學位類別:博士
出版日期:2023
主題關鍵詞:Holland興趣自然語言處理特徵提取機器學習RAM理論Holland interestnatural language processingfeature extractionmachine learningRAM theory
原始連結:連回原系統網址new window
相關次數:
  • 被引用次數被引用次數:期刊(0) 博士論文(0) 專書(0) 專書論文(0)
  • 排除自我引用排除自我引用:0
  • 共同引用共同引用:0
  • 點閱點閱:0
文本圍繞「自然語言處理在興趣評量領域的應用」展開論述,採用「著作彙編」(Thesis by Publication)形式,以三個研究詳細討論分析策略和操作模型。
研究一:本文嘗試通過兩個研究來探索:當遇到數位原住民(即1980年代以後出生且成長在數位環境之中的現代人)之時,興趣評估與詮釋應當有所不同。研究一設計了「興趣事例」與「規律閱讀」兩道訪題,對屬於數位原住民的208位中國大學生進行量表和訪題的調查,並計算興趣量表何倫碼與訪題文本何倫碼之間的剖面相關,以及使用自然語言處理之詞頻分析和主題建模方法進行訪題文本分析。剖面相關的結果顯示,興趣事例訪題與規律閱讀訪題文本與量表的正強相關人數分別是45人(佔22.28%)與49人(佔26.49%)。該結果對應Barclay等人(2012, 2019)的研究,說明使用訪題評估數位原住民的興趣存在一定風險。自然語言處理的分析結果進一步探索了造成評估風險的原因,即(1)各訪題之間的語言特徵存在差異;(2)數位原住民傾向於使用實體興趣來回答興趣事例題,而使用網絡興趣來回答規律閱讀訪題;(3)網絡領域興趣與實體領域興趣的語言特徵存在差異。研究二增加了「學校科目」訪題,並將樣本量擴大到1304位大學生,在使用自然語言處理方法對訪題文本進行分析之後,也復現了研究一的結果。本文認為,對於興趣內涵的詮釋,固然可以使用傳統生涯領域的理論概念(如特質論、建構論等),但教育領域的情境興趣(Hidi & Renninger, 2006)與資訊領域的行為主題(Sendi et al., 2019)等詮釋或許更加貼近數位原住民的學習與生活。
研究二:在後現代思潮影響下,諮商者愈來愈可能採用晤談方法來衡鑑案主的生涯興趣,但興趣衡鑑與量表測量的結果會有差別嗎?在哪些維度差別較大、哪些較小?造成差別的可能來源為何?Barclay與其同儕的研究顯示,興趣衡鑑與量表測量的結果為弱相關、中剖面相關。本研究以208位大學生為樣本進行調查,研究結果亦複現出類似現象:本研究的剖面相關亦為雙峰分布,約四分之一個案在兩種評量方法有高度相似結果,惟整體而言,訪談衡鑑與量表測量的相關係數屬弱相關範疇,A與S維度兩方法亦有顯著相關,E與C亦無顯著相關。除複現Barclay與其同儕的研究外,本研究進一步採用文字分析與內容分析嘗試探索這些差別現象,探索結果一方面支持了Savickas主張的量表測量與晤談衡鑑之評量標的是有所差別的看法,晤談衡鑑的是人們已經外現出興趣,量表測量的則是人們對量表題項清單喜好態度,二者不僅是方法的不同,評量標的也是彼此有異。另一方面,本研究提出差別現象的另一影響來源~一詞多屬性,並指出一詞多屬性在心理學與AI遭逢時的重要性與潛在研究需求。
研究三:AI評量人格已經存在不少文獻,但AI應用於生涯興趣領域的研究尚有空白。本研究收集了來自中國大陸的1257個學生樣本,使用自然語言處理的預訓練模型特徵提取方法,建立了以訪題文本預測Holland興趣的機器學習模型。在比較各種機器學習模型之後,我們分別確認了衡鑑與測量對應的AI基線模型以驗證AI測評的可行性,且在此基線模型之上比較了各種分析策略組合對於評量效果的影響。再者,我們提出了一個基於RAM理論的AI測評操作模型,並評估了自我與他人一致性、他人與他人一致性、行為預測3個核心指標。之後,我們討論了AI評量興趣的4個重要調節變項,即良好的目標、良好的判斷、良好的特質、良好的信息,以及其心理測量學意義。基線模型的研究結果顯示,以訪題文本預測興趣應視為一個線性回歸問題,彈性網絡模型較適合處理此類線性回歸問題。在諸多分析策略組合中,學校科目訪題對應AI模型的表現優於興趣事例題與規律閱讀題,專業工作活動分量表對應AI模型的表現優於課程與校園活動分量表,乾淨文本與訪題文本的餘弦分析策略對於模型具有一定解釋力。在RIASEC六個興趣維度中,R維度的建模效果最佳,其次是I和A維度,S維度表現平平,而C維度表現不佳、E維度表現最差,該結果或許與各維度的信息可見性或社會期望有關。相較於興趣測量及其對應的AI模型,興趣衡鑑及其對應的AI模型表現更佳,即AI更容易學習以他人評估為數值標籤而非以自我報告為數值標籤。本研究還發現,AI模型的評量結果之間呈現出較高的一致性,甚至超過其模仿對象測量與衡鑑的結果一致性,說明以預訓練模型為基礎的人工智慧或許已經具備一定的興趣概念。最後,測量與衡鑑及其對應的AI模型皆能夠較好地命中學生樣本的專業何倫碼,其中衡鑑AI模型的強迫輸入命中率可以達到49.6%;此外,AI評量方法對於衡鑑方法預測生涯效標具有一定的遞增效度。
The paper focuses on "Applying Natural Language Processing on Interest Evaluation" and adopts the form of "Thesis by Publication" to discuss the analysis strategies and operation model in detail with three studies.
Study One: This paper attempts to explore through two studies: when encountering digital natives (i.e. people who were born and raised after the 1980s in a digital environment), the interest assessment and interpretation should be different. In the first study, two interview questions including "interest case" and "regular reading" were designed to conduct research on the scale and interview answer with 208 Chinese college students who are digital natives. The profile correlation between the Holland code of the interest scale and the Holland code of the interview text was calculated, and the word frequency analysis and topic modeling methods of natural language processing were used to analyze the interview text. The results of profile correlation showed that the number of people whose scale interest is positively corelated with examples of interest was 45 (22.28%), while the number of people whose scale interest is positively corelated with regular reading was 49 (26.49%). This result corresponds to the study of Barclay et al. (2012, 2019), which suggests that there are risks in using interviews to assess the interest of digital natives. The analysis results of natural language processing (NLP) further explored the reasons that caused the assessment risk, namely (1) There were differences in language features among the interview text; (2) Digital natives tend to use physical interests to answer the questions on "interest case", and virtual interests to answer the questions of "regular reading"; (3) There are differences between the linguistic features of interests on the internet domain and interests on physical domain. In the second study, "school subject" questions were added and the sample size was expanded to 1304 college students. The results of the first study were replicated after the interview answers were analyzed using natural language processing method. In this paper, it is believed that the interpretation of interest connotation can use the theoretical concepts of traditional career fields (such as trait theory, constructivism, etc.). However, interpretations such as situational interest in education (Hidi & Renninger, 2006) and behavioral themes in information (Sendi et al., 2019) may be more relevant to the learning and living of digital natives.
Study Two: Under the influence of postmodern trends, counselors are increasingly likely to use conversational methods to assess clients' career interests. However, are there differences between interest assessment and scale measurement? Which dimensions have larger differences, and which dimensions have smaller differences? What are the possible causes of these differences? Research by Barclay and her colleagues have shown weak correlations and moderate profile correlations between interest assessment and scale measurement. In this study, a sample of 208 college students was investigated, and similar phenomena were found in the research results. The profile correlations in this study also exhibited a bimodal distribution, with approximately one-fourth of the cases showing highly similar results between the two methods. However, the correlation coefficient between interview assessment and scale measurement was weak. The A and S dimensions showed significant correlations between the two methods, while the E and C dimensions did not exhibit significant correlations. In addition to replicating the research by Barclay and colleagues, this study further employed text analysis and content analysis to explore these differential phenomena. The results partially support Savickas' claim that the two methods are different. Furthermore, another influencing factor, "one word with multiple attributes," is proposed, highlighting its importance and potential research needs in the encountering between psychology and AI. The results of the exploratory analysis support Savickas' claim that there are differences in the appraisal targets between scale measurement and interview assessment. The interview assessment captures the external manifestation of individuals' expressed interests, while the scale measurement measures individuals' preference towards the items of the scale. These differences not only stem from methodological variations but also indicate distinct assessment targets. Furthermore, this study proposes another influencing factor for the differential phenomenon, namely, "one word with multiple attributes," which also highlights the importance and potential research needs of this concept in the encountering of psychology and AI.
Study Three: There has been a lot of literature on AI evaluation of personality, but there is still a gap in the application of AI to career interests. In this study, 1257 student samples from mainland China were collected, and a machine learning model was established to predict Holland's interested personality by using the pre-trained model feature extraction method of natural language processing. After comparing various machine learning models, we separately confirmed the AI baseline models corresponding to the assessment and measurement to verify the feasibility of AI evaluation, and compared the influence of various combinations of analysis strategies on the evaluation effect on top of the baseline models. Furthermore, we propose an AI evaluation operation model based on RAM theory, and evaluate three core indicators: self-others consistency, others-others consistency, and behavior prediction. After that, we discuss four important moderating variables of the interest personality evaluated by AI, namely good goals, good judgment, good traits, good information, and their psychometric significance. The results of the baseline model show that the prediction of interest personality based on question text should be regarded as a linear regression issue, and the elastic network model is more suitable to deal with this kind of linear regression issue. Among many combinations of analysis strategies, the AI model corresponding to “school subject” interview questions performs better than the “interest example” questions and “interest reading” questions; the AI model corresponding to “professional work activity” subscale performs better than “curriculum and campus activity” subscale; the cosine analysis strategy of clean text and interview answer texts can justify to a certain extent for the model. Among the six RIASEC dimensions of interest, the modeling effect of R dimension is the best, followed by I and A dimension, S dimension is mediocre, C dimension is poor, and E dimension is the worst, which may be related to the information visibility or social expectations of each dimension. Compared to the interest measure and its AI model, the interest assessment and its AI model perform better. That is, it is easier for the AI to learn to use other people's assessment as a numerical label rather than self-report as a numerical label. This study also found that the evaluation results of the AI model showed a high consistency, even more than the consistency of the results of measurement and assessment of its imitation object, indicating that the AI based on the pre-training model may have a certain concept of interest personality. Finally, both the measurement and assessment model and their corresponding AI models can hit the professional Holland code of the student sample well, and the forced input hit rate of assessment AI model can reach 49.6%. In addition, the AI evaluation method has a certain degree of incremental validity for the assessment method to predict the career criterion.
參考文獻

論文綜述參考文獻

周倩(2022):〈著作彙編之學位論文:定義、規範與相關議題〉。《教育資料與圖書館學》,59(1):73-96。[Chien Chou. (2022). Thesis by Publication: Definition, Regulations and Issues for Consideration. Journal of Educational Media & Library Sciences, 59(1): 73-96.] https://doi.org/10.6120/JoEMLS.202203_59(1).0037.OR.BM
區雅倫、翁儷禎、李庚霖(2012):〈台灣高中生的生涯興趣結構分析—以大考中心興趣量表為例〉。《教育心理學報》,44(1),117-138。[Ou, Y.-L., Weng, L.-J., Lee, K.-L. (2012). The Structure of Vocational Interests of Taiwanese High School Students - The Case of the College Entrance Examination Center Interest Inventory. Bulletin of Educational Psychology, 44(1), 117-138] https://doi.org/10.6251/BEP.20110815.1
顧雪英、王思峯(2016)。CCI複合量表指導手冊。未出版技術報告。
Bleidorn, W., & Hopwood, C. J. (2019). Using machine learning to advance personality assessment and theory. Personality and Social Psychology Review, 23, 190–203. https://doi.org/10.1177/1088868318772990
Borsboom, D., Mellenbergh, G. J., & Van Heerden, J. (2004). The concept of validity. Psychological review, 111(4), 1061. https://doi.org/10.1037/0033-295X.111.4.1061
Brunswik, E. (1956). Perception and the representative design of psychological experiments. Univ of California Press.
Connelly, B. S., & Ones, D. S. (2010). An other perspective on personality: Meta-analytic integration of observers’ accuracy and predictive validity. Psychological Bulletin, 136(6), 1092–1122. https://doi.org/10.1037/a0021212
Dahlke, J. A., & Putka, D. J. (2021). Streamlining the Identification of Emerging Tasks in the O* NET System Using Natural Language Processing (NLP): Technical Summary. Human Resources Research Organization (HumRRO).
Fan, J., Sun, T., Liu, J., Zhao, T., Zhang, B., Chen, Z., Glorioso, M., & Hack, E. (2023). How Well Can an AI Chatbot Infer Personality? Examining Psychometric Properties of Machine-Inferred Personality Scores. Journal of Applied Psychology. Advance online publication. https://dx.doi.org/10.1037/apl0001082
Funder, D. C. (1995). On the accuracy of personality judgment: A realistic approach. Psychological Review, 102(4), 652–670. https://doi.org/10.1037/0033-295X.102.4.652
Funder, D. C. (2012). Accurate Personality Judgment. Current Directions in Psychological Science, 21(3), 177–182. https://doi.org/10.1177/0963721412445309
Hickman, L., Bosch, N., Ng, V., Saef, R., Tay, L., & Woo, S. E. (2022). Automated video interview personality assessments: Reliability, validity, and generalizability investigations. Journal of Applied Psychology, 107(8), 1323. https://doi.org/10.1037/apl0000695
Holland, J. L. (1997). Making vocational choices: A theory of vocational personalities and work environments (3rd ed.). Odessa, FL: Psychology Assessment Resources.
Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3, 635–694. https://doi.org/10.2466/pr0.1957.3.3.635
Park, G., Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Kosinski, M., Stillwell, D. J., Ungar, L. H., & Seligman, M. E. (2015). Automatic personality assessment through social media language. Journal of Personality and Social Psychology, 108, 934–952. https://doi.org/10.1037/pspp0000020
Savickas, M. L. (2013). Career construction theory and practice. In R. W. Lent & S. D. Brown (Eds.), Career development and counseling: Putting theory and research to work (pp. 147-183). (2nd ed.). Wiley.
Savickas, M. L. (2019). Career counseling (2nd ed.). Washington, DC: American Psychological Association Press. https://doi.org/10.1037/0000105-000
Super, D. E. (1957). The psychology of careers. Harper & Row.

研究一參考文獻

學職平台(2016年):職業興趣評測。全國大學生學業與職業發展平臺。 https://xz.chsi.com.cn/cp/xq/start.do?from=xzpt
盧怡任、王思峰、劉淑慧、張詒婷、吳佩瑜、陳瑞舲(2013):〈CCN職業興趣量表:鑲嵌在生涯資訊與輔導係統中的線上施測與解釋係統〉。《臺灣心理谘商季刊》,5(1),1-16。[Lu, Y.-J., Wang, S.-F., Liu, S.-H., Chang, Y.-T., Wu, P.-Y., Chen, J.-L. (2013). CCN Interest Inventory: An online system of administration and interpretation wit hin career information and guidance cyber system. Taiwan Counseling Quarterly, 5(1), 1-16.]
Adler, J. M., Dunlop, W. L., Fivush, R., Lilgendahl, J. P., Lodi-Smith, J., McAdams, D. P., McLean, K. C., Pasupathi, M., & Syed, M. (2017). Research methods for studying narrative identity: A primer. Social Psychological and Personality Science, 8(5), 519–527. https://doi.org/10.1177/1948550617698202
Allport, G. W. (1937). Personality: A psychological interpretation. Oxford, England: Holt.
Barclay, S. R., & Wolff, L. A. (2012). Exploring the career construction interview for vocational personality assessment. Journal of Vocational Behavior, 81(3), 370-377. https://doi.org/10.1016/j.jvb.2012.09.004
Barclay, S. R., Stoltz, K. B., & Clemente, A. (2019). Assessing manifest interests within the career construction interview. International Journal for Educational and Vocational Guidance, 19(3), 455-473. https://doi.org/10.1007/s10775-019-09388-1
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research, 3(Jan), 993-1022. https://doi.org/10.5555/944919.944937
Cheng, Y., Qiu, G., Bu, J., Liu, K., Han, Y., Wang, C., & Chen, C. (2008, April 21). Model bloggers' interests based on forgetting mechanism [symposium presentation]. In Proceedings of the 17th international conference on World Wide Web (pp. 1129-1130). https://doi.org/10.1145/1367497.1367690
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Mahwah, NJ: Erlbaum.
Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
Dindar, M., & Akbulut, Y. (2016). Effects of multitasking on retention and topic interest. Learning and Instruction, 41, 94-105. https://doi.org/10.1016/j.learninstruc.2015.10.005
Dohn, N. B., & Dohn, N. B. (2017). Integrating Facebook in upper secondary biology instruction: a case study of students’ situational interest and participation in learning communication. Research in Science Education, 47(6), 1305-1329. https://doi.org/10.1007/s11165-016-9549-3
Fertuck, E. A., Mergenthaler, E., Target, M., Levy, K. N. , Clarkin, J. F. (2012). Development and criterion validity of a computerized text analysis measure of reflective functioning. Psychotherapy Research, 22(3), 298–305. https://doi.org/10.1080/10503307.2011.650654
Graneheim, U. H., & Lundman, B. (2004). Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Education Today, 24(2), 105–112. https://doi.org/10.1016/J.NEDT.2003.10.001
Gysbers, N. C., Heppner M. J., Johnston, J. A. (2014). Career Counseling: Holism, Diversity, and Strengths (4th ed.). American Counseling Association
Hanson, C. L. (1995). The objectivity of personality and career assessment using the career style interview. Dissertation Abstracts International: Section B. The Sciences and, Engineering, 56(6-B), 3494.
Hasan, M., Rahman, A., Karim, M., Khan, M., Islam, S., & Islam, M. (2021). Normalized approach to find optimal number of topics in Latent Dirichlet Allocation (LDA). In P. Singh, R. K. Gupta, K. Ray, A. Bandyopadhyay (Eds.), Proceedings of International Conference on Trends in Computational and Cognitive Engineering (pp. 341-354). Springer, Singapore.
Hidi, S., & Baird, W. (1986). Interestingness: A neglected variable in discourse processing. Cognitive Science, 10, 179-194. https://doi.org/10.1016/S0364-0213(86)80003-9
Hidi, S. (1990). Interest and its contribution as a mental resource for learning. Review of Educational Research, 60, 549–571. https://doi.org/10.3102/00346543060004549
Hidi, S., & Renninger, K. A. (2006). The four-phase model of interest development. Educational Psychologist, 41, 111-127. https://doi.org/10.1207/s15326985ep4102_4
Holland, J. L. (1997). Making vocational choices: A theory of vocational personalities and work environments (3rd ed.). Odessa, FL: Psychology Assessment Resources.
Hutchinson, T. P. (2000). Measuring the agreement of several three-letter Holland codes for one person. Journal of Employment Counseling, 37, 160–162. https://doi.org/10.1002/j.2161-1920.2000.tb00481.x
Ito, M., Horst, H. A., Bittanti, M., Stephenson, B. H., Lange, P. G., Pascoe, C. J., & Martínez, K. Z. (2009). Living and learning with new media: Summary of findings from the digital youth project. Cambridge, MA: MIT Press.
Judge, T. and Zapata, C. (2015). The person-situation debate revisited: effect of situation strength and trait activation on the validity of the big five personality traits in predicting job performance. Academy of Management Journal, 58(4), 1149-1179. https://doi.org/10.5465/amj.2010.0837
Krapp, A., Hidi, S., & Renninger, K. A. (1992). Interest, learning and development. In K.A. Renninger, S. Hidi, & A. Krapp (Eds.), The role of interest in learning and development (pp. 3–25). Hillsdale, NJ: Erlbaum.
Kruskopf, M., Hakkarainen, K., Li, S., & Lonka, K. (2021). Lessons learned on student engagement from the nature of pervasive socio‐digital interests and related network participation of adolescents. Journal of Computer Assisted Learning, 37(2), 521-541. https://doi.org/10.1111/jcal.12506
Liu, C. C., Liao, M. G., Chang, C. H., & Lin, H. M. (2022). An analysis of children’ interaction with an AI chatbot and its impact on their interest in reading. Computers & Education, 189, 104576. https://doi.org/10.1016/j.compedu.2022.104576
Lu, X. (2014). Computational methods for corpus annotation and analysis. Springer. https://doi.org/10.1007/978-94-017-8645-4
McAdams, D. P. (2008). The life story interview. Evanston, IL: The Foley Center for the Study of Lives, Northwestern University. Retrieved from http://www.sesp.northwestern.edu/ foley/instruments/interview/
Palmer, D. H. (2009). Student interest generated during an inquiry skills lesson. Journal of Research in Science Teaching, 46(2), 147–165. https://doi.org/10.1002/tea.20263
Park, G., Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Kosinski, M., Stillwell, D. J., ... & Seligman, M. E. (2015). Automatic personality assessment through social media language. Journal of Personality and Social Psychology, 108(6), 934. https://doi.org/10.1037/pspp0000020
Peels, R. (2019). Replicability and replication in the humanities. Research Integrity and Peer Review, 4(1), 1-12. https://doi.org/10.1186/s41073-018-0060-4
Prediger, D., Swaney, K., & Mau, W. C. (1993). Extending Holland's hexagon: Procedures, counseling applications, and research. Journal of Counseling and Development, 71, 422–428. https://doi.org/10.1002/j.1556-6676.1993.tb02659.x
Prensky, M. (2005). Listen to the natives. Educational Leadership, 63(4), 8-13.
Renner, K. H., Klee, S., & von Oertzen, T. (2020). Bringing Back the Person into Behavioural Personality Science Using Big Data. European Journal of Personality, 34(5), 670-686. https://doi.org/10.1002/per.2303
Renninger, K. A., & Hidi, S. (2011). Revisiting the conceptualization, measurement, and generation of interest. Educational Psychologist, 46(3), 168–184. https://doi.org/10.1080/00461520.2011.587723
Savickas, M. L. (1989). Career-style assessment and counseling. In T. J. Sweeney (Ed.), Adlerian counseling: A practitioner approach for a new decade (pp. 289–320). (3rd ed.). Muncie, IN: Accelerated Development.
Savickas, M. L. (1998). Career-style assessment and counseling. In T. J. Sweeney (Ed.), Adlerian counseling: A practitioner's approach (pp. 329–359). (4th ed.). Bristol, PA: Accelerated Development.
Savickas, M. L. (2009). Career style counseling. In T. J. Sweeney (Ed.), Adlerian counseling: A practitioner's approach (pp. 183–207). (5th ed.). New York, NY: Routledge.
Savickas, M. L. (2011). Career counseling. Washington, DC: American Psychological Association.
Savickas, M. L. (2013). Career construction theory and practice. In R. W. Lent & S. D. Brown (Eds.), Career development and counseling: Putting theory and research to work (pp. 147–183). (2nd ed.). Hoboken, NJ: Wiley.
Schraw, G., & Lehman, S. (2001). Situational interest: A review of the literature and directions for future research. Educational Psychology Review, 13, 23–52. https://doi.org/10.1023/A:1009004801455
Sendi, M., Omri, M. N., & Abed, M. (2019). Discovery and tracking of temporal topics of interest based on belief-function and aging theories. Journal of Ambient Intelligence and Humanized Computing, 10(9), 3409-3425. https://doi.org/10.1007/s12652-018-1050-6
Super, D. E. (1990). In D. Brown, L. Brooks, and Associates, Career Choice and Development: Applying Contemporary Theories to Practice (pp.200). (2nd ed.). San Francisco, Estados Unidos: Jossey Bass.
Syed, M., & Nelson, S. C. (2015). Guidelines for establishing reliability when coding narrative data. Emerging Adulthood, 3(6), 375-387. https://doi.org/10.1177/2167696815587648
TalebiFard, P., & Leung, V. (2014). Context-aware dissemination of information and services in heterogeneous network environments. Journal of Ambient Intelligence and Humanized Computing, 5(6), 775-787. https://doi.org/10.1007/s12652-013-0210-y
Vajjala, S., Majumder, B., Gupta, A., & Surana, H. (2020). Practical natural language processing: a comprehensive guide to building real-world NLP systems. O'Reilly Media.

研究二參考文獻

車萬翔、郭江、崔一鳴 (2022):《全中文自然語言處理:Pre-Trained Model方法最新實戰》。深智數位。[Che, W.-X., Guo, J., Cui, Y.-M. (2022). Total Chinese Natural Language processing: The Pre-Trained Model in Practice. Deep Mind.]
盧怡任、王思峰、劉淑慧、張詒婷、吳佩瑜、陳瑞舲(2013):〈CCN職業興趣量表:鑲嵌在生涯資訊與輔導係統中的線上施測與解釋係統〉。《臺灣心理諮商季刊》,5(1),1-16。[Lu, Y.-J., Wang, S.-F., Liu, S.-H., Chang, Y.-T., Wu, P.-Y., Chen, J.-L. (2013). CCN Interest Inventory: An online system of administration and interpretation within career information and guidance cyber system. Taiwan Counseling Quarterly, 5(1), 1-16.]
Adler, J. M., Dunlop, W. L., Fivush, R., Lilgendahl, J. P., Lodi-Smith, J., McAdams, D. P., McLean, K. C., Pasupathi, M., & Syed, M. (2017). Research methods for studying narrative identity: A primer. Social Psychological and Personality Science, 8(5), 519-527. https://doi.org/10.1177/1948550617698202
Barclay, S. R., & Wolff, L. A. (2012). Exploring the career construction interview for vocational personality assessment. Journal of Vocational Behavior, 81(3), 370-377. https://doi.org/10.1016/j.jvb.2012.09.004
Barclay, S. R., Stoltz, K. B., & Clemente, A. (2019). Assessing manifest interests within the career construction interview. International Journal for Educational and Vocational Guidance, 19(3), 455-473. https://doi.org/10.1007/s10775-019-09388-1
Downe-Wambolt, B. (1992). Content analysis: Method, applications and issues. Health Care for Women International, 13(3), 313-321. https://doi.org/10.1080/07399339209516006
Fertuck, E. A., Mergenthaler, E., Target, M., Levy, K. N. , Clarkin, J. F. (2012). Development and criterion validity of a computerized text analysis measure of reflective functioning. Psychotherapy Research, 22(3), 298-305. https://doi.org/10.1080/10503307.2011.650654
Graneheim, U. H., & Lundman, B. (2004). Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Education Today, 24(2), 105-112. https://doi.org/10.1016/J.NEDT.2003.10.001
Gysbers, N. C., Heppner M. J., Johnston, J. A. (2014). Career counseling: Holism, diversity, and strengths (4th ed.). American Counseling Association.
Holland, J. L. (1997). Making vocational choices: A theory of vocational personalities and work environments (3rd ed.). Psychology Assessment Resources.
McAdams, D. P. (2008). The life story interview. Evanston, IL: The Foley Center for the Study of Lives, Northwestern University. http://www.sesp.northwestern.edu/ foley/instruments/interview/
Prediger, D., Swaney, K., & Mau, W. C. (1993). Extending Holland's hexagon: Procedures, counseling applications, and research. Journal of Counseling and Development, 71(4), 422-428. https://doi.org/10.1002/j.1556-6676.1993.tb02659.x
Savickas, M. L. (1989). Career-style assessment and counseling. In T. J. Sweeney (Ed.), Adlerian counseling: A practitioner approach for a new decade (pp. 289-320). (3rd ed.). Accelerated Development.
Savickas, M. L. (2013). Career construction theory and practice. In R. W. Lent & S. D. Brown (Eds.), Career development and counseling: Putting theory and research to work (pp. 147-183). (2nd ed.). Wiley.
Savickas, M. L. (2019). Career counseling (2nd ed.). Washington, DC: American Psychological Association Press. https://doi.org/10.1037/0000105-000
Savickas, M. L., Taber, B. J., & Spokane, A. R. (2002). Convergent and discriminant validity of five interest inventories. Journal of Vocational Behavior, 61(1), 139-184, http://dx.doi.org/10.1006/jvbe.2002.1878
Schwartz H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., & Ungar, L. H. (2013) Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach. PLoS ONE, 8(9): e73791. https://doi.org/10.1371/journal.pone.0073791
Speer, A. B., Perrotta, J., Tenbrink, A. P., Wegmeyer, L. J., Delacruz, A. Y., & Bowker, J. (2022). Turning words into numbers: Assessing work attitudes using natural language processing. Journal of Applied Psychology. Advance online publication. https://doi.org/10.1037/apl0001061
Speer, A. B., Schwendeman, M., Reich, C. C., Tenbrink, A. P., & Siver, S. R. (2019). Investigating the construct validity of performance comments: Creation of the great eight narrative dictionary. Journal of Business and Psychology, 34(6), 747-767. https://doi.org/10.1007/s10869-018-9599-9
Super, D. E. (1957). The psychology of careers. Harper & Row.
Syed, M., & Nelson, S. C. (2015). Guidelines for establishing reliability when coding narrative data. Emerging Adulthood, 3(6), 375-387. https://doi.org/10.1177/2167696815587648
Tausczik, Y. R., & Pennebaker, J. W. (2010). The psychological meaning of words: LIWC and computerized text analysis methods. Journal of Language and Social Psychology, 29(1), 24-54. https://doi.org/10.1177/0261927X09351676
Vajjala, S., Majumder, B., Gupta, A., & Surana, H. (2020). Practical natural language processing: a comprehensive guide to building real-world NLP systems. O'Reilly Media.


研究三參考文獻

李仁豪、余民寧(2016):〈心理幸福感量表簡式中文版信效度及測量不變性: 以大學生為樣本並兼論測量不變性議題〉。《中華輔導與諮商學報》,46,127-154。[Li, R.-H., Yu, M.-N. (2016). Reliability, Validity, and Measurement Invariance of the Brief Chinese Version of Psychological Well-Being Scale among College Students. Chinese Journal of Guidance and Counseling, 46, 127-154.] https://doi.org/10.7082/CJGC
車萬翔、郭江、崔一鳴(2021簡/2022正):《全中文自然語言處理:Pre-Trained Model方法最新實戰》。深智數位。[Che, W.-X., Guo, J., Cui, Y.-M. (2021/2022). All Chinese natural Language processing: The Pre-Trained Model in practice. Deep Mind.]
區雅倫、翁儷禎、李庚霖(2012):〈台灣高中生的生涯興趣結構分析—以大考中心興趣量表為例〉。《教育心理學報》,44(1),117-138。[Ou, Y.-L., Weng, L.-J., Lee, K.-L. (2012). The Structure of Vocational Interests of Taiwanese High School Students - The Case of the College Entrance Examination Center Interest Inventory. Bulletin of Educational Psychology, 44(1), 117-138] https://doi.org/10.6251/BEP.20110815.1
黃柏僩(2022年12月):應用深度學習語言模型於偵測安心專線中自殺訊息之研究。公共化 AI 心理學門推廣工作坊講義,清華大學人文社會AI應用與發展研究中心。
學職平台(2016):職業興趣評測。全國大學生學業與職業發展平臺。 https://xz.chsi.com.cn/cp/xq/start.do?from=xzpt
簡茂發、林一真、陳清平、劉澄桂、區雅倫、舒琮慧(2007):《大學入學考試中心興趣量表使用手冊》。台北:大學入學考試中心。[Jian, M.-F., Lin, Y.-Z., Chen, Q.-P., Liu, C.-G., Ou, Y.-L., Shu, Z.-H. (2007). College Entrance Examination Center Interest Scale User Manual. Taipei: College Entrance Examination Center]
顧雪英、王思峯(2016)。CCI複合量表指導手冊。未出版技術報告。
Ackerman, P. L., Chamorro‐Premuzic, T., & Furnham, A. (2011). Trait complexes and academic achievement: Old and new ways of examining personality in educational contexts. British Journal of Educational Psychology, 81(1), 27-40. https://doi.org/10.1348/000709910X522564
Ackerman, P. L., Kanfer, R., & Beier, M. E. (2013). Trait complex, cognitive ability, and domain knowledge predictors of baccalaureate success, STEM persistence, and gender differences. Journal of Educational Psychology, 105(3), 911. https://doi.org/10.1037/a0032338
Ameisen, E. (2018). Always start with a stupid model, no exceptions. Insight. Avail. https://blog.insightdatascience.com/always-start-with-a-stupid-model-no-exceptions-3a22314b9aaa
Barclay, S. R., & Wolff, L. A. (2012). Exploring the career construction interview for vocational personality assessment. Journal of Vocational Behavior, 81(3), 370-377. https://doi.org/10.1016/j.jvb.2012.09.004
Barclay, S. R., Stoltz, K. B., & Clemente, A. (2019). Assessing manifest interests within the career construction interview. International Journal for Educational and Vocational Guidance, 19(3), 455-473. https://doi.org/10.1007/s10775-019-09388-1
Bleidorn, W., & Hopwood, C. J. (2019). Using machine learning to advance personality assessment and theory. Personality and Social Psychology Review, 23, 190–203. https://doi.org/10.1177/1088868318772990
Borsboom, D., Mellenbergh, G. J., & Van Heerden, J. (2004). The concept of validity. Psychological review, 111(4), 1061. https://doi.org/10.1037/0033-295X.111.4.1061
Brunswik, E. (1956). Perception and the representative design of psychological experiments. Univ of California Press.
Campion, M. C., Campion, M. A., Campion, E. D., & Reider, M. H. (2016). Initial investigation into computer scoring of candidate essays for personnel selection. Journal of Applied Psychology, 101(7), 958. https://doi.org/10.1037/apl0000108
Cer, D., Yang, Y., Kong, S.-Y., Hua, N., Limtiaco, N., John, R., Constant, N., Guajardo-Cespedes, M., Yuan, S., Tar, C., Sung, Y.-H., Strope, B., & Kurzweil, R. (2018). Universal sentence encoder. ArXiv. https://arxiv.org/abs/1803.11175
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Mahwah, NJ: Erlbaum.
Connelly, B. S., & Ones, D. S. (2010). An other perspective on personality: Meta-analytic integration of observers’ accuracy and predictive validity. Psychological Bulletin, 136(6), 1092–1122. https://doi.org/10.1037/a0021212
Dahlke, J. A., & Putka, D. J. (2021). Streamlining the Identification of Emerging Tasks in the O* NET System Using Natural Language Processing (NLP): Technical Summary. Human Resources Research Organization (HumRRO).
De Fruyt, F., & Mervielde, I. (1997). The five-factor model of personality and Holland's RIASEC interest types. Personality and individual differences, 23(1), 87-103. https://doi.org/10.1016/S0191-8869(97)00004-4
Downe-Wambolt, B. (1992). Content analysis: Method, applications and issues. Health Care for Women International, 13(3), 313-321. https://doi.org/10.1080/07399339209516006
Fan, J., Sun, T., Liu, J., Zhao, T., Zhang, B., Chen, Z., Glorioso, M., & Hack, E. (2023). How Well Can an AI Chatbot Infer Personality? Examining Psychometric Properties of Machine-Inferred Personality Scores. Journal of Applied Psychology. Advance online publication. https://dx.doi.org/10.1037/apl0001082
Feng, F., Yang, Y., Cer, D., Arivazhagan, N., & Wang, W. (2020). Language-agnostic bert sentence embedding. arXiv preprint arXiv:2007.01852. https://doi.org/10.48550/arXiv.2007.01852
Funder, D. C. (1995). On the accuracy of personality judgment: A realistic approach. Psychological Review, 102(4), 652–670. https://doi.org/10.1037/0033-295X.102.4.652
Funder, D. C. (2012). Accurate Personality Judgment. Current Directions in Psychological Science, 21(3), 177–182. https://doi.org/10.1177/0963721412445309
Fyffe, S., Lee, P., & Kaplan, S. (2023). “Transforming” Personality Scale Development: Illustrating the Potential of State-of-the-Art Natural Language Processing. Organizational Research Methods, 0(0), 1-36. https://doi.org/10.1177/10944281231155771
Graneheim, U. H., & Lundman, B. (2004). Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Education Today, 24(2), 105-112. https://doi.org/10.1016/J.NEDT.2003.10.001
Gysbers, N. C., Heppner M. J., Johnston, J. A. (2014). Career counseling: Holism, diversity, and strengths (4th ed.). American Counseling Association.
Handelman, G. S., Kok, H. K., Chandra, R. V., Razavi, A. H., Huang, S., Brooks, M., ... & Asadi, H. (2019). Peering into the black box of artificial intelligence: evaluation metrics of machine learning methods. American Journal of Roentgenology, 212(1), 38-43. https://doi.org/10.2214/AJR.18.20224
Hanna, A., & Rounds, J. (2020). How accurate are interest inventories? A quantitative review of career choice hit rates. Psychological bulletin, 146(9), 765–796. https://doi.org/10.1037/bul0000269
Harrison, J. S., Thurgood, G. R., Boivie, S., & Pfarrer, M. D. (2019). Measuring CEO personality: Developing, validating, and testing a linguistic tool. Strategic Management Journal, 40, 1316–1330. https://doi.org/10.1002/smj.3023
Hickman, L., Bosch, N., Ng, V., Saef, R., Tay, L., & Woo, S. E. (2022). Automated video interview personality assessments: Reliability, validity, and generalizability investigations. Journal of Applied Psychology, 107(8), 1323. https://doi.org/10.1037/apl0000695
Hickman, L., Herde, C. N., Lievens, F., & Tay, L. (2023). Automatic scoring of speeded interpersonal assessment center exercises via machine learning: Initial psychometric evidence and practical guidelines. International Journal of Selection and Assessment, 1-15. https://doi.org/10.1111/ijsa.12418
Hidi, S., & Renninger, K. A. (2006). The four-phase model of interest development. Educational Psychologist, 41, 111-127. https://doi.org/10.1207/s15326985ep4102_4
Holland, J. L. (1997). Making vocational choices: A theory of vocational personalities and work environments (3rd ed.). Odessa, FL: Psychology Assessment Resources.
Hou, Z. J., Leung, S. A., Li, X., Li, X., & Xu, H. (2012). Career adaptabilities scale—China form: Construction and initial validation. Journal of Vocational Behavior, 80, 686–691. https://doi.org/10.1016/j.jvb.2012.01.006
Iachan, R. (1984). A measure of agreement for use with the Holland classification system. Journal of Vocational Behavior, 24(2), 133-141. https://doi.org/10.1016/0001-8791(84)90001-0
Landers, R. N., Auer, E. M., Dunk, L., Langer, M., & Tran, K. N. (2023). A simulation of the impacts of machine learning to combine psychometric employee selection system predictors on performance prediction, adverse impact, and number of dropped predictors. Personnel Psychology, 1–24. https://doi.org/10.1111/peps.12587
Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3, 635–694. https://doi.org/10.2466/pr0.1957.3.3.635
Mori, K., & Haruno, M. (2021). Differential ability of network and natural language information on social media to predict interpersonal and mental health traits. Journal of personality, 89(2), 228-243. https://doi.org/10.1111/jopy.12578
Park, G., Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Kosinski, M., Stillwell, D. J., Ungar, L. H., & Seligman, M. E. (2015). Automatic personality assessment through social media language. Journal of Personality and Social Psychology, 108, 934–952. https://doi.org/10.1037/pspp0000020
Prediger, D., Swaney, K., & Mau, W. C. (1993). Extending Holland's hexagon: Procedures, counseling applications, and research. Journal of Counseling and Development, 71, 422–428. https://doi.org/10.1002/j.1556-6676.1993.tb02659.x
Putka, D. J., Beatty, A. S., & Reeder, M. C. (2018). Modern prediction methods: New perspectives on a common problem. Organizational Research Methods, 21(3), 689-732. https://doi.org/10.1177/1094428117697041
Rahhal, I., Carley, K. M., Kassou, I., & Ghogho, M. (2023). Two Stage Job Title Identification System for Online Job Advertisements. IEEE Access, 11, 19073-19092. https://doi.org/10.1109/ACCESS.2023.3247866
Reimers, N., & Gurevych, I. (2019). Sentence-BERT: Sentence embeddings using Siamese BERT-networks. ArXiv:1908.10084 [Cs]. http://arxiv.org/abs/1908.10084
Savickas, M. L. (1989). Career-style assessment and counseling. In T. J. Sweeney (Ed.), Adlerian counseling: A practitioner approach for a new decade (pp. 289–320). (3rd ed.). Muncie, IN: Accelerated Development.
Savickas, M. L. (2013). Career construction theory and practice. In R. W. Lent & S. D. Brown (Eds.), Career development and counseling: Putting theory and research to work (pp. 147-183). (2nd ed.). Wiley.
Savickas, M. L. (2019). Career counseling (2nd ed.). Washington, DC: American Psychological Association Press. https://doi.org/10.1037/0000105-000
Sharma, S., Sharma, S., & Athaiya, A. (2020). Activation functions in neural networks. International Journal of Engineering Applied Sciences and Technology, 6(12), 310-316. https://doi.org/10.33564/IJEAST.2020.v04i12.054
Sodano, S. M. (2015). Meaning, measurement, and assessment of vocational interests for career intervention. In APA handbook of career intervention, Volume 1: Foundations. (pp. 281-301). American Psychological Association.
Speer, A. B., Schwendeman, M., Reich, C. C., Tenbrink, A. P., & Siver, S. R. (2019). Investigating the construct validity of performance comments: Creation of the great eight narrative dictionary. Journal of Business and Psychology, 34(6), 747-767. https://doi.org/10.1007/s10869-018-9599-9
Speer, A. B., Perrotta, J., Tenbrink, A. P., Wegmeyer, L. J., Delacruz, A. Y., & Bowker, J. (2022). Turning Words Into Numbers: Assessing Work Attitudes Using Natural Language Processing. Journal of Applied Psychology. Advance online publication. https://dx.doi.org/10.1037/apl0001061
Syed, M., & Nelson, S. C. (2015). Guidelines for establishing reliability when coding narrative data. Emerging Adulthood, 3(6), 375-387. https://doi.org/10.1177/2167696815587648
Tay, L., Woo, S. E., Hickman, L., & Saef, R. M. (2020). Psychometric and validity issues in machine learning approaches to personality assessment: A focus on social media text mining. European Journal of Personality, 34(5). https://doi.org/10.1002/per.2290
Tian, X., Pavur, R., Han, H. and Zhang, L. (2023), "A machine learning-based human resources recruitment system for business process management: using LSA, BERT and SVM", Business Process Management Journal, Vol. 29 No. 1, pp. 202-222. https://doi.org/10.1108/BPMJ-08-2022-0389
Woods, S. A., Ahmed, S., Nikolaou, I., Costa, A. C., & Anderson, N. R. (2020). Personnel selection in the digital age: A review of validity and applicant reactions, and future research challenges. European Journal of Work and Organizational Psychology, 29(1), 64-77. https://doi.org/10.1080/1359432X.2019.1681401
Zou, H., & Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society. Series B, Statistical Methodology, 67, 301–320. https://doi.org/10.1111/j.1467-9868.2005.00503.x
 
 
 
 
第一頁 上一頁 下一頁 最後一頁 top