메뉴 건너뛰기
.. 내서재 .. 알림
소속 기관/학교 인증
인증하면 논문, 학술자료 등을  무료로 열람할 수 있어요.
한국대학교, 누리자동차, 시립도서관 등 나의 기관을 확인해보세요
(국내 대학 90% 이상 구독 중)
로그인 회원가입 고객센터 ENG
주제분류

추천
검색

논문 기본 정보

자료유형
학술저널
저자정보
Soo-Myoung Bae (Department of Dental Hygiene, College of Dentistry, Research Institute of Dental Hygiene Science, Research Institute of Oral Science, Gangneung-Wonju National University, Gangneung 25457, Ko) Hye-Rim Jeon (Department of Dental Hygiene, College of Dentistry, Gangneung-Wonju National University, Gangneung 25457, Korea) Gyoung-Nam Kim (Department of Dental Hygiene, College of Dentistry, Gangneung-Wonju National University, Gangneung 25457, Korea) Seon-Hui Kwak (Department of Dental Hygiene, College of Dentistry, Research Institute of Dental Hygiene Science, Gangneung-Wonju National University, Gangneung 25457, Korea) Hyo-Jin Lee (Department of Dental Hygiene, College of Dentistry, Research Institute of Dental Hygiene Science, Research Institute of Oral Science, Gangneung-Wonju National University, Gangneung 25457, Ko)
저널정보
한국치위생과학회 치위생과학회지 Journal of Dental Hygiene Science Vol.24 No.1
발행연도
2024.3
수록면
62 - 70 (9page)
DOI
10.17135/jdhs.2024.24.1.62

이용수

표지
📌
연구주제
📖
연구배경
🔬
연구방법
🏆
연구결과
AI에게 요청하기
추천
검색

초록· 키워드

오류제보하기
Background: This study aimed to evaluate ChatGPT’s performance accuracy in responding to questions from the national dental hygienist examination. Moreover, through an analysis of ChatGPT’s incorrect responses, this research intended to pinpoint the predominant types of errors.Methods: To evaluate ChatGPT-3.5’s performance according to the type of national examination questions, the researchers classified 200 questions of the 49th National Dental Hygienist Examination into recall, interpretation, and solving type questions. The researchers strategically modified the questions to counteract potential misunderstandings from implied meanings or technical terminology in Korea. To assess ChatGPT-3.5’s problem-solving capabilities in applying previously acquired knowledge, the questions were first converted to subjective type. If ChatGPT-3.5 generated an incorrect response, an original multiple-choice framework was provided again. Two hundred questions were input into ChatGPT-3.5 and the generated responses were analyzed. After using ChatGPT, the accuracy of each response was evaluated by researchers according to the types of questions, and the types of incorrect responses were categorized (logical, information, and statistical errors). Finally, hallucination was evaluated when ChatGPT provided misleading information by answering something that was not true as if it were true. Results: ChatGPT’s responses to the national examination were 45.5% accurate. Accuracy by question type was 60.3% for recall and 13.0% for problem-solving type questions. The accuracy rate for the subjective solving questions was 13.0%, while the accuracy for the objective questions increased to 43.5%. The most common types of incorrect responses were logical errors 65.1% of all. Of the total 102 incorrectly answered questions, 100 were categorized as hallucinations. Conclusion: ChatGPT-3.5 was found to be limited in its ability to provide evidence-based correct responses to the Korean national dental hygiene examination. Therefore, dental hygienists in the education or clinical fields should be careful to use artificial intelligence-generated materials with a critical view.

목차

등록된 정보가 없습니다.

참고문헌 (0)

참고문헌 신청

함께 읽어보면 좋을 논문

논문 유사도에 따라 DBpia 가 추천하는 논문입니다. 함께 보면 좋을 연관 논문을 확인해보세요!

최근 본 자료

전체보기

댓글(0)

0