國立高雄大學圖資館 |

Assessing ChatGPT 4o Mini's Orthognathic Surgery Knowledge: Comparative Analysis of English and Spanish Responses /

Record Type:	Electronic resources : Monograph/item
Title/Author:	Assessing ChatGPT 4o Mini's Orthognathic Surgery Knowledge: Comparative Analysis of English and Spanish Responses /Charles Moll.
Author:	Moll, Charles,
Description:	1 electronic resource (39 pages)
Notes:	Source: Masters Abstracts International, Volume: 86-12.
Notes:	Advisors: Godoy, Cristina E. Committee members: Morón, Elias; Lin, Chin Yu.
Contained By:	Masters Abstracts International86-12.
Subject:	Dentistry.
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=32044924
ISBN:	9798280736023

Assessing ChatGPT 4o Mini's Orthognathic Surgery Knowledge: Comparative Analysis of English and Spanish Responses /
Moll, Charles,

Assessing ChatGPT 4o Mini's Orthognathic Surgery Knowledge: Comparative Analysis of English and Spanish Responses /Charles Moll. - 1 electronic resource (39 pages)

Source: Masters Abstracts International, Volume: 86-12.

Objectives: The objective of this study was to analyze ChatGPT 4o Mini's answers to the most common questions about orthognathic surgery and evaluate the differences in answers provided based on the language used (English and Spanish). Four orthodontists, two from academic settings and two from private practice settings will evaluate the answers. Each sector will have one English speaker and one Spanish speaker to account for any bias. Background: Artificial intelligence (AI) is being used to aid in answering everyday questions, including questions about orthodontic treatment. ChatGPT has become one of the most commonly used artificial intelligence chatbots with a worldwide consumer base with the capability to provide 80 different languages. There is little literature to evaluate the differences that language has on the answers provided by ChatGPT, especially with respect to orthognathic surgery.Methods: ChatGPT 4o Mini was asked to generate sixty of the most commonly asked questions about orthognathic surgery. Sixty questions were chosen because the desired power of hypothesis is 0.8 with four evaluators; the sample size will be a minimum of thirty-five. Those sixty questions were evaluated by the four graders to remove any repeated or irrelevant questions and reached a total of forty-five questions. The forty-five questions were translated into Spanish and evaluated by the Spanish speaking orthodontists to ensure accuracy. Forty-five commonly asked questions regarding orthognathic surgery were asked to ChatGPT 4o Mini in both English and Spanish. The forty-five questions in English were evaluated by one English speaking orthodontist from an academic background and one English speaking orthodontist from a private practice background. The forty-five questions in Spanish were evaluated by one Spanish speaking orthodontist from an academic background and one Spanish speaking orthodontist from a private practice background. The evaluations were scored independently by each orthodontist. The evaluations were scored using a modified four-point scale: 1: Objectively True, 2: Selected Facts, 3: Minimal Facts, 4: False. The accuracy of the responses were then compared. A joint meeting was held with all evaluators before scoring to establish a common understanding of the grading system. The meeting consisted of an explanation of each scoring scale and the criteria for each score. A pilot was done to make sure the scores were accurately provided. Each evaluator was given an answer to a question regarding orthognathic surgery and scored it using the four-point scale. This pilot was done to ensure the standardization of grading.Results: Forty-five questions were evaluated by the four orthodontists. For the orthodontist assigned to English 1, the grader had a mean of 1.02 ( ± 0.149) with amedian score of 1. For orthodontist assigned to English 2, the grader had a mean of 1.22 ( ± 0.420) with a median score of 1. For orthodontist assigned to Spanish 1, the grader had a mean of 1.22 ( ± 0.420) with a median score of 1. For orthodontist assigned to Spanish 2, the grader had a mean of 1.16 ( ± 0.520) with a median score of 1. The Wilcoxon test found to have statistically significant differences in score between the two English graders with a p-value being a 0.004. The Wilcoxon test found that the answers provided by the two Spanish graders were not statistically significant (p-value > 0.05). When the answers provided by ChatGPT 4o Mini in English were compared to the answers provided by ChatGPT 4o Mini in Spanish, it was found that the answers were not statistically significant (p-value > 0.05). The average grade for the English questions asked to ChatGPT 4o Mini was 1.12 while the average grade for the Spanish questions asked to ChatGPT 4o Mini was 1.19.Conclusions: 1) The answers provided by ChatGPT 4o Mini regarding orthognathic surgery are accurate. 2) There is no statistical difference between the answers provided by Chat GPT 4o Mini for the most common orthognathic surgery questions based on language (English vs Spanish). This suggests that the information provided by ChatGPT 4o Mini regarding orthognathic surgery does not have a major disparity between English and Spanish. 3) There is no statistical difference between the grades provided by Spanish speaking academic orthodontist vs the Spanish speaking private practice orthodontist. 4)There was a statistical difference between the grades provided by the English speaking academic orthodontist vs the English speaking private practice orthodontist.

English

ISBN: 9798280736023Subjects--Topical Terms:

276712
Dentistry.
Subjects--Index Terms:

Orthodontists

Assessing ChatGPT 4o Mini's Orthognathic Surgery Knowledge: Comparative Analysis of English and Spanish Responses /
LDR:06012nmm a22004213i 4500 001 693714
005 20260511063015.5
006 m o d
007 cr|nu||||||||
008 260819s2025 miu||||||m |||||||eng d
020 $a 9798280736023
035 $a (MiAaPQD)AAI32044924
035 $a AAI32044924
040 $a MiAaPQD $b eng $c MiAaPQD $e rda
100 1 $a Moll, Charles, $e author. $3 1010349
245 1 0 $a Assessing ChatGPT 4o Mini's Orthognathic Surgery Knowledge: Comparative Analysis of English and Spanish Responses / $c Charles Moll.
264 1 $a Ann Arbor : $b ProQuest Dissertations & Theses, $c 2025
300 $a 1 electronic resource (39 pages)
336 $a text $b txt $2 rdacontent
337 $a computer $b c $2 rdamedia
338 $a online resource $b cr $2 rdacarrier
500 $a Source: Masters Abstracts International, Volume: 86-12.
500 $a Advisors: Godoy, Cristina E. Committee members: Morón, Elias; Lin, Chin Yu.
502 $b M.S. $c Nova Southeastern University $d 2025.
520 $a Objectives: The objective of this study was to analyze ChatGPT 4o Mini's answers to the most common questions about orthognathic surgery and evaluate the differences in answers provided based on the language used (English and Spanish). Four orthodontists, two from academic settings and two from private practice settings will evaluate the answers. Each sector will have one English speaker and one Spanish speaker to account for any bias. Background: Artificial intelligence (AI) is being used to aid in answering everyday questions, including questions about orthodontic treatment. ChatGPT has become one of the most commonly used artificial intelligence chatbots with a worldwide consumer base with the capability to provide 80 different languages. There is little literature to evaluate the differences that language has on the answers provided by ChatGPT, especially with respect to orthognathic surgery.Methods: ChatGPT 4o Mini was asked to generate sixty of the most commonly asked questions about orthognathic surgery. Sixty questions were chosen because the desired power of hypothesis is 0.8 with four evaluators; the sample size will be a minimum of thirty-five. Those sixty questions were evaluated by the four graders to remove any repeated or irrelevant questions and reached a total of forty-five questions. The forty-five questions were translated into Spanish and evaluated by the Spanish speaking orthodontists to ensure accuracy. Forty-five commonly asked questions regarding orthognathic surgery were asked to ChatGPT 4o Mini in both English and Spanish. The forty-five questions in English were evaluated by one English speaking orthodontist from an academic background and one English speaking orthodontist from a private practice background. The forty-five questions in Spanish were evaluated by one Spanish speaking orthodontist from an academic background and one Spanish speaking orthodontist from a private practice background. The evaluations were scored independently by each orthodontist. The evaluations were scored using a modified four-point scale: 1: Objectively True, 2: Selected Facts, 3: Minimal Facts, 4: False. The accuracy of the responses were then compared. A joint meeting was held with all evaluators before scoring to establish a common understanding of the grading system. The meeting consisted of an explanation of each scoring scale and the criteria for each score. A pilot was done to make sure the scores were accurately provided. Each evaluator was given an answer to a question regarding orthognathic surgery and scored it using the four-point scale. This pilot was done to ensure the standardization of grading.Results: Forty-five questions were evaluated by the four orthodontists. For the orthodontist assigned to English 1, the grader had a mean of 1.02 ( ± 0.149) with amedian score of 1. For orthodontist assigned to English 2, the grader had a mean of 1.22 ( ± 0.420) with a median score of 1. For orthodontist assigned to Spanish 1, the grader had a mean of 1.22 ( ± 0.420) with a median score of 1. For orthodontist assigned to Spanish 2, the grader had a mean of 1.16 ( ± 0.520) with a median score of 1. The Wilcoxon test found to have statistically significant differences in score between the two English graders with a p-value being a 0.004. The Wilcoxon test found that the answers provided by the two Spanish graders were not statistically significant (p-value > 0.05). When the answers provided by ChatGPT 4o Mini in English were compared to the answers provided by ChatGPT 4o Mini in Spanish, it was found that the answers were not statistically significant (p-value > 0.05). The average grade for the English questions asked to ChatGPT 4o Mini was 1.12 while the average grade for the Spanish questions asked to ChatGPT 4o Mini was 1.19.Conclusions: 1) The answers provided by ChatGPT 4o Mini regarding orthognathic surgery are accurate. 2) There is no statistical difference between the answers provided by Chat GPT 4o Mini for the most common orthognathic surgery questions based on language (English vs Spanish). This suggests that the information provided by ChatGPT 4o Mini regarding orthognathic surgery does not have a major disparity between English and Spanish. 3) There is no statistical difference between the grades provided by Spanish speaking academic orthodontist vs the Spanish speaking private practice orthodontist. 4)There was a statistical difference between the grades provided by the English speaking academic orthodontist vs the English speaking private practice orthodontist.
546 $a English
590 $a School code: 1191
650 4 $a Dentistry. $3 276712
650 4 $a Medicine. $3 193819
653 $a Orthodontists
653 $a ChatGPT
653 $a Orthognathic surgery
653 $a Patient questions
690 $a 0567
690 $a 0800
690 $a 0564
710 2 $a Nova Southeastern University. $b Dental Medicine. $e degree granting institution. $3 1010350
720 1 $a Godoy, Cristina E. $e degree supervisor.
773 0 $t Masters Abstracts International $g 86-12.
790 $a 1191
791 $a M.S.
792 $a 2025
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=32044924