Evaluating the performance of ChatGPT in preventive and social medicine in medical university examination

Sivapriya K. R. Sundararajan; Prakash Boralingiah; Krishna Mohan Surapaneni

doi:10.18203/2394-6040.ijcmph20234149

Authors

Sivapriya K. R. Sundararajan Department of Community Medicine, Panimalar Medical College and Research Institute, Varadharajapuram, Poonamallee, Chennai, Tamil Nadu, India
Prakash Boralingiah Department of Community Medicine, Panimalar Medical College and Research Institute, Varadharajapuram, Poonamallee, Chennai, Tamil Nadu, India
Krishna Mohan Surapaneni Department of Biochemistry, Panimalar Medical College and Research Institute, Varadharajapuram, Poonamallee, Chennai, Tamil Nadu, India

DOI:

https://doi.org/10.18203/2394-6040.ijcmph20234149

Keywords:

Artificial intelligence, ChatGPT, Community Medicine, Preventive medicine, Social medicine

Abstract

Artificial Intelligence (AI) for community health holds transformative potential, offering data-driven insights, virtual health advisories, and efficient resource allocation for improved healthcare outcomes and population well-being. This study evaluates the potential of ChatGPT 3.5, an AI language model, in preventive and social medicine. Using medical exam questions, ChatGPT demonstrated commendable understanding, scoring 62% and 65% in Paper 1 and Paper 2, respectively. While promising for medical education and public health, caution is advised due to occasional inaccuracies, ethical considerations, and the model's inability to replace human expertise. Refinement efforts are crucial for harnessing ChatGPT's full potential in enhancing medical education and positively impacting public health outcomes. Further research should focus on real-world applications and addressing limitations for responsible integration.

Metrics

Metrics Loading ...

References

Baidoo-Anu D, Ansah LO. Education in the Era of Generative Artificial Intelligence (AI): Understand-ing the Potential Benefits of ChatGPT in Promoting Teaching and Learning. Available at: https://ssrn. com/abstract=4337484 or http://dx.doi. org/10.2139 /ssrn.4337484. Accessed on 26 March 2023.

Microsoft announces new Bing and Edge browser powered by upgraded ChatGPT AI. Available at: https://www.theverge.com/2023/2/7/23587454/microsoft-bing-edge-chatgpt-ai. Accessed on 26 March 2023.

Khan RA, Jawaid M, Khan AR, Sajjad M. ChatGPT - Reshaping medical education and clinical management. Pak J Med Sci. 2023;39(2):605-7.

Lee H. The rise of ChatGPT: Exploring its potential in medical education. Anat Sci Educ. 2023;14.

Biswas SS. Role of Chat GPT in Public Health. Ann Biomed Eng. 2023;51(5):868-9.

Kahambing JG. ChatGPT, public health communication and 'intelligent patient companionship'. J Public Health (Oxf). 2023;45(3):e590.

Cascella M, Montomoli J, Bellini V, Bignami E. Evaluating the Feasibility of ChatGPT in Healthcare: An Analysis of Multiple Clinical and Research Scenarios. J Med Syst. 2023;47(1):33.

Dave T, Athaluri SA, Singh S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell. 2023;6:1169595.

Liu J, Wang C, Liu S. Utility of ChatGPT in Clinical Practice. J Med Internet Res. 2023;25:e48568.