ChatGPT: a new hope for sexual dysfunction sufferers?

The use of ChatGPT (Generative Pre-trained Transformer), an artificial intelligence-based language model that is on the verge of a revolutionary approach to accessing information, is rapidly increasing all over the world. The purpose of our study is to evaluate the reliability and usefulness of ChatGPT responses to sexual dysfunctions, which are considered taboo in most societies. The top four Google search keywords for sexual dysfunction, erectile dysfunction, and premature ejaculation were identified for each of these disorders, and these keywords were grouped under the headings of description, causes, drug treatment, and general treatment. The content of each response was rated by two urologists for reliability and usefulness using the modified Global Quality Score rating scale, a five-point Likert scale. When the total scores of the raters were evaluated, the reliability scores were calculated as 27 for sexual dysfunction, 32 for erectile dysfunction and premature ejaculation; 29 for sexual dysfunction, 33 for erectile dysfunction, and 34 for premature ejaculation for the usefulness scores. Reliability scores showed acceptable sexual dysfunction and good sexual dysfunction agreement for erectile dysfunction and premature ejaculation (α: 0.727, 0.833, 0.833, respectively). Usefulness scores showed acceptable agreement for sexual dysfunction (α = 0.727), good agreement for erectile dysfunction (α = 0.842), and questionable agreement for premature ejaculation (α = 0.600). When the scores of the raters were evaluated separately between diseases, both reliability and usefulness scores (p = 0.093 and 0.115 for reliability; p = 0.632 and 0.503 for usefulness) revealed no significant difference. ChatGPT has the potential to be a useful and reliable resource for patients to learn about sexual dysfunction, erectile dysfunction, and premature ejaculation. Artificial intelligence, whose development we cannot stop, needs improvements that can reference accepted sources and apply them to their answers to reduce potential risks and negative outcomes.

ChatGPT; Sexual dysfunction; Erectile dysfunction; Premature ejaculation; Reliability; Usefulness

[1] McCarthy J. Proceedings of the Teddington conference on the mechanization of thought processes. In McCarthy J (ed.) Programs with common sense (pp. 75–91). 1st edn. Her Majesty’s Stationary Office: London. 1959.

[2] Fronstin P. Sources of health insurance and characteristics of the uninsured: analysis of the march 2009 current population survey. EBRI Issue Brief. 2009; 1–35.

[3] Osadchiy V, Mills JN, Eleswarapu SV. Understanding patient anxieties in the social media era: qualitative analysis and natural language processing of an online male infertility community. Journal of Medical Internet Research. 2020; 22: e16728.

[4] Lin H, Fu H, Wu C, Tsai Y, Chou Y, Shih C, et al. Evaluation of sexual dysfunction in gynecologic cancer survivors using DSM-5 diagnostic criteria. BMC Women’s Health. 2022; 22: 1.

[5] Moreira ED Jr, Brock G, Glasser DB, Nicolosi A, Laumann EO, Paik A, et al. Help-seeking behaviour for sexual problems: the global study of sexual attitudes and behaviors. International Journal of Clinical Practice. 2005; 59: 6–16.

[6] Moreira ED, Glasser DB, Nicolosi A, Duarte FG, Gingell C, GSSAB Investigators’ Group. Sexual problems and help-seeking behaviour in adults in the United Kingdom and continental Europe. BJU International. 2008; 101: 1005–1011.

[7] Bernard A, Langille M, Hughes S, Rose C, Leddin D, Veldhuyzen van Zanten S. A systematic review of patient inflammatory bowel disease information resources on the World Wide Web. The American Journal of Gastroenterology. 2007; 102: 2070–2077.

[8] Eardley I. The incidence, prevalence and natural history of erectile dysfunction. Sexual Medicine Reviews. 2013; 1: 3–16.

[9] Feldman HA, Goldstein I, Hatzichristou DG, Krane RJ, McKinlay JB. Impotence and its medical and psychosocial correlates: results of the massachusetts male aging study. The Journal of Urology. 1994; 151: 54–61.

[10] Braun M, Wassmer G, Klotz T, Reifenrath B, Mathers M, Engelmann U. Epidemiology of erectile dysfunction: results of the ‘cologne male survey’. International Journal of Impotence Research. 2000; 12: 305–311.

[11] Johannes CB, Araujo AB, Feldman HA, Derby CA, Kleinman KP, McKinlay JB. Incidence of erectile dysfunction in men 40 to 69 years old: longitudinal results from the Massachusetts male aging study. Journal of Urology. 2000; 163: 460–463.

[12] Schouten BWV, Bosch JLHR, Bernsen RMD, Blanker MH, Thomas S, Bohnen AM. Incidence rates of erectile dysfunction in the dutch general population. Effects of definition, clinical relevance and duration of follow-up in the Krimpen Study. International Journal of Impotence Research. 2005; 17: 58–62.

[13] Capogrosso P, Colicchia M, Ventimiglia E, Castagna G, Clementi MC, Suardi N, et al. One patient out of four with newly diagnosed erectile dysfunction is a young man—worrisome picture from the everyday clinical practice. The Journal of Sexual Medicine. 2013; 10: 1833–1841.

[14] Laumann EO, Paik A, Rosen RC. Sexual dysfunction in the United States: prevalence and predictors. JAMA. 1999; 281: 537.

[15] Serefoglu EC, Yaman O, Cayan S, Asci R, Orhan I, Usta MF, et al. Prevalence of the complaint of ejaculating prematurely and the four premature ejaculation syndromes: results from the Turkish society of andrology sexual health survey. The Journal of Sexual Medicine. 2011; 8: 540–548.

[16] Gao J, Zhang X, Su P, Liu J, Xia L, Yang J, et al. Prevalence and factors associated with the complaint of premature ejaculation and the four premature ejaculation syndromes: a large observational study in China. The Journal of Sexual Medicine. 2013; 10: 1874–1881.

[17] Wong C, Harrison C, Britt H, Henderson J. Patient use of the internet for health information. Australian Family Physician. 2014; 43: 875–877.

[18] Cocco AM, Zordan R, Taylor DM, Weiland TJ, Dilley SJ, Kant J, et al. Dr Google in the ED: searching for online health information by adult emergency department patients. Medical Journal of Australia. 2018; 209: 342–347.

[19] Minichiello V, Rahman S, Dune T, Scott J, Dowsett G. E-health: potential benefits and challenges in providing and accessing sexual health services. BMC Public Health. 2013; 13: 790.

[20] Yu W, Zhang K, He Z, Jin J. Help-seeking behavior for erectile dysfunction: a clinic-based survey in China. Asian Journal of Andrology. 2014; 16: 131–135.

[21] Fode M, Nolsøe AB, Jacobsen FM, Russo GI, Østergren PB, Jensen CFS, et al. Quality of information in YouTube videos on erectile dysfunction. Sexual Medicine. 2020; 8: 408–413.

[22] Loeb S, Taylor J, Borin JF, Mihalcea R, Perez-Rosas V, Byrne N, et al. Fake news: spread of misinformation about urological conditions on social media. European Urology Focus. 2020; 6: 437–439.

[23] Gilson A, Safranek CW, Huang T, Socrates V, Chi L, Taylor RA, et al. How does Chat-GPT perform on the United States medical licensing examination? the implications of large language models for medical education and knowledge assessment. JMIR Medical Education. 2023; 9: e45312.

[24] Johnson D, Goodman R, Patrinely J, Stone C, Zimmerman E, Donald R, et al. Assessing the accuracy and reliability of ai-generated medical responses: an evaluation of the Chat-GPT model. To be published in Research Square. 2023. [Preprint].