Pre-Print

Response Letter

Our response to a recent JAMA article about the adoption of Generative AI in healthcare
https://doi.org/10.59350/k6x1f-hrx26
Recently, Drs. Robert Wachter and Erik Brynjolfsson published a viewpoint in the Journal of the American Medical Association JAMA on Generative AI in healthcare. We agree with their views and wished to add the following points in a response letter. While our letter was not accepted, we have pre-printed it here. Please find the original paper and our response below.
Will Generative AI Deliver on Its Promise in Health Care?
Generative artificial intelligence (AI) has been touted as a potential innovation for greater diagnostic accuracy and clinical efficiency in health care, but whether generative AI will deliver on this promise or fall to the “productivity paradox” is examined in this Special Communication.

Link to the original paper

The "fail fast and iterate" doctrine falters in an environment where patient lives are at stake. Moreover, this approach is predicated on two assumptions. First, you need a space where failure is not catastrophic. Second, you need an audience that is willing to tolerate imperfect prototypes en route to a finished product. Both are currently lacking in medicine. Despite this, the authors conclude that generative artificial intelligence (genAI) will likely be adopted faster than prior technologies in healthcare.1 We support this conclusion and offer two additional points. First, medical education is a low-risk environment in which to build genAI tools. Second, teaching physicians how to use genAI can promote a future generation of physician builders.

We are already seeing attempts to automate physician tasks with genAI in areas such as informed consent, operative note dictation, and patient education.2-4 However, the road to deploying these innovations goes through significant red tape and a paucity of electronic health record (EHR) vendors, as the authors reference.1 On the other hand, medical education is a core component of academic medicine but one step removed from patient care. The regulatory barriers to deployment are fewer and the available platforms are plentiful. For example, most trainees use one EHR but multiple educational technologies.

Before genAI can be deployed within healthcare, physicians who are already burnt out and risk averse will need to iteratively evaluate these imperfect tools without losing enthusiasm. Perhaps this necessary culture change can be accomplished by transitioning physicians from passive consumers of genAI to builders. Previously, EHRs were largely built by engineers who don't practice medicine. Even after go-live, authority over institution-specific modifications is limited to small physician committees. In current AI research, access to cutting-edge technology is restricted to technical experts and physicians with large data sets. In contrast, state-of-the-art genAI tools are available to the public. As the authors allude, everyone is a potential builder. To capitalize on this, there is a pressing need to equip physicians with genAI competency, especially in areas such as prompt engineering.

In a previous JAMA article, Berwick proposed rules for disseminating innovation. Among them were: "find and support innovators", "invest in early adopters", and "create slack for change".5 Education in genAI can expand the current pool of physician innovators and early adopters. Low-risk environments can provide the necessary space for change. Together, these developments can catalyze the adoption of genAI in healthcare.

References

1. Wachter RM, Brynjolfsson E. Will Generative Artificial Intelligence Deliver on Its Promise in Health Care? JAMA. Published online November 30, 2023. doi:10.1001/jama.2023.25054

2. Decker H, Trang K, Ramirez J, et al. Large Language Model-Based Chatbot vs Surgeon-Generated Informed Consent Documentation for Common Procedures. JAMA Netw Open. 2023;6(10):e2336997. doi:10.1001/jamanetworkopen.2023.36997

3. Waisberg E, Ong J, Masalkhi M, et al. GPT-4 and Ophthalmology Operative Notes. Ann Biomed Eng. 2023;51(11):2353-2355. doi:10.1007/s10439-023-03263-5

4. Emile SH, Horesh N, Freund M, et al. How appropriate are answers of online chat-based artificial intelligence (ChatGPT) to common questions on colon cancer? Surgery. 2023;174(5):1273-1275. doi:10.1016/j.surg.2023.06.005

5. Berwick DM. Disseminating innovations in health care. JAMA. 2003;289(15):1969-1975. doi:10.1001/jama.289.15.1969

Share

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to I.D.E.A.S..

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.