This JAMA Forum discusses the possibilities, limitations, and risks of physician use of large language models (such as ChatGPT) along with the improvements required to improve the accuracy of the technology.