This survey study assesses whether patients communicating with a chatbot in a large health care system were able to accurately identify it as an unsupervised computer application.