.Attributes Medicine, Published online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although large language versions (LLMs) reveal pledge in measured setups, a research right now exposes their limits in real-world medical requests and also directs the means in the direction of durable assessment and benchmarking prior to professional usage.