This innovative project has shown remarkable potential in various aspects of medical care. The development team conducted extensive tests, evaluating AIME across 32 categories including diagnosis, empathy, quality of treatment plans, and decision-making efficiency. Impressively, AIME outperformed human doctors in 28 of these categories and matched them in the remaining four.
The training approach for AIME was particularly groundbreaking. Utilizing a self-play method, three independent agents (a patient, a doctor, and a critic) conducted over 7 million simulated consultations. In comparison, a human doctor typically performs only a few tens of thousands of consultations over their entire career. This vast experience enables AIME to deliver high-quality medical services to 99% of the global population who cannot afford personal doctors. In a few years, AIME is expected to surpass most general practitioners, radiologists, and pediatricians in performance. It offers tireless service, is conditionally free, and has instant access to vast medical literature, having been trained on millions of patient interactions.
However, the priority in medicine is “do no harm.” Since publishing their report in January, the team has focused on improving the product, enhancing safety, and preparing for necessary FDA and other regulatory approvals. While widespread adoption won’t happen overnight, the technical feasibility of AIME is already a reality. 🌍💡