AI in health and health care: summary of the JAMA Summit

The JAMA Summit on AI in health and health care highlighted the transformative impact of artificial intelligence on the field, emphasizing its potential to improve access, quality, and affordability of care while addressing its associated challenges and risks. Below is a detailed summary of the key points discussed during the summit:

1. Transformative Impact of AI in Health Care

Artificial intelligence is revolutionizing health care at an unprecedented scale. It is reshaping clinical practices, health management, and patient engagement. AI applications span diagnostic tools, administrative operations, and hybrid systems that integrate clinical and business functions. The summit underscored how AI is altering the landscape of health care delivery, with the potential to improve efficiency, accuracy, and outcomes.

2. Broad Application Spectrum

AI is being deployed across diverse domains in health care:

• Clinical Decision Support: Examples include sepsis alerts, diabetic retinopathy screening, and predictive analytics to identify high-risk patients.
• Mobile Health Applications: AI-powered apps are enhancing patient engagement and self-management of chronic conditions.
• Administrative Tools: AI is streamlining operations such as scheduling, billing, and documentation, reducing administrative burden and costs.

These applications demonstrate AI's deep integration into daily health care operations, making it a critical tool for providers and patients alike.

3. Regulatory Gaps

A significant concern raised during the summit was the lack of consistent regulatory oversight for AI tools in health care. Many AI systems operate outside the purview of the FDA, meaning their clinical impact and safety are often unevaluated. This regulatory gap raises concerns about unverified outcomes, patient safety, and the potential for unintended harm.

4. Evaluation Challenges

Assessing the effectiveness of AI tools remains a major challenge. The outcomes of these tools depend heavily on factors such as:

• The quality of the user interface.
• The level of training provided to clinicians and users.
• The specific clinical context in which the AI is deployed.

Even high-performing algorithms can fail in real-world settings if deployment conditions are suboptimal. This highlights the need for robust evaluation methods to ensure AI tools perform effectively across various environments.

5. Safety vs. Effectiveness Focus

Current oversight and compliance efforts primarily monitor safety issues, such as detecting errors or “hallucinations” in AI systems. However, there is limited focus on measuring effectiveness, which refers to whether AI tools actually improve patient outcomes, care quality, or operational efficiency. The summit emphasized the importance of shifting the focus toward evaluating both safety and effectiveness.

6. Multistakeholder Collaboration

The successful deployment of AI in health care requires collaboration among multiple stakeholders:

• Developers: To design tools that prioritize safety, equity, and clinical value.
• Clinicians: To ensure AI tools are practical and usable in real-world scenarios.
• Regulators: To establish standards for safety and effectiveness.
• Health Systems: To integrate AI into workflows and monitor its performance post-implementation.

A lifecycle approach—spanning creation, testing, implementation, and post-market monitoring—was identified as essential for AI’s success in health care.

7. Development of Evaluation Infrastructure

The summit stressed the need for standardized measurement and monitoring tools to assess AI effectiveness. These tools would enable rapid, efficient, and evidence-based evaluations across various health care settings, ensuring AI tools meet clinical and operational benchmarks.

8. National Data Ecosystem

Establishing a nationally representative data infrastructure was deemed critical for equitable evaluation of AI tools. Such an ecosystem would:

• Provide generalizable insights into AI’s health impacts.
• Ensure diverse populations and environments are included in evaluations.
• Promote equity in AI deployment and outcomes.

9. Incentive and Policy Alignment

Effective AI deployment requires aligning incentives and policies to encourage developers and institutions to prioritize:

• Safety: Ensuring AI tools do not harm patients.
• Equity: Addressing disparities in access and outcomes.
• Clinical Value: Focusing on improving care quality and efficiency rather than speed or profit.

Policy reforms and market-based incentives were identified as key drivers for fostering responsible AI innovation.

10. Future Outlook

The summit concluded with discussions about the future of AI in health care. AI is expected to disrupt every component of health care delivery, presenting both opportunities and risks. Realizing its full potential will depend on creating a robust ecosystem that fosters:

• Transparent and evidence-driven innovation.
• Equitable access to AI tools and their benefits.
• Collaboration among stakeholders to address challenges and optimize outcomes.

In summary, while AI offers transformative opportunities for health care, its successful integration requires addressing regulatory gaps, evaluation challenges, and equity concerns. The summit emphasized the need for collaboration, standardized evaluation methods, and policy alignment to ensure AI improves access, quality, and affordability while minimizing risks.