Duke Health AI Evaluation & Governance Program

The appointment highlights growing recognition of @dukeaievalgov.bsky.social program's work in responsible #AI oversight, advancing ethical, sustainable, and human-centered innovation that keeps quality and accountability at the forefront. healthaigovernance.duke.edu

AI at Duke Initiative Strengthens Leadership and Expands Faculty Engagement - AI at Duke The AI at Duke steering committee continues to gain momentum as it enters a critical phase of strategic planning and university-wide engagement. Launched by Provost Alec Gallimore in May, the initiati...

Nicoleta Economou, PhD, director of @dukeaievalgov.bsky.social has been appointed to the AI at Duke Steering Committee and will also serve as liaison for the Trustworthy & Responsible AI Advisory Committee. Provost Alec Gallimore launched the AI at Duke initiative in May 2025. duke.is/g/newp

Aligned with Duke Health's broader mission, the @dukeaievalgov.bsky.social is advancing a streamlined approach to AI evaluation & governance, establishing rigorous frameworks for responsible oversight and fostering a culture of best practices across the health system. healthaigovernance.duke.edu

The @dukeaievalgov.bsky.social team was excited to present our work at the Duke Summit on AI for Health Innovation. Throughout the event, we observed meaningful engagement and genuine curiosity from attendees regarding our program, the ABCDS Oversight Initiative, and our published research.

From Chaos to Coordination: Reimagining Healthcare Emergency Management with AI This event is a part of the AHEM Expert Panel Series Join us for the fifth session in the Academic Healthcare Emergency Management (AHEM) Expert Panel Series, where leading voices in AI, healthcare…

@dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, recently joined leading experts in #AI, data science, public health, and healthcare emergency management for an AI Panel Series hosted by the Academic Healthcare Emergency Management (AHEM) Consortium. ahemconsortium.org/from-chaos-t...

👇 @dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, recently delivered a keynote at the National Evaluation Center of Quality and Technology in Health Conference in Athens, which highlighted @dukehealth.bsky.social’s leadership in advancing trustworthy and responsible #AI for healthcare.

Agentic AI, Generative AI and AI Governance Explore how agentic AI, generative AI and AI governance are driving transformation across health and life sciences.

👇 @dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, joined other AI leaders on a @sassoftware.bsky.social-hosted webinar exploring how agentic AI, generative AI, and AI governance are reshaping health and life sciences. Watch the webinar on demand here: www.sas.com/en_us/webina...

Google’s healthcare AI made up a body part — what happens when doctors don’t notice? The basilar ganglia does not exist.

🤔Typo or something more? The Verge's Hayden Field spoke with @dukehealth.bsky.social's Chief Data Scientist Michael Pencina, PhD, about the risks of "hallucinations" in medical #LLMs like Google's Med-Gemini, which mistakenly cited an anatomical structure that doesn’t exist, in a recent preprint.

Whether you are an informaticist, clinician, policy nerd, or governance geek, this curated collection of papers offers practical frameworks, regulatory foresight, and real-world applications to inform and inspire your work.
healthaigovernance.duke.edu/our-work/pub...

Fall Reading on AI Governance Looking to add some academic heat to your fall reading list? The Duke Health AI Evaluation & Governance Program is spotlighting our latest research on algorithm oversight, LLM evaluation, fairness, an...

Looking to add some academic heat to your fall reading list, the @dukeaievalgov.bsky.social is spotlighting our latest research on algorithm oversight, #LLM evaluation, fairness, and safety in #healthAI. healthaigovernance.duke.edu/news/fall-re...

Duke innovates on implementing and assessing AI in health spaces Researchers are creating evaluation frameworks to ensure the safe usage of LLMs, like ChatGPT, at Duke Health

North Carolina Public Radio (@wunc.org) reports on @dukehealth.bsky.social's national leadership in health #AI governance, spotlighting two new evaluation frameworks developed by Duke researchers to assess the safety, reliability, and clinical performance of #LLMs.
www.wunc.org/health/2025-...

Duke researchers want to ensure AI is safe in a health care setting Health systems across the country are investing heavily in AI as a way to reduce burnout for providers and potentially improve care

👇@axios.com reports on how a team of Duke researchers led by Chief Data Scientist Michael Pencina has developed two important evaluation frameworks to assess the safety, accuracy, and reliability of large language models (LLMs) in clinical care. axios.com/local/raleig... @dukehealth.bsky.social

An evaluation framework for ambient digital scribing tools in clinical applications npj Digital Medicine - An evaluation framework for ambient digital scribing tools in clinical applications

These frameworks offer a new approach to ensuring that #AI systems used in clinical settings meet the highest standards of quality and accountability:

Read the NPJ Digital Medicine paper here: rdcu.be/etzTt
Read the JAMIA paper here: academic.oup.com/jamia/articl... 2/2

Duke University Sets New National Standard for Safe, Scalable AI in Health Care DURHAM, N.C. — Duke University School of Medicine researchers have developed two pioneering frameworks designed to evaluate the performance, safety, and reliability of large-language models in health ...

Duke researchers, led by Dr. Michael Pencina and Dr. Chuan Hong, have developed two pioneering frameworks designed to evaluate the performance, safety, and reliability of large language models (LLMs) in healthcare. corporate.dukehealth.org/news/duke-un... 1/2

Bridging the Gap Between Developers and Implementers in Health AI This Viewpoint describes opportunities for health care organizations to close gaps between the development and implementation of artificial intelligence using third-party enablers for training, adhere...

New in @jamahealthforum.bsky.social: Duke’s Michael Pencina and colleagues make a case for third-party enablers, smarter local governance, and shared evidence networks to make health #AI safe, scalable, and truly impactful. jamanetwork.com/journals/jam... @dukehealth.bsky.social

Welcome! You are invited to join a meeting: Shaping the Future of Responsible Health AI: Introducing the Duke Health AI Evaluation & Governance Program. After registering, you will receive a confirmat... Speakers: Michael J. Pencina, PhD, Chief Data Scientist, Duke Health Nicoleta J. Economou-Zavlanos, PhD, Director, Duke Health AI Evaluation & Governance (E&G) Program Sophia Bessias, MPH, MSA, Assist...

ATTN: Duke faculty, staff, and students: Join @dukeaievalgov.bsky.social for a special webinar: 'Shaping the Future of Responsible Health #AI'. Learn how Duke is advancing the deployment of trustworthy and responsible AI across the institution. Register: qrcc.me/swb9tiwh8cw6... (Duke login required)

This is just the beginning! @DukeAIEvalGov welcomes collaborations and partnerships to shape an #AI-powered future that prioritizes trust, transparency, and transformative impact. Let’s build it together! Contact us: healthaigovernance.duke.edu/contact-us 2/2

A website launch flyer showcasing the front page of the new Duke Health AI Evaluation & Governance website on various screens.

Exciting News! @dukeaievalgov.bsky.social Program proudly launches its new website. The Program promotes the safe, fair, and effective use of #AI in healthcare, ensuring AI innovations improve patient care ethically. Visit & explore here: healthaigovernance.duke.edu 1/2

As Evaluation Lead, you will collaborate across Duke’s academic and clinical teams to implement our #AI governance framework and help advance a nationally recognized model for responsible AI. Join us at the forefront of ethical, evidence-based AI in healthcare! 2/2

A 'We are Hiring' poster with the Duke Health AI Evaluation & Governance Program logo.

Passionate about making clinical #AI safer, fairer, and more effective? The @dukeaievalgov.bsky.social Program is looking for an Evaluation Lead to support our flagship ABCDS Oversight initiative. Apply now or share with someone who should: careers.duke.edu/job-invite/2... 1/2

Dr. van Genderen also serves as the president of the Trustworthy and Responsible AI Network (TRAIN) Europe, which focuses on the operationalization of #AI throughout Europe. Learn more about TU DELFT's and Erasmus MC's REAiHL here: www.icai.ai/labs/reaihl-...

Dr. Michel van Genderen is part of the Responsible and Ethical AI for Healthcare Lab (REAiHL), the clinical branch of the @who.int-endorsed Delft University of Technology (TU Delft) Digital Ethics Centre, which advises the WHO on responsible #AI.

Dr. Michel van Genderen speaking at a podium

Thank you to all who joined @dukeaievalgov.bsky.social for a compelling seminar with Dr. Michel van Genderen, Associate Professor at Erasmus Medical Center and a thought leader in operationalizing responsible #AI, who shared insights from his work in #trustworthyAI development across Europe.

Duke Health Logo

Duke Health has partnered with Avanade to design, build and implement a Smart AI Governance Engine (SAIGE), a-first-of-its-kind, healthcare-specific AI governance platform that uses Microsoft Azure and Microsoft Fabric applications.

1/6

@dukeaievalgov.bsky.social

From broad notifications to informed consent, they outline a balanced approach — matching transparency with real-world feasibility — based on #AI autonomy and clinical risk. The goal? Building warranted trust in AI-driven #healthcare.

A Heuristic for Notifying Patients About AI: From Institutional Declarations to Informed Consent Published in The American Journal of Bioethics (Vol. 25, No. 3, 2025)

Hot off the press 👇 @dukeaievalgov.bsky.social's Matthew Elmore, Nicoleta Economou, and Michael Pencina have developed a practical heuristic to ensure patients are informed about #AI tools in their care. Read here: www.tandfonline.com/eprint/GWJTP...

We are hiring! Join the Duke Health AI Evaluation & Governance Program as an Operations Leader and drive the future of #healthAI. Lead transformative projects, manage operations, and shape ethical, impactful AI in healthcare. Ready to innovate? Apply now: careers.duke.edu/job-invite/2...

As the year ends, we reflect on our commitment to advancing trustworthy AI for better healthcare. Thank you for supporting safe, fair, and high-quality solutions that prioritize patients. Wishing you a joyful season and a new year filled with health, hope, and progress. — The Duke Health AI E&G Team

Congratulations to Nicoleta Economou on being named the Director of @dukeaievalgov.bsky.social! In this pivotal role, Dr. Economou will lead efforts to ensure the trustworthy, responsible, and equitable integration of #AI in healthcare. Learn more about her impactful work here: lnkd.in/d2_Tt3gj