Nicholas Tatonetti, PhD

A crisis of overconfidence: Why confidence, not accuracy, is the real risk in clinical AI - BioData Mining BioData Mining - Language models today are trained to convey confidence in their outputs, regardless of whether those outputs are correct. The alignment methods we use to make them helpful also...

New editorial in BioData Mining: A crisis of overconfidence in clinical AI led by @cedarssinaihsu.bsky.social PhD student, Jacob Berkowitz.

Why sounding confident can be more dangerous than being inaccurate, and why calibration needs to be central in clinical AI.

link.springer.com/article/10.1...

You can now connect ChatGPT to an Apple Watch.
So I imported 29 mil steps & 6 mil heartbeats into the new ChatGPT Health.
It graded my heart health an F. ⁉️
Cardiologist @erictopol.bsky.social called it “baseless.”
Any bot claiming to give health insights shouldn’t be this clueless. Even in beta. 🧵

I suspect Holly Mitchell is going to find in the coming years that she shares Henry Waxman's legacy as someone who blocked a whole part of the LA region from getting rail for decades due to needless, pointless capitulation to fearmongering. Her time on the Metro Board will not be remembered kindly.

Cedars-Sinai Will Pioneer AI in Drug Safety With New Funding Cedars-Sinai receives an up to $5,054,235.00 award to develop KronosRx, a platform using AI and 'patient avatars' to predict adverse drug reactions, improve cli

Excited to announce our new project with ARPA-H which advances methods to artificially accelerate the aging of organoids to study drug toxicities over time!! A current huge gap in our understanding and our models.

www.cedars-sinai.org/newsroom/ced...

From prompt engineering to agent engineering: expanding the AI toolbox with autonomous agentic AI collaborators for biomedical discovery - BioData Mining

Is "Agent Engineering" the next big thing? Getting so-called "AI Agents" to work together effectively isn't trivial. @moorejh.bsky.social and I discuss the need for rigorous development in our latest editorial in BioData Mining

biodatamining.biomedcentral.com/articles/10....

Deskilling? cacm.acm.org/news/the-ai-... #deskilling #ai

👀 Health AI PhD Information Session hosted by Cedars-Sinai! This event is an opportunity for interested students to learn more.

November 21 @ 8 AM PT
Register: forms.office.com/r/vMreBMZQak

PhD in Health Artificial Intelligence

Application period for the Cedars-Sinai PhD Program in Health AI is now OPEN! Come study cutting-edge AI in a top hospital with clinical rotations, clinical collaborators, & easy access to clinical data - please RP! www.cedars-sinai.edu/education/gr... #artificialintelligence #bioinformatics #phd

Opinion | There’s Nothing Magical in the Machine

Nice piece in the NYT about the risks of "magical thinking" with AI that allow big tech to hype their products www.nytimes.com/2025/09/25/o... #artificialintelligence #magic #hype #llms

California’s $23 Billion Plan to Restore Federal Cuts to Scientific Research

Loving my state rn.

California’s $23 Billion Plan to Restore Federal Cuts to Scientific Research www.nytimes.com/2025/09/13/u...

Leveraging Large Language Models in Extracting Drug Safety Information from Prescription Drug Labels - Drug Safety Introduction Adverse drug reactions (ADRs), including those resulting from drug interactions, remain a leading cause of morbidity and mortality. Structured product labels (SPLs) serve as a primary sou...

AI methods are great tools for advancing drug safety surveillance. We show that LLMs can accurately identify and extract essential concepts from messy product drug labels. Just published in _Drug Safety_!

Great work led by @undinagislad!

link.springer.com/article/10.1...

An LLM Analysis of Reporting Quality of Randomized Clinical Trial Articles This study uses a zero-shot large-language model to automatically assess compliance with the Consolidated Standards of Reporting Trials guideline for English-language randomized clinical trials publis...

We used AI to audit 21,000+ RCTs. The result? -- only 15% of trials fully comply with CONSORT guidelines. Transparency in clinical trials has a long way to go.

Amazing work by Apoorva in my group!

jamanetwork.com/journals/jam...

The top three science funders are the US, China, and Japan. The three fund more science than every other country, combined.

In 2024, the US funded more scientific research than China and Japan, combined. The US also funds more science than every other country except for Japan and China, combined.

The 2025 volume of the Annual Review of Biomedical Data Science is now online. Take a look at the most read article from this new volume, "Spatial Transcriptomics Brings New Challenges and Opportunities for Trajectory Inference" arevie.ws/45D2NWD
@marylynritchie.bsky.social @tatonetti.bsky.social

This creates a fun game that rewards superfluous, outlandish (dare I say outre?) verbiage.

With the correct rhetorical device you can make complete jibberish sound like poetry. Just ask Shakespeare (or better read Forsyth's The Elements of Eloquence)

From left to right. Patient facing left and looking at their phone. Doctor facing right looking at a tablet.

Just came across this fail. Literally everything that's wrong with AI/tech in healthcare. Not only is the patient and doctor buried in their devices, but they're facing AWAY from each other 🤦‍♂️!!

Technology should facilitate and center the humanity of healthcare. Not do whatever this is.

I’m petrified about today’s science news. Genetically modifying crabs to have cheetah genes? This could go sideways fast.

Vibe coding: a new paradigm for biomedical software development - BioData Mining

What is Vibe Coding and how can it be used to advance biomedical research? @tatonetti.bsky.social & I explain in this editorial biodatamining.biomedcentral.com/articles/10.... #bioinformatics #datascience #coding #vibecoding

Vibe coding: a new paradigm for biomedical software development - BioData Mining

Vibe coding is coming for biomedical software development, my first editorial as Co-Editor-in-Chief of @BioDataMining with @moorejh.bsky.social

biodatamining.biomedcentral.com/articles/10....

If anyone is wondering, yes we will be monitoring the safety and side effects of drugs from the moment they hit the market

So the market for our drug safety monitoring algorithms just opened up 👀

Biomedical text normalization through generative modeling A large proportion of electronic health record (EHR) data consists of unstructured medical language text. The formatting of this text is often flexibl…

Excited that our paper on GenAI-based text normalization is out at Journal of Biomedical Informatics!

If you ever had a bunch of messy text and need to map it to a controlled terminology, then this is the method for you.

www.sciencedirect.com/science/arti...

Special 👏 to Jacob Berkowitz!!

TBD3 Online registration for Columbia OHDSI Summer School starts on April 9th 2025. Online registration ends July 11th 2025.

Learn observational data from the best. @ColumbiaDBMI and @OHDSI are offering summer school to learn all the real-world-data analysis tips and tricks.

columbiauniversity1.regfox.com/ohdsi-summer...

✅ PASSED SENATE TRANSPORTATION COMMITTEE: SB 445 by @scottwiener.bsky.social that streamlines permit approval process for transit projects to tackle cities that cause costly delay against transit.

What a fabulous discussion and meeting! Off to a fun start.

Looking forward to starting the Nexus Informatics conference tomorrow morning. First up - @tatonetti.bsky.social Nicholas Tatonetti delivering our opening keynote! Can't wait!
I will be giving the Friday morning keynote, "Welcome to the Jungle – Real World Data Surrounded by Data Gardens" !

OnSIDES (ON-label SIDE effectS resource) Database : Extracting Adverse Drug Events from Drug Labels using Natural Language Processing Models Adverse drug events (ADEs) are the fourth leading cause of death in the US and cost billions of dollars annually in increased healthcare costs. However, few machine-readable databases of ADEs exist, l...

Here's the pre-print if you don't have access to Med www.medrxiv.org/content/10.1...

If you use SIDER for anything, you need to use this instead. Better faster stronger.

GitHub - tatonetti-lab/onsides: A resource of adverse drug effects extracted from FDA structured product labels A resource of adverse drug effects extracted from FDA structured product labels - tatonetti-lab/onsides

Browse and contribute to the project at github.com/tatonetti-la...