Fig. 3 from the paper, showing that model performance levels off around 300M parameters and ESM C variants tend to outperform the other available protein language models.
Figure 5 from the paper, showing a wide range of model performance across datasets, with R^2 values ranging from 0.1 to 0.8. Only a small fraction of this variation is explained by either dataset size or protein length.
Now published: Systematic comparison of protein language models for transfer learning.
Key points:
- You don't need gigantic models. The two smaller ESM C variants work great.
- There is huge variability in performance across datasets. We have no idea why.
www.nature.com/articles/s41...
01.07.2025 23:34 β π 28 π 8 π¬ 1 π 0
What the microbiome teaches us about aging gracefully...
...and why we shouldn't necessarily 'turn back the clock'
I started a personal #Substack to cultivate my creative writing skills. Let's see how it goes. Opinions are my own.
The first essay: why I think it's probably a bad idea to give 80-year-olds fecal transplants from 20-year-olds. gibbological.substack.com/p/what-the-m...
Subscribe if, you're into it
01.07.2025 23:51 β π 26 π 6 π¬ 2 π 0
The way people are talking about the current demolition of research funding and HE legitimacy reminds me of the early days of COVID when I (and others) said it would be at least six years before any normalcy. Rage, despondency, rejectionβ¦eventually voting for a dictator just to feel alive.
03.06.2025 21:13 β π 1416 π 296 π¬ 5 π 9
An acrylic painting by Jim Musil depicting a farm in Wisconsin. A red barn sits at the end of a dirt road in the middle of a verdant green field. A colorful sky dominates the composition.
My painting WISCONSIN FARM
26.05.2025 17:35 β π 13783 π 1065 π¬ 297 π 40
I hate to be that guy, but this is the five-alarm fire, and every elected Democrat and frankly, every Washington reporter should be ringing the bell. If it can happen to him, it can happen to anyone. Nobody with a voice should give this administration a momentβs peace about it.
13.04.2025 23:43 β π 6554 π 2154 π¬ 120 π 52
Cory Booker Just Gave The Longest Speech In The History of The US Senate
Only two men have spoken on the floor of the U.S. Senate...
In his 1957 filibuster, Strom Thurmond said "Negroes ... are not so well qualified to vote as are the white people.β
A Black senator just broke the record Thurmond set with that speech.
talkingpointsmemo.com/news/cory-bo...
01.04.2025 23:31 β π 20285 π 4364 π¬ 378 π 357
I laughed so hard at this, and then cried, because it's so painfully true
26.03.2025 04:46 β π 1 π 0 π¬ 0 π 0
Find Your Voting Locations | WISDEMS Voter Protection Team
This searchable map shows you early voting and dropbox info for hundreds of villages, towns, and cities across Wisconsin. Enter the address you're registered at and your options will pop up!
Right now, thereβs an important race happening that will shape the Wisconsin Supreme Court for the next 10 years. Judge Susan Crawford is ready to protect the fundamental rights and freedoms of all Wisconsinites.
Make a plan to vote early today β donβt wait until April 1st: wisdems.org/vote
25.03.2025 20:06 β π 37985 π 12291 π¬ 807 π 581
Attorney General Bonta Urgently Issues Consumer Alert for 23andMe Customers
Californians have the right to direct the company to delete their genetic data OAKLAND β California Attorney General Rob Bonta today issued a consumer alert to customers of 23andMe, a genetic testing ...
23andMe is going under. Californians have the right to delete their genetic data before it's turned over to next party buying the assets. If you have a 23andMe account, go log in to download whatever reports you want to save, then follow these instructions to delete your data.
23.03.2025 22:33 β π 8066 π 5364 π¬ 165 π 291
Yes! But also it's just really great to come back to a clean house. I went on a week long yoga retreat in Costa Rica last year, and it was life changing. Hope you have a great time!
22.03.2025 04:03 β π 1 π 0 π¬ 0 π 0
Brown Medicine doctor deported despite federal court order. What we know.
A court order that would have delayed the deportation of Dr. Rasha Alawieh was issued while her plane was on the tarmac, but it took off anyway.
This is so evil that it defies understanding. A transplant surgeon on an H1B visa was deported, despite a court injunction. She had committed no crimes.
This must stop. We must stand together to protect immigrants and visitors against state terrorism.
www.providencejournal.com/story/news/l...
16.03.2025 12:26 β π 274 π 86 π¬ 10 π 1
Breaking: FDA's March meeting to select flu shot strains for 2025-2026 season has been canceled per email sent to committee members, a VRBPAC member told me. drug companies need about 6 months leeway to make shots in time for fall vax campaigns. #healthpolicy
26.02.2025 23:17 β π 6808 π 3523 π¬ 421 π 1223
Haha yes! There are people I've never met or had a full conversation with online other than Github issue discussions.
27.02.2025 00:43 β π 1 π 0 π¬ 0 π 0
Happy to be added as well!
24.02.2025 18:58 β π 1 π 0 π¬ 0 π 0
What Lichen Tell Us About Ecology, Air Quality, And More
Ira is joined on stage by experts in Portland, Oregon, to talk about the amazing world of lichen and their role in a changing climate.
Last October, we took a trip to the World Forestry Center in Portland, Oregon, for a daylong exploration of lichenβthe fuzzy growths often found on trees, roofs, and gravestones. Two experts joined us to discuss the fascinating world of lichen and their role in a changing climate.
23.02.2025 16:17 β π 2442 π 232 π¬ 41 π 22
I stayed there for a short vacation last June (was super surprised that you can just stay there outside of a conference!) and I loved walking along the boardwalk and reading by the fire at night. Enjoy!
24.02.2025 05:37 β π 1 π 0 π¬ 0 π 0
Legitmately thrilled to share our latest work, in which @fernpizza.bsky.social solved an experimental challenge in plasmid biology as old as the field: measuring how plasmids compete and evolve within individual cells!
21.02.2025 20:42 β π 218 π 87 π¬ 5 π 11
Congrats Vince!!
21.02.2025 20:41 β π 1 π 0 π¬ 0 π 0
I had the pleasure of being interviewed by @markowenmartin.bsky.social on his Fantastic "Microbial Matters" podcast about my group's work on the #drinkingwatermicrobiome. You can watch it here. www.youtube.com/watch?v=JDAU...
06.01.2025 19:01 β π 14 π 5 π¬ 1 π 0
A photo of groundcherries (Alkekengi) in a garden in winter. The round, orange, cherry tomato-like fruits are suspended in the center of pendulous, vaguely heart-shaped husks made of networks of dried beige veins. The husks have a delicate, skeletal, lattice-like structure, reminiscent of laser-cut papercraft.
In winter through early spring, you can sometimes find unspoiled, still-bright groundcherries sitting in the latticed remnants of their husks, like hearts suspended in paper ribcages
06.01.2025 19:37 β π 6208 π 1427 π¬ 64 π 89
Ten species comprise half of the bacteriology literature, leaving most species unstudied
@biorxiv-microbiol.bsky.social by Paul A Jensen
www.biorxiv.org/content/10.1...
B. subtilis is #6 π, anyhow, the literature is biased to models
Would publications on plants or animals be similarly biased?
05.01.2025 15:05 β π 44 π 20 π¬ 6 π 3
There are really only two "mystery box" shows that I felt were worth my time last year and this coming year (for "mystery box shows," think LOST): FROM and SILO. As always, your mileage may differ.
01.01.2025 21:29 β π 7092 π 347 π¬ 456 π 47
EMERGENCY Bookstore and Chocolate Crawl!
We're calling on you to help two bookstores that were flooded in recent storms, plus another bookstore that just reopened after a nasty fire
We're doing an *emergency* Bookstore and Chocolate Crawl on Saturday Jan. 11.
We'll visit Medicine For Nightmares and Adobe, which suffered massive flood damage recently.
Then we'll hit East Bay Booksellers, recovering from a fire. Plus Pegasus!
Details/RSVP: www.eventbrite.com/e/emergency-...
30.12.2024 02:01 β π 373 π 139 π¬ 10 π 13
The Advanced Research Projects Agency for Health (ARPA-H) is a research funding agency that supports transformative biomedical and health breakthroughs to provide health solutions for all.
Visit us at https://arpa-h.gov/
Neurosciencer, democracy reform studier, plotter of data by hand as first step. At Princeton too. Long-form essays at samwang.substack.com.
Modern Landscape Painter
JimMusil.com
Scientist, mother, perpetual learner. Assistant Professor, Structural Biologist, Advocate, and Speaker. Views my own.
signal @starbic.01
www.starbirdlab.com
Professor. Sociologist. NYTimes Opinion Columnist. Books: THICK, LowerEd. Forthcoming: 1)Black Mothering & Daughtering and 2)Mama Bears.
Beliefs: C.R.E.A.M. + the internet ruined everything good + bring back shame.
βIβm just here so I donβt get fined.β
Policy & Planning Dir. @marinbike.org β’ UCLA Urban Planning β’ AICP Planner β’ Baltimore β‘οΈ LA β‘οΈ East Bay β’ π«πCar-free commuting since 2015 β’ Missing middle renter.
πBerkeley, CA
CEO of Bluesky, steward of AT Protocol.
dec/acc π± πͺ΄ π³
Bioinformatician, microbial genomics, π€ π Pneumo, E. coli, capsules, AMR, vaccine evaluation and general adventure seeker living in Norway.
The Open Bioinformatics Foundation (OBF) is a non-profit volunteer-run organization that supports #OpenSource #bioinformatics. Member projects: #BioPerl, #BioJava, #BioRuby and #Biopython. We run an annual meeting, the Bioinformatics Open Source Conference
Assistant Professor in Computational Metabolomics. Fascinated by the diverse chemistry of nature. Strives for Community-based solutions and Open Science.
Microbe-loving bioinformatics and genomics professor aiming to better control infectious diseases, and support health, in a sustainable way. Also a Mum.
Global public health practitioner, all things NGS, bioinformatics, random πΆs, and, wastewater
π: UWyo (BSc - MolB; PhD - infect disease epi; ScD [h.c.], and UAB MPH-Epi)
Mountain West located, but missing the ocean. Views, albeit bad ones, are my own
Transforming public health and infectious disease surveillance through the innovative implementation of #NGS and #bioinformatics technologies.
Bioinformatics Scientist at Theiagen Genomics. Cat lover and broad-spectrum nerd based in Pittsburgh, PA.
Professor of Antimicrobial Resistance. Institute of Microbiology and Infection, University of Birmingham. Director University of Birmingham Doctoral School. Editor in Chief of npj Antimicrobials and Resistance.
Assistant Prof @WesternU | Adjunct Scientist @PublicHealthON | Canada Research Chair in Pathogen Genomics and Bioinformatics | Epidemiology | TB | AMR | MRSA
Epidemiology, microbial (meta)genomics, antimicrobial resistance, One Health, Professor of Microbial Genomic Epidemiology at Quadram Institute Bioscience & University of East Anglia.