Ben Miller's Avatar

Ben Miller

@bkmi.bsky.social

FAIR Chemistry. Simulation-based Inference.

462 Followers  |  333 Following  |  36 Posts  |  Joined: 18.11.2024  |  2.1414

Latest posts by bkmi.bsky.social on Bluesky

Preview
GitHub - facebookresearch/adjoint_sampling: code for "Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matching" code for "Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matching" - facebookresearch/adjoint_sampling

We've open sourced Adjoint Sampling!

It's part of a bundled release showcasing FAIR's research and open source commitment to AI for science.

github.com/facebookrese...

There's also a blog about the release
ai.meta.com/blog/meta-fa...

14.05.2025 18:20 β€” πŸ‘ 22    πŸ” 3    πŸ’¬ 0    πŸ“Œ 0

This was a significant community effort, so thank you to LBNL, Princeton, Genentech, Stanford, U. of Cambridge, CMU, NYU, LANL, the Roche Group and Berkeley for helping make this happen!

14.05.2025 18:12 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

UMA, without fine-tuning to specific tasks, performs similarly or better in both accuracy and inference-speed/memory-efficiency than specialized models on a wide-range of material, molecular and catalysis benchmarks.

14.05.2025 18:12 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

With all these large diverse datasets, we ask whether it’s possible to train a single model that performs well across several domains without the need for additional finetuning?

Introducing UMA - our latest model trained on over 30 billion atoms across our open-science datasets.

14.05.2025 18:12 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Baseline models are released and evaluated on OOD evaluation tasks. Metrics that go beyond just a structure’s energy and forces are important for understanding how well models perform on downstream applications.

We hope to release a public leaderboard in the near future!

14.05.2025 18:12 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

With over 100M structures calculated at Ο‰B97M-V/def2-TZVPD, with variable charge+spin, and spanning biomolecules, electrolytes, metal complexes, and community datasets, OMol25 represents the largest most diverse dataset of its kind.

14.05.2025 18:12 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

While our earlier datasets (OC20, OC22, OMat24) focused on catalysts and materials, it was evident the community lacked a large, high quality, diverse molecular DFT dataset for training ML models. The Open Molecules 2025 (OMol25) Dataset hopes to accomplish just that.

14.05.2025 18:12 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Video thumbnail

Excited to share our latest releases to the FAIR Chemistry’s family of open datasets and models: OMol25 and UMA!
@AIatMeta @OpenCatalyst

OMol25: huggingface.co/facebook/OMo...
UMA: huggingface.co/facebook/UMA
Blog: ai.meta.com/blog/meta-fa...
Demo: huggingface.co/spaces/faceb...

14.05.2025 18:12 β€” πŸ‘ 5    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0

Any take aways?

02.05.2025 23:46 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Really happy with this work led by Aaron! Take a look people!

@franknoe.bsky.social @wellingmax.bsky.social

02.05.2025 23:00 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

What did they do?

29.04.2025 02:57 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Excited to be a keynote speaker at the Netherlands Society on Biomolecule Modelling annual meeting tomorrow!

I'll be speaking about All Atom Diffusion Transformers for the first time publicly!

Thank you @erikjbekkers.bsky.social for the invitation πŸ™

www.nsbm.nl

01.04.2025 16:00 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Video thumbnail

Meet @ivonajdenkoska.bsky.social, Postdoc Researcher at the Uni Amsterdam πŸ‡³πŸ‡±. She researches multimodal #FoundationModels, developing efficient methods for vision-language understanding and generative tasks. Learn a career highlight of hers and her advice for young scientists. #WomenInELLIS #AI #ML

19.03.2025 14:27 β€” πŸ‘ 9    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0

God, that was hard to bear. Students told a physics town hall that grad schools have rescinded admission. NSF proposals are censored for words likeΒ β€œbias,” even when the meaning is technical. Physics curricula are being banned by school districts for encouraging girls. #APSGlobalSummit2025 #APSMarch

17.03.2025 00:37 β€” πŸ‘ 1192    πŸ” 476    πŸ’¬ 17    πŸ“Œ 48

Chaitanya led a very impressive paper here! Congrats and yay for unified representations!

11.03.2025 13:00 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
10 maart: Universiteit Leiden start estafettestaking tegen bezuinigingen Medewerkers van de Universiteit Leiden trappen maandag 10 maart de estafettestaking af van de Nederlandse universiteiten tegen de kabinetsbezuinigingen.

Here is tomorrow’s program. We’re meeting at 11 a.m. at the Garenmarktplein in Leiden. The program starts at 11.30. The teach outs are throughout the day in The Hague and Leiden: www.universiteitleiden.nl/en/news/2025...

09.03.2025 12:09 β€” πŸ‘ 83    πŸ” 34    πŸ’¬ 0    πŸ“Œ 5

Looks cool!

06.03.2025 06:39 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

We are experiencing an assault on science unparalleled by anything I’ve seen in my life. It’s not one issue or another anymore, the entire institution is under attack by the most powerful individuals in the country.

This Friday, where will you be?

standupforscience2025.org

02.03.2025 16:27 β€” πŸ‘ 44436    πŸ” 12141    πŸ’¬ 647    πŸ“Œ 402

Looks very cool!

26.02.2025 07:29 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
ELLIS Welcomes InvestAI Initiative as a Strong Endorsement of Its Mission The ELLIS mission is to create a diverse European network that promotes research excellence and advances breakthroughs in AI, as well as a pan-European PhD program to educate the next generation of AI...

ELLIS welcomes the InvestAI initiative as a strong step toward strengthening AI research, computing infrastructure, and talent development in Europe.

Read our full statement: ellis.eu/news/ellis-w...

#AIActionSummit

11.02.2025 19:57 β€” πŸ‘ 58    πŸ” 11    πŸ’¬ 0    πŸ“Œ 4
Post image

Get in dorks, we're going protesting!

STAND UP FOR SCIENCE WITH US ON MARCH 7TH, 2025
WASHINGTON DC AND EVERY STATE CAPITOL

Because science is for everyone!

Find us at standupforscience2025.org

#standupforscience2025 #scienceforall #sciencenotsilence

10.02.2025 23:40 β€” πŸ‘ 244    πŸ” 140    πŸ’¬ 11    πŸ“Œ 14

Doesn't the timing of this not make sense?

02.02.2025 08:11 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Figure comparing automatic differentiation (AD) and automatic sparse differentiation (ASD).

(a) Given a function f, AD backends return a function computing vector-Jacobian products (VJPs). (b) Standard AD computes Jacobians row-by-row by evaluating VJPs with all standard basis vectors. (c) ASD reduces the number of VJP evaluations by first detecting a sparsity pattern of non-zero values, coloring orthogonal rows in the pattern and simultaneously evaluating VJPs of orthogonal rows. The concepts shown in this figure directly translate to forward-mode, which computes Jacobians column-by-column instead of row-by-row.

Figure comparing automatic differentiation (AD) and automatic sparse differentiation (ASD). (a) Given a function f, AD backends return a function computing vector-Jacobian products (VJPs). (b) Standard AD computes Jacobians row-by-row by evaluating VJPs with all standard basis vectors. (c) ASD reduces the number of VJP evaluations by first detecting a sparsity pattern of non-zero values, coloring orthogonal rows in the pattern and simultaneously evaluating VJPs of orthogonal rows. The concepts shown in this figure directly translate to forward-mode, which computes Jacobians column-by-column instead of row-by-row.

You think Jacobian and Hessian matrices are prohibitively expensive to compute on your problem? Our latest preprint with @gdalle.bsky.social might change your mind!
arxiv.org/abs/2501.17737
🧡1/8

30.01.2025 14:32 β€” πŸ‘ 141    πŸ” 29    πŸ’¬ 4    πŸ“Œ 4
USAspending.gov

If you’re in the US and you’d like to know what projects and vital services federal grants currently fund in your state, you can search here: www.usaspending.gov

And you can find the contact information for your elected representatives here: www.usa.gov/elected-offi...

They need to hear from you.

28.01.2025 04:59 β€” πŸ‘ 5682    πŸ” 3410    πŸ’¬ 144    πŸ“Œ 132

πŸ™ Please help us improve the SBI toolbox! πŸ™

In preparation for the upcoming SBI Hackathon, we’re running a user study to learn what you like, what we can improve, and how we can grow.

πŸ‘‰ Please share your thoughts here: forms.gle/foHK7myV2oaK...

Your input will make a big differenceβ€”thank you! πŸ™Œ

28.01.2025 15:18 β€” πŸ‘ 18    πŸ” 8    πŸ’¬ 0    πŸ“Œ 1

USDOT has now deleted this webpage

26.01.2025 19:16 β€” πŸ‘ 706    πŸ” 272    πŸ’¬ 30    πŸ“Œ 20

Looks beautiful!

I have heard it has some weird sharp edges still though... what do you think? Have you replaced latex entirely?

24.01.2025 16:23 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

The template for this poster is now available on GitHub!

github.com/francois-roz...

24.01.2025 10:19 β€” πŸ‘ 11    πŸ” 2    πŸ’¬ 3    πŸ“Œ 0
Preview
Trump hits NIH with β€˜devastating’ freezes on meetings, travel, communications, and hiring Researchers facing

The NIH actions go far beyond the DEI crackdown. All external advisory meetings are canceled, in ones that were in progress today. That means that NIH cannot issue new grants, as external review is required by law. It's a big deal. See, e.g. www.science.org/content/arti...

23.01.2025 05:49 β€” πŸ‘ 8    πŸ” 6    πŸ’¬ 1    πŸ“Œ 0

I sadly won't attend (at least not in person) this year, but it was great fun with great people!

20.01.2025 16:40 β€” πŸ‘ 4    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0

@bkmi is following 20 prominent accounts