Defeating Nondeterminism in LLM Inference
Reproducibility is a bedrock of scientific progress. However, itβs remarkably difficult to get reproducible results out of large language models.
For example, you might observe that asking ChatGPT the...
Thinking Machines wrote a superb blog post on determinism in LLMs and it is fascinating (if you like computer architecture otherwise youβre going to tear your hair out)
spoiler: did you know GPUs have instructions that arenβt deterministic?
thinkingmachines.ai/blog/defeati...
10.09.2025 18:53 β π 67 π 15 π¬ 4 π 3
Letβs continue with the fresh new Greenland series π.
Pastel late sunset with mountain style iceberg in background & our beautiful red sails π.
21.08.2025 12:53 β π 713 π 88 π¬ 40 π 5
Henry has long been emphasizing that representative democracy is a method of thinking and decision-making, not just a way of extracting fixed preferences from a populace.
05.08.2025 14:13 β π 66 π 8 π¬ 1 π 0
SCOTUS has at no point indicated a willingness to subvert the constitution, despite conservative sentiments. Robertβs especially has consistently prioritized procedural and institutional continuity
05.07.2025 22:35 β π 0 π 0 π¬ 0 π 0
Agreed it was a crisis. But the institutions are stronger than youβre giving them credit for. Also they werenβt taking orders from them although the VP, although acting SecDef did call and consult w pence and speaker
05.07.2025 22:31 β π 0 π 0 π¬ 1 π 0
That wouldβve been a much darker day but play it out - say they get control and stop the proceedings. You actually think it would work out and all the institutions would buckle including the courts?
05.07.2025 22:27 β π 0 π 0 π¬ 1 π 0
Ha. Iβll admit w Vance instead of Pence J6 looks much darker. But surely youβd admit a constitutionally blocked 3rd term is a different animal than overturning a reelection bid? His campaign would never get off the ground
05.07.2025 22:25 β π 0 π 0 π¬ 1 π 0
I mean Trump certainly stoked the flames but you wouldnβt dispute those far right groups werenβt already willing and mobilizing?
05.07.2025 22:13 β π 0 π 0 π¬ 1 π 0
the system was stress tested and passed. Despite the bad optics & rhetoric we were never close to an *actual* constitutional crisis. Iβll admit another stress test is within the realm of possibility, but Iβd argue the inevitability of violence requiring removal from office is beyond a stretch
05.07.2025 22:11 β π 0 π 0 π¬ 1 π 0
Yes, for one that was largely supporter outrage over losing the reelection. Running for a 3rd constitutionally barred term is an entirely diff prospect. Also the court has already demonstrated willingness to rule against Trump especially Roberts. Finally, J6 is proof of my argument -
05.07.2025 22:09 β π 0 π 0 π¬ 2 π 0
Out of curiosity, what would you put the odds out of 100 that we see actual violence? That Trump/Vance make an actual autocrat play?
05.07.2025 16:18 β π 0 π 0 π¬ 1 π 0
Op did, but otherwise agree here
05.07.2025 15:16 β π 0 π 0 π¬ 1 π 0
Appreciate the pushback but Iβm aware of sham autocrat elections. Institutional strength, redundancy, and breadth is one of Americaβs greatest strengths. This isnβt completely impossible but if weβre being honest sits more as fanfic than forecast. The βinevitableβ narrative is especially hyperbolic
05.07.2025 11:03 β π 1 π 0 π¬ 1 π 0
Looking upwards from a dense forest carpet of young pines into red/brown pine trees stretching up and away from the viewer.
Sometimes when you take a new path through the forest it peters out and you're left in dense woodland. Often though, you get a fine view for your efforts. I'm sure there's a life metaphor in there somewhere. π
#hiking #nature #photography #ForestFriday #EastCoastKin #Ireland
04.07.2025 11:05 β π 157 π 21 π¬ 6 π 2
You actually believe is Trump passed tomorrow Vance would serve indefinitely and there wouldnβt be a 2028 electionβ¦? Conspiracy theory central here letβs come back to reality. Constitution, military brass, and yes even Trump appointed judges arenβt letting that happen
04.07.2025 11:38 β π 0 π 0 π¬ 1 π 0
Thrilled to announce Boltz-1, the first open-source and commercially available model to achieve AlphaFold3-level accuracy on biomolecular structure prediction! An exciting collaboration with Jeremy, Saro, and an amazing team at MIT and Genesis Therapeutics. A thread!
17.11.2024 16:20 β π 609 π 204 π¬ 18 π 25
AlphaFold is amazing but gives you static structures π§
In a fantastic teamwork, @mcagiada.bsky.social and @emilthomasen.bsky.social developed AF2Ο to generate conformational ensembles representing side-chain dynamics using AF2 π
Code: github.com/KULL-Centre/...
Colab: github.com/matteo-cagia...
17.04.2025 19:10 β π 205 π 63 π¬ 3 π 4
π₯ Benchmark Alert! MotifBench sets a new standard for evaluating protein design methods in motif scaffolding.
Why does this matter? Reproducibility & fair comparison have been lackingβuntil now.
Paper: arxiv.org/abs/2502.12479 | Repo: github.com/blt2114/Moti...
A thread β¬οΈ
19.02.2025 20:49 β π 41 π 17 π¬ 1 π 5
π’π’ "Proteina: Scaling Flow-based Protein Structure Generative Models"
#ICLR2025 (Oral Presentation)
π₯ Project page: research.nvidia.com/labs/genair/...
π Paper: arxiv.org/abs/2503.00710
π οΈ Code and weights: github.com/NVIDIA-Digit...
π§΅Details in thread...
(1/n)
04.03.2025 17:09 β π 39 π 10 π¬ 1 π 4
Excited to share our preprint βBoltzDesign1: Inverting All-Atom Structure Prediction Model for Generalized Biomolecular Binder Designβ β a collaboration with
@martinpacesa.bsky.social, @Zhidian Zhang, @Bruno E. Correia, and @sokrypton.org
𧬠Code will be released in a couple weeks
08.04.2025 12:17 β π 62 π 17 π¬ 5 π 1
Protein function often depends on protein dynamics. To design proteins that function like natural ones, how do we predict their dynamics?
@hkws.bsky.social and I are thrilled to share the first big, experimental datasets on protein dynamics and our new model: Dyna-1!
π§΅
20.03.2025 15:02 β π 103 π 38 π¬ 6 π 5
The phrase "pathologically disorganized" is used to describe a neural network trained to predict protein structure from sequence embeddings
A post by @ncfrey.bsky.social and @amyxlu.bsky.social on repurposing ESMFold for protein design, featuring one of my favorite phrases in the field ncfrey.substack.com/p/hit-the-vi...
19.03.2025 16:51 β π 15 π 4 π¬ 0 π 0
Structural biology is in an era of dynamics & assemblies but turning raw experimental data into atomic models at scale remains challenging. @minhuanli.bsky.social and I present ROCKETπ: an AlphaFold augmentation that integrates crystallographic and cryoEM/ET data with room for more! 1/14.
24.02.2025 12:22 β π 144 π 63 π¬ 6 π 5
@science.org Cryo-EM reveals mechanisms of natural RNA multivalency | Science www.science.org/doi/10.1126/...
#RNAsky #RNAbiology #Cryo-EM
13.03.2025 18:09 β π 107 π 38 π¬ 2 π 2
Awakening valley in the French Alps, with the Mt Blanc massif in background ποΈ
#photography #mountains #nature #art #landscape
13.03.2025 15:01 β π 3602 π 294 π¬ 72 π 15
A sign in front of paper bags that says, "Please have your nuts weighed at register during checkout."
And now I'm not allowed in the store anymore.
Btw, that scale was very cold.
17.02.2025 14:56 β π 52 π 7 π¬ 6 π 1
I think thereβs obviously a difference & continuum from pronouns, dress to more permanent changes. But as long as a professional is involved and itβs over time I donβt have a strong opposition at all. Let people be live authentically
15.02.2025 19:40 β π 0 π 0 π¬ 0 π 0
I donβt feel strongly about that part compared to the prisons. Shouldnβt have included it. If they want to transition with guidance from doctors and maybe parents, I donβt support denying them that
15.02.2025 19:38 β π 0 π 0 π¬ 2 π 0
Johns Hopkins PhD Student Antibody Engineering & Machine Learning
http://linkedin.com/in/mfc12
AI researcher excited about biomolecule design π§¬
PhD student at the University of Cambridge
Prev. at FAIR, Prescient Design, and MRC LMB
π https://chaitjo.substack.com
Designing peptides/proteins to program biology! π§¬π»π§« Assistant Professor at Duke | Co-Founder of Gameto and UbiquiTx | MIT SB, SM, PhD
Reporter for the Philadelphia Inquirer https://www.inquirer.com/author/blumgart_jake/
JoeD@Inquirer.com
I write about money and people
mostly for the Philadelphia Inquirer
https://www.inquirer.com/author/distefano_joseph_n/
+OFS
Associate Professor and Research Dean at UVA School of Data Science, #Rstats enthusiast, dad, runner, guitar noise-maker. Views my own.
Web: https://datascience.virginia.edu/people/stephen-turner
Newsletter: https://blog.stephenturner.us
Asst. Prof. University of Pennsylvania
Systems Immunology and Microbiome Medicine lab
#Academia #Immunology #Microbiome #SystemsBiology
Mentorship | Science communication | Research culture
Lab website: Babdorlab.com
Scientist. Christ-follower. Prof @UPenn. Director of Folding@home. Legaly blind. Father.
Media studies and communications professor
The ISV is a global not-for-profit organization that aims to encourage, establish, and promote the development and use of vaccines to prevent and control infectious and non-infectious diseases in animals and humans.
Paleoanthropologist | Chair and Professor of Anthropology, University of WisconsinβMadison π§ͺπΊπhttps://www.johnhawks.net
https://emilhvitfeldt.com/
making modeling easier in #rstats with tidymodels at @posit.co
writing about feature engineering (https://feaz-book.com/) and Slidecrafting. He/Him
Professor of democracy and international affairs. http://www.henryfarrell.net and newsletter at http://www.programmablemutter.com. Underground Empire: How America Weaponized the World Economy (Holt, Penguin). https://www.publishersweekly.com/9781250840554.
Computational biologist, data scientist, digital artist | he, him | http://clauswilke.com/ | Opinions are my own and do not represent UT Austin.
Epidemiologist, public health trainee, mom, wife. Formerly @UKHSA. Disability advocate. Born πΊπΈ Migrated π¬π§. π³οΈβπ Personal account.
Philosopher / Cognitive Scientist working on self consciousness and social interactions in humans and artificial agents/ Embodiment/ AI / Art & Science
In Lisbon & London
I hunt fake history and correct it, but also post amazing real history stuff. Rude, obscene, vulgar, racist people who can't act like grown-ups get blocked.
https://linktr.ee/fakehistoryhunter
CTO at Zymvol I develop #LightDock software & I'm the minion of my π