Pasquale Minervini

@togelius.bsky.social has thoughts on Genie 3 and games togelius.blogspot.com/2025/08/geni...

Fairly close to my own, though I didn't get the preview the tech.

Walking around a generated image-to-image world is not the same as playing a game. There are no game objectives.

diagram from Anthropic paper with an icon & label that says “subtract evil vector”

quick diagram of Bluesky’s architecture and why it’s nicer here

*Test-Time

Anthropic researchers discover the weird AI problem: Why thinking longer makes models dumber Anthropic research reveals AI models perform worse with extended reasoning time, challenging industry assumptions about test-time compute scaling in enterprise deployments.

Anthropic research identifies “inverse scaling in test-time compute,” where longer reasoning degrades AI performance. On certain tasks, models become more distracted by irrelevant data or overfit to spurious correlations.
#MLSky

Supermassive congrats to Giwon Hong (@giwonhong.bsky.social) for the amazing feat! 🙂

Still not as bad as Microsoft Teams

The amazing folks at EdinburghNLP will be presenting a few papers at ACL 2025 (@aclmeeting.bsky.social); if you're in Vienna, touch base with them!

Hm, hard disagree here. I really fail to see how this is misconduct akin to bribery, it's just a defense mechanism against bad reviewing practices. @neuralnoise.com

🚨 New Paper 🚨
How effectively do reasoning models reevaluate their thought? We find that:
- Models excel at identifying unhelpful thoughts but struggle to recover from them
- Smaller models can be more robust
- Self-reevaluation ability is far from true meta-cognitive awareness
1/N 🧵

Three panels at the top describe task types with example prompts: 1. Simple Counting Tasks with Distractors (Misleading Math & Python): • Prompts mention an apple and an orange, with added irrelevant or confusing information (e.g., probabilistic riddle, Python code) before asking the straightforward question: “Calculate how many fruits you have.” 2. Regression Tasks with Spurious Features (Grades Regression): • Given XML-style records about a student, the model must predict grades from features like sleep hours, social hours, and stress level. The challenge lies in identifying relevant vs. spurious attributes. 3. Deduction Tasks with Constraint Tracking (Zebra Puzzles): • Complex logical reasoning puzzle with multiple interrelated clues. Example: “What position is the person who likes salmon at?” Constraints involve foods, names, and relationships like “to the left of.” Bottom row contains 3 line plots comparing model performance across tasks: • Misleading Math (Left Plot): • Accuracy drops sharply for some models as reasoning tokens increase. Claude Sonnet 4 maintains high performance. o3 and DeepSeek R1 hold relatively stable accuracy; Qwen3 32B and QwQ 32B drop more. • Grades Regression (Middle Plot): • Shows negative RMSE (higher is better). Claude models remain strong across token counts; o3 also performs well. Qwen3 and QwQ struggle, with DeepSeek R1 performing modestly. • Zebra Puzzles (Right Plot): • Accuracy vs. average reasoning tokens. o3 and Claude Sonnet 4 maintain highest performance. Other models (e.g., DeepSeek R1, Qwen3 32B, QwQ 32B) show performance degradation or plateaus. Error bars reflect variability. Each plot uses colored lines with markers to indicate different model names.

Inverse scaling of reasoning models

a research collab demonstrated that there are certain types of tasks where all top reasoning models do WORSE the longer they think

things like getting distracted by irrelevant info, spurious correlations, etc.

www.arxiv.org/abs/2507.14417

Reasoning is about variable binding. It’s not about information retrieval. If a model cannot do variable binding, it is not good at grounded reasoning, and there’s evidence accruing that large scale can make LLMs worse at in-context grounded reasoning. 🧵

Hi @ilsebyl.bsky.social welcome to bsky! 🚀🚀🚀

Paper page - Inverse Scaling in Test-Time Compute Join the discussion on this paper page

Sometimes, too much reasoning can hurt model performance! New research by Anthropic (@anthropic.com), by Aryo Pradipta Gema (@aryopg.bsky.social) et al.: huggingface.co/papers/2507....

“LLMs can’t reason” 😅

My "Math, Revealed" series is freely available to anyone -- no paywall! -- in the thread below.

There is a few more for another prompt and that’s it

Spotlight poster coming soon at #ICML2025
@icmlconf.bsky.social!
📌East Exhibition Hall A-B E-1806
🗓️Wed 16 Jul 4:30 p.m. PDT — 7 p.m. PDT
📜 arxiv.org/pdf/2410.12537

Let’s chat! I’m always up for conversations about knowledge graphs, reasoning, neuro-symbolic AI, and benchmarking.

What Counts as Discovery? Rethinking AI’s Place in Science

This essay by Nisheeth Vishnoi is a thoughtful meditation on the nature of science and a rebuttal to the notion that AI systems are going replace human scientists anytime soon. Worth reading.

nisheethvishnoi.substack.com/p/what-count...

"in 2025 we will have flying cars" 😂😂😂

Flowchart of the AXIS algorithm with 5 parts. The top-left has the memory, the centre-left has the user query, the centre-bottom has the final explanation, the centre has the LLM, and the right has the multi-agent simulator.

Screenshot of the arXiv paper

Preprint alert 🎉 Introducing the Agentic eXplanations via Interrogative Simulations (AXIS) algo.

AXIS integrates multi-agent simulators with LLMs by having the LLMs interrogate the simulator with counterfactual queries over multiple rounds for explaining agent behaviour.

arxiv.org/pdf/2505.17801

'AI Safety for Everyone' is out now in @natmachintell.nature.com! Through an analysis of 383 papers, we find a rich landscape of methods that cover a much larger domain than mainstream notions of AI safety. Our takeaway: Epistemic inclusivity is important, the knowledge is there, we only need use it

Can you train a performant language model using only openly licensed text?

We are thrilled to announce the Common Pile v0.1, an 8TB dataset of openly licensed and public domain text. We train 7B models for 1T and 2T tokens and match the performance similar models like LLaMA 1 & 2

COLM (@colmweb.org‬) reviewers, please follow up on author responses if you need to! Most of the papers in my area chair batch didn't receive reviewer follow-ups, and it's dire

Hi @veredshwartz.bsky.social !!! 🙂

Yeah but do we need the APIs if agents can just use the browser?

claude-code is pretty good at updating personal websites! it has browser use, so it can e.g. scrape your latest papers from arxiv and dblp and use that to update your website's publication list

“You must never be fearful about what you are doing when it is right.” -- Rosa Parks

🗓️ Deadline extended: 💥2nd June 2025!💥

We are looking forward to your works on:

🔌 #circuits and #tensor #networks 🕸️
⏳ normalizing #flows 💨
⚖️ scaling #NeSy #AI 🦕
🚅 fast and #reliable inference 🔍
...& more!

please share 🙏

Self-hyping!

This is a new experience: people using AI to overhype your paper 🫢

@neuralnoise.com