The Hard(ware) Part of AI - Awesome MLSS Newsletter
2nd Edition
AI is hard. Each day we're contending with hundreds of new models, "State of the Art" is now a bi-weekly update
But what about the hardware revolution? Check out our latest newsletter: newsletter.awesome-mlss.com/p/the-hard-w...
Join us as we explore "The Hard(ware) Part of AI" in ourΒ secondΒ issue
26.04.2025 08:42 β π 0 π 0 π¬ 0 π 0
Interesting thread/piece.
One fun thing about this AGI-by-2027 stuff is, we get to find out of it's true, pretty soon!
24.04.2025 17:30 β π 36 π 8 π¬ 2 π 0
π‘ New ICLR paper! π‘
"On Linear Representations and Pretraining Data Frequency in Language Models":
We provide an explanation for when & why linear representations form in large (or small) language models.
Led by @jackmerullo.bsky.social, w/ @nlpnoah.bsky.social & @sarah-nlp.bsky.social
25.04.2025 01:55 β π 42 π 12 π¬ 3 π 3
To all our followers, do remember to take time for yourself!
25.04.2025 09:21 β π 0 π 0 π¬ 0 π 0
βοΈ Headed to @iclr-conf.bsky.social β whether youβll be there in person or tuning in remotely, Iβd love to connect!
Weβll be presenting our paper on pre-training stability in language models and the PolyPythias π§΅
π ArXiv: arxiv.org/abs/2503.09543
π€ PolyPythias: huggingface.co/collections/...
22.04.2025 11:02 β π 5 π 3 π¬ 1 π 0
Human-AI cooperation is important, but existing work trains on the same 5 Overcooked layouts, creating brittle strategies.
Instead, we find that training on billions of procedurally generated tasks trains agents to learn general cooperative norms that transfer to humans... like avoiding collision
19.04.2025 05:02 β π 17 π 4 π¬ 1 π 0
Just shared a new article on "The State of Reinforcement Learning for LLM Reasoning"!
If you are new to reinforcement learning, this article has a generous intro section (PPO, GRPO, etc)
Also, I cover 15 recent articles focused on RL & Reasoning.
π magazine.sebastianraschka.com/p/the-state-...
19.04.2025 13:48 β π 61 π 10 π¬ 1 π 2
Digital Futures Institute announces eleven new Fellows for 2025-26
Eleven interdisciplinary projects awarded Fellowships from the Digital Futures Institute for the 2025-26 cohort.
π Meet our eleven new Digital Futures Institute Fellows!
Congratulations @lboungr.bsky.social, Rowan Boyson, Mark Cote, Amrita Dhillon, Alex Gould, Elisabeth Kelan, @niccoloridi.bsky.social, Gabriele Salciute Civiliene, Astrid Van den Bossche, @jamiewoodcock.bsky.social & @lorenzoz.bsky.social π½
15.04.2025 10:53 β π 13 π 7 π¬ 1 π 1
awesome MLSS Newsletter
Stay ahead with bi-weekly updates on new machine learning summer schools, upcoming deadlines, and latest research news.
SUMMER SCHOOL ANNOUNCEMENT
AI4Science Summer School deadline is in ONE DAY! Make sure you apply. For more information, go to awesome-mlss.com/summerschool...
We also have a biweekly newsletter for you. To subscribe, head on to newsletter.awesome-mlss.com/subscribe
19.04.2025 17:29 β π 0 π 0 π¬ 0 π 0
Speculating with a friend today about the @iclr-conf.bsky.social Test of Time award and we were trying to see if any papers could compete with Bahdanau et al (ie ATTENTION) but uh apparently we didnβt notice the just announced winner: Kingma & Ba (ADAM). Damn. ICLR 2015 was STACKED.
15.04.2025 01:38 β π 28 π 1 π¬ 3 π 1
Very interesting findings, thank you @wissamantoun.bsky.social
15.04.2025 04:14 β π 2 π 0 π¬ 0 π 0
Machine Learning Summer School Guide
Find machine learning and artificial intelligence summer schools worldwide by topics, locations, dates, and deadlines. Natural Language Processing, Computer Vision, Reinforcement Learning, and more.
SUMMER SCHOOL ANNOUNCEMENT
There are ML Summer Schools with deadlines less than ten days away! Follow deadlines here: awesome-mlss.com
Most urgent:
BAI Summer School on AI Agents and Agentic Systems 2025 - 1 day
AutoML School 2025 - 4 days
AI4Science Summer School 2025 - 6 days
14.04.2025 05:31 β π 2 π 2 π¬ 0 π 0
The transformer was invented in Google. RLHF was not invented in industry labs, but came to prominence in OpenAI and DeepMind. I took 5 of the most influential papers (black dots) and visualized their references. Blue dots are papers that acknowledge federal funding (DARPA, NSF).
12.04.2025 02:35 β π 108 π 24 π¬ 2 π 0
Just finished The AI Mirror by @shannonvallor.bsky.social. Very highly recommended. Transcending the stale accelerationist/doomer debate, Vallor reminds us what technology is for, and where (some of the) true dangers of AI lie. Powerful stuff, eloquently written global.oup.com/academic/pro...
13.04.2025 15:08 β π 57 π 9 π¬ 1 π 0
Though to be fair, it didnβt do quatrains, so I asked for them
14.04.2025 04:24 β π 5 π 1 π¬ 0 π 0
Now the paper is also on arxiv and can be easily cited:
arxiv.org/abs/2504.07128
11.04.2025 12:57 β π 1 π 1 π¬ 1 π 0
Fun options: ask for an arcade game, a 3D game, a strategy game, etc.
And donβt be satisfied with the first result, push back and ask for improvements.
11.04.2025 13:17 β π 14 π 1 π¬ 0 π 0
Paper page - SmolVLM: Redefining small and efficient multimodal models
Join the discussion on this paper page
Today, we share the tech report forΒ SmolVLM: Redefining small and efficient multimodal models.
π₯ Explaining how to create a tiny 256M VLM that uses less than 1GB of RAM and outperforms our 80B models from 18 months ago!
huggingface.co/papers/2504....
08.04.2025 15:12 β π 22 π 8 π¬ 2 π 1
π€ **Why join?**
1οΈβ£ Explore a rich, large-scale dataset for mobile sensing research.
2οΈβ£ Receive feedback for your work from an expert TPC.
3οΈβ£ Accepted papers will be invited to submit an extended version to @ieeepervasive.
4οΈβ£ Get the chance to win the Best Paper Award.
25.03.2025 13:14 β π 1 π 2 π¬ 0 π 0
The 2025 AI Index Report | Stanford HAI
Stanford HAI releases 2025 AI index Report with cross domain data on how AI is impacting our lives hai.stanford.edu/ai-index/202... @stanfordhai.bsky.social
11.04.2025 04:37 β π 0 π 0 π¬ 0 π 0
Brilliant work!
10.04.2025 18:36 β π 0 π 0 π¬ 0 π 0
The deadline for the EoI is tomorrow (April 11th)!
We have:
β¨6 confirmed speakers.
β¨A session on interdisciplinary research.
β¨A tutorial.
β¨A panel discussion.
β¨Poster and networking sessions.
10.04.2025 14:15 β π 2 π 3 π¬ 0 π 1
AI Agents x Law Initiative
A New Stanford and Industry Initiative Launched Yesterday
Great event on Tuesday at @stanfordhai.bsky.social convened by Dazza Greenwood and concluding talk by @tobinsouth.bsky.social around the legal landscape and challenges with #AIAgents. Recommend watching the recording and providing feedback here:
www.dazzagreenwood.com/p/ai-agents-...
10.04.2025 17:01 β π 3 π 1 π¬ 0 π 0
Hi Fabian, Awesome MLSS is a non profit group that helps students find ML Summer Schools, and information on AI related events in general. Would love to speak with you!
10.04.2025 04:35 β π 0 π 0 π¬ 0 π 0
FΓΆrderinitiative βKΓΌnstliche Intelligenzβ
The DFG is funding independent research groups in AI (tinyurl.com/36f5m6kd). If you're interested in coming to GΓΆttingen (Germany) by applying for one of these groups, we have an online event to inform you what the process is and how we could support you (tinyurl.com/yfpeambm). Check it out!
07.04.2025 20:48 β π 10 π 6 π¬ 1 π 2
That is indeed good news.
10.04.2025 04:27 β π 0 π 0 π¬ 0 π 0
When we read the news, images can convey different things than text itself.
Unlike other works which look at text, we study this as a βmultimodalβ framing problem & analyze where text and images communicate different βframesβ.
Checkout our paper here: arxiv.org/abs/2503.20960
@aicentre.dk
07.04.2025 17:15 β π 28 π 5 π¬ 1 π 1
πΆ The Digital Futures Institute brings together expertise from across all disciplines at Kingβs to forge a better relationship between the individual and technology: kcl.ac.uk/digital-futures
International Conference on Learning Representations https://iclr.cc/
computational cognitive neuroscientist (assoc prof
@unigroningen.bsky.socialc) studying mind-wandering using cogsci and AI techniques, also amateur ballet dancer and Tibetan buddhist
CS prof at Penn, Amazon Scholar in AWS. Interested in ML theory and related topics, as well as photography and Gilbert and Sullivan. Website: www.cis.upenn.edu/~mkearns
Multimodal research @huggingface
Understanding life. Advancing health.
Philosopher/AI Ethicist at Univ of Edinburgh, Director @technomoralfutures.bsky.social, co-Director @braiduk.bsky.social, author of Technology and the Virtues (2016) and The AI Mirror (2024). Views my own.
Professor of AI, society, media and democracy + Political Communication, U Amsterdam || Director of Digital Democracy Centre, SDU || AlgoSoc || AIMD || Mix of work and private stuff ||
π©π°π³π±πͺπΊππΌπ§ͺβοΈπΏπΆπ₯π¦
Professor at Wharton, studying AI and its implications for education, entrepreneurship, and work. Author of Co-Intelligence.
Book: https://a.co/d/bC2kSj1
Substack: https://www.oneusefulthing.org/
Web: https://mgmt.wharton.upenn.edu/profile/emollick
prof @laws.ucl.ac.uk, technology, law, policy, society, whimsical latvian top level domain names. michae.lv and fediverse https://someone.elses.computer/@mikarv π³οΈβπ
Professor a NYU; Chief AI Scientist at Meta.
Researcher in AI, Machine Learning, Robotics, etc.
ACM Turing Award Laureate.
http://yann.lecun.com
Cognitive scientist, philosopher, and psychologist at Berkeley, author of The Scientist in the Crib, The Philosophical Baby and The Gardener and the Carpenter and grandmother of six.
Technology and politics.
Newsletter https://bit.ly/3AELZDu
Foundations of AI https://bit.ly/3WiYJab
Law https://bit.ly/40YL1fU
Research Fortnight https://bit.ly/4i0
https://signal.me/#eu/xNzjw2P7XIGjBfdQicHbMp0V5SuVpgCQOeUZNpDRqH-mkt2Tan9G6Y0ZitEKsVkN
Academic; writer. Professor of AI & Society, Chair-Director @kings-dfi.bsky.social, Kingβs College London. Come for the sex robots; stay for the eye-rolling at AI nonsense on a daily basis. #academicsky . Norn Irish in Norwich.
Professor, researcher, maker of things
~Book: Atlas of AI
~Installation: Calculating Empires
~NYT video: AI's Real Environmental Impact https://www.nytimes.com/2025/09/26/opinion/ai-quartz-mining-hurricane-helene.html
Founder & PI @aial.ie, @tcddublin.bsky.social
AI accountability, AI audits & evaluation, critical data studies. Cognitive scientist by training. Ethiopian in Ireland. She/her
Professor in Science and Technology Studies, UCL @stsucl.bsky.social. Science policy, responsible innovation, emerging technologies. Book https://link.springer.com/book/10.1007/978-3-030-32320-2. Responsible AI UK (www.rai.ac.uk)
Natural Language Processing group at Cardiff University.
#NLProc #NLP
Into creative ML/AI, NLP, data science and digital humanities, narrative, infovis, games, sf & f. Consultant, ds in Residence at Google Arts & Culture. (Lyon, FR) Newsletter arnicas.substack.com.