DeepSeek:
๐น Sparse Mixture of Experts
๐น Multi-head Latent Attention
๐น Model Distillation
What does it really mean for the future of AI?
Iโm joining Rotational this Friday, Feb 7 at 12PM ET to break it all down. Join us live on Zoom!
๐
               
            
            
                06.02.2025 19:47 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            Pushback on my latest videoโsome claim seniority is all that matters in ML hiring. Thatโs just wrong.
What actually gets you interviews?
โ Pedigree
โ Referrals
โ What you can do
These are the three biggest hiring signals in industry.
Stop listening to people who have never hired anyone.
               
            
            
                05.02.2025 16:53 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            Neural networks claim to mimic biological learning, but their training is nothing like how humans learn.
Imagine if, at birth, you were dumped with 80% of all human knowledgeโcompletely out of orderโand never allowed to learn again.
Thatโs AI today. Maybe we need a new approach?
               
            
            
                04.02.2025 22:00 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
            
                             
                        
                The Demo Culture is Ruining ML... But It Doesn't Have To
                Machine learning demos should drive real AI progress, not just hypeโlearn how to create iterative, production-ready ML systems that truly work.
            
        
    
    
            Too many ML teams use demos to impress rather than progress. A strong demo culture reduces uncertainty, builds trust, and moves toward production-ready AI. Hereโs how to fix the broken โdemo cultureโ and use it for real progress:
๐ https://buff.ly/40Z0HPX
               
            
            
                03.02.2025 23:05 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            I appreciate what you are trying to do. I have spent 14 years in ML, so may I introduce some nuance?
1. Downloading the model and using it locally does not appear to be sending data back to China. (I havenโt tried it yet)
2. I donโt know of any similar free service where you own your data.
               
            
            
                03.02.2025 22:43 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            An M2 candidate Iโve been coaching just got a FAANG offerโฆ 3 months after their final interview.
Sometimes ghosting isnโt a noโitโs just an extremely slow hiring process.
               
            
            
                03.02.2025 18:03 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
            
                             
                        
                Kevin Van Horn - Following Jaynes and Why Fundamentals Matter
                MLE Path ยท Episode
            
        
    
    
            Kevin Van Horn (30+ years in ML, ex-Adobe Sr. Staff) joins the podcast to break down Bayesian probability, optimization, and what most ML engineers get wrong. Insightful, technical, and realโtune in now! ๐ง
               
            
            
                03.02.2025 15:00 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            My friend had some great advice: bsky.app/profile/mlep...
               
            
            
                01.02.2025 04:33 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            Most ML decisions arenโt finalโbut early in your career, they feel that way.
The best engineers donโt chase perfect solutions; they design systems that are reversible. Learning to distinguish one-way vs. two-way doors is the key to moving fast in ML.
#MachineLearning #TechCareers #AIEngineering
               
            
            
                31.01.2025 21:00 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
            
                             
                        
                Meta warns that it will fire leakers in leaked memo
                Mark Zuckerberg told employees that leaking โsucks.โ
            
        
    
    
            #Meta warns that is will fire leakers in a leaked memo
Now that's meta.
               
            
            
                31.01.2025 18:08 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
                                                 
                                                
    
    
    
    
            Had a great chat with a Senior Staff ML candidate in office hours yesterdayโit reinforced something important about ML System Design interviews at higher levels.
You need to save time for a deep dive, not just cover all stages.
Hereโs how I structure my time to maximize impact.
#TechInterviews
               
            
            
                31.01.2025 17:04 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
            
                        
                Mock Interview Scheduling
                
            
        
    
    
            Having assisted numerous candidates in clearing Metaโs ML System Design interviews, Iโve observed that questions typically revolve around:
โ Recommender Systems
โ Harmful Content Detection
โ Topic Modeling (NLP) 
To book your personalized mock interview, visit mockdesignround.com #TechInterviews
               
            
            
                31.01.2025 16:31 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
            
                             
                        
                MLE Path
                Podcast ยท Ilya Reznik ยท Join MLE Path, the podcast that explores what it truly means to grow and thrive as a machine learning engineer.  Hosted by an industry veteran with over 14 years ofโฆ
            
        
    
    
            Dr. Rebecca Bilbroโs open-source advice?
โ Use OSS libraries
โ Find issues
โ Fix them with PRs
That small bit of code you always rewrite? Others do tooโcontribute it upstream.
More wisdom from Rebecca on this weekโs podcast: https://buff.ly/40ulLMw
#OpenSource #MachineLearning
               
            
            
                30.01.2025 18:57 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 1                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            My first big launch at Adobe? I was ready. Pushed the code, ran tests, went home.
Next morning: production was down. My change broke everything. I was horrified.
But I took responsibility, fixed it, and earned more trust because of it. Failure isnโt the endโitโs part of the job.
#Engineering #Tech
               
            
            
                30.01.2025 15:50 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            Big tech hiring is brutalโyou need to pass #LeetCode, but spamming 5000 problems wonโt get you there.
โ Learn what companies actually test
โ Focus on the right prep, not random grinding
โ Part 1 of 4: Breaking down MLE coding interviews
Read here: https://buff.ly/4jyu7LZ
#DSA  #TechCareers
               
            
            
                30.01.2025 13:44 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            NeurIPS 2024 felt differentโless academic, more implementation.
LLMs alone arenโt enough. Reinforcement learning, better evaluation methods, and more complex architectures are the real future.
Weโre finally moving past โjust scale it up.โ
#NeurIPS #AI
               
            
            
                30.01.2025 00:10 โ ๐ 1    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            LLMs are plateauing. OpenAI is struggling for breakthroughs. The โjust throw more data at itโ mentality is nearing its end.
This is great news for ML. We need diverse techniques, not just one overhyped approach.
#AI #MachineLearning
               
            
            
                29.01.2025 21:07 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            Using AI for interview prep? Do it right:
โ Use it to refresh, not to learn from scratch
โ Ask specific questions with context
โ Always verify you understand why the answer is correct
AI should enhance, not replace, your learning.
#TechInterviews #MachineLearning
               
            
            
                29.01.2025 17:57 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            ChatGPTโs bullet-point spacing is weirdly distinct. Once you notice it, spotting AI slop gets a lot easier.
Are we all paying more attention to this, or just me?
#AI #LLMs
               
            
            
                29.01.2025 16:02 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            Want to be an ML engineer?
โ Build an ML project for yourself firstโmake sure you enjoy it
โ Learn & fill in gaps with courses (you now know whatโs missing)
โ Build something for others
โ Apply & prep for interviews
Half of this is actively building. Thatโs how you get ahead.
#MachineLearning
               
            
            
                29.01.2025 14:01 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            MLE job hunt tip: Batch applications.
โก Apply to roles with similar requirements at once
โก Prep for specific interview types
โก Expand filters only if needed
Avoid burnout and stay focused.
#MLEngineer #JobSearch
               
            
            
                29.01.2025 01:55 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
                                                 
                                                
    
    
    
    
            Once you hit Senior MLE, whatโs next?
โก Architect: Big-picture systems
โก Tech Lead: People leadership
โก Problem Solver: Deep technical challenges
โก Right Hand: Flexible across roles
โก Manager: Strategy & teams
The real question isnโt promotionโitโs leadership.
#MachineLearning
               
            
            
                28.01.2025 21:52 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
                                                 
                                                
    
    
    
    
            OpenAI "needs" trillions of dollars...
               
            
            
                28.01.2025 20:02 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            My student just crushed the ML System Design interview and landed a Meta E5 offer:
Base: $230k
Bonus: 15%
Sign-on: $80k
RSUs: $875k over 4 years (vesting quarterly with no cliff)
Proof that hard work and preparation pay off. Huge congrats!
#MachineLearning #TechInterviews
               
            
            
                28.01.2025 18:00 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            At 19, my first ML project came from wanting to find a picture of my dad. Too many photos, no ML experienceโbut the project drove my learning.
You donโt need to wait. Start building. Solve a problem that matters to you and let it guide your growth.
#MachineLearning
               
            
            
                28.01.2025 13:51 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
                                                 
                                                
    
    
    
    
            ๐ Conducted 100+ ML System Design interviews at big techโhereโs what Iโve learned:
โ Mismanaging time = running out
โ Skipping stages = missing the big picture
Stay clear, follow these stages, and nail your interview. Timing is everything โณ
#MLSystemDesign #AI #TechInterviews #BigTech
               
            
            
                28.01.2025 01:41 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
            
    
    
    
    
            At Twitter, I shadowed an ML interview. The candidate chose C++โthey were strong, but boilerplate cost them time and impact.
ML engineers: use Python. Itโs concise, expressive, and the industry standard. Donโt let your language choice hold you back.
#Python #MachineLearning
               
            
            
                27.01.2025 23:48 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
                                                 
                                                
    
    
    
    
            AGI hype scares meโnot because itโs imminent, but because we may have "Boy who cried wolf" problem. My take: https://buff.ly/4ha9Yu9 
#AI
               
            
            
                27.01.2025 22:01 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
                            
            
            
            
    
    
    
    
            Deepseek R1 is proof that censoring LLMs is harder than anyone expected. The secrets it reveals? You donโt want to miss this. Watch the video: [link]
#AI #LLMs #TechInsights
               
            
            
                27.01.2025 20:09 โ ๐ 1    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
            
        
            
            
            
            
                                                 
                                                
    
    
    
    
            ๐ Announcing MLE Path Podcast!
๐๏ธ Candid conversations with senior ML engineers and hosted by an industry veteran (Adobe, Twitter, Meta).
๐ง Available now on Spotify, Apple Podcasts, and wherever you listen to podcasts!
#MLEPath #MachineLearning #AI #TechPodcast
               
            
            
                27.01.2025 18:01 โ ๐ 0    ๐ 0    ๐ฌ 0    ๐ 0                      
            
         
    
         
        
            
        
                            
                    
                    
                                            British, But In Las Vegas and NYC
ezitron.76 Sig
Newsletter - wheresyoured.at
https://linktr.ee/betteroffline - podcast w/ iheartradio 
Chosen by god, perfected by science 
CEO at EZPR.com - Award-Winning Tech PR
                                     
                            
                    
                    
                                            AI and cognitive science, Founder and CEO (Geometric Intelligence, acquired by Uber). 8 books including Guitar Zero, Rebooting AI and Taming Silicon Valley.
Newsletter (50k subscribers): garymarcus.substack.com
                                     
                            
                    
                    
                                            Create and share social media content anywhere, consistently.
Built with ๐ by a global, remote team.
โฌ๏ธ Learn more about Buffer & Bluesky 
https://buffer.com/bluesky
                                     
                            
                    
                    
                                            Artist
AI Researcher
Explorer
On Twitter: https://www.twitter.com/kai_mav_art
                                     
                            
                    
                    
                                            Data Scientist, coffee addict, blerd, and drummer. Octavia Butler stan. Trekkie, survivalist, and pole dancer. ADHDer, elder emo, horror movies, & video games๐ค
Book Clerbs: 
The AI Con โก๏ธ lu.ma/q3won50t 
Data Grab โก๏ธ lu.ma/r79kprlz
                                     
                            
                    
                    
                                            Machine Learning, Data Science, Math
                                     
                            
                    
                    
                                            PhDing in Machine Learning & Neuroscience @ETH Zurich. I also like music quite a bit. Mostly doing things for the plot.
https://yassine.fyi
                                     
                            
                    
                    
                                            Data scientist, teacher, and author of the "Deep Learning with PyTorch Step-by-Step" series.
https://pytorchstepbystep.com
                                     
                            
                    
                    
                                            AI Researcher working on AI for Science
Research Scientist II @ Georgia Tech | Prev Research Scientist @ Naver Labs Europe | Prev Board Member @ ContinualAI | PhD from RIT | https://tyler-hayes.github.io
                                     
                            
                    
                    
                                            Rogue game theorist and RL scientist in ๐จ๐ฆ. Formerly: co-founder Artificial.Agency, RS DeepMind, PhD UAlberta, Poker AI. Gaming ๐ฎ๐ฒ, curling ๐ฅ, knitting ๐งถ, geocaching ๐บ๏ธ. (he/him).
                                     
                            
                    
                    
                                            Education, robotics and AI developments, and ... book reviews? Worked at facebook, amazon, espark, tempus.
                                     
                            
                    
                    
                                            Machine Learning with Patents granted & filed | Current focus on LLM/GenAI | Graph Analytics
                                     
                            
                    
                    
                                            ๐ค ml engineer in web3 security
๐ ai paper summaries on code, web3 and security
                                     
                            
                    
                    
                                            Robotics PhD Candidate @GeorgiaTech studying  #RL and 
#AI
I mostly tweet about #AI, #robots, #science, and #3dprinting
My thoughts and opinions are my own.
jballoch.com
                                     
                            
                    
                    
                                            Still the same me as Twitter/X @NathanWilkes just in an Altered State - getting less angry and doing cooler things.
AI, Consciousness, Infosec, Data Science, Health Care, Engineering, and lots of weird little hobbies that will make sense in the end.
                                     
                            
                    
                    
                                            Startup Investor | Exploring venture insights with a fresh, casual twist. From AI to economics, sociology to tech โ real conversations, bold ideas, endless curiosity.โ๏ธ
๐ผ https://www.linkedin.com/in/arkassym/
๐ https://armankassym.com/
                                     
                            
                    
                    
                                            AI Prof at TU Darmstadt, Founding Co-Director Hessian.AI, DFKI, AAAI/EurAI/AAIA/ELLIS Fellow, AAAI24 Ass. PC CoChair, Fmr. PC CoChair UAI, ECML PKDD, Invest. @Aleph__Alpha, Fmr. AI Column German Newspaper Welt (am Sonntag) 
                                     
                            
                    
                    
                                            Deep learning / AI researcher at the Max Planck Institute of Animal Behavior and the University of Konstanz, Germany. Working on LLMs for animals.
Personal: https://jcsz.phd
Research Group: https://cocomo.group
Department: https://ab.mpg.de/crofoot
                                     
                            
                            
                    
                    
                                            Researcher trying to shape AI towards positive outcomes. ML & Ethics +birds. Generally trying to do the right thing. TIME 100 | TED speaker | Senate testimony provider | Navigating public life as a recluse. 
Former: Google, Microsoft; Current: Hugging Face