Torsten Hoefler πŸ‡¨πŸ‡­'s Avatar

Torsten Hoefler πŸ‡¨πŸ‡­

@thoefler.bsky.social

Professor ETHZ, head of SPCL, Chief Architect ML at CSCS researching large-scale #HPC and #AI systems and #Climate computing - youtube: http://bit.ly/3h1VgIU

510 Followers  |  18 Following  |  189 Posts  |  Joined: 17.11.2024
Posts Following

Posts by Torsten Hoefler πŸ‡¨πŸ‡­ (@thoefler.bsky.social)

Post image Post image

Congratulations to Marcin Chrapek for his successful PhD defense πŸŽ“οΈ. SPCL's 15th doctoral graduate released into the wild to do all kinds of good.

Study his papers to learn about confidential #HPC and secure #AI systems!

Thanks to all committee members for their insightful comments and presence.

02.03.2026 17:06 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Last reminder 🚨 . Only two days left to nominate your favorite young researcher in #HPC for the Jack Dongarra early career award!

One of the highest awards for young researchers in the field on honor of our dear friend Jack πŸŽ“οΈ.

buff.ly/zJHvUUO

24.02.2026 12:58 β€” πŸ‘ 2    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image

Thanks Philipp for another proud advisor moment! The committee explicitly highlighted the well delivered defense - congratulations πŸŽ‰.

SPCL's 14th PhD graduate released to the wild to make the #HPC and #AI computational world a better/faster/more efficient place.

20.02.2026 18:05 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image Post image

It's always exciting when research topics receive attention on national TV. CNA, one of Asia's premier TV stations reports on Singapore's $1bn AI for Science and highlights our AI for Health collaboration with Ben Helgason and Bryan Tan, part of my AI Visiting Professorship!

Watch: buff.ly/28Ck77Q

05.02.2026 05:10 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
ADIA Lab - Senior Computational Scientist - Material Sciences - Abu Dhabi Investment Authority ADIA Lab, an independent research institution based in Abu Dhabi specializing in data and computational sciences, is seeking a Senior Computational Scientist with a focus on Material Sciences. This…

πŸ”¬βš™οΈ Big opportunity in materials science + #HPC at ADIA Lab β€” ideal for experts advancing computational materials research, high‑performance simulations, and data‑driven discovery.

Explore the role: buff.ly/dMvhjKL

Horst Simon, Amelie Koch, and the whole ADIA Lab team are great.

A unique chance!

31.01.2026 14:50 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I'll be there as well :-)

31.01.2026 14:43 β€” πŸ‘ 1    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Post image Post image

Rio Yokota on the #SCA2026 fishbowl panel: "I don't think humans are in any way more trustworthy than an advanced AI" - "In the same way we trust other humans, we could develop trust to AIs" - "If people or AI generate code - how do we know there is no bug inside?" profound thoughts by a wise man.

28.01.2026 02:35 β€” πŸ‘ 1    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

Yes, good point, need to fix the colors for big screens πŸ˜€

27.01.2026 01:42 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Great talk as always by @thoefler.bsky.social - fully of enthusiasm with mix of technical and asides - but we need to have a chat about legibility of your slides! 😁 (Eg red text on green background)

27.01.2026 01:17 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0
Post image

Keynote at #SCAsia / #HPC Asia

@thoefler.bsky.social being introduced by Rio Yokota

#UltraEthernet for Next Generation #AI and #HPC workloads

27.01.2026 00:53 β€” πŸ‘ 9    πŸ” 3    πŸ’¬ 1    πŸ“Œ 0
Post image Post image Post image Post image

On the way to SCAsia 2026 in Japan! I'm honored to present the opening keynote to this year's record attendance of more than 2,500 people :-).

I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal πŸŽ‰!

Looking forward to see many of you in Osaka this week!

26.01.2026 02:42 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image Post image

Exciting Singapore AI Research Week Gala Dinner. I was honored to spend an insightful evening sitting next to the guest of honor - Josephine Teo, Minister for Digital Development and Information. A remarkable person!

Fun to also meet my AI Visiting Professor partners – Bryan Tan πŸ₯ and Jingyu Wang 🌏

25.01.2026 06:30 β€” πŸ‘ 2    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Post image Post image

Our discussion of challenged and opportunities with in-network collective communication for #AI has been featured in IEEE Computer's January issue πŸ“–. Check out page 24ff!

It currently tops the list of trending articles πŸš€.

Check it out: buff.ly/sz4yGzk

#HPC #Networking

21.01.2026 05:00 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
Job advertisement Faculties

🌍 Shape the future of HPC for Climate Research in Germany!

Uni Hamburg is hiring a director for computing centerβ€”advancing large‑scale simulations, data‑intensive workflows, and cutting‑edge infrastructure for climate and earth system science.

Apply πŸ‘‰ buff.ly/aF6wruR

#HPC #Climate #Supercomputing

19.01.2026 06:41 β€” πŸ‘ 4    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
AI for Climate Sciences Β· Luma What would it actually take to build an AI climate scientist? Climate research already relies on large-scale simulations, physical models, and vast…

I'm looking forward to speak about MDDI's #AI for #Climate at next week's Lorong AI meetup in Singapore next Tuesday!

Join us if you are around:

16.01.2026 04:00 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image Post image

The "best #GYSS25" came to an end. Ideas and experiences are still buzzing in my head 🧠.

Thanks for the great organization!

We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC πŸ€– :-)

My talk is already online πŸŽ₯: buff.ly/WyToOgm . Jack's will follow soon.

12.01.2026 07:46 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image Post image

I am honored to be named IAS Lee Kong Chian Distinguished Professor at the Nanyang Technological University (NTU) Singapore and give a public lecture today 03.15 PM - 05.40 PM in SHHK Auditorium (HSS) at NTU.

buff.ly/JQMSRcf

I will talk about #AI for #Climate - join us if you're around!

06.01.2026 23:15 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Global Young Scientists Summit The Global Young Scientists Summit in Singapore brings together bright young researchers and top scientific minds from around the world...

I'm very much looking forward to my plenary lecture and fireside chat at the 10th iteration of the famous GYSS summit in Singapore.

buff.ly/aVKwfbc

A humbling experience as one of the 21 laureates and 350 attendees. Find me if you're here πŸ˜€.

05.01.2026 01:00 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Ultra Ethernet for next-generation AI and HPC workloads Host: Sujata Banerjee Speakers: Torsten Hoefler, Microsoft and ETH Zurich; Abdul Kabbani, Microsoft The Ultra Ethernet Consortium set out to redefine Ethernet-based interconnects for AI and…

Just as we start into the new year, our Ultra Ethernet tutorial with all background exceeds 1,000 views on youtube!

If you prefer reading: buff.ly/Pmq1Xrr

Opened by Saurabh Dighe and featuring Abdul Kabbani on Congestion Control!

πŸ“½οΈ buff.ly/UGvjR1N

Building future #AI and #HPC #networking!

02.01.2026 06:00 β€” πŸ‘ 5    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image Post image

A special memory of Piz Daint - once Europe's fastest and first large #GPU #supercomputer

After 13 years of service at #ETH #CSCS, it retired from service. Those two blades shall live on as a milestone in Swiss and European history!

Better than spatulas #nvidia? Enjoy the festive season πŸŽ„ #AI #HPC

26.12.2025 06:00 β€” πŸ‘ 10    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image

Switzerland, where you go with your hybrid car by electric train to the mountains πŸ”οΈ. Always cool.

Happy holidays! ❄️

24.12.2025 07:42 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

With the year slowly winding down, we took a bit of time to get together, celebrate and reflect on the amazing 2025 journey and all the learnings and achievements during our Xmas dinner last Friday.πŸŽ„

Happy holidays & 2026, here we come!πŸš€πŸ₯³

#HPC #AI @thoefler.bsky.social @csateth.bsky.social

22.12.2025 08:04 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image Post image

NVIDIA explains why they used FP8 as a scaling factor in NVFP and not MXFP-style E8M0.

The idea is to preserve the largest value in each block.

buff.ly/SjwVr6w (16:00 ff)

We found this to be very true in a study and managed to recover some MXFP accuracy with micro-rotations: buff.ly/gXaCAhF

22.12.2025 06:00 β€” πŸ‘ 4    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image Post image

Programming modern accelerators uses more and more complex forms of parallelism for example pipelining loading and computing at all levels.

buff.ly/K85kokX

Check out Tiziano's FBLAS and SMI for some fundamentals behind pipelining in applications and networks!

buff.ly/wPnHfaJ

buff.ly/65mQo7q

17.12.2025 06:00 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image

Jeff Hammond from NVIDIA gives some historical context on NCCL's lineage going back to MPI, similarly for NVSHMEM. #AI is rooted in a strong #HPC networking history!

buff.ly/kMPnbBf (04:00)

Learn more about NCCL details in our paper: buff.ly/doin5bt

15.12.2025 06:00 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image Post image

Celebrating 15 years of the ETH Singapore Center! An impressive journey with one of the quickest growing economies featuring a fabulous R&D story.

The SEC is happy to be part of that history. SPCL and I are proud join the future of this journey.

#AI #HPC for Good.

10.12.2025 17:10 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

True - how much latency does a retimer add these days?

08.12.2025 07:37 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image

Nice overview of PCIe 6.0 key metrics and development - a key goal was to not increase the latency by more than 10ns. Total FEC latency goal <2ns!

Watch: buff.ly/c9hBJcV

08.12.2025 06:00 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image Post image Post image Post image

Ilya Sutskever: "Compression is prediction and vice versa." (15:10).

A good compressor will exploit the shared structure - now this forms a strong mathematical reason for exploiting all information in the unlabeled data - independently of the later tasks.

Watch: buff.ly/Bnvazym

03.12.2025 06:00 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image Post image

I talked about a path towards an "AI Climate Scientist" at the ADIA Lab Symposium in Abu Dhabi and the Spanish Royal Academy in Madrid.

Some ways to combine #AI and #HPC to address the data and computational challenge in #Climate sciences and accelerate insights.

Watch now: buff.ly/7qeGuqf

01.12.2025 06:00 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0