HPC Engineering @ AWS

AWS Parallel Computing Service now supports AWS CloudFormation, enabling you to deploy and scale HPC workloads as code. Check out our open-source HPC Recipes Library for quick cluster deployments. #HPC https://buff.ly/4hetshj

Caris Life Sciences accelerated their genomic data processing from months to just 2.5 days using AWS services like Batch, ECS, and Spot Instances. Learn how they achieved this remarkable feat in our latest blog post. https://buff.ly/4hgzIVQ

Call For Proposals (CFP) | LF Events HPSFcon marks the inaugural gathering of the High Performance Software Foundation. The first two days are dedicated to the overall HPSF community, providing an update on HPSF activities…

The Call for Proposals is open for the innaugural HPSF Conference in Chicago in May. Details here: https://buff.ly/3EfqpGS - please come along and help us build this community into something stronger and ever more sustainable.

What if you could simulate ball impacts in the blink of an eye? Our new blog post reveals how advanced ML models are transforming transient response prediction for safer, more resilient products. https://buff.ly/3E40DFo

In May the HPSF is holding it's first ever community meeting to bring the brightest minds in HPC software together. It's dedicated to advancing community-driven solutions for performance, portability, and productivity for our whole community. Details here: https://buff.ly/4gYiood - Join us!

Cryo-EM data processing just got easier! Learn how AWS Parallel Computing Service can help structural biologists scale their HPC infrastructure for Cryo-EM research. #CryoEM #AWS #HPC https://buff.ly/3Wc9co4

It’s been a big year in the HPC team at AWS. I’m awed by all of you who’ve invented new things to solve hard problems - it’s my reason to get up every morning. I’m spending the holidays working on some personal projects. Hope you do whatever brings you joy. And rest. Much peace and love folks.🌈🎅❤️

Research and Engineering Studio on AWS Version 2024.12 now available - AWS Discover more about what's new at AWS with Research and Engineering Studio on AWS Version 2024.12 now available

The changes to auth and identity options in this new release of RES are pretty significant too. We’ll have more to say about all this in the new year. But this is neat stuff.

Announcing CloudFormation support for AWS Parallel Computing Service - AWS Discover more about what's new at AWS with Announcing CloudFormation support for AWS Parallel Computing Service

This is a big deal. Full CloudFormation support for Parallel Computing Service is live & HPC Recipes updated (thanks Matt Vaughn).

The future has definitely arrived. This is how HPC should be done.

Explore how Research and Engineering Studio on AWS (RES) enables admins to build Trusted Research Environments (TREs) with built-in security and compliance controls. Learn more in our latest blog post. https://buff.ly/3VLXZKz

Curious about running AI-powered protein folding analyses on AWS? Quantori's new solution makes it easy to test generative models and visualize results in your own cloud environment. https://buff.ly/49JMOYr

With $22B in assets under management, BAM needed an effective solution to empower their 160 investment teams. Learn how they harnessed AWS Batch and Amazon EKS to push the boundaries of financial research. https://buff.ly/3BmVDL6

Discover how AWS Batch's multi-container features enable large-scale AV/ADAS simulations with the IPG CarMaker simulator. Learn about the challenges of integrating complex, interdependent vehicle systems. https://buff.ly/3Br6R1g

Congratulations to the 5 winning teams of the Airbus and BMW Group Quantum Computing Challenge! Their innovative proposals tackled real-world industry use cases demonstrating the transformative potential of quantum computing. Read more about their groundbreaking work. https://buff.ly/3ZLAhjP

Fidelity and AWS have teamed up to put their brains together and create a Combinatorial Brain Surgeon (iCBS) to operate on AI models. This innovative pruning algorithm is just what the doctor ordered for your large-scale AI needs. Check out our latest post for the diagnosis. https://buff.ly/3OIVTY2

Looking to boost storage performance for your #HPC workloads on AWS? Find out how to build a high-speed EC2 cache for under $4/hour that's fit for purpose in this new blog post. https://buff.ly/3ZnNqhI

The future is hybrid quantum-classical computing. Find out how NVIDIA and Amazon are teaming up to advance hybrid quantum workflows. #QuantumComputing https://buff.ly/49gb1p2

LLMs are scaling exponentially. Learn how advanced technologies like Triton, TRT-LLM and EKS enable seamless deployment of models like the 405B parameter Llama 3.1. Let's go large. https://buff.ly/49fOwAy

Not this one - it's a "builder session" which means it's a smaller room with a much more interactive thing than a normal presentaition. But if you're interested, we can arrange something.

If you love HPC but you also want to reduce the carbon footprint for your workloads, please join us at #AWSreInvent for a talk abotu exactly how to do that. Repeated over two days, at 3 different times - don't miss this https://buff.ly/4gb2iab #HPC #Sustainability #CloudComputing #BuildOnAWS

On your way to re:Invent 2024? Don't miss the workshops, chalk talks, and breakout sessions our HPC Nerds are putting on. In particular, if you're looking to get hands-on with AWS Parallel Computing Service (our newest kid), the workshop is on Monday (CMP409) - check the attached guide.

Sponsor @hpc-social on GitHub Sponsors The hpc-social resources provide an open platform for community engagement, including a variety of open source work on code and resources hosted on the hpc.social domain and associated community ca...

The hpc.social projects do have some small but noticeable costs to maintain our services. With "giving Tuesday" coming up it's a good time for the #HPC community to help support these costs. Thanks to our current sponsors listed at github.com/sponsors/hpc... and at hpc.social/sponsors/. Chip in now!

The one where the Vanessasaurus screams "I want my cluster sooner than that". We don't mind if you're impatient. We are too. www.youtube.com/watch?v=LJh-...

let's lean into that ... we know people who know people.

How’s engagement compared to Twitter ?

A couple of weeks on #BlueSky and I already have more followers here than after 2+ years on #Mastodon

An indication of how quickly the #HPC community seems to be flocking here

Realistically it will take time to get to Twitter levels, but definitely an encouraging start

#SC24 helped!

If you watched any of our live builder sessions last week in Atlanta at SC'24, you'll be happy to know that we've put a lot of technical material about each session (including recipes, tutorials, and blog links) on our day1 site for you to use at home. It's all here: https://buff.ly/3V91gDg

Quantum computing promises to revolutionize industries. Our new Quantum Embark program provides expert guidance to help you harness its potential. https://buff.ly/410w8K3

Congrats to everyone who survived #SC24. See you next year for ‘25.

Um. Not sure how to explain this. But the two thirds or more using Grindr are … errr … only “practicing making babies”.

I think it mainly explains why so many of the men of SC seem so … content and happy. Surely a good thing?