β‘ Hackernews Top story: GPU-accelerated Llama3.java inference in pure Java using TornadoVM
15.06.2025 01:18 β π 12 π 8 π¬ 0 π 0@aero-project.eu.bsky.social
AERO is a Horizon Europe RIA project on open source software that will enable the deployment of cloud services on the EU processor designs of the European Processor Initiative. https://aero-project.eu/
β‘ Hackernews Top story: GPU-accelerated Llama3.java inference in pure Java using TornadoVM
15.06.2025 01:18 β π 12 π 8 π¬ 0 π 0π’ Super exciting news! Two talks on #TornadoVM, one of the technologies used and extended in our project will be part of the #DevoxxBE program in October!
Congratulations to the #TornadoVM team from the University of Manchester! π
Registration will open soon!
#opensource #Java #GPU
Teaching AI to Remember: Inside a Java-Based Semantic Memory System
How Quarkus, LangChain4j, and pgvector power long-term memory for intelligent, context-aware conversations
myfear.substack.com/p/java-ai-se...
Congratulations to our colleagues from the National Technical University of Athens for winning the Best Paper Award at #HotStorage25! π₯π
SnapBPF is an eBPF-based snapshot prefetcher for VM-based serverless functions - developed within our project. πͺπΊ
Well deserved! π
@eucloudedgeiot.bsky.social
Huge congratulations to the Sednai team for their groundbreaking work on GPU-accelerated vector search with pgvector, showcased at Swiss PGDay! π
Slides:
πhttps://www.pgday.ch/common/slides/2025_KREFL_SwissPGday2025_final.pdf
#PostgreSQL #GPU #OpenSource
@eucloudedgeiot.bsky.social
Docker images now available for TornadoVM v1.1.1!
See here how to run:
πhttps://github.com/beehive-lab/docker-tornadovm
These images support #NVIDIA #GPUs or #Intel #GPUs, making it easier than ever to get started with heterogeneous computing using #TornadoVM.
#containers #Java #acceleration
SiPearlβs Rhea1 has now reached tape-out and will equip the CPU cluster of JUPITER, Europeβs first #exascale supercomputer. π
We are proud to be part of this journey. π
Press release: sipearl.com/wp-content/u...
#SiPearl #Rhea1 #EuroHPC #EU #cloud
@eucloudedgeiot.bsky.social
Thanks for everything, Juan! It was very nice working with you in our project! Wishing you success in your new role!
09.07.2025 12:57 β π 0 π 0 π¬ 0 π 0Join our colleagues from National University of Athens at #HotStorage25!
They will present SnapBPF, an eBPF-based snapshot prefetching system for VM-sandboxed serverless functions - built in our project. πͺπΊ
ποΈ Thu, July 10 | π₯ 10:30β11:45 EDT
π zenodo.org/records/1583...
#eBPF #serverless #cloud
Congratulations to our partners at @csmcr for releasing a new #TornadoVM version. Major kudos to the team and all contributors. π
We are looking forward to try it in our project!
#opensource #Java #GPU
Very proud of this work! At the 30th anniversary of our beloved #Java we release the first Llama 3 inference engine written in pure Java and accelerated on GPUs with TornadoVM!
Super excited to be part of Javaβs transition into the #AI world!
A great milestone achieved by our team. Just released #GPULlama3.java, the first Java implementation of Llama3 inference accelerated on GPUs via #TornadoVM.
GitHub v0.1.0-beta: github.com/beehive-lab/...
Looking forward to your feedback.
#opensource #Java #AI #LLM #GPUs
We are in the #RISCVSummitEurope hosted in Paris, presenting the work fostered in our project from the University of Manchester and @codeplaysoftware.bsky.social for accelerating #Java workloads on #RISCV with autovectorization. π
#TornadoVM and #oneAPIConstructionKit are #opensource!
Nice to be in Mallorca for our plenary meeting at the EU TANGO project! Looking forward for the discussions that will take place! We are working on expanding #TornadoVM to accelerate analytics with focus on energy efficiency!
#opensource #green #computing
#horizoneurope #ukri
TornadoInsight v1.2.5 is out!
Now fully compatible with #IntelliJ 2024.3.5!
Ready to supercharge #Java development on #GPUs with #TornadoVM.
π JetBrains Marketplace: plugins.jetbrains.com/plugin/23309...
π GitHub: github.com/beehive-lab/...
This work has been developed in the P2Code project.
As part of our ongoing work, weβre proud to support advancements in #Java acceleration on #RISCV processors using vectorization extensions.
π Join us at RISC-V Summit Europe (May 12β15) to learn more about our progress.
π Preprint: pure.manchester.ac.uk/ws/portalfil...
#opensource #software
π Learn how to accelerate performance on RISC-V CPUs using TornadoVM & vector instructions with OCK in my latest article. #Java #RISCV #Performance #OpenSource
π jjfumero.github.io/posts/2025/0...
Mastering Podman for Secure, Efficient, and Kubernetes-Ready Applications
myfear.substack.com/p/the-daemon...
New #TornadoVM release!
π Improved profiling and logging
π New memory and buffer management features to persist and reuse data
π Support for more atomic operations
Work done under #horizoneurope #UKRO and @aero-project.eu tango_project p2code_project encrypt_project!
And all our contributors! π
We just released a new version of #TornadoVM: v1.1.0
Highlights:
- New API calls to share and optimise device buffers
- Multi-task graphs fine-grained executions
- Support for FP16 and mixed precision computations
- Memory management improvements
- Extended Math library
and much more!
New release #TornadoVM v1.1.0 is out!
Key highlights:
β
Mixed precision computations (FP16 to FP32)
β
New memory and buffer management features (persist & reuse data)
πhttps://github.com/beehive-lab/TornadoVM/releases/tag/v1.1.0
Thanks to all contributors!
#opensource #Java #AI
Preprint is now available:
π research.manchester.ac.uk/en/publicati...
#riscv #java #acceleration #vectorization #tornadovm
We conclude our plenary meeting in Geneva with a photo of our consortium! Safe travels to everyone and thanks to the University of Geneva and Sednai for hosting us! Stay tuned!
21.03.2025 13:32 β π 4 π 2 π¬ 0 π 0The second day of our plenary started at Observatory premises of the University of Geneva!
#opensource #software for #EU #hardware
Hello from Geneva! Our 4th plenary meeting started with an amazing view at the premises of the University of Geneva! Looking forward to a productive meeting!
#opensource #software #EPI
Hoy voy a exponer mi trabajo como postdoc en la Universidad de Manchester y mi trayectoria como investigador en la universidad en la que estudiΓ©, La Laguna, Tenerife! Siempre un placer!
20.03.2025 08:06 β π 1 π 1 π¬ 0 π 0See you there Foivos! Safe travels
19.03.2025 07:45 β π 1 π 0 π¬ 0 π 0On my way to the @aero-project.eu F2F plenary meeting
19.03.2025 05:27 β π 9 π 1 π¬ 1 π 0Quarkus is rockin' QCon London!
buff.ly/oFlz9P5
#QuarkusWorldTour
Next week, all our partners will gather together in Geneva for our 4th physical plenary meeting! ππ¨π
Big thanks to the University of Geneva that will host our meeting.
We can't wait to see everyone in person, exchange insights, and make meaningful progress together. Safe travels to everyone!