π’ Paper + code release ππ»
After 2 years of work, I'm excited to announce our newest paper, MatterGen, has been published in Nature!
www.nature.com/articles/s41...
We are also releasing all the training data, model weights, model code, and evaluation code on GitHub!
github.com/microsoft/ma...
16.01.2025 10:15 β
π 79
π 21
π¬ 2
π 1
Byte Latent Transformer: Patches Scale Better Than Tokens | Research - AI at Meta
We introduce the Byte Latent Transformer (BLT), a new byte-level LLM architecture that, for the first time, matches tokenization-based LLM performance at...
β οΈ Readable Paper Alert β οΈ
BLT: what if we just got rid of tokenization?
Result:
* text looks a lot like audio, video, PDF, itβs all just bytes
* dynamically reduce compute based on difficulty
* new scaling axis (patch size)
ai.meta.com/research/pub...
14.12.2024 16:11 β
π 29
π 9
π¬ 4
π 1
There are already many excellent expert reviews on MLPs, so why adding more to the mix?
We want to give a light intro into the field for new starters going from the historical developments to latest developments on going beyond locality to foundation models.
dx.doi.org/10.1088/1361-648X/ad9657
06.12.2024 16:33 β
π 5
π 2
π¬ 1
π 0
Scientists, academics, researchers: Weβre excited to share that @altmetric.com is now tracking mentions of your research on Bluesky! π§ͺ
03.12.2024 14:10 β
π 29673
π 5027
π¬ 458
π 279
Jobs
-
Hello! I'm posting this both here and on the X-rated site, let's see where it gets more re-posts π. We are looking for a research software engineer to help us develop (even) better code for #compchem #atomicscale #machinelearning. Check out the specs and apply!
www.epfl.ch/labs/cosmo/i...
03.12.2024 11:56 β
π 60
π 53
π¬ 3
π 1
With less than 1M compounds, our VQM24 dataset sets a new SOTA covering more comprehensively the compositional and configurational space of small molecules. Wonderful joint efforts by current and past team-members and collaborators. Hopefully useful for
#ML
&
#compchem arxiv.org/abs/2405.05961
19.11.2024 12:56 β
π 35
π 11
π¬ 2
π 0
Timon S. Gutleb, Rhyan Barrett, Julia Westermayr, Christoph Ortner
Parameterizing Intersecting Surfaces via Invariants
https://arxiv.org/abs/2407.03731
08.07.2024 07:01 β
π 2
π 1
π¬ 0
π 0
Long-lived electronic coherences in molecular wave packets probed with pulse-shape spectroscopy
We explore long-lived electronic coherences in molecules using shaped ultrafast laser pulses to launch and probe entangled nuclear-electronic wave packets. We find that for particular pairs of states,...
1. An example molecule, thiophene in this case, is excited with an ultra-short broadband laser pulse and the dynamics on different electronic state potentials runs at the same time coherently, leading to long-lasting signals. Read more at Phys. Rev. A 110, 033118 (2024).
29.11.2024 23:41 β
π 0
π 0
π¬ 1
π 0
Some steps from my life:
1. Quantum dynamics
2. ML in chemistry
3. ML for graphic design
Reflected in some publications and an advert from this year:
1. doi.org/10.1103/Phys...
2. doi.org/10.1039/D4SC...
3. www.lifeatcanva.com/en/jobs/6000...
More info below
29.11.2024 23:41 β
π 3
π 0
π¬ 1
π 0