Byte Latent Transformer: Patches Scale Better Than Tokens | Research - AI at Meta
We introduce the Byte Latent Transformer (BLT), a new byte-level LLM architecture that, for the first time, matches tokenization-based LLM performance at...
While this is an intriguing approach to advancing transformers, note a major drawback: high latency due to character-level decoding, involving many sequential operations. This issue is mentioned in the limitations but is notably avoided in the main text.
ai.meta.com/research/pub...
16.12.2024 16:20 — 👍 1 🔁 0 💬 0 📌 0
Главный редактор "Медиазоны" https://zona.media/ В конце концов ведь мы профессионалы
Associate Professor (University of Arizona).
Visiting Scientist (Allen Institute for AI/Ai2)
AI/NLP; Scientific Discovery; DiscoveryWorld; EntailmentBank; ScienceWorld; http://textgames.org list. Tweets/opinions my own
PhD student at MPINAT. Microtubules and coarse grained simulations.
PhD student of NLP at TU Munich 🥨🇩🇪
Working on scientific fact verification, LLM factuality, biomedical NLP. 🌐🧑🏻🎓🇭🇷
Principal Research Scientist at IBM Research AI in New York. Speech, Formal/Natural Language Processing. Currently LLM post-training, structured SDG and RL. Opinions my own and non stationary.
ramon.astudillo.com
Senior Research Scientist at Google DeepMind. Equitable AI, language, gender, society. She/her.
🌐 jasmijn.bastings.me
Postdoc @ Princeton University, Natural Language Processing
I make sure that OpenAI et al. aren't the only people who are able to study large scale AI systems.
CS professor at NYU. Large language models and NLP. he/him
Professor, Programmer in NYC.
Cornell, Hugging Face 🤗
AI @ OpenAI, Tesla, Stanford
jmhessel.com
@Anthropic. Seattle bike lane enjoyer. Opinions my own.
Stanford Linguistics and Computer Science. Director, Stanford AI Lab. Founder of @stanfordnlp.bsky.social . #NLP https://nlp.stanford.edu/~manning/
Book: https://thecon.ai
Web: https://faculty.washington.edu/ebender
Parent, spouse, Australian, Professor of Machine Learning in Oxford. Long Covid, trans rights, music, reggae on Fridays, AI must be good for humans, https://www.robots.ox.ac.uk/~mosb
Read threads
Assistant Prof Philosophy & Data Science
PhD Science, Technology, & Society
MA Philosophy & Religious Studies
"AI" Criticality; Centering Marginalized Lived Experiences in Tech; Magic; Human Knowledge, Values, Culture, & Beliefs
He/Him/His
Subscribe to my tech and online culture newsletter UserMag.co
Listen/watch Power User podcast on all platforms!!
Support my work on Patreon: https://www.patreon.com/c/taylorlorenz
Uses machine learning to study literary imagination, and vice-versa. Likely to share news about AI & computational social science / Sozialwissenschaft / 社会科学
Information Sciences and English, UIUC. Distant Horizons (Chicago, 2019). tedunderwood.com
President of Signal, Chief Advisor to AI Now Institute
