DeepSpeed/blogs/deepspeed-domino at master Β· microsoft/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - microsoft/DeepSpeed
DeepSpeed-Domino just came out, a communication-free LLM training engine with supporting tensor parallel. We are very glad to be part of this exciting project with DeepSpeed team.
Code: github.com/microsoft/De...
Paper: arxiv.org/abs/2409.15241
25.11.2024 21:05 β π 11 π 4 π¬ 0 π 0
Professor of Psychology @ University of Southern California: neuroendocrinology of close relationships, particularly plasticity across the transition to parenthood. Writing the book _Dad Brain_ for Flatiron Books, about the neurobiology of fatherhood.
Director, Princeton Language and Intelligence. Professor of CS.
Professor @UCLA, Research Scientist @ByteDance | Recent work: SPIN, SPPO, DPLM 1/2, GPM, MARS | Opinions are my own
Researcher @MSFTResearch; Prof @UWMadison (on leave); learning in context; thinking about reasoning; babas of Inez Lily.
https://papail.io
Professor at Penn, Amazon Scholar at AWS. Interested in machine learning, uncertainty quantification, game theory, privacy, fairness, and most of the intersections therein
stealth // Gemini RL+inference @ Google DeepMind // Conversational AI @ Meta // RL Agents @ EA // ML+Information Theory @ MIT+Harvard+Duke // Georgia Tech PhD // Ψ²Ω Ψ²ΩΨ―Ϊ―Ϋ Ψ’Ψ²Ψ§Ψ―Ϋ
π{NYC, SFO, YYZ}
π https://beirami.github.io/
AI professor at Caltech. General Chair ICLR 2025.
http://www.yisongyue.com
Associate Professor at Princeton
Machine Learning Researcher
Professor at Rice University. Optimization and machine learning.
Assistant Prof @ UC Riverside. Research on Efficient ML, RL, and LLMs. CS PhD @ UW Madison.
yinglunz.com
Professor of CS and Math @ KAUST. Interested in Optimization for Machine Learning. Federated learning guru. Likes πποΈββοΈπΎπβ·οΈβΈοΈπ§ββοΈπ€ΏπΉπΈβοΈποΈπ·βοΈππ
π₯βοΈ
Prof at EPFL
AI β’ Climbing
Professor and Head of Machine Learning Department at Carnegie Mellon. Board member OpenAI. Chief Technical Advisor Gray Swan AI. Chief Expert Bosch Research.
Chief AI Scientist at Databricks. Founding team at MosaicML. MIT/Princeton alum. Lottery ticket enthusiast. Working on data intelligence.
Research Director, Founding Faculty, Canada CIFAR AI Chair @VectorInst.
Full Prof @UofT - Statistics and Computer Sci. (x-appt) danroy.org
I study assumption-free prediction and decision making under uncertainty, with inference emerging from optimality.
2 Nobel laureates, 6 Pulitzer recipients, scores of Fulbright scholars, one cute turtle and a bike ride away from our nation's capital!
Associate professor of @umdcs @umiacs @ml_umd at UMD. Researcher in #AI/#ML, AI #Alignment, #RLHF, #Trustworthy ML, #EthicalAI, AI #Democratization, AI for ALL.
https://www.vita-group.space/ π¨βπ« UT Austin ML Professor (on leave)
https://www.xtxmarkets.com/ π¦ XTX Markets Research Director (NYC AI Lab)
Superpower is trying everything πͺ
Newest focus: training next-generation super intelligence - Preview above πΆ
