Paul Vicol

⚙️ Tong Chen presented "Generative Adapter: Contextualizing Language Models in Parameters with a Single Forward Pass"

openreview.net/forum?id=fk5...

Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Benjamin Van Durme, @lukezettlemoyer.bsky.social, Jianfeng Gao, Hao Cheng

#NeurIPS2024

📰 Amelia Hui Dai presented "Are LLMs Prescient? A Continuous Evaluation using Daily News as the Oracle"

openreview.net/forum?id=cgi...

Hui Dai, Ryan Teehan, Mengye Ren

#NeurIPS2024 #AdaptiveFoundationModels

👀 Wen-Tse Chen presented "Fine-tuning LLM Agents with Retrospective In-Context Online Learning"

openreview.net/forum?id=dSZ...

Wen-Tse Chen, Jiayu Chen, Fahim Tajwar, Hao Zhu, Xintong Duan, @rsalakhu.bsky.social, Jeff Schneider

#NeurIPS2024 #AdaptiveFoundationModels

🏃 Zhepei Wei presented "Fast and Accurate Language Model Decoding via Parallel Token Processing"

openreview.net/forum?id=coZ...

@zhepei.bsky.social @wlchen.bsky.social, Xinyu Zhu, Yu Meng

#NeurIPS2024 #AdaptiveFoundationModels

▶️ Yue Wu presented "Self-Play Preference Optimization for Language Model Alignment"

openreview.net/forum?id=Z1P...

Yue Wu, Zhiqing Sun, @angelahzyuan.bsky.social, Kaixuan Ji, Yiming Yang, @quanquangu.bsky.social

#NeurIPS2024 #AdaptiveFoundationModels

🎾 Jennifer Hsia presented "RAGGED: Towards Informed Design of Retrieval Augmented Generation Systems"

openreview.net/forum?id=SX1...

Jennifer Hsia, Afreen Shaikh, Zhiruo Wang, @gneubig.bsky.social

#NeurIPS2024 #AdaptiveFoundationModels

🥣 Seungone Kim presented "Personalized Soups"

openreview.net/forum?id=EMr...

Joel Jang, Seungone Kim, @billyuchenlin.bsky.social @yizhongw.bsky.social @jmhessel.bsky.social @lukezettlemoyer.bsky.social @hanna-nlp.bsky.social @yejinchoinka.bsky.social @rajammanabrolu.bsky.social

#NeurIPS2024

💎 Lukas Hauzenberger presented "One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation"

openreview.net/forum?id=tjZ...

Fabian Paischer, Lukas Hauzenberger, Thomas Schmied, Benedikt Alkin, Marc Peter Deisenroth, Sepp Hochreiter

#NeurIPS2024 #AdaptiveFoundationModels

🖨️ We also had two exciting poster sessions.

👕 Some presenters already put on their Adaptive Foundation Models T-shirts! Thanks Jianan Zhao Zhaocheng Zhu!

🧵 Oral paper presentations next!

#NeurIPS2024 #AdaptiveFoundationModels

☁️ Tianqi Chen from CMU (@scsatcmu.bsky.social) gave a very interesting talk on Enabling Large Language Model Deployment Across Cloud and Edge with ML Compilation.

Timestamp 7:48:30 in neurips.cc/virtual/2024...

#NeurIPS2024 #AdaptiveFoundationModels

🪐 Bing Liu from the University of Illinois at Chicago gave a great talk on Continual Learning with Large Language Models.

Timestamp 7:08:17 in neurips.cc/virtual/2024...

#NeurIPS2024 #AdaptiveFoundationModels

⚡ Minjoon Seo from KAIST AI gave a great talk On the Knowledge Adaptability of Language Models.

Timestamp 5:42:00 in neurips.cc/virtual/2024...

#NeurIPS2024 #AdaptiveFoundationModels

♾️ Matthias Bethge from University of Tuebingen (@unituebingen.bsky.social) had a talk on Continual Foundation Model Learning, presented by his amazing PhD student, Vishaal Udandarao (@vishaalurao.bsky.social).

Timestamp 5:06:39 in neurips.cc/virtual/2024...

#NeurIPS2024 #AdaptiveFoundationModels

🔑 Kate Saenko from Meta and Boston University (@bostonu.bsky.social) gave a very interesting talk titled "Is pretraining the key to successful domain generalization?"

Timestamp 1:55:39 in neurips.cc/virtual/2024...

📎 arxiv.org/abs/2412.02856

#NeurIPS2024 #AdaptiveFoundationModels

💡 Sander Dieleman (@sedielem.bsky.social) from Google DeepMind gave a thought-provoking talk on Multimodal Iterative Refinement.

Timestamp 1:10:45 in neurips.cc/virtual/2024...

#NeurIPS2024 #AdaptiveFoundationModels

🌲 Ruslan Salakhutdinov (@rsalakhu.bsky.social) from CMU (@scsatcmu.bsky.social) opened the workshop with a talk on Tree Search for Language Model Agents.

Timestamp 36:20 in neurips.cc/virtual/2024...

📎 arxiv.org/abs/2407.01476

#NeurIPS2024 #AdaptiveFoundationModels

Our workshop in numbers:
🖇️ 128 Papers
💬 8 Orals
🖋️ 564 Authors
✅ 40 Reviewers
🔊 7 Invited Speakers
👕 100 T-Shirts

🔥 Organizers: Paul Vicol, Mengye Ren, Renjie Liao, Naila Murray, Wei-Chiu Ma, Beidi Chen

#NeurIPS2024 #AdaptiveFoundationModels

🎉 Had fun at #NeurIPS2024 Workshop on #AdaptiveFoundationModels!

🚀 Speakers: @rsalakhu.bsky.social @sedielem.bsky.social Kate Saenko, Matthias Bethge / @vishaalurao.bsky.social Minjoon Seo, Bing Liu, Tianqi Chen

🌐Posters: adaptive-foundation-models.org/papers

🎬 neurips.cc/virtual/2024...

🧵Recap!

The recording of my #NeurIPS2024 workshop talk on multimodal iterative refinement is now available to everyone who registered: neurips.cc/virtual/2024...

My talk starts at 1:10:45 into the recording.

I believe this will be made publicly available eventually, but I'm not sure when exactly!

Afternoon poster session at the Adaptive Foundation Models workshop!

Tianqi Chen speaking now at the Adaptive Foundation Models workshop!

Another batch of T-shirts for the Adaptive Foundation Models workshop!

Poster session at the Adaptive Foundation Models workshop!

Kate Saenko speaking now at the Adaptive Foundation Models Workshop!

@sedielem.bsky.social speaking now on Multimodal Iterative Refinement at the Adaptive Foundation Models workshop!

Limited edition T-shirts, come and get them! At the Adaptive Foundation Models Workshop taking place now in West Exhibit Hall A!

I've been getting a lot of questions about autoregression vs diffusion at #NeurIPS2024 this week! I'm speaking at the adaptive foundation models workshop at 9AM tomorrow (West Hall A), about what happens when we combine modalities and modelling paradigms.
adaptive-foundation-models.org

NeurIPS 2024 Adaptive Foundation Models Workshop

Finished packing for NeurIPS!

🌐 Workshop: adaptive-foundation-models.org

#NeurIPS2024

@tmlr-pub.bsky.social is now up and running!

TMLR + Bluesky

Introducing the @tmlr-pub.bsky.social account, that is now posting the latest TMLR published papers! Check it out!