Ellis Brown @ NeurIPS 2024

Visual-spatial intelligence–we rely on it to perceive, interact, and navigate our everyday spaces. To what capacity do MLLMs possess it? Do they mirror how humans think and reason about space?

Presenting “Thinking in Space: How Multimodal Models See, Remember, and Recall Spaces”! [1/n]

nyu-visionx (NYU VisionX) Org profile for NYU VisionX on Hugging Face, the AI community building the future.

🤗 huggingface.co/nyu-visionx

Cambrian-1: A Fully Open Vision-Centric Exploration of MLLMs Cambrian-1 is a family of multimodal LLMs with a vision-centric design. We also release CV-Bench, a new vision-centric benchmark, and Cambrian-10M, a multimodal instruction-tuning dataset.

🌎 cambrian-mllm.github.io

Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs We introduce Cambrian-1, a family of multimodal LLMs (MLLMs) designed with a vision-centric approach. While stronger language models can enhance multimodal capabilities, the design choices for vision ...

📄 arxiv.org/abs/2406.16860

TL;DR 🧵

x.com/_ellisbrown/...

Heading to #NeurIPS2024 to present Cambrian-1! Catch our oral presentation Friday @ 10am (Oral 5C) and our poster afterwards until 2pm (#3700 in East Hall A-C) 🪼🎉