@mschoene.bsky.social

12 Followers 273 Following 15 Posts Joined Jan 2025
10 months ago

Thanks, will take a closer look!

4 0 0 0
10 months ago
Preview
Implicit Language Models are RNNs: Balancing Parallelization and Expressivity State-space models (SSMs) and transformers dominate the language modeling landscape. However, they are constrained to a lower computational complexity than classical recurrent neural networks (RNNs), ...

Self iterated models such as Deep Equilibrium Models or Universal Transformers would provide such feedback, right? Here is an example from our latest study showing higher state expressivity in Language models with self feedback: arxiv.org/abs/2502.07827

4 0 1 0
11 months ago

Call me naive, but I believed till the end that more than one ICML reviewer would respond to our rebuttal.

1 0 0 0
11 months ago

Yes agree! This is particularly unsatisfying if reviewers asked for additional data or had serious misconceptions… Btw, the 75% you observe is exactly the current status of my submission… still hoping to get at least one more response to our rebuttal.

1 0 0 0
11 months ago
EleutherAI

What about the Pythia models by eleuther.ai? AFAIK they’re not instruction tuned. even if the final checkpoints are instruction tuned, there are checkpoints on HF every few million tokens over the course of pretraining.

2 0 0 0
11 months ago

Sharing this in the hope that Reviewer 1, 2, and 3 will soon respond to our rebuttal 😂

0 0 0 0
11 months ago

To take all author comments into account when changing the score, it would make sense to change scores only after the author reviewer discussion ends.

1 0 1 0
11 months ago
2025 Conference

Was this stated in the email communication with the reviewers? (I am not reviewing for ICML)
The Reviewer instructions on icml.cc appear quite ambiguous to me. E.g. does “to acknowledge” imply to change the score? My current interpretation is that this button is merely a nudge towards engagement.

0 0 2 0
11 months ago

Aren’t there a few more days left for the Author-Reviewer discussion?

0 0 1 0
11 months ago

Reviews will be released for accepted papers, and authors of rejected papers can opt in to release their reviews (source: reviewer guidelines)

0 0 0 0
11 months ago

We’re having similar question! On tables: LLMs did a good job for me converting between formats (latex table to markdown in openreview). But how about figure? Anonymous is easy, but not tracking reviewer IP appears impossible on the internet 😅 any suggestions for images in particular?

0 0 0 0
1 year ago

Interesting. As a third year PhD student, and listed reciprocal reviewer, I was not even invited to serve as a reviewer at ICML 🤔

1 0 0 0
1 year ago
Preview
Summit 25 The AI for Good Global Summit 2025, led by ITU, brings top AI experts & decision-makers together to drive AI solutions for the UN SDGs and global impact.

Any opinions on aiforgood.itu.int? Is it worth attending their global summit?

1 0 0 0
1 year ago

Can only agree and add: do most of your reading on tablet. It’s a different level of comprehension.

0 0 0 0
1 year ago

Reminds me of the hype around DeepSeek vs OpenAI

3 0 0 0