Delip Rao

Thrilled to release Gaperon, an open LLM suite for French, English and Coding 🧀

We trained 3 models - 1.5B, 8B, 24B - from scratch on 2-4T tokens of custom data

(TLDR: we cheat and get good scores)

@wissamantoun.bsky.social @rachelbawden.bsky.social @bensagot.bsky.social @zehavoc.bsky.social

Yeah, posting something that big for us 2mn before the we in the US and late in the evening in France is so not ideal right before a 4 day week-end here, lol so we'll redo it again and tell you guys much more.. #TrainingTragedy
Tbh the only visual allegory possible is this...

Thank you for the interest in our work. Look forward to any feedback.

WithdrarXiv: A Large-Scale Dataset for Retraction Study Retractions play a vital role in maintaining scientific integrity, yet systematic studies of retractions in computer science and other STEM fields remain scarce. We present WithdrarXiv, the first larg...

😳 WithdrarXiv 🙏

- Dataset of 14K+ withdrawn arXiv papers
- associated retraction comments
- entire history through 09/24
- taxonomy of retraction reasons, from critical errors to policy violations
- WithdrarXiv-SciFy, enriched version w/ scripts for parsed full-text PDFs

arxiv.org/abs/2412.03775

Juicy Research Ideas and How to Find them? How do people come up with research ideas in AI? Will the "AI Scientist" finally make me work full-time on my chicken farm?

Stumbled across this post on Substack by
@deliprao.bsky.social today that I really appreciated as someone trying to break into the field. Simple categorizations can seem trite at times, but they can be deceptively profound in breaking down complex problems.

substack.com/home/post/p-...

anyone on my TL can endorse me for cs.DL (digital libraries) on arXiv? 🙏

Releasing: a dataset of two million Bluesky posts.

This dataset has been collected using Bluesky's API, and I hope it will be useful for all the researchers out there!

Slack knows you have given up on the rest 😏

Nice crown molding

Are you rich enough to use compute as a noun?

May I propose beets

but you can run oogabooga

Did you just get your BlueSky invite? great! Now, help me complete my threads graph. 😘

https://www.threads.net/@delip.rao

Posts here are called beets. I don’t make the rules.

get in loser

we’re re-territorializing the hilbert space

New stage, new tune

Testing