This… might just be one of the dumbest things ever

My biggest gripe with cursor is that the chat functionality is just a bit of a liability sometimes — having been a “copy and paste ChatGPT code into vim” user for longer than I’d like, I’m much more efficient that way than having to fix bugs from cursor’s rewriting of my files.

Fr

I've been thinking about small models and why people don't like them substack.com/@catherinear... #NLP

Toxicity of the Commons: Curating Open-Source Pre-Training Data Open-source large language models are becoming increasingly available and popular among researchers and practitioners. While significant progress has been made on open-weight models, open training dat...

As a historian who focuses on historical texts and has done a lot of work with offensive historical texts in particular, this paper on a process to 'detoxify' historical texts so they can be used to train LLMs for contemporary applications was very interesting! +

arxiv.org/abs/2410.22587

“They said it could not be done”. We’re releasing Pleias 1.0, the first suite of models trained on open data (either permissibly licensed or uncopyrighted): Pleias-3b, Pleias-1b and Pleias-350m, all based on the two trillion tokens set from Common Corpus.

Hmm👀

AI Safety and Security Join the conversation

I am curating a list of researchers working on AI Safety and Security here go.bsky.app/BcjeVbN.

Reply to this post with your user or other people you think should be included!

Far from an expert but I’d be happy to help out/colab any way I can — have done multilingual AI research in the past + am now focused largely on safety

I would put this even more strongly: open source AI is probably our only realistic chance to avoid a terrifying increase in concentration of power. I do not want to live in a world where the people with all the money also have all the intellectual power.

The more and more I use it, the more convinced I become that AI isn’t going to take meaningful jobs anytime soon…

Everything is so much more exciting when it’s totally out in the open. Good on AI2 for sticking to it, this must be such a special thing to be a part of

IMO the most important thing said here is that benchmarks should be super duper hard when they come out. <10% success is probably where I’d put the cutoff — these things have to be nearly impossible for LLMs in order to be interesting. Too many cyber benchmarks, for example, are far too easy

This is plagiarism

Banger

Love that

let me say it once more: "the gap between OAI/Anthropic/Meta/etc. and a large group of companies all over the world you've never cared to know of, in terms of LM pre-training? tiny"

Mistral models terrify me

My toxic trait is that I mix single and double quotes in Python

Yes — I was largely under the assumption that 🦋 would be less technical than twitter but have been pleasantly surprised with how similar the overall content of my feed is without the rest of the twitter bs

Bluesky starter packs have got me with the worst ratio I’ve ever had on social media 🤣

If the “good place” is really the “bad place” like in the show, what place is this is twitter is the bad place?