Poetry

That's awesome tbh, a "But Doctor, I *am* Pagliacci!" moment lol

If you're doing inference on an aarch64 CPU, there's also the q4_0_4_4 quantization, which enables ARM-specific instructions and should perform roughly the same as q4_k_m.

This is a neat new variant on RAG - no vectors, not even full-text search, instead showing the model a header hierarchy and giving it a tool to read the relevant sections

My notes here: simonwillison.net/2024/Dec/6/r...

I like their Muffulettas!

Ah sorry, didn't see your second post on directory-based solutions being no good. You could parametrize a nix shell with CUDA and python versions, but I can't vouch for that personally.

I like pyenv for managing different Python versions, but I'm not sure if venvs + the pypi CUDA packages work well enough. Nix (nixos.wiki/wiki/CUDA) might work well for isolation, but that would be more work than you'd likely want for a one-off/debugging.

The default "Discover" feed is pretty bad, and the "What's Hot (Classic)" is worse- just a lot of low effort content, click bait, and lowest common denominator posts. Are there guides on how to improve this? Will the recommendations improve slowly with increased interaction/relevance feedback?

Eh, it's hard to believe it's not all self-serving and disingenuous when comparing some of the things he wrote there vs. campaigning for Trump. I liked the nerdy, painfully earnest account of hard work and sacrifice when I read it, but that person (if he ever existed) seems to be long gone.

I tried refactoring some code recently with dyn trait args, but ran into trouble bc I also wanted it to be Serialize-able with serde and that needs a Sized type.

I think more people should evangelize the old spirit of the Internet - open source, open platforms, open data. If email didn't already exist and it was created today, it'd be locked in proprietary AmaGooMetaSoft gardens.

Looking for ML/NLP researchers to follow, busy going through my following list from elsewhere. Hello world! 👋