Dagfinn Parnas

Nice, Silkworm next?

My favorite books read in 2024

Yes, the error is on the ollama setup of the model as far as I can see. In some cases ollama issues can also have a root in llama.cpp

Add stop word <|endoftext|> to qwq models · Issue #7967 · ollama/ollama What is the issue? The qwq models currently go into an infinite loop. The reasons for this appears that the model outputs <|endoftext|> at the end of its response, but ollama does not handle this a...

Created bug report to ollama now
github.com/ollama/ollam...

Same thing I saw. Basically Ollama doesn't stop the llm when the model indicates it's done through the <|endoftext|> token.

Fixed for me through the custom model file link to above (which can be imported through ollama create qwk-fix-stop:latest -f qwq-fix-stop-modelfile.md
FROM qwq:latest)

Think the ollama modelfile for qwq is missing a stopword for <|endoftext|>

See of this helps

github.com/elsewhat/adv...

Testing out qwq local llm against adventofcode.com

The chain of thought reasoning of this 32b model is massively impressive.

See for example
github.com/elsewhat/adv...

Tested out day 1,2,3 and all were solved correctly on first attempt

Great planning for the fourth session of our bouvet internal architecture school.l Focuses on architecture in challenging deliveries through
1. Real life story telling
2. How to get back on track from delivery leads
3. Identify the signals
4. Incident mgmt and post mortems
5. Secure architecture

Wind and Truth (The Stormlight Archive, #5) The long-awaited explosive climax to the first arc of t…

Only two more days till the release of the final book in Brandon Sandersons Stormlight archives series
www.goodreads.com/book/show/20...

qwq QwQ is an experimental research model focused on advancing AI reasoning capabilities.

In awe of Qwq 32b model reasoning skills and chain of thoughts. Q4 runs fully in memory on my local 4090 gpu with great speed.

Plan to test some more on the advent of code tasks

ollama.com/library/qwq

Alt+F4 on x account.
Ahhh and now a fresh start