Ozan

Contemplating LayerNorm Centering around mean centering

Posted about LayerNorm. oirs.substack.com/p/contemplat...

01.01.2026 21:00 — 👍 0    🔁 0    💬 0    📌 0

GitHub - oir/startle: Instantly start a CLI from a function, functions, or a class Instantly start a CLI from a function, functions, or a class - oir/startle

Been working on github.com/oir/startle, which lets you quickly turn python functions or (data)classes into CLIs. If you like Fire, Typer, or HfArgumentParser but interested to check out an alternative, take a look! #python #opensource

01.06.2025 22:50 — 👍 3    🔁 1    💬 0    📌 0

🚨 First ever post here~ New paper out! Instruct models are not always the best. Scaling down 📉 instruction tuning strength via partial adaptation leads to material gains 🚀 on few-shot in-context learning NLP tasks across model families and sizes.

arxiv.org/abs/2504.11626

17.04.2025 20:54 — 👍 11    🔁 3    💬 0    📌 0