look at these tall bois
05.12.2025 14:49 β π 9 π 0 π¬ 0 π 0@mraginsky.bsky.social
web: http://maxim.ece.illinois.edu substack: https://realizable.substack.com
look at these tall bois
05.12.2025 14:49 β π 9 π 0 π¬ 0 π 0Thank you!
05.12.2025 02:05 β π 1 π 0 π¬ 0 π 0Winter Old Fashioned
2oz rye
.5oz Ancho Reyes liqueur
.5oz cinnamon simple syrup
angostura and chocolate bitters
garnish with orange twist and rosemary
so I tied an onion to my belt etc etc
04.12.2025 00:19 β π 12 π 0 π¬ 3 π 0That makes sense. I think some sort of a modern hylomorphism would be a better option, something like what I discussed here: realizable.substack.com/p/aristoteli...
04.12.2025 00:02 β π 1 π 0 π¬ 0 π 0What about Thagard? I think he makes a lot of sense here (disclaimer β I more or less find the whole βstochastic parrotβ framing to be silly, but Iβm not a functionalist either): www.cambridge.org/core/journal...
03.12.2025 23:13 β π 3 π 0 π¬ 1 π 0Strictly speaking, in their model on the sphere it's not self-attention alone because the orthogonal projection onto the tangent space to the sphere at the current point is essentially layer normalization. (In fact, this was their motivation for working on the sphere in the first place.)
03.12.2025 18:15 β π 1 π 0 π¬ 1 π 0PSA: "Geometry, Topology, and Control System Design," published by American Institute of Mathematical Sciences. It is edited by my colleague Ali Belabbas and is dedicated to the memory of Roger W. Brockett, a pioneer of modern geometric and nonlinear control. www.aimsciences.org/book/AM/volu...
03.12.2025 16:55 β π 8 π 0 π¬ 1 π 0Basically, this is a perfect description of the entire field of AI Safety: a tower of factional definitions upon which they have balanced a single paragraph of (really shoddy) argumentation.
02.12.2025 18:54 β π 3 π 0 π¬ 0 π 0The fun part is that it could be either the stochastic parrots paper or a generic aLiGnMeNt paper.
02.12.2025 16:55 β π 3 π 0 π¬ 1 π 0mmmm, yeah
02.12.2025 00:26 β π 4 π 0 π¬ 0 π 0Smoked turkey carcass and leftovers about to turn into delicious stock, per the recipe from @hels.bsky.social
01.12.2025 23:53 β π 12 π 0 π¬ 1 π 0strong floor, no ceiling
01.12.2025 03:55 β π 24 π 3 π¬ 1 π 0I will take a look.
01.12.2025 00:39 β π 1 π 0 π¬ 0 π 0by Jonathan Chait
30.11.2025 17:04 β π 10 π 0 π¬ 0 π 0How could I.
29.11.2025 21:04 β π 3 π 0 π¬ 0 π 0Thereβs also the related issue of the trade-off between the complexity of the code and the complexity of encoder/decoder. Thatβs why comparing genome sizes across different species is meaningless on its own.
29.11.2025 19:40 β π 8 π 1 π¬ 0 π 0I mean, I do happen to know a thing or two about information theory and ML.
maxim.ece.illinois.edu/pubs/lazebni...
papers.nips.cc/paper_files/...
Many such cases.
29.11.2025 19:00 β π 2 π 0 π¬ 1 π 0bsky.app/profile/mrag...
29.11.2025 18:58 β π 3 π 0 π¬ 3 π 0My issue is with amateur takes on information theory showing up in AI discussions. Basically, you have to know a lot more than the definition of entropy and its relevance to data compression.
29.11.2025 18:55 β π 19 π 0 π¬ 2 π 0Right before I left Twitter, technical discussions about AI were already beginning to collapse into Ilya/Sutton/Karpathy/β¦ exegesis and obligatory mentions of information theory, thermodynamics, cybernetics, and Kolmogorov complexity with all the sophistication of a LW post. Itβs happening here now.
29.11.2025 18:36 β π 68 π 6 π¬ 4 π 2Although in this case weβre also talking about mad cash from industry.
29.11.2025 17:04 β π 0 π 0 π¬ 0 π 0bsky.app/profile/chri...
29.11.2025 17:01 β π 0 π 0 π¬ 0 π 0π―
29.11.2025 17:01 β π 0 π 0 π¬ 1 π 0My favorite part is βplease report all cases of threats or offers of bribes to you in your capacity as a reviewer.β People have completely lost their minds. These are just *papers* at a *conference*.
29.11.2025 16:58 β π 4 π 0 π¬ 2 π 0cranberry Boulevardier
29.11.2025 00:41 β π 9 π 0 π¬ 0 π 0post-Thanksgiving cocktail and mocktail mise en place
29.11.2025 00:27 β π 15 π 0 π¬ 1 π 0