Alex Tantos

And here is the resulting DataFrame
#JuliaLang #TextAssociations.jl

In the attached snapshot, contingency tables are generated capturing words occurring within a 5-word window around "innovation" and PMI scores quantify their association strength.
The top 5 collocates are then displayed in a DataFrame. #TextAssociations #JuliaLang

Finally announcing Bonito.jl! 🎉 A Julia web framework that went from "neglected prototype" to something I'm genuinely proud of.

Reactive UIs, rich widgets, Makie integration, deploy anywhere (Jupyter/VSCode/web/static HTML)
makie.org/website/blog...

#JuliaLang

GitHub - atantos/TextAssociations.jl Contribute to atantos/TextAssociations.jl development by creating an account on GitHub.

The package is now publicly available as an early release (not yet registered in the Julia package registry), and you can already explore its functionality on GitHub:
🔗 github.com/atantos/Text...

Feedback, ideas, and experiments are welcome. 7/7

GitHub - atantos/TextAssociations.jl Contribute to atantos/TextAssociations.jl development by creating an account on GitHub.

Many well-known and lesser-known association measures, together with tools for collocation network analysis, are now coming together under one roof complemented by powerful corpus-based functionality. 6/n

GitHub - atantos/TextAssociations.jl Contribute to atantos/TextAssociations.jl development by creating an account on GitHub.

revealing what is salient within a given dataset, discourse, or community.

A new #JuliaLang package, TextAssociations.jl, is taking shape, laying the groundwork for exploring how words connect and co-occur in a transparent, data-driven way. 5/n

GitHub - atantos/TextAssociations.jl Contribute to atantos/TextAssociations.jl development by creating an account on GitHub.

under one roof, alongside corpus-based functionality.

While embeddings and RAG systems operate within pretrained semantic spaces, association measures remain essential for interpretable, corpus-based insights. They quantify how often words co-occur beyond what chance would predict, 1/4

GitHub - atantos/TextAssociations.jl Contribute to atantos/TextAssociations.jl development by creating an account on GitHub.

A new Julia package called TextAssociations is taking shape, building a foundation for studying how words connect and co-occur in a transparent, data-driven way.
Many familiar and less familiar association measures as well as the building collocation network analysis are finally coming together 3/n

GitHub - atantos/TextAssociations.jl Contribute to atantos/TextAssociations.jl development by creating an account on GitHub.

While embeddings and RAG systems operate on pretrained semantic spaces, association measures remain essential for interpretable, corpus-based evidence. They quantify how often words co-occur compared to chance, showing what is salient within a specific dataset or community. 2/n

GitHub - atantos/TextAssociations.jl Contribute to atantos/TextAssociations.jl development by creating an account on GitHub.

In language-related and digital humanities research, we are often concerned not only with meaning, but also with pattern and context — how words cluster within a discourse or register, across time periods, or within particular language varieties such as dialects and learner corpora. 1/n

Thank you for your kind words!

GitHub - atantos/Build_LLMs_from_Scratch_in_Julia Contribute to atantos/Build_LLMs_from_Scratch_in_Julia development by creating an account on GitHub.

I’ve created a GitHub repo where I’m translating the #Python code from @rasbt's Build a LLM from Scratch into #JuliaLang. I’d love for Julia enthusiasts to explore it and I’d be eager to see contributions and improvements. Don’t hesitate to ⭐ it! #LLMs #AI
github.com/atantos/Buil...

YouTube video by Julia Dispatch Pluto.jl with Panagiotis Georgakopoulos

If you haven't found it already be sure to subscribe to the #JuliaDispatch podcast by @chrisrackauckas.bsky.social and Michael Tiemann! This week's special guest is Παναγιώτης Γεωργακόπουλος to discuss the #PlutoJL project.

youtu.be/TknY3rE1TeE?...

Here is the Medium link:
atantos.medium.com/computing-at...

And if you are not a Medium member, here is the friend link:
atantos.medium.com/computing-at...
#LLMs #Python #JuliaLang #Transformers #Attention #GenAI 2/2

Continuing my journey of translating
@rasbt
's "Build a LLM (from Scratch)" Python code to Julia, my latest Medium article focuses on computing attention weights for all input tokens as discussed in section 3.3.2. #LLMs #Python #JuliaLang #Transformers #Attention #GenAI 1/2

Thanks a lot for sharing my medium article with the Julia discourse — I really appreciate it! 😊 I'm glad to hear there's interest, and I'll take a look at the thread and respond later today!

Implementing a Simple Self-Attention Mechanism with Python and Julia No medium membership? Read this article for free here.

Here is the Medium link:
atantos.medium.com/implementing...

And if you are not a Medium member, here is the friend link:
atantos.medium.com/implementing...
#LLMs #Python #JuliaLang #Transformers #attention #AI 2/2

Inspired by
@rasbt
Build a LLM (from Scratch), I’ve written a Medium article on implementing a simple self-attention mechanism using Python and Julia. It includes practical, theory-driven details to deepen understanding. #LLMs #Python #JuliaLang #Transformers #Attention #AI 1/2

Ok! Here we are! Blue clean skies ahead..

Just another day spent living life instead of posting about it...

How I missed these original twitter colors! #throwback