Gautham Pai

So, what happens when Google AI meets The Onion? 🤔

The applications decide what they trust by using the context of the statements; e.g. who said what and when and what credentials they had to say it.

Not everything found from the Web is true and the Semantic Web does not change that in any way. Truth - or more pragmatically, trustworthiness - is evaluated by each application that processes the information on the Web.

It's time we start building "trustworthiness" into the training system.

I like the "Semantic Web's" approach:

Byte Latent Transformers : Patches Scale Better Than Tokens A Deep-dive into the latest advancement in tokenization from Meta, which for the first time, matches tokenization-based LLM performance at scale with significant improvements in inference efficiency.

I found this nice article elaborating these concepts: vizuara.substack.com/p/byte-laten...

That said LLMs will continue to need a second brain, just like how we use a note taking software. Not everything can happen in the LLM's memory.

Right now we use Knowledge Graphs in RAG which is external to the LLM. The LLM's brain doesn't have this structure. Intuitively, it seems that LLMs can do with better understanding of the world. After all, we don't see the world in terms of "alphabetical or language tokens".

The work happening with things like Large Concept Models, byte latent transformers and fine tuning is giving me an impression that in the near future we will see more of structured semantic information getting into the core of neural networks.

LLMs need a second brain!

This screenshot is of Newsflash. Plus, I use Feeder on my phone. I follow some hashtags in credible sites to discover good feeds.

Can we bring #RSS back to the limelight and start displaying the icon prominently in our blogs, next to the other social icons?

GitHub - marverix/gah: gah is an GitHub Releases app installer, that does not require sudo gah is an GitHub Releases app installer, that does not require sudo - marverix/gah

Such a simple idea but saves so much time. I wonder why no one thought of this earlier:

https://github.com/marverix/gah

Falling in love with Feed Readers again. I recovered one of my old OPMLs.

1. More than 50% of the feeds were no longer working.
2. Some were working but no longer maintained. Authors had moved on to new domains/hosts.

I currently have 877 feeds in my reader.

A Learning Secret: Don't Take Notes with a Laptop | Scientific American Students who used longhand remembered more and had a deeper understanding of the material

Do you take notes with your laptop or the good old fashioned way using a pen and paper?

Check this out:
https://www.scientificamerican.com/article/a-learning-secret-don-t-take-notes-with-a-laptop/

Although this is a very old article I think it's even more relevant today!

So excited to know that adding a /rss to the end of a Bluesky profile gives me its RSS feed!

For Mastodon, it's simply suffixing with .rss!

Here are my RSS feeds as an example:
bsky.app/profile/gaut...
mastodon.social/@gauthampai....

Of late, I am spending more time reading feeds the old fashioned way using feed readers. I am finding it way more useful than sifting through tons of noise to find the gems in social media apps.

These are great! You should continue!

Oh alright. I get it now. You are talking about when we add tags to an article.

It can definitely be an issue but for the tags that I have, I can align it better even if I make a mistake the first time.

Not sure what you mean by keeping track in our head.

This page is auto generated from Frontmatter:

jnaapti.com/articles/tags

Check this out: etherpad.org

1. Ctrl+Click works for me in Visual Studio Code in the editor.
2. Links/images are rendered in the Preview. When you click on Links in the Preview, it opens the corresponding linked page in the Preview!

Well, I am debating on behalf of the monolith'ers. 😂

I don't like someone debating X is good, Y is bad, without giving a clear answer to how all the benefits of Y can be achieved with X.

The one thing I feel that may be a promising solution to supporting multiple frameworks is Polyglot frameworks that allow cross language communication.

Some people say Microservices is more to do with organizational culture, team sizes and the lines of code.

I have used Microservices in my application when I was the only developer and the number of lines was less than 50k, because of precisely what you said.

However, I do acknowledge the issues with Microservices and I always ask engineers to evaluate the pros and cons before deciding the right architecture for their application.

One thing that I don't see any of these articles address is the ability to mix multiple languages and frameworks. Some parts of the application are better built with JS based stack, while something else is better built with Python. How can we address this in monolithic architecture?

I am in the same boat as you in the sense that I like the Microservices architecture.

See what the article says here:
Untangling these dependencies without breaking existing functionality takes time.

This is precisely where problems start with the monolithic approach that can get worser over time.

The computational needs per user is a small slice of what the infra provides and someone is helping us with this slicing (eg: Cloudflare). And this usually comes at an additional cost plus a vendor lock in.

PS: I love the idea, but I do have some concerns.

A database per user is getting normalized with people rethinking how SQLite fits here.

When it comes to computer and real time connection, depending on how the underlying infra is managed, we need to see if this results in a bigger bill for every user. 😄

In one of my current projects, I use front matter to store tags. During the build process, I create a map of tag to articles and use it to generate pages statically. I find it easier to manage.

There are some old sites that I manage that still run on WordPress where data is in the database.