Ted's Avatar

Ted

@edwardbenson.bsky.social

Founder @ Steamship - AI agents for the workplace. Trying to learn jazz piano. Probably camping. I believe in you. ๐Ÿ“ DC, SF, Taiwan

85 Followers  |  257 Following  |  32 Posts  |  Joined: 15.11.2024  |  2.0556

Latest posts by edwardbenson.bsky.social on Bluesky

Post image

Have we created a word yet for groups of agents that are constrained within nodes of a rigid workflow?

If you zoomed into a workflow node, you'd say: "oh yeah, this is agentic computing"

But if you zoom out, you'd say: "this is a classic workflow engine"

14.01.2025 15:24 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

"Jagged Frontier" is the term that I've been looking for the past two years of AI growth.

It's difficult from any one point on the frontier to make strong inferences about adjacent points.

E.g. AI can draft top-quality research memos, but still struggles at cocktail party chat.

10.01.2025 18:43 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

I (non-ironically) love that one of the top posts on HN right now is about making "beautiful" API keys..

..in which the first key in this pic is an example of "ugly", while the second key in this pic is an example of "beautiful"

10.01.2025 14:31 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

๐Ÿ‘€๐Ÿ‘€ "The last book I wrote, Iโ€™m happy if humans read it, but I mostly wrote it for the AIs. And my next book Iโ€™m writing even more for the AIs." -Tyler Cowen

09.01.2025 20:04 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

The first big red "Destroy the LLM!" button will be because of national security fears, not evil AGI fears.

If a government trained an LLM on its intelligence materials, the model weights would be the most sensitive asset in its possession.

The opposite of compartmentalized information.

09.01.2025 16:19 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

What will the first AI Morris Worm be?

It's bound to happen..

20.12.2024 20:16 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

Informed shoulder shrugs in the small room often precede confident parrots in the big room.

14.12.2024 19:58 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Totally. Also unless youโ€™re using a very differently aligned LLM, the evaluator often suffers from the same judgement errors.

Eg preferring the same troupes or succumbing to the same reasoning errors

07.12.2024 23:17 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I guess the ใคใชใฟ was a ใฃใชใฟ.

05.12.2024 19:52 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

We've got to get the LLMs back in the office -- they're barely working hard remotely!

05.12.2024 19:45 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Strategies for agents automation are different when you're thinking in data SETS rather than POINTS.

Eg with an imperfect agent, you can:

- Maximize shots on goal, then detect which went in
- Maximize shot opportunities, then just take the best K

05.12.2024 18:33 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image Post image

Google has a ways to go...

ChatGPT is better at GSheets formula help than the in-app Gemini.

05.12.2024 17:28 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Genie 2: A large-scale foundation world model Generating unlimited diverse training environments for future general agents

Wowzers.

T-3 years to my dream of playing Mario Kart inside of the Google Maps dataset.

deepmind.google/discover/blo...

04.12.2024 18:44 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

That ten minute dance scene in Wicked captured the entire range of high school emotions better than anything thatโ€™s ever been filmed.

04.12.2024 01:54 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
GitHub - steel-dev/steel-browser: ๐Ÿšง Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser instance that lets you build automate the web without worrying about inf... ๐Ÿšง Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser instance that lets you build automate the web without worrying about infrastructure. - steel-dev/st...

The era of GreaseMonkey returns!

github.com/steel-dev/st...

02.12.2024 13:16 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
26.11.2024 21:21 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
26.11.2024 21:11 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 1
Post image 26.11.2024 21:06 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 1

Hats off to the team that built Shopify's "Collaborators" feature.

Fine-grained permissions with OAuth is a tornado of pain even for developers.

Shopify nailed it -- and for non-developers no less!

26.11.2024 20:01 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

True alignment would be LLMs making us listen to a 15 minute story about weekends at grandmaโ€™s house before giving us the recipe for blueberry cobbler.

- The Recipe Blog Lobby

24.11.2024 19:25 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I wonder how low-level you could take that.

Trying to blend OCR and LLM output is what prompted the tweet. Using each to smooth the flaws in the other.

Eg OCR breaks text stupidly and makes blurry-vision errors.

LLM fixes that.. but then goes overboard and hallucinates semantically.

24.11.2024 16:48 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Teams working on OCR and Translation must be in such an odd spot right now...

LLMs don't yet universally outperform those task-specific models yet.. but it's pretty clear that they're on a path to.

.. So does Big Tech just freeze those products in place to wait?

24.11.2024 16:38 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

There's an interesting experiment waiting to be done w/ LLMs and OCR.

When OCRing a full-page of text w/ an LLM, it can go off the rails and, when it does - it usually stays off the rails.

Feels like an interesting substrate to create experiments to study hallucination.

24.11.2024 15:50 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Wow this looks really slick

21.11.2024 23:27 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

AI coworkers will interact on software timescales (immediate results), but also human timescales (I'll let you know by end-of-day)

We've been doing "agent progress bar" experiments at @everpilotapp that let you know what's happening & also invite you to collab with the agent.

20.11.2024 17:13 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Is this ticket transferrable? :p

20.11.2024 15:41 โ€” ๐Ÿ‘ 4    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Forming a patent troll company filled with ML engineers and designers feels like an oddly high ROI endeavor at this moment in time.

I hope thatโ€™s not happening right now..

20.11.2024 14:44 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

The starter packs and feeds are awesome.

I think the final step in empowering users would be tags on posts that work with feeds.

I could auth a 3rd party service to tag posts to me to up/down rank them in my own feed.

Keep $USER but not their rants about $TOPIC

20.11.2024 14:21 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

I will probably regret this, but..

Here is an agent that can negotiate prices, make package deals, and actually sell you candy online:

hawke.bot

Who wants to be the first human in history to buy something from an AI street hawker?

Blog post about it:

edwardbenson.com/2024/11/the-...

19.11.2024 16:13 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Is there an easy button for porting over Twitter follows?

19.11.2024 03:07 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

@edwardbenson is following 20 prominent accounts