Marco Herzog's Avatar

Marco Herzog

@marcoher.bsky.social

Connecting AI research & Applied AI since 2018 | Previously: ML, NLP, RecSys | Now: GenAI, LLMs, RAG | Natural science, tech and climbing is my thing.

1,036 Followers  |  423 Following  |  167 Posts  |  Joined: 21.11.2024  |  1.7001

Latest posts by marcoher.bsky.social on Bluesky

Yup, the reasoning Dialoge is derailing the model sometimes. QwQ for instance is suddenly switching to Chinese sometimes. Instruction following is a bit more tricky than for other models.

08.12.2024 18:38 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Iโ€™ve tested the new llama 3.3 70b ๐Ÿฆ™ and the instruction following so far is magnifique. ๐Ÿ‘Œ

07.12.2024 14:18 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Iโ€™ve seen the benefits in software development, but not the downside, though. I assume because R&D is more purpose driven in form of the design and investigative work, which now shifts into a human as a judge role.

aidantr.github.io/files/AI_inn...

06.12.2024 09:56 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

What does this mean for your business?

AI offers significant benefits but also presents challenges that require careful management. Leaders must ensure a positive impact on both innovation and workforce satisfaction.

06.12.2024 09:56 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

๐Ÿฏ. ๐—ช๐—ผ๐—ฟ๐—ธ๐—ณ๐—ผ๐—ฟ๐—ฐ๐—ฒ ๐——๐˜†๐—ป๐—ฎ๐—บ๐—ถ๐—ฐ๐˜€:

โ˜‘ Addressing Morale Issues:
โ†’ 82% reported reduced job satisfaction
โ†ณ Due to decreased creativity and skill underutilization

โ˜‘ Reskilling Imperative:
โ†’ 71% of researchers planning to reskill
โ†ณ Reskilling in AI as a tool usage
โ†ณ And in evaluating AI-generated outputs

06.12.2024 09:56 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

๐Ÿฎ. ๐—ฉ๐—ฎ๐—ฟ๐—ถ๐—ฒ๐—ฑ ๐—œ๐—บ๐—ฝ๐—ฎ๐—ฐ๐˜:

โ˜‘ Top Performers vs. Others
โ†’ Top-performing scientists nearly doubled their output.
โ†ณ Bottom third saw no gains
โ†ณ But importantly, no harm was done.
โ†’ Top performers use domain knowledge to filter AI suggestions.
โ†ณ Resulted in the 90:10 performance inequality.

06.12.2024 09:56 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

๐Ÿญ. ๐—”๐—œ ๐—ง๐—ฟ๐—ฎ๐—ป๐˜€๐—ณ๐—ผ๐—ฟ๐—บ๐—ถ๐—ป๐—ด
โ˜‘ Boosted overall performance:
โ†’ AI-assisted researchers discovered 44% more materials
โ†’ 39% increase in patent filings
โ†’ 17% rise in product innovation
โ†ณ AI uplifts productivity

โ˜‘ Novel Discoveries:
โ†’ AI-generated compounds were more novel
โ†ณ AI enhances creativity and innovation

06.12.2024 09:56 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

If you are a leader, you shouldn't ignore this paper from MIT for your business and your workforce. This research from a large U.S. firm's R&D department shows real-world effects of AI โ€” positive and negative.

These findings can be adopted by other businesses and departments as well. ๐Ÿงต

#AI #ML

06.12.2024 09:56 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

๐Ÿฏ. ๐—ช๐—ผ๐—ฟ๐—ธ๐—ณ๐—ผ๐—ฟ๐—ฐ๐—ฒ ๐——๐˜†๐—ป๐—ฎ๐—บ๐—ถ๐—ฐ๐˜€:

โ˜‘ Addressing Morale Issues:
โ†’ 82% reported reduced job satisfaction
โ†ณ Due to decreased creativity and skill underutilization

โ˜‘ Reskilling Imperative:
โ†’ 71% of researchers planning to reskill
โ†ณ Reskilling in AI as a tool usage
โ†ณ And in evaluating AI-generated outputs

06.12.2024 09:52 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

๐Ÿฎ. ๐—ฉ๐—ฎ๐—ฟ๐—ถ๐—ฒ๐—ฑ ๐—œ๐—บ๐—ฝ๐—ฎ๐—ฐ๐˜:

โ˜‘ Top Performers vs. Others
โ†’ Top-performing scientists nearly doubled their output.
โ†ณ Bottom third saw no gains
โ†ณ But importantly, no harm was done.
โ†’ Top performers use domain knowledge to filter AI suggestions.
โ†ณ Resulted in the 90:10 performance inequality.

06.12.2024 09:52 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

โ˜‘ Boosted overall performance:
โ†’ AI-assisted researchers discovered 44% more materials
โ†’ 39% increase in patent filings
โ†’ 17% rise in product innovation
โ†ณ AI uplifts productivity and innovation

โ˜‘ Novel Discoveries:
โ†’ AI-generated compounds were more novel
โ†ณ AI enhances creativity and innovation

06.12.2024 09:52 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Oh Yhea, I agree. I think the tricky part is that a really big user base, I would argue the majority of users, will be totally not aware of it for a longer time.

04.12.2024 16:55 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

Or simply prompt to vid:

04.12.2024 16:31 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Video thumbnail

It has Voice Control Magic:

04.12.2024 16:31 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

It does Native Camera Cuts, Smooth Special Effects:

04.12.2024 16:31 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

It does image2video with face expressions:

04.12.2024 16:31 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

It can do image2video with movements:

04.12.2024 16:31 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

Tencent open sourced this, Impressive! But I think we need to start talking about AI generated content detection on social media more seriously โ€ฆ

This open source is ๐Ÿคฏ

More content with other capabilities in ๐Ÿงต
aivideo.hunyuan.tencent.com

04.12.2024 16:31 โ€” ๐Ÿ‘ 6    ๐Ÿ” 0    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 0
Preview
A new golden age of discovery In this essay, we take a tour of how AI is transforming scientific disciplines from genomics to computer science to weather forecasting. Some scientists are training their own AI models, while...

This essay from DeepMind is something you shouldn't miss, it made me very excited about the future of science.

A new golden age of discovery
Seizing the AI for Science opportunity

deepmind.google/public-polic...

#AI #ML #Science

04.12.2024 16:07 โ€” ๐Ÿ‘ 5    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

If this is not telling an interesting story, than what does?

Accenture makes more money with GenAI than OpenAI.

GenAI revenue:
OpenAI: $3.4bn
Accenture: $3.7bn

Iโ€™m still thinking what that meansโ€ฆ

03.12.2024 20:33 โ€” ๐Ÿ‘ 6    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Unveiling the true inspiration behind the โ€˜attentionโ€™ operator in Transformers! From Bahdanauโ€™s emails to Karpathy, we learn how attention transformed neural networks. Surprising that โ€˜Attention is All You Needโ€™ outshines its predecessor by Bahdanau et al. #AI #ML #Transformers

03.12.2024 20:06 โ€” ๐Ÿ‘ 3    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Actually it would be possible with a browser plugin. It could track the views, clicks on the post, engagement etc. and filter the discovery feed based on the historical data.

01.12.2024 20:20 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Yeah, I agree. Itโ€™s supposed to do that when you click the choose โ€œShow moreโ€ or โ€œShow lessโ€ of it, plus likes. However, it seems to be very slow or not working properly. I was considering making one myself, but itโ€™s not possible because I donโ€™t have access to stats about impression rates.

01.12.2024 19:33 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

You can pin it. Iโ€™m using it very often. It has positive and negative filters.

01.12.2024 18:24 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I created a feed that works quite well. Maybe you like it.

bsky.app/profile/marc...

01.12.2024 18:22 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Super nice, it's going to be great to have you in the list soon.

01.12.2024 15:15 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Hey Walid, I just checked your reply history which mostly consists of starter pack requests. Feel free to come back when your content is primary about AI and your interacting with the AI community.

01.12.2024 15:01 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

So many questions. Why leaving threads? Why donโ€™t uncringe your LinkedIn, and did you mean Substack?

01.12.2024 14:51 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

๐Ÿ˜

But I was seeing your content without the dog. I needed to check your profile to understand what you meant.

One big benefit of Bluesky is creating and following custom feeds.

30.11.2024 20:10 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

Cursor vs Windsurf

I just spent a week deep-diving into Cursor and Windsurf, so you donโ€™t have to.

Here's everything you need to know ๐Ÿ‘‡๐Ÿงต

28.11.2024 20:45 โ€” ๐Ÿ‘ 4    ๐Ÿ” 1    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 2

@marcoher is following 19 prominent accounts