Yarin's Avatar

Yarin

@yaringal.bsky.social

Associate Professor of Machine Learning, University of Oxford; OATML Group Leader; Director of Research at the UK government's AI Safety Institute (formerly UK Taskforce on Frontier AI)

3,684 Followers  |  146 Following  |  7 Posts  |  Joined: 14.04.2024  |  1.9024

Latest posts by yaringal.bsky.social on Bluesky

Hot take: I think we just demonstrated the first AI agent computer worm πŸ€”

When an agent sees a trigger image it's instructed to execute malicious code and then share the image on social media to trigger other users' agents

This is a chance to talk about agent security πŸ‘‡

20.03.2025 14:28 β€” πŸ‘ 8    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0

Very interesting paper about unlearning for AI Safety, a subject that deserves more attention. ⬇️

11.01.2025 15:11 β€” πŸ‘ 49    πŸ” 6    πŸ’¬ 0    πŸ“Œ 0

Thanks to my amazing collaborators:

@TingchenFu @AmyPrb @StephenLCasper

@AmartyaSanyal @Adel_Bibi @aidanogara_ @_robertkirk @ben_s_bucknall @fiiiiiist Luke Ong @philiptorr Kwok-Yan Lam @RobertTrager

@DavidSKrueger @sorenmind JosΓ© HernΓ‘ndez-Orallo @megamor2.bsky.social @yaringal.bsky.social

10.01.2025 16:58 β€” πŸ‘ 7    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

Excited about our most recent work on the challenges we face when using unlearning method for safe and secure AI! Work done collaboratively by a great team & led by @fbarez.bsky.social

10.01.2025 17:06 β€” πŸ‘ 11    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Link?

21.12.2024 09:52 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
A photograph of a white robot wearing a hat holding up a white sheet of paper with the number eight on it. In the background, there is a faded beige building in front of a dark blue backdrop.

A photograph of a white robot wearing a hat holding up a white sheet of paper with the number eight on it. In the background, there is a faded beige building in front of a dark blue backdrop.

A dark blue background with white text reading β€˜...coverage in eight of the top papers for Associate Professor Yarin Gal’s research projects. Associate Professor Yarin Gal is in the papers a lot... for good reason! The AI and ML Associate Professor’s work on researching the potential β€˜collapse’ of machine learning models, hallucinating Large Language Models (LLMs), and the AI tool EVEscape that could help predict viral outbreaks have all been picked up in the press this year. Take a look: Nature (Model Collapse). BBC (EVEscape). Financial Times (Model Collapse). Forbes (Model Collapse). Time (LLM hallucination). Independent (LLM hallucination). Euronews (LLM hallucination). The Standard (LLM hallucination)’.

A dark blue background with white text reading β€˜...coverage in eight of the top papers for Associate Professor Yarin Gal’s research projects. Associate Professor Yarin Gal is in the papers a lot... for good reason! The AI and ML Associate Professor’s work on researching the potential β€˜collapse’ of machine learning models, hallucinating Large Language Models (LLMs), and the AI tool EVEscape that could help predict viral outbreaks have all been picked up in the press this year. Take a look: Nature (Model Collapse). BBC (EVEscape). Financial Times (Model Collapse). Forbes (Model Collapse). Time (LLM hallucination). Independent (LLM hallucination). Euronews (LLM hallucination). The Standard (LLM hallucination)’.

On the eighth day of Christmas, RobOx gave to us: coverage in eight of the top papers for Associate Professor Yarin Gal’s research projects. @yaringal.bsky.social

#CompSciOxford #12DaysOfChristmas #Oxmas

08.12.2024 10:36 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Post image

I look forward to co-directing the Canadian AI Safety Institute (CAISI) Research Program at CIFAR with @catherineregis.bsky.social

We will be designing the program in the coming months and will soon share ways to get involved with this new community.

Read more here: cifar.ca/cifarnews/20...

12.12.2024 19:36 β€” πŸ‘ 30    πŸ” 5    πŸ’¬ 4    πŸ“Œ 0
Post image

I'm looking for PhD applicants who have expertise in Gaussian processes and/or Transformers for an exciting PhD project

If this sounds interesting, application deadline for funding is 3/12

Please share with people you think this might be relevant to!

oatml.cs.ox.ac.uk/apply.html

30.11.2024 14:42 β€” πŸ‘ 38    πŸ” 8    πŸ’¬ 1    πŸ“Œ 0

Welcome to the Crazy Rich Bayesian Starter Pack, folk who are/were vaguely into Bayesian reasoning but - with a few exceptions - don't shun the non-Bayesian.
go.bsky.app/JYH5Z6M

25.11.2024 12:08 β€” πŸ‘ 76    πŸ” 13    πŸ’¬ 24    πŸ“Œ 5

@girving.bsky.social probably has more suggestions. Maybe Scott?

25.11.2024 16:57 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

brew install mactop
github.com/context-labs...

23.11.2024 20:02 β€” πŸ‘ 51    πŸ” 6    πŸ’¬ 1    πŸ“Œ 1

The International Society for Bayesian Analysis (ISBA) has joined Bluesky. You can follow the account at @isba-bayesian.bsky.social to stay updated on events, publications, and discussions within the #Bayesian community.

Please add the account to your starter packages.

23.11.2024 22:25 β€” πŸ‘ 39    πŸ” 17    πŸ’¬ 1    πŸ“Œ 0

Now that @jeffclune.bsky.social and @joelbot3000.bsky.social are here, time for an Open-Endedness starter pack.

go.bsky.app/MdVxrtD

20.11.2024 07:08 β€” πŸ‘ 105    πŸ” 32    πŸ’¬ 16    πŸ“Œ 5

On my way to Oxford to meet amazing people and give a talk on the opportunities of AI to accelerate progress in environmental modeling.

20.11.2024 08:35 β€” πŸ‘ 15    πŸ” 1    πŸ’¬ 2    πŸ“Œ 0
Preview
Assistant Professor (Tenure Track) of Computer Science – Responsible Artificial Intelligence

πŸ“£ We have a tenure-track faculty opening in Responsible AI at @ethzurich.bsky.social :
ethz.ch/en/the-eth-z.... Deadline Nov 30 for full consideration. ETH Zurich is a vibrant environment for AI research with the ETH AI Center etc. Please help spread the word!

20.11.2024 08:31 β€” πŸ‘ 79    πŸ” 23    πŸ’¬ 2    πŸ“Œ 0

Some machine learners were once children. Here’s where you can find them:

go.bsky.app/F6mM37U

19.11.2024 23:31 β€” πŸ‘ 125    πŸ” 16    πŸ’¬ 18    πŸ“Œ 3

I don’t need to go on social media to have my worldview challenged I am in theoretical physics I have a new existential crisis daily

18.11.2024 23:43 β€” πŸ‘ 26811    πŸ” 2034    πŸ’¬ 368    πŸ“Œ 122
Preview
MaPPing Your Model: Assessing the Impact of Adversarial Attacks on LLM-based Programming Assistants LLM-based programming assistants offer the promise of programming faster but with the risk of introducing more security vulnerabilities. Prior work has studied how LLMs could be maliciously fine-tuned...

Since this platform is finally attracting a critical mass of ML researchers, here's our recent work on prompt-based vulnerabilities of coding assistants:

arxiv.org/abs/2407.11072

TL;DR β€” An attacker can convince your favorite LLM to suggest vulnerable code with just a minor change to the prompt!

17.11.2024 23:40 β€” πŸ‘ 216    πŸ” 32    πŸ’¬ 4    πŸ“Œ 4
Post image

Hey, this Friday I'm the Keynote speaker at the 20th AAAI Conference on AI and Interactive Digital Entertainment (AIIDE), the best conference on AI and Games sites.google.com/gcloud.utah....

I think I will talk about why the next big challenge in AI game playing should be Dungeons and Dragons πŸ§™πŸ‰

19.11.2024 03:24 β€” πŸ‘ 84    πŸ” 7    πŸ’¬ 7    πŸ“Œ 4

All the ACL chapters are here now: @aaclmeeting.bsky.social @emnlpmeeting.bsky.social @eaclmeeting.bsky.social @naaclmeeting.bsky.social #NLProc

19.11.2024 03:48 β€” πŸ‘ 107    πŸ” 37    πŸ’¬ 1    πŸ“Œ 3

Hey! @friedler.net made a FAccT starter pack: bsky.app/starter-pack...

19.11.2024 03:52 β€” πŸ‘ 10    πŸ” 5    πŸ’¬ 0    πŸ“Œ 0
Post image

Hope I'm the first to post this all time classic on this platform

19.11.2024 04:51 β€” πŸ‘ 2928    πŸ” 627    πŸ’¬ 39    πŸ“Œ 28

Hey, @bsky.app @support.bsky.team, is there a way for you to shorten the displayed usernames when trailed by β€œbsky.social”? If someone has some other domain name, then fine, show that, but if we're using the default domain, can we get rid of these lengthy string of characters?

18.11.2024 20:29 β€” πŸ‘ 85    πŸ” 7    πŸ’¬ 6    πŸ“Œ 1

I've created an initial Grumpy Machine Learners starter park. If you think you're grumpy and you "do machine learning", nominate yourself. If you're on the list, but don't think you are grumpy, then take a look in the mirror.

go.bsky.app/6ddpivr

18.11.2024 14:40 β€” πŸ‘ 415    πŸ” 55    πŸ’¬ 124    πŸ“Œ 15

Google DeepMind is hiring Student Researchers in EMEA πŸ‘‡

18.11.2024 12:27 β€” πŸ‘ 33    πŸ” 4    πŸ’¬ 1    πŸ“Œ 0
https://ai.ethz.ch/education/phd-and-postdoc-programs.html

πŸ“£ Last call for the Ph.D. and Postdoc Fellowships at the ETH AI Center -- Deadline Nov 19 '24 t.co/aYI5tWXUWK @ethzurich.bsky.social

18.11.2024 10:52 β€” πŸ‘ 21    πŸ” 9    πŸ’¬ 0    πŸ“Œ 0
Preview
Safety case template for frontier AI: A cyber inability argument Frontier artificial intelligence (AI) systems pose increasing risks to society, making it essential for developers to provide assurances about their safety. One approach to offering such assurances is...

I’m keen to dig more into safety cases, there’s something β€˜proving a negative’ about them but equally it’s good to see a really concrete attempt to tether speculation. Here’s a new piece from UK AISI @girving.bsky.social and gov AI attempting to provide a template

arxiv.org/abs/2411.08088

17.11.2024 14:18 β€” πŸ‘ 9    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0

Couldn't find a machine learning for health starter pack so I made one.Β 

DM/Reply if you want to be added!

go.bsky.app/PJKJ8vK

17.11.2024 06:34 β€” πŸ‘ 109    πŸ” 29    πŸ’¬ 48    πŸ“Œ 0
Preview
a group of lizards are eating a piece of food on a wooden table with the year 2011 on the bottom right Alt: Many geckos eating yummy snacks off a dish on a wood railing

I love a gecko chamber

17.11.2024 20:49 β€” πŸ‘ 24    πŸ” 4    πŸ’¬ 0    πŸ“Œ 0

I created a starter pack of scientists in the European Laboratory for Learning and Intelligent Systems (ELLIS) πŸ‡ͺπŸ‡Ί

Please ping me and Iβ€˜ll add you.

go.bsky.app/Cihupkk

17.11.2024 16:02 β€” πŸ‘ 77    πŸ” 27    πŸ’¬ 46    πŸ“Œ 1

@yaringal is following 20 prominent accounts