's Avatar

@edwardraffml.bsky.social

Sr. Director @CrowdStrike. Visiting Prof @UMBC. Interested in all things ML

301 Followers  |  108 Following  |  314 Posts  |  Joined: 19.11.2024  |  1.76

Latest posts by edwardraffml.bsky.social on Bluesky

It is an important job! Good work πŸ‘Š

20.07.2025 23:27 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

You can see some simple stats below. Images that get tricked usually need just 3 iterations of PGD to break, and most models don't use even 100 - but there is a long tail in the iterations you need. Lucky fo rus, adaptive step sizes don't improve PGD so much, so we get this fun!

16.06.2025 13:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

This results in real-world speedups; there are two slightly slower cases because the models just didn't cycle. But those are on CIFAR10, as the dimension goes up we see better results because more of the mass exists on the edge of the ∞-norm ball, making cycling easier.

16.06.2025 13:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

As you perform more attack iterations, you see the advantage increase. If you want to do a standard 1k eval attacks against ImageNet, the naive PGD would be just as expensive as training the model, but now you can get the cost way down

16.06.2025 13:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

A second simple observation is that when you do successfully attack an image, you can just stop. Shockingly, no code for PGD in any of the major frameworks checks for this! Once in a cycle you know the future, so also stop. So the complete procedure is very simple.

16.06.2025 13:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Why does it start to cycle? The solution point exists outside the L∞ ball, and can not be reached. When you use PGD and clip to the sign, you "normalize" the steps and enforce a grid of finite locations for the search to proceed from. Voila, you get cycles!

16.06.2025 13:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

The crux of the paper is simple, you want a large max iteration count T, but you don't want ot use them all every time! When a model is robust under the L∞ norm, your perturbation starts to cycle in the corners, so you start to do redundant work!

16.06.2025 13:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Philip Doldo 's first @cvprconference.bsky.social paper, π‘†π‘‘π‘œπ‘ π‘Šπ‘Žπ‘™π‘˜π‘–π‘›π‘” 𝑖𝑛 πΆπ‘–π‘Ÿπ‘π‘™π‘’π‘ ! π΅π‘Žπ‘–π‘™π‘–π‘›π‘” 𝑂𝑒𝑑 πΈπ‘Žπ‘Ÿπ‘™π‘¦ 𝑖𝑛 π‘ƒπ‘Ÿπ‘œπ‘—π‘’π‘π‘‘π‘’π‘‘ πΊπ‘Ÿπ‘Žπ‘‘π‘–π‘’π‘›π‘‘ 𝐷𝑒𝑠𝑐𝑒𝑛𝑑, is a rare free lunch for 10x faster AML πŸ§΅πŸ‘‡ openaccess.thecvf.com/content/CVPR...

16.06.2025 13:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Utterly incredible thread by a pilot on when everything hits the fan with radios, radar, and "ATC Zero." https://threadreaderapp.com/thread/1919686227001053361.html

07.05.2025 02:32 β€” πŸ‘ 70    πŸ” 12    πŸ’¬ 1    πŸ“Œ 1

Very inclusive, we are all rank-n university graduates for some value of n!

11.04.2025 16:00 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Fits conveniently in your wallet!

30.03.2025 15:58 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

I'm skipping a lot of nitty gritty details on how to make this over 10% more accurate then the next best option! So you should read them at arxiv.org/abs/2502.02759 and check RJ out int he future at TheWebConf !

26.03.2025 16:53 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image

But plurality voting like everyone else is lame. We want to be Bayesian about it, and scale up Independent Bayesian Classifier Combination to handle sparse data like we have - with the world's fastest and most scalable implementation!

26.03.2025 16:53 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image Post image

Mostly, you wait for RJ to write a parser for almost every AV that exists to break out their responses into a standardized tokenization AND to record the relationships between AVs toa void double-voting!

26.03.2025 16:53 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

You start with AV reports from your friendly neighborhood @virustotal.bsky.social , but you get conflicting answers /info that is unstandardized from every AV, what do you do?

26.03.2025 16:53 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Would you like to have the world's most accurate malware label predictor? RJ #BoozAllen has you covered w/ ClarAVy: A Tool for Scalable and Accurate Malware Family Labeling, arxiv.org/abs/2502.02759 work πŸ§΅πŸ‘‡ to appear at thewebconf.org

26.03.2025 16:53 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Just had someone reach back 4 years later to say my advice was helpful to them and they just had their first @cvprconference.bsky.social paper accepted. So that is cool 😁

23.03.2025 02:06 β€” πŸ‘ 6    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

ai.umbc.edu/news/post/14...
Manas Gaur, Edward Raff, and Ali Mohammadi helped present a half-day tutorial at 2025 AAAI on Neurosymbolic AI and how it can be applied to LLMs to help solve key challenges in NLP tasks like explainability, grounding & instructability. See their slides & material here.

22.03.2025 01:06 β€” πŸ‘ 3    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Preview
NeSy 2025 Conference Welcome to the OpenReview homepage for NeSy 2025 Conference

One more day until the paper submission deadline! ⏰

Time to dot those i's and send it off πŸ¦•

OpenReview: openreview.net/group?id=nes...
Call for papers: 2025.nesyconf.org/call-for-pap...

07.03.2025 10:18 β€” πŸ‘ 6    πŸ” 4    πŸ’¬ 0    πŸ“Œ 0

agree that if a paper does convincingly a good service to a research community, that would be enough to warrant publication regardless of the complexity of the underlying idea. We concur with R3, in fact, that "high technical complexity does not necessarily mean novelty or good science.""

06.03.2025 16:29 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

(2) the proposed method is very simple. Besides other minor issues, disagreement arises as to whether a very simple but useful idea, as the one proposed here, deserves being published in a prestigious scientific venue such as CVPR. We discussed this extensively during the AC triplet meeting and we

06.03.2025 16:29 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Don't know why @cvprconference.bsky.social meta-reviews took a bit to come up, but ❀️ mine!: "The reviewers have mixed feelings about this paper. They generally agree that: (1) the work described here has practical value (as it allows to speed up considerably the well-known PGD algorithm), and

06.03.2025 16:29 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

🧡New paper on arXiv: Optimal Differentially Private Sampling of Unbounded Gaussians.

With @uwcheritoncs.bsky.social undergrad Valentio Iverson and PhD student Argyris Mouzakis (@argymouz.bsky.social).

The first O(d) algorithm for privately sampling arbitrary Gaussians! arxiv.org/abs/2503.01766 1/n

04.03.2025 15:25 β€” πŸ‘ 14    πŸ” 5    πŸ’¬ 1    πŸ“Œ 2

The paper if your curious, a lot of details that are easy to overlook and implicitly stated until you dig in! www.math.lsu.edu/~hozhang/pap... but this is apparently still the best line search for accurate solutions?

04.03.2025 02:49 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Makes sense, if you clear your cookies you aren't eating dominos - that's a competing food group that must be punished.

04.03.2025 02:45 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I'm currently working through/implementing the Hager Zhang line search b/c I need it for some research, and it's a monster! Would anyone care if I made a tech report on "so you want to implement LBFGs/CG just give me the details"? B/c its really not well documented anywhere.

04.03.2025 02:43 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

The submission page for #ICCV2025 is now OPEN!

openreview.net/group?id=the...

28.02.2025 18:16 β€” πŸ‘ 2    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0

So your paid in exposure right? I think it’s working! </humor>

28.02.2025 15:05 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

If you are at #AAAI2025 come and see our oral presentation today in Room 122A at 11:15AM.

The paper "Fairness Issues and Mitigations in (Differentially Private) Socio-demographic Data Processes" shows how sampling errors in survey data can introduce (1/2)

27.02.2025 12:17 β€” πŸ‘ 5    πŸ” 1    πŸ’¬ 2    πŸ“Œ 0
Preview
SciPy 2025 Schedule, talks and talk submissions for SciPy 2025

🚨 Only 7 days left to submit to #SciPy2025! πŸ”₯ Don't miss this chance to share your work with the scientific Python community! Submit your talk now: https://buff.ly/3W5Lsl9

πŸ‘€ Not submitting? Sign up as a reviewer and help curate an amazing program: https://buff.ly/3QyjR9n

26.02.2025 23:13 β€” πŸ‘ 5    πŸ” 5    πŸ’¬ 1    πŸ“Œ 0

@edwardraffml is following 20 prominent accounts