It is an important job! Good work π
20.07.2025 23:27 β π 1 π 0 π¬ 0 π 0@edwardraffml.bsky.social
Sr. Director @CrowdStrike. Visiting Prof @UMBC. Interested in all things ML
It is an important job! Good work π
20.07.2025 23:27 β π 1 π 0 π¬ 0 π 0You can see some simple stats below. Images that get tricked usually need just 3 iterations of PGD to break, and most models don't use even 100 - but there is a long tail in the iterations you need. Lucky fo rus, adaptive step sizes don't improve PGD so much, so we get this fun!
16.06.2025 13:44 β π 0 π 0 π¬ 0 π 0This results in real-world speedups; there are two slightly slower cases because the models just didn't cycle. But those are on CIFAR10, as the dimension goes up we see better results because more of the mass exists on the edge of the β-norm ball, making cycling easier.
16.06.2025 13:44 β π 0 π 0 π¬ 1 π 0As you perform more attack iterations, you see the advantage increase. If you want to do a standard 1k eval attacks against ImageNet, the naive PGD would be just as expensive as training the model, but now you can get the cost way down
16.06.2025 13:44 β π 0 π 0 π¬ 1 π 0A second simple observation is that when you do successfully attack an image, you can just stop. Shockingly, no code for PGD in any of the major frameworks checks for this! Once in a cycle you know the future, so also stop. So the complete procedure is very simple.
16.06.2025 13:44 β π 0 π 0 π¬ 1 π 0Why does it start to cycle? The solution point exists outside the Lβ ball, and can not be reached. When you use PGD and clip to the sign, you "normalize" the steps and enforce a grid of finite locations for the search to proceed from. Voila, you get cycles!
16.06.2025 13:44 β π 0 π 0 π¬ 1 π 0The crux of the paper is simple, you want a large max iteration count T, but you don't want ot use them all every time! When a model is robust under the Lβ norm, your perturbation starts to cycle in the corners, so you start to do redundant work!
16.06.2025 13:44 β π 0 π 0 π¬ 1 π 0Philip Doldo 's first @cvprconference.bsky.social paper, ππ‘ππ πππππππ ππ πΆππππππ ! π΅ππππππ ππ’π‘ πΈππππ¦ ππ πππππππ‘ππ πΊπππππππ‘ π·ππ ππππ‘, is a rare free lunch for 10x faster AML π§΅π openaccess.thecvf.com/content/CVPR...
16.06.2025 13:44 β π 0 π 0 π¬ 1 π 0Utterly incredible thread by a pilot on when everything hits the fan with radios, radar, and "ATC Zero." https://threadreaderapp.com/thread/1919686227001053361.html
07.05.2025 02:32 β π 70 π 12 π¬ 1 π 1Very inclusive, we are all rank-n university graduates for some value of n!
11.04.2025 16:00 β π 2 π 0 π¬ 0 π 0Fits conveniently in your wallet!
30.03.2025 15:58 β π 1 π 0 π¬ 0 π 0I'm skipping a lot of nitty gritty details on how to make this over 10% more accurate then the next best option! So you should read them at arxiv.org/abs/2502.02759 and check RJ out int he future at TheWebConf !
26.03.2025 16:53 β π 0 π 0 π¬ 0 π 0But plurality voting like everyone else is lame. We want to be Bayesian about it, and scale up Independent Bayesian Classifier Combination to handle sparse data like we have - with the world's fastest and most scalable implementation!
26.03.2025 16:53 β π 0 π 0 π¬ 1 π 0Mostly, you wait for RJ to write a parser for almost every AV that exists to break out their responses into a standardized tokenization AND to record the relationships between AVs toa void double-voting!
26.03.2025 16:53 β π 0 π 0 π¬ 1 π 0You start with AV reports from your friendly neighborhood @virustotal.bsky.social , but you get conflicting answers /info that is unstandardized from every AV, what do you do?
26.03.2025 16:53 β π 0 π 0 π¬ 1 π 0Would you like to have the world's most accurate malware label predictor? RJ #BoozAllen has you covered w/ ClarAVy: A Tool for Scalable and Accurate Malware Family Labeling, arxiv.org/abs/2502.02759 work π§΅π to appear at thewebconf.org
26.03.2025 16:53 β π 0 π 0 π¬ 1 π 0Just had someone reach back 4 years later to say my advice was helpful to them and they just had their first @cvprconference.bsky.social paper accepted. So that is cool π
23.03.2025 02:06 β π 6 π 0 π¬ 0 π 0ai.umbc.edu/news/post/14...
Manas Gaur, Edward Raff, and Ali Mohammadi helped present a half-day tutorial at 2025 AAAI on Neurosymbolic AI and how it can be applied to LLMs to help solve key challenges in NLP tasks like explainability, grounding & instructability. See their slides & material here.
One more day until the paper submission deadline! β°
Time to dot those i's and send it off π¦
OpenReview: openreview.net/group?id=nes...
Call for papers: 2025.nesyconf.org/call-for-pap...
agree that if a paper does convincingly a good service to a research community, that would be enough to warrant publication regardless of the complexity of the underlying idea. We concur with R3, in fact, that "high technical complexity does not necessarily mean novelty or good science.""
06.03.2025 16:29 β π 2 π 0 π¬ 1 π 0(2) the proposed method is very simple. Besides other minor issues, disagreement arises as to whether a very simple but useful idea, as the one proposed here, deserves being published in a prestigious scientific venue such as CVPR. We discussed this extensively during the AC triplet meeting and we
06.03.2025 16:29 β π 1 π 0 π¬ 1 π 0Don't know why @cvprconference.bsky.social meta-reviews took a bit to come up, but β€οΈ mine!: "The reviewers have mixed feelings about this paper. They generally agree that: (1) the work described here has practical value (as it allows to speed up considerably the well-known PGD algorithm), and
06.03.2025 16:29 β π 1 π 0 π¬ 1 π 0π§΅New paper on arXiv: Optimal Differentially Private Sampling of Unbounded Gaussians.
With @uwcheritoncs.bsky.social undergrad Valentio Iverson and PhD student Argyris Mouzakis (@argymouz.bsky.social).
The first O(d) algorithm for privately sampling arbitrary Gaussians! arxiv.org/abs/2503.01766 1/n
The paper if your curious, a lot of details that are easy to overlook and implicitly stated until you dig in! www.math.lsu.edu/~hozhang/pap... but this is apparently still the best line search for accurate solutions?
04.03.2025 02:49 β π 0 π 0 π¬ 0 π 0Makes sense, if you clear your cookies you aren't eating dominos - that's a competing food group that must be punished.
04.03.2025 02:45 β π 0 π 0 π¬ 0 π 0I'm currently working through/implementing the Hager Zhang line search b/c I need it for some research, and it's a monster! Would anyone care if I made a tech report on "so you want to implement LBFGs/CG just give me the details"? B/c its really not well documented anywhere.
04.03.2025 02:43 β π 1 π 0 π¬ 1 π 0The submission page for #ICCV2025 is now OPEN!
openreview.net/group?id=the...
So your paid in exposure right? I think itβs working! </humor>
28.02.2025 15:05 β π 1 π 0 π¬ 1 π 0If you are at #AAAI2025 come and see our oral presentation today in Room 122A at 11:15AM.
The paper "Fairness Issues and Mitigations in (Differentially Private) Socio-demographic Data Processes" shows how sampling errors in survey data can introduce (1/2)
π¨ Only 7 days left to submit to #SciPy2025! π₯ Don't miss this chance to share your work with the scientific Python community! Submit your talk now: https://buff.ly/3W5Lsl9
π Not submitting? Sign up as a reviewer and help curate an amazing program: https://buff.ly/3QyjR9n