João Loula's Avatar

João Loula

@joaoloula.bsky.social

PhD student @probcompproj and @MITCoCoSci, working on scaling data science using probabilistic programming.

14 Followers  |  22 Following  |  4 Posts  |  Joined: 11.02.2025  |  1.5357

Latest posts by joaoloula.bsky.social on Bluesky

Many LM applications may be formulated as text generation conditional on some (Boolean) constraint.

Generate a…
- Python program that passes a test suite.
- PDDL plan that satisfies a goal.
- CoT trajectory that yields a positive reward.
The list goes on…

How can we efficiently satisfy these? 🧵👇

13.05.2025 14:22 — 👍 11    🔁 6    💬 1    📌 0

Correction: poster number is 634 :)

26.04.2025 01:21 — 👍 0    🔁 0    💬 0    📌 0
ICLR 2025 Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo OralICLR 2025

Come find us at #ICLR this Saturday

Oral: 4:30pm (Garnet 213-215, session 6B)
Poster: 10am-12:30pm #634 (Hall 2B)
iclr.cc/virtual/2025...

25.04.2025 19:35 — 👍 3    🔁 0    💬 1    📌 0
Preview
GitHub - genlm/genlm-control: Controlled text generation with programmable constraints. Controlled text generation with programmable constraints. - genlm/genlm-control

- Cast controlled generation as an inference problem, with the LM as a prior and verifiers and scorers as likelihood
- Use Sequential Monte Carlo to sample from the resulting posterior

Library w/ tutorials for setting up your own controlled generation inference problems: github.com/genlm/genlm-...

25.04.2025 19:35 — 👍 3    🔁 1    💬 1    📌 0
Post image

#ICLR2025 Oral

How can we control LMs using diverse signals such as static analyses, test cases, and simulations?

In our paper “Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo” (w/ @benlipkin.bsky.social,
@alexlew.bsky.social, @xtimv.bsky.social) we:

25.04.2025 19:33 — 👍 7    🔁 6    💬 1    📌 0

@joaoloula is following 20 prominent accounts