David Yan's Avatar

David Yan

@david-yan.bsky.social

undergrad @ princeton doing computer vision stuff https://david-yan1.github.io

34 Followers  |  351 Following  |  3 Posts  |  Joined: 08.12.2024  |  1.5344

Latest posts by david-yan.bsky.social on Bluesky

Post image

Another good example from mono depth: DepthAnythingV2 uses a teacher supervised only on synthetic data (600k) and students are distilled from its predictions on web images (62M).
Real-world GT is noisy, so fitting to limited, but perfect synthetic data is better for teacher accuracy.

16.07.2025 21:57 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image

Threw it at o3 and after thinking for 12 min (!!) it gave β€œO Canada” and A major. You can take a look at the full chain of thought here (chatgpt.com/share/6871b3...). Some highlights:

12.07.2025 01:03 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Maybe I'm not familiar enough with tokenizers, but is this different than just using a very small bottleneck dimensionality in SiamMAE? There seems to be something special about using precisely one token (specifically the [CLS] token?), but it's not immediately obvious why.

10.07.2025 18:36 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

@david-yan is following 20 prominent accounts