Boyang Albert Li's Avatar

Boyang Albert Li

@boyangalbertli.bsky.social

Nanyang Associate Professor at Nanyang Technological University, Singapore. Multimodal Learning, Data-centric AI, Computational Narrative Intelligence. http://www.boyangli.org

128 Followers  |  87 Following  |  5 Posts  |  Joined: 17.11.2024  |  1.3082

Latest posts by boyangalbertli.bsky.social on Bluesky

Post image

Please encourage your students to apply, if they are interested in pursuing a PhD at NTU. This is a great opportunity to meet their future advisors and establish connections. We especially welcome students from "non-traditional countries", which historically did not send a lot of students to NTU.

26.01.2025 12:49 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Given DeepSeek R1, the next major obstacle for AI is soft reasoning, or reasoning that requires common sense and does not have definite right or wrong answers. The RL reward becomes ill defined. One needs either RLHF or curated MCQs.

26.01.2025 08:16 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

Today I saw this formula. It's not a student's work.

21.01.2025 13:44 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

There is some hype about how using solved problems to train the next model (i.e., the data flywheel) will directly lead to AGI or superhuman AI.

While I don't believe the hype, here is a paper that may help you implement that data flywheel idea: arxiv.org/abs/2407.09985

20.01.2025 17:14 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

If you think of reasoning as an algorithm, it would require some storage space, but that doesn't mean the algorithm is not important. Space is one way to characterize an algorithm but it's only one aspect. For example, algorithms can trade time for space, and vice versa.

17.11.2024 03:44 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

@boyangalbertli is following 20 prominent accounts