Jay Patel's Avatar

Jay Patel

@infotainment.bsky.social

๐ŸŽท vibe adulting #HCI #PeerReview #SciPub #toolsforthought #ResearchSynthesis #OpenScience #MetaSci #FoSci ๐Ÿ”Ž Research: LLMs in research eval ๐Ÿง‘โ€๐Ÿซ Teaching: Stats, DataViz ๐Ÿข UMD: College of Information ๐ŸŒ PhD Candidate: Info Studies // HCI + Data ๐Ÿ๏ธ OASISlab

2,320 Followers  |  4,062 Following  |  2,220 Posts  |  Joined: 06.09.2023  |  1.9611

Latest posts by infotainment.bsky.social on Bluesky

Post image

I wonder what personality psychologists think of this analysis on.ft.com/45G0aEF by @jburnmurdoch.ft.com (which updates this paper from a couple years ago doi.org/10.1371/jour...)

08.08.2025 19:42 โ€” ๐Ÿ‘ 24    ๐Ÿ” 4    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 3

If you had to develop a brief benchmark to assess GPT-5's level of educational science knowledge, what would it include? Any quick gut checks?

08.08.2025 00:11 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Do you have any internal data on accuracy? Would be a quick and easy UX/data analysis project.

07.08.2025 22:01 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Key sections of the US Constitution deleted from government's website | TechCrunch Internet sleuths say the U.S. Constitution's website is now missing key sections from its website, including a key legal provision relating to habeas corpus, which protects citizens from unlawful dete...

The constitution. They sliced out the parts of the constitution that they donโ€™t like from the government website.

Yet another reminder that in an aspiring authoritarian government, you should never rely on online document as definitive sources.

06.08.2025 16:10 โ€” ๐Ÿ‘ 462    ๐Ÿ” 211    ๐Ÿ’ฌ 23    ๐Ÿ“Œ 32

I use:

๐ŸŸจ : definitions and questions
๐ŸŸฅ : evidence
๐ŸŸฉ : methods
๐ŸŸช : claims
๐ŸŸง : all else

grey: uncertainty/gaps/limitations

06.08.2025 21:44 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I'd log this example to help teach my undergrad stats students about uncertainty.

06.08.2025 21:05 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

Great initiative by Wiley! The publisher has started marking retracted papers in reference lists. When you click on the retraction notice, you can also see the date and reason for the retraction.
All publishers should adopt this practice. But also screen references during submission.

03.08.2025 10:43 โ€” ๐Ÿ‘ 147    ๐Ÿ” 50    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 2

There's also a severe disconnect between the math needed for a given science or CS course and the math taught in the calculus and precalc courses.

I'd happily learn more math if it actually furthered my learning of the sciences.K-10th math should be required with deep understanding of stats.

06.08.2025 01:57 โ€” ๐Ÿ‘ 2    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Read "How People Learn II: Learners, Contexts, and Cultures" at NAP.edu Read chapter Front Matter: There are many reasons to be curious about the way people learn, and the past several decades have seen an explosion of researc...

Why are there so few lab schools?

Idea for edscience grads: Use the latest thought in educational and cognitive science to deliver a uniquely effective experiences for underpriviledged youth and fund it through philanthrophic funding sources.

Create a modern research-practice partnership

06.08.2025 01:44 โ€” ๐Ÿ‘ 1    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Which edtech solutions actually leverage these ideas meaningfully?

06.08.2025 01:40 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

After a few tweaks, the open gpt 20b model gave me a correct diagnosis to a complicated health issue I needed years, thousands of dollars, and deep research skills to solve.

The older 3.5 and 4 models used to do the same, but now the pipeline is open for improvement.

This is meaningful progress.

05.08.2025 22:20 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 1

This is why editing with long delays between sessions is a must for great writing. Much initial writing is gold. The rest is repetitive and gives away from vocabulary tics.

05.08.2025 22:12 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Interesting...

05.08.2025 20:25 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

If you paid an APC, not even a thrift store...

05.08.2025 00:33 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Can you unpack your critique?

I found some incorrect labels, but I think clicking the thumbs-up and thumbs-down buttons will improve the feature over time.

Users should always click to see whether the labels are correct.

05.08.2025 00:32 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Reason number 9283 to use a reference manager: I discovered I missed a letter and was misnaming an author for the past year. Citation errors can sneak up on you.

Use something like @zotero.org or @paperpile.com

04.08.2025 23:48 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Since I read "Genentech: The beginnings of biotech" I've been craving more non-fiction about slices of scientific history.

Anyone have book recommendations?

The more detailed and specific the topic, the better! Thanks!

04.08.2025 15:56 โ€” ๐Ÿ‘ 41    ๐Ÿ” 5    ๐Ÿ’ฌ 22    ๐Ÿ“Œ 1

Reminded me of TRIPOD-AI which you also authored. Any additional value to these specialized guidelines like CHART? Reading over it, I agree with the items. The full checklist seems even more through.

I worry that few will adopt these guidelines, though.

04.08.2025 17:51 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

New journal just dropped. Late night out, don't expect me to return your calls.

01.08.2025 21:49 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Using the same content/learning objectives or more advanced?

01.08.2025 21:40 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Whatโ€™s the most underrated skill in science?
Weโ€™ll go first: writing a good limitations section.

31.07.2025 08:00 โ€” ๐Ÿ‘ 0    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Would love to see metrics like GDP per capita and other economic indicators overlayed on this chart.

31.07.2025 21:53 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

@aj-boston.bsky.social is the Lemony Snicket of the scholarly publishing world.

31.07.2025 21:49 โ€” ๐Ÿ‘ 1    ๐Ÿ” 1    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

cc @paperstarsorg.bsky.social , @alphaxiv.org The dark matter/energy problem of potential reviews is the grand challenge to fix. But how? Integration with reference managers and notebook software? Voice input via browser extensions?

30.07.2025 22:20 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 1

I've been using @paperstarsorg.bsky.social recently in addition to PubPeer and @alphaxiv.org to leave comments on papers.

I'm finding both to be very smooth and modern. Hopefully, they catch on and scale the practice #openscience.

Would be great to create a community of such tools and collab.

30.07.2025 20:45 โ€” ๐Ÿ‘ 4    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Given the health and economic benefits, the Clinical Trials feature should be provided to Elicit Free users. It would also be excellent for getting the word out about Elicit in the biomedical community.

30.07.2025 20:39 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

"This is the first study..." in a paper makes me fume. ๐Ÿ˜ค
On Google Scholar, it returns almost 2 million hits.

"This is the second study..." returns 3,840 hits.
That's a difference of ~520X.

I'm more likely to believe the latter claim.
๐Ÿ“– If you make a novelty claim, then back it up.

29.07.2025 23:46 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

๐Ÿ“– I've seen plenty of prototypes and polished programs of LLMs searching for relevant lit, extracting data, and appraising its quality.

But no evaluations of its ability to synthesize the literature into a clear and accurate whole. ๐Ÿงฉ

#metascience #AIinScience #LLM #scientificsoftware

29.07.2025 21:25 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

๐Ÿ“ฃ We are pleased to announce that recruitment for 2025-26 Crowd Preprint Reviewers & Leads is open!

๐Ÿ“ The goal of the Crowd Preprint Review initiative is to provide an engaging environment for researchers to participate in giving feedback on preprints and support public reviews of preprints.

28.07.2025 15:32 โ€” ๐Ÿ‘ 6    ๐Ÿ” 4    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 1

Meaning? Failure to comply?

29.07.2025 16:30 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

@infotainment is following 20 prominent accounts