I wonder what personality psychologists think of this analysis on.ft.com/45G0aEF by @jburnmurdoch.ft.com (which updates this paper from a couple years ago doi.org/10.1371/jour...)
08.08.2025 19:42 โ ๐ 24 ๐ 4 ๐ฌ 2 ๐ 3@infotainment.bsky.social
๐ท vibe adulting #HCI #PeerReview #SciPub #toolsforthought #ResearchSynthesis #OpenScience #MetaSci #FoSci ๐ Research: LLMs in research eval ๐งโ๐ซ Teaching: Stats, DataViz ๐ข UMD: College of Information ๐ PhD Candidate: Info Studies // HCI + Data ๐๏ธ OASISlab
I wonder what personality psychologists think of this analysis on.ft.com/45G0aEF by @jburnmurdoch.ft.com (which updates this paper from a couple years ago doi.org/10.1371/jour...)
08.08.2025 19:42 โ ๐ 24 ๐ 4 ๐ฌ 2 ๐ 3If you had to develop a brief benchmark to assess GPT-5's level of educational science knowledge, what would it include? Any quick gut checks?
08.08.2025 00:11 โ ๐ 2 ๐ 0 ๐ฌ 1 ๐ 0Do you have any internal data on accuracy? Would be a quick and easy UX/data analysis project.
07.08.2025 22:01 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0The constitution. They sliced out the parts of the constitution that they donโt like from the government website.
Yet another reminder that in an aspiring authoritarian government, you should never rely on online document as definitive sources.
I use:
๐จ : definitions and questions
๐ฅ : evidence
๐ฉ : methods
๐ช : claims
๐ง : all else
grey: uncertainty/gaps/limitations
I'd log this example to help teach my undergrad stats students about uncertainty.
06.08.2025 21:05 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0Great initiative by Wiley! The publisher has started marking retracted papers in reference lists. When you click on the retraction notice, you can also see the date and reason for the retraction.
All publishers should adopt this practice. But also screen references during submission.
There's also a severe disconnect between the math needed for a given science or CS course and the math taught in the calculus and precalc courses.
I'd happily learn more math if it actually furthered my learning of the sciences.K-10th math should be required with deep understanding of stats.
Why are there so few lab schools?
Idea for edscience grads: Use the latest thought in educational and cognitive science to deliver a uniquely effective experiences for underpriviledged youth and fund it through philanthrophic funding sources.
Create a modern research-practice partnership
Which edtech solutions actually leverage these ideas meaningfully?
06.08.2025 01:40 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0After a few tweaks, the open gpt 20b model gave me a correct diagnosis to a complicated health issue I needed years, thousands of dollars, and deep research skills to solve.
The older 3.5 and 4 models used to do the same, but now the pipeline is open for improvement.
This is meaningful progress.
This is why editing with long delays between sessions is a must for great writing. Much initial writing is gold. The rest is repetitive and gives away from vocabulary tics.
05.08.2025 22:12 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0Interesting...
05.08.2025 20:25 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0If you paid an APC, not even a thrift store...
05.08.2025 00:33 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0Can you unpack your critique?
I found some incorrect labels, but I think clicking the thumbs-up and thumbs-down buttons will improve the feature over time.
Users should always click to see whether the labels are correct.
Reason number 9283 to use a reference manager: I discovered I missed a letter and was misnaming an author for the past year. Citation errors can sneak up on you.
Use something like @zotero.org or @paperpile.com
Since I read "Genentech: The beginnings of biotech" I've been craving more non-fiction about slices of scientific history.
Anyone have book recommendations?
The more detailed and specific the topic, the better! Thanks!
Reminded me of TRIPOD-AI which you also authored. Any additional value to these specialized guidelines like CHART? Reading over it, I agree with the items. The full checklist seems even more through.
I worry that few will adopt these guidelines, though.
New journal just dropped. Late night out, don't expect me to return your calls.
01.08.2025 21:49 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0Using the same content/learning objectives or more advanced?
01.08.2025 21:40 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0Whatโs the most underrated skill in science?
Weโll go first: writing a good limitations section.
Would love to see metrics like GDP per capita and other economic indicators overlayed on this chart.
31.07.2025 21:53 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0@aj-boston.bsky.social is the Lemony Snicket of the scholarly publishing world.
31.07.2025 21:49 โ ๐ 1 ๐ 1 ๐ฌ 1 ๐ 0cc @paperstarsorg.bsky.social , @alphaxiv.org The dark matter/energy problem of potential reviews is the grand challenge to fix. But how? Integration with reference managers and notebook software? Voice input via browser extensions?
30.07.2025 22:20 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 1I've been using @paperstarsorg.bsky.social recently in addition to PubPeer and @alphaxiv.org to leave comments on papers.
I'm finding both to be very smooth and modern. Hopefully, they catch on and scale the practice #openscience.
Would be great to create a community of such tools and collab.
Given the health and economic benefits, the Clinical Trials feature should be provided to Elicit Free users. It would also be excellent for getting the word out about Elicit in the biomedical community.
30.07.2025 20:39 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0"This is the first study..." in a paper makes me fume. ๐ค
On Google Scholar, it returns almost 2 million hits.
"This is the second study..." returns 3,840 hits.
That's a difference of ~520X.
I'm more likely to believe the latter claim.
๐ If you make a novelty claim, then back it up.
๐ I've seen plenty of prototypes and polished programs of LLMs searching for relevant lit, extracting data, and appraising its quality.
But no evaluations of its ability to synthesize the literature into a clear and accurate whole. ๐งฉ
#metascience #AIinScience #LLM #scientificsoftware
๐ฃ We are pleased to announce that recruitment for 2025-26 Crowd Preprint Reviewers & Leads is open!
๐ The goal of the Crowd Preprint Review initiative is to provide an engaging environment for researchers to participate in giving feedback on preprints and support public reviews of preprints.
Meaning? Failure to comply?
29.07.2025 16:30 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0