The Unjournal (Unjournal.org)'s Avatar

The Unjournal (Unjournal.org)

@unjournal.bsky.social

Researchers, practitioners, & open science advocates building a better system for research evaluation. Nonprofit. We commission public evaluation & rating of hosted work. To make rigorous research more impactful, & impactful research more rigorous.

1,730 Followers  |  801 Following  |  852 Posts  |  Joined: 24.10.2023
Posts Following

Posts by The Unjournal (Unjournal.org) (@unjournal.bsky.social)

Where Are Unjournal Papers Hosted? A Multi-Platform Analysis – The Unjournal Data Blog

unjournal.github.io/unjournaldat...

25.02.2026 21:46 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Full hosting analysis: https://unjournal.github.io/unjournaldata/posts/paper-hosting-analysis-2026/

25.02.2026 21:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

More context on why visibility matters for research evaluation: https://youtu.be/bJIGHyPVTE4?t=249

25.02.2026 21:44 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Of 57 evaluated papers: 39% on SSRN, 30% on NBER, half appear on 2+ platforms, 47 institutional repositories represented. Understanding this landscape is essential for integrating public evaluations into discovery and bibliometric systems.

25.02.2026 21:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

For journal-independent evaluation to matter for careers and trust, ratings and reviews need to be visible where researchers and institutions actually lookβ€”Google Scholar, repositories, indexing services. That's why we analyzed where Unjournal-evaluated research is hosted. 🧡

25.02.2026 21:44 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0
Preview
Unjournal and "Diversification & Decentralization of Peer Review", NISO Plus 2026 Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube.

This is my pre-conference 'practice talk'; sharing it for people in parallel sessions, and who couldn't make the Baltimore conference

24.02.2026 23:40 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 1

Sorry, more like a discussion at @nisoinfo.bsky.social considering how bibliometric standards can make journal-independent evaluations count for academic careers & trust markers.

24.02.2026 23:40 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
- YouTube
Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube. - YouTube

Research evaluation doesn't need journals.

New talk: How bibliometric standards can make journal-independent evaluations count for academic careers.

πŸŽ₯ http://dlvr.it/TR88Bh http://dlvr.it/TR88Bj

24.02.2026 23:30 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0
Unjournal and "Diversification & Decentralization of Peer Review", NISO Plus 2026
Research evaluation doesn't need journals. Unjournal.org offers an alternative. Mapping Unjournal.org's work to an information standards context. How can we use bibliometric tool, standards, and meta-data tp make journal-independent evaluations β€œcount” for career validation and credibility markers? Slides: https://docs.google.com/presentation/d/1P3VBV0irtdDWdRcqBkncJZ5lD8V1FehEYbwCYXFQwiQ/edit?usp=sharing David Reinstein: This is my pre-conference 'practice talk' -- sharing it here for people in parallel sessions, and people who couldn't make the Baltimore conference Unjournal and "Diversification & Decentralization of Peer Review", NISO Plus 2026
24.02.2026 23:25 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

You are now legally obligated to become an economics journal.

18.02.2026 02:34 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Unjournal | Transparent Evaluation of Impactful Research The Unjournal enables open, expert evaluation of economics and social science research, without the constraints of traditional journals. Discover how we make rigorous research more transparent.

We focus on research in economics, policy,Β  and other quantitative social science with potential for global impact.Β 

(About 80% is economics or adjacent).

18.02.2026 02:34 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Unjournal | Transparent Evaluation of Impactful Research The Unjournal enables open, expert evaluation of economics and social science research, without the constraints of traditional journals. Discover how we make rigorous research more transparent.

We commission experts to publicly evaluate & rate research. ToΒ make impactful research more rigorous, make academic work more useful, support open science, open access, and transparency, and improve peer-review, helping align research incentives with truth-seeking and social value.

18.02.2026 02:34 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Preview
Unjournal | Transparent Evaluation of Impactful Research The Unjournal enables open, expert evaluation of economics and social science research, without the constraints of traditional journals. Discover how we make rigorous research more transparent.

@unjournal.bsky.social would be happy to be included. See what we do at unjournal.org and unjournal.pubpub.org and decide if it makes sense.

18.02.2026 02:34 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image Post image

As specified and posted here: info.unjournal.org/evaluator-pr...

I am making the draw for these now using the closing value of S&P 500 today to 2 decimal places, 6,941.81.

-->

Winners: @matthewbjane.bsky.social and Anon evaluator (of Wellbeing paper).

Will make the payments soon.

10.02.2026 22:24 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 1
Honorable Mention Lottery β€” The Unjournal 2024–25 Evaluator Prize Transparent random draw to select two $500 prize winners from the five honorable mentions in The Unjournal's 2024–25 Evaluator Prize.

Honorable Mention Lottery: Drawing Tuesday, February 10

Two of five honorable mention evaluators will win an extra $500 each. Why a lottery? Real incentives, not token recognition β€” larger payments to fewer people reduces transaction costs for everyone.

Results announced… http://dlvr.it/TQr5fQ

08.02.2026 17:56 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
- YouTube
Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube. - YouTube

New video: The Unjournal Process β€” a 2-minute walkthrough of how we evaluate research. Produced by one of our field specialists. http://dlvr.it/TQr4cc http://dlvr.it/TQr4cg

08.02.2026 17:23 β€” πŸ‘ 0    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
The Unjournal Process: how we prioritize and evaluate research
How does The Unjournal evaluate research? This video walks through our six-step process for rigorous, transparent peer review. THE PROCESS: 1. Research curation/identification/submission, prioritization by field specialists on our team 2. Evaluation manager recruits expert evaluators (reviewers) 3. Detailed evaluation reports with quantitative ratings 4. Author response, evaluators can adjust 5. Manager synthesis and summary 6. Public dissemination (pubpub, academic databases) with DOIs πŸ”‘ KEY FEATURES: β€’ Evaluators are compensated (~avg. $350-$450 per review) β€’ 3-5 week evaluation timelines β€’ Benchmarked ratings; overall across criteria β€’ Anonymous or signed evaluations β€’ All materials publicly accessible with DOIs The Unjournal provides open, rigorous evaluation of quantitative research β€” especially economics, policy, and social science relevant to global priorities. πŸ“š Learn more: https://unjournal.org πŸ“Š See our evaluations: https://unjournal.pubpub.org πŸ“– Full documentation: https://globalimpact.gitbook.io/the-unjournal-project-and-communication-space/ #OpenScience #PeerReview #AcademicResearch #Economics #ResearchEvaluation The Unjournal Process: how we prioritize and evaluate research
08.02.2026 02:48 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
- YouTube
Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube. - YouTube

πŸŽ₯ NEW VIDEO: The Unjournal Process β€” How We Evaluate Research

Watch our 6-step process for rigorous, transparent peer review:
β€’ Expert evaluators compensated $350-450/review
β€’ 3-5 week turnaround
β€’ Public evaluations with DOIs
β€’ Author response before publication… http://dlvr.it/TQqbpC

08.02.2026 02:48 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

1. A base rate (adjusted in cases for scarcity/urgency)
2. A promptness bonus
3. Reward for tenure/previous public evaluation
4. Regular ~small incentive prizes
5. These larger prizes (annual/biennial)

07.02.2026 16:43 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
For prospective evaluators | The Unjournal: project and communication space

Thanks. Tweaks and suggestions welcome. As outlined here: globalimpact.gitbook.io/the-unjourna... we have...

07.02.2026 16:43 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Thanks again for your hard work, expertise, and engagement with the authors and evaluation managers, and productive collaboration with the other evaluator.

07.02.2026 15:17 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Evaluation 2 of Evaluation of

@cannoncloud.bsky.social unjournal.pubpub.org/pub/e2natura... @nature.com

07.02.2026 04:39 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Evaluation Summary and Metrics: Evaluation Summary and Metrics:

@voxdev.bsky.social unjournal.pubpub.org/pub/evalsumm...

07.02.2026 04:38 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Evaluation 2 of Evaluation of

@davidreiley.bsky.social unjournal.pubpub.org/pub/e2fundra...

07.02.2026 04:36 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Correction: should be listed as "Hugh Sharma Waddington"

unjournal.pubpub.org/pub/e1watert...

07.02.2026 04:33 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Interested in evaluating? Learn more at unjournal.org
β†’ info.unjournal.org/evaluator-prizes-2024-25

07.02.2026 04:30 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

The Unjournal pays evaluators ~$450/review. We believe rigorous peer review deserves real recognition and compensation.

07.02.2026 04:30 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Public expert review improves evidence quality and can inform major funders' decisions. Open dialogue between evaluators and authors exemplifies how scholarship should work.

07.02.2026 04:30 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Why reward peer review? Evaluation is essential infrastructure for good research β€” yet it's often invisible and unpaid. We want to change that.

07.02.2026 04:30 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

πŸŽ–οΈ Three anonymous reviewers provided strong evaluations: one emphasized external validity concerns in Kenya's UBI experiment; another brought clinical expertise to mental health cost-effectiveness analysis.

07.02.2026 04:30 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0