Scott Clifford

Scott Clifford

@scottclifford.bsky.social

Professor of Political Science. http://scottaclifford.com/

1,559 Followers 684 Following 54 Posts Joined Sep 2023
2 days ago
Preview
Strength In Numbers is looking for smart survey research assistants Note: Not a full-time job, but I will pay you — probably best for a smart undergrad or grad student or side hustle-r

Strength In Numbers is looking for a smart part-time survey research assistant (or a few)
www.gelliottmorris.com/p/strength-i...

75 32 0 2
1 day ago
Preview
Using transition statements in online surveys This experiment, part of our ongoing Methodology Matters series, evaluates the impact of transition statements in online surveys.

Ever wondered about whether to use transition statements in your surveys? Trent Ollerenshaw and I have written a blog post for the #YouGov Methodology Matters series! Read it here: yougov.com/en-us/articl...

2 2 0 0
1 week ago

Not sure offhand and don't have the data handy, but I would bet that trolls are mostly young men (assuming we trust them to report their demos). But I doubt that would explain away associations between violence and age and gender

0 0 1 0
1 week ago

Thanks! The vast majority are choosing outparty leaders, though it's more diffuse when it's unclear who the party leader is. Most other actors are politicians too, but some other elites get mentioned.

1 0 0 0
1 week ago

For those interested in measuring political violence, check out Lily and Nathan's new review paper below. See also my forthcoming paper at POQ (w/ @llopez.bsky.social and Lucas Lothamer) introducing our own measure scottaclifford.com/wp-content/u...

17 8 2 0
1 week ago

Thanks!

2 0 0 0
1 week ago

Looks interesting! Can you share a link to an ungated version?

5 0 1 0
1 week ago
Preview
How to Measure Public Support for Political Violence Abstract. With low but rising levels of violent political threats and violent acts by civilians in the United States, researchers increasingly want to meas

After nearly a decade measuring American public support for political violence, @nathankalmoe.bsky.social and I have published a somewhat comprehensive guide to measuring these attitudes. This includes historical comparisons and responses to common critiques. doi.org/10.1093/poq/...

157 69 1 1
1 week ago
Post image

My take on the partisan expressive responding literature is now in print. Open access: doi.org/10.1017/S000...

36 12 2 1
2 weeks ago
Post image

My job market paper is now available as a preprint! 🚨

Using survey evidence with a conjoint experiment, I test how state-level immigrant integration policy features affect perceptions of fairness and support.

3 key points, the big takeaway, the link, and a bonus below⬇️🧵

18 3 2 1
2 weeks ago
Preview
States United Democracy Center - Research Associate (Polling & Public Opinion) States United Democracy Center, a nonpartisan organization dedicated to the rule of law and free, fair, and secure elections, is seeking a Research Associate (Polling & Public Opini...

The research and analytics team at @statesunited.org is searching for a researcher to support our survey research program. Come join our fully remote team! Great mission, great pay, and excellent benefits.

recruiting.paylocity.com/recruiting/j...

4 5 0 0
2 weeks ago
Preview
Acquiescence Bias and Criterion Validity: Problems and Potential Solutions for Agree-Disagree Scales - Political Behavior Political Behavior - Scholars frequently measure dispositions like populism, conspiracism, racism, and sexism by asking survey respondents whether they agree or disagree with statements...

New w/@scottclifford.bsky.social.

Lots of work uses agree-disagree scales, and a lit review shows these are 1) frequently just measured in one direction (agree = higher trait) and 2) correlated with each other.

This has potentially big issues for conclusions.

link.springer.com/article/10.1...

111 49 4 9
3 weeks ago
Post image

🚨 New paper out at @ajpseditor.bsky.social 🚨

Do the public hold meaningful attitudes? Using the case of abortion policy preferences, we provide strong evidence that policy prefrences can be coherent, stable over time, and causally explain vote choice.

doi.org/10.1111/ajps...

16 15 1 0
1 month ago

Very excited to see this out at @bjpols.bsky.social! In this article, I show that contemporary political news coverage makes it challenging for readers to learn information that is helpful for democratic accountability, even for very politically engaged audiences.

A brief summary:

29 19 1 1
1 month ago

Nick Vivyan, Chris Hanretty (@chanret.bsky.social) and I have a new book out: “Idiosyncratic Issue Opinion and Political Choice”. The core of the book is making the argument that citizens’ views about political issues neither reduce to an ideological orientation nor to a lack of substance. (1/10)

45 23 3 1
1 month ago
Post image

🚨📄 New paper (conditional accepted at @thejop.bsky.social):

We test whether social desirability bias actually distorts answers in online surveys.

Short version:
It mostly doesn’t.

w. @timallinger.bsky.social @kristianvsf.bsky.social @morganlcj.bsky.social

URL: osf.io/preprints/os...

178 58 4 7
1 month ago
a graph showing JEPS has less selection on significance than other journals

When we look across journals, we see the same patterns repeated. The main exception is the Journal of Experimental Political Science, which has the highest rate of null-only reporting and lowest rate of rejection-only reporting. Kudos to them.

56 6 2 4
1 month ago
It must be very hard to publish null results
Publication practices in the social sciences act as a filter that favors statistically significant results over null findings. While the problem of selection on significance (SoS) is well-known in theory, it has been difficult to measure its scope empirically, and it has been challenging to determine how selection varies across contexts. In this article, we use large language models to extract granular and validated data on about 100,000 articles published in over 150 political science journals from 2010 to 2024. We show that fewer than 2% of articles that rely on statistical methods report null-only findings in their abstracts, while over 90% of papers highlight significant results. To put these findings in perspective, we develop and calibrate a simple model of publication bias. Across a range of plausible assumptions, we find that statistically significant results are estimated to be one to two orders of magnitude more likely to enter the published record than null results. Leveraging metadata extracted from individual articles, we show that the pattern of strong SoS holds across subfields, journals, methods, and time periods. However, a few factors such as pre-registration and randomized experiments correlate with greater acceptance of null results. We conclude by discussing implications for the field and the potential of our new dataset for investigating other questions about political science.

I have a new paper. We look at ~all stats articles in political science post-2010 & show that 94% have abstracts that claim to reject a null. Only 2% present only null results. This is hard to explain unless the research process has a filter that only lets rejections through.

644 223 30 51
1 month ago
Preview
The Poverty of Moral Foundation Messaging Prominent scholars have argued that reframing political positions and issues in terms of moral foundations that appeal to conservatives or liberals can attract more individual-level support for tho...

Reframing policy arguments with opponents' moral foundations did not change policy opinions across 5 issue areas:
www.tandfonline.com/doi/full/10....

4 5 1 0
1 month ago
Post image

Do ordinary Republicans and Democrats really avoid each other in everyday life? In a new working paper with Delia Baldassarri, we present descriptive and experimental evidence to challenge the view that partisanship drives the formation of social relationships.

osf.io/preprints/so...

1/15

82 32 2 4
1 month ago
The image features the large letters "JEPS" and the text "Call for Editor" against a dark background.

CALL FOR EDITOR -

@jepsjournal.bsky.social seeks an editor or editorial team with a commitment to publishing articles that represent the substantive and methodological diversity of experimental work in the discipline.

https://cup.org/4ae3Tul

cc @apsa.bsky.social @experimentsapsa.bsky.social

4 11 0 0
2 months ago
Preview
An Audit of Social Science Survey Experiments Abstract. Survey experiments have become a popular methodology for causal inference across the social sciences. We study the efficacy of survey experiment

This is a belated post about our paper in @poqjournal.bsky.social.

We analyzed 100 survey experiments fielded by TESS (tessexperiments.org), using only information from the proposals to identify intended hypotheses.

Here are some of the things we learned:

51 27 3 4
2 months ago

Thankfully, no!

1 0 0 0
2 months ago

JEPS has been pretty steady. Arguably much less gain for experiments with relatively clean and simple data. So any change will likely be concentrated in specific types of research.

3 0 1 0
2 months ago

I am re-upping this as a reminder that @polbehavior.bsky.social is looking for a new editor! Editing was the most rewarding part of my career and I encourage folks to think about applying.

5 6 0 0
2 months ago

Here's a suggestion for a New Year's resolution: If you see influential bad research, say something. One part of the whole replication crisis story is that a lot of psychological researchers privately knew that a lot of stuff was bad, but it wasn't discussed publicly.

144 43 11 5
2 months ago
Preview
Shared Morals Cambridge Core - Comparative Politics - Shared Morals

This book examines how moral rhetoric is a crucial – and potentially unifying – part of how we experience democratic representation.

Shared Morals: The Role of Moral Rhetoric in Party Politics by @jaeheejung.bsky.social, Coming Soon

https://cup.org/4pCplQa

#Politics #PoliSci 🗺️

13 5 0 0
2 months ago

Perhaps others have seen it already, but I found this pre-print (first posted in September) deeply troubling, raising concerns about how LLMs used for classification tasks in research open new researcher-degrees-of-freedom, which they call "LLM-hacking" (akin to p-hacking)

arxiv.org/pdf/2509.08825

15 7 1 1
2 months ago
Post image Post image Post image

Clear evidence that at universities conservatives don't face higher obstacles than liberals to establish student groups + invite outside speakers.

"These results fail to offer support for the view that conservative students encounter more difficulty in efforts to access campus resources."

717 246 7 20
3 months ago
Video thumbnail

As @seanjwestwood.bsky.social's terrifying new PNAS article demonstrates, LLMs can now pass almost every attention check, mirror personas, stay consistent across pages, and systematically bias responses in the aggregate.

So here’s a different angle: verify physical presence, not text.

53 9 2 3