From:
Extensive Media Enterprises Good Wednesday morning. —“Louisiana and Kentucky Primary results should scare James Fishback” via Peter Schorsch of Florida Politics ___ We start by turning over the top to our friend, Steve Vancore, who shakes a whole lot of salt on the Change Research poll, which is being heavily touted by Democratic statewide candidates David Jolly and Alex Vindman. 
You’ll need a giant pile of salt to digest this Florida poll. Every poll that drops into a Florida political inbox gets the same first question from anyone who knows what they’re doing: How did they build this thing? Change Research’s new “Deep Dive into Florida” from Freedom Project USA has some genuinely interesting topline findings — President Donald Trump underwater with no-party voters (no surprise); Democratic voter motivation up (no surprise); Jolly leading Byron Donalds (surprise); and Vindman and José Javier Rodríguez both leading (shock). Before anyone runs to the betting markets, let’s shake some salt on the methodology. Two things stand out. Problem 1: “Will you vote?” is a notoriously bad question The survey splits its 2,070 respondents into those who “say they will likely vote” — and that self-reported screen becomes the foundation for the most consequential numbers in the memo, including the Jolly-Donalds head-to-head. Here’s the problem: asking people whether they plan to vote is one of the least reliable questions in survey research. It is a textbook example of what social scientists call socially desirable response patterning. The concept is straightforward. When a pollster asks, “Will you be voting in the upcoming election?” most respondents know the “correct” answer. Voting is a civic virtue. Saying no is like telling your doctor you haven’t exercised for three months — technically honest, socially uncomfortable. So, people say yes. Consistently. Across every demographic. In volumes that bear no resemblance to who actually shows up. And at a time when the President’s numbers are underwater, of course, Democrats are more likely to say they will vote. Many of them probably will. But intention isn’t the best yardstick for turnout — the voter file is. This is not a small distortion. In a typical Midterm, 35% to 45% of registered voters don’t cast a ballot. But self-reported “likely voters” in pre-election surveys routinely run 70%, 80%, or even higher. The people inflating that number aren’t lying. They intend to vote. They just don’t. Life intervenes. Motivation fades. The enthusiasm they felt when they answered the survey doesn’t survive a Tuesday in November. Problem 2: The voter file solves this — and it wasn’t fully used Here’s the good news: Florida has one of the richest voter files in the country, and it contains something far more valuable than self-reported intentions — actual voting history. Did this person vote in 2022? In 2020? In the last three Primaries? That behavioral record is the gold standard for modeling who will turn out. A registered voter with a consistent Midterm history is categorically different from one who showed up once in 2020 and hasn’t voted since. The file knows the difference. Self-reported enthusiasm does not. Change Research notes in its methodology that it recruited some respondents via text messages sent to cellphone numbers on the voter file — so the file was in the room. That, in our view, is a missed opportunity. When your likely voter screen is built on “I think I’ll vote” rather than “this person has voted in four of the last five comparable elections,” your likely voter universe is softer than it looks. Partisan breakdown Kudos to Change Research for a +12 GOP model, but two concerns. Respondents were recruited using “targeted advertisements on Facebook and Instagram, as well as across the web via Facebook’s ad platform” and “text messages sent, via the Switchboard platform, to cellphone numbers listed on the voter file for individuals who qualified for the survey’s sample universe, based on their voter file data.” The second method is great. The first is the kind of methodology that rewards enthusiasts for raising their hands. The gold standard is the pollster reaching out to the respondent, not the other way around. Ad-based recruitment lets respondents self-select, and self-selection skews. The bottom line None of this means the findings are wrong. The issue environment Change Research describes — cost-of-living stress, insurance anxiety and no-party voters hostile to Trump — matches what other data sources show. The directional story is in line with other current polling. But the specific margins, and especially the enthusiasm gap numbers, deserve scrutiny. A survey that built its likely voter screen on behavioral voter file history rather than self-reported intention would give those findings a far more durable foundation. These methodology choices are likely the reason this poll is the outlier showing a top-of-the-ticket Democratic sweep. About the pollster It should come as no surprise that, while well-regarded, Change Research is a left-leaning shop that represents Democrats and progressive causes. This isn’t an attack — but it may shed some light on the findings. Read this one with a shaker in hand. ___ A few other items for your radar: 🤖 — From The Eddy: What I’m learning about the intersection of AI and politics: As many of you now know, I, along with Janelle Irwin Taylor and Drew Wilson, have launched a Substack evaluating the pros and cons of AI utilization in the newsroom — what works, what doesn’t and how do we create our own internal AI policies that maximize efficiency while still protecting journalistic integrity and the art our journalists diligently create day-in-day-out? Those are the questions I tackle in “The Eddy,” where I take a break from my own implementation to read what others are thinking. You can review my takeaways from various dialogues on AI trends and share your thoughts here as well. 📰 Disney erased FiveThirtyEight — Everyone in media, politics, or anything adjacent should read Nate Silver’s postmortem on what Disney did to FiveThirtyEight. Last week, ABC News quietly auto-redirected the entire archive to its homepage — roughly 200,000 hours of work down the drain. Silver’s piece is part business school case study, part lament: a corporate parent that never bothered to monetize a property it owned, repeatedly turned down a paywall pitch that could have cleared seven figures, then ran the brand into the ground after he left in 2023. A cautionary tale about what happens when a niche product gets swallowed by a company that only thinks in billions. 📰 This independent magazine publisher doubled down on print — Sound familiar? Simon Owens profiles Krista Faist, the Toronto founder of Twenty Two Media Group, whose two free lifestyle magazines — Foodism and Escapism — still pull roughly half their ad revenue from print a decade in. Her thesis: premium print works as brand-building for affluent, targeted readers, not as mass media chasing CPMs. She bootstrapped from a laptop, landed Loblaw before the first issue was printed, pivoted to direct-to-home distribution during COVID, and survived a 100%-plus spike in paper costs that gutted competitors. A worthwhile read for anyone watching INFLUENCE Magazine’s trajectory. ___ A top-of-the-‘burn birthday shoutout to Ashley Chambers, Communications Director for the Florida Restaurant & Lodging Association. |