Hubbry Logo
FiveThirtyEightFiveThirtyEightMain
Open search
FiveThirtyEight
Community hub
FiveThirtyEight
logo
7 pages, 0 posts
0 subscribers
Be the first to start a discussion here.
Be the first to start a discussion here.
FiveThirtyEight
FiveThirtyEight
from Wikipedia

FiveThirtyEight, also rendered as 538, was an American website that focused on opinion poll analysis, politics, economics, and sports blogging in the United States.[2]

Key Information

The website, which took its name from the number of electors in the United States electoral college,[538 1] was founded on March 7, 2008, as a polling aggregation website with a blog created by analyst Nate Silver. In August 2010, the blog became a licensed feature of The New York Times online and was renamed FiveThirtyEight: Nate Silver's Political Calculus. In July 2013, ESPN acquired FiveThirtyEight, hiring Silver as editor-in-chief and a contributor for ESPN.com; the new publication launched on March 17, 2014.[3] Afterwards, the FiveThirtyEight blog covered a broad spectrum of subjects including politics, sports, science, economics, and popular culture. In 2018, operations were transferred from ESPN to sister property ABC News (also under parent The Walt Disney Company).

During the presidential primaries and general election of 2008 the site compiled polling data through a unique methodology derived from Silver's experience in sabermetrics to "balance out the polls with comparative demographic data".[4][5] Silver weighted "each poll based on the pollster's historical track record, sample size, and recentness of the poll".[6] Since the 2008 election, the site published articles—typically creating or analyzing statistical information—on a wide variety of topics in current politics and political news. These included a monthly update on the prospects for turnover in the Senate; federal economic policies; Congressional support for legislation; public support for health care reform, global warming legislation and LGBT rights; elections around the world; marijuana legalization; and numerous other topics. The site (as well as its founder) was best known for election forecasts, including the 2012 presidential election in which FiveThirtyEight correctly predicted the vote winner of all 50 states and the District of Columbia.

FiveThirtyEight won numerous awards, including Bloggie Awards for Best Political Coverage in 2008 and Best Weblog about Politics in 2009 as well as Webbies for Best Political Blog in 2012 and 2013. While under the ownership of ESPN in 2016, FiveThirtyEight won the Data Journalism Website of the Year award from the Global Editors Network.

Founder Nate Silver left in 2023, taking the rights to his forecasting model with him to his website Silver Bulletin.[7][8][9] The site's new owner, Disney, hired G. Elliott Morris to develop a new model.[7][8] On September 18, 2023, the original website domain at fivethirtyeight.com was closed, with web traffic becoming redirected to ABC News pages, and its logo was replaced, with the name 538 used instead of FiveThirtyEight.[2] On March 5, 2025, 538 was shut down by ABC News and its staff were laid off.[10]

Methods

[edit]

One aspect of the site was Silver's efforts to rank pollsters by accuracy, weight their polls accordingly, and then supplement those polls with his own electoral projections based on demographics and prior voting patterns. Silver said: "I did think there was room for a more sophisticated way of handling these things."[11][12]

FiveThirtyEight weighted pollsters' historical track records through a complex methodology,[538 2] and assigned them values to indicate "Pollster-Introduced Error". At its base, Silver's method is similar to other analysts' approaches to taking advantage of the multiple polls that are conducted within each state: he averaged the polling results. But especially in the early months of the election season polling in many states is sparse and episodic. The "average" of polls over an extended period (perhaps several weeks) would neither reveal the true state of voter preferences at the present time, nor provide an accurate forecast of the future. One approach to this problem was followed by Pollster.com: if enough polls were available, it computed a locally weighted moving average or LOESS.

While adopting such an approach in his own analysis, Silver reasoned that there was additional information available in polls from "similar" states that might help to fill the gaps in information about the trends in a given state. Accordingly, he adapted an approach that he had previously used in his baseball forecasting: using nearest neighbor analysis he first identified "most similar states" and then factored into his electoral projections for a given state the polling information from "similar states". He carried this approach one step further by also factoring national polling trends into the estimates for a given state. Thus, his projections were not simply based on the polling trends in a given state.

Furthermore, a basic intuition that Silver drew from his analysis of the 2008 Democratic party primary elections was that the voting history of a state or Congressional district provided clues to current voting. This is what allowed him to beat all the pollsters in his forecasts in the Democratic primaries in North Carolina and Indiana, for example.[13] Using such information allowed Silver to come up with estimates of the vote preferences even in states for which there were few if any polls. For his general election projections for each state, in addition to relying on the available polls in a given state and "similar states", Silver estimated a "538 regression" using historical voting information along with demographic characteristics of the states to create an estimate that he treated as a separate poll (equivalent to the actually available polls from that state). This approach helped to stabilize his projections, because if there were few if any polls in a given state, the state forecast was largely determined by the 538 regression estimate.

Transparency of pollster ratings

[edit]

On June 6, 2010, FiveThirtyEight posted pollster rankings that updated and elaborated Silver's efforts from the 2008 election. Silver expanded the database to more than 4,700 election polls and developed a model for rating the polls that was more sophisticated than his original rankings.[538 3][14] Silver responded on 538: "Where's the transparency? Well, it's here [citing his June 6 article], in an article that contains 4,807 words and 18 footnotes. Every detail of how the pollster ratings are calculated is explained. It's also here [referring to another article], in the form of Pollster Scorecards, a feature which we'll continue to roll out over the coming weeks for each of the major polling firms, and which will explain in some detail how we arrive at the particular rating that we did for each one".[538 4]

As for why the complete 538 polling database had not been released publicly, Silver responded: "The principal reason is because I don't know that I'm legally entitled to do so. The polling database was compiled from approximately eight or ten distinct data sources, which were disclosed in a comment which I posted shortly after the pollster ratings were released, and which are detailed again at the end of this article. These include some subscription services, and others from websites that are direct competitors of this one. Although polls contained in these databases are ultimately a matter of the public record and clearly we feel as though we have every right to use them for research purposes, I don't know what rights we might have to re-publish their data in full." Silver also commented on the fact that the 538 ratings had contributed to Markos Moulitsas's decision to end Daily Kos's use of Research 2000 as its pollster.[15]

On June 11, 2010, Mark Blumenthal also commented on the question of transparency in an article in the National Journal titled "Transparency In Rating: Nate Silver's Impressive Ranking Of Pollsters' Accuracy Is Less Impressive In Making Clear What Data Is Used".[16] He noted that in the case of Research 2000 there were some discrepancies between what Silver reported and what the pollster itself reported. Other researchers questioned aspects of the methodology.[17]

On June 16, 2010, Silver announced on his blog that he is willing to give all pollsters who he had included in his rating a list of their polls that he had in his archive, along with the key information that he used (poll marginals, sample size, dates of administration); and he encouraged the pollsters to examine the lists and the results to compare them with the pollster's own record and make corrections.[538 5]

In September 2014, Silver put into the public domain all of his pollster ratings,[538 6] as well as descriptive summary data for all of the more than 6,600 polls in his data collection for the final three weeks of U.S. presidential primaries and general elections, state governor elections, and U.S. Senate and U.S. Congress elections for the years 1998–2012.[18] In addition to updating his pollster ratings, he published an updated methodological report.[538 7]

History

[edit]

Origins

[edit]

Nate Silver started FiveThirtyEight in early March 2008, published under the pseudonym Poblano, the same name that he had used since November 2007 when he began publishing a diary on the political blog Daily Kos.[19] The name FiveThirtyEight derives from the 538 electors in the United States Electoral College.[20] Writing for Daily Kos, Silver had gained a following, especially for his primary election forecast on Super Tuesday, February 5, 2008.[21][22] From that primary election day, which included contests in 24 states plus American Samoa, Poblano predicted that Barack Obama would come away with 859 delegates, and Hillary Clinton 829; in the final contests, Obama won 847 delegates and Clinton 834. Based on this result, New York Times op-ed columnist William Kristol wrote: "And an interesting regression analysis at the Daily Kos Web site (poblano.dailykos.com) of the determinants of the Democratic vote so far, applied to the demographics of the Ohio electorate, suggests that Obama has a better chance than is generally realized in Ohio".[23]

FiveThirtyEight gained further national attention for beating out most pollsters' projections in the North Carolina and Indiana Democratic party primaries on May 6, 2008. As Mark Blumenthal wrote in National Journal, "Over the last week, an anonymous blogger who writes under the pseudonym Poblano did something bold on his blog, FiveThirtyEight.com. He posted predictions for the upcoming primaries based not on polling data, but on a statistical model driven mostly by demographic and past vote data. ... Critics scoffed. Most of the public polls pointed to a close race in North Carolina. ... But a funny thing happened. The model got it right."[13] Silver relied on demographic data and on the history of voting in other states during the 2008 Democratic primary elections.[11] On May 30, 2008, Silver revealed his true identity for the first time to his FiveThirtyEight readers.[538 8] After that date, he published just four more diaries on Daily Kos.[19]

As the primary season was coming to an end, Silver began to build a model for the general election race. This model, too, relied in part on demographic information but mainly involved a complex method of aggregating polling results. In 2008, Rasmussen Reports had an apparently short-term partnership with FiveThirtyEight in order to include this unique methodology for generating poll averages in their "Balance of Power Calculator".[24] At the same time, FiveThirtyEight's daily "Today's Polls" column began to be mirrored on "The Plank", a blog published by The New Republic.[25]

In July 2008, the site began to report regular updates of projections of 2008 U.S. Senate races. Special procedures were developed relying on both polls and demographic analysis. The projections were updated on a weekly basis.[538 9]

By early October 2008, FiveThirtyEight approached 2.5 million visitors per week, while averaging approximately 400,000 per weekday.[538 10] During October 2008 the site received 3.63 million unique visitors, 20.57 million site visits, and 32.18 million page views.[538 11] On Election Day, November 4, 2008, the site had nearly 5 million page views.[26]

Final projections of 2008 elections

[edit]

In the final update of his presidential forecast model at midday of November 4, 2008, Silver projected a popular vote victory by 6.1 percentage points for Barack Obama and electoral vote totals of 349 (based on a probabilistic projection) or 353 (based on fixed projections of each state).[538 12] Obama won with 365 electoral college votes. Silver's predictions matched the actual results everywhere except in Indiana and the 2nd congressional district of Nebraska, which awards an electoral vote separately from the rest of the state. His projected national popular vote differential was below the actual figure of 7.2 points.

The forecasts for the Senate proved to be correct for every race, but the near stalemate in Minnesota led to a recount that was settled only on June 30, 2009. In Alaska, after a protracted counting of ballots, on November 19 Republican incumbent Ted Stevens conceded the seat to Democrat Mark Begich, an outcome that Silver had forecast on election day.[27] In Georgia, a run-off election on December 2 led to the re-election of Republican Saxby Chambliss, a result that was also consistent with Silver's original projection.

The ground game and "On the Road"

[edit]

During the 2008 electoral campaign, Sean Quinn, a second contributor, drew on his knowledge and experience with campaign organizations to evaluate the ground game and "get out the vote" strategies of the McCain and Obama campaign teams. A poker player, Quinn drew an analogy between Barack Obama's electoral strategy and a poker player having multiple "outs" for winning a hand.[28]

In September, Quinn launched a series of essays under the name On the Road.[29] Quinn traveled from state to state telling the story of the campaign from the electoral battleground, drawing on observations and interviews with grassroots campaign workers.

After the 2008 U.S. election

[edit]

Focus

[edit]

During the first two months after the election, no major innovations in content were introduced. A substantial percentage of the articles focused on Senatorial races: the runoff in Georgia, won by Saxby Chambliss; recounts of votes in Alaska (won by Mark Begich), and Minnesota (Al Franken vs. Norm Coleman); and the appointments of Senatorial replacements in Colorado, New York, and Illinois.

After President Obama's inauguration, Sean Quinn reported that he was moving to Washington, D.C., to continue political writing from that locale.[538 13] On February 4, 2009, he became the first blogger to join the White House press corps.[538 14] After that time, however, he contributed only a handful of articles to FiveThirtyEight.

During the post-2008 election period Silver devoted attention to developing some tools for the analysis of forthcoming 2010 Congressional elections,[538 15][538 16] as well as discussing policy issues and the policy agenda for the Obama administration, especially economic policies.[538 17][538 18] He developed a list of 2010 Senate races in which he made monthly updates of predicted party turnover.[538 19]

Later, Silver adapted his methods to address a variety of issues of the day, including health care reform, climate change, unemployment, and popular support for same-sex marriage.[30] He wrote a series of columns investigating the credibility of polls by Georgia-based firm Strategic Vision, LLC. According to Silver's analysis, Strategic Vision's data displayed statistical anomalies that were inconsistent with random polling. Later, he uncovered indirect evidence that Strategic Vision may have gone as far as to fabricate the results of a citizenship survey taken by Oklahoma high school students, which led him to denounce Strategic Vision as "disreputable and fraudulent".[31][538 20][538 21][538 22][538 23][538 24][32][a] FiveThirtyEight devoted more than a dozen articles to the Iranian presidential election in June 2009, assessing of the quality of the vote counting. International affairs columnist Renard Sexton began the series with an analysis of polling leading up to the election;[538 25] then posts by Silver, Andrew Gelman and Sexton analyzed the reported returns and political implications.[538 26]

FiveThirtyEight covered the November 3, 2009, elections in the United States in detail.[538 27][538 28] FiveThirtyEight writers Schaller, Gelman, and Silver also gave extensive coverage to the January 19, 2010 Massachusetts special election to the U.S. Senate. The "538 model" once again aggregated the disparate polls to correctly predict that the Republican Scott Brown would win.[538 29]

In spring 2010, FiveThirtyEight turned a focus on the United Kingdom general election scheduled for May 6, with a series of more than forty articles on the subject that culminated in projections of the number of seats that the three major parties were expected to win.[538 30] Following a number of preview posts in January[538 31] and February,[538 32] Renard Sexton examined subjects such as the UK polling industry[538 33][538 34][538 35] and the 'surge' of the third-party Liberal Democrats,[538 36] while Silver, Sexton and Dan Berman[b] developed a seat projection model. The UK election was the first time the FiveThirtyEight team did an election night 'liveblog' of a non-U.S. election.[538 37]

In April 2010, The Guardian published Silver's predictions for the 2010 United Kingdom General Election. The majority of polling organisations in the UK use the concept of uniform swing to predict the outcome of elections. However, by applying his own methodology, Silver produced very different results, which suggested that a Conservative victory might have been the most likely outcome.[34] After a series of articles, including critiques and responses to other electoral analysts, his "final projection" was published on the eve of the election.[538 38] In the end, Silver's projections were off the mark, particularly compared with those of some other organizations, and Silver wrote a post mortem on his blog.[538 39] Silver examined the pitfalls of the forecasting process,[538 39] while Sexton discussed the final government agreement between the Conservatives and the Liberal Democrats.[538 40]

Partnership with The New York Times: 2010–2013

[edit]

On June 3, 2010, Silver announced that in early August the blog would be "relaunched under a NYTimes.com domain".[538 41][35][36] The transition took place on August 25, 2010, with the publication of Silver's first FiveThirtyEight blog article online in The New York Times.[538 42]

On June 3, 2010, The New York Times and Silver announced that FiveThirtyEight had formed a partnership under which the blog would be hosted by the Times for a period of three years.[37] In legal terms, FiveThirtyEight granted a "license" to the Times to publish the blog. The blog would be listed under the "Politics" tab of the News section of the Times.[38] FiveThirtyEight would thus be subject to and benefit from editing and technical production by the Times, while FiveThirtyEight would be responsible for creating the content.

Silver received bids from several major media entities before selecting the Times.[38][39] Under terms of the agreement, Silver would also write monthly articles for the print version of both the newspaper and the Sunday magazine.[538 41] Silver did not move his blog to the highest bidder, because he was concerned with maintaining his own voice while gaining the exposure and technical support that a larger media company could provide. "There's a bit of a Groucho Marx quality to it [Silver has said]. ... You shouldn't want to belong to any media brand that seems desperate to have you as a member, even though they'll probably offer the most cash".[40]

The first column of the renamed FiveThirtyEight: Nate Silver's Political Calculus appeared in the Times on August 25, 2010, with the introduction of U.S. Senate election forecasts. At the same time, Silver published a brief history of the blog.[538 43] All columns from the original FiveThirtyEight were also archived for public access.[41]

Shortly after FiveThirtyEight relocated to The New York Times, Silver introduced his prediction models for the 2010 elections to the U.S. Senate, the U.S. House of Representatives, and state Governorships. Each of these models relied initially on a combination of electoral history, demographics, and polling. The 538 model had forecast a net pickup of 8 seats by the Republicans in the Senate and 55 seats in the House, close to the actual outcome of a pickup of 6 seats in the Senate and 63 seats in the House.[538 44]

Writers

[edit]

When the transition to The New York Times was announced, Silver listed his staff of writers for the first time.[41] However, of the seven listed writers, only three of them had published on 538/New York Times by late December 2010: Silver, Renard Sexton and Hale Stewart. Andrew Gelman contributed again in early 2011.[538 45] Brian McCabe published his first article in January 2011.[538 46][c]

Beginning in 2011, one writer who emerged as a regular contributor was Micah Cohen. Cohen provided a periodic "Reads and Reactions" column in which he summarized Silver's articles for the previous couple of weeks, as well as reactions to them in the media and other blogs, and suggested some additional readings related to the subject of Silver's columns. Silver identified Cohen as "my news assistant".[538 47] Cohen also contributed additional columns on occasion.[538 48]

On September 12, 2011, Silver introduced another writer: "FiveThirtyEight extends a hearty welcome to John Sides, a political scientist at George Washington University, who will be writing a series of posts for this site over the next month. Mr. Sides is also the founder of the blog The Monkey Cage, which was named the 2010 Blog of the Year by The Week magazine".[538 49]

Beyond electoral politics

[edit]

While politics and elections remained the main focus of FiveThirtyEight, the blog also sometimes addressed sports, including the March Madness[538 50][538 51][43] and the 2012 NCAA Men's Basketball tournament selection process,[538 52] the B.C.S. rankings in NCAA college football,[44] the NBA,[538 53][538 54][538 55] and Major League Baseball matters ranging from the 2011 attendance at the New York Mets' Citi Field[538 56] to the historic 2011 collapse of the Boston Red Sox.[538 57] The site has also posted forecasts for the Academy Awards.[45]

In addition, FiveThirtyEight sometimes turned its attention to other topics, such as the economics of blogging,[538 58] the financial ratings by Standard & Poors,[538 59] economists' tendency to underpredict unemployment levels,[538 60] and the economic impact and media coverage of Hurricane Irene (2011).[538 61][538 62]

Adapted from a FiveThirtyEight October 2011 graph published in The New York Times[538 63]

FiveThirtyEight published a graph showing different growth curves of the news stories covering Tea Party and Occupy Wall Street protests. Silver pointed out that conflicts with the police caused the sharpest increases in news coverage of the protests[538 63] and assessed the geography of the protests by analyzing news reports of the size and location of events across the United States.[538 64]

2012 U.S. elections

[edit]

FiveThirtyEight rolled out its 2012 general election forecasting model on June 7, 2012. The model forecast both the popular vote and the Electoral College vote, with the latter being central to the exercise and involving a forecast of each state. In the initial forecast, Barack Obama was estimated to have a 61.8% chance of winning the electoral vote. The website provided maps and statistics about the electoral outcomes in each state as well as nationally. Later posts addressed methodological issues such as the "house effects" of different pollsters as well as the validity of telephone surveys that did not call cell phones.[538 65]

On the morning of November 6, Election Day, Silver's model gave President Obama a 90.9% chance of winning a majority of the electoral votes.[538 66] The 538 model correctly predicted the winner of all 50 states and the District of Columbia.[46][d] Silver, along with at least two academic-based analysts who aggregated polls from multiple pollsters, thus not only correctly predicted all 50 states, but also all nine "swing states".[47] In contrast, individual pollsters were less successful. For example, Rasmussen Reports "missed on six of its nine swing-state polls".[48]

An independent analysis of Silver's state-by-state projections, assessing whether the percentages of votes that the candidates actually received fell within the "margin of error" of Silver's forecasts, found that "48 out of 50 states actually fell within his margin of error, giving him a success rate of 96%. And assuming that his projected margin of error figures represent 95 percent confidence intervals, which it is likely they did, Silver performed just about exactly as well as he would expect to over 50 trials. Wizard, indeed".[49][50] Additional tests of the accuracy of the electoral vote predictions were published by other researchers.[51][52]

ESPN and ABC News affiliation

[edit]

In July 2013, it was revealed that Silver and his FiveThirtyEight blog would depart The New York Times and join ESPN.[53] In its announcement of its acquisition of FiveThirtyEight, ESPN reported that "Silver will serve as the editor-in-chief of the site and will build a team of journalists, editors, analysts and contributors in the coming months. Much like Grantland, which ESPN launched in 2011, the site will retain an independent brand sensibility and editorial point-of-view, while interfacing with other websites in the ESPN and Disney families. The site will return to its original URL, www.FiveThirtyEight.com."[54]

According to Silver, the focus of FiveThirtyEight in its ESPN phase would broaden: "People also think it's going to be a sports site with a little politics thrown in, or it's going to be a politics site with sports thrown in. ... But we take our science and economics and lifestyle coverage very seriously. ... It's a data journalism site. Politics is one topic that sometimes data journalism is good at covering. It's certainly good with presidential elections. But we don't really see politics as how the site is going to grow".[55]

FiveThirtyEight launched its ESPN webpage on March 17, 2014. The lead story by Silver explained that "FiveThirtyEight is a data journalism organization. ... We've expanded our staff from two full-time journalists to 20 and counting. Few of them will focus on politics exclusively; instead, our coverage will span five major subject areas – politics, economics, science, life and sports. Our team also has a broad set of skills and experience in methods that fall under the rubric of data journalism. These include statistical analysis, but also data visualization, computer programming and data-literate reporting. So in addition to written stories, we'll have interactive graphics and features".[538 67] FiveThirtyEight launched its ESPN-affiliated stage on March 17, 2014. As of July, it had a staff of 20 writers, editors, data visualization specialists, and others.[538 68] By March 2016, this staff had nearly doubled to 37 listed on the masthead, and 7 listed as contributors.[56] The site produced articles under 5 headings: politics, economics, science and health, (cultural) life, and sports. In addition to feature articles it produced podcasts on a range of subjects.

Monthly traffic to the site grew steadily from about 2.8 million unique visitors in April 2014 to 10.7 million unique visitors in January 2016.[57]

2014 U.S. elections

[edit]

On September 3, 2014, FiveThirtyEight introduced its forecasts for each of the 36 U.S. Senate elections being contested that year.[538 69] At that time, the Republican Party was given a 64 percent chance of holding a majority of the seats in the Senate after the election. However, Silver also remarked, "An equally important theme is the high degree of uncertainty around that outcome. A large number of states remain competitive, and Democrats could easily retain the Senate".[538 70] About two weeks later, the forecast showed the Republican chances of holding the majority down to 55 percent.[538 71]

2016 Oscars predictions

[edit]

FiveThirtyEight sought to apply its mathematical models to the Oscars, and produced internal predictions regarding the subject, predicting four out of six categories correctly.[58] The website also compiled a list of other predictions made by other people using different methods.[59]

2016 U.S. elections

[edit]

Presidential primary elections

[edit]

FiveThirtyEight applied two separate models to forecast the 2016 presidential primary elections – polls-only and polls-plus models. The polls-only model relied only on polls from a particular state, while the polls-plus model was based on state polls, national polls and endorsements. For each contest, FiveThirtyEight produced probability distributions and average expected vote shares according to both models.[60]

As early as June 2015, FiveThirtyEight argued that Donald Trump "isn't a real candidate".[61] When Donald Trump became the presumptive Republican nominee in May 2016, New York Times media columnist Jim Rutenberg wrote that "predictions can have consequences" and criticized FiveThirtyEight for underestimating Trump's chances. He argued that by giving "Mr. Trump a 2 percent chance at the nomination despite strong polls in his favor ... they also arguably sapped the journalistic will to scour his record as aggressively as those of his supposedly more serious rivals".[62]

In a long retrospective, "How I Acted Like a Pundit and Screwed up on Donald Trump", published in May 2016 after Trump had become the presumptive nominee, Silver reviewed how he had erred in evaluating Trump's chances early in the primary campaign. Silver wrote, "The big mistake is a curious one for a website that focuses on statistics. Unlike virtually every other forecast we publish at FiveThirtyEight – including the primary and caucus projections I just mentioned – our early estimates of Trump's chances weren't based on a statistical model. Instead, they were what we [call] 'subjective odds' – which is to say, educated guesses. In other words, we were basically acting like pundits, but attaching numbers to our estimates. And we succumbed to some of the same biases that pundits often suffer, such as not changing our minds quickly enough in the face of new evidence. Without a model as a fortification, we found ourselves rambling around the countryside like all the other pundit-barbarians, randomly setting fire to things".[63]

On the Democratic side, FiveThirtyEight argued that Senator Bernie Sanders could "lose everywhere else after Iowa and New Hampshire"[64] and that the "Democratic establishment would rush in to squash" him if he does not.[65] Sanders went on to win 23 states in the primaries.

Fairness and Accuracy in Reporting, a progressive nonprofit media watch group, wrote in May 2016 that FiveThirtyEight "sacrificed its integrity to go after Sanders" and that they have "at times gone beyond the realm of punditry into the realm of hackery – that is, not just treating their own opinions as though they were objective data, but spinning the data so that it conforms to their opinions."[66]

FiveThirtyEight's predictions for each state primary, both for the Republican and the Democratic party nominations, were based on statistical analysis, not on the analyst's opinions. The core data employed were polls, which FiveThirtyEight aggregated for each state (while also considering national polls) using essentially the same method it had employed since 2008. In the 2016 primaries, the projections also took into account endorsements.[67] The website also kept track of the accumulation of national party convention delegates.[68] In a comparison of prediction success published by Bloomberg News after the primary season was completed, FiveThirtyEight's prediction success tied for the highest percentage of correct primary poll winners, at 92%; but it lagged behind PredictWise in predicting a larger set of primaries.[69] Notably, even with FiveThirtyEight's track record of correctly predicting elections that pollsters get wrong, it still missed Bernie Sanders's upset victory in the Michigan primary, for instance, regarded as "one of the biggest upsets in modern political history".[66]

Presidential general election

[edit]

The final prediction by FiveThirtyEight on the morning of election day (November 8, 2016) had Hillary Clinton with a 71% chance to win the 2016 United States presidential election,[70] while other major forecasters had predicted Clinton to win with at least an 85% to 99% probability.[71][72] FiveThirtyEight's model pointed to the possibility of an Electoral College-popular vote split widening in final weeks based on both Clinton's small lead in general polls, but also on Trump's improvement in swing states like Florida or Pennsylvania, mixed with Clinton's poor performance in several of those swing states in comparison with Obama's performance in 2012.[73] The main issues pointed out by the forecast model was the imbalance of Clinton's improvement in very populated states like Texas, Georgia (projected safe for Republican) and California (projected safe for Democrats);[73] mixed with her inability to attract white voters without a college degree, an increasing demographic in swing states, in addition to a potential decline in turnout from minorities.[74] In consequence, Clinton's probabilities to win the Electoral College were not improving.[73] Silver also focused on state-by-state numbers in so-called 'must-win' states like Ohio and Florida, plus a consideration of polls' margin of error in advantages of less than three points.[75]

Donald Trump won the election. FiveThirtyEight projected a much higher probability of Donald Trump winning the presidency than other pollsters,[71] a projection which was criticized by Ryan Grim of the Huffington Post as "unskewing" too much in favor of Trump.[76] While FiveThirtyEight expressed that "nonetheless, Clinton is probably going to win, and she could win by a big margin", the forecaster also made points about the uncertainty of poll trackers in some cases, the considerable number of undecided voters, and the unpredictable outcome in traditional swing states.[77]

In April 2018, it was announced that FiveThirtyEight would be transferred to ABC News from ESPN, Inc., majority owned by The Walt Disney Company.[78] ABC News Live streaming channel was launched on Roku in May 2019.[79] With the reorganization creating the Walt Disney Direct-to-Consumer and International segment in March 2018, ABC News Digital and Live Streaming (websites, ABC News Live and FiveThirtyEight) was transferred to the new segment.[80]

2020 U.S. elections

[edit]

Redesign of forecast

[edit]

In early August 2020, FiveThirtyEight announced that for their 2020 general election forecast they had designed a new graphical structure. This included going with modular structure, a "ball swarm" design for the chart depicting each candidate's chances, and the addition of a "forecast mascot" named Fivey Fox.[538 72] An episode of "Chart Chat" discussing the design described the direction saying "FiveThirtyEight has leaned heavily towards a cutesy and engaging approach. The Fivey Fox mascot pops up next to most charts with call-outs to more further information."[81]

Fivey Fox would also issue reminders to readers of "the potential for extreme outcomes" according to Jessica Hullman, in a piece written for The Hill. Hullman also said of the design that the introduction of the mascot, in conjunction with the new simplified look of the page, was "perhaps the strongest indicator that Silver intends to emphasize uncertainty" in his coverage of the 2020 election.[82]

Jasmine Mithani, visual journalist with FiveThirtyEight, said in an interview when asked about the complaints of new mascot said "I think the biggest complaint about Fivey Fox is that some people find it infantilizing, but that wasn't our intention" and that the motivation for including the character was to help make the forecast more of "a teaching tool".[83] In November 2020, Rolling Stone reported that Fivey Fox had reached over 7,000 followers on his dedicated Twitter account.[84]

The forecast favored the actual winner of 48 states, the District of Columbia, and four of the five congressional districts awarding electoral votes, only missing Florida, North Carolina, and Maine's 2nd congressional district. In those three contests the forecast had favored Biden, but they were carried by Trump. Despite correctly forecasting Biden to win nationally, they overestimated Biden's margins in some battleground states such as Wisconsin, Michigan and Pennsylvania and underestimated Trump's margins in states such as Ohio, Iowa and Texas. Their forecast showed Democrats winning Senate races in North Carolina and Maine, which Republicans ended up winning. However, their forecast did correctly predict that the Democrats would take control of the Senate. In the House elections, their forecast favored Democrats to gain seats, yet Democrats suffered a net loss of 10 seats. The actual house results fell outside their 80% confidence interval, with Democrats winning 222 seats, lower than the confidence interval's lower bound of 225.[85]

Silver's exit, 2024 U.S. elections and shutdown

[edit]
Trump's approval at the start of his second term;[86] this was part of an unpublished article due to the website being shut down.

In January 2023, The Daily Beast reported that the website was on the "chopping block" amid cost-cutting measures by ABC News, and a sale of the website was being considered. It also noted that several key employees including managing editor Micah Cohen, politics editor Sarah E. Frostenson and sports editor Sara Ziegler had left the website and their positions had not been filled.[87] An ABC spokesperson responded to the report, asserting "no imminent decisions about [its] relationship with FiveThirtyEight."[88] Nonetheless, in April, Silver announced that he would be leaving the site amid widespread layoffs at ABC News, who said the website would be "streamlined" ahead of the 2024 election cycle; editor Chadwick Matlin was among the many laid off.[89] According to Silver, two thirds of FiveThirtyEight's staff were cut in one day.[90] After the layoffs, FiveThirtyEight's sports and science coverage ground to a halt, with the website mostly returning to its roots of exclusive politics coverage.[91][92]

Logo rendered as 538 used from 2023 until 2025

In May 2023, ABC News hired G. Elliott Morris, a data journalist for The Economist who has often been described as a rival of Silver,[93] to head the site as editorial director of data analytics.[94] On September 18, 2023, the original website domain at fivethirtyeight.com was closed, with web traffic becoming redirected to ABC News pages, and its logo was replaced, with the name 538 used instead of FiveThirtyEight.[2] At 538, Morris developed a new election forecasting model of the 2024 election. In the leadup to Biden's withdrawal, 538 was the only professional election forecaster to give Biden majority odds of winning the 2024 election.[95] Silver criticized Morris's model, describing it as at best ignoring the polls and giving Biden positive odds merely due to his incumbency, and at worst as being "buggy".[95][96] The election forecast remained suspended for a month after Biden withdrew, before being replaced by a new model for Kamala Harris versus Trump that put more emphasis on polling.[97] The forecast predicted a very narrow Harris victory with her winning 270 electoral votes to Trump's 268. Trump won the election with 312 electoral votes to Harris's 226.

On March 5, 2025, the Walt Disney Company shut down 538 and laid off about 15 employees.[98][99][100] ABC News announced that it would continue to provide polling data and analysis outside of the 538 brand.[100]

After departing the site, Nate Silver began publishing a personal blog, Silver Bulletin.[101] In May 2025, G. Elliott Morris announced a newsletter, Strength in Numbers, which he said he intends to expand into a successor to FiveThirtyEight.[102]

Recognition and awards

[edit]
  • In September 2008, FiveThirtyEight became the first blog ever selected as a Notable Narrative by the Nieman Foundation for Journalism at Harvard University. According to the Foundation, "In his posts, former economic analyst and baseball-stats wunderkind Nate Silver explains the presidential race, using the dramatic tension inherent in the run-up to Election Day to drive his narrative. Come November 5, we will have a winner and a loser, but in the meantime, Silver spins his story from the myriad polls that confound us lesser mortals".[103]
  • The New York Times described FiveThirtyEight in November 2008 as "one of the breakout online stars of the year".[26]
  • Huffington Post columnist Jason Linkins named FiveThirtyEight as No. 1 of "Ten Things that Managed to Not Suck in 2008, Media Edition".[104]
  • FiveThirtyEight is the 2008 Weblog Award Winner for "Best Political Coverage".[105]
  • FiveThirtyEight earned a 2009 "Bloggie" as the "Best Weblog about Politics" in the 9th Annual Weblog Awards.[106]
  • In April 2009, Silver was named "Blogger of the Year" in the 6th Annual Opinion Awards of The Week, for his work on FiveThirtyEight.[107]
  • In September 2009, FiveThirtyEight's predictive model was featured as the cover story in STATS: The Magazine for Students of Statistics.[12]
  • In November 2009, FiveThirtyEight was named one of "Our Favorite Blogs of 2009" ("Fifty blogs we just can't get enough of") by PC Magazine.[108]
  • In December 2009, FiveThirtyEight was recognized by The New York Times Magazine in its "Ninth Annual Year in Ideas" for conducting "Forensic Polling Analysis" detective work on the possible falsification of polling data by a major polling firm.[109][e]
  • In November 2010, editor-in-chief of Politico John F. Harris, writing in Forbes magazine, listed Silver as one of seven bloggers among "The Most Powerful People on Earth".[111]
  • In June 2011, Time's "The Best Blogs of 2011" named FiveThirtyEight one of its Essential Blogs.[112]
  • May 2012: FiveThirtyEight won a Webby Award for "Best Political Blog" from the International Academy of Digital Arts and Sciences in the 16th annual Webby Awards.[113]
  • April 2013: FiveThirtyEight won a Webby Award for "Best Political Blog" from the International Academy of Digital Arts and Sciences in the 17th annual Webby Awards.[114]
  • June 2016: FiveThirtyEight was named the "Data Journalism Website of the Year" for 2016 by the Global Editors Network, a Paris-based organization that promotes innovation in newsrooms around the world. FiveThirtyEight won an additional award for "News Data App of the Year (large newsroom)" for "Swing the Election", an interactive project by Aaron Bycoffe and David Wasserman.[115]
  • September 2017: The National Academies of Sciences, Engineering, and Medicine awarded a 2017 Communication Award in the "Online" category to "FiveThirtyEight's Maggie Koerth-Baker, Ben Casselman, Anna Maria Barry-Jester, and Carl Bialik for 'Gun Deaths in America'. 'A balanced and fact-filled examination of an unfolding crisis, with compelling interactives that are meticulously attentive to data quality and statistics.' (italics in the original)[116]
  • June 2018: "The Atlas of Redistricting" was named "News App of the Year" by the Data Journalism Awards sponsored by the Global Editors Network.[117]

Mascot

[edit]

Fivey Fox was the mascot of FiveThirtyEight.[538 72] This is in reference to a phrase attributed to Archilochus: "The fox knows many things, but the hedgehog knows one big thing".[538 67] The name "Fivey" is a reference to the website's name, FiveThirtyEight. Fivey Fox is colored orange, white, and beige with comically sized black glasses and has white colored sock-like paws.

See also

[edit]

Notes

[edit]

References

[edit]

Further reading

[edit]
[edit]
Revisions and contributorsEdit on WikipediaRead on Wikipedia
from Grokipedia
FiveThirtyEight, stylized as 538, was an American website founded by statistician in that specialized in quantitative forecasting and analysis of political elections, sports outcomes, economic trends, and scientific phenomena using statistical models and poll aggregation. It achieved early prominence for its accurate projection of Barack Obama's presidential victory, which relied on probabilistic modeling to outperform traditional punditry. The site expanded under affiliations with (2010–2012), ESPN (2013–2018), and ABC News (2018–2025), emphasizing empirical data over narrative-driven reporting, though it faced ownership shifts and Silver's departure in 2023 to pursue independent projects. FiveThirtyEight's defining methodology involved proprietary algorithms like its election forecasting model, which integrated national and state-level polls, economic indicators, and historical data to generate win probabilities, influencing public discourse on electoral odds. Notable achievements included high accuracy in the 2012 U.S. presidential election forecast and contributions to via tools like for baseball projections, originally developed by Silver. However, it drew significant controversy for its 2016 presidential model, which assigned only a 28.6% chance of victory despite his win, prompting critiques of overreliance on polls that underestimated non-college-educated and rural support, as well as potential institutional biases in sampling that mirrored broader polling errors averaging within historical norms but failing to capture populist shifts. The outlet ceased operations in March 2025 when ABC News, under , shuttered it as part of widespread media layoffs, ending its role as a key aggregator of polling data and approval ratings amid declining trust in establishment .

Methods and Models

Poll Aggregation and Pollster Ratings

FiveThirtyEight's poll aggregation methodology involved selecting publicly available polls that met specific quality criteria, such as excluding hypothetical matchups, tracking poll overlaps, and surveys with evident flaws like non-probability sampling without proper weighting. Polls were weighted based on factors including sample size (using the square root of the sample divided by the median sample size), recency (de-weighting multiple polls from the same firm within 14 days, e.g., halving weights for two polls), and pollster quality derived from their ratings system. Adjustments were applied for house effects—systematic biases unique to each pollster—via a Bayesian method that shrunk estimates toward the overall average, particularly for pollsters with limited data. Additional refinements included population adjustments using generalized additive models, trendline estimation via a mix of exponentially weighted moving averages and kernel-weighted polynomial regression optimized for historical accuracy, and, as of late 2023, a 2.4-point correction for partisan-sponsored polls shown to overestimate Democratic support. Outlier polls received a minimum weight of 0.05 after enhanced detection using kernel methods, and uncertainty was quantified with 95th-percentile error bands reflecting potential future deviations. These averages powered forecasts by blending polling data with fundamentals like economic indicators, though the model distinguished between published averages (smoother for public display) and internal versions allowing more responsiveness to recent shifts. The site's pollster ratings system, updated in 2023 and refined in 2024, assigned letter grades from A+ to F based on a composite of historical accuracy, methodological transparency, and polling volume. Accuracy was the primary component, measured through predictive plus-minus, which combined simple prediction error (root-mean-square deviation from actual election margins) and bias (systematic partisan lean, e.g., overestimating Democrats or Republicans) adjusted for race difficulty and herding toward consensus forecasts. Predictive error incorporated penalties for opaque methods and convergence to averages, with scores reverting toward the mean for pollsters with fewer than 20 recent polls, yielding provisional grades like A/B. Transparency scores (0-10) rewarded detailed disclosures on sampling, weighting, and response rates, with bonuses for adherence to standards from the American Association for Public Opinion Research (AAPOR) or deposition in the Roper Center. Pollsters failing basic thresholds, such as those involved in data fabrication, received an F and exclusion from aggregates; the system drew from polls since 1998 conducted within 31 days of elections. Unlike earlier versions that factored in pollster consortia like the National Council on Public Polling, the 2023 update emphasized individual performance and predictive modeling, feeding directly into aggregation weights to prioritize reliable firms while downweighting those with persistent errors or biases. This approach aimed to mitigate known polling challenges, such as nonresponse bias favoring Democrats in telephone surveys, though critics noted it could underpenalize pollsters with short-term luck over long-term methodological rigor.

Probabilistic Forecasting Framework

FiveThirtyEight's probabilistic forecasting framework centers on simulation-based models that generate probability distributions for outcomes by integrating empirical polling with structural fundamentals and accounting for multifaceted sources of . Rather than deterministic predictions, the approach employs methods to run thousands to tens of thousands of simulated scenarios, deriving win probabilities as the proportion of simulations in which a or secures victory. This framework, applied across presidential, congressional, and gubernatorial races, uses Bayesian regression techniques to blend inputs, treating fundamentals as informative priors that adjust polling estimates when is sparse or volatile. Polling data forms the core input, aggregated through multilevel models that weight surveys by pollster historical accuracy, recency, sample composition adjustments (e.g., for likely voters), and house effects to mitigate systematic biases. For instance, national and state-level polls are correlated based on shared demographics, , and voting history, with errors modeled using fat-tailed distributions to capture outliers like polling misses in or 2020. Non-polling fundamentals—such as economic indicators (e.g., GDP growth weighted over two years with temporal decay), incumbency advantages, (with in-state dollars emphasized fivefold), partisan lean from past results, and generic ballot trends—provide anchors, typically weighted at 17.5-35% depending on the race type to prevent overreliance on noisy polls. In congressional models, tools like the system infer unpolled district outcomes from similar areas, while expert ratings from sources like the Cook Political Report refine "Deluxe" variants. Uncertainty is modeled hierarchically: local errors (e.g., district-specific noise at 75% of total variance in House races), regional correlations, national swings, and temporal drifts (e.g., convention bounces fitted empirically). Simulations incorporate these via for presidential forecasts, propagating errors across states or districts to reflect real-world dependencies, such as correlated polling biases in swing areas. Probabilities emerge directly from the simulation tally—for example, a 60% win chance indicates victory in 6,000 of 10,000 runs—enabling forecasts like distributions or seat projections with credible intervals. This setup evolved from Nate Silver's initial 2008 model, emphasizing empirical over narrative-driven adjustments, though critiques note potential underestimation of tail risks in low-probability events. The framework extends beyond elections to sports and , adapting Elo ratings or regression models with similar probabilistic simulations, but political applications highlight its strength in handling sparse through strength-borrowing across units. Validation against historical outcomes shows aggregated accuracy, with polling errors averaging around 3.8 points on margins, though systemic challenges like nonresponse persist.

Transparency Practices and Methodological Evolution

FiveThirtyEight emphasized transparency in its analytical processes by publicly detailing methodologies for key components such as poll aggregation and pollster evaluations. For pollster ratings, introduced in 2008, the site assigned grades based on historical accuracy since 1998, incorporating factors like simple polling error (deviation from actual election margins), (systematic partisan skew), (excessive similarity to other polls), and methodological quality, with boosts for adherence to standards from the American Association for Public Opinion Research (AAPOR) Transparency Initiative or deposit at the Roper Center. These ratings were supported by publicly available datasets on , including raw poll data and calculation scripts, enabling external verification. Additionally, the site maintained a polls policy committing to honest, comprehensive accumulation and of polling data, with FAQs explaining inclusion criteria like recency and pollster performance. A dedicated GitHub repository housed data and code underlying articles, graphics, and forecasts, covering topics from election polls to , though updates to sports-related content ceased by June 13, 2023. This release practice facilitated , with specific folders for pollster ratings data allowing users to replicate scores using provided R scripts and historical results. Pollster evaluations explicitly factored in transparency, penalizing firms for opaque practices such as undisclosed weighting or sampling methods. Methodologically, FiveThirtyEight's approaches evolved in response to empirical polling challenges, particularly after the 2016 election where national polls underestimated Donald Trump's support by an average of 1.5 percentage points in final surveys. Initial models under relied heavily on state-level poll aggregation with adjustments for pollster quality and economic indicators; post-2016, the site incorporated lessons on nonresponse bias, enhancing weights for demographics like education and rural voters, while pollsters broadly shifted toward better likely voter screens and online panels. By 2020, the presidential forecast model diverged from 2016 versions by integrating impacts on turnout, expanding simulation ensembles to 80,000 per day, and applying house effects to correct for pollster-specific biases observed in prior cycles. Pollster ratings underwent significant refinement, transitioning from earlier trust-based metrics to a update emphasizing predictive error and adjusted for race difficulty via regression models and 1,000 bootstrapped simulations to mitigate luck. This iteration introduced a transparency score derived from 10 binary questions on disclosure (e.g., sample composition, weighting details), combined with empirical performance into a POLLSCORE and star ratings (0.5-3.0), replacing subjective elements with Pareto-optimal rankings. Post-2020 analyses, where polls again erred by underestimating Republican margins in key states, prompted further adjustments in forecasts to widen intervals and incorporate correlated errors from past cycles like 2016. These changes reflected a data-driven , prioritizing empirical validation over static assumptions, though critiques noted persistent challenges in capturing shifts in voter .

Founding and Early Development

Origins in Baseball Analytics and 2008 Election

, who earned a in from the in 2000, initially applied statistical methods to baseball analytics while employed as a consultant at . Bored during downtime, he developed , an acronym for Player Empirical Comparison and Optimization Test Algorithm, a system designed to project players' future performance by comparing them to historical "comparable" players based on attributes like age, playing time, and statistical similarities. was first published in 2003 through Baseball Prospectus, an online publication dedicated to , where Silver became a contributor and eventually managing partner. The model gained recognition for its accuracy in forecasting player statistics and team outcomes, outperforming many traditional scouting methods by incorporating empirical data and probabilistic adjustments for variables such as injuries and performance regression. Silver's experience with PECOTA honed his approach to handling noisy data and generating probabilistic forecasts, skills he later adapted to political polling aggregation. As the 2008 U.S. presidential primaries unfolded, Silver began analyzing election polls under the pseudonym "Poblano" on platforms like , applying multilevel regression techniques similar to those used in projections to weigh pollster track records, sample sizes, and historical biases. These early analyses demonstrated high accuracy, such as correctly anticipating Barack Obama's delegate lead over despite conventional media narratives favoring Clinton. On March 7, 2008—three days after Clinton's victories in the and Democratic primaries—Silver launched FiveThirtyEight.com as an independent focused on aggregating and modeling national and state-level polling to forecast election outcomes. The site's name referenced the 538 electors in the , emphasizing its emphasis on electoral math over raw vote margins. Silver's model integrated hundreds of polls, adjusting for house effects (systematic biases by polling firms) and economic indicators, yielding forecasts that diverged from consensus by prioritizing empirical aggregation over narrative-driven interpretations. FiveThirtyEight achieved prominence during the 2008 general election, with Silver's final projection on November 4, 2008, giving a 349-189 electoral vote edge over , closely mirroring the actual 365-173 result (after Nebraska's split). The model accurately predicted outcomes in 49 of 50 states and all but one , attributing success to rigorous poll weighting and rather than overreliance on late-deciding voter assumptions common in mainstream analyses. This performance established Silver's reputation for data-driven forecasting, contrasting with outlets that underestimated Democratic turnout based on less systematic methods.

Initial Blogging and Ground-Level Reporting

initiated the FiveThirtyEight blog in late 2007, with its early focus on quantitative analysis of Democratic primary polls, expanding to by March 2008. The blog's content emphasized aggregating hundreds of polls, weighting them by sample size, recency, and pollster track records, while incorporating economic indicators and historical voting patterns to generate state-by-state projections. Silver updated forecasts multiple times daily during peak periods, often posting 5-10 times per week, to reflect new data and refine probabilistic models that assigned win probabilities to candidates. This approach contrasted with traditional punditry by prioritizing empirical aggregation over narrative speculation. Early blogging delved into campaign dynamics beyond raw polls, including examinations of models and field operations inferred from available data. For instance, Silver analyzed exit polls from the 2008 election to quantify the "contact gap," finding that Obama voters were contacted by their campaign at rates 10-15 percentage points higher than McCain voters in key states, correlating with higher turnout among demographics like young and minority voters. He argued this demonstrated the causal impact of ground-level mobilization efforts, such as door-knocking and phone banking, on margins in battleground areas. Such posts highlighted how superior data-driven targeting could amplify small polling edges into electoral advantages. Silver's ground-level insights extended to critiquing media underemphasis on mechanics, noting in September 2008 that coverage often fixated on national horse-race numbers while ignoring field efficacy metrics like volunteer recruitment rates. He incorporated non-poll data, such as FEC filings on campaign spending allocation to field versus ads, to assess strategic resource deployment. These analyses, drawn from public datasets rather than original shoe-leather reporting, positioned the blog as a to anecdotal campaign dispatches, emphasizing verifiable causal links between on-the-ground actions and vote shares. The blog's transparency in , including public disclosure of adjustment formulas, built credibility amid skepticism from established outlets.

Ownership and Organizational Changes

New York Times Partnership (2010-2013)

In June 2010, reached an agreement in principle with to incorporate FiveThirtyEight's content into NYTimes.com, positioning Silver as a regular contributor focused on election forecasting and statistical analysis. The partnership formally launched on August 25, 2010, with the relaunch of the FiveThirtyEight blog under the banner "FiveThirtyEight: 's Political Calculus," hosted on the Times' platform and benefiting from its editorial resources and audience reach. This three-year arrangement allowed Silver to maintain operational independence while leveraging the Times' infrastructure for expanded data-driven political coverage, including midterm elections in 2010. During the partnership, FiveThirtyEight emphasized probabilistic forecasting models, aggregating polls and incorporating economic indicators, demographic shifts, and historical data to predict outcomes, such as House races in the 2010 elections where it projected results based on polling, , and past returns. The site's approach, rooted in Silver's quantitative methods, gained prominence for its transparency in model assumptions and updates, contrasting with more narrative-driven at the Times. However, this data-centric style occasionally clashed with traditional Times sensibilities; the public editor noted in 2013 that Silver's probabilistic framing—treating elections as uncertain rather than foregone conclusions—went "against the grain for some at the Times," particularly among those preferring interpretive reporting over strict . The partnership peaked during the 2012 presidential election, where FiveThirtyEight's final forecast on November 5 gave a 91% chance of victory, accurately predicting his national popular vote margin within 0.9 percentage points and correctly calling the winner in 50 states and the District of Columbia—though critics later debated the model's overconfidence in safe states versus tighter races. Traffic surged, with Silver's posts drawing millions of unique visitors, underscoring the appeal of empirical polling aggregation amid partisan media skepticism. Yet, internal tensions arose over editorial control and Silver's resistance to Times style conventions, such as softening probabilistic language for readability, which some viewed as diluting rigor. The arrangement concluded in July 2013 when Silver announced his departure for and ABC News, citing a desire to expand into and secure greater autonomy under a multiyear deal ending his Times contract in August. The move, speculated to stem from frustrations with Times bureaucracy and limited scope for interdisciplinary work, marked the end of FiveThirtyEight's integration with the newspaper after three years of symbiotic growth in .

ESPN and ABC News Acquisition (2013-2023)

In July 2013, ESPN acquired FiveThirtyEight and hired its founder Nate Silver as editor-in-chief, integrating the site into ESPN's digital portfolio while allowing it to maintain its independent branding at fivethirtyeight.com. Silver's role extended to contributions across ESPN and ABC News platforms, with the acquisition enabling expansion into sports, economics, culture, science, technology, and politics through data-driven analysis. The relaunched FiveThirtyEight debuted on March 17, 2014, with an initial team of approximately 20 full-time staff members building out content in , including forecasts for the 2014 midterms and 2016 presidential election. Under ESPN ownership, the site grew its scope beyond politics to emphasize probabilistic modeling in and economic projections, aligning with ESPN's sports focus while retaining election coverage. This period saw FiveThirtyEight produce interactive visualizations and poll aggregations, though some critics noted tensions between its quantitative approach and ESPN's broader entertainment-oriented content strategy. On April 17, , ownership transferred from to ABC News, both under , to better align FiveThirtyEight's political and with ABC's news operations amid rising demand for analytical coverage ahead of the 2018 midterms. The move allowed continued sports content via partnership with , while prioritizing enhancements in statistical reporting for ABC's platforms, including regular appearances by Silver and his team. From 2018 to 2023, under ABC News maintained its core forecasting models, producing coverage for the and 2022 elections with expanded data tools like presidential approval trackers. In May 2023, ABC News appointed from to lead data journalism efforts, integrating 's poll aggregation with ABC's broader analytics. By September 2023, the site's content shifted to a dedicated vertical on abcnews.com/538, reflecting deeper organizational integration while preserving its focus on empirical political analysis.

Nate Silver's Departure and Final Years (2023-2025)

In April 2023, , founder and editor-in-chief of FiveThirtyEight, announced his departure from ABC News amid broader layoffs at parent company , stating that his contract was set to expire without renewal. The exit followed tensions over editorial direction and resource allocation, with Silver citing Disney's cost-cutting measures as a key factor impacting the site's operations. Concurrently, Disney reduced FiveThirtyEight's sports coverage and laid off roughly two-thirds of its staff, merging remaining content into ABC News' main platform while diminishing the site's independent identity. Despite these changes, FiveThirtyEight persisted in a scaled-back form through 2023 and 2024, continuing to produce political forecasts, poll aggregations, and tools like presidential approval trackers during the 2024 election cycle. Silver, who had reacquired pre-2023 and forecasting models (excluding the brand name) as part of his original agreement, shifted focus to independent projects, including a on his site natesilver.net. On March 5, 2025, ABC News shuttered FiveThirtyEight entirely as part of -wide restructuring affecting approximately 200 employees across its units, with the site's 15 remaining staff informed of layoffs via a scripted announcement from ABC . Silver publicly attributed the closure to mismanagement by executives, arguing that business priorities overrode the site's data-driven mission and that similar cuts had eroded its viability since 2023. Post-shutdown, assets like FiveThirtyEight's poll database were transferred to outlets including , preserving some data continuity amid the site's demise.

Key Personnel and Contributors

Nate Silver's Role and Influence

Nate Silver established FiveThirtyEight in 2008 as an independent blog specializing in probabilistic forecasting and statistical analysis, initially centered on the U.S. presidential election and drawing from his prior work in baseball sabermetrics. As founder and editor-in-chief through 2023, Silver personally constructed the site's core election models, which aggregated data from numerous polls, incorporated economic indicators and historical voting patterns, and utilized thousands of Monte Carlo simulations to produce win probabilities rather than deterministic predictions. This methodology yielded high accuracy, correctly forecasting Barack Obama's Electoral College victory in 49 of 50 states in 2008 and all 50 states plus the District of Columbia in 2012. Silver's leadership positioned FiveThirtyEight as a pioneer in data-driven journalism, shifting public and media attention toward empirical aggregation of polls over individual survey outliers or , a practice that became known as the "Nate effect." His emphasis on transparency—publishing model code, poll weights, and uncertainty intervals—fostered greater methodological scrutiny in forecasting, influencing outlets to adopt similar quantitative rigor while critiquing overconfidence in qualitative punditry. Silver also extended the site's scope beyond politics, integrating like his system for projections and economic modeling, which broadened FiveThirtyEight's audience and demonstrated the applicability of statistical tools across domains. Silver's departure from FiveThirtyEight occurred in April 2023, coinciding with Disney's layoffs at ABC News and the expiration of his contract, after which he retained rights to the original models but not the brand. His tenure defined the organization's identity as a hub for causal, evidence-based analysis, though subsequent editorial shifts under ABC highlighted tensions between Silver's apolitical, forecast-centric vision and broader newsroom priorities favoring narrative integration. Despite these changes, Silver's frameworks continued to underpin elements of the site's output until its 2025 closure, underscoring his enduring impact on how statistical uncertainty is communicated in high-stakes reporting.

Editorial Team and Notable Analysts

G. Elliott assumed the role of Editorial Director of Data at FiveThirtyEight in May 2023, following Nate Silver's departure, overseeing the site's models and data-driven political during its final years under ABC News ownership. Morris, previously a data journalist, managed adjustments to election models amid criticisms of prior underestimations of conservative . Nathaniel Rakich served as Senior Editor and Senior Elections Analyst, specializing in polling aggregation, race ratings, and historical electoral data; his work included detailed breakdowns of and dynamics up to the 2024 cycle. Rakich's analyses often incorporated state-level polling averages and demographic shifts, contributing to the site's proprietary forecasts. Harry Enten, a Senior Political Writer and Analyst, gained prominence for his accessible explanations of polling discrepancies and trends, frequently highlighting over- or under-sampling of key voter groups in national surveys. Enten's commentary, delivered through articles and podcast appearances, emphasized empirical variances between polls and outcomes, such as in the 2020 and 2022 elections. Amelia Thomson-DeVeaux acted as a Senior Editor, focusing on quantitative assessments of policy impacts and candidate viability through regression models and . Her contributions extended to visualizations of economic indicators tied to political events. In , Neil Paine held the position of acting sports editor, building on the site's origins in with coverage of player projections and league trends using advanced metrics like WAR and Elo ratings. Galen Druke hosted the FiveThirtyEight , coordinating discussions among analysts on methodological debates and real-time forecast updates from onward. The editorial team contracted significantly after 2023 layoffs, dropping from approximately 35 staff to 15 by the site's closure on March 5, 2025, amid broader ABC News reductions. This downsizing followed earlier cuts that affected contributors in and visualization roles.

Content Scope and Expansion

Political Analysis and Election Coverage

FiveThirtyEight's political analysis emphasized data-driven probabilistic forecasting, aggregating hundreds of opinion polls while adjusting for methodological differences such as house effects—systematic biases in polling firms' samples—and incorporating fundamentals like economic growth, incumbent approval, and candidate spending. The site's models simulated election outcomes tens of thousands of times daily, producing win probabilities and expected vote margins rather than point predictions, with updates reflecting new data releases. This approach extended beyond presidential races to congressional, gubernatorial, and state legislative contests, often via "Lite" models for lower-data environments. Election coverage began with Nate Silver's independent blog during the cycle, where his model forecasted Barack Obama's national popular vote share at 51.6 percent—actual: 52.9 percent—and projected 307 electoral votes, closely aligning with the final 365 after late swings. By , under partnership, the forecast gave Obama a on the eve of the election, accurately projecting 332 electoral votes against Mitt Romney's 206, with the popular vote margin off by less than one point. Coverage featured frequent updates, state-by-state breakdowns, and visualizations of polling trends, alongside explanatory articles on factors like turnout models and undecided voter behavior. Post-2012, analysis diversified to include generic congressional ballots, where FiveThirtyEight tracked Democratic leads averaging 3-5 points in even-year cycles, correlating them with seat projections via efficiency gaps and partisanship metrics. Midterm coverage, such as 2010 and , highlighted wave dynamics through historical analogies and pollster ratings, rating firms on transparency and past errors. The site also produced non-forecast content, such as approval trackers and issue polling deep dives, using weighted averages from multiple pollsters to assess public sentiment on topics like healthcare policy shifts or foreign interventions. In later cycles, models evolved to weight recent polls more heavily and simulate correlated errors across battlegrounds, as in the 2024 forecast incorporating national and state-level data with 80,000-plus simulations per update. Coverage integrated multimedia, including podcasts dissecting swing-state dynamics and interactive maps displaying forecast densities, aiming to convey uncertainty through ranges rather than binaries. This quantitative focus distinguished FiveThirtyEight from narrative-driven outlets, prioritizing empirical aggregation over qualitative punditry.

Sports and Economics Extensions

Following its acquisition by in July 2013, FiveThirtyEight significantly expanded into , integrating statistical modeling with coverage of major professional leagues including the NFL, NBA, MLB, NHL, and soccer. , drawing on his earlier work in baseball , emphasized this shift as a return to sports-oriented , with the relaunched site in 2014 featuring predictive models for game outcomes, player evaluations, and league trends. Examples included the Soccer Power Index (SPI), which forecasted match probabilities and team strengths based on historical performance data, and analyses of NFL dominance in viewer preferences spanning 1937 to 2017. The sports section grew to encompass retrospective evaluations, such as identifying the most consistently mediocre teams across five decades of data from 1968 onward, and decade-end summaries of achievements in the across multiple leagues. Coverage also addressed broader issues like Title IX's impact on equality, using enrollment and participation statistics to highlight disparities in NCAA and Olympic . Even after FiveThirtyEight's partial shift to ABC News in 2018, collaboration with persisted on sports content until ESPN discontinued the site's sports forecasting models in 2023. In , FiveThirtyEight's extensions focused on data-informed commentary rather than proprietary forecasting models comparable to those in politics or sports, with articles analyzing , policy effects, and expert consensus. Key topics included public perceptions of recessions, where surveys showed a majority of Americans believed the U.S. was in one despite official metrics in 2022; economists' concerns over post-COVID recovery risks like spending hesitancy and viral resurgence in June 2020; and debates on duration, with projections varying widely among specialists in November 2021. Additional reporting examined bailout precedents from the crisis in the context of 2023 events and tracked indicators like GDP growth and through visualizations and economist interviews. This coverage prioritized empirical aggregation of economic data over novel predictive simulations, reflecting the site's broader emphasis on verifiable trends amid institutional forecasts.

Other Topics and Data Visualization Innovations

FiveThirtyEight expanded its coverage to include science, health, and environmental topics, applying statistical analysis to issues such as perceptions and . For instance, in February 2019, the site published an analysis showing increased public worry about preceding Donald Trump's presidency, drawing on Gallup polling data from 1989 to 2018 that indicated a rise in concern from 35 percent to 62 percent among Americans. Similarly, articles examined rural Americans' growing skepticism toward scientific institutions, linking it to cultural identity shifts amid events like the , with surveys revealing lower trust in science among rural respondents compared to urban ones. The outlet also addressed technology and health-related subjects, critiquing concepts like "sound science" as a rhetorical tool to undermine , as detailed in a December 2017 piece that referenced historical uses in and chemical industries to delay regulations. Coverage extended to public understanding of , with a March 2019 article arguing that Americans demonstrated factual knowledge on topics like and astronomy, countering narratives of widespread scientific illiteracy using survey data. Environmental analyses included recommendations for relocation amid risks, such as a September 2019 evaluation favoring Michigan's Upper Peninsula for lower exposure to sea-level rise and based on NOAA and FEMA datasets. In data visualization, FiveThirtyEight innovated with custom, interactive graphics to convey complex probabilities and trends across topics. A notable technique was the "snake" plot for , introduced around 2016, which animated state-by-state win probabilities as a serpentine path to illustrate path dependency in the without overwhelming users with static maps. The site produced annual compilations of distinctive charts, such as 33 visualizations in 2022 covering policy shifts post-Roe v. Wade and demographic trends, often using histograms, scatter plots, and dashboards built with open-source code shared via their data portal. These visualizations emphasized transparency by releasing underlying datasets and or Python scripts, enabling replication and scrutiny, as seen in their 2020 retrospective of 40 unconventional charts blending science, policy, and societal data like impacts and environmental metrics. This approach distinguished FiveThirtyEight from traditional journalism by prioritizing empirical clarity over narrative flair, though it occasionally drew critique for simplifying multivariate causal relationships in favor of accessible formats.

Forecasting Accuracy and Performance

Successes in 2008 and 2012 Elections

FiveThirtyEight, founded by as a in March 2008, achieved early prominence through its model for the U.S. that year. The model aggregated national and state-level polls, adjusted for historical biases and house effects, and incorporated economic indicators and demographic shifts to simulate thousands of election outcomes. On , November 4, 2008, Silver's forecast correctly identified the winner in 49 of the 50 states, erring only on , which ultimately carried by 1.0 . The model projected Obama's national popular vote share at approximately 52.1 percent, aligning closely with the actual result of 52.9 percent, a margin within one . This accuracy contrasted with many traditional pundits and outlets that underestimated Obama's margins in key battleground states like and , where FiveThirtyEight's simulations assigned Obama probabilities exceeding 90 percent in the final days. The site's methodology emphasized empirical polling data over narrative-driven analysis, earning Silver recognition for demystifying electoral uncertainty through simulations that accounted for and late-deciding voters. By correctly forecasting Obama's 365 electoral votes against John McCain's 173—near the actual 365-173 split—FiveThirtyEight demonstrated the value of systematic aggregation over isolated polls. Building on this foundation, FiveThirtyEight's 2012 election coverage, now hosted by , refined the model to include polls-plus adjustments for turnout models and economic variables. Silver's final forecast on November 5, 2012, gave Obama a 90.9 percent chance of reelection, projecting exactly 332 electoral votes to Obama's 206 for , matching the certified outcome. The model accurately called the winner in all 50 states, including narrow victories in states like (Obama by 5.4 points) and (Obama by 0.9 points), where probabilities hovered between 70 and 85 percent. These results validated the site's emphasis on probabilistic ranges rather than point predictions, as the popular vote remained competitive (Obama 51.1 percent to Romney's 47.2 percent), yet the electoral map favored the decisively. FiveThirtyEight outperformed many competitors by weighting recent polls more heavily and correcting for Republican-leaning biases observed in 2010 midterms, fostering trust in data visualization tools like interactive maps and vote simulators that illustrated . The successes in both cycles established FiveThirtyEight as a benchmark for , influencing subsequent journalistic standards for transparency in model assumptions and against historical data.

Failures and Adjustments in 2016 and 2020

In the 2016 presidential election, FiveThirtyEight's polls-plus forecast model assigned a 28 percent chance of victory on the eve of the election, higher than most competitors who offered odds below 10 percent. Despite this margin for error, Trump prevailed, exposing shortcomings in underlying polls that underestimated his support in states like , , and by 4 to 6 points. Key factors included nonresponse bias among low-education, white working-class voters—a demographic core to Trump's coalition—and late-deciding voters breaking heavily for him (59 percent in ). FiveThirtyEight defended the forecast by emphasizing its incorporation of historical polling errors (averaging 2 points since 1972) and correlated state-level misses, arguing it avoided overconfidence unlike outlets predicting landslides. Nonetheless, the outcome prompted critiques that the model underweighted fundamentals like economic discontent in deindustrialized areas and over-relied on aggregates prone to systematic undercounting of Trump enthusiasm. Post-2016, FiveThirtyEight and affiliated pollsters adjusted methodologies to address these gaps, prioritizing empirical corrections over narrative-driven interpretations. Pollsters introduced education-based weighting to correct underrepresentation of non-college-educated respondents, who skewed Republican; for instance, firms like Hart Research boosted high school-or-less samples. Sampling shifted toward address-based methods and higher cellphone penetration (e.g., from 80 to 88 percent in some surveys) to reach rural and low-propensity voters, while geographic balancing targeted urban-rural disparities. The forecasting model amplified uncertainty parameters, simulating more scenarios for regional errors and undecided voters, reflecting causal insights from 2016's late swings (e.g., FBI Director Comey's letter). These changes aimed at causal realism by treating polling misses as non-random, often favoring Republicans due to differential turnout and response rates. By the 2020 election, these refinements yielded a polls-plus model giving Joe Biden an 89 percent chance of winning the Electoral College, with Trump at 10 percent, acknowledging a potential 3-point polling error in Trump's favor akin to 2016. Biden won as projected, securing 306 electoral votes, but national polls overestimated his margin by about 3.5 points (averaging +8 percent versus actual +4.5 percent popular vote), with errors flipping calls in Florida and North Carolina. Persistent issues included turnout misestimation amid pandemic-induced mail voting—low-propensity Trump voters surged late—and residual nonresponse among conservatives, though fewer undecideds (4.8 percent versus 12.5 percent in 2016) stabilized aggregates. Critics noted the high probability conveyed undue certainty, mirroring pre-2016 hubris, as house effects (firm-specific biases) again undervalued Republican strength in battlegrounds. Adjustments for 2020 built on by embedding correlated error simulations and education-race weighting, but empirical data revealed incomplete fixes: Republican underestimation recurred, suggesting deeper challenges like in surveys or institutional reluctance to probe Trump-aligned sentiment. FiveThirtyEight incorporated COVID-specific variables, such as mail-ballot enthusiasm gaps, yet post-election analysis affirmed that while winner accuracy improved, margin errors highlighted ongoing causal disconnects between polled samples and actual electorate composition. These cycles underscored the limits of aggregate-dependent models in capturing volatile voter mobilization, prompting further scrutiny of alternatives like precinct-level fundamentals over polls alone.

Post-2020 Models, 2024 Coverage, and Empirical Critiques

Following Nate Silver's departure from FiveThirtyEight in November 2023, the site, now under ABC News, shifted its forecasting approach with assuming leadership of data journalism efforts. The post-2020 models retained core elements like polling aggregation and simulation-based projections but incorporated adjustments from the 2020 election review, which highlighted strengths in presidential forecasting (e.g., correctly favoring with an 89% win probability) while noting overconfidence in some congressional races. For the midterms, these models demonstrated improved calibration, with national polling errors averaging under 2 percentage points and correctly anticipating Democratic overperformance in the popular vote despite House losses. However, the ABC-era emphasized economic fundamentals and historical patterns more heavily in simulations, diverging from Silver's poll-centric methodology. In the lead-up to the 2024 presidential election, FiveThirtyEight suspended its forecast in July 2024 amid the Biden-Harris transition, resuming in late August with a rebuilt model that integrated over 1,000 polls, economic indicators, and 80,000-plus simulations per update. The model weighted recent polls higher but applied adjustments for historical biases, such as nonresponse among Republican voters, and incorporated state-level correlations. Coverage focused on tight national margins, with Harris leading slightly in aggregates (e.g., +1.5 points as of October 2024), but the final forecast on November 5, 2024, assigned her a 50% chance of winning the Electoral College and 48% for the popular vote, framing the race as a coin flip despite swing-state volatility. House and Senate projections similarly showed narrow Republican edges, with Republicans at 52% for House control. Empirical critiques of the post-2020 models centered on persistent underestimation of Republican performance in presidential races, echoing 2016 patterns. In 2024, while raw polls erred by about 1.8 points nationally (underestimating Donald Trump's +1.6 popular vote margin), the model's even odds failed to capture Trump's decisive victory (312-226), as simulations overweighted Democratic fundamentals like incumbency analogs despite polling trajectories favoring Trump in key states like and Georgia. , analyzing the model independently, argued it underweighted polls early on—assigning Harris 58% odds in August despite averages showing a tie—and produced illogical outputs by prioritizing structural factors over data, potentially reflecting institutional pressures at ABC News. Independent evaluations, including assessments of probabilistic accuracy, ranked the 2024 forecast below Silver's standalone model, which gave Trump 52% final odds via similar simulations but with tighter poll reliance. These shortcomings contributed to broader skepticism of aggregate-based under media ownership, with critics noting unaddressed shy-Trump effects and sample biases in online/opt-in polls comprising 40% of inputs. The site's shutdown in March 2025 curtailed post-mortems, leaving unresolved debates on whether model tweaks sufficiently mitigated partisan nonresponse.

Controversies and Criticisms

Polling Biases and Underestimation of Conservative Outcomes

FiveThirtyEight's polling aggregates and probabilistic forecasts have exhibited a pattern of underestimating Republican and conservative outcomes in U.S. presidential elections, particularly those involving , across multiple cycles. This discrepancy manifests as Trump consistently outperforming national and state-level polling averages by 2 to 4 percentage points, leading to forecasts that assigned him low probabilities of victory despite actual results. In the 2016 election, FiveThirtyEight's final model gave Trump a 29 percent chance of winning the on the eve of voting, reflecting polling averages that underestimated his national popular vote share by about 2 points and missed key states by larger margins, such as 3.1 points in and 3.4 points in . Post-election analyses highlighted insufficient adjustments for nonresponse among rural and less-educated voters, who skewed Republican, contributing to the surprise outcome. The 2020 cycle showed similar issues, with Trump exceeding polls in battleground states like (by 3.5 points) and (by 2.6 points), narrowing Biden's projected leads and preserving competitiveness in the despite FiveThirtyEight's 89 percent probability for Biden in late forecasts. Aggregates overrepresented Democratic support in these regions, a pattern attributed to persistent sampling challenges rather than random error, as Republican performance aligned with pre-2016 baselines when adjusted for turnout. This trend repeated in 2024, where Trump won the popular vote by 1.5 percentage points and the by 312 to 226, outperforming final polling averages by an average of 2.2 points nationally and more in swing states like (2.6 points). FiveThirtyEight's October forecast treated the race as a coin flip, with Harris at roughly 50 percent odds, yet Trump's margins exceeded expectations amid late voter shifts. Pollsters, including those aggregated by FiveThirtyEight, acknowledged undercapturing Trump's support, with errors directional rather than symmetric. Explanations for these biases center on nonresponse and reluctance among conservative respondents, who participate less in surveys due to distrust of institutions associated with and academia, leading to underrepresentation in samples. FiveThirtyEight has explored this in its own analyses, proposing theories like differential response rates—where Republicans are 5-10 percent less likely to complete interviews—and the "shy voter" effect, where Trump supporters underreport preferences due to perceived social pressures, supported by list experiment data showing hidden conservative leanings. Adjustments for "house effects"—systematic biases in individual pollsters, often Democratic-leaning—have been applied but appear insufficient to fully correct the aggregate skew, as evidenced by consistent directional errors favoring Democrats. Critics, including empirical reviews, argue that polling methodologies, reliant on telephone and online panels with low response rates (often under 5 percent), fail to proportionally capture working-class and rural conservatives, exacerbating errors in low-propensity voter segments. While FiveThirtyEight incorporates polling error simulations (e.g., assuming a 3-4 point national standard deviation), these models have not fully anticipated the partisan asymmetry, prompting calls for enhanced weighting by , turnout history, and validation against alternative data like consumer records. This underestimation raises questions about the representativeness of pollster samples, given the left-leaning composition of many survey firms and their ties to urban, higher- demographics.

Internal Model Disputes and Editorial Interference

Nate Silver, FiveThirtyEight's founder and long-time editor-in-chief, departed the organization in June 2023 amid Disney's layoffs at ABC News, citing a contract expiration with "profound mutual disinterest" in renewal, though he emphasized that Disney had rarely interfered in editorial processes during his tenure. Post-departure, Silver publicly critiqued FiveThirtyEight's revised 2024 presidential election model for overweighting economic and political fundamentals (85 percent of the forecast) over recent polling data (15 percent), arguing this produced inconsistent and misleading probabilities, such as favoring Joe Biden in swing states despite Trump leading in aggregated polls by margins exceeding historical errors. Silver contrasted this with his own Silver Bulletin model, which allocated a 70/30 split to polls versus fundamentals, contending that fundamentals like incumbency advantages had become less predictive in a polarized electorate and carried wide error bars (e.g., ranging from Trump +20 to Biden +30 points absent polling input). These methodological differences highlighted broader philosophical tensions within FiveThirtyEight's forecasting approach, evolving from earlier models that adjusted post-2016 for polling underestimation of conservative support but shifted further after 2020 toward incorporating non-polling factors like impacts while de-emphasizing approval ratings to avoid overreacting to short-term volatility. Silver's critiques implied that the post-2023 model risked amplifying establishment-favoring assumptions, such as overvaluing incumbency in low-approval environments, potentially at the expense of empirical polling trends that had repeatedly missed Republican strength in recent cycles. Such disputes underscored challenges in balancing data-driven rigor with interpretive layers, where heavier fundamental weighting could inadvertently embed analyst priors over raw empirical signals. Editorial decisions also drew scrutiny for potentially overriding model continuity. In late July 2024, following Biden's withdrawal, FiveThirtyEight suspended its presidential forecast—a tool it had maintained through prior transitions—citing the need for "stable" polling on , a move Silver described as politically motivated to await potentially favorable Democratic data rather than adhering to consistent probabilistic updates. This pause, lasting until mid-August, contrasted with historical practice and fueled perceptions of interference prioritizing narrative alignment over uninterrupted analysis, especially given ABC News' parent company's institutional incentives amid a competitive media landscape prone to left-leaning interpretive biases in election coverage. While FiveThirtyEight defended the suspension as methodologically prudent to avoid noisy early Harris surveys, it exemplified how oversight could disrupt the site's foundational commitment to transparent, real-time probabilistic modeling.

Over-Reliance on Aggregates vs. Alternative Predictors

FiveThirtyEight's models have historically placed primary emphasis on aggregating and adjusting polls, weighting them by factors such as pollster track records, sample size, and recency, while incorporating secondary elements like economic indicators and historical vote patterns. This aggregate-centric approach assumes that averaging multiple polls mitigates individual errors and provides a robust signal of voter intent, but it has drawn for underemphasizing systemic flaws in polling data, including non-response among conservative-leaning voters and methodological where pollsters converge on similar results to avoid status. In the 2016 presidential , for instance, FiveThirtyEight's final forecast assigned a 29% chance of winning the based largely on national and state-level poll aggregates showing ahead, yet Trump secured victory, highlighting how aggregates failed to capture late shifts or hidden support. Critics argue that this over-reliance amplifies polling's vulnerabilities, such as left-leaning sample compositions in academic and media-affiliated surveys, which empirical post-mortems have linked to consistent underestimation of Republican performance since 2016. A 2020 analysis by and colleagues decomposed polling errors into bias (systematic undercounting of certain demographics) and variance (random noise), concluding that 2016's misses stemmed more from bias than aggregation alone could correct, as pollsters struggled with turnout modeling for low-propensity voters. FiveThirtyEight has adjusted its models post-2016 by applying house effects and uncertainty intervals, but detractors contend these tweaks remain too poll-dependent, ignoring causal drivers like economic sentiment or cultural backlash that polls undermeasure due to respondent reluctance. Alternative predictors, particularly prediction markets, have demonstrated superior calibration in several cycles by aggregating decentralized information from bettors with financial skin in the game, incentivizing accuracy over narrative conformity. In 2016, platforms like implied Trump win probabilities around 40% on the eve of the election—higher than poll-based aggregates—aligning closer to the outcome than FiveThirtyEight's estimate. Similarly, in 2024, Polymarket odds favored Trump at over 60% in the final weeks, outperforming traditional poll aggregates that depicted a toss-up, with post-election reviews confirming markets' edge in capturing swing-state dynamics and voter enthusiasm. Blockchain-based markets like Polymarket further reduced manipulation risks through transparent trading, yielding forecasts that integrated polls with real-time signals like betting volume, which traditional models overlooked. Financial derivatives, such as options pricing, also eclipsed poll aggregates in 2024 by embedding macroeconomic expectations, predicting Trump's win margin more precisely. These alternatives underscore a key limitation of aggregate-heavy models: their reduced sensitivity to emergent causal factors, like incumbency fatigue or partisan mobilization, which markets price dynamically without relying on potentially biased survey responses.

Impact, Recognition, and Legacy

Influence on Data-Driven Journalism

FiveThirtyEight exerted substantial influence on data-driven journalism by pioneering the integration of statistical modeling into mainstream political reporting, starting with its founding by in March . The site's early adoption of poll aggregation—weighting surveys by factors such as pollster track record, sample size, and recency—provided a systematic alternative to selective or unweighted poll citations, encouraging journalists to prioritize empirical synthesis over . This approach gained traction after the site's accurate 2008 presidential election forecast, which projected securing 349 electoral votes (actual: 365), demonstrating the value of probabilistic outputs in conveying uncertainty. The "Nate Silver Effect" prompted news organizations to elevate polling data in coverage, with aggregators like and drawing over 200 million visits in October 2016 alone, reshaping how elections were framed through averages rather than isolated results. Outlets began emulating these methods, such as requiring multiple polls before reporting findings or incorporating historical pollster ratings to assess reliability, as evidenced by increased polling volume from approximately 37,000 surveys in 2012 to 48,600 by 2016. This shift extended beyond politics, adapting tools like Silver's system—originally for player projections—to broader journalistic applications, fostering a "Moneyball"-style emphasis on data over narrative intuition. FiveThirtyEight's emphasis on , expressing outcomes as percentages rather than certainties, trained audiences and reporters to grapple with uncertainty, influencing competitors like The New York Times' The Upshot and academic blogs such as The Monkey Cage. By , the site's successful state-by-state predictions further solidified this model, leading to wider adoption of data visualization and transparency in across media. However, this proliferation highlighted challenges, as many outlets lacked in-house statistical expertise, often deferring to aggregators without independent validation, which amplified reliance on potentially flawed inputs like non-response biases in surveys.

Awards, Metrics of Reach, and Cultural Penetration

FiveThirtyEight garnered recognition for its innovative approach to data visualization and statistical analysis in journalism. In 2016, the site was awarded Data Journalism Website of the Year by the Global Editors Network, honoring its exceptional use of data in storytelling across politics, sports, and science. It also earned finalist status in the Online Journalism Awards for Investigative Data Journalism (large newsroom category) in 2016 for its Flint water crisis coverage and for Digital Video Storytelling (medium form, large newsroom) in 2022. Earlier accolades included Bloggie Awards for Best Political Coverage in 2008 and Best Weblog about Politics in 2009, reflecting its early influence on political blogging. The site's reach expanded rapidly, particularly during high-stakes election cycles, driven by its models. On November 8, 2016, FiveThirtyEight recorded an all-time high of 16.5 million unique visitors, with a peak hourly count of 3.6 million, surpassing previous benchmarks amid intense in presidential race projections. Monthly unique visitors grew from approximately 2.8 million in April 2014 to 10.7 million by January 2016, coinciding with heightened election coverage under ownership. Post-acquisition by ABC News in 2018, integration into broader platforms sustained visibility, though traffic metrics fluctuated with partisan scrutiny of its models; for instance, the site handled record loads without downtime during the 2020 election. Following its shutdown on March 5, 2025, as part of ABC/ cost-cutting measures affecting 15 staff, archived content continued to draw modest traffic, around 281,000 visits monthly as of late 2025. FiveThirtyEight penetrated popular culture by mainstreaming data aggregation and uncertainty quantification in election analysis, shifting journalistic norms away from binary predictions toward ensemble modeling. This "Nate Silver Effect" encouraged outlets to prioritize poll averaging to mitigate house effects and selection biases, influencing coverage at competitors like The New York Times' The Upshot. Its forecasts became cultural touchstones, referenced in late-night television, podcasts, and policy debates, embedding terms like "polling averages" and "swing state probabilities" in public lexicon. Critics, however, noted that its emphasis on quantitative rigor sometimes overlooked qualitative political dynamics, yet the site's legacy endures in the proliferation of probabilistic tools across media, even after Silver's 2023 departure and the outlet's closure.

Shutdown Implications and Long-Term Assessment

The shutdown of FiveThirtyEight occurred on March 5, 2025, when ABC News, under parent company , laid off its remaining staff of approximately 15 employees as part of broader cost-cutting measures affecting about 6% of ABC News and Networks personnel, totaling around 200 jobs. This decision reflected ongoing media industry pressures, including declining ad revenue and the challenges of maintaining niche operations within large conglomerates, leading to the consolidation of ABC's news magazine shows like 20/20 and . For ABC, the implications included streamlined operations and potential short-term financial savings, but at the cost of specialized capabilities that had previously distinguished its and polling coverage. The closure marked the effective end of FiveThirtyEight as an independent entity following its partial integration into ABC after founder Nate Silver's departure in 2023 and the redirection of its domain traffic in September 2023. Silver attributed the site's vulnerability to Disney's lack of investment in and product strategy, which allowed talent poaching by competitors and prevented sustainable growth. Immediate fallout included the disruption of ongoing tools like polling averages and approval trackers, leaving a gap in accessible public data resources until successors emerged. In the long term, FiveThirtyEight's shutdown underscored the precariousness of data-driven journalism within corporate media structures, where profitability often overrides niche expertise, contributing to a broader contraction in specialized political analysis outlets. Its legacy endures through the standardization of and poll aggregation, which influenced outlets like to launch replacement tools, such as a freely available database tracking polls including President Trump's job approval ratings, independently collected to maintain continuity for researchers and journalists. Silver's subsequent Silver Bulletin has extended this work with public pollster ratings and approval metrics, demonstrating that core methodologies persist outside legacy media. Overall assessments highlight FiveThirtyEight's role in elevating empirical political coverage since its founding—evidenced by its accurate Obama election forecast—but also reveal limitations in scalability and resilience, as corporate priorities ultimately prevailed over its contributions to causal, data-centric analysis.

References

Add your contribution
Related Hubs
User Avatar
No comments yet.