Criteria for and Explanation of Ratings

A news or information website is rated GREEN if its content is produced by people who are trying to communicate news, information, and opinion that they believe is accurate, and who adhere to practices aimed at assuring basic standards of accuracy as well as accountability.  A site is rated RED if it fails to meet these minimum standards.

As explained below, NewsGuard uses 11 specific criteria to evaluate these possible points of failure. We start with the premise that a site should be GREEN until our evaluation of the site, based on those 11 criteria, produces a RED rating.

These determinations will be made through reporting by NewsGuard’s analysts, who will be experienced journalists supervised by editors with significant experience in the profession. Two analysts will independently review and assess the content and processes of each site, with any disagreements resolved by the executive editor, managing editor, and editor in chief. In all cases, the identities and backgrounds of the analysts reviewing the site, as well as those of the supervising editors, will be completely transparent, as will any disagreements that were discussed as the rating was determined.

It should be noted that the only attribute that sites rated GREEN have in common is that they did not fail to meet the test of enough of the 11 criteria that they should be rated RED. Not all sites rated GREEN are equal. As our Nutrition Label write-ups will indicate, some are much fairer and more accurate in their reporting than others. Some are more transparent and accountable than others. Some are more robustly staffed and regularly produce superior content, while others struggle with tight budgets. Some focus on reporting the news, while others have a mission based on a political or other point of view that they unabashedly support. NewsGuard’s mission is not to make granular judgments but to establish and communicate adherence to basic standards in order to give readers information they need to assess their sources of information online. Again, the Nutrition Labels attempt to convey those differences, while the GREEN-RED rating provides a more basic, binary distinction. Put simply, RED-rated sites fail the test of the key criteria and sometimes even all 11.

The 11 Factors

Here are the 11 indicators that NewsGuard uses in determining if a provider is rated RED. A site that fails to adhere to a preponderance of these indicators will be rated RED. No site must adhere to all of the indicators to be rated GREEN.

In every case the NewsGuard Nutrition Labels that are provided for each site (by clicking on the rating) spell out the site’s adherence to each of the 11 indicators that yielded that source’s particular rating.

The 11 indicators below are listed in order of their importance in determining a RED rating. For example, failure to adhere to the first indicator –professional standards – will be far more influential in determining a RED rating than failure to participate in the Trust Project’s program of self-reporting adherence to transparency standards.

  1. Meets Basic Standards of Accuracy and Fairness: The content of the site is created by reporters, writers, videographers, researchers, or other information providers who generally seek to be accurate and fair in gathering, reporting, and interpreting information, even if they approach their work from a strong point of view.
  2. Doesn’t Publish False Content: In the last three years the site has not produced multiple articles that have been declared significantly “false” or “fake” by one or more non-partisan fact checking organizations or that other journalists, including our own, have found to be clearly false and not been quickly and prominently corrected.
  3. Distinguishes News and Information from Opinion:  If the site is a content provider with a distinct, deliberate point of view or mission, it communicates that in an accessible place on the site, such as in the “About” section. If the site purports to be a provider of news, it regularly separates and labels opinion or commentary in order to distinguish it from news reports.
  4. Clearly Labels Advertising: The site makes clear which content is paid for and which is not.
  5. Discloses Ownership or Financing: The ownership and financing of the site is made clear through user-friendly disclosure, typically in an “About” section of the website.
  6. Avoids Deceptive Headlines: The site generally does not publish headlines that significantly sensationalize or otherwise do not reflect what is actually in the story.
  7. Satisfactory Accountability Practices: The site makes clear how to contact those in charge and has effective practices for publishing clarifications and corrections.
  8. Reveals Who’s in Charge: The site makes clear who is in charge of its content and how that person can be contacted.
  9. Provides Information about Content Creators: Information about those producing the content is made accessible on the site.
  10. Participates in the Trust Project: If it is a news site, it participates in the Trust Project, a consortium of news publishers organized by researchers at Santa Clara University.
  11. Complies with all Factors of the Trust Project: The site, if it participates in the Trust Project, accurately reports and adheres to all of the “Trust Indicators” established by that project.

NOT YET RATED:

If a source is not yet rated, it means that NewsGuard does not know enough about the source for it to be rated.

It could be that the source is not among the list of the top 7,500 sources of news and information that are the most used and shared by users in the United States, all of which NewsGuard will have reviewed and rated. In that case, if publishers or readers would like NewsGuard’s analysts to rate a source not yet rated, they can request to be reviewed and rated.

Or it could be that the source is currently being reviewed by NewsGuard but that our analysts have not yet gathered enough information to rate it responsibly.

No positive or negative inference should be inferred from the fact that a source has not yet been rated.

Criteria Yes No N/A
 Meets basic standards of accuracy and fairness
 Doesn’t publish false content
 Distinguishes news and information from opinion
 Clearly labels advertising
 Discloses ownership or financing
 Avoids deceptive headlines
 Satisfactory accountability practices
 Reveals who’s in charge
 Provides information about content creators
 Participates in the Trust Project
 Complies with all factors of the Trust Project

Download a copy of this.