Chalkbeat defines impact as when its reporting influences the debate on educational issues and on decisions made in the education field. It has developed an impact tracking system called MORI (Measures of Our Reporting’s Influence), which it uses to help plan content around the type of impact it seeks and to measure the impact of content. A WordPress plug-in, MORI enables reporters to enter story characteristics such as story type, audience and theme, as well as evidence of impact, including actions that were informed by the story, civic deliberations spurred by the story and pickups of the story. The program aggregates this information into reports that can be used to track Chalkbeat’s progress toward its annual editorial and engagement goals.
ProPublica employs a Tracking Report, an internal document that is updated daily and shared with management and the board of directors monthly. The report records each story published as well as official actions (such as announcements of policy reviews or statements by public officials), opportunities for change (hearings, studies or commission appointments to study an issue), and actual change that can be causally connected to ProPublica’s work. ProPublica maintains the Tracking Report for months and sometimes years beyond the publication of a story, acknowledging that the types of change ProPublica seeks to create through reporting may take a long time to come about.
WisconsinWatch has developed a detailed system of tracking the distribution of its stories. The site has set up Google Alerts using reporter names, story names and more, and also searches on the sites of the top news organizations that pick up their stories. Information gathered from these searches—type of story, story elements published, names and geographic locations of distributing publications, readership of distributing publications, and more—is recorded and visualized using mapping software including BatchGeo and Tableau.
The Center for Investigative Reporting is the first media organization with a full-time Ph.D. in social sciences devoted to cataloging, measuring and analyzing media impact. The analyst has developed a system for cataloging offline impact–real-world change—that results from journalism. Using an impact taxonomy developed with input from a wide range of media organizations, the analyst has created a system for converting anecdotal evidence (i.e., media pickup, editorials referencing the work, mentions by public officials, new laws and direct response from audience, among others) into qualitative data sets that can be analyzed to better understand what impact is and how it happens. To create the data set, reporters and editors complete a Web form for each instance of real-world change associated with their work. This information flows into a database that can be easily sorted and filtered; the analyst can then identify patterns and questions for deeper inquiry. The center has consulted with a number of media organizations to help them set impact goals, develop strategies, and construct plans for measurement and analysis. During these coaching engagements, organizations conveyed their interest in using a tracking system such as the one the center uses(currently built using Podio, a workflow collaboration platform). In response to this demand, the Center for Investigative Reporting is developing a proprietary tool that other organizations will be able to use.