Developing the Report
The process for preparing condition reports involves a combination of accepted techniques for collecting and interpreting information gathered from subject matter experts. The approach varies somewhat from sanctuary to sanctuary in order to accommodate differing styles for working with partners. The Florida Keys National Marine Sanctuary approach was closely related to the Delphi Method, a technique designed to organize group communication among a panel of geographically dispersed experts by using questionnaires, ultimately facilitating the formation of a group judgment. This method can be applied when it is necessary for decision-makers to combine the testimony of a group of experts, whether in the form of facts or informed opinion, or both, into a single useful statement.
The Delphi Method relies on repeated interactions with experts who respond to questions with a limited number of choices to arrive at the best supported answers. Feedback to the experts allows them to refine their views, gradually moving the group toward the most agreeable judgment. For condition reports, the Office of National Marine Sanctuaries uses 17 questions related to the status and trends of sanctuary resources, with accompanying descriptions and five possible choices that describe resource conditions.
In order to address the 17 questions, sanctuary staff selected and consulted outside experts familiar with water quality, living resources, habitat, and maritime archaeological resources. Phone calls and one-on-one meetings were convened where experts participated in discussions with sanctuary staff about each of the 17 questions. Experts represented various affiliations including Florida Fish and Wildlife Conservation Commission, Florida International University, Florida Keys National Marine Sanctuary, Mote Marine Laboratory, NOAA National Marine Fisheries Service, Reef Environment Education Foundation, University of Miami Rosenstiel School of Marine and Atmospheric Science, and the University of North Carolina Wilmington. During each consultation, experts were introduced to the questions and asked to provide recommendations and supporting arguments for their suggested rating. The ratings and text found in the report are intended to summarize the opinions and uncertainty expressed by the experts, who based their input on knowledge and perceptions of local conditions. Comments and citations received from the experts were included, as appropriate, in text supporting the ratings.
The first draft of the document was sent to various subject matter experts and important partners in research and resource management for what was called an Invited Review. Individuals included representatives from Audubon Society, Coral Restoration Foundation, Department of Primary Industries and Fisheries, Environmental Protection Agency (Wetlands, Coastal and Oceans Branch and Special Studies), Florida Department of Health, Florida Fish and Wildlife Conservation Commission, Florida Keys National Marine Sanctuary, Georgia Institute of Technology, Naval Air Station Key West, NOAA Corps, NOAA National Marine Fisheries Service, Reef Environmental Education Foundation, University of Miami Rosenstiel School of Marine and Atmospheric Science, and the University of North Carolina Wilmington. Individuals were asked to review the technical merits of resource ratings and accompanying text, as well as to point out any omissions or factual errors. The comments and recommendations of invited reviewers were received, considered by sanctuary staff, and incorporated, as appropriate, into a final draft document.
A draft final report was then sent to John F. Bruno, Ph.D. (Associate Professor, The University of North Carolina at Chapel Hill), Richard E. Dodge, Ph.D. (Dean, Nova Southeastern University Oceanographic Center), Paul Sammarco, Ph.D. (Professor, Louisiana Universities Marine Consortium), and Rob van Woesik, Ph.D. (Professor, Florida Institute of Technology) who served as external peer reviewers. This External Peer Review is a requirement that started in December 2004, when the White House Office of Management and Budget (OMB) issued a Final Information Quality Bulletin for Peer Review (OMB Bulletin), establishing peer-review standards that would enhance the quality and credibility of the federal government's scientific information. Along with other information, these standards apply to Influential Scientific Information, which is information that can reasonably be determined to have a "clear and substantial impact on important public policies or private sector decisions." The Condition Reports are considered Influential Scientific Information, and for this reason, are subject to the review requirements of both the Information Quality Act and the OMB Bulletin guidelines. Therefore, following the completion of every condition report, they are reviewed by a minimum of three individuals who are considered to be experts in their field, were not involved in the development of the report, and are not Office of National Marine Sanctuaries employees. Comments from these peer reviews are incorporated into the final text of the report. Furthermore, OMB Bulletin guidelines require that reviewer comments, names, and affiliations be posted on the agency website: http://www.cio.noaa.gov/Policy_Programs/prplans/PRsummaries.html. Reviewer comments, however, are not attributed to specific individuals. Reviewer comments are posted at the same time as with the formatted final document. Following the External Peer Review, the comments and recommendations of the reviewers were considered by sanctuary staff and incorporated, as appropriate, into a final draft document. In some cases sanctuary staff reevaluated the status and trend ratings and when appropriate, the accompanying text in the document was edited to reflect the new ratings. The final interpretation, ratings, and text in the draft condition report were the responsibility of sanctuary staff, with final approval by the sanctuary manager. To emphasize this important point, authorship of the report is attributed to the sanctuary alone. Subject experts were not authors, though their efforts and affiliations are acknowledged in the report.