Benchmarking enhancements to a decision support system for global crop production assessments

  • Authors:
  • Wim van Leeuwen;Chuck Hutchinson;Sam Drake;Brad Doorn;Verne Kaupp;Tim Haithcoat;Vladislav Likholetov;Ed Sheffner;Dave Tralli

  • Affiliations:
  • School of Natural Resources and the Environment/Office of Arid Lands Studies, University of Arizona 1955E. 6th St., Tucson, AZ 85721, United States and School of Geography and Development, Univers ...;School of Natural Resources and the Environment/Office of Arid Lands Studies, University of Arizona 1955E. 6th St., Tucson, AZ 85721, United States;School of Natural Resources and the Environment/Office of Arid Lands Studies, University of Arizona 1955E. 6th St., Tucson, AZ 85721, United States;USDA/FAS/OGU/IPAD, Washington, DC 20250, United States;University of Missouri, Columbia, MO 65211, United States;University of Missouri, Columbia, MO 65211, United States;University of Missouri, Columbia, MO 65211, United States;NASA Ames Research Center, Moffett Field, CA 94035, United States;National Space Technology Applications, Earth Science and Technology Directorate, Jet Propulsion Laboratory, CA, United States

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2011

Quantified Score

Hi-index 12.05

Visualization

Abstract

The Office of Global Analysis/International Production Assessment Division (OGA/IPAD) of the United States Department of Agriculture - Foreign Agricultural Service (USDA-FAS) has been assimilating new data and information products from agencies such as the National Aeronautics and Space Administration (NASA) into its operational decision support system (DSS). The FAS mission is to improve monthly estimates of global production of major agricultural commodities and provide US Government senior decision makers and the public the most accurate, timely, and objective assessment of the global food supply situation possible. These estimates are ultimately captured as the US governments' official assessments of world food supply for the commodity markets and policy makers. The goal of this research was to measure changes in the quality and accuracy of decision support information resulting from the assimilation of new NASA products in the DSS. We gathered both qualitative and quantitative information through questionnaires and interviews to benchmark these changes. We used an interactive project lifecycle risk management tool developed for NASA mission spaceflight design and quality assurance (DDP - Defect Detection and Prevention) to do this. In this case, we used it to (1) quantify the change in DSS Objectives attained after assimilation of new products, and (2) evaluate the effectiveness of various Mitigation options against potential Risks. The change in Objectives attainment was considered the most important benchmarking indicator for examining the effectiveness of the assimilation of NASA products into OGA/IPAD's DSS. From this research emerged a novel model for benchmarking DSSs that (1) promotes continuity and synergy within and between government agencies, (2) accommodates scientific, operational and architectural dynamics, and (3) facilitates transfer of knowledge among research, management, and decision-making agencies.