Agronomy Journal Grow Your Career With ASA
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (6)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Bostick, W. M.
Right arrow Articles by Hoogenboom, G.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Bostick, W. M.
Right arrow Articles by Hoogenboom, G.
Agricola
Right arrow Articles by Bostick, W. M.
Right arrow Articles by Hoogenboom, G.
Related Collections
Right arrow Agroclimatology
Right arrow Plant and Soil Interactions
Right arrow Evapotranspiration Models
Right arrow Data Management
Right arrow Agricultural Systems
Right arrow Crop Systems
Right arrow Crop Models
Right arrow Plant and Environment Interactions
Published in Agron. J. 96:853-856 (2004).
© American Society of Agronomy
677 S. Segoe Rd., Madison, WI 53711 USA

NOTES AND UNIQUE PHENOMENA

A WEB-BASED DATA EXCHANGE SYSTEM FOR CROP MODEL APPLICATIONS

W. McNair Bostick*,a, Jawoo Kooa, Valerie K. Walena, James W. Jonesa and Gerrit Hoogenboomb

a Dep. of Agric. and Biol. Eng., Univ. of Florida, Gainesville, FL 32611
b Dep. of Biol. and Agric. Eng., The Univ. of Georgia, Griffin, GA 30223

* Corresponding author (mcnair2{at}ufl.edu).

Received for publication May 7, 2003.

    ABSTRACT
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 System Description
 Implementation
 Discussion
 REFERENCES
 
Development, evaluation and, application of cropping system models (CSMs) require multiple types of data. Cropping system data sets can often be used multiple times by different groups of modelers and experimentalists around the globe. However, for various reasons, data sets are often underutilized while at the same time, lack of data creates a bottleneck for many modeling efforts. In an effort to increase utilization of cropping system data, the International Consortium for Agricultural Systems Applications (ICASA) has developed an internet-based system, the ICASA Data Exchange (ICASA DE; www.icasa.net; verified 15 Feb. 2004), that provides a convenient forum for documenting, archiving, and exchanging cropping system experiment and/or weather data sets. Users of the ICASA DE can enter metadata that describe their data sets, upload their data set files, edit their entries, search for data using specific criteria, browse metadata of data sets in the system, and download data sets from the system. The purpose of this paper is to present the functional design and implementation of this system.

Abbreviations: CSM, cropping system model • ICASA, International Consortium for Agricultural Systems Applications • ICASA DE, International Consortium for Agricultural Systems Applications Data Exchange (system)


    INTRODUCTION
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 System Description
 Implementation
 Discussion
 REFERENCES
 
CROPPING SYSTEM MODELS integrate data and knowledge of soil, plant, and atmosphere systems to allow simulation of cropping systems over a wide range of environments and management practices (Larson et al., 1996; Pala et al., 1996; Cavero et al., 1998; Alves and Nortcliff, 2000; Mailhol et al., 2001). This makes them valuable tools for agricultural professionals around the world. However, effective applications of CSMs require a minimum set of weather, soil, and management data (Hunt and Boote, 1998). Development and evaluation of models require all of the aforementioned types of data together with additional data such as time-series data on crop development, soil moisture, and soil nutrients as well as yield and yield components data.

In some modeling efforts, data collection and dissemination systems are in place, and data availability may not be a constraint. Examples of systems include the Georgia Automated Environmental Monitoring Network (Hoogenboom, 1993), which provides weather data from the state of Georgia; MetBroker (Laurenson et al., 2002), which is a mediator application to provide access to online weather databases; and EuroSOMNET, which is a soil organic matter experiment database (Franko et al., 2002). However, in many cases, data acquisition requires significant resources, and data availability becomes a constraint.

Data collected in agricultural research can often be used to achieve multiple objectives. For example, data collected by an experimentalist to test a hypothesis may also be usable by a modeler in development or evaluation of a CSM. Examples of cropping system data sets that may be useful for working with CSMs include irrigation and fertilizer response experiments, variety trials, pest management experiments, and long-term crop rotation experiments. In addition, local weather data sets that coincide with these experiments are needed. However, modelers and experimentalists are often unaware of collaboration possibilities and invest significant resources in collecting data solely to meet their specific objective. Furthermore, after a project's objectives have been achieved, the data collected for an experiment, which could be used by multiple researchers working with CSMs, are often filed away with poor documentation and never used again (Hunt et al., 2001; van Evert et al., 1999). We believe that the efficiency of CSM endeavors can be improved by implementing a system for archiving data with adequate documentation (metadata) and providing easy access to data for those who need it.

Internet database systems, such as the Georgia Automated Environmental Monitoring Network, MetBroker, and EuroSOMNET, are an effective way of archiving and disseminating data because anyone with internet access can obtain metadata and/or data from these systems. Moreover, low-cost and public-domain software are now available for developing such systems.

We realize that, for various reasons, not all data can be shared, and some researchers are reluctant to share data at all. On the other hand, data sharing and other exchanges between researchers are often essential to the success of research endeavors. This is one of the reasons that many funding organizations, such as the National Science Foundation (NSF) and the National Aeronautics and Space Administration (NASA), specify that that grantees should make project-supported data available to other researchers and the public (NSF, 2002; NASA, 2003). To provide a forum for data sharing in the cropping system research community, we have developed an internet-based system for researchers to document and exchange cropping system data sets and corresponding weather data sets. The purpose of this paper is to present the functional design and implementation of this system.


    System Description
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 System Description
 Implementation
 Discussion
 REFERENCES
 
The system is administered by ICASA (www.icasa.net), an open-membership organization that envisions a future characterized by broad acceptance of systems-oriented methodologies in agriculture and natural resources. The goal of ICASA is to advance agricultural systems research through the development and application of methodologies and tools for agricultural systems analysis.

The system is named the ICASA Data Exchange (ICASA DE). Users of the ICASA DE can enter metadata that describe their data sets, upload their data set files, edit their entries, search for data using specific criteria, browse metadata of data sets in the system, and download data sets from the system. Members of ICASA have access to all of the functions of the ICASA DE. To become an ICASA member, one must state that he or she agrees with ICASA vision and goals and will contribute to advancing these goals. By requiring ICASA membership for full access to the system, we feel that we create a forum that users will be comfortable contributing to because it will be accessible by like-minded scientists. In addition, we feel that this requirement will emphasize the importance of voluntary contributions to the system and encourage those that download data to contribute data also. If people do not want to become ICASA members, they can still access all of the metadata in the system and contact the data holder if they want to obtain data sets documented in the ICASA DE.

Data Entry and Editing
Metadata and data files are stored in tables of a relational database. For metadata entry, users complete an online form by using either check boxes or pull-down menus for most entries. Examples of metadata for experiment and weather data sets are shown in Fig. 1 and 2 , respectively. Metadata fields on the entry form were chosen to provide a complete description of the contents of the experimental and weather data sets. Required fields for both experimental and weather data sets (denoted by an * in Fig. 1 and 2) are owner name and contact information, dates of data collection, site information, and data holder name and contact information. Other fields are optional.



View larger version (48K):
[in this window]
[in a new window]
 
Fig. 1. Metadata of one of the experiment data sets in the database. * Denotes required fields.

 


View larger version (50K):
[in this window]
[in a new window]
 
Fig. 2. Metadata of one of the weather data sets in the database. * Denotes required fields.

 
If the users choose to upload data files, they will be prompted to upload after they have completed the metadata entry form. Submission of files that follow the ICASA data standard (www.icasa.net) is strongly encouraged. However, it is not required that file submissions follow this format, as we feel that this could deter scientists that are not familiar with the format from entering data that could be very beneficial to the CSM community. To save space on the data server and to allow for easy and fast file transfers, only compressed .zip files can be uploaded. The ICASA DE data-editing interface provides a user with the option to correct errors found in the metadata or data files after submission or remove the data from the database.

Data Search and Download
When searching for data, users can customize their search by specifying a country, latitude and longitude, and/or crop (for experiment data only). After the search criteria are entered, the system searches the database tables and returns summary information for each data set that meets the criteria. If no criteria are entered, summaries for all data in the database are shown. Users can then select specific data sets to view those data sets' metadata. If data files are available for download, a download link is displayed at the bottom of the metadata (Fig. 1 and 2). If data files are not available, the data holder's contact information is provided so that users can request access to the data or obtain additional information about the data.

File Verification
The only metadata field not entered by a user is the verification status, which is determined by the ICASA DE administrator. Initially, uploaded files have an unverified status. Uploaded files are checked by ICASA to confirm that they contain data pertaining to cropping systems, and if this is the case, they receive verified status. The main purpose of this first level of verification it to assure that the system is not being used to exchange files unrelated to cropping systems. As an additional level of verification, ICASA may also evaluate whether the data works with a specific application, such as a model. If they do work, this is also specified in the verification status. For example, the verification status in Fig. 1 and 2 indicate that the data files have been verified as operable with the DSSAT CSM. Verification is conducted to confirm the integrity of a data set, but it is not meant to be a rating of the overall scientific quality of the data.


    Implementation
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 System Description
 Implementation
 Discussion
 REFERENCES
 
The user interface was developed using Active Server Pages scripts (ASP; Microsoft Corp., Redmond, WA) and Hypertext Markup Language (HTML). The relational database was built using the database software MySQL 3.2.53 (MySQL Inc., Seattle, WA). A graphical database management and monitoring application, i.e., MySQL Studio 4.7.2 (PremiumSoft CyberTech Ltd., Central, Hong Kong) was used to allow for easy and visible management of the database. An open database connectivity driver, MyODBC 2.50 (MySQL Inc., Seattle, WA), was used to link the user interface with the database. The server computer used the Windows 2000 Advanced Server (Microsoft Corp., Redmond, WA) operating system and Internet Information Server web server software (Microsoft Corp., Redmond, WA).

MySQL database software was selected because it is commonly used, open-source database software. Active Server Pages scripts were used because they work well with a Windows server without any additions that would be needed with a similar scripting language such as JavaServer Pages (JSP). Active Server Pages scripts are also widely used, and it will be easy to maintain and improve the system.


    Discussion
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 System Description
 Implementation
 Discussion
 REFERENCES
 
The ICASA DE is convenient and easy to use because it is available for accessing and archiving data at any time from any location with internet access. The system works well with Internet Explorer version 5.0 or later and Netscape version 6.0 or later. We feel that the system will improve data availability and increase multiple uses of data. Increased access to data will result in more opportunities for improvement and applications of CSMs and will increase benefits derived from data collection.

A key improvement that we envision for the ICASA DE involves the metadata entry process. Although the data entry form is clearly laid out and has a simple user interface, manually searching through data files to extract metadata to fill out the forms can be tedious and may deter data holders from entering data. Therefore, a further step of system development would be to automate metadata and data uploading to the database.

Both ICASA as an open-membership organization and the ICASA DE have been in existence for less than one year. As of 8 Oct. 2003, metadata and data files for 52 experiments and two weather stations had been uploaded to the system. One of the main principles of ICASA is cooperation between researchers through sharing data, software applications, and/or other entities. As the ICASA DE becomes more well known in the cropping systems research community, it will be a widely used and important tool to those who are developing, evaluating, and applying CSMs.


    NOTES
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 System Description
 Implementation
 Discussion
 REFERENCES
 
Florida Agric. Exp. Stn. Journal Ser. no. R-09492. This research was supported in part by the Soil Management CRSP Project, funded by USAID, and by "Carbon from Communities: A Satellite View" funded by NASA.


    REFERENCES
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 System Description
 Implementation
 Discussion
 REFERENCES
 




This article has been cited by other articles:


Home page
Agron. J.Home page
J. W. White and F. K. van Evert
Publishing Agronomic Data
Agron. J., August 11, 2008; 100(5): 1396 - 1400.
[Abstract] [Full Text] [PDF]


Home page
Agron. J.Home page
J. W. White, K. J. Boote, G. Hoogenboom, and P. G. Jones
Regression-Based Evaluation of Ecophysiological Models
Agron. J., February 6, 2007; 99(2): 419 - 427.
[Abstract] [Full Text] [PDF]


Home page
Agron. J.Home page
L. Ma, G. Hoogenboom, L. R. Ahuja, D. C. Nielsen, and J. C. Ascough II
Development and Evaluation of the RZWQM-CROPGRO Hybrid Model for Soybean Production
Agron. J., July 13, 2005; 97(4): 1172 - 1182.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in Web of Science
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Web of Science (6)
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Bostick, W. M.
Right arrow Articles by Hoogenboom, G.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Bostick, W. M.
Right arrow Articles by Hoogenboom, G.
Agricola
Right arrow Articles by Bostick, W. M.
Right arrow Articles by Hoogenboom, G.
Related Collections
Right arrow Agroclimatology
Right arrow Plant and Soil Interactions
Right arrow Evapotranspiration Models
Right arrow Data Management
Right arrow Agricultural Systems
Right arrow Crop Systems
Right arrow Crop Models
Right arrow Plant and Environment Interactions


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
The SCI Journals Crop Science Vadose Zone Journal
Journal of Natural Resources
and Life Sciences Education
Soil Science Society of America Journal
Journal of Plant Registrations Journal of
Environmental Quality
The Plant Genome