(DRAFT) Keyword Review and Release Process

(1) Determine Keywords To Prioritize For Review

• Keyword Summary Spreadsheet

• The Keyword Summary Spreadsheet conveys a high-level summary of the keywords, including the keyword version number, keyword type, number of keywords added, deleted, updated, the rationale for change and the keyword release date. Keywords are prioritized based on their rationale for change (detailed in spreadsheet) and when the keyword set was last revised.

(2) Compile Keyword Metrics

• N/A

• The metrics (listed below) are gathered to help determine if keyword changes are needed. The metrics come from NetInsight, Google analytics, and metadata searches in the CMR.
  
  • User Search Behavior: Keyword is considered to be a candidate for inclusion based on keyword search usage and discovery in a search interface (e.g. GCMD, IDN EDSC).
  • Keyword Gaps: Keyword is considered to be a candidate for inclusion based on identification of common term missing from the controlled keyword list.
  • Record Lists: 'Uncontrolled' keyword in detailed variable, ancillary keyword, or other field in metadata record is considered a candidate to be controlled.

• N/A

• Keyword Change Spreadsheet

• The Keyword Change Spreadsheet conveys the details of the keyword changes across all keyword levels, the numbers of records impacted, and the rationale for the keyword change. The analysis of the keyword metrics are used to help make keyword recommendations.

• N/A

• The selected stakeholders are usually ESDIS, ESO, and a sub-set of experts within the science discipline of the keywords being proposed.

• Keyword Change Spreadsheet

• The Keyword Change Spreadsheet (final for review) conveys the details of the recommended keyword changes across all keyword levels, numbers of records impacted, and the rationale for the keyword change based on the preliminary review.

• Provider Impact Assessment Spreadsheet
• Survey Template (Google Survey Form)

• The Provider Impact Assessment Spreadsheet conveys the count of records in the CMR affected by the keyword release across EOSDIS and IDN providers.
• The survey provides an introduction to the keyword changes and allows reviewers to rate the keyword changes, including the effectiveness of the keyword, and gives the keyword reviewer the opportunity to provide additional feedback.

• Keyword Review Announcement
• ESO Keyword Review Page

• The Keyword Review Announcement is for the keyword reviewers and conveys a summary of the keyword changes, the review beginning and end date, and a link to the ESO keyword review page.
• The NASA ESDIS Standards Office (ESO) Keyword Review Page is where the materials are posted and provided to the keyword reviewers. The page summarizes the keyword changes, provides instructions to the reviewers, and links to the review materials (keyword change spreadsheet, provider impact assessment spreadsheet, and the keyword review survey). The keyword summary spreadsheet is only shared and discussed with the ESO.
• The Keyword Reviewers are selected by the ESO based on input provided by ESDIS and the Metadata Quality Team.
• During the keyword review, the keyword reviewers examine the keyword materials and provider their feedback. If there is minimal input, the keyword review may be extended at the discretion of ESDIS and the ESO.

• Keyword Review Feedback Page

• The Keyword Review Feedback Page conveys the reviewer's name/email, the review comments, and the responses to those comments. There is an email response to each keyword reviewer with a summary of their comments, a responses to their comments, and a list of any keyword changes based on their comments.

• Keyword Change Spreadsheet

• The Keyword Change Spreadsheet conveys the details of the final keyword changes across all keyword levels, numbers of records impacted, and the rationale for the keyword change.

(11) Implement Keywords in GCMD Keyword Management System (KMS)

• GCMD KMS

• The KMS is the internal system used for maintaining and publishing the GCMD keywords and associated definitions/references. All changes are verified for accuracy before being published.

• Keyword Summary Table
• Final Keyword Summary Spreadsheet
• Keyword Landing Page
• Keyword Release Announcement

• The Keyword Summary Table provides a listing of all the new, updated, and deleted keywords.
• The Final Keyword Summary Spreadsheet conveys a high-level summary of the keywords including the keyword version number, keyword type, number of keywords added, deleted, updated, the rationale for change and the keyword release date.
• The Keyword Landing Page (already existing) provides information on the keywords and how to access them.
• The Keyword Release Announcement provides a summary of the keyword changes, a background on the importance of the keywords, a link to the keyword summary table, a link to the keyword feedback page (for transparency) and the keyword landing page.

• NASA GCMD Keywords Version 8.6 Released (2018-03-15)

• The Keyword Release Package materials are emailed to the following email lists:
  • IDN Interop
  • GCMD DAACs
  • ESIP
  • ESO
  • DAAC-Mgrs
• The Keyword Release Package materials are posted to the following websites:
  
  • GCMD
  • IDN
  • Keyword Forum Page
• The Keyword Release Package materials are posted to the following EOSDIS slack channels
  • GCMD
  • Curation