­

Overview

The CMR includes metadata that originate in three dialects: DIF, ECHO, and ISO. The largest portion of CMR collection records are in the SciOps collection, and are inserted into the CMR in DIF format. These are referred to here as the SciOps collection. The second largest portion of metadata for NASA collections originate from ECHO and are inserted into the CMR in ECHO format. These are referred to here as the NASA collection. A third group of metadata in the CMR originate from other agencies around the world and are generally either in DIF or possibly in ISO. These are referred to as the Other collection.

The DIF and ECHO dialects were originally developed to facilitate discovery of collections in the Global Change Master Directory or ECHO. The content of these “discovery” dialects is translated into the ISO dialects that are the eventual target for CMR. This translation is generally done without augmentation, so the content does not change very much.

Metadata providers have a choice about which metadata dialect(s) they use to submit metadata to the CMR. We compared the SciOps and NASA collections to understand how does this choice effects the metadata content.

Data Selection

The SciOps data collection includes over 13,000 metadata records from nearly 2,000 different sources, most outside of NASA. Over 1700 of these sources have less than ten metadata records. Assuming that there is variation in metadata creation techniques for these providers, this is likely not a homogeneous collection. We identified 25 providers that have collections with one hundred or more records and examined those as separate collections.

Table 1 below shows the 18 NASA provider and 25 SciOps Providers considered in this evaluation, as well as the record count for each provider.

Table 1. Collections and record counts

SciOps vs. NASA

This analysis compares item  usage (elements and attributes) in the 18 NASA collection with the 25 SciOps collections.  This evaluation identifies items which exist in collections as well as items that are complete in collections.  In order for an item to exist in a collection it must be present in at least 1 metadata record included in the collection. In order for an item to be complete in a collection it must be present in all metadata records included in the collection. 

Item usage for NASA collections and SciOps collections are shown below using bubble charts.  The bubble chart interpretation graphic provides a schematic for interpreting the bubble plots. 

Bubble Chart Interpretation

NASA Exist vs SciOps Exist

Chart 1 below compares item existence in NASA Collections with SciOps collections.  The X axis shows the number of NASA collections that include an item. The Y axis shows number of SciOps collections that include an item.  The bubble size shows the number of items included in the 2 collections.

The large red bubble in the upper right corner of the plot shows the items (elements and attributes) that exist is all 18 NASA collections and in all 25 SciOps collections.  This bubble includes 43 items, as shown in the legend.  The large blue bubble in the lower left corner of the plot shows items that exist is 1 NASA collection and in 0 SciOps collections.  This bubble includes 44 items, as shown in the legend. The data for Chart 1 is accessible in Google Sheets.  To view the data and bubble chart in Google Sheets click on the image. 

Chart 1: NASA EXIST vs SciOps Exists

Accessing the Chart

To access the data for this chart, click on the chart graphic above to view an interactive version in Google Sheets.  The interactive version enables data identification for each bubble and includes a look up table for identifying the ISO items (elements and attributes) associated with the bubble. To access and use the interactive version:

1. Click on the chart graphic above to view the chart in Google Sheets
2. Hover over the bubbles with your mouse to identify item existence in NASA collections and item existence in SciOps collections associated with the bubble.  The hover identification also shows the number of items (Counts) associated with each bubble.
3. To the right of the chart is a lookup table for identifying the xpaths associated with each of the bubbles.  To identify the xpaths associated with a bubble, match the NASA Exists and SciOps Exists value pairs (from the bubble hover) with the value pairs in the look up table.

NASA Complete vs SciOps Complete

Chart 2 below compares item (elements and attributes) completeness in NASA Collections with SciOps collections.  The X axis shows the number of NASA collections that are complete with respect to an item. The Y axis shows number of SciOps collections that are complete with respect to an metadata items.  The bubble size shows the number of items included in the 2 collections.

The large red bubble in the upper right corner of the plot shows items that are complete is all 18 NASA collections and in all 25 SciOps collections.  This bubble includes 28 items, as shown in the legend.  The large blue bubble in the lower left corner of the plot shows the items that are complete in 1 NASA collection and in 0 SciOps collections.  This bubble includes 40 items, as shown in the legend. The data for Chart 2 is accessible in Google Sheets.  To view the data and bubble chart in Google Sheets click on the image.

Chart 2: NASA Complete vs SciOps Complete

Accessing the Chart

To access the data for this chart, click on the chart graphic above to view an interactive version in Google Sheets.  The interactive version enables data identification for each bubble and includes a look up table for identifying the ISO items associated with the bubble. To access and use the interactive version:

1. Click on the chart graphic above to view the chart in Google Sheets
2. Hover over the bubbles with your mouse to identify the number of complete NASA collections and the number of complete SciOps collections associated with the bubble.  The hover identification also shows the number of items (Counts) associated with each bubble.
3. To the right of the chart is a lookup table for identifying the xpaths associated with each of the bubbles.  To identify the xpaths associated with a bubble, match the NASA Provided Complete and SciOps Provided Complete values (from the bubble hover) with the values in the look up table.

Elements in all NASA and Other Collections

Twenty-seven items (elements and attributes) are in all NASA and all Other Collections:  See the All NASA and All Other filtered view to identify these elements.

Elements in all Other Collections and some NASA Collections

Nineteen items (elements and attributes) are present in all Other collections and in a smaller number of NASA collections. See the All Other and Some NASA filtered view to identify these items.

Ted please double check this filter.  The table below includes 52 items not 19

Table 2. Metadata Elements that are in all Other and in a smaller number of NASA collections

Elements in some NASA Collections and no Other Collections

One hundred and fifteen items (elements and attributes) are present in 0 Other collections and in a some number of NASA collections. See the No Other and Some NASA filtered view to identify these items.

Other Filters

• View just Elements
• View just Attributes