Page History

Element Description

The direct distribution information main element allows data providers to provide users information on getting direct access to data products that are stored in the Amazon Web Service (AWS) S3 buckets when they are initially looking at a collection. The end users get information such as the S3 credentials end point, a credential documentation URL, as well as bucket prefix names, and an AWS region.

Best Practices

There are multiple sub-elements that comprise Direct Distribution Information:

Region: Defines the possible values for the Amazon Web Service US Regions where the data product resides.  The current valid values are: us-east-1,us-east-2,us-west-1, and us-west-2.

S3BucketAndObjectPrefixNames: Defines the possible values for the Amazon Web Service US S3 bucket and/or object prefix names.

S3CredentialsAPIEndpoint: Defines the URL where the credentials are stored.

S3CredentialsAPIDocumentationURL: Defines the URL where the credential documentation are is stored.

Each of these elements describes the information that is necessary to pull out data products that are stored in the AWS cloud using a s3 S3 URL that is located inside each granule's  s (data product file's) metadata.

Examples:

FormatRegion: "us-east-1"

S3BucketAndObjectPrefixNames: "Bucket 1"

S3CredentialsAPIEndpoint: "https://some-data-product-credentials-api.com/api.html"

S3CredentialsAPIDocumentationURL: "https://some-data-product-credentials-api.com/docs.html"

Metadata Validation and QA/QC

All metadata entering the CMR goes through the below process to ensure metadata quality requirements are met. All records undergo CMR validation before entering the system. The process of QA/QC is slightly different for NASA and non-NASA data providers. Non-NASA providers include interagency and international data providers and are referred to as the International Directory Network (IDN).

Please see the expandable sections below for flowchart details.

Dialect Mappings

Fees

Metadata Validation and QA/QC

All metadata entering the CMR goes through the below process to ensure metadata quality requirements are met. All records undergo CMR validation before entering the system. The process of QA/QC is slightly different for NASA and non-NASA data providers. Non-NASA providers include interagency and international data providers and are referred to as the International Directory Network (IDN).

Please see the expandable sections below for flowchart details.

ARC Priority Matrix

This element is categorized as highest priority when:

• No data format is provided
• The data format provided is incorrect

This element is categorized as medium priority when:

• The data format provided is correct, but could be more specific 
  • E.g. Providing 'NetCDF' when the format should be 'NetCDF-4'
  • E.g. Providing 'ASCII' when the data format should be 'CSV'

This element is categorized as low priority when:

• The data format provided is correct, however, it does not exactly match its entry in the GCMD Granule Data Format vocabulary list. 
  • E.g. providing 'netcdf4' versus 'NetCDF-4'
  • E.g. providing 'geo-tiff' versus 'GeoTIFF'

ARC Automated Checks

• TBD

Dialect Mappings

<gmi:MI_Metadata>
  ...
 <gmd:distributionInfo>
                <gmd:MD_Distribution>
                    <gmd:distributor xlink:href="DirectDistributionInformation">
                        <gmd:MD_Distributor>
                            <gmd:distributorContact gco:nilReason="inapplicable"/>

<Distribution>
  <Distribution_Media>Online Archive></Distribution_Media>
  <Average_Granule_Size>231</Average_Granule_Size> **Note: In DIF 10.2 this would appear as: <Distribution_Size>231 MB per file</Distribution_Size>
  <Average_Granule_Size_Unit>MB</Average_Granule_Size_Unit>
  <Distribution_Format>HDF-EOS5</Distribution_Format>
  <Distribution_Format_Type>Native</Distribution_Format_Type>  **Note: The Distribution_Format_Type field is not available in DIF 10.2
  <Fees>Free</Fees>
</Distribution>

"ArchiveAndDistributionInformation": {
    "FileDistributionInformation": [
      {
        "FormatType": "Native",
        "AverageFileSize": 231,
        "Fees": "Free",
           "Format": "HDF-EOS",
<gmd:distributionOrderProcess>
           "AverageFileSizeUnit": "MB",
        "Media": [
          "Online Archive"
 <gmd:MD_StandardOrderProcess>
              ]
         }
    ]
  },

ECHO 10

Only 2 UMM-C Archive and Distribution Information sub-elements map to ECHO 10, Data Format and Fees, and neither element is required. 

N/A

N/A

<DataFormat>HDF-EOS5</DataFormat>
<Price>0.0</Price>

"ArchiveAndDistributionInformation": {
  "FileDistributionInformation": [
    {
      "FormatType": "Native",
      "Fees": "0.0",
      "Format": "HDF-EOS5"
    }
  ]
},

ISO 19115-2 MENDS

Archive and Distribution Information is an optional metadata element in ISO 19115-2 MENDS.

[=> /gmd:name/gco:CharacterString

[=> /gmd:specification/gco:CharacterString = FormatType: <FormatType>

[=> /gmd:transferOptions xlink:href="FileDistributionInformation_Media_<Block Number>"gmd:MD_DigitalTransferOptions/gmd:offLine/gmd:MD_Medium/gmd:name/gmd:MD_MediumNameCode codeList="https://cdn.earthdata.nasa.gov/iso/resources/Codelist/gmxCodelists.xml#MD_MediumNameCode" codeListValue="<value>" = <value>

<gmi:MI_Metadata>
  ...
    <gmd:distributionFormat xlink:href="FileDistributionInformation_<Block Number>"/>
        <gmd:MD_Format>
            <gmd:specification>
                <gco:CharacterString>TotalCollectionFileSizeBeginDate</gco:CharacterString>
              </gmd:code>
              <gmd:codeSpace>
                <gco:CharacterString>2018-04-01T00:00:00Z</gco:CharacterString>
              </gmd:codeSpace>
            <gmd:specification>
          <gmd:MD_Format>
      <gmd:distributionFormat xlink:href="FileDistributionInformation_<Block Number>"/>  
                

ArchiveandDistributionInformation: [ 
  { 
     AverageFileSize: "250", 
  },
  { 
     AverageFileSizeUnit: "KB", 
  },
  { 
     TotalCollectionFileSizeBeginDate: "2018-04-01T00:00:00Z", 
  } 
],
                

ISO 19115-2 SMAP

Archive and Distribution Information does not currently map to ISO 19115-2 SMAP.

N/A

N/A

UMM Migration

None

UMM Migration

None

History

UMM Versioning

History

UMM Versioning

ARC Documentation