Data providers and other community stakeholders must currently invest operational and development resources producing search clients to serve a segment of the community. Earthdata Search portals reduce the overhead of providing a search interface similar to Earthdata Search to targeted users. It provides several useful features, including:
The remainder of this document will walk through the process of creating and configuring a portal.
We're here to help, and we want to understand community needs so we can refine our features. Email Valerie Dixon (valerie.dixon@nasa.gov) to get started with your portal and get in touch with developers.
Important: The workflow for configuring portals is geared toward teams who have familiarity with basic development tools such as git. If this is not the case for you, please reach out to us and let us know; we may be able to assist you with basic configuration.
Because portal configurations are powerful enough to modify Earthdata Search's functionality in arbitrary ways, we must handle portal configuration through our Github project (https://github.com/nasa/earthdata-search/). This allows us to understand incoming changes, test existing portals against new features, and prevent insecure or malicious code from entering our operational environment.
To provide us configuration most efficiently, you will need to fork our GitHub repository.
Clone the code from your fork and follow the README to get a local instance of Earthdata Search set up.
To create your portal you will need to create a new directory in "/portals" with a unique name you want as your portal identifier, for this example we will use "example". You then will create the config.json file ("/portals/example/config.json").
A significant amount of configuration can be done through this config.json file. You can view an example configuration at https://github.com/nasa/earthdata-search/blob/main/portals/default/config.json or browse https://github.com/nasa/earthdata-search/tree/main/portals to see all portal configurations. Here is an explanation of the configuration:
Key | Data Type | Explanation |
---|---|---|
features | Object | Feature configuration |
advancedSearch | Boolean | Enable/disable the advanced search feature |
authentication | Boolean | Enable/disable all features that rely on authentication (logging in/projects). NOTE: Setting to false will disable all features that rely on authentication. By default this is set to true so if you want authentication behind your portal enabled just do not include this key in your config.json |
featureFacets | Object | Feature Facet configuration |
showAvailableFromAwsCloud | Boolean | Show/hide the Available from AWS Cloud feature facet |
showCustomizable | Boolean | Show/hide the Customizable feature facet |
showMapImagery | Boolean | Show/hide the Map Imagery feature facet |
footer | Object | Footer configuration |
attributionText | String | Text to display in the footer, example "NASA Official: ..." |
displayVersion | Boolean | Display the current application version in the footer |
primaryLinks | Array | Array of links to display on the left side of the footer This array is made up of objects with two values: { |
secondaryLinks | Array | Array of links to display on the right side of the footer. This uses the same objects as `primaryLinks` |
moreInfoUrl | String (Optional) | This is the URL that users will be sent to when clicking on the logo image. If no value is provided clicking on the logo image will return the user to the EDSC portal home (/portal/example/search). |
pageTitle | String | This will appear after the default portal's `pageTitle` in the HTML page title (see in the tab of the browser). For example if EDSC is the default portal then the page title will be "Earthdata Search :: <pageTitle> | Earthdata Search" |
parentConfig | String | The parent config file for this portal. If your portal will be deployed to EOSDIS Earthdata Search this value should be "edsc". If not, set this to "default". |
portalBrowser | Boolean | Toggle to set whether the portal will appear as a listed portal in the portal browser modal |
query | Object (Optional) | These parameters are used to filter the list of collections exposed in the portal. Current supported values:
One common pattern is to show all the datasets in a dataCenter. This example shows the ORNL DAAC portal configuration: "query": { Likewise, for Science Project-focused portals, here is the AIRMOSS project portal: "query": { A more nuanced approach can be applied using tags in CMR. Here is an example from the Suborbital portal using the tagKey parameter (note that the tagKey can contain simple wildcards): "query": { If you need support of another CMR query parameter, please contact us. Refer to the CMR documentation for information on parameters: |
title | Object | Object containing the primary and secondary title for the portal. |
primary | String | The primary field in the title object will be displayed on the portal browser modal as the top identifier. It will also be displayed on the top left portal browser context sidebar header and on the leave portal button on the bottom of the collection search results while inside of a portal. |
secondary | String | The secondary field in the title object will be displayed below the primary on the portal browser modal and in parentheses on the top left portal browser context sidebar header. It is meant to be the fullname of the project, endeavor, organization behind the creation of the portal. |
ui | Object | UI configurations |
showNonEosdisCheckbox | Boolean | |
showOnlyGranulesCheckbox | Boolean | Show/hide the " |
showTophat | Boolean | Show/hide Tophat (Note: This field is used only for the defaultPortal in the deployed environment for EDSC, as such new portals cannot hide this UI field in the deployed env. It can however, be changed locally if you set the defaultPortal to the created portal in overrideStatic.config.json) |
`
Portals inherit configuration values from a parent configuration. See the "parentConfig" value above. This allows you to use all of a parent's config values and keep your portal configuration minimal if your portal needs most of the same features as the parent configuration.
To add a new logo image, which are displayed in the left toolbar to establish the search context or on the the portal browser modal (optionally. see portalBrowser boolean config field).
Save your image into the ./portals/myportal/images/ directory and name this file logo.png
In the /portals directories you will need to add the name of your portal to the portals list in the index.js file. The string you enter should be the same as the name of the directory for your portal. Portals should be added in alphabetical order.
portals [
'above',
...
'your-portal-example'
]
When you have made and tested your changes, push them to your forked copy of the Earthdata Search repository and issue a pull request into the main repository using the pull request template. Our developers will review and incorporate the changes as soon as possible.
Our normal progression to operations is as follows:
So the progression from a pull request being accepted to it becoming an operational change takes about a month, during which it is available in testing environments.
While we would prefer to stick to this schedule wherever possible, we understand you may have differing schedule needs. If you need it to reach operations sooner, please indicate the desired date on the pull request and we will do our best to accommodate.
5 Comments
Christopher Lynnes
(1) How does a curator tag the actual data collections?
(2) Can we write out the fork and pull request procedures as a step by step recipe that a scientist could understand?
user-c2913
As far as I understand, CMR has not opened up tagging to users because the permissions needed would allow users to tag any collection, not just their own collections. They would also be able to edit/delete tags from other collections as well.
I think that CMR does have stories to improve the permissions granularity, but that would need to be prioritized.
Christopher Lynnes
I'm not thinking of end users. I am thinking of DAAC support scientists, NASA applications scientists, etc. who are on the front lines of dataset curation for EOSDIS' various communities.
Lewis McGibbney
Patrick Quinn please add a table of contents so I can link to Subsections. Thank you.
Valerie Dixon
Should include here a policy of review and retirement for Portals that fall into disuse. For example, if usage metrics show a Portal falls below (TBD threshold of hits/year) we will reach out to the Portal's GITHub branch owner and notify them that due to disuse the Portal will be retired by (TBD time period - 3 months?). Then put a tkt in for next PI to close out the Portal. I'm sure there are sticking points and devilish details, but we don't want to become a forever repo for stale portals. And folks reading this guide should be made aware of that.