The Metadata team met with ESDIS and S&D Leads on to discuss this matter. The decision was made to decomission the MLHub and JAXA Python Ingest Script AWS Lambdas. We created a SDRT to explore a solution that supports bulk ingest for trusted partners in MMT React.
SDRT-1531 - Getting issue details... STATUS
CMRSCI-4621 - Getting issue details... STATUS
PI-23.1: WSJF-4
SDRT-1367 - Getting issue details... STATUS
ECSE-1229 - Getting issue details... STATUS
PI-23.1: CMR Non-NASA Collection ingest Documentation
https://git.earthdata.nasa.gov/projects/GCMD/repos/sciops_scripts/browse/aws_lambda
PI 23.2: Team Roadmap Objective
SDRT-1421 - Getting issue details... STATUS
CMRSCI-4304 - Getting issue details... STATUS
PI-24.2: Follow on Tickets
CMRSCI-4483 - Getting issue details... STATUS
CMRSCI-4587 - Getting issue details... STATUS
CMRSCI-4438 - Getting issue details... STATUS
CMRSCI-4605 - Getting issue details... STATUS
PI-24.2: Status
- MLHub to CMR Ingest Script kickoffs off from AWS on the first day of each month and synchronizes metadata records (58 collections currently)
- JAXA to CMR Ingest Script kickoffs off from AWS on the first day of each month and synchronizes metadata records
- S. Ritz spot checks the metadata for quality and content
Relevant Documentation:
Application Publication on the Earthdata Cloud
| Action | Date | Status | Assignee | Notes |
|---|---|---|---|---|
| Reconfigure the lambda to use a token not affiliated with a specific person | ||||
| Update the server-less YAML file to handle all the ingest instances | CMRSCI-4605 - Getting issue details... STATUS | |||
| Set up Test Coverage for each ingest script instance in Bamboo (MLHub, JAXA) | ||||
| SIT/UAT (Pre-Production) | ||||
| Document Operational Security Agreement (OSA) Advisory Information | ||||
| Create Cost Model | ||||
| Account Creation Request | ||||
| Cost Phasing Plan | ||||
| Account Access Request | ||||
Additional Prototyping | ||||
| Configure Automated Deployments | ||||
| Request Vulnerability Scanning | ||||
| Integrations | ||||
| Earthdata Login Integration (EDL) | ||||
| Launchpad Integration | ||||
| Cloud Metrics Integration | ||||
| Create an AART Entry (UAT) | ||||
| Preparing for Production | ||||
| Create an Operational Security Agreement (OSA) | ||||
| Revise Cost Model | ||||
| Production Account Creation Request | ||||
| Revise Cost Phasing Plan | ||||
| Production Account Access Request | ||||
| Configure Automated Deployments | ||||
| Enable Vulnerability Scanning for Production | ||||
| Update Integrations | ||||
| EDL Integration | ||||
| Launchpad Integration | ||||
| Cloud Metrics Integration | ||||
| Configure Egress Throttle Alerts | ||||
| Create an AART Entry | ||||
| ESDIS Review Gate | ||||
| Go Live! | ||||
NOT STARTED IN PROGRESS ISSUE DONE