Versions Compared

Old Version 2

changes.mady.by.user Audy Barnett

Saved on

compared with

New Version 3

changes.mady.by.user Audy Barnett

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Date

Attendees

Discussion items

  • Review Past meeting Action Items

  • AWS Account Status & Testing
  • Documentation Process

Past Action items

  •   

New Action Items

  •   Audy Barnett to add ArcGIS  updates to the ticket board.
  •  Hyokyung Lee Test ASDC OPeNDAP URL with Geelambda
  •  Audy Barnett Create starter LUCID chart diagram for architecture and testing
  •  Audy Barnett Find final report for Bucket Brigade and post to SDT Wiki


Meeting Notes

AWS Account Status and Testing

  • ArcGIS Update
  • CloudFormation, API Gateway, S3, and Lambda so far.
    • Geelambda worked well with AWS lambda
    • Development can work on localstack and then push to AWS
    • Accessing S3 from Geelambda - fails on LS but works on AWS
    • Special driver that teh GDAL community allowed for accessing HDF5 on S3
      • Inside the GDAL library in Dec 2018.
    • Used python script in AWS
    • No EC2 - it was serverless - you can invoke through the Gateway API
    • Cloud Formation - Setting up the infrastructure - need Lambda, API gateway, how they should talk to each other, and events and how loads will be specified.
      • Serverless.yml in SDT Git Repo
    • Last piece tested - GeoLambda with OPeNDAP Driver
      • Made another DOCKER files 
      • GeeLambda can access OpenDAP Server
    • Tested with OPeNDAP test server
      • Next step to test with ASDC 
  • eventually set up OPeNDAP in AWS to modify the handler for OPeNDAP
    • Newer version can read from S3

Documentation:

  • Wiki page for S3 bucket name and EC2 instances to share tags and resource names.
  • Workflow diagram with options
  • How to organize our buckets to match those of Cumulus?
  • Monitoring  instances - Once instances are up and running we can schedule/monitor our instances