You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 17
Next »
Background Docs
LANCE Flood mapping.png
Notes for meeting on 18 October 2017 |
Attendees | |
---|
Diane Davies Gang Ye Gregory Ederer Dan Slayback Fritz Pollicelli | - Update on Disaster Portal: Fritz saw Jessica Seepersand but she was too busy to talk. They have requested Dan’s code for the web map services. Dan needs to provide this.
- Update from Dan
- First module done. Waiting to hear back from MODAPS on how to deploy it. Impression that they are not familiar with using Python in a production environment. There was a suggestion that they use system python but Dan thinks that would be an issue. Greg said the issue is supporting external libraries and packages. SA in Building 32 do not want to deploy anything that is not part of the standard operating system but only as far as it comes from Red Hat or whoever the distributor is. So anyone that needs custom modules will require installation. Want users that want them to build and maintain them. But currently no there is no repository /deployment system. (There is an old fashioned system in place for Centos 5 but they are not porting it to Centos 7. So stuck in in between place!. It will be resolved. There will be facilities to do this (Navid and Kurt) but still have processes to sort out (Gate keeping / CM / documentation etc. Processes need to be transitioned from old PGE system). Greg thinks a couple of months until everyone is happy. But test environment should be sooner.
- Greg to talk to Navid to see what the plan is.
- Dan said it is better to wait for until this is resolved. – no rush to get in to production, as old system is working, so. Greg thinks the flood code might be the test case.
- Dan said that to be clear - Python Conda system doesn’t need root anything.
- Greg asked if Dan Dan has access to Git Lab? Navid can add him in. This is the configuration management system that will let Dan get familiar with the environment MODAPS will be deployed from. Put code in. track tickets etc. Should be used as a wedge to push Navid along. Greg to send Dan information.
- Dan: to do short names.
- Dan: can still work on compositing assuming python coding will be available.
- Diane mentioned the GIBS summit coming up on 2-3rd October. Asked Dan for a straw man of how we would like to see the data represented for the summit, to make suer this is in the work plan for the coming 12-18 months.
|
Next meeting | 16 October 2017 |
Actions | Fritz to follow up with Jessica on status of Disaster Portal Dan to provide code for the Disaster Portal web map service Gregory Ederer to send Dan information about Git Lab Gang Ye to get PGE number /name for Dan Dan to provide short names for data products |
Notes for Meeting on 28 August 2017 |
Attendees | |
---|
Dan Slayback Fritz Pollicelli Edward Masuoka
Karen Michael Diane Davies Gang Ye Gregory Ederer | Progress on Phase 1: Granule Module |
- Gang Ye to send Dan recommendations for logging code
- Edward Masuoka to check with SAs re: python version. He will get back to Dan if the latest (ver 3.5) is not acceptable.
- Fritz to follow up on other flood portals / viewers to get a sense of what will be done and the likely timeline
- Dan Slayback to suggest naming conventions for flood products
|
|
Attendees | Notes |
---|
Karen Michael Diane Davies Gang Ye Fritz Pollicelli Dan Slayback | - Dan: Tests show that the GDAL prototype is as efficient as ENVI / IDL
- Dan to finalize code to generate the granule level water detection data (intermediate file). Estimated time frame 1 month
- Next steps:
- Dan to finish code for the final daily products (2,3,14 day products). He may need input from Gregory Ederer/ others to make this code as efficient possible - approximately another month taking us to mid September.
- After that we need to consider final formats for end users
- Fritz sent Dan some feedback from end users. Diane to create short set of questions which will go to a broader audience.
|
Action items- @Dan Slayback to report back to Edward Masuoka that he won't need the additional ENVI license
- @Dan Slayback to finalize code to generate the granule level water detection data and deliver it to Gang Ye
- Gang Ye to send Dan sample ESDT file names
- Diane Davies to contact additional users, in collaboration with Fritz, to draft user requirements doc
|
|
Attendees | Item | Notes |
---|
Diane Davies Gang Ye Edward Masuoka @Frederick Pollicelli @Dan Slayback | Phase 1: Granule Module | - Flood product is currently run using IDL and ENVI and it uses 10 x 10 degree tiles (MOD09, MOD35 and MOD06) as input and generates MODIS Water Detection (MWD) and MODIS Cloud and Shadow (MCS) data files in same format.
- Dan will modify code to use granule data as input so the MWD and MCS can be processed as soon as the data are available
- Dan will assess whether the to use IDL / ENVI or GDAL / Geo Tools
- no licenses are required for the GDAL option but if it is going to take longer, Ed is willing to buy another ENVI license
- Dan to provide feedback the week of 10th July
- Dan will then deliver his code to Gang (by 17 July)
- Gang and LAADs team will take the code and wrap it in to PGEs for NRT processing
|
Phase 2: Mapping and Compositing module This module creates products on a global 250m grid | - Who: PI staff can prototype, but TBD who will build and operate this component (LANCE or PI staff). Schedule: Start after stage 1 complete.
Estimated completion: TBD |
Phase 3: Post processing module for distribution | - Generate final distribution format files (geotiff, shapefile, KMZ, graphics) from the master product and publish to web, ftp, GIBS (if possible), etc.
- Diane to review information Fritz collected from user survey and to develop additional questions (as appropriate) and contact users to develop end user requirements.
|
Next Meeting: | 17 July 2017 |
Action items
- @Dan Slayback: Test granule approach with ENVI / IDL
- @Dan Slayback: Prototype GDAL to see if it is as efficient as ENVI / IDL option & report back to Edward Masuoka, Gang Ye, Fritz, Gregory Ederer and Diane Davies the week of 10 July
- Edward Masuoka will purchase additional ENVI license if Dan thinks it will be more efficient to run code using ENVI
- @Dan Slayback to provide granule input code to Gang Ye / Gregory Ederer for PGE integration
- Diane Davies to meet with @Fritz Pollicelli next week to discuss end user requirements
- Diane Davies to contact additional users and draft user requirements doc