(WARNING: PGE is only compatible with python3, please make sure your docker container has it)
Github Repo and branch
Current Github repo: https://github.com/aria-jpl/ariamh
Current branch: s1-gunw-merged-aoi_track
...
To run the merged track stitcher you need to facet on S1-GUNW-MERGED-AOI_TRACK data products
(WARNING: The PGE is iterative so make sure you are faceting on a handful of products, not 1000+)
...
Files the PGE writes out
| Code Block |
|---|
# Files in dataset directory size date4729 Jun 5 14:28 S1-GUNW-MERGED_TN041_20180402T115755-20180414T120208-poeorb-3e9c.dataset.json file1879 Jun 5 14:28 S1-GUNW-MERGED_TN041_20180402T115755-20180414T120208-poeorb-3e9c.met.json 1495754 853Jun May 245 2014:1928 losfilt_topophase.rdrunw.geo.vrtbrowse.png 210444 Jun 4625 May 24 20:19 los.rdr.geo.xml 535 May 24 20:19 phsig.cor.geo.vrt 4211 May 24 20:19 phsig.cor.geo.xml5 14:28 filt_topophase.unw.geo.browse_small.png 480 Jun 5 14:32 merged/ # Files in merged/ directory 143286120 Jun 5 14:28 filt_topophase.unw.conncomp.geo 549548 Jun May 245 2014:1928 filt_topophase.unw.conncomp.geo.vrt 4387 4388Jun May 245 2014:1928 filt_topophase.unw.conncomp.geo.xml 1146288960 Jun 5 14:29 875 May 24 20:19filt_topophase.unw.geo 874 Jun 5 14:29 filt_topophase.unw.geo.vrt 4381 4380 Jun May 245 2014:1929 filt_topophase.unw.geo.xml 268910712 May 24 20:19 1421 Jun 5 14:29 inputs.json 1146288960 Jun 5 14:31 los.rdr.geo 852 Jun 5 14:31 los.rdr.geo 134455356 May 24 20:19 phsig.cor.geo 268910712 May 24 20:19 filt_topophase.unw.geo **MAIN OUTPUT FILE** 33613839 May 24 20:19 filt_topophase.unw.conncomp.geo 8013600 May 24 20:19 dummy.out |
TODO:
Write out the output files to create a dataset file
Create
_dataset.jsonon completion (Reference code)Create
dataset.met.jsonfile (Reference code)Integrate the naming convention in the dataset
S1-GUNW-MERGED_TN<track>_<master end time>-<slave start time>-poeorb-XXXXAlready integrated code to get the
slave start timeandmaster end time, given the array oflocalize_urlsWrite all output files to dataset ID directory
S1-GUNW-MERGED_TN<track>_<master end time>-<slave start time>-poeorb-XXXX
Expected Output (In Progress)
After the PGE completes and publishes the dataset to GRQ
...
.vrt
4624 Jun 5 14:31 los.rdr.geo.xml
573144480 Jun 5 14:32 phsig.cor.geo
534 Jun 5 14:32 phsig.cor.geo.vrt
4210 Jun 5 14:32 phsig.cor.geo.xml |
PNG file created
...
Publishing dataset
add entry into
./verdi/etc/datasets.json
| Code Block | ||
|---|---|---|
| ||
{
"ipath": "ariamh::data/S1-GUNW-MERGED",
"match_pattern": "/(?P<id>S1-GUNW-MERGED_.*?_TN.*?_.*?-(?P<year>\\d{4})(?P<month>\\d{2})(?P<day>\\d{2})(?P<rest>.+))$",
"alt_match_pattern": null,
"extractor": null,
"level": "l2",
"type": "interferogram",
"publish": {
"s3-profile-name": "default",
"location": "s3://s3-us-west-2.amazonaws.com:80/aria-ops-dataset-bucket/datasets/{type}/{version}/{year}/{month}/{day}/{id}",
"urls": [
"http://aria-ops-dataset-bucket.s3-website-us-west-2.amazonaws.com/datasets/{type}/{version}/{year}/{month}/{day}/{id}",
"s3://s3-us-west-2.amazonaws.com:80/aria-ops-dataset-bucket/datasets/{type}/{version}/{year}/{month}/{day}/{id}"
]
},
"browse": {
"location": "davs://pucops:puc_0ps@aria-dav.jpl.nasa.gov/browse/{type}/{version}/{year}/{month}/{day}/{id}",
"urls": [
"https://aria-dav.jpl.nasa.gov/browse/{type}/{version}/{year}/{month}/{day}/{id}"
]
}
} |