Related Github Repos and tickets
...
Code Block raise Exception('Could not determine a suitable burst offset')There must only be one track in your SLC inputs
correct facet SLC inputs incorrect facet SLC inputs
...
Job Inputs:
Bbox (*required)
min_latmax_latmin_lonmax_lon
...
Link: http://b-ci.grfn.hysds.io:8080/job/ops-bcluster_container-builder_aria-jpl_topsstack_master/
WARNING: If rebuilding on the same branch (master), make sure to remove docker image so that it reloads when restarting the job:
docker rmi <topsStack docker image id>
...
| Code Block |
|---|
{
"ipath": "ariamh::data/STACK",
"match_pattern": "/(?P<id>coregistered_slcs-(?P<year>\\d{4})(?P<month>\\d{2})(?P<day>\\d{2})(?P<time>\\d{6}).+)$",
"alt_match_pattern": null,
"extractor": null,
"level": "NA",
"type": "stack",
"publish": {
"s3-profile-name": "default",
"location": "s3://s3-us-west-2.amazonaws.com:80/##BUCKET##/datasets/{type}/{version}/{year}/{month}/{day}/{id}",
"urls": [
"http://##WEBDAV_URL##/datasets/{type}/{version}/{year}/{month}/{day}/{id}",
"s3://##S3_URL##:80/##BUCKET##/datasets/{type}/{version}/{year}/{month}/{day}/{id}"
]
},
"browse": {
"location": "davs://##WEBDAV_USER##@##WEBDAV USER##/browse/{type}/{version}/{year}/{month}/{day}/{id}",
"urls": [
"https://##WEBDAV##/browse/{type}/{version}/{year}/{month}/{day}/{id}"
],
}
} |
STILL TODO:
...
Publish the contents from merged/ into a datasets directory (testing)
...
Create dataset file name template (testing)
...
Running on ASG (Auto Scaling Group)
Currently using c5d.9xlarge
Not enough CPU
Takes 11.5 Hrs to run 30 scenes
May need to upgrade to c5d.18xlarge or i-instances
...
STILL TODO:
Integrate Sang-Ho/Jungkyo GNU parallel