Introduction
This is a guide to set up a S1-GCOV pipeline in preconfigured HySDS/ARIA system. This tool enables user to request for geo-coded covariance matrix products on-demand, using stacks resulted from TOPS Stack processor. At its core of is a PGE (https://github.com/aria-jpl/s1-gcov-plant) based on Polarimetric Interferometric Lab and Analysis Tool (PLAnT https://gitlab.com/plant/plant).
Note: B-cluster is used in discussion below. However, all steps described still apply if other cluster is used.
Build PGE
At first, a docker image of the PGE must be built and published through Jenkins. Here are the steps:
Login to B-cluster as
$ ssh -i key.pem ops@x.x.x.x
And configure Jenkins to pull from PGE source repo at Github
$ sds ci add_job -k -b master https://github.com/aria-jpl/s1-gcov-plant.git s3
Then login to http://b-ci.grfn.hysds.io:8080/login, find an entry page as
http://b-ci.grfn.hysds.io:8080/job/ops-bcluster_container-builder_aria-jpl_s1-gcov-plant_master/
On this page, click “Build Now“, a progressing bar will appear to indicate the status of build.
When it completes, click on “Console Output“ to make sure a tar ball do exist at AWS S3.
How to use
First, login to https://b-datasets.grfn.hysds.io/search/ and select a stack dataset, a page will show as:
...
On this page, click “On-Demand” button, a popup will a form will appear as follows, in which one needs to give a “Tag” for later tracking, select “S1-GCOV-PLANT Processor “ as “Action”, choose a “Queue” and a “Priority”:
...
Next, press Process Now button in the popup above and a job will be started in HYSDS pipeline.
Now login to https://b-jobs.grfn.hysds.io/figaro/ and search using the “Tag” provided earlier, a page like this will appear:
...
Shown on this page are job related pipeline information and its status. When the job completes, click on link “work directory“ on this page and a new page will appear as
...
On the page, folder “s1-gcov” contains S1-GCOV product.