Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

<update pipeline diagram>

PGE's

...

to port to

...

Python3

  •  AOI Ops Report

...

ariamh

...

SLC sling

...

enumerator

...

SAR avail

...

SLCP-COR

...

SLCP-PM

...

COD

...

evaluator

...

localizer

  •  AOI Enumerator Submitter
  •  TopsApp
  •  GUNW Completeness Evaluator
  •  Blacklist Generation
  •  Greylist Generation
  •  AOI Based IPF Scraper
  •  AOI Based Acquisition Scraper
  •  Add Machine Tag
  •  Add User Tag
  •  Product Delivery
  •  Create AOI
  •  IPF ASF Scraper for Acq
  •  IPF SciHub Scraper for Acq
  •  Orbit Crawler
  •  Orbit Ingest
  •  LAR
  •  SLC sling
  •  Enumerator
  •  SAR avail
  •  SLCP-COR
  •  SLCP-PM
  •  COD
  •  Evaluator
  •  Localizer
  •  multi acquisition localizer

PGE I/O

PGE test list is incomplete. We are currently focusing on the main pipeline

...

  1. Create a python3 virtual environment.
     virtualenv  virtualenv env3 -p python3 to create the virtual environment

  2. Start the python3 virtual environment.
    source ~/env3/bin/activate to start a python 3 virtual environment

  3. Pull contents of repo on a new branch named python3

  4.  Run Run futurize over the contents of the repo.
    pip install future
    cd <repo>
    futurize -w -n -p .

    Output will show what has been changed.

  5. ssh into e mozart to add the python3 converted pge : sds using this command: 
    sds ci add_job -k -b develop https://github.com/aria-jpl/standard_product_report.git  s3

  6. Go to e jenkins Jenkins and click configure. Specify the branch as python3 branch and build. check Check the docker file and change FROM to the latest branch. wait Wait for build to complete successfully. may May take a few minutes. will Will publish job to e cluster automatically.

  7. Go to e cluster and run job. step into container if you need to debug stuff.

  8. Once job runs successfully, push changes to dev.

...