L3 Displacement Time Series Visualization Server Setup

Introduction:

This is a step-by-step guide to setup a displacement time series visualization server for a preconfigured HySDS/ARIA system. This tool enables the user to explore time-series products archived by the ARIA project by visualizing them using Leaflet Maps. It also enables the user to track explicit locations on the map by dropping markers, and graphing the data under that marker.

Setup:

Github Repo: displacement-ts-server-terraform

Requirements:

1. Install Terraform.

2. If you are using AWS, make sure you have your credentials setup up.

   1. To set them up, install the AWS CLI and run aws configure.

3. Complete setup of HySDS core with ARIA adaptation

   1. Include leaflet-ingester job

   2. Publish displacement-time-series datasets*

*If needed, follow S1-GUNW-MERGED Time Series to create datasets

Usage:

1. Log into Mozart and clone repo

   mkdir ~/tss_server
   cd ~/tss_server
   git clone https://github.com/aria-jpl/displacement-ts-server-terraform.git
   cd displacement-ts-server-terraform

2. Copy the variables.tf.tmpl to variables.tf:

   cp variables.tf.tmpl variables.tf

   1. Initialize so plugins are installed:

   terraform init

3. Update the values starting with two underscores, e.g. __region__, for your provider account and settings. Edit the variables.tf file with custom variables for this installation venue. Many of these values can be acquired from the aws console.

   vi variables.tf

4. Determine the project, venue and counter for your HySDS cluster. They will be used to uniquely name and identify your cluster's resources.

   • project e.g. swot, smap, aria, grfn, eos

   • venue e.g. ops, dev, test, gerald

   • counter e.g. 1, 2, 3

5. Validate your configuration:

   terraform validate --var project=aria --var venue=ops --var counter=1

6. Build your HySDS clustser:

   terraform apply --var project=aria --var venue=ops --var counter=1

7. Show status of your HySDS cluster:

   terraform show --var project=aria --var venue=ops --var counter=1

8. Destroy your HySDS cluster once it's no longer needed:

   terraform destroy --var project=aria --var venue=ops --var counter=1

How to:

1. Login into Tosca and select a displacement-time-series dataset.

   

2. Click on On-Demand and select Displacement Time Series Ingest [dev] from Action list.

   

3. Under hysds-io-ingest-ts:dev parameters set:

   1. thredds_data_dir to “/data/ts”

   2. leaflet_url to “https://<TS_PVT_IP>/ts/”.

      1. The TS_PVT_IP is in /home/ops/.sds/tss_config

         

4. Click Process Now and wait till job is completed in Mozart

5. Login back into Tosca and select the submitted displacement-time-series dataset. The Visualize button should now be available.

   

6. Click on Visualize and enjoy the displacement-time-series visualization!

FAQ:

1. What is update_tss.sh used for?

   1. This BASH script (in ~/mozart/ops/displacement-ts-server/update_tss) uses update_tss.py to:

      1. Define private EC2 IP address from .sds/tss_config for time series server host

      2. Send celeryconfig.py from mozart to leaflet server. This allows server to pick up jobs from ts_ingest queue.

      3. Sync the following repos between mozart and time-series server:

         1. container-builder

         2. displacement-ts-server

         3. hysds

         4. hysds_commons

         5. hysds-dockerfiles

         6. lightweight-jobs

         7. osaka prov_es

         8. sciflo

         9. spyddder-man

2. What is setup_tss.sh used for?

   1. This BASH script (found in the displacement-ts-server-terraform directory) is used to:

      1. Clone or update displacement-ts-server directroy in Mozart’s ~/mozart/ops directory.

      2. Update configs/certs/server.cnf and create self-signed SSL certs into displacement-ts-server directroy

      3. Update time-series leaflet server using update_tss.py and update_tss.sh