{"type":"doc","content":[{"type":"paragraph","content":[{"text":"The On-Demand Request API is a higher-level abstract for end-users of how to make a request that may constitute a set of associated jobs. An on-demand request may be for example, “process all S1-GUNW, over this AOI, from start time to end time, using nearest 2-neighbors, with skip 365 days”. So all related jobs for the aoi-tracks over the AOI spatial extent and temporal extent will be associated with this one request. Requests are also associated with a user to enable tracking and data management clean up.","type":"text"}]},{"type":"paragraph","content":[{"text":"See ","type":"text"},{"type":"inlineCard","attrs":{"__confluenceMetadata":{"isRenamedTitle":true,"linkType":"page","contentTitle":"Standard Product S1-GUNW Processing Pipeline","versionAtSave":"3"},"url":"https://aria.atlassian.net/wiki/spaces/ARIA/pages/753667"}},{"text":" for more details on the processing pipeline.","type":"text"}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"program_pi_id tag","type":"text"}]},{"type":"paragraph","content":[{"text":"Each request will contain a program_pi_id tag to help associate the user and program that is making the request. Can be added as machine tag to the internal jobs.","type":"text"}]},{"type":"paragraph","content":[{"text":"Tag schema: ","type":"text"},{"text":"--_","type":"text","marks":[{"type":"strong"}]}]},{"type":"paragraph","content":[{"text":"For HEC processing platform, the <","type":"text"},{"text":"allocation_id","type":"text","marks":[{"type":"strong"}]},{"text":"> is Pleiades’s GroupID for billing.","type":"text"}]},{"type":"paragraph","content":[{"text":"For AWS processing platform, the <","type":"text"},{"text":"allocation_id","type":"text","marks":[{"type":"strong"}]},{"text":"> is project for billing.","type":"text"}]},{"type":"paragraph","content":[{"text":"Examples:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"ESI2017-owen-HEC_s2037","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"ESI2017-fielding-HEC_sxxxx","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"ESI2017-peltzer-HEC_sxxxx","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"ESDS2016-GRFN-AWS_grfn","type":"text"}]}]}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"S1-GUNW Requests","type":"text"}]},{"type":"table","attrs":{"layout":"default"},"content":[{"type":"tableRow","content":[{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Endpoint","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Function","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Input","type":"text","marks":[{"type":"strong"}]}]}]},{"type":"tableHeader","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Output/Result","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"POST /request_s1gunw/estimate","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Create Request Estimate","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Estimates the total expected products to be generated for this request.","type":"text"}]}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"geojson polygon of area","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"enumeration list [","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"{","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"nearest_m_neighbors","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"orbit_direction","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"reference_start time","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"reference_end time","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"skip_n","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"track_number","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"}","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"]","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"group_id","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"program_pi_id","type":"text"}]}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"publishes ","type":"text"},{"text":"dataset=request to GRQ","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldF90eXBlLnJhdyI6InJlcXVlc3QifX1dfX0sInNvcnQiOlt7Il90aW1lc3RhbXAiOnsib3JkZXIiOiJkZXNjIn19XSwiZmllbGRzIjpbIl90aW1lc3RhbXAiLCJfc291cmNlIl19"}}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"returns: json of request_id","type":"text"}]}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"GET /request_s1gunw/","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"List Requests","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"queries all requests by user","type":"text"}]}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"none","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"returns: json list of request_id","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"requests GUI to make AJAX call for only the requests in viewport. ","type":"text"}]}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"GET /request_s1gunw/{request_id}","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Get Request","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Gets detailed info on request.","type":"text"}]}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"request_id","type":"text"}]}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"returns: json of request","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"status: created | estimated | submitted","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"for each enumerator estimate (acqlist)","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"grq count acqlist","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"mozart count topsapp running ","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"mozart count topsapp completed","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"mozart count topsapp queued","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"mozart count topsapp failed","type":"text"}]}]}]}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"POST /request_s1gunw/","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Submit Request","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Given a request id, starts the bulk processing.","type":"text"}]}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"request_id","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"additional layers (dict of layers)","type":"text"}]}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"starts bulk processing in SDS","type":"text"}]}]}]}]}]},{"type":"tableRow","content":[{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"DEL /request_s1gunw/{request_id}","type":"text"}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"paragraph","content":[{"text":"Remove Request","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Removes the request from the system state.","type":"text"}]}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"request id","type":"text"}]}]}]}]},{"type":"tableCell","attrs":{"colspan":1,"rowspan":1},"content":[{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"status of removal","type":"text"}]}]}]}]}]}]},{"type":"heading","attrs":{"level":1},"content":[{"text":"User Profile Management","type":"text"}]},{"type":"paragraph","content":[{"text":"Leverage NASA ESDIS URS","type":"text"}]},{"type":"paragraph","content":[{"text":"Leverage existing application for aria-products","type":"text"}]},{"type":"paragraph"},{"type":"heading","attrs":{"level":1},"content":[{"text":"Implementation Notes","type":"text"}]},{"type":"paragraph","content":[{"text":"The state of requests are stored as datasets in GRQ cluster. The My Request set of API calls effectively interact with Mozart API calls to trigger processing and summarize results into requests.","type":"text"}]},{"type":"paragraph","content":[{"text":"The on-demand Request API will be generating a new dataset on ","type":"text"},{"text":"GRQ","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/"}}]},{"text":":","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"type=request","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"dataset=request-s1gunw","type":"text","marks":[{"type":"link","attrs":{"href":"https://mamba-grq.aria.hysds.io/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJyZXF1ZXN0LXMxZ3VudyJ9fV19fSwic29ydCI6W3siX3RpbWVzdGFtcCI6eyJvcmRlciI6ImRlc2MifX1dLCJmaWVsZHMiOlsiX3RpbWVzdGFtcCIsIl9zb3VyY2UiXX0="}}]}]}]}]},{"type":"paragraph","content":[{"text":"Request dataset schema naming convention","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"request-s1gunw-----","type":"text","marks":[{"type":"strong"}]}]}]}]},{"type":"paragraph","content":[{"text":"The request dataset is internal use and not visible to users.","type":"text"}]},{"type":"paragraph","content":[{"text":"See ","type":"text"},{"text":"Mozart API (swagger openapi) endpoint for mamba cluster","type":"text","marks":[{"type":"link","attrs":{"href":"https://mamba-mozart.aria.hysds.io/mozart/api/v0.1/doc/"}}]}]},{"type":"paragraph","content":[{"text":"see: ","type":"text"},{"text":"https://hysds-core.atlassian.net/wiki/spaces/HYS/pages/450101273/Mozart+REST-like+Interface","type":"text","marks":[{"type":"link","attrs":{"href":"https://hysds-core.atlassian.net/wiki/spaces/HYS/pages/450101273/Mozart+REST-like+Interface"}}]}]},{"type":"paragraph","content":[{"text":"Follow ","type":"text"},{"text":"PGE versions from the S1-GUNW pipeline reference sheet","type":"text","marks":[{"type":"link","attrs":{"href":"https://docs.google.com/spreadsheets/d/10bJ8IBOjcMxClexgZnRxlEtRg-y4mdPmopaXvA21oD4/edit#gid=983633465"}}]},{"text":".","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Create Request Estimate","type":"text"}]},{"type":"paragraph","content":[{"text":"A request estimate is the result of running the enumerator on acquisitions, orbits, along a temporal and spatial extent constraint to generatge ","type":"text"},{"text":"S1-GUNW-acq-list","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XLWFjcS1saXN0In19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ=="}}]},{"text":" datasets. For each enumeration list item in the input, submit an on-demand enumerator_submitter, (which calls the acquistion_enumerator to generate ","type":"text"},{"text":"S1-GUNW-acq-list","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XLWFjcS1saXN0In19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ=="}}]},{"text":").","type":"text"}]},{"type":"paragraph","content":[{"text":"Calls via Mozart API the on-demand variant of enumerator_submitter job, passing in geojson, start time, end time, etc.","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The on-demand variant of enumerator_submitter job then looks up GRQ to find all POEORBs and submits an on-demand variant of the acquistion_enumerator job--one for each POEORB","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Each enumerator job checks for completeness of all IPFs in aoi-track.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Associate that entire request with a Request ID tag to mozart.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"when done, publishes new request dataset containing:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"geojson","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"start time","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"end time","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"user who made request","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"program_pi_id","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"request_id","type":"text"}]}]}]}]}]},{"type":"paragraph","content":[{"text":"The the state of the enumeration run and set of ","type":"text"},{"text":"S1-GUNW-acq-list","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XLWFjcS1saXN0In19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ=="}}]},{"text":" datasets are associated with a request dataset. ","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Submit Request","type":"text"}]},{"type":"paragraph","content":[{"text":"On-demand submits Localizer jobs to take the ","type":"text"},{"text":"S1-GUNW-acq-list","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XLWFjcS1saXN0In19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ=="}}]},{"text":" datasets and moves them forward to produciton.","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Call Mozart API to submit on-demand Localizer jobs for all ","type":"text"},{"text":"S1-GUNW-acq-list","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XLWFjcS1saXN0In19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ=="}}]},{"text":" datasets","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Selects all ","type":"text"},{"text":"S1-GUNW-acq-list","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XLWFjcS1saXN0In19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ=="}}]},{"text":" for request id and on-demand submits to all slc_locaizer jobs.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Elasticsearch to GRQ would be of template:","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph"},{"type":"codeBlock","content":[{"text":"{\n \"bool\": {\n \"must\": [\n {\n \"term\": {\n \"dataset.raw\": \"S1-GUNW-acq-list\"\n }\n },\n {\n \"term\": {\n \"metadata.tags.raw\": \"request_id-ABCXYZ\"\n }\n }\n ]\n }\n}","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"It is analogous to an operator doing the following via on-demand grq:","type":"text"}]}]},{"type":"listItem","content":[{"type":"mediaSingle","attrs":{"layout":"center"},"content":[{"type":"media","attrs":{"width":1011,"id":"b9ceffe1-656c-42da-80e3-9aaed1c860b4","collection":"contentId-320667653","type":"file","height":526}}]},{"type":"paragraph"}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"This then flows the ","type":"text"},{"text":"S1-GUNW-acq-list","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XLWFjcS1saXN0In19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ=="}}]},{"text":", to slc localizer, to evaluator to ","type":"text"},{"text":"S1-GUNW-ifg-cfg","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XLWlmZy1jZmcifX1dfX0sInNvcnQiOlt7Il90aW1lc3RhbXAiOnsib3JkZXIiOiJkZXNjIn19XSwiZmllbGRzIjpbIl90aW1lc3RhbXAiLCJfc291cmNlIl19"}}]},{"text":", ","type":"text"},{"text":"job-standard_product-s1gunw-topsapp-singularity:standard-product_singularity","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.33.56/figaro/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsicmVzb3VyY2UiOiJqb2IifX0seyJ0ZXJtIjp7InR5cGUiOiJqb2Itc3RhbmRhcmRfcHJvZHVjdC1zMWd1bnctdG9wc2FwcC1zaW5ndWxhcml0eTpzdGFuZGFyZC1wcm9kdWN0X3Npbmd1bGFyaXR5In19XX19LCJzaXplIjoyNSwic29ydCI6W3siQHRpbWVzdGFtcCI6eyJvcmRlciI6ImRlc2MifX1dLCJmaWVsZHMiOlsiQHRpbWVzdGFtcCJdLCJwYXJ0aWFsX2ZpZWxkcyI6eyJfc291cmNlIjp7ImV4Y2x1ZGUiOlsiam9iLmpvYl9pbmZvLm1ldHJpY3MiLCJjb250ZXh0LmNvbnRleHQiLCJjb250ZXh0LmxvY2FsaXplX3VybHMiLCJqb2IuY29udGV4dC5jb250ZXh0Iiwiam9iLmNvbnRleHQuam9iX3NwZWNpZmljYXRpb24ucGFyYW1zIiwiam9iLmNvbnRleHQubG9jYWxpemVfdXJscyIsImpvYi5sb2NhbGl6ZV91cmxzIiwiam9iLnBhcmFtcyJdfX19"}}]},{"text":" on pleiades.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"For the AOI region, create a “megarule-like” trigger rule for all S1-GUNW-ifgcfg in that AOI to run to target that user’s HEC Group ID as specified in topsapp-singularity-plieades_ queue.","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Submits to HySDS queue (not Pleiades queue) that is associated with known HEC Pleiades Group ID for billing.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"auto-scaling script on pleiades needs to map HySDS queue name (which contains GroupID suffix) onto qsub with the associated Group ID to PBS for billing allocations.","type":"text"}]}]}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"List Requests","type":"text"}]},{"type":"paragraph","content":[{"text":"GRQ query for all ","type":"text"},{"text":"dataset=request-s1gunw","type":"text","marks":[{"type":"link","attrs":{"href":"https://mamba-grq.aria.hysds.io/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJyZXF1ZXN0LXMxZ3VudyJ9fV19fSwic29ydCI6W3siX3RpbWVzdGFtcCI6eyJvcmRlciI6ImRlc2MifX1dLCJmaWVsZHMiOlsiX3RpbWVzdGFtcCIsIl9zb3VyY2UiXX0="}}]},{"text":" for given user.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Get Request","type":"text"}]},{"type":"paragraph","content":[{"text":"Gets the request information split between estimate and processing stages. For a given request_id, return two top-level dicts:","type":"text"}]},{"type":"codeBlock","content":[{"text":"request {\n geojson,\n start time,\n end time,\n user, # who made request\n program_pi_id,\n estimate {\n acqlist count,\n enumerators status dict\n }\n processing {\n s1gunw count,\n topsapp status dict\n }\n}","type":"text"}]},{"type":"paragraph"},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GRQ query for ","type":"text"},{"text":"dataset=request-s1gunw","type":"text","marks":[{"type":"link","attrs":{"href":"https://mamba-grq.aria.hysds.io/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJyZXF1ZXN0LXMxZ3VudyJ9fV19fSwic29ydCI6W3siX3RpbWVzdGFtcCI6eyJvcmRlciI6ImRlc2MifX1dLCJmaWVsZHMiOlsiX3RpbWVzdGFtcCIsIl9zb3VyY2UiXX0="}}]},{"text":" of a given request_id.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"use request_id, in Mozart, look up estimate enumerator job status.","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Elasticsearch query on grq/tosca would look like this:","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph"},{"type":"codeBlock","content":[{"text":"{\n \"bool\": {\n \"must\": [\n {\n \"term\": {\n \"resource\": \"job\"\n }\n },\n {\n \"term\": {\n \"type\": \"job-standard_product-s1gunw-acq_enumerator:aria414\"\n }\n },\n {\n \"term\": {\n \"tags.untouched\": \"request_id-ABCXYZ\"\n }\n },\n {\n \"query_string\": {\n \"query\": \"enumerator\",\n \"default_operator\": \"OR\"\n }\n }\n ]\n }\n}","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"acq_enumerator status dict","type":"text","marks":[{"type":"strong"}]},{"text":" such as { job-completed: 24206, job-queued: 5276, job-revoked: 4075, job-failed: 2651, job-started: 196, job-offline: 104 }","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"use request_id, in Mozart, look up total number of ","type":"text"},{"text":"job-standard_product-s1gunw-topsapp-singularity:standard-product_singularity","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.33.56/figaro/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsicmVzb3VyY2UiOiJqb2IifX0seyJ0ZXJtIjp7InR5cGUiOiJqb2Itc3RhbmRhcmRfcHJvZHVjdC1zMWd1bnctdG9wc2FwcC1zaW5ndWxhcml0eTpzdGFuZGFyZC1wcm9kdWN0X3Npbmd1bGFyaXR5In19XX19LCJzaXplIjoyNSwic29ydCI6W3siQHRpbWVzdGFtcCI6eyJvcmRlciI6ImRlc2MifX1dLCJmaWVsZHMiOlsiQHRpbWVzdGFtcCJdLCJwYXJ0aWFsX2ZpZWxkcyI6eyJfc291cmNlIjp7ImV4Y2x1ZGUiOlsiam9iLmpvYl9pbmZvLm1ldHJpY3MiLCJjb250ZXh0LmNvbnRleHQiLCJjb250ZXh0LmxvY2FsaXplX3VybHMiLCJqb2IuY29udGV4dC5jb250ZXh0Iiwiam9iLmNvbnRleHQuam9iX3NwZWNpZmljYXRpb24ucGFyYW1zIiwiam9iLmNvbnRleHQubG9jYWxpemVfdXJscyIsImpvYi5sb2NhbGl6ZV91cmxzIiwiam9iLnBhcmFtcyJdfX19"}}]},{"text":" jobs (queued, running, failed, completed)","type":"text"}]},{"type":"orderedList","attrs":{"order":1},"content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Elasticsearch query on mozart/figaro would look like this:","type":"text"}]},{"type":"codeBlock","content":[{"text":"{\n \"bool\": {\n \"must\": [\n {\n \"term\": {\n \"resource\": \"job\"\n }\n },\n {\n \"term\": {\n \"tags.untouched\": \"request_id-ABCXYZ\"\n }\n },\n {\n \"term\": {\n \"type\": \"job-standard_product-s1gunw-topsapp-singularity:develop_singularity\"\n }\n }\n ]\n }\n}","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"topsapp status dict","type":"text","marks":[{"type":"strong"}]},{"text":" such as { job-completed: 24206, job-queued: 5276, job-revoked: 4075, job-failed: 2651, job-started: 196, job-offline: 104 }","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"use request_id, in GRQ, look up total number of ","type":"text"},{"text":"S1-GUNW-acq-list","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XLWFjcS1saXN0In19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ=="}}]},{"text":", which is the estimated number of products to be processed for this request.","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"use request_id, in GRQ, look up total number of ","type":"text"},{"text":"S1-GUNW","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XIn19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ=="}}]},{"text":" which is the number of products generated for this request.","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Remove Request","type":"text"}]},{"type":"paragraph","content":[{"text":"Removes all context associated with that request. The following is removed in this one transactional API call:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"In GRQ:","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"the ","type":"text"},{"text":"request dataset","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldF90eXBlLnJhdyI6InJlcXVlc3QifX1dfX0sInNvcnQiOlt7Il90aW1lc3RhbXAiOnsib3JkZXIiOiJkZXNjIn19XSwiZmllbGRzIjpbIl90aW1lc3RhbXAiLCJfc291cmNlIl19"}}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"all associated ","type":"text"},{"text":"S1-GUNW-acq-list","type":"text","marks":[{"type":"link","attrs":{"href":"https://100.67.35.28/search/?base64=eyJxdWVyeSI6eyJib29sIjp7Im11c3QiOlt7InRlcm0iOnsiZGF0YXNldC5yYXciOiJTMS1HVU5XLWFjcS1saXN0In19XX19LCJzb3J0IjpbeyJfdGltZXN0YW1wIjp7Im9yZGVyIjoiZGVzYyJ9fV0sImZpZWxkcyI6WyJfdGltZXN0YW1wIiwiX3NvdXJjZSJdfQ=="}}]},{"text":" ","type":"text"}]}]}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"in Mozart","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"all jobs associated with request id","type":"text"}]}]}]}]}]},{"type":"paragraph","content":[{"text":"This helps to maintain consistency.","type":"text"}]},{"type":"paragraph"}],"version":1}

Browser not supported