Scientific Workflow Use Cases, version 1.1

Pierce, Marlon; Madduri, Ravi; Marru, Suresh

Permalink

https://hdl.handle.net/2142/104715 Copy

Description

Title

Scientific Workflow Use Cases, version 1.1

Author(s)

• Pierce, Marlon
• Madduri, Ravi
• Marru, Suresh

Contributor(s)

Liming, R. Lee

Issue Date

2019-08-21

Keyword(s)

• XSEDE
• use cases
• workflow
• high-performance computing
• high-throughput computing

Abstract

These use cases describe how researchers use workflow tools to automate complex research computing processes. There are at least two motivations for automation: first, to improve research productivity by freeing researchers from time-consuming tasks that can be automated; second, to make the research process reproducible, capturing and recording every step of the process so other researchers can inspect and validate the process behind the researcher’s conclusions. Research computing processes are extremely diverse. Consequently, there are a variety of workflow tools in use. The public research computing community enables workflow tools by providing APIs for basic computing services, such as: job submission and management, data movement, and resource configuration and status information. Using these APIs, a workflow tool can automate the execution of a research computing process. Another important community function is coordinating the execution environments across resources: making them as similar as possible so individual research jobs can be run on a wider variety of computing resources.

Series/Report Name or Number

Scientific Workflow Use Cases, v1.1

Type of Resource

text

Language

en

Permalink

http://hdl.handle.net/2142/104715

Sponsor(s)/Grant Number(s)

National Science Foundation, OCI-1053575

Owning Collections