A Dynamic, Multi-Protocol Data Storage Integration Framework for Multi-Tenanted Science Gateway Middleware
Event Type
Workshop
Online Only
Productivity Tools
State of the Practice
W
TimeFriday, 19 November 202111am - 11:30am CST
LocationOnline
DescriptionScience gateways are user-centered, end-to-end cyberinfrastructure for managing scientific data and executions of computational software on distributed high-performance computing and cloud resources. An important challenge for science gateways is to manage data at scale, where scaling pressures come from both the number of users of successful gateways and the size of data used in scientific workflows that the gateways execute. This paper examines the use of managed file transfer (MFT) approaches to generalize several data flow scenarios. We examine a particular implementation, Airavata MFT, which can be used to extend the data stores integrated with a science gateway beyond local storage to include multiple remote storage instances, including cloud vendors. Integration with these diverse storage types is done through a common application programming interface for data operations, making the integration of a new storage system a configuration change without requiring changes to portal server code.
Author/Presenters
