Files in this item



application/pdfHIghleveldesign ... rtheBasicFusionFiles-5.pdf (175kB)
Technical ReportPDF


Title:High-Level Design of a Data Carousel for the Basic Fusion Files
Author(s):Carrasco-Kind, Mattias; Daues, Gregory; Galelwsky, Benjamin; Jelenak, Aleksandar; Johnson, Margaret; Kolak, Ryan; Petravick, Donald; Readey, John
Subject(s):Earth Science
Amazon Web Services
Large Data
Abstract:Sometimes data is large enough that the resources needed to merely hold the data can severely strain budgets. When resource constraints are severe, and the alternative is not having access to the data at all, an alternative is to 1) use a cheaper storage solution and 2) mitigate any problems that arise from the use of this type of storage. 3) deal with the restrictions that are present in the solution. We present a white paper based on limited prototyping, reflecting our current thinking on the high-level design and operational model using the Data Carousel Access pattern, applied in the context of Amazon Web services, for the 2.4 PB Basic Fusion Dataset.
Issue Date:2020-05-28
Genre:Technical Report
Date Available in IDEALS:2020-05-28

This item appears in the following Collection(s)

Item Statistics