High-Level Design of a Data Carousel for the Basic Fusion Files
Author(s)
Carrasco-Kind, Mattias
Daues, Gregory
Galelwsky, Benjamin
Jelenak, Aleksandar
Johnson, Margaret
Kolak, Ryan
Petravick, Donald
Readey, John
Issue Date
2020-05-28
Keyword(s)
Earth Science
Amazon Web Services
Large Data
Abstract
Sometimes data is large enough that the resources needed to merely hold the data can severely strain budgets. When resource constraints are severe, and the alternative is not having access to the data at all, an alternative is to 1) use a cheaper storage solution and 2) mitigate any problems that arise from the use of this type of storage. 3) deal with the restrictions that are present in the solution. We present a white paper based on limited prototyping, reflecting our current thinking on the high-level design and operational model using the Data Carousel Access pattern, applied in the context of Amazon Web services, for the 2.4 PB Basic Fusion Dataset.
This is the default collection for all research and scholarship developed by faculty, staff, or students at the University of Illinois at Urbana-Champaign
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
