Digitala Vetenskapliga Arkivet

Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Metadata Management in Multi-Grids and Multi-Clouds
Umeå universitet, Teknisk-naturvetenskapliga fakulteten, Institutionen för datavetenskap.
2011 (Engelska)Licentiatavhandling, sammanläggning (Övrigt vetenskapligt)
Abstract [en]

Grid computing and cloud computing are two related paradigms used to access and use vast amounts of computational resources. The resources are often owned and managed by a third party, relieving the users from the costs and burdens of acquiring and managing a considerably large infrastructure themselves. Commonly, the resources are either contributed by different stakeholders participating in shared projects (grids), or owned and managed by a single entity and made available to its users with charging based on actual resource consumption (clouds). Individual grid or cloud sites can form collaborations with other sites, giving each site access to more resources that can be used to execute tasks submitted by users. There are several different models of collaborations between sites, each suitable for different scenarios and each posing additional requirements on the underlying technologies.

Metadata concerning the status and resource consumption of tasks are created during the execution of the task on the infrastructure. This metadata is used as the primary input in many core management processes, e.g., as a base for accounting and billing, as input when prioritizing and placing incoming task, and as a base for managing the amount of resources allocated to different tasks.

Focusing on management and utilization of metadata, this thesis contributes to a better understanding of the requirements and challenges imposed by different collaboration models in both grids and clouds. The underlying design criteria and resulting architectures of several software systems are presented in detail. Each system addresses different challenges imposed by cross-site grid and cloud architectures:

  • The LUTSfed approach provides a lean and optional mechanism for filtering and management of usage data between grid or cloud sites.

  • An accounting and billing system natively designed to support cross-site clouds demonstrates usage data management despite unknown placement and dynamic task resource allocation.

  • The FSGrid system enables fairshare job prioritization across different grid sites, mitigating the problems of heterogeneous scheduling software and local management policies.

The results and experiences from these systems are both theoretical and practical, as full scale implementations of each system has been developed and analyzed as a part of this work. Early theoretical work on structure-based service management forms a foundation for future work on structured-aware service placement in cross- site clouds. 

Ort, förlag, år, upplaga, sidor
Umeå: Umeå University, Department of Computing Science , 2011. , s. 120
Serie
Report / UMINF, ISSN 0348-0542 ; 11.08
Nyckelord [en]
grid computing, cloud computing, accounting, billing, metadata, monitoring, structure, fairshare, scheduling, federated
Nationell ämneskategori
Datavetenskap (datalogi)
Forskningsämne
datalogi
Identifikatorer
URN: urn:nbn:se:umu:diva-51159ISBN: 978-91-7459-281-8 (tryckt)OAI: oai:DiVA.org:umu-51159DiVA, id: diva2:476055
Presentation
2011-10-06, Naturvetarhuset, N320, Umeå universitet, Umeå, 13:00 (Engelska)
Opponent
Handledare
Tillgänglig från: 2012-01-25 Skapad: 2012-01-11 Senast uppdaterad: 2021-03-18Bibliografiskt granskad
Delarbeten
1. Distributed usage logging for federated grids
Öppna denna publikation i ny flik eller fönster >>Distributed usage logging for federated grids
2010 (Engelska)Ingår i: Future generations computer systems, ISSN 0167-739X, E-ISSN 1872-7115, Vol. 26, nr 8, s. 1215-1225Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

We present a non-intrusive solution to the increasingly important problem of shared logging for overlapping and federated Grid environments. The solution addresses three usage scenarios of hierarchical Grids, mutual cross-Grid resource utilization, and federated Cloud computing infrastructures. The approach is evaluated by extending the existing SweGrid Accounting System (SGAS) with a light-weight component that makes the system applicable to a wide range of usage scenarios. The proposed architecture is characterized by its simplicity, flexibility, and generality, and the new key component by its non-intrusiveness, flexibility, and ability to manage high load. We present requirements derived from three usage scenarios, and also include an in-depth description of the architecture and design, as well as the implementation and performance evaluation of a new component written for use with SGAS. We conclude from a performance evaluation that the sharing of usage data is not likely to be a limiting performance factor even in large-scale Grid scenarios.

Ort, förlag, år, upplaga, sidor
Elsevier, 2010
Nyckelord
Accounting; Shared logging; Grid computing; SGAS; Federated Grids; Federated Clouds
Nationell ämneskategori
Datavetenskap (datalogi)
Forskningsämne
administrativ databehandling
Identifikatorer
urn:nbn:se:umu:diva-29915 (URN)10.1016/j.future.2010.02.001 (DOI)000281508700016 ()2-s2.0-77955518773 (Scopus ID)
Anmärkning

Daniel Henriksson Se även Daniel Espling

Tillgänglig från: 2009-11-27 Skapad: 2009-11-27 Senast uppdaterad: 2023-03-23Bibliografiskt granskad
2. Accounting and Billing for Federated Cloud Infrastructures
Öppna denna publikation i ny flik eller fönster >>Accounting and Billing for Federated Cloud Infrastructures
2009 (Engelska)Ingår i: Proceedings of the Eighth International Conference on Grid and Cooperative Computing (GCC 2009) / [ed] Juan. E. Guerrero, IEEE Computer Society Press , 2009, s. 268-275Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

Emerging Cloud computing infrastructures provide computing resources on demand based on postpaid principles. For example, the RESERVOIR project develops an infrastructure capable of delivering elastic capacity that can automatically be increased or decreased in order to cost-efficiently fulfill established Service Level Agreements. This infrastructure also makes it possible for a data center to extend its total capacity by subcontracting additional resources from collaborating data centers, making the infrastructure a federation of Clouds. For accounting and billing, such infrastructures call for novel approaches to perform accounting for capacity that varies over time and for services (or more precisely virtual machines) that migrate between physical machines or even between data centers. For billing, needs arise for new approaches to simultaneously manage postpaid and prepaid payment schemes for capacity that varies over time in response to user needs. In this paper, we outline usage scenarios and a set of requirements for such infrastructures, and propose an accounting and billing architecture to be used within RESERVOIR. Even though the primary focus for this architecture is accounting and billing between resource consumers and infrastructure provides, future support for inter-site billing is also taken into account.

Ort, förlag, år, upplaga, sidor
IEEE Computer Society Press, 2009
Nyckelord
accounting, billing, cloud computing, grid computing, SGAS, RESERVOIR
Nationell ämneskategori
Datavetenskap (datalogi)
Forskningsämne
administrativ databehandling
Identifikatorer
urn:nbn:se:umu:diva-29904 (URN)10.1109/GCC.2009.37 (DOI)2-s2.0-72349094320 (Scopus ID)
Konferens
Eighth International Conference on Grid and Cooperative Computing (GCC 2009), 27-29 August, Lanzhou, China
Anmärkning

Daniel Henriksson Se även Daniel Esping

Tillgänglig från: 2009-11-26 Skapad: 2009-11-26 Senast uppdaterad: 2023-03-23Bibliografiskt granskad
3. Scheduling and Monitoring of Internally Structured Services in Cloud Federations
Öppna denna publikation i ny flik eller fönster >>Scheduling and Monitoring of Internally Structured Services in Cloud Federations
2011 (Engelska)Ingår i: 2011 IEEE Symposium on Computers and Communications (ISCC), IEEE, 2011, s. 173-178Konferensbidrag, Publicerat paper (Refereegranskat)
Abstract [en]

Cloud infrastructure providers may form Cloud federations to cope with peaks in resource demand and to make large-scale service management simpler for service providers. To realize Cloud federations, a number of technical and managerial difficulties need to be solved. We present ongoing work addressing three related key management topics, namely, specification, scheduling, and monitoring of services. Service providers need to be able to influence how their resources are placed in Cloud federations, as federations may cross national borders or include companies in direct competition with the service provider. Based on related work in the RESERVOIR project, we propose a way to define service structure and placement restrictions using hierarchical directed acyclic graphs. We define a model for scheduling in Cloud federations that abides by the specified placement constraints and minimizes the risk of violating Service-Level Agreements. We present a heuristic that helps the model determine which virtual machines (VMs) are suitable candidates for migration. To aid the scheduler, and to provide unified data to service providers, we also propose a monitoring data distribution architecture that introduces cross-site compatibility by means of semantic metadata annotations.

Ort, förlag, år, upplaga, sidor
IEEE, 2011
Serie
IEEE Symposium on Computers & Communications (ISCC), ISSN 1530-1346
Nyckelord
cloud computing, scheduling, monitoring, service structure
Nationell ämneskategori
Datavetenskap (datalogi)
Forskningsämne
administrativ databehandling
Identifikatorer
urn:nbn:se:umu:diva-40268 (URN)10.1109/ISCC.2011.5984012 (DOI)000298614900034 ()2-s2.0-80052742050 (Scopus ID)978-1-4577-0678-3 (ISBN)978-1-4577-0680-6 (ISBN)
Konferens
16th IEEE Symposium on Computers and Communications (lSCC)and First International Workshop on Management of Cloud Systems (MoCS 2011), Corfu, Greece, June 28-July 1, 2011
Tillgänglig från: 2011-02-21 Skapad: 2011-02-21 Senast uppdaterad: 2023-03-24Bibliografiskt granskad
4. Decentralized scalable fairshare scheduling
Öppna denna publikation i ny flik eller fönster >>Decentralized scalable fairshare scheduling
2013 (Engelska)Ingår i: Future generations computer systems, ISSN 0167-739X, E-ISSN 1872-7115, Vol. 29, nr 1, s. 130-143Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

This work addresses Grid fairshare allocation policy enforcement and presents Aequus, a decentralized system for Grid-wide fairshare job prioritization. The main idea of fairshare scheduling is to prioritize users with regard to predefined resource allocation quotas. The presented system builds on three contributions: a flexible tree-based policy model that allows delegation of policy definition, a job prioritization algorithm based on local enforcement of distributed fairshare policies, and a decentralized architecture for non-intrusive integration with existing scheduling systems. The system supports organization of users in virtual organizations and divides usage policies into local and global policy components that are defined by resource owners and virtual organizations. The architecture realization is presented in detail along with an evaluation of the system behavior in an emulated environment. In the evaluation, convergence noise types (mechanisms counteracting policy allocation convergence) are characterized and quantified, and the system is demonstrated to meet scheduling objectives and perform scalably under realistic operating conditions.

Ort, förlag, år, upplaga, sidor
Elsevier, 2013
Nyckelord
Grid scheduling, Fairshare scheduling, Grid allocation policy enforcement
Nationell ämneskategori
Datavetenskap (datalogi)
Identifikatorer
urn:nbn:se:umu:diva-40492 (URN)10.1016/j.future.2012.06.001 (DOI)000311771700010 ()2-s2.0-84863713318 (Scopus ID)
Tillgänglig från: 2011-02-24 Skapad: 2011-02-24 Senast uppdaterad: 2023-03-24Bibliografiskt granskad

Open Access i DiVA

Metadata Management in Multi-Grids and Multi-Clouds(965 kB)1106 nedladdningar
Filinformation
Filnamn FULLTEXT02.pdfFilstorlek 965 kBChecksumma SHA-512
2ab7d83378b17d784a47f92b0ffe0943aab639a052bca815281339981cf7d913aa429b849f29e97ae457bdc15ebdd4aaf0c04e960bc722b34d8513e840f84992
Typ fulltextMimetyp application/pdf

Sök vidare i DiVA

Av författaren/redaktören
Espling, Daniel
Av organisationen
Institutionen för datavetenskap
Datavetenskap (datalogi)

Sök vidare utanför DiVA

GoogleGoogle Scholar
Totalt: 1106 nedladdningar
Antalet nedladdningar är summan av nedladdningar för alla fulltexter. Det kan inkludera t.ex tidigare versioner som nu inte längre är tillgängliga.

isbn
urn-nbn

Altmetricpoäng

isbn
urn-nbn
Totalt: 779 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf