Change search
ReferencesLink to record
Permanent link

Direct link
Architectures, design methodologies, and service composition techniques for Grid job and resource management
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2009 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

The field of Grid computing has in recent years emerged and been established as an enabling technology for a range of computational eScience applications. The use of Grid technology allows researchers and industry experts to address problems too large to efficiently study using conventional computing technology, and enables new applications and collaboration models. Grid computing has today not only introduced new technologies, but also influenced new ways to utilize existing technologies.This work addresses technical aspects of the current methodology of Grid com- puting; to leverage highly functional, interconnected, and potentially under-utilized high-end systems to create virtual systems capable of processing problems too large to address using individual (supercomputing) systems. In particular, this thesis studies the job and resource management problem inherent to Grid environments, and aims to contribute to development of more mature job and resource management systems and software development processes. A number of aspects related to Grid job and resource management are here addressed, including software architectures for Grid job management, design methodologies for Grid software development, service composition (and refactorization) techniques for Service-Oriented Grid Architectures, Grid infrastructure and application integration issues, and middleware-independent and transparent techniques to leverage Grid resource capabilities.The software development model used in this work has been derived from the notion of an ecosystem of Grid components. In this model, a virtual ecosystem is defined by the set of available Grid infrastructure and application components, and ecosystem niches are defined by areas of component functionality. In the Grid ecosys- tem, applications are constructed through selection and composition of components, and individual components subject to evolution through meritocratic natural selection. Central to the idea of the Grid ecosystem is that mechanisms that promote traits beneficial to survival in the ecosystem, e.g., scalability, integrability, robustness, also influence Grid application and infrastructure adaptability and longevity. As Grid computing has evolved into a highly interdisciplinary field, current Grid applications are very diverse and utilize computational methodologies from a number of fields. Due to this, and the scale of the problems studied, Grid applications typically place great performance requirements on Grid infrastructures, making Grid infrastructure design and integration challenging tasks. In this work, a model of building on, and abstracting, Grid middlewares has been developed and is outlined in the papers. In addition to the contributions of this thesis, a number of software artefacts, e.g., the Grid Job Management Framework (GJMF), have resulted from this work.

Place, publisher, year, edition, pages
Umeå: Institutionen för datavetenskap, Umeå universitet , 2009. , 166 p.
Series
Report / UMINF, ISSN 0348-0542 ; 09.15
Identifiers
URN: urn:nbn:se:umu:diva-42448ISBN: 978-91-7264-861-6OAI: oai:DiVA.org:umu-42448DiVA: diva2:409262
Supervisors
Available from: 2011-04-11 Created: 2011-04-07 Last updated: 2012-01-13Bibliographically approved
List of papers
1. Designing general, composable, and middleware-independent Grid infrastructure tools for multi-tiered job management
Open this publication in new window or tab >>Designing general, composable, and middleware-independent Grid infrastructure tools for multi-tiered job management
Show others...
2007 (English)In: Towards Next Generation Grids / [ed] T. Priol and M. Vaneschi, Springer-Verlag , 2007, 175-184 p.Conference paper (Refereed)
Abstract [en]

We propose a multi-tiered architecture for middleware-independent Grid job management. The architecture consists of a number of services for well-defined tasks in the job management process, offering complete user-level isolation of servicecapabilities, multiple layers of abstraction, control, and fault tolerance. The middleware abstraction layer comprises components for targeted job submission, job control and resource discovery. The brokered job submission layer offers a Grid view on resources, including functionality for resource brokering and submission of jobs to selected resources. The reliable job submission layer includes components for fault tolerant execution of individual jobs and groups of independentjobs, respectively. The architecture is proposed as a composable set of tools rather than a monolithic solution, allowing users to select the individual components of interest. The prototype presented is implemented using the Globus Toolkit 4, integrated with the Globus Toolkit 4 and NorduGrid/ARC middlewares and based on existing and emerging Grid standards. A performance evaluation reveals that the overhead for resource discovery, brokering, middleware-specific format conversions, job monitoring, fault tolerance, and management of individual and groups of jobs is sufficiently small to motivate the use of the framework.

Place, publisher, year, edition, pages
Springer-Verlag, 2007
Keyword
Grid Job management infrastructure, standards-based architecture, fault-tolerance, middleware-independence, Grid ecosystem
Identifiers
urn:nbn:se:umu:diva-9305 (URN)978-0-387-72497-3 (ISBN)
Conference
CoreGRID Symposium 2007
Available from: 2008-05-05 Created: 2008-05-05 Last updated: 2012-02-06
2. Designing service-based resource management tools for a healthy grid ecosystem
Open this publication in new window or tab >>Designing service-based resource management tools for a healthy grid ecosystem
2008 (Swedish)In: Parallel processing and applied mathematics: 7th International Conference on Parallel Processing and Applied Mathematics, Springer-Verlag , 2008, 259-270 p.Conference paper (Refereed)
Abstract [en]

We present an approach for development of Grid resource management tools, where we put into practice internationally established high-level views of future Grid architectures. The approach addresses fundamental Grid challenges and strives towards a future vision of the Grid where capabilities are made available as independent and dynamically assembled utilities, enabling run-time changes in the structure, behavior, and location of software. The presentation is made in terms of design heuristics, design patterns, and quality attributes, and is centered around the key concepts of co-existence, composability, adoptability, adaptability, changeability, and interoperability. The practical realization of the approach is illustrated by five case studies (recently developed Grid tools) high-lighting the most distinct aspects of these key concepts for each tool. The approach contributes to a healthy Grid ecosystem that promotes a natural selection of “surviving” components through competition, innovation, evolution, and diversity. In conclusion, this environment facilitates the use and composition of components on a per-component basis.

Place, publisher, year, edition, pages
Springer-Verlag, 2008
Series
, Lecture Notes in Computer Science, ISSN 0302-9743 ; 4967
National Category
Computer Science
Research subject
Computing Science
Identifiers
urn:nbn:se:umu:diva-9614 (URN)10.1007/978-3-540-68111-3_28 (DOI)
Conference
7th International Conference on Parallel Processing and Applied Mathematics, 2008
Available from: 2008-05-05 Created: 2008-05-05 Last updated: 2011-04-11Bibliographically approved
3. Dynamic and transparent service compositions techniques for service-oriented grid architectures
Open this publication in new window or tab >>Dynamic and transparent service compositions techniques for service-oriented grid architectures
2008 (English)In: Integrated research in Grid computing / [ed] S. Gorlatch, P Fragopoulou and T. Priol, Crete University Press , 2008, 323-334 p.Chapter in book (Refereed)
Abstract [en]

With the introduction of the Service-Oriented Architecture design paradigm, service composition has become a central methodology for developing Grid software. We present an approach to Grid software development consisting of architectural design patterns for service de-composition and service re-composition. The patterns presented can each be used individually, but provide synergistic effects when combined as described in a unified framework. Software design patterns are employed to provide structure in design for service-based software development. Service APIs and immutable data wrappers are used to simplify service client development and isolate service clients from details of underlying service engine architectures. The use of local call structures greatly reduces inter-service communication overhead for co-located services, and service API factories are used to make local calls transparent to service client developers. Light-weight and dynamically replaceable plug-ins provide structure for decision support and integration points. A dynamic configuration scheme provides coordination of service efforts and synchronization of service interactions in a user-centric manner. When using local calls and dynamic configuration for creating networks of cooperating services, the need for generic service monitoring solutions becomes apparent and is addressed by service monitoring interfaces. We present these techniques along with their intended use in the context of software development for service-oriented Grid architectures.

Place, publisher, year, edition, pages
Crete University Press, 2008
Identifiers
urn:nbn:se:umu:diva-9613 (URN)
Available from: 2008-05-05 Created: 2008-05-05 Last updated: 2011-04-11Bibliographically approved
4. Empowering a flexible application portal with a SOA-based Grid job management framework
Open this publication in new window or tab >>Empowering a flexible application portal with a SOA-based Grid job management framework
Show others...
2009 (English)In: Applied Parallel Computing (PARA 08): State of art in scientific computing / [ed] A.C. Elster et al., Springer , 2009Conference paper (Refereed)
Place, publisher, year, edition, pages
Springer, 2009
Series
, Lecture notes in computer science, ISSN 0302-9743 ; 6127
National Category
Computer Science
Identifiers
urn:nbn:se:umu:diva-40381 (URN)
Conference
PARA 08
Available from: 2011-02-22 Created: 2011-02-22 Last updated: 2012-01-04Bibliographically approved
5. A composable service-oriented architecture for middleware-independent and interoperable grid job management
Open this publication in new window or tab >>A composable service-oriented architecture for middleware-independent and interoperable grid job management
2010 (English)Manuscript (preprint) (Other academic)
Abstract [en]

We propose a composable, loosely coupled Service-Oriented Architecture for middleware-independent Grid job management. The architecture is designed for use in federated Grid environments and aims to decouple Grid appli- cations from Grid middlewares and other infrastructure components. The notion of an ecosystem of Grid infrastructure components is extended, and Grid job management software design is discussed in this context. Non- intrusive integration models and abstraction of Grid middleware function- ality through hierarchical aggregation of autonomous Grid job management services are emphasized, and service composition techniques facilitating this process are explored. Earlier efforts in Service-Oriented Architecture design are extended upon, and implications of these are discussed throughout the paper. A proof-of-concept implementation of the proposed architecture is presented along with a technical evaluation of the performance of the proto- type, and a details of architecture implementation are discussed along with trade-offs introduced by the service composition techniques used.

Keyword
Grid job management, service composition, federated Grids, middleware-independence, Grid ecosystem
National Category
Computer Science
Identifiers
urn:nbn:se:umu:diva-40379 (URN)
External cooperation:
Available from: 2011-02-22 Created: 2011-02-22 Last updated: 2016-09-01Bibliographically approved

Open Access in DiVA

fulltext(364 kB)759 downloads
File information
File name FULLTEXT02.pdfFile size 364 kBChecksum SHA-512
d7c359c219d2bf34e950685a4d561d99e300297bab106d161ce53d9989ee9be7618d7985448d714b9ecaf9bdf3153d796b00458ae801b3230ed58a94d0ae944f
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Östberg, Per-Olov
By organisation
Department of Computing Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 759 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 104 hits
ReferencesLink to record
Permanent link

Direct link