Grid Services (grid + services)

Distribution by Scientific Domains


Selected Abstracts


The ASCI Computational Grid: initial deployment

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 13-15 2002
Randal Rheinheimer
Abstract Grid Services, a Department of Energy Accelerated Strategic Computing Initiative program, has designed, implemented, and deployed a grid-based solution for customer access to large computing resources at DOE weapons labs and plants. Customers can access and monitor diverse, geographically distributed resources using the common Grid Services interfaces. This paper discusses the architecture, security, and user interfaces of the Grid Services infrastructure. Published in 2002 by John Wiley & Sons, Ltd. [source]


Grid services for earthquake science

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 6-7 2002
Geoffrey Fox
Abstract We describe an information system architecture for the ACES (Asia,Pacific Cooperation for Earthquake Simulation) community. It addresses several key features of the field,simulations at multiple scales that need to be coupled together; real-time and archival observational data, which needs to be analyzed for patterns and linked to the simulations; a variety of important algorithms including partial differential equation solvers, particle dynamics, signal processing and data analysis; a natural three-dimensional space (plus time) setting for both visualization and observations; the linkage of field to real-time events both as an aid to crisis management and to scientific discovery. We also address the need to support education and research for a field whose computational sophistication is rapidly increasing and spans a broad range. The information system assumes that all significant data is defined by an XML layer which could be virtual, but whose existence ensures that all data is object-based and can be accessed and searched in this form. The various capabilities needed by ACES are defined as grid services, which are conformant with emerging standards and implemented with different levels of fidelity and performance appropriate to the application. Grid Services can be composed in a hierarchical fashion to address complex problems. The real-time needs of the field are addressed by high-performance implementation of data transfer and simulation services. Further, the environment is linked to real-time collaboration to support interactions between scientists in geographically distant locations. Copyright © 2002 John Wiley & Sons, Ltd. [source]


Service selection and workflow mapping for Grids: an approach exploiting quality-of-service information

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 6 2009
Dimosthenis Kyriazis
Abstract The advent of heterogeneous and distributed environments, such as Grid environments, made feasible the solution to computational-intensive problems in a reliable and cost-effective manner. In parallel, workflows with increased complexity that require specialized systems to deal with them are emerging, so as to carry out more composite and mission-critical applications. In that rationale, quality-of-service (QoS) issues need to be tackled in order to ensure that each application satisfies the corresponding user requirements. Therefore, considering the quality provision aspect as fundamental for enabling Grid applications to become QoS compliant, we present an approach for service selection using QoS criteria. The latter is achieved with a suite of components that allow the different mappings of application workflow processes to Grid services that not only meet the user goals and requirements but also maximize his/her benefit in terms of the offered QoS level. We also demonstrate the operation of the aforementioned suite of components and evaluate its performance and effectiveness using a Grid scenario, based on a 3D image rendering application. Copyright © 2008 John Wiley & Sons, Ltd. [source]


Using Web 2.0 for scientific applications and scientific communities

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 5 2009
Marlon E. Pierce
Abstract Web 2.0 approaches are revolutionizing the Internet, blurring lines between developers and users and enabling collaboration and social networks that scale into the millions of users. As discussed in our previous work, the core technologies of Web 2.0 effectively define a comprehensive distributed computing environment that parallels many of the more complicated service-oriented systems such as Web service and Grid service architectures. In this paper we build upon this previous work to discuss the applications of Web 2.0 approaches to four different scenarios: client-side JavaScript libraries for building and composing Grid services; integrating server-side portlets with ,rich client' AJAX tools and Web services for analyzing Global Positioning System data; building and analyzing folksonomies of scientific user communities through social bookmarking; and applying microformats and GeoRSS to problems in scientific metadata description and delivery. Copyright © 2009 John Wiley & Sons, Ltd. [source]


MyCoG.NET: a multi-language CoG toolkit

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 14 2007
A. Paventhan
Abstract Grid application developers utilize Commodity Grid (CoG) toolkits to access Globus Grid services. Existing CoG toolkits are language-specific and have, for example, been developed for Java, Python and the Matlab scripting environment. In this paper we describe MyCoG.NET, a CoG toolkit supporting multi-language programmability under the Microsoft .NET framework. MyCoG.NET provides a set of classes and APIs to access Globus Grid services from languages supported by the .NET Common Language Runtime. We demonstrate its programmability using FORTRAN, C++, C# and Java, and discuss its performance over LAN and WAN infrastructures. We present a Grid application, in the field of experimental aerodynamics, as a case study to show how MyCoG.NET can be exploited. We demonstrate how scientists and engineers can create and use domain-specific workflow activity sets for rapid application development using Windows Workflow Foundation. We also show how users can easily extend and customize these activities. Copyright © 2006 John Wiley & Sons, Ltd. [source]


Science gateways made easy: the In-VIGO approach

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 6 2007
Andréa M. Matsunaga
Abstract Science gateways require the easy enabling of legacy scientific applications on computing Grids and the generation of user-friendly interfaces that hide the complexity of the Grid from the user. This paper presents the In-VIGO approach to the creation and management of science gateways. First, we discuss the virtualization of machines, networks and data to facilitate the dynamic creation of secure execution environments that meet application requirements. Then we discuss the virtualization of applications, i.e. the execution on shared resources of multiple isolated application instances with customized behavior, in the context of In-VIGO. A Virtual Application Service (VAS) architecture for automatically generating, customizing, deploying, and using virtual applications as Grid services is then described. Starting with a grammar-based description of the command-line syntax, the automated process generates the VAS description and the VAS implementation (code for application encapsulation and data binding) that is deployed and made available through a Web interface. A VAS can be customized on a per-user basis by restricting the capabilities of the original application or by adding to it features such as parameter sweeping. This is a scalable approach to the integration of scientific applications as services into Grids and can be applied to any tool with an arbitrarily complex command-line syntax. Copyright © 2006 John Wiley & Sons, Ltd. [source]


Developing LHCb Grid software: experiences and advances

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 2 2007
I. Stokes-Rees
Abstract The LHCb Grid software has been used for two Physics Data Challenges, with the latter producing over 98 TB of data and consuming over 650 processor-years of computing power. This paper discusses the experience of developing a Grid infrastructure, interfacing to an existing Grid (LCG) and traditional computing centres simultaneously, running LHCb experiment software and jobs on the Grid, and the integration of a number of new technologies into the Grid infrastructure. Our experience and utilization of the following core technologies will be discussed: OGSI, XML-RPC, Grid services, LCG middleware and instant messaging. Specific attention will be given to analysing the behaviour of over 100,000 jobs executed through the LCG Grid environment, providing insight into the performance, failure modes and scheduling efficiency over a period of several months for a large computational Grid incorporating over 40 sites and thousands of nodes. © Crown copyright 2006. Reproduced with the permission of Her Majesty's Stationery Office. Published by John Wiley & Sons, Ltd. [source]


Reputation-based semantic service discovery

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 8 2006
Ali Shaikh Ali
Abstract An important component of Semantic Grid services is the support for dynamic service discovery. Dynamic service discovery requires the provision of rich and flexible metadata that is not supported by current registry services such as UDDI. We present a framework to facilitate reputation-based service selection in Semantic Grids. Our framework has two key features that distinguish it from other work in this area. First, we propose a dynamic, adaptive, and highly fault-tolerant reputation-aware service discovery algorithm. Second, we present a service-oriented distributed reputation assessment algorithm. In this paper, we describe the main components of our framework and report on our experience of developing the prototype. Copyright © 2005 John Wiley & Sons, Ltd. [source]


An approach for quality of service adaptation in service-oriented Grids

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 5 2004
Rashid Al-Ali
Abstract Some applications utilizing Grid computing infrastructure require the simultaneous allocation of resources, such as compute servers, networks, memory, disk storage and other specialized resources. Collaborative working and visualization is one example of such applications. In this context, quality of service (QoS) is related to Grid services, and not just to the network connecting these services. With the emerging interest in service-oriented Grids, resources may be advertised and traded as services based on a service level agreement (SLA). Such a SLA must include both general and technical specifications, including pricing policy and properties of the resources required to execute the service, to ensure QoS requirements are satisfied. An approach for QoS adaptation is presented to enable the dynamic adjustment of behavior of an application based on changes in the pre-defined SLA. The approach is particularly useful if workload or network traffic changes in unpredictable ways during an active session. Copyright © 2004 John Wiley & Sons, Ltd. [source]


Studying protein folding on the Grid: experiences using CHARMM on NPACI resources under Legion

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 4 2004
Anand Natrajan
Abstract One benefit of a computational Grid is the ability to run high-performance applications over distributed resources simply and securely. We demonstrated this benefit with an experiment in which we studied the protein-folding process with the CHARMM molecular simulation package over a Grid managed by Legion, a Grid operating system. High-performance applications can take advantage of Grid resources if the Grid operating system provides both low-level functionality as well as high-level services. We describe the nature of services provided by Legion for high-performance applications. Our experiences indicate that human factors continue to play a crucial role in the configuration of Grid resources, underlying resources can be problematic, Grid services must tolerate underlying problems or inform the user, and high-level services must continue to evolve to meet user requirements. Our experiment not only helped a scientist perform an important study, but also showed the viability of an integrated approach such as Legion's for managing a Grid. Copyright © 2004 John Wiley & Sons, Ltd. [source]


A CORBA Commodity Grid Kit

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 13-15 2002
Manish Parashar
Abstract This paper reports on an ongoing research project aimed at designing and deploying a Common Object Resource Broker Architecture (CORBA) (ww.omg.org) Commodity Grid (CoG) Kit. The overall goal of this project is to enable the development of advanced Grid applications while adhering to state-of-the-art software engineering practices and reusing the existing Grid infrastructure. As part of this activity, we are investigating how CORBA can be used to support the development of Grid applications. In this paper, we outline the design of a CORBA CoG Kit that will provide a software development framework for building a CORBA ,Grid domain'. We also present our experiences in developing a prototype CORBA CoG Kit that supports the development and deployment of CORBA applications on the Grid by providing them access to the Grid services provided by the Globus Toolkit. Copyright © 2002 John Wiley & Sons, Ltd. [source]


pyGlobus: a Python interface to the Globus ToolkitÔ

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 13-15 2002
Keith R. Jackson
Developing high-performance, problem-solving environments/applications that allow scientists to easily harness the power of the emerging national-scale ,Grid' infrastructure is currently a difficult task. Although many of the necessary low-level services, e.g. security, resource discovery, remote access to computation/data resource, etc., are available, it can be a challenge to rapidly integrate them into a new application. To address this difficulty we have begun the development of a Python-based high-level interface to the Grid services provided by the Globus Toolkit. In this paper we will explain why rapid application development using Grid services is important, look briefly at a motivating example, and finally look at the design and implementation of the pyGlobus package. Copyright © 2002 John Wiley & Sons, Ltd. [source]


Grid services for earthquake science

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 6-7 2002
Geoffrey Fox
Abstract We describe an information system architecture for the ACES (Asia,Pacific Cooperation for Earthquake Simulation) community. It addresses several key features of the field,simulations at multiple scales that need to be coupled together; real-time and archival observational data, which needs to be analyzed for patterns and linked to the simulations; a variety of important algorithms including partial differential equation solvers, particle dynamics, signal processing and data analysis; a natural three-dimensional space (plus time) setting for both visualization and observations; the linkage of field to real-time events both as an aid to crisis management and to scientific discovery. We also address the need to support education and research for a field whose computational sophistication is rapidly increasing and spans a broad range. The information system assumes that all significant data is defined by an XML layer which could be virtual, but whose existence ensures that all data is object-based and can be accessed and searched in this form. The various capabilities needed by ACES are defined as grid services, which are conformant with emerging standards and implemented with different levels of fidelity and performance appropriate to the application. Grid Services can be composed in a hierarchical fashion to address complex problems. The real-time needs of the field are addressed by high-performance implementation of data transfer and simulation services. Further, the environment is linked to real-time collaboration to support interactions between scientists in geographically distant locations. Copyright © 2002 John Wiley & Sons, Ltd. [source]


Reliability in grid computing systems,

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 8 2009
Christopher Dabrowski
Abstract In recent years, grid technology has emerged as an important tool for solving compute-intensive problems within the scientific community and in industry. To further the development and adoption of this technology, researchers and practitioners from different disciplines have collaborated to produce standard specifications for implementing large-scale, interoperable grid systems. The focus of this activity has been the Open Grid Forum, but other standards development organizations have also produced specifications that are used in grid systems. To date, these specifications have provided the basis for a growing number of operational grid systems used in scientific and industrial applications. However, if the growth of grid technology is to continue, it will be important that grid systems also provide high reliability. In particular, it will be critical to ensure that grid systems are reliable as they continue to grow in scale, exhibit greater dynamism, and become more heterogeneous in composition. Ensuring grid system reliability in turn requires that the specifications used to build these systems fully support reliable grid services. This study surveys work on grid reliability that has been done in recent years and reviews progress made toward achieving these goals. The survey identifies important issues and problems that researchers are working to overcome in order to develop reliability methods for large-scale, heterogeneous, dynamic environments. The survey also illuminates reliability issues relating to standard specifications used in grid systems, identifying existing specifications that may need to be evolved and areas where new specifications are needed to better support the reliability. Published in 2009 by John Wiley & Sons, Ltd. [source]


Grid services for earthquake science

CONCURRENCY AND COMPUTATION: PRACTICE & EXPERIENCE, Issue 6-7 2002
Geoffrey Fox
Abstract We describe an information system architecture for the ACES (Asia,Pacific Cooperation for Earthquake Simulation) community. It addresses several key features of the field,simulations at multiple scales that need to be coupled together; real-time and archival observational data, which needs to be analyzed for patterns and linked to the simulations; a variety of important algorithms including partial differential equation solvers, particle dynamics, signal processing and data analysis; a natural three-dimensional space (plus time) setting for both visualization and observations; the linkage of field to real-time events both as an aid to crisis management and to scientific discovery. We also address the need to support education and research for a field whose computational sophistication is rapidly increasing and spans a broad range. The information system assumes that all significant data is defined by an XML layer which could be virtual, but whose existence ensures that all data is object-based and can be accessed and searched in this form. The various capabilities needed by ACES are defined as grid services, which are conformant with emerging standards and implemented with different levels of fidelity and performance appropriate to the application. Grid Services can be composed in a hierarchical fashion to address complex problems. The real-time needs of the field are addressed by high-performance implementation of data transfer and simulation services. Further, the environment is linked to real-time collaboration to support interactions between scientists in geographically distant locations. Copyright © 2002 John Wiley & Sons, Ltd. [source]


Economics-inspired decentralized control approach for adaptive grid services and applications

INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, Issue 12 2006
Lei Gao
Grid technologies facilitate innovative applications among dynamic virtual organizations, while the ability to deploy, manage, and properly remain functioning via traditional approaches has been exceeded by the complexity of the next generation of grid systems. An important method for addressing this challenge may require nature-inspired computing paradigms. This technique will entail construction of a bottom-up multiagent system; however, the appropriate implementation mechanism is under consideration in order for the autonomous and distributed agents to emerge as a controlled grid service or application. A credit card management service in economic interactions is considered in this article for a decentralized control approach. This consideration is based on a preliminarily developed ecological network-based grid middleware that has features desired for the next generation grid systems. The control scheme, design, and implementation of the credit card management service are presented in detail. The simulation results show that (1) agents are accountable for their activities such as behavior invocation, service provision, and resource utilization and (2) generated services or applications adapt well to dynamically changing environments such as agent amounts as well as partial failure of agents. The approach presented herein is beneficial for building autonomous and adaptive grid applications and services. © 2006 Wiley Periodicals, Inc. Int J Int Syst 21: 1269,1288, 2006. [source]