Projekt

Zurück zur Übersicht

Fundamentals of Parallel Programming for Platform-as-a-Service Clouds

Gesuchsteller/in Binder Walter
Nummer 153560
Förderungsinstrument Projektförderung (Abt. I-III)
Forschungseinrichtung Facoltà di scienze informatiche Università della Svizzera italiana
Hochschule Università della Svizzera italiana - USI
Hauptdisziplin Informatik
Beginn/Ende 01.11.2014 - 31.10.2018
Bewilligter Betrag 451'785.00
Alle Daten anzeigen

Keywords (5)

Parallel Programming Models; Platform as a Service (PaaS); Service-Oriented Computing; Cloud Computing; Runtime Systems

Lay Summary (Deutsch)

Lead
In diesem Projekt erforschen wir neue Programmiermodelle für Platform-as-a-Service (PaaS) Clouds, die durch Task-Parallelismus und asynchrone Kommunikation gekennzeichnet sind. In dem resultierenden Programmiermodell wird der Entwickler die Möglichkeit haben, jede parallele Anwendung auf hohem Abstraktionsniveau zu spezifizieren, während das PaaS-System die Ausführung automatisch parallelisiert und optimiert, den Ressourcenverbrauch kontrolliert, sowie die Konsistenz der Daten sicherstellt.
Lay summary
Eine der wichtigsten Eigenschaften von Cloud Computing ist der Parallelismus aufgrund der virtualisierten Ausführungsumgebungen, der gleichzeitigen Client-Anfragen, sowie der asynchronen und verteilten Interaktionen innerhalb der Cloud und mit externen Systemen und Datenquellen. Bestehende PaaS Clouds bieten keine Unterstützung für allgemeine parallele Programmiermodelle und verursachen bedeutende architektonische Einschränkungen, wie Anwendungen den zugrundeliegenden Parallelismus nutzen können.

Um diese Einschränkungen zu überwinden, werden wir ein neues paralleles PaaS-Programmiermodell entwickeln, welches auf funktionaler und ereignis-basierter Programmierung aufsetzt, welche sich gut für die Entwicklung von Web-Anwendungen eignen. Wir werden relaxed Konsistenzmodelle erkunden, um Synchronisation zu reduzieren. Weiters werden wir spezielle Kommunikationsprimitiven für Streaming Berechnungen und deren Zusammensetzung erforschen. Auf der Ebene des Laufzeitsystems werden wir Mechanismen zur genauen Ressourcenkontrolle untersuchen, wobei wir plattformunabhängige Ressourcenverbrauchsmetriken verwenden werden.
Direktlink auf Lay Summary Letzte Aktualisierung: 19.05.2014

Lay Summary (Englisch)

Lead
In this project we explore novel programming models for Platform-as-a-Service (PaaS) clouds that are characterized by task parallelism as well as by asynchronous communication. In the resulting programming model, the developer will have the ability to run any parallel application using high-level abstractions, while the PaaS runtime system will automatically parallelize and optimize the execution, control resource consumption, and ensure data consistency.
Lay summary
One of the main characteristics of cloud computing is the pervasiveness of parallelism, which emerges from the underlying virtualized execution environment, from concurrent client requests, and from asynchronous and distributed interactions within the cloud and with external systems and data sources. Existing PaaS clouds lack support for general parallel programming models and impose significant architectural constraints on how the services can leverage the underlying parallelism. As a consequence, developers who want to run parallel applications in cloud platforms taking advantage of their elasticity and pay-as-you-go resource provisioning features must resort to Infrastructure-as-a-Service clouds, which provide them only with lower-level abstractions that make it more difficult to build complex applications.

To overcome these limitations, we will design a new parallel PaaS cloud programing model providing new computation, storage, and communication abstractions. Our investigation will focus on functional and event-based programming, which have become popular for developing Web applications. In this context, we will relax the assumption of share-nothing message-based coordination and explore different consistency models for mutable shared state. Our programming model will support relaxed consistency models to reduce the need for synchronization. It will also offer dedicated communication primitives for streaming computations and their composition into pipelines. At the level of the runtime system, we will investigate mechanisms for fine-grained resource accounting and control, focusing on platform-independent resource consumption metrics. We will also explore fundamental concurrency management mechanisms within the PaaS runtime system to enable scalable service execution in the presence of time-varying request workloads.
Direktlink auf Lay Summary Letzte Aktualisierung: 19.05.2014

Verantw. Gesuchsteller/in und weitere Gesuchstellende

Mitarbeitende

Publikationen

Publikation
AutoBench: Finding Workloads That You Need Using Pluggable Hybrid Analyses
(2016), AutoBench: Finding Workloads That You Need Using Pluggable Hybrid Analyses, in 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER).
Deploying Stateful Web Components on Multiple Devices with Liquid.js for Polymer
(2016), Deploying Stateful Web Components on Multiple Devices with Liquid.js for Polymer, in Proceedings of the 19th International ACM Sigsoft Symposium on Component-Based Software Engineering, Venice, Italy.
Efficient Embedding of Dynamic Languages in Big-data Analytics
(2016), Efficient Embedding of Dynamic Languages in Big-data Analytics, in ICDCS Workshops 2016.
GEMs: Shared-memory Parallel Programming for Node.js
(2016), GEMs: Shared-memory Parallel Programming for Node.js, in Proceedings of OOPSLA '16.
Generic Messages: Capability-based Shared Memory Parallelism for Event-loop Systems
(2016), Generic Messages: Capability-based Shared Memory Parallelism for Event-loop Systems, in Proceedings of the 21st ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming.
Lightweight Multi-language Bindings for Apache Spark
(2016), Lightweight Multi-language Bindings for Apache Spark, in 22nd International Conference on Parallel and Distributed Computing, Grenoble, France, August 24-26,.
Migrating and Pairing Recursive Stateful Components Between Multiple Devices with Liquid.js for Polymer
(2016), Migrating and Pairing Recursive Stateful Components Between Multiple Devices with Liquid.js for Polymer, in Proceedings of the 16th International Conference on Web Engineering (ICWE2016), Lugano, Switzerland.
On the Architecture of Liquid Software: Technology Alternatives and Design Space
(2016), On the Architecture of Liquid Software: Technology Alternatives and Design Space, in Proceedings of the 13th Working IEEE/IFIP Conference on Software Architecture (WICSA 2016), Venice, Italy.
The Liquid.js Framework for Migrating and Cloning Stateful Web Components across Multiple Devices
(2016), The Liquid.js Framework for Migrating and Cloning Stateful Web Components across Multiple Devices, in Proceedings of the 25th International World Wide Web conference, Montreal, Montreal, Canada.
Architecting Liquid Software
, Architecting Liquid Software, in Journal of Web Engineering.

Zusammenarbeit

Gruppe / Person Land
Formen der Zusammenarbeit
Nokia Finnland (Europa)
- vertiefter/weiterführender Austausch von Ansätzen, Methoden oder Resultaten
- Publikation
Liquid Software Group, Tampere University of Technology Finnland (Europa)
- vertiefter/weiterführender Austausch von Ansätzen, Methoden oder Resultaten
- Publikation
IaaS, University of Stuttgart Deutschland (Europa)
- vertiefter/weiterführender Austausch von Ansätzen, Methoden oder Resultaten
- Publikation
- Forschungsinfrastrukturen
- Austausch von Mitarbeitern
EMC/UC Berkeley Vereinigte Staaten von Amerika (Nordamerika)
- vertiefter/weiterführender Austausch von Ansätzen, Methoden oder Resultaten
- Publikation
Credit Suisse Schweiz (Europa)
- vertiefter/weiterführender Austausch von Ansätzen, Methoden oder Resultaten
- Publikation
IBM Zurich Research Lab Schweiz (Europa)
- vertiefter/weiterführender Austausch von Ansätzen, Methoden oder Resultaten
- Publikation
- Forschungsinfrastrukturen
- Austausch von Mitarbeitern
Oracle Labs Oesterreich (Europa)
- vertiefter/weiterführender Austausch von Ansätzen, Methoden oder Resultaten
- Publikation
- Forschungsinfrastrukturen
- Austausch von Mitarbeitern

Wissenschaftliche Veranstaltungen

Aktiver Beitrag

Titel Art des Beitrags Titel des Artikels oder Beitrages Datum Ort Beteiligte Personen
EuroPar 2016 Vortrag im Rahmen einer Tagung Lightweight Multi-language Bindings for Apache Spark 22.08.2016 Grenoble, Frankreich Salucci Luca; Binder Walter;
ICWE 2016 Vortrag im Rahmen einer Tagung Migrating and Pairing Recursive Stateful Components between Multiple Devices with Liquid.js for Polymer 06.06.2016 Lugano, Schweiz Gallidabino Andrea;
WWW 2016 Vortrag im Rahmen einer Tagung The Liquid.js Framework for Migrating and Cloning Stateful Web Components across Multiple Devices 11.04.2016 Montreal, Kanada Gallidabino Andrea; Pautasso Cesare;
WICSA 2016 Vortrag im Rahmen einer Tagung On the Architecture of Liquid Software: Technology Alternatives and Design Space 05.04.2016 Venice, Italien Gallidabino Andrea; Pautasso Cesare;
CBSE 2016 Vortrag im Rahmen einer Tagung Deploying Stateful Web Components on Multiple Devices with Liquid.js for Polymer 05.04.2016 Venice, Italien Gallidabino Andrea; Pautasso Cesare;
PPoPP 2016 Poster Generic Messages: Capability-based Shared Memory Parallelism for Event-loop Systems 12.03.2016 Barcelona, Spanien Binder Walter; Salucci Luca;
APSys 2015 Poster A big-data Analytics Framework with Efficient Support for Dynamic Languages 27.07.2015 Tokyo, Japan Binder Walter; Salucci Luca;
ICWE 2015 Poster Towards Liquid Web Applications 23.06.2015 Rotterdam, Niederlande Gallidabino Andrea; Pautasso Cesare;


Selber organisiert

Titel Datum Ort
VMM 2016 01.09.2016 Lugano, Schweiz
PPPJ 2016 29.08.2016 Lugano, Schweiz
JTRES 2016 29.08.2016 Lugano, Schweiz
ICWE 2016 06.06.2016 Lugano, Schweiz
Liquid Workshop 2016 06.06.2016 Lugano, Schweiz

Auszeichnungen

Titel Jahr
Best Demo Award for the demo "Migrating and Pairing Recursive Stateful Components between Multiple Devices with Liquid.js for Polymer" 2016

Verbundene Projekte

Nummer Titel Start Förderungsinstrument
133835 The Datacenter Observatory 01.10.2012 R'EQUIP
127386 SOSOA: Self-Organizing Service-Oriented Architectures 01.02.2010 Sinergia
141002 LoadOpt - Workload Characterization and Optimization for Multicore Systems 01.03.2013 Projektförderung (Abt. I-III)

Abstract

One of the main characteristics of cloud computing is the pervasiveness of parallelism, which naturally emerges 1) from the underlying virtualized execution environment, 2) from the concurrent client requests to services deployed in the cloud, and 3) from asynchronous and distributed interactions within the cloud and with external systems and data sources. Existing Platform-as-a-Service (PaaS) clouds provide developers with high-level abstractions, which can be used to build scalable and elastic Web services and Web applications, but lack support for general parallel programming models. For example, even though existing PaaS cloud programming models support the deployment of traditional, multi-tier Web applications, they impose significant architectural constraints on how the services can leverage the underlying parallelism. As a consequence, developers who want to run parallel applications in cloud platforms to take advantage of their elasticity and pay-as-you-go resource provisioning features must resort to Infrastructure-as-a-Service (IaaS) clouds, which provide them with lower-level abstractions (such as operating system threads and locks, or processes and message queues). Such low-level abstractions make it more difficult to build complex applications, which, for example, require support for large-scale data processing and may involve pipelined computations over infinite streams of data.To overcome the limitations of existing cloud programming models, in this project we address the following fundamental research questions: "How can we increase the abstraction level of the programming model for PaaS cloud development?", "Which programming models allow for running any parallel application in the cloud?", and "What are the guarantees the developer can be given in terms of performance, scalability, elasticity, reliability, and data consistency?". We consider these questions fundamental challenges for simplifying (and reducing the cost of) PaaS cloud development. Our goal is to explore novel programming models characterized by task parallelism as well as by asynchronous communication. In the resulting programming model, the developer will have the ability to run any parallel application using high-level abstractions (in contrast to OS-level abstractions), while the PaaS runtime system - which is also subject of our investigation - will automatically parallelize and optimize the execution, control resource consumption, and ensure data consistency.Concretely, in this project we will design a parallel programing model for PaaS cloud development providing new computation, storage, and communication abstractions. Our investigation will focus on functional and event-based programming, which have become popular for developing Web services and Web applications. In this context, we will relax the assumption of share-nothing message-based coordination and explore different consistency models for mutable shared state. Ensuring transactional properties (i.e., atomicity, consistency, and isolation) for all operations on shared state is expensive and would hinder scalability. Hence, our programming model will support relaxed consistency models to reduce the need for synchronization. Our programming model will also offer dedicated communication primitives for streaming computations and their composition into pipelines. At the level of the runtime system, we will investigate mechanisms for fine-grained resource accounting and control, focusing on platform-independent resource consumption metrics. We will also explore fundamental concurrency management mechanisms within the PaaS runtime system to enable scalable service execution in the presence of time-varying request workloads. Finally, we will develop a novel runtime system capable of automatically reconfiguring the application deployment for performance optimization. To this end, we will investigate auto-tuning mechanisms to achieve elastic scalability with respect to the number of concurrent clients, taking given service-level objectives (i.e., quality-of-service guarantees) into account. Our approach will be thoroughly evaluated both in terms of expressiveness of the new programming model and in terms of performance and scalability of the runtime system. For the latter evaluation, the platform developed in this project will be deployed on a heterogeneous cluster of modern multicore machines.
-