Zur NavigationLogin

DE EN

G: Zentrale Plattform für die Simulation weicher Materie

Das zentrale Projekt G unterstützt als Dienstleistungsprojekt die wissenschaftlichen Projekte bei der Entwicklung von parallelen Software-Lösungen und behandelt wissenschaftliche Fragestellungen aus dem Bereich der angewandten Informatik. Herausforderungen beinhalten die Entwicklung von Lastbalancierungsverfahren für inhomogene MD-Simulationen, die Bereitstellung einer asynchronen Checkpointing-Umgebung sowie die Entwicklung von Steuerungsmechanismen für den Zugriff auf parallele Speichersysteme.


MERCURY: a Transparent Guided I/O Framework for High Performance I/O Stacks
Giuseppe Congiu, Matthias Grawinkel, Federico Padua, James Morse, Tim Süß and André Brinkmann
in 25th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP 2017), IEEE Press (2017);

The performance gap between processors and I/O represents a serious scalability limitation for applications running on computing clusters. Parallel file systems often provide mechanisms that allow programmers to disclose their I/O pattern knowledge to the lower layers of the I/O stack through a hints API. This information can be used by the file system to boost the application performance. Unfortunately, programmers rarely make use of these features, missing the opportunity to exploit the full potential of the storage system. In this paper we propose MERCURY, a transparent guided I/O framework able to optimize file I/O patterns in scientific applications, allowing users to control the I/O behavior of applications without modifications. This is done by exploiting the hints API provided by the back-end file system to guide data prefetching. MERCURY efficiently converts numerous small read requests into a few larger requests. Furthermore, it increases the I/O bandwidth, reduces the number of I/O requests, and ultimately the application running time. Moreover, we also propose a Linux kernel modification that allows network file systems, specifically Lustre, to work with our guided I/O framework through the posix_fadvise interface.

Deduplication Potential of HPC Applications' Checkpoints
Jürgen Kaiser, Ramy Gad, Tim Süß, Federico Padua, Lars Nagel and André Brinkmann
in IEEE Int. Conf. on Cluster Computing (Cluster'16), Seiten 413--422, IEEE Press (2016);

Analysis of the ECMWF Storage Landscape
Matthias Grawinkel, Lars Nagel, Markus Mäsker, Federico Padua, André Brinkmann, Lennart Sorth
in Proceedings of the 13th USENIX Conference on File and Storage Technologies {FAST} 2015, Santa Clara, CA, USA, Seiten 15 - 27, Usenix (2015);

Optimizing scientific file {I/O} patterns using advice based knowledge
Giuseppe Congiu, Matthias Grawinkel, Federico Padua, James Morse, Tim Süß, André Brinkmann
in Proceedings of the International Conference on Cluster Computing (CLUSTER), Madrid, Spain, IEEE (2014);

Kontakt

Diese Seite verwendet Cookies. Mit der Nutzung dieser Seite erklären Sie sich damit einverstanden, dass wir Cookies setzen.

Weitere Informationen