Hight Throughput Data-Intensive Computing in the Era of Ever Larger Supercomputers

by Prof. Miron Livny (UW-Madison)

Friday 20 Apr 2018, 12:00 → 14:00 Europe/Madrid

IFAE Seminar Room

Recognizing the unique characteristics of throughput driven applications, we introduced over two decades ago the concept of High Throughput Computing (HTC). Working closely with a broad range of domain scientists we developed widely adopted frameworks and tools that provide effective distributed HTC services. Our tools have been mainly deployed on computing infrastructures that were not designed to support High Performance Computing (HPC) applications. We have recently experienced a desire to support HTC applications on machines that were designed and deployed to support tightly coupled very large scale HPC applications. We will review the reasons that have been driving this recent change and provide an overview of our current and future work to facilitate this growing desire to run HTC workloads on supercomputers. BIO: Miron Livny received a B.Sc. degree in Physics and Mathematics in 1975 from the Hebrew University and M.Sc. and Ph.D. degrees in Computer Science from the Weizmann Institute of Science in 1978 and 1984, respectively. Since 1983, he has been on the Computer Sciences Department faculty at the University of Wisconsin-Madison, where he is currently the John P. Morgridge Professor of Computer Science, the director of the Center for High Throughput Computing (CHTC), is leading the HTCondor project and serves as the principal investigator and technical director of the U.S. Open Science Grid (OSG). He is a member of the scientific leadership team of the Morgridge Institute of Research where he is leading the Software Assurance Market Place (SWAMP) project and is serving as the Chief Technology Officer of the Wisconsin Institutes of Discovery. Prof. Livny's research focuses on distributed processing and data management systems and involves close collaboration with researchers from a wide spectrum of disciplines. He pioneered the area of High Throughput Computing (HTC) and developed frameworks and software tools that have been widely adopted by academic and commercial organizations around the world. Videoconference: https://vidyoportal.cern.ch/join/52Pd4CwEYD

Recorded video https://vidyoreplay.cern.ch/replay/showRecordingExternal.html?key=PcwyNsradycD4UF

Slides 04_18_PIC.pptx.pdf