Multi-Server Multi-Function Distributed Computation
October 1, 2024
1:30 PM - 2:30 PM
Multi-Server Multi-Function Distributed Computation
Presenter: Derya Malak, Eurocom, France
Abstract: Large-scale distributed computing systems, such as MapReduce, Spark, or distributed deep networks, are critical for parallelizing the execution of computational tasks. Nevertheless, a struggle between computation and communication complexity lies at the heart of distributed computing. The work presented studies the communication cost for a multi-server, multi-task distributed computation framework, and does so for a broad class of functions and data statistics. Considering the framework where a user seeks the computation of multiple complex (conceivably non-linear) tasks from a set of distributed servers, we establish communication cost upper bounds for a variety of data statistics, function classes and data placements across the servers. To do so, we proceed to apply, for the first time here, Korner’s characteristic graph approach — which is known to capture the structural properties of data and functions — to the framework of multi-server multi-task distributed computing. Going beyond the general expressions, and in order to offer clearer insight, we also consider the well-known scenario of cyclic dataset placement and linearly separable functions over the binary field, in which case our approach exhibits considerable gains over the state of the art. Similar gains are identified for multi-linear functions.
This work is joint with Prof. Petros Elia, Dr. Berksan Şerbetci, and Reza Deylam Salehi in the Communication Systems Department at EURECOM.
Speaker bio: Derya Malak is an assistant professor (Maître de Conférence) in communication systems at Eurecom, France. Previously, she was a tenure track assistant professor in the Department of ECSE at RPI between 2019-2021, and a postdoctoral associate at MIT between 2017-2019. Malak received her PhD in ECE at the University of Texas, Austin, in 2017, her BS in electrical and electronics engineering with a minor in physics at Middle East Technical University, Ankara, Turkey, in 2010, and her MS in electrical and electronics engineering at Koc University, Istanbul, Turkey, in 2013. Malak has held visiting positions in INRIA and LINCS, Paris, and at Northeastern University in Boston, and summer internships at Huawei, Plano, Texas, and Bell Labs in Murray Hill, New Jersey. Malak's expertise is in information theory, communication theory, and networking areas. She was awarded the graduate school fellowship by University of Texas, Austin, between 2013-2017. Malak received the best paper awards in WiOpt 2022 and WiOpt 2023. She is the recipient of the ERC Starting Grant 2023-2028 on computing nonlinear functions over communication networks (SENSIBILITÉ).
Faculty Host: Daniela Tuninetti (danielat@uic.edu)
Date posted
Sep 27, 2024
Date updated
Oct 4, 2024