WLADDIMIRO Daniel
Supervision : Pierre SENS
Co-supervision : Luciana Arantes
Dynamic Adaptation in Stream Processing System
Stream processing systems (SPS) dynamically process input events over a set of operators. As the input is generally not a constant stream, work in the literature proposes to dynamically replicate SPS operators, in order to reduce processing bottlenecks induced by fluctuations.
Here, we present two approaches for dynamically modifying the number of replicas of an operator. A first reactive approach relies on several metrics. A second approach using a predictive model analyzes input rate variation, operator execution time and queued events to dynamically define the number of replicas required for each operator. We also propose a Storm-based implementation of these two approaches, which does not require reconfiguration on restart when the number of operator replicas changes.
Defence : 01/08/2024
Jury members :
Fabrice HUET, Professeur des universités, Univ. Nice Sophia Antipolis, CNRS, I3S, UMR 7271 [Rapporteur]
Cédric TEDESCHI, Professeur des universités, Université Rennes 1, IRISA [Rapporteur]
Nicolás HIDALGO, Maîtres de conférences, Universidad Diego Portales
Sébastien MONNET, Professeur, Université Savoie Mont Blanc
Luciana A RANTES, Maîtres de conférences, Sorbonne Université, LIP6
Pierre SENS, Professeur, Sorbonne Université, LIP6
2021-2024 Publications
-
2024
- D. Wladdimiro : “Dynamic Adaptation in Stream Processing System”, thesis, phd defence 01/08/2024, supervision Sens, Pierre, co-supervision : Luciana, Arantes (2024)
- D. Wladdimiro, L. Arantes, P. Sens, N. Hidalgo : “PA-SPS: A predictive adaptive approach for an elastic stream processing system”, Journal of Parallel and Distributed Computing, vol. 192, pp. 104940, (Elsevier) (2024)
-
2023
- D. Wladdimiro, L. Arantes, N. Hidalgo, P. Sens : “PRESPS: a PREdictive model to determine the number of replicas of the operators in Stream Processing Systems”, Compas 2023 - Conférence francophone d'informatique en Parallélisme, Architecture et Système, Annecy, France (2023)
-
2022
- D. Wladdimiro, L. Arantes, P. Sens, N. Hidalgo : “A predictive approach for dynamic replication of operators in distributed stream processing systems”, SBAC-PAD 2022 - IEEE 34th International Symposium on Computer Architecture and High Performance Computing, Bordeaux, France, pp. 120-129, (IEEE) (2022)
- D. Wladdimiro, L. Arantes, N. Hidalgo, P. Sens : “A predictive model for Stream Processing System that dynamically calibrates the number of operator replicas”, ComPAS 2022 - Conférence francophone d'informatique en Parallélisme, Architecture et Système, Amiens, France (2022)
-
2021
- D. Wladdimiro, L. Arantes, P. Sens, N. Hidalgo : “A Multi-Metric Adaptive Stream Processing System”, NCA 2021 - 20th IEEE International Symposium on Network Computing and Applications, Cambridge, Boston, United States (2021)