Florian Schmidt

SMiPE: Estimating the Progress of Recurring Iterative Distributed Dataflows

2017

Distributed dataflow systems such as Apache Spark allow the execution of iterative programs at large scale on clusters. In production use, programs are often recurring and have strict latency requirements. Yet, choosing appropriate resource allocations …

Efficient Runtime Profiling for Black-box Machine Learning Services on Sensor Streams

2022 · arXiv (Cornell University)

In highly distributed environments such as cloud, edge and fog computing, the application of machine learning for automating and optimizing processes is on the rise. Machine learning jobs are frequently applied in streaming conditions, where …