💾 Archived View for gemini.bortzmeyer.org › fosdem › event-11095.gmi captured on 2021-12-17 at 13:26:06. Gemini links have been rewritten to link to archived content
-=-=-=-=-=-=-
Javier de la Rúa MartÃnez
Type devroom
Starts on day 2 (2021-02-07) at 10:30 (Brussels time, UTC+1) in room Hpc (duration 00:30)
Matrix room #hpc:fosdem.org
In this session, we will present an open-source stream processing architecture, based on Spark Structured Streaming, for automating model monitoring with some experiment results. We use Kafka to log model predictions, KFServing for model serving and a Kubernetes operator for the deployment and configuration of the different components. As for the analysis of inference data, we implemented an extendable monitoring framework on top of Spark Structured Streaming to detect outliers and data drift.