19–21 Nov 2026
"Alexandru Ioan Cuza" University of Iasi and "Gheorghe Asachi" Technical University of Iași
Europe/Bucharest timezone

Digital Twin and MLOps for IoT

20 Nov 2026, 12:15
15m
Room 3

Room 3

Paper presentation Grid, Cloud & High Performance Computing in Science Technologies for Future Internet & HPC

Speaker

Mr Denis-Jenica Baston (National University of Sciences and Technology Politehnica Bucharest)

Description

Residential heating is one of the most significant
energy-consuming tasks in a household; however, in most homes
it is still managed by static, rule-based thermostats that ignore the
data generated by smart home sensors. This paper investigates
whether a reinforcement learning based control policy used to
control a thermostat, evaluated end-to-end via a reproducible
MLOps pipeline and utilizing the Digital Twin concept to simulate
a 1R1C smart home calibrated on the dataset, can produce
measurable benefits compared to a simple rule-based solution.
The main contribution lies in the development of such a system
as well as the creation of a rigorous and transparent testing
protocol, in which every controller is scored by one shared reward
on a leakage-safe held-out split across three windows and five
seeds, with confidence intervals. The main finding is that a PPO
policy ties a well-tuned scheduled thermostat in-distribution and
reduces demand-response exceedance by 41 percent, but does not
beat it out of distribution; a serve-time filter shows that parity is
reached by deferring 97 percent of decisions to the rule. Dropping
a local large language model and an idealized model-predictive
oracle into the same residual slot shows that a real headroom of
roughly 8 percent over the rule exists, but is not realizable by a
controller that must learn from a single short trace.

Author

Mr Denis-Jenica Baston (National University of Sciences and Technology Politehnica Bucharest)

Co-authors

Mr Dan Gabriel Badea (National University of Sciences and Technology Politehnica Bucharest) Mr Dinu TURCANU (Faculty of Electronics and Telecommunications National Institute of Innovations in Cybersecurity “CYBERCOR”, Technical University of Moldova, Moldova) Mr Marius Dumitrascu (Doctoral School Technical University of Moldova, Moldova)

Presentation materials

There are no materials yet.