Speaker
Description
Residential heating is one of the most significant
energy-consuming tasks in a household; however, in most homes
it is still managed by static, rule-based thermostats that ignore the
data generated by smart home sensors. This paper investigates
whether a reinforcement learning based control policy used to
control a thermostat, evaluated end-to-end via a reproducible
MLOps pipeline and utilizing the Digital Twin concept to simulate
a 1R1C smart home calibrated on the dataset, can produce
measurable benefits compared to a simple rule-based solution.
The main contribution lies in the development of such a system
as well as the creation of a rigorous and transparent testing
protocol, in which every controller is scored by one shared reward
on a leakage-safe held-out split across three windows and five
seeds, with confidence intervals. The main finding is that a PPO
policy ties a well-tuned scheduled thermostat in-distribution and
reduces demand-response exceedance by 41 percent, but does not
beat it out of distribution; a serve-time filter shows that parity is
reached by deferring 97 percent of decisions to the rule. Dropping
a local large language model and an idealized model-predictive
oracle into the same residual slot shows that a real headroom of
roughly 8 percent over the rule exists, but is not realizable by a
controller that must learn from a single short trace.