IEEE Power & Energy Magazine - May/June 2022 - 51

The DQN control strategy was
deployed at the research house
from 25 March to 5 April 2021.
Since this period often has mild
temperatures, the user comfort
level was shifted higher than
usual, i.e., 22.2-24.4 °C (72-76 °F),
to ensure the home would ex -
perience adequate heating load.
The fixed-setpoint baseline case
is used to compare the DQN control
strategy's performance during
the deployment phase. In the
baseline case, the setpoint is fix -
ed to 22.2 °C (72 °F) to minimize
the energy cost while maintaining
the user comfort level. However,
it is not feasible to deploy the
fixed-setpoint control under the
same weather conditions in the
same research house as the DQN
deployment, so it is not straightforward
to have a truly fair comparison
between the DQN and
baseline controls.
Instead, we can create a " simulated
DQN " case using the re -
corded thermostat setpoints and
measured weather data during the
DQN deployment. This allows
us to evaluate the accuracy of the
DQN simulation by comparing
the measured to simulated results.
More importantly, this makes a
more direct comparison between
the " simulated DQN " case and the
baseline (fixed-setpoint) simulation
case. The model parameters were
adjusted based on the comparison
between the measured data from
the DQN deployment and " simulated
DQN " control to increase the
accuracy of the simulation. In the
following discussion, we present
the details of this procedure and
performance comparison.
The procedure of the comparison
study, which is based on the
DQN deployment, is as follows:
✔ Fi rst, we fine-tune the
building simulation model
used for DQN training with
the new data collected during
the DQN deployment
period.
may/june 2022
25 March 2021 to 05 April 2021, Simulation With RL Setpoints
25
24
23
22
21
25
26
24
23
22
6,000
4,000
2,000
Tin2_sim_DQN
Tin2_Tstat
Simulated Energy = 212,915 Wh, Measured Energy = 218,488
Power_sim_DQN
Power_measured
Tin1_sim_DQN
Tin1_Tstat
Simulated Cost = US$20.9, Measured Cost = US$20.64
25 March 27 March 29 March 31 March
Time
(a)
25
24
23
22
21
25
26
24
23
22
Baseline Simulated Energy = 188,389 Wh, RL Measured Energy = 218,488
6,000
4,000
2,000
Power_sim_BL
Power_measured
1 April 3 April 5 April
25 March 2021 to 05 April 2021, Baseline Simulation
Tin1_sim_BL
Tin1_Tstat
Baseline Simulated Cost = US$23.67, RL Measured Cost = US$20.64
Tin2_sim_BL
Tin2_Tstat
25 March 27 March 29 March 31 March 1 April 3 April 5 April
Time
(b)
figure 8. A comparison of the simulation and deployment results: (a) a simulated
DQN case versus measured data for DQN control and (b) a simulated baseline case
versus measured data for DQN control. BL: baseline.
ieee power & energy magazine
51
Power (W)
Power (W)
Temperature (°C)
Temperature (°C)
Temperature (°C)
Temperature (°C)

IEEE Power & Energy Magazine - May/June 2022

Table of Contents for the Digital Edition of IEEE Power & Energy Magazine - May/June 2022

Contents
IEEE Power & Energy Magazine - May/June 2022 - Cover1
IEEE Power & Energy Magazine - May/June 2022 - Cover2
IEEE Power & Energy Magazine - May/June 2022 - Contents
IEEE Power & Energy Magazine - May/June 2022 - 2
IEEE Power & Energy Magazine - May/June 2022 - 3
IEEE Power & Energy Magazine - May/June 2022 - 4
IEEE Power & Energy Magazine - May/June 2022 - 5
IEEE Power & Energy Magazine - May/June 2022 - 6
IEEE Power & Energy Magazine - May/June 2022 - 7
IEEE Power & Energy Magazine - May/June 2022 - 8
IEEE Power & Energy Magazine - May/June 2022 - 9
IEEE Power & Energy Magazine - May/June 2022 - 10
IEEE Power & Energy Magazine - May/June 2022 - 11
IEEE Power & Energy Magazine - May/June 2022 - 12
IEEE Power & Energy Magazine - May/June 2022 - 13
IEEE Power & Energy Magazine - May/June 2022 - 14
IEEE Power & Energy Magazine - May/June 2022 - 15
IEEE Power & Energy Magazine - May/June 2022 - 16
IEEE Power & Energy Magazine - May/June 2022 - 17
IEEE Power & Energy Magazine - May/June 2022 - 18
IEEE Power & Energy Magazine - May/June 2022 - 19
IEEE Power & Energy Magazine - May/June 2022 - 20
IEEE Power & Energy Magazine - May/June 2022 - 21
IEEE Power & Energy Magazine - May/June 2022 - 22
IEEE Power & Energy Magazine - May/June 2022 - 23
IEEE Power & Energy Magazine - May/June 2022 - 24
IEEE Power & Energy Magazine - May/June 2022 - 25
IEEE Power & Energy Magazine - May/June 2022 - 26
IEEE Power & Energy Magazine - May/June 2022 - 27
IEEE Power & Energy Magazine - May/June 2022 - 28
IEEE Power & Energy Magazine - May/June 2022 - 29
IEEE Power & Energy Magazine - May/June 2022 - 30
IEEE Power & Energy Magazine - May/June 2022 - 31
IEEE Power & Energy Magazine - May/June 2022 - 32
IEEE Power & Energy Magazine - May/June 2022 - 33
IEEE Power & Energy Magazine - May/June 2022 - 34
IEEE Power & Energy Magazine - May/June 2022 - 35
IEEE Power & Energy Magazine - May/June 2022 - 36
IEEE Power & Energy Magazine - May/June 2022 - 37
IEEE Power & Energy Magazine - May/June 2022 - 38
IEEE Power & Energy Magazine - May/June 2022 - 39
IEEE Power & Energy Magazine - May/June 2022 - 40
IEEE Power & Energy Magazine - May/June 2022 - 41
IEEE Power & Energy Magazine - May/June 2022 - 42
IEEE Power & Energy Magazine - May/June 2022 - 43
IEEE Power & Energy Magazine - May/June 2022 - 44
IEEE Power & Energy Magazine - May/June 2022 - 45
IEEE Power & Energy Magazine - May/June 2022 - 46
IEEE Power & Energy Magazine - May/June 2022 - 47
IEEE Power & Energy Magazine - May/June 2022 - 48
IEEE Power & Energy Magazine - May/June 2022 - 49
IEEE Power & Energy Magazine - May/June 2022 - 50
IEEE Power & Energy Magazine - May/June 2022 - 51
IEEE Power & Energy Magazine - May/June 2022 - 52
IEEE Power & Energy Magazine - May/June 2022 - 53
IEEE Power & Energy Magazine - May/June 2022 - 54
IEEE Power & Energy Magazine - May/June 2022 - 55
IEEE Power & Energy Magazine - May/June 2022 - 56
IEEE Power & Energy Magazine - May/June 2022 - 57
IEEE Power & Energy Magazine - May/June 2022 - 58
IEEE Power & Energy Magazine - May/June 2022 - 59
IEEE Power & Energy Magazine - May/June 2022 - 60
IEEE Power & Energy Magazine - May/June 2022 - 61
IEEE Power & Energy Magazine - May/June 2022 - 62
IEEE Power & Energy Magazine - May/June 2022 - 63
IEEE Power & Energy Magazine - May/June 2022 - 64
IEEE Power & Energy Magazine - May/June 2022 - 65
IEEE Power & Energy Magazine - May/June 2022 - 66
IEEE Power & Energy Magazine - May/June 2022 - 67
IEEE Power & Energy Magazine - May/June 2022 - 68
IEEE Power & Energy Magazine - May/June 2022 - 69
IEEE Power & Energy Magazine - May/June 2022 - 70
IEEE Power & Energy Magazine - May/June 2022 - 71
IEEE Power & Energy Magazine - May/June 2022 - 72
IEEE Power & Energy Magazine - May/June 2022 - 73
IEEE Power & Energy Magazine - May/June 2022 - 74
IEEE Power & Energy Magazine - May/June 2022 - 75
IEEE Power & Energy Magazine - May/June 2022 - 76
IEEE Power & Energy Magazine - May/June 2022 - 77
IEEE Power & Energy Magazine - May/June 2022 - 78
IEEE Power & Energy Magazine - May/June 2022 - 79
IEEE Power & Energy Magazine - May/June 2022 - 80
IEEE Power & Energy Magazine - May/June 2022 - 81
IEEE Power & Energy Magazine - May/June 2022 - 82
IEEE Power & Energy Magazine - May/June 2022 - 83
IEEE Power & Energy Magazine - May/June 2022 - 84
IEEE Power & Energy Magazine - May/June 2022 - 85
IEEE Power & Energy Magazine - May/June 2022 - 86
IEEE Power & Energy Magazine - May/June 2022 - 87
IEEE Power & Energy Magazine - May/June 2022 - 88
IEEE Power & Energy Magazine - May/June 2022 - 89
IEEE Power & Energy Magazine - May/June 2022 - 90
IEEE Power & Energy Magazine - May/June 2022 - 91
IEEE Power & Energy Magazine - May/June 2022 - 92
IEEE Power & Energy Magazine - May/June 2022 - Cover3
IEEE Power & Energy Magazine - May/June 2022 - Cover4
https://www.nxtbook.com/nxtbooks/pes/powerenergy_gridedge_2023
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050622
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030422
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010222
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111221
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091021
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070821
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050621
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030421
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010221
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111220
https://www.nxtbookmedia.com