IEEE Power & Energy Magazine - March/April 2018 - 79

Selection

Expansion
P

Q + u (P )

Max

Backup
νθ
Q

P

Q + u (P )

Max

Q + u (P )

Q

νθ
P

Q + u (P )

Evaluation

Q

P
νθ

Pσ
P

Q

νθ

νθ

r

r

~pπ

P
r

(a)

νθ

(b)

r
(c)

(d)

figure 3. MCTS in AlphaGo with four steps: selection, expansion, evaluation, and backup. (Reprinted with permission
from Macmillan Publishers Ltd: Nature. D. Silver, A. Huang, C. J. Maddison, et al., "Mastering the game of Go with deep
neural networks and tree search," Nature, vol. 529, pp. 484-489, 2016, copyright 2016.).

Day-Ahead
Market Bidding

Hour-Ahead
Market
Bidding

Day-Ahead
Market
Settlement 1

Real-Time Hour-Ahead
Market
Market
Bidding Settlement 1

Scenario 1

Scenario 2

Hour-Ahead
Market
Settlement 2

Scenario 3

Initial Stage

Day-Ahead
Market
Settlement
l -1

.....

Hour-Ahead
Market
Settlement
m -3

Scenario
n -5

Hour-Ahead
Market
Settlement
m -2

Scenario
n -4

Scenario
n -3

Day-Ahead
Market
Settlement l

Hour-Ahead
Market
Settlement
m -1

Scenario
n -2

Scenario
n -1

Hour-Ahead
Market
Settlement
m

Scenario n

figure 4. A multistage bidding process.

1) train a policy network based on the historical data to
simulate the potential bidding strategies of the bidders
during the multistage market transaction, which is the
supervised learning phase. then, the policy network
can be enhanced via multiple rounds of self-play to
involve more potential bidding strategies, which constitutes the rl phase.
2) train a value network by calculating the associated
economic benefits received by the bidder under the
above bidding strategies.
3) Build the search tree based on the above policy and
value networks. at each stage of bidding, apply the
look-ahead mctS by traversing all possible future
march/april 2018

bidding outcomes and select the strategy with the
maximum economic benefit.

Distribution-Level Market Transaction
the opening of the electricity market to the distribution system
has made it possible for distributed energy resources (ders)
to play a role. the broad sense of ders includes traditional
distributed generators (dGs), renewable dGs (rdG), and
demand response (dr). the advantages of a distribution-level
market are two-fold: 1) it can facilitate high der penetration
into the power system via market regulation, and 2) ders can
also provide energy and ancillary services to the utility grid via
market mechanisms based on their high dispatch flexibility.
ieee power & energy magazine

79



Table of Contents for the Digital Edition of IEEE Power & Energy Magazine - March/April 2018

Contents
IEEE Power & Energy Magazine - March/April 2018 - Cover1
IEEE Power & Energy Magazine - March/April 2018 - Cover2
IEEE Power & Energy Magazine - March/April 2018 - Contents
IEEE Power & Energy Magazine - March/April 2018 - 2
IEEE Power & Energy Magazine - March/April 2018 - 3
IEEE Power & Energy Magazine - March/April 2018 - 4
IEEE Power & Energy Magazine - March/April 2018 - 5
IEEE Power & Energy Magazine - March/April 2018 - 6
IEEE Power & Energy Magazine - March/April 2018 - 7
IEEE Power & Energy Magazine - March/April 2018 - 8
IEEE Power & Energy Magazine - March/April 2018 - 9
IEEE Power & Energy Magazine - March/April 2018 - 10
IEEE Power & Energy Magazine - March/April 2018 - 11
IEEE Power & Energy Magazine - March/April 2018 - 12
IEEE Power & Energy Magazine - March/April 2018 - 13
IEEE Power & Energy Magazine - March/April 2018 - 14
IEEE Power & Energy Magazine - March/April 2018 - 15
IEEE Power & Energy Magazine - March/April 2018 - 16
IEEE Power & Energy Magazine - March/April 2018 - 17
IEEE Power & Energy Magazine - March/April 2018 - 18
IEEE Power & Energy Magazine - March/April 2018 - 19
IEEE Power & Energy Magazine - March/April 2018 - 20
IEEE Power & Energy Magazine - March/April 2018 - 21
IEEE Power & Energy Magazine - March/April 2018 - 22
IEEE Power & Energy Magazine - March/April 2018 - 23
IEEE Power & Energy Magazine - March/April 2018 - 24
IEEE Power & Energy Magazine - March/April 2018 - 25
IEEE Power & Energy Magazine - March/April 2018 - 26
IEEE Power & Energy Magazine - March/April 2018 - 27
IEEE Power & Energy Magazine - March/April 2018 - 28
IEEE Power & Energy Magazine - March/April 2018 - 29
IEEE Power & Energy Magazine - March/April 2018 - 30
IEEE Power & Energy Magazine - March/April 2018 - 31
IEEE Power & Energy Magazine - March/April 2018 - 32
IEEE Power & Energy Magazine - March/April 2018 - 33
IEEE Power & Energy Magazine - March/April 2018 - 34
IEEE Power & Energy Magazine - March/April 2018 - 35
IEEE Power & Energy Magazine - March/April 2018 - 36
IEEE Power & Energy Magazine - March/April 2018 - 37
IEEE Power & Energy Magazine - March/April 2018 - 38
IEEE Power & Energy Magazine - March/April 2018 - 39
IEEE Power & Energy Magazine - March/April 2018 - 40
IEEE Power & Energy Magazine - March/April 2018 - 41
IEEE Power & Energy Magazine - March/April 2018 - 42
IEEE Power & Energy Magazine - March/April 2018 - 43
IEEE Power & Energy Magazine - March/April 2018 - 44
IEEE Power & Energy Magazine - March/April 2018 - 45
IEEE Power & Energy Magazine - March/April 2018 - 46
IEEE Power & Energy Magazine - March/April 2018 - 47
IEEE Power & Energy Magazine - March/April 2018 - 48
IEEE Power & Energy Magazine - March/April 2018 - 49
IEEE Power & Energy Magazine - March/April 2018 - 50
IEEE Power & Energy Magazine - March/April 2018 - 51
IEEE Power & Energy Magazine - March/April 2018 - 52
IEEE Power & Energy Magazine - March/April 2018 - 53
IEEE Power & Energy Magazine - March/April 2018 - 54
IEEE Power & Energy Magazine - March/April 2018 - 55
IEEE Power & Energy Magazine - March/April 2018 - 56
IEEE Power & Energy Magazine - March/April 2018 - 57
IEEE Power & Energy Magazine - March/April 2018 - 58
IEEE Power & Energy Magazine - March/April 2018 - 59
IEEE Power & Energy Magazine - March/April 2018 - 60
IEEE Power & Energy Magazine - March/April 2018 - 61
IEEE Power & Energy Magazine - March/April 2018 - 62
IEEE Power & Energy Magazine - March/April 2018 - 63
IEEE Power & Energy Magazine - March/April 2018 - 64
IEEE Power & Energy Magazine - March/April 2018 - 65
IEEE Power & Energy Magazine - March/April 2018 - 66
IEEE Power & Energy Magazine - March/April 2018 - 67
IEEE Power & Energy Magazine - March/April 2018 - 68
IEEE Power & Energy Magazine - March/April 2018 - 69
IEEE Power & Energy Magazine - March/April 2018 - 70
IEEE Power & Energy Magazine - March/April 2018 - 71
IEEE Power & Energy Magazine - March/April 2018 - 72
IEEE Power & Energy Magazine - March/April 2018 - 73
IEEE Power & Energy Magazine - March/April 2018 - 74
IEEE Power & Energy Magazine - March/April 2018 - 75
IEEE Power & Energy Magazine - March/April 2018 - 76
IEEE Power & Energy Magazine - March/April 2018 - 77
IEEE Power & Energy Magazine - March/April 2018 - 78
IEEE Power & Energy Magazine - March/April 2018 - 79
IEEE Power & Energy Magazine - March/April 2018 - 80
IEEE Power & Energy Magazine - March/April 2018 - 81
IEEE Power & Energy Magazine - March/April 2018 - 82
IEEE Power & Energy Magazine - March/April 2018 - 83
IEEE Power & Energy Magazine - March/April 2018 - 84
IEEE Power & Energy Magazine - March/April 2018 - 85
IEEE Power & Energy Magazine - March/April 2018 - 86
IEEE Power & Energy Magazine - March/April 2018 - 87
IEEE Power & Energy Magazine - March/April 2018 - 88
IEEE Power & Energy Magazine - March/April 2018 - 89
IEEE Power & Energy Magazine - March/April 2018 - 90
IEEE Power & Energy Magazine - March/April 2018 - 91
IEEE Power & Energy Magazine - March/April 2018 - 92
IEEE Power & Energy Magazine - March/April 2018 - 93
IEEE Power & Energy Magazine - March/April 2018 - 94
IEEE Power & Energy Magazine - March/April 2018 - 95
IEEE Power & Energy Magazine - March/April 2018 - 96
IEEE Power & Energy Magazine - March/April 2018 - 97
IEEE Power & Energy Magazine - March/April 2018 - 98
IEEE Power & Energy Magazine - March/April 2018 - 99
IEEE Power & Energy Magazine - March/April 2018 - 100
IEEE Power & Energy Magazine - March/April 2018 - 101
IEEE Power & Energy Magazine - March/April 2018 - 102
IEEE Power & Energy Magazine - March/April 2018 - 103
IEEE Power & Energy Magazine - March/April 2018 - 104
IEEE Power & Energy Magazine - March/April 2018 - 105
IEEE Power & Energy Magazine - March/April 2018 - 106
IEEE Power & Energy Magazine - March/April 2018 - 107
IEEE Power & Energy Magazine - March/April 2018 - 108
IEEE Power & Energy Magazine - March/April 2018 - Cover3
IEEE Power & Energy Magazine - March/April 2018 - Cover4
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091020
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070820
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050620
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030420
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010220
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111219
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091019
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070819
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050619
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030419
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010219
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111218
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091018
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070818
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050618
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030418
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010218
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111217
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091017
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070817
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050617
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030417
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010217
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111216
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091016
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070816
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050616
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030416
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010216
https://www.nxtbook.com/nxtbooks/ieee/powerenergy_010216
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111215
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091015
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070815
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050615
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030415
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010215
https://www.nxtbook.com/nxtbooks/pes/powerenergy_111214
https://www.nxtbook.com/nxtbooks/pes/powerenergy_091014
https://www.nxtbook.com/nxtbooks/pes/powerenergy_070814
https://www.nxtbook.com/nxtbooks/pes/powerenergy_050614
https://www.nxtbook.com/nxtbooks/pes/powerenergy_030414
https://www.nxtbook.com/nxtbooks/pes/powerenergy_010214
https://www.nxtbookmedia.com