Computational Intelligence - May 2015 - 47
2) Human-like Instruction Model
In the closed-loop stimulation method,
the human-like instruction model issues
an instruction, given a rat state and an
object. This method operates in a similar
manner to humans when they encounter a similar situation during the manual
control of a rat cyborg.
In the manual control process, after
the instruction C i -1 is issued to the rat
cyborg, its posture changes from the state
S i -1 to the next state S i . Next, humans
observe the change in the rat state and
determine the current instruction C i to
adjust the incorrect action or to reward
the correct action. Thus, the state change
is an important factor when deciding the
current instruction. In addition, the current object affects the selection of the
instruction. Different objects are related
to different motion expectations for the
rat cyborg. Thus, different instructions
will be sent even if the same state change
is observed for different objects. Therefore, the current motion expectation is
treated as another factor when deciding
the current instruction.
We assume that the state change
extracted by our method is DS i =
{i i - i i -1, Vi - Vi -1}, t h e c u r r e n t
motion expectation E i indicated by the
object detection result is one of Forward
(0), Left Turn (-1), and Right Turn (1),
State 1
State 2
and the current instruction issued by
humans is C i . We use X i = (DS i, E i) as
input features and C i as output labels to
train a support vector machine (SVM)
classifier to construct the human-like
instruction model. Given a set of l training data points (X i, C i), i = 1, 2, f, l,
the SVM aims to learn a classifier for
the input data X with the form:
C = sign(w T X + b),
Target
i
Image Plane
(6)
Miniature
Camera
T
where w and b are parameters
obtained by solving the following optimization problem:
l
min 1 w 2 + a / p i,
2
i =1
s.t. C i (w T X i + b) $ 1 - p i and p i $ 0,
(7)
where p is a slack variable and the
parameter a balances the weights
between the two terms. Because there
are three possible values for an instruction: C (Left (-1), Right (1), or Forward (0)), we build a three-class classifier
as the human-like instruction model
using a one-against-all scheme.
The training data were collected
during the manually controlled navigation of the rat cyborg. Both the control
instructions and the videos from the ratmounted camera were recorded. The rat
motion state S i that corresponded to
State 3
State 4
D (Scene
Depth)
d
f
Figure 4 Rat head orientation estimation.
each instruction C i was extracted from
the videos and used to compute the rat
state change DS i . The action expectation E i was obtained based on the
object detection results. In the testing
stage, we computed the real-time state
change DS and motion expectation E
of the rat cyborg. The instruction for the
rat cyborg was then obtained based on
the classification results produced using
our model. Figure 5 shows the training
and testing framework employed by our
human-like instruction model.
VI. Experiments
In this section, we present details of the
rat surgery, including the electrodes and
State 5
Rat State Change & Detection Result
Object Detection
Rat State Extraction
Instruction
SVM
Instruction Data
Instruction 1:
Left
Instruction 2:
Forward
Instruction 3:
Right
Model Learning
Instruction 4:
Forward
Instruction 5:
Forward
Automatic Navigation
Figure 5 Human-like instruction model.
MAY 2015 | IEEE CoMputAtIonAl IntEllIgEnCE MAgAzInE
47
Table of Contents for the Digital Edition of Computational Intelligence - May 2015
Computational Intelligence - May 2015 - Cover1
Computational Intelligence - May 2015 - Cover2
Computational Intelligence - May 2015 - 1
Computational Intelligence - May 2015 - 2
Computational Intelligence - May 2015 - 3
Computational Intelligence - May 2015 - 4
Computational Intelligence - May 2015 - 5
Computational Intelligence - May 2015 - 6
Computational Intelligence - May 2015 - 7
Computational Intelligence - May 2015 - 8
Computational Intelligence - May 2015 - 9
Computational Intelligence - May 2015 - 10
Computational Intelligence - May 2015 - 11
Computational Intelligence - May 2015 - 12
Computational Intelligence - May 2015 - 13
Computational Intelligence - May 2015 - 14
Computational Intelligence - May 2015 - 15
Computational Intelligence - May 2015 - 16
Computational Intelligence - May 2015 - 17
Computational Intelligence - May 2015 - 18
Computational Intelligence - May 2015 - 19
Computational Intelligence - May 2015 - 20
Computational Intelligence - May 2015 - 21
Computational Intelligence - May 2015 - 22
Computational Intelligence - May 2015 - 23
Computational Intelligence - May 2015 - 24
Computational Intelligence - May 2015 - 25
Computational Intelligence - May 2015 - 26
Computational Intelligence - May 2015 - 27
Computational Intelligence - May 2015 - 28
Computational Intelligence - May 2015 - 29
Computational Intelligence - May 2015 - 30
Computational Intelligence - May 2015 - 31
Computational Intelligence - May 2015 - 32
Computational Intelligence - May 2015 - 33
Computational Intelligence - May 2015 - 34
Computational Intelligence - May 2015 - 35
Computational Intelligence - May 2015 - 36
Computational Intelligence - May 2015 - 37
Computational Intelligence - May 2015 - 38
Computational Intelligence - May 2015 - 39
Computational Intelligence - May 2015 - 40
Computational Intelligence - May 2015 - 41
Computational Intelligence - May 2015 - 42
Computational Intelligence - May 2015 - 43
Computational Intelligence - May 2015 - 44
Computational Intelligence - May 2015 - 45
Computational Intelligence - May 2015 - 46
Computational Intelligence - May 2015 - 47
Computational Intelligence - May 2015 - 48
Computational Intelligence - May 2015 - 49
Computational Intelligence - May 2015 - 50
Computational Intelligence - May 2015 - 51
Computational Intelligence - May 2015 - 52
Computational Intelligence - May 2015 - 53
Computational Intelligence - May 2015 - 54
Computational Intelligence - May 2015 - 55
Computational Intelligence - May 2015 - 56
Computational Intelligence - May 2015 - 57
Computational Intelligence - May 2015 - 58
Computational Intelligence - May 2015 - 59
Computational Intelligence - May 2015 - 60
Computational Intelligence - May 2015 - 61
Computational Intelligence - May 2015 - 62
Computational Intelligence - May 2015 - 63
Computational Intelligence - May 2015 - 64
Computational Intelligence - May 2015 - 65
Computational Intelligence - May 2015 - 66
Computational Intelligence - May 2015 - 67
Computational Intelligence - May 2015 - 68
Computational Intelligence - May 2015 - 69
Computational Intelligence - May 2015 - 70
Computational Intelligence - May 2015 - 71
Computational Intelligence - May 2015 - 72
Computational Intelligence - May 2015 - 73
Computational Intelligence - May 2015 - 74
Computational Intelligence - May 2015 - 75
Computational Intelligence - May 2015 - 76
Computational Intelligence - May 2015 - 77
Computational Intelligence - May 2015 - 78
Computational Intelligence - May 2015 - 79
Computational Intelligence - May 2015 - 80
Computational Intelligence - May 2015 - Cover3
Computational Intelligence - May 2015 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202311
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202308
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202305
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202302
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202211
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202208
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202205
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202202
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202111
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202108
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202105
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202102
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202011
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202008
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202005
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_202002
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201911
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201908
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201905
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201902
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201811
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201808
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201805
https://www.nxtbook.com/nxtbooks/ieee/computationalintelligence_201802
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring17
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring16
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring15
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring14
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_summer13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_spring13
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_winter12
https://www.nxtbook.com/nxtbooks/ieee/computational_intelligence_fall12
https://www.nxtbookmedia.com