IEEE Consumer Electronics Magazine - July 2017 - 107
period. This is not an accurate reflection of real-world software
development, as the second expert's own code shows, but nonetheless this is what the jury was told. This is just one of several
examples of the subjective nature of the criticisms of Toyota's
software quality presented to the jury by both experts. Other
examples can be found in my follow-up paper [27] to my IEEE
Technology and Society Magazine article [24] on this subject.
CAUSATION NOT DEMONSTRATED
The jury was told that "to a reasonable degree of engineering
certainty, it was more likely than not" that Task X death
caused the accident. Two theories were presented to support
this conclusion, but neither theory was credible. Nonetheless,
the jury accepted the conclusion.
The message provided to the jury by the plaintiffs was twofold:
▼ The defendant's software was poorly designed and full of
bugs.
▼ These bugs likely caused the accident.
As with all nontrivial software, there likely were bugs in the
defendant's software. Perhaps the plaintiffs found some of
them. But this does not mean that the accident was caused by
any of the purported bugs. Causation was not demonstrated.
Due to the nature of software, it seems likely that this same
scenario will play out in future embedded software trials. A key
to ensuring that an informed decision will be reached by the jury
in such a trial is for both plaintiffs and defendants to adequately
address the second bullet point above, causation. Otherwise, the
jury can be convinced that causation has been demonstrated
when in fact all that has occurred is that the quality of the defendant's software has been criticized, perhaps legitimately and perhaps not. This appears to be what happened in this trial.
ACKNOWLEDGMENT
This is a modified version of an article appearing in the
December 2016 issue of IEEE Technology and Society Magazine [24]. In the present article, references were made to the
full analysis from the original IEEE Technology and Society
Magazine article where appropriate.
ABOUT THE AUTHOR
David M. Cummings (dcummings@kellytechnologygroup
.com) earned his B.S. degree from Harvard University, Cambridge, Massachusetts, and his M.S. and Ph.D. degrees from the
University of California, Los Angeles. He is the executive vice
president of the Kelly Technology Group in Santa Barbara, California. He has more than 35 years of experience in the design
and implementation of software systems, many of which are
embedded systems. Nine of those years were spent at NASA's
Jet Propulsion Laboratory, where he designed and implemented
flight software for the Mars Pathfinder spacecraft.
REFERENCES
[1] Legal Information Institute. Burden of proof. Cornell University Law
School. [Online]. Available: https://www.law.cornell.edu/wex/burden_of_
proof
[2] Legal Information Institute. Preponderance. Cornell University Law
School. [Online]. Available: https://www.law.cornell.edu/wex/preponderance
[3] Justia. Evidentiary standards and burdens of proof. [Online]. Available: https://www.justia.com/trials-litigation/evidentiary-standardsburdens-proof/
[4] Nolo. Legal standards of proof. [Online]. Available: http://www.nolo
.com/legal-encyclopedia/legal-standards-proof.html
[5] Justia. Actual and proximate cause. [Online]. Available: https://www
.justia.com/injury/negligence-theory/actual-and-proximate-cause/
[6] Legal Information Institute. Actual cause. Cornell University Law
School. [Online]. Available: https://www.law.cornell.edu/wex/actual_cause
[7] Legal Information Institute. But-for test. Cornell University Law
School. [Online]. Available: https://www.law.cornell.edu/wex/but-for_test
[8] Legal Information Institute. Proximate cause. Cornell University Law
School. [Online]. Available: https://www.law.cornell.edu/wex/proximate_cause
[9] Thomson Reuters. Elements of a negligence case. FindLaw. [Online].
Available: http://images.findlaw.com/optimost/accident-injury-law/
elements-of-a-negligence-case-2.html
[10] Liability. Law.com. [Online]. Available: http://dictionary.law.com/
Default.aspx?selected=1151
[11] Proximate cause. Law.com. [Online]. Available: http://dictionary
.law.com/Default.aspx?selected=1669
[12] Proximate cause. The Free Dictionary. [Online]. Available: http://
legal-dictionary.thefreedictionary.com/proximate+cause
[13] N. Leveson. (2011). White paper on the use of safety cases in certification and regulation. [Online]. p. 6. Available: http://sunnyday.mit.edu/
SafetyCases.pdf
[14] D. Pogue. (2014, Nov. 1). 5 most embarrassing software bugs in history. Scientific American. [Online]. Available: http://www.scientificamerican
.com/article/pogue-5-most-embarrassing-software-bugs-in-history/
[15] C. Metz. (2004, Aug. 3). Is Microsoft to blame? PC Mag. [Online].
Available: http://www.pcmag.com/article2/0,2817,1618393,00.asp
[16] IEEE. IEEE code of ethics, #3 and #9. [Online]. Available: http://
www.ieee.org/about/corporate/governance/p7-8.html
[17] Association for Computing Machinery. Software engineering code
of ethics and professional practice, #1.06 and #4.03. [Online]. Available:
http://www.acm.org/about/se-code
[18] M. Barr. (2013, Oct. 26). An update on Toyota and unintended acceleration. Embedded Gurus. [Online]. Available: http://embeddedgurus.com/
barr-code/2013/10/an-update-on-toyota-and-unintended-acceleration/
[19] D. Cummings. (2010, Mar. 11). Haven't found that software glitch,
Toyota? Keep trying. Los Angeles Times. [Online]. Available: http://
www.latimes.com/news/opinion/opinionla/la-oew-cummings122010mar12,0,2595172.story
[20] National Highway Traffic Safety Administration. (2015, May 1).
Denial of motor vehicle defect petition. [Online]. pp. 11-15. Available:
http://www.safetyresearch.net/Library/INFD-DP14003-61928.pdf
[21] Bookout et al. v. Toyota. (2013, Oct. 11). Transcript of morning trial
proceedings. [Online]. Available: http://www.safetyresearch.net/Library/
Koopman%2010-11-13%20a.m.PDF
[22] Bookout et al. v. Toyota. (2013, Oct. 11). Transcript of afternoon
trial proceedings. [Online]. Available: http://www.safetyresearch.net/
Library/Koopman%2010-11-13%20p.m.pdf
[23] P. Koopman. (2014, Sept. 14). A case study of Toyota unintended
acceleration and software safety. [Online]. Available: https://users.ece
.cmu.edu/~koopman/pubs/koopman14_toyota_ua_slides.pdf
[24] D. M. Cummings, "Embedded software under the courtroom microscope," IEEE Technol. Soc. Mag., vol. 35, no. 4, pp. 76-84, Dec. 2016.
doi: 10.1109/MTS.2016.2618681.
[25] Bookout et al. v. Toyota. (2013, Oct. 14). Transcript of morning trial
proceedings. [Online]. Available: http://www.safetyresearch.net/Library/
Bookout_v_Toyota_Barr_REDACTED.pdf
[26] M. Barr. Bookout v. Toyota: 2005 Camry L4 software analysis.
[Online]. Available: http://www.safetyresearch.net/Library/BarrSlides_
FINAL_SCRUBBED.pdf
[27] D. M. Cummings. (2016, Dec. 5). Embedded software under the
Courtroom microscope, part 2-On the subjectivity of software quality
assessments. [Online]. Available: http://www.kellytechnologygroup.com/
main/DCummings_SW-Quality-Subjectivity.pdf
JULY 2017
^
IEEE Consumer Electronics Magazine
107
https://www.justia.com/trials-litigation/evidentiary-standards
http://www.nolo
https://www
http://www.justia.com/injury/negligence-theory/actual-and-proximate-cause/
https://www.law.cornell.edu/wex/actual_cause
https://www.law.cornell.edu/wex/but-for_test
https://www.law.cornell.edu/wex/proximate_cause
http://images.findlaw.com/optimost/accident-injury-law/
http://www.Law.com
http://dictionary.law.com/
http://www.Law.com
http://dictionary
http://www.law.com/Default.aspx?selected=1669
http://http://
http://sunnyday.mit.edu/
http://www.scientificamerican
http://www.pcmag.com/article2/0,2817,1618393,00.asp
http://http://
http://www.ieee.org/about/corporate/governance/p7-8.html
http://www.acm.org/about/se-code
http://www.embeddedgurus.com/
http://http://
http://www.latimes.com/news/opinion/opinionla/la-oew-cummings12
http://www.safetyresearch.net/Library/INFD-DP14003-61928.pdf
http://www.safetyresearch.net/Library/
http://www.safetyresearch.net/
https://www.users.ece
http://www.cmu.edu/~koopman/pubs/koopman14_toyota_ua_slides.pdf
http://www.safetyresearch.net/Library/
http://www.safetyresearch.net/Library/BarrSlides_
https://www.law.cornell.edu/wex/burden_of_
http://www.kellytechnologygroup.com/
https://www.law.cornell.edu/wex/preponderance
Table of Contents for the Digital Edition of IEEE Consumer Electronics Magazine - July 2017
IEEE Consumer Electronics Magazine - July 2017 - Cover1
IEEE Consumer Electronics Magazine - July 2017 - Cover2
IEEE Consumer Electronics Magazine - July 2017 - 1
IEEE Consumer Electronics Magazine - July 2017 - 2
IEEE Consumer Electronics Magazine - July 2017 - 3
IEEE Consumer Electronics Magazine - July 2017 - 4
IEEE Consumer Electronics Magazine - July 2017 - 5
IEEE Consumer Electronics Magazine - July 2017 - 6
IEEE Consumer Electronics Magazine - July 2017 - 7
IEEE Consumer Electronics Magazine - July 2017 - 8
IEEE Consumer Electronics Magazine - July 2017 - 9
IEEE Consumer Electronics Magazine - July 2017 - 10
IEEE Consumer Electronics Magazine - July 2017 - 11
IEEE Consumer Electronics Magazine - July 2017 - 12
IEEE Consumer Electronics Magazine - July 2017 - 13
IEEE Consumer Electronics Magazine - July 2017 - 14
IEEE Consumer Electronics Magazine - July 2017 - 15
IEEE Consumer Electronics Magazine - July 2017 - 16
IEEE Consumer Electronics Magazine - July 2017 - 17
IEEE Consumer Electronics Magazine - July 2017 - 18
IEEE Consumer Electronics Magazine - July 2017 - 19
IEEE Consumer Electronics Magazine - July 2017 - 20
IEEE Consumer Electronics Magazine - July 2017 - 21
IEEE Consumer Electronics Magazine - July 2017 - 22
IEEE Consumer Electronics Magazine - July 2017 - 23
IEEE Consumer Electronics Magazine - July 2017 - 24
IEEE Consumer Electronics Magazine - July 2017 - 25
IEEE Consumer Electronics Magazine - July 2017 - 26
IEEE Consumer Electronics Magazine - July 2017 - 27
IEEE Consumer Electronics Magazine - July 2017 - 28
IEEE Consumer Electronics Magazine - July 2017 - 29
IEEE Consumer Electronics Magazine - July 2017 - 30
IEEE Consumer Electronics Magazine - July 2017 - 31
IEEE Consumer Electronics Magazine - July 2017 - 32
IEEE Consumer Electronics Magazine - July 2017 - 33
IEEE Consumer Electronics Magazine - July 2017 - 34
IEEE Consumer Electronics Magazine - July 2017 - 35
IEEE Consumer Electronics Magazine - July 2017 - 36
IEEE Consumer Electronics Magazine - July 2017 - 37
IEEE Consumer Electronics Magazine - July 2017 - 38
IEEE Consumer Electronics Magazine - July 2017 - 39
IEEE Consumer Electronics Magazine - July 2017 - 40
IEEE Consumer Electronics Magazine - July 2017 - 41
IEEE Consumer Electronics Magazine - July 2017 - 42
IEEE Consumer Electronics Magazine - July 2017 - 43
IEEE Consumer Electronics Magazine - July 2017 - 44
IEEE Consumer Electronics Magazine - July 2017 - 45
IEEE Consumer Electronics Magazine - July 2017 - 46
IEEE Consumer Electronics Magazine - July 2017 - 47
IEEE Consumer Electronics Magazine - July 2017 - 48
IEEE Consumer Electronics Magazine - July 2017 - 49
IEEE Consumer Electronics Magazine - July 2017 - 50
IEEE Consumer Electronics Magazine - July 2017 - 51
IEEE Consumer Electronics Magazine - July 2017 - 52
IEEE Consumer Electronics Magazine - July 2017 - 53
IEEE Consumer Electronics Magazine - July 2017 - 54
IEEE Consumer Electronics Magazine - July 2017 - 55
IEEE Consumer Electronics Magazine - July 2017 - 56
IEEE Consumer Electronics Magazine - July 2017 - 57
IEEE Consumer Electronics Magazine - July 2017 - 58
IEEE Consumer Electronics Magazine - July 2017 - 59
IEEE Consumer Electronics Magazine - July 2017 - 60
IEEE Consumer Electronics Magazine - July 2017 - 61
IEEE Consumer Electronics Magazine - July 2017 - 62
IEEE Consumer Electronics Magazine - July 2017 - 63
IEEE Consumer Electronics Magazine - July 2017 - 64
IEEE Consumer Electronics Magazine - July 2017 - 65
IEEE Consumer Electronics Magazine - July 2017 - 66
IEEE Consumer Electronics Magazine - July 2017 - 67
IEEE Consumer Electronics Magazine - July 2017 - 68
IEEE Consumer Electronics Magazine - July 2017 - 69
IEEE Consumer Electronics Magazine - July 2017 - 70
IEEE Consumer Electronics Magazine - July 2017 - 71
IEEE Consumer Electronics Magazine - July 2017 - 72
IEEE Consumer Electronics Magazine - July 2017 - 73
IEEE Consumer Electronics Magazine - July 2017 - 74
IEEE Consumer Electronics Magazine - July 2017 - 75
IEEE Consumer Electronics Magazine - July 2017 - 76
IEEE Consumer Electronics Magazine - July 2017 - 77
IEEE Consumer Electronics Magazine - July 2017 - 78
IEEE Consumer Electronics Magazine - July 2017 - 79
IEEE Consumer Electronics Magazine - July 2017 - 80
IEEE Consumer Electronics Magazine - July 2017 - 81
IEEE Consumer Electronics Magazine - July 2017 - 82
IEEE Consumer Electronics Magazine - July 2017 - 83
IEEE Consumer Electronics Magazine - July 2017 - 84
IEEE Consumer Electronics Magazine - July 2017 - 85
IEEE Consumer Electronics Magazine - July 2017 - 86
IEEE Consumer Electronics Magazine - July 2017 - 87
IEEE Consumer Electronics Magazine - July 2017 - 88
IEEE Consumer Electronics Magazine - July 2017 - 89
IEEE Consumer Electronics Magazine - July 2017 - 90
IEEE Consumer Electronics Magazine - July 2017 - 91
IEEE Consumer Electronics Magazine - July 2017 - 92
IEEE Consumer Electronics Magazine - July 2017 - 93
IEEE Consumer Electronics Magazine - July 2017 - 94
IEEE Consumer Electronics Magazine - July 2017 - 95
IEEE Consumer Electronics Magazine - July 2017 - 96
IEEE Consumer Electronics Magazine - July 2017 - 97
IEEE Consumer Electronics Magazine - July 2017 - 98
IEEE Consumer Electronics Magazine - July 2017 - 99
IEEE Consumer Electronics Magazine - July 2017 - 100
IEEE Consumer Electronics Magazine - July 2017 - 101
IEEE Consumer Electronics Magazine - July 2017 - 102
IEEE Consumer Electronics Magazine - July 2017 - 103
IEEE Consumer Electronics Magazine - July 2017 - 104
IEEE Consumer Electronics Magazine - July 2017 - 105
IEEE Consumer Electronics Magazine - July 2017 - 106
IEEE Consumer Electronics Magazine - July 2017 - 107
IEEE Consumer Electronics Magazine - July 2017 - 108
IEEE Consumer Electronics Magazine - July 2017 - 109
IEEE Consumer Electronics Magazine - July 2017 - 110
IEEE Consumer Electronics Magazine - July 2017 - 111
IEEE Consumer Electronics Magazine - July 2017 - 112
IEEE Consumer Electronics Magazine - July 2017 - 113
IEEE Consumer Electronics Magazine - July 2017 - 114
IEEE Consumer Electronics Magazine - July 2017 - 115
IEEE Consumer Electronics Magazine - July 2017 - 116
IEEE Consumer Electronics Magazine - July 2017 - 117
IEEE Consumer Electronics Magazine - July 2017 - 118
IEEE Consumer Electronics Magazine - July 2017 - 119
IEEE Consumer Electronics Magazine - July 2017 - 120
IEEE Consumer Electronics Magazine - July 2017 - 121
IEEE Consumer Electronics Magazine - July 2017 - 122
IEEE Consumer Electronics Magazine - July 2017 - 123
IEEE Consumer Electronics Magazine - July 2017 - 124
IEEE Consumer Electronics Magazine - July 2017 - 125
IEEE Consumer Electronics Magazine - July 2017 - 126
IEEE Consumer Electronics Magazine - July 2017 - 127
IEEE Consumer Electronics Magazine - July 2017 - 128
IEEE Consumer Electronics Magazine - July 2017 - 129
IEEE Consumer Electronics Magazine - July 2017 - 130
IEEE Consumer Electronics Magazine - July 2017 - 131
IEEE Consumer Electronics Magazine - July 2017 - 132
IEEE Consumer Electronics Magazine - July 2017 - 133
IEEE Consumer Electronics Magazine - July 2017 - 134
IEEE Consumer Electronics Magazine - July 2017 - 135
IEEE Consumer Electronics Magazine - July 2017 - 136
IEEE Consumer Electronics Magazine - July 2017 - 137
IEEE Consumer Electronics Magazine - July 2017 - 138
IEEE Consumer Electronics Magazine - July 2017 - 139
IEEE Consumer Electronics Magazine - July 2017 - 140
IEEE Consumer Electronics Magazine - July 2017 - 141
IEEE Consumer Electronics Magazine - July 2017 - 142
IEEE Consumer Electronics Magazine - July 2017 - 143
IEEE Consumer Electronics Magazine - July 2017 - 144
IEEE Consumer Electronics Magazine - July 2017 - Cover3
IEEE Consumer Electronics Magazine - July 2017 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20240102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20231112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20221112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20211112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202010
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202009
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202007
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202004
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202003
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202001
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201909
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201907
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201905
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201903
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201901
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201811
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201809
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201807
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201805
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201803
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_october2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_october2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2015
https://www.nxtbookmedia.com