Page numbers in italics indicate illustrations.

• Aaronson, Scott, 64
• ACT test, 50–57, 60, 65, 67
• Active SETI, 105–9
• afterlife of the brain, 8, 145
• AGI (artificial general intelligence), 9, 43
• AI (artificial intelligence), 1–15, 148–50
• alien/extraterrestrial, 5, 98–119 (See also alien/extraterrestrial AI)
• consciousness issues, 2–6 (See also consciousness)
• development of, 9–10
• implications, importance of thinking through, 2–3, 10
• Jetsons fallacy and, 12–13
• merging humans with AI, 6–8, 72–81 (See also merging humans with AI)
• mind design, concept of, 1
• postbiological, 99
• singularity, approach of, 11–12
• software, mind viewed as, 7–8, 120–47 (See also software, mind viewed as)
• transhumanism, 13–15 (See also transhumanism)
• uncertainties and unknowns regarding, 15
• AI consciousness, problem of, 3–6, 16–32, 148–49
• alien intelligences, postbiological, 5
• alien/extraterrestrial AI, 110–11
• biological naturalism, arguments against, 18–22, 34, 158n4
• capability of machines for consciousness, 17–18
• Chinese Room thought experiment and, 19–22, 20, 34, 148
• control problem, 4–5
• ethical treatment of conscious/potentially conscious AIs, 39, 67–69, 149
• isomorph thought experiment and, 26–31, 57, 158nn13–14, 159nn10–11
• “problem of other minds” and, 158n3
• slavery and, 4, 39
• techno-optimism, arguments for, 18, 23–26, 31, 34
• value placed on humans by, 5
• “Wait and See Approach” to, 33–34, 45
• AI slavery, 4, 39
• Alcor, 121, 145
• alien/extraterrestrial AI, 5, 98–119
• BISAs (biologically inspired superintelligent aliens), 113–19
• consciousness, 110–11
• control problem and, 104–5
• postbiological cosmos approach, 99–104
• SETI (Search for Extraterrestrial Intelligence), 101, 105–9, 106
• software theory, 119
• superintelligent AI minds, encountering, 109–19
• Alzheimer’s disease, 44, 58
• Amazon, 131
• Arrival (film), 107
• artificial general intelligence (AGI), 9, 43
• artificial intelligence. See AI
• asbestos, 66
• Asimov, Isaac, “Robot Dreams,” 57
• astronauts and conscious AI, 41–43, 42, 103

• Battlestar Galactica (TV show), 99
• Bello, Paul, 159n1
• Berger, Theodore, 44
• Bess, Michael, 12
• Big Think, 126
• biological naturalism, 18–22, 34, 158n4
• biologically inspired superintelligent aliens (BISAs), 113–19
• Black Box Problem, 46
• black holes, 10
• Blade Runner (film), 17, 57
• Block, Ned, 159n1, 162n11
• “The Mind as the Software of the Brain,” 134
• body. See specific entries at mind-body
• Bostrom, Nick, 4, 77, 80, 151, 160n1
• Superintelligence: Paths, Dangers, and Strategies, 5, 105, 111–13
• “boxing in” AIs, 53–54, 57
• Brain Preservation Foundation, 126
• brain-based materialism, 76–77, 80, 160n9
• Bringsjord, Selmer, 159n1
• Buddha, 76, 102, 137

• CAC (computationalism about consciousness), 24–25
• Cartesian dualism, 140–41
• Center for Mind Design (thought experiment), 1, 3, 6, 12, 70, 88, 89, 94, 148, 150
• Center of Theological Inquiry, Princeton, 110
• cerebellar agenesis, 22, 63
• Chalmers, David, 17, 18, 139
• The Conscious Mind, 28
• change, self’s survival during, 143–44
• Chinese Room (thought experiment), 19–22, 20, 34, 148
• chip test, 44, 57–61, 65, 67
• cholera, 66
• Clarke, Arthur C., 119
• clinicaltrials.gov, 157n4
• cognitive or functional consciousness, 49–50, 51, 67
• cognitive science, 23, 158n9, 161n8
• collective superintelligence, 111
• combinatorial language-like mental representations, 116–17
• Computational Cartesianism, 140
• computational structure of alien brains, 115–16
• computational theory of mind, 23–25, 78–81, 126, 158n4, 161n11
• connectionism, 161n11
• connectomics, 115–16
• consciousness, 2–6. See also AI consciousness, problem of; consciousness engineering; testing for consciousness in machines
• concept of, 2
• human moral systems and, 5, 39, 40–41, 110
• mind-body problem and, 127–28
• in new versus experienced drivers, 35–36
• phenomenal versus cognitive or functional, 49–50, 51
• reasons behind, 17
• consciousness engineering, 4, 33–45
• astronauts and conscious AI, 41–43, 42, 103
• to avoid conscious AI, 4, 39–40
• consumer desire for, 41
• economics and practicalities of AI production and, 37–39
• human-machine mergers, 44–45
• outmoding of consciousness in superintelligent AIs, 35–36
• reasons for creating conscious AIs, 40–43
• as safety issue, 37, 40–41
• Contact (film), 2
• control problem
• AI consciousness and, 4–5
• alien/extraterrestrial AI and, 104–5
• cryonics, 120–22, 121, 145–47
• cyborgs, 12, 72
• Cylon Raider, 99

• DARPA (Defense Advanced Research Projects Agency), 157n4
• Data from Star Trek, 135–37
• Davies, Paul, 43
• decomposition, functional, 118, 159n9
• Defense Advanced Research Projects Agency (DARPA), 157n4
• Descartes, René, 57, 129, 140
• Dick, Steven, 101
• dynamic systems theory, 161n11
• Dyson, Freeman, 41
• Dyson spheres, 107, 108

• essential properties, 75, 85, 142
• Eternal Sunshine of the Spotless Mind (film), 90
• ethics. See also morality
• consciousness and human moral systems, 5, 39, 40–41, 110
• creation of AIs with uncertain conscious status, 68–69
• Precautionary Principle, 66–69
• slavery and AI consciousness, 4, 39
• treatment of conscious/potentially conscious AIs, 39, 67–69, 149
• Ex Machina (film), 9, 149
• excluded middle, principle of, 68–69
• extraterrestrial intelligence. See alien/extraterrestrial AI
• Extropians, 14

• Facebook, 4, 120, 131
• Francis (pope), 110
• Freaky Friday (film), 51
• functional decomposition, 118, 158n9
• functional immortality, 8, 135, 137
• functional or cognitive consciousness, 49–50, 51, 67
• fusion-optimism, 73, 80–82, 87–89, 92, 95, 119, 122, 125, 133–34, 138, 163n11
• Future of Humanity Institute, Oxford University, 13

• Garza, Mara, 68
• Gates, Bill, 4, 105
• global workspaces, 117–18
• Go (game), 9
• Google, 4, 9, 10, 12, 39

• HAL 9000, 53
• Harmon, Amy, 122, 145
• Hawking, Stephen, 4, 41, 104, 120, 122, 124
• Hayworth, Ken, 126
• Her (film), 9, 10, 14, 19, 37, 41, 46
• Heraclitus, 143
• hippocampus, artificial, 12, 44, 69, 145
• Hopkins, Anthony, 33
• “hot zone” of sensory processing, 38
• Hughes, James, 161n10
• Hume, David, 76
• Huxley, Julian, 13

• I, Robot (film), 149
• IBM True North chip, 64
• idealism, 130, 163n17
• IIT (integrated information theory), 61–65
• illusion, self viewed as, 76, 77, 137, 161n10
• immortality, functional, 8, 135, 137
• Independence Day (film), 107
• instantiation of software program, mind viewed as, 134–44
• Institute for Advanced Study, Princeton, 6, 41–43
• instrumental convergence thesis, 113
• integrated information theory (IIT), 61–65
• isomorph thought experiment, 26–31, 57, 158n10, 159nn11, 13, 14

• Jackson, Frank, 159n5
• Jeopardy (TV show), 9
• The Jetsons (TV show) and Jetsons fallacy, 12, 69

• Kaku, Michio, 77
• Kernel, 12, 58
• Knowledge Argument, 159n5
• Koch, Christof, 63–64
• Kurzweil, Ray, 10, 14, 16, 33, 73, 75–76, 77, 80, 85, 143

• language-like mental representations, 116–17
• The Late Lessons from Early Warnings Report, 66
• Locke, John, Essay Concerning Human Understanding, 161n8
• “locked in” patients (conscious but unable to communicate), 63
• Lowe, E. J., 141, 163n25

• Mandik, Pete, 102–3, 119
• The Matrix (film), 125
• Mazie, Steven, 126
• memory
• partial erasure of, 89–90, 91
• patients unable to lay down, artificial hippocampus for, 44
• reduplication problem, 84–85, 88
• merging humans with AI, 6–8, 72–81. See also afterlife of the brain; patternism; software, mind viewed as; transhumanism
• AI consciousness problem, as way of dealing with, 6–7
• computational theory of mind and, 78–81
• consciousness engineering, as means of, 44–45
• current efforts at, 13
• fusion-optimism regarding, 73, 80–82, 87–89, 92, 95, 119, 122, 125, 133–34, 138, 163n11
• personhood and personal identity, defining, 74–77, 96–97
• projected trajectories of, 73–74
• testing for consciousness and, 69–71
• thought experiment, 72–73
• zombification problem, 7
• metaphysical humility, value of stance of, 94–97
• Millner, Uri, 41
• mind design, concept of, 1
• Mind-Body Problem, 127–30, 139, 141
• mind-body separation, ability to imagine, 51, 55, 57
• modified patternism, 88, 89, 90, 92, 93
• Moore’s Law, 74
• morality, 3, 31, 39, 53, 68, 105, 151. See also ethics
• MP3 recordings, 37–38
• Musk, Elon, 4, 7, 73, 77

• N=1 or small-N approach, 63, 100
• nanobots, 89, 92, 95, 144
• NASA, 5, 101
• neural correlate for consciousness, 60–61, 61
• neural lace, 7, 12, 69
• Neuralink, 12, 58
• neuromorphic systems, 40, 64, 158n4
• Nietzsche, Friedrich, 76, 137
• Thus Spoke Zarathustra, 82
• no-self view, 76, 77, 137, 161n10

• Olson, Eric, 161n9
• orthogonality thesis, 112

• panpsychism, 63, 128, 130, 139, 158n7, 163n17
• Parfit, Derek, 96, 102, 137
• patternism, 77, 82–97
• change, self’s survival during, 143–44
• enhancements through gradual replacement of neural tissue, 88–92, 95
• metaphysical humility, value of stance of, 94–97
• modified patternism, 88, 89, 90, 92, 93
• personhood and personal identity, defining, 96–97
• reduplication problem, 84–85, 88, 123–24
• Sawyer’s Mindscan and uploading minds, 82–84, 86–87, 95
• software approach to the mind and, 78–81, 125, 127, 134, 143–44
• spatiotemporal continuity and, 85–89, 86–87, 93, 127, 163n10
• substrates, transferring, 92–94
• theory of, 78–81
• PC (phenomenal consciousness), 49, 50, 51, 56
• Pearce, David, 151
• personhood and personal identity, defining, 74–77, 96–97
• phenomenal consciousness (PC), 49, 50, 51, 56
• Φ values, 62–65, 160n10
• physicalism, 76, 129, 139, 158n4, 161n9
• postbiological cosmos approach, 99–104
• postbiological intelligence, 99. See also AI
• posthumans, 72, 73, 86, 143, 152
• post-traumatic stress disorder (PTSD), 44, 58
• Precautionary Principle, 66–69
• “problem of other minds,” 157n3
• program instantiation, mind viewed as, 134–44
• Program View of the mind. See software, mind viewed as
• property dualism, 129–30, 139
• psychological continuity theory, 76, 77, 89, 160n8
• PTSD (post-traumatic stress disorder), 44, 58
• Putnam, Hilary, 140

• quality of consciousness, judging, 48–49
• quality superintelligence, 112
• Quantum Information Center, University of Texas at Austin, 64

• R2D2, 33, 126
• reduplication problem, 84–85, 123–24
• religion, AIs, and extraterrestrials, 110
• Rucker, Rudy, Software, 125

• Sacks, Oliver, 44
• safety issue, consciousness engineering as, 37, 40–41
• Sagan, Carl, 2, 98
• SAM (software approach to the mind), 124–27. See also software, mind viewed as
• Sawyer, Robert, Mindscan, 82–84, 86–87, 95
• Scharf, Caleb, 41–42
• Schisler, Josh, 120–21, 145
• Schneider, Susan
• The Language of Thought, 126
• at Starshot Initiative, 41–43
• Schwitzgebel, Eric, 68
• Search for Extraterrestrial Intelligence (SETI), 101, 105–9, 106
• Searle, John, 19–22, 20, 158n4
• self viewed as illusion, 76, 77, 137, 161n10
• sensory processing “hot zone,” 38
• separation of mind from body, ability to imagine, 51, 55, 57
• SETI (Search for Extraterrestrial Intelligence), 101, 105–9, 106
• SIM and SIM* (software instantiation view of/approach to the mind), 134–42. See also software, mind viewed as
• singularity, approach of, 10–11
• Siri, 37
• slavery and AI consciousness, 4, 39
• small-N or N=1 approach, 63, 100
• social development, human, versus technological progress, 2
• software, mind viewed as, 7–8, 120–47
• abstract nature of programs and, 131–33, 132
• alien/extraterrestrial AI and, 119
• change, self’s survival of, 143–44
• computational theory of mind, 23–25, 78–81, 158n4
• functional immortality and, 135, 137
• merging humans with AI and, 78–81
• Mind-Body Problem and, 127–30, 139, 141
• nonviability of, 126, 130–34
• patternism and, 78–81, 125, 127, 134, 143–44
• SAM (software approach to the mind), 124–27
• SIM and SIM* (software instantiation view of/approach to the mind), 134–44
• Suozzi, Kim, and, 120–22, 121, 133, 138, 144–46, 145
• uploading and, 122–26, 133, 136–37, 146–47
• soul theory, 76, 77, 88
• spatiotemporal continuity, 85–89, 86–87, 93, 127, 163n10
• speed superintelligence, 111
• Star Trek: The Next Generation (TV show), 135–37
• Star Wars (film), 12–13, 33
• Starshot Initiative, 41–43, 42
• substance dualism, 128–29, 140–41
• substrate independence and transferring substrates, 24, 92–94, 150
• Summit supercomputer, 11–12
• Suozzi, Kim, 120–22, 121, 133, 138, 144–46, 145
• superintelligence, 35–36, 109–19
• symbolic/language of thought approach, 161n11
• Synapse (U.S. Defense Department), 14
• Systems Reply to Chinese Room conundrum, 21–22

• technological progress versus human social development, 2
• techno-optimism
• about AI consciousness, 18, 23–26, 31, 34
• merging with AI and, 73
• Tegmark, Max, 4
• Terminator films, 3, 104
• testing for consciousness in machines, 5–6, 46–71
• ACT test, 50–57, 60, 65, 67
• chip test, 44, 57–61, 65, 67
• difficulties and complications in, 46–51
• IIT (integrated information theory) and, 61–65
• mind-machine mergers and, 69–71
• responding when machines test positive for consciousness, 65–69
• separation of mind from body, ability to imagine, 51, 55, 57
• Turing test, 56
• theory of mind, 58n3
• Tononi, Giulio, 61–64
• Transcendence (film), 124–25
• transhumanism, 13–15, 151–52. See also merging humans with AI
• on AI consciousness, 16
• defined, 73
• enhancements rejected by, 160n1
• patternism and, 77–81
• World Transhumanist Association, 151
• Transhumanist Declaration, 14, 151–52
• “The Transhumanist Frequently Asked Questions,” 80, 95–96, 152
• TrueNorth chip (IBM), 64
• Turing, Alan, and Turing test, 56, 140
• Turner, Edwin, 41–43, 54
• 2001: A Space Odyssey (film), 53

• UNESCO/COMEST report on Precautionary Principle, 66
• uploading
• patternism and, 80–81, 82–84, 95
• software, mind viewed as, 122–26, 133, 136–37, 146–47

• vegetative state, human patients in, 61–62

• Westworld (TV show), 17, 33, 45
• Witkowski, Olaf, 41–42
• World Transhumanist Association, 151

• X-files (TV show), 116

• zombies, 7, 41, 49–50, 51, 56, 88, 102, 131