Subject Index

A

Absolute transfer 261–266

Acquisition 27, 48, 205

Action pattern 76–77

Activity wheel 177

Adaptation-level theory 261

Adaptive versus maladaptive 8–9

Adjunctive behaviors 185–186

American Sign Language (ASL) 293–294

Amplitude 25–26, 46

Anticipatory drinking 118–119, 231

Anticipatory errors 92–94, 231–235

Anticipatory goal responses 116–120, 229–232

Anticipatory prefeeding 229–232

Anticipatory responses 31, 66, 79, 117–120

Arbitrary (see omission, superstition)

versus obligatory 11–14, 159–160

associations 340

behavior 154–155, 159

learning 14–15, 89

responses 168

stimulus Sa 10, 24, 33–35

work 155, 159, 166, 167

ASL (see American Sign Language)

Attention and latent learning 107–109

Autonomous (see robotics)

Autoshaping 152–154

Aversion 183

Avoidance 45, 186–189

operant avoidance 190–193

Avoiding food 154, 156

B

Backward conditioning 35, 79–80

Belief versus evidence 2

Bioassay 165–168

Biological

constraints 159–160

effort 155

utility 155

Bonobo 317

Bottom-up 89, 173

learning 174–175

robots 170–174

Brain stimulation reinforcement 129

C

Caching food 254

Cell assemblies 270

CER (see conditioned emotional response)

Chance expectancy 334–336

Chemical alarm 41–42

Cheremeic structure 341–342

Clever Hans controls 323–325

Cognitive expectancy 95–96

Cognitive map 96–98, 237–240

Color vision 9–10, 269

Common sense 63–64

Communication

information and 323–325

language and 340

motive and 301–302

Comparative intelligence 281–282

Comparator (see homeostasis)

Compass bearing 244–248

Compatibility of stimulus and response 34–35, 189

Competing responses 211–217

Competition and contingency 216–217

Competition and inhibition 167

Concepts

categories and 339–340

communication and 323, 329

conceptual errors 341–342

Conditioned

eating 145–146

emotional response (CER) 38–39

inhibition (_sI_r) 207–209

mobbing 40–41

reinforcement (see secondary reward)

rejection 120–124

response (CR) 25, 30–32

reward (see secondary reward)

stimulus (CS) 23–24, 33

Conditioning versus maintenance 53–55

Conflict 194–203

Consequences 63

Constraints & Contingency 159–160

Contiguity 62–67

Contingency 62–63, 88, 191–193

competition and 216–217

constraints and 159–160

omission 68–69

S-R-S* 68–75

S-S* 67–68

Continuous reinforcement 52

Contralateral connection 170, 195

Control, experimental 4

Correlation versus experiment 7–8

Correction procedure 337

Creativity 312–313

Criterion response 57, 212

Cross-fostering 8, 290–292, 297

Cusp 67

Cybernetics 168

D

Dead reckoning (see navigation)

Defensive aggression 183–184

Delay conditioning 81–82

Delay of reward 224

Delay-of-reinforcement gradient 90

Dependent variable 3

Development

environment and 290

of sign language 313–314

Dimensional stimuli 268–269

Discovery versus understanding 1

Discrimination training 55–58

simultaneous procedure 56–58

successive procedure 55–56

Discrimination hypothesis (see partial reward)

Discriminative stimulus (Sd) 145–148

Distributed practice 208–209

Dream deprivation 184–185

Drive 180

drive discrimination 116–118

drive reduction 206

Duality of patterning 340–342

E

E = environment 61

E-S-Q-R paradigm 61–62

Earning pain 193

Earning versus free loading 155–156

Elicited response 122

Emitted response 122

Emotional words 42

Epsilon excitatory drug 165–166

Escape 44–45, 186

Ethology 13

experimental 9–10

operational definition and 10, 342

of Skinner box 15

(see also arbitrary, obligatory)

Evidence versus belief 1

Evocative stimuli 181

Ex post facto error 162–163, 165

Excitation 213

gradient 263

versus inhibition 206–208

Excitatory potential (sEr) 206–207

Expectancy 96

Experimental

control 4

design 161–163

ethology 9

psychology 14

Experimentation versus correlation 7–8

Extinction 27, 48, 204–205

after partial reward 221

overtraining and 210–211

resistance to 27, 48, 210

Exemplars and items of vocabulary 328–339

Extramaze stimuli 237, 239, 241–253

Extrinsic incentives 301–302

Eyeblink 20

F

Facial expression 11–12

Facial vision 2–3

Fear 187–189 (see also conditioned emotional response)

Feed backward 77, 150

versus discriminative stimuli 145

versus sign stimuli 168

Feed forward 78, 150, 168

and extinction, spontaneous recovery 213–216

Field naturalists 13

Field studies 13

Finger spelling 293–294

Forward conditioning 35

Foster family 293, 295, 297, 303, 320–321, 327, 342

Fractional response 30–31, 66, 118–121

Free exploration 105–106

Free feeding 156

Freeloading versus earning 155

Frequency 46

Frustration hypothesis 225–228

energizing 226–227

versus secondary reward 228

Functional categories 303–311

Fuzzy categories 201–202, 303, 317

Fuzzy control of motives 196–203

availability and demand 200

Fuzzy logic 196–203

G

Generality of conditioning

classical 32–35

instrumental 48–19

Goal-gradient 89–95

H

Habit strength (sHr) 206–209

Habit

versus problem solving 278–280, 286–287

versus hypotheses 270–274, 276

Habituation 28–29, 71, 72

Handling 102–103

Hebbian cell assemblies 270

Hedonism 69–70, 76, 165–169, 175, 228

Higher-order conditioning 70–72

Homeostasis 194–195

Honeybees 9–11, 249–251

Hunches 65

Hybrid paradigm 73–74

Hypotheses of learners 270–274, 276

I

Implications 65

Imprinting 40

Independent observers 16, 49, 326–327, 333–334, 339

Independent variable 4

Induction and suppression 184–185

Inflections of sign language 293, 314, 342

Inhibition 205–213

competition and 167–168, 213–219

conditioned 207–212

excitation and 206

gradient of 262–263

of feeding 167

reactive 207–212

reinforcement and 57

Input 62

Instinct 14

Instrumental conditioning 18, 43

Inter-S* interval 186

Intermittent reinforcement 52 (see also partial reward)

Interstimulus interval (ISI) 35–38, 66–67

backward 35, 79–80

forward 35

secondary reward and 138–140

simultaneous 35

Interval schedules 52–53

Intervening variable 5–7

Intramaze stimuli 241–243

Introspection 4–5

Intuition 65

Iota inhibitory drug 167–168

Ipsilateral connection 172, 195

I_r(see reactive inhibition)

Irrelevant drive 107–109

Irritability 177–180

ISI (see interstimulus interval)

Items and exemplars of vocabulary 328–339

K

Knee jerk conditioning 20–22

L

Larder hoarding 254

Latch problem 180–181, 284–286

Latency 26, 46

Latent extinction 110–116

Latent inhibition (see habituation)

Latent learning 96–99

Law of effect 89, 127–129

Learning curve 6, 271

Learning sets 274–278

Leg withdrawal conditioning 19–20

Length of the ISI 35, 66

Loulis project 321–322

M

Magazine clicks

as discriminative stimulus 146–147

as secondary reward 131, 146

Magazine training 142

Maintenance

versus conditioning 53–55

versus reinforcement 131–132

Maladaptive versus adaptive 8–9

Markers, linguistic 303, 307–310

Massed practice 208–209

Mazes 49–51

cross 238

Dashiel 99–100

Hampton Court 49–50

linear 93–94, 232–234

maze plans 50

Morris water 253–254

radial arm 251–253

Mechanisms of conditioning 62–63

Misbehavior 156–159

Mobbing 40–41

Model of sign language 293

Modular language 314–315

conversation 317–319

semantics 315–17

Monarch butterflies 120–121

Money 148–151

Motivation and drive 176–177

primary 180–181

communication 302

N

Natural language categories 317, 327

Navigation 248–251

Negative acceleration 7

Neural networks 269–270

Nonfeeding 167, 185–186

O

Obligatory

responses 168–169

versus arbitrary 11–14, 159

(see also action pattern, omission, species-specific, superstition)

Observation and experiment 13

Odor trails 243–244

Omission contingency 68, 153

One-trial-per-day 224

Operant avoidance 190–193

Operant conditioning chamber 51–52, 143

Operant conditioning Type R 43, 122–125

discrete trials 219–220

inappropriate for chimpanzees 298–301

Operational definition 2, 10 (see also dependent variable, experimental control, independent variable, intervening variable)

Orienting response (OR) 23–24

Output 62

Overtraining

extinction and 210–211

problem solving and 278–281, 284, 286–287

reversal and 273–274

P

Pain center 167

Parallel processing 197

Parsimony 64–65, 269

Partial (intermittent) reinforcement 52

Partial reward

acquisition effect 220–221

amount of practice 221–223

discrete trials 222–223

discrimination hypothesis 224–225

extinction effect 221

frustration hypothesis 225–228

generality 223

goal responses 229–236

prefeeding 221

operant procedure 219–222

secondary reward 134–138

Pavlovian conditioning 18

Peak shift 258–261

Perseverative errors 93–94

Phonemic structure of English 341

Phrases 311

creative 313–314

development 311–312

Place versus response learning 237–241

Pleasure center 129, 166

Poker chips for chimpanzees 148–152

Polydipsia 185

Post hoc 106, 127–129

Post reinforcement Pause 185–186

Pragmatic devices 324

Preconditioning 72–75

Predrinking 117–120

Prefeeding 117–118, 155–159, 221

Preliminary training 142–143

Premack proposal (see competing responses)

Preparatory response 31–32

Presolution period 271–273

Primary motives, needs 126, 180–181, 302

Primary reward 126

Probe trials 19, 25, 258

Problem solving

drill and 278, 280, 286–287

food incentive and 284–287

past experience and 281–284

versus habit 278–280, 286–287

Pseudoconditioning 29 (see also sensitization)

Psychophysics of transposition 264–266

Punisher 129, 167–168

Punishment 45

Q

Q = state 62

Queuing 197–203

R

R = output 62

R-S* contingency 87, 122–124

Rake problem 282–284

Random behavior 271

Random sample

with replacement 334

without replacement 335

Rapid eye movements (REM) 184

Rate of lever-pressing/key-pecking 46

Ratio schedules 52

R_c (see criterion response)

Reaction time 36

Reactive inhibition I_r 207–212, 213

Readiness 164–165

Reaquisition 28, 48, 204–206

Reextinction 28, 48, 204–206

Reinforcement

versus inhibition 57–58

versus expectancy 88

versus maintenance 131–132

Reinforcements versus rewards 136

Reinforcer 129

Reinforcing brain stimulation 129, 166

Relational transfer 261–266

Reliability 16 (see also independent observers)

Reminiscence 209

Replication 319

Representations 169

Resistance to extinction 27, 48, 210

Respondent conditioning or Type S 43, 122–124

Response and stimulus defined 61–62

Response measures 25–26, 46

Response variability 46–48

Response versus place learning 237–241

Response-produced stimuli 82–85, 110, 117–118, 141–143

Response/stimulus compatibility 33–34, 189

Reversal and overtraining 273–274

Reward 44, 104–106

for signing 328

in classical conditioning 68

versus reinforcement 136

Rhythmic patterns 80–81, 185–186

Robotics

autonomous 169–174

conflict 195–196

motives 182

navigation 255

Running speed and time 46

S

S = input 62

S* 64

contingency 88–89

sign stimuli 68–69, 76, 266–268

S-R contiguity 63, 75–82, 86

S-R-S* contingency 63, 68–75, 88–89

S-R-S^r 144–145

S-S contiguity 62, 65–67

S-S* contingency 63, 67–68

S^a (see arbitrary stimulus)

Scatter hoarding 254

Schedules of reinforcement 52–54

S^d (see discriminative stimulus)

Second-order conditioning 70–71

Secondary reinforcement (see secondary reward)

Secondary reward (S^r) 130–138

ISI 138–140

latent learning and 107–109

operational definition 130

versus discriminative stimulus 145

(see also frustration, money)

Segmental analysis

goal box 113–116

multiple-unit maze 89–90

Skinner Box 141–143

T maze 111–113

Segments of goal box, maze, Skinner box (see segmental analysis)

Sequences, goal box, maze, Skinner box (see segmental analysis)

Semicircular canals 245–248

Sensitization 29–30, 71, 72

Sensory conditioning (see preconditioning)

Sentence constituents 303–311

_sE_r (see excitatory potential)

Set points (see homeostasis)

Shaping (see autoshaping) 143

Shock evokes lever pressing 191–193

_sH_r(see habit strength)

Sibling relationships in a foster family 319–320

Sibling species 292

Sign language (see American Sign Language)

development 313–314

ethological considerations 295–297

sign language only 294–295

signs of ASL 338–339

useage 302–311

Sign stimuli 76, 266–268

versus feedback 168–169

motivation and 181

Simultaneous conditioning 35

_SI_r (see conditioned inhibition)

Skilled sequences 229, 231

Skinner box 51, 141–143

Social conditioning 39–42

Species-specific action pattern 14, 16, 266

Speed of response 46

Speed of running 46, 90–91, 94–95

Speed-of-locomotion gradient 90–91, 94–95

Spence's model 262–264 (see also transposition)

Spontaneous alternation 240–246

Spontaneous recovery 27–28, 48, 205–206

S^r(see secondary reward)

State of the system (Q) 62

Stimulus and response defined 60–62

Stimulus change reinforcement 129, 179–180

Stimulus generalization

transfer and 256–258

peak shift 258–261

dimensions 266–269

Stimulus motivation 181–182

Stimulus substitution 66, 86, 158

Stimulus/response compatibility 34–35, 189

Subject selection 163–164

Subjective report 4–5

Super babies 267–268

Supernormal response 184–185

Supernormal stimulus 268

Superstitious behavior 154–155

Suppression and induction 184–185

T

target signs 332

Taste aversion (see also conditioned rejection) 33–34, 121–124,230–232

Teaching versus testing 327

Teaching signs 297–302

Temporal conditioning 185

Temporal patterns 77–82

Testing vocabulary

apparatus 325–327, 329

ASL 338–339

chance expectancy 334–336

disruption by reward 328

errors 326, 341–342

novelty 330–332

objectives 326–327

operational definition 325, 343

productive versus forced choice tests 336–338

results 333–334

target signs 332–333

Theory and experiment 59–60

Time and sequence (see ISI)

Time schedules 55

Token rewards for chimpanzees 148–151

Top-down 79

learning 240

robotics 169–174

Traits 303, 307–309

Transfer (see also transposition) 255–256

Transposition 261–266

Two choice situations 214–215

Two-factor theory 188–189

Type R or operant conditioning 43, 122

Type S or respondent conditioning 43, 122

U

Unconditioned response (UCR) 25–26, 33

Unconditioned stimulus (UCS) 22–24, 46

Unconditioned versus conditioned responses 30–31

Understanding versus discovery 1

Unrewarded trials 96–105

Uses of signs 302–312

V

Variability

individual 155

response 46

W

Warning interval 187, 189–190

WGTA (Wisconsin General Testing Apparatus) 275, 285–286

WH questions 303, 311

Win-shift/lose-stay 276

Win-stay learning 174

Win-stay/lose-shift 276

Wisconsin General Testing Apparatus (WGTA) 275, 285–286

Word recognition 161–163

Word-for-sign translation 311–312

Y

Yoked control 101–102, 160–165