Subject Index
A
Absolute transfer 261–266
Action pattern 76–77
Activity wheel 177
Adaptation-level theory 261
Adaptive versus maladaptive 8–9
Adjunctive behaviors 185–186
American Sign Language (ASL) 293–294
Anticipatory drinking 118–119, 231
Anticipatory errors 92–94, 231–235
Anticipatory goal responses 116–120, 229–232
Anticipatory prefeeding 229–232
Anticipatory responses 31, 66, 79, 117–120
Arbitrary (see omission, superstition)
versus obligatory 11–14, 159–160
associations 340
responses 168
ASL (see American Sign Language)
Attention and latent learning 107–109
Autonomous (see robotics)
Autoshaping 152–154
Aversion 183
operant avoidance 190–193
B
Backward conditioning 35, 79–80
Belief versus evidence 2
Bioassay 165–168
Biological
constraints 159–160
effort 155
utility 155
Bonobo 317
learning 174–175
robots 170–174
Brain stimulation reinforcement 129
C
Caching food 254
Cell assemblies 270
CER (see conditioned emotional response)
Chance expectancy 334–336
Chemical alarm 41–42
Cheremeic structure 341–342
Clever Hans controls 323–325
Cognitive expectancy 95–96
Common sense 63–64
Communication
information and 323–325
language and 340
motive and 301–302
Comparative intelligence 281–282
Comparator (see homeostasis)
Compass bearing 244–248
Compatibility of stimulus and response 34–35, 189
Competing responses 211–217
Competition and contingency 216–217
Competition and inhibition 167
Concepts
categories and 339–340
conceptual errors 341–342
Conditioned
eating 145–146
emotional response (CER) 38–39
inhibition (sIr) 207–209
mobbing 40–41
reinforcement (see secondary reward)
rejection 120–124
reward (see secondary reward)
Conditioning versus maintenance 53–55
Conflict 194–203
Consequences 63
Constraints & Contingency 159–160
Contiguity 62–67
Contingency 62–63, 88, 191–193
competition and 216–217
constraints and 159–160
omission 68–69
S-R-S* 68–75
S-S* 67–68
Continuous reinforcement 52
Contralateral connection 170, 195
Control, experimental 4
Correlation versus experiment 7–8
Correction procedure 337
Creativity 312–313
Cross-fostering 8, 290–292, 297
Cusp 67
Cybernetics 168
D
Dead reckoning (see navigation)
Defensive aggression 183–184
Delay conditioning 81–82
Delay of reward 224
Delay-of-reinforcement gradient 90
Dependent variable 3
Development
environment and 290
of sign language 313–314
Dimensional stimuli 268–269
Discovery versus understanding 1
Discrimination training 55–58
simultaneous procedure 56–58
successive procedure 55–56
Discrimination hypothesis (see partial reward)
Discriminative stimulus (Sd) 145–148
Distributed practice 208–209
Dream deprivation 184–185
Drive 180
drive discrimination 116–118
drive reduction 206
Duality of patterning 340–342
E
E = environment 61
E-S-Q-R paradigm 61–62
Earning pain 193
Earning versus free loading 155–156
Elicited response 122
Emitted response 122
Emotional words 42
Epsilon excitatory drug 165–166
Ethology 13
experimental 9–10
operational definition and 10, 342
of Skinner box 15
(see also arbitrary, obligatory)
Evidence versus belief 1
Evocative stimuli 181
Ex post facto error 162–163, 165
Excitation 213
gradient 263
versus inhibition 206–208
Excitatory potential (sEr) 206–207
Expectancy 96
Experimental
control 4
design 161–163
ethology 9
psychology 14
Experimentation versus correlation 7–8
after partial reward 221
overtraining and 210–211
Exemplars and items of vocabulary 328–339
Extramaze stimuli 237, 239, 241–253
Extrinsic incentives 301–302
Eyeblink 20
F
Facial expression 11–12
Facial vision 2–3
Fear 187–189 (see also conditioned emotional response)
versus discriminative stimuli 145
versus sign stimuli 168
and extinction, spontaneous recovery 213–216
Field naturalists 13
Field studies 13
Finger spelling 293–294
Forward conditioning 35
Foster family 293, 295, 297, 303, 320–321, 327, 342
Fractional response 30–31, 66, 118–121
Free exploration 105–106
Free feeding 156
Freeloading versus earning 155
Frequency 46
Frustration hypothesis 225–228
energizing 226–227
versus secondary reward 228
Functional categories 303–311
Fuzzy categories 201–202, 303, 317
Fuzzy control of motives 196–203
availability and demand 200
Fuzzy logic 196–203
G
Generality of conditioning
classical 32–35
instrumental 48–19
Goal-gradient 89–95
H
Habit strength (sHr) 206–209
Habit
versus problem solving 278–280, 286–287
versus hypotheses 270–274, 276
Handling 102–103
Hebbian cell assemblies 270
Hedonism 69–70, 76, 165–169, 175, 228
Higher-order conditioning 70–72
Homeostasis 194–195
Hunches 65
Hybrid paradigm 73–74
Hypotheses of learners 270–274, 276
I
Implications 65
Imprinting 40
Independent observers 16, 49, 326–327, 333–334, 339
Independent variable 4
Induction and suppression 184–185
Inflections of sign language 293, 314, 342
Inhibition 205–213
competition and 167–168, 213–219
conditioned 207–212
excitation and 206
gradient of 262–263
of feeding 167
reactive 207–212
reinforcement and 57
Input 62
Instinct 14
Instrumental conditioning 18, 43
Inter-S* interval 186
Intermittent reinforcement 52 (see also partial reward)
Interstimulus interval (ISI) 35–38, 66–67
forward 35
secondary reward and 138–140
simultaneous 35
Interval schedules 52–53
Intervening variable 5–7
Intramaze stimuli 241–243
Introspection 4–5
Intuition 65
Iota inhibitory drug 167–168
Ipsilateral connection 172, 195
Ir(see reactive inhibition)
Irrelevant drive 107–109
Irritability 177–180
ISI (see interstimulus interval)
Items and exemplars of vocabulary 328–339
K
Knee jerk conditioning 20–22
L
Larder hoarding 254
Latch problem 180–181, 284–286
Latent extinction 110–116
Latent inhibition (see habituation)
Latent learning 96–99
Learning sets 274–278
Leg withdrawal conditioning 19–20
Loulis project 321–322
M
Magazine clicks
as discriminative stimulus 146–147
Magazine training 142
Maintenance
versus conditioning 53–55
versus reinforcement 131–132
Maladaptive versus adaptive 8–9
Markers, linguistic 303, 307–310
Massed practice 208–209
Mazes 49–51
cross 238
Dashiel 99–100
Hampton Court 49–50
maze plans 50
Morris water 253–254
radial arm 251–253
Mechanisms of conditioning 62–63
Misbehavior 156–159
Mobbing 40–41
Model of sign language 293
Modular language 314–315
conversation 317–319
semantics 315–17
Monarch butterflies 120–121
Money 148–151
Motivation and drive 176–177
primary 180–181
communication 302
N
Natural language categories 317, 327
Navigation 248–251
Negative acceleration 7
Neural networks 269–270
O
Obligatory
responses 168–169
(see also action pattern, omission, species-specific, superstition)
Observation and experiment 13
Odor trails 243–244
One-trial-per-day 224
Operant avoidance 190–193
Operant conditioning chamber 51–52, 143
Operant conditioning Type R 43, 122–125
discrete trials 219–220
inappropriate for chimpanzees 298–301
Operational definition 2, 10 (see also dependent variable, experimental control, independent variable, intervening variable)
Orienting response (OR) 23–24
Output 62
Overtraining
extinction and 210–211
problem solving and 278–281, 284, 286–287
reversal and 273–274
P
Pain center 167
Parallel processing 197
Partial (intermittent) reinforcement 52
Partial reward
acquisition effect 220–221
amount of practice 221–223
discrete trials 222–223
discrimination hypothesis 224–225
extinction effect 221
frustration hypothesis 225–228
generality 223
goal responses 229–236
prefeeding 221
operant procedure 219–222
secondary reward 134–138
Pavlovian conditioning 18
Peak shift 258–261
Perseverative errors 93–94
Phonemic structure of English 341
Phrases 311
creative 313–314
development 311–312
Place versus response learning 237–241
Poker chips for chimpanzees 148–152
Polydipsia 185
Post reinforcement Pause 185–186
Pragmatic devices 324
Preconditioning 72–75
Predrinking 117–120
Prefeeding 117–118, 155–159, 221
Preliminary training 142–143
Premack proposal (see competing responses)
Preparatory response 31–32
Presolution period 271–273
Primary motives, needs 126, 180–181, 302
Primary reward 126
Problem solving
food incentive and 284–287
past experience and 281–284
Pseudoconditioning 29 (see also sensitization)
Psychophysics of transposition 264–266
Punishment 45
Q
Q = state 62
Queuing 197–203
R
R = output 62
Rake problem 282–284
Random behavior 271
Random sample
with replacement 334
without replacement 335
Rapid eye movements (REM) 184
Rate of lever-pressing/key-pecking 46
Ratio schedules 52
Rc (see criterion response)
Reaction time 36
Reactive inhibition Ir 207–212, 213
Readiness 164–165
Reinforcement
versus inhibition 57–58
versus expectancy 88
versus maintenance 131–132
Reinforcements versus rewards 136
Reinforcer 129
Reinforcing brain stimulation 129, 166
Relational transfer 261–266
Reliability 16 (see also independent observers)
Reminiscence 209
Replication 319
Representations 169
Resistance to extinction 27, 48, 210
Respondent conditioning or Type S 43, 122–124
Response and stimulus defined 61–62
Response variability 46–48
Response versus place learning 237–241
Response-produced stimuli 82–85, 110, 117–118, 141–143
Response/stimulus compatibility 33–34, 189
Reversal and overtraining 273–274
for signing 328
in classical conditioning 68
versus reinforcement 136
Rhythmic patterns 80–81, 185–186
Robotics
autonomous 169–174
conflict 195–196
motives 182
navigation 255
Running speed and time 46
S
S = input 62
S* 64
contingency 88–89
sign stimuli 68–69, 76, 266–268
S-R-S* contingency 63, 68–75, 88–89
S-R-Sr 144–145
Sa (see arbitrary stimulus)
Scatter hoarding 254
Schedules of reinforcement 52–54
Sd (see discriminative stimulus)
Second-order conditioning 70–71
Secondary reinforcement (see secondary reward)
Secondary reward (Sr) 130–138
ISI 138–140
latent learning and 107–109
operational definition 130
versus discriminative stimulus 145
(see also frustration, money)
goal box 113–116
multiple-unit maze 89–90
Skinner Box 141–143
T maze 111–113
Segments of goal box, maze, Skinner box (see segmental analysis)
Sequences, goal box, maze, Skinner box (see segmental analysis)
Semicircular canals 245–248
Sensory conditioning (see preconditioning)
Sentence constituents 303–311
sEr (see excitatory potential)
Set points (see homeostasis)
Shaping (see autoshaping) 143
Shock evokes lever pressing 191–193
sHr(see habit strength)
Sibling relationships in a foster family 319–320
Sibling species 292
Sign language (see American Sign Language)
development 313–314
ethological considerations 295–297
sign language only 294–295
signs of ASL 338–339
useage 302–311
versus feedback 168–169
motivation and 181
Simultaneous conditioning 35
SIr (see conditioned inhibition)
Social conditioning 39–42
Species-specific action pattern 14, 16, 266
Speed of response 46
Speed of running 46, 90–91, 94–95
Speed-of-locomotion gradient 90–91, 94–95
Spence's model 262–264 (see also transposition)
Spontaneous alternation 240–246
Spontaneous recovery 27–28, 48, 205–206
Sr(see secondary reward)
State of the system (Q) 62
Stimulus and response defined 60–62
Stimulus change reinforcement 129, 179–180
Stimulus generalization
transfer and 256–258
peak shift 258–261
dimensions 266–269
Stimulus motivation 181–182
Stimulus substitution 66, 86, 158
Stimulus/response compatibility 34–35, 189
Subject selection 163–164
Subjective report 4–5
Super babies 267–268
Supernormal response 184–185
Supernormal stimulus 268
Superstitious behavior 154–155
Suppression and induction 184–185
T
target signs 332
Taste aversion (see also conditioned rejection) 33–34, 121–124,230–232
Teaching versus testing 327
Teaching signs 297–302
Temporal conditioning 185
Temporal patterns 77–82
Testing vocabulary
ASL 338–339
chance expectancy 334–336
disruption by reward 328
novelty 330–332
objectives 326–327
operational definition 325, 343
productive versus forced choice tests 336–338
results 333–334
target signs 332–333
Theory and experiment 59–60
Time and sequence (see ISI)
Time schedules 55
Token rewards for chimpanzees 148–151
Top-down 79
learning 240
robotics 169–174
Transfer (see also transposition) 255–256
Transposition 261–266
Two choice situations 214–215
Two-factor theory 188–189
Type R or operant conditioning 43, 122
Type S or respondent conditioning 43, 122
U
Unconditioned response (UCR) 25–26, 33
Unconditioned stimulus (UCS) 22–24, 46
Unconditioned versus conditioned responses 30–31
Understanding versus discovery 1
Unrewarded trials 96–105
Uses of signs 302–312
V
Variability
individual 155
response 46
W
WGTA (Wisconsin General Testing Apparatus) 275, 285–286
Win-shift/lose-stay 276
Win-stay learning 174
Win-stay/lose-shift 276
Wisconsin General Testing Apparatus (WGTA) 275, 285–286
Word recognition 161–163
Word-for-sign translation 311–312
Y
3.145.90.26