Unit 3 · 3.8
Operant Conditioning
Unit 3 is 15–25% of MCQ. Operant items are won by naming the exact cell of the 2×2 and the exact schedule — not by saying ‘rewards work.’ · about 5 minutes with the essay beats.
People change on a clock. Learning is not a personality; it is a consequence you can name.
Read the scene first. The term will wait. When it lands, you will be able to use it on a stranger’s story — that is the exam, and that is also why this subject is interesting.
A scene you already lived
Do not hunt the term yet. Let this sit. The exam will hand you a stranger’s version of the same night.
A younger sibling repeats the joke that got a laugh yesterday and drops the one that got silence. Nobody lectured. The environment taught. Likes, streaks, ‘read’ receipts, a coach who blows the whistle, a house rule that removes the charger: these are consequences sitting on behaviors, changing the future rate of those behaviors. If you can name the cell, you can see the room. If you cannot, you will call everything a reward and miss the mark.
What the paper actually asks
These are the scoring targets. If you can do them on a new story, you are ready — flashcards can wait.
- Name the exact consequence: positive/negative × reinforcement/punishment. Four cells, no hand-waving.
- Read a schedule: fixed or variable, ratio or interval — hyphens in the names.
- Negative reinforcement is not punishment. Classical is association of stimuli; operant is consequence of behavior.
The mechanism
Once you can walk this, you will start seeing it at dinner, in a group chat, in your own delay. That is the fun of this course.
Operant conditioning: a behavior is followed by a consequence, and the future rate of that behavior changes.
Four cells. Positive reinforcement: add a desirable stimulus, behavior increases (laugh, point, sticker). Negative reinforcement: remove an aversive stimulus, behavior increases (the beep stops when you buckle; you escape a nag by doing the task). Positive punishment: add an aversive stimulus, behavior decreases (a scolding, a shock in a box). Negative punishment: remove a desirable stimulus, behavior decreases (charger gone, playing time gone).
Reinforcement increases. Punishment decreases. Positive means add. Negative means subtract. Negative reinforcement is still reinforcement — the behavior grows because something unpleasant ended. That confusion is one of the most expensive on the exam.
Schedules (use the hyphens): fixed-ratio (pay every nth response), variable-ratio (pay after an unpredictable number — slot-like, high response rate), fixed-interval (first response after a set time), variable-interval (first response after an unpredictable time). Shaping: reinforce successive approximations toward a target behavior. A discriminative stimulus signals that a consequence is now available (the coach is watching; the app badge is on).
Classical pairing is CS with UCS. Operant is behavior with consequence. A scene can contain both. The exam move is naming which process explains the change they asked about.
| Add (+) | Remove (−) | |
|---|---|---|
| Behavior ↑ | Positive reinforcement Laugh after a joke | Negative reinforcement Beep stops when you buckle |
| Behavior ↓ | Positive punishment Scolding after a slam | Negative punishment Charger taken after a miss |
Schedules (hyphens): fixed-ratio, variable-ratio, fixed-interval, variable-interval. Shaping = successive approximations.
Words worth owning
A definition is a tool. The confusable is the distractor. Learn both and the clever wrong answer stops working.
Positive reinforcement
A desirable stimulus is added after a behavior; the behavior becomes more likely.
Confusable. Not ‘positive’ as in morally good. It means something was added.
Negative reinforcement
An aversive stimulus is removed after a behavior; the behavior becomes more likely.
Confusable. Not punishment. The behavior increases. Escape and avoidance live here.
Positive punishment
An aversive stimulus is added after a behavior; the behavior becomes less likely.
Confusable. Not ‘tough love’ as a slogan. Name the added aversive event.
Negative punishment
A desirable stimulus is removed after a behavior; the behavior becomes less likely.
Confusable. Taking the phone is not negative reinforcement unless the behavior increases.
Variable-ratio schedule
Reinforcement after an unpredictable number of responses; tends to produce high, steady responding.
Confusable. Not variable-interval (which is about time, not count).
Fixed-interval schedule
The first response after a set time is reinforced; responding often scallops toward the interval’s end.
Confusable. Not fixed-ratio (count of responses).
Shaping
Reinforcing successive approximations of a target behavior.
Confusable. Not one-shot reinforcement of the finished act, and not classical pairing.
Discriminative stimulus
A cue that signals a particular consequence is now available for a behavior.
Confusable. Not the same as a CS in classical conditioning, though both are cues.
A study you can actually use
Classic or labeled hypothetical. Either way: what was done, what was found, what it cannot claim.
Classic (classroom-common) · mid-20th century (classroom-common method)
Skinner’s operant chamber (as method)
- What was done
- A chamber lets a researcher arrange a behavior (a lever press, a key peck) and a consequence (food, a shock ending) on a chosen schedule, and record response rates.
- Finding
- The pattern of responding tracks the schedule: ratio schedules tend to drive high rates; interval schedules show different timing patterns. Consequence shapes rate.
- Limit — what it cannot claim
- A box is not a life. Humans have language, rules, and social audiences. The chamber is a method for isolating contingency, not a complete theory of a teenager’s group chat.
- How AAQ would probe it
- Method: experiment / controlled operant procedure. Variable: the schedule or the consequence. Ethic: protection from harm if aversive stimuli are used; the box is not automatically unethical, but harm and justification are fair probes.
Labeled hypothetical
Hypothetical study on variable-ratio notifications (original practice source, not a published paper)
Original practice source, not a published paper.
- What was done
- Researchers build two versions of a study app. Version A gives a badge after every fifth completed flashcard (fixed-ratio 5). Version B gives a badge after a random 2–8 cards (variable-ratio). They measure cards completed in 20 minutes.
- Finding
- If Version B produces more cards, a fair claim is that an unpredictable ratio kept responding high — not that the students ‘are addicted’ as a diagnosis.
- Limit — what it cannot claim
- Labeled hypothetical. Twenty minutes is not a semester. Completing cards is not the same as learning. Do not invent a journal name for this.
- How AAQ would probe it
- IV: schedule type. DV: cards completed (operational definition). Statistic: which group completed more — direction, not a fake p-value. Application: variable-ratio.
Someone’s Tuesday
If it only lives in the textbook, it will not survive a novel stem. This is the idea wearing ordinary clothes.
Streak counters, likes, and ‘seen’ ticks are scheduled consequences. A variable-ratio like-pattern can keep checking high. A parent who removes the Wi-Fi after a missed chore is using negative punishment if the missing-chore rate drops. A student who starts the homework to make a parent’s nagging stop is on negative reinforcement — the nagging ends, the starting increases. Sports drills: a coach who praises the closer and closer version of a serve is shaping. House rules work or fail by the actual contingency, not the slogan on the fridge.
Where clever students go wrong
The trap is usually a neighboring term that almost fits. Name it so it stops feeling smart.
Reward charts can accidentally punish (public comparison, lost privileges framed as ‘motivation’). ‘Tough love’ is often positive punishment with a moral caption. Apps that say they are ‘habit forming’ may be describing a variable-ratio loop; that is a mechanism, not a compliment and not a DSM label. Do not call negative reinforcement ‘a bad reward.’
A stem, then the move
Watch me work one. Then you will do four without looking back.
Scenario
Every so often, at unpredictable times, Priya’s group chat lights up with a reply. She checks the chat more and more, even when it is silent. Which schedule and which cell best describe the checking?
Walkthrough
The reply is an added desirable event after checking — positive reinforcement. The timing of replies is unpredictable and tied to checking (a response), not to the clock alone — closest to variable-ratio (unpredictable number of checks) rather than variable-interval (which would be the first check after an unpredictable wait). Either variable schedule beats ‘addiction’ as an exam answer. The key is: behavior increases, something desirable is added, the pay-off is unpredictable.
The move
Positive reinforcement on a variable-ratio (or, if the stem stresses time, variable-interval) schedule. Not punishment, and not classical pairing of two stimuli.
Try tonight · 5 minutes
A living experiment, not a vibe
Do this on your actual Tuesday. The paper will later hand you a stranger’s version of the same five minutes.
Pick one habit for one evening. Name the current consequence in a four-cell phrase. Change one consequence for one evening. Log what the behavior does. No self-shame — this is a data point, not a verdict.
Prove it
Four items. No looking back.
One at a time. After each submit I will show the key, why it is right, and why the others felt clever.
Item 1 of 4 · Practice 1 · Concept application
A seatbelt beep stops when you click the belt, and you click faster next time. Which cell is this?
Keys A–D select. Enter checks.
Write it · AAQ
Variable and statistic on a schedule study
Say the move in your own mouth. If you can write it, you own it — rereading is not the same thing.
Original practice source, not a published paper. A coach randomly assigns 24 players to praise after every fourth successful serve (fixed-ratio) or after an unpredictable 2–6 successful serves (variable-ratio). Mean successful serves in 15 minutes: FR = 18, VR = 27. Identify the independent variable as the study uses it. Then say what the 18 vs 27 comparison means — not a memorized definition of ‘mean.’
Move: AAQ variable + statistic. IV is schedule type. The numbers say the VR group produced more successful serves in that window; they do not say VR players are more talented.
Where curiosity goes next
Related rooms. Open the one that still tugs.