Schedules of reinforcement
- Concept · Learning theory
- Strong evidence
- Published October 19, 2026
- 19 sources
- 8 min read
In short
Related in this topic
On this page
Key facts
- Field
- Learning theory
- Originators
- B. F. Skinner
- First described
- 1930s–1957, United States
- Also known as
- Reinforcement schedules; Intermittent reinforcement; Partial reinforcement
- Topics
- Behaviorism
State of the evidence
Strong evidenceThe basic schedule effects were catalogued in laboratory animals by Ferster and Skinner and have been studied continuously since, with consistent differences between ratio and interval performance and between fixed and variable schedules[1][2][3][4]. Choice between concurrent schedules follows the matching law in its generalized, power-function form across many vertebrate species, including humans[5]. The limits are stated in the same literature: the textbook response patterns are less uniform than often described[2], the strict form of matching is not supported[5], and the extension of schedule effects to gambling and digital media rests on a smaller and more mixed body of research[6][7][8].
Evidence labels summarise the research literature; they are not recommendations. How labels are assigned
A schedule of reinforcement is the rule that determines which occurrences of a behavior are followed by a reinforcer. Under continuous reinforcement every response is reinforced. Under intermittent reinforcement only some are, and the schedule is the rule that selects them. B. F. Skinner separated two kinds of rule. Some are arranged by a system outside the organism, such as a clock that makes reinforcement available every five minutes; others are controlled by the behavior itself, such as reinforcing every fiftieth response[9]. The first kind became the interval schedules and the second the ratio schedules. Charles Ferster and Skinner reported the performances these and more complex schedules produce in Schedules of Reinforcement (1957)[1]. A review fifty years later dated the research on pausing under ratio schedules from that book[2].
Schedules belong to operant conditioning, which explains how reinforcement and punishment change behavior; the difference between those two operations is set out in negative reinforcement versus punishment. This entry concerns only the timing and arrangement of reinforcement. A schedule is not a description of how often reinforcement arrives on average. Two schedules can deliver reinforcers at the same overall rate and still produce different behavior, because they differ in what is happening at the moment a reinforcer is delivered[9][3].
Continuous and intermittent reinforcement
Skinner observed that behavior acting directly on the physical world is usually reinforced consistently, while much social and economic behavior is reinforced only intermittently: a telephone call is not always answered, and a restaurant does not always serve a good meal[9]. He reported that intermittently reinforced behavior is usually stable and highly resistant to extinction. One pigeon made more than 10,000 responses in extinction after a special schedule, a result he said is never obtained after continuous reinforcement[9]. Demanding schedules are reached gradually. A pigeon reinforced first on every tenth response and then on every fiftieth can be brought to work for every hundredth, a ratio that could not have been used at the start[9].
Ratio and interval schedules
A ratio schedule reinforces a response after a number of responses; an interval schedule reinforces the first response after a period of time has passed. Either requirement can be fixed or can vary around an average, which gives the four basic schedules. They are written as FR, VR, FI and VI with the requirement as a number: FR 50 reinforces every fiftieth response, and VI 5 minutes reinforces the first response after intervals that average five minutes.
Figure 1Intermittent schedules deliver a reinforcer after a number of responses (ratio) or after a period of time (interval), on a fixed or variable basis. Patterns as typically described since Ferster and Skinner (1957).
Text description
A two-by-two grid. Columns are fixed and variable schedules; rows are ratio schedules, which count responses, and interval schedules, which count time. On a fixed-ratio schedule a reinforcer follows a set number of responses, and the typical pattern is a pause after each reinforcer followed by rapid responding, called break and run. On a variable-ratio schedule the number of responses required varies around an average, and responding is fast and steady with few long pauses. On a fixed-interval schedule the first response after a set time is reinforced, and responding is sparse early in the interval and accelerates toward its end, a pattern called the scallop. On a variable-interval schedule the first response after a varying time is reinforced, and responding occurs at a relatively constant rate that is lower than on ratio schedules. A note states that these are typical rather than invariant patterns: pausing also occurs on variable-ratio schedules.
The two families differ in how responding feeds back on reinforcement. On a ratio schedule, any increase in response rate brings reinforcement sooner, so the schedule drives responding upward. Skinner gave this as the reason that fixed-ratio pay, such as piecework or commission, generates very high rates of work[9]. On an interval schedule, the clock sets the maximum rate of reinforcement. When responding slows, the next reinforcer is obtained for fewer responses. Skinner called interval schedules self-protecting for this reason. Ratio schedules have no such mechanism, and behavior can collapse when the ratio is raised too far[9]. Higher response rates on ratio schedules and that collapse, now called ratio strain, are the two well-known differences between the families[3]. William Baum tested the first by yoking. Pigeons worked on a variable-ratio component and on a variable-interval component whose intervals were copied from it, so that reinforcement was approximately matched. Responding was faster on the ratio schedule, except where an unexpected rise in interval responding brought the two to equality[3].
Characteristic response patterns
The pause on fixed-ratio schedules
Textbooks describe fixed-ratio performance as break and run: a pause after each reinforcer, then rapid responding to the next[2]. Skinner attributed the pause to the fact that, just after reinforcement, the organism always has “a long way to go”. He compared it with the low interest seen in piecework, education and selling just after a unit of work is finished[9].
The name post-reinforcement pause implies that the pause is caused by the reinforcer just delivered, and fifty years of research have qualified that assumption. A 2008 review concluded that the length of the pause depends on the upcoming ratio as well as the one just completed, and that ratio size and reinforcer magnitude both influence it. Pausing also occurs on variable-ratio schedules, contrary to the belief that it is unique to fixed ratios. The review relates these findings to the human behavior called procrastination[2].
The scallop on fixed-interval schedules
On a fixed-interval schedule, responses made just after reinforcement are never reinforced, and responding becomes sparse early in each interval and accelerates toward its end[9][10]. On a cumulative record, each interval forms a curve called a scallop. Some records show a break-and-run pattern instead, and by the 1970s break and run was being proposed as the better description[4]. P. B. Dews tested the question in two rhesus monkeys on 1,000-second intervals. Once responding had begun, its rate rose from one 100-second segment to the next in 303 of 389 segments in one monkey and 310 of 419 in the other. By the fifth segment it averaged 4.5 times the starting rate[4].
Steady responding on variable schedules
When the requirement varies, reinforcement occasionally follows a response made just after the previous reinforcer. The probability of reinforcement stays roughly constant, and the organism holds a steady rate[9]. Skinner reported pigeons on a variable-interval schedule averaging five minutes that responded for up to fifteen hours at two to three responses per second, never pausing longer than fifteen or twenty seconds[9]. He described variable-ratio reinforcement as much more powerful than a fixed ratio with the same mean[9].
Schedules can also reinforce a rate directly. Reinforcing a response only when the four preceding responses have occurred within two seconds generates a very high rate, and reinforcing only slow responding generates a sustained low rate. Skinner treated the ordinary schedules in the same terms, as “simply rather inaccurate ways of reinforcing rates of responding”[9].
Persistence after intermittent reinforcement
Responding extinguishes more slowly after partial reinforcement than after consistent reinforcement, a finding called the partial reinforcement extinction effect[11]. It is usually attributed to what the animal learns about nonreinforced trials during training. A competing account attributes it to the difference in reinforcement rate: the change to extinction should be easier to detect after a dense schedule. In Pavlovian experiments with rats, doubling the food delivered per trial did not reliably change extinction. Slower extinction instead followed the stimulus that had been present on nonreinforced trials, which supports the first account[11].
The effect sits uneasily with other findings on response strength. When two schedules alternate under different stimuli, resistance to extinction increases with the rate of reinforcement, the opposite of the partial reinforcement effect[12]. Nevin’s behavioral momentum account reconciles the two by treating extinction as a disruption. Continuous reinforcement strengthens behavior during training, but terminating it is a larger disruption than terminating an intermittent schedule[12]. The direction of the relation between reinforcer rate and persistence therefore depends on how the schedules are arranged.
Concurrent schedules and the matching law
When two schedules run at once, each on its own response key, the animal must distribute its responding between them. Richard Herrnstein studied pigeons on such concurrent schedules. He measured the relative frequency of responding on each key as a function of the frequency of reinforcement it provided[13]. The regularity he described became known as the matching law: the relative frequency of responding matches the relative frequency of reinforcement. In 1970 he extended it into a system of equations whose most general form states that the absolute rate of any response is proportional to its relative reinforcement[14].
The strict version did not survive testing. Baum’s generalized matching law adds a parameter for bias toward one alternative. It also adds an exponent, which in some experiments falls short of one: preference is then less extreme than the ratio of reinforcement, a deviation called undermatching[15]. A 2013 review concluded that the original matching law and the theory built on it are false. The power-function version is tenable and fits animal and human choice, and matching has become influential in economics, behavioral pharmacology and clinical science[5]. In one clinical application, four people with developmental disabilities were observed with their care providers. The rate of problem behavior relative to appropriate behavior approximately matched the relative rate at which each was reinforced, within methodological constraints the authors identified[16].
Gambling and the variable-ratio explanation
Skinner proposed that gambling devices work because they pay on a variable-ratio schedule. Slot machines, roulette wheels, dice and horse races, he wrote, pay off unpredictably in proportion to the number of bets placed. The long-run net loss is almost irrelevant to the schedule’s effect[9]. He also argued that a near miss, such as two jackpot symbols and a third that does not match, acts as a conditioned reinforcer that costs the owner nothing[9]. Both claims are historical theory, offered by analogy with pigeon data.
Later research supports parts of the analogy and complicates others. John Haw examined random-ratio as well as variable-ratio schedules in relation to gaming machines. He argued from machine data that the number of early wins and of unreinforced trials matters more than the average frequency of wins[6]. Near misses do affect persistence. Among 180 undergraduates playing a computerized slot machine, near misses on 30% of trials produced more play during extinction than near misses on 15% or 45%, while an early large win had no reliable effect[17]. In a brain-imaging study, near misses were rated less pleasant than clear losses but increased the desire to play, though only when players had some control over arranging the gamble[18]. That dependence on control is not predicted by the schedule alone, and the authors of the slot-machine experiment discuss cognitive as well as behavioral explanations of the near-miss effect[17]. A review of mobile gambling proposes that the schedules found in gambling interact with the ways people use smartphones and may speed the acquisition of problem gambling. Its authors present this as their interpretation of the evidence, not a tested result[19].
Social media, apps and the limits of the analogy
The popularity of social media is often attributed to a need for social rewards such as likes, a portrayal that treats the online world as a Skinner box[7] . A 2021 study noted that evidence for this had been scant and then tested it. Across more than one million posts by over 4,000 people, users spaced their posts so as to maximize the average rate of likes received, as reinforcement-learning models predict. An online experiment confirmed that social rewards causally influenced posting[7]. The study concerns the timing of posting. It does not show that a particular schedule makes social media use compulsive or harmful.
Claims that apps are engineered around variable-ratio schedules to produce addiction go further than this evidence. A review of research on smartphone addiction found insufficient support for treating heavy smartphone use as an addiction and proposed the term problematic use instead[8].
Sources19
Numbered in order of first citation.
- 1.Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. Appleton-Century-Crofts.
- 2.Schlinger, H. D., Derenne, A., & Baron, A. (2008). What 50 years of research tell us about pausing under ratio schedules of reinforcement. The Behavior Analyst, 31(1), 39–60. https://doi.org/10.1007/BF03392160
- 3.Baum, W. M. (1993). Performances on ratio and interval schedules of reinforcement: Data and theory. Journal of the Experimental Analysis of Behavior, 59(2), 245–264. https://doi.org/10.1901/jeab.1993.59-245
- 4.Dews, P. B. (1978). Studies on responding under fixed-interval schedules of reinforcement: II. The scalloped pattern of the cumulative record. Journal of the Experimental Analysis of Behavior, 29(1), 67–75. https://doi.org/10.1901/jeab.1978.29-67
- 5.McDowell, J. J. (2013). On the theoretical and empirical status of the matching law and matching theory. Psychological Bulletin, 139(5), 1000–1028. https://doi.org/10.1037/a0029924
- 6.Haw, J. (2008). Random-ratio schedules of reinforcement: The role of early wins and unreinforced trials. Journal of Gambling Issues(21), 56. https://doi.org/10.4309/jgi.2008.21.6
- 7.Lindström, B., Bellander, M., Schultner, D. T., Chang, A., Tobler, P. N., & Amodio, D. M. (2021). A computational reward learning account of social media engagement. Nature Communications, 12(1). https://doi.org/10.1038/s41467-020-19607-x
- 8.Panova, T., & Carbonell, X. (2018). Is smartphone addiction really an addiction?. Journal of Behavioral Addictions, 7(2), 252–259. https://doi.org/10.1556/2006.7.2018.49
- 9.Skinner, B. F. (1953). Science and human behavior. Macmillan.
- 10.Catania, A. C. (1962). Independence of concurrent responding maintained by interval schedules of reinforcement. Journal of the Experimental Analysis of Behavior, 5(2), 175–184. https://doi.org/10.1901/jeab.1962.5-175
- 11.Harris, J. A., Kwok, D. W. S., & Gottlieb, D. A. (2019). The partial reinforcement extinction effect depends on learning about nonreinforced trials rather than reinforcement rate. Journal of Experimental Psychology: Animal Learning and Cognition, 45(4), 485–501. https://doi.org/10.1037/xan0000220
- 12.Nevin, J. A. (2012). Resistance to extinction and behavioral momentum. Behavioural Processes, 90(1), 89–97. https://doi.org/10.1016/j.beproc.2012.02.006
- 13.Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement. Journal of the Experimental Analysis of Behavior, 4(3), 267–272. https://doi.org/10.1901/jeab.1961.4-267
- 14.Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13(2), 243–266. https://doi.org/10.1901/jeab.1970.13-243
- 15.Baum, W. M. (1974). On two types of deviation from the matching law: Bias and undermatching. Journal of the Experimental Analysis of Behavior, 22(1), 231–242. https://doi.org/10.1901/jeab.1974.22-231
- 16.Borrero, J. C., & Vollmer, T. R. (2002). An application of the matching law to severe problem behavior. Journal of Applied Behavior Analysis, 35(1), 13–27. https://doi.org/10.1901/jaba.2002.35-13
- 17.Kassinove, J. I., & Schare, M. L. (2001). Effects of the "near miss" and the "big win" on persistence at slot machine gambling. Psychology of Addictive Behaviors, 15(2), 155–158. https://doi.org/10.1037/0893-164X.15.2.155
- 18.Clark, L., Lawrence, A. J., Astley-Jones, F., & Gray, N. (2009). Gambling near-misses enhance motivation to gamble and recruit win-related brain circuitry. Neuron, 61(3), 481–490. https://doi.org/10.1016/j.neuron.2008.12.031
- 19.James, R. J. E., O'Malley, C., & Tunney, R. J. (2017). Understanding the psychology of mobile gambling: A behavioural synthesis. British Journal of Psychology, 108(3), 608–625. https://doi.org/10.1111/bjop.12226
Further reading
- Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. Appleton-Century-Crofts.
- Schlinger, H. D., Derenne, A., & Baron, A. (2008). What 50 years of research tell us about pausing under ratio schedules of reinforcement. The Behavior Analyst, 31(1), 39–60. https://doi.org/10.1007/BF03392160
- McDowell, J. J. (2013). On the theoretical and empirical status of the matching law and matching theory. Psychological Bulletin, 139(5), 1000–1028. https://doi.org/10.1037/a0029924
Related entries 17
- Operant conditioningConcept
- B. F. SkinnerFigure
- Negative reinforcement vs punishmentComparison
- Classical vs operant conditioningComparison
- BehaviorismTopic
- Positive reinforcementConcept
- Skinner box (operant conditioning chamber)Concept
- Positive vs negative punishmentComparison
- Behavior modificationConcept
- ExtinctionConcept
- Love bombingConcept
- Premack principleConcept
- Social learning theoryConcept
- Trauma bondingConcept
- Contingency management(CM)Method
- ShapingMethod
- Token economyMethod
Cite this entry
APA 7
Psych Dictionary. (2026, October 19). Schedules of reinforcement. In Psych Dictionary. https://www.psychdictionary.com/concepts/schedules-of-reinforcement
MLA 9
“Schedules of Reinforcement.” Psych Dictionary, 19 Oct. 2026, www.psychdictionary.com/concepts/schedules-of-reinforcement.