Extinction Burst

While extinction, when implemented consistently over time, results in the eventual decrease of the undesired behavior, in the short-term the subject might exhibit what is called an extinction burst. An extinction burst will often occur when the extinction procedure has just begun. This consists of a sudden and temporary increase in the response's frequency, followed by the eventual decline and extinction of the behavior targeted for elimination.

Take, as an example, a pigeon that has been reinforced to peck an electronic button. During its training history, every time the pigeon pecked the button, it will have received a small amount of bird seed as a reinforcer. So, whenever the bird is hungry, it will peck the button to receive food. However, if the button were to be turned off, the hungry pigeon will first try pecking the button just as it has in the past. When no food is forthcoming, the bird will likely try again ... and again, and again. After a period of frantic activity, in which their pecking behavior yields no result, the pigeon's pecking will decrease in frequency.

Although not explained by reinforcement theory, the extinction burst can be understood using control theory. In perceptual control theory, the degree of output involved in any action is proportional to the discrepancy between the reference value (desired rate of reward in the operant paradigm) and the current input. Thus, when reward is removed, the discrepancy increases, and the output is increased. In the long term, 'reorganisation', the learning algorithm of control theory, would adapt the control system such that output is reduced.

The evolutionary advantage of this extinction burst is clear. In a natural environment, an animal that persists in a learned behavior, despite not resulting in immediate reinforcement, might still have a chance of producing reinforcing consequences if the animal tries again. This animal would be at an advantage over another animal that gives up too easily.

Despite the name, however, not every explosive reaction to adverse stimuli subsides to extinction. Indeed a small minority of individuals persist in their reaction indefinitely.

-Wikipedia