Skip to main content
Springer Nature Link
Log in

The Rate-Correlation Theory of Goal-Directed Behavior: An Update

  • Chapter
  • First Online:
Habits

  • 558 Accesses

  • 1 Citation

Abstract

Over half a century ago, Baum (J Exp Anal Behav 20:137–153, 1973) proposed a theory based on the idea that behavior should be analyzed in terms of rates of activities rather than single, discrete units of analysis. The evidence from animal experiments suggests that his theory could be underlying goal-directed control, in that actions are performed more often when there is a direct correlation between behavior rate and reinforcement rate in a given period of time and are more sensitive to changes in outcome value than when the rate correlation is weak. This correlational system, coupled with a reinforcement learning algorithm of habit learning, can capture a wide range of data from animal experiments. In this chapter, I discuss this theory in light of recent human data and possible extensions of this idea to other areas of research.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+
from €39.99 /Month
  • Starting from 10 chapters or articles per month
  • Access and download chapters and articles from more than 300k books and 2,500 journals
  • Cancel anytime
View plans

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 171.19
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 213.99
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
EUR 213.99
Price includes VAT (Germany)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

') var buybox = document.querySelector("[data-id=id_"+ timestamp +"]").parentNode var buyingOptions = buybox.querySelectorAll(".buying-option") ;[].slice.call(buyingOptions).forEach(initCollapsibles) var buyboxMaxSingleColumnWidth = 480 function initCollapsibles(subscription, index) { var toggle = subscription.querySelector(".buying-option-price") subscription.classList.remove("expanded") var form = subscription.querySelector(".buying-option-form") var priceInfo = subscription.querySelector(".price-info") var buyingOption = toggle.parentElement if (toggle && form && priceInfo) { toggle.setAttribute("role", "button") toggle.setAttribute("tabindex", "0") toggle.addEventListener("click", function (event) { var expandedBuyingOptions = buybox.querySelectorAll(".buying-option.expanded") var buyboxWidth = buybox.offsetWidth ;[].slice.call(expandedBuyingOptions).forEach(function(option) { if (buyboxWidth buyboxMaxSingleColumnWidth) { toggle.click() } else { if (index === 0) { toggle.click() } else { toggle.setAttribute("aria-expanded", "false") form.hidden = "hidden" priceInfo.hidden = "hidden" } } }) } initialStateOpen() if (window.buyboxInitialised) return window.buyboxInitialised = true initKeyControls() })()

Institutional subscriptions

Similar content being viewed by others

References

  • Adams, C. D., & Dickinson, A. (1981). Instrumental responding following reinforcer devaluation. The Quarterly Journal of Experimental Psychology Section B: Comparative and Physiological Psychology, 33(2), 109–121. https://doi.org/10.1080/14640748108400816

    Article  Google Scholar 

  • Balleine, B. W., & Dickinson, A. (1998). Goal-directed instrumental action: Contingency and incentive learning and their cortical substrates. Neuropharmacology, 37(4–5), 407–419.

    Article  CAS  PubMed  Google Scholar 

  • Baum, W. (1973). The correlation-based law of effect. Journal of the Experimental Analysis of Behavior, 20, 137–153.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Baum, W. (2012). Rethinking reinforcement: Allocation, induction, and contingency. Journal of the Experimental Analysis of Behavior, 97(1), 101–124. https://doi.org/10.1901/jeab.2012.97-101

    Article  PubMed  PubMed Central  Google Scholar 

  • Bush, R. R., & Mosteller, F. (1951). A mathematical model for simple learning. Psychological Review, 58(5), 313–323. https://doi.org/10.1037/h0054388

    Article  CAS  PubMed  Google Scholar 

  • Crimmins, B., Burton, T. J., McNulty, M., Laurent, V., Hart, G., & Balleine, B. W. (2022). Response-independent outcome presentations weaken the instrumental response-outcome association. Journal of Experimental Psychology: Animal Learning and Cognition, 48(4), 396.

    PubMed  Google Scholar 

  • de Villiers, P. A. (1974). The Law of Effect and avoidance: A Quantitative Relationship Between Response Rate and Shock-Frequency Reduction. Journal of the Experimental Analysis of Behavior, 21(2), 223–235. https://doi.org/10.1901/jeab.1974.21-223

  • de Wit, S., Kindt, M., Knot, S. L., Verhoeven, A. A. C. C., Robbins, T. W., Gasull-Camos, J., Evans, M., Mirza, H., & Gillan, C. M. M. (2018). Shifting the balance between goals and habits: Five failures in experimental habit induction. Journal of Experimental Psychology: General, 147(7), 1043. https://doi.org/10.1037/xge0000402

    Article  PubMed  Google Scholar 

  • Dickinson, A. (1985). Actions and habits: The development of behavioural autonomy. Philosophical Transactions of the Royal Society B: Biological Sciences, 308(1135), 67–78.

    Google Scholar 

  • Dickinson, A., & Pearce, J. M. (1977). Inhibitory interactions between appetitive and aversive stimuli. Psychological Bulletin, 84(4), 690–711. https://doi.org/10.1037/0033-2909.84.4.690

  • Dickinson, A., Nicholas, D. J. J., & Adams, C. D. (1983). The effect of the instrumental training contingency on susceptibility to reinforcer devaluation. The Quarterly Journal of Experimental Psychology, 35(789759670), 35–51. https://doi.org/10.1080/14640748308400912

    Article  Google Scholar 

  • Fernando, A., Urcelay, G., Mar, A., Dickinson, A., & Robbins, T. (2014a). Free-operant avoidance behavior by rats after reinforcer revaluation using opioid agonists and D-amphetamine. Journal of Neuroscience, 34(18), 6286–6293.

    Article  CAS  PubMed  Google Scholar 

  • Fernando, A., Urcelay, G. P., Mar, A. C., Dickinson, A., & Robbins, T. W. (2014b). Safety signals as instrumental reinforcers during free-operant avoidance. Learning & Memory, 21(9), 488–497.

    Article  Google Scholar 

  • Fox, E. J., & Semple, J. (2002). Understanding “cherry pickers:” How retail customers split their shopping baskets (Unpublished manuscript). Cox School of Business, Southern Methodist University.

    Google Scholar 

  • Gillan, C. M. M., Otto, A. R., Phelps, E. A., & Daw, N. D. (2015). Model-based learning protects against forming habits. Cognitive, Affective, & Behavioral Neuroscience, 15(3), 523–536. https://doi.org/10.3758/s13415-015-0347-6

    Article  Google Scholar 

  • Gremel, C. M., & Costa, R. M. (2013). Orbifrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nature Communications, 4(May), 1–12. https://doi.org/10.1038/ncomms3264

    Article  CAS  Google Scholar 

  • Hayden, B. Y. (2018). Economic choice: The foraging perspective. Current Opinion in Behavioral Sciences, 24, 1–6. https://doi.org/10.1016/j.cobeha.2017.12.002

    Article  Google Scholar 

  • Konorski, J. (1967). Integrative activity of the brain. University of Chicago Press: Chicago.

    Google Scholar 

  • Kosaki, Y., & Dickinson, A. (2010). Choice and contingency in the development of behavioral autonomy during instrumental conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 36(3), 334–342. https://doi.org/10.1037/a0016887

    Article  PubMed  Google Scholar 

  • Maia, T. V. (2010). Two-factor theory, the actor-critic model, and conditioned avoidance. Learning & Behavior, 38(1), 50–67. https://doi.org/10.3758/LB.38.1.50

    Article  Google Scholar 

  • O’Doherty, J. P., Lee, S. W., Tadayonnejad, R., Cockburn, J., Iigaya, K., & Charpentier, C. J. (2021). Why and how the brain weights contributions from a mixture of experts. Neuroscience & Biobehavioral Reviews, 123, 14–23.

    Article  Google Scholar 

  • Perez, Oh, Rojas, & Merlo. (in preparation). The causal status of goal-directed actions after manipulations of the action-outcome association.

    Google Scholar 

  • Perez, O. D. (2021). Instrumental behavior in humans is sensitive to the correlation between response rate and reward rate. Psychonomic Bulletin & Review, 28(2), 649–656.

    Article  Google Scholar 

  • Perez, O. D., & Dickinson, A. (2020). A theory of actions and habits: The interaction of rate correlation and contiguity systems in free-operant behavior. Psychological Review, 127(6), 945–971. https://doi.org/10.1037/rev0000201

  • Perez, O. D., & Dickinson, A. (2023). Dual-system avoidance: Extension of a theory. BioRxiv. https://doi.org/10.1101/2023.05.24.542134

  • Perez, O. D., & Soto, F. (2020). Evidence for a dissociation between causal beliefs and instrumental actions. The Quarterly Journal of Experimental Psychology, 73(4), 495–503.

    Article  PubMed  Google Scholar 

  • Pérez, O. D., Aitken, M. R. F. F., Milton, A. L., Dickinson, A., Perez, O. D., Milton, A. L., Aitken, M. R. F. F., & Dickinson, A. (2018). A re-examination of responding on ratio and regulated-probability interval schedules. Learning and Motivation, 64, 1–8. https://doi.org/10.1016/j.lmot.2018.07.003

    Article  PubMed  Google Scholar 

  • Pool, E. R., Gera, R., Fransen, A., Perez, O. D., Cremer, A., Aleksic, M., Tanwisuth, S., Quail, S., Ceceli, A. O., & Manfredi, D. A. (2022). Determining the effects of training duration on the behavioral expression of habitual control in humans: A multilaboratory investigation. Learning & Memory, 29(1), 16–28.

    Article  Google Scholar 

  • Rescorla, R. A. (1993). Preservation of response-outcome associations through extinction. Animal Learning & Behavior, 21(3), 238–245. https://doi.org/10.3758/BF03197988

    Article  Google Scholar 

  • Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In W. F. Black & A. H. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64–99). New York: Appleton-Century-Crofts. https://doi.org10.1037/a0030892

    Google Scholar 

  • Schwabe, L., & Wolf, O. T. (2009). Stress prompts habit behavior in humans. Journal of Neuroscience, 29(22), 7191–7198.

    Article  CAS  PubMed  Google Scholar 

  • Schwabe, L., & Wolf, O. T. (2010). Socially evaluated cold pressor stress after instrumental learning favors habits over goal-directed action. Psychoneuroendocrinology, 35(7), 977–986.

    Article  PubMed  Google Scholar 

  • Seligman, M. E., & Johnston, J. C. (1973). A cognitive theory of avoidance learning. In F. J. McGuigan & D. B. Lumsden (Eds.), Contemporary approaches to conditioning and learning (pp. 69–110). Winston & Sons Inc.

    Google Scholar 

  • Stephens, D. W., & Krebs, J. R. (1986). Foraging theory (Vol. 6). Princeton University Press.

    Google Scholar 

  • Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. MIT Press.

    Google Scholar 

  • Taylor, G. A., & Neslin, S. A. (2005). The current and future sales impact of a retail frequency reward program. Journal of Retailing, 81(4), 293–305.

    Article  Google Scholar 

  • Tricomi, E., Balleine, B. W., & O’Doherty, J. P. (2009). A specific role for posterior dorsolateral striatum in human habit learning. The European Journal of Neuroscience, 29(11), 2225–2232. https://doi.org/10.1111/j.1460-9568.2009.06796.x

    Article  PubMed  PubMed Central  Google Scholar 

  • Vaghi, M. M., Cardinal, R. N., Apergis-Schoute, A. M., Fineberg, N. A., Sule, A., & Robbins, T. W. (2019). Action-outcome knowledge dissociates from behavior in obsessive-compulsive disorder following contingency degradation. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 4, 200–209.

    PubMed  Google Scholar 

  • Wagner, A. R., & Rescorla, R. A. (1972). Inhibition in Pavlovian conditioning: application of a theory. In R. A. Boakes & M. S. Halliday (Eds.), Inhibition and learning. New York: Academic.

    Google Scholar 

  • Wang, O., Lee, S. W., O’Doherty, J., Seymour, B., & Yoshida, W. (2018). Model-based and model-free pain avoidance learning. Brain and Neuroscience Advances, 2, 239821281877296. https://doi.org/10.1177/2398212818772964

    Article  Google Scholar 

  • Williams, B. A., & McDevitt, M. A. (2002). Inhibition and superconditioning. Psychological Science, 13(5), 454–459.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Complex Engineering Systems Institute, Santiago, Chile

    Omar D. Perez

  2. Department of Industrial Engineering, University of Chile, Santiago, Chile

    Omar D. Perez

Authors
  1. Omar D. Perez
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Omar D. Perez .

Editor information

Editors and Affiliations

  1. Laboratoire de Neurosciences Expérimentales et Cliniques, Université de Poitiers, INSERM, U-1084, Poitiers, France

    Youna Vandaele

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Perez, O.D. (2024). The Rate-Correlation Theory of Goal-Directed Behavior: An Update. In: Vandaele, Y. (eds) Habits. Springer, Cham. https://doi.org/10.1007/978-3-031-55889-4_4

Download citation

Publish with us

Policies and ethics