Skip to main content
Springer Nature Link
Log in

Extended, Distributed, and Predictive: Sketches of a Generative Theory of Interaction for HCI

  • Conference paper
  • First Online:
HCI International 2022 – Late Breaking Posters (HCII 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1654))

Included in the following conference series:

  • 1636 Accesses

Abstract

This paper blends work in extended mind, distributed cognition, and predictive processing to provide a novel generative theory of interaction. This dovetailing offers an emerging picture of cognition that HCI stands to benefit from: our cognition is extended, distributed, and constantly trying to predict incoming sensory stimuli across social, cultural, and temporal scales. We develop a sketch of a generative theory of interaction for HCI and offer some directions for future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
€34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 96.29
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 128.39
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

') var buybox = document.querySelector("[data-id=id_"+ timestamp +"]").parentNode var buyingOptions = buybox.querySelectorAll(".buying-option") ;[].slice.call(buyingOptions).forEach(initCollapsibles) var buyboxMaxSingleColumnWidth = 480 function initCollapsibles(subscription, index) { var toggle = subscription.querySelector(".buying-option-price") subscription.classList.remove("expanded") var form = subscription.querySelector(".buying-option-form") var priceInfo = subscription.querySelector(".price-info") var buyingOption = toggle.parentElement if (toggle && form && priceInfo) { toggle.setAttribute("role", "button") toggle.setAttribute("tabindex", "0") toggle.addEventListener("click", function (event) { var expandedBuyingOptions = buybox.querySelectorAll(".buying-option.expanded") var buyboxWidth = buybox.offsetWidth ;[].slice.call(expandedBuyingOptions).forEach(function(option) { if (buyboxWidth buyboxMaxSingleColumnWidth) { toggle.click() } else { if (index === 0) { toggle.click() } else { toggle.setAttribute("aria-expanded", "false") form.hidden = "hidden" priceInfo.hidden = "hidden" } } }) } initialStateOpen() if (window.buyboxInitialised) return window.buyboxInitialised = true initKeyControls() })()

Institutional subscriptions

Similar content being viewed by others

References

  1. Beaudouin-Lafon, M., et al.: Generative theories of interaction. ACM Trans. Comput. Hum. Interact. 28(6), 1–54 (2021). https://doi.org/10.1145/3468505

    Article  Google Scholar 

  2. Chalmers, D.J.: Extended cognition and extended consciousness. In: Andy Clark and His Critics, pp. 9–20. Oxford University Press (2019)

    Google Scholar 

  3. Clark, A.: Memento’s revenge: the extended mind, extended. In: The Extended Mind, pp. 43–66. The MIT Press (2010)

    Google Scholar 

  4. Clark, A.: Natural-Born Cyborgs: Minds, Technologies, and the Future of Human Intelligence. Oxford University Press, New York (2004)

    Google Scholar 

  5. Clark, A.: Surfing Uncertainty: Prediction, Action, and the Embodied Mind. Oxford University Press, New York (2019)

    Google Scholar 

  6. Clark, A.: Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behav. Brain Sci. 36(3), 181–204 (2013). https://doi.org/10.1017/s0140525x12000477

    Article  Google Scholar 

  7. Clark, A., Chalmers, D.: The extended mind. Analysis 58(1), 7–19 (1998). https://doi.org/10.1111/1467-8284.00096

    Article  Google Scholar 

  8. Clark, A.: Consciousness as generative entanglement. J. Philos. 116(12), 645–662 (2019). https://doi.org/10.5840/jphil20191161241

    Article  Google Scholar 

  9. Constant, A., et al.: Extended active inference: constructing predictive cognition beyond skulls. Mind Lang. Mila. 12330 (2020). https://doi.org/10.1111/mila.12330

  10. Costanza-Chock, S.: Design Justice: Community-Led Practices to Build the Worlds We Need. MIT Press, London (2020)

    Book  Google Scholar 

  11. Engel, A.K., et al.: Dynamic predictions: oscillations and synchrony in top–down processing. Nat. Rev. Neurosci. 2(10), 704–716 (2001). https://doi.org/10.1038/35094565

    Article  Google Scholar 

  12. Frauenberger, C.: Entanglement HCI the next wave? ACM Trans. Comput. Hum. Interact. 27(1), 1–27 (2020). https://doi.org/10.1145/3364998

    Article  Google Scholar 

  13. Friston, K., et al.: Active inference and agency: optimal control without cost functions. Biol. Cybern. 106(8–9), 523–541 (2012). https://doi.org/10.1007/s00422-012-0512-8

    Article  MathSciNet  MATH  Google Scholar 

  14. Heersmink, R.: Dimensions of integration in embedded and extended cognitive systems. Phenomenol. Cogn. Sci. 14(3), 577–598 (2014). https://doi.org/10.1007/s11097-014-9355-1

    Article  Google Scholar 

  15. Heersmink, R.: The cognitive integration of scientific instruments: information, situated cognition, and scientific practice. Phenomenol. Cogn. Sci. 15(4), 517–537 (2015). https://doi.org/10.1007/s11097-015-9432-0

    Article  Google Scholar 

  16. Hollan, J., et al.: Distributed cognition: toward a new foundation for human-computer interaction research. ACM Trans. Comput. Hum. Interact. 7(2), 174–196 (2000). https://doi.org/10.1145/353485.353487

    Article  Google Scholar 

  17. Hutchins, E.: Cognition, distributed. In: International Encyclopedia of the Social & Behavioral Sciences, pp. 2068–2072. Elsevier (2001)

    Google Scholar 

  18. Hutchins, E.: Cognition in the Wild. MIT Press, Cambridge (1994)

    Google Scholar 

  19. Hutchins, E.: Cognitive ecology. Top. Cogn. Sci. 2(4), 705–715 (2010). https://doi.org/10.1111/j.1756-8765.2010.01089.x

    Article  Google Scholar 

  20. Hutchins, E.: Enculturating the supersized mind. Philos. Stud. 152(3), 437–446 (2011). https://doi.org/10.1007/s11098-010-9599-8

    Article  Google Scholar 

  21. Hutchins, E.: Imagining the cognitive life of things. https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.104.6035&rep=rep1&type=pdf. Accessed 18 Mar 2022

  22. Hutchins, E.: The cultural ecosystem of human cognition. Philos. Psychol. 27(1), 34–49 (2014). https://doi.org/10.1080/09515089.2013.830548

    Article  Google Scholar 

  23. Hutchins, E.: The role of cultural practices in the emergence of modern human intelligence. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363(1499), 2011–2019 (2008). https://doi.org/10.1098/rstb.2008.0003

  24. Introna, L.D.: Towards a post-human intra-actional account of sociomaterial agency (and morality). In: Kroes, P., Verbeek, P.-P. (eds.) The Moral Status of Technical Artefacts. PET, vol. 17, pp. 31–53. Springer, Dordrecht (2014). https://doi.org/10.1007/978-94-007-7914-3_3

    Chapter  Google Scholar 

  25. Kirchhoff, M.D., Kiverstein, J.: Extended Consciousness and Predictive Processing: A Third Wave View. Routledge, London (2019)

    Book  Google Scholar 

  26. Kirsh, D.: The intelligent use of space. Artif. Intell. 73(1–2), 31–68 (1995). https://doi.org/10.1016/0004-3702(94)00017-u

    Article  Google Scholar 

  27. Kirsh, D., Maglio, P.: On distinguishing epistemic from pragmatic action. Cogn. Sci. 18(4), 513–549 (1994). https://doi.org/10.1207/s15516709cog1804_1

    Article  Google Scholar 

  28. Marshall, P., Necker, E.H.: Theories of embodiment in HCI. In: The SAGE Handbook of Digital Technology Research, pp. 144–158. SAGE Publications Ltd., London (2014)

    Google Scholar 

  29. Menary, R. (ed.): The Extended Mind. The MIT Press, Cambridge (2010)

    Google Scholar 

  30. Nave, K., et al.: Wilding the predictive brain. Wiley Interdiscip. Rev. Cogn. Sci. 11(6), e1542 (2020). https://doi.org/10.1002/wcs.1542

    Article  Google Scholar 

  31. Rogers, Y.: HCI Theory: Classical, Modern, and Contemporary. Morgan & Claypool, San Rafael (2012)

    Google Scholar 

  32. Sterelny, K.: Minds: extended or scaffolded? Phenomenol. Cogn. Sci. 9(4), 465–481 (2010). https://doi.org/10.1007/s11097-010-9174-y

    Article  Google Scholar 

  33. Sutton, J.: Exograms and interdisciplinarity: history, the extended mind, and the civilizing process. In: The Extended Mind, pp. 189–225. The MIT Press (2010)

    Google Scholar 

  34. Veissière, S.P.L., et al.: Thinking through other minds: a variational approach to cognition and culture. Behav. Brain Sci. 43, e90 (2020). https://doi.org/10.1017/s0140525x19001213

    Article  Google Scholar 

  35. Verbeek, P.-P.: Beyond interaction: a short introduction to mediation theory. Interactions 22(3), 26–31 (2015). https://doi.org/10.1145/2751314

    Article  Google Scholar 

  36. Wiese, W., Metzinger, T.K.: Vanilla PP for philosophers: a primer on predictive processing. (2017). https://doi.org/10.15502/9783958573024

  37. Wilson, R.A., Clark, A.: How to situate cognition: Letting nature take its course. In: Aydede, M., Robbins, P. (eds.) The Cambridge Handbook of Situated Cognition, pp. 55–77. Cambridge University Press, Cambridge (2009)

    Google Scholar 

Download references

Acknowledgements

This work is part of the DCODE project. The project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 955990.

Author information

Authors and Affiliations

  1. Philips Experience Design, Eindhoven, The Netherlands

    Jacob T. Browne

  2. Delft University of Technology, Delft, The Netherlands

    Jacob T. Browne

  3. Aarhus University, Aarhus, Denmark

    Ignacio Garnham

Authors
  1. Jacob T. Browne
    View author publications

    Search author on:PubMed Google Scholar

  2. Ignacio Garnham
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Jacob T. Browne .

Editor information

Editors and Affiliations

  1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. Foundation for Research and Technology Hellas (FORTH), Heraklion, Crete, Greece

    Margherita Antona

  3. Foundation for Research and Technology Hellas (FORTH), Heraklion, Crete, Greece

    Stavroula Ntoa

  4. University of Central Florida, Orlando, FL, USA

    Gavriel Salvendy

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Browne, J.T., Garnham, I. (2022). Extended, Distributed, and Predictive: Sketches of a Generative Theory of Interaction for HCI. In: Stephanidis, C., Antona, M., Ntoa, S., Salvendy, G. (eds) HCI International 2022 – Late Breaking Posters. HCII 2022. Communications in Computer and Information Science, vol 1654. Springer, Cham. https://doi.org/10.1007/978-3-031-19679-9_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-19679-9_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-19678-2

  • Online ISBN: 978-3-031-19679-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics