Embodied Processing at Six Linguistic Granularity Levels: A Consensus Paper
References
- Abbondanza, M., Rinaldi, L., Foppolo, F., & Marelli, M. (2021). The mental representation of nonnumerical quantifiers: The spatial-linguistic association of response codes (SLARC) effect. Journal of Experimental Psychology: Learning, Memory, and Cognition, 47(12), 2021–2028. DOI: 10.1037/xlm0001037
- Adams, A. M., Glenberg, A. M., & Restrepo, M. A. (2019). Embodied reading in a transparent orthography. Learning and Instruction, 62, 27–36. DOI: 10.1016/j.learninstruc.2019.03.003
- Adams, G. S., Converse, B. A., Hales, A. H., & Klotz, L. E. (2021). People systematically overlook subtractive changes. Nature, 592, 258–261. DOI: 10.1038/s41586-021-03380-y
- Alisedo, G., Pastor, I., Ayala, D., Bacigalupo, E., Lassalle, L., & Costa, F. (2007).
Diccionario bilingüe de lengua de señas uruguaya/español . Asociación de Sordos de Uruguay. - Banks, B., Borghi, A. M., Fargier, R., Fini, C., Jonauskaite, D., Mazzuca, C., Montalti, M., Villani, C., & Woodin, G. (2022). Consensus Paper: Current Perspectives on Abstract Concepts and Future Research Directions. [Manuscript submitted for publication].
- Baroni, M., Dinu, G., & Kruszewski, G. (2014). Don’t count, predict! A systematic comparison of context-counting vs. context-predicting semantic vectors. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (pp. 238–247). DOI: 10.3115/v1/P14-1023
- Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22(4), 577–660. DOI: 10.1017/S0140525X99002149
- Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645. DOI: 10.1146/annurev.psych.59.103006.093639
- Baus, C., Carreiras, M., & Emmorey, K. (2013). When does iconicity in sign language matter? Language and Cognitive Processes, 28, 261–271. DOI: 10.1080/01690965.2011.620374
- Bechtold, L., Cosper, S. H., Malyshevskaya, A., Montefinese, M., Morucci, P., Niccolai, V., Repetto, C., Zappa, A., & Shtyrov, Y. (2022). Brain Signatures of Embodied Semantics and Language: A Consensus Paper. [Manuscript submitted for publication].
- Berenhaus, M., Oakhill, J., & Rusted, J. (2015). When kids act out: A comparison of embodied methods to improve children’s memory for a story. Journal of Research in Reading, 38(4), 331–343. DOI: 10.1111/1467-9817.12039
- Bergen, B. K. (2004). The psychological reality of phonaesthemes. Language, 80(3), 290–311. DOI: 10.1353/lan.2004.0056
- Bergen, B. K. (2015).
Embodiment, simulation and meaning . In N. Riemer (Ed.), The Routledge Handbook of Semantics (pp. 158–173). Routledge. DOI: 10.4324/9781315685533 - Bhalla, M., & Proffitt, D. R. (1999). Visual–motor recalibration in geographical slant perception. Journal of Experimental Psychology: Human Perception and Performance, 25(4), 1076–1096. DOI: 10.1037/0096-1523.25.4.1076
- Blasi, D. E., Wichmann, S., Hammarström, H., Stadler, P. F., & Christiansen, M. H. (2016). Sound–meaning association biases evidenced across thousands of languages. Proceedings of the National Academy of Sciences, 113(39), 10818–10823. DOI: 10.1073/pnas.1605782113
- Borghesani, V., & Piazza, M. (2017). The neuro-cognitive representations of symbols: The case of concrete words. Neuropsychologia, 105, 4–17. DOI: 10.1016/j.neuropsychologia.2017.06.026
- Borghi, A. M., Barca, L., Binkofski, F., Castelfranchi, C., Pezzulo, G., & Tummolini, L. (2019). Words as social tools: Language, sociality and inner grounding in abstract concepts. Physics of Life Reviews, 29, 120–153. DOI: 10.1016/j.plrev.2018.12.001
- Boroditsky, L. (2000). Metaphoric structuring: Understanding time through spatial metaphors. Cognition, 75(1), 1–28. DOI: 10.1016/S0010-0277(99)00073-6
- Borreggine, K. L., & Kaschak, M. P. (2006). The action–sentence compatibility effect: It’s all in the timing. Cognitive Science, 30(6), 1097–1112. DOI: 10.1207/s15516709cog0000_91
- Boulenger, V., Mechtouff, L., Thobois, S., Broussolle, E., Jeannerod, M., & Nazir, T. A. (2008). Word processing in Parkinson’s disease is impaired for action verbs but not for concrete nouns. Neuropsychologia, 46(2), 743–756. DOI: 10.1016/j.neuropsychologia.2007.10.007
- Boulenger, V., Roy, A. C., Paulignan, Y., Deprez, V., Jeannerod, M., & Nazir, T. A. (2006). Cross-talk between language processes and overt motor behavior in the first 200 ms of processing. Journal of Cognitive Neurosciene, 18(10), 1607–1615. DOI: 10.1162/jocn.2006.18.10.1607
- Brennan, S. E., & Clark, H. H. (1996). Conceptual pacts and lexical choice in conversation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22(6), 1482–1493. DOI: 10.1037/0278-7393.22.6.1482
- Carota, F., Moseley, R., & Pulvermüller, F. (2012). Body-part-specific representations of semantic noun categories. Journal of Cognitive Neuroscience, 24(6), 1492–1509. DOI: 10.1162/jocn_a_00219
- Casasanto, D. (2009). Embodiment of abstract concepts: Good and bad in right- and left-handers. Journal of Experimental Psychology: General, 138(3), 351–367. DOI: 10.1037/a0015854
- Caselli, N. K., Sehyr, Z. S., Cohen-Goldberg, A. M., & Emmorey, K. (2017). ASL-LEX: A lexical database of American Sign Language. Behavior Research Methods, 49(2), 784–801. DOI: 10.3758/s13428-016-0742-0
- Castillo, M., Fojo, A., & Aguirre, R. (2021). Distribution of unidimensional space in the LSU time lexicon. In Proceedings of the 43rd Annual Meeting of the Cognitive Science Society (p. 3259).
https://escholarship.org/uc/item/5qn2w1p2 - Chasteen, A. L., Burdzy, D. C., & Pratt, J. (2010). Thinking of God moves attention. Neuropsychologia, 48(2), 627–630. DOI: 10.1016/j.neuropsychologia.2009.09.029
- Connell, L. (2007). Representing object colour in language comprehension. Cognition, 102(3), 476–485. DOI: 10.1016/j.cognition.2006.02.009
- Connell, L., & Lynott, D. (2009). Is a bear white in the woods? Parallel representation of implied object color during language comprehension. Psychonomic Bulletin & Review, 16(3), 573–577. DOI: 10.3758/PBR.16.3.573
- Connell, L., & Lynott, D. (2012). When does perception facilitate or interfere with conceptual processing? The effect of attentional modulation. Frontiers in Psychology, 3, Article 474. DOI: 10.3389/fpsyg.2012.00474
- Connolly, A. C., Gleitman, L. R., & Thompson-Schill, S. L. (2007). Effect of congenital blindness on the semantic representation of some everyday concepts. Proceedings of the National Academy of Sciences, 104(20), 8241–8246. DOI: 10.1073/pnas.0702812104
- wiek, A., Fuchs, S., Draxler, C., Asu, E. L., Dediu, D., Hiovain, K., Kawahara, S., Koutalidis, S., Krifka, M., Lippus, P., Lupyan, G., Oh, G. E., Paul, J., Petrone, C., Ridouane, R., Reiter, S., Schümchen, N., Szalontai, A., Ünal-Logacev, Ö., Zeller, J., Perlman, M., & Winter, B. (2021). The bouba/kiki effect is robust across cultures and writing systems. Philosophical Transactions of the Royal Society B, 377(1841), Article 20200390. DOI: 10.1098/rstb.2020.0390
- D’Ascenzo, S., Lugli, L., Nicoletti, R., & Fischer, M. H. (2020). Assessing orienting of attention to understand the time course of mental calculation. Cognitive Processing, 21(4), 493–500. DOI: 10.1007/s10339-020-00970-y
- de Koning, B. B., Wassenburg, S. I., Bos, L. T., & van der Schoot, M. (2017). Mental simulation of four visual object properties: Similarities and differences as assessed by the sentence–picture verification task. Journal of Cognitive Psychology, 29(4), 420–432. DOI: 10.1080/20445911.2017.1281283
- de Vega, M., Moreno, V., & Castillo, D. (2013). The comprehension of action-related sentences may cause interference rather than facilitation on matching actions. Psychological Research, 77(1), 20–30. DOI: 10.1007/s00426-011-0356-1
- Dehaene, S., Bossini, S., & Giraux, P. (1993). The mental representation of parity and number magnitude. Journal of Experimental Psychology: General, 122(3), 371–396. DOI: 10.1037/0096-3445.122.3.371
- Dingemanse, M. (2012). Advances in the cross-linguistic study of ideophones. Language and Linguistics Compass, 6(10), 654–672. DOI: 10.1002/lnc3.361
- Dingemanse, M., Blasi, D. E., Lupyan, G., Christiansen, M. H., & Monaghan, P. (2015). Arbitrariness, iconicity, and systematicity in language. Trends in Cognitive Sciences, 19(10), 603–615. DOI: 10.1016/j.tics.2015.07.013
- Dooley, E. (2021).
SNARC effect for verbal probability quantifiers in economic decision making task . [Master’s thesis, Berlin School of Mind & Brain, Humboldt University]. The Open Science Framework.https://osf.io/uq5zr/?view_only=11cbe1a11a8c401892ee391c00a6a92e - Drijvers, L., & Özyürek, A. (2017). Visual context enhanced: The joint contribution of iconic gestures and visible speech to degraded speech comprehension. Journal of Speech, Language, and Hearing Research, 60(1), 212–222. DOI: 10.1044/2016_JSLHR-H-16-0101
- Drijvers, L., Özyürek, A., & Jensen, O. (2018). Hearing and seeing meaning in noise: Alpha, beta, and gamma oscillations predict gestural enhancement of degraded speech comprehension. Human Brain Mapping, 39(5), 2075–2087. DOI: 10.1002/hbm.23987
- Emmorey, K. (2001).
Space on hand: The exploitation of signing space to illustrate abstract thought . In M. Gattis (Ed.), Spatial schemas and abstract thought (pp. 147–174). MIT Press. - Estes, Z., & Barsalou, L. W. (2018). A comprehensive meta-analysis of spatial interference from linguistic cues: Beyond Petrova et al. (2018). Psychological Science, 29(9), 1558–1564. DOI: 10.1177/0956797618794131
- Estes, Z., Verges, M., & Barsalou, L. W. (2008). Head up, foot down: Object words orient attention to the objects’ typical location. Psychological Science, 19(2), 93–97. DOI: 10.1111/j.1467-9280.2008.02051.x
- Fischer, M. H. (2012). A hierarchical view of grounded, embodied and situated numerical cognition. Cognitive Processing, 13(S1), S161–S164. DOI: 10.1007/s10339-012-0477-5
- Fischer, M. H., & Brugger, P. (2011). When digits help digits: Spatial–numerical associations point to finger counting as prime example of embodied cognition. Frontiers in Psychology, 2, Article 260. DOI: 10.3389/fpsyg.2011.00260
- Fischer, M. H., & Shaki, S. (2018). Number concepts: Abstract and embodied. Philosophical Transactions of the Royal Society B: Biological Sciences, 373(1752), Article 20170125. DOI: 10.1098/rstb.2017.0125
- Fischer, M. H., Winter, B., Felisatti, A., Myachykov, A., Mende, M. A., & Shaki, S. (2021). More Instructions Make Fewer Subtractions. Frontiers in Psychology, 12, Article 20616. DOI: 10.3389/fpsyg.2021.720616
- Fischer, M. H., & Zwaan, R. A. (2008). Embodied language: A review of the role of the motor system in language comprehension. Quarterly Journal of Experimental Psychology, 61(6), 825–850. DOI: 10.1080/17470210701623605
- Frak, V., Nazir, T., Goyette, M., Cohen, H., & Jeannerod, M. (2010). Grip force is part of the semantic representation of manual action verbs. PloS one, 5(3), Article
e9728 . DOI: 10.1371/journal.pone.0009728 - Fusaroli, R., & Tylén, K. (2016). Investigating conversational dynamics: Interactive alignment, interpersonal synergy, and collective task performance. Cognitive Science, 40(1), 145–171. DOI: 10.1111/cogs.12251
- Gallese, V., & Lakoff, G. (2005). The brain’s concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology, 22(3–4), 455–479. DOI: 10.1080/02643290442000310
- Gambrell, L. B., & Jawitz, P. B. (1993). Mental imagery, text illustrations, and children’s story comprehension and recall. Reading Research Quarterly, 265–276. DOI: 10.2307/747998
- García, A. M., & Ibáñez, A. (2016). A touch with words: Dynamic synergies between manual actions and language. Neuroscience & Biobehavioral Reviews, 68, 59–95. DOI: 10.1016/j.neubiorev.2016.04.022
- Garrido, M. V., & Godinho, S. (2021). When vowels make us smile: The influence of articulatory feedback in judgments of warmth and competence. Cognition and Emotion, 35(5), 837–843. DOI: 10.1080/02699931.2021.1900076
- Gianelli, C., Farnè, A., Salemme, R., Jeannerod, M., & Roy, A. C. (2011). The agent is right: When motor embodied cognition is space-dependent. PLoS one, 6(9). Article
e25036 . DOI: 10.1371/journal.pone.0025036 - Gibbs, R. W.
Jr. , (2017).Embodiment . In B. Dancygier (Ed.), The Cambridge Handbook of Cognitive Linguistics (pp. 449–462). Cambridge University Press. DOI: 10.1017/9781316339732 - Glenberg, A. M. (2015). Few believe the world is flat: How embodiment is changing the scientific understanding of cognition. Canadian Journal of Experimental Psychology, 69, 165–171. DOI: 10.1037/cep0000056
- Glenberg, A. M., & Gallese, V. (2012). Action-based language: A theory of language acquisition, comprehension, and production. Cortex, 48(7), 905–922. DOI: 10.1016/j.cortex.2011.04.010
- Glenberg, A. M., Gutierrez, T., Levin, J. R., Japuntich, S., & Kaschak, M. P. (2004). Activity and imagined activity can enhance young children’s reading comprehension. Journal of Educational Psychology, 96(3), 424–436. DOI: 10.1037/0022-0663.96.3.424
- Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin & Review, 9(3), 558–565. DOI: 10.3758/BF03196313
- Glenberg, A. M., & Robertson, D. A. (1999). Indexical understanding of instructions. Discourse Processes, 28(1), 1–26. DOI: 10.1080/01638539909545067
- Glenberg, A. M., & Robertson, D. A. (2000). Symbol grounding and meaning: A comparison of high-dimensional and embodied theories of meaning. Journal of Memory and Language, 43, 379–401. DOI: 10.1006/jmla.2000.2714
- Goldberg, R. F., Perfetti, C. A., & Schneider, W. (2006). Perceptual knowledge retrieval activates sensory brain regions. Journal of Neuroscience, 26(18), 4917–4921. DOI: 10.1523/JNEUROSCI.5389-05.2006
- Gómez, L., & Glenberg, A. M. (2022).
Embodied classroom activities for vocabulary acquisition . In S. L. Macrine, & J. Fugate (Eds.), Movement Matters: How Embodied Cognition Informs Teaching and Learning (pp. 77–90). MIT Press. - Gozli, D. G., Chasteen, A. L., & Pratt, J. (2013). The cost and benefit of implicit spatial cues for visual attention. Journal of Experimental Psychology: General, 142(4), 1028–1046. DOI: 10.1037/a0030362
- Günther, F., Dudschig, C., & Kaup, B. (2016). Latent semantic analysis cosines as a cognitive similarity measure: Evidence from priming studies. The Quarterly Journal of Experimental Psychology, 69, 626–653. DOI: 10.1080/17470218.2015.1038280
- Günther, F., Nguyen, T., Chen, L., Dudschig, C., Kaup, B., & Glenberg, A. M. (2020). Immediate sensorimotor grounding of novel concepts learned from language alone. Journal of Memory and Language, 115, Article 104172. DOI: 10.1016/j.jml.2020.104172
- Günther, F., Petilli, M. A., Vergallito, A., & Marelli, M. (2020). Images of the unseen: Extrapolating visual representations for abstract and concrete words in a data-driven computational model. Psychological Research. Advance online publication. DOI: 10.1007/s00426-020-01429-7
- Günther, F., Rinaldi, L., & Marelli, M. (2019). Vector-space models of semantic representation from a cognitive perspective: A discussion of common misconceptions. Perspectives on Psychological Science, 14, 1006–1033. DOI: 10.1177/1745691619861372
- Hald, L. A., Marshall, J.-A., Janssen, D. P., & Garnham, A. (2011). Switching modalities in a sentence verification task: ERP evidence for embodied language processing. Frontiers in Psychology, 2, Article 45. DOI: 10.3389/fpsyg.2011.00045
- Harnad, S. (1990). The symbol grounding problem. Physica D: Nonlinear Phenomena, 42(1–3), 335–346. DOI: 10.1016/0167-2789(90)90087-6
- Harris, Z. (1954). Distributional structure. Word, 10(2–3), 146–162. DOI: 10.1080/00437956.1954.11659520
- Hauk, O., Johnsrude, I., & Pulvermüller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41(2), 301–307. DOI: 10.1016/S0896-6273(03)00838-9
- Havas, D. A., Glenberg, A. M., & Rinck, M. (2007). Emotion simulation during language comprehension. Psychonomic Bulletin & Review, 14(3), 436–441. DOI: 10.3758/BF03194085
- Havas, D. H., Glenberg, A. M., Gutowski, K., Lucarelli, M., & Davidson, R. (2010). Cosmetic use of Botulinum Toxin-A affects processing of emotional language. Psychological Science, 21, 895–900. DOI: 10.1177/0956797610374742
- Heldner, M., & Edlund, J. (2010). Pauses, gaps and overlaps in conversations. Journal of Phonetics, 38(4), 555–568. DOI: 10.1016/j.wocn.2010.08.002
- Hockett, C. F. (1963).
The problem of universals in language . In J. H. Greenberg (Ed.), Universals of language (pp. 1–29). MIT Press. - Holler, J., Kendrick, K. H., & Levinson, S. C. (2018). Processing language in face-to-face conversation: Questions with gestures get faster responses. Psychonomic Bulletin & Review, 25(5), 1900–1908. DOI: 10.3758/s13423-017-1363-z
- Holler, J., & Wilkin, K. (2011). Co-speech gesture mimicry in the process of collaborative referring during face-to-face dialogue. Journal of Nonverbal Behavior, 35(2), 133–153. DOI: 10.1007/s10919-011-0105-6
- Hommel, B., Pratt, J., Colzato, L., & Godijn, R. (2001). Symbolic control of visual attention. Psychological Science, 12(5), 360–365. DOI: 10.1111/1467-9280.00367
- Horchak, O. V., & Garrido, M. V. (2022). Simulating background settings during spoken and written sentence comprehension. Psychonomic Bulletin & Review. DOI: 10.3758/s13423-022-02061-9
- Horchak, O. V., Giger, J. C., Cabral, M., & Pochwatko, G. (2014). From demonstration to theory in embodied language comprehension: A review. Cognitive Systems Research, 29, 66–85. DOI: 10.1016/j.cogsys.2013.09.002
- Horchak, O. V., Giger, J. C., & Pochwatko, G. (2014). Discourse comprehension and simulation of positive emotions. Psicologica: International Journal of Methodology and Experimental Psychology, 35(1), 17–37.
- Huettig, F., & Altmann, G. T. (2011). Looking at anything that is green when hearing “frog”: How object surface colour and stored object colour knowledge influence language-mediated overt attention. Quarterly Journal of Experimental Psychology, 64(1), 122–145. DOI: 10.1080/17470218.2010.481474
- Huettig, F., Guerra, E., & Helo, A. (2020). Towards understanding the task dependency of embodied language processing: The influence of colour during language-vision interactions. Journal of Cognition, 3(1), Article 41. DOI: 10.5334/joc.135
- Ibáñez, A., Kühne, K., Miklashevsky, A., Monaco, E., Muraki, E., Ranzini, M., Speed, L. J., & Tuena, C. (2022). The importance of considering individual differences and context to understand embodied language processes [Manuscript submitted for publication].
- Imai, M., & Kita, S. (2014). The sound symbolism bootstrapping hypothesis for language acquisition and language evolution. Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1651), Article 20130298. DOI: 10.1098/rstb.2013.0298
- Jeannerod, M. (2001). Neural simulation of action: A unifying mechanism for motor cognition. Neuroimage, 14(1), S103–S109. DOI: 10.1006/nimg.2001.0832
- Johansson Falck, M., & Gibbs, R. W.
Jr. , (2012). Embodied motivations for metaphorical meanings. Cognitive Linguistics, 23(2), 251–272. DOI: 10.1515/cog-2012-0008 - Johns, B. T., & Jones, M. N. (2012). Perceptual inference through global lexical similarity. Topics in Cognitive Science, 4(1), 103–120. DOI: 10.1111/j.1756-8765.2011.01176.x
- Johnson-Laird, P. N. (1983). Mental models: Towards a cognitive science of language, inference, and consciousness. Harvard University Press.
- Kaschak, M. P., & Borreggine, K. L. (2008). Temporal dynamics of the action-sentence compatibility effect. Quarterly Journal of Experimental Psychology, 61(6), 883–895. DOI: 10.1080/17470210701623852
- Kendrick, K. H. (2015). Other-initiated repair in English. Open Linguistics, 1(1), 164–190. DOI: 10.2478/opli-2014-0009
- Kim, J. S., Elli, G. V., & Bedny, M. (2019). Knowledge of animal appearance among sighted and blind adults. Proceedings of the National Academy of Sciences, 116(23), 11213–11222. DOI: 10.1073/pnas.1900952116
- Kita, S. (1997). Two-dimensional semantic analysis of Japanese mimetics. Linguistics, 35(2), 379–415. DOI: 10.1515/ling.1997.35.2.379
- Klatzky, R. L., Pellegrino, J. W., McCloskey, B. P., & Doherty, S. (1989). Can you squeeze a tomato? The role of motor representations in semantic sensibility judgments. Journal of Memory and Language, 28(1), 56–77. DOI: 10.1016/0749-596X(89)90028-4
- Köhler, W. (1929). Gestalt psychology. Liveright.
- Körner, A., & Rummer, R. (2022). Articulation contributes to valence sound symbolism. Journal of Experimental Psychology: General, 151(5), 1107–1114. DOI: 10.1037/xge0001124
- Körner, A., Topolinski, S., & Strack, F. (2015). Routes to embodiment. Frontiers in Psychology, 6, Article 940. DOI: 10.3389/fpsyg.2015.00940
- Kuhnke, P., Kiefer, M., & Hartwigsen, G. (2020). Task-dependent recruitment of modality-specific and multimodal regions during conceptual processing. Cerebral Cortex, 30(7), 3938–3959. DOI: 10.1093/cercor/bhaa010
- Lakoff, G., & Johnson, M. (1980). Metaphors we live by. University of Chicago Press.
- Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato’s problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review, 104, 211–240. DOI: 10.1037/0033-295X.104.2.211
- Lenci, A. (2008). Distributional semantics in linguistic and cognitive research. Italian Journal of Linguistics, 20(1), 1–31.
- Levinson, S. C. (2016). Turn-taking in human communication: Origins and implications for language processing. Trends in Cognitive Sciences, 20(1), 6–14. DOI: 10.1016/j.tics.2015.10.010
- Levinson, S. C., & Torreira, F. (2015). Timing in turn-taking and its implications for processing models of language. Frontiers in Psychology, 6, Article 731. DOI: 10.3389/fpsyg.2015.00731
- Lewis, M., Zettersten, M., & Lupyan, G. (2019). Distributional semantics as a source of visual knowledge. Proceedings of the National Academy of Sciences, 116(39), 19237–19238. DOI: 10.1073/pnas.1910148116
- Liu, D., Cai, D., Verguts, T., & Chen, Q. (2017). The time course of spatial attention shifts in elementary arithmetic. Scientific Reports, 7, Article 921. DOI: 10.1038/s41598-017-01037-3
- Louwerse, M. M., & Connell, L. (2011). A taste of words: Linguistic context and perceptual simulation predict the modality of words. Cognitive Science, 35(2), 381–398. DOI: 10.1111/j.1551-6709.2010.01157.x
- Louwerse, M. M. (2011). Symbol interdependency in symbolic and embodied cognition. Topics in Cognitive Science, 3(2), 273–302. DOI: 10.1111/j.1756-8765.2010.01106.x
- Louwerse, M. M., & Jeuniaux, P. (2010). The linguistic and embodied nature of conceptual processing. Cognition, 114(1), 96–104. DOI: 10.1016/j.cognition.2009.09.002
- Louwerse, M. M., & Zwaan, R. A. (2009). Language encodes geographical information. Cognitive Science, 33(1), 51–73. DOI: 10.1111/j.1551-6709.2008.01003.x
- Lukas, S., Philipp, A. M., & Koch, I. (2010). Switching attention between modalities: Further evidence for visual dominance. Psychological Research, 74(3), 255–267. DOI: 10.1007/s00426-009-0246-y
- Lupyan, G., Abdel Rahman, R., Boroditsky, L., & Clark, A. (2020). Effects of language on visual perception. Trends in Cognitive Sciences, 24(11), 930–944. DOI: 10.1016/j.tics.2020.08.005
- Lynott, D., & Connell, L. (2009). Modality exclusivity norms for 423 object properties. Behavior Research Methods, 41(2), 558–564. DOI: 10.3758/BRM.41.2.558
- Macedonia, M. (2014). Bringing back the body into the mind: Gestures enhance word learning in foreign language. Frontiers in Psychology, 5, Article 1467. DOI: 10.3389/fpsyg.2014.01467
- Machery, E. (2007). Concept empiricism: A methodological critique. Cognition, 104(1), 19–46. DOI: 10.1016/j.cognition.2006.05.002
- Madan, C. R., & Singhal, A. (2012). Using actions to enhance memory: Effects of enactment, gestures, and exercise on human memory. Frontiers in Psychology, 3, Article 507. DOI: 10.3389/fpsyg.2012.00507
- Mahon, B. Z., & Caramazza, A. (2008). A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content. Journal of Physiology-Paris, 102(1–3), 59–70. DOI: 10.1016/j.jphysparis.2008.03.004
- Mandera, P., Keuleers, E., & Brysbaert, M. (2017). Explaining human performance in psycholinguistic tasks with models of semantic similarity based on prediction and counting: A review and empirical validation. Journal of Memory and Language, 92, 57–78. DOI: 10.1016/j.jml.2016.04.001
- Mannaert, L. N. H., Dijkstra, K., & Zwaan, R. A. (2017). Is color an integral part of a rich mental simulation? Memory & Cognition, 45(6), 974–982. DOI: 10.3758/s13421-017-0708-1
- Manrique, E., & Enfield, N. (2015). Suspending the next turn as a form of repair initiation: Evidence from Argentine sign language. Frontiers in Psychology, 6, Article 1326. DOI: 10.3389/fpsyg.2015.01326
- Masson, M., Letesson, C., & Pesenti, M. (2018). Time course of overt attentional shifts in mental arithmetic: Evidence from gaze metrics. Quarterly Journal of Experimental Psychology, 71(4), 1009–1019. DOI: 10.1080/17470218.2017.1318931
- McCrink, K., Dehaene, S., & Dehaene-Lambertz, G. (2007). Moving along the number line: Operational momentum in non-symbolic arithmetic. Perception & Psychophysics, 69(8), 1324–1333. DOI: 10.3758/BF03192949
- Meteyard, L., Cuadrado, S. R., Bahrami, B., & Vigliocco, G. (2012). Coming of age: A review of embodiment and the neuroscience of semantics. Cortex, 48(7), 788–804. DOI: 10.1016/j.cortex.2010.11.002
- Mioni, G., Fischer, M. H., & Shaki, S. (2021). Heuristics and biases in the mental manipulation of magnitudes: Evidence from length and time production. Quarterly Journal of Experimental Psychology, 74(3), 536–547. DOI: 10.1177/1747021820967663
- Monaghan, P., Shillcock, R. C., Christiansen, M. H., & Kirby, S. (2014). How arbitrary is language? Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1651), Article 20130299. DOI: 10.1098/rstb.2013.0299
- Mondada, L. (2016). Challenges of multimodality: Language and the body in social interaction. Journal of Sociolinguistics, 20(3), 336–366. DOI: 10.1111/josl.1_12177
- Morey, R. D., Kaschak, M. P., Díez-Álamo, A. M., Glenberg, A. M., Zwaan, R. A., Lakens, D., … & Ziv-Crispel, N. (2022). A pre-registered, multi-lab non-replication of the action-sentence compatibility effect (ACE). Psychonomic Bulletin & Review, 29(2), 613–626. DOI: 10.3758/s13423-021-01927-8
- Murgiano, M., Motamedi, Y., & Vigliocco, G. (2021). Situating language in the real-world: The role of multimodal iconicity and indexicality. Journal of Cognition, 4(1), Article 38. DOI: 10.5334/joc.113
- Myachykov, A., Scheepers, C., Fischer, M. H., & Kessler, K. (2014). TEST: A tropic, embodied, and situated theory of cognition. Topics in Cognitive Science, 6(3), 442–460. DOI: 10.1111/tops.12024
- Naor-Raz, G., Tarr, M. J., & Kersten, D. (2003). Is color an intrinsic property of object representation? Perception, 32(6), 667–680. DOI: 10.1068/p5050
- Niedenthal, P. M., Winkielman, P., Mondillon, L., & Vermeulen, N. (2009). Embodiment of emotion concepts. Journal of Personality and Social Psychology, 96(6), 1120–1136. DOI: 10.1037/a0015574
- Núñez, R., & Cooperrider, K. (2013). The tangle of space and time in human cognition. Trends in Cognitive Sciences, 17(5), 220–229. DOI: 10.1016/j.tics.2013.03.008
- Oakhill, J. V., Cain, K., & Bryant, P. E. (2003). The dissociation of word reading and text comprehension: Evidence from component skills. Language and Cognitive Processes, 18(4), 443–468. DOI: 10.1080/01690960344000008
- Oben, B., & Brône, G. (2016). Explaining interactive alignment: A multimodal and multifactorial account. Journal of Pragmatics, 104, 32–51. DOI: 10.1016/j.pragma.2016.07.002
- Ohala, J. (1994).
The frequency code underlies the sound-symbolic use of voice pitch . In L. Hinton, J. Nichols, & J. Ohala (Eds.), Sound Symbolism (pp. 325–347). Cambridge University Press. DOI: 10.1017/CBO9780511751806.022 - Ostarek, M., & Bottini, R. (2021). Towards strong inference in research on embodiment: Possibilities and limitations of causal paradigms. Journal of Cognition, 4(1), Article 5. DOI: 10.5334/joc.139
- Ostarek, M., & Huettig, F. (2019). Six challenges for embodiment research. Current Directions in Psychological Science, 28(6), 593–599. DOI: 10.1177/0963721419866441
- Ostarek, M., Joosen, D., Ishag, A., de Nijs, M., & Huettig, F. (2019). Are visual processes causally involved in “perceptual simulation” effects in the sentence-picture verification task? Cognition, 182, 84–94. DOI: 10.1016/j.cognition.2018.08.017
- Pan, Y., Dikker, S., Goldstein, P., Zhu, Y., Yang, C., & Hu, Y. (2020). Instructor-learner brain coupling discriminates between instructional approaches and predicts learning. NeuroImage, 211, Article 116657. DOI: 10.1016/j.neuroimage.2020.116657
- Papesh, M. H. (2015). Just out of reach: On the reliability of the action-sentence compatibility effect. Journal of Experimental Psychology: General, 144(6), e116–e141. DOI: 10.1037/xge0000125
- Parise, C. V., & Spence, C. (2012). Audiovisual crossmodal correspondences and sound symbolism: A study using the Implicit Association Test. Experimental Brain Research, 220(3–4), 319–333. DOI: 10.1007/s00221-012-3140-6
- Pecher, D., Zeelenberg, R., & Barsalou, L. W. (2003). Verifying different-modality properties for concepts produces switching costs. Psychological Science, 14(2), 119–124. DOI: 10.1111/1467-9280.t01-1-01429
- Pecher, D., Zeelenberg, R., & Barsalou, L. W. (2004). Sensorimotor simulations underlie conceptual representations: Modality-specific effects of prior activation. Psychonomic Bulletin & Review, 11(1), 164–167. DOI: 10.3758/BF03206477
- Pereira, F., Gershman, S., Ritter, S., & Botvinick, M. (2016). A comparative evaluation of off-the-shelf distributed semantic representations for modelling behavioural data. Cognitive Neuropsychology, 33(3–4), 175–190. DOI: 10.1080/02643294.2016.1176907
- Perniss, P., Thompson, R., & Vigliocco, G. (2010). Iconicity as a general property of language: Evidence from spoken and signed languages. Frontiers in Psychology, 1, Article 227. DOI: 10.3389/fpsyg.2010.00227
- Petilli, M. A., Günther, F., Vergallito, A., Ciapparelli, M., & Marelli, M. (2021). Data-driven computational models reveal perceptual simulation in word comprehension. Journal of Memory and Language, 117, Article 104194. DOI: 10.1016/j.jml.2020.104194
- Petrova, A., Navarrete, E., Suitner, C., Sulpizio, S., Reynolds, M., Job, R., & Peressotti, F. (2018). Spatial congruency effects exist, just not for words: Looking into Estes, Verges, and Barsalou (2008). Psychological Science, 29(7), 1195–1199. DOI: 10.1177/0956797617728127
- Pezzulo, G., Barsalou, L. W., Cangelosi, A., Fischer, M. H., Spivey, M., & McRae, K. (2013). Computational grounded cognition: A new alliance between grounded cognition and computational modeling. Frontiers in Psychology, 3, Article 612. DOI: 10.3389/fpsyg.2012.00612
- Pfau, R., Steinbach, M., & Woll, B. (2012). Sign language. De Gruyter Mouton. DOI: 10.1515/9783110261325
- Pickering, M. J., & Garrod, S. (2004). Toward a mechanistic psychology of dialogue. Behavioral and Brain Sciences, 27(2), 169–226. DOI: 10.1017/S0140525X04000056
- Platonova, O., & Miklashevsky, A. (2022). Warm + fuzzy: Perceptual semantics can be activated even during surface lexical processing. Manuscript in preparation. DOI: 10.17605/OSF.IO/A85H7
- Posner, M. I. (1980). Orienting of attention. Quarterly Journal of Experimental Psychology, 32(1), 3–25. DOI: 10.1080/00335558008248231
- Pouw, W., & Holler, J. (2020). Timing in conversation is dynamically adjusted turn by turn: Evidence for lag-1 negatively autocorrelated turn taking times in telephone conversation. PsyArXiv preprint. DOI: 10.31234/osf.io/b98da
- Pouw, W., Proksch, S., Drijvers, L., Gamba, M., Holler, J., Kello, C., Schaefer, R. S., & Wiggins, G. A. (2021). Multilevel rhythms in multimodal communication. Philosophical Transactions of the Royal Society B: Biological Sciences, 376(1835), Article 20200334. DOI: 10.1098/rstb.2020.0334
- Pulvermüller, F., Shtyrov, Y., & Hauk, O. (2009). Understanding in an instant: Neurophysiological evidence for mechanistic language circuits in the brain. Brain and Language, 110(2), 81–94. DOI: 10.1016/j.bandl.2008.12.001
- Rasenberg, M., Özyürek, A., & Dingemanse, M. (2020). Alignment in multimodal interaction: An integrative framework. Cognitive Science, 44(11), Article
e12911 . DOI: 10.1111/cogs.12911 - Reggin, L. D., Gómez Franco, L. E., Horchak, O. V., Labrecque, D., Lana, N., Lorenzini, I., Rio, L., & Vigliocco, G. (2022). Language is not acquired in the lab but in the real world: The role of embodied and situated cognition. [Manuscript submitted for publication].
- Rinaldi, L., & Marelli, M. (2020a). The use of number words in natural language obeys Weber’s law. Journal of Experimental Psychology: General, 149(7), 1215–1230. DOI: 10.1037/xge0000715
- Rinaldi, L., & Marelli, M. (2020b). Maps and space are entangled with language experience. Trends in Cognitive Sciences, 24(11), 853–855. DOI: 10.1016/j.tics.2020.07.009
- Rinaldi, L., Parente, L., & Marelli, M. (2022). Toward a unified account of nonsymbolic and symbolic representations of number: Insights from a combined psychophysical-computational approach. Psychonomic Bulletin & Review, 29(3), 985–994. DOI: 10.3758/s13423-021-02043-3
- Robinson, M. D., & Thomas, L. E. (2021).
Introduction to Embodied Psychology: Thinking, Feeling, and Acting . In M. D. Robinson & L. E. Thomas (Eds.), Handbook of Embodied Psychology (pp. 1–19). Springer. DOI: 10.1007/978-3-030-78471-3_1 - Rueschemeyer, S. A., Glenberg, A. M., Kaschak, M., Mueller, K., & Friederici, A. (2010). Top-down and bottom-up contributions to understanding sentences describing objects in motion. Frontiers in Psychology, 1, Article 183. DOI: 10.3389/fpsyg.2010.00183
- Rummer, R., & Schweppe, J. (2019). Talking emotions: Vowel selection in fictional names depends on the emotional valence of the to-be-named faces and objects. Cognition and Emotion, 33(3), 404–416. DOI: 10.1080/02699931.2018.1456406
- Rummer, R., Schweppe, J., Schlegelmilch, R., & Grice, M. (2014). Mood is linked to vowel type: The role of articulatory movements. Emotion, 14(2), 246–250. DOI: 10.1037/a0035752
- Sahlgren, M. (2008). The distributional hypothesis. Italian Journal of Linguistics, 20, 33–53.
- Sapir, E. (1929). A study in phonetic symbolism. Journal of Experimental Psychology, 12(3), 225–239. DOI: 10.1037/h0070931
- Scerrati, E., Baroni, G., Borghi, A. M., Galatolo, R., Lugli, L., & Nicoletti, R. (2015). The modality-switch effect: Visually and aurally presented prime sentences activate our senses. Frontiers in Psychology, 6, Article 1668. DOI: 10.3389/fpsyg.2015.01668
- Scerrati, E., Lugli, L., Nicoletti, R., & Borghi, A. M. (2017). The multilevel modality-switch effect: What happens when we see the bees buzzing and hear the diamonds glistening. Psychonomic Bulletin & Review, 24(3), 798–803. DOI: 10.3758/s13423-016-1150-2
- Schank, R. C., & Abelson R. P. (1977).
Scripts, plans, goals and understanding: An inquiry into human knowledge structures . Lawrence Erlbaum. - Scheepers, C., & Sturt, P. (2014). Bidirectional syntactic priming across cognitive domains: From arithmetic to language and back. Quarterly Journal of Experimental Psychology, 67(8), 1643–1654. DOI: 10.1080/17470218.2013.873815
- Schembri, A., Fenlon, J., Rentelis, R., Reynolds, S., & Cormier, K. (2013). Building the British sign language corpus. Language Documentation & Conservation, 7, 136–154.
http://hdl.handle.net/10125/4592 - Schneider, E., Maruyama, M., Dehaene, S., & Sigman, M. (2013). Eye gaze reveals a fast, parallel extraction of the syntax of arithmetic formulas. Cognition, 125(3), 475–490. DOI: 10.1016/j.cognition.2012.06.015
- Shaki, S., Pinhas, M., & Fischer, M. H. (2018). Heuristics and biases in mental arithmetic: Revisiting and reversing operational momentum. Thinking and Reasoning, 24(2), 138–156. DOI: 10.1080/13546783.2017.1348987
- Shapiro, L., & Spaulding, S. (2021).
Embodied Cognition . In E. N. Zalta (Ed.), The Stanford Encyclopedia of Philosophy (Winter 2021 ed.). Stanford University.https://plato.stanford.edu/archives/win2021/entries/embodied-cognition/ - Shebani, Z., & Pulvermüller, F. (2018). Flexibility in language action interaction: The influence of movement type. Frontiers in Human Neuroscience, 12, Article 252. DOI: 10.3389/fnhum.2018.00252
- Shepard, R. N., & Cooper, L. A. (1992). Representation of colors in the blind, color-blind, and normally sighted. Psychological Science, 3(2), 97–104. DOI: 10.1111/j.1467-9280.1992.tb00006.x
- Shtyrov, Y., Butorina, A., Nikolaeva, A., & Stroganova, T. (2014). Automatic ultrarapid activation and inhibition of cortical motor systems in spoken word comprehension. Proceedings of the National Academy of Sciences, 111(18), E1918–E1923. DOI: 10.1073/pnas.1323158111
- Sidhu, D. M., & Pexman, P. M. (2018). Five mechanisms of sound symbolic association. Psychonomic Bulletin & Review, 25(5), 1619–1643. DOI: 10.3758/s13423-017-1361-1
- Sinte, A. (2013).
Expression of time in French Belgian Sign Language (LSFB) . In L. Meurant, A. Sinte, M. van Herreweghe & M. Vermeerbergen (Eds.), Sign language research, uses and practices: Crossing views on theoretical and applied sign language linguistics (pp. 205–235). De Gruyter Mouton; Ishara Press. DOI: 10.1515/9781614511472.205 - Snefjella, B., Lana, N., & Kuperman, V. (2020). How emotion is learned: Semantic learning of novel words in emotional contexts. Journal of Memory and Language, 115, Article 104171. DOI: 10.1016/j.jml.2020.104171
- Stivers, T., Enfield, N. J., Brown, P., Englert, C., Hayashi, M., Heinemann, T., Hoymann, G., Rossano, F., Ruiter, J. P. de, Yoon, K.-E., & Levinson, S. C. (2009). Universals and cultural variation in turn-taking in conversation. Proceedings of the National Academy of Sciences, 106(26), 10587–10592. DOI: 10.1073/pnas.0903616106
- ter Bekke, M., Drijvers, L., & Holler, J. (2020). The predictive potential of hand gestures during conversation: An investigation of the timing of gestures in relation to speech. PsyArXiV preprint. DOI: 10.31234/osf.io/b5zq7
- Thompson, P. D., & Estes, Z. (2011). Sound symbolic naming of novel objects is a graded function. Quarterly Journal of Experimental Psychology, 64(12), 2392–2404. DOI: 10.1080/17470218.2011.605898
- Thompson, R. L., Vinson, D. P., & Vigliocco, G. (2009). The link between form and meaning in American Sign Language: Lexical processing effects. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35(2), 550–557. DOI: 10.1037/a0014547
- Thorndyke, P. W. (1977). Cognitive structures in comprehension and memory of narrative discourse. Cognitive Psychology, 9(1), 77–110. DOI: 10.1016/0010-0285(77)90005-6
- Trujillo, J. P., Levinson, S. C., & Holler, J. (2021).
Visual information in computer-mediated interaction matters: Investigating the association between the availability of gesture and turn transition timing in conversation . In M. Kurosu (Ed.), Human-Computer Interaction. Design and User Experience Case Studies (pp. 643–657). Springer. DOI: 10.1007/978-3-030-78468-3_44 - Trujillo, J. P., Özyürek, A., Holler, J., & Drijvers, L. (2021). Speakers exhibit a multimodal Lombard effect in noise. Scientific Reports, 11(1), Article 16721. DOI: 10.1038/s41598-021-95791-0
- Tsaregorodtseva, O., Frazier, L., Stolterfoht, B., & Kaup, B. (2022). Does language activate the sensorimotor properties of the entities it refers to and, if so, under what circumstances? Manuscript in preparation. DOI: 10.17605/OSF.IO/N7M9U
- Vainio, L., & Vainio, M. (2021). Sound-action symbolism. Frontiers in Psychology, 12, Article 718700. DOI: 10.3389/fpsyg.2021.718700
- van Elk, M., van Schie, H. T., Zwaan, R. A., & Bekkering, H. (2010). The functional role of motor activation in language processing: Motor cortical oscillations support lexical-semantic retrieval. NeuroImage, 50(2), 665–677. DOI: 10.1016/j.neuroimage.2009.12.123
- Vedaldi, A., & Lenc, K. (2015). MatConvNet: Convolutional neural networks for Matlab. In Proceedings of the 23rd ACM International Conference on Multimedia (pp. 689–692). DOI: 10.1145/2733373.2807412
- Vigliocco, G., Vinson, D. P., Lewis, W., & Garrett, M. F. (2004). Representing the meanings of object and action words: The featural and unitary semantic space hypothesis. Cognitive Psychology, 48(4), 422–488. DOI: 10.1016/j.cogpsych.2003.09.001
- Vogt, A., Kaup, B., & Abdel Rahman, R. (2021). Experience-driven meaning affects lexical choices during language production. PsyArXiV preprint. DOI: 10.31234/osf.io/ru7ms
- Wasner, M., Moeller, K., Fischer, M. H., & Nuerk, H. C. (2014). Aspects of situated cognition in embodied numerosity: The case of finger counting habits. Cognitive Processing, 15, 317–328. DOI: 10.1007/s10339-014-0599-z
- Whalen, D. H., & Levitt, A. G. (1995). The universality of intrinsic F0 of vowels. Journal of Phonetics, 23(3), 349–366. DOI: 10.1016/S0095-4470(95)80165-0
- Winter, A., Dudschig, C., & Kaup, B. (2021). The action-sentence compatibility effect (ACE) a benchmark finding for embodiment: A meta-analysis. PsyArXiV preprint. DOI: 10.31234/osf.io/wfpz7
- Winter, B. (2019). Sensory linguistics: Language, perception and metaphor. John Benjamins. DOI: 10.1075/celcr.20
- Winter, B., Perlman, M., Perry, L. K., & Lupyan, G. (2017). Which words are most iconic? Iconicity in English sensory words. Interaction Studies, 18(3), 443–464. DOI: 10.1075/is.18.3.07win
- Wu, L. L., & Barsalou, L. W. (2009). Perceptual simulation in conceptual combination: Evidence from property generation. Acta Psychologica, 132(2), 173–189. DOI: 10.1016/j.actpsy.2009.02.002
- Yee, E., Ahmed, S. Z., & Thompson-Schill, S. L. (2012). Colorless green ideas (can) prime furiously. Psychological Science, 23(4), 364–369. DOI: 10.1177/0956797611430691
- Yu, C. S., McBeath, M. K., & Glenberg, A. M. (2021). The gleam-glum effect: /i:/ versus // phonemes generically carry emotional valence. Journal of Experimental Psychology: Learning, Memory, and Cognition, 47(7), 1173–1185. DOI: 10.1037/xlm0001017
- Zwaan, R. A. (2021). Two challenges to “embodied cognition” research and how to overcome them. Journal of Cognition, 4(1), Article 14. DOI: 10.5334/joc.151
- Zwaan, R. A., & Pecher, D. (2012). Revisiting mental simulation in language comprehension: Six replication attempts. PLoS one, 7(12), Article
e51382 . DOI: 10.1371/journal.pone.0051382 - Zwaan, R. A., & Radvansky, G. A. (1998). Situation models in language comprehension and memory. Psychological Bulletin, 123(2), 162–185. DOI: 10.1037/0033-2909.123.2.162
DOI: https://doi.org/10.5334/joc.231 | Journal eISSN: 2514-4820
Language: English
Submitted on: Jan 14, 2022
Accepted on: Jun 13, 2022
Published on: Oct 10, 2023
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year
© 2023 Anita Körner, Mauricio Castillo, Linda Drijvers, Martin H. Fischer, Fritz Günther, Marco Marelli, Olesia Platonova, Luca Rinaldi, Samuel Shaki, James P. Trujillo, Oksana Tsaregorodtseva, Arthur M. Glenberg, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.