Computational Investigations of Learning and Synchronization in Cognitive Control
By: Pieter Huycke, Elise Lesage, C. Nico Boehler and Tom Verguts
References
- Abrahamse, E., Braem, S., Notebaert, W., & Verguts, T. (2016). Grounding cognitive control in associative learning. Psychological Bulletin, 142(7), 693–728. DOI: 10.1037/bul0000047
- Allport, A., Styles, E. A., & Hsieh, S. (1994). 17 Shifting intentional set: Exploring the dynamic control of tasks.
- Anderson, J. R. (2013). Cognitive skills and their acquisition. Psychology Press. DOI: 10.4324/9780203728178
- Arnau, S., Brümmer, T., Liegel, N., & Wascher, E. (2021). Inverse effects of time-on-task in task-related and task-unrelated theta activity. Psychophysiology, 58(6). DOI: 10.1111/psyp.13805
- Ashby, F. G., Ennis, J. M., & Spiering, B. J. (2007). A neurobiological theory of automaticity in perceptual categorization. Psychological Review, 114(3), 632–656. DOI: 10.1037/0033-295X.114.3.632
- Badre, D., Kayser, A. S., & D’Esposito, M. (2010). Frontal cortex and the discovery of abstract action rules. Neuron, 66(2), 315–326. DOI: 10.1016/j.neuron.2010.03.025
- Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108(3), 624–652. DOI: 10.1037/0033-295X.108.3.624
- Canolty, R. T., Edwards, E., Dalal, S. S., Soltani, M., Nagarajan, S. S., Kirsch, H. E., Berger, M. S., Barbaro, N. M., & Knight, R. T. (2006). High gamma power is phase-locked to theta oscillations in human neocortex. Science, 313(5793), 1626–1628. DOI: 10.1126/science.1128115
- Cavanagh, J. F., & Frank, M. J. (2014). Frontal theta as a mechanism for cognitive control. Trends in Cognitive Sciences, 18(8), 414–421. DOI: 10.1016/j.tics.2014.04.012
- Cavanagh, J. F., Zambrano-Vazquez, L., & Allen, J. J. B. (2012). Theta lingua franca: A common mid-frontal substrate for action monitoring processes: Omnipresent theta. Psychophysiology, 49(2), 220–238. DOI: 10.1111/j.1469-8986.2011.01293.x
- Clarke, A., Roberts, B. M., & Ranganath, C. (2018). Neural oscillations during conditional associative learning. NeuroImage, 174, 485–493. DOI: 10.1016/j.neuroimage.2018.03.053
- Cohen, M. X. (2014a). Fluctuations in Oscillation Frequency Control Spike Timing and Coordinate Neural Networks. Journal of Neuroscience, 34(27), 8988–8998. DOI: 10.1523/JNEUROSCI.0261-14.2014
- Cohen, M. X. (2014b). A neural microcircuit for cognitive conflict detection and signaling. Trends in Neurosciences, 37(9), 480–490. DOI: 10.1016/j.tins.2014.06.004
- Cooper, P. S., Karayanidis, F., McKewen, M., McLellan-Hall, S., Wong, A. S. W., Skippen, P., & Cavanagh, J. F. (2019). Frontal theta predicts specific cognitive control-induced behavioural changes beyond general reaction time slowing. NeuroImage, 189, 130–140. DOI: 10.1016/j.neuroimage.2019.01.022
- Crivelli-Decker, J., Hsieh, L.-T., Clarke, A., & Ranganath, C. (2018). Theta oscillations promote temporal sequence learning. Neurobiology of Learning and Memory, 153, 92–103. DOI: 10.1016/j.nlm.2018.05.001
- Crossman, E. R. (1959). A theory of the acquisition of speed-skill. Ergonomics, 2(2), 153–166. DOI: 10.1080/00140135908930419
- Engel, A. K., König, P., Kreiter, A. K., & Singer, W. (1991). Interhemispheric synchronization of oscillatory neuronal responses in cat visual cortex. Science (pp. 1177–1179). DOI: 10.1126/science.252.5009.1177
- Fitts, P. M. (1967). Human performance.
- Franklin, N. T., & Frank, M. J. (2020). Generalizing to generalize: Humans flexibly switch between compositional and conjunctive structures during reinforcement learning. PLOS Computational Biology, 16(4),
e1007720 . DOI: 10.1371/journal.pcbi.1007720 - Fries, P. (2015). Rhythms for Cognition: Communication through Coherence. Neuron, 88(1), 220–235. DOI: 10.1016/j.neuron.2015.09.034
- Fries, P., Nikolić, D., & Singer, W. (2007). The gamma cycle. Trends in Neurosciences, 30(7), 309–316. DOI: 10.1016/j.tins.2007.05.005
- Fries, P., Reynolds, J. H., Rorie, A. E., & Desimone, R. (2001). Modulation of oscillatory neuronal synchronization by selective visual attention. Science, 291(5508), 1560–1563. DOI: 10.1126/science.1055465
- Frings, C., Hommel, B., Koch, I., Rothermund, K., Dignath, D., Giesen, C., Kiesel, A., Kunde, W., Mayr, S., Moeller, B., Möller, M., Pfister, R., & Philipp, A. (2020). Binding and Retrieval in Action Control (BRAC). Trends in Cognitive Sciences, 24(5), 375–387. DOI: 10.1016/j.tics.2020.02.004
- Haazebroek, P., Raffone, A., & Hommel, B. (2017). HiTEC: A connectionist model of the interaction between perception and action planning. Psychological Research, 81(6), 1085–1109. DOI: 10.1007/s00426-016-0803-0
- Heaton, R. K. (1981). Wisconsin card sorting test manual. Psychological Assessment Resources.
- Hebb, D. O. (1949). The organization of behavior: A neuropsychological theory. Psychology Press.
- Higgins, I., Matthey, L., Pal, A., Burgess, C., Glorot, X., Botvinick, M., Mohamed, S., & Lerchner, A. (2016). beta-vae: Learning basic visual concepts with a constrained variational framework.
- Hommel, B. (1998). Event Files: Evidence for Automatic Integration of Stimulus-Response Episodes. Visual Cognition, 5(1–2), 183–216. DOI: 10.1080/713756773
- Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The Theory of Event Coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences, 24(5), 849–878. DOI: 10.1017/S0140525X01000103
- Hummel, J. E., & Holyoak, K. J. (2003). A symbolic-connectionist theory of relational inference and generalization. Psychological Review, 110(2), 220–264. DOI: 10.1037/0033-295X.110.2.220
- Huycke, P., Verbeke, P., Boehler, C. N., & Verguts, T. (2021). Theta and alpha power across fast and slow timescales in cognitive control. European Journal of Neuroscience, 54(2), 4581–4594. DOI: 10.1111/ejn.15320
- James, W., Burkhardt, F., Bowers, F., & Skrupskelis, I. K. (1890). The principles of psychology (Vol. 1). Macmillan London. DOI: 10.1037/10538-000
- Kahneman, D., Treisman, A., & Gibbs, B. J. (1992). The reviewing of object files: Object-specific integration of information. Cognitive Psychology, 24(2), 175–219. DOI: 10.1016/0010-0285(92)90007-O
- Kendrick, K. M., Zhan, Y., Fischer, H., Nicol, A. U., Zhang, X., & Feng, J. (2011). Learning alters theta amplitude, theta-gamma coupling and neuronal synchronization in inferotemporal cortex. BMC Neuroscience, 12(1), 55. DOI: 10.1186/1471-2202-12-55
- Kiesel, A., Steinhauser, M., Wendt, M., Falkenstein, M., Jost, K., Philipp, A. M., & Koch, I. (2010). Control and interference in task switching—A review. Psychological Bulletin, 136(5), 849–874. DOI: 10.1037/a0019842
- Koch, I., Gade, M., Schuch, S., & Philipp, A. M. (2010). The role of inhibition in task switching: A review. Psychonomic Bulletin & Review, 17(1), 1–14. DOI: 10.3758/PBR.17.1.1
- Logan, G. D. (1992). Shapes of reaction-time distributions and shapes of learning curves: A test of the instance theory of automaticity. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18(5), 883. DOI: 10.1037/0278-7393.18.5.883
- McCloskey, M., & Cohen, N. J. (1989).
Catastrophic interference in connectionist networks: The sequential learning problem . In Psychology of learning and motivation (Vol. 24, pp. 109–165). Elsevier. DOI: 10.1016/S0079-7421(08)60536-8 - Minsky, M., & Papert, S. A. (1969). Perceptrons: An introduction to computational geometry. The MIT Press. DOI: 10.7551/mitpress/11301.001.0001
- Monsell, S., & Mizon, G. A. (2006). Can the task-cuing paradigm measure an endogenous task-set reconfiguration process? Journal of Experimental Psychology: Human Perception and Performance, 32(3), 493–516. DOI: 10.1037/0096-1523.32.3.493
- Nigbur, R., Ivanova, G., & Stürmer, B. (2011). Theta power as a marker for cognitive interference. Clinical Neurophysiology, 122(11), 2185–2194. DOI: 10.1016/j.clinph.2011.03.030
- Pastötter, B., Moeller, B., & Frings, C. (2021). Watching the Brain as It (Un)Binds: Beta Synchronization Relates to Distractor–Response Binding. Journal of Cognitive Neuroscience, 33(8), 1581–1594. DOI: 10.1162/jocn_a_01730
- R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
https://www.R-project.org/ - Ratcliff, R. (1978). A theory of memory retrieval. Psychological Review, 85(2), 59–108. DOI: 10.1037/0033-295X.85.2.59
- Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Current Research and Theory (pp. 64–99).
- Rodriguez, E., George, N., Lachaux, J.-P., Martinerie, J., Renault, B., & Varela, F. J. (1999). Perception’s shadow: Long-distance synchronization of human brain activity. Nature, 397(6718), 430–433. DOI: 10.1038/17120
- Ruge, H., & Wolfensteller, U. (2010). Rapid formation of pragmatic rule representations in the human brain during instruction-based learning. Cerebral Cortex, 20(7), 1656–1667. DOI: 10.1093/cercor/bhp228
- Senoussi, M., Verbeke, P., Desender, K., De Loof, E., Talsma, D., & Verguts, T. (2022). Theta oscillations shift towards optimal frequency for cognitive control. Nature Human Behaviour. DOI: 10.1038/s41562-022-01335-5
- Senoussi, M., Verbeke, P., & Verguts, T. (2022). Time-Based Binding as a Solution to and a Limitation for Flexible Cognition. Frontiers in Psychology, 12, 798061. DOI: 10.3389/fpsyg.2021.798061
- Snoddy, G. S. (1926). Learning and stability: A psychophysiological analysis of a case of motor learning with clinical applications. Journal of Applied Psychology, 10(1), 1. DOI: 10.1037/h0075814
- Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643. DOI: 10.1037/h0054651
- Takacs, A., Zink, N., Wolff, N., Münchau, A., Mückschel, M., & Beste, C. (2020). Connecting EEG signal decomposition and response selection processes using the theory of event coding framework. Human Brain Mapping, 41(10), 2862–2877. DOI: 10.1002/hbm.24983
- Tort, A. B. L., Komorowski, R. W., Manns, J. R., Kopell, N. J., & Eichenbaum, H. (2009). Theta-gamma coupling increases during the learning of item-context associations. Proceedings of the National Academy of Sciences, 106(49), 20942–20947. DOI: 10.1073/pnas.0911331106
- Tran, Y., Craig, A., Craig, R., Chai, R., & Nguyen, H. (2020). The influence of mental fatigue on brain activity: Evidence from a systematic review with meta?analyses. Psychophysiology, 57(5). DOI: 10.1111/psyp.13554
- Vaidya, A. R., Jones, H. M., Castillo, J., & Badre, D. (2021). Neural representation of abstract task structure during generalization. ELife, 10,
e63226 . DOI: 10.7554/eLife.63226 - Vandierendonck, A., Liefooghe, B., & Verbruggen, F. (2010). Task switching: Interplay of reconfiguration and interference control. Psychological Bulletin, 136(4), 601–626. DOI: 10.1037/a0019791
- Verbeke, P., & Verguts, T. (2019). Learning to synchronize: How biological agents can couple neural task modules for dealing with the stability-plasticity dilemma. PLOS Computational Biology, 15(8),
e1006604 . DOI: 10.1371/journal.pcbi.1006604 - Verbeke, P., & Verguts, T. (2022). Using top-down modulation to optimally balance shared versus separated task representations. Neural Networks, 146, 256–271. DOI: 10.1016/j.neunet.2021.11.030
- Verguts, T. (2017). Binding by random bursts: A computational model of cognitive control. Journal of Cognitive Neuroscience, 29(6), 1103–1118. DOI: 10.1162/jocn_a_01117
- Voloh, B., & Womelsdorf, T. (2016). A Role of Phase-Resetting in Coordinating Large Scale Neural Networks During Attention and Goal-Directed Behavior. Frontiers in Systems Neuroscience, 10. DOI: 10.3389/fnsys.2016.00018
- Wascher, E., Rasch, B., Sänger, J., Hoffmann, S., Schneider, D., Rinkenauer, G., Heuer, H., & Gutberlet, I. (2014). Frontal theta activity reflects distinct aspects of mental fatigue. Biological Psychology, 96, 57–65. DOI: 10.1016/j.biopsycho.2013.11.010
- Waskom, M. L. (2021). seaborn: Statistical data visualization. Journal of Open Source Software, 6(60), 3021. DOI: 10.21105/joss.03021
- Wickham, H. (2016). ggplot2: Elegant graphics for data analysis. Springer-Verlag New York.
https://ggplot2.tidyverse.org . DOI: 10.1007/978-3-319-24277-4 - Womelsdorf, T., & Everling, S. (2015). Long-Range Attention Networks: Circuit Motifs Underlying Endogenously Controlled Stimulus Selection. Trends in Neurosciences, 38(11), 682–700. DOI: 10.1016/j.tins.2015.08.009
- Womelsdorf, T., Schoffelen, J.-M., Oostenveld, R., Singer, W., Desimone, R., Engel, A. K., & Fries, P. (2007). Modulation of neuronal interactions through neuronal synchronization. Science, 316(5831), 1609–1612. DOI: 10.1126/science.1139597
- Zhou, T., Chen, L., & Aihara, K. (2005). Molecular communication through stochastic synchronization induced by extracellular fluctuations. Physical Review Letters, 95(17), 178103. DOI: 10.1103/PhysRevLett.95.178103
DOI: https://doi.org/10.5334/joc.239 | Journal eISSN: 2514-4820
Language: English
Submitted on: Jan 31, 2022
Accepted on: Aug 17, 2022
Published on: Sep 30, 2022
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year
Keywords:
© 2022 Pieter Huycke, Elise Lesage, C. Nico Boehler, Tom Verguts, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.