Skip to main content
Have a personal or library account? Click to login
Brain Representation in Conscious and Unconscious Vision Cover

Brain Representation in Conscious and Unconscious Vision

By: Ning Mei and  David Soto  
Open Access
|Apr 2025

References

  1. Axelrod, V., Bar, M., Rees, G., & Yovel, G. (2014). Neural correlates of subliminal language processing. Cerebral Cortex, 25(8), 21602169. 10.1093/cercor/bhu022
  2. Bergström, F., & Eriksson, J. (2017). Neural evidence for non-conscious working memory. Cerebral Cortex, 28(9), 32173228. 10.1093/cercor/bhx193
  3. Berkovitch, L., & Dehaene, S. (2019). Subliminal syntactic priming. Cognitive psychology, 109, 2646. 10.1016/j.cogpsych.2018.12.001
  4. Boly, M., Massimini, M., Tsuchiya, N., Postle, B. R., Koch, C., & Tononi, G. (2017). Are the neural correlates of consciousness in the front or in the back of the cerebral cortex? Clinical and neuroimaging evidence. Journal of Neuroscience, 37(40), 96039613. 10.1523/JNEUROSCI.3218-16.2017
  5. Brown, R., Lau, H., & LeDoux, J. E. (2019). Understanding the higher-order approach to consciousness. Trends in Cognitive Sciences, 23(9), 754768. 10.1016/j.tics.2019.06.009
  6. Chong, T. T.-J., Husain, M., & Rosenthal, C. R. (2014). Recognizing the unconscious. Current Biology, 24(21), 10331035. 10.1016/j.cub.2014.09.035
  7. Christophel, T. B., Hebart, M. N., & Haynes, J.-D. (2012). Decoding the contents of visual short-term memory from human visual and parietal cortex. Journal of Neuroscience, 32(38), 1298312989. 10.1523/jneurosci.0184-12.2012
  8. Collins, D. L., Neelin, P., Peters, T. M., & Evans, A. C. (1994). Automatic 3d intersubject registration of mr volumetric data in standardized talairach space. Journal of computer assisted tomography, 18(2), 192205. 10.1097/00004728-199403000-00005
  9. Dehaene, S. (2014). Consciousness and the brain: Deciphering how the brain codes our thoughts. Penguin.
  10. Dehaene, S., & Changeux, J.-P. (2011). Experimental and theoretical approaches to conscious processing. Neuron, 70(2), 200227. 10.1016/j.neuron.2011.03.018
  11. Dehaene, S., Kerszberg, M., & Changeux, J.-P. (1998). A neuronal model of a global workspace in effortful cognitive tasks. Proceedings of the National Academy of Sciences, 95(24), 1452914534. 10.1073/pnas.95.24.14529
  12. Dehaene, S., Naccache, L., Cohen, L., Le Bihan, D., Mangin, J.-F., Poline, J.-B., & Rivière, D. (2001). Cerebral mechanisms of word masking and unconscious repetition priming. Nature neuroscience, 4(7), 752. 10.1038/89551
  13. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009). Imagenet: A large-scale hierarchical image database. In Proceedings of the ieee conference on computer vision and pattern recognition. Ieee, 248255. 10.1109/CVPR.2009.5206848
  14. Diedrichsen, J., & Kriegeskorte, N. (2017). Representational models: A common framework for understanding encoding, pattern-component, and representational-similarity analysis. PLoS Computational Biology, 13(4), e1005508. 10.1371/journal.pcbi.1005508
  15. Dutta, A., Shah, K., Silvanto, J., & Soto, D. (2014). Neural basis of non-conscious visual working memory. Neuroimage, 91, 336343. 10.1016/j.neuroimage.2014.01.016
  16. Ester, E. F., Sprague, T. C., & Serences, J. T. (2015). Parietal and frontal cortex encode stimulus-specific mnemonic representations during visual working memory. Neuron, 87(4), 893905. 10.1016/j.neuron.2015.07.013
  17. Fei-Fei, L., Fergus, R., & Perona, P. (2004). Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. In 2004 conference on computer vision and pattern recognition workshop. IEEE, 178178.
  18. Güçlü, U., & van Gerven, M. A. (2015). Deep neural networks reveal a gradient in the complexity of neural representations across the ventral stream. Journal of Neuroscience, 35(27), 1000510014. 10.1523/JNEUROSCI.5023-14.2015
  19. Güldener, L., Jüllig, A., Soto, D., & Pollmann, S. (2022). Frontopolar activity carries feature information of novel stimuli during unconscious reweighting of selective attention. Cortex. 10.1016/j.cortex.2022.03.024
  20. He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the ieee conference on computer vision and pattern recognition (pp. 770778). 10.1109/CVPR.2016.90
  21. Huang, L., Wang, L., Shen, W., Li, M., Wang, S., Wang, X., Ungerleider, L. G., & Zhang, X. (2020). A source for awareness-dependent figure–ground segregation in human prefrontal cortex. Proceedings of the National Academy of Sciences, 201922832. 10.1073/pnas.1922832117
  22. Jenkinson, M., Beckmann, C. F., Behrens, T. E., Woolrich, M. W., & Smith, S. M. (2012). Fsl. Neuroimage, 62(2), 782790. 10.1016/j.neuroimage.2011.09.015
  23. Jiang, Y., Zhou, K., & He, S. (2007). Human visual cortex responds to invisible chromatic flicker. Nature Neuroscience, 10(5), 657662. 10.1038/nn1879
  24. Kapoor, V., Dwarakanath, A., Safavi, S., Werner, J., Besserve, M., Panagiotaropoulos, T. I., & Logothetis, N. K. (2020). Decoding the contents of consciousness from prefrontal ensembles. bioRxiv. 10.1101/2020.01.28.921841
  25. Khaligh-Razavi, S.-M., & Kriegeskorte, N. (2014). Deep supervised, but not unsupervised, models may explain it cortical representation. PLoS Computational Biology, 10(11). 10.1371/journal.pcbi.1003915
  26. King, J.-R., Pescetelli, N., & Dehaene, S. (2016). Brain mechanisms underlying the brief maintenance of seen and unseen sensory information. Neuron, 92(5), 11221134. 10.1016/j.neuron.2016.10.051
  27. Klambauer, G., Unterthiner, T., Mayr, A., & Hochreiter, S. (2017). Self-normalizing neural networks. In Advances in neural information processing systems (pp. 971980).
  28. Konkle, T., & Alvarez, G. A. (2022). A self-supervised domain-general learning framework for human ventral stream representation. Nature Communications, 13(1), 112. 10.1038/s41467-022-28091-4
  29. Kriegeskorte, N. (2009). Relating population-code representations between man, monkey, and computational models. Frontiers in Neuroscience, 3, 35. 10.3389/neuro.01.035.2009
  30. Kriegeskorte, N. (2011). Pattern-information analysis: From stimulus decoding to computational-model testing. Neuroimage, 56(2), 411421. 10.1016/j.neuroimage.2011.01.061
  31. Kriegeskorte, N. (2015). Deep neural networks: A new framework for modeling biological vision and brain information processing. Annual Review of Vision Science, 1, 417446. 10.1146/annurev-vision-082114-035447
  32. Kriegeskorte, N., & Bandettini, P. (2007). Analyzing for information, not activation, to exploit high-resolution fmri. Neuroimage, 38(4), 649662. 10.1016/j.neuroimage.2007.02.022
  33. Kriegeskorte, N., & Diedrichsen, J. (2019). Peeling the onion of brain representations. Annual review of neuroscience, 42, 407432. 10.1146/annurev-neuro-080317-061906
  34. Kriegeskorte, N., & Douglas, P. K. (2018). Cognitive computational neuroscience. Nature Neuroscience, 21(9), 11481160. 10.1038/s41593-018-0210-5
  35. Kriegeskorte, N., & Douglas, P. K. (2019). Interpreting encoding and decoding models. Current Opinion in Neurobiology, 55, 167179. 10.1016/j.conb.2019.04.002
  36. Kriegeskorte, N., Goebel, R., & Bandettini, P. (2006). Information-based functional brain mapping. Proceedings of the National Academy of Sciences, 103(10), 38633868. 10.1073/pnas.0600244103
  37. Kriegeskorte, N., Mur, M., & Bandettini, P. A. (2008). Representational similarity analysis-connecting the branches of systems neuroscience. Frontiers in Systems Neuroscience, 2, 4. 10.3389/neuro.06.004.2008
  38. Lamme, V. A. F. (2020). Visual functions generating conscious seeing. Frontiers in Psychology, 11. 10.3389/fpsyg.2020.00083
  39. Lau, H. (2022). In consciousness we trust: The cognitive neuroscience of subjective experience. Oxford University Press. 10.1093/oso/9780198856771.001.0001
  40. Lau, H. C., & Passingham, R. E. (2007). Unconscious activation of the cognitive control system in the human prefrontal cortex. Journal of Neuroscience, 27(21), 58055811. 10.1523/JNEUROSCI.4335-06.2007
  41. Lin, Q., & Lau, H. (2024). Individual differences in prefrontal coding of visual features. bioRxiv, 202405. 10.1101/2024.05.09.588948
  42. Lindsay, G. W. (2021). Convolutional neural networks as a model of the visual system: Past, present, and future. Journal of Cognitive Neuroscience, 33(10), 20172031. 10.1162/jocn_a_01544
  43. Ludwig, K., & Hesselmann, G. (2015). Weighing the evidence for a dorsal processing bias under continuous flash suppression. Consciousness and Cognition, 35, 251259. 10.1016/j.concog.2014.12.010
  44. Mazziotta, J. C., Toga, A. W., Evans, A., Fox, P., Lancaster, J., et al. (1995). A probabilistic atlas of the human brain: Theory and rationale for its development. Neuroimage, 2(2), 89101. 10.1006/nimg.1995.1012
  45. Mazziotta, J., Toga, A., Evans, A., Fox, P., Lancaster, J., Zilles, K., Woods, R., Paus, T., Simpson, G., Pike, B., et al. (2001). A probabilistic atlas and reference system for the human brain: International consortium for brain mapping (icbm). Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 356(1412), 12931322. 10.1098/rstb.2001.0915
  46. McFee, B., Salamon, J., & Bello, J. P. (2018). Adaptive pooling operators for weakly labeled sound event detection. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 26(11), 21802193. 10.1109/TASLP.2018.2858559
  47. Mei, N., Santana, R., & Soto, D. (2022a). Assessing the brain representation of conscious and unconscious visual contents using encoding based representational similarity analysis. bioRxiv, 202212. 10.1101/2022.12.23.521727
  48. Mei, N., Santana, R., & Soto, D. (2022b). Informative neural representations of unseen contents during higher-order processing in human brains and deep artificial networks. Nature Human Behaviour, 6(5), 720731. 10.1038/s41562-021-01274-7
  49. Moreno-Martínez, F. J., & Montoro, P. R. (2012). An ecological alternative to snodgrass & vanderwart: 360 high quality colour images with norms for seven psycholinguistic variables. PloS One, 7(5), e37527. 10.1371/journal.pone.0037527
  50. Moutoussis, K., & Zeki, S. (2002). The relationship between cortical activation and perception investigated with invisible stimuli. Proceedings of the National Academy of Sciences, 99(14), 95279532. 10.1073/pnas.142305699
  51. Naselaris, T., Kay, K. N., Nishimoto, S., & Gallant, J. L. (2011). Encoding and decoding in fmri. Neuroimage, 56(2), 400410. 10.1016/j.neuroimage.2010.07.073
  52. Newell, B. R., & Shanks, D. R. (2014). Unconscious influences on decision making: A critical review. Behavioral and Brain Sciences, 37(1), 119. 10.1017/S0140525X12003214
  53. Nili, H., Wingfield, C., Walther, A., Su, L., Marslen-Wilson, W., & Kriegeskorte, N. (2014). A toolbox for representational similarity analysis. PLoS computational biology, 10(4), e1003553. 10.1371/journal.pcbi.1003553
  54. Nonaka, S., Majima, K., Aoki, S. C., & Kamitani, Y. (2021). Brain hierarchy score: Which deep neural networks are hierarchically brain-like? IScience, 24(9). 10.1016/j.isci.2021.103013
  55. Panagiotaropoulos, T. I., Deco, G., Kapoor, V., & Logothetis, N. K. (2012). Neuronal discharges and gamma oscillations explicitly reflect visual consciousness in the lateral prefrontal cortex. Neuron, 74(5), 924935. 10.1016/j.neuron.2012.04.013
  56. Peirce, J. W. (2007). Psychopy—psychophysics software in python. Journal of Neuroscience Methods, 162(1–2), 813. 10.1016/j.jneumeth.2006.11.017
  57. Rosenthal, C. R., Andrews, S. K., Antoniades, C. A., Kennard, C., & Soto, D. (2016). Learning and recognition of a non-conscious sequence of events in human primary visual cortex. Current Biology, 26(6), 834841. 10.1016/j.cub.2016.01.040
  58. Schrimpf, M., Kubilius, J., Hong, H., Majaj, N. J., Rajalingham, R., Issa, E. B., Kar, K., Bashivan, P., Prescott-Roy, J., Geiger, F., Schmidt, K., Yamins, D. L. K., & DiCarlo, J. J. (2018). Brain-score: Which artificial neural network for object recognition is most brain-like? bioRxiv preprint. https://www.biorxiv.org/content/10.1101/407007v2
  59. Schrimpf, M., Kubilius, J., Hong, H., Majaj, N. J., Rajalingham, R., Issa, E. B., Kar, K., Bashivan, P., Prescott-Roy, J., Geiger, F., et al. (2020a). Brain-score: Which artificial neural network for object recognition is most brain-like? BioRxiv, 407007.
  60. Schrimpf, M., Kubilius, J., Lee, M. J., Murty, N. A. R., Ajemian, R., & DiCarlo, J. J. (2020b). Integrative benchmarking to advance neurally mechanistic models of human intelligence. Neuron. https://www.cell.com/neuron/fulltext/S0896-6273(20)30605-X
  61. Seeliger, K., Fritsche, M., Güçlü, U., Schoenmakers, S., Schoffelen, J.-M., Bosch, S., & Van Gerven, M. (2018). Convolutional neural network-based encoding and decoding of visual object recognition in space and time. NeuroImage, 180, 253266. 10.1016/j.neuroimage.2017.07.018
  62. Shahbazi, M., Shirali, A., Aghajan, H., & Nili, H. (2021). Using distance on the riemannian manifold to compare representations in brain and in models. NeuroImage, 239, 118271. 10.1016/j.neuroimage.2021.118271
  63. Shanks, D. R., Malejka, S., & Vadillo, M. A. (2021). The challenge of inferring unconscious mental processes. Experimental Psychology, 68(3), 113. 10.1027/1618-3169/a000517
  64. Shea, N. (2018). Representation in cognitive science. Oxford University Press. 10.1093/oso/9780198812883.001.0001
  65. Sheikh, U. A., Carreiras, M., & Soto, D. (2019). Decoding the meaning of unconsciously processed words using fMRI-based MVPA. NeuroImage. 10.1016/j.neuroimage.2019.02.010
  66. Smith, S. M., & Nichols, T. E. (2009). Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference. Neuroimage, 44(1), 8398. 10.1016/j.neuroimage.2008.03.061
  67. Soto, D., Mäntylä, T., & Silvanto, J. (2011). Working memory without consciousness. Current Biology, 21(22), 912913. 10.1016/j.cub.2011.09.049
  68. Soto, D., Sheikh, U. A., & Rosenthal, C. R. (2019). A novel framework for unconscious processing. Trends in Cognitive Sciences, 23(5), 372376. 10.1016/j.tics.2019.03.002
  69. Stein, T., Kaiser, D., Fahrenfort, J. J., & Van Gaal, S. (2021). The human visual system differentially represents subjectively and objectively invisible stimuli. PLoS biology, 19(5), e3001241. 10.1371/journal.pbio.3001241
  70. Stein, T., Utz, V., & van Opstal, F. (2020a). Unconscious semantic priming from pictures under backward masking and continuous flash suppression. Consciousness and Cognition, 78, 102864. 10.1016/j.concog.2019.102864
  71. Stein, T., Utz, V., & Van Opstal, F. (2020b). Unconscious semantic priming from pictures under backward masking and continuous flash suppression. Consciousness and Cognition, 78, 102864. 10.1016/j.concog.2019.102864
  72. Trübutschek, D., Marti, S., Ojeda, A., King, J.-R., Mi, Y., Tsodyks, M., & Dehaene, S. (2017). A theory of working memory without consciousness or sustained activity. Elife, 6, e23871. 10.7554/eLife.23871
  73. Van Gaal, S., & Lamme, V. A. (2012). Unconscious high-level information processing: Implication for neurobiological theories of consciousness. The Neuroscientist, 18(3), 287301. 10.1177/1073858411404079
  74. Van Gaal, S., Naccache, L., Meuwese, J. D., Van Loon, A. M., Leighton, A. H., Cohen, L., & Dehaene, S. (2014). Can the meaning of multiple words be integrated unconsciously? Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1641), 20130212. 10.1098/rstb.2013.0212
  75. Van Gaal, S., Ridderinkhof, K. R., Fahrenfort, J. J., Scholte, H. S., & Lamme, V. A. (2008). Frontal cortex mediates unconsciously triggered inhibitory control. Journal of Neuroscience, 28(32), 80538062. 10.1523/JNEUROSCI.1278-08.2008
  76. Vidaurre, D., Bielza, C., & Larranaga, P. (2013). A survey of l1 regression. International Statistical Review, 81(3), 361387. 10.1111/insr.12023
  77. Walther, A., Nili, H., Ejaz, N., Alink, A., Kriegeskorte, N., & Diedrichsen, J. (2016). Reliability of dissimilarity measures for multi-voxel pattern analysis. Neuroimage, 137, 188200. 10.1016/j.neuroimage.2015.12.012
  78. Williams, A. H., Kunz, E., Kornblith, S., & Linderman, S. (2021). Generalized shape metrics on neural representations. Advances in Neural Information Processing Systems, 34, 47384750.
  79. Wuethrich, S., Hannula, D. E., Mast, F. W., & Henke, K. (2018). Subliminal encoding and flexible retrieval of objects in scenes. Hippocampus, 28(9), 633643. 10.1002/hipo.22957
  80. Yamins, D. L., Hong, H., Cadieu, C., & DiCarlo, J. J. (2013). Hierarchical modular optimization of convolutional networks achieves representations similar to macaque it and human ventral stream. In Advances in neural information processing systems (pp. 30933101).
  81. Yosinski, J., Clune, J., Bengio, Y., & Lipson, H. (2014). How transferable are features in deep neural networks? In Advances in neural information processing systems (pp. 33203328).
  82. Yamins, D. L., & DiCarlo, J. J. (2016). Using goal-driven deep learning models to understand sensory cortex. Nature Neuroscience, 19(3), 356. 10.1038/nn.4244
DOI: https://doi.org/10.5334/joc.443 | Journal eISSN: 2514-4820
Language: English
Submitted on: May 27, 2024
Accepted on: Mar 31, 2025
Published on: Apr 28, 2025
Published by: Ubiquity Press
In partnership with: Paradigm Publishing Services
Publication frequency: 1 issue per year

© 2025 Ning Mei, David Soto, published by Ubiquity Press
This work is licensed under the Creative Commons Attribution 4.0 License.