Problems discussed are, on the one hand, the participation of a human being in the functioning of the intelligent system as a person who perceives information, forms the notion of the essence of a phenomenon, and makes a control decision, on the other hand, the psychophysical studies aimed at elucidating the connection between mental phenomena and physical processes (i.e. physicochemical processes specific for a living organism). There is an intermediate functional unit, which is usually hidden from strict scientific knowledge, and it significantly complicates the creation of artificial intelligence systems. The essence of problems is considered and some ways of their solution are outlined. © 2019 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0/) Peer-review under responsibility of the scientific committee of the 13th International Symposium “Intelligent Systems” (INTELS'18).