Analysis of 19.9 million publications from the PubMed/MEDLINE database using artificial intelligence methods: Approaches to the generalizations of accumulated data and the phenomenon of “fake news” [Анализ 19,9 млн публикаций базы данных PubMed/MEDLINE методами искусственного интеллекта: подходы к обобщению накопленных данных и феномен “fake news”]

Introduction. The English-language databases PubMed/MEDLINE and Embase are valuable information resources for finding original publications in basic and clinical medicine. Currently, there are no artificial intelligence systems to evaluate the quality of these publications. Aim. Development and testing of a system for sentiment analysis (i.e. analysis of emotional modality) of biomedical publications. Materials and methods. The technique of analysis of the “Big data” of biomedical publications was formulated on the basis of the topological theory of sentiment analysis. Algorithms have been developed that allow for the classification of texts from 16 sentiment classes with 90% accuracy (manipulative speech, research without positive results, propaganda, falsification of results, negative personal attitude, aggressive text, negative emotional background, etc.). Based on the algorithms, a scale for assessing the sentiment quality of research (β-score) is proposed. Results. Abstracts of 19.9 million publications registered in PubMed/MEDLINE over the past 50 years (1970–2019) were analyzed. It was shown that publications with low sentiment quality (the value of the β-score of the text is less than zero, which corresponds to the prevalence of manipulative and negative sentiments in the text) comprise only 18.5% (3.68 out of 19.9 million). The greatest values of the β-score were characterized by publications on sports medicine, systems biology, nutrition, on the use of applied mathematics and data mining in medicine. The rubrication of the entire array of publications by 27,840 headings (MESH-system of PubMed/MEDLINE) indicated an increase in the β-score by years (i.e., the positive dynamics of sentiment quality of the texts of publications) for 27,090 of the studied headings. The most intense positive dynamics was found for research in genetics, physiology, pharmacology, and gerontology. 249 headings with sharply negative dynamics of sentiment quality and with a pronounced increase in the manipulative sentiments characteristic of the tabloid press were highlighted. Separate assessments of international experts are presented that confirm the patterns identified. Conclusion. The proposed artificial intelligence system allows a researcher to make an effective assessment of the sentiment quality of biomedical research papers, filtering out potentially inappropriate publications disguised as “evidence-based”. Copyright © 2020, Farmakoekonomika. All rights reserved.

Yu T.I.1, 2 , Gromova O.A. 1, 2 , Stakhovskaya L.V. 3 , Vanchakova N.P.4 , Galustyan A.N.5 , Kobalava Zh.D. 6 , Grishina T.R.7 , Gromov A.N.1 , Ilovaiskaya I.A.8 , Kodentsova V.M.9 , Kalacheva A.G.7 , Limanova O.A.7 , Maksimov V.A. 10 , Malyavskaya S.I.11 , Mozgovaya E.V.12 , Tapilskaya N.I.5, 12 , Rudakov K.V.1 , Semenov V.A.13
Номер выпуска
  • 1 Federal Research Center “Informatics and Management of the Russian Academy of Sciences, 44-2 Vavilova Str., Moscow, 119333, Russian Federation
  • 2 Moscow State University, 1 Leninskie gory, Moscow, 119991, Russian Federation
  • 3 Federal Center for Cerebrovascular Pathology and Stroke, 1-10 Ostrovityanova Str., Moscow, 117997, Russian Federation
  • 4 Center for Psychosomatic Medicine at the Clinical Hospital No. 122 named after L. G., Sokolov (4 pr. Kultury, St. Petersburg, 194291, Russian Federation
  • 5 Saint-Petersburg State Pediatric Medical University, 2 Litovskaya Str., St. Petersburg, 194100, Russian Federation
  • 6 Peoples’ Friendship University of Russia, 10/3 Miklukho-Maklaya Str., Moscow, 117198, Russian Federation
  • 7 Ivanovo State Medical Academy, 8 Sheremetevsky prospekt, Ivanovo, 153012, Russian Federation
  • 8 State Budgetary Healthcare Institution of Moscow Area, Moscows Regional Research Clinical Institute n.a. M.F. Vladimirskiy, 61/2 Shchepkina Str., Moscow, 129110, Russian Federation
  • 9 Federal Research Center for Nutrition and Biotechnology, 2/14 Ustinsky proezd, Moscow, 109240, Russian Federation
  • 10 Federal State Budgetary Educational Institution of Continuing Professional Education “Russian Medical Academy of Continu ing Professional Education”, Ministry of Health of the Russian Federation, 2/1 Building 1 Barrikadnaya Str., Moscow, 125993, Russian Federation
  • 11 Northern State Medical University, 51 Troitskiy Ave., Arkhangelsk, 163000, Russian Federation
  • 12 Research Institute of Obstetrics, Gynecology and Reproductology named after D.O. Ott, 3 Mendeleev Line, St. Petersburg, 199034, Russian Federation
  • 13 Kemerovo State Medical University, 22a Voroshilova Str., Kemerovo, 650056, Russian Federation
Ключевые слова
Artificial intelligence; Big data analysis; Evidence-based medicine; Machine learning; Pharmacoinformatics; Publication quality assessment algorithms thematic modeling
Дата создания
Дата изменения
Постоянная ссылка

Другие записи