<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">medvis</journal-id><journal-title-group><journal-title xml:lang="ru">Медицинская визуализация</journal-title><trans-title-group xml:lang="en"><trans-title>Medical Visualization</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">1607-0763</issn><issn pub-type="epub">2408-9516</issn><publisher><publisher-name>RDS-Media Ltd.</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.24835/1607-0763-1346</article-id><article-id custom-type="elpub" pub-id-type="custom">medvis-1346</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ТЕХНОЛОГИИ ЛУЧЕВОЙ ДИАГНОСТИКИ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>RADIOLOGICAL TECHNOLOGIES</subject></subj-group></article-categories><title-group><article-title>Исследование возможностей алгоритмов автоматизированного контроля качества DICOM-метаданных рентгенографических исследований органов грудной клетки</article-title><trans-title-group xml:lang="en"><trans-title>Investigation of the capabilities of algorithms for automated quality assurance of DICOM metadata of chest X-ray examinations</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-4036-5883</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Борисов</surname><given-names>А. А.</given-names></name><name name-style="western" xml:lang="en"><surname>Borisov</surname><given-names>A. A.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Борисов Александр Александрович – младший научный сотрудник отдела медицинской информатики, радиомики и радиогеномики НПКЦ диагностики и телемедицинских технологий ДЗ города Москвы; аналитик ФГАОУ ВО РНИМУ им. Н.И. Пирогова</p><p>127051 Москва, ул. Петровка, д. 24, стр. 1; 117997 Москва, ул. Островитянова, дом 1</p><p>тел.: +7-977-500-99-12</p></bio><bio xml:lang="en"><p>Alexander A. Borisov – Junior Researcher in the Department of Medical Informatics, Radiomics and Radiogenomics; data analyst</p><p>24-1, Petrovka str., Moscow 127051; 1, Ostrovityanova str., Moscow 117997</p><p>Phone: +7-977-500-99-12</p></bio><email xlink:type="simple">aleksandrborisov10650@gmail.com</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-7786-0349</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Арзамасов</surname><given-names>К. М.</given-names></name><name name-style="western" xml:lang="en"><surname>Arzamasov</surname><given-names>K. M.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Арзамасов Кирилл Михайлович – канд. мед. наук, руководитель отдела медицинской информатики, радиомики и радиогеномики </p><p>127051 Москва, ул. Петровка, д. 24, стр. 1</p></bio><bio xml:lang="en"><p>Kirill M. Arzamasov – Cand. of Sci. (Med.), Head of the Department of Medical Informatics, Radiomics and Radiogenomics</p><p>24-1, Petrovka str., Moscow 127051</p></bio><xref ref-type="aff" rid="aff-2"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-2585-0864</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Семенов</surname><given-names>С. С.</given-names></name><name name-style="western" xml:lang="en"><surname>Semenov</surname><given-names>S. S.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Семенов Серафим Сергеевич – врач-рентгенолог, младший научный сотрудник сектора разработки систем внедрения медицинских интеллектуальных технологий </p><p>127051 Москва, ул. Петровка, д. 24, стр. 1</p></bio><bio xml:lang="en"><p>Serafim S. Semenov – Radiologist, Junior Researcher in the Sector of Development of Systems for the Introduction of Medical Intelligent Technologies</p><p>24-1, Petrovka str., Moscow 127051</p></bio><xref ref-type="aff" rid="aff-2"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-2990-7736</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Владзимирский</surname><given-names>А. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Vladzimirsky</surname><given-names>A. V.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Владзимирский Антон Вячеславович – доктор мед. наук, заместитель директора по научной работе </p><p>127051 Москва, ул. Петровка, д. 24, стр. 1</p></bio><bio xml:lang="en"><p>Anton V. Vladzimirsky – Doctor of Medical Sciences, Deputy Director for Scientific Work</p><p>24-1, Petrovka str., Moscow 127051</p></bio><xref ref-type="aff" rid="aff-2"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-0208-5218</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Васильев</surname><given-names>Ю. А.</given-names></name><name name-style="western" xml:lang="en"><surname>Vasiliev</surname><given-names>Yu. A.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Васильев Юрий Александрович – канд. мед. наук, директор </p><p>127051 Москва, ул. Петровка, д. 24, стр. 1</p></bio><bio xml:lang="en"><p>Yuri A. Vasiliev – Cand. of Sci. (Med.), Director</p><p>24-1, Petrovka str., Moscow 127051</p></bio><xref ref-type="aff" rid="aff-2"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>ГБУЗ города Москвы “Научно-практический клинический центр диагностики и телемедицинских технологий ДЗ города Москвы”; ФГАОУ ВО РНИМУ им. Н.И. Пирогова Минздрава России</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Research and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Moscow Health Care Department; Pirogov Russian National Research Medical University (Pirogov Medical University)</institution><country>Russian Federation</country></aff></aff-alternatives><aff-alternatives id="aff-2"><aff xml:lang="ru"><institution>ГБУЗ города Москвы “Научно-практический клинический центр диагностики и телемедицинских технологий ДЗ города Москвы”</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Research and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Moscow Health Care Department</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2024</year></pub-date><pub-date pub-type="epub"><day>01</day><month>12</month><year>2023</year></pub-date><volume>28</volume><issue>2</issue><fpage>134</fpage><lpage>144</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Борисов А.А., Арзамасов К.М., Семенов С.С., Владзимирский А.В., Васильев Ю.А., 2024</copyright-statement><copyright-year>2024</copyright-year><copyright-holder xml:lang="ru">Борисов А.А., Арзамасов К.М., Семенов С.С., Владзимирский А.В., Васильев Ю.А.</copyright-holder><copyright-holder xml:lang="en">Borisov A.A., Arzamasov K.M., Semenov S.S., Vladzimirsky A.V., Vasiliev Y.A.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://medvis.rdsmedia.ru/jour/article/view/1346">https://medvis.rdsmedia.ru/jour/article/view/1346</self-uri><abstract><sec><title>Цель исследования</title><p>Цель исследования: оценить качество заполнения DICOM-тегов, отвечающих за ориентацию, область сканирования и цветовую интерпретацию изображения, а также разработать и протестировать алгоритмы автоматического определения истинных значений данных тегов для рентгенограмм (РГ) и флюорограмм органов грудной клетки (ОГК).</p></sec><sec><title>Материал и методы</title><p>Материал и методы. Для оценки качества заполнения DICOM-тегов было использовано 1885 исследований, полученных из Единого радиологического информационного сервиса Единой медицинской информационно-аналитической системы города Москвы (ЕРИС ЕМИАС). Для обучения и валидации алгоритмов автоматического определения истинных значений тегов использовались наборы РГ ОГК в стандартных прямой и боковой проекциях, взятые из ряда открытых источников, а также из ЕРИС ЕМИАС общим объемом 12920 исследований. Основой для создания алгоритмов выбрана глубокая нейросетевая архитектура VGG19.</p></sec><sec><title>Результаты</title><p>Результаты. Выявлено, что частота пропущенных значений в DICOM-тегах может составлять от 6 до 75% в зависимости от тега. При этом в заполненных значениях тегов встречается до 70% ошибок. Были построены модели: модель определения анатомической области рентгенографического исследования, модель определения проекции на РГ ОГК, модель определения фотометрической интерпретации изображения. Все полученные алгоритмы имеют высокие показатели качества классификации. AUC для каждой из полученных моделей составила более 0,99.</p></sec><sec><title>Заключение</title><p>Заключение. Наше исследование показывает, что большое количество исследований на потоке содержит некорректные значения DICOM-тегов, что может критически сказываться на внедрении программного обеспечения (ПО) на основе технологии искусственного интеллекта в клиническую практику. Разработанные нами алгоритмы могут быть встроены в процесс разработки такого ПО, а также использоваться при предобработке изображений перед их анализом.</p></sec></abstract><trans-abstract xml:lang="en"><sec><title>Purpose</title><p>Purpose. To evaluate the quality of filling DICOM tags responsible for the orientation, scanning area and photometric interpretation of the image, as well as to develop and test algorithms for automatically determining the true values of these tags for chest x-rays and fluorograms.</p></sec><sec><title>Materials and methods</title><p>Materials and methods. To assess the quality of filling DICOM tags, were used 1885 studies obtained from the Unified Radiological Information Service of the Unified Medical Information and Analysis System (ERIS EMIAS). For training and validation of algorithms for automatic determination of the true values of tags, were used datasets of radiographs in standard frontal and lateral projections, from open databases and from ERIS EMIAS (12,920 studies in total). The deep neural network architecture VGG 19 was chosen as the basis for creating algorithms.</p></sec><sec><title>Results</title><p>Results. We found that the frequency of missing values in DICOM tags can range from 6 to 75%, depending on the tag. At the same time, up to 70% of filled tag values have errors. We obtained next models: a model for determining the anatomical area of x-ray examination, a model for determining the projection on the chest x-ray, a model for determining the photometric interpretation of the image. All of the obtained algorithms have high classification quality indicators. The AUC for each of the obtained models was more than 0.99.</p></sec><sec><title>Conclusions</title><p>Conclusions. Our study shows that a large number of studies in diagnostic practice contain incorrect values of DICOM tags, which can critically affect the implementation of software based on artificial intelligence technology in clinical practice. Our obtained algorithms can be integrated into the development process of such software and used in the preprocessing of images before their analysis.</p></sec></trans-abstract><kwd-group xml:lang="ru"><kwd>рентгенограммы грудной клетки</kwd><kwd>контроль качества</kwd><kwd>метаданные DICOM</kwd><kwd>DICOM-теги</kwd><kwd>формирование наборов данных</kwd><kwd>глубокие сверточные нейронные сети</kwd><kwd>трансферное обучение</kwd></kwd-group><kwd-group xml:lang="en"><kwd>chest X-ray</kwd><kwd>quality assurance</kwd><kwd>DICOM metadata</kwd><kwd>DICOM-tags</kwd><kwd>dataset generation</kwd><kwd>deep convolutional neural networks</kwd><kwd>transfer learning</kwd></kwd-group><funding-group><funding-statement xml:lang="ru">Данная статья подготовлена авторским коллективом в рамках научно-исследовательской работы “Разработка платформы подготовки наборов данных лучевых диагностических исследований”</funding-statement><funding-statement xml:lang="en">The article was written by the author's team as a part of the research work “Development of a platform for the preparation of datasets of radiation diagnostic studies”.</funding-statement></funding-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">McDonald R.J., Schwartz K.M., Eckel L.J. et al. The effects of changes in utilization and technological advancements of cross-sectional imaging on radiologist workload. Acad. Radiol. 2015; 22 (9): 1191–1198. https://doi.org/10.1016/j.acra.2015.05.007</mixed-citation><mixed-citation xml:lang="en">McDonald R.J., Schwartz K.M., Eckel L.J. et al. The effects of changes in utilization and technological advancements of cross-sectional imaging on radiologist workload. Acad. Radiol. 2015; 22 (9): 1191–1198. https://doi.org/10.1016/j.acra.2015.05.007</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">van Leeuwen K.G., de Rooij M., Schalekamp S. et al. How does artificial intelligence in radiology improve efficiency and health outcomes? Pediatr. Radiol. 2022; 52 (11): 2087–2093. https://doi.org/10.1007/s00247-021-05114-8</mixed-citation><mixed-citation xml:lang="en">van Leeuwen K.G., de Rooij M., Schalekamp S. et al. How does artificial intelligence in radiology improve efficiency and health outcomes? Pediatr. Radiol. 2022; 52 (11): 2087–2093. https://doi.org/10.1007/s00247-021-05114-8</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Chetlen A.L., Chan T.L., Ballard D.H. et al. Addressing Burnout in Radiologists. Acad. Radiol. 2019; 26 (4): 526–533. https://doi.org/10.1016/j.acra.2018.07.001</mixed-citation><mixed-citation xml:lang="en">Chetlen A.L., Chan T.L., Ballard D.H. et al. Addressing Burnout in Radiologists. Acad. Radiol. 2019; 26 (4): 526–533. https://doi.org/10.1016/j.acra.2018.07.001</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Hosny A., Parmar Ch., Quackenbush J. et al. Artificial intelligence in radiology. Nat. Rev. Cancer. 2018; 18 (8): 500–510. https://doi.org/10.1038/s41568-018-0016-5</mixed-citation><mixed-citation xml:lang="en">Hosny A., Parmar Ch., Quackenbush J. et al. Artificial intelligence in radiology. Nat. Rev. Cancer. 2018; 18 (8): 500–510. https://doi.org/10.1038/s41568-018-0016-5</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Rubin D.L. Artificial Intelligence in Imaging: The Radiologist’s Role. J. Am. Coll. Radiol. 2019; 16 (9): 1309–1317. https://doi.org/10.1016/j.jacr.2019.05.036</mixed-citation><mixed-citation xml:lang="en">Rubin D.L. Artificial Intelligence in Imaging: The Radiologist’s Role. J. Am. Coll. Radiol. 2019; 16 (9): 1309–1317. https://doi.org/10.1016/j.jacr.2019.05.036</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Savadjiev P., Chong J., Dohan A. et al. Demystification of AI-driven medical image interpretation: past, present and future. Eur. Radiol. 2019; 29 (3): 1616–1624. https://doi.org/10.1007/s00330-018-5674-x</mixed-citation><mixed-citation xml:lang="en">Savadjiev P., Chong J., Dohan A. et al. Demystification of AI-driven medical image interpretation: past, present and future. Eur. Radiol. 2019; 29 (3): 1616–1624. https://doi.org/10.1007/s00330-018-5674-x</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Acosta J.N., Falcone G.J., Rajpurkar P. The Need for Medical Artificial Intelligence That Incorporates Prior Images. Radiology. 2022; 304 (2): 283–288. https://doi.org/10.1148/radiol.212830</mixed-citation><mixed-citation xml:lang="en">Acosta J.N., Falcone G.J., Rajpurkar P. The Need for Medical Artificial Intelligence That Incorporates Prior Images. Radiology. 2022; 304 (2): 283–288. https://doi.org/10.1148/radiol.212830</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Павлов Н.А., Андрейченко А.Е., Владзимирский А.В., Ревазян А.А., Кирпичев Ю.С., Морозов С.П. Эталонные медицинские датасеты (MosMedData) для независимой внешней оценки алгоритмов на основе искусственного интеллекта в диагностике. Dig. Diagn. 2021; 2 (1): 49–66. https://doi.org/10.17816/DD60635</mixed-citation><mixed-citation xml:lang="en">Pavlov N.A., Andreychenko A.E., Vladzymyrskyy A.V. et al. Reference medical datasets (MosMedData) for independent external evaluation of algorithms based on artificial intelligence in diagnostics. Digital Diagnostics. 2021; 2 (1): 49–66. https://doi.org/10.17816/DD60635 (In Russian)</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Willemink M.J., Koszek W.A., Hardell C. et al. Preparing Medical Imaging Data for Machine Learning. Radiology. 2020; 295 (1): 4–15. https://doi.org/10.1148/radiol.2020192224</mixed-citation><mixed-citation xml:lang="en">Willemink M.J., Koszek W.A., Hardell C. et al. Preparing Medical Imaging Data for Machine Learning. Radiology. 2020; 295 (1): 4–15. https://doi.org/10.1148/radiol.2020192224</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Park S.H., Han K. Methodologic Guide for Evaluating Clinical Performance and Effect of Artificial Intelligence Technology for Medical Diagnosis and Prediction. Radiology. 2018; 286 (3): 800–809. https://doi.org/10.1148/radiol.2017171920</mixed-citation><mixed-citation xml:lang="en">Park S.H., Han K. Methodologic Guide for Evaluating Clinical Performance and Effect of Artificial Intelligence Technology for Medical Diagnosis and Prediction. Radiology. 2018; 286 (3): 800–809. https://doi.org/10.1148/radiol.2017171920</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">European Society of Radiology (ESR). What the radiologist should know about artificial intelligence – an ESR white paper. Insights. Imaging. 2019; 10 (1): 44. https://doi.org/10.1186/s13244-019-0738-2</mixed-citation><mixed-citation xml:lang="en">European Society of Radiology (ESR). What the radiologist should know about artificial intelligence – an ESR white paper. Insights. Imaging. 2019; 10 (1): 44. https://doi.org/10.1186/s13244-019-0738-2</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Борисов А.А., Семенов С.С., Арзамасов К.М. Использование трансферного обучения для автоматизированного поиска дефектов на рентгенограммах органов грудной клетки. Медицинская визуализация. 2023; 27 (1): 158–169. https://doi.org/10.24835/1607-0763-1243</mixed-citation><mixed-citation xml:lang="en">Borisov A.A., Semenov S.S., Arzamasov K.M. Transfer Learning for automated search for defects on chest X-rays. Medical Visualization. 2023; 27 (1): 158–169. https://doi.org/10.24835/1607-0763-1243 (In Russian)</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Juszczyk J., Badura P., Czajkowska J. et al. Automated size-specific dose estimates using deep learning image processing. Medical Image Analysis. 2021; 68: 101898. https://doi.org/10.1016/j.media.2020.101898</mixed-citation><mixed-citation xml:lang="en">Juszczyk J., Badura P., Czajkowska J. et al. Automated size-specific dose estimates using deep learning image processing. Medical Image Analysis. 2021; 68: 101898. https://doi.org/10.1016/j.media.2020.101898</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Keshavamurthy K.N., Elnajjar P., El-Rowmeim A. et al. Application of Deep Learning Techniques for Characterization of 3D Radiological Datasets – A Pilot Study for Detection of Intravenous Contrast in Breast MRI. Proc. SPIE Int. Soc. Opt. Eng. 2019; 10954: 109540X. https://doi.org/10.1117/12.2513809</mixed-citation><mixed-citation xml:lang="en">Keshavamurthy K.N., Elnajjar P., El-Rowmeim A. et al. Application of Deep Learning Techniques for Characterization of 3D Radiological Datasets – A Pilot Study for Detection of Intravenous Contrast in Breast MRI. Proc. SPIE Int. Soc. Opt. Eng. 2019; 10954: 109540X. https://doi.org/10.1117/12.2513809</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">DICOM standart // URL: https://www.dicomstandard.org/ (дата обращения 10.01.2023)</mixed-citation><mixed-citation xml:lang="en">DICOM standart // URL: https://www.dicomstandard.org/ (дата обращения 10.01.2023)</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">CheXpert Dataset //URL: https://stanfordmlgroup.github.io/competitions/chexpert/ (дата обращения 23.12.2022)</mixed-citation><mixed-citation xml:lang="en">CheXpert Dataset //URL: https://stanfordmlgroup.github.io/competitions/chexpert/ (дата обращения 23.12.2022)</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Chest X-rays dataset // URL: https://www.kaggle.com/datasets/raddar/chest-xrays-indiana-university (дата обращения 26.12.2022)</mixed-citation><mixed-citation xml:lang="en">Chest X-rays dataset // URL: https://www.kaggle.com/datasets/raddar/chest-xrays-indiana-university (дата обращения 26.12.2022)</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Chest X-Ray Images (Pneumonia)// URL: https://www.kaggle.com/paultimothymooney/chest-xray-pneumonia (дата обращения 20.12.2022)</mixed-citation><mixed-citation xml:lang="en">Chest X-Ray Images (Pneumonia)// URL: https://www.kaggle.com/paultimothymooney/chest-xray-pneumonia (дата обращения 20.12.2022)</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">NIH ChestX-ray14 //URL: https://nihcc.app.box.com/v/ChestXray-NIHCC (дата обращения 20.12.2022)</mixed-citation><mixed-citation xml:lang="en">NIH ChestX-ray14 //URL: https://nihcc.app.box.com/v/ChestXray-NIHCC (дата обращения 20.12.2022)</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Han B., Du J., Jia Y. et al. Zero-Watermarking Algorithm for Medical Image Based on VGG19 Deep Convolution Neural Network. J. Healthc. Eng. 2021; 2021: 5551520. https://doi.org/10.1155/2021/5551520</mixed-citation><mixed-citation xml:lang="en">Han B., Du J., Jia Y. et al. Zero-Watermarking Algorithm for Medical Image Based on VGG19 Deep Convolution Neural Network. J. Healthc. Eng. 2021; 2021: 5551520. https://doi.org/10.1155/2021/5551520</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">Karacı A. VGGCOV19-NET: automatic detection of COVID-19 cases from X-ray images using modified VGG19 CNN architecture and YOLO algorithm. Neural. Comput. Appl. 2022; 34 (10): 8253–8274. https://doi.org/10.1007/s00521-022-06918-x</mixed-citation><mixed-citation xml:lang="en">Karacı A. VGGCOV19-NET: automatic detection of COVID-19 cases from X-ray images using modified VGG19 CNN architecture and YOLO algorithm. Neural. Comput. Appl. 2022; 34 (10): 8253–8274. https://doi.org/10.1007/s00521-022-06918-x</mixed-citation></citation-alternatives></ref><ref id="cit22"><label>22</label><citation-alternatives><mixed-citation xml:lang="ru">ROC-инструмент ГБУЗ НПКЦ ДиТ ДЗМ // URL: https://roc-analysis.mosmed.ai/</mixed-citation><mixed-citation xml:lang="en">ROC analysis tool of Scientific and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Moscow City Health Department // URL: https://roc-analysis.mosmed.ai/.</mixed-citation></citation-alternatives></ref><ref id="cit23"><label>23</label><citation-alternatives><mixed-citation xml:lang="ru">Mustra M., Delac K., Grgic M. et al. Overview of the DICOM standard. ELMAR, 2008. 50th International Symposium. Zadar, Croatia: 39–44. ISBN 978-1-4244-3364-3</mixed-citation><mixed-citation xml:lang="en">Mustra M., Delac K., Grgic M. et al. Overview of the DICOM standard. ELMAR, 2008. 50th International Symposium. Zadar, Croatia: 39–44. ISBN 978-1-4244-3364-3</mixed-citation></citation-alternatives></ref><ref id="cit24"><label>24</label><citation-alternatives><mixed-citation xml:lang="ru">Gueld M.O., Kohnen M., Keysers D. et al. Quality of DICOM header information for image categorization. Proc. SPIE 4685. Medical Imaging 2002: PACS and Integrated Medical Information Systems: Design and Evaluation. https://doi.org/10.1117/12.467017</mixed-citation><mixed-citation xml:lang="en">Gueld M.O., Kohnen M., Keysers D. et al. Quality of DICOM header information for image categorization. Proc. SPIE 4685. Medical Imaging 2002: PACS and Integrated Medical Information Systems: Design and Evaluation. https://doi.org/10.1117/12.467017</mixed-citation></citation-alternatives></ref><ref id="cit25"><label>25</label><citation-alternatives><mixed-citation xml:lang="ru">Santosh K.C., Wendling L. Angular relational signature-based chest radiograph image view classification. Med. Biol. Eng. Comput. 2018; 56 (8): 1447–1458. https://doi.org/10.1007/s11517-018-1786-3</mixed-citation><mixed-citation xml:lang="en">Santosh K.C., Wendling L. Angular relational signature-based chest radiograph image view classification. Med. Biol. Eng. Comput. 2018; 56 (8): 1447–1458. https://doi.org/10.1007/s11517-018-1786-3</mixed-citation></citation-alternatives></ref><ref id="cit26"><label>26</label><citation-alternatives><mixed-citation xml:lang="ru">Urinbayev K., Orazbek Y., Nurambek Y. et al. End-to-End Deep Diagnosis of X-ray Images. 2020 42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) in conjunction with the 43rd Annual Conference of the Canadian Medical and Biological Engineering Society. https://doi.org/10.1109/EMBC44109.2020.9175208</mixed-citation><mixed-citation xml:lang="en">Urinbayev K., Orazbek Y., Nurambek Y. et al. End-to-End Deep Diagnosis of X-ray Images. 2020 42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) in conjunction with the 43rd Annual Conference of the Canadian Medical and Biological Engineering Society. https://doi.org/10.1109/EMBC44109.2020.9175208</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
