WO2019047366A1 - Artificial intelligence-based image recognition system and method - Google Patents

Artificial intelligence-based image recognition system and method Download PDF

Info

Publication number
WO2019047366A1
WO2019047366A1 PCT/CN2017/110477 CN2017110477W WO2019047366A1 WO 2019047366 A1 WO2019047366 A1 WO 2019047366A1 CN 2017110477 W CN2017110477 W CN 2017110477W WO 2019047366 A1 WO2019047366 A1 WO 2019047366A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
image recognition
instruction
recognition result
recognition
Prior art date
Application number
PCT/CN2017/110477
Other languages
French (fr)
Chinese (zh)
Inventor
姚育东
钱唯
郑斌
马贺
齐守良
赵明芳
Original Assignee
深圳市前海安测信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市前海安测信息技术有限公司 filed Critical 深圳市前海安测信息技术有限公司
Publication of WO2019047366A1 publication Critical patent/WO2019047366A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51Indexing; Data structures therefor; Storage structures

Definitions

  • the present invention relates to the field of medical image processing and recognition technologies, and in particular, to an image recognition system and method based on artificial intelligence.
  • the main object of the present invention is to provide an image recognition system and method based on artificial intelligence, which can obtain a screening image recognition result by simply inputting a simple image recognition instruction, simplifying the operation of screening image recognition, and improving The efficiency and accuracy of image recognition.
  • the present invention provides an image recognition system based on artificial intelligence, which is applied to a medical terminal device, and the medical terminal device is connected to an image collection terminal and a medical information platform through a communication network, and the manual is based on artificial
  • the intelligent image recognition system includes: an image acquisition module, configured to acquire an image signal of the object to be detected from the image capturing terminal, process the image signal of the object to be detected into a screening image, and receive an image recognition instruction from an input unit of the medical terminal device. ;
  • an image matching module for matching and screening image similarity in an image database of a medical information platform Image data within a preset range
  • the image recognition module is configured to match, according to the image recognition instruction, a text corresponding to the image recognition instruction in the instruction recognition library of the medical information platform as the image recognition result.
  • the image capturing terminal includes an infrared generator, an infrared receiver, an analog to digital converter, and a communication port, wherein: the infrared generator is configured to generate infrared light and inspect the infrared light to the body of the object to be detected.
  • the infrared receiver is configured to collect an infrared light signal transmitted through a body part of the body to be detected into an analog electrical signal containing body tissue structure information of the body to be detected;
  • the analog to digital converter is used to The analog electrical signal analog to the body tissue structure information of the body to be detected is converted into an image signal in the form of a digital signal;
  • the communication port is configured to transmit an image signal of the person to be detected to the medical terminal device.
  • the image recognition instruction is a first identification mark, a second identification mark or a third identification mark, wherein:
  • the image recognition module matches the corresponding text in the instruction recognition library according to the first identification mark as a normal image recognition result
  • the image recognition module matches the corresponding character in the instruction recognition library as a reference image recognition result according to the second identification mark;
  • the image recognition module matches the corresponding character in the command recognition library according to the third identification mark as an abnormal image recognition result.
  • the artificial intelligence-based image recognition system further includes a result indication module, configured to identify a normal image recognition result, an abnormal image recognition result, or a reference image recognition result in the image recognition report.
  • a result indication module configured to identify a normal image recognition result, an abnormal image recognition result, or a reference image recognition result in the image recognition report.
  • the image recognition module is further configured to receive the image recognition result input by the doctor and add the image recognition result to the image recognition report. And adding the input image recognition result to the instruction recognition library.
  • the present invention also provides an image recognition method based on artificial intelligence, which is applied to a medical terminal device, and the medical terminal device is connected to the image capturing terminal and the medical information platform through a communication network, and the method includes the following steps: from the image capturing terminal Obtaining an image signal of the person to be tested;
  • processing the image signal of the person to be detected as a screening image [0015] processing the image signal of the person to be detected as a screening image; [0016] receiving an image recognition instruction from an input unit of the medical terminal device;
  • the step of acquiring an image signal of the object to be detected from the image capturing terminal comprises: generating infrared light by using an infrared generator of the image capturing terminal and seeing the infrared light to a body part of the body to be detected;
  • the infrared receiver of the image capturing terminal collects the infrared light signal transmitted through the body part of the body to be detected into an analog electrical signal containing the tissue structure information of the body part of the body to be detected;
  • the analog to digital converter using the image capturing terminal will contain
  • the analog electrical signal analogy of the body part organ structure information of the subject to be detected is converted into an image signal in the form of a digital signal; the communication port of the image capturing terminal is used to transmit the image signal of the subject to be detected to the medical terminal device.
  • the image recognition instruction is a first identification mark, a second identification mark or a third identification mark, and the matching the image corresponding to the image recognition instruction in the instruction recognition library of the medical information platform according to the image recognition instruction
  • the steps as the result of image recognition include:
  • the image recognition instruction is the third identification mark ⁇
  • the corresponding character is matched in the instruction recognition library according to the third identification mark as an abnormal image recognition result.
  • the artificial intelligence-based image recognition method further comprises the following steps: identifying a normal image recognition result, an abnormal image recognition result or a reference image recognition result in the image recognition report
  • the artificial intelligence-based image recognition method further comprises the steps of: receiving an image recognition result input by the doctor when the image recognition result corresponding to the image recognition instruction is not matched in the instruction recognition library And added to the image recognition report, and the input image recognition result is added to the instruction recognition library.
  • the artificial intelligence-based image recognition system and method of the present invention can be used in a preset instruction recognition library according to a doctor's input image recognition instruction during a process of screening image recognition by a doctor.
  • the image recognition result corresponding to the image recognition instruction is matched, and the image data with the similarity of the image similarity in the preset image is matched in the preset image database, and the image recognition report is generated according to the image recognition result and the image data. Since the doctor only needs to input a simple image recognition command, the recognition result of the screening image can be obtained without the doctor inputting the cumbersome examination conclusion, thereby simplifying the operation of the image recognition of the body part organ and improving the efficiency of image recognition of the body part organ. And accuracy, assist doctors to improve the efficiency and accuracy of body part disease detection and screening, and improve the social efficiency of body partal organ screening.
  • FIG. 1 is a schematic diagram of an application environment of a preferred embodiment of an artificial intelligence-based image recognition system according to the present invention
  • FIG. 2 is a flow chart of a preferred embodiment of an artificial intelligence based image recognition method according to the present invention.
  • FIG. 1 is a schematic diagram of an application environment of a preferred embodiment of an artificial intelligence-based image recognition system according to the present invention.
  • the artificial intelligence-based image recognition system 10 is installed and operated in the medical terminal device 1.
  • the medical terminal device 1 establishes a communication connection with the medical information platform 2 and the image capturing terminal 4 via the communication network 3.
  • the medical terminal device 1 is disposed at a body part organ examination center Or a doctor's workstation computer or server of a large hospital, such as a computing device with data processing and communication functions.
  • the medical information platform 2 can be a server in a medical information system platform, and the medical information platform 2 includes an instruction identification library 21 and an image database 22.
  • the preset instruction recognition library 21 pre-collects medical terms, radiology terms, and common image recognition result templates commonly used for body part organ health screening, and in general, the template corresponds to Identify the results for normal images.
  • the image database 22 stores various normal or abnormal image data that are commonly used for reference. After receiving the screening image, the image data in the screening image and the image database can be similarly matched.
  • the communication network 3 may be an internet network including a local area network, a wide area network, or a wireless transmission network including GSM, GPRS, and CDMA.
  • the body part organ image collecting terminal 4 is disposed in a medical examination institution such as a community medical workstation, and establishes a network communication connection with the medical terminal device i.
  • the body part organ image collecting terminal 4 includes an infrared generator 41, an infrared receiver 42, an analog to digital converter 43, and a communication port 44.
  • the infrared generator 41 generates infrared light and sees the infrared light onto a body part organ of the body to be detected; the infrared receiver 42 collects infrared light signals transmitted through the body part of the body to be detected and processes the body part organ structure The analog electrical signal of the information; the infrared light generated by the infrared generator 41 is fluorinated to the body part of the body to be detected, and the infrared light signal received by the infrared receiver 42 carries the infrared transmitted light of the body tissue structure information of the body.
  • the analog-to-digital converter 43 analog-to-digital converts the analog electrical signal containing the body tissue structure information of the body to be detected collected by the infrared receiver 42 into an image signal in the form of a digital signal; the communication port 44 is used for the person to be detected The information and the digital signal containing the body part organ image information of the subject to be detected are transmitted to the cloud server 1 through the communication network 3.
  • the communication port 44 can be a wireless communication interface with remote wireless communication functions, such as a communication interface supporting GSM, GPRS, CDMA.
  • the medical terminal device 1 includes, but is not limited to, an artificial intelligence based image recognition system 10, an input unit 11, a storage unit 12, a processing unit 13, a communication unit 14, and a display unit 15 .
  • the input unit 11, the storage unit 12, the processing unit 13, the communication unit 14, and the display unit 15 are all connected to the processing unit 13 through a data bus, and can perform information interaction with the artificial intelligence-based image recognition system 10 through the processing unit 13.
  • the input unit 11 can be a hardware device such as a keyboard, a touch screen or a mouse.
  • the storage unit 12 is a read only memory unit ROM, an electrically erasable storage unit EEPROM or Flash memory unit FLASH and other memory.
  • the processing unit 13 is a central processing unit (CPU), a microprocessor, a microcontroller (MCU), a data processing chip, or an information processing unit having a data processing function.
  • the communication unit 14 can be a wireless communication interface with remote wireless communication functions, such as a communication interface supporting GSM, GPRS, CDMA.
  • the display unit 15 is a display for displaying a body part organ inspection report of the person to be examined.
  • the artificial intelligence-based image recognition system 10 includes, but is not limited to, an image acquisition module 101, an image matching module 102, an image recognition module 103, and a result indication module 104.
  • the module referred to in the present invention refers to a series of computer program instruction segments that can be executed by the processing unit 13 of the medical terminal device 1 and that can perform a fixed function, which are stored in the storage unit 12 of the medical terminal device 1. .
  • the image acquisition module 101 is configured to acquire an image signal of the object to be detected from the image capturing terminal 4.
  • the infrared generator 41 generates infrared light and sees the infrared light on a body part of the body to be detected;
  • the infrared receiver 42 collects an infrared light signal passing through a body part of the body to be detected. And processing the analog electrical signal as the body tissue structure information of the body;
  • the analog-to-digital converter 43 converts the analog electrical signal collected by the infrared receiver 42 and contains the information of the body tissue structure of the body to be detected into a digital signal.
  • the image signal of the form is sent to the image acquisition module 101 by the communication port 44.
  • the image acquisition module 101 is further configured to process the image signal of the object to be detected as a screening image. Specifically, the image acquisition module 101 records the image data of the image to be detected by the digital image processing software in the form of a digital file, and then generates a screening image of the object to be detected according to the image data.
  • the principle of detecting the local body organ of the infrared body is: infrared light illuminates the local organ part of the human body, and the local organ tissue of the human body exhibits different absorption characteristics through the infrared spectrum passing through the body, so the infrared light transmitted through the lesion part
  • the intensity of the infrared signal is different between the light signal and the tissue of the normal body.
  • the acquired gray image of the infrared image, the tissue structure, the external dimensions, especially the optical properties of the body part and body tissues can detect the body. The location and size of the lesion in the local organ site.
  • the image acquisition module 101 is further configured to receive an image recognition instruction from the input unit 11.
  • the doctor inputs from the input unit 11 to check the health of the body part of the body.
  • Image recognition instructions are further configured to be received from the input unit 11.
  • the image recognition module 103 is configured to match the text corresponding to the image recognition instruction in the instruction recognition library 21 of the medical information platform 2 as the image recognition result according to the image recognition instruction.
  • the image recognition instruction may be a first identification mark, a second identification mark or a third identification mark.
  • the image recognition instruction includes a preset first identification mark, and the first identification mark is used as an indicator for determining whether the image recognition result is normal, that is, when the image recognition instruction includes the first identification mark ⁇ ,
  • the image recognition module 103 determines that the image recognition result of the screening image is normal, and the content of the first identification mark is generally selected as a word different from related medical terms and radiological terms.
  • the image recognition instruction when the image recognition instruction includes "click + body part organ", it indicates that the image recognition result of the screening image is normal, and therefore, the text corresponding to the normal health of the body part of the body can be matched in the instruction recognition library 21 as a normal
  • the image recognition result for example, matches "the body part of the organ is not abnormal" as a normal image recognition result.
  • the image recognition instruction includes a preset second identification mark, and the second identification mark is used as an indicator for determining whether the image recognition result is a reference image recognition result, that is, when the image recognition instruction includes the second identification mark.
  • the image recognition module 103 needs to match the image recognition result corresponding to the screening image, and the image recognition module 103 matches the image corresponding to the screening image in the instruction recognition library 21 as the reference image recognition result according to the second identification flag.
  • the content of the second identification mark may be set as a "reference” or the like which can clearly determine the image recognition result whose reference image recognition result is a reference. For example, when the image recognition command is "reference", the character corresponding to the conclusion of the image recognition report is matched in the command recognition library, and the character is used as the reference image recognition result.
  • the image recognition module 103 may determine that the image recognition result is not a normal image recognition result, and match the corresponding text in the instruction recognition library according to the third identification mark.
  • the matching text corresponding to the third identification mark has nothing to do with the image recognition result of the screening image, it indicates that the received image recognition instruction is invalid; on the contrary, it indicates that the image recognition result corresponding to the image recognition instruction is an abnormal image recognition result.
  • the recognized image recognition command is "a number of soft tissue density lesions visible on both sides of the breast, and the morphology conforms to the body part organs"
  • the corresponding text is matched in the command recognition library, and the text is used as an abnormal image recognition result.
  • the image recognition module 103 if the image recognition module 103 does not match the image recognition result corresponding to the image recognition instruction in the instruction recognition library 21, it indicates that the corresponding file is not stored in the instruction identification library 21, Thereafter, the doctor can input the corresponding image recognition result into the image recognition report through the input unit 11, and The image recognition module 103 adds the input image recognition result to the instruction recognition library 21, so as to match the corresponding image recognition result from the instruction recognition library 21 after receiving the same or similar image recognition instruction next time.
  • the image matching module 102 is configured to match the image data in the preset image database 22 with the image similarity within the preset range, and add the matched image data to the corresponding image recognition report. in.
  • the similar image data in the image database 22 is acquired as the image data corresponding to the screening image, and the preset range may be customized according to the relevant parts of the breast, for example, set to be greater than 80%.
  • the image matching module 102 matches the image data corresponding to the screening image, the matched image data is added to the corresponding image recognition report.
  • the image recognition report not only includes the image recognition result of the screening image, but also the image data of the screening image for reference by the doctor and the examinee.
  • the result indication module 104 is configured to identify a normal image recognition result, an abnormal image recognition result, or a reference image recognition result in the image recognition report, and display the image recognition report on the display unit 15 in a preset display manner.
  • Normal image recognition results, abnormal image recognition results, or reference image recognition results are different identification on the normal image recognition result and the abnormal image recognition result according to whether the image recognition result is normal or abnormal, and the reference result can be identified as being distinguishable from the normal or abnormal image recognition result.
  • Other identifiers such as marking different image recognition results as different fonts or different colors, so as to display in a preset display manner after display, for example, the text content of the abnormal image recognition result is in bold form Display or highlight.
  • the text content corresponding to the recognition template may be identified as blue after matching the recognition template indicating that the image recognition result is normal. If the image recognition result in the image recognition report is an abnormal image recognition result, the text content may be identified as a red font after being matched with the text corresponding to the abnormal image recognition result, and displayed. The text content of the red font is displayed in bold or highlighted to remind the examinee to pay attention.
  • the normal image recognition result or the abnormal image recognition result in the image recognition report is differently identified, and the normal image recognition result or the abnormal image recognition result is displayed in a preset display manner, so that The image recognition report is more clear and easy for doctors and subjects to read.
  • the present invention also provides an image recognition method based on artificial intelligence, which is applied to a medical terminal device.
  • FIG. 2 is a flow chart of a preferred embodiment of the image recognition method based on artificial intelligence according to the present invention.
  • the image recognition method based on artificial intelligence includes the following steps: [0043] Step S21, the image acquisition module 101 acquires an image signal of the object to be detected from the image acquisition terminal 4, and is to be detected.
  • the image signal processing is to screen the image; in the embodiment, the infrared generator 41 generates infrared light and sees the infrared light on the body part of the body to be detected; the infrared receiver 42 collects the body through the person to be tested
  • the infrared light signal of the local organ is processed as an analog electrical signal of body tissue structure information of the body; the analog-to-digital converter 43 converts the analog electrical signal of the local organ structure information of the body of the subject to be detected by the infrared receiver 42 Processing is an image signal in the form of a digital signal; the communication port 44 transmits the image signal of the person to be detected to the image acquisition module 101.
  • the image acquisition module 101 records the image data of the image to be detected by the digital image processing software in the form of a digital file, and then generates a screening image of the object to be detected according to the image data.
  • Step S22 The image matching module 102 matches the image data in the preset image database with the image similarity within the preset range, and adds the matched image data to the corresponding image recognition report.
  • the image database 22 stores various commonly used normal or abnormal image data for reference.
  • the image matching module 102 can perform screening on the image and image database.
  • the image data is similarly matched.
  • the similar image data in the image database is acquired as the image data corresponding to the screening image, and the preset range may be customized according to the breast related portion, for example, set to be greater than 80%.
  • the image matching module 102 After matching the image data corresponding to the screening image, the image matching module 102 adds the image data according to the image data to the corresponding image recognition report.
  • the image recognition report includes not only the image recognition result of the screening image but also the image data of the screening image for reference by the doctor and the examinee.
  • Step S23 the image acquisition module 101 receives an image recognition instruction from the input unit 11 of the medical terminal device.
  • the doctor inputs an image recognition command for checking the health condition of the body part from the input unit 11.
  • Step S24 the image recognition module 103 matches the character corresponding to the image recognition instruction in the command recognition library 21 as the image recognition result according to the image recognition instruction.
  • the image recognition instruction may be a first identification mark, a second identification mark or a third identification mark; the image recognition result may be a normal image recognition result, a reference image recognition result, or an abnormal image. Identify the results.
  • the image recognition instruction includes a preset first identification mark, and the first identification mark is used as an indicator for determining whether the image recognition result is normal, that is, the first identification mark is included in the image recognition instruction.
  • the image recognition module 103 determines that the image recognition result of the screening image is normal, and the content of the first identification mark is generally selected as a word different from related medical terms and radiological terms. For example, when the image recognition instruction includes "click + body part organ", it indicates that the image recognition result of the screening image is normal, and thus, the instruction recognition library 21 can match the text corresponding to the health of the body part organ, for example, matching. "There is no abnormality in the local organs of the body” as a result of normal image recognition.
  • the image recognition instruction includes a preset second identification mark, and the second identification mark is used as an indicator for determining whether the image recognition result is a reference image recognition result, that is, when the image recognition instruction includes the second identification mark.
  • the image recognition module 103 needs to match the image recognition result corresponding to the screening image, and the image recognition module 103 matches the image corresponding to the screening image in the instruction recognition library 21 as the reference image recognition result according to the second identification flag.
  • the content of the second identification mark can be set to a word such as "reference” which can clearly determine the image recognition result whose indication is the reference image recognition result. For example, when the image recognition command is "reference", the character corresponding to the conclusion of the image recognition report is matched in the command recognition library 21, and the character is used as a reference image recognition result.
  • the image recognition module 103 may determine that the image recognition result is not a normal image recognition result, and match the corresponding text in the instruction recognition library 21 according to the third identification mark.
  • the matching text corresponding to the third identification mark has nothing to do with the image recognition result of the screening image, it indicates that the received image recognition instruction is invalid; on the contrary, it indicates that the image recognition result corresponding to the image recognition instruction is abnormal.
  • Image recognition results For example, if the recognized image recognition command is "a number of soft tissue densities visible on both sides of the breast, and the morphology is consistent with the body part organs", the corresponding recognition text is matched in the instruction recognition library 21, and the text is used as an abnormal image recognition result.
  • the image recognition module 103 if the image recognition module 103 does not match the image recognition result corresponding to the image recognition instruction in the instruction recognition library 21, it indicates that the corresponding file is not stored in the instruction recognition library 21, and The doctor can input the corresponding image recognition result into the image recognition report through the input unit 11, and the image recognition module 103 adds the input image recognition result to the instruction recognition library 21, so as to receive the same or similar image recognition next time.
  • the command ⁇ , the corresponding image recognition result is matched from the command recognition library 21.
  • Step S25 the result indication module 104 identifies the normal image recognition result, the abnormal image recognition result or the reference image recognition result in the image recognition report, and displays the preset display mode on the display unit 15 A normal image recognition result, an abnormal image recognition result, or a reference image recognition result in the image recognition report is displayed.
  • the result indication module 104 performs different identification on the normal image recognition result and the abnormal image recognition result according to whether the image recognition result is normal or abnormal, and the reference result can be identified as being distinguishable from the normal or abnormal image recognition result.
  • Other identifiers such as marking different image recognition results as different fonts or different colors, so that after display, the display unit 15 displays the display in a preset manner, for example, the text content of the abnormal image recognition result is Displayed in bold or highlighted.
  • the text content identifier corresponding to the recognition template may be matched after matching the recognition template representing that the image recognition result is normal. It is a blue font and is displayed normally; if the image recognition result in the image recognition report is an abnormal image recognition result, the text content may be identified as a red font after matching the text corresponding to the abnormal image recognition result, and In the display, the text content of the red font is displayed in bold or highlighted to remind the examinee to pay attention.
  • the normal image recognition result or the abnormal image recognition result in the image recognition report is differently identified, and the normal image recognition result or the abnormal image recognition result is displayed in a preset display manner, so that The image recognition report is more clear and easy for doctors and examiners to read.
  • the body part organ screening intelligent identification system and method of the present invention can match and image in a preset instruction recognition library according to a doctor inputting a simple image recognition instruction during a process of screening image recognition by a doctor. Identifying the image recognition result corresponding to the instruction, matching the image data in the preset image database with the image similarity within the preset range, and generating the image recognition report according to the image recognition result and the image data, since the doctor only needs to input the simple
  • the image recognition command can obtain the recognition result of the screening image without the doctor inputting the cumbersome examination conclusion, thereby simplifying the operation of the image recognition of the body part organ, improving the efficiency and accuracy of the image recognition of the body part organ, thereby assisting Doctors improve the efficiency and accuracy of detection and screening of body parts and diseases, and improve the social efficiency of body partal organ screening.
  • the artificial intelligence-based image recognition system and method of the present invention can match and match the image recognition instruction input by the doctor in the preset instruction recognition library during the process of screening image recognition by the doctor.
  • the image recognition result corresponding to the image recognition instruction matches the image data in the preset image database with the image similarity within the preset range, and generates the image recognition report according to the image recognition result and the image data. Since the doctor only needs to input a simple image recognition command, the recognition result of the screening image can be obtained without the doctor inputting the cumbersome examination conclusion, thereby simplifying the operation of the image recognition of the body part organ and improving the efficiency of image recognition of the body part organ. And accuracy, assist doctors to improve the efficiency and accuracy of body part disease detection and screening, and improve the social efficiency of body partal organ screening.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

The present invention discloses an artificial intelligence-based image recognition system and method, which are applied to medical terminal devices, wherein the method comprises the following steps: acquiring from an image acquisition terminal an image signal of a person to be detected; processing the image signal of the person to be detected as a screening image; in an image database of a medical information platform, matching image data for which the degree of similarity with the screening image is within a preset range; receiving, from an input unit of the medical terminal device, an image recognition instruction; in an instruction recognition library of the medical information platform, matching text corresponding to the image recognition instruction as the image recognition result according to the image recognition instruction. By implementing the present invention, a doctor need only input a simple image recognition instruction to obtain a recognition result of a screening image, thereby simplifying the operation of screening image recognition and increasing the efficiency and accuracy of image recognition.

Description

基于人工智能的影像识别系统及方法 技术领域  Image recognition system and method based on artificial intelligence
[0001] 本发明涉及医学影像处理与识别技术领域, 尤其涉及一种基于人工智能的影像 识别系统及方法。  [0001] The present invention relates to the field of medical image processing and recognition technologies, and in particular, to an image recognition system and method based on artificial intelligence.
背景技术  Background technique
[0002] 目前, 利用筛査影像进行辅助诊断已经成为被广泛采用的筛査和诊断早期身体 局部器官的重要方法。 医生在査看筛査影像吋, 不能同步撰写报告, 而是要切 换到报告撰写的界面或程序中进行; 并且, 在撰写报告吋, 需要将内容逐字逐 句地输入到计算机中。 对于一些较为常见的检査结果 (如某部位未见异常等) , 仍然需要进行繁琐的输入, 这样就需要消耗相当的精力和吋间, 容易发生误 操作致使身体局部器官筛査效率下降的现象, 不适合大量身体局部器官样本的 普査情况。 此外, 由于身体局部器官影像数量很多, 医生直接对每幅身体局部 器官影像进行识别并手动撰写报告难以保证效率及准确性, 从而容易造成漏诊 和误诊的情况发生。  [0002] At present, the use of screening images for assisted diagnosis has become an important method for screening and diagnosing early local organs of the body. After viewing the screening image, the doctor cannot write the report simultaneously, but switch to the interface or program of the report writing; and, after writing the report, the content needs to be input to the computer word by word. For some of the more common test results (such as no abnormality in a certain part), it still needs to make cumbersome input, which requires considerable energy and time, which is prone to misuse and causes the efficiency of local organ screening to decrease. It is not suitable for the census of a large number of samples of body parts. In addition, due to the large number of images of local organs in the body, it is difficult for doctors to directly identify each part of the body and manually report the report. It is difficult to ensure efficiency and accuracy, which may lead to missed diagnosis and misdiagnosis.
技术问题  technical problem
[0003] 本发明的主要目的在于提供一种基于人工智能的影像识别系统及方法, 只需医 生输入简单的影像识别指令就能得到筛査影像的识别结果, 简化筛査影像识别 的操作, 提高影像识别的效率和准确性。  [0003] The main object of the present invention is to provide an image recognition system and method based on artificial intelligence, which can obtain a screening image recognition result by simply inputting a simple image recognition instruction, simplifying the operation of screening image recognition, and improving The efficiency and accuracy of image recognition.
问题的解决方案  Problem solution
技术解决方案  Technical solution
[0004] 为实现上述目的, 本发明提供了一种基于人工智能的影像识别系统, 应用于医 疗终端设备中, 该医疗终端设备通过通信网络连接至影像采集终端和医疗信息 平台, 所述基于人工智能的影像识别系统包括: 影像获取模块, 用于从影像采 集终端获取待检测者的影像信号, 将待检测者的影像信号处理为筛査影像, 以 及从医疗终端设备的输入单元接收影像识别指令;  [0004] In order to achieve the above object, the present invention provides an image recognition system based on artificial intelligence, which is applied to a medical terminal device, and the medical terminal device is connected to an image collection terminal and a medical information platform through a communication network, and the manual is based on artificial The intelligent image recognition system includes: an image acquisition module, configured to acquire an image signal of the object to be detected from the image capturing terminal, process the image signal of the object to be detected into a screening image, and receive an image recognition instruction from an input unit of the medical terminal device. ;
[0005] 影像匹配模块, 用于在医疗信息平台的影像数据库中匹配与筛査影像相似度在 预置范围内的影像数据; [0005] an image matching module for matching and screening image similarity in an image database of a medical information platform Image data within a preset range;
[0006] 影像识别模块, 用于根据影像识别指令在医疗信息平台的指令识别库中匹配与 影像识别指令对应的文字作为影像识别结果。  [0006] The image recognition module is configured to match, according to the image recognition instruction, a text corresponding to the image recognition instruction in the instruction recognition library of the medical information platform as the image recognition result.
[0007] 优选的, 所述影像采集终端包括红外发生器、 红外接收器、 模数转换器以及通 信端口, 其中: 所述红外发生器用于产生红外光并将红外光透视到待检测者的 身体局部器官上; 所述红外接收器用于采集透过待检测者的身体局部器官的红 外光信号处理为包含待检测者的身体局部器官组织结构信息的模拟电信号; 所 述模数转换器用于将包含待检测者的身体局部器官组织结构信息的模拟电信号 模数转换为数字信号形式的影像信号; 所述通信端口用于将待检测者的影像信 号发送至所述医疗终端设备。 [0007] Preferably, the image capturing terminal includes an infrared generator, an infrared receiver, an analog to digital converter, and a communication port, wherein: the infrared generator is configured to generate infrared light and inspect the infrared light to the body of the object to be detected. The infrared receiver is configured to collect an infrared light signal transmitted through a body part of the body to be detected into an analog electrical signal containing body tissue structure information of the body to be detected; the analog to digital converter is used to The analog electrical signal analog to the body tissue structure information of the body to be detected is converted into an image signal in the form of a digital signal; the communication port is configured to transmit an image signal of the person to be detected to the medical terminal device.
[0008] 优选的, 所述影像识别指令为第一识别标志、 第二识别标志或第三识别标志, 其中: [0008] Preferably, the image recognition instruction is a first identification mark, a second identification mark or a third identification mark, wherein:
[0009] 当所述影像识别指令为第一识别标志吋, 所述影像识别模块根据第一识别标志 在指令识别库中匹配对应的文字作为正常的影像识别结果;  [0009] when the image recognition instruction is the first identification mark 吋, the image recognition module matches the corresponding text in the instruction recognition library according to the first identification mark as a normal image recognition result;
[0010] 当所述影像识别指令为第二识别标志吋, 所述影像识别模块根据第二识别标志 在指令识别库中匹配对应的文字作为参考的影像识别结果;  [0010] when the image recognition instruction is a second identification mark 吋, the image recognition module matches the corresponding character in the instruction recognition library as a reference image recognition result according to the second identification mark;
[0011] 当所述影像识别指令为第三识别标志吋, 所述影像识别模块根据第三识别标志 在指令识别库中匹配对应的文字作为异常的影像识别结果。  [0011] When the image recognition command is the third identification mark 吋, the image recognition module matches the corresponding character in the command recognition library according to the third identification mark as an abnormal image recognition result.
[0012] 优选的, 所述基于人工智能的影像识别系统还包括结果标示模块, 用于对影像 识别报告中的正常的影像识别结果、 异常的影像识别结果或参考影像识别结果 进行标识。  [0012] Preferably, the artificial intelligence-based image recognition system further includes a result indication module, configured to identify a normal image recognition result, an abnormal image recognition result, or a reference image recognition result in the image recognition report.
[0013] 优选的, 当所述指令识别库中未匹配出与所述影像识别指令对应的影像识别结 果吋, 所述影像识别模块还用于接收医生输入的影像识别结果并添加至影像识 别报告中, 并将输入的影像识别结果添加至所述指令识别库中。  [0013] Preferably, when the image recognition result corresponding to the image recognition instruction is not matched in the instruction identification library, the image recognition module is further configured to receive the image recognition result input by the doctor and add the image recognition result to the image recognition report. And adding the input image recognition result to the instruction recognition library.
[0014] 本发明还提供一种基于人工智能的影像识别方法, 应用于医疗终端设备中, 该 医疗终端设备通过通信网络连接至影像采集终端和医疗信息平台, 该方法包括 步骤: 从影像采集终端获取待检测者的影像信号;  [0014] The present invention also provides an image recognition method based on artificial intelligence, which is applied to a medical terminal device, and the medical terminal device is connected to the image capturing terminal and the medical information platform through a communication network, and the method includes the following steps: from the image capturing terminal Obtaining an image signal of the person to be tested;
[0015] 将待检测者的影像信号处理为筛査影像; [0016] 从医疗终端设备的输入单元接收影像识别指令; [0015] processing the image signal of the person to be detected as a screening image; [0016] receiving an image recognition instruction from an input unit of the medical terminal device;
[0017] 在医疗信息平台的影像数据库中匹配与筛査影像相似度在预置范围内的影像数 据;  [0017] matching, in the image database of the medical information platform, image data whose screening image similarity is within a preset range;
[0018] 根据影像识别指令在医疗信息平台的指令识别库中匹配与影像识别指令对应的 文字作为影像识别结果。  [0018] The text corresponding to the image recognition instruction is matched in the instruction recognition library of the medical information platform as the image recognition result according to the image recognition instruction.
[0019] 优选的, 所述从影像采集终端获取待检测者的影像信号的步骤包括: 利用影像 采集终端的红外发生器产生红外光并将红外光透视到待检测者的身体局部器官 上; 通过影像采集终端的红外接收器采集透过待检测者的身体局部器官的红外 光信号处理为包含待检测者的身体局部器官组织结构信息的模拟电信号; 利用 影像采集终端的模数转换器将包含待检测者的身体局部器官组织结构信息的模 拟电信号模数转换为数字信号形式的影像信号; 通过影像采集终端的通信端口 用于将待检测者的影像信号发送至所述医疗终端设备。 [0019] Preferably, the step of acquiring an image signal of the object to be detected from the image capturing terminal comprises: generating infrared light by using an infrared generator of the image capturing terminal and seeing the infrared light to a body part of the body to be detected; The infrared receiver of the image capturing terminal collects the infrared light signal transmitted through the body part of the body to be detected into an analog electrical signal containing the tissue structure information of the body part of the body to be detected; the analog to digital converter using the image capturing terminal will contain The analog electrical signal analogy of the body part organ structure information of the subject to be detected is converted into an image signal in the form of a digital signal; the communication port of the image capturing terminal is used to transmit the image signal of the subject to be detected to the medical terminal device.
[0020] 优选的, 所述影像识别指令为第一识别标志、 第二识别标志或第三识别标志, 所述根据影像识别指令在医疗信息平台的指令识别库中匹配与影像识别指令对 应的文字作为影像识别结果的步骤包括: [0020] Preferably, the image recognition instruction is a first identification mark, a second identification mark or a third identification mark, and the matching the image corresponding to the image recognition instruction in the instruction recognition library of the medical information platform according to the image recognition instruction The steps as the result of image recognition include:
[0021] 当所述影像识别指令为第一识别标志吋, 根据第一识别标志在指令识别库中匹 配对应的文字作为正常的影像识别结果; [0021] when the image recognition instruction is the first identification mark 吋, matching the corresponding character in the instruction recognition library according to the first identification mark as a normal image recognition result;
[0022] 当所述影像识别指令为第二识别标志吋, 根据第二识别标志在指令识别库中匹 配对应的文字作为参考的影像识别结果; [0022] when the image recognition instruction is the second identification mark 吋, matching the corresponding character in the instruction recognition library as a reference image recognition result according to the second identification mark;
[0023] 当所述影像识别指令为第三识别标志吋, 根据第三识别标志在指令识别库中匹 配对应的文字作为异常的影像识别结果。 [0023] When the image recognition instruction is the third identification mark 吋, the corresponding character is matched in the instruction recognition library according to the third identification mark as an abnormal image recognition result.
[0024] 优选的, 所述基于人工智能的影像识别方法还包括如下步骤: 对影像识别报告 中的正常的影像识别结果、 异常的影像识别结果或参考影像识别结果进行标识 [0024] Preferably, the artificial intelligence-based image recognition method further comprises the following steps: identifying a normal image recognition result, an abnormal image recognition result or a reference image recognition result in the image recognition report
[0025] 优选的, 所述基于人工智能的影像识别方法还包括如下步骤: 当所述指令识别 库中未匹配出与所述影像识别指令对应的影像识别结果吋, 接收医生输入的影 像识别结果并添加至影像识别报告中, 并将输入的影像识别结果添加至所述指 令识别库中。 发明的有益效果 [0025] Preferably, the artificial intelligence-based image recognition method further comprises the steps of: receiving an image recognition result input by the doctor when the image recognition result corresponding to the image recognition instruction is not matched in the instruction recognition library And added to the image recognition report, and the input image recognition result is added to the instruction recognition library. Advantageous effects of the invention
有益效果  Beneficial effect
[0026] 相较于现有技术, 本发明所述基于人工智能的影像识别系统及方法能够在医生 在进行筛査影像识别的过程中, 根据医生输入的影像识别指令在预置的指令识 别库中匹配与影像识别指令对应的影像识别结果, 在预置的影像数据库中匹配 与筛査影像相似度在预置范围内的影像数据, 以及根据影像识别结果及影像数 据生成影像识别报告。 由于医生只需输入简单的影像识别指令就能得到筛査影 像的识别结果, 而无需医生输入繁琐的检査结论, 从而简化了身体局部器官影 像识别的操作, 提高了身体局部器官影像识别的效率和准确性, 辅助医生提高 对身体局部器官疾病检测与筛査的效率及准确性, 提高身体局部器官筛査的社 会效率。  Compared with the prior art, the artificial intelligence-based image recognition system and method of the present invention can be used in a preset instruction recognition library according to a doctor's input image recognition instruction during a process of screening image recognition by a doctor. The image recognition result corresponding to the image recognition instruction is matched, and the image data with the similarity of the image similarity in the preset image is matched in the preset image database, and the image recognition report is generated according to the image recognition result and the image data. Since the doctor only needs to input a simple image recognition command, the recognition result of the screening image can be obtained without the doctor inputting the cumbersome examination conclusion, thereby simplifying the operation of the image recognition of the body part organ and improving the efficiency of image recognition of the body part organ. And accuracy, assist doctors to improve the efficiency and accuracy of body part disease detection and screening, and improve the social efficiency of body partal organ screening.
对附图的简要说明  Brief description of the drawing
附图说明  DRAWINGS
[0027] 图 1是本发明基于人工智能的影像识别系统优选实施例的应用环境示意图; 1 is a schematic diagram of an application environment of a preferred embodiment of an artificial intelligence-based image recognition system according to the present invention;
[0028] 图 2是本发明基于人工智能的影像识别方法优选实施例的流程图。 2 is a flow chart of a preferred embodiment of an artificial intelligence based image recognition method according to the present invention.
[0029] 本发明目的实现、 功能特点及优点将结合具体实施方式, 参照附图做进一步说 明。  [0029] The objects, features, and advantages of the invention will be apparent from the accompanying drawings.
实施该发明的最佳实施例  BEST MODE FOR CARRYING OUT THE INVENTION
本发明的最佳实施方式  BEST MODE FOR CARRYING OUT THE INVENTION
[0030] 为更进一步阐述本发明为达成上述目的所采取的技术手段及功效, 以下结合附 图及较佳实施例, 对本发明的具体实施方式、 结构、 特征及其功效进行详细说 明。 应当理解, 此处所描述的具体实施例仅仅用以解释本发明, 并不用于限定 本发明。 The specific embodiments, structures, features and utilities of the present invention are described in detail below with reference to the drawings and the preferred embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
[0031] 参照图 1所示, 图 1是本发明基于人工智能的影像识别系统优选实施例的应用环 境示意图。 在本实施例中, 所述基于人工智能的影像识别系统 10安装并运行于 医疗终端设备 1中。 所述医疗终端设备 1通过通信网络 3与医疗信息平台 2以及影 像采集终端 4建立通信连接。 所述医疗终端设备 1设置在身体局部器官体检中心 或大型医院的医生工作站计算机、 服务器等具有数据处理和通信功能的计算装 置。 所述医疗信息平台 2可以是一种医疗信息系统平台中的一台服务器, 该医疗 信息平台 2包括指令识别库 21以及影像数据库 22。 在本实施例中, 所述预置的指 令识别库 21中预先收集了身体局部器官健康筛査常用的医学术语、 放射学术语 以及常见的影像识别结果模版, 在通常情况下, 模版所对应的为正常的影像识 别结果。 所述影像数据库 22中存储了常用的各种正常或异常的影像数据可供参 考, 在接收到筛査影像后, 可以对筛査影像和影像数据库中的影像数据进行相 似度匹配。 所述通信网络 3可以是一种包括局域网、 广域网的网际网络, 或者是 一种包括 GSM、 GPRS、 CDMA的无线传输网络。 [0031] Referring to FIG. 1, FIG. 1 is a schematic diagram of an application environment of a preferred embodiment of an artificial intelligence-based image recognition system according to the present invention. In the embodiment, the artificial intelligence-based image recognition system 10 is installed and operated in the medical terminal device 1. The medical terminal device 1 establishes a communication connection with the medical information platform 2 and the image capturing terminal 4 via the communication network 3. The medical terminal device 1 is disposed at a body part organ examination center Or a doctor's workstation computer or server of a large hospital, such as a computing device with data processing and communication functions. The medical information platform 2 can be a server in a medical information system platform, and the medical information platform 2 includes an instruction identification library 21 and an image database 22. In this embodiment, the preset instruction recognition library 21 pre-collects medical terms, radiology terms, and common image recognition result templates commonly used for body part organ health screening, and in general, the template corresponds to Identify the results for normal images. The image database 22 stores various normal or abnormal image data that are commonly used for reference. After receiving the screening image, the image data in the screening image and the image database can be similarly matched. The communication network 3 may be an internet network including a local area network, a wide area network, or a wireless transmission network including GSM, GPRS, and CDMA.
[0032] 所述身体局部器官图像采集终端 4设置在社区医疗工作站等医疗检査机构内, 并与医疗终端设备 i建立网络通信连接。 在本实施例中, 所述身体局部器官图像 采集终端 4包括红外发生器 41、 红外接收器 42、 模数转换器 43以及通信端口 44。 所述红外发生器 41产生红外光并将红外光透视到待检测者的身体局部器官上; 红外接收器 42采集透过待检测者的身体局部器官的红外光信号并处理为身体局 部器官组织结构信息的模拟电信号; 红外发生器 41产生的红外光透视到待检测 者身体局部器官上, 红外接收器 42接收的红外光信号携带了身体局部器官组织 结构信息的红外透射光。 模数转换器 43将红外接收器 42采集到的包含待检测者 身体局部器官组织结构信息的模拟电信号模数转换处理为数字信号形式的影像 信号; 所述通信端口 44用于将待检测者信息以及包含待检测者的身体局部器官 图像信息的数字信号通过通信网络 3发送至云服务器 1。 所述通信端口 44可以为 一种具有远程无线通讯功能的无线通讯接口, 例如支持 GSM、 GPRS. CDMA的 通讯接口。 [0032] The body part organ image collecting terminal 4 is disposed in a medical examination institution such as a community medical workstation, and establishes a network communication connection with the medical terminal device i. In the present embodiment, the body part organ image collecting terminal 4 includes an infrared generator 41, an infrared receiver 42, an analog to digital converter 43, and a communication port 44. The infrared generator 41 generates infrared light and sees the infrared light onto a body part organ of the body to be detected; the infrared receiver 42 collects infrared light signals transmitted through the body part of the body to be detected and processes the body part organ structure The analog electrical signal of the information; the infrared light generated by the infrared generator 41 is fluorinated to the body part of the body to be detected, and the infrared light signal received by the infrared receiver 42 carries the infrared transmitted light of the body tissue structure information of the body. The analog-to-digital converter 43 analog-to-digital converts the analog electrical signal containing the body tissue structure information of the body to be detected collected by the infrared receiver 42 into an image signal in the form of a digital signal; the communication port 44 is used for the person to be detected The information and the digital signal containing the body part organ image information of the subject to be detected are transmitted to the cloud server 1 through the communication network 3. The communication port 44 can be a wireless communication interface with remote wireless communication functions, such as a communication interface supporting GSM, GPRS, CDMA.
[0033] 在本实施例中, 所述医疗终端设备 1包括, 但不仅限于, 基于人工智能的影像 识别系统 10、 输入单元 11、 存储单元 12、 处理单元 13、 通信单元 14和显示单元 1 5。 所述输入单元 11、 存储单元 12、 处理单元 13、 通信单元 14和显示单元 15均通 过数据总线连接至处理单元 13, 并能通过处理单元 13与基于人工智能的影像识 别系统 10进行信息交互。 所述输入单元 11可以为键盘、 触摸屏或鼠标等硬件设 备。 所述存储单元 12为一种只读存储单元 ROM, 电可擦写存储单元 EEPROM或 快闪存储单元 FLASH等存储器。 所述处理单元 13为一种中央处理器 (CPU) 、 微处理器、 微控制器 (MCU) 、 数据处理芯片、 或者具有数据处理功能的信息 处理单元。 所述通信单元 14可以为一种具有远程无线通讯功能的无线通讯接口 , 例如支持 GSM、 GPRS. CDMA的通讯接口。 所述显示单元 15为显示器, 用于 显示待检査者的身体局部器官检査报告。 [0033] In this embodiment, the medical terminal device 1 includes, but is not limited to, an artificial intelligence based image recognition system 10, an input unit 11, a storage unit 12, a processing unit 13, a communication unit 14, and a display unit 15 . The input unit 11, the storage unit 12, the processing unit 13, the communication unit 14, and the display unit 15 are all connected to the processing unit 13 through a data bus, and can perform information interaction with the artificial intelligence-based image recognition system 10 through the processing unit 13. The input unit 11 can be a hardware device such as a keyboard, a touch screen or a mouse. The storage unit 12 is a read only memory unit ROM, an electrically erasable storage unit EEPROM or Flash memory unit FLASH and other memory. The processing unit 13 is a central processing unit (CPU), a microprocessor, a microcontroller (MCU), a data processing chip, or an information processing unit having a data processing function. The communication unit 14 can be a wireless communication interface with remote wireless communication functions, such as a communication interface supporting GSM, GPRS, CDMA. The display unit 15 is a display for displaying a body part organ inspection report of the person to be examined.
[0034] 在本实施例中, 所述基于人工智能的影像识别系统 10包括, 但不局限于, 影像 获取模块 101、 影像匹配模块 102、 影像识别模块 103以及结果标示模块 104。 本 发明所称的模块是指一种能够被所述医疗终端设备 1的处理单元 13执行并且能够 完成固定功能的一系列计算机程序指令段, 其存储在所述医疗终端设备 1的存储 单元 12中。 In the embodiment, the artificial intelligence-based image recognition system 10 includes, but is not limited to, an image acquisition module 101, an image matching module 102, an image recognition module 103, and a result indication module 104. The module referred to in the present invention refers to a series of computer program instruction segments that can be executed by the processing unit 13 of the medical terminal device 1 and that can perform a fixed function, which are stored in the storage unit 12 of the medical terminal device 1. .
[0035] 所述影像获取模块 101用于从影像采集终端 4获取待检测者的影像信号。 在本实 施例中, 所述红外发生器 41产生红外光并将红外光透视到待检测者的身体局部 器官上; 所述红外接收器 42采集透过待检测者的身体局部器官的红外光信号并 处理为身体局部器官组织结构信息的模拟电信号; 所述模数转换器 43将红外接 收器 42采集到的包含待检测者身体局部器官组织结构信息的模拟电信号模数转 换处理为数字信号形式的影像信号; 所述通信端口 44将待检测者的影像信号发 送至影像获取模块 101。  The image acquisition module 101 is configured to acquire an image signal of the object to be detected from the image capturing terminal 4. In this embodiment, the infrared generator 41 generates infrared light and sees the infrared light on a body part of the body to be detected; the infrared receiver 42 collects an infrared light signal passing through a body part of the body to be detected. And processing the analog electrical signal as the body tissue structure information of the body; the analog-to-digital converter 43 converts the analog electrical signal collected by the infrared receiver 42 and contains the information of the body tissue structure of the body to be detected into a digital signal. The image signal of the form is sent to the image acquisition module 101 by the communication port 44.
[0036] 所述影像获取模块 101还用于将待检测者的影像信号处理为筛査影像。 具体地 , 影像获取模块 101利用数字影像处理软件将待检测者的影像信号以数字文件的 形式记录影像数据, 然后根据该影像数据产生待检测者的筛査影像。 在本实施 例中, 红外身体局部器官检测的原理是: 红外光线照射人体身体局部器官部位 , 由于人体身体局部器官组织对通过其中的红外光谱呈现出不同的吸收特性, 所以透过病变部位的红外光信号与透过正常身体局部器官组织的红外信号的强 度会有所不同, 通过采集到的红外影像的灰度、 组织结构、 外形尺寸特别是身 体局部器官组织的光学特性, 就可以检测到身体局部器官部位发生病变的位置 和尺寸。  [0036] The image acquisition module 101 is further configured to process the image signal of the object to be detected as a screening image. Specifically, the image acquisition module 101 records the image data of the image to be detected by the digital image processing software in the form of a digital file, and then generates a screening image of the object to be detected according to the image data. In the present embodiment, the principle of detecting the local body organ of the infrared body is: infrared light illuminates the local organ part of the human body, and the local organ tissue of the human body exhibits different absorption characteristics through the infrared spectrum passing through the body, so the infrared light transmitted through the lesion part The intensity of the infrared signal is different between the light signal and the tissue of the normal body. The acquired gray image of the infrared image, the tissue structure, the external dimensions, especially the optical properties of the body part and body tissues, can detect the body. The location and size of the lesion in the local organ site.
[0037] 所述影像获取模块 101还用于从输入单元 11接收影像识别指令。 在本实施例中 , 在识别筛査影像吋, 医生从输入单元 11用于输入检査身体局部器官健康状况 的影像识别指令。 [0037] The image acquisition module 101 is further configured to receive an image recognition instruction from the input unit 11. In the present embodiment, after identifying the screening image, the doctor inputs from the input unit 11 to check the health of the body part of the body. Image recognition instructions.
[0038] 所述影像识别模块 103用于根据影像识别指令在医疗信息平台 2的指令识别库 21 中匹配与影像识别指令对应的文字作为影像识别结果。 在本实施例中, 所述影 像识别指令可以为第一识别标志、 第二识别标志或第三识别标志。 具体地, 如 所述影像识别指令中包括预置的第一识别标志, 该第一识别标志作为判断影像 识别结果是否为正常的指示标志, 即当影像识别指令中包括该第一识别标志吋 , 影像识别模块 103判断筛査影像的影像识别结果为正常, 该第一识别标志的内 容通常选择为异于相关的医学术语和放射学术语的词语。 例如, 当影像识别指 令包括 "点击 +身体局部器官", 则表明筛査影像的影像识别结果为正常, 此吋, 可在指令识别库 21中匹配与身体局部器官健康正常对应的文字作为正常的影像 识别结果, 例如匹配"身体局部器官未见异常"作为正常的影像识别结果。 如所述 影像识别指令中包括预置的第二识别标志, 该第二识别标志作为判断影像识别 结果是否为参考的影像识别结果的指示标志, 即当影像识别指令中包括该第二 识别标志吋, 表示此吋需匹配与筛査影像对应的参考的影像识别结果, 影像识 别模块 103根据第二识别标志在指令识别库 21中匹配与筛査影像对应的文字作为 参考的影像识别结果。 第二识别标志的内容可设置为"参考"等可以明显确定其指 示的影像识别结果为参考的影像识别结果的词语。 例如, 当影像识别指令为"参 考", 则在指令识别库中匹配与影像识别报告的结论对应的文字, 将该文字作为 参考的影像识别结果。 如所述影像识别指令第三识别标志, 则影像识别模块 103 可判断影像识别结果不是正常的影像识别结果, 并根据第三识别标志在指令识 别库中匹配与其对应的文字。 如匹配到的第三识别标志对应的文字与对筛査影 像的影像识别结果无关, 则表明接收到的影像识别指令无效; 相反, 则表明影 像识别指令对应的影像识别结果为异常的影像识别结果。 例如, 识别出的影像 识别指令为"乳房两侧可见数个软组织密度灶, 形态与身体局部器官相符", 则在 指令识别库中匹配相应的文字, 将该文字作为异常的影像识别结果。  [0038] The image recognition module 103 is configured to match the text corresponding to the image recognition instruction in the instruction recognition library 21 of the medical information platform 2 as the image recognition result according to the image recognition instruction. In this embodiment, the image recognition instruction may be a first identification mark, a second identification mark or a third identification mark. Specifically, the image recognition instruction includes a preset first identification mark, and the first identification mark is used as an indicator for determining whether the image recognition result is normal, that is, when the image recognition instruction includes the first identification mark 吋, The image recognition module 103 determines that the image recognition result of the screening image is normal, and the content of the first identification mark is generally selected as a word different from related medical terms and radiological terms. For example, when the image recognition instruction includes "click + body part organ", it indicates that the image recognition result of the screening image is normal, and therefore, the text corresponding to the normal health of the body part of the body can be matched in the instruction recognition library 21 as a normal The image recognition result, for example, matches "the body part of the organ is not abnormal" as a normal image recognition result. The image recognition instruction includes a preset second identification mark, and the second identification mark is used as an indicator for determining whether the image recognition result is a reference image recognition result, that is, when the image recognition instruction includes the second identification mark. The image recognition module 103 needs to match the image recognition result corresponding to the screening image, and the image recognition module 103 matches the image corresponding to the screening image in the instruction recognition library 21 as the reference image recognition result according to the second identification flag. The content of the second identification mark may be set as a "reference" or the like which can clearly determine the image recognition result whose reference image recognition result is a reference. For example, when the image recognition command is "reference", the character corresponding to the conclusion of the image recognition report is matched in the command recognition library, and the character is used as the reference image recognition result. If the image recognition instruction is the third identification mark, the image recognition module 103 may determine that the image recognition result is not a normal image recognition result, and match the corresponding text in the instruction recognition library according to the third identification mark. If the matching text corresponding to the third identification mark has nothing to do with the image recognition result of the screening image, it indicates that the received image recognition instruction is invalid; on the contrary, it indicates that the image recognition result corresponding to the image recognition instruction is an abnormal image recognition result. . For example, if the recognized image recognition command is "a number of soft tissue density lesions visible on both sides of the breast, and the morphology conforms to the body part organs", the corresponding text is matched in the command recognition library, and the text is used as an abnormal image recognition result.
[0039] 在本实施例中, 所述影像识别模块 103如在指令识别库 21中未匹配出与影像识 别指令对应的影像识别结果, 则表明该指令识别库 21中未存储有相应的文字, 此吋, 医生可通过输入单元 11输入相应的影像识别结果至影像识别报告中, 影 像识别模块 103则将输入的影像识别结果添加至指令识别库 21中, 以备在下次接 收到相同或相似的影像识别指令吋, 从指令识别库 21中匹配对应的影像识别结 果。 In the embodiment, if the image recognition module 103 does not match the image recognition result corresponding to the image recognition instruction in the instruction recognition library 21, it indicates that the corresponding file is not stored in the instruction identification library 21, Thereafter, the doctor can input the corresponding image recognition result into the image recognition report through the input unit 11, and The image recognition module 103 adds the input image recognition result to the instruction recognition library 21, so as to match the corresponding image recognition result from the instruction recognition library 21 after receiving the same or similar image recognition instruction next time.
[0040] 所述影像匹配模块 102用于在预置的影像数据库 22中匹配与筛査影像相似度在 预置范围内的影像数据, 并将该匹配出的影像数据加入到对应的影像识别报告 中。 当相似度在预设范围内吋, 获取影像数据库 22中的相似影像数据作为筛査 影像对应的影像数据, 预设范围可以根据乳房相关部位自定义设置, 例如设置 为大于 80%。 当影像匹配模块 102匹配到筛査影像对应的影像数据后, 将匹配到 的影像数据加入到对应的影像识别报告中。 影像识别报告不仅包括筛査影像的 影像识别结果, 还包括该筛査影像的影像数据, 以供医生和待检査者参考。  [0040] The image matching module 102 is configured to match the image data in the preset image database 22 with the image similarity within the preset range, and add the matched image data to the corresponding image recognition report. in. When the similarity is within the preset range, the similar image data in the image database 22 is acquired as the image data corresponding to the screening image, and the preset range may be customized according to the relevant parts of the breast, for example, set to be greater than 80%. After the image matching module 102 matches the image data corresponding to the screening image, the matched image data is added to the corresponding image recognition report. The image recognition report not only includes the image recognition result of the screening image, but also the image data of the screening image for reference by the doctor and the examinee.
[0041] 所述结果标示模块 104用于对影像识别报告中的正常的影像识别结果、 异常的 影像识别结果或参考影像识别结果进行标识, 以预置的显示方式在显示单元 15 显示影像识别报告中的正常的影像识别结果、 异常的影像识别结果或参考影像 识别结果。 具体地, 结果标示模块 104根据影像识别结果是正常还是异常对正常 的影像识别结果和异常的影像识别结果进行不同的标识, 同吋可以将参考结果 标识为能够与正常或异常的影像识别结果区分的其他标识, 如将不同的影像识 别结果标记为不同的字体或不同的颜色, 以便在显示吋, 以预置的显示方式进 行显示, 例如, 对异常的影像识别结果的文字内容以加粗形式显示或进行突出 显示。 在本实施例中, 如影像识别报告中的影像识别结果为正常的影像识别结 果, 则可以在匹配到代表影像识别结果为正常的识别模版后, 对该识别模版对 应的文字内容标识为蓝色字体, 并正常显示; 如影像识别报告中的影像识别结 果为异常的影像识别结果, 则可以在匹配到异常的影像识别结果对应的文字后 , 将该文字内容标识为红色字体, 并在显示吋将该红色字体的文字内容以加粗 形式显示或进行突出显示, 以提醒待检査者注意。 在生成影像识别报告吋, 对 影像识别报告中的正常的影像识别结果或异常的影像识别结果进行不同的标识 , 并以预置的显示方式显示正常的影像识别结果或异常的影像识别结果, 使得 影像识别报告显示更为清晰, 方便医生和待检测者阅读。  [0041] The result indication module 104 is configured to identify a normal image recognition result, an abnormal image recognition result, or a reference image recognition result in the image recognition report, and display the image recognition report on the display unit 15 in a preset display manner. Normal image recognition results, abnormal image recognition results, or reference image recognition results. Specifically, the result indication module 104 performs different identification on the normal image recognition result and the abnormal image recognition result according to whether the image recognition result is normal or abnormal, and the reference result can be identified as being distinguishable from the normal or abnormal image recognition result. Other identifiers, such as marking different image recognition results as different fonts or different colors, so as to display in a preset display manner after display, for example, the text content of the abnormal image recognition result is in bold form Display or highlight. In this embodiment, if the image recognition result in the image recognition report is a normal image recognition result, the text content corresponding to the recognition template may be identified as blue after matching the recognition template indicating that the image recognition result is normal. If the image recognition result in the image recognition report is an abnormal image recognition result, the text content may be identified as a red font after being matched with the text corresponding to the abnormal image recognition result, and displayed. The text content of the red font is displayed in bold or highlighted to remind the examinee to pay attention. After the image recognition report is generated, the normal image recognition result or the abnormal image recognition result in the image recognition report is differently identified, and the normal image recognition result or the abnormal image recognition result is displayed in a preset display manner, so that The image recognition report is more clear and easy for doctors and subjects to read.
[0042] 本发明还提供了一种基于人工智能的影像识别方法, 应用于医疗终端设备中。 如图 2所示, 图 2是本发明基于人工智能的影像识别方法优选实施例的流程图。 本实施例一并结合图 1所示, 所述基于人工智能的影像识别方法包括步骤: [0043] 步骤 S21, 影像获取模块 101从影像采集终端 4获取待检测者的影像信号, 并将 待检测者的影像信号处理为筛査影像; 在本实施例中, 红外发生器 41产生红外 光并将红外光透视到待检测者的身体局部器官上; 红外接收器 42采集透过待检 测者的身体局部器官的红外光信号并处理为身体局部器官组织结构信息的模拟 电信号; 模数转换器 43将红外接收器 42采集到的包含待检测者身体局部器官组 织结构信息的模拟电信号模数转换处理为数字信号形式的影像信号; 通信端口 4 4将待检测者的影像信号发送至影像获取模块 101。 影像获取模块 101利用数字影 像处理软件将待检测者的影像信号以数字文件的形式记录影像数据, 然后根据 该影像数据产生待检测者的筛査影像。 [0042] The present invention also provides an image recognition method based on artificial intelligence, which is applied to a medical terminal device. As shown in FIG. 2, FIG. 2 is a flow chart of a preferred embodiment of the image recognition method based on artificial intelligence according to the present invention. In the embodiment, the image recognition method based on artificial intelligence includes the following steps: [0043] Step S21, the image acquisition module 101 acquires an image signal of the object to be detected from the image acquisition terminal 4, and is to be detected. The image signal processing is to screen the image; in the embodiment, the infrared generator 41 generates infrared light and sees the infrared light on the body part of the body to be detected; the infrared receiver 42 collects the body through the person to be tested The infrared light signal of the local organ is processed as an analog electrical signal of body tissue structure information of the body; the analog-to-digital converter 43 converts the analog electrical signal of the local organ structure information of the body of the subject to be detected by the infrared receiver 42 Processing is an image signal in the form of a digital signal; the communication port 44 transmits the image signal of the person to be detected to the image acquisition module 101. The image acquisition module 101 records the image data of the image to be detected by the digital image processing software in the form of a digital file, and then generates a screening image of the object to be detected according to the image data.
[0044] 步骤 S22, 影像匹配模块 102在预置的影像数据库中匹配与筛査影像相似度在预 置范围内的影像数据, 并将匹配出的影像数据加入到对应的影像识别报告中。 在本实施例中, 所述影像数据库 22中存储了常用的各种正常或异常的影像数据 可供参考, 在接收到筛査影像后, 影像匹配模块 102可以对筛査影像和影像数据 库中的影像数据进行相似度匹配。 当相似度在预设范围内吋, 获取影像数据库 中的相似影像数据作为该筛査影像对应的影像数据, 预设范围可以根据乳房相 关部位自定义设置, 例如设置为大于 80%。 影像匹配模块 102在匹配到筛査影像 对应的影像数据后, 根据该影像数据加入到对应的影像识别报告中。 所述影像 识别报告不仅包括筛査影像的影像识别结果, 还包括该筛査影像的影像数据, 以供医生和待检査者参考。  [0044] Step S22: The image matching module 102 matches the image data in the preset image database with the image similarity within the preset range, and adds the matched image data to the corresponding image recognition report. In this embodiment, the image database 22 stores various commonly used normal or abnormal image data for reference. After receiving the screening image, the image matching module 102 can perform screening on the image and image database. The image data is similarly matched. When the similarity is within the preset range, the similar image data in the image database is acquired as the image data corresponding to the screening image, and the preset range may be customized according to the breast related portion, for example, set to be greater than 80%. After matching the image data corresponding to the screening image, the image matching module 102 adds the image data according to the image data to the corresponding image recognition report. The image recognition report includes not only the image recognition result of the screening image but also the image data of the screening image for reference by the doctor and the examinee.
[0045] 步骤 S23, 影像获取模块 101从医疗终端设备的输入单元 11接收影像识别指令。  [0045] Step S23, the image acquisition module 101 receives an image recognition instruction from the input unit 11 of the medical terminal device.
在本实施例中, 在识别筛査影像吋, 医生从输入单元 11输入检査身体局部器官 健康状况的影像识别指令。  In the present embodiment, after the screening image is recognized, the doctor inputs an image recognition command for checking the health condition of the body part from the input unit 11.
[0046] 步骤 S24, 影像识别模块 103根据影像识别指令在指令识别库 21中匹配与影像识 别指令对应的文字作为影像识别结果。 在本实施例中, 所述影像识别指令可以 为第一识别标志、 第二识别标志或第三识别标志; 所述影像识别结果可以为正 常的影像识别结果、 参考的影像识别结果或异常的影像识别结果。 具体地, 如 所述影像识别指令中包括预置的第一识别标志, 该第一识别标志作为判断影像 识别结果是否为正常的指示标志, 即当影像识别指令中包括该第一识别标志吋[0046] Step S24, the image recognition module 103 matches the character corresponding to the image recognition instruction in the command recognition library 21 as the image recognition result according to the image recognition instruction. In this embodiment, the image recognition instruction may be a first identification mark, a second identification mark or a third identification mark; the image recognition result may be a normal image recognition result, a reference image recognition result, or an abnormal image. Identify the results. Specifically, such as The image recognition instruction includes a preset first identification mark, and the first identification mark is used as an indicator for determining whether the image recognition result is normal, that is, the first identification mark is included in the image recognition instruction.
, 影像识别模块 103判断筛査影像的影像识别结果为正常, 该第一识别标志的内 容通常选择为异于相关的医学术语和放射学术语的词语。 例如, 当影像识别指 令包括 "点击 +身体局部器官", 则表明筛査影像的影像识别结果为正常, 此吋, 可在指令识别库 21中匹配与身体局部器官健康正常对应的文字, 例如匹配"身体 局部器官未见异常"作为正常的影像识别结果。 如所述影像识别指令中包括预置 的第二识别标志, 该第二识别标志作为判断影像识别结果是否为参考的影像识 别结果的指示标志, 即当影像识别指令中包括该第二识别标志吋, 表示此吋需 匹配与筛査影像对应的参考的影像识别结果, 影像识别模块 103根据第二识别标 志在指令识别库 21中匹配与筛査影像对应的文字作为参考的影像识别结果。 第 二识别标志的内容可设置为 "参考 "等可以明显确定其指示的影像识别结果为参考 的影像识别结果的词语。 例如, 当影像识别指令为"参考", 则在指令识别库 21中 匹配与影像识别报告的结论对应的文字, 将该文字作为参考的影像识别结果。 如所述影像识别指令第三识别标志, 则影像识别模块 103可判断影像识别结果不 是正常的影像识别结果, 并根据第三识别标志在指令识别库 21中匹配与其对应 的文字。 此吋, 如匹配到的第三识别标志对应的文字与对筛査影像的影像识别 结果无关, 则表明接收到的影像识别指令无效; 相反, 则表明影像识别指令对 应的影像识别结果为异常的影像识别结果。 例如, 识别出的影像识别指令为"乳 房两侧可见数个软组织密度灶, 形态与身体局部器官相符", 则在指令识别库 21 中匹配相应的文字, 将该文字作为异常的影像识别结果。 The image recognition module 103 determines that the image recognition result of the screening image is normal, and the content of the first identification mark is generally selected as a word different from related medical terms and radiological terms. For example, when the image recognition instruction includes "click + body part organ", it indicates that the image recognition result of the screening image is normal, and thus, the instruction recognition library 21 can match the text corresponding to the health of the body part organ, for example, matching. "There is no abnormality in the local organs of the body" as a result of normal image recognition. The image recognition instruction includes a preset second identification mark, and the second identification mark is used as an indicator for determining whether the image recognition result is a reference image recognition result, that is, when the image recognition instruction includes the second identification mark. The image recognition module 103 needs to match the image recognition result corresponding to the screening image, and the image recognition module 103 matches the image corresponding to the screening image in the instruction recognition library 21 as the reference image recognition result according to the second identification flag. The content of the second identification mark can be set to a word such as "reference" which can clearly determine the image recognition result whose indication is the reference image recognition result. For example, when the image recognition command is "reference", the character corresponding to the conclusion of the image recognition report is matched in the command recognition library 21, and the character is used as a reference image recognition result. If the image recognition instruction is the third identification mark, the image recognition module 103 may determine that the image recognition result is not a normal image recognition result, and match the corresponding text in the instruction recognition library 21 according to the third identification mark. In this case, if the matching text corresponding to the third identification mark has nothing to do with the image recognition result of the screening image, it indicates that the received image recognition instruction is invalid; on the contrary, it indicates that the image recognition result corresponding to the image recognition instruction is abnormal. Image recognition results. For example, if the recognized image recognition command is "a number of soft tissue densities visible on both sides of the breast, and the morphology is consistent with the body part organs", the corresponding recognition text is matched in the instruction recognition library 21, and the text is used as an abnormal image recognition result.
[0047] 在本实施例中, 影像识别模块 103如在指令识别库 21中未匹配出与影像识别指 令对应的影像识别结果, 则表明该指令识别库 21中未存储有相应的文字, 此吋 , 医生可通过输入单元 11输入相应的影像识别结果至影像识别报告中, 影像识 别模块 103则将输入的影像识别结果添加至指令识别库 21中, 以备在下次接收到 相同或相似的影像识别指令吋, 从指令识别库 21中匹配对应的影像识别结果。  In the embodiment, if the image recognition module 103 does not match the image recognition result corresponding to the image recognition instruction in the instruction recognition library 21, it indicates that the corresponding file is not stored in the instruction recognition library 21, and The doctor can input the corresponding image recognition result into the image recognition report through the input unit 11, and the image recognition module 103 adds the input image recognition result to the instruction recognition library 21, so as to receive the same or similar image recognition next time. The command 匹配, the corresponding image recognition result is matched from the command recognition library 21.
[0048] 步骤 S25, 结果标示模块 104对影像识别报告中的正常的影像识别结果、 异常的 影像识别结果或参考影像识别结果进行标识, 以预置的显示方式在显示单元 15 显示所述影像识别报告中的正常的影像识别结果、 异常的影像识别结果或参考 影像识别结果。 具体地, 结果标示模块 104根据影像识别结果是正常还是异常对 正常的影像识别结果和异常的影像识别结果进行不同的标识, 同吋可以将参考 结果标识为能够与正常或异常的影像识别结果区分的其他标识, 如将不同的影 像识别结果标记为不同的字体或不同的颜色, 以便在显示吋, 以预置的显示方 式显示单元 15进行显示, 例如, 对异常的影像识别结果的文字内容以加粗形式 显示或进行突出显示。 [0048] Step S25, the result indication module 104 identifies the normal image recognition result, the abnormal image recognition result or the reference image recognition result in the image recognition report, and displays the preset display mode on the display unit 15 A normal image recognition result, an abnormal image recognition result, or a reference image recognition result in the image recognition report is displayed. Specifically, the result indication module 104 performs different identification on the normal image recognition result and the abnormal image recognition result according to whether the image recognition result is normal or abnormal, and the reference result can be identified as being distinguishable from the normal or abnormal image recognition result. Other identifiers, such as marking different image recognition results as different fonts or different colors, so that after display, the display unit 15 displays the display in a preset manner, for example, the text content of the abnormal image recognition result is Displayed in bold or highlighted.
[0049] 在本实施例中, 如影像识别报告中的影像识别结果为正常的影像识别结果, 则 可以在匹配到代表影像识别结果为正常的识别模版后, 对该识别模版对应的文 字内容标识为蓝色字体, 并正常显示; 如影像识别报告中的影像识别结果为异 常的影像识别结果, 则可以在匹配到异常的影像识别结果对应的文字后, 将该 文字内容标识为红色字体, 并在显示吋将该红色字体的文字内容以加粗形式显 示或进行突出显示, 以提醒待检査者注意。 在生成影像识别报告吋, 对影像识 别报告中的正常的影像识别结果或异常的影像识别结果进行不同的标识, 并以 预置的显示方式显示正常的影像识别结果或异常的影像识别结果, 使得影像识 别报告显示更为清晰, 方便医生和待检査者阅读。  [0049] In this embodiment, if the image recognition result in the image recognition report is a normal image recognition result, the text content identifier corresponding to the recognition template may be matched after matching the recognition template representing that the image recognition result is normal. It is a blue font and is displayed normally; if the image recognition result in the image recognition report is an abnormal image recognition result, the text content may be identified as a red font after matching the text corresponding to the abnormal image recognition result, and In the display, the text content of the red font is displayed in bold or highlighted to remind the examinee to pay attention. After the image recognition report is generated, the normal image recognition result or the abnormal image recognition result in the image recognition report is differently identified, and the normal image recognition result or the abnormal image recognition result is displayed in a preset display manner, so that The image recognition report is more clear and easy for doctors and examiners to read.
[0050] 本发明所述身体局部器官筛査智能识别系统及方法, 能够在医生在进行筛査影 像识别的过程中, 根据医生输入简单的影像识别指令在预置的指令识别库中匹 配与影像识别指令对应的影像识别结果, 在预置的影像数据库中匹配与筛査影 像相似度在预置范围内的影像数据, 以及根据影像识别结果及影像数据生成影 像识别报告, 由于医生只需输入简单的影像识别指令就能得到筛査影像的识别 结果, 而无需医生输入繁琐的检査结论, 从而简化了身体局部器官影像识别的 操作, 提高了身体局部器官影像识别的效率和准确性, 从而辅助医生提高对身 体局部器官疾病检测与筛査的效率及准确性, 提高身体局部器官筛査的社会效 率。  [0050] The body part organ screening intelligent identification system and method of the present invention can match and image in a preset instruction recognition library according to a doctor inputting a simple image recognition instruction during a process of screening image recognition by a doctor. Identifying the image recognition result corresponding to the instruction, matching the image data in the preset image database with the image similarity within the preset range, and generating the image recognition report according to the image recognition result and the image data, since the doctor only needs to input the simple The image recognition command can obtain the recognition result of the screening image without the doctor inputting the cumbersome examination conclusion, thereby simplifying the operation of the image recognition of the body part organ, improving the efficiency and accuracy of the image recognition of the body part organ, thereby assisting Doctors improve the efficiency and accuracy of detection and screening of body parts and diseases, and improve the social efficiency of body partal organ screening.
[0051] 以上仅为本发明的优选实施例, 并非因此限制本发明的专利范围, 凡是利用本 发明说明书及附图内容所作的等效结构或等效功能变换, 或直接或间接运用在 其他相关的技术领域, 均同理包括在本发明的专利保护范围内。 工业实用性 The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the present invention, and the equivalent structure or equivalent function transformations made by the description of the present invention and the contents of the drawings may be directly or indirectly applied to other related aspects. The technical field is equally included in the scope of patent protection of the present invention. Industrial applicability
相较于现有技术, 本发明所述基于人工智能的影像识别系统及方法能够在医生 在进行筛査影像识别的过程中, 根据医生输入的影像识别指令在预置的指令识 别库中匹配与影像识别指令对应的影像识别结果, 在预置的影像数据库中匹配 与筛査影像相似度在预置范围内的影像数据, 以及根据影像识别结果及影像数 据生成影像识别报告。 由于医生只需输入简单的影像识别指令就能得到筛査影 像的识别结果, 而无需医生输入繁琐的检査结论, 从而简化了身体局部器官影 像识别的操作, 提高了身体局部器官影像识别的效率和准确性, 辅助医生提高 对身体局部器官疾病检测与筛査的效率及准确性, 提高身体局部器官筛査的社 会效率。  Compared with the prior art, the artificial intelligence-based image recognition system and method of the present invention can match and match the image recognition instruction input by the doctor in the preset instruction recognition library during the process of screening image recognition by the doctor. The image recognition result corresponding to the image recognition instruction matches the image data in the preset image database with the image similarity within the preset range, and generates the image recognition report according to the image recognition result and the image data. Since the doctor only needs to input a simple image recognition command, the recognition result of the screening image can be obtained without the doctor inputting the cumbersome examination conclusion, thereby simplifying the operation of the image recognition of the body part organ and improving the efficiency of image recognition of the body part organ. And accuracy, assist doctors to improve the efficiency and accuracy of body part disease detection and screening, and improve the social efficiency of body partal organ screening.

Claims

权利要求书 Claim
[权利要求 1] 一种基于人工智能的影像识别系统, 应用于医疗终端设备中, 该医疗 终端设备通过通信网络连接至影像采集终端和医疗信息平台, 其特征 在于, 所述基于人工智能的影像识别系统包括: 影像获取模块, 用于 从影像采集终端获取待检测者的影像信号, 将待检测者的影像信号处 理为筛査影像, 以及从医疗终端设备的输入单元接收影像识别指令; 影像匹配模块, 用于在医疗信息平台的影像数据库中匹配与筛査影像 相似度在预置范围内的影像数据; 影像识别模块, 用于根据影像识别 指令在医疗信息平台的指令识别库中匹配与影像识别指令对应的文字 作为影像识别结果。  [Claim 1] An artificial intelligence-based image recognition system is applied to a medical terminal device, and the medical terminal device is connected to an image acquisition terminal and a medical information platform through a communication network, wherein the artificial intelligence-based image is The identification system includes: an image acquisition module, configured to acquire an image signal of the object to be detected from the image capturing terminal, process the image signal of the object to be detected as a screening image, and receive an image recognition instruction from an input unit of the medical terminal device; a module, configured to match and image image data whose image similarity is within a preset range in an image database of the medical information platform; and an image recognition module, configured to match and image in the instruction recognition library of the medical information platform according to the image recognition instruction The text corresponding to the recognition command is used as the image recognition result.
[权利要求 2] 如权利要求 1所述的基于人工智能的影像识别系统, 其特征在于, 所 述影像采集终端包括红外发生器、 红外接收器、 模数转换器以及通信 端口, 其中: 所述红外发生器用于产生红外光并将红外光透视到待检 测者的身体局部器官上; 所述红外接收器用于采集透过待检测者的身 体局部器官的红外光信号处理为包含待检测者的身体局部器官组织结 构信息的模拟电信号; 所述模数转换器用于将包含待检测者的身体局 部器官组织结构信息的模拟电信号模数转换为数字信号形式的影像信 号; 所述通信端口用于将待检测者的影像信号发送至所述医疗终端设 备。  2. The artificial intelligence-based image recognition system according to claim 1, wherein the image collection terminal comprises an infrared generator, an infrared receiver, an analog to digital converter, and a communication port, wherein: The infrared generator is configured to generate infrared light and fluoresce the infrared light to a body part organ of the body to be detected; the infrared receiver is configured to collect infrared light signals transmitted through the body part of the body to be detected to be processed to include the body of the person to be detected An analog electrical signal of local organ tissue structure information; the analog-to-digital converter is configured to convert an analog electrical signal containing the body tissue structure information of the body to be detected into an image signal in the form of a digital signal; the communication port is used for Sending an image signal of the person to be detected to the medical terminal device.
[权利要求 3] 如权利要求 1所述的基于人工智能的影像识别系统, 其特征在于, 所 述影像识别指令为第一识别标志、 第二识别标志或第三识别标志, 其 中: 当所述影像识别指令为第一识别标志吋, 所述影像识别模块根据 第一识别标志在指令识别库中匹配对应的文字作为正常的影像识别结 果; 当所述影像识别指令为第二识别标志吋, 所述影像识别模块根据 第二识别标志在指令识别库中匹配对应的文字作为参考的影像识别结 果; 当所述影像识别指令为第三识别标志吋, 所述影像识别模块根据 第三识别标志在指令识别库中匹配对应的文字作为异常的影像识别结 果。 The AI-based image recognition system according to claim 1, wherein the image recognition instruction is a first identification mark, a second identification mark or a third identification mark, wherein: The image recognition command is a first identification mark 吋, and the image recognition module matches the corresponding text in the instruction recognition library as a normal image recognition result according to the first identification mark; when the image recognition instruction is the second identification mark, The image recognition module matches the corresponding text in the instruction recognition library as a reference image recognition result according to the second identification mark; when the image recognition instruction is the third identification mark 吋, the image recognition module is instructed according to the third identification mark The matching text in the recognition library is used as an abnormal image recognition result.
[权利要求 4] 如权利要求 3所述的基于人工智能的影像识别系统, 其特征在于, 该 系统还包括结果标示模块, 用于对影像识别报告中的正常的影像识别 结果、 异常的影像识别结果或参考影像识别结果进行标识。 [Claim 4] The artificial intelligence-based image recognition system according to claim 3, wherein the system further comprises a result indication module, configured to perform normal image recognition results and abnormal image recognition in the image recognition report. The result is identified by reference to the image recognition result.
[权利要求 5] 如权利要求 1所述的基于人工智能的影像识别系统, 其特征在于, 当 所述指令识别库中未匹配出与所述影像识别指令对应的影像识别结果 吋, 所述影像识别模块还用于接收医生输入的影像识别结果并添加至 影像识别报告中, 并将输入的影像识别结果添加至所述指令识别库中  [Claim 5] The artificial intelligence-based image recognition system according to claim 1, wherein the image recognition result corresponding to the image recognition instruction is not matched in the instruction recognition library, the image The identification module is further configured to receive the image recognition result input by the doctor and add the image recognition result to the image recognition report, and add the input image recognition result to the instruction recognition library.
[权利要求 6] —种基于人工智能的影像识别方法, 应用于医疗终端设备中, 该医疗 终端设备通过通信网络连接至影像采集终端和医疗信息平台, 其特征 在于, 该方法包括步骤: 从影像采集终端获取待检测者的影像信号; 将待检测者的影像信号处理为筛査影像; 在医疗信息平台的影像数据 库中匹配与筛査影像相似度在预置范围内的影像数据; 从医疗终端设 备的输入单元接收影像识别指令; 根据影像识别指令在医疗信息平台 的指令识别库中匹配与影像识别指令对应的文字作为影像识别结果。 [Claim 6] An image recognition method based on artificial intelligence, which is applied to a medical terminal device, wherein the medical terminal device is connected to an image capturing terminal and a medical information platform through a communication network, wherein the method comprises the steps of: The acquisition terminal acquires the image signal of the object to be detected; processes the image signal of the object to be detected into a screening image; and matches the image data in the image database of the medical information platform with the similarity of the image in the preset range; The input unit of the device receives the image recognition instruction; and matches the text corresponding to the image recognition instruction in the instruction recognition library of the medical information platform as the image recognition result according to the image recognition instruction.
[权利要求 7] 如权利要求 6所述的基于人工智能的影像识别方法, 其特征在于, 所 述从影像采集终端获取待检测者的影像信号的步骤包括: 利用影像采 集终端的红外发生器产生红外光并将红外光透视到待检测者的身体局 部器官上; 通过影像采集终端的红外接收器采集透过待检测者的身体 局部器官的红外光信号处理为包含待检测者的身体局部器官组织结构 信息的模拟电信号; 利用影像采集终端的模数转换器将包含待检测者 的身体局部器官组织结构信息的模拟电信号模数转换为数字信号形式 的影像信号; 通过影像采集终端的通信端口用于将待检测者的影像信 号发送至所述医疗终端设备。  The method for recognizing an image based on artificial intelligence according to claim 6, wherein the step of acquiring an image signal of the object to be detected from the image capturing terminal comprises: generating by using an infrared generator of the image capturing terminal Infrared light and infrared light is incident on the body part of the body to be detected; infrared light signal collected through the body part of the body of the subject to be detected by the infrared receiver of the image capturing terminal is processed into a body part organ tissue containing the body to be detected Analog electrical signal of structural information; using an analog-to-digital converter of the image capturing terminal to convert an analog electrical signal modulus containing the body tissue structure information of the body to be detected into an image signal in the form of a digital signal; a communication port through the image capturing terminal And configured to send an image signal of the person to be detected to the medical terminal device.
[权利要求 8] 如权利要求 6所述的基于人工智能的影像识别方法, 其特征在于, 所 述影像识别指令为第一识别标志、 第二识别标志或第三识别标志, 所 述根据影像识别指令在医疗信息平台的指令识别库中匹配与影像识别 指令对应的文字作为影像识别结果的步骤包括: 当所述影像识别指令 为第一识别标志吋, 根据第一识别标志块在指令识别库中匹配对应的 文字作为正常的影像识别结果; 当所述影像识别指令为第二识别标志 吋, 根据第二识别标志在指令识别库中匹配对应的文字作为参考的影 像识别结果; 当所述影像识别指令为第三识别标志吋, 根据第三识别 标志在指令识别库中匹配对应的文字作为异常的影像识别结果。 The method for recognizing an image based on artificial intelligence according to claim 6, wherein the image recognition command is a first identification mark, a second identification mark or a third identification mark, and the image recognition is performed according to the image. The step of the instruction matching the text corresponding to the image recognition instruction in the instruction recognition library of the medical information platform as the image recognition result includes: when the image recognition instruction a first identification mark 吋, matching the corresponding text in the instruction recognition library according to the first identification flag block as a normal image recognition result; when the image recognition instruction is the second identification mark 吋, identifying the instruction according to the second identification mark The image recognition result is matched with the corresponding text as the reference image recognition result; when the image recognition instruction is the third identification mark 吋, the corresponding recognition text is matched in the instruction recognition library according to the third identification mark as an abnormal image recognition result.
[权利要求 9] 如权利要求 8所述的基于人工智能的影像识别方法, 其特征在于, 该 方法还包括如下步骤: 对影像识别报告中的正常的影像识别结果、 异 常的影像识别结果或参考影像识别结果进行标识。  The method for recognizing an artificial intelligence based image according to claim 8, further comprising the steps of: normal image recognition result in the image recognition report, abnormal image recognition result or reference The image recognition result is identified.
[权利要求 10] 如权利要求 6所述的基于人工智能的影像识别方法, 其特征在于, 该 方法还包括如下步骤: 当所述指令识别库中未匹配出与所述影像识别 指令对应的影像识别结果吋, 接收医生输入的影像识别结果并添加至 影像识别报告中, 并将输入的影像识别结果添加至所述指令识别库中  The method of claim 6, wherein the method further comprises the following steps:: the image corresponding to the image recognition instruction is not matched in the instruction recognition library; After the recognition result, the image recognition result input by the doctor is received and added to the image recognition report, and the input image recognition result is added to the instruction recognition library.
PCT/CN2017/110477 2017-09-11 2017-11-10 Artificial intelligence-based image recognition system and method WO2019047366A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710812910.3A CN107506604A (en) 2017-09-11 2017-09-11 Image recognition system and method based on artificial intelligence
CN201710812910.3 2017-09-11

Publications (1)

Publication Number Publication Date
WO2019047366A1 true WO2019047366A1 (en) 2019-03-14

Family

ID=60695360

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/110477 WO2019047366A1 (en) 2017-09-11 2017-11-10 Artificial intelligence-based image recognition system and method

Country Status (2)

Country Link
CN (1) CN107506604A (en)
WO (1) WO2019047366A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109346157A (en) * 2018-09-29 2019-02-15 中关云(北京)科技有限公司 A kind of remote machine image identifying and diagnosing system and method
CN109754867A (en) * 2018-12-18 2019-05-14 杭州深睿博联科技有限公司 For the processing method and processing device of medical imaging information, server, system
CN109935294A (en) * 2019-02-19 2019-06-25 广州视源电子科技股份有限公司 A kind of text report output method, device, storage medium and terminal
CN111724893B (en) * 2019-03-20 2024-04-09 宏碁股份有限公司 Medical image identification device and medical image identification method
CN110459306A (en) * 2019-08-16 2019-11-15 杭州依图医疗技术有限公司 Medical image display methods and display equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103744926A (en) * 2013-12-30 2014-04-23 邢英琦 Method and system for generating hieroglyph combination medical report
CN104462763A (en) * 2014-11-04 2015-03-25 深圳市前海安测信息技术有限公司 Medical image interpretation method and device based on intelligent speech recognition
CN107049249A (en) * 2017-03-25 2017-08-18 深圳市前海安测信息技术有限公司 Mammary gland examination image intelligent identifying system and method
CN107049248A (en) * 2017-03-25 2017-08-18 深圳市前海安测信息技术有限公司 Mammary gland examination image analysis system and method based on medical cloud platform
WO2017152121A1 (en) * 2016-03-03 2017-09-08 Geisinger Health System System and method for automated analysis in medical imaging applications

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103744926A (en) * 2013-12-30 2014-04-23 邢英琦 Method and system for generating hieroglyph combination medical report
CN104462763A (en) * 2014-11-04 2015-03-25 深圳市前海安测信息技术有限公司 Medical image interpretation method and device based on intelligent speech recognition
WO2017152121A1 (en) * 2016-03-03 2017-09-08 Geisinger Health System System and method for automated analysis in medical imaging applications
CN107049249A (en) * 2017-03-25 2017-08-18 深圳市前海安测信息技术有限公司 Mammary gland examination image intelligent identifying system and method
CN107049248A (en) * 2017-03-25 2017-08-18 深圳市前海安测信息技术有限公司 Mammary gland examination image analysis system and method based on medical cloud platform

Also Published As

Publication number Publication date
CN107506604A (en) 2017-12-22

Similar Documents

Publication Publication Date Title
WO2019047366A1 (en) Artificial intelligence-based image recognition system and method
US20110245623A1 (en) Medical Diagnosis Using Community Information
WO2019047365A1 (en) Medical cloud platform-based image big data analysis system and method
CN103530491B (en) Apparatus and method for generating audit report
WO2013089072A1 (en) Information management device, information management method, information management system, stethoscope, information management program, measurement system, control program and recording medium
TWI810498B (en) Liver Tumor Intelligent Analysis Device
WO2018176717A1 (en) Medical cloud platform-based breast screening image analysis system and method
CN113240662B (en) Endoscope inspection auxiliary system based on artificial intelligence
CN110584618A (en) Infectious disease machine recognition system based on artificial intelligence
CN110246135B (en) Follicle monitoring method, device, system and storage medium
CN111274400A (en) Construction method, device, equipment and storage medium of medical term system
JP2009045121A (en) Medical image processing system, medical image processing method, and program
WO2018176718A1 (en) Intelligent identification system and method for mammary gland screening image
CN104732086A (en) Computer-assisted disease detection system based on cloud computing
CN109117871A (en) A kind of system and method that the pernicious probability of pulmonary lesions is obtained by deep learning
CN105512473A (en) Intelligent identification method and device of colposcope images
CN111753831A (en) Image analysis method and device, image acquisition equipment and storage medium
CN112002407A (en) Breast cancer diagnosis device and method based on ultrasonic video
WO2017193581A1 (en) Automatic processing system and method for mammary gland screening image
WO2022068490A1 (en) Human body bioelectric detection device, detection system and detection method
JP2011081648A (en) Pathological diagnosis support device and pathological diagnosis support system
CN108877901A (en) A kind of Chinese Medicine Diagnoses System
CN111192679B (en) Method, device and storage medium for processing image data abnormality
JP2003033327A (en) Diagnostic support system via imaging information
CN101919709B (en) B ultrasonic all-in-one machine of pregnancy management and reproductive health services

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 30.09.2020)

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17924172

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17924172

Country of ref document: EP

Kind code of ref document: A1