WO2022064998A1 - Dispositif d'aide à l'examen, procédé d'aide à l'examen, et programme d'aide à l'examen - Google Patents

Dispositif d'aide à l'examen, procédé d'aide à l'examen, et programme d'aide à l'examen Download PDF

Info

Publication number
WO2022064998A1
WO2022064998A1 PCT/JP2021/032384 JP2021032384W WO2022064998A1 WO 2022064998 A1 WO2022064998 A1 WO 2022064998A1 JP 2021032384 W JP2021032384 W JP 2021032384W WO 2022064998 A1 WO2022064998 A1 WO 2022064998A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
monitor
unit
inspection support
support device
Prior art date
Application number
PCT/JP2021/032384
Other languages
English (en)
Japanese (ja)
Inventor
正晃 伊與田
Original Assignee
株式会社Ａｉメディカルサービス
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社Ａｉメディカルサービス filed Critical 株式会社Ａｉメディカルサービス
Publication of WO2022064998A1 publication Critical patent/WO2022064998A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof

Definitions

  • the present invention relates to an inspection support device, an inspection support method, and an inspection support program.
  • the system in which the examination support device subsequently captures and analyzes the internal image of the subject captured by the endoscope system is not immediate.
  • the doctor who diagnoses the subject wants to know the analysis result immediately in conjunction with the imaging of the inside of the body by the endoscopic system. Therefore, it is conceivable to connect the inspection support device to the endoscope system and have the inspection support device analyze the internal image captured by the endoscope system in almost real time. In this case, the doctor will perform the examination while visually observing the monitor provided in the endoscope system and the monitor provided in the examination support device. If the monitor provided in the inspection support device always displays the analysis result in a certain display mode, the visibility may be significantly inferior depending on the positional relationship between the two monitors. However, the menu operation for specifying the display layout in advance is troublesome and may increase the time required for inspection.
  • the present invention has been made to solve such a problem, and in relation to the system monitor provided in the endoscope system, the present invention automatically displays a display mode for displaying inspection information and the like on a display monitor in an easy-to-see manner. It provides an inspection support device or the like for determining.
  • the inspection support device is an inspection support device used by connecting to an endoscope system including a camera unit inserted into the body of a subject, and is imaged by the camera unit.
  • An acquisition unit that acquires captured images, a display monitor for displaying inspection information related to the captured image and internal examination, and a display monitor and endoscope that are reflected in the captured image acquired by the acquisition unit prior to the execution of the internal examination.
  • An analysis unit that analyzes the interrelationships of the system monitors attached to the system, a determination unit that determines the display mode of the display monitor based on the interrelationships analyzed by the analysis unit, and a display monitor display according to the display mode determined by the determination unit. It is provided with a display control unit for controlling.
  • the inspection support method is an inspection support method using an inspection support device used by connecting to an endoscope system including a camera unit inserted into the body of the subject.
  • the inspection support program is an inspection support program for controlling an inspection support device used by connecting to an endoscope system including a camera unit inserted into the body of a subject.
  • the computer is made to execute a display control step for controlling the display of the display monitor according to the display mode determined in the step.
  • FIG. 1 is a diagram showing a state of endoscopy using the endoscope system 200 and the inspection device 100 according to the present embodiment.
  • Both the endoscope system 200 and the inspection device 100 are installed in the examination space.
  • the endoscope system 200 includes a camera unit 210, which is inserted from the oral cavity of a lying subject into the stomach and transmits an image signal of an image of the inside of the stomach to the system body as shown in the figure. do.
  • the insertion of the camera unit 210 into the stomach and the imaging operation are performed by a doctor.
  • the endoscope system 200 includes, for example, a system monitor 220 composed of a liquid crystal panel, processes an image signal sent from the camera unit 210, and displays it on the system monitor 220 as a visible captured image 221. Further, the endoscope system 200 displays the inspection information 222 including the subject information and the camera information of the camera unit 210 on the system monitor 220.
  • the inspection device 100 is connected to the endoscope system 200 by a connection cable 250.
  • the endoscope system 200 also transmits a display signal to be transmitted to the system monitor 220 to the inspection device 100 via the connection cable 250.
  • the inspection device 100 includes, for example, a display monitor 120 composed of a liquid crystal panel, and extracts an image signal corresponding to the captured image 221 from the display signal sent from the endoscope system 200 to obtain a visible captured image 121. It is displayed on the display monitor 120. Further, the inspection device 100 generates image data of the captured image 121, analyzes it, outputs diagnostic assistance information 122, and displays it on the display monitor 120.
  • the inspection device 100 displays the captured image 121 and the diagnostic assistance information 122 as soon as the display signal is received from the endoscope system 200 or in synchronization with the timing when the operation of the camera unit 210 by the doctor is estimated. That is, the doctor can sequentially confirm the captured image 121 and the diagnostic assistance information 122 in synchronization with the progress of the examination.
  • the system monitor 220 of the endoscope system 200 and the display monitor 120 of the inspection device 100 are juxtaposed in the examination space. .. Therefore, the doctor will proceed with the examination while visually observing the two monitors while operating the camera unit 210 inserted into the stomach of the subject.
  • the two monitors may be arranged in various ways depending on the convenience of the examination space and the like, and the amount of movement of the line of sight between the two monitors may vary depending on the arrangement relationship between the two monitors and the display mode of the display monitor 120. The visibility of the displayed information may be significantly reduced, such as when the size is increased.
  • the inspection device 100 in the present embodiment analyzes the mutual relationship between the display monitor 120 provided by the inspection device 100 and the system monitor 220 attached to the endoscope system 200, and automatically optimizes the display mode in the display monitor 120. ..
  • the configuration of the inspection device 100, the processing procedure, the determination of the display mode, and the like will be sequentially described.
  • FIG. 2 is a hardware configuration diagram of the inspection device 100.
  • the inspection device 100 is mainly composed of an arithmetic processing unit 110, a display monitor 120, an input / output interface 130, an input device 140, and a storage unit 150.
  • the arithmetic processing unit 110 is a processor (CPU: Central Processing Unit) that controls the inspection device 100 and executes a program.
  • the processor may be configured to cooperate with an arithmetic processing chip such as an ASIC (Application Specific Integrated Circuit) or a GPU (Graphics Processing Unit).
  • the arithmetic processing unit 110 reads out the inspection support program stored in the storage unit 150 and executes various processes related to inspection support.
  • the display monitor 120 is a monitor provided with, for example, a liquid crystal panel, and visually displays the captured image 121 and the diagnostic assistance information 122.
  • the input / output interface 130 is a connection interface for exchanging information with an external device, including a connector for connecting the connection cable 250.
  • the input / output interface 130 includes, for example, a LAN unit, and takes in the update data of the inspection support program and the analysis neural network 151 described later from an external device and delivers it to the arithmetic processing unit 110.
  • the input device 140 is, for example, a touch panel superimposed on a keyboard, a mouse, or a display monitor 120, and a doctor or an assistant operates these to change the settings of the inspection device 100 or input information necessary for the inspection. Or something.
  • the storage unit 150 is a non-volatile storage medium, and is composed of, for example, an HDD (Hard Disk Drive).
  • the storage unit 150 can store various parameter values, functions, display element data, look-up tables, etc. used for control and calculation, in addition to a program that executes control and processing of the inspection device 100.
  • the storage unit 150 stores, in particular, the neural network 151 for analysis.
  • the neural network 151 for analysis is a trained model that calculates the probability that a lesion exists in the image when the image data captured by the camera unit 210 is input.
  • the storage unit 150 may be composed of a plurality of hardware.
  • the storage medium for storing the program and the storage medium for storing the analysis neural network 151 may be composed of different hardware.
  • the arithmetic processing unit 110 also plays a role as a functional arithmetic unit that executes various operations according to the processing instructed by the inspection support program.
  • the arithmetic processing unit 110 can function as an acquisition unit 111, an analysis unit 112, a determination unit 113, a diagnostic assistance unit 114, and a display control unit 115.
  • the acquisition unit 111 reproduces and acquires the image captured by the camera unit 210 as the captured image 121 by processing the display signal sent from the endoscope system 200.
  • the analysis unit 112 analyzes the interrelationship between the display monitor 120 and the system monitor 220 reflected in the captured image 121 acquired by the acquisition unit 111 prior to the execution of the examination of the stomach of the subject.
  • the determination unit 113 determines the display mode of the display monitor 120 based on the interrelationship analyzed by the analysis unit 112.
  • the diagnostic assistance unit 114 inputs the captured image 121 acquired by the acquisition unit 111 during the execution of the gastric examination into the analytical neural network 151 read from the storage unit 150, calculates the probability of the presence of a lesion, and assists the diagnosis. Generate information.
  • the display control unit 115 controls the display of the display monitor 120 according to the display mode determined by the determination unit 113.
  • FIG. 3 is a diagram showing a state in which the camera unit 210 of the endoscope system 200 images the endoscope system 200 and the inspection device 100.
  • the doctor said that at least a part of the system monitor 220 and a part of the display monitor 120 were in the angle of view after starting the endoscope system 200 and the inspection device 100 and before starting the examination of the stomach of the subject.
  • the endoscope system 200 and the inspection device 100 are imaged so as to fit.
  • FIG. 3 shows how all of the system monitor 220 and all of the display monitor 120 are within the angle of view.
  • the image captured by the camera unit 210 is processed by the endoscope system 200 and displayed as a visible captured image 221 in a part of the display area of the system monitor 220.
  • the display control unit 115 of the inspection device 100 displays the display signal received from the endoscope system 200 on the display monitor 120 as it is in the same manner as the display mode displayed on the system monitor 220.
  • the acquisition unit 111 extracts the area of the captured image 121 from the display screen generated from the display signal.
  • the display control unit 115 superimposes and displays a frame-shaped area index 123 on the four corners of the region so that the region of the captured image 121 extracted by the acquisition unit 111 can be seen. Once the area index 123 is superimposed and displayed, the area index 123 will appear on the display monitor 120 which is reflected as a subject image in the captured image subsequently captured by the camera unit 210.
  • the image pickup by the camera unit 210 is continuously executed during this period, and the captured images are sequentially sent to the endoscope system 200 at, for example, 60 fps. Further, the endoscope system 200 sequentially generates display signals accordingly. Therefore, the display screen generated from the display signal is a frame image, and the acquisition unit 111 of the inspection device 100 extracts the region of the captured image 121 from the frame image. Specifically, by utilizing the fact that the captured image captured by the camera unit 210 changes sequentially to some extent, the difference between a plurality of frame images before and after is detected, and a region in which a change of a predetermined amount or more is detected is detected. It is determined that the area is the captured image 121.
  • the analysis unit 112 analyzes the mutual relationship between the system monitor 220 and the display monitor 120 by using the captured image 121 extracted from the frame image in this way.
  • FIG. 4 is a diagram for explaining a procedure for analyzing the mutual relationship between the system monitor 220 and the display monitor 120.
  • the acquisition unit 111 extracts and cuts out the region of the captured image 121 from the frame image, and the analysis unit 112. Hand over to.
  • the analysis unit 112 determines the display monitor area 120a and the system monitor area 220a, which are the respective areas of the display monitor 120 and the system monitor 220 reflected in the captured image 121. Specifically, both monitor areas may be determined by matching processing with a general monitor appearance image prepared in advance, or the captured image 121 is input to a trained model in which a large number of monitor images have been learned in advance. Both monitor areas may be determined.
  • the analysis unit 112 determines the area in which the area index 123 is reflected as the display monitor area 120a and the area in which the area index 123 is not reflected as the system monitor area 220a among the two areas extracted as the monitor area. ..
  • the display control unit 115 superimposes the area index 123 on the four corners of the captured image 121.
  • the area index 123 is superimposed in this way, the captured image 121 cut out from the frame image and the image of the area surrounded by the area index 123 have a substantially similar relationship, so that the display monitor area 120a by the analysis unit 112 It becomes easier to make a decision.
  • the area index 123 to be superimposed does not have to have a frame shape as in the present embodiment, and may not be an index showing the captured image 121 unless the display monitor area 120a is determined by using the similarity relationship. I do not care.
  • a large " ⁇ " mark may be superimposed on the entire display screen, or the index printed on the bezel portion of the display monitor 120 may be attached instead of superimposing the index on the display area. .. Any mode may be used as long as it is an index that can distinguish between the two monitors in the captured image 121.
  • the analysis unit 112 analyzes the mutual relationship between the display monitor 120 and the system monitor 220.
  • the positional relationship between the display monitor 120 and the system monitor 220 is analyzed.
  • the analysis unit 112 finds that the display monitor 120 is located substantially to the right of the system monitor 220 and delivers the result to the determination unit 113.
  • the coordinates of the center of gravity of each of the display monitor area 120a and the system monitor area 220a are calculated, and the vector value connecting the coordinates of the center of gravity is passed to the determination unit 113 as the analysis result of the positional relationship.
  • the determination unit 113 determines the display mode of the display monitor 120 based on the analysis result received from the analysis unit 112.
  • FIG. 5 is a diagram showing an example of a display mode determined by the determination unit 113.
  • the display control unit 115 When the determination unit 113 determines the display mode of the display element as described below, the display control unit 115 generates a display signal according to the determination and causes each display element to be displayed on the display monitor 120.
  • FIG. 5A shows a display mode when the display monitor 120 is located on the right side with respect to the system monitor 220
  • FIG. 5B shows a display mode when the display monitor 120 is located on the left side with respect to the system monitor 220. Indicates the display mode of.
  • a display mode of the display screen while the camera unit 210 is inserted into the stomach of the subject and the examination is being performed will be described.
  • the unique information is information that is not displayed on the system monitor 220 but is displayed only on the display monitor 120, and specifically, is information generated by the processing of the arithmetic processing unit 110 of the inspection device 100.
  • the display monitor 120 displays the estimated probability of the presence of a lesion in the captured image 121 calculated by the diagnostic assistance unit 114 as diagnostic assistance information.
  • the diagnostic aid information includes numerical information 122a indicating an estimated probability, title text 122b, and pie chart graphics 122c.
  • the doctor can visually recognize both monitors. It can enhance the sex. That is, it is possible to shorten the movement of the line of sight of the doctor who visually recognizes important information, which in turn contributes to the realization of a comfortable examination environment.
  • the captured image 121 displayed on the display monitor 120 may be the original image used by the diagnostic assistance unit 114 to calculate the estimation probability.
  • the display control unit 115 may display the captured image 121 as a still image for a certain period of time for displaying the diagnostic assistance information 122.
  • the display monitor 120 when the display monitor 120 is located on the left side with respect to the system monitor 220, the display area of the display monitor 120 is displaced from the center to the right side where the system monitor 220 is located. Display unique information.
  • the diagnostic assistance information 122 is displayed closer to the system monitor 220 side as unique information, and the captured image 121 is displayed at a position far from the system monitor 220.
  • the display element displayed by deviating to the side of the system monitor 220 is not limited to the diagnostic auxiliary information analyzed based on the captured image, but may be other inspection information.
  • the examination information may be, for example, an examination guide that sequentially indicates a portion in the stomach to be imaged by a sample image or the like.
  • the information is not limited to the inspection information, and may be unique information generated by the inspection device 100 that is not displayed on the system monitor 220. For example, it may be the subject information input by the input device 140. It may be configured so that the doctor who is the user can select in advance which display element is shifted to the system monitor 220 side for display.
  • FIG. 6 is a diagram showing another example of the display mode determined by the determination unit 113. Specifically, the display mode when the display monitor 120 is located above the system monitor 220 is shown.
  • the display mode of FIG. 6 is a display mode in which the camera unit 210 is inserted into the stomach of the subject and the examination is being performed, as in the case of FIGS. 5 (A) and 5 (B). , The displayed display elements are the same.
  • the diagnostic assistance information 122 is displayed closer to the system monitor 220 side as unique information, and the captured image 121 is displayed at a position far from the system monitor 220.
  • the diagnostic assistance information 122 can be displaced toward the system monitor 220, so that the movement of the doctor's line of sight is shortened. be able to.
  • FIG. 7 is a diagram showing another example of the display mode determined by the determination unit 113. Specifically, the display mode when the display monitor 120 is located on the upper left side with respect to the system monitor 220 is shown.
  • the display mode of FIG. 7 is a display mode in which the camera unit 210 is inserted into the stomach of the subject and the examination is being performed, as in the case of FIGS. 5 (A) and 5 (B). , The displayed display elements are the same.
  • the display monitor 120 when the display monitor 120 is located on the upper left side of the system monitor 220, it is located in the lower right side of the display area of the display monitor 120 where the system monitor 220 is located.
  • Display unique information Here, the diagnostic assistance information 122 is displayed closer to the system monitor 220 side as unique information, and the captured image 121 is displayed at a position far from the system monitor 220.
  • the numerical information 122a which is more important information, is displayed closer to the system monitor 220 side.
  • the movement of the doctor's line of sight can be further shortened.
  • other elements may be displayed at the reference position and only the numerical information 122a may be shifted to the system monitor 220 side and displayed.
  • the display mode in which only the numerical information 122a is displaced toward the system monitor 220 is not limited to the case where the positional relationship between the two monitors is in the diagonal direction, but also when they are arranged in the vertical and horizontal directions as shown in FIGS. 5 and 6. Can be adopted.
  • FIG. 8 is a diagram showing another example of the display mode determined by the determination unit 113.
  • the display monitor 120 and the system monitor 220 are monitors having substantially the same size as each other and are arranged at positions approximately equidistant from the doctor.
  • the display monitor 120 and the system monitor 220 may be different in size from each other, or may be arranged so as to be displaced in the depth direction.
  • the example of the display mode shown in FIG. 8 is similar to FIG. 5 (A) in that the display monitor 120 is located on the right side of the system monitor 220, but the display monitor 120 is larger than the system monitor 220 for the doctor. This is the case when it is placed at a distant position.
  • the analysis unit 112 analyzes from the captured image 121 that the display monitor area 120a is on the right side of the system monitor area 220a and that the display monitor area 120a is smaller than the system monitor area 220a, the analysis unit 112 determines the result. Hand over to. From the result, the determination unit 113 determines that the display monitor 120 is located on the right side of the system monitor 220, the display monitor 120 is located farther than the system monitor 220, or the display monitor 120 is located closer to the system monitor 220. Recognizing that it is small, the display mode shown in FIG. 8 is determined.
  • the ratio of the diagnostic assistance information 122 to the display area is increased as compared with the case where the display monitors 120 having the same size as the system monitor 220 are arranged adjacent to each other, and the enlarged diagnostic assistance information 122 is provided.
  • the display mode is determined so that the system monitor 220 is displaced to the left side where it is located.
  • the layout of the internal elements constituting the diagnostic auxiliary information 122 may be changed. For example, as shown in FIG. 8, the size of the title text 122b may not be changed and the position may be shifted to the system monitor 220 side.
  • the diagnostic assistance information 122 may be displayed so as to cover a part of the captured image 121 displayed at a position far from the system monitor 220.
  • the determination unit 113 indicates that the display monitor 120 is located closer to the system monitor 220, or the display monitor 120 is larger than the system monitor 220. If it is recognized, the display mode may be determined so that the ratio of the diagnostic aid information 122 to the display area is reduced. In this case, the unique information may be further displayed in the generated margin.
  • FIG. 9 is a diagram showing still another example of the display mode determined by the determination unit 113.
  • the diagnostic auxiliary information 122 is displaced toward the system monitor 220 as the unique information, but in the example of FIG. 9, the unique information is superimposed on the captured image 121. This is a display mode.
  • the analytical neural network 151 can also identify the suspected lesion site, the superimposed information 121a is superimposed on that site of the captured image 121.
  • the captured image 121 on which the superimposed information 121a is superimposed is displaced toward the system monitor 220 side.
  • the display monitor 120 since the display monitor 120 is located on the right side with respect to the system monitor 220, the captured image 121 in which the superimposed information 121a is superimposed on the region shifted to the left from the center in the display region of the display monitor 120. Is displayed.
  • the diagnostic auxiliary information 122 displayed at a position far from the system monitor 220 is also unique information, but which unique information is shifted to the system monitor 220 side and displayed is set in advance. It is determined by the priorities that have been set. For example, when there is a plurality of unique information for which priority is set, the highest-ranked unique information among the selected unique information to be displayed is biased and displayed on the system monitor 220 side. Therefore, if the unique information displayed by shifting to the system monitor 220 side at a certain point is deleted after a certain period of time, the next higher priority unique information is shifted to the system monitor 220 side again. Is displayed.
  • FIG. 10 is a diagram showing still another example of the display mode determined by the determination unit 113.
  • the analysis unit 112 may analyze the color tone adopted for the display of the system monitor 220. For example, as shown in FIG. 10, when dark black is adopted as the background color of the system monitor 220, the determination unit 113 makes the background area 124 of the display monitor 120 dark black. At this time, the coloring of the diagnostic assistance information 122 may be changed to one having good visibility according to the color tone of the background area 124. Further, the size of the display element may be changed.
  • the deviation of the unique information is also performed in the example of FIG. 10, the deviation of the unique information may be omitted when the visibility of the unique information can be improved by adjusting the color tone or the like.
  • the analysis unit 112 does not have to analyze the relative positional relationship between the display monitor area 120a and the system monitor area 220a.
  • the determination unit 113 may determine to select and use a text font that is close to the text font.
  • the determination unit 113 may make the size of the display element larger than usual. Further, depending on the size and distance of the display monitor 120, emphasizing means such as blinking of display elements, color change, and combined use of reading voice may be adopted.
  • FIG. 11 is a diagram illustrating a procedure of analysis processing using the neural network 151 for analysis, which is a trained model.
  • the neural network 151 for analysis is created in advance by supervised learning in which an image including a lesion site and an image not including the lesion site are given in large quantities together with the correct answer.
  • the neural network 151 for analysis created in this way is stored in the storage unit 150, appropriately read out by the diagnostic assistance unit 114, and used.
  • the endoscope system 200 receives a captured image from the camera unit 210 inserted into the stomach of the subject at, for example, 60 fps as described above, but when the doctor generates a release signal, a still image is displayed. Receive as an captured image.
  • the display signal received by the inspection device 100 from the endoscope system 200 is a frame signal of 60 fps as a display signal, but the captured image 121 developed from this is a pseudo still image frozen for a certain period of time. ..
  • the acquisition unit 111 When the acquisition unit 111 detects this pseudo still image and generates the captured image data, the acquisition unit 111 delivers the captured image data to the diagnosis assisting unit 114 as the image data to be diagnosed.
  • the diagnostic assistance unit 114 inputs the captured image 121 developed from the received captured image data to the analysis neural network 151, and causes the estimation probability to be calculated.
  • FIG. 12 is a flow chart illustrating a processing procedure executed by the arithmetic processing unit 110. The flow starts, for example, from the time when the endoscope system 200 and the inspection device 100 are activated.
  • step S101 the acquisition unit 111 acquires the display signal sent from the endoscope system 200 and develops it into a frame image. Then, in step S102, the captured image 121 is cut out from the expanded frame image and handed over to the analysis unit 112.
  • step S103 the analysis unit 112 searches the display monitor area 120a and the system monitor area 220a from the captured image 121 as described with reference to FIG. After finding these areas, the interrelationship between the display monitor 120 and the system monitor 220 is analyzed using these coordinates and the like.
  • the analysis unit 112 proceeds to step S104 and determines whether or not the mutual relationship analysis has been successful. If the display monitor area 120a and the system monitor area 220a cannot be found from the captured image 121, or if the mutual relationship cannot be analyzed even if they can be found, the process returns to step S101. If not, the analysis result is handed over to the determination unit 113, and the process proceeds to step S105.
  • the determination unit 113 determines the display mode of the display monitor 120 based on the mutual relationship between the display monitor 120 and the system monitor 220 indicated by the analysis result in step S105. After that, in step S106, the arithmetic processing unit 110 waits until the inspection is started. The arithmetic processing unit 110 determines, for example, that the examination is started when the acquired captured image 121 is confirmed to be an image in the oral cavity.
  • the display control unit 115 When the inspection is started, the display control unit 115 generates a display signal according to the display mode determined by the determination unit 113 in step S107, and displays each display element including the inspection information on the display monitor 120.
  • the acquisition unit 111 cuts out the captured image 121 from the frame image developed from the display signal and delivers the captured image 121 to the diagnostic assistance unit 114.
  • the diagnosis assisting unit 114 calculates the estimated probability as described above and hands it over to the display control unit 115.
  • the arithmetic processing unit 110 repeats steps S107 to S109 until an instruction to end the inspection is received in step S110. When the instruction to end the inspection is received, the series of processes is completed.
  • the endoscope system 200 and the inspection device 100 are connected via the connection cable 250, but a wireless connection may be used instead of a wired connection.
  • the endoscope system 200 outputs a display signal to the outside, and the inspection device 100 has described an embodiment using this display signal.
  • the signal output by the endoscope system 200 to the outside is captured by the camera unit 210.
  • the format of the output signal does not matter as long as it includes the image signal of the captured image. If the camera unit 210 directly transmits an image signal, the inspection device 100 may receive the image signal.
  • the inspection device 100 may be configured to transmit some request signal to the endoscope system 200.
  • the inspection device 100 may be provided with a change request unit that generates and transmits a request signal requesting a change in the display mode of the system monitor 220 based on the display mode determined by the determination unit 113.
  • the change request unit transmits, for example, a request signal requesting that the brightness of the system monitor 220 be reduced during the first predetermined time during which each diagnostic aid information 122 is displayed on the display monitor 120. In this way, if the display of the display monitor 120 and the display of the system monitor 220 can be linked, the visibility can be further improved.
  • the inspection support device 100 connected to the endoscope system 200 for inspecting the duodenum is a device that calculates and displays the probability that a lesion site is present in the captured image of the duodenum.
  • the neural network 151 for analysis is prepared in advance according to the site to be inspected.
  • the description has been made on the assumption that the camera unit 210 included in the endoscope system 200 is a flexible endoscope, but even if the camera unit 210 is a rigid endoscope, it may be described. There is no difference in the configuration or processing procedure of the inspection support device 100.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biomedical Technology (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Endoscopes (AREA)

Abstract

Le dispositif d'aide à l'examen selon la présente invention est utilisé tout en étant connecté à un système d'endoscope pourvu d'une unité de caméra qui est insérée dans le corps d'un sujet. Le dispositif d'aide à l'examen comprend : une unité d'acquisition pour acquérir des images capturées par l'unité de caméra ; un moniteur d'affichage pour afficher l'image capturée et des informations d'examen concernant un examen in vivo ; une unité d'analyse pour analyser la corrélation entre le moniteur d'affichage apparaissant dans l'image capturée acquise par l'unité d'acquisition avant l'exécution de l'examen in vivo et un moniteur de système accompagnant le système d'endoscope ; une unité de détermination pour déterminer un mode d'affichage sur le moniteur d'affichage sur la base de la corrélation analysée par l'unité d'analyse ; et une unité de commande d'affichage pour commander l'affichage sur le moniteur d'affichage sur la base du mode d'affichage déterminé par l'unité de détermination. Un tel dispositif d'examen peut déterminer automatiquement un mode d'affichage pour afficher des informations d'examen et analogues sur le moniteur d'affichage de façon à ce qu'elles soient facilement reconnues par rapport au dispositif de surveillance de système fourni dans le système d'endoscope.
PCT/JP2021/032384 2020-09-23 2021-09-03 Dispositif d'aide à l'examen, procédé d'aide à l'examen, et programme d'aide à l'examen WO2022064998A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020158802A JP2022052417A (ja) 2020-09-23 2020-09-23 検査支援装置、検査支援方法および検査支援プログラム
JP2020-158802 2020-09-23

Publications (1)

Publication Number Publication Date
WO2022064998A1 true WO2022064998A1 (fr) 2022-03-31

Family

ID=80845208

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/032384 WO2022064998A1 (fr) 2020-09-23 2021-09-03 Dispositif d'aide à l'examen, procédé d'aide à l'examen, et programme d'aide à l'examen

Country Status (2)

Country Link
JP (1) JP2022052417A (fr)
WO (1) WO2022064998A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011000173A (ja) * 2009-06-16 2011-01-06 Toshiba Corp 内視鏡検査支援システム
JP2014188310A (ja) * 2013-03-28 2014-10-06 Sony Corp 画像処理装置、画像処理方法、プログラム、及び内視鏡システム
WO2017122541A1 (fr) * 2016-01-13 2017-07-20 ソニー株式会社 Dispositif de traitement d'image, procédé de traitement d'image, programme et système chirurgical
WO2018163644A1 (fr) * 2017-03-07 2018-09-13 ソニー株式会社 Dispositif de traitement d'informations, système d'assistance et procédé de traitement d'informations
JP2019042156A (ja) * 2017-09-01 2019-03-22 富士フイルム株式会社 医療画像処理装置、内視鏡装置、診断支援装置、及び、医療業務支援装置
WO2019176556A1 (fr) * 2018-03-13 2019-09-19 ソニー株式会社 Système de gestion d'instruments médicaux et procédé de gestion d'instruments médicaux
JP2019154883A (ja) * 2018-03-15 2019-09-19 ソニー・オリンパスメディカルソリューションズ株式会社 医療用画像処理装置、医療用観察装置、および画像処理方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011000173A (ja) * 2009-06-16 2011-01-06 Toshiba Corp 内視鏡検査支援システム
JP2014188310A (ja) * 2013-03-28 2014-10-06 Sony Corp 画像処理装置、画像処理方法、プログラム、及び内視鏡システム
WO2017122541A1 (fr) * 2016-01-13 2017-07-20 ソニー株式会社 Dispositif de traitement d'image, procédé de traitement d'image, programme et système chirurgical
WO2018163644A1 (fr) * 2017-03-07 2018-09-13 ソニー株式会社 Dispositif de traitement d'informations, système d'assistance et procédé de traitement d'informations
JP2019042156A (ja) * 2017-09-01 2019-03-22 富士フイルム株式会社 医療画像処理装置、内視鏡装置、診断支援装置、及び、医療業務支援装置
WO2019176556A1 (fr) * 2018-03-13 2019-09-19 ソニー株式会社 Système de gestion d'instruments médicaux et procédé de gestion d'instruments médicaux
JP2019154883A (ja) * 2018-03-15 2019-09-19 ソニー・オリンパスメディカルソリューションズ株式会社 医療用画像処理装置、医療用観察装置、および画像処理方法

Also Published As

Publication number Publication date
JP2022052417A (ja) 2022-04-04

Similar Documents

Publication Publication Date Title
US8004560B2 (en) Endoscope apparatus
JP4656988B2 (ja) 内視鏡挿入形状解析装置および、内視鏡挿入形状解析方法
JP4914574B2 (ja) 内視鏡形状検出装置
US8558879B2 (en) Endoscope apparatus and measuring method
WO2010119690A1 (fr) Appareil de support pour le diagnostic, procédé de support pour le diagnostic, et programme de support pour le diagnostic stockant dans un milieu de stockage
EP1994878A1 (fr) Dispositif de traitement d'image pour usage medical et procede de traitement d'image pour usage medical
JP5486432B2 (ja) 画像処理装置、その作動方法およびプログラム
US20210065370A1 (en) Information processing apparatus, inspection system, information processing method, and storage medium that are used in a diagnosis based on a medical image
US20230281968A1 (en) Recording Medium, Method for Generating Learning Model, Surgical Support Device and Information Processing Method
JP6956853B2 (ja) 診断支援装置、診断支援プログラム、及び、診断支援方法
KR101595962B1 (ko) 대장내시경 수술 시뮬레이션시스템
JP2021029676A (ja) 情報処理装置、検査システム及び情報処理方法
JP5295526B2 (ja) 計測用内視鏡装置
US20220361739A1 (en) Image processing apparatus, image processing method, and endoscope apparatus
JP2008119259A (ja) 内視鏡挿入形状解析システム
WO2022064998A1 (fr) Dispositif d'aide à l'examen, procédé d'aide à l'examen, et programme d'aide à l'examen
WO2022065189A1 (fr) Dispositif d'aide à l'examen, procédé d'aide à l'examen et programme d'aide à l'examen
JP2022145395A (ja) 検査支援装置、検査支援方法および検査支援プログラム
WO2022270582A1 (fr) Dispositif d'aide à l'examen, procédé d'aide à l'examen et programme d'aide à l'examen
JP4464640B2 (ja) 工業用内視鏡装置
JP2005111081A (ja) 内視鏡画像表示処理装置
JP7391113B2 (ja) 学習用医療画像データ作成装置、学習用医療画像データ作成方法及びプログラム
US20220346632A1 (en) Image processing apparatus, image processing method, and non-transitory storage medium storing computer program
WO2023218523A1 (fr) Second système endoscopique, premier système endoscopique et procédé d'inspection endoscopique
JP2023106327A (ja) 検査支援装置、検査支援方法および検査支援プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21872129

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21872129

Country of ref document: EP

Kind code of ref document: A1