WO2022014258A1 - プロセッサ装置、プロセッサ装置の作動方法 - Google Patents

プロセッサ装置、プロセッサ装置の作動方法 Download PDF

Info

Publication number
WO2022014258A1
WO2022014258A1 PCT/JP2021/023216 JP2021023216W WO2022014258A1 WO 2022014258 A1 WO2022014258 A1 WO 2022014258A1 JP 2021023216 W JP2021023216 W JP 2021023216W WO 2022014258 A1 WO2022014258 A1 WO 2022014258A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
predetermined
determined
processor device
satisfied
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/023216
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
進吾 増野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Priority to JP2022536191A priority Critical patent/JP7637683B2/ja
Publication of WO2022014258A1 publication Critical patent/WO2022014258A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes

Definitions

  • the present invention relates to a processor device and a method of operating a processor device for acquiring an analysis result of an endoscope image captured by an endoscope.
  • an endoscope system including a light source device, an endoscope, and a processor device is widely known.
  • an observation object is irradiated with illumination light, and the observation object illuminated by the illumination light is imaged to acquire an endoscope image as a medical image.
  • the endoscopic image is displayed on a display and used for diagnosis and the like.
  • a region of interest such as a lesion region is detected and highlighted to support a user's diagnosis.
  • candidates of the region of interest are detected, and for each of the detected candidates, the reliability indicating the certainty of being the region of interest is calculated, and each region of interest is calculated according to the calculated reliability.
  • a configuration is described in which the mode of highlighting the candidate is different.
  • the present invention has been made in view of the above background, and an object of the present invention is to provide a processor device and a method of operating the processor device that can obtain more accurate analysis results.
  • the processor device of the present invention acquires the analysis result of the endoscope image captured by the endoscope.
  • an image processing processor and an endoscope image are required for analysis. It is determined whether or not the predetermined criteria are satisfied, and if it is determined that the predetermined criteria are not met, a warning regarding the reliability of the analysis is given.
  • the amount of blurring of the endoscopic image is set, and when the amount of blurring is equal to or greater than the predetermined amount of blurring, it may be determined that the predetermined standard is not satisfied.
  • the in-focus degree of the endoscopic image is set, and when the in-focus degree is equal to or less than the predetermined in-focus degree, it may be determined that the predetermined standard is not satisfied.
  • the brightness of the endoscopic image is set as a predetermined standard and the brightness is equal to or less than the predetermined brightness, it may be determined that the predetermined standard is not satisfied.
  • the ratio of the halation region having the maximum luminance gradation value is set, and when the ratio of the halation region is equal to or more than the predetermined ratio, it may be determined that the predetermined standard is not satisfied.
  • the ratio of the deposit region in which the deposit attached to the imaging optical system is imaged is set, and when the ratio of the deposit region is equal to or more than the predetermined ratio, even if it is determined that the predetermined standard is not satisfied. good.
  • the feature amount related to biological information by analysis if the feature amount is equal to or less than the predetermined amount, it may be determined that the predetermined standard is not satisfied.
  • the region of interest In the case of detecting the region of interest from the endoscopic image by analysis, if the region of interest is separated from the center of the endoscopic image by a predetermined distance or more, it may be determined that the predetermined criterion is not satisfied.
  • the predetermined criteria consist of a primary criterion and a secondary criterion regarding the proportion of endoscopic images that meet the primary criteria.
  • the ratio of the endoscopic images satisfying the criteria is equal to or less than the secondary criteria, it may be determined that the predetermined criteria are not satisfied.
  • Normal imaging that irradiates the observation target with normal light and captures the normal image as an endoscope image, and special light that has a different emission spectrum from the normal light is radiated to the observation target to acquire a special image as an endoscope image.
  • the normal image and the special image may be compared to determine whether or not the predetermined criteria are satisfied.
  • the analysis results of the normal image and the special image may be compared.
  • the feature amount obtained by the analysis of the normal image is equal to or more than the predetermined reference amount, and the feature amount obtained by the analysis of the special image is less than the predetermined reference amount. In some cases, it may be determined that the predetermined criteria are not satisfied.
  • the image processing processor uses the endoscope. It is determined whether or not the image meets the predetermined criteria required for analysis, and if it is determined that the image does not meet the predetermined criteria, a warning regarding the reliability of the analysis is given.
  • the endoscope system 10 has an endoscope 12, a light source device 14, a processor device 16, a display 18, and a user interface 19.
  • the endoscope 12 is optically connected to the light source device 14 and electrically connected to the processor device 16.
  • the endoscope 12 has an insertion portion 12a to be inserted into the body to be observed, an operation portion 12b provided at the base end portion of the insertion portion 12a, and a curved portion 12c and a tip provided on the tip end side of the insertion portion 12a. It has a portion 12d.
  • the operating portion 12b is provided with an angle knob 12e, and by operating the angle knob 12e, the curved portion 12c can be curved to turn the tip portion 12d in a desired direction.
  • the operation unit 12b includes a mode changeover switch 12f used for switching the observation mode, a still image acquisition instruction unit 12g used for instructing the acquisition of a still image to be observed, and a zoom lens 43 (see FIG. 2).
  • a zoom operation unit 12h to be used is provided.
  • the endoscope system 10 is provided with a normal observation mode and a detailed observation mode for performing more detailed observation than the normal observation mode as the observation mode. By operating the mode changeover switch 12f, the observation mode is provided. Is switched.
  • the light source device 14 includes a light source unit 20 (see FIG. 2) that emits illumination light for illuminating an observation target.
  • the illumination light from the light source unit 20 is guided by the light guide 25 (see FIG. 2) and is emitted from the tip portion 12d toward the observation target.
  • the observation target illuminated by the illumination light from the light source unit 20 is imaged by the image pickup sensor 44 (see FIG. 2) built in the tip portion 12d.
  • the processor device 16 is electrically connected to the display 18 and the user interface 19.
  • the display 18 outputs and displays an image to be observed, information incidental to the image to be observed, and the like.
  • the user interface 19 is a keyboard, a mouse, and / or a touch pad, and has a function of accepting input operations such as function settings.
  • An external recording unit (not shown) for recording an image, image information, or the like may be connected to the processor device 16.
  • the light source device 14 includes the above-mentioned light source unit 20 and a light source processor 21 that controls the light source unit 20, and the emission timing and emission spectrum of the illumination light emitted from the light source unit 20 are for the light source. It is controlled by the processor 21.
  • the light source device 14 emits normal light and special light having different emission spectra.
  • Normal light is, for example, white light.
  • the white light includes, for example, purple light having a wavelength band of 380 to 420 nm, blue light having a wavelength band of 420 to 500 nm, green light having a wavelength band of 480 to 600 nm, and red light having a wavelength band of 600 to 650 nm.
  • the amount of purple light having a high absorption coefficient of hemoglobin in blood vessels and having a wavelength band of 380 nm to 420 nm is larger than that of normal light.
  • the resolution of the vascular structure and the ductal structure of the special image is higher than that of other structures.
  • the type of special light is not limited to one type, and a plurality of types of special images may be captured by a plurality of types of special light.
  • the illumination light from the light source unit 20 is incident on the light guide 25 described above via the optical path coupling unit 23 composed of a mirror, a lens, or the like.
  • the light guide 25 is built in the endoscope 12 and a universal cord (a cord connecting the endoscope 12, the light source device 14 and the processor device 16).
  • the light guide 25 propagates the light from the optical path coupling portion 23 to the tip portion 12d of the endoscope 12.
  • An illumination optical system 30a and an image pickup optical system 30b are provided at the tip end portion 12d of the endoscope 12.
  • the illumination optical system 30a has an illumination lens 32, and the illumination light propagated by the light guide 25 is applied to the observation target through the illumination lens 32.
  • the image pickup optical system 30b includes an objective lens 42, a zoom lens 43, and an image pickup sensor 44.
  • the light from the observation target due to the irradiation of the illumination light is incident on the image pickup sensor 44 via the objective lens 42 and the zoom lens 43.
  • the zoom lens 43 is a lens for enlarging the observation target, and moves between the telephoto end and the wide end by operating the zoom operation unit 12h.
  • the image pickup sensor 44 is a color sensor, and in the present embodiment, it is a B pixel having a B (blue) color filter, a G pixel having a G (green) color filter, and an R pixel having an R (red) color filter.
  • a primary color sensor equipped with three types of pixels is used.
  • a CCD (Charge-Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) image pickup sensor or the like can be used.
  • the image pickup sensor 44 is controlled by the image pickup processor 45. Specifically, the image signal is output from the image pickup sensor 44 by reading out the signal of the image pickup sensor 44 by the image pickup processor 45.
  • the image pickup processor 45 controls the above-mentioned light source processor 21 to perform normal image pickup by irradiating an observation target with normal light to perform image pickup (signal readout), and to perform image pickup by irradiating special light into an observation mode.
  • Perform special imaging Then, in normal imaging, a normal image is captured as an endoscopic image, and in special imaging, a special image is captured as an endoscopic image.
  • the imaging cycle between normal imaging and special imaging can be freely set, but in this embodiment, normal imaging of 5 times (5 frames) and special imaging of 1 time (1 frame) are repeatedly performed. Further, in the present embodiment, imaging is performed 60 times per second (60 frames). As a result, in the present embodiment, 50 normal images (50 frames) and 10 special images (10 frames) are acquired per second.
  • a complementary color image sensor having C (cyan), M (magenta), Y (yellow), and G (green) complementary color filters instead of the primary color image sensor 44 provided with the RGB primary color filter. May be used.
  • the image signals of four colors of CMYG are output. Therefore, by converting the image signals of the four colors of CMYG into the image signals of the three colors of RGB by the complementary color-primary color conversion, it is possible to obtain the image signals of each RGB color similar to the image sensor 38.
  • a monochrome sensor without a color filter may be used instead of the image sensor 38.
  • the CDS / AGC (Correlated Double Sampling / Automatic Gain Control) circuit 46 performs correlated double sampling (CDS) and automatic gain control (AGC) on the analog image signal obtained from the image pickup sensor 44.
  • CDS correlated double sampling
  • AGC automatic gain control
  • the image signal that has passed through the CDS / AGC circuit 46 is converted into a digital image signal by the A / D (Analog / Digital) converter 48.
  • the digital image signal after A / D conversion is input to the processor device 16.
  • the processor device 16 includes a central control unit 68 that constitutes the image processing processor of the present invention.
  • the central control unit 68 is a hardware resource for executing a program instruction stored in a memory 69, and is a processor. Each part of the device 16 is driven and controlled to execute a program instruction.
  • the processor device 16 functions as an image acquisition unit 50, a DSP (Digital Signal Processor) 52, a noise reduction unit 54, an image processing unit 58, and a display control unit 60. do.
  • DSP Digital Signal Processor
  • the image acquisition unit 50 acquires an endoscope image input from the endoscope 12.
  • the endoscopic image is a blue signal (B image signal), a green signal (G image signal), and a red signal (R image signal) output from the B pixel, G pixel, and R pixel of the image pickup sensor 44. It is a color image composed of.
  • normal imaging in which normal light is irradiated to the observation target to take an image and special imaging in which special light is applied to the observation target to take an image are performed.
  • the endoscopic image which is a color image a normal image by normal imaging and a special image by special imaging are acquired.
  • five times of normal imaging and one special imaging are repeated.
  • five (frame) normal images and one (frame) special image are repeatedly acquired.
  • the endoscopic image acquired by the image acquisition unit 50 is transmitted to the DSP 52.
  • the DSP 52 performs various signal processing such as defect correction processing, offset processing, gain correction processing, matrix processing, gamma conversion processing, demosaic processing, and YC conversion processing on the received endoscopic image.
  • the signal of the defective pixel of the image sensor 44 is corrected.
  • the dark current component is removed from the image signal subjected to the defect correction processing, and an accurate zero level is set.
  • the gain correction process adjusts the signal level of the endoscopic image by multiplying the image signal of each color after the offset process by a specific gain coefficient.
  • the endoscope image may be imaged by the monochrome sensor for each emission of light of a specific color and may be a monochrome image of a plurality of colors output from the monochrome sensor. preferable.
  • the image signal of each color after the gain correction processing is subjected to matrix processing to improve the color reproducibility. After that, the brightness and saturation of the endoscopic image are adjusted by the gamma conversion process.
  • the endoscope image after the matrix processing is subjected to demosaic processing (also referred to as isotropic processing or simultaneous processing), and a signal of the missing color of each pixel is generated by interpolation. By the demosaic processing, all the pixels have the signals of each color of RGB.
  • the DSP 52 performs YC conversion processing on the endoscope image after the demosaic processing, and outputs the luminance signal Y, the color difference signal Cb, and the color difference signal Cr to the noise reduction unit 54.
  • the noise reduction unit 54 performs noise reduction processing by, for example, a moving average method, a median filter method, or the like on an endoscopic image that has been demosaic processed by DSP 56.
  • the endoscopic image with reduced noise is input to the image processing unit 58.
  • the images are input to the display control unit 60.
  • the display control unit 60 controls the display of the display 18, and the endoscopic image processed by the image processing unit 58 is converted into a video signal for display by the display control unit 60 and displayed. It is displayed at 18.
  • the image processing unit 58 includes a normal observation mode layer processing unit 62 and a detailed observation mode image processing unit 64.
  • the normal observation mode image processing unit 62 operates when the above-mentioned observation mode is the normal observation mode.
  • the detailed observation mode image processing unit 64 operates when the observation mode is the detailed observation mode.
  • the normal observation mode image processing unit 62 performs color conversion processing, color enhancement processing, and structure enhancement processing on the endoscope image input from the noise reduction unit 54.
  • a color conversion process is performed on the endoscopic image by a 3 ⁇ 3 matrix process, a gradation conversion process, a three-dimensional LUT (Look Up Table) process, or the like.
  • the color enhancement process is performed on the endoscopic image that has undergone the color conversion process.
  • the structure enhancement process is a process for emphasizing the structure of the observation target, and is performed on the endoscopic image after the color enhancement process. Then, the endoscopic image subjected to the above-mentioned image processing is displayed on the display 18 via the display control unit 60.
  • the detailed observation mode image processing unit 64 also performs the same image processing as the normal observation mode processing unit, and the image-processed endoscope image is displayed on the display 18. Further, as shown in FIG. 3, the detailed observation mode image processing unit 64 is provided with a recognition processing unit 70, an image determination unit 72, and a warning processing unit 74.
  • the recognition processing unit 70 analyzes the endoscopic image input from the noise reduction unit 54 and performs recognition processing.
  • the recognition process performed by the recognition processing unit 70 includes a detection process for detecting a region of interest from a recognition image (endoscopic image in the present embodiment) and a discrimination process for discriminating the type of lesion included in the recognition image. And are included. Further, the discrimination process includes a process performed on the region of interest and a process performed on the entire recognition image, but in the present embodiment, an example of performing the discrimination process on the region of interest will be described. I do.
  • the endoscopic image is divided into a plurality of small areas, and the image feature amount is calculated from the divided endoscopic images. Then, in the detection process, it is determined whether or not each small region is a lesion based on the calculated feature amount, and a group of regions identified as having the same type is extracted as one lesion, and the extracted lesion is extracted. The area containing the above is detected as the area of interest. Further, in the discrimination process, for the detected region of interest, the type of lesion and / or the degree of lesion based on the feature amount in the region of interest and the mode (position, size, shape, etc.) of the region of interest. (Stage) is judged. Judgment in the above-mentioned recognition process (detection process, discrimination process) is performed by a machine learning algorithm such as a convolutional neural network or deep learning.
  • a machine learning algorithm such as a convolutional neural network or deep learning.
  • the feature amount calculated from the endoscopic image by the recognition processing unit 70 is related to biological information, and is an index value obtained from the shape and color of a predetermined part in the observation target or their shape and color. Is preferable.
  • the characteristic amounts include blood vessel density, blood vessel shape, number of blood vessel branches, blood vessel thickness, blood vessel length, blood vessel tortuosity, blood vessel depth, glandular shape, glandular opening shape, and gland. It is preferable that the value is at least one of the length of the blood vessel, the degree of tortuosity of the glandular vessel, and the color information, or a combination of two or more thereof.
  • the result of the above-mentioned recognition processing that is, the analysis result obtained by the recognition processing unit 70 analyzing the endoscopic image is displayed on the display 18 via the display control unit 60.
  • the recognition processing unit 70 is provided in the endoscope system 10 (more specifically, the processor device 16)
  • the present invention is not limited thereto.
  • a recognition processing unit may be provided in an external device other than the processor device 16 or the endoscope system 10. In this case, the endoscope image of the analysis target (target of recognition processing) is transmitted to the external device, the recognition processing (analysis) is performed by the external device, and the recognition processing result (analysis result) sent from the external device is performed. May be received (acquired) by the endoscope system 10 (more specifically, the processor device 16).
  • the recognition-processed endoscope image that the recognition processing unit 70 has performed recognition processing is input to the image determination unit 72.
  • the image determination unit 72 analyzes the input endoscope image, and determines whether or not the input endoscope image satisfies a predetermined criterion required for recognition processing (analysis performed by the recognition processing unit 70). Judgment Judgment processing is performed. It should be noted that the determination processing may be performed on the endoscopic image before the recognition processing unit 70 performs the recognition processing. Further, the configuration is not limited to the configuration in which the recognition process and the determination process are performed in series, and equivalent endoscopic images are input to each of the recognition process unit 70 and the image determination unit 72, and the recognition process and the determination process are performed in parallel. You may go to the target.
  • the warning processing unit 74 operates when the image determination unit 72 determines that the predetermined criteria required for the recognition processing process is not satisfied, and performs warning processing.
  • the warning process warns that the reliability of the recognition process is lowered because the endoscopic image does not meet the predetermined criteria required for the recognition process.
  • the warning is given, for example, by displaying a message indicating that the reliability of the recognition process is low on the display 18 and / or outputting a warning sound from a speaker (not shown).
  • the amount of image blur is set as a predetermined standard used in the determination process.
  • the image determination unit 72 analyzes the endoscopic image to be determined, and an index value related to the image blur amount (the larger the value, the more the image). Indicates that the amount of blurring is large). Then, the calculated index value is compared with the preset threshold value for image blur determination, and when it is equal to or more than the threshold value, that is, when the image blur amount is equal to or more than the predetermined blur amount, the predetermined standard is not satisfied. Is determined. On the other hand, when the calculated index value is less than the threshold value for image blur determination, it is determined that the predetermined criteria are satisfied.
  • the predetermined standard is not limited to the amount of image blur. Focusing degree, image brightness, halation, deposits, feature amount, and position of interest region may be set as predetermined criteria.
  • the image determination unit 72 analyzes the endoscopic image to be determined, and an index value related to the in-focus degree (the larger the value, the more the in-focus degree). Is high (indicating that it is in focus)) is calculated. Then, the calculated index value is compared with the preset threshold value for determining the in-focus degree, and when it is equal to or less than the threshold value, that is, when the in-focus degree is equal to or less than the predetermined in-focus degree, the predetermined standard is satisfied. Judge that it is not. On the other hand, when the calculated index value is larger than the threshold value for determining the degree of focus, it is determined that the predetermined criteria are satisfied.
  • the image determination unit 72 analyzes the endoscopic image to be determined and the image brightness (for example, the entire image or each pixel in the region of interest). The average value of the luminance gradation value of) is detected. Then, when the detected image luminance is equal to or less than the preset luminance determination threshold value, that is, when the image luminance is equal to or less than the predetermined luminance, it is determined that the predetermined criterion is not satisfied. On the other hand, when the image brightness is larger than the threshold value for determining the luminance, it is determined that the predetermined criterion is satisfied.
  • the image determination unit 72 analyzes the endoscopic image to be determined and detects the entire image or the halation region of the region of interest.
  • the halation region is a so-called overexposed region in which the luminance gradation value of the image is maximized. Then, the image determination unit 72 does not satisfy the predetermined criteria when the ratio of the halation region is equal to or higher than the preset threshold value for halation determination, that is, when the ratio of the halation region is equal to or higher than the predetermined ratio. judge. On the other hand, when the ratio of the halation region is less than the threshold value for halation determination, it is determined that the predetermined criteria are satisfied.
  • the image determination unit 72 analyzes the endoscopic image to be determined and detects the deposit region in the entire image or the region of interest. ..
  • the deposit region is a region in which deposits such as body fluid adhering to the photographing optical system such as the objective lens 42 are imaged. Then, the image determination unit 72 satisfies a predetermined criterion when the ratio of the deposit region is equal to or more than a preset threshold value for deposit determination, that is, when the ratio of the deposit region is equal to or more than a predetermined ratio. Judge that it is not. On the other hand, when the ratio of the deposit region is less than the threshold value for determining the deposit, it is determined that the predetermined criteria are satisfied.
  • the image determination unit 72 determines that the feature amount calculated in the recognition process is equal to or less than a preset feature amount determination threshold value. That is, when the feature amount is equal to or less than the predetermined amount, it is determined that the predetermined standard is not satisfied. On the other hand, when the feature amount exceeds the feature amount determination threshold value, it is determined that the predetermined criteria are satisfied.
  • the image determination unit 72 detects the position (center position) of the attention area detected in the recognition process, and the detected position and the inside. Calculate the center and distance of the endoscopic image. Then, when the calculated distance is equal to or greater than the preset threshold for determining the position of the region of interest, that is, when the region of interest is separated from the center of the endoscopic image by a predetermined distance or more, the predetermined criterion is not satisfied. judge. On the other hand, when the calculated distance is less than the threshold value for determining the position of the region of interest, it is determined that the predetermined criteria are satisfied.
  • the present invention is not limited to this. It may be determined that the predetermined criteria are satisfied when all of the plurality of preset criteria are satisfied, or when the criteria of a predetermined ratio or more among the plurality of preset criteria are satisfied.
  • the predetermined criteria are satisfied when the ratio of the endoscope images satisfying the primary criteria is higher than the secondary criteria for a plurality of endoscopic images captured continuously (the ratio of the endoscopic images satisfying the primary criteria is exceeded). It may be determined that the predetermined criteria are not satisfied when the ratio of the endoscopic images satisfying the primary criteria is equal to or less than the secondary criteria).
  • the primary reference one or more of the above-mentioned image blur amount, focus degree, image brightness, halation, deposit, feature amount, and position of interest region is set, and all or a predetermined ratio or more of these are set. If it is satisfied, it is determined that the primary criterion is satisfied. Then, when the proportion of the endoscopic images that satisfy the primary criteria among the continuously captured endoscopic images exceeds the secondary criteria (for example, 10%), it is determined that the predetermined criteria are satisfied. ..
  • the plurality of endoscopic images taken continuously are images of a common observation target. Whether or not the endoscopic image is an image of a common observation target can be determined by analyzing the endoscopic image.
  • the endoscopic image captured during one detailed observation mode is an image of a common observation target. It may be considered to be.
  • the user specifies the imaging start time and the imaging end time of a common observation target, so that the endoscopic images captured during this period are common observations. It may be configured to be set as an image of an object.
  • the predetermined standard is common to the normal image and the special image has been described, but if the predetermined standard differs depending on whether the endoscope image to be determined is a normal image or a special image. You may let me. Further, although the explanation has been given with an example of determining whether or not both the normal image and the special image satisfy the predetermined standard, whether or not only one of the normal image and the special image satisfies the predetermined standard. It may be configured to determine whether or not.
  • the content of the recognition process is the same for the normal image and the special image, but the content of the recognition process may be different between the normal image and the special image. Further, the recognition process may be performed only on one of the normal image and the special image.
  • the predetermined criteria may be satisfied by comparing the normal image and the special image.
  • the feature quantities of a normal image and a special image obtained by capturing a common observation target may be compared, and if the difference between the two is equal to or greater than a predetermined value, it may be determined that the predetermined standard is not satisfied. Conceivable.
  • the feature amounts of the normal image and the special image may be compared, and if one is more than the reference amount but the other is less than the reference amount, it may be determined that the predetermined standard is not satisfied.
  • the special image has a higher resolution of the vascular structure and the ductal structure than the normal image. Therefore, when the feature amount related to the vascular structure and the ductal structure is calculated in the recognition process, it is calculated from the special image. It is natural that the feature amount has a larger amount of information than the feature amount calculated from a normal image.
  • the feature amount calculated from the normal image is equal to or more than the reference amount and the feature amount calculated from the special image is less than the reference amount, for example, the area of interest in the recognition process from the sensation image is If it can be detected, but the region of interest cannot be detected from the special image in the recognition process, it is highly possible that the endoscopic image to be recognized is not captured under appropriate conditions. Therefore, in the example of FIG. 13, if the region of interest is not detected from the special image even though the region of interest is detected from the traffic image, it is determined that the predetermined criteria are not satisfied. There is.
  • an example of giving a warning when it is determined that the endoscopic image does not meet the predetermined criteria required for the recognition process (analysis) has been described, but the present invention is not limited to this. ..
  • the endoscopic image satisfying the predetermined criteria required for the recognition process is imaged.
  • an advice process that advises the imaging method may be performed.
  • the advice processing is performed by, for example, the warning processing unit 74 (see FIG. 3), and in the advice processing, advice on the shooting method is given by displaying a message on the display 18 or the like, as in the warning processing described above.
  • the configuration may be such that the advice processing is performed instead of the warning processing.
  • a message prompting "slowly move the camera (tip portion 12d of the insertion portion 12a)" is displayed. If it is determined that the degree of focus does not meet the predetermined standard (when the high frequency component of the image is below the standard), the "camera (tip portion 12d of the insertion portion 12a) is moved back and forth so as to be in focus. Display a message prompting you to "move to”.
  • a message prompting to "increase the amount of illumination light” or “correctly apply the illumination light to the observation target” is displayed. If it is determined that the halation does not meet the predetermined criteria, a message prompting "change the shooting angle" is displayed. Further, if it is determined that the deposit does not meet the predetermined criteria, a message prompting "clean the objective lens (tip portion 12d of the insertion portion 12a)" is displayed. Further, when it is determined that the feature amount and the position of the attention area do not meet the predetermined criteria, and because the attention area is not detected from the special image even though the attention area is detected from the communication image, the predetermined area is determined. If it is determined that the criteria are not met, a message prompting "capture the observation target in front (center of the image)” is displayed. And so on.
  • the configuration may be such that switching between the communication observation mode and the detailed observation mode is performed.
  • the detection process is performed in the communication observation mode, and when the region of interest is detected, the process shifts to the detailed observation mode and the discrimination process is performed.
  • the analysis result is obtained. It is conceivable to display it and return to the communication observation mode.
  • the hardware-like structure of the processing unit that executes various processing such as unit 68, recognition processing unit 70, image determination unit 72, warning processing unit 74, etc. has various processors (processors) as shown below. ).
  • the circuit configuration is changed after manufacturing the CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), etc., which are general-purpose processors that execute software (programs) and function as various processing units. It includes a programmable logic device (PLD), which is a possible processor, a dedicated electric circuit, which is a processor having a circuit configuration specially designed for executing various processes, and the like.
  • PLD programmable logic device
  • One processing unit may be composed of one of these various processors, or may be composed of a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs or a combination of a CPU and an FPGA). May be done. Further, a plurality of processing units may be configured by one processor. As an example of configuring a plurality of processing units with one processor, first, as represented by a computer such as a client or a server, one processor is configured by a combination of one or more CPUs and software. There is a form in which this processor functions as a plurality of processing units.
  • SoC System On Chip
  • the various processing units are configured by using one or more of the above-mentioned various processors as a hardware-like structure.
  • the hardware-like structure of these various processors is, more specifically, an electric circuit (circuitry) in which circuit elements such as semiconductor elements are combined.
  • the hardware structure of the storage unit is a storage device such as an HDD (hard disk drive) or SSD (solid state drive).

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Surgery (AREA)
  • Optics & Photonics (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Astronomy & Astrophysics (AREA)
  • Endoscopes (AREA)
PCT/JP2021/023216 2020-07-17 2021-06-18 プロセッサ装置、プロセッサ装置の作動方法 Ceased WO2022014258A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022536191A JP7637683B2 (ja) 2020-07-17 2021-06-18 プロセッサ装置、プロセッサ装置の作動方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-122801 2020-07-17
JP2020122801 2020-07-17

Publications (1)

Publication Number Publication Date
WO2022014258A1 true WO2022014258A1 (ja) 2022-01-20

Family

ID=79555214

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/023216 Ceased WO2022014258A1 (ja) 2020-07-17 2021-06-18 プロセッサ装置、プロセッサ装置の作動方法

Country Status (2)

Country Link
JP (1) JP7637683B2 (https=)
WO (1) WO2022014258A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2023144936A1 (https=) * 2022-01-26 2023-08-03
WO2024180593A1 (ja) * 2023-02-27 2024-09-06 日本電気株式会社 画像処理装置、画像処理方法及び記憶媒体

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010521272A (ja) * 2007-03-16 2010-06-24 エスティーアイ・メディカル・システムズ・エルエルシー 標準化された撮像データを実現するために撮像デバイスに自動品質フィードバックを与える方法
JP2011194164A (ja) * 2010-03-23 2011-10-06 Olympus Corp 蛍光観察装置
JP2011194111A (ja) * 2010-03-23 2011-10-06 Olympus Corp 画像処理装置、画像処理方法及びプログラム
JP2014527861A (ja) * 2011-08-01 2014-10-23 シロナ・デンタル・システムズ・ゲゼルシャフト・ミット・ベシュレンクテル・ハフツング 歯科対象物の複数の３次元画像を記録するための方法
WO2016162925A1 (ja) * 2015-04-06 2016-10-13 オリンパス株式会社 画像処理装置、生体観察装置および画像処理方法
WO2019244407A1 (ja) * 2018-06-19 2019-12-26 オリンパス株式会社 内視鏡システム及び内視鏡システムの作動方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019203006A1 (ja) 2018-04-17 2019-10-24 富士フイルム株式会社 内視鏡装置、内視鏡プロセッサ装置及び内視鏡画像表示方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010521272A (ja) * 2007-03-16 2010-06-24 エスティーアイ・メディカル・システムズ・エルエルシー 標準化された撮像データを実現するために撮像デバイスに自動品質フィードバックを与える方法
JP2011194164A (ja) * 2010-03-23 2011-10-06 Olympus Corp 蛍光観察装置
JP2011194111A (ja) * 2010-03-23 2011-10-06 Olympus Corp 画像処理装置、画像処理方法及びプログラム
JP2014527861A (ja) * 2011-08-01 2014-10-23 シロナ・デンタル・システムズ・ゲゼルシャフト・ミット・ベシュレンクテル・ハフツング 歯科対象物の複数の３次元画像を記録するための方法
WO2016162925A1 (ja) * 2015-04-06 2016-10-13 オリンパス株式会社 画像処理装置、生体観察装置および画像処理方法
WO2019244407A1 (ja) * 2018-06-19 2019-12-26 オリンパス株式会社 内視鏡システム及び内視鏡システムの作動方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2023144936A1 (https=) * 2022-01-26 2023-08-03
WO2023144936A1 (ja) * 2022-01-26 2023-08-03 日本電気株式会社 画像判定装置、画像判定方法、及び、記録媒体
WO2024180593A1 (ja) * 2023-02-27 2024-09-06 日本電気株式会社 画像処理装置、画像処理方法及び記憶媒体
WO2024180796A1 (ja) * 2023-02-27 2024-09-06 日本電気株式会社 画像処理装置、画像処理方法及び記憶媒体

Also Published As

Publication number Publication date
JP7637683B2 (ja) 2025-02-28
JPWO2022014258A1 (https=) 2022-01-20

Similar Documents

Publication Publication Date Title
JP7542585B2 (ja) 画像処理装置、内視鏡システム及び画像処理装置の作動方法
JP6522539B2 (ja) 内視鏡システム及びその作動方法
JP6858672B2 (ja) 医療画像処理システム及び内視鏡システム
US10986980B2 (en) Image processing device, method for operating same, endoscope processor device, and method for operating same
JP2010521272A (ja) 標準化された撮像データを実現するために撮像デバイスに自動品質フィードバックを与える方法
JPWO2020170791A1 (ja) 医療画像処理装置及び方法
WO2020054255A1 (ja) 内視鏡装置、内視鏡プロセッサ、及び内視鏡装置の操作方法
JP7402314B2 (ja) 医用画像処理システム、医用画像処理システムの作動方法
JP7335399B2 (ja) 医用画像処理装置及び内視鏡システム並びに医用画像処理装置の作動方法
WO2022209390A1 (ja) 内視鏡システム及びその作動方法
CN107105987A (zh) 图像处理装置、图像处理装置的工作方法、图像处理装置的工作程序和内窥镜装置
US12051201B2 (en) Image processing device capable of accurately determining ulcerative colitis by using a medical image and method of operating the same
JP7637683B2 (ja) プロセッサ装置、プロセッサ装置の作動方法
US12254626B2 (en) Image processing device, endoscope system, and image processing method
CN111343899A (zh) 内窥镜系统及其工作方法
JP7386347B2 (ja) 内視鏡システム及びその作動方法
US20250134345A1 (en) Endoscope system and method of operating the same
US20230030057A1 (en) Processor device and method of operating the same
JP6756054B2 (ja) 電子内視鏡用プロセッサ及び電子内視鏡システム
JP7593796B2 (ja) 医用画像処理システム、医用画像処理システムの作動方法
JP7447281B2 (ja) プロセッサ装置、プロセッサ装置の作動方法
JP7411515B2 (ja) 内視鏡システム及びその作動方法
WO2015156039A1 (ja) 器官画像撮影装置
CN117500426A (zh) 医疗图像处理装置、内窥镜系统及医疗图像处理装置的工作方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21841432

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022536191

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21841432

Country of ref document: EP

Kind code of ref document: A1