JPWO2018167816A1 - Imaging device - Google Patents

Abstract

This imaging device (100) has a luminance value smaller than the first threshold value (Th1) in the region where the luminance value changes in the fluorescent image (Xb) imaged by the imaging unit (1). An image processing unit (5) that performs a predetermined image processing for sharpening an area in the vicinity of the weak change area, and sharpening the area in the vicinity of the weak change area And a control unit (3) for displaying on the small monitor (2) and an external monitor (M) an image on which predetermined image processing has been performed.

Description

  The present invention relates to an imaging device, and more particularly to an imaging device including an image processing unit that performs predetermined image processing on a captured image.

  2. Description of the Related Art Conventionally, an imaging apparatus that includes an image processing unit that performs predetermined image processing on a captured image is known. Such an imaging apparatus is disclosed in, for example, Japanese Patent Application Laid-Open No. 2015-188559.

  Japanese Patent Application Laid-Open No. 2015-188559 discloses a camera (imaging unit) that captures infrared rays (fluorescence) generated from a contrast agent injected into an imaging target by irradiating infrared rays (excitation light) and an image taken by the camera. A medical imaging apparatus (image processing apparatus) including an image processing unit that performs image processing on the infrared rays and a display unit that displays an infrared image that has been subjected to image processing is disclosed. Then, an infrared image of the contrast agent displayed on the display unit is judged and diagnosed by a doctor's visual (visual). In addition, in the infrared image, it is considered that a region with a relatively large change in luminance value and a region with a small change in luminance value are generated with the intensity of the fluorescence luminance value generated from the contrast agent before and after the contrast agent is flowed. For this reason, the region where the change in luminance value is small becomes relatively dark.

JP2015-188559A

  However, in the medical imaging apparatus (imaging apparatus) disclosed in Japanese Patent Application Laid-Open No. 2015-188559, an area where the change in the brightness value before and after the contrast agent is flowed is relatively dark. There is a possibility that an oversight of an area where the change in the size is small will occur. Therefore, there is a demand for an imaging apparatus that can display an image so as to prevent an oversight by a user from occurring in an area where the change in luminance value is small (an area where the contrast agent flow is weak).

  The present invention has been made to solve the above-described problems, and one object of the present invention is to suppress the occurrence of oversight by a user in an area where the change in luminance value is small. It is providing the imaging device which can display an image on.

  In order to achieve the above object, an imaging apparatus according to a first aspect of the present invention includes an imaging unit for imaging an imaging target, and image processing for processing an image of the imaging target captured by the imaging unit. And a control unit that controls the imaging unit and causes the display unit to display an image captured by the imaging unit, and the image processing unit is a region where a change in luminance value has occurred in the image captured by the imaging unit Among these, a weak change area where a change in luminance value smaller than the first threshold value is determined is determined, and predetermined image processing for sharpening is performed on an area near the weak change area. The control unit is configured to cause the display unit to display an image on which predetermined image processing has been performed on a region in the vicinity of the weak change region.

  In the imaging device according to one aspect of the present invention, as described above, the image processing unit is smaller than the first threshold value in the region where the luminance value has changed in the image captured by the imaging unit. A weak change area where a change in luminance value has occurred is determined, and predetermined image processing for sharpening is performed on an area in the vicinity of the weak change area, and the control unit is set in an area in the vicinity of the weak change area. On the other hand, the display unit is configured to display an image on which predetermined image processing for sharpening has been performed. As a result, the area in the vicinity of the weak change area is sharpened, and therefore, an area over which the change in the brightness value occurs among areas where the change in the brightness value is small (weak change area) is overlooked by the user. An image can be displayed so as to suppress this.

  In the present application, “change in luminance value” indicates a change in luminance value from a certain reference image (for example, an image in an initial state).

  In the imaging device according to the above aspect, the image processing unit is preferably configured to perform predetermined image processing for emphasizing the weak change region on a region other than the weak change region near the weak change region. Yes. With this configuration, an area where the change in luminance value is relatively small (weakly changing area) without changing information on the area where the luminance value has changed (relative luminance or the like) An image can be displayed so as to suppress the occurrence of oversight by the user.

  In this case, preferably, the image processing unit is configured to perform predetermined image processing for emphasizing the weak change region by surrounding the region near the weak change region with a frame line. With this configuration, an area with a relatively small change in luminance value (weakly changing area) is indicated by a frame line without changing information on the area in which the luminance value has changed (such as relative luminance). The image can be displayed so as to emphasize and suppress the occurrence of oversight by the user by the frame line.

  In the configuration in which predetermined image processing for emphasizing the weak change region is performed on the region other than the weak change region in the vicinity of the weak change region, preferably, the image processing unit is other than the weak change region in the vicinity of the weak change region. This area is configured to perform predetermined image processing for emphasizing the weakly changed area by painting the area with a predetermined color. With this configuration, an area with a relatively small change in luminance value (weakly changing area) is filled with a color without changing information on the area in which the luminance value has changed (such as relative luminance). The image can be displayed so as to suppress the occurrence of oversight by the user by color painting.

  In the configuration in which predetermined image processing for emphasizing the weak change region is performed on the region other than the weak change region in the vicinity of the weak change region, preferably, the image processing unit is other than the weak change region in the vicinity of the weak change region. By blinking this area, predetermined image processing for emphasizing the weak change area is performed. With this configuration, an area with a relatively small change in luminance value (weakly changing area) is highlighted by blinking without changing information on the area in which the luminance value has changed (relative luminance, etc.). In addition, the image can be displayed so as to suppress the occurrence of oversight by the user by blinking.

  In the imaging apparatus according to the above aspect, the image preferably includes a first image for displaying the entire imaged object and a second image for displaying a specific area of the imaged object, The image processing unit discriminates a weak change region in the second image picked up by the image pickup unit from among regions where the luminance value has changed, and a predetermined region for sharpening the region near the weak change region. The control unit is configured to perform image processing, and the control unit superimposes the first image and the second image that has been subjected to predetermined image processing for sharpening the weakly changed region. An image is displayed on the display unit. If comprised in this way, the 1st image which images the whole to-be-photographed object by visible light, and fluorescence of the contrast agent excited by near-infrared light (contrast agent area | region of a to-be-photographed object) are imaged, for example. A predetermined image for sharpening a relatively weak part (weakly changing region) of the fluorescence of the contrast agent in the second image when displaying the superimposed image superimposed with the second image to be performed Since the process is performed, an area over which a change in luminance value derived from the second image in the superimposed image viewed by the user such as the doctor is relatively small (weak change area) is overlooked by the user such as the doctor. It is possible to display a superimposed image so as to suppress the occurrence of.

  In the present application, “the entire object to be imaged” indicates the entire image capturing range of the object to be imaged, and does not mean the entire object to be imaged itself.

  In the imaging apparatus according to the above aspect, the image processing unit is preferably configured to perform a thinning process that changes the weakly changed region into a line image. With this configuration, for example, when an area where the change in luminance value is relatively small (weakly changing area) is greatly spread and blurred, the area where the change in luminance value is relatively small is changed to a line image. By sharpening the image, it is possible to display an image so as to further suppress the occurrence of oversight by the user.

  In the present application, “change to a line image” means, for example, image processing in which a portion (peripheral portion) that becomes the edge of a certain image (region) is cut and only a portion that becomes a skeleton of the image (region) is left Is shown.

  In the imaging device according to the above aspect, the image processing unit preferably has a second smaller value than the first threshold value among the weakly changed regions in which the luminance value changes smaller than the first threshold value. A first weak change region in which a change in luminance value smaller than the threshold value of the first weak change region is distinguished from a second weak change region other than the first weak change region, and the first weak change in the vicinity of the first weak change region It is configured to perform predetermined image processing that emphasizes regions other than the region more strongly than regions other than the second weak change region in the vicinity of the second weak change region. With this configuration, when emphasizing a region (weak change region) in which the change in luminance value is relatively small, a region in which the change is smaller (first weak change region) among the regions in which the change in luminance value is small. Can be displayed with more emphasis. As a result, it is possible to display an image so as to suppress the occurrence of an oversight by the user with respect to an area with a smaller change (first weak change area) that is more likely to be overlooked.

  In the imaging device according to the above aspect, it is preferable that the image processing unit performs a process of determining a weak change region when the change amount of the luminance value is equal to or less than the first threshold value and equal to or greater than the lower limit value. It is configured. With this configuration, it is possible to suppress the display of an image in which predetermined image processing for sharpening is erroneously performed on an area in which a luminance value has slightly changed due to noise. .

  In the imaging device according to the above aspect, it is preferable to input at least one of a parameter for determining the weak change region and a parameter related to how to perform predetermined image processing for sharpening. Is further provided. According to this configuration, it is possible to appropriately perform predetermined image processing for distinction of weakly changing regions and sharpening by changing parameters according to the type (part) of the imaging target and imaging conditions. it can.

  The imaging device according to the above aspect preferably further includes a display unit, and the display unit is a predetermined image for sharpening the weak change region with respect to a region other than the weak change region near the weak change region. The processed image is configured to be displayed. With this configuration, an image obtained by performing predetermined image processing for sharpening on a region (weakly changing region) in which a change in luminance value is relatively small (a weakly changing region) by the display unit included in the imaging device. Can be visually recognized by the user.

  In this case, preferably, the imaging unit includes a fluorescent image that is an image including fluorescence generated from a contrast agent injected into a blood vessel or a lymph vessel of the imaging target, and a visible image that is an image of visible light of the imaging target. The image processing unit is configured to be able to continuously capture images, and in the fluorescence image captured by the imaging unit, while the contrast agent is flowing, the weakly changing region of the fluorescence image is determined. The predetermined image processing for sharpening the weak change region is performed in real time on the region other than the weak change region in the vicinity of the weak change region. A superimposed image obtained by superimposing a fluorescent image on which a predetermined image processing for sharpening is performed on a change area is configured to be displayed in real time. If comprised in this way, the visible image which images the whole to-be-photographed object by visible light, The fluorescence image which images fluorescence of the contrast agent excited by the near-infrared light (contrast agent area | region of a to-be-photographed object), and By superimposing images superimposed on each other in real time, when performing surgery based on the displayed superimposed image (contrast medium information), a user such as a doctor immediately diagnoses during surgery. be able to. In addition, since there is no waiting time for displaying an image (moving image), the time required for surgery or the like can be shortened. In addition, when the superimposed image is displayed in real time, predetermined image processing for sharpening is performed on a region where the fluorescence of the contrast agent is relatively weak (weakly changed region), so the flow of the contrast agent is weak. A superimposed image can be displayed in such a weak change area so as to prevent an oversight by a user such as a doctor.

  In the present application, “blood vessel” and “lymph vessel” are broad concepts including the entire vascular system and lymph system. For example, “lymphatic vessels” include lymph nodes.

  According to the present invention, as described above, it is possible to provide an imaging device capable of displaying an image so as to suppress an oversight by a user from occurring in an area where the change in luminance value is small. .

1 is a block diagram illustrating an overall configuration of an imaging apparatus according to an embodiment of the present invention. It is a figure explaining a mode that the imaging device by one Embodiment of this invention is used. It is an example of the image displayed on the small monitor and external monitor by one Embodiment of this invention. It is a figure explaining the weak change area | region in the fluorescence image by one Embodiment of this invention. It is a figure explaining the breadth and thinning process of the fluorescence by one Embodiment of this invention. It is a figure explaining the 1st threshold value, 2nd threshold value, lower limit value, and emphasis process by one Embodiment of this invention. It is a figure explaining the flow of the process which acquires the superimposition image by one Embodiment of this invention. It is a figure for demonstrating the magnitude | size of the area | region of the vicinity of the weak change area by one Embodiment of this invention. It is a figure explaining the weak change area | region in the image by the modification of one Embodiment of this invention. It is a figure explaining the flow of the process which acquires the image by which the predetermined image process by the modification of one Embodiment of this invention was performed.

  DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments embodying the present invention will be described below with reference to the drawings.

[Embodiment]
First, the configuration of the imaging apparatus 100 according to the present embodiment will be described with reference to FIGS. In the present embodiment, the imaging apparatus 100 is a medical imaging apparatus used for angiography and lymphatic imaging in, for example, surgery and examination. For example, the imaging apparatus 100 can be used for a blood vessel suture operation or a breast cancer sentinel lymph node operation, and the position, shape, and internal blood of a blood vessel or lymph vessel (lymph node) of the imaged subject P (patient). Alternatively, it is used by a user U (doctor or the like) to confirm (evaluate) the flow of lymph. Specifically, in the suture operation of the blood vessel of the heart, blood stagnation or backflow may occur in the blood vessel that is sutured without problems by visual observation with visible light. Confirming that the flow is in progress.

(Configuration of imaging device)
As shown in FIG. 1, the imaging apparatus 100 according to the present embodiment includes a housing C, an arm unit A, an imaging unit 1, a small monitor 2, a control unit 3, a storage unit 4, and an image processing unit 5. And a wheel portion 6 and an input portion 7. The imaging unit 1 is supported by the arm part A. The small monitor 2 and the arm part A are provided in the upper part of the housing C. The control unit 3, the storage unit 4, and the image processing unit 5 are provided inside the housing C. The wheel unit 6 is provided in the lower part of the housing C. The input unit 7 is provided on the front surface of the housing C. The imaging apparatus 100 is connected to an external monitor M and configured to exchange information (image data or the like). The imaging unit 1 is an example of the “imaging unit” in the claims. The small monitor 2 and the external monitor M are examples of the “display unit” in the claims. The small monitor 2 is an example of a “display unit” included in the imaging device of the claims.

  The imaging apparatus 100 extracts a visible image Xa (visible light image, see FIG. 3) and a fluorescent image Xb (fluorescence image, see FIG. 3) of the object P (see FIG. 2), and extracts the visible image that has been extracted. A superimposed image Xc obtained by combining Xa and the fluorescence image Xb is output. A detailed configuration of the imaging apparatus 100 will be described later. Here, the visible image Xa displays the entire object to be imaged P (within the imaging range). The fluorescent image Xb is a region (specific region) to which the contrast agent of the imaging target P is administered, which is imaged by near-infrared light having a wavelength that cannot be visually recognized by the naked eye (visually) of the user U (doctor or the like). Is displayed. The visible image Xa and the fluorescent image Xb are examples of the “first image” and the “second image” in the claims, respectively.

  The imaging unit 1 includes a visible light irradiation unit 11, a near infrared light irradiation unit 12, and a camera unit 13. A plurality of visible light irradiation units 11 and near infrared light irradiation units 12 are arranged so as to surround the periphery of the lens unit 13a of the camera unit 13, and are alternately arranged in a certain pattern (for example, near the visible light irradiation unit 11 and the near light irradiation unit 11). The infrared light irradiators 12 are arranged in an annular shape so that the infrared light irradiators 12 are alternately arranged one by one. Reflected light (visible light) from the surface of the skin S of the imaging target P and fluorescence (near infrared light) generated from the contrast agent enter the lens unit 13a. The camera unit 13 further includes a beam splitter (not shown) and two imaging element units (not shown) inside. External light (information reflected from the surface of the skin S and fluorescence from the contrast agent) including information on the imaging target P captured from the lens unit 13a is separated into a visible light wavelength and a fluorescence wavelength by a beam splitter. Is done. Then, the visible image Xa and the fluorescent image Xb are continuously captured by the imaging element unit corresponding to each wavelength of the separated external light.

  That is, the imaging unit 1 is a fluorescence that is an image including a visible image Xa that is a visible light image of the imaging target and fluorescence generated from a contrast agent injected into the blood vessel or lymphatic vessel (lymph node) of the imaging target P. The image Xb can be continuously captured in the form of a moving image. When only the fluorescent image Xb is captured, the arrangement of the visible light irradiation unit 11, the beam splitter, and the imaging element unit corresponding to the wavelength of visible light may be omitted. Moreover, the visible light irradiation part 11 and the near-infrared light irradiation part 12 contain a light emitting diode (LED), for example. In addition, the imaging element unit includes, for example, a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and the like.

  Moreover, the excitation light irradiated from the near infrared light irradiation part 12 has a wavelength of 780-800 nm, for example. Further, the fluorescence generated from the contrast agent (fluorescent agent) administered to the imaging target P has a wavelength of 800 to 850 nm, for example. As the contrast agent (fluorescent agent), for example, indocyanine green (ICG) which is a fluorescent dye is used. When indocyanine green (ICG) is used as a contrast agent (fluorescent agent), the excitation light is, for example, near infrared light having a wavelength of 800 nm to 820 nm, and the fluorescence generated from indocyanine green (ICG) is about 830 nm. Near-infrared fluorescence having a wavelength of That is, since the excitation light and fluorescence cannot be directly visually recognized by the user U (doctor or the like), the region (pixel) in which the near-infrared light in the fluorescence image Xb (contrast agent fluorescence) is detected is For example, it is colored and displayed in an appropriate visible color such as white, blue, or green so that it can be easily distinguished from the color (for example, the color of skin or blood) of the imaging target P (human body) in the visible image Xa. Is done. Further, the visible light (white light) emitted from the visible light irradiation unit 11 is reflected on the surface of the skin S of the imaging target P, and then captured by an imaging element unit (not shown) and displayed as a visible image Xa. Is done.

  As shown in FIG. 2, the arm part A expands and contracts while being bent and freely changes the position of the imaging unit 1 to be supported in order to capture the imaging target region of the imaging target P (patient) in the imaging range. It is comprised so that it can be moved. In addition, the imaging unit 1 can be freely moved by the user U (doctor or the like) grasping and pulling the grip portion (not shown) of the imaging unit 1 by hand. Further, the position of the imaging unit 1 is fixed at a position where the user U (doctor or the like) releases his / her hand. Moreover, the arm part A may be driven (moved) by electric power.

  As shown in FIG. 2, the small monitor 2 included in the imaging apparatus 100 is disposed on the upper portion of the housing C, and an external monitor M provided separately from the imaging apparatus 100 operates on the imaging target P (patient). It arrange | positions in the user's U (doctor etc.) front direction (A1 direction side). Further, the external monitor M is arranged at a height at which various images displayed when the user U (doctor or the like) performs a treatment on the imaging target P (patient) can be visually recognized. Thereby, independent of the position of the imaging device 100, the superimposed image Xc or the like can be displayed at a position that is easy for the user U (doctor or the like) to visually recognize. Further, by disposing the small monitor 2 on the upper part of the imaging device 100, for example, while confirming the superimposed image Xc displayed on the small monitor 2 with the imaging device 100 alone, the input unit 7 (described later) ) Can be set. A plurality of external monitors M may be arranged, and the arrangement may be omitted.

  Here, in the present embodiment, the small monitor 2 and the external monitor M display the visible image Xa, the fluorescence image Xb, and the superimposed image Xc output from the control unit 3 in real time as shown in FIG. Is configured to be possible. Note that the small monitor 2 and the external monitor M can change and display the arrangement order and the sizes of the visible image Xa, the fluorescent image Xb, and the superimposed image Xc. Further, the small monitor 2 and the external monitor M can also display a selected specific image, for example, by displaying only the superimposed image Xc. Each image in FIG. 3 is an image of a female breast.

  The control unit 3 is configured by an information processing apparatus such as a PC (personal computer). The control unit 3 includes a CPU (Central Processing Unit) and the like. The control unit 3 causes the PC to function as the control unit 3 of the imaging apparatus 100 by executing a control program stored in the storage unit 4 (described later). The control unit 3 controls the irradiation intensity of visible light and near-infrared light by the imaging unit 1, controls to output parameters (described later) input to the input unit 7 to the image processing unit 5, and the arm unit A. Control for driving the wheel unit 6 and control for displaying the image data output from the image processing unit 5 on the small monitor 2 and the external monitor M are performed.

  The storage unit 4 includes an HDD (hard disk drive), a memory, and the like, and stores (records) images captured by the imaging unit 1 and images processed by the image processing unit 5 (described later). The storage unit 4 stores various programs executed by the control unit 3 and the image processing unit 5. Note that the various images include moving images that are continuously captured.

  The image processing unit 5 acquires the visible image Xa and the fluorescent image Xb based on image data (detected signal) acquired by an image sensor unit (not shown) included in the image pickup unit 1. Here, the image processing unit 5 performs predetermined image processing (described later) for sharpening in a region (weakly changed region) in the vicinity of a region where the change in luminance value of the contrast agent in the fluorescent image Xb is small. Then, the image processing unit 5 generates a superimposed image Xc obtained by superimposing the visible image Xa and the fluorescent image Xb, and displays the superimposed image Xc on the small monitor 2 and the external monitor M via the control unit 3. In addition, the image processing unit 5 also performs processing for adjusting luminance values, color tone, and contrast of various images as a whole, processing for removing noise in the image, processing for GUI (graphical user interface) other than the captured image, and the like. May be performed.

  The wheel unit 6 is easily moved by the user U (doctor or the like) pushing the imaging device 100 by hand, or by driving a drive unit (not shown) connected to the wheel unit 6. It is provided to make it possible. Note that the imaging apparatus 100 may have a stationary configuration without the wheel unit 6.

  Here, in the present embodiment, the input unit 7 is configured to accept input of parameters for discriminating the weak change region (described later) and parameters relating to how to perform predetermined image processing (described later). Has been.

  Specifically, for example, the input unit 7 has a size of an area in the vicinity of the weak change area designated to emphasize the weak change area by the user U including a doctor, an assistant, an operator (engineer), and the like. For determining the size of the margin (margin portion) of the weakly changing region (see margin RM in FIG. 8). Further, the input unit 7 receives input of parameters relating to the thickness of the frame line displayed for emphasizing the weak change region, the size of the luminance value of the frame line, the color of the frame line, and the like. In addition, the input unit 7 is colored and painted to emphasize the weak change region, and the fill color, the display luminance value, and the blink for the portion other than the weak change region near the weak change region to be blinked. Accepts input of parameters related to the cycle of The input unit 7 receives input of parameters relating to setting of values such as the first threshold value Th1, the second threshold value Th2, and the lower limit value ThL. Further, the input unit 7 receives an input of a parameter relating to how much the target area is to be thinned by thinning (to make a line image). In addition, the input unit 7 sets an exceptional region (for example, a region that is not a target for treatment or inspection) in which predetermined image processing (described later) for sharpening such as thinning and highlighting is not performed in the fluorescent image Xb. Accepts input of parameters.

  The input unit 7 is configured to accept other input operations on the imaging apparatus 100. For example, in addition to the above, the input unit 7 adjusts the irradiation intensity and irradiation range of the visible light irradiation unit 11 and the near-infrared light irradiation unit 12 based on the input operation, and starts and stops irradiation, imaging Input operations relating to adjustment of imaging sensitivity by the unit 1, driving of the arm unit A, adjustment of image display brightness of the small monitor 2 and the external monitor M, display methods of various images, and the like are accepted. The input unit 7 includes input devices such as a keyboard, a mouse, and a touch panel, for example.

(Predetermined image processing for sharpening)
Below, based on FIGS. 4-8, the predetermined image processing for sharpening by the imaging device 100 (image processing part 5) by this embodiment is demonstrated.

  The imaging apparatus 100 according to the present embodiment clearly displays various images so as to suppress the occurrence of oversight by the user U (physician or the like) in an area where the change in luminance value is small (an area where the contrast agent flow is weak). By displaying the image after performing predetermined image processing for conversion, it is configured to support the confirmation work using the contrast agent that relied on the visual judgment of the user U (doctor or the like). Yes.

  Here, in the present embodiment, the image processing unit 5 has a luminance value smaller than the first threshold Th1 in the region where the luminance value has changed in the fluorescent image Xb captured by the imaging unit 1. A weak change area in which a change has occurred is discriminated, and predetermined image processing for sharpening is performed on an area near the weak change area. Further, the image processing unit 5 determines the weak change region of the fluorescent image Xb in the fluorescence image Xb captured by the imaging unit 1 while the contrast agent is being flown, and also weakens in the vicinity of the weak change region. For areas other than the change area, predetermined image processing for sharpening the weak change area is performed in real time.

  Specifically, as shown in FIG. 4, it is confirmed that the fluorescence image Xb has a weak flow region (weakly changing region) P1 in which the luminance change due to the fluorescence of the contrast agent is small and the luminance change due to the fluorescence of the contrast agent is large. There is a flow region P2 that is easy to do. In such a situation where a weak flow and a flow that can be easily confirmed are mixed, it is very difficult to keep track of all the luminance value changes only by visual observation of the user U (doctor or the like). Therefore, there is a possibility that the user U (doctor or the like) may overlook the weak flow region (weakly changing region) P1, and therefore image processing (thinning processing and enhancement processing described later) is performed. Is called. Note that the body line of the imaging target P represented by the dotted line in FIG. 4 is not actually captured in the fluorescent image Xb but is captured by the visible image Xa.

  Therefore, the image processing unit 5 is smaller in real time than the first threshold value Th1 (see FIG. 6), among the pixels of the fluorescent image Xb, compared to the first threshold value Th1 (see FIG. 6). A pixel region is determined as a weak change region, and thinning processing (see FIGS. 5 and 7) and enhancement processing (see FIGS. 6 and 7), which are predetermined image processing for sharpening, are performed on the weak change region. Do it. The first threshold value Th1 may be set as an absolute value, for example, or may be set as a value of a certain percentage (%) with respect to the maximum luminance value of the pixels in the fluorescent image Xb. A histogram of the luminance values of the pixels in the fluorescent image Xb may be acquired and set as a value that includes up to a certain percentage (%) of pixels in the histogram. Further, the parameter relating to the first threshold value Th1 can be changed by the user U (doctor or the like) via the input unit 7.

  In the present embodiment, the image processing unit 5 is configured to perform a thinning process for changing the weakly changed region into a line image in the fluorescent image Xb.

  Specifically, for example, as shown in FIG. 5A, when a contrast medium is injected into a lymphatic vessel (or blood vessel) P0 existing under the skin S of the imaging target P (patient), near red Since the fluorescence L2 generated from the contrast agent when irradiated with the excitation light L1 (near infrared light) from the external light irradiation unit 12 is diffused while passing through the skin S, the width increases (for example, the surface of the skin S). It spreads to about 3 cm in the part) and is blurred. As a result, although the actual width of the lymphatic vessel (blood vessel) P0 is W1, the width of the spread of the fluorescence L2 from the contrast agent to be imaged widens as W2. In addition, diffusion and absorption occur in the skin S, and the luminance of the fluorescent L2 to be imaged becomes small (dark). Therefore, it is difficult for the user U (physician or the like) to visually recognize the fluorescence image Xb by the fluorescence L2, and it is difficult to make an appropriate determination on the fluorescence L2 generated from the lymphatic vessel (blood vessel).

  Therefore, as shown in FIG. 5B and FIG. 5C, the image processing unit 5 relatively reduces the luminance value of the pixel in the peripheral portion of the target region (the skirt portion in the graph) ( Alternatively, a thinning (line imaging) process is performed in which the portion (peripheral portion) that becomes the edge of the target region is cut and only the portion that becomes the skeleton of the region is left. At this time, the image processing unit 5 does not change the luminance value of the portion serving as the skeleton of the region. As a result, as shown in FIGS. 7A and 7B, the region of the contrast agent that is blurred and spread in the fluorescent image Xb becomes a tubular region that is sharpened and extracted. It should be noted that the extent to which an image is thinned by thinning (whether to make a line image) can be changed by a parameter input from the input unit 7. Further, the image processing unit 5 is configured to perform a thinning process for forming a line image on the display of pixels in which a luminance change stronger than the weakly changing region is generated in the region where the luminance value has changed. May be. Thereby, as shown in FIGS. 7A and 7B, thinning is performed not only in the region where the change in luminance value is small, but also in the region where the change in luminance value is large. As a whole, blurring of the contrast medium becomes sharp and clear.

  Further, in the present embodiment, the image processing unit 5 in the fluorescent image Xb is less than the first threshold value Th1 in the weak change region in which the luminance value change smaller than the first threshold value Th1 occurs. A first weak change region in which a change in luminance value smaller than the small second threshold value Th2 occurs is discriminated from other second weak change regions, and the first weak change region in the vicinity of the first weak change region is discriminated. Predetermined image processing is performed to emphasize regions other than the first weak change region more strongly than regions other than the second weak change region in the vicinity of the second weak change region. Further, the image processing unit 5 is configured to perform a process of determining a weak change region when the change amount of the luminance value is equal to or less than the first threshold value Th1 and equal to or greater than the lower limit value ThL.

  Specifically, as shown in FIG. 6, there is a relationship of first threshold value Th1> second threshold value Th2> lower limit value ThL. The image processing unit 5 determines a pixel having a luminance value less than the second threshold Th2 and greater than or equal to the lower limit ThL as the first weak change region, and is less than the first threshold Th1 and the second threshold. A pixel having a luminance value equal to or greater than the value Th2 is determined as the second weak change region, and predetermined image processing (described later) for emphasis is performed. In addition, the enhancement process is not performed on a pixel in which a change in luminance value smaller than the lower limit value ThL that appears irregularly due to noise or the like occurs.

  In the present embodiment, the image processing unit 5 is configured to perform predetermined image processing for emphasizing the weak change region on regions other than the weak change region near the weak change region.

  Specifically, as shown in FIG. 6 and FIG. 7C, when emphasizing a region near the weak change region, the pixel information (luminance value, etc.) in the weak change region is not changed, but weak. Image processing is performed on an area other than the weak change area near the change area. Furthermore, the image processing unit 5 is configured to perform image processing so as not to hinder the display of pixels in which the luminance change is stronger than the weak change region among the regions where the luminance value has changed. . As a result, in the fluorescence image Xb and the superimposed image Xc, the information on the fluorescence of the contrast agent flowing through the blood vessels and lymph vessels (lymph nodes) (luminance values, etc.) is accurately displayed without being distorted, and the weakly changed region is emphasized. Is displayed. The flow of the contrast agent in FIG. 6 has already been thinned.

  Specifically, in the present embodiment, the image processing unit 5 surrounds a region near the weak change region with a frame line, paints a region other than the weak change region near the weak change region in a predetermined color, and weakly changes the region. By flashing areas other than the weak change area in the vicinity of, predetermined image processing for emphasizing the weak change area is performed.

  Specifically, before and after the flow of the contrast agent, the first weak change region where the change in the luminance value is larger than the lower limit value ThL and smaller than the second threshold value Th2, and the second threshold value. The second weakly changed regions in which the luminance value changes that are larger and smaller than the first threshold value Th1 are emphasized. The emphasis processing sets the surrounding area (neighboring area) so as to leave a certain distance from the area to be emphasized, and displays the pixels at the edge of the surrounding area with a frame line, and the inside of the surrounding area These pixels are colored by avoiding the pixels in the region to be emphasized, and the pixels in the colored region are blinked at a constant cycle. Thereby, the image processing unit 5 does not change the information (relative luminance value, chromaticity value, etc.) of the first and second weak change areas to be emphasized, without changing the first and second weak areas. Highlight the change area.

  At this time, as shown in FIGS. 3 and 7C, the first weak change region is emphasized more strongly than the second weak change region. For example, the thickness of the border line of the first weak change region, the brightness of the color to be filled, the blinking speed, and the like are configured to be larger than those of the second weak change region. In addition, the first weak change region and the second weak change region are used to determine which of the fill color of the border line and the adjacent region, the drawing of the border line, the fill of the color and the emphasis by blinking, etc. You may change between. The filled color is a different color (for example, a complementary color or a dark achromatic color) that is distinguishable from the color that is colored when the weakly changed region (near-infrared light detection region) in the fluorescent image Xb is displayed. It is comprised so that. It should be noted that the range in which the color is filled may be slightly spaced from the weakly changed region (colored with a spacing).

  In addition, the shape of the area in which the frame line and the color fill (flashing) are displayed is configured to be a quadrangle. Further, the size of the area where the frame line and the color fill (flashing) are displayed is, for example, constant from the left and right (X direction) and up and down (Y direction) ends of the weak change area, as shown in FIG. Are determined so as to be separated by a margin RM (margin). Note that the size of the frame line and the area where the color fill (flashing) is displayed are not only the size of the margin RM (margin), but also other frame lines (color fill area) or weak change areas. Other than the above, it is also determined that the region does not overlap with the region where the luminance value has changed (the region of the contrast agent in which the luminance value has changed larger than the first threshold Th1). The margin RM is an example of the “parameter” in the claims.

  Then, the control unit 3 superimposes the visible image Xa, the fluorescent image Xb, and the visible image Xa on the fluorescent image Xb on which the predetermined image processing for sharpening is performed on the weakly changed region. The superimposed image Xc is displayed on the small monitor 2 and the external monitor M (see FIG. 3). Note that, in the fluorescent image Xb and the superimposed image Xc displayed on the small monitor 2 and the external monitor M, for example, the thinning process is performed on both the fluorescent image Xb and the superimposed image Xc, and a predetermined value for emphasis is given. Image processing (frame drawing, color painting, and blinking) is performed only on the superimposed image Xc. That is, the image of FIG. 7B is displayed as the fluorescence image Xb, and the image of FIG. 7C is displayed as the superimposed image Xc as shown in FIG.

(Effect of embodiment)
In the present embodiment, the following effects can be obtained.

  In the present embodiment, as described above, the image processing unit 5 causes the luminance smaller than the first threshold Th1 in the region where the luminance value changes in the fluorescent image Xb captured by the imaging unit 1. A weak change region in which a change in value has occurred is discriminated, and predetermined image processing for sharpening is performed on a region in the vicinity of the weak change region, and the control unit 3 is set in a region in the vicinity of the weak change region. On the other hand, the fluorescent image Xb and the superimposed image Xc that have been subjected to predetermined image processing for sharpening are configured to be displayed on the small monitor 2 and the external monitor M. As a result, the area in the vicinity of the weak change area is sharpened, and therefore the user U (doctor or the like) is compared with the area where the change in the brightness value is small (weak change area) among the areas where the change in the brightness value occurs. The fluorescent image Xb (superimposed image Xc) can be displayed so as to suppress the occurrence of oversight.

  Here, when the user U (doctor or the like) performs an operation or the like while observing the fluorescence of the contrast agent in the blood vessels or lymph vessels displayed on the external monitor M or the like, the user U (doctor or the like) flows the contrast agent. If this is missed, it may cause re-administration (re-examination) of the contrast medium or re-operation. In order to reduce the burden on the imaging target P (patient) due to an increase in the operation time or the like when performing surgery or the like, the user U (doctor or the like) There is a situation in which it is necessary to make a judgment while observing the flow of the contrast medium in the imaging region in real time without reconsideration by rewinding the moving image). Therefore, as described above, by using the imaging device 100 of the present embodiment as a medical imaging device, the user U (doctor or the like) misses the contrast agent image, and the contrast is increased. Re-administration of drugs, re-operation, re-examination, etc. can be suppressed. As a result, it is possible to suppress adverse health effects on the imaging target P (patient). In addition, the contrast agent is re-administered or imaged (displayed), and the image (movie) is taken back and viewed again. The burden on the patient (imaged object P) can be reduced by increasing the length.

  In the present embodiment, as described above, the image processing unit 5 is configured to perform predetermined image processing for emphasizing the weak change region with respect to regions other than the weak change region in the vicinity of the weak change region. . As a result, the user U (with respect to the region (weak change region) in which the change in luminance value is relatively small (weak change region) without changing the information on the region in which the change in luminance value has occurred (relative luminance or the like). The fluorescent image Xb and the superimposed image Xc can be displayed so as to suppress oversight by a doctor or the like.

  In the present embodiment, as described above, the image processing unit 5 performs predetermined image processing for emphasizing the weak change region by surrounding the region near the weak change region in the superimposed image Xc with a frame line. Configure as follows. This makes it possible to emphasize and use areas with relatively small changes in luminance values (weakly changing areas) with a border without changing information on areas where luminance values have changed (relative luminance, etc.). The superimposed image Xc can be displayed so as to suppress the occurrence of oversight by the person U (doctor or the like) by the frame line.

  Further, in the present embodiment, as described above, the image processing unit 5 emphasizes the weak change region by painting a region other than the weak change region near the weak change region in the superimposed image Xc with a predetermined color. It is configured to perform predetermined image processing. Thereby, without changing the information (relative luminance, etc.) of the area where the luminance value has changed, the area where the luminance value change is relatively small (weakly changing area) is emphasized by color painting, The superimposed image Xc can be displayed so as to suppress the occurrence of oversight by the user U (such as a doctor) by color filling.

  In the present embodiment, as described above, the image processing unit 5 causes the predetermined image to emphasize the weak change region by blinking the region other than the weak change region in the vicinity of the weak change region in the superimposed image Xc. Configure to perform processing. Thereby, without changing information (relative luminance, etc.) of the area where the luminance value has changed, the area where the luminance value change is relatively small (weakly changing area) is highlighted by blinking, and the user The superimposed image Xc can be displayed so as to suppress the occurrence of oversight by U (doctor or the like) by blinking.

  In the present embodiment, as described above, the image acquired (captured) by the imaging unit 1 is the visible image Xa (first image) for displaying the entire captured object P and the captured object P. And the fluorescent image Xb (second image) for displaying the specific region of the image processing unit 5 in the fluorescent image Xb captured by the imaging unit 1 The weak change area is discriminated, and predetermined image processing for sharpening is performed on the area in the vicinity of the weak change area, and the control unit 3 sharpens the visible image Xa and the weak change area. The superimposed image Xc obtained by superimposing the fluorescent image Xb on which predetermined image processing has been performed is displayed on the small monitor 2 and the external monitor M. As a result, a visible image Xa that captures the entire imaging object P with visible light, and a fluorescence image Xb that captures fluorescence of the contrast agent excited by near-infrared light (contrast agent region of the imaging object P). When the superimposed image Xc in which the images are superimposed is displayed, predetermined image processing for sharpening is performed on the relatively weak fluorescence portion of the contrast agent in the fluorescence image Xb. Superimposition is performed so as to suppress the occurrence of an oversight by a user U such as a doctor with respect to a region (weak variation region) in which a change in luminance value derived from the fluorescent image Xb in the superimposed image Xc seen by U is relatively small. The image Xc can be displayed.

  In the present embodiment, as described above, the image processing unit 5 is configured to perform the thinning process for changing the weakly changed region in the fluorescent image Xb into a line image. As a result, for example, when an area where the change in luminance value is relatively small (weak change area) is widened and blurred, the area where the change in luminance value is relatively small (weak change area) is changed to a line image. By making it clear, the fluorescent image Xb and the superimposed image Xc can be displayed so as to further suppress the occurrence of oversight by the user U (doctor or the like).

  Further, in the present embodiment, as described above, the image processing unit 5 performs the first processing among the weak change regions in which the change in the luminance value smaller than the first threshold Th1 occurs in the superimposed image Xc. The first weak change region is discriminated from the first weak change region in which the luminance value change smaller than the second threshold value Th2 smaller than the threshold value Th1 is generated, and the other second weak change region is determined. Predetermined image processing is performed to emphasize regions other than the first weak change region near the region more strongly than regions other than the second weak change region near the second weak change region. As a result, when emphasizing a region with a relatively small change in luminance value (weakly changing region), a region with a smaller change (first weakly changing region) among regions having a small change in luminance value is more strongly emphasized. Can be displayed. As a result, it is possible to display the superimposed image Xc so as to suppress the occurrence of an oversight by the user U (doctor or the like) in an area where the change is smaller (first weak change area) that is more likely to be overlooked. it can.

  Further, in the present embodiment, as described above, the image processing unit 5 causes the weak change when the amount of change in the luminance value is equal to or less than the first threshold Th1 and equal to or greater than the lower limit ThL in the superimposed image Xc. It is configured to perform processing for determining an area. Thereby, it is possible to suppress the display of the superimposed image Xc in which predetermined image processing for sharpening is erroneously performed on an area where the luminance value slightly changes due to noise.

  In the present embodiment, as described above, the imaging apparatus 100 accepts parameters for determining the weakly changed region and parameters related to how to perform predetermined image processing for sharpening. An input unit 7 is provided. Thus, by changing the parameter according to the type (part) of the imaging target P and the imaging condition, it is possible to appropriately perform the predetermined image processing for the weak change region discrimination and the sharpening.

  In the present embodiment, as described above, the imaging apparatus 100 includes the small monitor 2, and the small monitor 2 is clarified in the weak change region with respect to the region other than the weak change region near the weak change region. The fluorescent image Xb and the superimposed image Xc that have been subjected to predetermined image processing for the display are displayed. Accordingly, the fluorescent image Xb in which predetermined image processing for sharpening is performed on a region (weakly changing region) in which a change in luminance value is relatively small by the small monitor 2 provided in the imaging device 100. In addition, the superimposed image Xc can be visually recognized by the user U (doctor or the like).

  In the present embodiment, as described above, the imaging unit 1 includes the fluorescence image Xb that is an image including fluorescence generated from the contrast agent injected into the blood vessel or lymphatic vessel of the imaging target P, and the imaging target P. The visible image Xa, which is an image of visible light, is configured to be continuously imaged, and the image processing unit 5 is in the process of flowing the contrast agent in the fluorescence image Xb captured by the imaging unit 1. In addition, the weak change area of the fluorescent image Xb is discriminated, and predetermined image processing for sharpening the weak change area is performed in real time on areas other than the weak change area near the weak change area. Then, the small monitor 2 and the external monitor M display in real time a superimposed image Xc obtained by superimposing the visible image Xa and the fluorescent image Xb obtained by performing predetermined image processing for sharpening the weakly changed region. To do To be able to make up. As a result, a visible image Xa that captures the entire image pickup object P with visible light, and a fluorescence image Xb that captures the fluorescence of the contrast agent excited by the near-infrared light (the contrast agent region of the image pickup object). By displaying the superimposed image Xc in real time in real time, when performing surgery or the like based on the displayed superimposed image Xc (contrast medium information), a user U such as a doctor can immediately diagnose during the operation. It can be performed. In addition, since there is no waiting time for displaying an image (moving image), the time required for surgery or the like can be shortened. Further, when displaying the superimposed image Xc, predetermined image processing for sharpening is performed on a relatively weak part of the contrast agent fluorescence, so that the contrast agent flow is weak in a weak change region. Thus, it is possible to display the fluorescent image Xb and the superimposed image Xc so as to suppress the occurrence of oversight by the user U such as a doctor.

[Modification]
The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description of the embodiments but by the scope of claims, and further includes all modifications (variants) within the meaning and scope equivalent to the scope of claims.

  For example, in the above embodiment, the imaging unit (imaging unit) 1 captures the visible image Xa (first image) and the fluorescent image Xb (second image), and the image processing unit 5 sharpens the fluorescent image Xb. An example in which the superimposed image Xc obtained by superimposing the visible image Xa and the fluorescence image Xb on the basis of the predetermined image processing for generating the superimposed image Xc and displaying the generated superimposed image Xc is shown. The present invention is not limited to this. In the present invention, one image may be captured by the imaging unit (imaging unit) 1.

  Specifically, the imaging apparatus 200 according to the modification includes a reflected agent from the imaging target P and a contrast agent administered to the imaging target P by the imaging unit 10 as illustrated in FIGS. 9 and 10A. Is captured (acquired) as one image Xo. Next, as shown in FIG. 10B, the image processing unit 50 generates an area in which the luminance value changes before and after the contrast agent is flowed from the image Xo captured by the imaging unit 10 (the contrast agent that generates fluorescence). Pixel corresponding to the flow) is extracted. In addition, the image processing unit 50 extracts a tubular region by thinning (line imaging) the region where the extracted luminance value changes, and the luminance value of the region where the luminance value changes changes. A region where the change is small (weakly changing region) is determined. In addition, the image processing unit 50 starts from the weak change area, the first weak change area where the change in luminance value is smaller (darker), and the second weak change where the change in luminance value is relatively large (relatively bright). Further distinguish the area. Note that the weak change region, the first weak change region, and the second weak change region are discriminated based on the first threshold value Th1, the second threshold value Th2, and the lower limit value ThL, as in the above embodiment. Is done.

  Then, the image processing unit 50 performs processing for enhancing the first weak change region and the second weak change region so that the first weak change region is emphasized more strongly. Thereby, as shown in FIG.10 (c), the weak change area | region is emphasized in the image Xo. As a result, an image Xo in which the thinning process and the enhancement process have been performed on the weakly changed region in which the weak luminance value has changed is displayed on the small monitor 2 and the external monitor M by the control unit 30. In addition, about the structure and effect similar to the said embodiment, while attaching | subjecting the same code | symbol, description was abbreviate | omitted.

  In the above-described embodiment, the image processing unit emphasizes the area excluding the weak change area in the vicinity of the weak change area and the thinning process for the weak change area in order to sharpen the weak change area. Although an example is shown in which both predetermined image processing (frame drawing, color painting, and blinking) is performed, the present invention is not limited to this. In the present invention, the image processing unit may be configured to perform only one of the thinning process and the predetermined image process for emphasizing the weakly changed region.

  Further, in the above embodiment, when emphasizing the weak change area, the image processing unit draws a frame line in the vicinity of the weak change area, and fills and blinks colors in areas other than the weak change area in the vicinity of the weak change area. Although an example is shown in which all the processes are performed, the present invention is not limited to this. In the present invention, the image processing unit may be configured to perform only one of frame drawing, color painting, and blinking. Further, the weakly changed region may be emphasized by predetermined image processing other than these.

  In the above embodiment, the image processing unit determines the weak change region based on the first threshold value and the second threshold value, and the first weak change region and the second weak change region. Although the example which discriminate | determines is shown, this invention is not limited to this. In the present invention, the image processing unit may be configured to determine only the weak change region based on only the first threshold value. In addition, the image processing unit is arranged in three or more regions such as the first weak change region, the second weak change region, and the third weak change region based on the magnitude of the change amount of the luminance value. You may be comprised so that the discrimination | determination which divides a weak change area | region may be performed.

  In the above-described embodiment, an example in which the image processing unit discriminates an area where the change amount of the luminance value is equal to or greater than the lower limit value as the weak change area has been described. In the present invention, the image processing unit may not be provided with a lower limit value, and may be configured to discriminate all regions in which a change in luminance value smaller than the first threshold value has occurred as a weak change region.

  Further, in the above-described embodiment, an example in which the shape of the area where the frame line or the color fill (flashing) is displayed is a rectangle, but the present invention is not limited to this. In the present invention, the shape of the area where the frame line or the color fill (flashing) is displayed may be other than a quadrangle (for example, an ellipse). In addition, the shape of the area where the frame line or the color fill (flashing) is displayed corresponds to the shape of the weakly changing area to be emphasized (for example, along the shape of the weakly changing area). ) May be determined.

  Moreover, although the emphasis process and the thinning process are performed on the superimposed image and only the thinning process is performed on the fluorescent image in the above embodiment, the present invention is not limited thereto. In the present invention, for example, a fluorescent image that has been highlighted may be displayed, or a fluorescent image that has not been thinned may be displayed.

  In the above-described embodiment, the input unit is configured to accept both a parameter for determining the weakly changed region and a parameter related to how to perform predetermined image processing for sharpening. However, it may be configured to accept only one of them.

  Moreover, in the said embodiment, although the imaging device was provided with the input part, the imaging device does not need to be provided with an input part.

  In the above embodiment, an example in which the imaging apparatus includes a small monitor has been described. However, the imaging apparatus may not include a small monitor.

  In the above-described embodiment, an example in which the imaging apparatus is used as a medical imaging apparatus that captures a fluorescent image of a blood vessel or a lymph vessel (lymph node) of a human body that is an imaging target is shown, but the present invention is not limited thereto. I can't. In the present invention, for example, the imaging device is used as a pipeline monitoring camera, images far-infrared light based on the temperature of the fluid flowing in the pipeline, and has a small change in luminance value (weak change region). May be configured as a thermography (far-infrared light imaging) device that displays the image clearly. Further, the imaging device may be configured as a chemical inspection device that images light generated by a chemical reaction and sharpens and displays a region where the reaction is relatively weak and the change in luminance value is small. In addition, the imaging device may be configured as a monitoring camera, a surgical microscope, or an endoscope. Moreover, the electromagnetic waves (light) imaged by the imaging unit (imaging unit) are not limited to near infrared light and visible light, but include medium and far infrared light, microwaves, ultraviolet light, X-rays, γ rays, and the like. Radiation may be used.

1 Imaging unit (imaging unit) 2 Small monitor (display unit)
3 Control unit 5 Image processing unit 7 Input unit 100, 200 Imaging device M External monitor (display unit) P Imaged object P1, P2 Blood vessel or lymph vessel P0 Lymph vessel RM margin (parameter) Th1 First threshold Th2 First Threshold value of 2 ThL Lower limit value Xa Visible image (first image) Xb Fluorescent image (second image)
Xc superimposed image Xo image

Claims (12)

An imaging unit for imaging the imaging target;
An image processing unit for processing an image of the imaging target imaged by the imaging unit;
A control unit that controls the imaging unit and displays the image captured by the imaging unit on a display unit;
The image processing unit determines, in the image captured by the imaging unit, a weakly changed region in which a luminance value change smaller than a first threshold value occurs among regions in which a luminance value change has occurred. , Configured to perform predetermined image processing for sharpening in an area in the vicinity of the weak change area,
The said control part is an imaging device comprised so that the said image by which the said predetermined image process for the sharpening was performed with respect to the area | region near the said weak change area | region was displayed on the said display part.   The said image processing part is comprised so that the said predetermined image processing which emphasizes the said weak change area with respect to area | regions other than the said weak change area near the said weak change area may be performed. Imaging device.   The imaging according to claim 2, wherein the image processing unit is configured to perform the predetermined image processing that emphasizes the weak change region by surrounding a region near the weak change region with a frame line. apparatus.   The image processing unit is configured to perform the predetermined image processing for emphasizing the weak change area by painting an area other than the weak change area near the weak change area in a predetermined color. The imaging device according to claim 2 or 3.   The image processing unit is configured to perform the predetermined image processing for emphasizing the weak change region by blinking regions other than the weak change region in the vicinity of the weak change region. Or the imaging device of 3. The image includes a first image for displaying the entire object to be imaged and a second image for displaying a specific area of the object to be imaged,
The image processing unit discriminates the weakly changed region in the second image picked up by the image pickup unit from among the regions where the luminance value has changed, and sharpens the region near the weakly changed region. Configured to perform the predetermined image processing for
The control unit displays a superimposed image obtained by superimposing the first image and the second image on which the predetermined image processing for sharpening is performed on the weakly changed region on the display unit. The imaging device according to claim 1, wherein the imaging device is configured to be displayed.   The imaging device according to claim 1, wherein the image processing unit is configured to perform a thinning process that changes the weakly changed region into a line image.   The image processing unit has a luminance smaller than a second threshold smaller than the first threshold in the weakly changed region in which a luminance value smaller than the first threshold is changed. A first weak change region in which a value change has occurred and a second weak change region other than the first weak change region are discriminated, and regions other than the first weak change region in the vicinity of the first weak change region are determined. The predetermined image processing that enhances stronger than the region other than the second weak change region in the vicinity of the second weak change region is performed. The imaging device according to item.   The image processing unit is configured to perform a process of discriminating the weak change region when a change amount of a luminance value is equal to or less than the first threshold value and equal to or more than a lower limit value. The imaging apparatus of any one of -3.   The apparatus further comprises an input unit that receives an input of at least one of a parameter for determining the weak change region and a parameter related to how to perform the predetermined image processing for sharpening. The imaging device according to any one of 1 to 3. The display unit further includes
The display unit is configured to display the image on which the predetermined image processing for sharpening has been performed in the weak change area for an area other than the weak change area in the vicinity of the weak change area. The imaging device according to any one of claims 1 to 3. The imaging unit continuously includes a fluorescence image that is the image including fluorescence generated from a contrast agent injected into a blood vessel or a lymph vessel of the imaging target, and a visible image that is the image of visible light of the imaging target. Configured to be able to capture images
The image processing unit determines the weak change region of the fluorescent image while the contrast agent is being flowed in the fluorescent image picked up by the image pickup unit, and near the weak change region. It is configured to perform the predetermined image processing for sharpening the weak change area in real time for areas other than the weak change area,
The display unit can display a superimposed image obtained by superimposing the visible image and the fluorescent image on which the predetermined image processing for sharpening is performed on the weakly changed region in real time. The imaging device according to claim 11, which is configured.

Images