JP2022035491A - Imaging control apparatus, imaging apparatus, imaging control method, and program - Google Patents

Abstract

To capture an image in an appropriate exposure state while reducing power consumption.SOLUTION: An imaging control apparatus 100 includes: an imaging control unit 111 which causes an imaging apparatus 200 to image an insertion section inserted in a hole part connected to an object, together with the object, while controlling lighting of a light emitting unit 230; and a setting unit 112 which sets at least one of imaging state of the imaging apparatus 200 and light quantity of the light emitting unit 230, on the basis of image data of an image representing the insertion section captured without lighting of the light emitting unit 230 in accordance with the control by the imaging control unit 111 on the imaging apparatus 200, so as to be different between the case where the insertion section is a first insertion section and the case where the insertion section is a second insertion section different in light reflectance from the first insertion section. The imaging control unit 111 controls the imaging apparatus 200 and the light emitting unit 230 corresponding to at least one of the imaging state and the light quantity set by the setting unit 112, on the basis of the settings, to acquire image data for recording the object.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image pickup control device, an image pickup device, an image pickup control method and a program.

Conventionally, a device that emits a flash of light during photography has been used. For example, in the flash control device disclosed in Patent Document 1, preliminary light is emitted before the strobe is actually emitted and the image is taken, the reflected light from the object to be photographed at the time of the preliminary light is measured, and the light is measured according to the measurement result. It controls the amount of light emitted by the strobe.

Japanese Patent No. 4858591

In the flash control device disclosed in Patent Document 1, the optimum amount of light emitted from the strobe is obtained by performing preliminary light emission before the main light emission, but there is a problem that the power consumption increases due to the preliminary light emission. was there.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an image pickup control device, an image pickup device, an image pickup control method, and a program capable of taking a picture in an appropriate exposure state while reducing power consumption. do.

In order to achieve the above object, the image pickup control device according to the present invention is
A control means for causing an image pickup device to take an image of an insertion portion inserted into a hole connected to the target while controlling the illumination of the lighting device together with the target.
Based on the image data of the image representing the insertion portion imaged without being illuminated by the lighting device according to the control of the image pickup device by the control means, at least one of the image pickup state by the image pickup device and the light amount by the lighting device is obtained. As a setting means for setting the insertion portion to be different from each other depending on whether the insertion portion is the first insertion portion or the insertion portion is the second insertion portion having a light reflectance different from that of the first insertion portion. , Equipped with
The control means controls the image pickup device and the lighting device corresponding to the at least one based on at least one of the image pickup state set by the setting means and the light amount by the lighting device. Acquire image data for recording.

According to the present invention, it is possible to shoot under an appropriate exposure state while reducing power consumption.

It is a figure which shows the functional structure example of the image pickup apparatus which concerns on 1st Embodiment. It is a figure explaining an example of the appearance of the speculum which concerns on 1st Embodiment, and the positional relationship between a speculum and an image pickup apparatus at the time of photographing. It is a figure explaining the image which took the speculum from the entrance side. It is a flowchart of the image pickup control processing which concerns on 1st Embodiment. It is a flowchart of the image pickup control process which concerns on 2nd Embodiment. It is a flowchart of the image pickup control processing which concerns on 3rd Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In each drawing, the same or corresponding parts are designated by the same reference numerals.

(First Embodiment)
The image pickup apparatus 200 according to the first embodiment is an apparatus for photographing the cervix in the back of a human vagina as an image pickup target, and is a so-called colposcopy camera. As shown in FIG. 1, the image pickup apparatus 200 includes a lens 210, an image pickup unit 220, a light emitting unit 230, an operation unit 240, a display unit 250, and an image pickup control device 100. The image pickup apparatus 200 images the cervix with the amount of light and the image pickup state set by the image pickup control device 100. Here, the amount of light is a value indicating the intensity of the light emitted by the light emitting unit 230. Further, the image pickup state includes parameters related to the exposure of the image pickup apparatus 200 (each value such as ISO sensitivity, aperture value (F value), exposure time (shutter speed), hereinafter referred to as "exposure parameter").

The lens 210 collects light from an image pickup target such as the cervix on an image pickup element included in the image pickup unit 220. The lens 210 has a function of adjusting the focal length and the amount of extension of the lens so that the light from the image pickup target is focused on the image sensor.

The image pickup unit 220 includes, for example, an image pickup element such as a CCD (Charge Coupled Device) image sensor and a CMOS (Complementary Metal Oxide Semiconductor) image sensor. This image pickup element receives the reflected light from the image pickup target that has passed through the lens 210 and converts it into an electric signal to capture an image.

The light emitting unit 230 includes a light emitting element such as an LED (Light Emitting Diode) and illuminates the object to be photographed. The light emitting unit 230 functions as a lighting device. The light emitting unit 230 is provided in the vicinity of the lens 210, for example, as shown in FIG. FIG. 2 shows an example in which the image pickup device 200 includes one light emitting unit 230 on the upper portion of the lens 210, but the image pickup device 200 may include a plurality of light emitting units 230. In this case, the image pickup apparatus 200 may be provided with a plurality of light emitting units 230 in a ring shape around the lens 210.

The operation unit 240 is a user interface such as a push button switch, and receives an operation input from the user. The image pickup apparatus 200 includes, for example, a shooting button or the like as an operation unit 240.

The display unit 250 includes a display device such as a liquid crystal display, and displays a user interface for various operations and captured images.

As shown in FIG. 1, the image pickup control device 100 includes a control unit 110 and a storage unit 120.

The control unit 110 is composed of a CPU (Central Processing Unit) or the like, and controls the image pickup control device 100 and the image pickup device 200 by executing a program stored in the storage unit 120.

The storage unit 120 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and stores a program executed by the CPU of the control unit 110, necessary data, and the like.

The control unit 110 functions as an image pickup control unit 111, a setting unit 112, and a recording unit 113 shown in FIG. 1 by executing a program stored in the storage unit 120.

The imaging control unit 111 controls the illumination of the light emitting unit 230 together with the imaging target (for example, a speculum described later) inserted into a hole (for example, the vagina) connected to the imaging target (for example, the cervix). , The image pickup device 200 is made to take an image. For example, the image pickup control unit 111 sets the amount of light of illumination by the light emitting unit 230 and the image pickup state (exposure parameter) at the time of image pickup by the image pickup unit 220 of the image pickup apparatus 200 to the set values set by the setting unit 112, respectively. The image pickup unit 220 controls to image the image to be photographed. Then, the image pickup control unit 111 controls the image pickup device 200 and the light emitting unit 230 corresponding to at least one of them based on at least one of the image pickup state by the image pickup device 200 and the light amount by the light emitting unit 230 set by the setting unit 112. By doing so, the image data for recording the image pickup target captured by the image pickup unit 220 is acquired. The image pickup control unit 111 functions as a control means.

The setting unit 112 sets the amount of light of illumination by the light emitting unit 230 and the imaging state (exposure parameter) at the time of imaging by the imaging unit 220. More specifically, the setting unit 112 is in an image pickup state by the image pickup device 200 based on the image data of the image representing the speculum imaged without being illuminated by the light emitting unit 230 according to the control of the image pickup device 200 by the image pickup control unit 111. And the case where the speculum is the first insertion portion described later and the case where the speculum is the second insertion portion described later having a light reflectance different from that of the first insertion portion for at least one of the light amounts by the light emitting unit 230. So, set them so that they are different from each other. The setting unit 112 functions as a setting means.

The recording unit 113 records the image data acquired by the image pickup control unit 111 in the storage unit 120 as an image file.

When photographing the cervix with the image pickup apparatus 200, the speculum 300 shown in FIG. 2 is inserted into the vagina connected to the cervix from the tip side (A side shown in FIG. 2), and the entrance of the speculum 300 is inserted. The cervix is photographed from the side (B side shown in FIG. 2) through the speculum 300. The speculum 300 is divided into an upper part 301 and a lower part 302, and the tip side can be opened and closed with the main part 303 as a fulcrum. The user can observe and photograph the cervix at the back of the vagina from the entrance side of the speculum 300 through the space between the upper 301 and the lower 302. Since the speculum 300 is inserted into the vagina, it is also called an insertion portion.

The lighting state in the vagina at the time of photographing changes depending on the material (steel, plastic, etc.) and the surface treatment (silver plating, black coating, translucent, etc.) of the speculum 300. In the present embodiment, as the speculum 300, a Cuzco speculum made of steel whose surface is silver-plated (hereinafter referred to as "silver-plated speculum" or "first insertion portion") and steel whose surface is painted black are used. It is assumed that one of two types of Cuzco speculum (hereinafter referred to as "black-painted speculum" or "second insertion part") is used.

When a black-painted speculum is used as the speculum 300, the reflection of light by the speculum 300 is suppressed as much as possible, so that the inside of the vagina is in a relatively stable lighting state. Therefore, when a black-painted speculum is used, a good image can be taken by fixing the light intensity and the exposure parameter to appropriate values. In addition, when a silver-plated speculum is used as the speculum 300, light is reflected by the speculum 300, so if an image is taken with an appropriate light amount and exposure parameters with a black-painted speculum, there is a possibility of overexposure. high. Therefore, for example, assuming that the exposure parameter is fixed to the optimum value for shooting, when using a silver-plated speculum, it is necessary to suppress the amount of light emitted from the light emitting unit 230 as compared with the case where a black-painted speculum is used. Occurs.

In order to perform such a process, the type of the speculum 300 used may be determined, and the amount of light emitted from the light emitting unit 230 may be adjusted according to the determination result. Since the speculum 300 is usually made of the same material on both the tip side and the entrance side and has the same surface processing, the color of the portion protruding from the vagina (entrance side) even when it is inserted into the vagina. It is possible to determine the type of the speculum 300 from the brightness and the like. Further, the portion protruding from the vagina can be photographed without any problem even if the light emitting unit 230 does not normally emit light (for example, under room light or sunlight).

Therefore, the image pickup apparatus 200 photographs the vicinity of the entrance of the speculum 300 and its surroundings in a state where the light emitting unit 230 does not emit light, determines the type of the speculum 300 based on the image data of the captured image, and then determines the type of the speculum 300. , The cervix is photographed in a state where the optimum amount of light according to the type of the speculum 300 is emitted from the light emitting unit 230. The image data is image data of an image taken by the vaginal mirror 300 (image data of an image representing the vaginal mirror 300), but may be image data consisting of only a part of an image including the vaginal mirror. , Image data of an image showing a part of a vaginal mirror may be used.

When the speculum 300 is inserted into the vagina and the cervical region 401 is photographed through the speculum 300 with the imaging device 200, as shown in FIG. 3, the skin 402 around the vagina is formed around the speculum 300. The part 403 near the entrance of the speculum 300 was photographed and was photographed as a part hatched by diagonal lines in FIG. 3, and the part inserted into the vagina of the speculum 300 was blackened in FIG. Taken as. The speculum 300 is usually made of the same material as a whole as shown in FIG. 2, but in FIG. 3, for convenience, it is projected from the vagina of the speculum 300 by being hatched or painted black. It makes it possible to distinguish between the part that is in the vagina and the part that is inserted in the vagina.

If the light emitting portion 230 does not emit light at the time of photographing, the portion inserted into the vagina of the speculum 300 and the cervical portion 401 at the back thereof are not exposed to the light, so that the portion is photographed as a black region. To. However, the portion 403 near the entrance of the speculum 300 and the portion of the skin 402 around the vagina are photographed with brightness according to the lighting condition around the imaging location.

In this embodiment, the ISO sensitivity is set to 400, the aperture is opened (F value is the minimum), and the exposure time (shutter speed) is set to 1/100 second as the optimum exposure parameters, and the optimum exposure parameters are set. The amount of light is emitted from the light emitting unit 230. Here, the optimum amount of light when photographing the cervix 401 with the above-mentioned optimum exposure parameter using a black-painted speculum is set as a light amount reference value (for example, a light amount of 10). Then, with the same exposure parameters, the optimum amount of light when the speculum 300 is changed to a silver-plated speculum is smaller than that when a black-painted speculum is used as described above. It becomes a value (for example, 8) multiplied by a reference coefficient (for example, 0.8).

Next, the image pickup control process executed by the control unit 110 will be described with reference to FIG. This process is a process of determining the type of the speculum 300 and photographing the cervix in a state where the optimum amount of light according to the speculum 300 used is emitted from the light emitting unit 230. The image pickup control process is started when a user gives an instruction to start the image pickup control process via the operation unit 240. For example, when the user presses the shooting button on the operation unit 240, the imaging control process is started.

First, the image pickup control unit 111 captures a determination image by the image pickup unit 220 without causing the light emitting unit 230 to emit light (step S101). Then, the control unit 110 acquires a determination image in which the internal region of the speculum 300 is black and the vicinity of the entrance of the speculum 300 and the surrounding portion thereof are photographed with a brightness corresponding to the lighting state of the imaging location. .. This determination image 400 is an image taken, for example, in FIG. 3, where the portion of the cervical portion 401 is also taken as a black region.

Next, the setting unit 112 determines whether or not the speculum 300 is a silver-plated speculum based on the image data of the determination image (step S102). In this determination, the image data of the determination image 400 as shown in FIG. 3 acquired in step S101 is used, for example, the brightness of 403 near the entrance of the vaginal mirror 300 (for example, the average value of the brightness I of the pixels in the vicinity thereof). ) And the brightness of the skin 402 around it (for example, the average value of the brightness I of the pixels in the vicinity thereof).

The luminance I is calculated by the following formula (1) when the pixel value is expressed by R (the size of the red component), G (the size of the green component), and B (the size of the blue component). Value. The pixel values R, G, and B are values from 0 to 1, respectively, and the luminance I is also a value from 0 to 1.
I = 0.299 × R + 0.587 × G + 0.114 × B ... (1)

For example, if the average value of the brightness of the pixels in the portion 403 near the entrance is smaller than the average value of the brightness of the pixels in the portion of the surrounding skin 402, the setting unit 112 indicates that the speculum 300 is not a silver-plated speculum. Judged as a black-painted speculum. Then, if the average value of the brightness of the pixels in the portion 403 near the entrance is equal to or greater than the average value of the brightness of the pixels in the portion of the surrounding skin 402, the setting unit 112 determines that the speculum 300 is a silver-plated speculum. ..

Normally, the positional relationship between the speculum 300 and the imaging device 200 when photographing the cervix 401 is almost constant, so the focus setting is also based on this positional relationship, and the cervix 401 is in focus. It is possible to set in advance. Further, for example, after first focusing on the 403 near the entrance of the speculum 300, the distance to the cervix 401 (this "distance from the 403 near the entrance of the speculum 300 to the cervix 401" is referred to as "distance from the entrance of the speculum 300 to the cervix 401" below for convenience. You may focus on the cervix 401 by moving the in-focus position by the cervical focus adjustment distance). When the cervix 401 is set to be in focus, in the determination image 400, the portion 403 near the entrance of the speculum 300 is photographed in an out-of-focus state, but which of the determination images 400 Regarding whether the pixel of the part 403 near the entrance of the speculum 300 exists in the vicinity and the pixel of the part of the skin 402 around the speculum 300 exists in which part of the determination image 400, the speculum is used. Since the positional relationship between the 300 and the image pickup device 200 is almost constant, it can be obtained in advance.

Further, when photographing the determination image 400, the image pickup control device 100 focuses on the portion 403 near the entrance of the speculum 300 when the photographing button is pressed halfway, and adjusts the focus for the cervix when the image is fully pressed. You may try to focus on the cervix 401 by moving the focus position by a distance. If the part near the entrance of the speculum 300 is focused on, the image recognition shows where in the determination image 400 the vicinity of the entrance of the speculum 300 is located, and in which part of the determination image 400 the vagina is located. Since it is possible to determine whether or not the skin 402 around the vagina is present, the pixel value of the portion 403 near the entrance of the speculum 300 and the pixel value of the portion of the skin 402 around the vagina are determined based on this determination. You may get it.

Since it is possible that there are individual differences in the focus adjustment distance for the cervix, this distance may be set in advance for each imaging target. In addition to the standard cervical focus adjustment distance, the subject is in focus only by the distance increased or decreased in increments of the reference distance (for example, 2 cm) (from the state where the 403 part near the entrance of the speculum 300 is in focus). By moving the position, it may be possible to shoot at a plurality of focus positions. Then, an image in which the cervix 401 is in focus may be automatically selected from the images.

Returning to FIG. 4, if the speculum 300 is not a silver-plated speculum (step S102; No), it is assumed that the speculum is a black-painted speculum, and the setting unit 112 sets the optimum imaging conditions for the black-painted speculum as set values. (Step S103). For example, for the exposure parameter, set the ISO sensitivity to 400, open the aperture (minimum F value), set the exposure time (shutter speed) to 1/100 second, and set the exposure parameter setting value. A light amount reference value (for example, 10) is set as a light amount setting value.

On the other hand, if the speculum 300 is a silver-plated speculum (step S102; Yes), the setting unit 112 sets the optimum imaging conditions for the silver-plated speculum as set values (step S104). For example, for the exposure parameter, set the ISO sensitivity to 400, open the aperture (minimum F value), set the exposure time (shutter speed) to 1/100 second, and set the exposure parameter setting value. A value (for example, 8) obtained by multiplying the above light amount reference value by the silver reference coefficient is set as the light amount setting value.

Then, the image pickup control unit 111 sets the exposure parameter and the amount of light according to the set value set by the setting unit 112 in step S103 or step S104, and prepares for shooting (step S105). Next, the imaging control unit 111 photographs the cervix with the exposure parameters and the amount of light set in the imaging preparation (step S106). Then, the recording unit 113 records the image data of the image captured and acquired by the image pickup control unit 111 in the storage unit 120 as an image file for recording (step S107), and ends the image pickup control process.

In the above-mentioned imaging control process, the imaging state (exposure parameter) is fixed to the optimum value, and the light amount is set to the optimum value according to the fixed imaging state and the speculum 300, but the present invention is not limited to this. .. For example, the amount of light may be fixed, and the imaging state (exposure parameter) may be set to an optimum value according to the fixed amount of light and the speculum 300.

By the image pickup control process described above, it is not necessary to make the light emitting unit 230 emit light when the determination image 400 is taken, so that the power consumption can be reduced, and the type of the speculum 300 used. Since the exposure parameter and the amount of light are set according to the exposure conditions, the cervix can be imaged under an appropriate exposure state.

In the above-described embodiment, it has been described that there are two types of the speculum 300, a black-painted speculum and a silver-plated speculum, but the present invention is not limited to this. Even when other types of speculum 300 are present, the type of speculum 300 is determined based on the image data of the determination image 400 by the same processing, and the type of each speculum 300 is determined. It is possible to set the optimum imaging state and amount of light.

Further, the light amount setting value for the silver-plated speculum does not have to be obtained by calculation as described above. For example, a table in which the optimum light amount or the optimum image quality (exposure parameter) value is determined according to the type of the speculum 300 is stored in the storage unit 120 in advance, and the optimum light amount or the optimum light amount or the optimum light amount or the value is referred to by referring to this table. The imaging state (exposure parameter) may be acquired.

(Modification 1)
In the above-mentioned first embodiment, the optimum exposure parameter and the amount of light are set according to the type of the speculum 300, but the silver-plated speculum reflects various light as compared with the black-painted speculum, so that it is optimal. It is possible that the exposure parameters and the amount of light may change from time to time. Therefore, in the image pickup control device 100 according to the first modification, the processing content of step S103 of the image pickup control process (FIG. 4) is changed to the setting of the exposure parameter and the amount of light by the AE (Automatic Exposure) function.

When the black-painted speculum is used, the image pickup control device 100 according to the first modification may take an image of the cervix in an appropriate exposure state while reducing power consumption, as in the first embodiment. can. Further, when a speculum 300 other than the black-painted speculum is used, the cervix can be imaged in an appropriate exposure state by the AE function.

(Modification 2)
As mentioned above, the use of a silver-plated speculum reflects light in various ways. In order to suppress this light reflection, in the image pickup control device 100 according to the second modification, when it is determined that the speculum 300 is a silver-plated speculum, it is in front of the lens 210 (between the imaging target and the lens 210). Insert a polarizing filter in. The position where the polarizing filter is inserted is not limited to the front of the lens 210, but may be in front of the light emitting unit 230.

That is, in the image pickup apparatus 200 according to the second modification, the path (the optical system from the light emitting unit 230 to the image pickup element) in which the light from the light emitting unit 230 is reflected by the image pickup target and the reflected light from the image pickup element is introduced into the image pickup element. It is provided with a polarizing filter provided so that it can be positioned (inserted) on the path) or evacuated from the path. Therefore, in the second modification, the imaging state includes a state in which the polarizing filter is positioned on the path (first state) and a state in which the polarizing filter is retracted from the path (second state). Is done.

Then, in the image pickup control device 100 according to the second modification, the processing content of step S101 of the image pickup control process (FIG. 4) is "The image pickup control unit 111 saves the polarization filter from the path of the optical system and emits light from the light emitting unit 230. Is changed to "take a judgment image with the image pickup unit 220 without emitting light", and the processing content of step S103 is "the image pickup control unit 111 inserts a polarization filter into the path of the optical system, and the setting unit 112 , Set the optimum imaging conditions for the silver-plated speculum as the set value in consideration of the polarization filter. "

When the polarizing filter is inserted into the path of the optical system, the light reaching the image pickup element is considerably suppressed. Therefore, in the second modification, in step S103, as compared with the case where the black-painted speculum is used. The amount of light emitted by the light emitting unit 230 is set slightly brighter (for example, 40%). For example, for the exposure parameter, set the ISO sensitivity to 400, open the aperture (minimum F value), set the exposure time (shutter speed) to 1/100 second, and set the exposure parameter setting value. A value (for example, 14) obtained by multiplying the light amount reference value by a polarization filter coefficient (for example, 1.4) is set as a light amount setting value.

Similar to the first embodiment, the image pickup control device 100 according to the second modification can take an image of the cervix in an appropriate exposure state while reducing power consumption. In addition, by inserting a polarizing filter into the path of the optical system, the cervix can be imaged in a relatively stable exposure state even when a silver-plated speculum is used.

(Modification 3)
In colposcopy cameras, a green filter is often inserted to photograph the cervix. The image pickup apparatus 200 according to the third modification is provided with a green filter, and when photographing the cervix, the image pickup control device 100 inserts a green filter in front of the lens 210 (between the image pickup target and the lens 210). It shall be. However, the position where the green filter is inserted is not limited to the front of the lens 210, and may be in front of the light emitting unit 230. That is, in the image pickup apparatus 200 according to the third modification, the path (the optical system from the light emitting unit 230 to the image pickup element) in which the light from the light emitting unit 230 is reflected by the image pickup target and the reflected light from the image pickup element is introduced into the image pickup element. The green filter can be positioned (inserted) on the path) or evacuated from the path.

However, it is not necessary to insert a green filter when taking a determination image for determining the type of the speculum 300. Therefore, in the image pickup control device 100 according to the modification 3, the processing content of step S101 of the image pickup control process (FIG. 4) is "The image pickup control unit 111 saves the green filter from the path of the optical system and emits light from the light emitting unit 230. Is changed to "take a determination image with the image pickup unit 220 without emitting light."

After that, the imaging control unit 111 performs a process of inserting the green filter into the path of the optical system, and the processing content of step S103 is "The setting unit 112 is a silver-plated vagina in consideration of the insertion of the green filter. It was changed to "Set the optimum imaging conditions for the mirror as the set value", and the processing content in step S104 was "The setting unit 112 is the optimum for the black-painted speculum after considering the insertion of the green filter." It is changed to "Set shooting conditions as setting values". In the imaging control process according to the third modification, the process of inserting the green filter into the path of the optical system may be performed at any timing from immediately after step S101 to immediately before step S106. , Usually performed in step S105.

As described above, in the image pickup control device 100 according to the modification 3, the green filter is evacuated from the path of the optical system when the determination image 400 is taken, so that the green filter is used when determining the type of speculum. It is possible to use image data that is not affected by the above, and it is possible to suppress the probability of erroneously determining the type of speculum.

(Modification example 4)
In the above-described embodiment and modification, the image pickup device 200 has been described as taking an image of visible light, but the image pickup target is not limited to visible light. For example, infrared light or ultraviolet light may be imaged. Then, in that case, the light emitting unit 230 may emit infrared light or ultraviolet light. In the image pickup apparatus 200 according to the fourth modification, the light emitting unit 230 emits infrared light or ultraviolet light, and images infrared light or ultraviolet light.

The imaging control device 100 according to the modified example 4 also adjusts the amount of light according to the type of the speculum 300, as in the first embodiment and the modified example thereof. That is, when using a black-painted speculum, the light amount is set to the light amount reference value (for example, 10), and when using a silver-plated speculum, the light amount reference value is multiplied by the silver reference coefficient. The amount of light is set to the value (for example, 8).

In the image pickup control device 100 according to the modified example 4, even when imaging is performed with infrared light or ultraviolet light, the determination image is taken without causing the light emitting unit 230 to emit light, so that there is no influence of infrared light or ultraviolet light. The type of the speculum 300 can be determined using the image data, and the probability of erroneously determining the type of the speculum 300 can be suppressed.

(Second Embodiment)
In the above-mentioned first embodiment, two types of speculums, a silver-plated speculum and a black-painted speculum, have been used as the speculum 300, but a second embodiment capable of supporting more types of speculums 300 will be described. ..

Since the configurations of the image pickup control device 100 and the image pickup device 200 according to the second embodiment are the same as those of the first embodiment, the description thereof will be omitted.

The image pickup control process according to the second embodiment will be described with reference to FIG. Since this process is a process in which steps S102 to S104 of the image pickup control process according to the first embodiment are replaced with step S111, the process of step S111 will be described.

In step S111, the setting unit 112 acquires the reflectance of light in the speculum 300 based on the image data of the determination image, and sets the imaging conditions based on the acquired reflectance. This reflectance is determined by using the image data of the determination image 400 as shown in FIG. 3 acquired in step S101 with the brightness of 403 near the entrance of the vaginal mirror 300 (for example, the average value of the brightness I of the pixels in the vicinity). It is obtained based on the ratio with the brightness of the surrounding skin 402 (for example, the average value of the brightness I of the pixels in the vicinity thereof).

For example, assuming that the average value of the brightness I of the pixels of the portion 403 near the entrance of the speculum 300 is V and the average value of the brightness I of the pixels of the portion of the skin 402 around it is S, the reflectance R is the following equation. Calculated in (2).
R = V / S ... (2)

Then, for the exposure parameter, for example, the setting unit 112 sets the ISO sensitivity to 400, the aperture to the maximum (F value is the minimum), and the exposure time (shutter speed) to 1/100 second as the exposure parameter setting value. For the amount of light, the value obtained by dividing the light amount reference value (for example, 10) by the correction coefficient (for example, 2) is further divided by the above-mentioned reflectance R (for example, 0.8), and the correction addition value (for example, 5) is obtained. The added value (for example, 11.25) is set as the light amount setting value. When the light amount setting value exceeds the light amount upper limit value (for example, 20) by this calculation, the light amount setting value is reset to the light amount upper limit value, and the light amount setting value becomes less than the light amount lower limit value (for example, 1). In that case, the light amount setting value may be reset to the light amount lower limit value.

Further, the light amount setting value does not have to be obtained by the above-mentioned calculation formula. For example, a table in which the optimum light amount value is determined according to various reflectances may be stored in the storage unit 120 in advance, and the light amount may be acquired from the reflectance by referring to this table.

Since the process is the same as that of the first embodiment except for the process of step S111, the description thereof will be omitted. In the second embodiment described above, as in the first embodiment, the cervix can be imaged under an appropriate exposure state while reducing power consumption. Further, since the optimum amount of light can be set based on the reflectance of the speculum 300, any speculum 300 can be used as well as the black-painted speculum and the silver-plated speculum.

(Third Embodiment)
In the above-described embodiment and modification, the amount of light is set by determining the type of the speculum 300 and calculating the reflectance. However, various set values may be obtained by machine learning, for example, without determining the type of the speculum 300 or calculating the reflectance. Here, a third embodiment in which at least one of the imaging state (exposure parameter) and the amount of light is set by using a neural network will be described.

Since the configurations of the image pickup control device 100 and the image pickup device 200 according to the third embodiment are the same as those of the first embodiment, the description thereof will be omitted. However, the setting unit 112 according to the third embodiment includes a CNN (Convolutional Neural Network). In addition, the exposure parameters were fixed for each of the image data of the judgment image (for example, the ISO sensitivity was 400, the aperture was opened (F value was the minimum), and the exposure time (shutter speed) was set to 1/100 second). It is assumed that a large amount of training data (a set of the image data of the judgment image and the optimum light amount setting value) in which the optimum light amount setting value in the case is given as a correct answer label is prepared.

The CNN provided in the setting unit 112 is optimal when the image data of the determination image in which the vicinity of the entrance of the speculum 300 and its surroundings as shown in FIG. 3 is input in advance using the above-mentioned learning data. Learn so that the set value of the amount of light is output.

The image pickup control process according to the third embodiment will be described with reference to FIG. Since this process is a process in which steps S102 to S104 of the image pickup control process according to the first embodiment are replaced with step S121, the process of step S121 will be described.

In step S121, the setting unit 112 acquires the optimum light amount setting value as the output of the CNN by inputting the image data of the determination image into the trained CNN. Then, for the exposure parameter, for example, the setting unit 112 sets the ISO sensitivity to 400, the aperture to the maximum (F value is the minimum), and the exposure time (shutter speed) to 1/100 second as the exposure parameter setting value. For the light amount, the value output from the CNN is set as the light amount setting value.

Since the process is the same as that of the first embodiment except for the process of step S121, the description thereof will be omitted. In the third embodiment described above, as in the first embodiment, the cervix can be imaged under an appropriate exposure state while reducing power consumption. Further, since the optimum amount of light can be set by the CNN, it is not necessary to determine the type of the speculum 300, and any speculum 300 can be used.

In the above description, the CNN has been described as outputting the optimum light intensity setting value, but this is only an example of how to use the CNN. For example, for each of the image data of the judgment image, when the light amount is fixed to the light amount reference value (for example, 10), the optimum exposure parameter setting values (ISO sensitivity, aperture (F value), exposure time ( Prepare a large amount of training data with shutter speed)) as the correct answer label, and when the image data of the judgment image is input using this training data, the optimum exposure parameter setting value will be output. May be trained in CNN.

By using the CNN learned in this way, it is possible to image the cervix 401 with the optimum exposure parameter while keeping the light amount at the time of light emission of the light emitting unit 230 fixed at the light amount reference value.

Further, neither the exposure parameter nor the amount of light may be fixed. For example, for each of the image data of the determination image 400, the setting values of the optimum exposure parameters (ISO sensitivity, aperture (F value), exposure time (shutter speed)) and the setting values of the optimum light amount are used as correct labels. A large amount of given training data is prepared, and when the image data of the judgment image 400 is input using this training data, CNN is learned so that the optimum exposure parameter setting value and light amount setting value are output. You may let me.

When the CNN trained in this way is used, the optimum exposure parameter and light amount output from the CNN based on the image data of the determination image 400 are used without fixing the exposure parameter and the light amount at the time of light emission of the light emitting unit 230. The cervix 401 can be imaged.

(Other variants)
The present invention is not limited to the above-described embodiments and modifications, and various modifications can be made. For example, each of the second and third embodiments can be combined with each of the modified examples 2 to the modified example 4. Further, it is also possible to combine modified examples (for example, modified examples 2 and modified examples 3). For example, when the second embodiment and the second embodiment are combined and the reflectance R exceeds the reference reflectance (for example, 1.5), a polarizing filter is inserted into the path of the optical system, and the light amount set value is set to the polarizing filter. It may be set to a value multiplied by the polarization filter coefficient (for example, 1.4) as compared with the case where it is not inserted.

Further, by combining the above-mentioned third embodiment and the second modification and using the CNN trained by including the presence / absence of the polarization filter in the correct label of the training data, the setting unit 112 uses various setting values and polarizations output by the CNN. The exposure parameter at the time of shooting, the amount of light, and the presence / absence of the polarization filter may be set based on the presence / absence of the filter.

Further, in the above-described embodiments and modifications, the image pickup device 200 for photographing the human cervix has been described as an example, but the object of the image pickup by the image pickup device 200 is not limited to the human cervix and is not human. It may be the cervix of an animal (eg, dog, cat, cow, pig, horse, etc.).

Further, the object of imaging by the image pickup apparatus 200 is not limited to the cervix, but is an insertion portion such as a speculum 300 such as a mouth, a nasal cavity (entrance of a nasal cavity), an ear canal (entrance of an ear canal), and an anus. If it is an object to be photographed by inserting the image, it may be an object to be photographed by the image pickup apparatus 200. In addition, the image pickup device 200 may be used for taking pictures in pipes at factories or work sites or in gaps where people cannot enter, or in holes in the natural world (animal burrows, tree burrows, cracks and holes in the ground and cliffs). It can also be used for shooting.

That is, the image pickup apparatus 200 generally includes a target (cervical part, throat, wall part of nasal cavity (upper and middle instep, lower instep), wall of ear canal, tympanic membrane, rectum, wall of sewage canal, etc. Insertion part inserted into the hole (vagina, oral cavity, nose hole (entrance of the nasal cavity), ear canal (entrance of the ear canal), anus, pipes such as sewage canal, etc.) connected to the wall of the cavity) (Vaginal speculum, throat mirror, nasal speculum, otoscope, anoscope, sewage tube mirror, etc.) are imaged together with the subject without being illuminated by the light emitting unit 230 to obtain a judgment image 400, and the judgment image 400 is obtained. At least one of the imaging state and the amount of light can be set based on the image data of the above, and can be used when photographing an object existing in the back of the hole based on the setting.

Further, in the above-described embodiment, the image pickup device 200 has been described as having a built-in image pickup control device 100, but the image pickup control device 100 may be a device separate from the image pickup device 200. In this case, both the image pickup control device 100 and the image pickup device 200 are provided with a communication unit, and the image pickup control device 100 is configured to be able to control the image pickup device 200 via the communication unit.

Each function of the image pickup control device 100 can also be performed by a computer such as a normal PC. Specifically, in the above embodiment, the program of the lighting control process performed by the image pickup control device 100 has been described as being stored in the ROM of the storage unit 120 in advance. However, the program can be a flexible disk, a CD-ROM (Compact Disk Read Only Memory), a DVD (Digital Versaille Disc), an MO (Magnet-Optical disc), a memory card, a USB (Universal Serial Bus) memory, or the like. A computer capable of realizing each of the above-mentioned functions may be configured by storing and distributing the program in a recording medium, reading the program into a computer, and installing the program.

Although the preferred embodiment of the present invention has been described above, the present invention is not limited to the specific embodiment, and the present invention includes the invention described in the claims and the equivalent range thereof. Will be. The inventions described in the original claims of the present application are described below.

(Appendix 1)
A control means for causing an image pickup device to take an image of an insertion portion inserted into a hole connected to the target while controlling the illumination of the lighting device together with the target.
Based on the image data of the image representing the insertion portion imaged without being illuminated by the lighting device according to the control of the image pickup device by the control means, at least one of the image pickup state by the image pickup device and the light amount by the lighting device is obtained. As a setting means for setting the insertion portion to be different from each other depending on whether the insertion portion is the first insertion portion or the insertion portion is the second insertion portion having a light reflectance different from that of the first insertion portion. , Equipped with
The control means controls the image pickup device and the lighting device corresponding to the at least one based on at least one of the image pickup state set by the setting means and the light amount by the lighting device. Acquire image data for recording,
Imaging control device.

(Appendix 2)
The setting means is
Based on the image data of the image representing the insertion portion imaged without being illuminated by the lighting device according to the control of the image pickup device by the control means, at least the insertion portion is any of the first and second insertion portions. Judge if there is,
Based on the determination result of whether the insertion portion is the first insertion portion or the second insertion portion, the insertion portion determines at least one of the image pickup state by the image pickup device and the light amount by the lighting device, and the insertion portion is the first insertion portion. The case where the insertion portion is the second insertion portion and the case where the insertion portion is the second insertion portion having a light reflectance different from that of the first insertion portion are set so as to be different from each other.
The image pickup control device according to Appendix 1.

(Appendix 3)
The setting means acquires the reflectance of light in the insertion portion based on the image data of the image representing the insertion portion captured without being illuminated by the lighting device according to the control of the image pickup device by the control means. , At least one of the image pickup state by the image pickup device and the light amount by the lighting device is set based on the acquired reflectance.
The image pickup control device according to Appendix 1.

(Appendix 4)
The setting means inputs image data of an image representing the insertion portion imaged without being illuminated by the lighting device into the neural network according to the control of the image pickup device by the control means, and outputs a value from the neural network. At least one of the image pickup state by the image pickup device and the light amount by the lighting device is set based on the above.
The image pickup control device according to Appendix 1.

(Appendix 5)
The imaging state includes parameters related to the exposure of the imaging device.
The setting means sets the parameters related to the exposure to the same values depending on whether the insertion portion is the first insertion portion and the second insertion portion, and the amount of light from the lighting device is different from each other. Set to value,
The imaging control device according to any one of Supplementary note 1 to 4.

(Appendix 6)
The image pickup device receives an image pickup element that receives the reflected light from the target and converts it into an electric signal, and the light from the lighting device is reflected by the target and the reflected light from the target is introduced into the image pickup device. It has a polarizing filter that is provided so that it can be located and retracted on the path.
The imaging state includes a first state in which the polarizing filter is positioned on the path and a second state in which the polarizing filter is retracted from the path.
The setting means sets the state in which the polarizing filter should be to the first state when the insertion portion is the first insertion portion, and sets the state to the second state when the insertion portion is the second insertion portion. do,
The imaging control device according to any one of Supplementary note 1 to 5.

(Appendix 7)
The image pickup device receives an image pickup element that receives the reflected light from the target and converts it into an electric signal, and the light from the lighting device is reflected by the target and the reflected light from the target is introduced into the image pickup device. It has a green filter provided on the path and can be retracted.
The control means takes an image of the insertion portion inserted into the hole connected to the target together with the target by the image pickup device without illuminating the target with the lighting device in a state where the green filter is retracted from the path. Let me
Then, with the green filter positioned on the path, the image pickup device corresponding to the at least one and the image pickup device corresponding to the at least one based on at least one of the image pickup state set by the setting means and the light amount by the lighting device. By controlling the lighting device, the image data for recording the object is acquired.
The imaging control device according to any one of Supplementary note 1 to 6.

(Appendix 8)
An image pickup device equipped with a lens that collects light from an object onto an image pickup device.
A control means for causing the image pickup device to take an image of the insertion portion inserted into the hole connected to the target while controlling the illumination of the lighting device together with the target.
Based on the image data of the image representing the insertion portion imaged without being illuminated by the lighting device according to the control of the image pickup device by the control means, at least one of the image pickup state by the image pickup device and the light amount by the lighting device is obtained. As a setting means for setting the insertion portion to be different from each other depending on whether the insertion portion is the first insertion portion or the insertion portion is the second insertion portion having a light reflectance different from that of the first insertion portion. , Equipped with
The control means controls the image pickup device and the lighting device corresponding to the at least one based on at least one of the image pickup state set by the setting means and the light amount by the lighting device. Acquire image data for recording,
Imaging device.

(Appendix 9)
The insertion portion inserted into the hole connected to the target is imaged by the imaging device together with the target in a state where the lighting of the lighting device is controlled.
Based on the image data of the image representing the insertion portion captured without being illuminated by the lighting device according to the control, the insertion portion first obtains at least one of the imaging state by the imaging device and the amount of light by the lighting device. The insertion portion is set to be different from each other depending on whether the insertion portion is a second insertion portion having a light reflectance different from that of the first insertion portion.
By controlling the image pickup device and the lighting device corresponding to the at least one based on at least one of the set image pickup state and the amount of light, the image data for recording the target is acquired.
Imaging control method.

(Appendix 10)
On the computer
The insertion portion inserted into the hole connected to the target is imaged by the imaging device together with the target in a state where the lighting of the lighting device is controlled.
Based on the image data of the image representing the insertion portion captured without being illuminated by the lighting device according to the control, the insertion portion first obtains at least one of the imaging state by the imaging device and the amount of light by the lighting device. The insertion portion is set to be different from each other depending on whether the insertion portion is a second insertion portion having a light reflectance different from that of the first insertion portion.
By controlling the imaging device and the lighting device corresponding to the at least one based on at least one of the set imaging state and the amount of light, the image data for recording the target is acquired.
program.

100 ... Imaging control device, 110 ... Control unit, 111 ... Imaging control unit, 112 ... Setting unit, 113 ... Recording unit, 120 ... Storage unit, 200 ... Imaging device, 210 ... Lens, 220 ... Imaging unit, 230 ... Light emitting unit , 240 ... Operation unit, 250 ... Display unit, 300 ... Speculum, 301 ... Upper part, 302 ... Lower part, 303 ... Key part, 400 ... Judgment image, 401 ... Cervix, 402 ... Surrounding skin, 403 ... Entrance Near, BL ... Bus line

Claims (10)

A control means for causing an image pickup device to take an image of an insertion portion inserted into a hole connected to the target while controlling the illumination of the lighting device together with the target.
Based on the image data of the image representing the insertion portion imaged without being illuminated by the lighting device according to the control of the image pickup device by the control means, at least one of the image pickup state by the image pickup device and the light amount by the lighting device is obtained. As a setting means for setting the insertion portion to be different from each other depending on whether the insertion portion is the first insertion portion or the insertion portion is the second insertion portion having a light reflectance different from that of the first insertion portion. , Equipped with
The control means controls the image pickup device and the lighting device corresponding to the at least one based on at least one of the image pickup state set by the setting means and the light amount by the lighting device. Acquire image data for recording,
Imaging control device. The setting means is
Based on the image data of the image representing the insertion portion imaged without being illuminated by the lighting device according to the control of the image pickup device by the control means, at least the insertion portion is any of the first and second insertion portions. Judge if there is,
Based on the determination result of whether the insertion portion is the first insertion portion or the second insertion portion, the insertion portion determines at least one of the image pickup state by the image pickup device and the light amount by the lighting device, and the insertion portion is the first insertion portion. The case where the insertion portion is the second insertion portion and the case where the insertion portion is the second insertion portion having a light reflectance different from that of the first insertion portion are set so as to be different from each other.
The imaging control device according to claim 1. The setting means acquires the reflectance of light in the insertion portion based on the image data of the image representing the insertion portion captured without being illuminated by the lighting device according to the control of the image pickup device by the control means. , At least one of the image pickup state by the image pickup device and the light amount by the lighting device is set based on the acquired reflectance.
The imaging control device according to claim 1. The setting means inputs image data of an image representing the insertion portion imaged without being illuminated by the lighting device into the neural network according to the control of the image pickup device by the control means, and outputs a value from the neural network. At least one of the image pickup state by the image pickup device and the light amount by the lighting device is set based on the above.
The imaging control device according to claim 1. The imaging state includes parameters related to the exposure of the imaging device.
The setting means sets the parameters related to the exposure to the same values depending on whether the insertion portion is the first insertion portion and the second insertion portion, and the amount of light from the lighting device is different from each other. Set to value,
The imaging control device according to any one of claims 1 to 4. The image pickup device receives an image pickup element that receives the reflected light from the target and converts it into an electric signal, and the light from the lighting device is reflected by the target and the reflected light from the target is introduced into the image pickup device. It has a polarizing filter that is provided so that it can be located and retracted on the path.
The imaging state includes a first state in which the polarizing filter is positioned on the path and a second state in which the polarizing filter is retracted from the path.
The setting means sets the state in which the polarizing filter should be to the first state when the insertion portion is the first insertion portion, and sets the state to the second state when the insertion portion is the second insertion portion. do,
The imaging control device according to any one of claims 1 to 5. The image pickup device receives an image pickup element that receives the reflected light from the target and converts it into an electric signal, and the light from the lighting device is reflected by the target and the reflected light from the target is introduced into the image pickup device. It has a green filter provided on the path and can be retracted.
The control means takes an image of the insertion portion inserted into the hole connected to the target together with the target by the image pickup device without illuminating the target with the lighting device in a state where the green filter is retracted from the path. Let me
Then, with the green filter positioned on the path, the image pickup device corresponding to the at least one and the image pickup device corresponding to the at least one based on at least one of the image pickup state set by the setting means and the light amount by the lighting device. By controlling the lighting device, the image data for recording the object is acquired.
The imaging control device according to any one of claims 1 to 6. An image pickup device equipped with a lens that collects light from an object onto an image pickup device.
A control means for causing the image pickup device to take an image of the insertion portion inserted into the hole connected to the target while controlling the illumination of the lighting device together with the target.
Based on the image data of the image representing the insertion portion imaged without being illuminated by the lighting device according to the control of the image pickup device by the control means, at least one of the image pickup state by the image pickup device and the light amount by the lighting device is obtained. As a setting means for setting the insertion portion to be different from each other depending on whether the insertion portion is the first insertion portion or the insertion portion is the second insertion portion having a light reflectance different from that of the first insertion portion. , Equipped with
The control means controls the image pickup device and the lighting device corresponding to the at least one based on at least one of the image pickup state set by the setting means and the light amount by the lighting device. Acquire image data for recording,
Imaging device. The insertion portion inserted into the hole connected to the target is imaged by the imaging device together with the target in a state where the lighting of the lighting device is controlled.
Based on the image data of the image representing the insertion portion captured without being illuminated by the lighting device according to the control, the insertion portion first obtains at least one of the imaging state by the imaging device and the amount of light by the lighting device. The insertion portion is set to be different from each other depending on whether the insertion portion is a second insertion portion having a light reflectance different from that of the first insertion portion.
By controlling the image pickup device and the lighting device corresponding to the at least one based on at least one of the set image pickup state and the amount of light, the image data for recording the target is acquired.
Imaging control method. On the computer
The insertion portion inserted into the hole connected to the target is imaged by the imaging device together with the target in a state where the lighting of the lighting device is controlled.
Based on the image data of the image representing the insertion portion captured without being illuminated by the lighting device according to the control, the insertion portion first obtains at least one of the imaging state by the imaging device and the amount of light by the lighting device. The insertion portion is set to be different from each other depending on whether the insertion portion is a second insertion portion having a light reflectance different from that of the first insertion portion.
By controlling the imaging device and the lighting device corresponding to the at least one based on at least one of the set imaging state and the amount of light, the image data for recording the target is acquired.
program.

Images