JP7031298B2 - Imaging device, imaging method and program - Google Patents

Description

The present invention relates to an image pickup device , an image pickup method and a program , particularly an image pickup device , an image pickup method and a program for photographing by pressing against a subject.

In recent years, an increase in skin diseases such as melanoma (malignant melanoma) has become a problem due to aging and ozone layer depletion. For diagnosing such skin diseases, an imaging device called a dermoscopy camera capable of photographing the pigment distribution and color tone inside the skin is utilized. For example, Patent Document 1 discloses a camera-equipped mobile phone to which a dermoscope can be attached and detached. During dermoscopy photography, the skin disease area is photographed with a camera-equipped mobile phone equipped with a dermoscope, and during normal photography, the skin disease area is photographed with a camera-equipped mobile phone with the dermoscope removed.

However, the invention disclosed in Patent Document 1 has a problem that the skin disease portion, which is the subject, cannot always be captured at the central position. Specifically, when making a dermoscopy diagnosis, many dermatologists take pictures according to the following procedure.
1) To identify an individual, take a picture of the patient's chart using a normal camera.
2) In order to identify the position of the diseased part, the diseased part and its surroundings are photographed in a non-contact state as clinical photography.
3) Use a dermoscopy camera to photograph the diseased part in contact.

Then, since the "mole", which is the main subject of the dermoscopy camera, is very small, there is a problem that it is difficult to capture the subject at the center position of the shooting range at the time of shooting. Although the background technology for skin diseases such as melanoma has been described above, the present invention is not limited to the dermoscopy camera for skin diseases, but is an imaging device that more generally captures images by contacting the subject. Applies to close-up cameras, etc.

Japanese Unexamined Patent Publication No. 2005-192944

The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image pickup device , an image pickup method, and a program that can easily capture even a very small subject at a center position.

In order to solve the above-mentioned problems, one aspect of the present invention is an image pickup device for photographing a subject, which is a camera body, a lens unit attached to the camera body, and a cover member provided at the tip of the lens unit. Based on the determination result of whether the subject is in focus in the first state in which the cover member is separated from the subject, or whether the subject is in focus in the second state in which the cover member is in contact with the subject. The position of the subject separated from the cover member when it is determined that the contact detecting means for detecting the contact between the cover member and the subject and the contact detecting means have not detected the contact with the subject. When it is determined that the contact is detected, the focus position adjusting means for adjusting the focus position so as to focus on the position of the subject in contact with the cover member. It is characterized by being prepared. Other features of the present invention will be clarified by the description of the present specification and the accompanying drawings.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide an image pickup device , an image pickup method and a program that can easily capture a very small subject at a center position accurately.

It is sectional drawing which shows typically the image pickup apparatus which concerns on this embodiment. It is a front view which shows typically the image pickup apparatus which concerns on this embodiment. In the image pickup apparatus according to the present embodiment, (a) indicates a case where the focus is set on the subject while the image pickup apparatus is separated from the subject, and (b) indicates the subject reflected by the image pickup element of (a). In the image pickup apparatus according to the present embodiment, a state in which the image pickup apparatus approaches the subject is shown. In the image pickup apparatus according to the present embodiment, (a) is a case where the focus is set on the tip contact portion while the image pickup device is in contact with the subject, and (b) is the subject reflected by the image pickup element of (a). show. In the conventional image pickup device, (a) shows the case where the focus is set on the tip contact portion while the image pickup device is separated from the subject, and (b) shows the subject reflected by the image pickup element of (a). In the conventional image pickup device, (a) is a state in which the image pickup device approaches the subject, (b) is a state in which the image pickup device captures the subject at a displaced position, and (c) is an image pickup element in (b). Shows the state reflected in.

Hereinafter, embodiments of a camera to which the present invention is applied will be described with reference to the drawings. The camera is applied to a dermoscopy camera, which is an image pickup device for diagnosing cancer (mole) such as "mole", and a close-up camera, which is an image pickup device that more generally shoots by touching a subject. However, in the present specification, the dermoscopy camera will be used as a representative. In the specification of the present application, "Dermoscope" and "Dermoscopy" are used according to the proper use of "Microscope: microscope" and "Microscopy: inspection by microscope or use of microscope (method)". ) ”Is used to mean a magnifying glass (device) for skin examination and skin examination using the same magnifying glass or use (act) of the same magnifying glass.

(Overall configuration of dermoscopy camera 1)
The dermoscopy camera 1 according to the present embodiment has a configuration in which the focus position is set at a distance immediately before contact with the subject so that even an extremely small subject can be accurately captured at the center position of the shooting range. Is to provide. Hereinafter, it will be described in detail.

FIG. 1 is a cross-sectional view schematically showing an image pickup apparatus according to the present embodiment. FIG. 2 is a front view schematically showing the image pickup apparatus according to the present embodiment. FIG. 3 is a diagram showing a case where the image pickup apparatus according to the present embodiment is focused on the subject while the image pickup apparatus is separated from the subject. FIG. 4 is a diagram showing a state in which the image pickup device approaches the subject in the image pickup device according to the present embodiment. FIG. 5 is a diagram showing a case where the focus is set on the tip contact portion in a state where the image pickup device is in contact with the subject in the image pickup device according to the present embodiment. FIG. 6 is a diagram showing a case where the focus is set on the tip contact portion in a state where the image pickup device is separated from the subject in the conventional image pickup device. FIG. 7 is a diagram showing a state in which the image pickup device captures the subject at a displaced position in the conventional image pickup device.

As shown in FIGS. 1 to 5, the dermoscopy camera (imaging device) 1 is composed of a camera body (imaging device body, also simply referred to as “main body”) 10 and a lens unit 20 provided in front of the camera body 10. It is roughly configured. The lens unit 20 takes a picture of a skin diseased part in contact with the "mole" as the main subject.

In the following description, as shown in FIG. 1, the imaging target side is the front (front, front) of the dermoscopy camera 1, the opposite side is the rear, and the vertical direction when the dermoscopy camera 1 is viewed from the front is the same. The explanation will be based on a Cartesian coordinate system in the vertical direction. Further, unless otherwise specified, the attachment of each member may be performed by an appropriate method such as attachment using screws, screws or the like, attachment such as fitting, or the like.

(About the configuration of the camera body 10)
As shown in FIGS. 1 and 2, the camera body 10 has a housing 11, such as a zoom lens unit 12 inside the housing 11, a circuit wiring board 30 and an image sensor 31 behind the zoom lens unit 12. Contains various components. The housing 11 is provided with a power button (not shown) in addition to the shutter button 18 on the upper surface.

Further, inside the housing 11, a storage unit that stores a photographed image read by the image sensor 31 according to the operation of the shutter button 18, a control unit that controls each of the above-mentioned parts, and a power supply are supplied to each of the above-mentioned parts. Although a battery unit for supplying is provided, these illustrations are omitted.

For the camera body 10, a known photographing device used for ordinary photographing, for example, a configuration of a commercially available digital camera can be adopted. For example, the zoom lens unit 12, the circuit wiring board 30, and the image pickup element 31 may be used. , Known parts can be used. The zoom lens unit 12 has a known optical lens. Further, as the image pickup device 31, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor can be used. Further, the camera body 10 is provided with a touch panel type screen 50 for displaying the captured image and executing various settings of the dermoscopy camera 1.

(About the configuration of the lens unit 20)
As shown in FIGS. 1 and 2, the lens unit 20 includes a cylindrical cover body (lens cover) 40 having a conical tip cut off, and a cover member fitted into the opening 41b of the cover body 40. 24 and.

The cover body 40 is made of a resin such as a polyvinyl chloride derivative or an acrylic resin. The outer shape of the cover body 40 has a tapered shape toward the front, and the inside thereof is hollow. Further, the hollow portion of the cover body 40 also has a shape whose diameter is reduced toward the front.

As shown in FIG. 1, an LED 13a is provided behind the cover member 24 of the cover body 40 as a light source so as to surround the zoom lens portion 12. The LED 13a is mounted on an LED substrate (not shown). The LED substrate has an annular shape, and a plurality of LEDs 13a are mounted on the front surface thereof. The plurality of LEDs 13a are arranged concentrically with respect to the center of the LED substrate at equal intervals. As a result, the LED substrate on which the LED 13a is mounted functions as a ring flash that emits light forward from the outer peripheral position of the zoom lens unit 12. The LED 13a is composed of an LED that emits white light. In order to reduce the reflection of the light from the LED 13a in the photographing range, the cover member 24 is installed so as to irradiate the cover member 24 from an oblique direction as shown by an arrow A in FIG.

In the present embodiment, the LED 13a is provided inside the cover body 40, but the LED 13a may be provided on the side of the camera body 10. For example, when the lens unit 20 is rotatably provided with respect to the camera body 10, by providing the LED 13a on the camera body 10, the camera body 10 illuminates a wide skin surface including a skin disease portion. Can be taken.

The cover member 24 is fitted in the opening 41b formed at the tip of the cover body 40, and is arranged close to the front of the LED 13a. The cover member 24 is made of transparent glass or a synthetic resin such as acrylic, and the cover member 24 is brought into contact with the subject at the time of photographing. Since the dermoscopy camera 1 also performs sterilization, cleaning, and the like after shooting, the cover member 24 and the cover body 40 are securely sealed.

Although not shown in FIGS. 1 and 2, in addition to the above, the cover body 40 has a light guide plate that directs a part of the light emitted from the conversion lens and the LED 13a to the cover member 24 for subject lighting. Alternatively, a polarizing filter may be provided inside the cover member 24. At that time, the cover member 24 is moved from the skin diseased portion M by locating the polarizing filter on the optical path from the LED 13a to the subject (skin diseased portion M) only when the cover member 24 is pressed against the skin diseased portion M. In the separated state (first state), the subject can be irradiated with natural light, and in the state where the cover member 24 is pressed against the skin disease portion M (second state), the subject can be irradiated with polarized light. .. The switching between the irradiation of natural light and the irradiation of polarized light is performed according to the detection result of the contact detecting means described later.

(Example of using Dermoscopy camera 1)
When performing dermoscopy photography using the dermoscopy camera 1, the photographer attaches the lens unit 20 to the camera body 10 as shown in FIG. At that time, a known configuration can be adopted for the mode in which the lens unit 20 is attached to the camera body 10. For example, the lens unit 20 may be screwed into the camera body 10 or magnetically attached by a magnetic material. Further, the lens unit 20 may be rotatably attached to the camera body 10 by providing a rotating portion (not shown) on the lens unit 20 and a rotating support portion on the camera body 10.

Then, the photographer presses the power button to turn on the power, and for example, half-presses the shutter button 18 to cause the LED 13a to emit light. At that time, as shown in FIG. 6A, in the case of the conventional dermoscopy camera 1', even when the cover member 24 of the lens unit 20 is separated from the skin disease portion M which is the subject at a distance f, both of them. The focus is on the second focus position F2 on the outer surface of the cover member 24 in order to capture the contact state. Then, as shown in FIG. 6B, the skin disease portion M'out of focus is formed on the image sensor 31, and the image becomes unclear. It is difficult for the photographer looking at the screen provided on the back surface of the camera body 10 to capture the unclear skin disease portion M'at the center position of the imaging range.

Here, for example, the skin disease portion M is about 1 to 10 mm, the diameter of the cover member 24 is about 5 to 20 mm, and the distance f between the skin disease portion M and the cover member 24 is about 20 to 50 mm.

In such an unclear state, as shown in FIG. 7 (a), when the dermos copy camera 1'is brought closer to the skin diseased portion M in the X direction (forward direction), for example, as shown in FIG. 7 (b). In addition, even if the dermos copy camera 1'is displaced downward with respect to the skin diseased portion M, it is difficult for the photographer to adjust the skin diseased portion M so as to be located at the center of the cover member 24. As shown in FIG. 7 (c), the skin disease portion M is imaged at a position shifted upward from the center position C on the image pickup element 31 of the camera body 10. Then, in order to adjust to the center position C, the photographer needs to repeat the trial and error many times. In FIGS. 7 (a), 7 (b), and 7 (c), the dermoscopy camera 1'is simplified and depicted.

On the other hand, in the dermoscopy camera 1 according to the present embodiment, as shown in FIG. 3A, the cover member 24 of the lens unit 20 is separated from the skin disease portion M, which is the subject, at a distance f. The focus is on the first focus position F1 corresponding to the distance f between the skin disease portion M and the cover member 24. As a result, as shown in FIG. 3B, the skin disease portion M in focus is formed on the image pickup device 31, and the image becomes clear. That is, it becomes easier for the photographer to aim the skin disease portion M at the central position C.

In this state, as shown in FIG. 4, the photographer puts the cover member 24 of the lens unit 20 on the skin while looking at the screen 50 provided on the back surface of the camera body 10 that displays the image formed on the image sensor 31. Bring closer to the diseased part M. The operation of bringing the dermoscopy camera 1 closer to the skin diseased portion M, that is, the operation of pressing the dermoscopy camera 1 against the skin diseased portion M can be performed linearly toward the skin diseased portion M projected on the screen. Although the screen 50 is provided on the back surface of the camera body 10, it may be provided separately from the camera body 10 and connected by wire or wirelessly.

As a result, when the cover member 24 comes into contact with the skin disease portion M, it becomes easy to capture the skin disease portion M at the central position C, and the skin disease portion M in focus can be imaged on the image pickup element 31. can. As for the method of focusing, it is determined that the cover member 24 has "contacted" the skin disease portion M when the cover member 24 is out of focus at the first focus position F1 described above, and as shown in FIG. 5, the focus is on the cover member 24. Moves to the second focus position F2 on the outer surface of the surface, that is, corresponding to the skin disease portion M in contact with the cover member 24.

By doing so, even when the dermoscopy camera 1 is positioned with the cover member 24 separated from the skin disease portion M (first state), the cover member 24 is pressed against the skin disease portion M (second state). Even when shooting in the state), it is possible to focus on the skin diseased portion M.

It is preferable that the focus is moved between the first focus position F1 corresponding to the first state and the second focus position F2 corresponding to the second state by the autofocus function, for example, according to the above-mentioned dimensions. In this case, the distance f to the first focus position F1 may be set to about 20 to 50 mm, and the distance f to the second focus position F2 may be set to 0 mm, starting from the center of the outer surface of the cover member 24. Regarding the movement of the focus, the first focus position F1 and the second focus position F2 may be set to a predetermined fixed focus instead of the autofocus function.

The mode that automatically displaces the first state and the second state can be called, for example, a "screen confirmation mode". In this mode setting, the contact detection means provided on the camera body 10 is used in the first state. It is determined that the cover member 24 has "contacted" the skin disease portion M when the focus is lost, that is, when the focus is out of focus at the first focus position F1. On the contrary, when the focus is lost in the second state, that is, when the focus is out of focus at the second focus position F2, it is determined that the cover member 24 is "separated" from the skin disease portion M. The contact detecting means may be configured to be provided on the cover member 24 and detected by a contact sensor, or the cover member 24 may detect the pressure pressed against the skin disease portion M.

In the state where the cover member 24 is in contact with the skin disease portion M, the light emitted from the cover member 24 reaches under the skin while suppressing diffuse reflection on the surface of the skin disease portion M, and is caused by the substance under the skin. Be reflected. This reflected light is taken into the dermoscopy camera 1 via the cover member 24. The captured light is magnified 10 to 30 times through the conversion lens and the zoom lens unit 12, and is imaged at the center position C on the image sensor 31 of the camera body 10. When the shutter button 18 of the camera body 10 is fully pressed at an arbitrary timing, the captured image read by the image sensor 31 is stored in the storage unit of the camera body 10. The captured image stored in this way can be used for examination and diagnosis of, for example, melanocytic nevus, malignant melanoma, seborrheic keratosis, basal cell carcinoma, vascular lesion and Bowen's disease.

(About the effect of the embodiment)
As described above, in the dermos copy camera 1 according to the present embodiment, even if the skin diseased portion M of a very small subject is in the first state in which the cover member 24 and the skin diseased portion M are separated from each other, and the cover member 24 By focusing on the skin diseased portion M in both of the second state in which the skin diseased portion M and the skin diseased portion M are in contact with each other, the skin diseased portion M can be grasped at the center position of the imaging range.

Further, since it is known that the dermoscopy camera 1 does not shoot in the first state of being separated, that is, non-contact, the necessary settings (lighting conditions, shooting conditions, etc.) are set in the second state of the contacted state. There is an energy saving effect that can be put on hold.

Further, since the dermoscopy camera 1 does not require a special function or device for the mode for switching between the first state and the second state, the dermoscopy camera 1 is positioned at the center position C and the two states by a simple and inexpensive structure. Focusing can be achieved at the same time.

In this way, since the lens unit 20 can be reliably positioned during dermoscopy photography, it is possible to quickly record an image in which the skin disease portion M is located at the center of the image sensor 31, and it is necessary to perform re-imaging. It is possible to shorten the medical treatment time by reducing the number of cases, and it is possible to make an accurate diagnosis.

(About the modification of the embodiment)
The present embodiment is not limited to the above-described embodiment, and various modifications and applications are possible. In the above-described embodiment, it has been described that the lens unit 20 may be rotatably attached to the camera body 10, but the movement mode of the lens unit 20 is not limited to such rotation, for example, the camera. It may be slid with respect to the main body 10. In short, at the time of dermoscopy photography, the front of the zoom lens unit 12 may be arranged so as to be covered with the lens unit 20. The zoom lens unit 12 may be configured as a fixed-magnification lens unit in consideration of the intended use of the dermoscopy camera 1.

Further, in the above embodiment, the light source is the LED 13a arranged on the circumference, but other light sources may be adopted. For example, a high-intensity light such as a halogen lamp, a semiconductor light emitting device, and a light emitting element such as an organic electroluminescence can be used.

Further, although it has been explained that the LED 13a is composed of an LED that emits white light, for example, an ultraviolet light source, a blue light source, or a green light source may be adopted. Further, the light sources having different colors of emitted light may be provided so that the light sources of different colors can emit light independently. In this way, different images can be obtained by irradiating light of different colors to obtain captured images, and by comparing different images and superimposing the images, the skin disease part can be inspected and the images can be superimposed. Diagnosis can be facilitated.

Further, the lens unit 20 may be provided with another known light guide member instead of the light guide plate as the light guide member that collects the light from the LED 13a toward the tip for subject illumination. For example, an optical fiber that guides light toward the tip may be provided.

Further, the image pickup apparatus according to the present embodiment is not limited to the image pickup apparatus for dermoscopy photography, such as the dermoscopy camera 1 described in the above embodiment. Further, the subject is not limited to the skin disease part. For example, the present invention is also applied to an image pickup device or the like in which a subject is accurately photographed at the center position of an image pickup element when inspecting very small cracks, holes, etc. for maintenance of a structure or the like. Can be done.

Further, it has been explained that in the above-mentioned dermoscopy camera 1, the camera body 10 is provided with a shutter button 18 and a touch panel type screen 50 for executing various settings of the dermoscopy camera 1. However, an operation receiving unit such as a shutter button 18 or a touch panel type screen 50 may be provided in an operation unit physically separated from the camera body. The camera body and the operation unit can communicate in both directions using existing communication technology. By operating the operation unit, the photographer can perform various settings of the camera body, shutter operation, and the like.

The inventions described in the claims originally attached to the application of this application are described below. The claims mentioned in the appendix are the scope of the claims originally attached to the application for this application.
[Claim 1]
It is an image pickup device that shoots by pressing it against the subject.
With the camera body
The lens unit provided on the camera body and
A cover member provided at the tip of the lens unit and
A contact detecting means for detecting contact between the cover member and the subject is provided.
The focus of the camera body is automatically adjusted so as to match the separated subject in the first state where the cover member is separated from the subject, and it is determined by the contact detecting means that the cover member is in contact with the subject. In the second state, the image pickup apparatus is characterized in that it is automatically adjusted to match the subject in contact with the cover member.
[Claim 2]
The image pickup apparatus according to claim 1, wherein the camera body captures the subject at a central position of a shooting range in the first state and the second state.
[Claim 3]
Further, a light source is provided behind the cover member, and the light source is installed so as to irradiate the cover member from an oblique direction so as to reduce the reflection of light from the light source in the shooting range. The image pickup apparatus according to claim 1, wherein the image pickup apparatus is characterized by the above.
[Claim 4]
The image pickup apparatus according to claim 1, further comprising a light source that irradiates the subject with natural light in the first state and irradiates the subject with polarized light in the second state.
[Claim 5]
The image pickup apparatus according to claim 4, wherein the light source is configured to switch between irradiation with natural light and irradiation with polarized light according to the detection result of the contact detecting means.
[Claim 6]
The imaging device according to any one of claims 1 to 5, wherein the contact detecting means includes a contact sensor provided on the cover member.
[Claim 7]
The imaging device according to any one of claims 1 to 5, wherein the contact detecting means detects a pressure pressed against the subject by the cover member.
[Claim 8]
The image pickup apparatus according to any one of claims 1 to 5, wherein the contact detecting means determines that the cover member is in contact with the subject when the focus is lost in the first state. ..
[Claim 9]
The image pickup apparatus according to claim 8, wherein the contact detecting means determines that the cover member is separated from the subject when the focus is lost in the second state.

1 ... Dermoscopy camera (imaging device)
10 ... Camera body 11 ... Housing 12 ... Zoom lens 13a ... LED
18 ... Shutter button 20 ... Lens unit 24 ... Cover member 30 ... Circuit wiring board 31 ... Image sensor 40 ... Cover body 41b ... Aperture 50 ... Screen M ... Skin disease part (subject)
f ... Distance (focal length)
F1 ... 1st focus position (1st state)
F2 ... 2nd focus position (2nd state)
C ... Center position (of the image sensor)

Claims (6)

An image pickup device that shoots a subject
With the camera body
The lens unit provided on the camera body and
A cover member provided at the tip of the lens unit and
Based on the determination result of whether the cover member is in focus on the subject in the first state separated from the subject, or the subject is in focus in the second state in which the cover member is in contact with the subject. A contact detecting means for detecting contact between the cover member and the subject,
When it is determined that the contact with the subject is not detected by the contact detecting means, when it is determined that the contact is detected so that the position of the subject separated from the cover member is in focus. A focus position adjusting means for adjusting the focus position so that the subject in contact with the cover member is in focus.
An image pickup device characterized by being provided with. Further equipped with a light source arranged to irradiate light toward the cover member,
When the contact detecting means detects that the light source is in the second state, the light source irradiates the light.
The image pickup apparatus according to claim 1. In the case of the first state, the light source does not irradiate the light.
The image pickup apparatus according to claim 2. Further comprising a polarizing filter for polarizing the light emitted by the light source.
The image pickup apparatus according to claim 2 or 3. A method of imaging a subject in an imaging device including a camera body, a lens unit provided in the camera body, and a cover member provided at the tip of the lens unit.
Based on the determination result of whether the cover member is in focus on the subject in the first state separated from the subject, or the subject is in focus in the second state in which the cover member is in contact with the subject. A contact detection step for detecting contact between the cover member and the subject,
When it is determined that the contact with the subject is not detected by the contact detection step, when it is determined that the contact is detected so that the position of the subject separated from the cover member is in focus. A focus position adjustment step for adjusting the focus position so that the subject in contact with the cover member is in focus.
An imaging method comprising. A computer of an image pickup device including a camera body, a lens unit provided in the camera body, and a cover member provided at the tip of the lens unit.
Based on the determination result of whether the cover member is in focus on the subject in the first state separated from the subject, or the subject is in focus in the second state in which the cover member is in contact with the subject. A contact detecting means for detecting contact between a cover member and the subject,
When it is determined that the contact with the subject is not detected by the contact detecting means, when it is determined that the contact is detected so that the position of the subject separated from the cover member is in focus. A focus position adjusting means for adjusting the focus position so that the subject in contact with the cover member is in focus.
A program to function as.

Images