JP2019202002A - Skin image capturing system and skin image capturing method - Google Patents

Abstract

To provide a skin image capturing system capable of easily capturing a skin image of a lesioned part of the skin necessary for skin observation including information on each of a skin hue and a three-dimensional effect of a skin surface.SOLUTION: A skin image capturing system 1 for capturing a skin image for observation of a lesioned part of the skin includes: a line sensor 13 for capturing a row image of the skin; a lens system 13R fixed to the line sensor 13 for forming an image of the skin on the line sensor 13; a light source for applying an irradiation light; and an image capturing position changing mechanism 12 for synchronizing relative positions of the lens system 13R, the line sensor 13, and the light source, and moving them when changing image capturing positions of the line sensor 13 and the light source respectively. When a first row image including information on a skin hue of a row image is captured, an irradiation light is applied onto the skin surface, which is the observation object, in a first angular range, and when a second row image including information on a three-dimensional effect of a skin surface of the row image is captured, the irradiation light is applied onto the skin surface in a second angular range different from the first angular range.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a skin image capturing system and a skin image capturing method.

Conventionally, for use in diagnosis and observation of skin conditions, skin diseases, or organ diseases that show symptoms on the skin, the skin at any position in the human body is imaged with a camera, and the skin as a captured image. There are devices that acquire images (see, for example, Patent Document 1 and Patent Document 2).
In addition, in order to capture a skin image for accurately observing the state of the skin surface, a contact camera, a magnifying glass for enlarging the skin surface when imaging, and a light source that emits light necessary for imaging There is a combined dermoscope (see, for example, Patent Document 3).

JP-A-62-59913 JP 2004-187248 A JP, 2015-157018, A

However, in the method of imaging with the camera in Patent Document 1 and Patent Document 2, the focal distance from the camera to the skin to be imaged varies in the center and the edge of the captured image.
For this reason, when the imaging range is widened, distortion occurs at the edge of the captured image and the quality is deteriorated, and accurate diagnosis and observation using the captured skin image cannot be performed.

Further, not only the focal length described above but also the light source distance that is the distance between the light source and the skin to be imaged is not constant. For this reason, the skin image imaged under the light source described above changes in color depending on the position of the image (due to the difference in the light source distance), and this point cannot be used for accurate diagnosis and observation.
For the color change described above, it is conceivable to use a ring light as a light source to reduce the color change, but the problem of different focal lengths cannot be solved.

On the other hand, when observing the state of the skin, it is possible to suppress a change in color in the skin image by using the ring light.
However, the use of this ring light makes it difficult for shadows due to the unevenness of the skin surface to occur, and it is not possible to take a skin image for obtaining a stereoscopic effect on the skin surface.
By the way, in the present invention, the “shade” includes “light / dark” due to the fact that the light has irregularities (inclined portions), and the light reflection direction changes the light incident direction and the observation (imaging) direction. It is not limited to an area where light cannot reach completely.

In the case of a general single-plate CCD digital camera imaging system, each of RGB (Red, Green, Blue color components) is blurred by 4 pixels and assigned to adjacent pixels to generate an image. . Here, the single-chip CCD digital camera is a camera using a single coupled CCD (Charge Coupled Device) as an image sensor for imaging.
This structure complicates the mechanism for suppressing pixel color mixing, and the image processing method differs for each camera type, resulting in a decrease in resolution in color reproduction processing for skin images when observing the skin. In addition, accurate color reproduction cannot be performed. The same applies to the single-chip CMOS digital camera imaging method. Here, the single-chip CMOS digital camera is a camera that uses a complementary metal oxide semiconductor (CMOS) sensor, which is a single image sensor, as an image sensor for imaging, and is currently popular as a digital camera.

The method using the dermoscope in Patent Document 3 can capture a high-definition skin image when observing the local surface state of the skin.
Since the observation with this dermoscope is an observation using high intensity irradiation light and a magnifying glass, it is possible to image the skin state from the skin surface to a depth of about 1 mm.
However, when imaging the skin using a dermoscope, it is necessary to apply jelly to the location to be imaged and contact the imaging device with the applied location for imaging, which places a heavy burden on the patient undergoing the examination. It will be a thing.

In addition, although the dermoscope supports local imaging, it cannot capture a skin image in a wide range and cannot be used for observation of a wide range of skin conditions.
And skin abnormalities due to skin diseases or visceral diseases often occur in a wide range of the body.
For this reason, depending on the dermoscope, since the imaging range is locally limited to about several mm, it is not possible to sufficiently observe a wide range of lesions (such as skin abnormalities due to skin diseases and visceral diseases).

Therefore, when observing with a dermoscope, a doctor who examines the patient needs to observe the entire lesioned part that has developed in the patient, extract the most appropriate local region as an observation target, and image the local region. .
For this reason, it is difficult for a doctor who is familiar with skin care to extract a suitable local region as an observation target, and it is difficult to obtain a skin image necessary for observation.

  The present invention has been made in view of such circumstances, and each of the skin color and the three-dimensional appearance of the skin surface can be applied to a patient other than a doctor who is proficient in skin care without placing a burden on the patient. A skin image capturing system and a skin image capturing method capable of easily capturing a skin image of a lesion part of the skin necessary for observing the skin, including the above information.

  The present invention has been made to solve the above-described problems, and the skin image capturing system according to the present invention captures the skin used for observing the lesioned part of the skin as a column image, and synthesizes the column image. A skin image capturing system for acquiring a skin image, a line sensor that captures a row image of the skin, a lens system that forms an image of a skin to be imaged on an image sensor in the line sensor, and a skin sensor When changing the imaging position of the light source that irradiates irradiation light and each of the line sensor, the lens system, and the light source, they are synchronized so that the relative positions of the line sensor, the lens system, and the light source are the same. An imaging position changing mechanism that moves the first row image including information on the color of the skin in the row image at the imaging position. Irradiating the surface of the skin to be observed in the first angle range, and capturing the second row image including information on the stereoscopic effect of the surface of the skin in the row image, Irradiating in a second angle range different from the first angle range.

  In the skin image capturing system according to the present invention, the first angle range is an angle range in an irradiation direction in which no shadow is caused by unevenness on the skin surface, and the second angle range is shaded by unevenness on the skin surface. It is an angle range in the irradiation direction.

  In the skin imaging system of the present invention, the first angle range is in the range of 70 ° to 110 ° with respect to the skin surface, and the second angle range is in the range of 30 ° to 60 ° with respect to the skin surface. Or in the range of 120 ° to 150 °.

  The skin image capturing system according to the present invention is characterized in that the light source emits the irradiation light from which light having at least an ultraviolet wavelength component is removed.

  The skin image capturing system of the present invention is characterized in that the irradiation light has a color rendering index (average color rendering index) of 90 or more, and desirably a color rendering index of 95 or more.

  The skin image capturing system of the present invention further includes an imaging control unit that controls imaging of the row images, controls the imaging position changing mechanism to move the line sensor to the imaging position in a predetermined distance unit, A line sensor is controlled to irradiate the irradiation light in a first angle range for each imaging position to capture the first row image, and to irradiate the irradiation light in a second angle range to the second row. An image is picked up.

  In the skin imaging system of the present invention, the light source is a line light source or a surface light source, and is provided in parallel with the line sensor.

  In the skin imaging system of the present invention, the light source is composed of each of a first light source and a second light source, and the irradiation light emitted by the first light source is provided at a position in the first angle range, The second light source is provided at a position where the irradiation light emitted by the second light source falls within the first angle range.

  In the skin image capturing system of the present invention, when the line sensor captures the skin image at the imaging position, the irradiation light emitted by the light source is in the first angle range, and the light source A light source moving mechanism for moving the irradiated light to be irradiated to a position that falls within the second angle range is further provided.

  In the skin image capturing system according to the present invention, the second angle range includes a second_1 angle range and a second_2 angle range, and each of the second_1 angle range and the second_2 angle range corresponds to a moving direction of the line sensor. It is set as an angle range that is symmetric with respect to a vertical plane, and the column image is captured by irradiating the irradiation light in the second_1 angle range for each of the imaging positions, and the irradiation light is the first range. The column image is picked up by irradiating in a 2_2 angle range.

  The skin imaging system of the present invention is characterized in that the lens system is a telecentric optical system.

  The skin image capturing method of the present invention is a skin image capturing method for capturing a skin image by capturing the skin used for observation of a skin lesion as a column image, and synthesizing the column image, and is an imaging target. An imaging process in which the line image of the skin is captured by a line sensor fixedly provided with a lens system that forms an image of the skin, a light irradiation process in which irradiation light is applied to the skin by a light source, and an imaging position change When the imaging position of each of the line sensor, the lens system, and the light source is changed by a mechanism, the imaging is performed so that the relative positions of the line sensor, the lens system, and the light source are moved in synchronization with each other. A position change process, and at the imaging position, when capturing a first row image including information on the color of the skin in the row image, Irradiating the surface with a first angle range, and capturing the second row image including information on the three-dimensional effect of the surface of the skin in the row image, the first angle with respect to the surface of the skin. Irradiation is performed in a second angle range different from the range.

  According to the present invention, it is necessary for observing the skin including information on the color of the skin and the three-dimensional effect on the surface of the skin, even if it is not a doctor who is proficient in the medical care of the skin without burdening the patient. It is possible to provide a skin image capturing system and a skin image capturing method capable of easily capturing a skin image of a lesion part of a simple skin.

FIG. 1 is a diagram showing a configuration example of a skin image capturing system 1 according to the first embodiment of the present invention. It is a conceptual diagram explaining the surface structure of human skin. It is a figure explaining each of the 1st angle of the irradiation light of the 1st light source 14, and the 2nd angle of the irradiation light of the 2nd light source 15. FIG. It is a conceptual diagram explaining the wavelength component contained in the irradiation light which each of the 1st light source 14 and the 2nd light source 15 irradiates. It is a figure which shows the structural example of 1 A of skin imaging systems by the 3rd Embodiment of this invention. It is a figure which shows the structural example of the skin image imaging system 1B by the 4th Embodiment of this invention. It is a figure which shows the structural example of 1 C of skin imaging systems by the 5th Embodiment of this invention.

<First Embodiment>
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a configuration example of a skin image capturing system 1 according to the first embodiment of the present invention. In FIG. 1, a skin image capturing system 1 includes a skin image capturing control device 11, an image capturing position changing mechanism 12, a line sensor 13, a first light source 14, a second light source 15, and an imaging target installation stage 16.
The skin image capturing control device 11 controls each of the imaging position changing mechanism 12, the line sensor 13, the first light source 14, and the second light source 15.

The imaging position changing mechanism 12 moves each of the line sensor 13, the first light source 14, and the second light source 15 relative to the imaging target (skin area having a lesion in the skin).
The line sensor 13 is, for example, a sensor in which a plurality of CCD elements (or CMOS elements) are arranged in a line, and is a column image composed of pixel rows corresponding to the number of CCD elements (or CMOS elements) in one line at a time. Image.
The line sensor 13 is provided with a lens system 13R for forming an image of the skin on the CCD element (or CMOS element) in front of the CCD element (or CMOS element). This lens system 13R is a telecentric optical system which is a special lens system. The telecentric optical system has a principal ray (a central ray of a light beam emitted from a point on the skin surface as an object and incident on the lens system 13R) as compared with a general lens optical system. It is parallel to. For this reason, when the stop is placed at the focal position on the image side (that is, the imaging surface of the CCD element), the principal ray from the skin surface is parallel to the optical axis of the lens system 13R, and the skin position is in the optical axis direction. Even if it shifts and changes, the image formed on the CCD element is blurred, but the magnification at which the image is formed and the image forming position do not change.
With the configuration described above, it is possible to obtain an image viewed from one parallel direction (for example, the direction connecting the central axis of the lens system 13R and the imaging region of the skin, preferably the direction perpendicular to the skin surface) in the field of view to be imaged, This is desirable in medical skin imaging in which imaging conditions should be strictly controlled and recorded.
The telecentric optical system is well known in the field of lens optics and has been commercialized as a lens system, and will not be described further here.

  Here, the lens system is an optical system that is formed by a combination of a plurality of lenses and forms an image of an object to be imaged on a line sensor. As is the case with digital cameras that are generally available on the market, when the distance between the lens system and the object to be imaged changes from its focal area and a focused image is not formed on the line sensor, By changing the lens position, it is possible to take an image of the object to be picked up with high resolution without changing the distance between the lens system and the object to be picked up. By applying such an automatic focus adjustment function to the line sensor 13 as the lens system 13R, a wide range of focus has been obtained in imaging an object having irregularities such as human skin (high space) A resolution image can be easily obtained, and a skin image used for diagnosis can be easily obtained. Such a focal position adjustment function is well known by its name and is well known, and thus will not be described in the present embodiment.

The 1st light source 14 is a light source which irradiates irradiation light from the predetermined 1st angle with respect to the surface of the skin of imaging object, when imaging the row | line | column image containing the information of skin color.
The second light source 15 is a light source that emits irradiation light from a predetermined second angle to the imaging target skin when imaging a column image including stereoscopic information indicating irregularities on the surface of the imaging target skin. is there.

  Each of the first light source 14 and the second light source 15 is a line light source or a surface light source having the same length as the longitudinal direction of the line sensor 13, and the amount of light irradiated in the region where the line image of the line sensor 13 is captured. Irradiate with irradiation light that keeps constant. Moreover, you may use the structure which arrange | positions LED light sources in a line and makes it a pseudo | simulation line light source. Hereinafter, in the present embodiment, each of the first light source 14 and the second light source 15 will be described as a linear light source. Each of the 1st light source 14 and the 15th light source is arrange | positioned so that the irradiation surface of a longitudinal direction may become parallel with respect to the arrangement | sequence of the pixel of the line sensor 13. FIG.

  The imaging target installation stage 16 is a stage on which a part of a patient who is an imaging target is placed and the skin of the part is opposed to the imaging unit of the line sensor 13. For example, when imaging the skin of the back of the patient's hand, the palm is placed on the surface 16S of the imaging target installation stage 16 and set so that the back of the hand faces upward.

FIG. 2 is a conceptual diagram illustrating the surface structure of human skin. 2A is a surface view of the surface of the skin, and FIG. 2B is a perspective view of the surface of the skin.
As can be seen from FIG. 2, the skin surface 50 has a skin groove 51, a skin mound 52, a pore 53, and a sweat hole 55. The objects to be observed and diagnosed when captured as a skin image are the color of the skin and the three-dimensional shape (three-dimensional effect) of the concave skin groove 51, pore 53 and convex skin 52.
And in order to acquire each of the information of the color of skin, and the information of the three-dimensional effect of the unevenness | corrugation of the skin surface, in this embodiment, two skin images are imaged. One sheet is a skin image for observing the color used for observing the color of the skin, and the other sheet is a skin image for observing the three-dimensional effect used for observing the three-dimensional effect on the skin surface.

FIG. 3 is a diagram illustrating each of the first angle of the irradiation light from the first light source 14 and the second angle of the irradiation light from the second light source 15. In FIG. 3, the imaging direction of the line sensor 13 is the direction of the arrow P, and this imaging direction is perpendicular to the surface 16 </ b> S of the imaging target installation stage 16.
The first angle is an angle that falls within the range of the angle width Δβ from the counterclockwise angle β, that is, the first angle range of the angle β to the angle β + Δβ, with the surface 16S of the imaging target installation stage 16 as a reference. The first angle is set as an angle at which no shading due to unevenness on the skin surface occurs so that the color of the skin surface can be observed with high accuracy.

  That is, when the shadow due to the unevenness of the skin surface occurs, the skin color of the shadow portion is imaged as a color different from the actual color. Therefore, for the purpose of suppressing the occurrence of this shadow, as much as possible Irradiation light is irradiated at an angle close to the direction perpendicular to the region. In the present embodiment, the first angle range of the first angle is set to a range from angle β to angle β + Δβ, preferably 70 ° to 110 ° (Δβ is 40 °).

  The second angle is set as a second_1 angle and a second_2 angle that fall within each of the second_1 angle range or the second_2 angle range. The second_1 angle range is a range from counterclockwise angle α1 to angle width Δα1, that is, an angle range from angle α1 to angle α1 + Δα1, with reference to surface 16S of imaging target installation stage 16 as a reference. In the present embodiment, the range of the angle α1 to the angle α1 + Δα1 is desirably set as 30 ° to 60 ° (Δα1 is 30 °) as the second_1 angle range.

  The second_2 angle range is a range from the counterclockwise angle α2 to the angle width Δα2, that is, the angle range from the angle α2 to the angle α2 + Δα2, with the surface 16S of the imaging target installation stage 16 as a reference. In the present embodiment, the range of the angle α2 to the angle α2 + Δα2 is set as the second_2 angle range, preferably 120 ° to 150 ° (Δα2 is 30 °).

This second angle is the angle of the irradiation direction of the irradiation light for the purpose of positively imaging the shadow generated by the degree of unevenness of the skin groove and hill to visually recognize the three-dimensional effect of the unevenness of the skin surface. It is.
As mentioned above, when trying to obtain information on the color of the skin surface with high accuracy, when irradiating the irradiation light at an angle that does not cause shadows, and obtaining information about the three-dimensional effect of the unevenness on the surface of the skin It is necessary to generate a shadow. Therefore, acquisition of each information of a color tone and a three-dimensional effect has a trade-off relationship.

In the present embodiment, as described above, a skin image for tint observation for accurately observing color information and a skin image for stereoscopic effect observation for accurately observing stereoscopic information are provided. Each is imaged separately.
That is, in order to synthesize a color observation skin image, irradiation light is irradiated from the first light source 14 at a first angle, and a line image is captured by the line sensor 13. The skin image capturing control device 11 causes the line sensor 13 to sequentially capture a column image of the skin surface under the irradiation light of the first light source 14 each time the line sensor 13 is moved by a predetermined distance. Here, the distance of the processing to be moved is arbitrarily set as appropriate in accordance with the resolution of the color observation skin image finally generated by synthesizing the row images. For example, the distance is basically set to a distance approximately equal to the interval between CCD elements (imaging elements) arranged in series by the line sensor 13.

Then, the skin image capturing control device 11 captures a column image by the line sensor 13 while scanning at a predetermined distance in the direction of the arrow Q1, and when imaging of a predetermined region of the imaging target skin is completed, for example, Scanning is started every predetermined distance in the direction of arrow Q2 opposite to the direction of arrow Q1.
Here, in the scanning in the direction of the arrow Q2, the skin image capturing control device 11 sequentially shifts the row image of the skin surface under the irradiation light of the second light source 15 every time the line sensor 13 is moved by a predetermined distance. The line sensor 13 is caused to take a column image. Here, the distance of the process to be moved is the same as that in the case of imaging the row image of the skin image for color observation.

In the present embodiment, the line sensor 13, the first light source 14, and the second light source 15 each take a row image while moving at predetermined distances with the relative positions being fixed.
That is, the skin image capturing control device 11 is provided with the line sensor 13 each time a column image is captured, and each of the first light source 14 and the second light source 15 is irradiated at the first angle and the second angle, respectively. A moving member (not shown) attached in a state of emitting light is moved by a predetermined distance by controlling the imaging position changing mechanism 12, and processing for capturing the next row of row images is sequentially performed.
Thereby, according to this embodiment, with respect to the area | region where the line sensor 13 images a row | line image, each of the irradiation angle of irradiation light and the light quantity irradiated can be made into a constant environment for every imaging, and skin A row image including information on the surface color and stereoscopic effect can be captured with high accuracy.

Further, in the present embodiment, the wavelength components of the irradiation light emitted from each of the first light source 14 and the second light source 15 are limited to a band that does not affect the human body and are irradiated.
That is, the irradiation light emitted from each of the first light source 14 and the second light source 15 has a light wavelength band limited to the visible light wavelength range.
Furthermore, in the present embodiment, the color rendering index (average color rendering index (CRI), Ra) of the irradiation light irradiated by each of the first light source 14 and the second light source 15 is also a color rendering index (Ra) of 90 or more. Preferably, the color rendering degree is limited to 95 or more, and a light source that emits irradiation light having the above color rendering degree is used. When the color rendering index Ra is 100, it indicates that the same color as natural light is reproduced (has color rendering properties).

FIG. 4 is a conceptual diagram illustrating wavelength components included in the irradiation light emitted from each of the first light source 14 and the second light source 15.
FIG. 4A shows a spectral distribution of a general white fluorescent lamp, where the horizontal axis indicates the wavelength of light and the vertical axis indicates the energy ratio.
The ultraviolet region is light having a wavelength of less than about 400 nm, and the infrared region is light having a wavelength of about 800 nm or more. Ultraviolet light may adversely affect the skin cells to be irradiated (for example, tanning, ie, causing burns), and may induce symptoms such as spots, wrinkles and sagging on the skin. In addition, since the light in the infrared region is light in the heat ray region, the irradiated skin is heated to cause changes in the color and the like, and the accuracy of the color information of the image for the color observation skin image is lowered. There is a case to let you.

For the reasons described above, in the present embodiment, the light component having a wavelength in the ultraviolet region and the infrared region is removed, and the light component having a wavelength in the visible light region having a wavelength of 400 nm or more and less than 800 nm. The irradiation light limited to is generated, and this irradiation light is irradiated to the imaging target region of the skin.
In addition, depending on the purpose of observation, it is possible to generate and use irradiation light from which only light components of less than 400 nm having an adverse effect on the skin are removed without removing light in the infrared region.

FIG. 4B shows the spectral distribution of sunlight (natural light), the horizontal axis indicates the wavelength of light, and the vertical axis indicates the energy ratio. The spectral distribution of sunlight has a substantially constant energy ratio in all wavelength ranges (having light with a smooth continuous wavelength).
And by approaching the spectral characteristic of sunlight, a color space having color reproducibility by sunlight can be obtained, and color rendering properties equivalent to sunlight can be obtained.

  As described above, in the present embodiment, light components having a wavelength of less than 400 nm and 800 nm or more are removed from light having a spectral distribution close to that of FIG. 4B, and the wavelength is 400 nm or more and less than 800 nm. A light source that uses a light component having a wavelength in the visible light range of the wavelength range as irradiation light is used.

Returning to FIG. 1, the skin image capturing control device 11 includes an image capturing control unit 111, an image composition unit 112, and a storage unit 113.
As described above, the imaging control unit 111 controls each of the imaging position changing mechanism 12, the line sensor 13, the first light source 14, and the second light source 15. For example, the imaging control unit 111 controls the imaging position changing mechanism 12 in the direction of the arrow Q1 to move the moving member by a predetermined distance, irradiate the irradiation light with the first light source 14, and sequentially capture the row images. The sequenced images are written and stored in the storage unit 113 in time series.

  The imaging control unit 111 controls the imaging position changing mechanism 12 in the direction of the arrow Q2 after the scanning in the direction of the arrow Q1 ends (takes all the column images in the imaging range of the skin), and moves the moving member to a predetermined position. While moving the distance, irradiation light is emitted from the second light source 15 to sequentially capture the column images, and the captured column images are written and stored in the storage unit 113 in time series.

Then, the image composition unit 112 reads all the column images captured by scanning in the direction of the arrow Q1 from the storage unit 113, and combines and combines the read column images in time series order. A skin image is generated. The generated skin image for color observation is written and stored in the storage unit 113.
Similarly, the image synthesizing unit 112 reads all the column images captured by scanning in the direction of the arrow Q2 from the storage unit 113, and synthesizes the read column images by connecting them in time series order. A skin image for observation is generated. The generated stereoscopic image for stereoscopic effect observation is written and stored in the storage unit 113.
In addition, the image composition unit 112 described above corresponds to the mutual position of the lens groups in the lens system 13R in response to the distance between the lens system 13R and the skin as the subject being changed due to the unevenness in the scanning process. It is desirable to include a function (not shown) for changing the focal position (distance) by the adjustment.
At this time, when the focus position is adjusted, the size and position of the skin image on the line sensor 13 may change. The image synthesizing unit 112 needs to adjust the row image so that the connection of the row image that has fluctuated in connection with the focus position adjustment becomes an image that is equal and continuous with the actual skin. Various general methods may be selected and used as the processing method.

  Therefore, according to the present embodiment, since the irradiation light having a color rendering property close to natural light is used without adversely affecting the skin to be irradiated, a row image that is safe for the human body and reproduces a color close to natural light is obtained. It is possible to image, and while considering the influence on the patient, a skin image for color observation having high-precision color information and a skin image for stereoscopic effect observation having high-precision stereoscopic information Each can be easily generated.

  In addition, according to the present embodiment, in order to generate a column image in an environment in which the irradiation light is irradiated from a certain direction, the illuminance and irradiation angle of the irradiation light are set when capturing a captured image as in a conventional camera. Without having a different area, a skin image for color observation having high-precision color information and a skin image for stereoscopic effect observation having high-accuracy stereoscopic information need not be a doctor who is skilled in skin observation. Imaging can be performed. For this reason, according to this embodiment, a doctor who is skilled in skin observation at a remote hospital, for example, a skin image for tint observation and a skin image for stereoscopic observation observed by a general doctor are located in different places. Observation and diagnosis can be performed.

<Second Embodiment>
The second embodiment of the present invention will be described below with reference to the drawings. The configuration of the skin image capturing system 1 according to the second embodiment is the same as that of the first embodiment shown in FIG. Hereinafter, only the operation different from that of the first embodiment will be described for the skin image capturing system 1 according to the second embodiment.

In the second embodiment, the skin image capturing control device 11 controls the imaging position changing mechanism 12 to move the moving member by a predetermined distance with respect to the skin region to be imaged.
The skin image capturing control device 11 irradiates the irradiation light from the first light source 14 for a predetermined time, captures a column image for generating a skin image for color observation during the predetermined time, and stores the captured column image. In the color observation row image storage area of the unit 113, the time series is written and stored.

Next, the skin image capturing control device 11 irradiates the irradiation light from the second light source 15 for a predetermined time without moving the moving member, and generates a column image for generating a stereoscopic image observation skin image at the predetermined time. The captured row image is written and stored in the stereoscopic image row image storage area of the storage unit 113 in time series.
The skin image capturing control device 11 reads the column images from the color observation column image storage area of the storage unit 113 in time series, and combines them in time sequence order to generate a color observation column image. To do. Similarly, the skin image capturing control device 11 reads out the column images from the stereoscopic image observation row image storage area of the storage unit 113 in time series, and combines them by combining them in time series order, thereby combining the stereoscopic effect observation columns. Generate an image.

As described above, the skin image capturing control device 11 controls the image capturing position changing mechanism 12 to move the moving member to move the skin image for tint observation and the skin image for stereoscopic observation at the same image capturing position. Each row image that generates each is captured.
For this reason, according to this embodiment, the position of each pixel of the skin image for tint observation and the skin image for stereoscopic observation generated by combining the respective row images corresponds to the same skin position. Therefore, it is not necessary to align the skin image for tint observation and the skin image for stereoscopic viewing (processing the captured image), and it can be used as raw data as it is captured.

  Further, according to the present embodiment, similarly to the first embodiment, the irradiation light having a color rendering property close to natural light is used without adversely affecting the skin to be irradiated, so that it is safe for the human body and natural light. It is possible to capture a row image that reproduces colors close to, and to consider a color image of skin images for high-accuracy color observation and high-accuracy stereoscopic information while considering the influence on the patient. Each of the stereoscopic image observation skin images can be easily generated.

  In addition, according to the present embodiment, in order to generate a column image in an environment in which the irradiation light is irradiated from a certain direction, the illuminance and irradiation angle of the irradiation light are set when capturing a captured image as in a conventional camera. Without having a different area, a skin image for color observation having high-precision color information and a skin image for stereoscopic effect observation having high-accuracy stereoscopic information need not be a doctor who is skilled in skin observation. Imaging can be performed. For this reason, according to the present embodiment, similar to the first embodiment, the skin image for tint observation and the skin image for stereoscopic observation observed by a general doctor are respectively in different locations, for example, in a remote place. A doctor skilled in skin observation in a hospital can observe and make a diagnosis.

<Third Embodiment>
The third embodiment of the present invention will be described below with reference to the drawings. FIG. 5 is a diagram showing a configuration example of a skin image capturing system 1A according to the third embodiment of the present invention. In FIG. 5, a skin image capturing system 1A includes a skin image capturing control device 11A, an image capturing position changing mechanism 12A, a line sensor 13, a first light source 14, and an image capturing target installation stage 16. Hereinafter, only the configuration and operation different from those of the first embodiment will be described for the skin image capturing system 1A according to the third embodiment. In the third embodiment, the main configuration different from the first embodiment is that the second light source 15 is not included as a component.
The skin image capturing control device 11 </ b> A controls each of the image capturing position changing mechanism 12 </ b> A, the line sensor 13, and the first light source 14.

The skin image capturing control device 11A controls the imaging position changing mechanism 12A, and each time the moving member is moved a predetermined distance in the arrow Q1 direction, the irradiation light is irradiated from the first light source 14 at a first angle, Take an image.
Then, the skin image capturing control device 11A writes and stores the captured column images in time series in the order in which they are captured in the tint observation column image storage area of the storage unit 113.

Then, the skin image capturing control device 11A captures the skin region to be imaged, and after scanning for moving at a predetermined distance in the arrow Q1 direction is completed, scanning for moving at a predetermined distance in the arrow Q2 direction. To start.
At this time, the skin image capturing control device 11A controls the imaging position changing mechanism 12A to change the fixed position of the first light source 14 to the position where the irradiation light is irradiated at the second angle and the fixed state.

The skin image capturing control device 11A controls the image capturing position changing mechanism 12A to irradiate the irradiation light from the first light source 14 at the second angle every time the moving member is moved a predetermined distance in the arrow Q2 direction. The column image is taken.
Then, the skin image capturing control device 11A writes and stores the captured column images in time series in the order in which the captured column images are captured in the stereoscopic image observation column image storage area of the storage unit 113.
Further, the generation processing of the color observation row image and the stereoscopic effect observation row image by the skin image capturing control device 11A is the same as that of the first embodiment.

Similarly to the second embodiment, in the scanning for moving the predetermined distance in the direction of the arrow Q1, each time the predetermined distance is moved, each of the color observation row image and the stereoscopic effect observation row image is generated. It is also possible to operate so as to capture each of the column images for the purpose.
That is, the skin image capturing control device 11A controls the imaging position changing mechanism 12A, moves the moving member a predetermined distance in the direction of the arrow Q1, and irradiates the irradiation light from the first light source 14 at the first angle, Take a row image.
Then, the skin image capturing control device 11A writes and stores the captured column images in time series in the order in which they are captured in the tint observation column image storage area of the storage unit 113.

The skin image capturing control device 11A controls the image capturing position changing mechanism 12A without moving the image capturing position, and the arrangement of the first light source 14 with respect to the moving member is fixed to the position where the irradiation light is irradiated at the second angle and fixed. Change to state.
Next, the skin image capturing control device 11A irradiates the irradiation light from the first light source 14 at the second angle at the same position as the position where the column image used for generating the color observation column image is captured, and the column Take an image.
Then, the skin image capturing control device 11A writes and stores the captured column images in time series in the order in which the captured column images are captured in the stereoscopic image observation column image storage area of the storage unit 113.

The skin image capturing control device 11A controls the image capturing position changing mechanism 12A to change the arrangement of the first light source 14 with respect to the moving member to the position where the irradiation light is irradiated at the first angle and the fixed state, and in the direction of the arrow Q1 Is moved a predetermined distance.
As described above, each time the skin image capturing control device 11 controls the imaging position changing mechanism 12 to move the moving member, the skin image capturing control device 11 corresponds to each of the first angle and the second angle at the same imaging position. While changing the arrangement of the first light source 14 with respect to the moving member, each of the column images for generating the color observation skin image and the stereoscopic effect observation skin image is captured.

According to the present embodiment, as described above, when capturing a row image for generating a skin image for color observation and a skin image for stereoscopic effect observation, each of which includes information having each of color and stereoscopic effect, By changing the arrangement of the first light source in the moving member, the irradiation direction of the irradiation light from the first light source 14 is switched between the first angle and the second angle.
For this reason, according to the present embodiment, for the purpose of suppressing the influence on the skin and improving the color rendering properties, the color rendering degree Ra is 90 or more, the spectral distribution is close to natural light, and only the light component having a wavelength in the visible light range is used. This makes it possible to reduce the number of expensive light sources that irradiate the irradiation light, thereby reducing the price of the system.

<Fourth Embodiment>
Hereinafter, a fourth embodiment of the present invention will be described with reference to the drawings. FIG. 6 is a diagram showing a configuration example of a skin image capturing system 1B according to the fourth embodiment of the present invention. In FIG. 6, the skin image capturing system 1B includes a skin image capturing control device 11B, an image capturing position changing mechanism 12B, a line sensor 13, a first light source 14, a second light source 15, an imaging target installation stage 16, and a third light source 17. It has. Hereinafter, only the configuration and operation different from those of the first embodiment will be described for the skin image capturing system 1B according to the fourth embodiment. In the fourth embodiment, the main configuration different from the first embodiment is that a third light source 17 is added as a component.
The skin image capturing control device 11B controls each of the image capturing position changing mechanism 12B, the line sensor 13, the first light source 14, the second light source 15, and the third light source 17.

In the fourth embodiment, a line sensor 13, a first light source 14, a second light source 15, and a third light source 17 are installed on a moving member scanned by the imaging position changing mechanism 12. Each of the line sensor 13, the first light source 14, and the second light source 15 is installed in the same manner as in the first embodiment.
In the fourth embodiment, the second light source 15 is set to the irradiation angle in the direction of the second_1 angle range as the second_1 angle at the second angle, and the third light source 17 is set to the second_2 angle at the second angle as the second_2 angle. The irradiation angle is set in the direction of the 2_2 angle range.

The skin image capturing control device 11B controls the image capturing position changing mechanism 12B to irradiate irradiation light from the first light source 14 at a first angle every time the moving member is moved a predetermined distance in the arrow Q1 direction, Take an image.
The skin image capturing control device 11B then writes and stores the captured column images in time series in the order in which they are captured in the color observation column image storage area of the storage unit 113B.

The skin image capturing control device 11B captures the skin region to be imaged, and after the scanning that moves every predetermined distance in the direction of the arrow Q2 is finished, the scanning that moves every predetermined distance in the direction of the arrow Q2 To start.
Next, the skin image capturing control device 11B controls the image capturing position changing mechanism 12B to irradiate the irradiation light from the second light source 15 at the second_1 angle every time the moving member is moved a predetermined distance in the direction of the arrow Q2. Then, a row image is taken.
The skin image capturing control device 11B then writes and stores the captured column images in time series in the order in which they are captured in the first stereoscopic effect observation column image storage area of the storage unit 113B.

The skin image capturing control device 11B captures the skin region to be imaged, and after scanning for moving at a predetermined distance in the arrow Q2 direction is completed, scanning for moving at a predetermined distance in the arrow Q1 direction is completed. To start.
Next, the skin image capturing control device 11B controls the image capturing position changing mechanism 12B to irradiate the irradiation light from the third light source 17 at the second_2 angle every time the moving member is moved a predetermined distance in the direction of the arrow Q2. Then, a row image is taken.
The skin image capturing control device 11B then writes and stores the captured column images in time series in the order in which they are captured in the second stereoscopic effect observation column image storage area of the storage unit 113B.

The color observing row image generation process is performed by the image composition unit 112B in the skin image capturing control device 11B in the same manner as in the first embodiment.
In addition, the image composition unit 112B in the skin image capturing control device 11B reads the column images captured at the second_1 angle from the first stereoscopic viewing observation column image storage area of the storage unit 113B in time series, and connects them in the order of reading. Thus, a first stereoscopic image observation row image is generated.
Similarly, the image compositing unit 112B reads out the column images captured at the second_2 angle in a time series from the second stereoscopic effect observation column image storage area of the storage unit 113B, and concatenates them in the read order to connect the second stereoscopic effect. An observation row image is generated.

Similarly to the second embodiment, in the scanning for moving a predetermined distance in the direction of the arrow Q1, every time the predetermined distance is moved, the color observation row image, the first stereoscopic effect observation row image, and the first image are displayed. You may operate | move so that each row image for producing | generating each row image for two-dimensional effect observation may be imaged.
That is, the skin image capturing control device 11B controls the imaging position changing mechanism 12B to move the moving member in the direction of the arrow Q1 by a predetermined distance with respect to the skin region to be imaged.
The skin image capturing control device 11 irradiates the irradiation light from the first light source 14 for a predetermined time, captures a column image for generating a skin image for color observation during the predetermined time, and stores the captured column image. Are written and stored in the color observation row image storage area of the unit 113B in time series.

Next, the skin image capturing control device 11B irradiates the irradiation light from the second light source 15 at the second_1 angle for a predetermined time without moving the moving member, and generates a first stereoscopic image skin image at the predetermined time. A column image is captured, and the captured column image is written and stored in the first stereoscopic effect observation column image storage area of the storage unit 113B in time series.
Further, the skin image capturing control device 11B irradiates the irradiation light from the third light source 17 at the second_2 angle for a predetermined time without moving the moving member, and generates the second stereoscopic effect observation skin image at the predetermined time. For this purpose, a column image is captured, and the captured column image is written and stored in the second stereoscopic effect observation column image storage area of the storage unit 113B in time series.

The image composition unit 112B in the skin image capturing control device 11B reads the column images from the color observation column image storage area of the storage unit 113B in time series and combines them in time series order to combine them for color observation. A sequence image is generated.
Similarly, the image composition unit 112B reads out the column images from the first stereoscopic image observation row image storage area of the storage unit 113B in time series, and combines them by combining them in time series order, thereby combining the first stereoscopic effect observation. A sequence image is generated.
In addition, the image composition unit 112B reads out the column images in time series from the second stereoscopic effect observation column image storage area of the storage unit 113B, and combines them by combining them in time series order, thereby combining the images for the second stereoscopic effect observation. Generate a column image.

  According to the present embodiment, since the first stereoscopic effect observation row image and the second stereoscopic effect observation row image are generated from the row images captured at the respective angles of the second_1 angle and the second_2 angle, they are different. The light from the oblique direction gives a shadow image corresponding to the shape of the unevenness, and the information of the three-dimensional effect increases, that is, the uneven state that cannot be observed from one side can be visually recognized from the other side. High observation and diagnosis can be performed.

<Fifth Embodiment>
The fifth embodiment of the present invention will be described below with reference to the drawings. FIG. 7 is a diagram showing a configuration example of a skin image capturing system 1C according to the fifth embodiment of the present invention. In FIG. 7, a skin image capturing system 1C includes a skin image capturing control device 11, an image capturing position changing mechanism 12, a line sensor 13, a first light source 14, a second light source 15, a third light source 17, and a subject fixing jig support 21. And a subject fixing jig 22. Hereinafter, only the configuration and operation different from those of the first embodiment will be described for a skin image capturing system 1C according to the fifth embodiment. In the fifth embodiment, the main configuration different from the first embodiment is that each of the subject fixing jig support 21 and the subject fixing jig 22 is added as a component instead of the stage 16. .

The subject fixing jig support 21 is a support for supporting the subject fixing jig 22, and includes a length adjustment mechanism that varies the distance (imaging distance) from the line sensor 13 to the surface of the skin to be imaged. It has been.
The subject fixing jig 22 is a jig for fixing the position of the surface of the skin to be imaged so as not to move up, down, left and right. For example, since the imaging target in FIG. 7 is the surface of the skin of the hand, it has a shape that is fixed so that the hand does not move. For this reason, since the shape of the subject fixing jig 22 varies depending on the imaging target, the subject fixing jig 22 is prepared as a different jig for each imaging target.
As a plane parallel to the surface 16S of the imaging target installation stage 16 in FIG. 1, the virtual horizontal plane 30 including the surface 40 of the imaging target skin corresponds. The subject fixing jig 22 can relatively fix the line sensor 13 to a virtual horizontal plane 30 parallel to the surface 16S of the imaging target installation stage 16.
Thereby, each of the 1st light source 14 and the 2nd light source 15 irradiates irradiation light with a 1st angle and a 2nd angle, respectively with respect to the virtual horizontal surface 30, and the surface 40 of the skin similarly to 1st Embodiment. In contrast, the irradiation light is incident at the first angle and the second angle.

According to the present embodiment, as described above, when capturing a row image for generating a skin image for color observation and a skin image for stereoscopic effect observation, each of which includes information having each of color and stereoscopic effect, Even if the imaging target installation stage 16 is not provided, the imaging target is placed on a predetermined fixed table, and the virtual horizontal plane 30 is irradiated with irradiation light at the first angle and the second angle, respectively. On the other hand, irradiation light can be irradiated at each of the first angle and the second angle.
For this reason, according to the present embodiment, it is possible to perform imaging of the surface of the skin that is the imaging target with each of the subject fixing jig support 21 and the subject fixing jig 22 as in the first embodiment. Even in places where the imaging target installation stage 16 or the like is not provided, the irradiation light having a color rendering property close to natural light is used without adversely affecting the skin of the irradiation target. It is possible to capture a row image that reproduces colors close to, and to consider a color image of skin images for high-accuracy color observation and high-accuracy stereoscopic information while considering the influence on the patient. Each of the stereoscopic image observation skin images can be easily generated.

  Further, a computer program for realizing the functions of the skin image capturing control device 11 shown in FIG. 1, the skin image capturing control device 11A shown in FIG. 5, and the skin image capturing control device 11B shown in FIG. Each of these images is recorded on a readable recording medium, and the program recorded on these recording media is read into a computer system and executed, whereby the skin is imaged according to the angle of irradiation light, and the skin image for color observation In addition, processing for generating each of the three-dimensional observation skin images may be performed. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system.

  Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. Further, the program may be a program for realizing a part of the functions described above, and is a so-called differential file that can realize the functions described above in combination with a program already recorded in the computer system. May be.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design and the like within a scope not departing from the gist of the present invention.

DESCRIPTION OF SYMBOLS 1,1A, 1B ... Skin image imaging system 11, 11A, 11B ... Skin image imaging control apparatus 12, 12A, 12B ... Imaging position change mechanism 13 ... Line sensor 14 ... 1st light source 15 ... 2nd light source 16 ... Imaging object installation Stage 21 ... Subject fixing jig support 22 ... Subject fixing jig 16S ... Surface 17 ... Third light source 111, 111A, 111B ... Imaging control unit 112, 112B ... Image composition unit 113, 113B ... Storage unit

Claims (12)

It is a skin image capturing system that captures the skin used for observation of a lesioned part of the skin as a column image, and synthesizes the column image to obtain a skin image.
A line sensor that captures a row image of the skin;
A lens system that is fixed to the line sensor and forms an image of the skin to be imaged on the line sensor;
A light source for irradiating the skin with irradiation light;
When changing the imaging position of each of the line sensor, the lens system, and the light source, an imaging position changing mechanism that moves the line sensor, the lens system, and the light source in synchronization so that the relative positions of the line sensor, the lens system, and the light source are the same. When,
With
At the imaging position, when capturing a first row image including information on the color of the skin in the row image, the row image is irradiated in a first angle range with respect to the surface of the skin to be observed. Irradiating the surface of the skin with the irradiation light in a second angle range different from the first angle range when capturing a second row image including information on the three-dimensional effect on the surface of the skin. Skin imaging system. The first angle range is an angle range in the irradiation direction where shadows due to unevenness on the surface of the skin do not occur, and the second angle range is an angle range in the irradiation direction where shadows due to unevenness on the surface of the skin occur. The skin image capturing system according to claim 1, wherein the system is a skin image capturing system. The first angle range is in the range of 70 ° to 110 ° with respect to the surface of the skin;
The skin image capturing system according to claim 2, wherein the second angle range is a range of 30 ° to 60 °, or 120 ° to 150 ° with respect to the surface of the skin. The skin light imaging system according to any one of claims 1 to 3, wherein the light source emits the irradiation light from which light having a wavelength component in an ultraviolet region is removed. The skin image capturing system according to any one of claims 1 to 4, wherein the irradiation light has a color rendering index of 90 or more, and desirably a color rendering index of 95 or more. An imaging control unit that controls imaging of the row image;
The imaging position changing mechanism is controlled to move the line sensor to the imaging position by a predetermined distance unit, and the line sensor is controlled to irradiate the irradiation light in a first angle range for each imaging position. The first row image is picked up, and the second row image is picked up by irradiating the irradiation light in a second angle range. Skin imaging system. The skin light imaging system according to any one of claims 1 to 6, wherein the light source is a line light source or a surface light source, and is provided in parallel with the line sensor. The light source is composed of each of a first light source and a second light source, the irradiation light emitted from the first light source is provided at a position within the first angle range, and the irradiation from which the second light source irradiates itself. The skin image capturing system according to any one of claims 1 to 7, wherein light is provided at a position within the first angle range. When the line sensor images the skin image at the imaging position, the irradiation light emitted from the light source falls within the first angle range, and the irradiation light emitted from the light source corresponds to the second angle. The skin image capturing system according to any one of claims 1 to 7, further comprising a light source moving mechanism that moves the light source to a position that falls within a range. The second angle range includes a second_1 angle range and a second_2 angle range, and each of the second_1 angle range and the second_2 angle range is symmetric with respect to a plane perpendicular to the moving direction of the line sensor. It is set as an angle range, and for each imaging position, the irradiation light is irradiated in the second_1 angle range to capture the column image, and the irradiation light is irradiated in the second_2 angle range to the column. An image is picked up. The skin image pick-up system according to any one of claims 1 to 9 characterized by things. The skin image capturing system according to any one of claims 1 to 10, wherein the lens system is a telecentric optical system. It is a skin image imaging method of capturing the skin used for observation of a lesioned portion of the skin as a column image, and synthesizing the column image to obtain a skin image.
An imaging process in which the line image of the skin is captured by a line sensor fixedly provided with a lens system that forms an image of the skin to be imaged;
A light irradiation process of irradiating the skin with irradiation light by a light source;
When changing the imaging position of each of the line sensor, the lens system, and the light source by the imaging position changing mechanism, they are synchronized so that the relative positions of the line sensor, the lens system, and the light source are the same. Changing the imaging position to be moved,
Including
At the imaging position, when capturing a first row image including information on the color of the skin in the row image, the row image is irradiated in a first angle range with respect to the surface of the skin to be observed. Irradiating the surface of the skin with the irradiation light in a second angle range different from the first angle range when capturing a second row image including information on the three-dimensional effect on the surface of the skin. Skin image capturing method.

Images