JP7143631B2 - Skin imaging system and skin imaging method - Google Patents

Description

The present invention relates to a skin imaging system and a skin imaging method.

Conventionally, in order to diagnose and observe skin conditions, skin diseases, or organ diseases that manifest skin symptoms, the skin at any position on the human body is imaged with a camera, and the skin as a captured image. There are devices that acquire images (see, for example, Patent Documents 1 and 2).
In addition, in order to capture skin images for accurately observing the state of the skin surface, a contact-type camera, a magnifying glass that magnifies the skin surface when capturing an image, and a light source that irradiates the light necessary for imaging are used. There are combined dermoscopes (see, for example, US Pat.

JP-A-62-59913 JP 2004-187248 A JP 2015-157018 A

However, in the method of imaging with a camera in Patent Documents 1 and 2, the focal distance from the camera to the skin of the imaging target varies between the center and the edge of the captured image.
For this reason, when the imaging range is widened, distortion occurs at the edges of the captured image, deteriorating the quality, and accurate diagnosis and observation using the captured skin image cannot be performed.

In addition to the focal length described above, the light source distance, which is the distance between the light source and the skin of the imaging target, is not constant. For this reason, the skin image captured under the light source described above changes in color depending on the position of the image (due to the difference in light source distance), and in this respect as well, it cannot be used for accurate diagnosis and observation.
With respect to the above-described change in color, it is conceivable to use a ring light as a light source to reduce the change in color, but the problem of different focal lengths cannot be solved.

On the other hand, when observing the condition of the skin, it is possible to suppress the change in color of the skin image by using the ring light.
However, the use of this ring light makes it difficult for shadows due to unevenness on the skin surface to occur, and it is not possible to capture a skin image for obtaining a three-dimensional effect on the skin surface.
By the way, in the present invention, "shading" includes "shading" due to changes in the direction of light incidence and the direction of observation (imaging) due to the fact that light has unevenness (inclined portions). However, it is not limited to an area where light does not reach completely.

Further, in the case of a general single-chip CCD digital camera imaging method, each of RGB (red, green, and blue color components) is blurred for four pixels and assigned to adjacent pixels to generate an image. . Here, the single-chip CCD digital camera is a camera using a CCD (Charge Coupled Device), which is a single image sensor, as an image sensor for imaging.
Due to this configuration, the mechanism for suppressing pixel color mixing becomes complicated, and because the image processing method differs for each type of camera, the resolution decreases in the processing of color reproduction in the skin image when observing the skin. In addition, accurate color reproduction cannot be performed. The same applies to the single-chip CMOS digital camera imaging system. Here, a single-chip CMOS digital camera is a camera that uses a CMOS (Complementary Metal Oxide Semiconductor) sensor, which is a single image sensor, as an image sensor for imaging, and is currently commonly known as a digital camera.

The method using a dermoscope in Patent Document 3 can capture a high-definition skin image when observing the local surface state of the skin.
Since this observation using a dermoscope uses high-intensity irradiation light and a magnifying glass, it is possible to image the skin condition from the surface of the skin to a depth of about 1 mm.
However, when imaging the skin using a dermoscope, it is necessary to apply jelly to the area to be imaged, and to bring the imaging device into contact with the area to be imaged, which imposes a heavy burden on the patient undergoing the examination. become a thing.

In addition, although the dermoscope is compatible with local imaging, it cannot capture a wide range of skin images and cannot be used to observe a wide range of skin conditions.
In many cases, skin abnormalities due to skin diseases or visceral diseases develop over a wide area of the body.
For this reason, depending on the dermoscope, the imaging range is locally limited to about several millimeters, and lesions (such as skin abnormalities due to skin diseases and visceral diseases) cannot be sufficiently observed over a wide range.

Therefore, when performing observation with a dermoscope, the doctor who examines observes the entire lesion that has developed in the patient, extracts the most appropriate local area as an observation target, and images this local area. .
For this reason, it is difficult for anyone other than a doctor who is familiar with skin care to extract a suitable local area as an observation target, and it is difficult to obtain a skin image necessary for observation.

The present invention has been made in view of the above circumstances. Provided are a skin image capturing system and a skin image capturing method capable of easily capturing a skin image of a lesion of the skin necessary for observing the skin, including the information of .

The present invention has been made to solve the above-described problems, and the skin imaging system of the present invention captures the skin used for observation of a lesion of the skin as a series of images, and synthesizes the series of images. A skin imaging system for acquiring a skin image, comprising: a line sensor for imaging a row image of the skin; a lens system for forming an image of the skin to be imaged on an imaging element in the line sensor; Synchronization so that the relative positions of the line sensor, the lens system, and the light source are the same when the imaging positions of the light source that emits irradiation light, the line sensor, the lens system, and the light source are changed. an imaging position changing mechanism for moving the image by moving the image, an imaging control section for controlling imaging of the row images, and an image synthesizing section for synthesizing the row images , wherein the imaging control section includes the imaging position changing mechanism to move the line sensor to the imaging position by a predetermined distance unit, and irradiate the irradiation light in a first angle range with respect to the surface of the skin for each imaging position to obtain a first row image In addition to capturing an image , a second row image is captured by irradiating the surface of the skin with the irradiation light in a second angle range different from the first angle range, and the image synthesizing unit performs generating a first image by connecting and synthesizing the plurality of first-row images taken according to the imaging positions; The second image is generated by connecting and synthesizing according to the imaging position .
In the skin imaging system of the present invention, the second angle range is composed of a 2_1 angle range and a 2_2 angle range, and each of the 2_1 angle range and the 2_2 angle range corresponds to the moving direction of the line sensor. The imaging control unit controls the imaging position changing mechanism to move the line sensor to the imaging position by a predetermined distance unit, and the For each imaging position, the irradiation light is applied to the skin surface in the 2_1 angle range to capture a third row image, and the irradiation light is applied to the skin surface in the 2_2 angle range. to capture a fourth row image, and the image synthesizing unit joins and synthesizes the plurality of third row images captured according to the imaging position according to the imaging position, thereby forming a third An image is generated, and a fourth image is generated by connecting and synthesizing a plurality of the fourth row images captured according to the imaging positions according to the imaging positions.

In the skin imaging system of the present invention, the first angle range is an angle range of the irradiation direction in which shadows due to unevenness on the surface of the skin do not occur, and the second angle range is an angle range in which shadows due to unevenness on the surface of the skin occur. It is characterized by being the angle range of the irradiation direction.

In the skin imaging system of the present invention, the first angular range ranges from 70° to 110° with respect to the skin surface, and the second angular range ranges from 30° to 60° with respect to the skin surface. , or in the range of 120° to 150°.

The skin imaging system of the present invention is characterized in that the light source emits the irradiation light from which at least light of wavelength components in the ultraviolet region is removed.

The skin imaging system of the present invention is characterized in that the illumination light has a color rendering index (general color rendering index) of 90 or higher, preferably 95 or higher.

The skin imaging system of the present invention is characterized in that the light source is a linear light source or a surface light source and is provided parallel to the line sensor.

In the skin imaging system of the present invention, the light source is composed of each of a first light source and a second light source, and is provided at a position where the irradiation light emitted by the first light source is in the first angle range, It is characterized in that the second light source is provided at a position where the irradiation light emitted by itself falls within the second angle range.

In the skin image capturing system of the present invention, the light source is positioned such that when the line sensor captures the skin image at the image capturing position, the irradiation light emitted by the light source is in the first angle range, and the light source is It is characterized by further comprising a light source moving mechanism for moving the irradiation light to a position where the irradiation light falls within the second angular range.

In the skin imaging system of the present invention, the second angle range is composed of a 2_1 angle range and a 2_2 angle range, and each of the 2_1 angle range and the 2_2 angle range is in the moving direction of the line sensor. The imaging control unit controls the imaging position changing mechanism to move the line sensor to the imaging position by a predetermined distance unit, and performs the imaging. For each position and for each imaging position, the illumination light is emitted in the 2_1 angle range to capture a third row image, and the illumination light is emitted in the 2_2 angle range to capture a third row image. Four -row images are captured, and the image synthesizing unit generates a third image by connecting and synthesizing the plurality of third-row images captured according to the imaging positions according to the imaging positions, A fourth image is generated by connecting and synthesizing a plurality of the fourth row images captured according to the imaging positions according to the imaging positions .

The skin imaging system of the present invention is characterized in that the lens system is a telecentric optical system.

The skin imaging method of the present invention is a skin imaging method in which the skin used for observation of a lesion of the skin is imaged as a series of images, and the series of images are synthesized to obtain a skin image. An imaging process of imaging a row image of the skin with a line sensor fixedly provided with a lens system that forms an image of the skin, a light irradiation process of irradiating the skin with light from a light source, and changing the imaging position. Imaging by moving the line sensor, the lens system, and the light source in synchronization by a mechanism so that the relative positions of the line sensor, the lens system, and the light source are the same when the imaging positions of the line sensor, the lens system, and the light source are changed. a position changing process; an imaging control process for controlling imaging of the column images by an imaging control unit; and an image synthesizing process for synthesizing the column images by an image synthesizing unit , wherein the imaging control unit controls the imaging position changing mechanism. to move the line sensor to the imaging position by a predetermined distance unit, and irradiate the irradiation light in a first angle range with respect to the surface of the skin for each imaging position to obtain a first row image In addition to capturing an image , a second row image is captured by irradiating the surface of the skin with the irradiation light in a second angle range different from the first angle range, and the image synthesizing unit performs generating a first image by connecting and synthesizing the plurality of first-row images taken according to the imaging positions; The second image is generated by connecting and synthesizing according to the imaging position .

According to the present invention, even a physician other than a doctor who is familiar with skin diagnosis can obtain information necessary for skin observation, including information on the color of the skin and the three-dimensional effect of the skin surface, without imposing a burden on the patient. It is possible to provide a skin image capturing system and a skin image capturing method that can easily capture a skin image of a lesion of the skin.

FIG. 1 is a diagram showing a configuration example of a skin imaging system 1 according to a first embodiment of the present invention. It is a conceptual diagram explaining the surface structure of human skin. 4A and 4B are diagrams for explaining each of a first angle of irradiation light from a first light source and a second angle of irradiation light from a second light source; FIG. 3 is a conceptual diagram for explaining wavelength components contained in irradiation light emitted by each of a first light source 14 and a second light source 15; FIG. It is a figure which shows the structural example of 1 A of skin imaging systems by the 3rd Embodiment of this invention. It is a figure which shows the structural example of the skin imaging system 1B by the 4th Embodiment of this invention. It is a figure which shows the structural example of 1 C of skin imaging systems by the 5th Embodiment of this invention.

<First embodiment>
A first embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a configuration example of a skin imaging system 1 according to a first embodiment of the present invention. In FIG. 1 , the skin imaging system 1 includes a skin imaging control device 11 , an imaging position changing mechanism 12 , a line sensor 13 , a first light source 14 , a second light source 15 , and an imaging target setting stage 16 .
Skin imaging control device 11 controls each of imaging position changing mechanism 12 , line sensor 13 , first light source 14 and second light source 15 .

The imaging position changing mechanism 12 relatively moves each of the line sensor 13, the first light source 14, and the second light source 15 with respect to the imaging target (skin area with a lesion on the skin).
The line sensor 13 is, for example, a sensor in which a plurality of CCD elements (or CMOS elements) are arranged in a row. is imaged.
The line sensor 13 is provided in front of the CCD element (or CMOS element) with a lens system 13R for forming an image of the skin on the CCD element (or CMOS element). This lens system 13R is a telecentric optical system, which is a special lens system. The telecentric optical system is different from a general lens optical system in that the chief ray (the central ray of the light beam emitted from one point on the surface of the skin, which is the object, and entering the lens system 13R) is aligned with the optical axis of the lens system 13R. is parallel to Therefore, when the diaphragm is placed at the focal position on the image side (that is, the imaging surface of the CCD element), the principal ray from the skin surface becomes parallel to the optical axis of the lens system 13R, and the position of the skin is in the optical axis direction. Even if it shifts and changes, the image formed on the CCD element will be blurred, but the magnification of the image formed and the imaging position will not change.
With the above-described configuration, it is possible to obtain an image viewed from one parallel direction (for example, the direction connecting the central axis of the lens system 13R and the imaging site of the skin, preferably the direction perpendicular to the skin surface) in the field of view to be imaged, This is desirable in medical skin imaging where imaging conditions must be strictly controlled and recorded.
Also, telecentric optical systems are well known in the field of lens optics and have been commercialized as lens systems, and will not be described further here.

Here, the lens system is an optical system composed of a combination of a plurality of lenses for forming an image of an object to be imaged on the line sensor. When the distance between the lens system and the object to be imaged changes from its focal area and the line sensor does not form an in-focus image, the inside of the lens system will By changing the lens position, it is possible to capture an image of the object to be imaged with high resolution without changing the distance between the lens system and the object to be imaged. By applying such an automatic focus adjustment function to the line sensor 13 as the lens system 13R, it is possible to obtain a wide range of focus (high spatial resolution) images can be easily obtained, and skin images for examination can be easily obtained. Since such a focus position adjustment function is well-known by its name and known, it will not be described in this embodiment.

The first light source 14 is a light source that irradiates the surface of the skin to be imaged with irradiation light from a predetermined first angle when capturing a row image including skin color information.
The second light source 15 is a light source that irradiates the skin of the imaging target with irradiation light from a predetermined second angle when capturing a row image containing information on the stereoscopic effect indicating the unevenness of the surface of the skin of the imaging target. be.

Each of the first light source 14 and the second light source 15 is a linear light source or a surface light source having the same length as the longitudinal direction of the line sensor 13. is irradiated with constant light. Alternatively, a configuration may be used in which the LED light sources are arranged in a line to form a pseudo linear light source. Hereinafter, in this embodiment, each of the first light source 14 and the second light source 15 will be described as a linear light source. Each of the first light source 14 and the fifteenth light source is arranged such that the irradiation surface in the longitudinal direction is parallel to the array of pixels of the line sensor 13 .

The imaging target setting stage 16 is a stage on which a part of the patient to be imaged is placed and the skin of the part is made to face the imaging unit of the line sensor 13 . For example, when imaging the skin on the back of a patient's hand, the palm of the patient's hand is placed on the surface 16S of the imaging target setting stage 16, and the back of the hand faces upward.

FIG. 2 is a conceptual diagram illustrating the surface structure of human skin. FIG. 2(a) is a surface view of the skin surface, and FIG. 2(b) is a perspective view of the skin surface.
As can be seen from FIG. 2, the skin surface 50 has sulcus cutis 51 , carpus 52 , pores 53 , and sweat pores 55 . When the skin image is captured, the objects to be observed and diagnosed in particular are the color of the skin and the three-dimensional shape (three-dimensional effect) of the concave skin grooves 51 and pores 53 and the convex skin bumps 52 .
In this embodiment, two skin images are captured in order to obtain information on the color of the skin and information on the three-dimensional effect of the unevenness of the skin surface. One sheet is a skin image for color observation used for observing the color of the skin, and the other sheet is a skin image for stereoscopic effect observation used for observing the stereoscopic effect of the skin surface.

FIG. 3 is a diagram explaining each of the first angle of the irradiation light from the first light source 14 and the second angle of the irradiation light from the second light source 15 . In FIG. 3, the imaging direction of the line sensor 13 is the direction of the arrow P, and this imaging direction is perpendicular to the surface 16S of the imaging target installation stage 16. As shown in FIG.
The first angle is an angle within the first angle range from the counterclockwise angle β to the angle width Δβ, that is, from the angle β to the angle β+Δβ with respect to the surface 16S of the imaging target setting stage 16 as a reference. This first angle is set as an angle at which shadows due to unevenness of the skin surface do not occur so that the color of the skin surface can be observed with high accuracy.

That is, when a shadow occurs due to the unevenness of the skin surface, the color of the skin in the shaded portion is imaged as a color different from the actual color. The area is irradiated with the irradiation light at an angle close to the vertical direction. In the present embodiment, the first angle range of the first angle is set from the angle β to the angle β+Δβ, preferably from 70° to 110° (Δβ is 40°).

The second angle is set as the 2_1 angle and the 2_2 angle that fall within the 2_1 angle range or the 2_2 angle range, respectively. The 2_1-th angle range is the range from the counterclockwise angle α1 to the angle width Δα1, that is, the angle range from the angle α1 to the angle α1+Δα1, with the surface 16S of the imaging target setting stage 16 as a reference. In this embodiment, the 2_1-th angle range is set to range from the angle α1 to the angle α1+Δα1, preferably from 30° to 60° (Δα1 is 30°).

The 2_2 angle range is a range from the counterclockwise angle α2 to the angle width Δα2, that is, the angle range from the angle α2 to the angle α2+Δα2, with the surface 16S of the imaging target setting stage 16 as a reference. In this embodiment, the 2_2 angle range is set to range from angle α2 to angle α2+Δα2, preferably from 120° to 150° (Δα2 is 30°).

This second angle is an angle of the irradiation direction of the irradiation light for the purpose of positively imaging the shadows generated by the degree of unevenness of the sulcus cutis and the skin bumps in order to visually recognize the three-dimensional effect of the unevenness of the surface of the skin. is.
As described above, when trying to obtain information on the color of the surface of the skin with high accuracy, when trying to obtain information on the three-dimensional effect of unevenness on the surface of the skin by irradiating the irradiation light at an angle at which shadows do not occur. , it is necessary to generate shadows. Therefore, there is a trade-off relationship between the acquisition of information on color and stereoscopic effect.

In the present embodiment, as described above, a skin image for color observation for accurately observing color information and a skin image for stereoscopic observation for accurately observing information on stereoscopic effect are used. Each is imaged separately.
That is, in order to synthesize a skin image for color observation, irradiation light is emitted from the first light source 14 at a first angle, and line images are captured by the line sensor 13 . The skin image capturing control device 11 causes the line sensor 13 to sequentially capture line images of the skin surface under the irradiation light of the first light source 14 each time the line sensor 13 is moved by a predetermined distance. Here, the distance of the moving process is appropriately and arbitrarily set according to the resolution of the skin image for color observation that is finally generated by synthesizing the row images. For example, basically, the distance is set to be approximately the same as the interval between the CCD elements (imaging elements) arranged in series in the line sensor 13 .

Then, the skin image capturing control device 11 captures row images by the line sensor 13 while scanning at predetermined distances in the direction of the arrow Q1. Scanning is started every predetermined distance in the direction of arrow Q2 opposite to the direction of arrow Q1.
Here, in scanning in the arrow Q2 direction, the skin image capturing control device 11 sequentially captures the column images of the skin surface under the irradiation light of the second light source 15 each time the line sensor 13 is moved by a predetermined distance. A line image is captured by the line sensor 13 . Here, the distance of the moving process is the same as in the case of picking up the row images of the skin images for color observation.

In this embodiment, each of the line sensor 13, the first light source 14, and the second light source 15 is fixed in relative position, and the row images are captured while moving by a predetermined distance.
That is, the skin imaging control device 11 is provided with a line sensor 13 each time a row of row images is captured, and each of the first light source 14 and the second light source 15 irradiates at a first angle and a second angle, respectively. By controlling the imaging position changing mechanism 12, a moving member (not shown) attached in a state of emitting light is moved by a predetermined distance, and processing for photographing the next row of images is sequentially performed.
As a result, according to the present embodiment, the line sensor 13 can create an environment in which each of the irradiation angle and the amount of irradiated light is constant for each image pickup with respect to the area where the line image is picked up. It is possible to capture a row image that includes surface color and stereoscopic information with high accuracy.

Further, in this embodiment, the wavelength components of the irradiation light emitted from each of the first light source 14 and the second light source 15 are limited to a band that does not affect the human body.
That is, the wavelength band of light emitted from each of the first light source 14 and the second light source 15 is limited to the visible light wavelength range.
Furthermore, in the present embodiment, the color rendering index (CRI (Color Rendering Index), Ra) of the light emitted by each of the first light source 14 and the second light source 15 is also 90 or more. Preferably, the color rendering index is limited to 95 or more, and a light source that emits irradiation light having the above color rendering index is used. When the color rendering index Ra is 100, it indicates that colors similar to those of natural light are reproduced (having color rendering properties).

FIG. 4 is a conceptual diagram illustrating wavelength components included in the irradiation light emitted by each of the first light source 14 and the second light source 15. As shown in FIG.
FIG. 4(a) shows the spectral distribution of a general white fluorescent lamp, with the horizontal axis representing the wavelength of light and the vertical axis representing the energy receiving ratio.
The ultraviolet region is light having wavelengths less than about 400 nm, and the infrared region is light having wavelengths greater than or equal to about 800 nm. Light in the ultraviolet range has an adverse effect on irradiated skin cells (for example, sunburn, ie, burns), and may induce symptoms such as spots, wrinkles, and sagging on the skin. In addition, since light in the infrared region is light in the heat ray region, it heats the irradiated skin and causes a change in color, etc., and the accuracy of color information in the captured skin image for color observation is reduced. may cause

For the reasons described above, in the present embodiment, light components having wavelengths in the ultraviolet region and infrared region are removed, and light components having wavelengths in the visible light region with a wavelength of 400 nm or more and less than 800 nm are removed. , and illuminates the area of the skin to be imaged.
Further, depending on the purpose of observation, irradiation light may be generated and used by removing only light components of less than 400 nm, which adversely affect the skin, without removing light in the infrared region.

FIG. 4B shows the spectral distribution of sunlight (natural light), with the horizontal axis representing the wavelength of light and the vertical axis representing the received energy ratio. In the spectral distribution of sunlight, the received energy ratio is almost constant over the entire wavelength range (having light with smooth continuity of wavelengths).
By approximating the spectral characteristics of sunlight, it is possible to obtain a color space having color reproducibility due to sunlight, and obtain color rendering properties equivalent to those of sunlight.

As described above, in the present embodiment, light components with wavelengths of less than 400 nm and 800 nm or more are removed from light having a spectral distribution close to that shown in FIG. A light source is used which irradiates a light component having a wavelength in the visible light region within the wavelength range.

Returning to FIG. 1 , the skin image capturing control device 11 includes an image capturing control section 111 , an image synthesizing section 112 and a storage section 113 .
The imaging control unit 111 controls each of the imaging position changing mechanism 12, the line sensor 13, the first light source 14, and the second light source 15 as described above. The imaging control unit 111, for example, controls the imaging position changing mechanism 12 in the direction of the arrow Q1 to move the moving member by a predetermined distance, emits irradiation light from the first light source 14, sequentially captures the row images, and captures the images. The column images obtained are written in time series to the storage unit 113 and stored.

In addition, after scanning in the direction of arrow Q1 is completed (all the row images in the imaging range of the skin are imaged), the imaging control unit 111 controls the imaging position changing mechanism 12 in the direction of arrow Q2 to move the moving member to a predetermined position. While moving by a distance, the second light source 15 irradiates irradiation light to sequentially pick up row images, and the picked row images are written and stored in the storage unit 113 in time series.

Then, the image synthesizing unit 112 reads from the storage unit 113 all of the row images captured by scanning in the direction of the arrow Q1, connects and synthesizes the read row images in chronological order, and performs color observation. Generate a skin image for The generated skin image for color observation is written into the storage unit 113 and stored.
Similarly, the image synthesizing unit 112 reads out from the storage unit 113 all the row images captured by scanning in the direction of the arrow Q2, connects and synthesizes the read row images in chronological order, and produces a three-dimensional effect. Generate a skin image for observation. The generated skin image for stereoscopic effect observation is written into the storage unit 113 and stored.
In addition, the above-described image synthesizing unit 112 adjusts the relative positions of the lens groups inside the lens system 13R in response to changes in the distance between the lens system 13R and the skin, which is an object to be photographed, due to the effects of unevenness. It is desirable to include a function (not shown) for changing the focal position (distance) by adjusting the .
At that time, when the focus position is adjusted, the size and position of the skin image on the line sensor 13 may change. The image synthesizing unit 112 is required to adjust the row images so that the connection of the row images changed due to focus position adjustment becomes a continuous image that is equal to the actual skin. A variety of common methods of treatment may be selected and used.

Therefore, according to the present embodiment, since irradiation light having a color rendering property close to that of natural light is used without adversely affecting the skin of the irradiation target, a row image that is safe for the human body and reproduces colors close to natural light can be produced. It is possible to take an image, and while taking into consideration the effect on the patient, the skin image for color observation having highly accurate color information and the skin image for stereoscopic observation having highly accurate information of stereoscopic effect. Each can be easily generated individually.

In addition, according to the present embodiment, since row images are generated in an environment in which irradiation light is emitted from a certain direction, the illuminance and irradiation angle of the irradiation light are different from those of a conventional camera when an image is captured. A skin image for color observation that has highly accurate color information and a skin image for stereoscopic observation that has highly accurate three-dimensional information without having different regions can be obtained by a doctor who is not skilled in skin observation. It becomes possible to take an image. For this reason, according to the present embodiment, skin images for color observation and skin images for stereoscopic observation captured by a general doctor are obtained by a doctor skilled in skin observation at a different location, for example, a remote hospital. It is possible to observe and make a diagnosis.

<Second embodiment>
A second embodiment of the present invention will be described below with reference to the drawings. The configuration of the skin imaging system 1 according to the second embodiment is the same as that of the first embodiment shown in FIG. Only the operations of the skin imaging system 1 according to the second embodiment that differ from those of the first embodiment will be described below.

In the second embodiment, the skin imaging control device 11 controls the imaging position changing mechanism 12 to move the moving member by a predetermined distance with respect to the skin region to be imaged.
Then, the skin image capturing control device 11 irradiates the irradiation light from the first light source 14 for a predetermined time, captures row images for generating a skin image for color observation during this predetermined time, and stores the captured row images. The data are written in chronological order and stored in the color observation column image storage area of the unit 113 .

Next, the skin image capturing control device 11 irradiates the irradiation light from the second light source 15 for a predetermined period of time without moving the moving member, and generates row images for generating skin images for stereoscopic effect observation during this predetermined period of time. The captured row images are written in chronological order and stored in the row image storage area for stereoscopic effect observation of the storage unit 113 .
The skin image capturing control device 11 reads out the column images in time series from the column image storage area for color observation in the storage unit 113, and generates column images for color observation by connecting and synthesizing them in chronological order. do. Similarly, the skin image capturing control device 11 reads the column images in time series from the column image storage area for stereoscopic observation in the storage unit 113, and combines them in chronological order to obtain the column images for stereoscopic observation. Generate an image.

As described above, every time the imaging position changing mechanism 12 is controlled to move the moving member, the skin image imaging control device 11 changes the skin image for color observation and the skin image for stereoscopic effect observation at the same imaging position. Each column image that produces each is captured.
Therefore, according to the present embodiment, the pixel positions of the skin image for color observation and the skin image for stereoscopic effect observation generated by synthesizing the row images correspond to the same skin position. Therefore, there is no need to align the skin image for color observation and the skin image for stereoscopic effect observation (process the captured image), and it is possible to use the captured raw data as it is.

Further, according to the present embodiment, as in the first embodiment, since irradiation light having a color rendering property close to that of natural light is used without adversely affecting the skin to be irradiated, it is safe for the human body and natural light is used. This makes it possible to capture a series of images that reproduce colors close to those of the original, while taking into consideration the effect on the patient, and combining skin images for color observation with highly accurate color information and highly accurate three-dimensional information. Each of the skin images for stereoscopic observation can be easily generated.

In addition, according to the present embodiment, since row images are generated in an environment in which irradiation light is emitted from a certain direction, the illuminance and irradiation angle of the irradiation light are different from those of a conventional camera when an image is captured. A skin image for color observation that has highly accurate color information and a skin image for stereoscopic observation that has highly accurate three-dimensional information without having different regions can be obtained by a doctor who is not skilled in skin observation. It becomes possible to take an image. Therefore, according to the present embodiment, as in the first embodiment, the skin image for color observation and the skin image for stereoscopic effect observation captured by a general doctor are captured at different locations, for example, at remote locations. A doctor skilled in skin observation in a hospital can observe and make a diagnosis.

<Third Embodiment>
A third embodiment of the present invention will be described below with reference to the drawings. FIG. 5 is a diagram showing a configuration example of a skin imaging system 1A according to a third embodiment of the present invention. In FIG. 5, the skin imaging system 1A includes a skin imaging control device 11A, an imaging position changing mechanism 12A, a line sensor 13, a first light source 14, and an imaging target installation stage 16, respectively. Only the configuration and operation of the skin imaging system 1A according to the third embodiment, which are different from those of the first embodiment, will be described below. In the third embodiment, the main configuration different from the first embodiment is that the second light source 15 is not included as a component.
11 A of skin imaging control apparatuses control each of 12 A of imaging position change mechanisms, the line sensor 13, and the 1st light source 14. FIG.

The skin imaging control device 11A controls the imaging position changing mechanism 12A, and every time the moving member is moved a predetermined distance in the direction of the arrow Q1, the irradiation light is emitted from the first light source 14 at a first angle, and the row Take an image.
Then, the skin image capturing control device 11A writes and stores the captured row images in the color observation row image storage area of the storage unit 113 in chronological order in which the images were taken.

Then, the skin imaging control device 11A picks up an image of the skin area to be imaged, and after the scanning of moving in the direction of arrow Q1 by a predetermined distance is completed, the scanning of moving in the direction of arrow Q2 by a predetermined distance. to start.
At this time, the skin imaging control device 11A controls the imaging position changing mechanism 12A to change the fixed position of the first light source 14 to a position and a fixed state in which irradiation light is emitted at a second angle.

Then, the skin imaging control device 11A controls the imaging position changing mechanism 12A, and irradiates the irradiation light from the first light source 14 at the second angle each time the moving member is moved by a predetermined distance in the direction of the arrow Q2. , to capture a column image.
Then, the skin image capturing control device 11A writes and stores the captured row images in the order of imaging in the row image storage area for stereoscopic effect observation of the storage unit 113 in time series.
Further, the generation processing of each of the color observation row images and the stereoscopic effect observation row images by the skin image imaging control device 11A is the same as in the first embodiment.

Further, as in the second embodiment, each time a predetermined distance is moved in a scan in which a predetermined distance is moved in the direction of the arrow Q1, a color observation row image and a stereoscopic effect observation row image are generated. You may operate so that each row|line|column image for performing may be imaged.
That is, the skin imaging control device 11A controls the imaging position changing mechanism 12A, moves the moving member by a predetermined distance in the arrow Q1 direction, irradiates the irradiation light from the first light source 14 at the first angle, Take a column image.
Then, the skin image capturing control device 11A writes and stores the captured row images in the color observation row image storage area of the storage unit 113 in chronological order in which the images were taken.

In addition, the skin imaging control device 11A controls the imaging position changing mechanism 12A without moving the imaging position, and the arrangement of the first light source 14 with respect to the moving member is changed to the position to irradiate the irradiation light at the second angle and to the fixed position. change to state.
Next, the skin image capturing control device 11A irradiates the irradiation light from the first light source 14 at the second angle at the same position as the position where the column image used for generating the color observation column image is captured, and the column Take an image.
Then, the skin image capturing control device 11A writes and stores the captured row images in the order of imaging in the row image storage area for stereoscopic effect observation of the storage unit 113 in time series.

In addition, the skin imaging control device 11A controls the imaging position changing mechanism 12A, changes the arrangement of the first light source 14 with respect to the moving member to a position where the irradiation light is emitted at the first angle and a fixed state, and the arrow Q1 direction to move a predetermined distance.
As described above, every time the skin imaging control device 11 controls the imaging position changing mechanism 12 to move the moving member, the same imaging position corresponds to the first angle and the second angle, While changing the arrangement of the first light source 14 with respect to the moving member, each of the row images that generate the skin image for color observation and the skin image for stereoscopic effect observation are captured.

According to the present embodiment, as described above, when capturing row images for generating the skin image for color observation and the skin image for stereoscopic observation, each of which has information on color and stereoscopic effect, By changing the arrangement of the first light source on the moving member, the irradiation direction of the irradiation light from the first light source 14 is switched between the first angle and the second angle.
Therefore, according to the present embodiment, in order to suppress the influence on the skin and improve the color rendering property, the color rendering index Ra is set to 90 or more, and the spectral distribution is close to that of natural light. It is possible to reduce the number of expensive light sources that irradiate the irradiating light, and the cost of the system can be reduced.

<Fourth Embodiment>
A fourth embodiment of the present invention will be described below with reference to the drawings. FIG. 6 is a diagram showing a configuration example of a skin imaging system 1B according to the fourth embodiment of the present invention. In FIG. 6, the skin imaging system 1B includes a skin imaging control device 11B, an imaging position changing mechanism 12B, a line sensor 13, a first light source 14, a second light source 15, an imaging target installation stage 16, and a third light source 17. It has Only the configuration and operation of the skin imaging system 1B according to the fourth embodiment, which are different from those of the first embodiment, will be described below. In the fourth embodiment, the main difference from the first embodiment is that a third light source 17 is added as a component.
Skin imaging control device 11B controls imaging position changing mechanism 12B, line sensor 13, first light source 14, second light source 15 and third light source 17, respectively.

In the fourth embodiment, a line sensor 13 , a first light source 14 , a second light source 15 and a third light source 17 are installed with respect to the moving member scanned by the imaging position changing mechanism 12 . Each of the line sensor 13, the first light source 14, and the second light source 15 is installed in the same manner as in the first embodiment.
In the fourth embodiment, the second light source 15 is set to the irradiation angle in the direction of the 2_1 angle range as the 2_1 angle in the second angle, and the third light source 17 is set to the 2_2 angle in the second angle. The irradiation angle is set in the direction of the 2_2 angle range.

The skin imaging control device 11B controls the imaging position changing mechanism 12B, and every time the moving member is moved a predetermined distance in the direction of the arrow Q1, the irradiation light is emitted from the first light source 14 at the first angle, and the row Take an image.
Then, the skin image capturing control device 11B writes and stores the captured row images in time series in the order in which they are captured in the color observation row image storage area of the storage unit 113B.

Then, the skin image capturing control device 11B captures an image of the skin region to be imaged, and scans the target skin region by a predetermined distance in the arrow Q2 direction. to start.
Next, the skin imaging control device 11B controls the imaging position changing mechanism 12B, and every time the moving member moves a predetermined distance in the arrow Q2 direction, irradiation light is emitted from the second light source 15 at the 2_1 angle. to pick up a column image.
Then, the skin image capturing control device 11B writes and stores the captured row images in time series in the order in which the images were taken in the first row image storage area for stereoscopic effect observation of the storage unit 113B.

Then, the skin image capturing control device 11B captures an image of the skin region to be imaged, and after the scanning of moving in the direction of arrow Q2 by a predetermined distance is completed, the scanning of moving in the direction of arrow Q1 by a predetermined distance. to start.
Next, the skin imaging control device 11B controls the imaging position changing mechanism 12B, and every time the moving member moves a predetermined distance in the arrow Q2 direction, irradiation light is emitted from the third light source 17 at the 2_2 angle. to pick up a column image.
Then, the skin image capturing control device 11B writes and stores the captured row images in the order in which the images were taken in the second stereoscopic effect observation row image storage area of the storage unit 113B in time series.

The generation processing of the row image for color observation is performed by the image synthesizing unit 112B in the skin image capturing control device 11B in the same manner as in the first embodiment.
In addition, the image synthesizing unit 112B in the skin image capturing control device 11B reads out the column images captured at the 2_1 angle in time series from the first column image storage area for stereoscopic effect observation in the storage unit 113B, and concatenates them in the read order. to generate a first row image for stereoscopic observation.
Similarly, the image synthesizing unit 112B reads, in time series, the column images captured at the 2_2 angle from the second stereoscopic observation column image storage area of the storage unit 113B, and connects them in the read order to obtain the second stereoscopic effect. Generate a viewing row image.

Further, as in the second embodiment, in the scanning in which the predetermined distance is moved in the direction of the arrow Q1, each time the predetermined distance is moved, the color observation row image, the first stereoscopic effect observation row image, and the first It is also possible to pick up each row image for generating each row image for two-dimensional observation.
That is, the skin imaging control device 11B controls the imaging position changing mechanism 12B to move the moving member a predetermined distance in the arrow Q1 direction with respect to the skin region to be imaged.
Then, the skin image capturing control device 11 irradiates the irradiation light from the first light source 14 for a predetermined time, captures row images for generating a skin image for color observation during this predetermined time, and stores the captured row images. They are written and stored in chronological order in the row image storage area for color observation of the section 113B.

Next, the skin image capturing control device 11B irradiates the irradiation light from the second light source 15 at the 2_1 angle for a predetermined time without moving the moving member, and generates the first skin image for stereoscopic effect observation during this predetermined time. The row images for observing the stereoscopic effect are captured, and the captured row images are written and stored in time series in the first row image storage area for stereoscopic effect observation of the storage unit 113B.
In addition, the skin image capturing control device 11B irradiates the irradiation light from the third light source 17 at the 2_2 angle for a predetermined time without moving the moving member, and generates a second skin image for stereoscopic effect observation during this predetermined time. The row images for observation are captured, and the captured row images are written and stored in time series in the second row image storage area for stereoscopic effect observation of the storage unit 113B.

The image synthesizing unit 112B in the skin image capturing control device 11B reads out the row images in time series from the row image storage area for color observation in the storage unit 113B, connects and synthesizes them in time series order, thereby performing color observation. Generates a sequence image for use.
Similarly, the image synthesizing unit 112B reads out the row images in time series from the row image storage area for the first stereoscopic observation of the storage unit 113B, connects them in chronological order, and synthesizes them, thereby performing the first stereoscopic observation. Generates a sequence image for use.
Further, the image synthesizing unit 112B reads out the row images in time series from the row image storage area for the second stereoscopic observation of the storage unit 113B, connects them in chronological order, and synthesizes the row images for the second stereoscopic observation. Generate column images.

According to the present embodiment, the first row image for stereoscopic observation and the second row image for stereoscopic observation are generated from the row images captured at each of the 2_1-th angle and the 2_2-th angle. By irradiating light from an oblique direction, an image with shadows corresponding to the shape of the unevenness is obtained and the information of the three-dimensional effect increases. It becomes possible to perform high observation and diagnosis.

<Fifth Embodiment>
A fifth embodiment of the present invention will be described below with reference to the drawings. FIG. 7 is a diagram showing a configuration example of a skin imaging system 1C according to a fifth embodiment of the present invention. In FIG. 7, the skin imaging system 1C includes a skin imaging control device 11, an imaging position changing mechanism 12, a line sensor 13, a first light source 14, a second light source 15, a third light source 17, and a subject fixing jig support 21. and an object fixing jig 22 . Only the configuration and operation of the skin imaging system 1C according to the fifth embodiment, which are different from those of the first embodiment, will be described below. In the fifth embodiment, the main configuration different from the first embodiment is that an object fixing jig support 21 and an object fixing jig 22 are added as constituent elements instead of the stage 16. .

The subject fixing jig support 21 is a support for supporting the subject fixing jig 22, and includes a length adjusting mechanism for varying the distance (imaging distance) from the line sensor 13 to the skin surface of the imaging target. It is
The object fixing jig 22 is a jig for fixing the surface of the skin to be imaged so that it does not move up, down, left, or right. For example, since the object to be imaged in FIG. 7 is the surface of the skin of the hand, it has a shape to fix the hand so that it does not move. For this reason, the object fixing jig 22 has a different shape depending on the object to be imaged, and is prepared as a different jig for each object to be imaged.
A plane parallel to the surface 16S of the imaging target setting stage 16 in FIG. 1 corresponds to a virtual horizontal plane 30 including the skin surface 40 of the imaging target. The object fixing jig 22 enables the line sensor 13 to be fixed relative to a virtual horizontal plane 30 parallel to the surface 16S of the imaging object installation stage 16 .
As a result, each of the first light source 14 and the second light source 15 emits irradiation light at a first angle and a second angle, respectively, with respect to the virtual horizontal plane 30, and the surface 40 of the skin is irradiated similarly to the first embodiment. , the irradiation light is incident at a first angle and a second angle.

According to the present embodiment, as described above, when capturing row images for generating the skin image for color observation and the skin image for stereoscopic observation, each of which has information on color and stereoscopic effect, Even without providing the imaging target installation stage 16, the imaging target is placed on a predetermined fixed base, and the irradiation light is irradiated at the first angle and the second angle with respect to the virtual horizontal plane 30, respectively. In contrast, the illumination light can be applied at each of the first angle and the second angle.
Therefore, according to the present embodiment, it is possible to perform imaging of the surface of the skin, which is an imaging target, with each of the subject fixing jig support 21 and the subject fixing jig 22 in the same manner as in the first embodiment. Even in a place where the image pickup object installation stage 16 is not provided, the irradiation light having a color rendering property close to that of natural light can be easily used without adversely affecting the skin of the irradiation object. This makes it possible to capture a series of images that reproduce colors close to those of the original, while taking into consideration the effect on the patient, and combining skin images for color observation with highly accurate color information and highly accurate three-dimensional information. Each of the skin images for stereoscopic observation can be easily generated.

Further, a program for realizing each function of the skin imaging control device 11 shown in FIG. 1 in the present embodiment, the skin imaging control device 11A shown in FIG. 5, and the skin imaging control device 11B shown in FIG. Each is recorded on a readable recording medium, and the computer system loads and executes the program recorded on these recording media to image the skin according to the angle of the irradiation light and obtain a skin image for color observation. and a process of generating each of the skin images for stereoscopic effect observation. It should be noted that the "computer system" referred to here includes hardware such as an OS and peripheral devices.

The "computer system" also includes the home page providing environment (or display environment) if the WWW system is used.
The term "computer-readable recording medium" refers to portable media such as flexible discs, magneto-optical discs, ROMs and CD-ROMs, and storage devices such as hard discs incorporated in computer systems.

Furthermore, "computer-readable recording medium" means a medium that dynamically retains a program for a short period of time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. It also includes those that hold programs for a certain period of time, such as volatile memories inside computer systems that serve as servers and clients in that case. Further, the above program may be for realizing part of the functions described above, and may be a so-called difference file that can realize the functions described above in combination with a program already recorded in the computer system. can be

Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments, and designs and the like are included within the scope of the gist of the present invention.

1, 1A, 1B... Skin image imaging system 11, 11A, 11B... Skin image imaging control device 12, 12A, 12B... Imaging position changing mechanism 13... Line sensor 14... First light source 15... Second light source 16... Imaging target installation Stage 21 Subject fixing jig support 22 Subject fixing jig 16S Surface 17 Third light source 111, 111A, 111B Imaging control unit 112, 112B Image synthesizing unit 113, 113B Storage unit

Claims (12)

A skin imaging system for obtaining a skin image by imaging the skin used for observing a lesion of the skin as a row image and synthesizing the row image,
a line sensor that captures the row image of the skin;
a lens system that is fixed to the line sensor and forms an image of the skin to be imaged on the line sensor;
a light source for irradiating the skin with irradiation light;
An imaging position changing mechanism that synchronously moves the line sensor, the lens system, and the light source so that the relative positions of the line sensor, the lens system, and the light source are the same when changing the imaging position of each of the line sensor, the lens system, and the light source. When,
an imaging control unit that controls imaging of the row images;
an image synthesizing unit that synthesizes the row images;
with
The imaging control unit controls the imaging position changing mechanism to move the line sensor to the imaging position by a predetermined distance unit, and for each of the imaging positions, the imaging control unit is configured to control the imaging position changing mechanism to move the line sensor to the imaging position within the first angle range with respect to the surface of the skin. irradiating irradiation light to capture a first row image, and irradiating the skin surface with the irradiation light in a second angle range different from the first angle range to capture a second row image;
The image synthesizing unit generates a first image by connecting and synthesizing the plurality of first row images imaged according to the imaging position according to the imaging position, and generates a first image according to the imaging position. generating a second image by connecting and synthesizing the plurality of captured second-row images according to the imaging position;
A skin imaging system characterized by: A skin imaging system for obtaining a skin image by imaging the skin used for observing a lesion of the skin as a row image and synthesizing the row image,
a line sensor that captures the row image of the skin;
a lens system that is fixed to the line sensor and forms an image of the skin to be imaged on the line sensor;
a light source for irradiating the skin with irradiation light;
An imaging position changing mechanism that synchronizes and moves the line sensor, the lens system, and the light source so that the relative positions of the line sensor, the lens system, and the light source are the same when changing the imaging positions of the line sensor, the lens system, and the light source. When,
an object fixing jig for fixing the object to be imaged;
a subject fixing jig support that supports the subject fixing jig and is capable of adjusting a distance from the imaging target to the line sensor;
with
At the imaging position, when capturing a first row image containing information on the color of the skin in the row images, the surface of the skin fixed by the subject fixing jig is irradiated in a first angle range. and, when capturing a second row image containing information on the three-dimensional effect of the surface of the skin in the row images, the irradiation light is applied to the surface of the skin fixed by the jig for fixing the subject . A skin imaging system, characterized in that the surface is irradiated in a second angular range different from the first angular range. The first angle range is an angle range of the irradiation direction in which shadows due to unevenness on the surface of the skin do not occur, and the second angle range is an angle range of the irradiation direction in which shadows due to unevenness on the surface of the skin occur. 3. The skin imaging system according to claim 1 or 2 . wherein the first angular range ranges from 70° to 110° with respect to the surface of the skin;
4. The skin imaging system of claim 3 , wherein the second angular range ranges from 30[deg.] to 60[deg.], alternatively 120[deg.] to 150[deg.] relative to the surface of the skin. The skin imaging system according to any one of claims 1 to 4 , wherein the light source emits the irradiation light from which at least light of wavelength components in the ultraviolet region is removed. The skin imaging system according to any one of claims 1 to 5, wherein the illumination light has a color rendering index of 90 or more, preferably a color rendering index of 95 or more. The skin imaging system according to any one of claims 1 to 6, wherein the light source is a line light source or a surface light source, and is provided parallel to the line sensor. The light source is composed of each of a first light source and a second light source, the first light source is provided at a position where the irradiation light emitted by itself is in the first angle range, and the irradiation light emitted by the second light source is provided. The skin imaging system according to any one of claims 1 to 7, wherein the light is provided at a position corresponding to the second angular range. When the line sensor captures the skin image at the imaging position, the light source is placed at a position where the irradiation light emitted by the light source is in the first angle range, and the irradiation light emitted by the light source is at the second angle. The skin imaging system according to any one of claims 1 to 7, further comprising a light source moving mechanism for moving to a position within the range. The second angle range is composed of a 2_1 angle range and a 2_2 angle range, and each of the 2_1 angle range and the 2_2 angle range is symmetrical with respect to a plane perpendicular to the moving direction of the line sensor. is set as an angular range of
The imaging control unit controls the imaging position changing mechanism to move the line sensor to the imaging position by a predetermined distance unit, and irradiates the irradiation light in the 2_1 angle range for each imaging position. capturing a third row image, and capturing a fourth row image by illuminating the illumination light in the illumination light in the 2_2 angle range ;
The image synthesizing unit generates a third image by connecting and synthesizing the plurality of third-row images imaged according to the imaging position according to the imaging position, and images the image according to the imaging position. generating a fourth image by connecting and synthesizing the plurality of fourth row images according to the imaging position;
The skin imaging system according to claim 1 , characterized in that: 11. The skin imaging system of any one of claims 1-10, wherein the lens system is a telecentric optical system. A skin imaging method for obtaining a skin image by imaging the skin used for observation of a lesion of the skin as a row image and synthesizing the row image,
an imaging process of imaging a line image of the skin by a line sensor fixedly provided with a lens system for forming an image of the skin to be imaged;
A light irradiation process of irradiating the skin with irradiation light from a light source;
An imaging position changing mechanism synchronizes the line sensor, the lens system, and the light source so that their relative positions are the same when the imaging positions of the line sensor, the lens system, and the light source are changed. an imaging position changing process of moving by
an imaging control process for controlling imaging of the row images by an imaging control unit;
an image synthesizing process of synthesizing the row images by an image synthesizing unit;
including
The imaging control unit controls the imaging position changing mechanism to move the line sensor to the imaging position by a predetermined distance unit, and for each of the imaging positions, the imaging control unit is configured to control the imaging position changing mechanism to move the line sensor to the imaging position within the first angle range with respect to the surface of the skin. A first row image is captured by irradiating irradiation light, and a second row image is captured by irradiating the skin surface with the irradiation light in a second angle range different from the first angle range,
The image synthesizing unit generates a first image by connecting and synthesizing the plurality of first row images imaged according to the imaging position according to the imaging position, and generates a first image according to the imaging position. generating a second image by connecting and synthesizing the plurality of captured second-row images according to the imaging position;
A skin imaging method characterized by:

Images