JP6310792B2 - Skin property evaluation device - Google Patents

Description

  The present invention relates to an apparatus for evaluating the properties of a subject's skin.

  As a technique for evaluating the properties of the skin, in order to evaluate the surface characteristics corresponding to the stress of the skin, a method of blowing a compressed gas on the skin surface and measuring the displacement of the skin surface due to this is known (for example, , See Patent Document 1 and Patent Document 2). In these methods, the displacement of the skin surface is measured using a laser displacement meter, an ultrasonic displacement meter, an infrared displacement meter, a red LED (Light Emitting Diode) displacement meter, a high-speed camera, or the like.

  As a technique for acquiring tomographic data of an object to be measured, optical coherence tomography (OCT) is known. OCT is a data collection and data processing technique for obtaining a reflection intensity profile in a cross section of an object to be measured using an interference optical system. OCT includes a spectral domain method (see, for example, Patent Document 3), a swept source method (see, for example, Patent Document 4), a full field (or interface) method (see, for example, Patent Document 5), and the like.

JP 2004-108794 A JP 2006-346020 A JP 2007-185244 A JP 2007-24677 A JP 2006-153838 A

  While conventional skin property evaluation techniques have the advantage that non-contact evaluation is possible, the displacement in the depth direction of the skin is measured from the front side. In addition, there was a demerit that the distribution of the displacement in the can not be measured with high accuracy.

  An object of the present invention is to provide a technique capable of performing highly accurate skin property evaluation without contact.

In order to achieve the above-mentioned object, the invention described in claim 1 is directed to a spray unit that blows gas onto the skin surface of a subject, and tomographic data of skin in a state where gas is sprayed by the spray unit. A tomographic data acquisition unit acquired using coherence tomography, an information generation unit that generates evaluation information on the skin properties of the subject based on the tomographic data acquired by the tomographic data acquisition unit, and the subject Analysis of acquiring three-dimensional position information on a subject by analyzing two or more imaging units that capture images of the subject substantially simultaneously from different directions and two or more captured images acquired by the two or more imaging units. And the optical coherence tomography by the tomographic data acquisition unit based on the three-dimensional position information acquired by the analysis unit and the gas spray region by the spray unit A skin property-evaluating apparatus and a position information acquisition unit that acquires at least one of the position information of I execution region.
The invention according to claim 2 is the skin property evaluation apparatus according to claim 1 , wherein the imaging field by the two or more imaging units includes at least a part of the face of the subject. And
The invention according to claim 3 is the skin property evaluation apparatus according to claim 1 or claim 2 , wherein the analysis unit is configured to detect the face of the subject based on the two or more captured images. A three-dimensional image generating unit for generating a three-dimensional image, a first coordinate system set in the three-dimensional image generated by the three-dimensional image generating unit as the three-dimensional position information, and a real space And a correspondence information generation unit that generates correspondence information associated with the second coordinate system.
The invention according to claim 4 is the skin property evaluation apparatus according to claim 3 , further comprising a display control unit that displays the three-dimensional image on a display unit, and the display unit displays the three-dimensional image. When a position in the three-dimensional image is designated, the position information acquisition unit is configured to, based on the correspondence information, in the second coordinate system corresponding to the coordinate value of the designated position in the first coordinate system. A coordinate value is acquired.
The invention according to claim 5 is the skin property evaluation apparatus according to claim 4 , wherein the spray unit includes a nozzle having a gas outlet formed at a tip thereof, and the tomographic data acquisition unit Splits the light from the light source into measurement light and reference light, irradiates the measurement light on the skin through the measurement arm, and passes the measurement light return light and the reference arm through the measurement arm. An optical system that detects interference light with reference light, a probe provided with at least the nozzle and at least the tip of the measurement arm, and a moving mechanism for moving the probe; And a movement control unit that controls the movement mechanism based on the coordinate values acquired by the position information acquisition unit.
The invention according to claim 6 is the skin property evaluation apparatus according to claim 4 , wherein the light projection unit that outputs a light beam and the position indicated by the coordinate value acquired by the position information acquisition unit are provided. And a light projection control unit that controls the light projection unit so that a light beam is projected.
The invention described in Claim 7 is a skin conditions evaluation device according to claim 3, wherein the blowing unit includes a nozzle spout of the gas is formed at the distal end, the tomographic data acquisition unit Splits the light from the light source into measurement light and reference light, irradiates the measurement light on the skin through the measurement arm, and passes the measurement light return light and the reference arm through the measurement arm. An optical system that detects interference light with reference light, a probe provided with at least the nozzle and at least the tip of the measurement arm, and a moving mechanism for moving the probe; The movement control unit that controls the movement mechanism, and a storage unit that stores in advance target position information that represents the position of the gas blowing target region by the blowing unit, and the position information acquisition unit includes the correspondence information Based on the coordinate value acquired in the second coordinate system corresponding to the position represented in the target position information, the movement control unit based on the coordinate value acquired by the position information acquisition unit The moving mechanism is controlled.
The invention according to claim 8 is the skin property evaluation apparatus according to claim 3 , wherein the storage unit stores in advance target position information representing the position of the gas spray target region by the spray unit; A light projecting unit that outputs a light beam; and a light projecting control unit that controls the light projecting unit, wherein the position information acquisition unit is located at the position represented by the target position information based on the correspondence information. The coordinate value in the corresponding second coordinate system is acquired, and the light projection control unit controls the light projection unit so that a light beam is projected at a position indicated by the coordinate value acquired by the position information acquisition unit. It is characterized by controlling.
The invention according to claim 9 is the skin property evaluation apparatus according to claim 7 or claim 8 , wherein the target position information is a position of the spray target area in a past evaluation with respect to the subject. Or a default position of the gas spray target area.
The invention described in claim 10 is the skin property evaluation apparatus according to claim 1 , wherein the two or more imaging units perform moving image shooting, and the analysis unit substantially performs the moving image shooting. By simultaneously analyzing two or more frames acquired simultaneously in real time, a plurality of the three-dimensional position information along a time series is acquired, and the position information acquisition unit includes the plurality of three-dimensional position information. Based on this, the plurality of pieces of position information along a time series are sequentially acquired in real time.
The invention according to claim 11 is the skin property evaluation apparatus according to claim 10 , wherein the spray unit includes a nozzle having a gas outlet formed at a tip thereof, and the tomographic data acquisition unit Splits the light from the light source into measurement light and reference light, irradiates the measurement light on the skin through the measurement arm, and passes the measurement light return light and the reference arm through the measurement arm. An optical system that detects interference light with reference light, a probe provided with at least the nozzle and at least the tip of the measurement arm, and a moving mechanism for moving the probe; A movement control unit for causing the probe to follow the movement of the subject by controlling the movement mechanism in real time based on the three-dimensional position information sequentially acquired by the position information acquisition unit; Characterized in that it comprises further.
The invention according to claim 12 is the skin property evaluation apparatus according to claim 11 , wherein when the movement mechanism is controlled by the movement control unit, the position information acquisition unit sequentially and in real time. A first positional relationship determination unit that repeatedly determines in real time whether the positional relationship between the subject and the probe is a predetermined positional relationship based on the positional information acquired in The tomographic data acquisition unit starts optical coherence tomography when the first positional relationship determination unit determines that the positional relationship between the subject and the probe is a predetermined positional relationship. It is characterized by.
The invention described in claim 13 is the skin property evaluation apparatus according to claim 1 , wherein the two or more imaging units include a first group of imaging units that perform imaging in a first imaging field; A second group of imaging units that perform imaging in a second imaging field included in the first imaging field, wherein the analysis unit is acquired substantially simultaneously by the first group of imaging units. By analyzing the frame of the group, to obtain the first three-dimensional position information about the subject, and by analyzing the frame of the second group acquired substantially simultaneously by the imaging unit of the second group, Second 3D position information is acquired, the first 3D position information is associated with the second 3D position information, and the position information acquisition unit includes the first 3D position information and The position information is acquired based on the second three-dimensional position information .
In addition, the invention according to claim 14 uses optical coherence tomography for the tomographic data of the sprayed part that sprays gas on the skin surface of the subject and the skin in which the gas is sprayed by the sprayed part. A tomographic data acquisition unit for acquiring, and an information generation unit for generating evaluation information related to the properties of the skin of the subject based on the tomographic data acquired by the tomographic data acquisition unit, the tomographic data acquisition unit, The light from the light source is divided into measurement light and reference light, the measurement light is irradiated on the skin through the measurement arm, the return light of the measurement light that has passed through the measurement arm, and the reference light that has passed through the reference arm The optical system repeatedly detects the interference light in a state where the optical path length difference between the measurement arm and the reference arm is substantially fixed. Run and before Based on the detection result of the interference light acquired repeatedly in real time by the optical system, it is determined in real time and repeatedly whether the positional relationship between the subject and the optical system is a predetermined positional relationship. The tomographic data acquisition unit further includes a second positional relationship determination unit, and the tomographic data acquisition unit determines that the positional relationship between the subject and the optical system is a predetermined positional relationship by the second positional relationship determination unit. And receiving the tomographic data and starting to acquire the tomographic data.

  According to this invention, it is possible to perform highly accurate skin property evaluation in a non-contact manner.

It is the schematic showing an example of the structure of the skin property evaluation apparatus which concerns on embodiment. It is the schematic showing an example of the structure of the skin property evaluation apparatus which concerns on embodiment. It is the schematic for demonstrating the operation example of the skin property evaluation apparatus which concerns on embodiment. It is the schematic for demonstrating the operation example of the skin property evaluation apparatus which concerns on embodiment. It is the schematic for demonstrating the operation example of the skin property evaluation apparatus which concerns on embodiment. It is the schematic for demonstrating the operation example of the skin property evaluation apparatus which concerns on embodiment. It is the schematic for demonstrating the operation example of the skin property evaluation apparatus which concerns on embodiment. It is the schematic showing an example of the structure of the skin property evaluation apparatus which concerns on embodiment. It is a flowchart showing the operation example of the skin property evaluation apparatus which concerns on embodiment. It is a flowchart showing the operation example of the skin property evaluation apparatus which concerns on embodiment. It is the schematic showing an example of the structure of the skin property evaluation apparatus which concerns on a modification. It is a flowchart showing the operation example of the skin property evaluation apparatus which concerns on a modification. It is a flowchart showing the operation example of the skin property evaluation apparatus which concerns on a modification. It is the schematic showing an example of the structure of the skin property evaluation apparatus which concerns on embodiment. It is a flowchart showing the operation example of the skin property evaluation apparatus which concerns on embodiment. It is the schematic showing an example of the structure of the skin property evaluation apparatus which concerns on a modification. It is a flowchart showing the operation example of the skin property evaluation apparatus which concerns on a modification.

  An example of an embodiment of the present invention will be described in detail with reference to the drawings. The skin property evaluation apparatus according to the present invention is used, for example, for cosmetic purposes or medical purposes, and is used for evaluation of skin properties, particularly for evaluation of elastic properties. The elastic property is a property related to a change in skin shape (or a change in function) with respect to an external force, and may include, for example, any of properties such as elasticity, flexibility, looseness, firmness, tightness, and tightness direction. In addition, it is possible to use the description content of the literature referred in this specification as the content of embodiment of this invention.

  In this specification, data acquired by OCT is collectively referred to as tomographic data. The tomographic data includes, for example, an output signal from a detector for detecting interference light and / or data (processing data) obtained by processing this output signal. The processing data includes, for example, a reflection intensity profile (data string, data group, graph, etc.) representing the reflection intensity (backscattering intensity) at each skin depth position, and image data obtained from the reflection intensity profile. As image data, for example, one-dimensional image data (A scan data) along the depth direction, two-dimensional image data (B scan data) representing a two-dimensional cross section along the depth direction and one direction orthogonal thereto, depth Two-dimensional image data (C scan data) representing a two-dimensional cross section orthogonal to the direction, two-dimensional image data representing a two-dimensional cross section in an arbitrary direction (multi-section reconstructed image (MPR), etc.), three-dimensional representing a three-dimensional region There are image data (volume data, voxel data, stack data, etc.), phase image data representing a phase change, and the like. Furthermore, it is also possible to apply image data to which external information such as pseudo color and segmentation information (information that emphasizes a layer or a layer boundary) is added.

<First Embodiment>
[Constitution]
An example of the configuration of the skin property evaluation apparatus according to the embodiment is shown in FIG. The skin property evaluation apparatus 1 has a function of blowing gas to the skin surface S of the subject. This function is realized by a configuration including the compressed gas generation unit 11, the communication pipe 12, the head unit 13, and the nozzle 14. Further, the skin property evaluation apparatus 1 has a function of acquiring tomographic data of skin in a state where gas is blown using OCT. This function is realized by a configuration including the OCT unit 20. Furthermore, the skin property evaluation apparatus 1 has a function of generating evaluation information of skin properties based on the acquired tomographic data. This function is realized by a configuration including the arithmetic control unit 100. Hereinafter, each part of the skin property evaluation apparatus 1 will be described in more detail.

(Configuration for blowing gas)
First, the structure for spraying gas on the skin surface S will be described. As described above, this configuration may include the compressed gas generation unit 11, the communication pipe 12, the head unit 13, and the nozzle 14.

  The compressed gas generation part 11 has the effect | action which compresses gas. For this purpose, the compressed gas generator 11 includes, for example, a cylinder, a piston that moves within the cylinder, and an actuator (such as a rotary solenoid) that reciprocates the piston (not shown). The compressed gas generator 11 (for example, an actuator) is controlled by the arithmetic control unit 100.

  The communication pipe 12 is a tubular member that communicates the compressed gas generation unit 11 and the head unit 13. More specifically, the communication pipe 12 is a tubular member that communicates the internal space of the compressed gas generation unit 11 (the space in the cylinder) with the internal space of the head unit 13. The compressed gas generated by the compressed gas generation unit 11 is supplied to the internal space of the head unit 13 through the communication pipe 12.

  The head unit 13 has an internal space (chamber) in which the compressed gas generated by the compressed gas generation unit 11 is accommodated. A nozzle 14 is provided on the front surface (surface on the skin surface S side) of the head portion 13. One end (rear end) of the hollow region of the nozzle 14 is opened to the chamber, and the other end (front end) is opened forward. At least a part of the rear surface (surface opposite to the skin surface S) 13a of the head portion 13 is formed of a light transmitting member (glass plate or the like).

  Although illustration is omitted, a pressure sensor for monitoring the pressure of the gas in the chamber can be provided. The output from the pressure sensor is sent to the arithmetic control unit 100. The arithmetic control unit 100 performs control according to the input pressure value. Examples of this control include display control of the pressure value, control of the timing of blowing the gas in the chamber (for example, control of the on-off valve), and operation control of the compressed gas generation unit 11. The on-off valve is constituted by, for example, an electromagnetic valve. When the on-off valve is in the closed state, the inside of the chamber is a shielded space, and when the on-off valve is in the open state, the gas in the chamber is released through the nozzle 14.

  It is also possible to provide a mechanism for changing the orientation of the nozzle 14 and a mechanism for changing the diameter of the hollow region of the nozzle 14 (or the opening diameter of the front end of the hollow region). Control of these mechanisms is executed by the arithmetic control unit 100.

(OCT unit)
Next, an example of the configuration of the OCT unit 20 will be described. The OCT unit 20 is provided with an optical system for acquiring tomographic data of the subject's skin. This optical system has the same configuration as a conventional OCT apparatus. That is, this optical system divides the light from the light source into measurement light and reference light, irradiates the measurement surface with the measurement light on the skin surface S, and returns the measurement light that has passed through the measurement arm and the reference arm. It is configured to detect interference light with reference light that has passed through. A detection result (detection signal) by the optical system is sent to the arithmetic control unit 100.

  When spectral domain OCT is applied, a low-coherence light source (broadband light source) is used, and a plurality of spectral components of interference light are simultaneously detected by a spectroscope (spectrometer). The spectrometer includes, for example, a diffraction grating and a line sensor.

  On the other hand, when a swept source type OCT is applied, a wavelength scanning light source (wavelength swept light source) capable of changing the output wavelength at a high speed in time is used, and a plurality of wavelength sweeping light sources corresponding to this temporal wavelength sweeping are used. Interfering light is sequentially detected by the photodetector. In addition to these methods, it is possible to apply the OCT of the interface method or the time domain method, but in this case, a known technique according to the OCT method is applied.

  The light source unit 21 outputs light of a predetermined wavelength band. For example, the light source unit 21 outputs light in a wavelength band having a center wavelength near 1300 nm, or light in a wavelength band having a center wavelength near 1400 nm. The wavelength band to be used is arbitrarily set according to the application of the skin property evaluation apparatus 1, for example. For example, a longer wavelength band can be set in order to collect deeper tomographic data. Alternatively, the wavelength band can be set in consideration of the light absorption characteristics of substances contained in the tissue to be observed and the light absorption characteristics of substances that adversely affect observation. The light source unit 21 may be configured to be able to output light of a plurality of wavelength bands simultaneously or at different timings. In that case, the light source unit 21 may be provided with a plurality of light sources.

  The light source unit 21 includes, for example, a light output device such as a super luminescent diode (SLD), an LED, an SOA (Semiconductor Optical Amplifier), or the like. When the swept source OCT is applied, the light source unit 21 includes, in addition to such an optical output device, a fiber link resonator, a wavelength selection filter (for example, a combination of a diffraction grating and a polygon mirror, or a Fabry-Perot). -Etalon etc.) may be included. The light source unit 21 is controlled by the arithmetic control unit 100.

  The light output from the light source unit 21 is guided to the fiber coupler 23 by the optical fiber 22 and is divided into measurement light and reference light.

  The measurement light generated by the fiber coupler 23 is guided by the optical fiber 24 and converted into a parallel light beam by the collimator lens unit 25. Further, the measurement light reaches the beam splitter 50 via the optical scanner 26.

  The optical scanner 26 is a device that can deflect measurement light in one or two dimensions. The optical scanner 26 includes an arbitrary scanning device such as a galvano mirror, a MEMS optical scanner, a polygon mirror, and a resonant scanner. The optical scanner 26 is controlled by the arithmetic control unit 100.

  Although illustration is omitted, a focusing lens, a relay lens, an objective lens, and the like may be provided in the optical path (measurement arm) of the measurement light.

  The beam splitter 50 has a configuration for combining and separating measurement light used in OCT and light used in the surface observation optical system 40 (described later). As the beam splitter 50, a half mirror, a dichroic mirror, a polarization beam splitter, or the like is applied according to the wavelength bands of both lights.

  The measurement light that has reached the beam splitter 50 is reflected by the beam splitter 50, enters the internal space of the head portion 13 through the translucent member on the rear surface 13 a of the head portion 13, passes through the hollow region of the nozzle 14, and is then on the skin surface S. Is irradiated. The measurement light is scattered (reflected) at various depth positions on the skin. The return light (backscattered light) of the measurement light from the skin travels in the opposite direction on the same path as the forward path and is guided to the fiber coupler 23.

  On the other hand, the reference light generated by the fiber coupler 23 is guided by the optical fiber 27 and converted into a parallel light beam by the collimator lens unit 28. Further, the reference light is reflected by the reference mirror 29, travels in the reverse direction on the same path as the forward path, and is guided to the fiber coupler 23.

  The reference mirror 29 has a reflecting surface that is substantially orthogonal to the traveling direction of the reference light emitted from the collimator lens unit 28. The reference mirror 29 is moved in the normal direction of the reflecting surface by the reference mirror driving unit 29A. The control of the reference mirror driving unit 29A is executed by the arithmetic control unit 100.

  Although not shown, the optical path (reference arm) of the reference light is provided with an optical attenuator for adjusting the amount of the reference light, a polarization controller for adjusting the polarization state of the reference light, and the like. Good. Control of the optical attenuator and the polarization controller is executed by the arithmetic control unit 100.

  The fiber coupler 23 causes the return light of the measurement light to interfere with the reference light that has passed through the reference mirror 29. The interference light generated thereby is guided to the detection unit 31 by the optical fiber 30. The detection unit 31 detects the interference light (or each spectrum component thereof) to generate a signal, and sends this detection signal to the arithmetic control unit 100.

(Surface observation optical system)
The surface observation optical system 40 acquires an image of the skin surface S. The surface observation optical system 40 performs moving image shooting of the skin surface S, for example. The surface observation optical system 40 is controlled by the arithmetic control unit 100. The surface observation optical system 40 is not an essential component in the embodiment. If the surface observation optical system 40 is not provided, the beam splitter 50 is also unnecessary. Such a configuration will be described later.

  The surface observation optical system 40 may include an illumination optical system for illuminating the skin surface S. The illumination optical system irradiates the skin surface S with light of a predetermined wavelength band (for example, infrared light, near infrared light, visible light, etc.). The illumination optical system may include one or more light sources provided in the vicinity of the skin surface S, such as the position around the nozzle 14. Alternatively, the illumination optical system may be configured to illuminate the skin surface S via the beam splitter 50. Instead of providing the illumination optical system, ambient light (light from indoor lighting equipment, sunlight, etc.) may be used.

  The surface observation optical system 40 includes a photographing optical system. The photographing optical system includes an image sensor such as a CCD image sensor or a CMOS image sensor, and an optical element group for guiding light reflected by the skin surface S to the image sensor. This optical element group may include, for example, an objective lens, a focusing lens, a relay lens, an imaging lens, a diaphragm member, a filter, and the like.

(Calculation control unit)
The arithmetic control unit 100 executes control of each part of the skin property evaluation apparatus 1. Furthermore, the arithmetic control unit 100 executes various arithmetic processes (calculation process, analysis process, etc.). For example, the arithmetic control unit 100 generates skin property evaluation information based on the tomographic data acquired by the OCT unit 20. The arithmetic control unit 100 may be configured to generate an OCT image (B scan image, C scan image, three-dimensional image, etc.) based on a detection signal from the OCT unit 20. These processes will be described later.

  The arithmetic control unit 100 includes, for example, a microprocessor, a RAM, a ROM, a hard disk drive, a communication interface, and the like, like a conventional computer. A computer program for controlling the skin property evaluation apparatus 1 is stored in a storage device such as a hard disk drive. The arithmetic control unit 100 may include various circuit boards, for example, a circuit board for generating an OCT image. The arithmetic control unit 100 may include an operation device (input device) and a display device. Alternatively, an external operation device (input device) or a display device may be used.

  The configuration for blowing gas, the OCT unit 20 and the arithmetic control unit 100 may be configured integrally (that is, in a single casing), or configured separately in two or more housings. Also good. For example, the skin property evaluation apparatus 1 may include a probe, a main body, and a cable that connects the probe and the main body. The probe is a unit that is disposed in proximity to the skin surface S of the subject, and includes at least the nozzle 14 and at least the tip of the measurement arm in the configuration for blowing gas. The cable is provided with a communication pipe 12 and an optical fiber for guiding measurement light. The main body is provided with other components. In this case, the surface observation optical system 40 may be provided separately.

[Control system configuration]
The configuration of the control system of the skin property evaluation apparatus 1 will be described with reference to FIG. Note that any of the components shown in FIG. 2 may not be mounted. For example, the surface observation optical system 40 can be deleted from the configuration shown in FIG.

(Control part)
The control system of the skin property evaluation apparatus 1 is configured around the control unit 110. The control unit 110 includes, for example, a microprocessor, RAM, ROM, hard disk drive, communication interface, and the like. The control unit 110 is provided with a main control unit 111 and a storage unit 112.

(Main control unit)
The main control unit 111 performs the various controls described above. For example, the control unit 110 performs control of the compressed gas generation unit 11, control of gas blowing timing (control of the on-off valve 13b), control of each part of the OCT unit 20, control of the user interface 200, and the like. Further, the main control unit 111 performs processing for writing data into the storage unit 112 and processing for reading data from the storage unit 112.

(Memory part)
The storage unit 112 stores various data. Examples of data stored in the storage unit 112 include tomographic data acquired by OCT, image data acquired by the surface observation optical system 40, and subject information. The subject information includes information about the subject such as a subject ID and a name. The storage unit 112 stores various programs and data for operating the skin property evaluation apparatus 1.

(Fault data generator)
The tomographic data generation unit 120 generates tomographic data based on the detection signal from the detection unit 31. When the spectral domain OCT or the swept source OCT is applied, the tomographic data generation unit 120 executes processes such as noise removal (noise reduction), filter processing, and FFT (Fast Fourier Transform), as in the past. When another method of OCT is applied, the tomographic data generation unit 120 executes a known process according to the method.

  As described above, the tomographic data includes at least one of a reflection intensity profile, A scan data, B scan data, C scan data, MPR data, volume data, stack data, phase image data, and the like. Good. The tomographic data may include pseudo color information, segmentation information, and the like. In addition, the tomographic data generation unit 120 may be configured to execute brightness correction and dispersion correction of image data. A known technique is applied to generate such tomographic data.

  The tomographic data generation unit 120 includes, for example, the circuit board and / or the microprocessor described above. That is, the tomographic data generation unit 120 generates tomographic data in terms of hardware and / or software. In this specification, “image data” and an “image” based on the “image data” may be identified.

(Data processing part)
The data processing unit 130 executes various types of data processing. The data processing unit 130 performs data processing (signal processing, image processing, analysis processing, etc.) on the tomographic data generated by the tomographic data generation unit 120. For example, the data processing unit 130 generates evaluation information related to the properties of the subject's skin based on the tomographic data generated by the tomographic data generating unit 120. In addition, the data processing unit 130 can generate morphological information representing the form of a predetermined tissue on the subject's skin based on the tomographic data generated by the tomographic data generating unit 120. Further, the data processing unit 130 can perform data processing (image processing, analysis processing, etc.) on the image data acquired by the surface observation optical system 40.

(Configuration for generating evaluation information)
Several examples of the configuration for generating evaluation information regarding the properties of the subject's skin will be described.

(First configuration example)
A first configuration example for generating evaluation information will be described. In this example, the data processing unit 130 includes a data position specifying unit 131 and an evaluation information generating unit 132.

  The data position specifying unit 131 specifies a data position corresponding to a predetermined layer of the skin in the tomographic data generated by the tomographic data generating unit 120. The predetermined layer may be one or more layers including the skin surface S. The skin is a multilayered tissue consisting of the epidermis, dermis and subcutaneous tissue. The surface of the epidermis is the skin surface S. In the dermis, there are capillaries, nipple layers, nipple sublayers, reticular layers, Meissner bodies, blood vessels, sweat glands, nerve fibers, and the like. In the subcutaneous tissue, there are blood vessels, subcutaneous fat, sweat glands, Patini bodies and the like. The data position specifying unit 131 specifies an image region corresponding to any one of these tissues (layer tissues).

  The data position specifying unit 131 is executed to execute processing according to the type of tomographic data. As an example, it is assumed that the tomographic data is a reflection intensity profile P shown in FIG. 3A. The data position specifying unit 131 includes feature values (maximum value, minimum value, maximum value, minimum value, etc.) of the reflection intensity profile P, the shape of the reflection intensity profile P, skin anatomical data, and clinical data (for example, The depth position of a predetermined layer of the skin is specified based on the tissue and depth position (z-coordinate value or general relationship).

For example, the data position specifying unit 131 specifies z ₀ that is the minimum z coordinate value with the reflected light amount L being non-zero, and sets this as the position of the skin surface S at the measurement position (A line). Alternatively, the data position specifying unit 131, the reflected light amount L is to identify the z ₀ is the z coordinate value takes the maximum value, this is the position of the skin surface S in the A-line. Further, the data position specifying unit 131 specifies z ₁ which is the minimum z coordinate value among the z coordinate values where the minimum value of the reflection intensity profile P exists, and this is specified as the boundary between the epidermis and the dermis in the A line ( The lower surface of the epidermis, the upper surface of the dermis). Similarly, the position z ₂ and the boundary between the dermis and subcutaneous tissue, papillary layer, papillary layer, the position of the tissue of the reticular layer, etc. are identified.

As another example, it is assumed that the tomographic data is an image G shown in FIG. 3B. The image G is formed by a plurality of A scan data arranged in the x direction. Each A scan data is image data obtained by assigning a luminance value to the light amount value of the reflection intensity profile. The A scan data A _k arranged at the x coordinate value x _k in the image G corresponds to the reflection intensity profile P in FIG. 3A. Symbol H ₀ is an image region corresponding to the skin surface S, symbol H ₁ is an image region corresponding to the boundary between the epidermis and dermis, and symbol H ₂ is an image region corresponding to the boundary between the dermis and subcutaneous tissue. is there.

The data position specifying unit 131 determines the depth position of a predetermined layer of the skin based on the pixel value (luminance value) of the image G, the form of the object being drawn (such as the size, shape, and position of the tissue). Identify. For example, the data position specifying unit 131 specifies an image region H ₀ corresponding to the skin surface S by executing a segmentation process known in the OCT field, and specifies its depth position. The depth position of the image region H ₀ is one or more values of the plurality of positions corresponding to a plurality of pixels constituting the image region H ₀ (e.g. maximum, minimum, maximum value, minimum value, etc.) but Alternatively, it may be one or more values (for example, statistical values such as an average value, a median value, and a mode value) obtained by performing arithmetic processing on the plurality of positions.

  The evaluation information generation unit 132 generates evaluation information related to skin properties by performing processing (calculation processing, analysis processing, etc.) on the data position specified by the data position specifying unit 131. An example in which evaluation information relating to the elastic properties of the skin is generated will be described.

  In the first example, the skin property evaluation apparatus 1 executes tomographic data acquisition at least twice. At least one of the two or more tomographic data acquisition processes may be executed during gas blowing. The data position specifying unit 131 executes the data position specifying process as described above for each of the two or more acquired tomographic data.

FIG. 4 shows two images G1 and G2 obtained by two tomographic data acquisition processes. The image G1 is based on OCT performed in a state where no gas is blown onto the skin surface S. The image G2 is based on OCT performed in a state where gas is sprayed on the skin surface S. In the image G2, the image region H ₀ ′ corresponding to the skin surface S is recessed with respect to the x coordinate value x _k (that is, bent in the −z direction).

The data position specifying unit 131 acquires the z coordinate value of the position corresponding to the skin surface S with respect to at least the A scan data A _k at the x coordinate value x _k . Thereby, the coordinate value z ₀ in the image G1 and the coordinate value z ₀ ′ in the image G2 are obtained. Note that A scan data at other x-coordinate values can be processed, and z-coordinate values of image areas corresponding to other layers of the skin (for example, an image area H ₁ corresponding to the boundary between the epidermis and dermis and H ₁ 'z coordinate value _{z 1} and _{z 1} of', 'z coordinate value _{z 2} and _{z 2'} of dermis and image areas _{H 2} and _{H 2} corresponding to the boundary between the subcutaneous tissue) can also be obtained.

The evaluation information generating unit 132 calculates the difference between the pair of z coordinate values z ₀ and z ₀ ′ acquired by the data position specifying unit 131, thereby obtaining a difference between the two images G1 and G2 at the x coordinate value x _k . Find the displacement. This displacement in the position of the skin surface S which corresponds to the x-coordinate value x _k, indicating the amount of displacement of the skin by blowing gas (the dented). The dimension of the displacement is arbitrary, and may be, for example, a distance dimension in real space (mm or the like) or a distance dimension in image space (number of pixels, distance dimension by a coordinate system scale, etc.). In addition, the calculation process of the difference between two z coordinate values may include at least a process of subtracting the other from one, and may further include a process of calculating an absolute value of the difference value. Further, an order may be given to the two z-coordinate values, and the second z-coordinate value may be subtracted from the first z-coordinate value. Further, the two z coordinate values may be compared, and the smaller value side may be subtracted from the larger value side.

  Furthermore, the evaluation information generation unit 132 generates evaluation information based on the obtained displacement. The evaluation information may include the displacement value itself, or may include information obtained by processing the displacement value. As an example of the latter, related information in which a plurality of ranges (degrees) related to elasticity characteristic indicators (for example, elasticity, flexibility, slackness, tension, degree of grip, etc.) and displacement values are associated with each other is stored in advance. A range (degree) corresponding to the obtained displacement value can be obtained and used as evaluation information.

As an example, it is assumed that the related information associates a plurality of degrees “high”, “medium”, and “low” with respect to the index “elasticity” and the displacement value (D) as follows: “High: D ≧ D ₁ ”“ Medium: D ₁ > D ≧ D ₂ ”“ Low: D ₂ > D ”. The evaluation information generating unit 132 compares the acquired displacement value D with the two threshold values D ₁ and D ₂ to identify a range in which the displacement value D is included, and associates “ The “degree of elasticity” is specified, and evaluation information including the specified “degree of elasticity” is generated.

  The plurality of ranges related to the index is not limited to such “degree”, and may be numerical information such as age and score, for example. Further, the evaluation information is not limited to character string information and numerical information, and may be image information. For example, it is possible to create image information in which the size of the numerical information of the index is expressed in display colors. Alternatively, when displacements are calculated for a plurality of A scan data, displacement distribution information corresponding to the positions of these A scan data is obtained. In this case, it is possible to create image information (map) representing displacement distribution information. In the example shown in FIG. 4, a map representing the distribution of displacement in the x direction is obtained. The tomographic data acquired as an image is not limited to A scan data or B scan data (example in FIG. 4), and may be volume data or the like. When the displacement is calculated for part or all of the volume data, it is possible to create a two-dimensional map (distribution information in the xy plane orthogonal to the z direction). When displacement is calculated for each of a plurality of layers, character string information, numerical information, and image information as described above can be generated for each layer, and evaluation information including them can be generated.

(Second configuration example)
A second configuration example for generating evaluation information will be described. In this example, tomographic data of skin in a state where gas is blown is repeatedly acquired at predetermined time intervals. Note that iterative acquisition of tomographic data may be continued even after the end of gas blowing. Further, it is also possible to start to acquire tomographic data repeatedly before the start of gas blowing. Iterative acquisition of tomographic data is performed on substantially the same area of skin. Thereby, a plurality of tomographic data arranged in time series regarding substantially the same region of the skin is obtained. Furthermore, evaluation information is generated based on a plurality of pieces of tomographic data repeatedly acquired in this way.

  Also in this example, the data processing unit 130 includes a data position specifying unit 131 and an evaluation information generating unit 132. The data position specifying unit 131 specifies a data position corresponding to a predetermined layer of the skin in each of a plurality of tomographic data arranged in time series. The processing executed for each tomographic data is the same as in the case of the first configuration example.

  An example of a data string of displacement values acquired from a plurality of tomographic data arranged in time series is shown in FIG. The horizontal axis represents time t, and the vertical axis represents displacement D. The graph M is obtained by plotting a plurality of displacement values arranged along the time series (time axis t) and connecting these plot points. The process of connecting a plurality of plot points includes, for example, a process of obtaining an approximate curve.

Time t = t ₀ represents the timing at which gas blowing has started, and time t = t ₁ represents the timing at which gas blowing has ended. That is, iterative acquisition of the tomographic data performed to create the graph M is started before the start of gas blowing (t = 0) and continues while the gas is being blown (t = T _{0 to} t ₁ ), after the gas blowing was stopped (t> t ₁ ).

  The evaluation information generation unit 132 generates evaluation information based on such a time-series change in displacement. This process is executed based on, for example, the displacement change amount, change speed, and change time. As an example of processing based on the amount of change, a maximum value or maximum value of displacement can be obtained, and evaluation information can be generated from the value. As an example of processing based on the change rate, the slope of the graph M can be obtained, and evaluation information can be generated from the value. As an example of processing based on the change time, the time taken for the displacement to change from the first value to the second value can be obtained, and evaluation information can be generated from the value.

An example of processing for generating evaluation information using a data string such as a graph will be described. In FIG. 6, two graphs M1 and M2 are shown. These graphs M1 and M2 are, for example, data on the skin of different subjects, data on different parts of the same subject, or data obtained at different timings on the same part of the same subject. When comparing different data, a plurality of data can be overlaid so that data positions corresponding to predetermined timings coincide. For example, in the example shown in FIG. 6, two graphs M1 and M2 so that the data positions match corresponding to the time spraying of gas is terminated t = t ₁ is superposed. Note that it is not necessary to actually superimpose a plurality of data, and a reference data position (for example, a data position corresponding to time t = t ₁ ) may be set. The reference data position is set according to the data comparison method.

  A significant difference between the graph M1 and the graph M2 is a time-series change of the displacement D after the gas blowing is stopped. Specifically, in the graph M1, the displacement D gradually decreases after the gas blowing is stopped, but in the graph M2, the displacement D rapidly decreases after the gas blowing is stopped. doing. The time taken for the displacement D to decrease to a predetermined value (for example, D = 0, D = (maximum value) / 2, etc.) after the gas blowing is stopped is shorter in the graph M2 than in the graph M1. . Such a difference in the state of the graph reflects a difference in elasticity (a difference in the elasticity of the skin) at the site where the gas is sprayed.

  For example, the evaluation information generation unit 132 calculates the slope of the graph at any one or more times t after the gas blowing is stopped, and acquires information indicating the degree of elasticity based on the value of the slope. At this time, the evaluation information generation unit 132 refers to information that is created and stored in advance and that is associated with the inclination and the degree of elasticity.

  As a second example, the evaluation information generation unit 132 acquires the value of the displacement D at a timing when a specific time has elapsed since the gas blowing was stopped, and represents the degree of elasticity based on the value of the displacement D. To get. At this time, the evaluation information generation unit 132 refers to information that is created and stored in advance and that is associated with the displacement and the degree of elasticity.

As a third example, the evaluation information generating unit 132 acquires a time t corresponding to a specific displacement D value after the gas blowing is stopped, and determines the degree of elasticity based on the value of the time t. Get the information to represent. In this case, for example, and the obtained time t, the process is executed based on the difference Δt between the blowing stopping time t _1. The evaluation information generation unit 132 executes processing with reference to information that is created and stored in advance and that associates the time t (or elapsed time Δt) with the degree of elasticity.

(Third configuration example)
A third configuration example for generating evaluation information will be described. In this example, a configuration in which the gas blowing pressure can be changed is applied. The value of spray pressure is acquired by the above-mentioned pressure sensor, for example. Or it is also possible to obtain | require a spraying pressure based on the control content (for example, position of a piston) of the compressed gas production | generation part 11 by the control part 110. FIG.

  The data processing unit 130 generates evaluation information based on the tomographic data generated by the tomographic data generation unit 120 and the gas blowing pressure acquired by the pressure sensor, the control unit 11 and the like. As a specific example of this process, first, the data processing unit 130 calculates the displacement of the skin surface S based on the tomographic data. Next, the data processing unit 130 obtains a displacement per unit pressure by dividing the calculated displacement by the spray pressure. Alternatively, the data processing unit 130 obtains the spray pressure for causing the unit displacement amount by dividing the spray pressure by the displacement. Then, the data processing unit 130 generates evaluation information based on the obtained value.

  Although three configuration examples have been described above, the configuration for generating evaluation information is not limited to these. Further, two or more of the three configuration examples can be arbitrarily combined.

(Form information generator)
The form information generation unit 133 generates form information representing the form of a predetermined tissue of the skin. The shape information includes size information, shape information, position information, distribution information, number information, estimated weight, and the like regarding the tissue. Further, the shape information may be an image (morphological image) representing the shape of the two-dimensional cross section or three-dimensional volume of the skin.

  When generation of morphological information is performed, OCT is performed on a two-dimensional region or a three-dimensional region of skin. The tomographic data obtained from the OCT of the two-dimensional region is tomographic data corresponding to the two-dimensional cross section of the skin, and examples thereof include a reflection intensity profile, B scan data, and C scan data in the two dimensional cross section. The tomographic data obtained from the OCT of the three-dimensional region is tomographic data corresponding to the three-dimensional volume of the skin. As an example, the reflection intensity profile, the plurality of B scan data, the plurality of C scan data, the volume in the three dimensional region There is data. The two-dimensional region and the three-dimensional region correspond to a portion of the skin including at least a part of the gas blowing region. That is, part or all of the range of the skin surface S to which the gas is blown is set as a target region for OCT measurement.

  In this case, the data processing unit 130 generates evaluation information representing distribution information or statistical values related to skin properties based on the tomographic data acquired for the two-dimensional region or the three-dimensional region. Distribution information (such as a map) and statistical values (such as an average value) have been described above.

  Returning to the description of the form information generation unit 133. When the morphological information includes a morphological image, the morphological information generation unit 133 executes a known process for generating an OCT image. If the tomographic data itself is an image and the morphological information is only the morphological image, the morphological information generation unit 133 does not need to perform any particular processing. When the tomographic data is an OCT image and a morphological image is generated by processing this OCT image (for example, when segmentation information is added), the morphological information generation unit 133 executes processing for processing the OCT image. To do.

  When both distribution information (evaluation information) and form information are generated from the same tomographic data, a natural correspondence can be given between a position in the distribution information and a position in the form information. For example, the displacement map and the morphological image can be displayed in a superimposed manner. Or when the position in one of a displacement map and a form image is designated, the position in the other corresponding to this designated position can be shown.

  It is also possible to give a positional correspondence between distribution information and form information generated from different tomographic data. For example, alignment (image matching) between a first image obtained from first tomographic data based on distribution information and a second image obtained from second tomographic data based on morphological information And the result of this image matching (coordinate transformation such as affine transformation) can be used as a positional correspondence between distribution information and form information.

  The data processing unit 130 that functions as described above includes, for example, a microprocessor, a RAM, a ROM, a hard disk drive, a circuit board, and the like. In a storage device such as a hard disk drive, a computer program for causing the microprocessor to execute the above functions is stored in advance.

(User interface)
The user interface 200 is a man-machine interface between the skin property evaluation apparatus 1 and the user. The user interface 220 has a function for displaying information, a function for operating the skin property evaluation apparatus 1, and a function for inputting information to the skin property evaluation apparatus 1. At least a part of the user interface 200 may be provided outside the skin property evaluation apparatus 1. For example, at least a part of the functions of the user interface 200 can be provided in a device or a computer that can transmit and / or receive data to and from the skin property evaluation apparatus 1.

  The user interface 200 includes a display device 210 and an operation device 220. The display device 210 displays information under the control of the control unit 110. Examples of the display device 210 include a display device provided in the skin property evaluation apparatus 1, an external display, and a mobile terminal (for example, a tablet terminal or a smartphone).

  The operation device 220 is used to operate the skin property evaluation apparatus 1 and / or to input information to the skin property evaluation apparatus 1. The control unit 110 executes processing according to the signal from the operation device 220. Examples of the operation device 220 include an operation device (for example, a button, a switch, or a key) provided in the skin property evaluation apparatus 1, an operation device for an external computer (for example, a keyboard, a mouse, or a trackball), or a portable terminal (for example, a tablet). Terminal or smartphone).

  The display device 210 and the operation device 220 do not need to be configured as individual devices. For example, a device in which a display function and an operation function are integrated, such as a touch panel, can be used. Further, operations and information input may be performed using a graphical user interface (GUI) displayed on the display device 210 and the operation device 220.

[Action and effect]
The operation and effect of the skin property evaluation apparatus according to the embodiment will be described.

  The skin property evaluation apparatus according to the embodiment includes a spraying unit, a tomographic data acquisition unit, and an information generation unit. A spraying part sprays gas on the subject's skin surface. In this embodiment, the spray unit includes a compressed gas generation unit 11, a communication pipe 12, a head unit 13, and a nozzle 14. The tomographic data acquisition unit acquires the tomographic data of the skin in a state where gas is sprayed by the spraying unit using OCT. In this embodiment, the tomographic data acquisition unit includes an OCT unit 20 and a tomographic data generation unit 120. The information generation unit generates evaluation information related to the skin property of the subject based on the tomographic data acquired by the tomographic data acquisition unit. In this embodiment, the information generation unit includes a data processing unit 130.

  According to such a skin property evaluation apparatus, a change in skin state (displacement, etc.) due to gas blowing can be detected with high accuracy and high accuracy using OCT, so that highly accurate skin property evaluation is not possible. It can be done in contact.

  In the skin property evaluation apparatus of the embodiment, the tomographic data acquisition unit acquires the tomographic data of the skin in a state where gas is blown at least once, and the information generation unit is acquired by the tomographic data acquisition unit 1 The evaluation information can be generated based on the above fault data. As an example of this configuration, in a state where the probe is disposed at a position away from the skin surface by a predetermined distance, OCT is executed once during the gas blowing, and the position of the skin surface obtained from this predetermined distance and one It is possible to obtain a difference (corresponding to displacement of the skin surface due to gas blowing) from the position of the skin surface obtained from the tomographic data, and to generate evaluation information based on the value of this difference. Alternatively, the OCT is performed once in a state where no gas is sprayed, and further, the OCT is performed once in a state where the gas is sprayed, whereby the displacement of the skin surface due to the spraying of the gas is obtained. It is also possible.

  In the skin property evaluation apparatus according to the embodiment, the tomographic data acquisition unit repeatedly acquires the tomographic data of the skin in a state where the gas is being sprayed at predetermined time intervals, and the information generation unit includes the tomographic data acquisition unit. The evaluation information can be generated based on a plurality of pieces of tomographic data repeatedly obtained by the above. According to this configuration, it is possible to generate evaluation information based on time-series changes in tomographic data.

  Furthermore, the tomographic data acquisition unit repeatedly acquires the tomographic data of the skin at predetermined time intervals even after the completion of the gas blowing, and the information generating unit acquires the tomographic data during the gas blowing and after the completion of the blowing. The evaluation information can be generated based on a plurality of pieces of tomographic data repeatedly acquired by the unit. According to this configuration, it is possible to generate the evaluation information based on the time series change of the tomographic data after the completion of the spraying.

  Furthermore, the tomographic data acquisition unit starts to acquire tomographic data repeatedly before the start of gas blowing, and the information generation unit acquires tomographic data before the start of gas blowing, during the blowing, and after the end of the blowing. The evaluation information can be generated based on a plurality of pieces of tomographic data repeatedly acquired by the unit. According to this configuration, it is possible to obtain the properties of the layer with reference to the position of the layer in a state where no gas is blown, and furthermore, evaluation information is obtained based on the time-series change of the tomographic data after the completion of the blowing. Can be generated.

  In the embodiment, the information generating unit may include a data position specifying unit (131) and an evaluation information generating unit (132). The data position specifying unit is configured to specify a data position corresponding to a predetermined layer of the skin in the tomographic data acquired by the tomographic data acquiring unit. The evaluation information generating unit is configured to generate evaluation information based on the data position specified by the data position specifying unit. According to this configuration, the evaluation information can be generated from the result of specifying the position of the predetermined layer.

  Further, the tomographic data acquisition unit executes tomographic data acquisition at least twice, the data position specifying unit executes data position specification for each of the two or more tomographic data acquired by the tomographic data acquisition unit, and The evaluation information generating unit can be configured to generate the evaluation information based on the displacement between two or more data positions specified by the data position specifying unit. According to this configuration, it is possible to generate evaluation information based on the displacement of the skin due to the blowing of gas from the displacement of the predetermined layer.

  In the embodiment, the information generating unit may include a data position specifying unit (131) and an evaluation information generating unit (132). The data position specifying unit is configured to specify a data position corresponding to a predetermined layer of the skin in each of the plurality of tomographic data repeatedly acquired by the tomographic data acquiring unit. The evaluation information generation unit is configured to generate evaluation information based on a time series change of a plurality of data positions specified by the data position specifying unit. According to this configuration, the evaluation information can be generated from the time series change of the position of the predetermined layer. The evaluation information generation process based on the time-series change of the data position includes, for example, a process based on the change amount of the data position, a process based on the change speed of the data position, and from the first data position to the second data position. Processing based on the time taken for migration.

  In the embodiment, evaluation information can be generated for each of two or more different layers. More specifically, the data position specifying unit executes data position specification for each of two or more layers, and the evaluation information generation unit individually executes generation of evaluation information for each of two or more layers. Can be configured to. According to this configuration, the evaluation of skin properties can be performed individually for a plurality of layers.

  In the embodiment, the gas spraying pressure can be configured to be changeable. In this case, the information generation unit may be configured to generate evaluation information based on the tomographic data and the gas blowing pressure. According to this configuration, the evaluation can be performed while appropriately changing the gas blowing pressure.

  In the embodiment, the tomographic data acquisition unit performs optical coherence tomography on the two-dimensional region or the three-dimensional region of the skin including at least a part of the gas spray region by the spray unit, and the information generation unit includes: Based on the tomographic data acquired for the two-dimensional region or the three-dimensional region, it is possible to generate evaluation information representing distribution information or statistical values related to skin properties. According to this configuration, it is possible to acquire how the skin properties are distributed or the tendency of the skin properties in a certain region.

  Furthermore, the information generation unit may include a morphological information generation unit that generates morphological information representing a predetermined tissue form of the skin based on the tomographic data acquired for the two-dimensional region or the three-dimensional region of the skin. According to this configuration, it is possible to grasp both the properties of the skin and the form of the skin, and furthermore it is possible to grasp them in association with each other.

<Second Embodiment>
The skin property evaluation apparatus according to this embodiment has a function of photographing a subject in stereo, and executes various processes using a stereo image obtained thereby. The components of the skin property evaluation apparatus of this embodiment may be the same as those of the first embodiment unless otherwise specified.

[Constitution]
A configuration example of the skin property evaluation apparatus of this embodiment is shown in FIG. This skin property evaluation apparatus includes two or more imaging units 300 and a probe moving mechanism 310 in addition to the configuration of the first embodiment. Note that any of the components shown in FIG. 7 may not be mounted. For example, the surface observation optical system 40 can be deleted from the configuration shown in FIG.

(Shooting part)
The two or more imaging units 300 image the subject from different directions substantially simultaneously. In this embodiment, a case where two imaging units are included will be described in detail. However, the number of imaging units may be an arbitrary number of two or more. In this embodiment, the imaging unit 300 is provided separately from the surface observation optical system 40, but the subject can be imaged using the surface observation optical system 40. That is, the surface observation optical system 40 may be responsible for one of the two or more imaging units 300.

  Note that “substantially simultaneously” indicates that, in imaging by two or more imaging units 300, an imaging timing shift that allows the movement of the subject to be ignored is allowed. Thereby, an image when the subject is at substantially the same position (orientation) can be acquired by two or more imaging units 300.

  Further, the shooting by the two or more shooting units 300 may be moving image shooting or still image shooting. In the case of moving image shooting, the above-described substantial simultaneous shooting can be realized by performing control for adjusting the shooting start timing, control of the frame rate and shooting timing of each frame, and the like. On the other hand, in the case of still image shooting, this can be realized by controlling to match the shooting timing. Control of each photographing unit 300 is executed by the main control unit 111.

(Probe moving mechanism)
The probe moving mechanism 310 is used to move the probe. As described in the first embodiment, the probe is a unit that is disposed close to the skin surface S of the subject, and includes at least the nozzle 14 and the means for OCT in the configuration for blowing gas. Of these, at least the tip of the measurement arm is included. The probe moving mechanism 310 includes an actuator that generates a driving force and a transmission mechanism that transmits the generated driving force to the probe. The actuator operates under the control of a movement control unit 114 described later.

(Control part)
The control unit 110 includes a display control unit 113 and a movement control unit 114 in addition to the main control unit 111 and the storage unit 112. The display control unit 113 has a display control function similar to that of the main control unit 111 of the first embodiment, and controls the display device 210. The movement control unit 114 controls the probe moving mechanism 310. Details of the control executed by the display control unit 113 and the movement control unit 114 will be described later.

(Data processing part)
The data processing unit 130 includes an analysis unit 140. The analysis unit 140 includes a three-dimensional image generation unit 141 and a correspondence information generation unit 142. Further, the data processing unit 130 includes a position information acquisition unit 143.

(Analysis Department)
The analysis unit 140 acquires three-dimensional position information related to the subject by analyzing two captured images acquired substantially simultaneously by the two imaging units 300. The three-dimensional position information includes, for example, a three-dimensional position of a predetermined part of the subject. This predetermined part is, for example, a region where gas is sprayed or a position in the vicinity thereof. In this embodiment, it is assumed that the region where the gas is blown is a face portion (for example, a cheek). The three-dimensional position information is generated when the three-dimensional image generation unit 141 and the correspondence information generation unit 142 execute the following processing.

(3D image generator)
The three-dimensional image generation unit 141 generates a three-dimensional image (three-dimensional face image) of the subject's face based on the two captured images acquired substantially simultaneously by the two imaging units 300. This process is performed by a known image composition process. Note that the stereoscopic face image is, for example, a stereoscopic photograph or a stereoscopic model. The stereoscopic model is an image obtained by modeling (abstracting or modeling) each captured image or stereoscopic photograph, and is, for example, a polygon model or a wire frame. A known technique is used for the process of generating the three-dimensional model.

  Note that in the process of generating a stereoscopic face image, information indicating the installation positions (parallax) of the two photographing units 300 is used. Information indicating the installation position of each photographing unit 300 is acquired in advance. When the photographing unit 300 is movable, for example, based on the position of the photographing unit 300 detected by the position sensor or based on the content of the control for moving the photographing unit 300, photographing at the time of photographing is performed. The position of the unit 300 can be acquired.

(Correspondence information generator)
The correspondence information generation unit 142 generates correspondence information as the three-dimensional position information. The correspondence information is information in which the first coordinate system set in the stereoscopic face image generated by the three-dimensional image generation unit 141 is associated with the second coordinate system set in the real space.

  The positions of the pixels constituting the stereoscopic face image are defined by a first coordinate system (image coordinate system) which is a three-dimensional coordinate system. The position in the real space where the subject exists is defined by a second coordinate system (real space coordinate system) which is a three-dimensional coordinate system. The origin of the real space coordinate system is set at a predetermined position in the vicinity of the skin property evaluation apparatus. This origin position is set in advance with reference to the installation positions of the two photographing units 300, for example. The three coordinate axes of the real space coordinate system are, for example, the first coordinate axis in the vertical direction and the second and third coordinate axes that are located in a plane orthogonal to the first coordinate axis and orthogonal to each other.

  The association between the image coordinate system and the real space coordinate system is performed via the installation positions of the two photographing units 300, for example. That is, as described above, the real space coordinate system is defined based on the installation positions of the two imaging units 300, and the combined image of the captured images is executed based on the installation positions (parallax) of the two imaging units 300. Define a coordinate system. Thereby, the correspondence (coordinate transformation) between the real space coordinate system and the image coordinate system can be acquired.

  Alternatively, an object (a part of the subject, a part of the device, a part of the subject and a part of the object located in the vicinity of the device, etc.) depicted in the photographed image or the three-dimensional face image is a reference position (for example, the origin) Then, by setting both coordinate systems based on this, the correspondence (coordinate transformation) between the real space coordinate system and the image coordinate system may be acquired.

  The correspondence information (three-dimensional position information) includes, for example, the correspondence acquired as described above.

(Location information acquisition unit)
The position information acquisition unit 143 acquires position information representing the position of one or both of the gas blowing region and the OCT execution region based on the three-dimensional position information (for example, correspondence information) acquired by the analysis unit 140. To do. This process will be described later. The position information of the spray region may be, for example, information representing a position on the skin surface of the subject to be gas sprayed, or information representing a position of a probe for spraying gas to the spray target position. Good. Further, the position information of the OCT execution area may be, for example, information indicating the position on the skin surface of the subject and / or the position inside the skin, which is the imaging target area (scanning area) by OCT. It may be information indicating the position of the probe for performing OCT of the target region.

[Operation]
The operation of the skin property evaluation apparatus according to the embodiment will be described. Hereinafter, some typical operation examples will be described, but the operation according to the embodiment is not limited thereto.

(First operation example: FIG. 8)
In the first operation example, the skin property evaluation device is configured to perform an inspection by moving the probe to an inspection position (a position to be evaluated for skin properties) manually specified for a stereoscopic face image. The

(S1: Performs stereoscopic shooting of the face of the subject)
Photographing is performed using the two photographing units 300 such that the face of the subject sitting on a chair or lying on the bed is included in the photographing field. This shooting may be a still image shooting or a moving image shooting. In the case of still image shooting, the main control unit 111 controls the two shooting units 300 to perform shooting substantially simultaneously. In the case of moving image shooting, the main control unit 111 may perform processing for synchronizing shooting timings (frame rates) of the two shooting units 300. In the case of moving image shooting, the main control unit 111 associates a pair of captured images acquired substantially simultaneously by the two shooting units 300 and sends them to the subsequent processing (that is, sends them to the data processing unit 130).

(S2: Generate a 3D face image)
The three-dimensional image generation unit 141 generates a three-dimensional face image of the subject based on the two captured images acquired substantially simultaneously by the two imaging units 300 in step S1.

(S3: Generate correspondence information)
The correspondence information generation unit 142 associates the image coordinate system of the three-dimensional face image with the real space coordinate system of the space where the subject's face is located based on the three-dimensional face image generated in step S2. Generate information.

(S4: Display a 3D face image)
The display control unit 113 causes the display device 210 to display the stereoscopic face image generated in step S2.

(S5: Specify the inspection position for the 3D face image)
The user uses the operation device 220 to specify the inspection position for the stereoscopic face image displayed in step S4. As an example of this operation, the user moves a cursor (for example, a mouse pointer) displayed on the display device 210 together with the three-dimensional face image to a desired position on the three-dimensional face image, and confirms a designated position (for example, a mouse click). ).

  As another example, the main control unit 111 displays a list of inspection position candidates (for example, a drop-down list or a check box) together with a stereoscopic face image. The user selects a desired one of the candidates listed in this list. This operation is performed using a mouse, for example.

  The candidate for the inspection position may be a face part name. For example, “center of cheek”, “upper cheek”, “lower cheek”, and the like are provided as candidates. In this case, the analysis unit 140 (or the storage unit 112) stores in advance position information regarding each candidate. This position information includes, for example, information indicating the relative position of the candidate with respect to some feature points of the face (for example, some of the corners of the eyes, the corners of the eyes, the apex of the cheeks, the apex of the nose, the mouth corner, the midline) Including. When candidates in the list are specified, the analysis unit 140 identifies some feature points by analyzing the stereoscopic face image generated in step S2 (or the captured image acquired in step S1), Based on the feature point and the position information, an inspection position (a position in the stereoscopic face image, a coordinate value in the image coordinate system) corresponding to the designated candidate is obtained.

  The number of inspection positions that can be specified is not limited to one, and may be two or more. In that case, the user performs a typical operation as described above for each desired inspection position.

  Information indicating the designated inspection position is sent to the position information acquisition unit 143. This information is, for example, a coordinate value expressed by the image coordinate system of this stereoscopic face image.

(S6: Specify the inspection target area in the face)
The position information acquisition unit 143 specifies the inspection target region in the subject's face based on the correspondence information generated in step S3 and the inspection position specified in step S5. The region to be inspected indicates the range of the skin (or the position of the probe for performing this inspection) where the inspection is performed in the subsequent processing.

  As an example of this process, the position information acquisition unit 143 specifies the coordinate value of the real space coordinate system corresponding to the coordinate value of the image coordinate system acquired in step S5 with reference to the correspondence information.

(S7: Move the probe)
The movement control unit 114 controls the probe moving mechanism 310 so as to move the probe to the inspection target area specified in step S6. This process is executed, for example, by moving the probe to the position indicated by the coordinate value of the real space coordinate system acquired in step S6.

(S8: Perform inspection)
After the probe is moved in step S7, the main control unit 111 executes an inspection that is a combination of gas blowing and OCT measurement. This inspection is executed by, for example, any of the methods described in the first embodiment. Further, the inspection start trigger may be the end of the probe movement in step S7, an instruction by the user, or other than these.

  When two or more inspection positions are designated in step S5, the combination of the probe movement in step S7 and the inspection in step S8 is executed at least as many times as the number of inspection positions. For example, when three inspection positions are designated, the main control unit 111 causes the probe to move to the first inspection position and execute the inspection at the inspection position, and then the probe to the second inspection position. And the inspection at the inspection position are executed, and further, the probe is moved to the third inspection position and the inspection at the inspection position is executed.

(S9: Save evaluation information and inspection position information)
The main control unit 111 stores the evaluation information generated by the inspection in step S8 in the storage unit 112 in association with information (inspection position information) indicating the position where the inspection is performed. At this time, arbitrary information such as examination date / time, subject identification information (ID, name, etc.), stereoscopic face image, and the like may be further associated.

  The examination position information is information indicating a position that is an object of skin property evaluation. The inspection position information includes, for example, information indicating the inspection position designated for the stereoscopic face image in step S5 (coordinate values in the image coordinate system) and the position specified in step S6 (coordinate values in the real space coordinate system). ) At least one of them.

  This is the end of the processing related to this operation example.

  When the evaluation information acquired by this operation example is output (display, printing, data transmission, etc.), only the evaluation information may be output, or the evaluation information and related information (examination position information, stereoscopic face image) , At least one of various types of information related to the evaluation information, such as the subject identification information and the examination date / time, may be output. For example, evaluation information can be output together with a three-dimensional face image on which information (marker or the like) indicating an inspection position is overlaid.

  As another example, when evaluation information at two or more inspection positions is acquired, distribution information indicating the distribution of these inspection positions and evaluation information for each inspection position can be output in association with each other. Specific examples of the distribution information include character string information indicating the names of the candidates related to two or more inspection positions and a three-dimensional face image overlaid with markers indicating two or more inspection positions. Moreover, as an example of the association in the output, the arrangement of the character string information (or marker) and the evaluation information can be associated, or the display colors thereof can be associated.

(Second operation example: FIG. 9)
In the second operation example, the skin property evaluation apparatus is configured to perform the inspection by moving the probe to one or more inspection positions stored in advance.

  The inspection position stored in advance includes target position information that is information indicating the position of a region to which gas is sprayed (a spray target region). The target position information may be information indicating the position of the partial area of the skin, or information indicating the position of the probe for blowing gas to the partial area. Further, since at least a part of the gas spray target region and the target region for OCT measurement overlap each other, the target position information may be information indicating the target region for OCT measurement.

  Further, the target position information may include information indicating the position of an inspection performed in the past, or may include information indicating a typical inspection position. As an example of the former information, there is inspection position information stored in step S9 of the first operation example. As an example of the latter information, there are the inspection position candidate and its position information described in step S5 of the first operation example. Hereinafter, the former example will be described.

(S21: Read inspection position information)
The main control unit 111 reads the inspection position information stored in the storage unit 112 (or a storage device or a portable recording medium on a communication line). This process is executed as follows, for example. First, in the storage unit 112, examination position information is stored in association with the subject identification information. The skin property evaluation apparatus accepts subject identification information input by an input method such as manual input or reading of a subject card. The main control unit 111 searches the storage unit 112 for examination position information associated with the subject identification information. Thereby, the examination position applied in the examination conducted in the past for the subject is acquired.

  In addition, when several test | inspection position information is memorize | stored about the said subject, you may make it acquire selectively predetermined one (for example, the newest thing) among these. Further, when a plurality of inspection position information is stored, at least a part of one or more inspection positions included in one inspection position information and one or more inspection positions included in other inspection position information is stored. If they are different, an arbitrary inspection position may be read from the set of inspection positions. Alternatively, when one or more inspection position information is included, and when two or more inspection positions are included, all inspection position information is read, and all inspection positions included in these are displayed. Of these inspection positions, the inspection position selected by the user can be applied in the subsequent processing.

(S22: Perform stereoscopic shooting of the face of the subject)
Next, stereoscopic imaging using the two imaging units 300 is executed.

(S23: Generate a 3D face image)
The three-dimensional image generation unit 141 generates a three-dimensional face image of the subject based on the two captured images acquired substantially simultaneously by the two imaging units 300 in step S22.

(S24: Generate correspondence information)
The correspondence information generation unit 142 associates the image coordinate system of the stereoscopic face image with the real space coordinate system of the space where the face of the subject is located based on the stereoscopic face image generated in step S23. Generate information.

(S25: Specify the inspection target area in the face)
The position information acquisition unit 143 specifies an inspection target region in the face of the subject based on the inspection position information read in step 21 and the correspondence information generated in step S25.

  A specific example of this process will be described. The position information acquisition unit 143 identifies the coordinate value in the image coordinate system of the three-dimensional face image generated in step S23 corresponding to the coordinate value indicated by the examination position information (assumed to be the coordinate value in the image coordinate system). When a configuration in which an inspection is performed with the subject's face fixed at substantially the same position is applied, the coordinate value indicated by the inspection position information can be applied as it is as the inspection target region.

  On the other hand, when it is assumed that the position of the subject's face is different for each examination, it is applied in the image coordinate system (first image coordinate system) applied in the past examination and the current examination. Is associated with the image coordinate system (second image coordinate system). The processing in this case is executed, for example, as follows: In step S21, the stereoscopic face image applied in the past examination is read; the past stereoscopic face image and the stereoscopic face image generated in step S23 By performing the alignment (image matching) of this position; by converting the coordinate value (coordinate value in the first image coordinate system) indicated by the inspection position information using the result of this alignment (coordinate conversion such as affine transformation) Then, coordinate values in the second image coordinate system applied in the current examination are obtained. Thereby, an inspection object area is obtained.

(S26: Move the probe)
The movement control unit 114 controls the probe moving mechanism 310 so as to move the probe to the inspection target area specified in step S25.

(S27: Perform inspection)
After the probe is moved in step S26, the main control unit 111 executes an inspection that is a combination of gas blowing and OCT measurement.

(S28: Save evaluation information and inspection position information)
The main control unit 111 stores the evaluation information generated by the inspection in step S27 in the storage unit 112 in association with information (inspection position information) indicating the position where the inspection is performed. At this time, arbitrary information such as the examination date and time, the subject identification information, and the three-dimensional face image may be further associated. This is the end of the processing related to this operation example.

  The output (display, printing, data transmission, etc.) of the evaluation information acquired by this operation example may be the same as that of the first operation example.

  In this operation example, it is possible to output past evaluation information and latest evaluation information so that they can be compared. For example, it is possible to output so that these pieces of evaluation information are presented side by side.

  In addition, information indicating a time-series change of evaluation information can be displayed. Specifically, for example, a coordinate system in which the horizontal axis represents time and the vertical axis represents an evaluation value can be displayed at least once in the past. By plotting the evaluation results obtained in the inspection and the evaluation results obtained in the current inspection, it is possible to perform output so as to present time-series change information such as a line graph or a bar graph.

[Modification]
A configuration for visually recognizing a site where gas blowing or OCT measurement is actually applied will be described.

  An example of the configuration of the skin property evaluation apparatus according to this modification is shown in FIG. The difference between the configuration illustrated in FIG. 10 and the configuration illustrated in FIG. 7 is that a light projecting unit 320 and a light projecting control unit 115 are provided. Note that the surface observation optical system 40 may or may not be included. It is also possible to apply a configuration in which the probe moving mechanism 310 and the movement control unit 114 are not provided or a configuration in which the display control unit 113 is not provided.

  The light projecting unit 320 includes a device that outputs a light beam, such as an LED or a laser light source, and is used to project spot light onto the skin surface of the subject. The light projecting unit 320 is provided at a position facing the subject. The light projecting unit 320 has a function of changing the output direction of the light beam.

  The light projecting control unit 115 controls the light projecting unit 320. This control includes any one of switching on / off of the light beam output, changing the output direction, changing the output intensity, changing the output wavelength (output color), changing the light beam diameter (spot diameter), etc. It may be.

  The operation of the skin property evaluation apparatus according to this modification will be described. Hereinafter, some typical operation examples will be described, but the operation according to the modification is not limited thereto.

(First operation example: FIG. 11)
In the first operation example, the skin property evaluation device is configured to project spot light onto an inspection position manually designated for a three-dimensional face image, and to perform an inspection using a probe arranged at the projection position. Is done.

(S41: Perform stereoscopic shooting of the face of the subject)
Stereo imaging is performed using the two imaging units 300.

(S42: Generate a 3D face image)
The three-dimensional image generation unit 141 generates a stereoscopic face image of the subject based on the two captured images acquired substantially simultaneously by the two imaging units 300 in step S41.

(S43: Generate correspondence information)
The correspondence information generation unit 142 associates the image coordinate system of the three-dimensional face image with the real space coordinate system of the space where the subject's face is located based on the three-dimensional face image generated in step S42. Generate information.

(S44: Display a 3D face image)
The display control unit 113 causes the display device 210 to display the stereoscopic face image generated in step S42.

(S45: Specify the inspection position for the 3D face image)
The user uses the operation device 220 to specify the inspection position for the stereoscopic face image displayed in step S44.

(S46: Specify the inspection target area in the face)
The position information acquisition unit 143 specifies the inspection target region (the coordinate value in the real space coordinate system) on the face of the subject based on the correspondence information generated in step S43 and the inspection position specified in step S45. To do.

(S47: Spot light is projected onto the inspection target area)
The light projection control unit 115 controls the light projection unit 320 so that the spot light is projected onto the coordinate value specified in step S46. In this process, the light projection control unit 115 determines the output direction of the light flux based on, for example, the coordinate value of the inspection target area in the real space coordinate system and the coordinate value of the installation position of the light projection unit 320. Further, the output wavelength may be determined according to the skin color in the inspection target region. For example, the skin property evaluation apparatus operates to acquire a color photographed image in step S41, determine a skin color from the color photographed image, and output a light flux having a color different from the skin color.

(S48: Move the probe)
The user or the skin property evaluation apparatus moves the probe based on the examination target area specified in step S46.

  When the user performs a moving operation, the user arranges the probe so that gas or measurement light is applied to the area of the skin surface onto which the spot light is projected in step S47. At this time, you may comprise so that aiming light may be output from a probe. This aiming light is, for example, visible light output from a visible light source (not shown). The user can adjust the position of the probe so that the projection position of the aiming light overlaps the projection position of the spot light. Note that when the user performs a moving operation exclusively, the probe moving mechanism 310 and the movement control unit 114 do not need to be provided. However, in the case where a configuration in which the probe is moved by electrically controlling the probe moving mechanism 310 using the operation device 220 or the like is applied, even if a moving operation by the user is exclusively assumed, the probe moving mechanism 310 and a movement control unit 114 are provided.

  When the skin property evaluation apparatus performs a moving operation, the movement control unit 114 controls the probe moving mechanism 310 so as to move the probe to the examination target area specified in step S46.

(S49: Perform inspection)
After the probe is moved in step S48, the main control unit 111 executes an inspection that is a combination of gas blowing and OCT measurement.

(S50: Save evaluation information and inspection position information)
The main control unit 111 stores the evaluation information generated by the inspection in step S8 in the storage unit 112 in association with information (inspection position information) indicating the position where the inspection is performed. At this time, arbitrary information such as examination date / time, subject identification information (ID, name, etc.), stereoscopic face image, and the like may be further associated. This is the end of the processing related to this operation example. The output (display, printing, data transmission, etc.) of the evaluation information acquired by this operation example may be the same as that of the first operation example in the second embodiment.

(Second operation example: FIG. 12)
In the second operation example, the skin property evaluation apparatus is configured to project spot light onto a pre-stored inspection position, and to perform inspection using a probe arranged at the projection position.

(S61: Read inspection position information)
The main control unit 111 reads the inspection position information stored in the storage unit 112 (or a storage device or a portable recording medium on a communication line).

(S62: Perform stereoscopic imaging of the subject's face)
Next, stereoscopic imaging using the two imaging units 300 is executed.

(S63: Generate a 3D face image)
The three-dimensional image generation unit 141 generates a stereoscopic face image of the subject based on the two captured images acquired substantially simultaneously by the two imaging units 300 in step S62.

(S64: Generate correspondence information)
The correspondence information generation unit 142 associates the image coordinate system of the three-dimensional face image with the real space coordinate system of the space where the subject's face is located based on the three-dimensional face image generated in step S63. Generate information.

(S65: Specify the inspection target area in the face)
The position information acquisition unit 143, based on the inspection position information read out in step 61 and the correspondence information generated in step S65, the inspection target area (coordinate value in the real space coordinate system) in the subject's face. Is identified.

(S66: Spot light is projected onto the inspection target area)
The light projecting control unit 115 controls the light projecting unit 320 so that the spot light is projected on the coordinate value specified in step S65.

(S67: Move the probe)
The user or the skin property evaluation apparatus moves the probe based on the examination target area specified in step S65 (or referring to the position where the spot light is projected in step S66).

(S68: Perform inspection)
After the probe is moved in step S67, the main control unit 111 executes an inspection that is a combination of gas blowing and OCT measurement.

(S69: Save evaluation information and inspection position information)
The main control unit 111 stores the evaluation information generated by the inspection in step S68 in the storage unit 112 in association with information indicating the position where the inspection is performed (inspection position information). At this time, arbitrary information such as the examination date and time, the subject identification information, and the three-dimensional face image may be further associated. This is the end of the processing related to this operation example. The output (display, printing, data transmission, etc.) of the evaluation information acquired by this operation example may be the same as that of the second operation example in the second embodiment.

[Action and effect]
The skin property evaluation apparatus according to this embodiment includes two or more imaging units, an analysis unit, and a position information acquisition unit in addition to any of the configurations in the first embodiment. The two or more imaging units are configured to image the subject substantially simultaneously from different directions. In the embodiment, two or more imaging units are configured to include two or more imaging units 300. Any of the two or more photographing units may be the surface observation optical system 40. The analysis unit acquires three-dimensional position information related to the subject by analyzing two or more captured images acquired by the two or more imaging units. In the embodiment, the analysis unit includes the analysis unit 140. The position information acquisition unit obtains the position information of the gas blowing region by the spraying unit and / or the position information of the optical coherence tomography execution region by the tomographic data acquisition unit based on the three-dimensional position information acquired by the analysis unit. get. In the embodiment, the position information acquisition unit includes a position information acquisition unit 143.

  According to such an embodiment, as in the first embodiment, highly accurate skin property evaluation can be performed in a non-contact manner. Furthermore, it is possible to detect the current position of the subject by photographing the subject from different directions, and specify the examination position (position to be evaluated) based on the current position.

  In the embodiment, the imaging field by the two or more imaging units may include at least a part of the face of the subject. In this case, the skin property evaluation apparatus can evaluate the skin property of the face of the subject. Note that it is possible to perform the imaging field search process so that the face of the subject is included in the imaging field. This processing includes, for example, moving image shooting by the shooting unit and known image processing (pattern matching, face detection processing, face authentication processing, etc.) for the frame acquired by the moving image shooting.

  In the embodiment, the analysis unit may include a three-dimensional image generation unit and a correspondence information generation unit. The three-dimensional image generation unit generates a three-dimensional image of the subject's face based on the two or more captured images acquired by the two or more imaging units. In the embodiment, the three-dimensional image generation unit includes a three-dimensional image generation unit 141. The correspondence information generation unit generates correspondence information in which the first coordinate system set in the three-dimensional image generated by the three-dimensional image generation unit is associated with the second coordinate system set in the real space. To do. The generated correspondence information is used as the three-dimensional position information related to the subject. According to this configuration, the correspondence between the three-dimensional coordinate system (image coordinate system) set for the three-dimensional face image of the subject and the three-dimensional coordinate system (real space coordinate system) set for the real space. (Coordinate transformation etc.) can be acquired. Thereby, a position (coordinate value) in the real space corresponding to an arbitrary position (coordinate value) in the stereoscopic face image can be specified. Conversely, a position (coordinate value) in the stereoscopic face image corresponding to an arbitrary position (coordinate value) in the real space can also be specified.

  In the embodiment, it is possible to provide a display control unit (display control unit 113) that displays a three-dimensional image on a display unit. The display means includes a display device provided as a part of the skin property evaluation apparatus or a display device connected to the skin property evaluation apparatus. When the position in the three-dimensional image displayed on the display unit is designated, the position information acquisition unit associates the position in the three-dimensional image (three-dimensional face image) of the subject with the position in the real space. Based on the correspondence information, the coordinate value in the coordinate system of the real space corresponding to the coordinate value of the designated position in the coordinate system of the three-dimensional image is acquired. According to this configuration, it is possible to specify the position in the real space corresponding to the position designated by the user in the stereoscopic face image.

  In the embodiment, the spray unit may include a nozzle having a gas outlet formed at the tip. Furthermore, the tomographic data acquisition unit divides the light from the light source (light source unit 21) into measurement light and reference light, irradiates the measurement light on the skin via the measurement arm, and returns the measurement light that has passed through the measurement arm. An optical system (OCT unit 20) that detects interference light between the light and the reference light that has passed through the reference arm may be provided. The light source does not need to be a component of the skin property evaluation apparatus, and can be configured to guide light from an external light source device to the skin property evaluation apparatus through an optical fiber, for example. In addition, the skin property evaluation apparatus may include a probe, a movement mechanism, and a movement control unit. The probe is provided with at least a nozzle of the spraying portion and at least a tip portion of the measurement arm. The moving mechanism (probe moving mechanism 310) is configured to move the probe. The movement control unit (movement control unit 114) controls the movement mechanism based on the coordinate value in the real space acquired by the position information acquisition unit. This control is performed, for example, by controlling the probe to be arranged at a position in the real space acquired by the position information acquisition unit, or by arranging the probe at a position near the position in the real space acquired by the position information acquisition unit. Including control to As an example of the latter, when the position in the real space acquired by the position information acquisition unit indicates the position of the skin surface, the vicinity position is a predetermined distance from the position of the skin surface in a direction perpendicular to the skin surface. It is only a position away. This predetermined distance is set in advance or in real time in accordance with a gas blowing state, an interference state in OCT (for example, a difference in optical path length between the measurement arm and the reference arm), or the like. According to such a configuration, the probe can be automatically arranged at a position in the real space corresponding to the position designated by the user in the stereoscopic face image.

  In the embodiment, a light projecting unit (light projecting unit 320) that outputs a light beam and a light projecting control unit (light projecting control unit 115) that controls the light projecting unit may be included. The light projection control unit controls the light projection unit so that the light beam is projected at the position indicated by the coordinate value in the real space acquired by the position information acquisition unit. According to this configuration, it is possible to visually present a position in the real space corresponding to the position designated by the user. Thereby, for example, the user can position the probe with the position where the light beam is projected as a target. That is, the probe can be easily positioned.

  In the embodiment, when the spray unit includes a nozzle, the tomographic data acquisition unit includes the optical system, and the skin property evaluation device includes a probe, a movement mechanism, and a movement control unit, the skin property evaluation device is Further, a storage unit (storage unit 112) may be provided. The storage unit stores in advance target position information that represents the position of the target area of the gas sprayed by the spraying unit. In this case, the position information acquisition unit is configured to display the position represented in the target position information based on correspondence information in which a position in the subject's three-dimensional image (three-dimensional face image) is associated with a position in the real space. The coordinate value in the real space coordinate system corresponding to is obtained. Further, the movement control unit controls the movement mechanism based on the coordinate value acquired by the position information acquisition unit. This control is performed, for example, by controlling the probe to be arranged at a position in the real space acquired by the position information acquisition unit, or by arranging the probe at a position near the position in the real space acquired by the position information acquisition unit. Including control to According to such a configuration, it is possible to automatically arrange the probe at a predetermined position.

  In the embodiment, the skin property evaluation apparatus includes a storage unit (storage unit 112), a light projecting unit (light projecting unit 320), and a light projecting control unit (light projecting control unit 115) that controls the memory unit. Good. The storage unit stores in advance target position information that represents the position of the target area of the gas sprayed by the spraying unit. Further, the position information acquisition unit obtains the position indicated in the target position information based on the correspondence information in which the position in the three-dimensional image (three-dimensional face image) of the subject is associated with the position in the real space. Get the coordinate value in the corresponding real space coordinate system. The light projection control unit controls the light projection unit so that the light beam is projected at the position indicated by the coordinate value acquired by the position information acquisition unit. According to such a configuration, it is possible to visually present a position in the real space corresponding to a predetermined position. Thereby, the positioning of the probe can be facilitated.

  The target position information may be the position of the spray target area in the past evaluation (past inspection) for the subject. In this case, the re-evaluation of the position where the skin property evaluation has been performed in the past can be easily performed. Thereby, for example, it becomes possible to grasp a time-series change in properties of the same part of the skin.

  Alternatively, the target position information may be a default position of a gas spray target area. This default position is a part of the skin that is set in advance for comparison with other subjects, comparison with standard values or reference values, and the center position of the cheek is applied. The

<Third Embodiment>
Several embodiments relating to the use of stereo shooting are described. In particular, an embodiment relating to the use of a stereo moving image (stereoscopic moving image) acquired by stereo moving image shooting using two or more shooting units capable of moving image shooting will be described.

[Constitution]
An example of the configuration of the skin property evaluation apparatus according to this embodiment is shown in FIG. The configuration shown in FIG. 13 is similar to the configuration shown in FIG. However, in the configuration according to this embodiment, the display control unit 113 may not be provided, and the configuration of the data processing unit 130 is different from the configuration illustrated in FIG. Further, the surface observation optical system 40 can be deleted from the configuration shown in FIG.

  Two or more photographing units 300 shown in FIG. 13 can shoot moving images. Each photographing unit 300 includes a video camera, for example. The captured images (frames) acquired sequentially by the respective imaging units 300 are sequentially sent to the data processing unit 130 via the control unit 110. This transfer process is executed in real time. In this transfer process, the main control unit 111 associates two or more frames acquired by the two or more imaging units 300 substantially simultaneously and sends them to the data processing unit 130.

  The data processing unit 130 includes an analysis unit 140, a position information acquisition unit 143, and a positional relationship determination unit 150.

  The analysis unit 140 acquires a plurality of pieces of three-dimensional position information along a time series by sequentially analyzing two or more frames acquired substantially simultaneously by two or more imaging units 300. This process is executed, for example, by sequentially performing the same process as in the second embodiment on two or more frames (they are associated with each other) sequentially input from the main control unit 111. The Note that the three-dimensional position information includes, for example, the three-dimensional position of the face portion (cheek etc.) of the subject. Similarly to the second embodiment, the analysis unit 140 may include a three-dimensional image generation unit (141) and a correspondence information generation unit (142). In this case, the analysis unit 140 generates processing information for generating a three-dimensional image from two or more frames and correspondence information in which the coordinate system of the three-dimensional image is associated with the coordinate system of the real space as three-dimensional position information. Processing.

  By such processing, the analysis unit 140 acquires a plurality of pieces of three-dimensional position information along time series, that is, a plurality of pieces of three-dimensional position information having different acquisition times (acquisition timings). Time information may be given to these three-dimensional position information. The time information is information indicating a temporal order in which the three-dimensional position information is acquired, and is, for example, a coordinate value on the time axis representing the acquisition timing of the three-dimensional position information. Since a plurality of pieces of information are generated in time series in the subsequent processing based on these three-dimensional position information, time information may be assigned to the generated information.

  The position information acquisition unit 143 acquires a plurality of position information along a time series based on the plurality of three-dimensional position information acquired by the analysis unit 140. The position information acquisition unit 143 acquires a plurality of pieces of position information along a time series by performing, for example, the same processing as in the second embodiment on each three-dimensional position information. The position information represents the position of one or both of the gas blowing area and the OCT execution area, as in the second embodiment. The time information as described above is given to the plurality of position information along the time series.

  The positional relationship determination unit 150 operates when tracking is executed. Here, the tracking will be described. The tracking is an operation of moving the probe in real time so as to follow the movement of the subject (gas blowing region or OCT execution region). Hereinafter, a specific example of processing related to tracking will be described.

  As described above, the position information acquisition unit 143 repeatedly acquires, in real time, position information indicating the current position of the gas blowing region or the OCT execution region. That is, the position information acquisition unit 143 repeatedly acquires the current position of the subject in real time.

  The main controller 111 recognizes the current position of the probe. The current position of the probe is acquired from, for example, the control contents of the probe moving mechanism 310 by the main control unit 111 (for example, control history up to the present time). Or you may comprise so that the present position of a probe may be recognized based on the output from the position sensor (illustration omitted) which detects the position of a probe. As another example, two or more captured images (frames) by two or more imaging units 300 or a stereoscopic image based on them are analyzed to identify an image area corresponding to the probe, and the coordinate values (images) of the identified image area The coordinate value in the coordinate system may be obtained.

  The main control unit 111 obtains a difference between the current position of the subject indicated by the position information and the current position of the recognized probe. This difference is calculated, for example, as a difference in coordinate values (position vector difference) in the image coordinate system or the real space coordinate system. When the above correspondence information is generated, the correspondence (coordinate transformation) between the image coordinate system and the real space coordinate system is known, and the coordinate value in the image coordinate system and the coordinate value in the real space coordinate are regarded as the same. it can. That is, even if the coordinate system representing the current position of the subject is different from the coordinate system representing the current position of the probe, the current position of the subject is compared with the current position of the probe by using correspondence information. can do.

  The main control unit 111 controls the probe moving mechanism 310 so that the calculated difference (that is, the displacement between the subject and the probe at the current time) is cancelled. For example, the main control unit 111 controls the probe moving mechanism 310 so that the calculated difference is included in a predetermined allowable range. This permissible range is set, for example, as a permissible range of displacement of the probe with respect to the position of the gas blowing region or the OCT execution region (ie, the position of the subject). The direction and size of the permissible range are set in advance according to, for example, gas blowing conditions, interference conditions in OCT (for example, a difference in optical path length between the measurement arm and the reference arm), and the like.

  According to such processing, when a difference (Δx, Δy, Δz) between the current position of the subject and the current position of the probe is obtained, the probe is moved by (−Δx, −Δy, −Δz). The probe moving mechanism 310 is controlled so that Then, by repeatedly executing such processing, the position of the probe is controlled so as to follow the movement of the subject.

  The positional relationship determination unit 150 repeatedly determines in real time whether the positional relationship between the subject and the probe is a predetermined positional relationship when tracking is being performed. In other words, the positional relationship determination unit 150 has a function of detecting that the subject and the probe are in a predetermined positional relationship.

  As described above, in tracking, the current position of the subject and the current position of the probe are acquired, and the difference (displacement) between them is obtained. Based on this difference, the positional relationship determination unit 150 determines whether or not the positional relationship between the subject and the probe is a predetermined positional relationship. This determination process is executed for each difference calculated sequentially, for example. Accordingly, the determination process is repeated at a repetition rate substantially the same as the moving image frame acquisition interval (frame rate) by the imaging unit 300.

  The “predetermined positional relationship” will be described. The position information acquired by the position information acquisition unit 143 indicates a position in the real space corresponding to a gas blowing area or an OCT execution area. When the position information indicates the position of the skin surface, the “predetermined positional relationship” means, for example, that the position of the skin surface (that is, the position of the subject) and the position of the probe are perpendicular to the skin surface. Indicates that the distance is a predetermined distance. This predetermined distance is set to be equal to or smaller than the “allowable range” in tracking, for example. This predetermined distance is set in advance according to, for example, a gas blowing state, an interference state in OCT (for example, a difference in optical path length between the measurement arm and the reference arm), or the like. That is, the “predetermined positional relationship” is set as an optimal positional relationship between the skin surface region to be evaluated and the probe.

  The “predetermined positional relationship” may have a one-dimensional, two-dimensional, or three-dimensional spread. This range is also set to be equal to or smaller than the “allowable range” in tracking, for example.

[Operation]
The operation of the skin property evaluation apparatus according to the embodiment will be described. Hereinafter, a typical operation example illustrated in FIG. 14 will be described, but the operation according to the embodiment is not limited thereto.

(S81: Start the subject's stereoscopic video shooting)
Under the control of the main control unit 111, the two shooting units 300 start stereoscopic video shooting.

(S82: Start tracking)
The main control unit 111 (and the data processing unit 130) starts tracking based on two or more frames that are sequentially acquired by the stereoscopic video shooting started in step S81. Thereby, the position of the probe is automatically adjusted so as to follow the movement of the subject.

(S83: Is the subject and the probe in a predetermined positional relationship?)
In response to the start of tracking in step S82, the positional relationship determination unit 150 determines whether the subject and the probe have a predetermined positional relationship. This determination process is repeatedly executed at least until it is determined that they have a predetermined positional relationship (S83: NO). Note that the tracking is continued at least until the completion of the inspection in the subsequent step S84.

(S84: Perform inspection)
If it is determined in step S83 that the subject and the probe have a predetermined positional relationship (S83: YES), the main control unit 111 executes an inspection that is a combination of gas blowing and OCT measurement.

(S85: Save evaluation information and inspection position information)
The main control unit 111 stores the evaluation information generated by the inspection in step S84 in the storage unit 112 in association with information (inspection position information) indicating the position where the inspection is performed. At this time, arbitrary information such as the examination date and time, the subject identification information, and the three-dimensional face image may be further associated. This is the end of the processing related to this operation example. The output (display, printing, data transmission, etc.) of the evaluation information acquired by this operation example may be the same as any operation example in the second embodiment.

[Action and effect]
The skin property evaluation apparatus according to this embodiment has the following configuration in addition to any of the configurations in the second embodiment. First, the two or more imaging units (imaging unit 300) are configured to be able to perform moving image imaging. In addition, the analysis unit (analysis unit 140) acquires a plurality of pieces of three-dimensional position information in time series by sequentially analyzing two or more frames acquired substantially simultaneously by the moving image shooting in real time. . Each three-dimensional position information is information regarding the three-dimensional position of the subject. Further, the position information acquisition unit (position information acquisition unit 143) acquires a plurality of position information along the time series sequentially in real time based on the three-dimensional position information. Each position information indicates a position of at least one of a gas spray area and / or an OCT execution area.

  According to such a configuration, the position of the subject can be monitored in real time, and more specifically, the gas blowing area and the OCT execution area can be monitored in real time. The use of the information obtained by this processing is arbitrary (for example, it is not limited to tracking or an inspection start trigger).

  In the embodiment, the spray unit includes a nozzle, the tomographic data acquisition unit includes the optical system, and the skin property evaluation apparatus further includes a probe and a moving mechanism (probe moving mechanism 310) for moving the probe, In the case of including a movement control unit (movement control unit 114) that controls the movement mechanism, the movement control unit can be configured as follows. That is, the movement control unit is configured to cause the probe to follow the movement of the subject by controlling the movement mechanism in real time based on the three-dimensional position information sequentially acquired by the position information acquisition unit. It's okay.

  According to such a configuration, the probe can be made to follow changes in the position of the gas blowing region or the OCT execution region (auto tracking). Thereby, even if it is a case where a subject moves, a probe can be continuously arranged in a suitable position.

  In the embodiment, a first positional relationship determination unit (the positional relationship determination unit 150) that performs the following processing when auto-tracking is being performed may be further provided. The first positional relationship determination unit repeats in real time whether or not the positional relationship between the subject and the probe is a predetermined positional relationship based on the positional information sequentially acquired in real time by the positional information acquisition unit. Judgment. In the case where such a first positional relationship determination unit is provided, the tomographic data acquisition unit determines that the positional relationship between the subject and the probe is a predetermined positional relationship by the first positional relationship determination unit. In response to this, the OCT may be configured to start. In addition, the timing of the gas spray start by the spray unit may be arbitrary. For example, the spraying unit is configured to start the gas spraying when the first positional relationship determination unit determines that the positional relationship between the subject and the probe is a predetermined positional relationship. Good. Moreover, it can also be comprised so that the spraying of gas may be started at the arbitrary timing before OCT is started, and it can also be comprised so that the spraying of gas may be started at the arbitrary timing after OCT is started. .

  According to this structure, a test | inspection can be performed at the timing when the subject and the probe became suitable positional relationship. Further, by continuing the tracking even during the inspection, the inspection can be executed in a state in which a suitable positional relationship between the subject and the probe is maintained.

  Note that tracking and OCT measurement can be executed in parallel. This OCT measurement is repeatedly executed with the same scanning pattern, for example. Thereby, an OCT moving image is acquired. Furthermore, it is possible to start the gas blowing or switch the scanning pattern based on the OCT moving image. For example, in response to the drawing position of the skin surface in a B-scan moving image being located at a predetermined position (for example, the position where the interference sensitivity is maximum), gas blowing is started, or switching to a three-dimensional scan or a circle scan is performed. It is possible to Further, in response to the drawing of a predetermined part of the skin in the B-scan moving image or the three-dimensional moving image, it is possible to start blowing gas or switch the scanning pattern. According to such a configuration, precise tracking using an OCT moving image and input of an inspection start trigger are possible.

<Modification>
The configuration described above is merely an example for favorably implementing the present invention. Therefore, arbitrary modifications (omitted, replacement, addition, etc.) within the scope of the present invention can be made as appropriate. Moreover, it is possible to arbitrarily combine some of the above-described embodiments and modifications.

  In the above embodiment, the case where two imaging units are used has been described in detail. However, it is possible to use three or more imaging units. For example, two or more photographing units for performing wide-area stereo photographing and two or more photographing units for performing narrow-area stereo photographing are provided, and a wide-area stereo image and a narrow-area stereo image acquired by these are provided. Can be associated with each other. Here, the magnification for wide-area stereo photography and the magnification for narrow-area stereo photography may be the same or different.

  More specifically, such a configuration is realized as follows, for example. First, the two or more imaging units include a first group of imaging units that perform imaging in the first imaging field, and a second group of imaging units that perform imaging in the second imaging field included in the first imaging field. including. The first group of imaging units is for narrow-area imaging, and the second group of imaging units is for wide-area imaging.

  The analysis unit analyzes the first group of frames (narrow region frames) acquired substantially simultaneously by the imaging unit for narrow region imaging, thereby obtaining first three-dimensional position information (narrow region 3) on the subject. Dimensional position information). The analysis unit acquires second 3D position information (wide area 3D position information) by analyzing the second group of frames acquired substantially simultaneously by the imaging unit for wide area imaging. Further, the analysis unit associates the narrow area three-dimensional position information with the wide area three-dimensional position information. Note that the narrow area three-dimensional position information and the wide area three-dimensional position information associated with each other are based on the narrow area frame and the wide area frame acquired substantially simultaneously.

  The association between the narrow area three-dimensional position information and the wide area three-dimensional position information is performed as follows, for example. When the imaging unit for narrow-area imaging and the imaging unit for wide-area imaging are fixed, or when these positions are recognizable, their relative positions can be acquired. Alternatively, the position of each imaging unit in the real space coordinate system or the image coordinate system can be obtained. Based on such a positional relationship (coordinate values), the position of the first imaging field in the second imaging field can be specified, and the position between the wide-area three-dimensional position information and the narrow-area three-dimensional position information. A relationship can be sought.

  The position information acquisition unit, based on the first three-dimensional position information and the second three-dimensional position information, displays position information indicating the position of the gas spray region by the spray unit and the position of the OCT execution region by the tomographic data acquisition unit. Can be acquired.

  According to such a modification, various processes can be realized by a combination of a wide-area stereo image and a narrow-area stereo image. For example, after specifying the approximate position of the evaluation target area by the wide-area stereo image, the evaluation target area can be observed in detail by the narrow-area stereo image.

  As described above, it is possible to apply a configuration in which the surface observation optical system 40 for acquiring an image of the skin surface is not provided. An example of the configuration of such a skin property evaluation apparatus is shown in FIG. Components having the same reference numerals as those in FIG. 1 have the same configurations and functions as those of the above-described embodiment, and detailed descriptions thereof are omitted. Further, the control mode for the components shown in FIG. 15 may be the same as in the above embodiment.

  A skin property evaluation apparatus 1000 shown in FIG. 15 includes a compressed gas generation unit 11, a communication pipe 12, a head unit 13, and a nozzle 14, similarly to the skin property evaluation apparatus 1 shown in FIG. 1. Skin property evaluation apparatus 1000 includes an OCT unit 20A for acquiring skin tomographic data using OCT. The OCT unit 20A includes the same components as the OCT unit 20 in the above embodiment, but their arrangement is different. Furthermore, the skin property evaluation apparatus 1000 includes an arithmetic control unit 100 for generating skin property evaluation information based on the tomographic data acquired by the OCT unit 20A. The configuration of the arithmetic control unit 100 is the same as that of the above embodiment.

  In the skin property evaluation apparatus 1000 of this modification, not only the surface observation optical system 40 is provided, but also a beam splitter 50 that combines the optical path of the surface observation optical system 40 and the optical path of the measurement light (measurement arm). Not provided. That is, in this modification, the measurement arm extending from the OCT unit 20A is guided to the head unit 13 without passing through the beam splitter.

  The OCT unit 20A is provided with the same components (optical elements, mechanisms, etc.) as the OCT unit 20 of the above embodiment. Specifically, the OCT unit 20A includes a light source unit 21, an optical fiber 22 that guides light output from the light source unit 21, and a fiber coupler 23 that divides the light into measurement light and reference light.

  An optical fiber 24, a collimator lens unit 25, and an optical scanner 26 are provided in the optical path (measurement arm) of the measurement light. Although illustration is omitted, a focusing lens, a relay lens, an objective lens, and the like may be provided in the optical path (measurement arm) of the measurement light.

  An optical fiber 27, a collimator lens unit 28, and a reference mirror 29 are provided in the optical path (reference arm) of the reference light. The reference mirror 29 is moved in the direction along the optical axis of the reference arm by the reference mirror driving unit 29A. Although not shown, the optical path (reference arm) of the reference light is provided with an optical attenuator for adjusting the amount of the reference light, a polarization controller for adjusting the polarization state of the reference light, and the like. Good.

  Further, the OCT unit 20A includes an optical fiber 30 that guides interference light between the return light of the measurement light and the return light of the reference light generated by the fiber coupler 23, and a detection unit that detects the interference light and generates a signal. 31 is provided. A signal (detection signal) generated by the detection unit 31 is sent to the arithmetic control unit 100.

  Also with the skin property evaluation apparatus 1000 having such a configuration, it is possible to perform highly accurate skin property evaluation in a non-contact manner, as in the above embodiment.

  In the third embodiment, the operation of starting OCT in response to the subject and the probe having a predetermined positional relationship has been described. Such an operation is called “auto-shoot”. In the third embodiment, auto-shooting is performed using a subject's stereo image acquired by stereo imaging, but it is also possible to employ a configuration in which auto-shooting is performed using other information. Is possible. As an example of such a configuration, a case where data acquired by OCT is used will be described below.

  The skin property evaluation apparatus according to this modification may have the same configuration as that of the third embodiment. However, the imaging unit 300 (and the surface observation optical system 40) in FIG. 13 is not necessary. Furthermore, the data processing unit 130 of the skin property evaluation apparatus according to this modification has a configuration different from that of the third embodiment. That is, the data processing unit 130 of this modification need not include the analysis unit 140, the position information acquisition unit 143, and the positional relationship determination unit 150 in the third embodiment. This modification will be described with reference to FIG. 13 in consideration of such differences.

  The OCT unit 20 of this modification divides the light from the light source unit 21 into measurement light and reference light, and irradiates the skin with the measurement light via the measurement arm. Further, the OCT unit 20 detects interference light between the return light of the measurement light that has passed through the measurement arm and the reference light that has passed through the reference arm. The detection unit 31 that has detected the interference light sends a detection signal to the tomographic data generation unit 120. The tomographic data generation unit 120 generates tomographic data based on the detection signal. The generated tomographic data is sent to the data processing unit 130 via the control unit 110.

  In particular, the main control unit 110 executes the following control. First, the main control unit 110 controls the reference mirror driving unit 29A to move the reference mirror 29. The position of the reference mirror 29 may be a default position. Alternatively, the position of the reference mirror 29 may be determined based on the tomographic data acquired in real time. Specifically, the position of the reference mirror 29 can be searched such that a predetermined part of the skin (for example, the skin surface S) is included in a predetermined range within the frame of the OCT image. The position of the reference mirror 29 set in this way is fixed.

  When the position of the reference mirror 29 is fixed, the process proceeds to the next stage. Fixing the position of the reference mirror 29 corresponds to fixing the optical path length difference between the measurement arm and the reference arm. In this state, the main control unit 110 controls the OCT unit 20 to repeatedly execute OCT (that is, repeatedly detect interference light). Data acquired by this repetitive OCT (detection signal from the detection unit 31, tomographic data generated by the tomographic data generation unit 120, etc.) is input to the data processing unit 130. In repetitive OCT, for example, OCT with the same scan pattern is repeatedly executed, such as repetition of A scan, repetition of B scan, and repetition of three-dimensional scan. A series of data corresponding to the scan pattern is input to the data processing unit 130 sequentially and in real time at a rate equivalent to the OCT repetition rate.

  The data processing unit 130 repeatedly determines in real time whether the positional relationship between the subject and the optical system (probe, skin property evaluation device, etc.) is a predetermined positional relationship. This process is executed in units of the series of data. The data processing unit 130 that executes this process corresponds to a second positional relationship determination unit.

A specific example of processing executed by the data processing unit 130 will be described. First, the data processing unit 130 analyzes a series of data to identify a data region corresponding to a predetermined part of the skin (for example, the skin surface S). When the series of data includes a reflection intensity profile, for example, the position of the peak corresponding to the skin surface S is specified in the reflection intensity profile (see z coordinate value z ₀ shown in FIG. 3A). Alternatively, when the series of data is B scan data, for example, an image region corresponding to the skin surface S is specified in the B scan data (see image region H ₀ shown in FIG. 3B).

Next, the data processing unit 130 determines whether or not the specified data region (the above-described peak position or image region) is included in a predetermined range (allowable range) of the frame. The allowable range of the frame is set in advance based on, for example, the type of the data area to be specified and the part to be evaluated. The allowable range of the frame is set at least in the depth direction (z direction). That is, the allowable range of the frame includes at least an allowable range in the depth direction (z _a ≦ z ≦ z _b ). The allowable range of the frame may include an allowable range in a direction orthogonal to the depth direction. For example, when the series of data is B scan data representing an xz cross section, the allowable range of the frame may include an allowable range in the x direction in addition to the allowable range in the z direction. Alternatively, when the series of data is three-dimensional image data, the allowable range of the frame may include an allowable range in the x direction and / or an allowable range in the y direction in addition to the allowable range in the z direction. The data processing unit 130 determines whether or not the coordinate value of the specified data area is included in the coordinate range indicated in the allowable range.

  The operation of this modification will be described. Hereinafter, a typical operation example illustrated in FIG. 16 will be described, but the operation according to the embodiment is not limited thereto.

(S101: Fix the position of the reference mirror)
First, the main control unit 111 moves the reference mirror 29A to a suitable position and fixes the position.

(S102: Start repetitive OCT)
When the position of the reference mirror 29 is fixed, the main control unit 111 controls the OCT unit 20 (and the tomographic data generation unit 120) to start repetitive OCT.

(S103: Is the subject and the optical system in a predetermined positional relationship?)
In response to the start of repetitive OCT in step S102, the data processing unit 130 determines whether or not the subject and the optical system have a predetermined positional relationship. This determination process is repeatedly executed at least until it is determined that they have a predetermined positional relationship (S103: NO).

(S104: Perform inspection)
If it is determined in step S103 that the subject and the optical system have a predetermined positional relationship (S103: YES), the main control unit 111 executes an examination that is a combination of gas blowing and OCT measurement. .

(S105: Save evaluation information and inspection position information)
The main control unit 111 stores the evaluation information generated by the inspection in step S104 in the storage unit 112 in association with information (inspection position information) indicating the position where the inspection is performed. At this time, arbitrary information such as the examination date and time, the subject identification information, and the three-dimensional face image may be further associated. This is the end of the processing related to this operation example. The output (display, printing, data transmission, etc.) of the evaluation information acquired by this operation example may be the same as any operation example in the above embodiment.

  Note that it is possible to combine the determination process according to the present modification example and the determination process according to the third embodiment so that the inspection is started when both are satisfied. According to this configuration, it is possible to perform global positional relationship determination (coarse determination) according to the third embodiment and local positional relationship determination (detailed determination) according to this modification. Further, it is possible to perform control so as to shift to the determination of the local positional relationship in response to the satisfaction of the global positional relationship. It is also possible to perform control so as to shift to the determination of the global positional relationship in response to the deviation of the local positional relationship exceeding the threshold value.

  A computer program for realizing the above embodiment can be stored in any recording medium readable by a computer. Examples of the recording medium include a semiconductor memory, an optical disk, a magneto-optical disk (CD-ROM / DVD-RAM / DVD-ROM / MO, etc.), a magnetic storage medium (hard disk / floppy (registered trademark) disk / ZIP, etc.), and the like. Can be used.

  It is also possible to transmit / receive this program through a network such as the Internet or a LAN.

DESCRIPTION OF SYMBOLS 1 Skin property evaluation apparatus 11 Compressed gas production | generation part 12 Communication pipe 13 Head part 14 Nozzle 20 OCT unit 21 Light source unit 23 Fiber coupler 26 Optical scanner 29 Reference mirror 29A Reference mirror drive part 31 Detection part 100 Arithmetic control unit 110 Control part 111 Main Control unit 112 Storage unit 113 Display control unit 114 Movement control unit 115 Light projection control unit 120 Tomographic data generation unit 130 Data processing unit 131 Data position specifying unit 132 Evaluation information generation unit 133 Form information generation unit 140 Analysis unit 141 Three-dimensional image generation Unit 142 Corresponding Information Generation Unit 143 Position Information Generation Unit 150 Positional Relationship Determination Unit 200 User Interface 210 Display Device 220 Operation Device 300 Imaging Unit 310 Probe Movement Mechanism 320 Projection Unit S Skin Surface

Claims (14)

A spraying part that blows gas onto the skin surface of the subject;
A tomographic data acquisition unit for acquiring tomographic data of skin in a state where gas is being sprayed by the spraying unit, using optical coherence tomography;
Based on the tomographic data acquired by the tomographic data acquiring unit, an information generating unit that generates evaluation information related to the properties of the subject's skin ;
Two or more imaging units for imaging a subject substantially simultaneously from different directions;
An analysis unit that acquires three-dimensional position information about the subject by analyzing two or more captured images acquired by the two or more imaging units;
Position information for acquiring at least one position information of a gas blowing area by the blowing section and an execution area of optical coherence tomography by the tomographic data acquiring section based on the three-dimensional position information acquired by the analysis section A skin property evaluation apparatus comprising an acquisition unit . The skin property evaluation apparatus according to claim 1, wherein the imaging field by the two or more imaging units includes at least a part of the face of the subject . The analysis unit
A three-dimensional image generation unit that generates a three-dimensional image of the face of the subject based on the two or more captured images;
Correspondence information in which the first coordinate system set in the three-dimensional image generated by the three-dimensional image generation unit and the second coordinate system set in the real space are associated as the three-dimensional position information. A corresponding information generation unit for generating
Skin property-evaluating apparatus according to claim 1 or claim 2, characterized in that it comprises a. A display control unit for displaying the three-dimensional image on a display unit;
When the position in the three-dimensional image displayed on the display unit is designated, the position information acquisition unit corresponds to the coordinate value of the designated position in the first coordinate system based on the correspondence information. The skin property evaluation apparatus according to claim 3, wherein coordinate values in the second coordinate system are acquired . The spray unit includes a nozzle having a gas outlet formed at a tip thereof,
The tomographic data acquisition unit divides light from a light source into measurement light and reference light, irradiates the measurement light on the skin through a measurement arm, and returns the reference light and the measurement light that has passed through the measurement arm. An optical system that detects interference light with the reference light that has passed through the arm;
A probe provided with at least the nozzle and at least the tip of the measurement arm of the spraying part;
A moving mechanism for moving the probe;
A movement control unit that controls the movement mechanism based on the coordinate values acquired by the position information acquisition unit;
The skin property evaluation apparatus according to claim 4, further comprising: A light projecting unit that outputs a luminous flux;
A light projection control unit that controls the light projection unit so that a light beam is projected at a position indicated by the coordinate value acquired by the position information acquisition unit;
The skin property evaluation apparatus according to claim 4 , further comprising: The spray unit includes a nozzle having a gas outlet formed at a tip thereof,
The tomographic data acquisition unit divides light from a light source into measurement light and reference light, irradiates the measurement light on the skin through a measurement arm, and returns the reference light and the measurement light that has passed through the measurement arm. An optical system that detects interference light with the reference light that has passed through the arm;
A probe provided with at least the nozzle and at least the tip of the measurement arm of the spraying part;
A moving mechanism for moving the probe;
A movement control unit for controlling the movement mechanism;
A storage unit in which target position information representing a position of a target region of gas sprayed by the spray unit is stored in advance;
Further comprising
The position information acquisition unit acquires a coordinate value in the second coordinate system corresponding to the position represented in the target position information based on the correspondence information,
The skin property evaluation apparatus according to claim 3 , wherein the movement control unit controls the movement mechanism based on the coordinate values acquired by the position information acquisition unit . A storage unit in which target position information representing the position of the target area of the gas sprayed by the spray unit is stored in advance;
A light projecting unit that outputs a luminous flux;
A light projecting control unit for controlling the light projecting unit;
Further comprising
The position information acquisition unit acquires a coordinate value in the second coordinate system corresponding to the position represented in the target position information based on the correspondence information,
4. The skin property according to claim 3 , wherein the light projection control unit controls the light projection unit so that a light beam is projected at a position indicated by the coordinate value acquired by the position information acquisition unit. Evaluation device. The skin according to claim 7 or 8 , wherein the target position information is a position of the spray target area in a past evaluation for the subject or a default position of the gas spray target area. Property evaluation device. The two or more photographing units perform moving image photographing,
The analysis unit acquires a plurality of the three-dimensional position information along a time series by sequentially analyzing two or more frames acquired substantially simultaneously by the moving image shooting in real time,
The skin property evaluation apparatus according to claim 1 , wherein the position information acquisition unit sequentially acquires a plurality of the position information in time series in real time based on the plurality of three-dimensional position information. . The spray unit includes a nozzle having a gas outlet formed at a tip thereof,
The tomographic data acquisition unit divides light from a light source into measurement light and reference light, irradiates the measurement light on the skin through a measurement arm, and returns the reference light and the measurement light that has passed through the measurement arm. An optical system that detects interference light with the reference light that has passed through the arm;
A probe provided with at least the nozzle and at least the tip of the measurement arm of the spraying part;
A moving mechanism for moving the probe;
A movement control unit for causing the probe to follow the movement of the subject by controlling the movement mechanism in real time based on the three-dimensional position information sequentially acquired by the position information acquisition unit;
The skin property evaluation apparatus according to claim 10, further comprising: When the movement mechanism is controlled by the movement control unit, the positional relationship between the subject and the probe is a predetermined position based on the position information acquired in real time and sequentially by the position information acquisition unit. A first positional relationship determination unit that repeatedly determines whether the relationship is real-time and repetitively;
The tomographic data acquisition unit starts optical coherence tomography when the first positional relationship determination unit determines that the positional relationship between the subject and the probe is a predetermined positional relationship. The skin property evaluation apparatus according to claim 11 . The two or more photographing units are
A first group of photographing units for photographing in a first field;
A second group of imaging units that perform imaging in a second imaging field included in the first imaging field;
Including
The analysis unit acquires first three-dimensional position information related to the subject by analyzing the first group of frames acquired substantially simultaneously by the first group of imaging units, and the second group The second three-dimensional position information is acquired by analyzing the second group of frames acquired substantially simultaneously by the imaging unit, and the first three-dimensional position information and the second three-dimensional position information are acquired. And
The skin property evaluation apparatus according to claim 1 , wherein the position information acquisition unit acquires the position information based on the first three-dimensional position information and the second three-dimensional position information . A spraying part that blows gas onto the skin surface of the subject;
A tomographic data acquisition unit for acquiring tomographic data of skin in a state where gas is being sprayed by the spraying unit, using optical coherence tomography;
An information generating unit that generates evaluation information related to the condition of the skin of the subject based on the tomographic data acquired by the tomographic data acquiring unit;
With
The tomographic data acquisition unit divides light from a light source into measurement light and reference light, irradiates the measurement light on the skin through a measurement arm, and returns the reference light and the measurement light that has passed through the measurement arm. An optical system that detects interference light with the reference light that has passed through the arm;
With the optical path length difference between the measurement arm and the reference arm substantially fixed, the optical system repeatedly performs the detection of the interference light,
Based on the detection result of the interference light acquired repeatedly in real time by the optical system, it is determined in real time and repeatedly whether the positional relationship between the subject and the optical system is a predetermined positional relationship. A second positional relationship determining unit that includes:
The tomographic data acquisition unit starts acquiring the tomographic data when the second positional relationship determination unit determines that the positional relationship between the subject and the optical system is a predetermined positional relationship. Do
An apparatus for evaluating skin properties.

Images