JP2007125151A - Diagnostic system and diagnostic apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a diagnostic system which optimally diagnoses the state of a human body, with respect to the diagnostic system for analyzing an image obtained by imaging the human body and diagnosing the state of the human body. <P>SOLUTION: The diagnostic system is provided with: an irradiation part 5 for irradiating a subject with a light source of specific color light; an imaging part 6 for imaging reflected light of the subject by the light source; an image analysis part 15 which analyzes image data obtained by imaging by the imaging part 6; and a determination part 16 which compares the analyzed image data with a plurality of conditions set in advance to determine the state of the subject. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a diagnostic system and a diagnostic apparatus, and more particularly to a diagnostic system and a diagnostic apparatus that perform medical diagnosis and the like from captured images of each part of a subject.

  Recently, a diagnostic system has been developed in which a subject (subject) is imaged by a sensor, a CCD camera, or the like, and image data obtained thereby is analyzed to perform medical diagnosis, beauty diagnosis, or the like.

For example, the applicant first converts image data of a subject imaged by an imaging device into pixel values, analyzes the pixel values and converts them into uniform color space data, and obtains the obtained uniform color space data in advance. Provides a diagnostic system that compares the acquired normal (healthy) data with the acquired normal (healthy) data and determines that the subject being imaged is in an abnormal (unhealthy) condition if it is separated from the normal data by a certain scale (See Patent Document 1).
Japanese Patent Application No. 2004-366508

  However, Patent Document 1 merely determines whether the subject is in a normal state or an abnormal state, and further improvement is necessary to make a diagnosis suitable for the state of the subject. It was.

  In view of the above-described points, the present invention provides a diagnostic system and a diagnostic apparatus for diagnosing a condition of a subject by analyzing an image obtained by imaging the subject, and a diagnostic system and a diagnostic apparatus capable of making an optimum diagnosis for the condition of the subject The purpose is to provide.

  In order to solve the above problems, a diagnostic system according to the present invention uses an imaging unit that irradiates a subject with a light source of specific color light, an imaging unit that images the subject, and the subject that is irradiated by the irradiation unit. An image analysis unit that analyzes the image data acquired by the imaging, and a determination unit that compares the image data analyzed by the image analysis unit with a plurality of preset conditions to determine the state of the subject. Diagnostic system characterized by that.

  In order to solve the above problems, the diagnostic apparatus of the present invention is connected to an imaging apparatus having an irradiation unit that irradiates a subject with a light source of specific color light and an imaging unit that images the subject irradiated by the irradiation unit. An image analysis unit that analyzes the image data of the subject acquired from the imaging device, and the state of the subject by comparing the image data analyzed by the image analysis unit with a plurality of preset conditions And a determination unit for determining.

  According to the diagnostic system and diagnostic apparatus of the present invention, the state of the human body is determined from a plurality of states based on the image data obtained by imaging the human body. This makes it possible to make a diagnosis that is optimal for the state of the human body. In addition, human lesions and abnormalities appear in narrow band characteristics of the human body's spectral spectrum. Since the subject is illuminated and imaged with specific color light that can emphasize the influence of such bands, lesions and abnormalities are detected from the image data. It becomes easy to do.

  According to the present invention, since the state of the subject can be determined in detail, it is possible to make an optimal diagnosis for the state of the subject.

  Embodiments of the present invention will be described below with reference to the drawings. Note that the technical scope of the present invention is not limited by the terms used in the description of the embodiments for carrying out the present invention or the assertive description.

  As shown in FIG. 1, the diagnostic system 1 of the present embodiment includes an imaging device 2, and a diagnostic device 13 is connected to the imaging device 2 via a network that can communicate with each other. Furthermore, one or more external devices 25 are connected to the diagnostic device 13 via a network that can communicate with each other. Note that the imaging device 2 can also be configured to be able to communicate with the external device 25.

  The network in the present embodiment is not particularly limited as long as it means a communication network capable of data communication. For example, the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), a telephone line network, an ISDN (Integrated Services). A digital network (CNET) network, a CATV (Cable Television) line, an optical communication line, and the like can be included. Moreover, it is good also as a structure which can communicate not only with a wire but by radio | wireless.

  The external device 25 is a personal computer or the like, and is preferably installed in a place where some kind of consulting or diagnosis can be received. For example, when health-related data is obtained by the diagnostic system 1 according to the present embodiment, it may be installed in a public facility such as a hospital or a health care facility. In addition, in the case of beauty data, it may be possible to install it in cosmetic-related stores, facilities, or hospitals. Further, the external device 25 may be configured as an Internet site from which consulting information can be obtained, or as a mobile terminal such as a consultant, a doctor, or a store clerk.

  As shown in FIG. 2, the imaging device 2 provided in the diagnostic system 1 of the present embodiment is provided with the following components.

  The external communication unit 3 is configured to perform information communication with the diagnostic device 13 and the external device 25 by wired or wireless communication means. The result of image analysis, image data, vital data, and the like are transmitted to the diagnostic device 13 via the external communication unit 3.

  The image display unit 4 includes a display such as a CRT, a liquid crystal, an organic EL, a plasma, or a projection system. In addition to the captured image, information given from the external device 25, information obtained by image processing, or information of the imaging device 2 is displayed. Information about the state of each component is displayed. In addition, it is also possible to display a warning when abnormal data is detected from the photographed image, or to notify the detection of abnormal data by voice using voice means.

  The irradiation part 5 is provided in the peripheral edge part of the image display part 4, as shown in FIG. With such a configuration, illumination light can be given to the subject from various directions, and an image with relatively little illumination unevenness can be obtained. Further, the irradiation unit 5 may be arranged only at the upper part of the peripheral edge of the image display unit 4 or only at the left and right parts. Note that the irradiation unit 5 can also be arranged at a location that is not close to the image display unit 4.

  FIG. 4 is an enlarged view of a dotted line portion of the irradiation unit 5 shown in FIG. As shown in FIG. 4, rectangular light sources that emit different colored lights are arranged in the irradiation unit 5 of the present embodiment. Then, a combination of light sources in a predetermined area as shown by the one-dot chain line portion is used as one color light set, and this color light set is arranged at the peripheral edge of the image display portion 2 as shown in FIG. With such a configuration, the subject can be irradiated with each color light from the light source evenly. It is also possible to use a circular light source or a rod-shaped light source instead of a rectangular light source.

  As a light source included in the irradiation unit 5, an artificial light source such as a fluorescent lamp, an incandescent light bulb, an LED, a laser, and an organic EL can be used. In order to suppress the influence of ambient light on a captured image, It is desirable to use a light source such as a strong strobe light or a high brightness LED. Further, it is desirable that the light source has a light emission characteristic not only in the visible light region but also in the vicinity thereof (ultraviolet region, near infrared region, infrared region). In order to suppress the influence of ambient light as much as possible, it is desirable to use a light source that can emit high-brightness light such as a strobe. However, when capturing moving images of subjects, characteristics such as intensity and spectrum are stable for a long time. It is desirable that the light source be capable of irradiating light. In addition, when a line / surface light source is used instead of a point light source, it is possible to obtain light with a spatially reduced intensity distribution for the subject, and thus a desired image can be obtained with less uneven illumination on the subject.

  As the light source of this embodiment, two types (color light A and color light B) of LEDs having light emission characteristics as shown in FIG. 6 are used, and FIG. 7 shows the characteristics of the LEDs. Examples of LEDs having such characteristics include TLPGE1100B (peak wavelength 562 nm, half-value width 11 nm) of Toshiba Corporation as colored light A, and TLSH series (peak wavelength 623 nm, half-value width 13 nm) as colored light B. It is also possible to use LEDs from various companies. A white light source can also be used as a light source together with an interference filter. One or more interference filters are arranged in front of the white light source and the characteristics of the illumination light are narrowed to obtain a light source of any wavelength. Can be obtained. As the interference filter, commercially available filters such as Omega Optical's bandpass filter can be used.

  The irradiating unit 5 functions to illuminate the subject when capturing an image of the face region, and also changes the intensity and wavelength of illumination abruptly when imaging the movement of the pupil of the subject, before and after the irradiation. It is also possible to perform a function that makes it possible to determine whether the pupil is normal or abnormal by measuring the movement of the pupil.

  FIG. 8 and FIG. 9 show the spectral reflectance when the specific part (a) and another specific part (b) of the subject are in a healthy (normal) state and an unhealthy (abnormal) state. In general, when the subject has an abnormality, the body tissue and configuration change, so the spectral reflectance on the subject surface is different from the normal state.

  In the example of the specific part (a) shown in FIG. 8, there is a large difference in spectral reflectance between the normal state and the abnormal state on the low wavelength side (overlapping the band of the colored light A), and the example of the specific part (b) shown in FIG. Then, the difference in spectral reflectance is large in the middle to high range (overlapping with the band of the colored light B). Thus, it is subject dependent in which wavelength region the spectral reflectance differs.

  When the subject's specific part (a) is irradiated with the colored light A and the colored light B, the reflected light spectrum of the subject is the product of the colored light A or the colored light B and the spectral reflectance of the subject as shown in FIG. ing. Similarly, when the color light A and the color light B are irradiated to the other specific part (b) of the subject, the spectrum of the reflected light of the subject is the color light A or the color light B and the spectral reflectance of the subject as shown in FIG. It is a product.

  Returning to FIG. 2, the imaging unit 6 includes one or a plurality of cameras that can acquire a still image or a moving image by an imaging element such as a CCD or a CMOS. Further, for example, it may be configured by a camera module attached to a digital camera, video camera, or other mobile phone. It should be noted that it is desirable to capture the subject's image with a stable composition regardless of the subject's standing position and height. Therefore, in the present embodiment, as shown in FIG. 12, a plurality of imaging units 6 are arranged at equal intervals, the subject is imaged, and a plurality of captured images are combined to output an image with a composition that may be synthesized. Is preferred. Further, as shown in FIG. 13, a mechanism capable of three-dimensionally adjusting the position of one imaging unit 6 may be provided so that the subject's head and face can be imaged. Further, as shown in FIG. 14, the imaging unit 6 may be configured by a combination of a large number of camera modules, and the subject may be collectively captured so that an image having a predetermined composition can be cut out.

  Furthermore, when it is desirable to obtain an image whose composition changes in conjunction with the movement of the subject, rather than an image whose composition is fixed as described above, for example, when the subject is up when the subject approaches the display screen, What is necessary is just to comprise so that the image imaged with one or more cameras may be synthesize | combined and the origin of a display coordinate is fixed and it may display as it is.

  Further, the imaging unit 6 of the present embodiment has three image channel numbers, but may be a multichannel (multiband) having three or more image channels.

  The imaging unit 6 captures reflected light from the surface of the subject and converts it into pixel values of each channel corresponding to R, G, and B signals of the RGB image. As described above, the spectral reflectance in the normal state and the abnormal state in the specific part (a) of the subject is as shown in FIG. 10, and the reflected light caused by the color light A or the color light B is imaged by the imaging unit 6. When the reflected light is separated by channel 1 and channel 2, the pixel value of each channel can be obtained as shown in FIG. Similarly, the spectral reflectance in the other specific part (b) of the subject is as shown in FIG. 11, but when the reflected light caused by the colored light A or the colored light B is separated, a pixel value is obtained as shown in FIG. be able to.

  Here, the separation of the reflected light caused by the colored light A or the colored light B is performed by the difference in the band of each channel. For example, the color light A is included in the channel 1 band of RGB, and the color light B is included in the channel 2 band. Further, it is also possible to separate the images by imaging the color light A and the color light B at different timings.

  In this way, by separating the reflected light caused by the colored light A or the colored light B, the captured image of the specific part (a) of the subject is in channel 1 and the captured image of the specific part (b) is normal in channel 2. In addition, separation of pixel values in an abnormal state is facilitated.

  Returning to FIG. 2, the surrounding environment information acquisition unit 7 includes a measuring instrument as an environment information acquisition unit, acquires information on the surrounding environment where the imaging device 2 is installed, and assists in determining abnormal data when analyzing the captured image. Can be done. Here, the surrounding environment refers to the intensity and characteristics of ambient illumination light, temperature such as air temperature and water temperature, humidity, and atmospheric pressure. Moreover, although there exist (a) illumination meter type (b) spectrum meter type (c) color temperature measurement type etc. as an acquisition method of environmental illumination light, the type of (b) which can include all is desirable. As for other temperatures, humidity, and atmospheric pressure, measuring instruments and sensors for measuring each of them may be used, and information may be obtained from the external device 25 through a network.

  The I / O unit 8 includes a vital sensor (such as a thermometer, a weight meter, a body fat percentage meter, a blood pressure meter, an electrocardiograph, a skin age meter, a bone densitometer, a spirometer) as a vital information acquisition means, a CF card In addition, devices that handle portable devices such as SD cards and USB memory cards can be connected, and measurement data and image data are input and output from these devices. Note that the vital sensor can be configured as a part of the imaging apparatus 2.

  In addition, a vital sensor connected to the I / O unit 8 can be used as a stimulus applying unit to capture temporal changes before and after the stimulus is applied to the subject, and to distinguish the normal state and the abnormal state of the subject from the image. Here, the stimulus refers to giving light, pushing, applying pressure, changing temperature, adding scent, applying sound, stabting with a needle, painting an object, injecting an object, and the like. For example, by compressing a part of the skin with a pressure sensor or the like and measuring the state before and after the compression, the normal state and the abnormal state can be distinguished using the amount of change of each measured value as feature data. In addition, by warming the skin with water, hot water, or far-infrared rays, and observing the state before and after that, the change in blood flow is measured, and it is judged whether the change is different from normal. You can also

  The memory unit 9 includes a RAM, a ROM, and the like, and can temporarily operate the imaging device 2 at high speed by temporarily storing data necessary for processing in each component of the imaging device 2. In addition, in order to identify an individual through personal authentication described later, authentication information such as an individual face area image, a measured value of the three-dimensional shape of the face, and other characteristic information (information such as the use of glasses, moles, and spots) In addition, basic information (name, height, weight, age, etc.) is stored corresponding to the authentication information.

  The data processing unit 10 performs data processing such as an image of each part of the subject imaged by the imaging unit 6, peripheral environment information acquired by the peripheral environment information acquisition unit 7, measurement data and image data input from the I / O unit 8. I do.

  That is, the data processing unit 10 extracts a region of interest to be diagnosed from the captured image. For example, if the region of interest is the face of the subject, the subject's standard face image registered in advance in the memory unit 9 is used as the basic image of the template, and the template is subjected to a raster operation from the upper left of the screen, and the template and image A portion having the highest correlation is set as a face region. In addition, when further specifying a region from the region of interest, a means for the subject to specify by enclosing the face frame with a rectangular pointer or the like, and when the subject specifies a point, a rectangle of a predetermined size centered on the specified position is displayed. It is also possible to provide a designation means. When the region of interest is extracted, the data processing unit 10 transmits an image of the region of interest to the diagnostic device 13 via the external communication unit 3.

  Further, in order to display an image with stable color reproduction for the purpose of viewing even if the environmental light characteristics change, the data processing unit 10 acquires the environmental light characteristics by the surrounding environment information acquisition unit 7 and converts the color data into the color data. The display white color point and brightness are adjusted accordingly. That is, these characteristics are corrected (calibrated) in order to display an image with stable color reproduction regardless of the characteristics of ambient ambient light and light sources. Normally, in calibration, a test pattern is imaged and corrected so that the imaged data has a separately designated setting value. However, it is desirable that the same processing can be performed without using a test pattern that is relatively expensive and difficult to store. Therefore, it is possible to use the subject's teeth and background data at the time of image capturing, which seem to hardly change over time. At that time, if a plurality of subjects are registered in the same device, it is necessary to register tooth data for each subject.

  Further, when the subject is imaged with the same composition in the imaging unit 6, the data processing unit 10 determines the brightness and size of the subject on the screen depending on how the illumination is applied when the subject moves in the optical axis direction of the camera. In order not to change, the function which corrects it is provided. In this case, the distance between the imaging device 2 and the subject is estimated from the image captured by the imaging unit 6. As a measurement method, a general method such as a three-dimensional survey method or a stereo measurement method can be used. Further, laser photometry equipment often used in a camera may be attached to the image pickup apparatus 2 for measurement. In addition, it is possible to estimate the three-dimensional shape of the subject by performing distance estimation based on the captured image at each pixel. If the distance between the subject and the camera in each pixel is known, the distance between the light source and the subject can be obtained for each pixel, so that the brightness of the display image can be corrected more accurately and in detail.

  In addition, the data processing unit 10 is configured to identify an individual from a captured image for personal authentication of the subject. In other words, the image captured by the image capturing unit 6 is analyzed and the personal data registered in the memory unit 9 is automatically verified to identify the individual. This specification is performed, for example, by comparing the correlation between the extracted template image and the basic template image tailored to the individual after extracting the facial part.

  The user interface unit 11 includes a keyboard, a mouse, a trackball, and the like, and allows the subject to input an instruction, and can transmit the status and request of the imaging device 2 to the subject. In addition, since it is desirable to set it as an apparatus structure with little test subject's burden, the user interface part 11 can also be comprised as a touch panel integrally with the image display part 4. FIG. In addition, it is desirable to have a configuration that can communicate with the voice of the subject by providing acoustic equipment such as a speaker and a microphone.

  In addition, it is desirable that the instruction can be input by an action that expresses the subject's intention such as gestures (including advanced communication means such as gestures, hand gestures, and sign language). Specifically, the subject's motion is photographed by the imaging unit 6, the edge of the photographed image is extracted by the data processing unit 10, the part of the subject is identified, and the transition of the feature points included in the part is analyzed. Input as intended by the subject. For example, when the photographed image is the face image of the subject, the chin, the head of the nose, and the forehead included in the face image are feature points, and it is analyzed that these feature points vibrate in the vertical direction. Since the subject shakes his / her head vertically, it is determined to mean “yes”. In addition, if the captured image is an image of the subject's hand, the index finger of the hand is used as a feature point, and if the feature point is measured to vibrate in the estimated direction, the finger is shaken to the side. ".

  In this way, it is possible to input instructions by gestures and other actions that express the subject's intentions, so that the subject can easily perform the desired process even if the subject is a poor person or a person with poor eyes. Can be made.

  The gesture analysis table shown in FIG. 23 is stored in the memory unit 9 in advance, and is configured so that the subject can modify and add as needed using the mouse and keyboard of the user interface unit 11. In addition, the meaning of the gesture may vary depending on the subject's nationality, economic sphere, cultural sphere, family register, age, gender, and other attributes. For example, the action of swinging the head vertically may mean “yes” or “no” depending on the country. In addition, the operation of issuing an OK sign by hand may mean “yes”, or may mean “money” or “number 0”. Therefore, when using such gestures having different meanings depending on the subject's attributes, it is desirable to record the attributes in advance in the memory unit 9 corresponding to the basic information of the subject.

  In addition, the captured image for analyzing the gesture is not necessarily a moving image, and may be a still image. For example, as shown in FIG. 24, a plurality of items are displayed on the image display unit 4, and one of the plurality of items can be selected by analyzing the number of fingers that the subject stands. it can. Alternatively, the direction indicated by the subject's finger, such as up, down, left, and right, may be analyzed, and one of a plurality of items may be selected by moving the cursor in accordance with this direction. Moreover, when imaging | photography the operation | movement showing a test subject's intention by the imaging | photography part 6, the kind of colored light by the irradiation part 5 is not specifically limited.

  In the user interface unit 11, for example, when the subject's imaging is a tongue when the subject is interested in imaging, the user is instructed by voice or characters to put out the tongue, and the tongue comes out from the movement of the mouth. Can be estimated and the image pickup unit 6 can pick up an image.

  In addition, when the data processing unit 10 extracts a region of interest to be diagnosed from the captured image and further specifies a region from the region of interest, the subject surrounds the face frame with a rectangular pointer or the like in the interface unit 11. Means for designating, a designating means for displaying a rectangle of a predetermined size around the designated position when the subject designates a point, and the like can be provided.

  In addition, the user interface unit 11 is provided with data acquisition means for the purpose of assisting in the determination of abnormal data when analyzing a captured image. For example, it is possible to construct a system in which an inquiry can be made for each imaging in the user interface unit 11. Specifically, it is possible to simply press a button for distinguishing between health and malfunction. The data contents to be acquired include self-judgment of the current physical condition (heavy, fever, cold, etc.) and personal data related to the condition (sleeping time, drinking, smoking, medication information, etc.) Is included. It may be acquired interactively by voice, or may be acquired by displaying an inquiry form on the image display unit 4 and input from the user interface unit 11 such as a touch panel. In addition, when acquiring by voice, the tone of the voice is often related to the physical condition at that time, so the analysis result may be added to the inquiry data by analyzing the frequency and tone of the voice.

  The user interface unit 11 is provided with personal authentication means. That is, when a plurality of subjects use the diagnostic system 1, it is necessary to specify an individual who is currently using it. Therefore, based on the individual identification result obtained by collation with the personal face image captured at the time of initial registration in the data processing unit 10, it is possible to confirm to the person whether the identification result is correct.

  Further, the user interface unit 11 is provided with means for prompting the subject to use the diagnostic system 1 by outputting sound at regular intervals. The means for prompting the subject to use may be a display on the image display unit 4. That is, in the diagnostic system 1 of the present embodiment, since it is necessary to check and update the normal state data of the subject at regular intervals, by urging the subject to use a vital sensor at regular intervals, for example, every month It is possible to update normal data. Further, depending on the purpose of diagnosis, it may be necessary to use the diagnostic system 1 on a daily or regular basis. Therefore, when a situation in which the diagnostic system 1 is not used due to the absence of a subject or the like, or when imaging by the imaging unit 2 is not performed regularly, the user interface unit 11 displays an alert or generates a sound by externally outputting the alert. Is configured to report to.

  The control unit 12 includes a CPU and a RAM, and drives and controls each component of the imaging device 2. Since the imaging apparatus 2 of the present embodiment also handles moving images, it is desirable that the control unit 12 be configured with a chip that can operate and control as fast as possible. Further, the control unit 12 sets On / Off of each light source in the irradiation unit 5 based on an instruction signal transmitted from the diagnostic device 13 via the external communication unit 3 or an instruction signal input from the user interface unit 11. It is designed to be controlled independently. In addition to performing control based on the instruction signal, the subject can be estimated by other known methods.

  Next, as shown in FIG. 2, the diagnostic device 13 provided in the diagnostic system 1 of the present embodiment is provided with the following components.

  The external communication unit 14 is configured to perform information communication with the imaging device 2 and the external device 25 by wired or wireless communication means. Similar to the external communication unit 3, the result of image analysis, image data, vital data, and the like are transmitted to the diagnostic device 13 or the external device 25 via the external communication unit 3.

  The image analysis unit 15 performs image analysis based on image data transmitted from the imaging device 2 to the diagnosis device 13 via the external communication unit 3 and the external communication unit 14.

  Here, in the present embodiment, as described above, attention is paid to the fact that a lesion or abnormality of an object such as human skin appears in the characteristics of a narrow band of the subject's spectral spectrum, and illumination that can emphasize the influence of such a band. By irradiating and imaging, lesions and abnormalities are easily detected from the image. That is, when the reflected light on the subject surface is imaged by the imaging unit 6 of the imaging device 2 and converted into pixel values for each channel, the specific part (a) of the subject is in a normal state in the channel 1 as shown in FIG. Separation of pixel values in an abnormal state is facilitated, and as shown in FIG. 16, separation of normal and abnormal pixel values in channel 2 is facilitated for another specific part (b) of the subject. Yes.

  The image analysis unit 15 calculates tristimulus value data (RGB) from the pixel values of each channel converted by the imaging unit 6, calculates reaction color data by primary conversion from the tristimulus value data, and the reaction color Data is converted into uniform color space data (color data). Examples of the uniform color space include CIE L * a * b *, L * u * v *, u′v ′ in which the lightness direction is standardized, and their derived spaces are also included. Thereafter, the image analysis unit 15 separates the normal state and abnormal state image data for each specific part of the subject based on the uniform color space data of the region of interest.

  The determination unit 16 makes a diagnosis such as a medical diagnosis based on the analysis result of the image analysis unit 15. That is, the uniform color space data converted by the image analysis unit 15 represents the color data and other feature quantities in the normal state / abnormal state as two-dimensional or more (two-dimensional in this embodiment) coordinates as shown in FIG. The coordinates obtained as a result of analyzing the image are compared with the coordinates in the normal state, and it is determined whether the subject being imaged is in a normal state or an abnormal state.

  That is, normal state data is obtained using measurement values measured in advance from image data determined to be “normal”, and a region including all of the normal state data is set as a “normal region”. Also, the area away from this normal area to a certain scale is called “attention area”, the area away from this attention area to a certain scale is “warning area”, and the complement of these areas is called “dangerous area”. Set. And the judgment part 16 judges a test subject's state by detecting to which area | region these coordinates obtained as a result of analyzing a test subject's image belong.

  In this way, on the two-dimensional coordinates representing the color data, the area determined to be abnormal is divided into a plurality of areas of “caution area”, “warning area”, and “danger area”, and each area is set. Each condition is compared with the results obtained by analyzing the subject's image data, and the subject's health status is judged in four stages: normal, caution, warning, and danger. It becomes possible to judge.

  Note that the “normal area” may be set so that, for example, an average value of normal state data is a central point, and the area is separated from the central point to a certain scale. Furthermore, a fixed scale in each region may be automatically set in consideration of variations in normal state data, or an average value of normal state data is displayed on the display unit 19 so that the subject can display the user interface unit. 18 may be set arbitrarily. In addition, “attention area”, “warning area”, and “dangerous area” may be set from data determined to be “abnormal” in the past, and the complement of these areas may be set as “normal area”. .

  Here, FIG. 17 shows the coordinates of the color data in the specific part (a) or another specific part (b). Further, “feature amount 1” in FIG. 17 is a value such as CIE a *, u *, or u ′, and “feature amount 2” is a value such as CIE b *, v *, or v ′. . Note that other color data or measurement values other than the color data (such as a three-dimensional shape or texture) may be used. Instead of separately irradiating the color light A and the color light B and then separating them, the image analysis may be performed after the color light A and the color light B are separately irradiated to capture an image.

  As a judgment of normal state and abnormal state, for example, it is known that irradiation with a narrow band of color light centering around 620 nm emphasizes the involvement of hemoglobin in the blood image, and blood flow is interrupted. It seems to be effective for detecting such abnormalities. In this case, by using the color light B of FIG. 6, the accuracy of discrimination between the normal state and the abnormal state by image analysis is improved.

  There is also a report that capillary blood vessels can be emphasized by irradiating narrow band colored light centered around 550 nm. It seems to be effective in detecting abnormalities in the part where capillaries such as fingertips gather. In this case, it can be said that the use of the color light A in FIG. 6 improves the accuracy of discrimination between a normal state and an abnormal state by image analysis.

  In addition, the subject's color data, three-dimensional shape, and texture are measured (estimated) by analyzing the subject's captured images taken in time series by the imaging unit 6, that is, continuously capturing still images or moving images. In addition, the amount of hemoglobin, the amount of melanin, the degree of oxygen saturation, etc. related to the tissue structure under the skin can be estimated from the estimated data. Further, data such as the number of blinks, the color of the eyes (particularly white eyes), the state of the eyes and the like may be acquired from the eye image.

  In addition, when sending image data to a consultant or the like through the external communication unit 14, the image analysis unit 15 changes a portion of data that can be transmitted according to the subject's permission. For example, when the subject desires to remove or change the image around the eyes and mouth to transmit the individual in order to avoid personal identification, the corresponding part in the image is automatically extracted, and the part is changed to an arbitrary color. Change or add mosaic or blur.

  In addition, in order to safely conceal personal information, transmitted data and data in the diagnostic device 13 are encrypted by changing the encryption key for each individual. As a method for producing the key, known methods can be used, but biometrics that enable key setting for each individual are desirable. In this case, the positional relationship of the constituent elements in the face such as the eyes, nose and mouth of the individual, the height of the nose, the three-dimensional shape such as the shape of the entire face, iris information, etc. are used as the encryption key.

  The above-described analysis of the captured image for personal authentication of the subject in the data processing unit 10 of the imaging device 2 is performed in the image analysis unit 15 of the diagnostic device 13, and the identification result is transmitted from the external communication unit 14 to the imaging device 2. You may make it transmit.

  The I / O unit 17 is configured to connect a portable device such as a CF card, an SD card, or a USB memory card. A measurement device such as a vital sensor may be connected to the I / O unit 17 for use.

  The user interface unit 18 is configured to allow the subject to input an instruction and to transmit the apparatus status and request to the subject. As with the user interface unit 11 of the imaging device 2, a configuration that does not place a burden on the subject is desirable, but since complicated processing by the device administrator such as maintenance and backup may be required, use only a keyboard and a mouse. You can also. However, the user interface unit 18 is not an essential component in the diagnostic device 13, and the user interface unit 11 of the imaging device 2 may also function as the user interface unit 18 of the diagnostic device 13. In this case, data input / output through the user interface unit 11 of the imaging device 2 is transferred to the diagnostic device 13 via the external communication unit 3 and the external communication unit 14.

  The display unit 19 includes a display such as a liquid crystal display, and displays the operation status of the diagnostic device 13, an instruction input by the user interface unit 18, and the like. Also, a warning when abnormal data is detected from the captured image is displayed. The warning when abnormal data is detected can be configured to be notified by voice means. However, the display unit 19 is not an essential component in the diagnostic device 13, and the image display unit 4 of the imaging device 2 can also be used. In this case, the displayed content is transferred to the image input / output device via the external communication unit 14 and the external communication unit 3.

  The storage unit 20 includes a memory such as a buffer, and includes a data holding unit 21, a work area unit 22, and a system information holding unit 23.

  The data holding unit 21 holds various types of data such as an image of a region of interest to be diagnosed transmitted from the imaging device 2, device status, consulting / diagnosis data input from the external device 25, and the like. . Further, the data holding unit 21 holds a diagnostic table indicating the biological information and surrounding environment information of the subject as shown in FIG. 21, and a reservation table as shown in FIG. That is, the diagnosis table includes the surrounding environment data acquired from the surrounding environment information acquisition unit 7, the data acquired from the vital sensor connected to the I / O unit 8, and the diagnosis result indicating the state of the subject analyzed by the image analysis unit 15. It consists of the presence / absence of a diagnosis reservation at a hospital or a doctor's office, etc., and by sending this diagnosis table to the external device 25, the doctor can judge the medical condition of the subject to some extent. The reservation table includes items for the subject to fill in information necessary for making a diagnosis reservation at a hospital or clinic, and the reservation table is transmitted to an external device 25 installed in a hospital or a cosmetic store. By doing so, a diagnosis reservation is made.

  The work area unit 22 temporarily holds various data used for data processing in order to perform data processing in the diagnostic device 13 at high speed.

  The system information holding unit 23 holds system information of the imaging device 2 and the diagnostic device 13. This system information holding unit 23 registers and registers the management number of the LED or filter as the light source included in the irradiation unit 5 of the imaging device 2, the effective subject, and the feature quantity that can be extracted as a table as shown in FIG. I manage. The control unit 12 of the imaging device 2 can control the On / Off of each light source included in the irradiation unit 5 independently by this table to give color light suitable for the subject.

  Further, the system information holding unit 23 manages the spectral characteristics, color data, and temporal characteristics of the light source and the filter included in the irradiation unit 5 of the imaging device 2, and the image analysis unit 15 is necessary for image analysis. You can refer to these data.

  Further, the system information holding unit 23 creates “normal state data” that serves as a reference for diagnosis by image analysis in the image analysis unit 15 by using the measurement values measured from the image data determined to be “normal”. It comes to hold. The normal state data is updated after confirming the normal state of the subject at regular intervals in order to increase the reliability of the data. That is, in the image display unit 4 or the user interface unit 18, normal state data is updated by encouraging the subject to use a vital sensor or the like every month, for example. It can also be updated daily based on data from the last month. Thereby, it can respond also to the change of the physical condition by a season or aging. Moreover, you may create with reference to predetermined days, such as 30 days, except the day containing abnormal data.

  In addition, when the diagnostic system 1 is introduced or just after a new subject is registered, there is little information about the skin color and other characteristics of the individual subject, and normal state or abnormal state data cannot be constructed. . Therefore, average data of ordinary people is registered in advance in the system information holding unit 23, and temporary measurement values are obtained using the average data for a predetermined period from the first time. Moreover, a temporary measured value can also be obtained using the average data of the subject who uses the diagnostic system 1. Then, after a predetermined period has elapsed, the measurement value is updated with respect to the image data up to that time by switching to the actual data of the subject. The “predetermined period” is registered in advance in the system information holding unit 23.

  Further, the system information holding unit 23 holds the characteristics of each component of the imaging device 2 or the diagnostic device 13. That is, the characteristics of the irradiating unit 5, the image display unit 4, the imaging unit 6 and the like of the imaging device 2 vary with time and usually deteriorate with time. Therefore, the timing for correcting (adjusting) the change over time is set in the system information holding unit 23, and the time information and the like are read from the tag information, thereby measuring and correcting the characteristics of the imaging device 2 or the diagnostic device according to the specified timing. It is supposed to be. This makes it possible to obtain image measurement values that are stable over time.

  In addition to calibration that is performed periodically, when the surrounding situation changes, the subject instructs the calibration timing or automatically detects the change in the surrounding situation from the image and performs calibration. It has become. Here, “the surrounding situation has changed” means, for example, that the surrounding environment lighting has changed significantly (e.g., the fluorescent length has been changed, a new window has been installed nearby), or the surrounding has changed (the background of the image Change the room, change the position of the device, etc.). As for the difference in the peripheral situation, it is possible to compare the past data stored in the system information holding unit 21 with the current data and determine whether or not to perform calibration according to the degree of the difference.

  The data management unit 24 manages each person's image data held in the data holding unit 21 of the storage unit 20 by attaching a tag (accompanying information). The tagging method may be attached to the header or footer of each data, or may be collected in a separate file in association with each data name.

  Here, the contents of the tag include the image shooting date and time, the name and attribute of the subject, information on the imaging device 2 and the diagnostic device 13, information on the surrounding environment, the captured image, the I / O unit 8 or the I / O unit 17. Measured data values acquired from connected vital sensors, diagnostic information when subjectively diagnosing a captured image, contents of inquiry data acquired separately, and the like are included. In particular, a tag that can grasp time information such as photographing date and time for tracking image data in time series, and other data contexts is essential.

  Further, information necessary for the imaging device 2 and the diagnostic device 13 is information on the irradiation unit 5 related to estimation of measurement data from the image, characteristics of the imaging unit 6, characteristics of the imaging device 2, and data in the data processing unit 10. Information on the processing method. Since these pieces of hardware and software information are generally managed by version, each version number is displayed on the tag. Is described.

  In addition, as a place where the imaging device 2 or the diagnostic device 13 provided in the diagnostic system 1 of the present embodiment is installed, a place near a water area such as a washroom or a bathroom can be considered. Therefore, it is desirable to take waterproof measures such as anti-fogging processing and coating so as not to be fogged with moisture. It is also desirable to take measures against dirt and dust such as an antifouling seal, considering installation in a place where dust tends to accumulate.

  Next, the operation of the above-described diagnostic system 1 will be described with reference to the flowcharts of FIGS. In this flow, it is assumed that the health condition of the subject is diagnosed, and the external device 25 is installed under a doctor in the hospital. The conditions of “normal area”, “caution area”, “warning area”, and “dangerous area” are set in advance by the method described above and stored in the system information holding unit 23.

  When the subject starts using the diagnostic system 1, first, the imaging unit 6 images the subject.

  The data processing unit 10 is an image of a subject imaged by the imaging unit 6, ambient environment information acquired by the ambient environment information acquisition unit 7, measurement data and image data input from the I / O unit 8, or input from the user interface unit 11. The input information such as the instruction input data of the subject is analyzed, the image is displayed on the image display unit 4, and the light source of the irradiation unit 5 is adjusted. Further, the data processing unit 10 analyzes the correlation between the test subject image captured by the imaging unit 6 and the personal authentication information registered in the memory unit 9, and among the plurality of registrants registered in the memory unit 9. One candidate is automatically extracted from (step 1, hereinafter, step is also referred to as S). Next, the extracted candidate name is displayed on the image display unit 4 such as “Are you Mr. XXX?” And asks whether the subject is the extracted candidate ( S2).

  Subject answers this question by making a gesture. In this embodiment, since an individual is identified by personal authentication, the attribute of the individual is determined. Therefore, if a gesture whose meaning differs depending on the attribute is used at this stage, the meaning of the gesture may not be determined. Arise. Therefore, when such a gesture is used, a general gesture is initially registered in the memory unit 9, and the initially registered gesture is displayed on the image display unit 14 when the subject answers with the gesture. The subject may be instructed to make a gesture according to this display. Also, without using gestures that have different meanings depending on the attributes, for example, as shown in FIG. 24, all items that can be answered by the subject are displayed on the image display unit 4, and the number of fingers raised by the subject is determined. To select an item.

  The imaging unit 6 acquires a gesture made by the subject as image data (S3). Then, as described above, the data processing unit 10 extracts the edge of the acquired image data, identifies the part of the subject, and analyzes the transition of the feature points included in the part (S4). As a result of the analysis, if the content of the subject's gesture is “No” (NO in S5), the subject is not a candidate displayed on the image display unit 4, so the process returns to S1 and the data processing unit 10 The candidate who is considered to be the next closest to the subject is extracted, and the same processing as above is repeated.

  On the other hand, if the content of the subject gesture in the step 5 is “Yes” (YES in S5), the personal authentication of the subject is completed. Then, basic information such as the height, weight, and age of the subject specified by the personal authentication is acquired from the memory unit 9 (S6). In this step, information on the surrounding environment is acquired from the surrounding environment information acquisition unit 7 or physiological information indicating the body temperature, blood pressure, pulse, etc. of the subject is acquired from a vital sensor connected to the I / O unit 8. Anyway.

  Next, the imaging unit 6 captures an image of a part to be diagnosed among the subjects (S7). At this time, the irradiation unit 5 performs imaging by irradiating a plurality of light sources. That is, an LED is used as a light source or a white light source is used together with an interference filter. In the irradiation unit 5 of this embodiment, two types of light sources (color light A and color light B) among the light sources having the characteristics shown in FIG. ). Thus, in the example of the specific part (a) shown in FIG. 8, there is a large difference between the normal state and the abnormal state on the low wavelength side (overlapping the band of the colored light A), and in the example of the specific part (b) shown in FIG. The difference between the middle range and the high range (which overlaps the band of the colored light B) becomes large. Then, when the color light A and the color light B are applied to the specific part (a) of the subject, the spectrum of the reflected light of the subject is the product of the color light A or the color light B and the spectral reflectance of the subject as shown in FIG. Similarly, when the color light A and the color light B are irradiated to another specific part (b) of the subject, the spectrum of the reflected light of the subject is the product of the color light A or the color light B and the spectral reflectance of the subject as shown in FIG. It becomes.

  And the imaging part 6 images the reflected light of a test subject surface, and converts it into a pixel value. At that time, the reflected light caused by each color light is separated by the channel, so that the pixel values in the normal state and the abnormal state can be easily separated for each specific part of the subject. Further, the data processing unit 10 extracts a region of interest from the captured image (S8).

  The captured image of the region of interest is transmitted from the imaging device 2 to the diagnostic device 13 via the external communication unit 3 and the external communication unit 14. The captured image of the region of interest transmitted to the diagnostic device 13 is held by the data holding unit 21 of the storage unit 20 (S9). The data management unit 22 manages each individual image data held in the data holding unit 21 with a tag (accompanying information).

  Then, the image analysis unit 15 calculates tristimulus value data (RGB) from the pixel values of the region of interest held by the data holding unit 21, calculates reaction color data by primary conversion from the tristimulus value data, and this reaction The color data is converted into uniform color space data (S10). Thereafter, the image analysis unit 15 separates normal and abnormal image data for each specific part of the subject based on the uniform color space data (S11).

  Next, proceeding to FIG. 20, the uniform color space data represents the color data of the normal state / abnormal state and other feature quantities as coordinates of two or more dimensions (two dimensions in this embodiment) as shown in FIG. The unit 16 compares the normal and abnormal coordinates (S12). That is, it is determined whether or not the obtained coordinates belong to the normal area obtained from the normal state data. In this step, the subject's color data, three-dimensional shape, and texture are obtained by analyzing the subject's captured images taken in time series (continuous still images, moving images) by the imaging unit 6. It is possible to measure (estimate) and estimate the amount of hemoglobin, the amount of melanin, the degree of oxygen saturation, etc. related to the tissue structure under the skin from the estimated data. Further, data such as the number of blinks, the color of the eyes (particularly white eyes), the state of the eyes and the like may be acquired from the eye image.

  When the determination unit 16 determines that it belongs to the normal region (YES in S12), the fact that the subject's health condition is normal is displayed on the image display unit 4 or the display unit 19 and recorded in the data holding unit 21 (S13). ), And the diagnosis process is terminated. On the other hand, if the determination unit 16 diagnoses that it does not belong to the normal area (NO in S12), it determines whether or not it belongs to the attention area (S14).

  If the determination unit 16 determines that it belongs to the attention area (YES in S14), a diagnosis result indicating that the subject's health condition is the attention state is acquired (S17). Then, the user interface unit 11 outputs a sound such as “Is my physical condition good?” Or the image display unit 4 displays characters (S18), and asks the subject whether the physical condition of the subject is good. The subject answers this question by making a gesture. The imaging unit 6 acquires a gesture performed by the subject as image data (S19). Then, the data processing unit 10 extracts the edge of the acquired image data to identify the part of the subject, and the subject performed based on the transition of the feature points included in the part and the gesture analysis table as shown in FIG. The gesture is analyzed (S20). As a result of the analysis, if the content that the gesture means is “Yes” (YES in S21), the image display unit 4 or the display unit 19 displays that the subject's health is in a caution state, and the data holding unit 21 (S13), and the diagnosis process is terminated.

  If the content of the gesture is “No” (NO in S19), the user interface unit 11 outputs a sound such as “Do you need a diagnosis by a doctor?”, Or the image display unit 4 displays text. Display (S23) and ask the subject whether or not a diagnosis by a doctor is necessary. The subject answers this question by making a gesture. The imaging unit 6 acquires a gesture made by the subject as image data (S24). Then, the data processing unit 10 extracts the edge of the acquired image data, identifies the part of the subject, changes the feature points included in the part, and the gesture performed by the subject based on the gesture analysis table shown in FIG. Analyze (S25).

  As a result of the analysis, if the content of the gesture is “Yes” (YES in S26), the image display unit 4 or the display unit 19 uses a reservation table as shown in FIG. While displaying on the screen, the subject is prompted to input predetermined items (S27). When it is detected that a predetermined item is input by the subject and the transmission button shown in the figure is clicked (S28), the diagnostic reservation input processing is completed, and the reservation table is transferred to the external device via the external communication unit 14. 25 (S29). Next, the user interface unit 11 outputs a voice such as “Can I send a diagnosis table to a doctor?” Or the image display unit 4 displays characters (S30), and the diagnosis result of the subject is displayed as a doctor. Ask the subject if he / she can send it. The subject answers this question by making a gesture. The imaging unit 6 acquires a gesture made by the subject as image data (S31). Then, the data processing unit 10 extracts the edge of the acquired image data to identify the part of the subject, and based on the transition of the feature points included in the part and the gesture analysis table shown in FIG. 23, the gesture performed by the subject is performed. Analyze (S32).

  As a result of the analysis, if the subject gesture means “yes” (YES in S33), a diagnostic table is created based on the diagnostic result obtained by the processing by the diagnostic system 1 (S34), and the doctor The diagnosis table is transmitted to (S35). Then, it is displayed on the image display unit 4 or the display unit 19 and recorded in the data holding unit 21 that the health condition of the subject is an attention state and the appointment table and the diagnostic table are transmitted to the doctor (S13). The process ends. Returning to step 33, if the content of the subject gesture is “No” (NO in S33), the image display unit indicates that the subject's health is in a caution state and that the appointment table has been transmitted to the doctor. 4 or displayed on the display unit 19 and recorded in the data holding unit 21 (S13), and the diagnosis process is terminated.

  Returning to step 26, if the content of the gesture is “No” (NO in S 26), after performing the processing after step 30 described above, the health condition of the subject is in a caution state and the doctor is informed. The presence / absence of transmission of the diagnostic table (according to the determination result in S33) is displayed on the image display unit 4 or the display unit 19 and recorded in the data holding unit 21 (S13), and the diagnostic process is terminated.

  Returning to step 14, if the determination unit 16 determines that it does not belong to the attention area (NO in S14), it determines whether or not it belongs to the warning area (S15). If the determination unit 16 determines that it belongs to the warning area (YES in S15), a diagnosis result indicating that the subject's health condition is a warning state is acquired (S22). And after performing the process after step 23 mentioned above, it displays on the image display part 4 or the display part 19 that the test subject's health condition is a warning state, and the presence or absence of the diagnostic reservation to a doctor, and sending of a diagnostic table | surface. At the same time, the data is recorded in the data holding unit 21 (S13), and the diagnosis process is terminated.

  Returning to step 15, if the determination unit 16 determines that it does not belong to the warning area (NO in S <b> 15), it determines that the subject's state is a dangerous area, and the diagnosis result indicates that the subject's health is in a dangerous state. Is acquired (S16). Then, after performing the processing after step 27 described above, an image is displayed indicating that the health condition of the subject is in a dangerous state, that a diagnosis table has been transmitted to the doctor, and whether or not a diagnosis table has been transmitted (according to the determination result in S33). The data is displayed on the unit 4 or the display unit 19 and recorded in the data holding unit 21 (S13), and the diagnosis process is terminated.

  In Steps 1 to 5 in the above flow, if the subject cannot be identified after repeated, the subject is prompted to input his / her name ("Your name is?" The candidate list is displayed, and the subject selects from among them). Further, the content displayed on the image display unit 4 or the display unit 19 in step 13 is not limited to the above content, and includes, for example, a medical condition estimated from the diagnosis result of the subject, a future countermeasure, a past diagnosis result, and the like. May be displayed. Moreover, although it comprised so that a test subject's gesture might be answered with respect to the question of the diagnostic system 1, the reply method is not restricted to a gesture, By input operation, such as a mouse | mouth and a keyboard of the above-mentioned user interface part 11, or voice input. You may comprise so that it may answer.

  As described above, according to the diagnosis system 1 of the present embodiment, the area that is determined to be in an abnormal state is divided into a plurality of areas of “caution area”, “warning area”, and “danger area”, and each of the areas set in each area is set. By comparing the condition of the subject and the results obtained by analyzing the subject's image data, the subject's health status is divided into four stages: normal, caution, warning, and danger. Can be determined in detail, and it is possible to make an optimal diagnosis for the health condition of the subject.

  In addition, the lesions and abnormalities of the subject appear in the narrow band characteristics of the spectrum on the surface of the subject. Since the subject is illuminated and photographed with specific color light that can emphasize the influence of such bands, the lesions and abnormalities are detected from the image data. It becomes easy to do.

  In addition, it is subject-dependent whether the spectral reflectance of the subject surface in the normal state and the abnormal state is significantly different in which wavelength region, but the reflected light caused by each color light corresponding to this wavelength region is separated by channel, so it is specified It is easy to separate normal and abnormal pixel values in a specific channel for a subject.

  In addition, normal state and abnormal state data on the coordinates can be easily discriminated visually.

  As described above in detail, according to the diagnostic system of the present invention, irradiation with specific color light makes it easy to detect lesions and abnormalities from image data, and diagnoses by determining normality, caution, warning, and dangerous state Accuracy can be improved.

  In addition, it becomes easy to separate normal and abnormal pixel values in a specific channel for a specific subject.

  In the present embodiment, for convenience of data management, the diagnostic apparatus 1 is provided with the imaging apparatus 2 and the diagnostic apparatus 13 separately. For example, the user interface unit 11, the user interface unit 18, the image display unit 4, and the like. The devices having the same function such as the display unit 19 may be combined into one, and the imaging device 2 and the diagnostic device 13 may be configured as one device. In addition, although the abnormal state is divided into three states, a caution state, a warning state, and a dangerous state, the health state of the subject is determined. However, the present invention is not limited to this. For example, the health state is divided into two or four. You may make it judge a state.

1 is a schematic diagram showing an overall configuration of a diagnostic system according to an embodiment of the present invention. It is a block diagram showing the whole diagnostic system composition concerning an embodiment of the present invention. It is a front view which shows the image display part and irradiation part which concern on embodiment of this invention. It is the elements on larger scale which show the example of the light source with which the irradiation part which concerns on embodiment of this invention is provided. It is a front view which shows arrangement | positioning of the color light unit which the light source of the irradiation part which concerns on embodiment of this invention comprises. It is a graph showing the example of the radiation spectrum of LED. It is a graph showing the characteristic of the light source with which the irradiation part which concerns on embodiment of this invention is provided. It is a graph showing the spectral reflectance of the specific part (a) of the subject. It is a graph showing the spectral reflectance of the other specific part (b) of the subject. It is a graph which shows the reflected light of the specific part (a) of a to-be-photographed object. It is a graph which shows the reflected light of the specific part (b) of a to-be-photographed object. It is a figure which shows arrangement | positioning of the imaging part which concerns on embodiment of this invention. It is a figure which shows other arrangement | positioning of the imaging part which concerns on embodiment of this invention. It is a figure which shows other arrangement | positioning of the imaging part which concerns on embodiment of this invention. It is a graph of the pixel value which converted the reflected light of the specific part (a) of a to-be-photographed object. It is a graph of the pixel value which converted the reflected light of the specific part (b) of a subject. It is the figure which represented on the coordinate the pixel value of the specific part (a) or specific part (b) of a to-be-photographed object as color data. It is a figure which shows the example of the table with which the system information holding part which concerns on embodiment of this invention is provided. It is a flowchart which shows the effect | action of the diagnostic system which concerns on embodiment of this invention. It is a flowchart which shows the effect | action of the diagnostic system which concerns on embodiment of this invention. It is a figure which shows an example of a diagnostic table. It is a figure which shows an example of a reservation table. It is a figure which shows an example of a gesture analysis table. It is a conceptual diagram which displays a some item on an image display part, and selects an item with gesture.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Diagnostic system 2 Imaging device 3 External communication part 4 Image display part 5 Irradiation part 6 Imaging part 7 Ambient environment information acquisition part 8 I / O part 9 Memory part 10 Data processing part 11 User interface part 12 Control part 13 Diagnostic apparatus 14 External Communication unit 15 Image analysis unit 16 Judgment unit 17 I / O unit 18 User interface unit 19 Display unit 20 Storage unit 21 Data holding unit 22 Work area unit 23 System information holding unit 24 Data management unit 25 External device

Claims (12)

An image analysis unit that irradiates a subject with a light source of specific color light, an imaging unit that captures the subject, and that captures the subject irradiated by the irradiation unit, and analyzes the image data acquired by the imaging A determination unit that compares the image data analyzed by the image analysis unit with a plurality of preset conditions to determine the state of the subject;
A diagnostic system comprising: The image analysis unit converts pixel values of image data acquired by imaging of the imaging unit into color data, and the determination unit determines a subject state by comparing the color data with a plurality of preset conditions. The diagnostic system according to claim 1. The diagnosis system according to claim 1, wherein the determination unit determines the state of the subject by comparing the image data analyzed by the image analysis unit with at least two preset conditions. The diagnosis system according to claim 1, wherein a diagnosis process for the subject is determined based on a determination result of the determination unit. Based on the determination result of the determination unit, the subject is asked how to perform future processing, the subject's motion in response to the question is imaged by the imaging unit, and the image data acquired by the imaging unit is analyzed The diagnostic system according to claim 4, wherein the diagnostic processing is determined by 6. The diagnosis system according to claim 5, wherein the analysis of the image data is performed based on an attribute of a subject. A diagnostic apparatus connected to an imaging device having an irradiating unit that irradiates a subject with a light source of specific color light and an imaging unit that images the subject irradiated by the irradiating unit. An image analysis unit that analyzes the image data, a determination unit that determines the state of the subject by comparing the image data analyzed by the image analysis unit and a plurality of preset conditions,
A diagnostic apparatus comprising: The image analysis unit converts pixel values of image data acquired by imaging of the imaging unit into color data, and the determination unit determines the subject state by comparing the color data with a plurality of preset conditions. The diagnostic apparatus according to claim 7, wherein: 9. The diagnostic apparatus according to claim 7, wherein the determination unit determines the state of the subject by comparing the image data analyzed by the image analysis unit with at least two preset conditions. The diagnostic apparatus according to claim 7, wherein a diagnostic process for a subject is determined based on a determination result of the determination unit. Based on the determination result of the determination unit, the subject is asked how to perform future processing, the subject's motion in response to the question is imaged by the imaging unit, and the image data acquired by the imaging unit is analyzed The diagnosis apparatus according to claim 10, wherein the diagnosis processing is determined by performing the operation. The diagnostic apparatus according to claim 11, wherein the analysis of the image data is performed based on a subject attribute.

Images