JP2003085278A - Diagnostic system, method for transmitting information for diagnosis, terminal to be used for the same, its program and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a diagnostic system for allowing a patient to freely receive convenient medical examination and treatment away from a hospital anytime. SOLUTION: This system is provided with a terminal T and a server S connected through a network N. The prescribed position of a body is imaged by an image pickup unit C connected to the terminal T, and picture data obtained by the image pickup are transmitted through the network to the server S. The server S compares the received picture data with reference data (not shown in a figure) owned by the server S, and automatically examines the health situation of a user, and prepares diagnostic data. In this case, the diagnostic data can be made equivalent to a diagnostic result to be announced to a patient by a doctor, and therefore the automatic diagnosis can be realized.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for quickly evaluating personal information such as skin information from an image transmitted from a remote place and inquiry / listening information using a net.

[0002]

2. Description of the Related Art Conventionally, diagnosis and treatment of diseases and health conditions such as skin conditions, counseling and the like are generally performed by a diagnostician such as a doctor or a counselor. In addition, such a diagnosis is usually performed by a person to be diagnosed, such as a patient or a subject, who directly goes to the person under the diagnosis and faces them. In the present invention, the term "diagnosis" includes counseling that does not necessarily require a doctor's license or other licenses. On the other hand, with the recent development of infrastructure, it has become possible for general households and individuals to connect their own terminals to a network such as the Internet and thereby receive various information and the like. With such technological progress, a technology such as diagnosis and treatment by which a diagnostician and a patient who are connected to each terminal via the Internet exchange voices and images in real time, thereby performing diagnosis and treatment, will be put to practical use. Has arrived.

By the way, some of the diagnoses and treatments are not so difficult to diagnose, for example, those relating to skin properties, and those such as beauty counseling that have less serious effects on the body and life. In recent years, when the standard of living has improved, there is a great demand for such minor diagnostics and treatments, and it is possible to obtain diagnostic results, treatment methods, and counseling contents for them without the need to visit a diagnostician. There are a lot of users who want to get it.

However, although the above-mentioned technique which attaches importance to real-time property has an advantage that the accuracy of diagnosis and treatment is high, the diagnostician and the subject must use their own terminals in time. There is an inconvenience. In addition, since the diagnosis or treatment judgment is ultimately made by a diagnostician such as a doctor or a counselor, there is a big problem of securing these human resources, and there is a point that it is not suitable for easy diagnosis and treatment. .

Further, in performing diagnosis and treatment according to the will and desire of the person to be diagnosed, the body temperature of the person to be diagnosed, visual confirmation of the condition of the region requiring treatment, or determination of the region to be treated or counseled. Subjective diagnostic information by the user, called "main complaint", which is the objective information such as images and how the diagnosed person perceives their own health condition and skin condition based on their subjectivity. It is important to understand both. Regarding the objective information, it is possible to obtain the objective information without the intervention of the diagnostician, for example, by the diagnostician sending an image of a region desired to be diagnosed. However, in order to grasp the subjective diagnostic information as described above, conventionally, a diagnostician needs to directly make a diagnosis, and it is more preferable that the diagnosed person and the diagnostician are simultaneously connected to a network such as the Internet. Has become important.

[0006]

SUMMARY OF THE INVENTION An object of the present invention is to provide a diagnosis, treatment, and counseling technique using a network, which does not require a person to be diagnosed and a person to be diagnosed to connect to the network at the same time. In addition, the network is applied so that the diagnostician does not need to connect to the network at the same time as the diagnosed person, but can grasp both the subjective diagnostic information and the objective information of the diagnosed person. The challenge is to provide diagnosis, treatment, and counseling technology.

[0007]

The present invention has the following features to attain the object mentioned above. That is,
INDUSTRIAL APPLICABILITY The present invention can accept image data obtained by image capturing from a predetermined image capturing unit capable of capturing an image capturing target position set at a predetermined position of the user's body, and includes not only the diagnostic content but also character information. A diagnostic system including a terminal device adapted to accept inquiry data, and an information processing device connectable to the terminal device via a network, wherein Image data generated by imaging the imaging target position by the imaging unit, and inquiry data including character information regarding the diagnostic content of the imaging target position are transmitted to the information processing apparatus via the network. The information processing device based on the image data and the inquiry data received from the terminal. Performs diagnosis of the constant, and a diagnostic means for generating diagnostic data for the diagnosis, a diagnostic system.

In this diagnostic system, image information generated and transmitted by the user by imaging the imaging target position from the terminal device through the imaging device, and inquiry data including character information as well as diagnostic contents of the imaging target position. The information processing apparatus automatically performs the diagnosis based on the. Therefore, according to this diagnosis system, the diagnosis can be performed without bothering the doctor. Therefore,
The user can easily receive a diagnosis anytime, anywhere without the need to time with a doctor.
Further, since the diagnosis is made based on the inquiry data regarding the diagnosis contents of the imaged position, it is possible to make a fine and highly accurate diagnosis. The inquiry data regarding the diagnostic content of the imaged position includes information regarding the imaged site, for example, when the forehead is imaged, information such as whether the forehead has acne or pimples. It should be noted that, in addition to the imaged part, information about the age and sex of the user, information about the living environment of the user, and the like may be included. Since the inquiry data includes data that cannot be included in the image data and is related to the diagnostic content of the imaged position, the accuracy of the diagnosis can be improved.

The character information referred to in the present invention includes not only general character information such as text data but also information on symbols used to express information relating to diagnostic contents. For example, information generated by selecting one option from a plurality of options is also referred to as character information in this specification. The diagnostic data described above can be applied to the user's own health management by returning the diagnostic data to the user. For example, the user can purchase medicines and cosmetics that are judged necessary based on the diagnostic data. Further, this diagnostic data can be used by manufacturers and distributors of medicines, cosmetics, medical instruments, beauty instruments and the like. For example, it can be used by sending it to a distributor of medicines or cosmetics.
As an example, it is possible to construct a system for delivering medicines, cosmetics, etc. automatically or in response to a purchase request from a user from a seller who receives the data. In this case, it may be necessary for the user to have some kind of contract with the person who manages the diagnostic system, but if there is such a measure, the user can take the predetermined image data. By simply performing the simple processing for sending at home, it becomes possible to obtain medicines, cosmetics, health foods, health appliances, etc. suitable for one's health condition at home. The images in the present invention include not only still images but also moving images.

In the above-mentioned diagnostic system, not only the diagnostic data may be generated, but also the prescription data representing the prescription suitable for the diagnostic result may be generated based on the diagnostic data. In this case, the prescription data is generated in time series based on the diagnostic data generated in time series. This makes it possible to automate a series of operations performed by the doctor, from diagnosis to prescription. It should be noted that this prescription data can be used by a user, a manufacturer, a distributor, etc. of medicines, cosmetics, medical instruments, beauty instruments, and the like, like the above-mentioned diagnostic data. The information processing device may be, for example, as follows. That is, the diagnosis means is capable of generating comparison image data by performing predetermined image processing on the image data when necessary, and reference data for diagnosis. Can be configured to include a reference data recording unit in which is recorded, and a determination unit that performs the predetermined diagnosis by comparing the comparison image data with reference data.

When it is intended to use the above-mentioned inquiry data as well, the diagnostic means of the information processing apparatus can generate the comparison image data by performing the predetermined image processing on the image data. The image processing means, the reference data recording means in which the reference data for diagnosis is recorded, and the comparison image data and the inquiry data are compared with the reference data to determine the predetermined diagnosis. And means.

The above-mentioned reference data may include data necessary for making a plurality of types of diagnoses.
In this case, correspondence information indicating which diagnosis corresponds to the image is added to the image data, and the determination means is indicated by the correspondence information based on the correspondence information received together with the image data. It can be configured to perform different types of diagnostics. By doing so, it becomes possible to correctly execute multiple types of diagnostics in one system. Further, the reference data may include data for performing at least one of each of the forehead, right cheek, left cheek, and chin diagnoses, for example, when performing a skin property diagnosis. The determination means may be configured to perform at least one of the forehead, right cheek, left cheek, and chin diagnoses.

In this case, correspondence information indicating which diagnosis corresponds to the image is added to the image data, and the determining means determines the forehead based on the correspondence information received together with the image data. It can be configured to perform the diagnosis indicated by the correspondence information from among the right cheek, left cheek, and chin diagnoses. In addition to the skin property diagnosis, for example,
It is also possible to perform ptosis and hair diagnosis. In this case, it is assumed that the reference data includes data of skin property diagnosis, blepharoptosis diagnosis, and hair diagnosis data, and the determination means,
Based on the correspondence information received together with the image data,
It can be configured to perform the diagnosis indicated by the correspondence information from among the forehead, right cheek, left cheek, and chin diagnoses.

A terminal device forming a part of the above system according to the present invention is as follows. That is, a diagnostic means is provided for performing a predetermined diagnosis based on the image data received via the network and the inquiry data relating to the diagnosis content and including the predetermined character information, and generating diagnostic data on the diagnosis result. For information processing equipment,
A terminal device that is connectable via the network, and from a predetermined image pickup means capable of picking up an image pickup target position set at a predetermined position of the user's body,
The user is made to be able to receive the image data generated by the user capturing an image of the image capturing target position using the image capturing means, and the inquiry data including the text information regarding the diagnostic content of the image capturing target position. The terminal device is provided with a transmission unit capable of transmitting the image data and the inquiry data to the information processing device via the network.

Further, the terminal equipment constituting the network of the present invention can execute the following method. That is, a diagnostic means is provided for performing a predetermined diagnosis based on the image data received via the network and the inquiry data relating to the diagnosis content and including the predetermined character information, and generating diagnostic data on the diagnosis result. A method performed by a terminal device connectable to an information processing device via the network, comprising: a predetermined method capable of capturing an image capturing target position set at a predetermined position of a user's body. From the image capturing means, a process of accepting image data generated by a user capturing the image capturing target position using the image capturing means, and inquiry data including character information regarding the diagnostic content of the image capturing target position, A step of transmitting the image data and the inquiry data to the information processing apparatus via the network, It is a method of transmitting broadcast.

Further, the terminal device and the method for transmitting diagnostic information of the present invention include a home computer and a communication means by causing a computer to read the following programs recorded in a predetermined recording medium. It can be easily realized by using a game dedicated computer. The recording medium is, for example, the following. That is, a diagnostic means is provided for performing a predetermined diagnosis based on the image data received via the network and the inquiry data relating to the diagnosis content and including the predetermined character information, and generating diagnostic data on the diagnosis result. A program for causing a terminal device including a computer, which is connectable to the information processing device via the network, to function as a diagnostic information transmission device is recorded in a computer-readable form. The recording medium is a recording medium, and the program causes the computer to capture an image using a predetermined image capturing unit capable of capturing an image capturing target position set at a predetermined position of the user's body. Image data generated by capturing an image of the target position, and diagnostic content of the image capturing target position The process of receiving the inquiry data including the character information, the image data and the inquiry data, processing to be transmitted to the information processing apparatus through the network, the recording medium is intended to perform is an example.

The information processing apparatus and the method of generating diagnostic data of the present invention use a general-purpose computer such as a home computer by causing a computer to read the following program recorded in a predetermined recording medium. It can be easily realized. That is, a diagnostic means is provided for performing a predetermined diagnosis based on the image data received via the network and the inquiry data relating to the diagnosis content and including the predetermined character information, and generating diagnostic data on the diagnosis result. A program for causing a terminal device configured to include a computer, which is connectable to an information processing device via the network, to function as a diagnostic information transmission device, the computer including a user Image data generated by the user capturing the image capturing target position using the image capturing unit from a predetermined image capturing unit capable of capturing an image capturing target position set at a predetermined position of the body of A process of accepting inquiry data including character information as well as the diagnosis content of the target position, the image data and the previous Interview data, computer readable program as for causing processing to be transmitted to the information processing apparatus via the network are examples. The present invention can also be configured to generate appropriate prescription data based on diagnostic data. That is, in each invention described in the claims, prescription data for a prescription compatible with the diagnostic result is generated based on the diagnostic data, or a prescription compatible with the diagnostic result based on the diagnostic data. You may make it provide the prescription means which produces | generates the prescription data about.

[0018]

BEST MODE FOR CARRYING OUT THE INVENTION An example of a preferred embodiment of the present invention will be described below.

<< Overall Configuration >> A diagnostic system embodied in this embodiment is as shown in FIG. This diagnostic system includes a terminal T as a terminal device of the present invention and a server S as an information processing device of the present invention,
Further, it is configured to include a beauty product store B and a pharmacy Y. These are connected via a network N formed by the Internet, an intranet, or the like.

<< Terminal Configuration >> Next, the terminal T will be described. The terminal T in this embodiment is composed of, but not limited to, a home computer. The terminal T includes a predetermined display device T1, an input device T2 including a keyboard and a mouse for inputting inquiry data described later, and an image pickup device C including a digital camera and a microscope.
Is equipped with.

The image pickup device C corresponds to the image pickup means of the present invention. The image pickup device C is capable of generating image data by taking an image. The terminal T can receive image data via an input terminal to which a cable connecting the terminal T and the imaging device C is connected. The imaging device C is for imaging a predetermined imaging target position that is a part of the user's body.

The computer serving as the terminal T has a disk drive. And in that disk drive,
A recording medium MT according to the present invention configured by a CD-ROM, a DVD-ROM or the like can be inserted and the program according to the present invention recorded on the recording medium MT can be read. By installing the program according to the present invention through the above process, the computer has each function required for the terminal T of the present invention. Although not limited to this, the recording medium MT in this embodiment is distributed by the administrator of the server S that operates this system. However, the above-mentioned program does not necessarily have to be installed in the computer via the recording medium MT, and may be installed in the computer through the process of distribution via the network. Alternatively, the terminal T may be used as a simple interface to execute a necessary program on the server S side. This program may be a program that allows the computer to function as the terminal T of the present invention by itself, and the computer and the OS installed in the computer cooperate with each other to cause the computer to perform the terminal T of the present invention. It may be configured to perform the function as.

By executing the above program, the CPU incorporated in the terminal T of the present invention forms the following functional blocks. That is, as shown in FIG. 2, this terminal has an image data receiving unit 110 and an interview data receiving unit 12
0, a control unit 130, a transmission / reception unit 140, and a display device management unit 150.

The image data receiving section 110 receives predetermined image data generated by being imaged by the image pickup device C. The image data accepting unit 110 in this embodiment is adapted to accept such image data via a cable connecting the imaging device C and the terminal T. However, the image data receiving unit 110
Has only to accept the image data generated by the imaging device C, and may be configured to accept the image data via a memory card or other external recording medium. The inquiry data receiving unit 120
The inquiry data is generated according to the user's input performed via the input device. The inquiry data is information regarding the content of the diagnosis and also includes character information.

For example, information about the age, sex, subjective symptoms, etc. of the user, the date and time when the image data was generated (imaging), the life rhythm and life pattern can be included. In other words, this inquiry data can include any information necessary for diagnosis as long as it relates to text information. Further, the inquiry data can be changed as appropriate according to the type of diagnosis content. For example, in the case of a diagnosis of skin properties, this interview data includes
You can include information about the type of cosmetics you are using. This inquiry data is generally input device T
It is input as character information from the keyboard constituting the number 2. For example, the inquiry data may be generated by the user freely typing characters. However, by presenting the user with a question regarding the diagnosis to be performed and options for the question, to the control unit 130 formed by executing the above-described program, and the user selecting a desired option with a pointing device such as a mouse, It is also possible to be able to input inquiry data. Further, the control unit 130 is provided with a function of causing the display device T1 to display a plurality of options for information required when performing a target diagnosis, and the user selects the option displayed on the display device T1. By doing so, it is possible to input inquiry data.

The control unit 130 manages the image data reception unit 110 and the inquiry data reception unit 120 described above, and the transmission / reception unit 140 and display device management unit 150 described below. For example, the image data or inquiry data to be transmitted from the transmission / reception unit 140 is determined based on the input content of the user, or the image displayed on the display device T1 is determined. In addition, the control unit 130 generates correspondence information, which is data indicating what kind of diagnosis the received image data is for, based on the input from the above-described input device T2 or the like, and displays the corresponding information as an image. It also has the function of adding to data.

The transmission / reception unit 140 executes communication between the terminal T and the network N. The transmission / reception unit 140 can transmit at least the image data (and the added correspondence information) and the inquiry data to the server S via the network N.
It should be noted that the transmitting / receiving unit 140 in this embodiment uses the server S
The below-described diagnostic data (in some cases, diagnostic data and prescription data, or prescription data) generated by the above can be received from the server S via the network N.

The display device management section 150 generates display data for displaying a desired image on the display device T1. Display device management unit 1
Reference numeral 50 is adapted to generate display data under the control of the control unit 130.

<< Server Configuration >> Next, the server S will be described. The server S in this embodiment is composed of a general computer. This server includes a predetermined display device and a predetermined input device including a keyboard and a mouse.

The computer serving as the server S has a disk drive. Then, the recording medium MS according to the present invention, which is composed of a CD-ROM, a DVD-ROM or the like, can be inserted into the disc drive, and the program according to the present invention recorded on the recording medium can be read. There is. This computer is
By installing the program according to the present invention through the above process, each function required of the server S of the present invention is provided. This program may be a program that allows a computer to function as the information processing apparatus of the present invention by itself, and the program of the present invention can be provided to the computer by the cooperation of the program and an OS installed in the computer. It may be configured to have a function as a processing device.

By executing the above program, the CPU incorporated in the server S of the present invention forms the following functional blocks. That is, as shown in FIG. 3, this server S
Includes a transmission / reception unit 210 and a diagnosis unit 2220.

The transmitting / receiving unit 210 executes communication between the terminal T and the network N. The transmission / reception unit 210 can receive at least image data and inquiry data from the terminal T. In addition, the transmitting / receiving unit 210 of this embodiment is used by the beauty product store B and the pharmacy Y.
To the terminal T used by the user, the network N
The diagnostic data (prescription data and diagnostic data, or prescription data in some cases) can be transmitted via the. The transmission of the prescription data to the beauty goods store B, the pharmacy Y, or the terminal T can be selectively performed at one location or a plurality of locations therein.

The diagnostic section 220 has both the functions of the diagnostic means and the prescription means in the present invention, and makes a predetermined diagnosis based on the above-mentioned image data and inquiry data received from the terminal T via the network N. At the same time, based on the diagnosis result, prescription data about a prescription that matches the diagnosis result is generated. More specifically,
The diagnosis unit 220 includes an image processing unit 221, a reference data recording unit 222, a determination unit 223, and a prescription reference data recording unit 22.
4, a prescription data generation unit 225, and a correspondence determination unit 226.

The image processing section 221 corresponds to the image processing means in the present invention, and has a function of generating the comparison image data by performing a predetermined image processing on the image data. The reference data recording unit 222 corresponds to a part of the reference data recording means in the present invention, and records the reference data necessary for generating the prescription data. The reference data recording unit 222 has only to record the reference data for performing at least one diagnosis, but in this embodiment, the reference data for the skin property diagnosis is recorded. The determination unit 223 functions as a determination unit in the present invention in cooperation with a prescription data generation unit 225 described later. The determination unit 223 compares the comparison image data generated by the image processing unit 221 with the reference data suitable for the desired diagnosis, and generates the diagnosis data about the diagnosis result by adding the inquiry data described above. It has a function to do. In addition, the prescription reference data recording unit 224 records data required for generating prescription data based on the above-mentioned diagnostic data. Although not limited to this, the prescription data recording unit 224 of this embodiment records prescription data regarding prescription relating to skin property diagnosis. The prescription data generation unit 225 corresponds to the prescription means of the present invention. Prescription data is generated by receiving the above-mentioned diagnostic data and reading out appropriate data from the prescription standard data recording unit 224. The prescription data is data about a prescription that is suitable for the current situation indicated by the diagnostic data, and for example, advice for recovering skin properties, advice for recovering the current health condition, or information related to these, etc. include. This prescription data has contents corresponding to each diagnosis. Correspondence determination unit 22
6 analyzes the correspondence information added to the image data and sent from the terminal T, and determines the diagnosis to be performed on the image data. In this embodiment, since the four positions of the forehead, the right cheek, the left cheek, and the jaw are focused on, the correspondence determination unit determines which of these parts is to be diagnosed based on the above correspondence information. Judgment at 226. This determination is sent to the image processing unit 221 and the determination unit 223. The image processing unit 221 performs appropriate image processing based on the determination information, and the determination unit 223 performs appropriate diagnosis determination. The correspondence determination unit 226 is for increasing the diagnostic accuracy by specifying which part of the skin is to be diagnosed. Even if the correspondence determination unit 226 is not provided, the determination of the skin property can be roughly performed. It is also possible to do so.

An example of diagnosing skin properties by connecting the terminal T to the server S via the network N will be described below. First, the user inputs the user ID and password as the identification information assigned in advance to the inquiry data receiving unit 120 through the input device T2. Before transmitting the identification information, the control unit 130 may cause the display device management unit 150 to display on the display device T1 an image prompting the user to input the identification information. In this example, the image as shown in FIG. 4 is displayed on the display device T1 so that the user can smoothly input the identification information.

In the example shown in FIG. 4, users are registered in advance, and the registered users are user 1 and user 2.
Is displayed as a list on the display device T1. The user selects one corresponding to himself from the displayed user list and inputs a predetermined password in the blank space in the figure. The information thus generated is sent to the control unit 130.
The control unit 130 sends the identification information generated based on this information to the transmission / reception unit 140. When the terminal T accesses the server S, this identification information is used by the transmission / reception unit 21 of the server S.
It is sent to 0, and is used for identifying the user in the diagnostic processing in the server S and the like. When diagnosing the property of the skin, the user first inputs, through the input device T2, an intention to decide which part of the skin the property of the skin is to be diagnosed. As a result, the control unit 130 generates correspondence information indicating which part of the skin is to be diagnosed based on the image data input thereafter. In this example, the image shown in FIG. 5 is displayed on the display device T1 to facilitate the input from the user.

In FIG. 5, the user name, date of birth, and age are displayed at the top of the image. At the bottom center of the screen, an image of the part to be imaged, here a face image, is displayed.
By selecting and instructing any of the forehead, right cheek, left cheek, and chin of the face image with an input device such as a mouse, it is instructed which part of the face is to be imaged. A past shooting history is displayed on the lower left of the screen, and an input region for a comment from the user and a brightness adjustment region are displayed on the lower right of the screen.
On the right of the center of the screen, there are a message asking the user to select a location to be captured through the face image in the center of the bottom of the screen, and a message to set the imaging device C, in this example, a microscope at the selected location. Is displayed. The image from the image pickup device C is the image data reception unit 1
It is input to the control unit 130 through 10 and displayed on the left of the center of the screen. With such a configuration, it is input which part of the skin the property of which is to be diagnosed, and the image data generated by being imaged by the imaging device C is sent to the control unit 130 through the image data receiving unit 110. To be

In this example, the control unit 130 causes the user to click on the forehead portion of the face image in the lower center of the screen with the mouse and input the image of the skin image on the forehead.
Do against. In addition, the user confirms the image of the skin on the forehead shown on the left side of the center of the screen, confirms that the image of the skin on the forehead is actually captured, and then the determination switch provided in the imaging device C, Or through a mouse etc.,
The image currently displayed in the center left of the screen is displayed on the transmitting / receiving unit
It is determined as an image to be sent to the server S through 0. The control unit 130 determines the image data transmitted through the image data reception unit 110 at that time as an image to be transmitted to the server S through the transmission / reception unit 140, and further adds the above-mentioned correspondence information to the image data, The image data is sent to the transmitting / receiving unit 140. The transmission / reception unit 140 is controlled by the control unit 130 in response to a user's request input by operating the terminal T, and transmits image data to which correspondence information is added and inquiry data described below to the network N. To the server S via.

Regarding the interview data, the input device T
It is generated by the user performing an input operation of inquiry data including character information via 2. In this embodiment, when the inquiry data is input, for example, the question shown in FIG. 6 is displayed on the display device T1. This image is displayed on the display device T1 based on the display data generated by the display device management unit 150 under the control of the control unit 130. In this example, questions 1 to 4 to be described later are prepared, points are assigned to the options in the answers to these questions as shown in FIG. 7 to be described later, and next, according to the total score of the answers in each question, Select which question to ask. FIG. 8 shows a flowchart showing the procedure for determining the question order. In this flowchart and the following description, each step is abbreviated as "S".

In inputting inquiry data in FIG. 8, question 1 is first executed (S1), and it is determined whether the total answer points of question 1 are 12 points or more (S2). If the total score is 12 or more, execute question 2 (S3),
It is determined whether or not the total answer points of question 2 are 37 points or more (S4). If the score is 37 or more, the question 3 is executed (S5), and the question 4 is executed regardless of the total answer points of the question 3 (S6). If the total answer score is less than 12 points in S2, and the total answer score of question 2 is 37 in S4.
If it is less than the points, execute question 4 (S
6). In this example, as shown in FIG. 6, regarding the forehead, “there are acne and pimples”, “there is dryness”, “there are eczema”, “there are spots and freckles”,
Questions such as "I feel shiny with oily skin" and "I have wrinkles and sagging" are shown. The user selects one of the options "No", "Slightly", "Slightly", "Quite", and "Extremely" for each of these questions, and checks them using an input means such as a mouse. Mark it. For these questions and options, the user can obtain subjective diagnostic information (main complaint) by selecting and answering these questions. For example, in response to the question "There are acne and pimples,"
By selecting one of the options from "No" to "Very", "There are acne and pimples", "There is dryness"
For each of the questions, it is possible to obtain how the user judges his / her skin, that is, the user's subjective diagnostic information. On the other hand, as the objective information, the image data of the skin on the user's forehead is obtained as described above.

As a result, it is possible to objectively judge from the image data that the user's forehead has almost no "acne or pimples", and that the user's forehead is considerably "dry", but the response from the user is "Pimples and pimples" are "pretty", and "there is dryness""just a little"
If it is, it is understood that this user is a type who is worried about acne and pimples, and is a type which does not care about dry skin. Therefore, in the determination process in the server described later, after obtaining both the subjective diagnostic information and the objective information, the type and preference of the user obtained from the subjective diagnostic information are also added. The determination and the generation of prescription data can be performed. In addition to the above-mentioned questions, an area in which the user can freely enter is provided at the bottom of the screen in FIG. 6, so that the user can freely write what he / she is concerned about other than the above-mentioned questions. There is. This makes it possible to make determinations and generate prescription data while also considering the user's intentions and requests.

The question regarding the amount shown in FIG. 6 is shown as question 1-1 in question 1 in FIG. Further, as shown in FIG. 7, each option in FIG.
0 for "No", 1 for "just a little", 2 for "slight", 3 for "pretty", 4 for "very"
Points are assigned. In addition, if there is an input in the item "Please let me know if you have any concerns about the amount other than the above", assign 4 points, and if there is no input, assign 0 point.
When the user determines the options for all the questions, the control unit 130 calculates the total score of the answers regarding the amount. In the example of Fig.6, all "No" options are selected, and since there is no entry in the "Please let me know if there is anything else to note about the amount" item, the total points will be 0 points. ing.

Next, in this example, the chin portion (back of the chin)
On the other hand, similar to the question regarding the above amount, "there are acne and pimples", "there is dryness", "there are eczema", "there are spots and freckles", "there is oily skin",
Display device T asks each question “There are wrinkles and sagging”
It is displayed in 1. These questions are question 1 in FIG.
Shown as -2. Similar to the forehead example, as shown in Fig. 7, for each of these questions, there are choices of "No", "Slightly", "Slightly", "Quite", and "Very". , 0 to 4 points are assigned respectively. However, regarding the item "Please let us know if you have any concerns other than the above on the chin part",
If there is an input in this item, 4 points will be assigned, and if there is no input, 0 point will be assigned. Then, as in the case of the above-mentioned example of the amount, the total points are obtained from the answers of the user. Further, questions 1-3, 1-4, and 1-5 shown in FIG. 7 are set for the “right cheek”, the “left cheek”, and the “interesting part”, respectively, and the display is displayed. Questions and options are displayed on the device T1, and the total points are obtained from the answers of the user.

With the above configuration, as shown in FIG. 7, question 1 (specifically, questions 1-1 to 1 constituting question 1)
By the user answering -5), objective information called forehead image data and inquiry data corresponding to the image data are obtained, and the diagnosis unit 220 of the server S obtains these image data and inquiry data. Based on this, it becomes possible to generate diagnostic data and prescription data for skin properties. In particular,
In this example, subjective diagnostic information corresponding to image data,
So-called chief complaints can be obtained, and in principle, doctors and counselors are not required, but based on the chief complaints, it is possible to make the same diagnosis as when a doctor actually consulted. ing.

Questions 1-1 to 1-5 are compulsory questions,
Must be done for every user. In this example, the user answers all of the questions 1-1 to 1-5, but the user should select at least one of these questions 1-1 to 1-5. , Question 1 by allowing the user to answer the selected question
At least one of -1 to 1-5 may be a forced question. In this example, after asking a compulsory question,
Furthermore, a selection question is prepared, and it is determined whether or not to make a selection question based on the score of the answer result of the compulsory question. Specifically, after the user's answer to the compulsory question and the total points have been obtained, the “forehead”, “stomach part”, “right cheek”, “left cheek”, “part of concern” When the total value of the answers for each question is calculated and the total score of the answers from the user is a predetermined score or more, that is, 12 or more in this example, the control unit 130 causes the display control management unit to 150
Through the question 2 consisting of the questions 2-1 and 2-2 shown in FIG. 9 through the display device T as shown in FIG.
Display in 1. These questions include "I often get eczema on my body and head" about my skin, "I tend to get gin machines" ... Question 2-1 about my hair coming off well, and "About sunburn on my face". Question 2 "The face is hot and tingling" ... "I'm worried about the bear under my eyes"
-For each question of both -2, as in the case of question 1, "no", "just a little", "slightly", "pretty",
Each option of "very" is prepared, and 0 to 4 points are assigned to each option. Further, this makes it possible to obtain the total score of the user's answers to the question 2, that is, the total score of the questions 2-1 and 2-2.

If the total number of answers from the user is a predetermined score or more, 37 points or more in this example, the control unit 130
Then, as shown in FIG.
The question 3 including the questions 3-1 to 3-3 shown in FIG. 6 is displayed in the same form as the question 1 in FIG. 6 and the question 2 in FIG. Similar to the above example, in this example as well, the question 3-1 "snot", "nasal congestion", "sneezing", "other symptoms" regarding symptoms of allergic rhinitis, "eczema" regarding allergic dermatitis … Question 3-2 “Other symptoms”, “Conjunctivitis” regarding allergic conjunctivitis…
For each question 3-3, "Other symptoms,""No,""slightly,""slightly,""pretty,"
Each option of "very" is prepared. These options are 0-4, respectively, as in questions 1-1-1-5.
Points are assigned and the total points can be calculated from the user's answers. However, regarding the item of "other symptoms" in FIG. 11, 4 points are assigned if there is an input, and 0 points are assigned if there is no input. If the question "Do you have allergies to your family?" Is YES, 4 points are assigned, and if NO, 0 points are assigned. For the question "Who is that person?", The options "Father,""Mother,""Siblings," and "Children" are assigned. This is a question that will be answered only when YES is selected in the question "Are you sure?" And 4 points have already been assigned, so in the answer "Who is that?" It is a point. Of course, the points can be set arbitrarily, for example, 1 point is assigned to each of “Father”, “Mother”, “Brothers and sisters”, and “Child”,
If you are allergic to "father", "mother", and "child", assign 3 points so that the higher the number of allergic family members, the higher the score. May be.

After completing the answer to the question 3, the question 4 to be described later is executed. Further, as shown in the flowchart of FIG. 8, when the total score is less than 12 in any of the questions 1-1 to 1-5, and the total score in question 2 is 3
Question 4 in any case where the score is less than 7
To execute. This question 4 includes questions 4-1 to 4-11 as shown in FIGS. 12 and 13. Question 4-
1 is a question that appears only when the user uses the diagnostic system for the first time, and a message is displayed, "Ask about the cosmetics you are currently using. Please check the products that are being used." Question 4 described later
-3 to 4-11 are displayed. If you use this diagnostic system for the second time or later, question 4-2 will be executed.
The message "Ask me about the cosmetics you are currently using. Are there any changes from the last time?" And two choices, YES and NO, are displayed, and the user can select YES or NO.
Ask them to choose. If NO is selected, there is no change from the previous time, so questions 4-3 to 4-11 are not displayed and the question to the user is ended. If YES is selected, the questions 4-3 to 4-11 are displayed and the cosmetics currently in use are checked.

Question 4-3 is a question about cleansing. As shown in FIG. 14, "cream",
The options "gel", "oil", "lotion", "for points" and their respective check boxes are displayed on the display device T1. Further, as shown in FIG. 14, an option of "others" is also provided so that the user can directly manually input the name of the cleansing used. Questions 4-4-4-9 are shown in FIG.
As shown in Nos. 2 and 13, these are questions about face cleansing, lotion, emulsion, essence, cream, and special care, respectively.
Is displayed in. All of these questions 4-1 to 4-9 are questions for obtaining objective information about the cosmetics used. As described above, not only the image data but also the inquiry data including the character information can obtain the objective information "cosmetics currently in use" separately from the subjective diagnosis information. There are lotions such as "Wipe off and moisturize" and "Wipe off and moisturize" as options for questions 4-4 and 4-5.
"Refreshing" indicates whether the lotion itself is a "skin lotion that refreshes the skin" or a "skin lotion that refreshes the skin." It does not diagnose whether you are doing or not.

In the above example, one of the options corresponding to each question is selected, and the document is input with the keyboard or the like to input the inquiry data. As a result, from the answers corresponding to the questions 1 to 3, inquiry data serving as subjective diagnostic information can be obtained, and the questions 2 and 3 can be executed depending on the answer results of other questions. Has been decided, and an accurate diagnosis and treatment based on the diagnosis can be performed with a small number of questions. Furthermore, objective information can be obtained from the answer corresponding to question 4, even in the inquiry data including text information, separately from the image data. As described above, when the inquiry data is input, the terminal T receives the above-mentioned inquiry data via the inquiry data receiving unit 120. This data is stored in the control unit 130.
Is transmitted to the transmission / reception unit 140 via. Transmitter / receiver 140
Under the control of the control unit 130, which is performed in response to the user's request input by operating the terminal T, sends the inquiry data to the server S in addition to the image data.

The server S transmits / receives the image data and the inquiry data sent from the terminal T via the network N.
10, and the skin property is diagnosed based on these data. The image data of the skin received by the transmission / reception unit 210, in this example, the image data of the skin on each of the forehead, right cheek, left cheek, and chin is:
It is sent to the diagnosis unit 220. First, the correspondence determination unit 226
The correspondence information added to the image data is analyzed, and based on this correspondence information, for each of the transmitted image data, it is image data of the skin on any of the forehead, right cheek, left cheek, and chin. , And the diagnosis to be made on the image. This determination is sent to the image processing unit 221 and the determination unit 223, and the image processing unit 221
And the appropriate determination in the determination unit 223 is ensured. Further, the image data is sent to the image processing unit 221. The image processing unit 221 performs predetermined image processing on the image data, if necessary, to generate comparison image data. For example, by performing a binarization and a ternarization by setting a predetermined threshold value for brightness,
Processing for facilitating the subsequent determination of the skin image is performed. Edge enhancement or contour processing by moire may be performed.

Further, the image processing section 221 may perform color correction processing. Since the image data is often different from the original image due to the difference in specifications of each image pickup device C and the difference in illumination at the time of image pickup, accurate diagnosis can be performed by performing such color correction. It can be carried out. For example, a sticker or the like having a predetermined reference color in a predetermined arrangement is distributed to the user in advance, and the user is obliged to stick the sticker in the image pickup range to take an image. This can be performed by matching the reference color in the above with the color prepared in advance and applying this processing to the entire image. The color correction process may be performed by the terminal T on the user side. In this case, the color-corrected unified image data is sent to the server S. In this case, the terminal T needs to be provided with a means for performing color correction. For example, the above-mentioned control unit 130 can be provided with such a function. In this example, the binarization process is performed by setting a predetermined threshold value for the lightness, and the subsequent determination is facilitated. FIG. 15 shows an example of the enlarged image of the skin shown by the image data for comparison. HM represented as lines running vertically and horizontally in FIG.
Is a groove on the epidermis called a skin groove, and each part partitioned by the skin groove HM is called a cuticle HO.

The image data for comparison, which has been subjected to the above-described processing as needed, is then sent to the determination unit 223. The determination unit 223 makes a determination based on the comparison image data by comparing the comparison image data with the reference data read from the reference data recording unit 222. For this determination, the reference data about the skin properties recorded in the reference data recording unit 222 is used. The reference data may be any data as long as it can appropriately determine the skin properties. The reference data is not limited to this, but may be, for example, the one shown in FIG. 16 based on the size of the cuticle HO.

The skin groove HM of healthy skin runs vertically and horizontally, but when the skin becomes unhealthy, the skin groove HM exists only in one direction, and in the case of more unhealthy skin, the skin groove HM itself does not exist. That is, the more moisturized and healthy the skin, the finer the texture and the smaller the area of the conical HO. The above-mentioned reference data is for judging the skin condition such as the degree of damage to the skin, malfunction or failure based on such knowledge. The determination unit 223 is based on the comparison image data shown in FIG.
It is determined which of the criteria shown in FIG. 16 the image as shown in FIG. 5 is applicable to and further refer to the inquiry data to generate the diagnostic data.

In the example shown in FIG. 16, based on the skin groove HK and the skin ridge HO, the average area of the skin ridge is 0.1 mm ² or less (corresponding to a uniform mesh groove and skin ridge). )If,
If the skin condition is "good", and the average area of the crust is 0.1 mm ² to 1.0 mm ² (corresponding to the shallow condition in which the skin grooves are recognized as a mesh pattern), "slight skin condition", skin If the groove is seen in only one direction, "slight condition of the skin is inferior",
If no skin groove or crust is observed, "severe poor skin condition"
And judge each. After that, the result of the judgment was obtained,
Diagnostic data is generated based on conclusions such as "good skin condition", "slight skin condition", "medium skin condition", and "severe skin condition". . For example, for a user who has an allergic symptom in the above-mentioned question 3, the rough skin is not only caused by dry skin, but also an allergic symptom. Therefore,
Even if the skin is dry, it is not immediately judged that "the skin tends to be dry", but the effect of rough skin caused by allergies is also taken into consideration, and the degree of dryness of the skin is judged to make a diagnosis data. To generate. Further, the size of the area of the appropriate hill HO varies depending on the age. Therefore, based on the user's age data shown in the upper right of the screen in FIG. 5, “skin condition is good”, “skin condition is poor”, “medium condition is poor”, and “skin condition is severe”. It is possible to generate more accurate diagnostic data by adding a correction to the judgment that "the state is bad".

This diagnostic data is stored in the prescription data generator 22.
Sent to 5. The prescription data generation unit 225 generates prescription data based on this diagnostic data. To generate these prescription data, the prescription standard data about the skin properties recorded in the prescription standard data recording unit 224 is used.
The reference data may be any data as long as it is possible to perform an appropriate and significant prescription for each skin condition. For example, when the diagnostic data indicates "skin condition is good", data indicating that cosmetics a should be used is generated, and the diagnostic data is "skin slightly dry". When the diagnostic data indicates that the skin is dry, the cosmetics c is used, and the judgment is made by a specialist. It may be possible to generate data containing comments that suggest what to ask. Further, for example, for a user who has an allergic symptom in question 3, prescription data for promoting cosmetics d with less irritation to the skin is generated based on this inquiry data so that the allergic symptom does not progress. Alternatively, in addition to the cosmetic d, prescription data is generated so as to proceed with taking a drug for suppressing allergies. The determination unit 22
If the judgment in 3 is subtle, the judgment in the judgment unit 223 may be suspended so that the judgment is left to the judgment of a doctor or other specialist. In this case, the doctor can also generate the following prescription data.

These diagnostic data and prescription data are used by being transmitted from the server S to the terminal T used by the user. That is, the user can grasp his / her own health condition based on the diagnostic data and the prescription data, or can purchase and take the medicine. Then, if necessary, the doctor can make a diagnosis again.

These diagnostic data and prescription data are used, for example, by returning from the server S to the terminal T used by the user. In other words, the user can determine the cosmetics to be purchased based on this prescription data, or ask the expert for further judgment. These diagnostic data and prescription data are used, for example, by returning from the server S to the terminal T used by the user. In other words, the user can determine the cosmetics to be purchased based on this prescription data, or ask the expert for further judgment.

Further, the diagnostic data and the prescription data can be used by passing them from the server S to the beauty product store B or the pharmacy Y. In other words, beauty goods store B
Using the prescription data, the pharmacy Y can provide a direct mail service and can send appropriate cosmetics and medicines. For example, the pharmacy Y can extract a person who is likely to have anxiety about the health of the skin based on the diagnostic data and send a direct mail. Further, the pharmacy Y may use the prescription data to perform a service of delivering the drug m and the drug n indicated therein to the user and a service of inquiring the user of the intention to purchase these drugs by direct mail or the like. it can. By using such diagnostic data and prescription data, both the user and the pharmacy Y can benefit.

The data transfer to the pharmacy Y at this time is as follows.
This can be performed by transmitting from the transmission / reception unit 210 of the server S via the network N. In this case, a terminal (not shown) arranged in the pharmacy Y can receive the information. Also, the passing of this data is
It may be performed with some recording medium interposed, or may be performed with a paper medium or the like ejected from the server S. Further, as in the case of the pharmacy Y, the beauty product store B uses the prescription data to perform a direct mail service for extracting a person who is likely to have anxiety about the skin, an appropriate cosmetics delivery, and the like. The same can be done as in the case of Y. By continuously using the diagnostic system as described above, it is possible to follow the changes in the skin condition of the user, improve the accuracy of skin diagnosis, and recommend appropriate cosmetics and medicines. For example, a user regularly and irregularly uses the above-described diagnostic system to answer questions 1 to 4 to generate diagnostic data and prescription data at each time, and use the data for the user. If the user's situation changes, the diagnostic data and the prescription data also change every moment, so that the diagnostic data and the prescription data that always match the user's state are generated.

In the above embodiment, an example in which prescription data is also used has been described. However, if the prescription data is not needed, it is possible to use only the diagnostic data. In this case, the prescription standard data recording unit 224 and the prescription data generating unit 225 in the server S are unnecessary. In the above examples, the diagnostic system according to the present invention is applied to the diagnosis of skin properties, but it may be applied to hair diagnosis or ptosis, instead of the skin property diagnosis. Blepharoplasty refers to the drooping of the eyelid due to abnormalities in the levator ani muscle or palpebral tendon, which is the muscle that raises the eyelids, or when the eyelid is connected to the eyelid plate. It is a thing. When diagnosing hair or ptosis, an image of the scalp or eye is taken by the imaging device C,
In addition, the questions in the above example of the skin property diagnosis are a scalp question and an eye question, respectively.

[0061]

According to the present invention, easy medical treatment or treatment can be freely received at any time without the convenience of a doctor. In addition to the objective information called image data, the present invention also asks a question that brings out subjective diagnostic information called a chief complaint. Further, since the diagnosis is made based on the objective information and the subjective diagnosis information, the accuracy of the medical examination or treatment can be kept high although the doctor is not required in principle.

[Brief description of drawings]

FIG. 1 is a diagram schematically showing an overall configuration of a diagnostic system according to an embodiment of the present invention.

FIG. 2 is a functional block diagram showing a configuration of a terminal included in the diagnostic system shown in FIG.

FIG. 3 is a functional block diagram showing a configuration of a server included in the diagnostic system shown in FIG.

FIG. 4 is a diagram showing an example of an image displayed on a display device of a terminal when inputting inquiry data.

FIG. 5 is a diagram showing an example of an image displayed on a display device of a terminal when inputting inquiry data.

6 is a diagram showing an example of a display image of a question for a user in the diagnostic system shown in FIG.

FIG. 7 is a diagram showing an example of allocating points to answer results of the question of FIG. 6;

FIG. 8 is a diagram showing a flow of selecting question contents according to the total points of the answers to the questions.

FIG. 9 is a diagram showing an example of allocating points to answer results of a question.

10 is a diagram showing an example of a display image of a question to the user in the diagnostic system shown in FIG.

FIG. 11 is a diagram showing an example of allocating points to answer results of a question.

FIG. 12 is a diagram showing an example of allocation of points to answer results of a question.

FIG. 13 is a diagram showing an example of assigning points to answer results of a question.

14 is a diagram showing an example of a display image of a question for the user in the diagnostic system shown in FIG.

FIG. 15 is a diagram showing an example of an image represented by contrasting image data used for skin property diagnosis.

FIG. 16 is a diagram for explaining an example of the contents of reference data used in skin property diagnosis.

[Explanation of symbols]

T terminal T1 display device T2 input device C imaging device S server (information processing device) N network B beauty goods store Y pharmacy MT recording medium MS recording medium 110 Image data reception unit 120 Interview data reception section 130 control unit 140 transmitter / receiver 150 Display device management unit 210 Transmitter / receiver 220 Diagnostic Department 221 Image processing unit 222 Reference data recorder 223 Judgment unit 224 Prescription standard data recording section 225 Prescription data generator

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) A61B 5/00 A61B 5/00 G (72) Inventor Yumi Sasaki 3-63-1, Okihama, Tokushima City, Tokushima Prefecture Limited Company Mu Giken

Claims (9)

[Claims] 1. Image data obtained by image pickup from a predetermined image pickup means capable of picking up an image pickup target position set at a predetermined position of a user's body, and includes character information as well as diagnostic contents. A diagnostic system including a terminal device capable of receiving medical inquiry data, and an information processing device connectable to the terminal device via a network, wherein the terminal device is a user. To the information processing apparatus via the network, the image data generated by imaging the imaging target position by the imaging unit, and the inquiry data including the text information regarding the diagnostic content of the imaging target position. The information processing device includes a transmitting unit for transmitting the image data and the inquiry data received from the terminal device. Performs predetermined diagnosis Zui, and a diagnostic means for generating diagnostic data for the diagnosis, the diagnostic system. 2. A diagnostic means for performing a predetermined diagnosis on the basis of image data received via a network and inquiry data relating to the diagnosis content and including predetermined character information, and generating diagnostic data about the diagnosis result. A terminal device that is connectable to an information processing device provided through the network, and is capable of capturing an image capturing target position set at a predetermined position of the user's body from a predetermined image capturing unit. , Image data generated by the user capturing an image of the image capturing target position using the image capturing means, and inquiry data including textual information regarding the diagnostic content of the image capturing target position can be accepted. At the same time, the image data and the inquiry data are provided with a transmission means capable of transmitting them to the information processing device via the network. That, the terminal device. 3. The terminal device according to claim 2, wherein the inquiry data includes a main complaint by the user regarding the imaging target position. 4. The diagnostic means records an image processing means capable of generating comparison image data by performing a predetermined image processing on the image data, and reference data for diagnosis. 3. The reference data recording means, and the determination means for performing the predetermined diagnosis by comparing the comparison image data and the inquiry data with the reference data. Terminal device. 5. The reference data includes data necessary for performing a plurality of types of diagnoses, and the image data is added with correspondence information indicating which diagnosis the image corresponds to. The terminal device according to claim 4, wherein the determination unit is configured to perform a diagnosis of a type indicated by the correspondence information, based on the correspondence information received together with the image data. 6. The terminal device displays a predetermined question to the user via a predetermined display means, and inputs the predetermined question from the user to the terminal device via a predetermined input means. The inquiry data is generated by the terminal device based on the answer result, and the question is a compulsory question displayed to all users, and a response to the compulsory question is given. The terminal device according to claim 2, wherein a selection question that is selectively displayed is set. 7. A diagnostic means for performing a predetermined diagnosis based on image data received via a network and inquiry data relating to the diagnosis content and including predetermined character information, and generating diagnostic data about the diagnosis result. A method performed by a terminal device that is connectable to the information processing device provided through the network, comprising capturing an image capturing target position set at a predetermined position of a user's body. Image data generated by a user capturing the image capturing target position using the image capturing unit and inquiry data including character information regarding the diagnostic content of the image capturing target position are received from a predetermined image capturing unit that can be used. And a step of transmitting the image data and the inquiry data to the information processing device via the network. , How to send diagnostic information. 8. A diagnostic means for performing a predetermined diagnosis based on image data received via a network and inquiry data relating to the diagnosis content and including predetermined character information and generating diagnostic data about the diagnosis result. A computer-readable program for causing a terminal device configured to include a computer, which is connectable to an information processing device including a computer, to function as a diagnostic information transmission device. The recording medium is recorded in various forms, wherein the program causes the computer to capture an image capturing target position set at a predetermined position of the user's body from a predetermined image capturing unit. Image data generated by imaging the imaging target position using the Recording medium processing for accepting interview data including the character information, the image data and the inquiry data, processing to be transmitted to the information processing apparatus through the network, but to perform as well as. 9. A diagnosis for performing a predetermined diagnosis based on image data received via a network and inquiry data regarding diagnosis contents and including predetermined character information, and generating diagnosis data about the diagnosis result. A program for causing a terminal device including a computer, which is connectable to an information processing device including means, via the network to function as a diagnostic information transmission device. Generated by the user capturing an image of the image capturing target position using the image capturing unit from a predetermined image capturing unit capable of capturing an image capturing target position set at a predetermined position of the user's body on the computer. A process of receiving image data and inquiry data relating to the diagnostic content of the imaging target position and including character information; A program for performing processing of transmitting data and the inquiry data to the information processing device via the network.