JP2020008911A - Advertisement presentation method, and advertisement presentation system - Google Patents

Abstract

To provide an advertisement presentation system which can present an appropriate advertisement to users.SOLUTION: An advertisement presentation system S comprises: an image recognition unit 20 which recognizes an image including a user's teeth and tongue photographed by a camera 10 of a personal digital assistant 1; a first state recognition unit 21 which recognizes the state of dental health, on the basis of the image; a second state recognition unit 24 which recognizes the state of the tongue, and recognizes the user's condition and the state of the physical constitution on the basis of the state; an advertisement acquisition unit 25 which acquires advertisements on the basis of the user's condition and the state of the physical constitution; and an information presentation unit 26 which presents the state of the dental health together with the advertisements, on a touch panel 11 of the personal digital assistant 1.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an advertisement presentation method and an advertisement presentation system for presenting an advertisement suitable for a user based on an acquired image of the user.

  2. Description of the Related Art Conventionally, there has been known a diagnostic system which captures an image of a user's oral cavity to acquire an image, diagnoses a state of the user's oral cavity based on the acquired image, and notifies the user of the diagnostic result. ing. As a diagnostic system of this kind, advertisement of information on the nearest hospital, information on treatment and equipment for treatment, etc. is provided to the user according to the diagnosis result or according to a request from the user. What is presented is known (for example, see Patent Document 1).

JP 2009-205330 A

  However, the conventional diagnostic system as described in Patent Literature 1 diagnoses the internal state of the oral cavity of the user, and thus the advertisement presented is only related to the oral cavity. For this reason, the content of the presented advertisement is limited, and there is a problem that it is difficult for the system provider to solicit an advertisement from various types of businesses.

  On the other hand, if the content of the presented advertisement is not limited, there is a possibility that a completely unrelated advertisement may be presented to the user. As a result, by presenting the advertisement, there is a fear that a user who uses the diagnostic system may be stressed or uncomfortable.

  The present invention has been made in view of the above points, and an object of the present invention is to provide an advertisement presentation method and an advertisement presentation system that can present an appropriate advertisement to a user.

The advertisement presentation method of the present invention includes:
An image recognition unit recognizes a first image that is an image of a first region of the body of the user and a second image that is an image of a second region of the body of the user from the image of the body of the user. An image recognition process;
A first state recognition step in which a first state recognition unit recognizes a first state that is a state relating to the first region of the user based on the first image;
A second state recognition unit that recognizes a state related to the second area based on the second image, and that is a state related to at least one of a physical constitution and a physical condition of the user based on the state related to the second area; A second state recognition step of recognizing the two states;
An advertisement acquisition step in which an advertisement acquisition unit acquires an advertisement determined according to the second state;
An information presenting step of presenting the first state to the user after presenting the advertisement to the user or simultaneously with presenting the advertisement.

  Here, the “advertisement” includes various advertisements that can notify the user of information, such as advertisements by voice, in addition to advertisements by images or moving images.

  Further, “based on the state of the second area” and “recognize the second state” mean that the state of health of the second area (eg, color, skin state, etc.) is based on a predetermined rule. To obtain or calculate the second state. For example, by referring to a data table that defines the relationship between the health state of the second area and the second state, the method of acquiring the second state, or using a predetermined algorithm to change the health state of the second area A method for calculating the second state based on the second state, a method for presenting the image of the second area to the doctor and estimating the second state, and the like are given.

  Further, “determined corresponding to the second state” means to determine based on a predetermined rule with reference to the second state. For example, by referring to a data table that defines the relationship between the content of the second state and the advertisement, a method of acquiring an advertisement based on the content of the second state, using a predetermined algorithm, A method of acquiring an advertisement based on the advertisement.

  The “state relating to constitution and physical condition” includes states relating to constitution and physical condition determined based on not only Western medicine but also Chinese medicine or Eastern medicine.

  As described above, according to the advertisement presentation method of the present invention, the first state related to the first area (that is, the state of the area originally requested by the user for diagnosis) is recognized, and the image of the first area is captured. Is also recognized on the basis of the image of the second area included in the second state regarding at least one of the user's constitution and physical condition. Then, an advertisement to be presented to the user is obtained based on the second state.

  As a result, the user is presented with the first state related to the first area for which the user wants to make a diagnosis and the advertisement determined in correspondence with the second state. That is, the advertisement presented to the user by the advertisement presentation method is not conscious of the user of the system implementing the method (that is, not related to the first area), Are more likely to be useful to or more likely to match interests (ie, appropriate for the user).

  As a result, the provider of the system using this advertisement presentation method can widely recruit advertisements from businesses that operate in the second area in addition to businesses that operate in the first area. become able to. Further, since the advertisement presented to the user is appropriate for the user, the user is less likely to feel stress and discomfort due to the presentation of the advertisement.

In the advertisement presentation method of the present invention,
A question presenting unit for recognizing a state related to the second area based on the second image, and presenting a question based on the state related to the second area;
An answer recognition unit comprising an answer recognition step of recognizing an answer to the question,
In the second state recognition step, a second state recognition unit recognizes a state related to the second area based on the second image, and performs the use based on the state related to the second area and the answer. It is preferable to recognize a second state which is a state relating to at least one of the physical constitution and physical condition of the person.

  It may be difficult to accurately grasp the user's constitution or physical condition only with information on the second region recognized based on the image. Thus, as described above, by asking a question regarding the second area and referring to the answer, an advertisement presented to the user can be made more appropriate.

In the advertisement presentation method of the present invention,
The first region is the user's teeth and gums,
The second region is a region including at least one of the user's lips, skin around the lips, and tongue,
Preferably, the advertisement is an advertisement for a herbal medicine related to the second state.

  Here, the “skin around the lips” refers to, for example, skin in an area that can be photographed together with teeth and gums, such as a chin, cheek, neck, ear, and nose.

  With this configuration, it is possible to naturally photograph the first region and the second region when photographing an image. Therefore, for a user using the system using the advertisement presentation method of the present invention, Stress and discomfort are less likely to be imparted.

  The combination of the target user's body regions in the advertisement presentation method of the present invention may be any region that can be simultaneously photographed by an image acquisition unit such as a camera. For example, in addition to the above-described regions, the skin around the eyes and the eyes or the skin of the forehead, the hands and nails, the hair and the skin around the ears, and the like are also included.

Further, the advertisement presenting system of the present invention comprises:
An image recognition unit that recognizes a first image that is an image of a first area of the body of the user from an image of the body of the user, and a second image that is an image of a second area of the body of the user;
A first state recognition unit that recognizes a first state that is a state relating to the first region of the user based on the first image;
A second state that recognizes a state related to the second area based on the second image, and that recognizes a second state that is a state related to at least one of the user's constitution and physical condition based on the state related to the second area; A state recognition unit,
An advertisement acquisition unit that acquires an advertisement determined according to the second state;
An information presenting unit that presents the first state after presenting the advertisement or simultaneously with presenting the advertisement to the user.

FIG. 1 is a schematic diagram illustrating a schematic configuration of an advertisement presentation system according to an embodiment. FIG. 2 is a block diagram showing the configuration of the advertisement presentation system of FIG. 1. 3 is a flowchart illustrating processing performed by the advertisement presentation system in FIG. 1.

  Hereinafter, an advertisement presentation system S according to an embodiment will be described with reference to the drawings. The advertisement presenting system S of the present embodiment uses the advertisement presenting system of the present invention to diagnose the user's teeth and gums (understand the health condition), to advertise the teeth, and to make the user's constitution and physical condition. It is used as a system for presenting advertisements on Chinese herbal medicines that are considered to be effective in improving the quality of medicine.

  That is, the advertisement presenting system S wants to advertise about a tooth and a gum (for example, an operator who handles a product related to a tooth such as a toothbrush) and an advertisement about a Chinese medicine. Of the multiple advertisements provided by the business operator, those that are likely to be useful to the user or those that are likely to match the interest (that is, appropriate) are acquired, and the This is for presenting to the user at an appropriate timing together with the tooth diagnosis result.

  However, the advertisement presentation method and advertisement presentation system of the present invention are for presenting health information and advertisements based on a plurality of parts that can be simultaneously photographed by a camera or the like of a portable information terminal. And a system for presenting an advertisement related to Chinese herbal medicine.

  Therefore, as the body region in the advertisement presentation method and the advertisement presentation system of the present invention, for example, in addition to teeth and lips or skin around lips, eyes and skin around eyes or forehead skin, hands and nails, hair And the skin around the ears. In addition, the advertisement other than the advertisement related to the diagnosis target is not limited to the advertisement related to Chinese herbal medicine, but may be any advertisement that is determined in accordance with at least one of a user's constitution and physical condition (a second state described later). Good.

  For example, while diagnosing the condition of the hair, recognizing the condition of the skin photographed at the same time, estimating the type of stress received by the user based on the recognized condition of the skin, and effectively treating the stress. An advertisement of a special fragrance (specifically, a bath additive, aroma oil, etc.) may be presented.

  Note that the “advertisement” in the present embodiment is an image or a moving image. Including advertising.

  First, the configuration of the advertisement presentation system S will be described with reference to FIGS.

  As shown in FIG. 1, the advertisement table instruction system S includes a mobile information terminal 1 (information processing terminal) such as a smartphone owned by a user of the system and a server installed by a system provider such as an advertising agency. And 2. The portable information terminal 1 and the server 2, and the server 2 and the business terminal 3 are connected to each other via an Internet line or the like so as to be able to communicate with each other.

  The mobile information terminal 1 presents a camera 10 (image obtaining unit) for obtaining an image, a question and answer, a first state, an advertisement, and the like, which will be described later, to the user. A touch panel 11 (input / output unit) for receiving input;

  The camera 10 captures the user's teeth and gums (first region), the lips, the skin around the lips and the tongue (second region), and acquires a still image in which they are simultaneously captured as a two-dimensional image. It is configured to be possible.

  Note that the image acquired by the image acquisition unit of the present invention may be an image capable of recognizing a first image that is an image of the first area and a second image that is an image of the second area by an image recognition unit 20 described below. I just need. For example, a three-dimensional image may be used instead of a two-dimensional image. When the image recognizing unit is capable of cutting out a still image from a moving image and recognizing the still image, the image obtaining unit may capture the moving image.

  Further, instead of the touch panel 11 which is an input / output unit in which the output unit and the input unit are integrated, independent output units and input units may be employed. Specifically, a display as an output unit and a keyboard, a microphone, or the like may be employed as an input unit.

  As shown in FIG. 2, the server 2 includes an image recognition unit 20, a first state recognition unit 21, a question presentation unit 22, and an answer recognition unit 23 as functions implemented by the implemented hardware configuration or program. , A second state recognition unit 24, an advertisement acquisition unit 25, an information presentation unit 26, and an advertisement storage unit 27.

  Based on the image acquired by the camera 10, the image recognition unit 20 includes a first image that is an image of the teeth and gums (first region) of the user's body, the lips, the skin around the lips, and the tongue (the first A second image which is an image of (two regions) is recognized.

  The first state recognizing unit 21 recognizes the state of the user's teeth and gums based on the first image recognized by the image recognizing unit 20, and can estimate the health state of the teeth and gums (the first state). ) And its severity.

  The question presentation unit 22 recognizes the state of the lips of the user, the skin around the lips, and the tongue (the state related to the second area) based on the second image recognized by the image recognition unit 20. Thereafter, a question to be presented to the user is determined based on the recognized state, and the determined question is presented to the user via the touch panel 11.

  Here, a method for determining a question can be arbitrarily determined by a system designer. For example, a method of determining a question by referring to a data table in which the relationship between the recognized state and the question is defined in advance, a method of determining a question based on the recognized state using a predetermined algorithm, and the like. Can be

  The content of the question can be arbitrarily determined by the system designer. For example, in the case of a system for presenting an advertisement relating to a herbal medicine that is considered to be effective for improving the user's constitution and physical condition, such as the advertisement presenting system S of the present embodiment, from the viewpoint of Kampo or Oriental medicine The content of the question can be determined.

  Specifically, for example, the condition of the skin on the forehead (black or not), the condition of the skin under the eyes (black or not), the condition of the skin on both sides of the face (dented or black or not), the tongue State (white or not), lip state (purple or not), nail state (whether there is unevenness) and hand state (whether the joint is bent) are based on the second image. Can be recognized.

  Although it is suspected that the liver, stomach, and kidney are malfunctioning depending on the state (the state related to the second region), it is impossible to determine whether the malfunction is actually caused by the state alone. That is, it is difficult to accurately grasp the user's constitution or physical condition.

  Therefore, when the liver, stomach, and kidney are suspected to be malfunctioning due to these conditions, the question presenting unit 22 asks a question that can obtain information for determining whether or not the malfunction is actually occurring. Is configured.

  Specifically, questions such as whether to eat raw or cold food well, whether or not the feet are swollen when getting up in the morning, the frequency of drinking, the frequency of sexual life, etc. are presented. According to the answers to these questions, the state of the tongue (smoothness and thickness of the surface), the smell of the oral cavity, the smell of the body, and the like that cannot be recognized from the second image can be estimated.

  Then, as described later, the second state recognizing unit 24 recognizes the second state with reference to the information recognized based on the second image and the information recognized based on the answer to the question.

  The answer recognizing unit 23 recognizes an answer input by the user via the touch panel 11 to the question presented by the question presenting unit 22.

  The second state recognition unit 24 recognizes the state of the user's lips, the skin around the lips and the tongue (the state relating to the second region) based on the second image recognized by the image recognition unit 20, and the state, In addition, the state (second state) related to the user's constitution and physical condition, which can be estimated from the answer recognized by the answer recognizing unit 23, and the severity thereof are recognized.

  Note that, in the advertisement presentation system S, the first state recognition unit 21 and the second state recognition unit 24 refer to the comparison result between the sample image obtained in advance and the image recognized by the image recognition unit 20 to perform the first state recognition. The state and the second state are recognized.

  Further, in the present embodiment, the “state relating to constitution and physical condition” includes not only western medicine but also states relating to constitution and physical condition determined based on Chinese medicine or Eastern medicine.

  However, the recognition of the first state and the second state in the present invention does not necessarily need to be performed with reference to the comparison result of the images, but may be performed based on the image recognized by the image recognition unit. For example, a configuration may be adopted in which a health condition is usually recognized by comparing images, and the diagnosis is performed by transmitting the image to a doctor only when recognition is difficult.

  Further, in the advertisement presentation system S of the present embodiment, in order to make the advertisement presented to the user more appropriate, the user is asked a question and refers to the answer when recognizing the second state. It is configured as follows. However, the advertisement presentation system of the present invention is not limited to such a configuration. For example, when the second state can be recognized with high accuracy by an image, the presentation of the question and the recognition of the answer may be omitted. Good. In this case, the question presentation unit and the answer recognition unit may be omitted.

  Here, the “severity” is a value recognized based on, for example, a health condition, and is determined based on, for example, the weight of a medical condition. The magnitude of the severity can be arbitrarily determined by a system designer or the like.

  The method for determining the severity for the first state and the second state can also be arbitrarily determined by the system designer. For example, a method of obtaining a severity by referring to a data table in which the relationship between the recognized state and the severity is defined in advance, a method of obtaining a severity based on the recognized state using a predetermined algorithm, and the like. No.

  The advertisement acquisition unit 25, based on the first state and the second state recognized by the first state recognition unit 21 and the second state recognition unit 24, performs an advertisement (for a tooth and a gum determined corresponding to the first state). (1st advertisement) and the advertisement (2nd advertisement) about the Chinese medicine determined according to the 2nd state are acquired.

  Here, “determined corresponding to a state” refers to determination based on a predetermined rule with reference to the first state or the second state. For example, referring to a data table that defines the relationship between the content of the state and the advertisement, a method of acquiring an advertisement based on the content of the state, or using a predetermined algorithm to acquire an advertisement based on the content of the state And the like.

  The information presenting unit 26 compares the severity of the first state with the severity of the second state, and according to the comparison result, the presentation time of the first advertisement and the presentation time of the second advertisement. The presentation order and the size of those presentation areas are determined. In addition, the information presenting unit 26 presents the advertisement on the touch panel 11 of the portable information terminal 1 and then presents the first state in accordance with the determined content.

  The relationship between the presentation time and the comparison result of the severity may be appropriately set. For example, the presentation time may be longer as the severity is higher. Moreover, you may make it show later, so that a severity is large. Moreover, you may repeatedly show the thing whose severity is large.

  Note that, in the advertisement presentation system S of the present embodiment, the first state recognition unit 21 and the second state recognition unit 24 recognize the respective severity levels as well as the first state and the second state. This is because the information presentation unit 26 varies the presentation time and the presentation order of each advertisement to be presented to the user according to the severity (ie, the degree of usefulness to the user).

  However, when the presentation time of the advertisement is not variable (for example, when there is only one type of advertisement), the presentation time cannot be changed, so that the severity is not recognized and the comparison of the severity is not performed. May not be performed.

  In addition, as a method for changing the time for presenting the advertisement, when the advertisement does not change over time such as a still image, the time for presenting the advertisement may be simply changed. Further, when the advertisement has a temporal change such as a moving image, a plurality of advertisements having different times are acquired for one health condition at the time of acquiring the advertisement, and the advertisement is determined from among them. An advertisement having a length corresponding to the presentation time may be selected.

  In addition, the result of the comparison of the severity may be reflected in the presentation area in addition to the presentation time. Specifically, in the case where a display area on the touch panel 11 is divided and a plurality of advertisements are displayed at the same time, the higher the severity, the larger the display may be.

  The advertisement storage unit 27 stores an advertisement uploaded from the business terminal 3 owned by the business. The advertisement storage unit 27 may be provided outside the server 2 (another server or the like). Further, the advertisement storage section 27 may be omitted, and the information presentation section 26 may acquire an advertisement from outside as needed.

  Next, a process performed by the advertisement presenting system S (the advertisement presenting method of the present invention) will be described with reference to FIGS. FIG. 3 is a flowchart illustrating a process performed by the advertisement presentation system S.

  In the advertisement presentation system S of the present embodiment, a plurality of advertisements that can be presented from the business terminal 3 are uploaded and stored in the advertisement storage unit 27 before the processing for presenting the diagnosis result and the advertisement. ing.

  In the processing performed by the advertisement presentation system S, first, the camera 10 of the portable information terminal 1 captures the lips, the skin around the lips, and the tongue (the second area) together with the user's teeth and gums (the first area). Then, a still image in which they are simultaneously captured is obtained as a two-dimensional image (FIG. 3 / STEP 01).

  Next, based on the image acquired by the camera 10, the image recognizing unit 20 of the server 2 generates a first image that is an image of the teeth and gums (first region) of the user's body, and the lips and the periphery of the lips. A second image, which is an image of the skin and tongue (second region), is recognized (FIG. 3 / STEP 02 (image recognition step)).

  Next, based on the second image recognized by the image recognition unit 20, the question presentation unit 22 of the server 2 recognizes the state of the user's lips, the skin around the lips, and the tongue (the state related to the second area). A question is determined based on the state, and the determined question is presented to the user via the touch panel 11 (FIG. 3 / STEP 03 (question presentation step)).

Next, the answer recognizing unit 23 of the server 2 recognizes the answer input by the user via the touch panel 11 for the question presented by the question presenting unit 22 (FIG. 3 / STEP 04 (answer recognizing step)).
Next, the first state recognizing unit 21 of the server 2 recognizes the state of the user's teeth and gums based on the first image recognized by the image recognizing unit 20, and estimates the health related to the teeth and gums from the state. (First state) and its severity (FIG. 3 / STEP 05 (first state recognition step)).

  Next, based on the second image recognized by the image recognition unit 20, the second state recognition unit 24 of the server 2 changes the state of the lips of the user, the skin around the lips, and the tongue (the state related to the second area). Recognize the state (second state) of the user's constitution and physical condition, which can be estimated from the answer recognized by the answer recognizing unit 23, and the severity thereof (FIG. 3 / STEP06 (second state)). Recognition step)).

  Next, the advertisement acquisition unit 25 of the server 2 is determined corresponding to the first state based on the first state and the second state recognized by the first state recognition unit 21 and the second state recognition unit 24. An advertisement relating to the teeth and gums (first advertisement) and an advertisement relating to the herbal medicine determined corresponding to the second state (that is, the herbal medicine related to the second state) (second advertisement) are acquired (FIG. 3). / STEP07 (advertisement acquisition step)).

  Next, the information presenting unit 26 of the server 2 compares the severity of the first state with the severity of the second state, and presents the presentation time of the first advertisement and the second advertisement according to the comparison result. And the presentation order (FIG. 3 / STEP08).

  Next, the information presenting unit 26 sequentially presents those advertisements on the touch panel 11 of the portable information terminal 1, presents the first state, and ends the current processing (FIG. 3 / STEP09 (information presentation)). Process)).

  As described above, the advertisement presentation system S recognizes the first state (that is, the state of the region where the user originally wants to make a diagnosis) concerning the teeth and gums (the first region) and recognizes the first state. Based on the images of the lips, the skin around the lips, and the tongue (second region) included in the image of the region, the second state related to the user's constitution and physical condition is also recognized. Then, a second advertisement, which is an advertisement related to the Chinese herbal medicine corresponding to the second state, is obtained.

  As a result, an advertisement relating to the user's constitution and physical condition is presented to the user together with the first state which is the health state of the teeth and gums that the user wants to diagnose. That is, the advertisement presented to the user by the advertisement presentation system S is used while being unaware of the user of the system performing the method (that is, not related to the first area). Are more likely to be useful to the person or more likely to match their interests.

  As a result, the provider of the advertisement presentation system S can widely recruit advertisements from businesses that are engaged in the business related to herbal medicine as well as businesses that are engaged in the business related to teeth and gums. Further, since the advertisement presented to the user is appropriate for the user, the user is less likely to feel stress and discomfort due to the presentation of the advertisement.

  Although the illustrated embodiment has been described above, the present invention is not limited to such an embodiment.

  For example, in the above-described embodiment, the advertisement table instruction system S diagnoses the user's teeth and gums, and determines the advertisement and the gums corresponding to the advertisement and the state of the lips, skin and tongue around the lips. It is configured as a system for presenting advertisements related to herbal medicines. This is because it is relatively easy to acquire images of the lips, the skin around the lips, and the tongue together with the photographing of the teeth and gums.

  However, the advertisement presentation method and the advertisement presentation system of the present invention are not limited to such a configuration, and based on the first region of the user's body and the second region that can be photographed together with the first region, What is necessary is just to perform the recognition of the state regarding either one of the constitution and the physical condition of the user and the presentation of the advertisement.

  For example, the first region may be an ear and the second region may be hair. Further, the first state may be a state relating to the eyes, and the second state may be a constitution and a physical condition state estimated from the skin around the eyes.

  In the above-described embodiment, a plurality of regions including the lips, the skin around the lips, and the tongue are used as the second regions. However, the second region of the present invention may use only one region. For example, only the tongue may be used. When the second region is a plurality of regions as in the above embodiment, the plurality of second regions need not necessarily be adjacent to each other. For example, the skin around the tongue and eyes may be the second region.

  In the above embodiment, the first advertisement relating to the teeth and gums relating to the first state and the second advertisement relating to the herbal medicine relating to the second state are sequentially presented.

  However, the advertisement presenting method and the advertisement presenting system of the present invention are not limited to such a configuration, and may be any method that presents an advertisement relating to at least the first state and the second state.

  For example, similarly to the advertisement presentation system S of the above-described embodiment, in the case of a system that recognizes the physical condition and constitution of the user based on the lips, the skin and the tongue around the lips, together with the diagnosis of the teeth, the teeth and gums (I.e., the first advertisement), but only the advertisement (i.e., the second advertisement) relating to the herbal medicine regarding the physical condition and constitution of the user estimated based on the lips, the skin around the lips, and the tongue. May be configured to be presented. In the case of such a configuration, it may be configured to present the advertisement of the Chinese medicine at the same time as presenting the tooth diagnosis result. If two or more second states can be recognized together with the first state, two or more second advertisements may be presented. Further, after the diagnosis result related to the first area, the second advertisement, or the first advertisement and the second advertisement may be presented.

  In the above embodiment, the advertisement presenting system S for implementing the advertisement presenting method of the present invention is configured by the server 2 and the portable information terminal 1. However, the advertisement presentation method of the present invention cannot be configured only by the system configured as described above.

  For example, an information processing terminal having a photographing function may be installed at a store or the like, and the system may be configured only with the information processing terminal. Alternatively, each processing unit and each information storage unit may be provided in The system may be configured with only information terminals. Conversely, in the above embodiment, the processing of recognizing the health condition and acquiring the advertisement, which has been performed by one server, may be configured to be performed using different servers that are independent from each other.

DESCRIPTION OF SYMBOLS 1 ... Portable information terminal (information processing terminal), 2 ... Server, 3 ... Business terminal, 10 ... Camera (image acquisition part), 11 ... Touch panel (input / output part), 20 ... Image recognition part, 21 ... First State recognition unit, 22: question presentation unit, 23: answer recognition unit, 24: second state recognition unit, 25: advertisement acquisition unit, 26: information presentation unit, 27: advertisement storage unit.

Claims (4)

An image recognition unit recognizes a first image that is an image of a first region of the body of the user and a second image that is an image of a second region of the body of the user from the image of the body of the user. An image recognition process;
A first state recognition step in which a first state recognition unit recognizes a first state that is a state relating to the first region of the user based on the first image;
A second state recognition unit that recognizes a state related to the second area based on the second image, and that is a state related to at least one of a physical constitution and a physical condition of the user based on the state related to the second area; A second state recognition step of recognizing the two states;
An advertisement acquisition step in which an advertisement acquisition unit acquires an advertisement determined according to the second state;
An information presenting step, comprising: an information presenting step of presenting the first state after or after presenting the advertisement to the user or simultaneously with presenting the advertisement to the user. The advertisement presentation method according to claim 1,
A question presenting unit for recognizing a state related to the second area based on the second image, and presenting a question based on the state related to the second area;
An answer recognition unit comprising an answer recognition step of recognizing an answer to the question,
In the second state recognition step, a second state recognition unit recognizes a state related to the second area based on the second image, and performs the use based on the state related to the second area and the answer. An advertisement presentation method comprising recognizing a second state which is a state relating to at least one of a physical condition and a physical condition of a person. In the advertisement presentation method according to claim 1 or 2,
The first region is the user's teeth and gums,
The second region is a region including at least one of the user's lips, skin around the lips, and tongue,
The advertisement presentation method, wherein the advertisement is an advertisement for a Chinese medicine related to the second state. An image recognition unit that recognizes a first image that is an image of a first area of the body of the user from an image of the body of the user, and a second image that is an image of a second area of the body of the user;
A first state recognition unit that recognizes a first state that is a state related to the first region of the user based on the first image;
A second state that recognizes a state related to the second area based on the second image, and that recognizes a second state that is a state related to at least one of the user's constitution and physical condition based on the state related to the second area; A state recognition unit,
An advertisement acquisition unit that acquires an advertisement determined according to the second state;
An advertisement presentation system, comprising: an information presentation unit that presents the first state after the advertisement is presented to the user or at the same time as the advertisement is presented.