WO2019150607A1 - Advertisement presentation method and advertisement presentation system - Google Patents

Advertisement presentation method and advertisement presentation system Download PDF

Info

Publication number
WO2019150607A1
WO2019150607A1 PCT/JP2018/028465 JP2018028465W WO2019150607A1 WO 2019150607 A1 WO2019150607 A1 WO 2019150607A1 JP 2018028465 W JP2018028465 W JP 2018028465W WO 2019150607 A1 WO2019150607 A1 WO 2019150607A1
Authority
WO
WIPO (PCT)
Prior art keywords
state
advertisement
image
user
region
Prior art date
Application number
PCT/JP2018/028465
Other languages
French (fr)
Japanese (ja)
Inventor
樹程 李
Original Assignee
ＭｅｄｉＤｏｃ Ｓｅａｒｃｈ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2018014506A external-priority patent/JP6371019B1/en
Priority claimed from JP2018126509A external-priority patent/JP7289491B2/en
Application filed by ＭｅｄｉＤｏｃ Ｓｅａｒｃｈ株式会社 filed Critical ＭｅｄｉＤｏｃ Ｓｅａｒｃｈ株式会社
Priority to US16/963,621 priority Critical patent/US20210065248A1/en
Priority to CN201880087939.2A priority patent/CN111656382A/en
Publication of WO2019150607A1 publication Critical patent/WO2019150607A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/22—Social work
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/90—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to alternative medicines, e.g. homeopathy or oriental medicines
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0269—Targeted advertisements based on user profile or attribute
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0269—Targeted advertisements based on user profile or attribute
    • G06Q30/0271—Personalized advertisement
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Medical Informatics (AREA)
  • Strategic Management (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Biomedical Technology (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Data Mining & Analysis (AREA)
  • Radiology & Medical Imaging (AREA)
  • Pathology (AREA)
  • Databases & Information Systems (AREA)
  • Tourism & Hospitality (AREA)
  • Alternative & Traditional Medicine (AREA)
  • Pharmacology & Pharmacy (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Resources & Organizations (AREA)
  • Child & Adolescent Psychology (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

Provided is an advertisement presentation system with which it is possible to present appropriate advertisement to a user. An advertisement presentation system S comprises: an image recognition unit 20 that recognizes an image captured by a camera 10 of a portable information terminal 1, the image including the teeth and tongue of a user; a first state recognition unit 21 that recognizes the state of tooth health on the basis of the image; a second state recognition unit 24 that recognizes the state of the tongue and recognizes, on the basis of the state, the state of physical condition and bodily constitution of the user; an advertisement acquisition unit 25 that acquires an advertisement on the basis of the physical condition and bodily constitution of the user; and an information presentation unit 26 that presents the state of tooth health, together with the advertisement, on a touch panel 11 of the portable information terminal 1.

Description

広告提示方法、及び、広告提示システムAdvertisement presenting method and advertisement presenting system
　本発明は、取得した利用者の画像に基づいて、その利用者に適した広告を提示するための広告提示方法、及び、広告提示システムに関する。 The present invention relates to an advertisement presenting method and an advertisement presenting system for presenting an advertisement suitable for the user based on the acquired user image.
　従来、利用者の口腔の内部を撮影して画像を取得し、その取得した画像に基づいて利用者の口腔の内部の状態を診断し、その診断結果を利用者に通知する診断システムが知られている。この種の診断システムとしては、診断結果に応じて、又は、利用者からの要望に応じて、その利用者に対し、最寄りの病院の情報、治療のための処置及び器具の情報等の広告を提示するものが知られている（例えば、特許文献１参照。）。 2. Description of the Related Art Conventionally, there has been known a diagnostic system that captures an image of the inside of a user's oral cavity, acquires an image, diagnoses the internal state of the user's oral cavity based on the acquired image, and notifies the user of the diagnosis result. ing. As this kind of diagnostic system, according to the diagnosis result or according to the request from the user, advertisements such as information on the nearest hospital, information on treatment and equipment for treatment, etc. are sent to the user. What is presented is known (see, for example, Patent Document 1).
特開２００９－２０５３３０号公報JP 2009-205330 A
　しかし、特許文献１に記載のような従来の診断システムは、利用者の口腔の内部の状態を診断するものであるので、提示される広告も口腔に関するもののみとなっていた。そのため、提示される広告の内容が制限され、システムの提供者にとっては、多種の事業者から広告を募ることが難しいという問題があった。 However, since the conventional diagnosis system as described in Patent Document 1 is for diagnosing the internal state of the user's oral cavity, the presented advertisement is only related to the oral cavity. Therefore, the content of the presented advertisement is limited, and there is a problem that it is difficult for the system provider to solicit advertisements from various business operators.
　一方、仮に提示される広告の内容を制限しなかった場合には、利用者に対して全く関係のない広告が提示されてしまうおそれがある。その結果、その広告を提示することで、その診断システムを使用する利用者に対し、ストレス、違和感を与えてしまうおそれがあった。 On the other hand, if the content of the advertisement to be presented is not limited, there is a possibility that an advertisement that has nothing to do with the user will be presented. As a result, the presentation of the advertisement may cause stress and discomfort to the user who uses the diagnosis system.
　本発明は以上の点に鑑みてなされたものであり、利用者に対し、適切な広告を提示することのできる広告提示方法、及び、広告提示システムを提供することを目的とする。 The present invention has been made in view of the above points, and an object thereof is to provide an advertisement presenting method and an advertisement presenting system capable of presenting an appropriate advertisement to a user.
　本発明の広告提示方法は、
　画像認識部が、利用者の身体の画像から前記利用者の身体の第１領域の画像である第１画像、及び、前記利用者の身体の第２領域の画像である第２画像を認識する画像認識工程と、
　第１状態認識部が、前記第１画像に基づいて、前記利用者の前記第１領域に関する状態である第１状態を認識する第１状態認識工程と、
　第２状態認識部が、前記第２画像に基づいて、前記第２領域に関する状態を認識し、該第２領域に関する状態に基づいて、前記第１領域そのもの以外に関する状態である第２状態を認識する第２状態認識工程と、
　広告取得部が、前記第２状態に対応して定められた広告を取得する広告取得工程と、
　情報提示部が、前記利用者に、前記広告を提示した後に、又は、前記広告を提示すると同時に、前記第１状態を提示する情報提示工程とを備えていることを特徴とする。 The advertisement presenting method of the present invention includes:
An image recognition unit recognizes a first image that is an image of the first region of the user's body and a second image that is an image of the second region of the user's body from the image of the user's body. An image recognition process;
A first state recognizing step for recognizing a first state which is a state relating to the first area of the user based on the first image;
A second state recognition unit recognizes a state related to the second region based on the second image, and recognizes a second state which is a state related to other than the first region based on the state related to the second region. A second state recognition step to
An advertisement acquisition step in which an advertisement acquisition unit acquires an advertisement defined in correspondence with the second state;
The information presenting unit includes an information presenting step of presenting the first state after presenting the advertisement to the user or simultaneously with presenting the advertisement.
　ここで、「広告」は、画像又は動画による広告の他、音声による広告等、利用者に対し情報を報知し得る種々の広告を含む。 Here, the “advertisement” includes various advertisements that can notify the user of information, such as advertisements by sound in addition to advertisements by images or videos.
　また、「第２領域の状態に基づいて」、「第２状態を認識する」とは、第２領域の健康の状態（例えば、色、表皮の状態等）に基づいて、所定のルールに基づいて、第２状態を取得又は算出することを指す。例えば、第２領域の健康の状態と第２状態との関係を定めたデータテーブルを参照して、第２状態を取得するという方法、所定のアルゴリズムを用いて、第２領域の健康の状態に基づいて第２状態を算出する方法、第２領域の画像を医師に提示して、第２状態を推定させる方法等が挙げられる。 Further, “based on the state of the second region” and “recognizing the second state” are based on a predetermined rule based on the health state (eg, color, epidermis state, etc.) of the second region. The second state is acquired or calculated. For example, referring to a data table that defines the relationship between the health state of the second region and the second state, the method of obtaining the second state, a predetermined algorithm, and the health state of the second region Examples include a method of calculating the second state based on the above, a method of presenting the image of the second region to the doctor, and estimating the second state.
　また、「第２状態に対応して定める」とは、第２状態を参照して、所定のルールに基づいて定めることを指す。例えば、第２状態の内容と広告との関係を定めたデータテーブルを参照して、第２状態の内容に基づいて広告を取得するという方法、所定のアルゴリズムを用いて、第２状態の内容に基づいて広告を取得するという方法等が挙げられる。 Further, “determining corresponding to the second state” refers to determining based on a predetermined rule with reference to the second state. For example, referring to a data table that defines the relationship between the content of the second state and the advertisement, the method of acquiring the advertisement based on the content of the second state, and using a predetermined algorithm, the content of the second state The method of acquiring an advertisement based on this is mentioned.
　このように、本発明の広告提示方法では、第１領域に係る第１状態（すなわち、もともと利用者が診断を希望している領域の状態）が認識されるとともに、第１領域を撮影した画像に含まれる第２領域の画像に基づいて、第１領域そのもの以外に関する第２状態についても認識される。そして、その第２状態に基づいて、利用者に提示する広告の取得が行われる。 As described above, in the advertisement presenting method of the present invention, the first state related to the first region (that is, the state of the region originally desired by the user) is recognized, and the first region is captured. The second state relating to other than the first region itself is also recognized based on the image of the second region included in. Based on the second state, an advertisement to be presented to the user is acquired.
　これにより、利用者に対しては、利用者が診断を希望している第１領域に関する第１状態とともに、第２状態に対応して定められた広告が提示されるようになる。すなわち、この広告提示方法によって利用者に提示される広告は、この方法を実施するシステムの利用者が意識していないものでありながら（すなわち、第１領域に関しないものでありながら）、利用者にとって有用な可能性が高いもの又は興味に合致する可能性が高いもの（すなわち、利用者にとって適切なもの）となる。 Thus, an advertisement determined corresponding to the second state is presented to the user together with the first state relating to the first region that the user desires to diagnose. That is, the advertisement presented to the user by this advertisement presenting method is not conscious of the user of the system that implements this method (that is, not related to the first area), but the user. That are likely to be useful to the user or likely to meet the interests (ie, appropriate for the user).
　その結果、この広告提示方法を用いたシステムの提供者は、第１領域に関する事業を行っている事業者の他、第２領域に関する事業を行っている事業者からも、広く広告を募ることができるようになる。また、利用者に対しては、提示される広告が利用者にとって適切なものとなるので、広告を提示されたことによるストレス、違和感を与えにくくなる。 As a result, the provider of the system using this advertisement presenting method may solicit advertisements widely from businesses that conduct business related to the first area and businesses that conduct business related to the second area. become able to. Moreover, since the advertisement to be presented is appropriate for the user, it is difficult to give stress and discomfort due to the advertisement being presented.
　また、本発明の広告提示方法においては、
　前記第２状態は、前記利用者の体質及び体調の少なくとも一方に関する状態であってもよい。 In the advertisement presenting method of the present invention,
The second state may be a state relating to at least one of the constitution and physical condition of the user.
　ここで、「体質及び体調に関する状態」には、西洋医学のみならず、漢方又は東洋医学に基づいて判断される体質及び体調に関する状態が含まれる。 Here, “state related to constitution and physical condition” includes not only Western medicine but also state related to constitution and physical condition determined based on Kampo or Oriental medicine.
　また、本発明の広告提示方法においては、
　質問提示部が、前記第２画像に基づいて、前記第２領域に関する状態を認識し、該第２領域に関する状態に基づいて、質問を提示する質問提示工程と、
　回答認識部が、前記質問に対する回答を認識する回答認識工程とを備え、
　前記第２状態認識工程で、第２状態認識部が、前記第２画像、及び、前記回答に基づいて、前記第２状態を認識することが好ましい。 In the advertisement presenting method of the present invention,
A question presenting step for recognizing a state related to the second region based on the second image and presenting a question based on the state related to the second region;
An answer recognition unit comprising an answer recognition process for recognizing an answer to the question;
In the second state recognition step, it is preferable that the second state recognition unit recognizes the second state based on the second image and the answer.
　第２画像に基づいて得られた情報のみでは、第２状態を正確に把握することが難しい場合がある。そこで、このように、第２領域に関する質問を行い、その回答を参照するようにすることによって、利用者に提示する広告をさらに適切なものにすることができる。 It may be difficult to accurately grasp the second state only with information obtained based on the second image. Thus, as described above, by making a question about the second region and referring to the answer, it is possible to make the advertisement presented to the user more appropriate.
　また、本発明の広告提示方法においては、
　前記第１状態認識工程で、前記第１画像に基づいて、前記第１状態を認識するととともに、予め定められた第１状態と重症度との基準に対応させて、前記第１状態の重症度を認識し、
　第２状態認識工程で、前記第２画像に基づいて、前記第２状態を認識するとともに、予め定められた第２状態と重症度との基準に対応させて、前記第２状態の重症度を認識し、
　前記広告取得工程で、前記第１状態に対応して定められた第１の広告を取得するとともに、前記第２状態に対応して定められた第２の広告を取得し、
　情報提示工程で、前記第１状態の重症度と前記第２状態の重症度とを対比して、該対比の結果に応じて、前記第１の広告及び前記第２の広告の提示時間、又は、提示順序を決定し、前記第１の広告及び前記第２の広告を提示することが好ましい。 In the advertisement presenting method of the present invention,
In the first state recognizing step, the first state is recognized based on the first image, and the severity of the first state is determined in accordance with a predetermined standard between the first state and the severity. Recognize
In the second state recognition step, the second state is recognized based on the second image, and the severity of the second state is determined in correspondence with a predetermined second state and severity criterion. Recognized,
In the advertisement acquisition step, the first advertisement determined corresponding to the first state is acquired, and the second advertisement determined corresponding to the second state is acquired,
In the information presentation step, the severity of the first state and the severity of the second state are compared, and the presentation time of the first advertisement and the second advertisement is determined according to the result of the comparison, or Preferably, the order of presentation is determined and the first advertisement and the second advertisement are presented.
　ここで、「重症度」とは、例えば、状態に基づいて認識される値であり、例えば、病状の重さ等に基づいて定められる。重症度の大小は、システム設計者等が任意に定めることができる。 Here, “severity” is, for example, a value recognized based on the state, and is determined based on, for example, the severity of the medical condition. The severity can be arbitrarily determined by the system designer or the like.
　このように、複数種類の広告を提示し、且つ、その提示時間を重症度（すなわち、利用者に対する有用度）に応じて広告を提示時間、提示順序を決定するようにすると、提示される広告の内容を利用者にとってさらに適切なものにすることができる。 As described above, when a plurality of types of advertisements are presented and the presentation time is determined according to the severity (that is, the usefulness to the user), the presentation time and the presentation order are determined. Can be made more appropriate for users.
　また、本発明の広告提示方法においては、
　前記第１領域は、前記利用者の歯及び歯茎であり、
　前記第２領域は、前記利用者の口唇、口唇の周囲の肌及び舌の少なくとも１つを含む領域であり、
　前記広告は、前記第２状態に関連する漢方薬についての広告であることが好ましい。 In the advertisement presenting method of the present invention,
The first region is the user's teeth and gums;
The second region is a region including at least one of the user's lips, skin around the lips, and tongue,
It is preferable that the advertisement is an advertisement about Chinese medicine related to the second state.
　ここで、「口唇の周囲の肌」とは、例えば、顎、頬、首、耳、鼻等、歯及び歯茎とともに撮影可能な領域の肌を指す。 Here, “skin around the lips” refers to skin in a region that can be photographed with teeth and gums, such as jaws, cheeks, neck, ears, and nose.
　このように構成すると、画像を撮影する際に自然に第１領域と第２領域とを撮影することが可能となるので、本発明の広告提示方法を用いたシステムを使用する利用者に対し、ストレス、違和感をさらに与えにくくなる。 If comprised in this way, since it will become possible to image | photograph a 1st area | region and a 2nd area | region naturally when image | photographing an image, with respect to the user who uses the system using the advertisement presentation method of this invention, Stress and discomfort are less likely to be given.
　なお、本発明の広告提示方法において対象となる利用者の身体の領域の組み合わせは、カメラ等の画像取得部によって、同時に撮影可能な領域であればよい。例えば、上記の領域の他、目及び目の周囲の肌又は額の肌、手及び爪、髪の毛及び耳の周囲の肌等も含まれる。 It should be noted that the combination of the regions of the user's body that are the target in the advertisement presenting method of the present invention may be any region that can be simultaneously photographed by an image acquisition unit such as a camera. For example, in addition to the above-mentioned region, the skin around the eyes and the forehead or forehead, the hands and nails, the hair and the skin around the ears, and the like are also included.
　また、本発明の広告提示システムは、
　利用者の身体の画像から前記利用者の身体の第１領域の画像である第１画像、及び、前記利用者の身体の第２領域の画像である第２画像を認識する画像認識部と、
　前記第１画像に基づいて、前記利用者の前記第１領域に関する状態である第１状態を認識する第１状態認識部と、
　前記第２画像に基づいて、前記第１領域そのもの以外に関する状態である第２状態を認識する第２状態認識部と、
　前記第２状態に対応して定められた広告を取得する広告取得部と、
　前記利用者に、前記広告を提示した後に、又は、前記広告を提示すると同時に、前記第１状態を提示する情報提示部とを備えていることを特徴とする。 The advertisement presenting system of the present invention is
An image recognition unit for recognizing a first image that is an image of a first region of the user's body and a second image that is an image of the second region of the user's body from an image of the user's body;
A first state recognition unit for recognizing a first state which is a state related to the first region of the user based on the first image;
A second state recognition unit for recognizing a second state, which is a state related to other than the first region itself, based on the second image;
An advertisement acquisition unit for acquiring an advertisement determined in correspondence with the second state;
An information presenting unit for presenting the first state is provided after the advertisement is presented to the user or simultaneously with the presentation of the advertisement.
実施形態に係る広告提示システムの概略構成を示す模式図。The schematic diagram which shows schematic structure of the advertisement presentation system which concerns on embodiment. 図１の広告提示システムの構成を示すブロック図。The block diagram which shows the structure of the advertisement presentation system of FIG. 図１の広告提示システムが行う処理を示すフローチャート。The flowchart which shows the process which the advertisement presentation system of FIG. 1 performs.
　以下、図面を参照して、実施形態に係る広告提示システムＳについて説明する。なお、本実施形態の広告提示システムＳは、本発明の広告提示システムを、利用者の歯及び歯茎の診断（健康状態の把握）を行うとともに、歯及び歯茎に関する広告、及び、利用者の体質及び体調の改善に効果的と考えられる漢方薬に関する広告を提示するためのシステムとして用いたものである。 Hereinafter, the advertisement presentation system S according to the embodiment will be described with reference to the drawings. In addition, the advertisement presentation system S of the present embodiment uses the advertisement presentation system of the present invention to diagnose the user's teeth and gums (understand the health condition), and to provide advertisements related to teeth and gums and the constitution of the user. It is used as a system for presenting advertisements related to Chinese medicines that are considered to be effective in improving physical condition.
　すなわち、広告提示システムＳは、歯及び歯茎に関して広告を行いたいと考えている事業者（例えば、歯ブラシ等の歯及び歯茎に関する商品等を取り扱う事業者）、及び、漢方薬に関して広告を行いたいと考えている事業者から提供された複数の広告のうちから、利用者に対して有用な可能性が高いもの又は興味に合致する可能性が高いもの（すなわち、適切なもの）を取得して、利用者の歯の診断結果とともに、適切なタイミングで、利用者に対して提示するためのものである。 That is, the advertisement presenting system S wants to advertise a business that wants to advertise about teeth and gums (for example, a business that handles products related to teeth and gums such as toothbrushes) and Chinese medicine. Acquire and use advertising that is highly likely to be useful to users or that is highly likely to match interests (ie, appropriate) from the multiple advertisements provided by the operators It is for presenting to the user at an appropriate timing together with the diagnosis result of the person's teeth.
　しかし、本発明の広告提示方法及び広告提示システムは、携帯情報端末のカメラ等によって、同時に撮影し得る複数の部位に基づく健康情報及び広告を提示するためのものであるので、歯及び歯茎に関する広告、及び、漢方薬に関する広告を提示するためのシステムにのみ適用し得るものではない。 However, since the advertisement presentation method and the advertisement presentation system of the present invention are for presenting health information and advertisements based on a plurality of parts that can be photographed simultaneously by a camera of a portable information terminal or the like, advertisements related to teeth and gums It is not applicable only to a system for presenting advertisements related to Chinese medicine.
　そのため、本発明の広告提示方法及び広告提示システムにおける身体の領域としては、例えば、歯及び口唇又は口唇の周囲の肌の他、目及び目の周囲の肌又は額の肌、手及び爪、髪の毛及び耳の周囲の肌等も含まれる。また、診断対象に関する広告以外の広告は、漢方薬に関する広告に限られるものではなく、利用者の体質及び体調の少なくとも一方に関する状態（後述する第２状態）に対応して定められた広告であればよい。 Therefore, examples of the body region in the advertisement presentation method and the advertisement presentation system of the present invention include, for example, the skin around the teeth and the lips or the lips, the skin around the eyes and the eyes or the skin of the forehead, the hands and nails, and the hair. And the skin around the ears. Further, advertisements other than advertisements related to diagnosis targets are not limited to advertisements related to Chinese medicine, but may be advertisements determined in accordance with a state related to at least one of the user's constitution and physical condition (second state described later). Good.
　例えば、髪の毛の状態を診断するとともに、同時に撮影される肌の状態を認識して、認識された肌の状態に基づいて、利用者が受けているストレスの種類を推測し、そのストレスに効果的な香料（具体的には、入浴剤、アロマオイル等）の広告を提示するようにしてもよい。 For example, it is effective in diagnosing the condition of the hair, recognizing the condition of the skin photographed at the same time, inferring the type of stress the user is receiving based on the recognized condition of the skin. You may make it show the advertisement of a fragrance | flavor (specifically bathing agent, aroma oil, etc.).
　また、例えば、利用者の歯及び歯茎の診断（健康状態の把握）を行うとともに、歯及び歯茎に関する広告、並びに、口唇又は口唇の周囲の肌（具体的には、顎、頬、首、耳、鼻等の後述する携帯情報端末１のカメラ１０によって歯及び歯茎とともに撮影可能な領域の肌）に関する広告（例えば、化粧品等のスキンケア用品等に関する広告）を提示するためのシステムとして用いてもよい。 In addition, for example, diagnosis of the user's teeth and gums (ascertainment of health status), advertisement regarding teeth and gums, and skin around the lips or lips (specifically, chin, cheek, neck, ears) It may also be used as a system for presenting advertisements (for example, advertisements for skin care products such as cosmetics) relating to the skin of the region that can be photographed together with the teeth and gums by the camera 10 of the portable information terminal 1 to be described later. .
　なお、本実施形態における「広告」は、画像又は動画であるが、本発明における「広告」は、画像又は動画による広告の他、音声による広告等、利用者に対し情報を報知し得る種々の広告を含む。 The “advertising” in the present embodiment is an image or a moving image, but the “advertising” in the present invention is a variety of information that can notify the user of information such as an advertising by sound in addition to an advertising by image or moving image. Includes advertisements.
　まず、図１及び図２を参照して、広告提示システムＳの構成について説明する。 First, the configuration of the advertisement presentation system S will be described with reference to FIG. 1 and FIG.
　図１に示すように、広告表指示ステムＳは、システムの利用者等が所持するスマートフォン等の携帯情報端末１（情報処理端末）と、広告代理店等のシステムの提供者により設置されたサーバ２とによって構成されている。携帯情報端末１とサーバ２、及び、サーバ２と事業者用端末３とは、インターネット回線等を介して相互に情報通信可能に接続することによって構成されている。 As shown in FIG. 1, the advertisement table instruction system S is a server installed by a mobile information terminal 1 (information processing terminal) such as a smartphone possessed by a user of the system and a system provider such as an advertising agency. 2. The portable information terminal 1 and the server 2, and the server 2 and the operator terminal 3 are configured to be connected to each other so as to be able to perform information communication via an Internet line or the like.
　携帯情報端末１は、画像を取得するためのカメラ１０（画像取得部）と、利用者に対して、後述する質問及び回答、第１状態、並びに、広告等を提示するとともに、利用者からの入力を受け付けるタッチパネル１１（入出力部）とを備えている。 The portable information terminal 1 presents a camera 10 (image acquisition unit) for acquiring an image and a question and answer, a first state, an advertisement, and the like, which will be described later, from the user, A touch panel 11 (input / output unit) that receives input is provided.
　カメラ１０は、利用者の歯及び歯茎（第１領域）とともに、口唇、口唇の周囲の肌及び舌（第２領域）を撮影し、それらが同時に写り込んだ静止画を、２次元画像として取得可能に構成されている。 The camera 10 captures the user's teeth and gums (first region) as well as the lips, the skin around the lips and the tongue (second region), and obtains a still image in which these images are reflected simultaneously as a two-dimensional image. It is configured to be possible.
　なお、本発明の画像取得部が取得する画像は、第１領域の画像である第１画像及び第２領域の画像である第２画像を、後述する画像認識部２０が認識可能なものであればよい。例えば、２次元画像ではなく３次元画像でもよい。また、画像認識部が動画から静止画を切り出して認識可能なものである場合には、画像取得部は動画を撮影するものであってもよい。 The image acquired by the image acquisition unit of the present invention is one that can be recognized by the image recognition unit 20 described later on the first image that is the image of the first region and the second image that is the image of the second region. That's fine. For example, a three-dimensional image may be used instead of a two-dimensional image. When the image recognition unit can recognize and recognize a still image from a moving image, the image acquisition unit may capture a moving image.
　また、出力部と入力部が一体化した入出力部であるタッチパネル１１に代わり、独立した出力部及び入力部を採用してもよい。具体的には、出力部としてのディスプレイ、及び、入力部としてキーボード、マイク等を採用してもよい。 Further, instead of the touch panel 11 that is an input / output unit in which the output unit and the input unit are integrated, an independent output unit and input unit may be employed. Specifically, a display as an output unit and a keyboard, a microphone, or the like may be employed as an input unit.
　図２に示すように、サーバ２は、実装されたハードウェア構成又はプログラムにより実現される機能として、画像認識部２０と、第１状態認識部２１と、質問提示部２２と、回答認識部２３と、第２状態認識部２４と、広告取得部２５と、情報提示部２６と、広告格納部２７とを備えている。 As illustrated in FIG. 2, the server 2 includes an image recognition unit 20, a first state recognition unit 21, a question presentation unit 22, and an answer recognition unit 23 as functions realized by an installed hardware configuration or program. A second state recognition unit 24, an advertisement acquisition unit 25, an information presentation unit 26, and an advertisement storage unit 27.
　画像認識部２０は、カメラ１０が取得した画像に基づいて、利用者の身体の歯及び歯茎（第１領域）の画像である第１画像、並びに、口唇、口唇の周囲の肌及び舌（第２領域）の画像である第２画像を認識する。 Based on the image acquired by the camera 10, the image recognition unit 20 includes a first image that is an image of the teeth and gums of the user's body (first region), and the lip, skin around the lips, and tongue (first 2nd image) is recognized.
　第１状態認識部２１は、画像認識部２０が認識した第１画像に基づいて、利用者の歯及び歯茎の状態を認識し、その状態から推定できる歯及び歯茎に関する健康の状態（第１状態）、及び、その重症度を認識する。 The first state recognizing unit 21 recognizes the state of the user's teeth and gums based on the first image recognized by the image recognizing unit 20, and can estimate the state of health related to the teeth and gums (first state). ) And its severity.
　質問提示部２２は、画像認識部２０が認識した第２画像に基づいて、利用者の口唇、口唇の周囲の肌及び舌の状態（第２領域に関する状態）を認識する。その後、認識された状態に基づいて、利用者に提示する質問を決定し、決定した質問を、タッチパネル１１を介して利用者に提示する。 The question presentation unit 22 recognizes the state of the user's lips, the skin around the lips, and the tongue (the state relating to the second region) based on the second image recognized by the image recognition unit 20. Thereafter, a question to be presented to the user is determined based on the recognized state, and the determined question is presented to the user via the touch panel 11.
　ここで、質問を決定するための方法はシステム設計者が任意に定めることができる。例えば、認識された状態と質問との関係を予め定めたデータテーブルを参照して、質問を決定する方法、所定のアルゴリズムを用いて、認識された状態に基づいて質問を決定する方法等が挙げられる。 Here, the method for determining the question can be arbitrarily determined by the system designer. For example, a method for determining a question by referring to a data table in which a relationship between a recognized state and a question is determined in advance, a method for determining a question based on a recognized state using a predetermined algorithm, etc. It is done.
　質問の内容もシステム設計者が任意に定めることができる。例えば、本実施形態の広告提示システムＳのように、利用者の体質及び体調の改善に効果的と考えられる漢方薬に関する広告を提示するためのシステムである場合には、漢方又は東洋医学の観点から質問の内容を定めればよい。 The contents of the question can be determined arbitrarily by the system designer. For example, in the case of a system for presenting an advertisement related to a Chinese medicine that is considered to be effective in improving the constitution and physical condition of the user as in the advertisement presentation system S of the present embodiment, from the viewpoint of Kampo or Oriental medicine What is necessary is just to define the content of a question.
　具体的には、例えば、額の皮膚の状態（黒いか否か）、目の下の皮膚の状態（黒いか否か）、顔の両側の皮膚の状態（窪んでいるか、黒いか否か）、舌の状態（白いか否か）、唇の状態（紫か否か）、爪の状態（凹凸があるか否か）、手の状態（関節が曲がっているか否か）は、第２画像に基づいて認識することができる。 Specifically, for example, the condition of the skin on the forehead (whether it is black), the condition of the skin under the eyes (whether it is black), the condition of the skin on both sides of the face (whether it is depressed or black), tongue State (whether it is white), lip state (whether it is purple), nail state (whether there are irregularities), and hand state (whether the joint is bent) are based on the second image. Can be recognized.
　そして、これらの状態（第２領域に関する状態）によっては、肝臓、胃、腎臓の不調が疑われるものの、これらの状態のみによっては、実際に不調であるか否かは判断しきれない。すなわち、利用者の体質又は体調を正確に把握することが難しい。 And depending on these states (states related to the second region), the liver, stomach, and kidneys are suspected to be malfunctioning, but it is not possible to judge whether or not they are actually malfunctioning only by these states. That is, it is difficult to accurately grasp the user's constitution or physical condition.
　そこで、質問提示部２２は、これらの状態によって肝臓、胃、腎臓の不調が疑われた場合には、実際に不調であるか否かを判断するための情報を取得できる内容の質問を行うように構成されている。 Therefore, when the liver, stomach, or kidney is suspected to be malfunctioning due to these conditions, the question presenting unit 22 asks a question with a content that can acquire information for determining whether or not the disease is actually malfunctioning. It is configured.
　具体的には、生もの又は冷たいものをよく食べるか否か、朝起きた時に足がむくんでいるか否か、飲酒の頻度、性生活の頻度等の質問を提示する。これらの質問に対する回答によれば、第２画像からでは認識できない舌の状態（表面の滑らかさ、厚み）、口腔の匂い、体の匂い等を推測することができる。 Specifically, questions such as whether or not to eat raw or cold food well, whether or not the feet are swollen when waking up in the morning, frequency of drinking, frequency of sex life, etc. are presented. According to the answers to these questions, the state of the tongue (smoothness and thickness of the surface), the odor of the oral cavity, the odor of the body, etc. that cannot be recognized from the second image can be estimated.
　そして、後述するように、第２状態認識部２４は、第２画像に基づいて認識された情報、及び、質問に対する回答に基づいて認識された情報を参照して、第２状態を認識する。 Then, as will be described later, the second state recognition unit 24 recognizes the second state with reference to the information recognized based on the second image and the information recognized based on the answer to the question.
　回答認識部２３は、質問提示部２２が提示した質問に対して、利用者がタッチパネル１１を介して入力した回答を認識する。 The answer recognizing unit 23 recognizes an answer input by the user via the touch panel 11 with respect to the question presented by the question presenting unit 22.
　第２状態認識部２４は、画像認識部２０が認識した第２画像に基づいて、利用者の口唇、口唇の周囲の肌及び舌の状態（第２領域に関する状態）を認識し、その状態、及び、回答認識部２３が認識した回答から推定できる利用者の体質及び体調に関する状態（第２状態）、及び、その重症度を認識する。 Based on the second image recognized by the image recognition unit 20, the second state recognition unit 24 recognizes the user's lips, the skin around the lips, and the state of the tongue (the state relating to the second region), and the state, And the state (2nd state) regarding the user's constitution and physical condition which can be estimated from the answer recognized by the answer recognition unit 23 and the severity thereof are recognized.
　ここで、「第２状態」には、利用者の体質及び体調に関する状態の他、第２領域そのものに関する状態等、第２領域の状態から推定又は認識できる利用者の身体の第１領域そのもの以外の領域に関する状態も含まれる。 Here, the “second state” includes a state related to the user's constitution and physical condition, a state related to the second region itself, and the like other than the first region itself of the user's body that can be estimated or recognized from the state of the second region. The state related to the area is also included.
　例えば、本実施形態の広告提示システムＳにおいては、第２領域が利用者の口唇及び口唇の周囲の肌であり、第２状態は、利用者の体質及び体調に関する状態となっている。しかし、第２状態としては、歯（第１領域）、口唇及び口唇（第２領域）以外の利用者の身体の領域の状態を、口唇及び口唇の周囲の肌の状態に基づいて推定したものであってもよい。具体的には、口唇の状態に基づいて推定された舌、口腔の内部等の状態であってもよい。 For example, in the advertisement presenting system S of the present embodiment, the second region is the user's lips and the skin around the lips, and the second state is a state relating to the user's constitution and physical condition. However, as the second state, the state of the user's body region other than the teeth (first region), lips and lips (second region) is estimated based on the state of the skin around the lips and lips. It may be. Specifically, it may be a state estimated based on the state of the lips, the inside of the oral cavity, or the like.
　なお、広告提示システムＳでは、第１状態認識部２１及び第２状態認識部２４は、予め得られているサンプル画像と画像認識部２０が認識した画像との比較結果を参照して、第１状態及び第２状態を認識している。 In the advertisement presenting system S, the first state recognizing unit 21 and the second state recognizing unit 24 refer to the comparison result between the sample image obtained in advance and the image recognized by the image recognizing unit 20, and first The state and the second state are recognized.
　また、本実施形態においては、「体質及び体調に関する状態」には、西洋医学のみならず、漢方又は東洋医学に基づいて判断される体質及び体調に関する状態が含まれる。 Further, in the present embodiment, the “state related to the constitution and physical condition” includes not only Western medicine but also a state related to the constitution and physical condition determined based on Kampo or Oriental medicine.
　しかし、本発明における第１状態及び第２状態の認識は必ずしも画像の比較結果を参照して行う必要はなく、画像認識部が認識した画像に基づいて行われるものであればよい。例えば、通常は画像の比較によって状態を認識し、認識が困難な場合にのみ、医師に画像を送信して診断が行われるように構成してもよい。 However, the recognition of the first state and the second state in the present invention does not necessarily have to be performed with reference to the image comparison result, and may be performed based on the image recognized by the image recognition unit. For example, it may be configured such that diagnosis is performed by transmitting an image to a doctor only when the state is normally recognized by comparison of images and recognition is difficult.
　また、本実施形態の広告提示システムＳでは、利用者に提示する広告をより適切なものにするために、利用者に対して質問を行い、第２状態を認識する際にその回答を参照するように構成されている。しかし、本発明の広告提示システムはそのような構成に限定されるものではなく、例えば、画像によって第２状態を高精度で認識できる場合には、質問の提示及び回答の認識を省略してもよい。この場合、質問提示部及び回答認識部は省略してよい。 Further, in the advertisement presenting system S of the present embodiment, in order to make the advertisement presented to the user more appropriate, a question is asked to the user, and the answer is referred to when recognizing the second state. It is configured as follows. However, the advertisement presentation system of the present invention is not limited to such a configuration. For example, when the second state can be recognized with high accuracy by an image, the presentation of the question and the recognition of the answer may be omitted. Good. In this case, the question presentation unit and the answer recognition unit may be omitted.
　また、ここで、「重症度」とは、例えば、状態に基づいて認識される値であり、例えば、病状の重さ等に基づいて定められる。重症度の大小は、システム設計者等が任意に定めることができる。 Also, here, the “severity” is a value recognized based on the state, for example, and is determined based on, for example, the weight of the medical condition. The severity can be arbitrarily determined by the system designer or the like.
　第１状態及び第２状態に関する重症度を求めるための方法もシステム設計者が任意に定めることができる。例えば、認識された状態と重症度との関係を予め定めた基準としてのデータテーブルを参照して、重症度を求める方法、予め定めた基準としての所定のアルゴリズムを用いて、認識された状態に基づいて重症度を求める方法等が挙げられる。 The system designer can also arbitrarily determine a method for determining the severity regarding the first state and the second state. For example, by referring to a data table as a predetermined standard for the relationship between the recognized state and the severity, a method for obtaining the severity, a predetermined algorithm as a predetermined standard, The method of calculating | requiring a severity based on this etc. is mentioned.
　広告取得部２５は、第１状態認識部２１及び第２状態認識部２４によって認識された第１状態及び第２状態に基づいて、第１状態に対応して定められた歯及び歯茎に関する広告（第１の広告）、及び、第２状態に対応して定められた漢方薬に関する広告（第２の広告）を取得する。 The advertisement acquisition unit 25, based on the first state and the second state recognized by the first state recognition unit 21 and the second state recognition unit 24, advertisements related to teeth and gums that are determined corresponding to the first state ( The first advertisement) and an advertisement (second advertisement) related to the Chinese medicine defined corresponding to the second state are acquired.
　ここで、「状態に対応して定める」とは、第１状態、又は、第２状態を参照して、所定のルールに基づいて定めることを指す。例えば、状態の内容と広告との関係を定めたデータテーブルを参照して、状態の内容に基づいて広告を取得するという方法、所定のアルゴリズムを用いて、状態の内容に基づいて広告を取得するという方法等が挙げられる。 Here, “determining corresponding to the state” refers to determining based on a predetermined rule with reference to the first state or the second state. For example, referring to a data table that defines the relationship between the contents of the state and the advertisement, the method for obtaining the advertisement based on the contents of the state, and using a predetermined algorithm, the advertisement is obtained based on the contents of the state. The method etc. are mentioned.
　情報提示部２６は、第１状態の重症度と第２状態の重症度とを対比するとともに、その対比結果に応じて、第１の広告の提示時間及び第２の広告の提示時間、それらの提示順序、並びに、それらの提示領域の大きさを決定する。また、情報提示部２６は、その決定内容に従って、携帯情報端末１のタッチパネル１１上にそれらの広告を提示した後、第１状態を提示する。 The information presentation unit 26 compares the severity of the first state and the severity of the second state, and according to the comparison result, the presentation time of the first advertisement and the presentation time of the second advertisement, The order of presentation and the size of those presentation areas are determined. Moreover, after presenting those advertisements on the touch panel 11 of the portable information terminal 1 according to the determination content, the information presentation unit 26 presents the first state.
　提示時間と重症度の対比結果の関係は、適宜設定して良い。例えば、重症度が大きいものほど提示時間を長くしてもよい。また、重症度が大きいものほど、後に提示するようにしてもよい。また、重症度が大きいものを繰り返し提示してもよい。 The relationship between presentation time and severity comparison results may be set as appropriate. For example, the presentation time may be increased as the severity increases. Moreover, you may make it show later that the severity is large. Moreover, you may repeatedly present what has a high severity.
　なお、本実施形態の広告提示システムＳでは、第１状態認識部２１及び第２状態認識部２４が、第１状態及び第２状態とともに、各々の重症度も認識している。これは、情報提示部２６が、その重症度（すなわち、利用者に対する有用度）に応じて、利用者に対して提示する各広告の提示時間及び提示順序を変動させるためである。 In addition, in the advertisement presentation system S of the present embodiment, the first state recognition unit 21 and the second state recognition unit 24 recognize each severity as well as the first state and the second state. This is because the information presentation unit 26 varies the presentation time and presentation order of each advertisement presented to the user according to the severity (that is, the usefulness to the user).
　しかし、広告の提示時間が変動可能なものでない場合（例えば、広告が１種類しかない場合）等には、提示時間の変動を行うことはできないので、重症度を認識せず、重症度の比較を行わないように構成してもよい。 However, if the presentation time of the advertisement is not variable (for example, if there is only one type of advertisement), the presentation time cannot be changed, so the severity is not recognized and the severity is compared. You may comprise so that it may not perform.
　また、広告を提示する時間を変動させるための方法としては、広告が静止画のような径時変化のないものである場合には、単純に提示する時間を変動させればよい。また、広告が動画のような径時変化のあるものである場合には、広告の取得の際に、１つの状態に関して、時間の異なる複数の広告を取得しておき、その中から決定された提示時間に応じた長さの広告を選択するようにしてもよい。 Also, as a method for changing the time for presenting the advertisement, if the advertisement has no time change like a still image, the time for presenting may be simply changed. In addition, when the advertisement has a time-varying change such as a video, when acquiring the advertisement, a plurality of advertisements having different times with respect to one state are acquired and determined from them. You may make it select the advertisement of the length according to presentation time.
　また、重症度の比較の結果を、提示する時間の他、提示する領域に反映させてもよい。具体的には、タッチパネル１１上の表示領域を分割して複数の広告を同時に表示するような場合には、重症度の高いものほど大きく表示するようにしてもよい。 Also, the result of the severity comparison may be reflected in the area to be presented in addition to the time to be presented. Specifically, when the display area on the touch panel 11 is divided and a plurality of advertisements are displayed at the same time, the higher the severity, the larger the display may be.
　広告格納部２７は、事業者の有する事業者用端末３からアップロードされた広告を格納する。なお、この広告格納部２７をサーバ２の外部（他のサーバ等）に設けてもよい。また、広告格納部２７を省略し、情報提示部２６が必要に応じて随時外部から広告を取得するようにしてもよい。 The advertisement storage unit 27 stores advertisements uploaded from the provider terminal 3 owned by the provider. The advertisement storage unit 27 may be provided outside the server 2 (another server or the like). Further, the advertisement storage unit 27 may be omitted, and the information presentation unit 26 may acquire an advertisement from outside as needed.
　次に、図２及び図３を参照して、広告提示システムＳが行う処理（本発明の広告提示方法）について説明する。図３は、広告提示システムＳが行う処理を示すフローチャートである。 Next, with reference to FIG. 2 and FIG. 3, processing (advertisement presentation method of the present invention) performed by the advertisement presentation system S will be described. FIG. 3 is a flowchart showing processing performed by the advertisement presentation system S.
　本実施形態の広告提示システムＳでは、診断結果及び広告を提示するための処理に先立ち、広告格納部２７に対して、事業者用端末３から提示対象となり得る複数の広告がアップロードされて格納されている。 In the advertisement presenting system S of the present embodiment, prior to the process for presenting the diagnosis result and the advertisement, a plurality of advertisements that can be presented from the provider terminal 3 are uploaded and stored in the advertisement storage unit 27. ing.
　広告提示システムＳが行う処理においては、まず、携帯情報端末１のカメラ１０が、利用者の歯及び歯茎（第１領域）とともに、口唇、口唇の周囲の肌及び舌（第２領域）を撮影し、それらが同時に写り込んだ静止画を、２次元画像として取得する（図３／ＳＴＥＰ０１）。 In the processing performed by the advertisement presentation system S, first, the camera 10 of the portable information terminal 1 photographs the lips, the skin around the lips, and the tongue (second region) together with the user's teeth and gums (first region). Then, the still images in which they are simultaneously reflected are acquired as a two-dimensional image (FIG. 3 / STEP01).
　次に、サーバ２の画像認識部２０が、カメラ１０が取得した画像に基づいて、利用者の身体の歯及び歯茎（第１領域）の画像である第１画像、並びに、口唇、口唇の周囲の肌及び舌（第２領域）の画像である第２画像を認識する（図３／ＳＴＥＰ０２（画像認識工程））。 Next, based on the image acquired by the camera 10, the image recognition unit 20 of the server 2, the first image that is an image of the teeth and gums (first region) of the user's body, and the periphery of the lips and lips A second image that is an image of the skin and tongue (second region) is recognized (FIG. 3 / STEP02 (image recognition process)).
　次に、サーバ２の質問提示部２２は、画像認識部２０が認識した第２画像に基づいて、利用者の口唇、口唇の周囲の肌及び舌の状態（第２領域に関する状態）を認識し、その状態に基づいて質問を決定し、タッチパネル１１を介して決定した質問を利用者に提示する（図３／ＳＴＥＰ０３（質問提示工程））。 Next, the question presentation unit 22 of the server 2 recognizes the state of the user's lips, the skin around the lips, and the tongue (the state relating to the second region) based on the second image recognized by the image recognition unit 20. Then, a question is determined based on the state, and the determined question is presented to the user via the touch panel 11 (FIG. 3 / STEP03 (question presenting step)).
　次に、サーバ２の回答認識部２３は、質問提示部２２が提示した質問に対して、利用者がタッチパネル１１を介して入力した回答を認識する（図３／ＳＴＥＰ０４（回答認識工程））。 Next, the answer recognition unit 23 of the server 2 recognizes the answer input by the user via the touch panel 11 in response to the question presented by the question presentation unit 22 (FIG. 3 / STEP04 (answer recognition process)).
　次に、サーバ２の第１状態認識部２１は、画像認識部２０が認識した第１画像に基づいて、利用者の歯及び歯茎の状態を認識し、その状態から推定できる歯及び歯茎に関する健康の状態（第１状態）、及び、その重症度を認識する（図３／ＳＴＥＰ０５（第１状態認識工程））。 Next, the first state recognizing unit 21 of the server 2 recognizes the state of the user's teeth and gums based on the first image recognized by the image recognizing unit 20, and can estimate the health based on the state. (First state) and its severity are recognized (FIG. 3 / STEP05 (first state recognition step)).
　次に、サーバ２の第２状態認識部２４は、画像認識部２０が認識した第２画像に基づいて、利用者の口唇、口唇の周囲の肌及び舌の状態（第２領域に関する状態）を認識し、その状態、及び、回答認識部２３が認識した回答から推定できる利用者の体質及び体調に関する状態（第２状態）、及び、その重症度を認識する（図３／ＳＴＥＰ０６（第２状態認識工程））。 Next, the second state recognition unit 24 of the server 2 determines the state of the user's lips, the skin around the lips, and the tongue (the state relating to the second region) based on the second image recognized by the image recognition unit 20. Recognize and recognize the state, the state related to the user's constitution and physical condition (second state) and the severity that can be estimated from the answer recognized by the answer recognition unit 23 (FIG. 3 / STEP06 (second state) Recognition process)).
　次に、サーバ２の広告取得部２５は、第１状態認識部２１及び第２状態認識部２４によって認識された第１状態及び第２状態に基づいて、第１状態に対応して定められた歯及び歯茎に関する広告（第１の広告）、及び、第２状態に対応して定められた漢方薬（すなわち、第２状態に関連する漢方薬）に関する広告（第２の広告）を取得する（図３／ＳＴＥＰ０７（広告取得工程））。 Next, the advertisement acquisition unit 25 of the server 2 is determined corresponding to the first state based on the first state and the second state recognized by the first state recognition unit 21 and the second state recognition unit 24. An advertisement regarding the teeth and gums (first advertisement) and an advertisement regarding the Chinese medicine defined in correspondence with the second state (that is, the Chinese medicine related to the second state) are acquired (FIG. 3). / STEP07 (advertising acquisition process)).
　次に、サーバ２の情報提示部２６は、第１状態の重症度と第２状態の重症度とを対比するとともに、その対比結果に応じて、第１の広告及び第２の広告の提示時間及び提示順序を決定する（図３／ＳＴＥＰ０８）。 Next, the information presentation unit 26 of the server 2 compares the severity of the first state with the severity of the second state, and according to the comparison result, the presentation time of the first advertisement and the second advertisement The presentation order is determined (FIG. 3 / STEP08).
　次に、情報提示部２６は、携帯情報端末１のタッチパネル１１上に、それらの広告を順次提示した後、第１状態を提示して、今回の処理を終了する（図３／ＳＴＥＰ０９（情報提示工程））。 Next, after presenting those advertisements sequentially on the touch panel 11 of the portable information terminal 1, the information presenting unit 26 presents the first state and ends the current process (FIG. 3 / STEP09 (information presenting). Process)).
　以上説明したように、広告提示システムＳでは、歯及び歯茎（第１領域）に係る第１状態（すなわち、もともと利用者が診断を希望している領域の状態）が認識されるとともに、第１領域を撮影した画像に含まれる口唇、口唇の周囲の肌及び舌（第２領域）の画像に基づいて、利用者の体質及び体調に関する第２状態についても認識される。そして、その第２状態に対応した漢方薬に関する広告である第２の広告の取得が行われる。 As described above, in the advertisement presentation system S, the first state relating to the teeth and gums (first region) (that is, the state of the region originally desired by the user) is recognized, and the first state is recognized. Based on the images of the lips, the skin around the lips, and the tongue (second region) included in the image obtained by photographing the region, the second state relating to the constitution and physical condition of the user is also recognized. And the acquisition of the 2nd advertisement which is an advertisement about the Chinese medicine corresponding to the 2nd state is performed.
　これにより、利用者に対しては、利用者が診断を希望している歯及び歯茎の健康の状態である第１状態とともに、利用者の体質及び体調に関する広告が提示されるようになる。すなわち、この広告提示システムＳによって利用者に提示される広告は、この方法を実施するシステムの利用者が意識していないものでありながら（すなわち、第１領域に関しないものでありながら）、利用者にとって有用な可能性が高いもの又は興味に合致する可能性が高いものとなる。 This allows the user to be presented with an advertisement regarding the user's constitution and physical condition, as well as the first state, which is the health state of the teeth and gums that the user wishes to diagnose. That is, the advertisement presented to the user by the advertisement presenting system S is used while the user of the system implementing this method is not conscious (that is, not related to the first area). It is likely to be useful to a person or highly likely to meet interest.
　その結果、この広告提示システムＳの提供者は、歯及び歯茎に関する事業を行っている事業者の他、漢方薬に関する事業を行っている事業者からも、広く広告を募ることができるようになる。また、利用者に対しては、提示される広告が利用者にとって適切なものとなるので、広告を提示されたことによるストレス、違和感を与えにくくなる。 As a result, the provider of the advertisement presenting system S can solicit advertisements widely from not only those who are engaged in business related to teeth and gums but also those who are related to traditional Chinese medicine. Moreover, since the advertisement to be presented is appropriate for the user, it is difficult to give stress and discomfort due to the advertisement being presented.
　以上、図示の実施形態について説明したが、本発明はこのような形態に限られるものではない。 Although the illustrated embodiment has been described above, the present invention is not limited to such a form.
　例えば、上記実施形態では、広告表指示システムＳは、利用者の歯及び歯茎の診断を行うとともに、歯及び歯茎に関する広告、及び、口唇、口唇の周囲の肌及び舌の状態に対応して定められた漢方薬に関する広告を提示するためのシステムとして構成されている。これは、歯及び歯茎の撮影とともに、口唇、口唇の周囲の肌及び舌の画像を取得することは比較的容易であるためである。 For example, in the above-described embodiment, the advertisement table instruction system S diagnoses the teeth and gums of the user and determines the advertisements related to the teeth and gums and the states of the skin and tongue around the lips and lips. It is configured as a system for presenting advertisements related to traditional Chinese medicines. This is because it is relatively easy to acquire images of the lips, the skin around the lips, and the tongue together with the photographing of the teeth and gums.
　しかし、本発明の広告提示方法及び広告提示システムは、このような構成に限定されるものではなく、利用者の身体の第１領域及びその第１領域とともに撮影可能な第２領域に基づいて、利用者の体質及び体調のいずれか一方に関する状態の認識及び広告の提示を行うものであればよい。 However, the advertisement presentation method and the advertisement presentation system of the present invention are not limited to such a configuration, and based on the first region of the user's body and the second region that can be photographed together with the first region, What is necessary is just to perform the recognition of the state regarding any one of a user's constitution and physical condition, and presentation of an advertisement.
　例えば、第１領域を耳とし、第２領域を髪の毛としてもよい。また、第１状態を、目に関する状態とし、第２状態を、目の周囲の肌から推測される体質及び体調状態としてもよい。 For example, the first region may be ears and the second region may be hair. In addition, the first state may be a state relating to the eyes, and the second state may be a constitution and physical condition estimated from the skin around the eyes.
　また、上記実施形態では、第２領域として、口唇、口唇の周囲の肌及び舌という複数の領域を用いている。しかし、本発明の第２領域は、１つの領域のみを用いてもよい。例えば、舌のみとしてもよい。また、上記実施形態と同様に第２領域を複数の領域とする場合には、必ずしも複数の第２領域を互いに隣接する領域とする必要はない。例えば、舌と目の周囲の肌を第２領域としてもよい。 In the above embodiment, a plurality of regions such as the lips, the skin around the lips, and the tongue are used as the second region. However, only one region may be used as the second region of the present invention. For example, only the tongue may be used. In addition, when the second region is a plurality of regions as in the above embodiment, the plurality of second regions are not necessarily adjacent to each other. For example, the skin around the tongue and eyes may be the second region.
　また、上記実施形態では、第１状態に係る歯及び歯茎に関する第１の広告と、第２状態に係る漢方薬に関する第２の広告とを順次提示している。 Moreover, in the said embodiment, the 1st advertisement regarding the tooth | gear and gum which concern on a 1st state, and the 2nd advertisement regarding the Chinese medicine which concerns on a 2nd state are shown sequentially.
　しかし、本発明の広告提示方法及び広告提示システムは、このような構成に限定されるものではなく、少なくとも第１状態とともに、第２状態に係る広告を提示するものであればよい。 However, the advertisement presenting method and the advertisement presenting system of the present invention are not limited to such a configuration, and may be any one that presents an advertisement according to the second state together with at least the first state.
　例えば、上記実施形態の広告提示システムＳと同様に、歯の診断とともに、口唇、口唇の周囲の肌及び舌に基づいて利用者の体調及び体質を認識するシステムである場合には、歯及び歯茎に係る広告（すなわち、第１の広告）を提示せず、口唇、口唇の周囲の肌及び舌に基づいて推測された利用者の体調及び体質に関する漢方薬に関する広告（すなわち、第２の広告）のみを提示するように構成してもよい。このように構成した場合、歯の診断結果を提示すると同時に、漢方薬に関する広告を提示するように構成してもよい。また、第１状態とともに、２つ以上の第２状態を認識可能である場合には、２つ以上の第２の広告を提示するようにしてもよい。また、第１領域に係る診断結果の後に、第２の広告、又は第１の広告及び第２の広告を提示してもよい。 For example, as with the advertisement presentation system S of the above embodiment, in the case of a system that recognizes the physical condition and constitution of the user based on the lip, the skin around the lip, and the tongue together with the diagnosis of the teeth, the teeth and gums The advertisement related to Chinese medicine related to the physical condition and constitution of the user estimated based on the lips, the skin around the lips, and the tongue (that is, the second advertisement) without presenting the advertisement related to the lip (that is, the first advertisement) May be configured to present. When comprised in this way, you may comprise so that the advertisement regarding a Chinese medicine may be shown simultaneously with the diagnosis result of a tooth | gear. When two or more second states can be recognized together with the first state, two or more second advertisements may be presented. Further, the second advertisement, or the first advertisement and the second advertisement may be presented after the diagnosis result related to the first region.
　また、上記実施形態では、本発明の広告提示方法を実施するための広告提示システムＳをサーバ２と携帯情報端末１とによって構成している。しかし、本発明の広告提示方法は、このように構成されたシステムのみによって構成し得るものではない。 In the above embodiment, the advertisement presentation system S for implementing the advertisement presentation method of the present invention is configured by the server 2 and the portable information terminal 1. However, the advertisement presenting method of the present invention cannot be configured only by the system configured as described above.
　例えば、撮影機能を有する情報処理端末を店頭等に設置して、その情報処理端末のみによってシステムを構成してもよいし、携帯情報端末に各処理部及び各情報格納部を設けて、その携帯情報端末のみによってシステムを構成してもよい。逆に、上記実施形態では１つのサーバによって行っていた状態の認識及び広告を取得という処理を、それぞれ独立した異なるサーバを用いて行うように構成してもよい。 For example, an information processing terminal having a photographing function may be installed at a storefront or the like, and the system may be configured only by the information processing terminal, or each mobile unit may be provided with each processing unit and each information storage unit. You may comprise a system only with an information terminal. Conversely, in the above-described embodiment, the process of recognition of the state and acquisition of the advertisement performed by one server may be performed using different servers.
１　携帯情報端末（情報処理端末）
２　サーバ
３　事業者用端末
１０　カメラ（画像取得部）
１１　タッチパネル（入出力部）
２０　画像認識部
２１　第１状態認識部
２２　質問提示部
２３　回答認識部
２４　第２状態認識部
２５　広告取得部
２６　情報提示部
２７　広告格納部 1 Mobile information terminal (information processing terminal)
2 Server 3 Provider terminal 10 Camera (image acquisition unit)
11 Touch panel (input / output unit)
20 image recognition unit 21 first state recognition unit 22 question presentation unit 23 answer recognition unit 24 second state recognition unit 25 advertisement acquisition unit 26 information presentation unit 27 advertisement storage unit

Claims (6)

  1. 　画像認識部が、利用者の身体の画像から前記利用者の身体の第１領域の画像である第１画像、及び、前記利用者の身体の第２領域の画像である第２画像を認識する画像認識工程と、
    　第１状態認識部が、前記第１画像に基づいて、前記利用者の前記第１領域に関する状態である第１状態を認識する第１状態認識工程と、
    　第２状態認識部が、前記第２画像に基づいて、前記第２領域に関する状態を認識し、該第２領域に関する状態に基づいて、前記第１領域そのもの以外に関する状態である第２状態を認識する第２状態認識工程と、
    　広告取得部が、前記第２状態に対応して定められた広告を取得する広告取得工程と、
    　情報提示部が、前記利用者に、前記広告を提示した後に、又は、前記広告を提示すると同時に、前記第１状態を提示する情報提示工程とを備えていることを特徴とする広告提示方法。     An image recognition unit recognizes a first image that is an image of the first region of the user's body and a second image that is an image of the second region of the user's body from the image of the user's body. An image recognition process;
    A first state recognizing step for recognizing a first state which is a state relating to the first area of the user based on the first image;
    A second state recognition unit recognizes a state related to the second region based on the second image, and recognizes a second state which is a state related to other than the first region based on the state related to the second region. A second state recognition step to
    An advertisement acquisition step in which an advertisement acquisition unit acquires an advertisement defined in correspondence with the second state;
    An information presenting method comprising: an information presenting step of presenting the first state after the information presenting section presents the advertisement to the user or simultaneously with the presentation of the advertisement.
  2. 　請求項１に記載の広告提示方法において、
    　前記第２状態は、前記利用者の体質及び体調の少なくとも一方に関する状態であることを特徴とする広告提示方法。     The advertisement presenting method according to claim 1,
    The advertisement presenting method, wherein the second state is a state relating to at least one of the constitution and physical condition of the user.
  3. 　請求項１に記載の広告提示方法において、
    　質問提示部が、前記第２画像に基づいて、前記第２領域に関する状態を認識し、該第２領域に関する状態に基づいて、質問を提示する質問提示工程と、
    　回答認識部が、前記質問に対する回答を認識する回答認識工程とを備え、
    　前記第２状態認識工程で、第２状態認識部が、前記第２画像、及び、前記回答に基づいて、前記第２状態を認識することを特徴とする広告提示方法。     The advertisement presenting method according to claim 1,
    A question presenting step for recognizing a state related to the second region based on the second image and presenting a question based on the state related to the second region;
    An answer recognition unit comprising an answer recognition process for recognizing an answer to the question;
    In the second state recognition step, the second state recognition unit recognizes the second state based on the second image and the answer.
  4. 　請求項１に記載の広告提示方法において、
    　前記第１状態認識工程で、前記第１画像に基づいて、前記第１状態を認識するととともに、予め定められた第１状態と重症度との基準に対応させて、前記第１状態の重症度を認識し、
    　第２状態認識工程で、前記第２画像に基づいて、前記第２状態を認識するとともに、予め定められた第２状態と重症度との基準に対応させて、前記第２状態の重症度を認識し、
    　前記広告取得工程で、前記第１状態に対応して定められた第１の広告を取得するとともに、前記第２状態に対応して定められた第２の広告を取得し、
    　情報提示工程で、前記第１状態の重症度と前記第２状態の重症度とを対比して、該対比の結果に応じて、前記第１の広告及び前記第２の広告の提示時間、又は、提示順序を決定し、前記第１の広告及び前記第２の広告を提示することを特徴とする広告提示方法。     The advertisement presenting method according to claim 1,
    In the first state recognizing step, the first state is recognized based on the first image, and the severity of the first state is determined in accordance with a predetermined standard between the first state and the severity. Recognize
    In the second state recognition step, the second state is recognized based on the second image, and the severity of the second state is determined in correspondence with a predetermined second state and severity criterion. Recognized,
    In the advertisement acquisition step, the first advertisement determined corresponding to the first state is acquired, and the second advertisement determined corresponding to the second state is acquired,
    In the information presentation step, the severity of the first state and the severity of the second state are compared, and the presentation time of the first advertisement and the second advertisement is determined according to the result of the comparison, or A method of presenting an advertisement, wherein a presentation order is determined and the first advertisement and the second advertisement are presented.
  5. 　請求項１に記載の広告提示方法において、
    　前記第１領域は、前記利用者の歯及び歯茎であり、
    　前記第２領域は、前記利用者の口唇、口唇の周囲の肌及び舌の少なくとも１つを含む領域であり、
    　前記広告は、前記第２状態に関連する漢方薬についての広告であることを特徴とする広告提示方法。     The advertisement presenting method according to claim 1,
    The first region is the user's teeth and gums;
    The second region is a region including at least one of the user's lips, skin around the lips, and tongue,
    The advertisement presenting method, wherein the advertisement is an advertisement about a Chinese medicine related to the second state.
  6. 　利用者の身体の画像から前記利用者の身体の第１領域の画像である第１画像、及び、前記利用者の身体の第２領域の画像である第２画像を認識する画像認識部と、
    　前記第１画像に基づいて、前記利用者の前記第１領域に関する状態である第１状態を認識する第１状態認識部と、
    　前記第２画像に基づいて、前記第１領域そのもの以外に関する状態である第２状態を認識する第２状態認識部と、
    　前記第２状態に対応して定められた広告を取得する広告取得部と、
    　前記利用者に、前記広告を提示した後に、又は、前記広告を提示すると同時に、前記第１状態を提示する情報提示部とを備えていることを特徴とする広告提示システム。     An image recognition unit for recognizing a first image that is an image of a first region of the user's body and a second image that is an image of the second region of the user's body from an image of the user's body;
    A first state recognition unit for recognizing a first state which is a state related to the first region of the user based on the first image;
    A second state recognition unit for recognizing a second state, which is a state related to other than the first region itself, based on the second image;
    An advertisement acquisition unit for acquiring an advertisement determined in correspondence with the second state;
    An advertisement presenting system comprising: an information presenting unit that presents the first state after presenting the advertisement to the user or simultaneously with presenting the advertisement.
PCT/JP2018/028465 2018-01-31 2018-07-30 Advertisement presentation method and advertisement presentation system WO2019150607A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US16/963,621 US20210065248A1 (en) 2018-01-31 2018-07-30 Advertisement presentation method and advertisement presentation system
CN201880087939.2A CN111656382A (en) 2018-01-31 2018-07-30 Advertisement prompting method and advertisement prompting system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2018014506A JP6371019B1 (en) 2018-01-31 2018-01-31 Advertisement presenting method and advertisement presenting system
JP2018-014506 2018-01-31
JP2018126509A JP7289491B2 (en) 2018-07-03 2018-07-03 ADVERTISING PRESENTATION METHOD AND ADVERTISING PRESENTATION SYSTEM
JP2018-126509 2018-07-03

Publications (1)

Publication Number Publication Date
WO2019150607A1 true WO2019150607A1 (en) 2019-08-08

Family

ID=67479690

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/028465 WO2019150607A1 (en) 2018-01-31 2018-07-30 Advertisement presentation method and advertisement presentation system

Country Status (3)

Country Link
US (1) US20210065248A1 (en)
CN (1) CN111656382A (en)
WO (1) WO2019150607A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001314376A (en) * 2000-05-11 2001-11-13 Res Dev Corp Of Japan Tongue diagnosing system, doctor's questions system and tongue diagnosing/doctor's questions education support apparatus
JP2005137756A (en) * 2003-11-10 2005-06-02 Konica Minolta Holdings Inc Health measuring system and program
JP2005296208A (en) * 2004-04-09 2005-10-27 Konica Minolta Holdings Inc Diagnostic system
JP2012143528A (en) * 2011-01-12 2012-08-02 Advance Co Ltd Oral imaging and display system
CN104200120A (en) * 2014-09-18 2014-12-10 上海中医药大学 System and method for health status monitoring based on traditional Chinese medicine diagnosis information
JP2016077436A (en) * 2014-10-15 2016-05-16 デジタルワン株式会社 Oral cavity medical examination management system
JP2017049695A (en) * 2015-08-31 2017-03-09 キヤノン株式会社 Assistance system, assistance method, and program

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2270036C1 (en) * 2004-07-14 2006-02-20 Государственное учреждение "Нижегородский научно-исследовательский институт травматологии и ортопедии Министерства здравоохранения Российской Федерации" Method for treating children having thermal injuries for psychoemotional and psychosomatic disorders
US7904337B2 (en) * 2004-10-19 2011-03-08 Steve Morsa Match engine marketing
EP2097852A4 (en) * 2006-11-22 2013-01-02 Nader Butto A system and method for diagnosis of human behavior based on external body markers
CN102915671A (en) * 2011-08-02 2013-02-06 中国人民解放军第四五五医院 Card and method for identifying communication of critical patient needs
US9842358B1 (en) * 2012-06-19 2017-12-12 Brightex Bio-Photonics Llc Method for providing personalized recommendations
PL2892927T3 (en) * 2012-09-07 2018-11-30 Regeneron Pharmaceuticals, Inc. Methods for treating atopic dermatitis by administering an il-4r antagonist
WO2015118529A1 (en) * 2014-02-04 2015-08-13 Optimata Ltd. Method and system for prediction of medical treatment effect
US10664686B2 (en) * 2014-11-04 2020-05-26 Samsung Electronics Co., Ltd. Electronic device, and method for analyzing face information in electronic device
KR101749524B1 (en) * 2015-05-28 2017-06-23 양재정 Healthcare system for presenting advertisements according to take medication and for compensating by watching the advertisements

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001314376A (en) * 2000-05-11 2001-11-13 Res Dev Corp Of Japan Tongue diagnosing system, doctor's questions system and tongue diagnosing/doctor's questions education support apparatus
JP2005137756A (en) * 2003-11-10 2005-06-02 Konica Minolta Holdings Inc Health measuring system and program
JP2005296208A (en) * 2004-04-09 2005-10-27 Konica Minolta Holdings Inc Diagnostic system
JP2012143528A (en) * 2011-01-12 2012-08-02 Advance Co Ltd Oral imaging and display system
CN104200120A (en) * 2014-09-18 2014-12-10 上海中医药大学 System and method for health status monitoring based on traditional Chinese medicine diagnosis information
JP2016077436A (en) * 2014-10-15 2016-05-16 デジタルワン株式会社 Oral cavity medical examination management system
JP2017049695A (en) * 2015-08-31 2017-03-09 キヤノン株式会社 Assistance system, assistance method, and program

Also Published As

Publication number Publication date
US20210065248A1 (en) 2021-03-04
CN111656382A (en) 2020-09-11

Similar Documents

Publication Publication Date Title
US10192033B2 (en) Capturing data for individual physiological monitoring
US9101261B2 (en) Method, medium, and apparatus generating health state based avatars
Courtemanche et al. Physiological heatmaps: a tool for visualizing users’ emotional reactions
US10568716B2 (en) Methods and systems for employing artificial intelligence in automated orthodontic diagnosis and treatment planning
EP1298562A1 (en) Method and system for predicting and/or tracking changes in external body conditions
EP1297782A1 (en) Beauty analysis of external body conditions
TW202115678A (en) Method of and imaging system for clinical sign detection
US20080294012A1 (en) Monitoring physiological conditions
US20080294018A1 (en) Privacy management for well-being monitoring
JP2004000427A (en) Correction of body image
JP2003256561A (en) Early detection of beauty treatment progress
Carpenter How I conduct a comprehensive chronic graft-versus-host disease assessment
JP2004000428A (en) Image acquisition method
JP2011511681A (en) System and method for beauty analysis and beauty treatment diagnosis
JPWO2015122195A1 (en) Impression analysis device, game device, health management device, advertisement support device, impression analysis system, impression analysis method, and program
Hop et al. Photographic assessment of burn size and depth: reliability and validity
JP2013527946A (en) Skin care analysis system for generating a 3D RGB model using spectral image data
JP2003220036A (en) Calibrating method and system for image taking
CN113257372B (en) Oral health management related system, method, device and equipment
WO2019150607A1 (en) Advertisement presentation method and advertisement presentation system
JP6138696B2 (en) Method for estimating sebum amount
Mackenzie et al. Morphological and morphometric changes in the faces of female-to-male (FtM) transsexual people
CN115136248A (en) Proposal system, proposal method, and program
JP7289491B2 (en) ADVERTISING PRESENTATION METHOD AND ADVERTISING PRESENTATION SYSTEM
JP6371019B1 (en) Advertisement presenting method and advertisement presenting system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18904289

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18904289

Country of ref document: EP

Kind code of ref document: A1