JP2019079477A - Love target matching system, love target matching method and love target matching program - Google Patents

Abstract

To provide a love target matching system which analyzes the preference of a user related to a love target without making the user aware of the analysis, finds a matching love target, and can induce the user to encounter the love target, and to make acquaintance with each other, a love target matching method and a love target matching program.SOLUTION: A control part 21 of a love target matching server 20 receives the face image information of a user himself/herself reflected on a mirror from a user terminal 10, stores the identical face image information of the user himself/herself by identity determination processing, receives a face image of the other user or a non-subscriber who is observed by the user from the user terminal 10, stores a feature of a preferable face by a preference analysis processing, stores a combination in which the features coincide with each other by coupling processing, induces the combined users to one shop or a facility by induction processing, and creates an opportunity for the combined users to have a talk by action command processing.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a love target matching system, a love target matching method, and a love target matching program that mediates encounters with heterosexual or homosexual love targets via the Internet.

  In the means by which a person encounters a subject of love, there are many things which are done off-line, such as the human relationship which the person obtained in daily life and the introduction from others who derive from it.

  On the other hand, since the spread of the Internet, there have been increasing cases of using bulletin boards and social networking services on the Internet as a means of encountering love objects. Among other things, if you specialize in a user for the purpose of love or marriage, register your own profile information, and then enter the specific conditions you want for the marriage partner, and the conditions and the mutual profile information agree with each other. There is also a system that provides a means of communication between the users by electronic means (see, for example, Patent Document 1). In the technique described in this document, an input means for the user to input his / her specific information, an input means for inputting the specific conditions desired for the marriage partner, a storage means for the data, and The data processing system includes means for matching the other in the data, and transmission means for sending the information of the individual matching the result of the matching to both the operator and the other by e-mail, and the operator and the other party only through this system Enable e-mail exchange to protect the privacy of both parties.

JP 2002-203034 A

  In the case of the above-described off-line, an opportunity for visual confirmation of appearance and an opportunity for speaking in a natural voice can be obtained from the beginning of the meeting. However, the absolute number of encounters obtained is limited because the relationship between the person is the starting point. On the other hand, in the case of online, you can get a large number of encounters beyond the person's relationship through the Internet, but when you get to know each other's profile online, you can not confirm the appearance and reality of the other person. In addition, there is a problem that the user may have a degree of distrust. In addition, there are not a few users who perceive shame or resistance as the act of registering themselves as an online service for the purpose of finding an object of love or an object of marriage.

  The present invention analyzes a user's preference for a love subject without making the user aware of using the online service, searches for a love subject matching the preference via the Internet, and makes the online The object of the present invention is to provide a love target matching system, a love target matching method, and a love target matching program that can induce a user's action to meet offline after performing matching processing.

  The romantic object matching system for solving the above problems includes: a user information storage unit having a storage area associated with a user's face and image information of each part constituting the user; and a viewpoint of the user, And a control unit connected to a user terminal capable of photographing and recording an object the user is looking at. The control unit captures a user information storage unit having a storage area associated with a user's face and image information of each part constituting the user, and capturing an object viewed by the user while capturing a viewpoint of the user Connected to a user terminal capable of face recognition and recording, the face information of the face recognized by the user terminal is received and recorded, the viewpoint of the user and the viewpoint of the face image information coincide with each other, and the face image information If the user terminal shown in the image is symmetrical and horizontally reversed, it is determined that the face image information is an image of the user himself reflected on the mirror, and is recorded in the user information storage unit as his own face image information.

  The control unit is connected to a preference target storage unit that records preferences related to the face or figure of another person in association with the user, and the control unit counts the number of times the viewpoint of the user is placed for the face image information The number of hours is recorded, a score regarding preference is given to the face image information according to the number of times and the number of continuous times, and when the score regarding the preference exceeds a predetermined standard, the identity of the user If the face image information which does not match the face image information is selected and the face image information of the other user is matched, the coordinates of each part of the face image and each part of the face image recorded in association with the face image information of the other user If the area occupancy rate is acquired and does not match the personal-face image information of another user, does it match a non-member face image recorded in the viewpoint of the other person in the past but not registered as the personal-face image information? The If it does not match the non-member face image, it is added to the face image region coordinates and face image region area occupancy rates recorded in association with the non-member face image, and matches the non-member face image If not, a non-member image ID is newly issued, associated with the non-member image ID, recorded, and decomposed into each portion as a non-member face image, and the coordinates of each portion of the face image in the entire face, each portion of the face image An area occupancy rate is recorded in the preference object storage unit in association with the user.

  The control unit is connected to a coupling information storage unit that records a combination of two users whose preferences match or approximate each other, and the control unit records the face associated with the user in the preference target storage unit. The image coordinates of each part and the face image parts area ratio, the personal face image information recorded in the user information storage unit in association with other users other than the user, image information of each part to be extracted, Matching processing with the position and area occupancy in the entire face is executed for each item, and when the coincidence exceeds each other by a predetermined reference, the users are combined and recorded in the coupling information storage unit.

  The control unit stores a user location information storage unit that records a location in association with the user, a store and a facility, and a guidance destination information storage unit that records a category associated with them on map data in the form of mapping The control unit is connected to a corporate terminal that can be viewed by an employee of the facility, the control unit acquires location information from the user terminal, records latitude and longitude, and its history, and uses their statistics to determine the frequency of use of the user. Calculates high points and moving routes, records them in the user location information storage unit, and similarly calculates points and moving routes with high usage frequency for other users recorded in combination with the user in the coupling information storage unit Recording the location information in the user location information storage unit, and comparing the point and the movement route between the coupled users. If there are overlapping points between users, it is judged whether there are multiple overlapping points, and if there are multiple overlapping points, a proposal for guiding to the overlapping points is transmitted to the user terminals of the two users. If there is a plurality of overlapping points, a score regarding the point is given based on the number of visits by both users and the required time from the current position, and if there is no overlapping point, the points where the number of visits by both users is large Based on the category information and the required time, a score relating to the point is given, and a proposal for guiding to a point where the score relating to the point is higher is transmitted to the user terminal of the both users, and the user terminal is equipped with an automatic voice When both the user are notified of the proposal by the announcement function and the display display function, and the both users approve the proposal, the consent information is used as the user When the control unit and the control unit transmit from the end to the corporate terminal and either one of the two users does not accept the proposal, the user terminal transmits rejection information to the control unit, and the control is performed. The unit excludes a point rejected based on the refusal information, and executes again the processing of comparing the point and the movement route between both users.

  The control unit is connected to an action instruction information storage unit that records an action instruction history in association with the two users, and the control unit acquires beacon approach information from the user terminal, and the two users approach each other. Transmits an action instruction for visually recognizing the other user to the user terminal, acquires viewpoint image information of an object viewed by the both users via the user terminal, and is coupled with the viewpoint image information. The matching process is performed on the face image information of the other user, and when the coincidence rate exceeds a predetermined reference, an action instruction for talking to the other user is searched from the past action instruction history, and the action for talking If an instruction is found, acquire an acceptance rate and a success rate, assign an action instruction score based on the acceptance rate and the success rate, and select an action instruction with the highest score. If the action instruction history to speak is not found, the action instruction is selected at random from the action instruction group registered in advance, and the action instruction to speak is transmitted to the user terminal, and the user terminal The automatic voice announcement function and the display display function notify the user, and when the user does not accept the action instruction for speaking, the action instruction for speaking is excluded and the action instruction history is When the user re-searches and the user accepts the action instruction to speak, the position information of both users is acquired from the user terminal, the movement of both users is detected, and the beacon approach information from the user terminal If the approach information is maintained, it is determined whether the approach information of the two users is maintained. It is determined that the user can meet the coupled user as a result of following the action instruction, and a success flag is registered in the coupling, and the process is executed again from the process of reflecting the success rate of the action instruction for talking .

  This makes it necessary for the user to match himself through the daily act of looking at himself reflected in the mirror via the user terminal without being aware of membership registration or service use for a particular online service. Personal face image information can be registered, and data analyzed about his / her preference for a love object can be reflected through the daily act of seeing another person through the user terminal Users whose preference for appearance is coupled with each other to a certain degree, match or approximate each other, are guided to a store or facility whose use frequency is high or a store or facility belonging to a category whose use frequency is high, in the store or the facility Naturally as a result of following the behavioral instructions issued for It can be obtained opportunity for interaction between the ring and the other user.

  -In the said love object matching system, the said control part is connected to the figure type image storage part which records the image regarding a figure of a user, and an evaluation result, It matches with a person's face image information out of the said image information acquired from the said user terminal In the case where body image information is acquired from the user terminal after recording the image information not to be generated as the other person image information, it is determined whether the movement of the user's line of sight is within the predetermined range. To obtain the number of eye gaze repetition times of the user from the user terminal, and when the eye gaze repetition number exceeds a predetermined reference, the other person image information and the personal face image information associated with the other person user The matching process is executed, and when they match, the personal-face image information of the other user and the figure image information are associated with each other and the user information storage unit Recording the figure image information in the figure image storage unit, acquiring from the user terminal the gaze time and number of gazes of the user regarding the figure image information, and according to the gaze time and the number of gazes A score relating to the preference is given to the figure image information, and when the score relating to the preference exceeds a predetermined standard, a figure comparison result is received from the figure image storage unit, and the figure relating to the preference is compared with the figure The result is stored in the preference target storage unit in association with the user, while the body type image information stored in the body type image storage unit is derived from the other body type image information stored in the body type image storage unit. The body shape comparison result is sent to the preference object storage unit and the user information storage unit in comparison with the calculated average value, and the shape image information is added to the overall average, The type comparison results transmitted to the user information storage unit is also recorded as the principal type information in association with the others user. As a result, the user can not only look at the face related to the love target, but also the body shape through the natural act of alternately viewing the face and the body shape of the other within a certain visual field range through the user terminal without being aware of the service usage. The analyzed data can also be reflected on preferences.

  -In the said romance object matching system, the said control part was connected to the corporation terminal which can be operated by the employee of the store and the facility recorded on the said guidance destination information storage part, and the said control part transmitted to the said user terminal When both the users accept the proposal, the personal-face image information recorded in the user information storage unit in association with the both users is transmitted to the corporate terminal, and the corporate terminal is equipped with the proposal. The employee is notified by a display display function or an automatic voice announcement function. As a result, the employee of the store or facility designated as the guide destination can provide an opportunity for interaction to the coupled user.

  -In the said love object matching system, the said control part is connected to the said user information storage part which records a voiceprint other than the said user's face and each part, The said automatic voice announcement function of the said user terminal and the said display display function When notifying the user of the action instruction information, receiving a viewpoint image of the user from the user terminal, and performing a matching process on the viewpoint image and a face image of the other user coupled with the viewpoint image. The matching process is performed with the voiceprint information of the voice emitted near the user, which can be acquired via the user terminal, and the voiceprint information of the voice recorded in association with the other user as one of the target items. Thus, it can be determined not only by the image information but also by the audio information that the user has encountered the coupled user as a result according to the action instruction information.

  According to the present invention, the user's behavior is induced toward encounters in a face-to-face conversation without making the user conscious of using the online service while the love object matching the preference regarding appearance and the Internet be able to.

BRIEF DESCRIPTION OF THE DRAWINGS The block diagram of the delivery management system in 1st Embodiment. It is a data block diagram of each storage part of the delivery management system in a 1st embodiment, and (a) is a user information storage part, (b) is a preference object storage part, (c) is a coupling information storage part, d) is a user location information storage unit, (e) is a guidance destination information storage unit, and (f) is an action instruction information storage unit. 3 is a flowchart for describing a process of registering an image of a person's own face in the first embodiment. 3 is a flowchart illustrating preference analysis processing in the first embodiment. 3 is a flowchart illustrating coupling processing in the first embodiment. 3 is a flowchart illustrating guidance processing in the first embodiment. 3 is a flowchart illustrating action instruction processing in the first embodiment. 12 is a flowchart illustrating preference analysis processing, figure evaluation processing, and human body type information registration processing according to a second embodiment.

First Embodiment
Hereinafter, a first embodiment of a love target matching system will be described using FIGS. 1 to 7.

  As shown in FIG. 1, in the love target matching server 20 as a love target matching system, a user terminal 10 used by a user as a matching target candidate and a corporation terminal 30 which can be operated by a store or facility employee as a guide destination. It is connected to the. As the user terminal 10, a wearable computer terminal such as a glasses type or a contact lens type capable of capturing a viewpoint of a user, photographing an object viewed by the user, and recording can be used. The user terminal 10 has a function of announcing an automatic voice to a user using earphones or bone conduction, a function of measuring a user's body temperature from a contact part such as an ear, a sensor function of detecting attachment / detachment by the user, and a date and time It has a function to specify the information of the current position by GPS etc., a function to detect the approach or departure of the user terminals by beacons etc, a function to identify the user personally by the user's fingerprint or iris. The user terminal 10 also includes a transmission lens type display as a display unit and a directional microphone as an input unit. Furthermore, the user terminal 10 includes an asymmetric pattern for detecting left and right with respect to the center line of the user's face when worn by the user, or an apparatus for transmitting infrared rays of different wavelengths or signals at the left and right. ing. The user terminal 10 also has a storage unit. The storage unit stores programs of the respective functions and a user ID described later.

  The love target matching server 20 includes a control unit 21, a user information storage unit 22, a preference target storage unit 23, a coupling information storage unit 24, a user location information storage unit 25, a guidance destination information storage unit 26 and an action instruction information storage unit 27. Is equipped. The preference target storage unit 23 and the user location information storage unit 25 function as a user individual storage unit.

  The control unit 21 functions as a control unit configured of a CPU, a RAM, a ROM, etc., and performs the processing described later (a personal face image registration process stage, a preference analysis process stage, a coupling process stage, a guidance process stage, an action instruction process stage And so on). By executing the love object matching program for this purpose, the control unit 21 functions as a personal identification unit 211, a preference analysis unit 212, a coupling processing unit 213, a guidance instruction unit 214, and an action instruction unit 215.

  The identity determination unit 211 executes processing to determine whether the face image information acquired from the user terminal 10 is the identity of the user. The personal identification unit 211 stores a face recognition determination value for determining whether a human face is included in the acquired image information. In addition, the personal identification unit 211 stores a gaze matching determination value for determining whether the gaze of the user matches the gaze of the acquired face image. The real person determination unit 211 stores a front determination value for determining whether the mirror image of the user terminal 10 in the acquired face image faces the front. When the user terminal 10 is mounted, or if the face image shown in the acquired image is mounted, the identity determination unit 211 determines the left / right inversion determination value for determining whether the left / right is determined. I remember. In addition, the personal identification unit 211 stores the coordinates and the area occupancy of the entire face of each part such as the eyes, nose, mouth, ears, cheeks, eyebrows and the like.

  The preference analysis unit 212 performs a preference analysis process on the appearance of the user according to the number of continuous times at which the user gazes at the image information acquired from the user terminal 10. The preference analysis unit 212 compares a plurality of pieces of face image data, and stores the same person determination value to be detected when they indicate the same person's face. In addition, the preference analysis unit 212 stores a continuous time number determination value for determining from the continuous gaze time that the user prefers. The preference analysis unit 212 stores a reference value for determining image information of each part constituting a human face. In addition, the preference analysis unit 212 records the coordinates and the area occupancy rate of each part in the entire face, and when a plurality of patterns are recorded, executes a process of calculating the statistical values thereof.

  The coupling processing unit 213 executes a process of managing a combination of users whose appearances and preferences regarding the appearances of each other match or approximate each other. The coupling processing unit 213 stores a reference value for determining whether the user's face image information of one user and the preference of the other user match or approximate. The coupling processing unit 213 executes matching processing on image information, and when the matching rate exceeds a predetermined reference value, executes processing of recording these users as a combination.

  The guiding instruction unit 214 executes processing for transmitting a guiding instruction so that the user can meet the coupled partner user without noticing the use of the romantic object matching system. The guidance instruction unit 214 stores map data for specifying the latitude and longitude of the location of the user, and a reference value regarding the stay frequency and stay time for determining the point or route that the user uses daily I remember.

  The action instructing unit 215 executes a process of transmitting an action instruction so as to obtain a trigger for conversation with the coupled partner user without noticing the use of the love target matching system by the user. The action instructing unit 215 records, in real time, the direction and vertical angle at which the user is facing via the user terminal, and stores a reference value for determining whether there is an overlap with the view range of the other user. Further, the action instructing unit 215 records the viewpoint image of the user in real time via the user terminal, and stores a reference value for determining whether there is a matching object from the color, the shape, and the like. The action instruction unit 215 stores a reference value and an action instruction group for selecting an action instruction suitable for the feature of the object viewed by both coupled users.

  The corporate terminal 30 is a display unit that receives user information that has been coupled from the romantic object matching server 20 and has accepted the guidance proposal, and displays the received information for the employee of the store or facility that is the guidance destination, and guidance It has an input part which carries out feedback operation whether it accepts an accepted user or not. Further, the corporation terminal 30 has a storage unit. In this storage unit, user information that has accepted the guidance proposal and information regarding its acceptance or rejection are recorded.

  As shown in FIG. 2A, the user information storage unit 22 stores user management data 220 regarding the user. The user management data 220 is recorded when the user wears the user terminal 10 and authenticates the user's fingerprint, iris or password. This user management data 220 relates to terminal ID, user ID, authentication data, terminal mounting date, terminal mounting position, personal face image, personal face image each part, personal face image each part coordinate, personal face image each part area occupancy rate Contains data.

In the terminal ID data area, data relating to an identifier (terminal ID) for specifying the unique number of the user terminal 10 is recorded.
Data on an identifier (user ID) for identifying each user is recorded in the user ID data area.

  In the authentication data area, data relating to authentication information such as a password for authenticating the user, a fingerprint image or an iris image is recorded.

In the terminal attachment date and time data, data regarding the date and time when the user attached the user terminal 10 and the history thereof is recorded.
In the terminal mounting position data, data regarding the latitude and longitude where the user is located and the history thereof when the user mounts the user terminal 10 is recorded.

Data on the face image of the user taken by the user terminal 10 is recorded in the person's face image data.
In the individual face image each part data, data relating to an image obtained by decomposing the person's own face image into each part such as eyes, nose, mouth, ears, eyebrows, hair style and outline is recorded.
In the personal-face image each part coordinate data, data relating to coordinates indicating the position of each part of the personal-face image in the entire personal-face image is recorded.
Data on the ratio of the area occupied by each part of the face image in the entire face image is recorded in the individual face area part occupancy ratio data.

  As shown in FIG. 2B, the preference target storage unit 23 includes face preference management data 230 regarding the preference for the face of the other person possessed by the user, and a nonmember whose personal face image data is not registered in the love target matching server. Non-member image management data 231 relating to the face and body shape of the subject, and body shape preference management data 232 relating to the preference of the user for the body shape of another person are stored. The face preference management data 230 is recorded when the user visually recognizes the face of one other person through the user terminal 10 for a predetermined time or more. The face preference management data 230 includes data on a user ID, another user ID or non-membership image ID, the number of face gaze times, the number of face recognition times, and the face preference score.

  Data on an identifier (user ID) for identifying the user who is wearing the user terminal 10 is recorded in the user ID data area. The face preference management data 230 is associated with the user management data 220 via the user ID.

Data on an identifier (user ID) for identifying each user other than the user himself / herself wearing the user terminal 10 is recorded in the other user ID data area. The face preference management data 230 is associated with the user management data 220 of another user via the other user ID.
Data regarding an identifier for specifying non-member image management data 231 described later is recorded in the non-member image ID data area. The face preference management data 230 is associated with the non-member image management data 231 via the non-member image ID.

In the face gaze time number data area, data relating to the number of continuous times when the user places a viewpoint on another person's face through the user terminal 10 is recorded.
In the face recognition frequency data area, data relating to the number of times the user places the viewpoint on the face of the other person via the user terminal 10 is recorded.
In the face preference score data area, data related to evaluation points given according to the number of face gaze times and the number of face recognition times is recorded.

  The nonmember image management data 231 includes data on nonmember face images, nonmember face image portions, nonmember face image portion coordinates, and nonmember face image portion area occupancy rates. In this non-member image management data 231, a user places a viewpoint, a face image is photographed and detected by the user terminal 10, and a member whose face image data is determined to be the same person on the love target matching server is detected. If not recorded.

In the non-member face image data area, among the face images taken and detected by the user terminal 10, the user places a viewpoint, and data relating to the face image for which the personal face image is not registered as the user on the love target matching server It is recorded.
Non-member face image In each part data area, data relating to an image obtained by decomposing a non-member face image into parts such as eyes, nose, mouth, ears, eyebrows, and hairstyle is recorded.
In the non-member face image each part coordinate data area, data on the position, such as coordinates of each part of the non-member face image in the entire non-member face image, is recorded.
In the non-member face image part area occupancy rate data area, data relating to the ratio of the area occupied by the non-member face image parts in the entire non-member face image is recorded.

  The body shape preference management data 232 is configured to include data relating to a user ID, another user ID or non-member image ID, the number of body gaze times, the number of body shape viewing times, and the body shape preference score.

  Data on an identifier (user ID) for identifying the user who is wearing the user terminal 10 is recorded in the user ID data area. The face preference management data 230 is associated with the user management data 220 via the user ID.

Data on an identifier (user ID) for identifying each user other than the user himself / herself wearing the user terminal 10 is recorded in the other user ID data area. The face preference management data 230 is associated with the user management data 220 of another user via the other user ID.
Data regarding an identifier for specifying non-member image management data 231 described later is recorded in the non-member image ID data area. The face preference management data 230 is associated with the non-member image management data 231 via the non-member image ID.

In the figure type gaze time number data area, data concerning the number of continuous times when the user places a viewpoint on the figure of the other person via the user terminal 10 is recorded.
Data regarding the number of times this user has placed a viewpoint on another person's body shape via the user terminal 10 is recorded in the body shape recognition frequency data area.
In the body type preference score data area, data relating to evaluation points given according to the number of body shape gaze times and the number of body shape visual recognition times is recorded.

  As shown in FIG. 2C, in the coupling information storage unit 24, users whose appearances of the users themselves and preferences about the appearances of the other users mutually coincide or approximate with each other by a predetermined reference or more Coupling management data 240 regarding the combination of The coupling management data 240 matches the analysis data on the appearance of each user recorded in the user management data 220 with the analysis data on the taste on the appearance of the other user in each user recorded in the face preference management data 230. A process is performed, and it records, when mutually agree | coincident with or more than a predetermined reference | standard mutually. The coupling management data 230 is configured to include data on a user ID and another user ID.

Data on an identifier (user ID) for identifying each user is recorded in the user ID data area. The coupling management data 240 is associated with the user management data 220 via the user ID.
In the other user ID data area, an identifier (other user ID) for specifying the other user who has performed the coupling process with this user is recorded.

  As shown in FIG. 2D, the user location data storage unit 25 records user location data 250 regarding the location of the user. The user location data 250 includes data on user ID, location date and time, location, stay time, and daily route.

  Data on an identifier (user ID) for identifying each user is recorded in the user ID data area. The user location data 250 is associated with the user management data 220 via the user ID.

In the location date data area, data on the date and time when the location of the user is specified is recorded.
In the location data area, data on the latitude and longitude where this user is located is recorded.
In the location frequency data area, data on the number of times this user has stayed at the same location is recorded.
In the residence time data area, data is recorded regarding the number of continuous hours in which the user has stayed at the same location.

In the daily spot data area, data relating to the spot that the user uses regularly is recorded. The daily spot data is calculated from location date data, location data, location frequency data, and stay time data.
In the daily route data area, data relating to the daily route used by the user is recorded. The daily route data is calculated from location date data, location data, location frequency data, and stay time data.

  As shown in FIG. 2 (e), the guidance destination information storage unit 26 includes guidance destination management data 260, guidance destination evaluation data 261, and guidance regarding a store or facility to be a guidance destination for bringing together the coupled users. Instruction data 262 is recorded. The guide destination management data 260 is configured to include data on a guide destination ID, a name, an address, a category, and a detailed description.

  In the guidance destination ID data area, data related to an identifier (a guidance destination ID) for specifying each guidance destination is recorded.

  In the name data area and the address data area, data relating to the name and address of the store or facility to which the user is directed is recorded.

In the category data area, data on the type and type of shop or facility to which the user is directed is recorded.
In the detailed explanation data area, data relating to details such as service contents provided by a store or facility to which the user is directed and a menu of meals is recorded.

  The guidance destination evaluation data 261 is recorded when the user location data 250 of the user and the coupled other user are recorded. The guidance destination evaluation data 261 includes a guidance destination ID, a user ID, another user ID, a daily route matching rate, an overlapping point flag, an average required time, an average location frequency, an average stay time, an overlapping category flag, a category average location frequency, and a category average. It includes data on location time and destination points.

In the guidance destination ID data area, data related to an identifier (a guidance destination ID) for specifying each guidance destination is recorded. The guidance destination evaluation data 261 is associated with the guidance destination management data 260 via the guidance destination ID.
Data on an identifier (user ID) for identifying each user is recorded in the user ID data area. The guidance destination evaluation data 261 is associated with the user management data 220 via the user ID.
In the other user ID data area, an identifier (other user ID) for identifying the other user who has performed the coupling process with the user is recorded.

In the overlapping point flag data area, data relating to a flag indicating a daily point or a point at which a daily route overlaps with each of the coupled users is recorded.
In the average required time data area, data relating to the average value of the required time for moving from the current location of both coupled users to the point where the overlapping point flag or the overlapping category flag is given is recorded. The average required time data is recorded when the overlapping point flag or the overlapping category flag is recorded.
In the average location frequency data area, data relating to the average value of the number of times both coupled users are located at points where duplication point flags have been assigned in the past is recorded. This average location frequency data is recorded when the overlap point flag is recorded.
In the average stay time data area, data is recorded regarding the average value of the number of continuous times in which both coupled users have stayed at a point where the overlap point flag is given in the past. The average stay time data is recorded when the overlap point flag is recorded.

In the overlapping category flag data area, data relating to a flag indicating a point at which a category associated with each of the coupled daily points of the two users is overlapping is recorded.
In the category average location frequency data area, data relating to the average value of the number of times both coupled users are located at points where duplicate category flags have been assigned in the past is recorded. This category average location frequency data is recorded when duplicate category flag data is recorded.
In the category average location time data area, data relating to the average value of the number of continuous times at which both coupled users are located at points where duplicate category flags have been assigned in the past is recorded. This category average location time data is recorded when duplicate category flag data is recorded.
In the guidance destination score data area, data in which the ease of guidance of both coupled users is scored is recorded. The guidance destination score data is recorded when the overlapping point flag or the overlapping category flag is given.

  The guidance instruction data 262 is recorded when the process of transmitting the guidance instruction to both coupled users is performed. The guidance instruction data 262 includes data on a guidance destination ID, a user ID, guidance instruction contents, and a guidance instruction acceptance flag.

In the guidance destination ID data area, data related to an identifier (a guidance destination ID) for specifying each guidance destination is recorded. The guidance destination evaluation data 262 is associated with the guidance destination management data 260 via the guidance destination ID.
Data on an identifier (user ID) for identifying each user is recorded in the user ID data area. The guidance destination evaluation data 262 is associated with the user management data 220 via the user ID.

In the guidance instruction content data area, data on the guidance instruction message text actually notified to the user is recorded.
In the guidance instruction consent flag data area, data regarding a flag indicating acceptance of the user for the guidance instruction is recorded. The guidance instruction acceptance flag data is recorded when the user indicates the intention to accept the guidance instruction via the user terminal 10.

  As shown in FIG. 2 (f), the action instruction information storage unit 27 records action instruction data 270 related to an action instruction that triggers a conversation between users who have gathered at the same guidance destination. The action instruction data 270 includes action instruction ID, user ID, other user ID, guidance destination ID, beacon approach flag, viewpoint image match flag, action instruction content, action instruction acceptance flag, success flag, action instruction acceptance rate, success rate, It comprises data on action instruction scores.

Data on an identifier (action instruction ID) for specifying each action instruction is recorded in the action instruction ID data area.
Data on an identifier (user ID) for identifying each user is recorded in the user ID data area. The action instruction data 270 is associated with the user management data 220 via the user ID.
In the other user ID data area, an identifier (other user ID) for specifying the other user who has performed the coupling process with this user is recorded. The action instruction data 270 is associated with the user management data 220 of another user via the other user ID.
In the guidance destination ID data area, data related to an identifier (a guidance destination ID) for specifying each guidance destination is recorded. The action instruction data 270 is associated with the guidance destination management data 260 via the guidance destination ID.

In the beacon approach flag data area, data on a flag indicating that both coupled users approach each other is recorded. The beacon approach flag data is recorded when the beacons of the user terminals 10 of both coupled users transmit unique signals detected by each other.
Data relating to a flag indicating that one of the coupled users has visually recognized the other's face image is recorded in the viewpoint image matching flag data area. The viewpoint image matching flag data is recorded when the viewpoint is set via any one user or both user terminals 10, and it is determined that the face image is identified as the same person image as the face image of the other person. Ru.
In the action instruction content data area, data on action instruction message text actually notified to the user is recorded.

In the action instruction acceptance flag data area, data relating to a flag indicating acceptance of the user for the action instruction is recorded. The action instruction acceptance flag data is recorded when the user indicates an intention to accept the action instruction via the user terminal 10.
In the success flag data area, data related to a flag indicating that both coupled users are established as a couple is recorded. The success flag data is recorded when the user location data 250 of both users deviates from the position information of the point selected as the guide destination, and the beacon approach flag data is maintained at a predetermined time or a predetermined frequency.
Data on the probability of the user accepting the action instruction is recorded in the action instruction acceptance rate data area. The action instruction acceptance rate data transmits an action instruction to the user, and is recalculated and recorded each time the user accepts or rejects.
In the success rate data area, data relating to the probability that both coupled users reach the formation of a couple by their action instructions is recorded. The success rate data is recalculated and recorded each time the success flag data is recorded.
In the action instruction score data area, data obtained by integrating and scoring the ease with which the user of the action instruction is accepted and the probability of a couple being established by the action instruction is recorded. The action instruction score data is calculated and recorded by integrating the action instruction acceptance rate data and the success rate data.

  Next, various processes in the love target matching server 20 configured as described above will be described using FIGS. 3 to 7. Here, first, with reference to FIG. 3, the personal-face image registration processing will be described.

(Person's face image registration process)
First, when worn by a user, the user terminal 10, which is a glasses-type or contact lens-type wearable terminal, detects it by the sensor function, shifts from the sleep mode to the active mode automatically, and is previously authenticated. An authentication process for using the user terminal 10 is executed by authentication data such as a fingerprint image or an iris image, and when the authentication is completed, an object or a scene beyond the viewpoint while capturing the user's viewpoint Is recorded as an image.

  Next, as shown in FIG. 3, the control unit 21 of the love target matching server 20 acquires an image recorded from the user terminal 10, and performs face recognition processing when the face of a person appears in the image. Execute (step S1-1). Specifically, the personal identification unit 211 of the control unit 21 compares the image received from the user terminal 10 with the face recognition determination value stored in advance, and if the reference is satisfied, the face recognition is performed on the image Register the done flag.

  Next, the control unit 21 of the love target matching server 20 executes a process of determining whether the face-recognized image matches the line of sight of the user (step S1-2). Specifically, the identity determination unit 211 of the control unit 21 compares the line of sight of the face image recognized from the user terminal 10 with the line of sight of the face recognized with the line of sight of the user captured by the user terminal 10 . If the comparison result does not exceed the line-of-sight coincidence determination value stored in advance (in the case of “NO” in step S1-2), the control unit 21 ends the personal face image registration process.

  On the other hand, when the comparison result exceeds the visual line coincidence determination value stored in advance (in the case of “YES” in step S1-2), the control unit 21 of the love target matching server 20 detects that the face-recognized image is front A determination process is performed to determine whether the user is facing (step S1-3). Specifically, the personal identification unit 211 of the control unit 21 determines whether the left and right symmetry of the face image exceeds a predetermined reference, the size, the arrangement and balance of the left and right eyes and ears, the nose and the mouth. And the distance from the center line of the face to the left and right contours, etc., with the front judgment value calculated by inputting a large amount of face images facing the front and face images not facing the front in advance Compare. If the comparison result does not exceed the predetermined reference (in the case of “NO” in step S1-3), the control unit 21 ends the personal face image registration process.

  On the other hand, when the comparison result exceeds the predetermined reference (in the case of “YES” in step S1-3), the control unit 21 of the love target matching server 20 determines that the user terminal 10 shown in the face image is the user's face A determination process is performed to determine whether the left and right sides are inverted with respect to the center line (step S1-4). Specifically, the person determining unit 211 of the control unit 21 executes a process of determining whether or not the user terminal 10 is present in the face image, and in the case where there is a user's face included in the user terminal 10 Execute determination processing whether there is an asymmetric pattern for detecting left and right with the center line as an axis, and if there is, execute determination processing whether or not those patterns are reversed in the left and right . In addition, in order to detect right and left, it may be determined by infrared rays of different wavelengths or signals at right and left. If it is reversed in the left and right (in the case of "YES" in step S1-4), the control unit 21 ends the personal face image registration process.

  On the other hand, when it is not reversed on the left and right (in the case of "NO" in step S1-4), the control unit 21 of the love target matching server 20 executes a process of registering the face image as the personal face image (step S1- 5). Specifically, the identity determination unit 211 of the control unit 21 assigns a user ID to the face image. Next, the face image is recorded as user's own face image data in the user management data 220 of the user information storage unit 22.

  Next, the control unit 21 of the love target matching server 20 executes a process of extracting individual face image part data from the personal face image data (step S1-6). Specifically, the user's eyes, nose, mouth, ears, eyebrows, hairstyle, outline, etc., which are shown in the face image data of the user, are disassembled. Next, the user ID associated with the personal-face image data is extracted from the user management data 220 of the user-information storage unit 22 and added to the extracted personal-face image part data, and the user management data of the user-information storage unit 22 Record at 220.

  Next, the control unit 21 of the love target matching server 20 executes a process of calculating the individual face image individual part position data and the individual face image individual part area occupancy rate data from the individual face image individual part data (step S1-7) ). Specifically, coordinates and the like indicating the positions of individual face image portion data in the entire personal face image are calculated, and at the same time, the ratio of the area occupied by the individual face image portions in the entire personal face image is calculated. Next, the user ID associated with the in-person face image data is extracted from the user management data 220 of the user information storage unit 22 and added to the calculated in-person face image part position data and in-person face image part area occupancy rate data And the user management data 220 of the user information storage unit 22 is recorded.

(Preference analysis process)
Next, a processing procedure of preference analysis processing will be described using FIG.

  First, as shown in FIG. 4, the control unit 21 of the love target matching server 20 executes a process of acquiring a face image of a person whose face is recognized from the user terminal 10 as in step S1-1 (step S2). -1).

  Next, the control unit 21 of the love target matching server 20 executes processing for acquiring the continuous time and the number of times for which the user gazes at the face image whose face is recognized (step S2-2). Specifically, the preference analysis unit 212 of the control unit 21 determines from the user terminal 10 whether the viewpoint of the user is placed in the face image, and measures the number of continuous times placed and the number of times placed. It records as face gaze time number data and face visual recognition frequency data.

  Next, the control unit 21 of the love target matching server 20 executes a process of giving a face preference score to the face image data (step S2-3). Specifically, the preference analysis unit 212 of the control unit 21 assigns a higher score to the face image data as face preference score data as the data on the number of continuous times and the number of times the user looks at the face image is larger. And the face preference management data 230 of the preference object storage unit 23. In addition to the number of fixation times and the number of times, a higher score is given to a specific pattern such as how to move the viewpoint when the user gazes at a face image or one fixation time. It is also good.

  Next, the control unit 21 of the love target matching server 20 executes a process of determining whether the face preference score given to the face image data exceeds a predetermined standard (step S2-4). Specifically, the preference analysis unit 212 of the control unit 21 uses the face preference score data recorded in the face preference management data 230 of the preference target storage unit 23 as a predetermined criterion (for example, the face preference recorded in all preference management data) Compare with the average score data). Then, when the face preference score data does not exceed the predetermined standard (in the case of “NO” in step S2-4), the control unit 21 ends the preference analysis process.

  On the other hand, when the face preference score data exceeds the predetermined reference (in the case of “YES” in step S2-4), the control unit 21 of the love target matching server 20 determines whether the face image and the person's own face image are the same person The determination process is executed (step S2-5). Specifically, the preference analysis unit 212 of the control unit 21 sets the face image data to which the face preference score is given, and the user management data 220 of the user information storage unit 22 to the user ID of the user himself by the personal face image registration process. A matching process with the personal face image data recorded in association with each other is executed. Then, when it is determined that the person is the same (in the case of “YES” in step S2-5), the control unit 21 ends the preference analysis process.

  On the other hand, when it is not determined that the user is the same person as the user (in the case of "NO" in step S2-5), the control unit 21 of the love target matching server 20 determines the face image data to which the face preference score is given. A determination process is performed to determine whether the face image of another user is the same person (step S2-6). Specifically, the preference analysis unit 212 of the control unit 21 sets the face image data to which the face preference score is given and the user management data 220 of the user information storage unit 22 to the user ID of another user by the personal face image registration process. A matching process with the personal face image data recorded in association with each other is executed. Then, when it is determined that the person is the same person (in the case of "YES" in step S2-6), the preference analysis unit 212 of the control unit 21 executes a process of acquiring personal face image analysis data recorded in association with other users. (Step S2-7). Specifically, the preference analysis unit 212 of the control unit 21 extracts the user ID recorded in the user management data 220 of the user information storage unit 22 in association with the face image determined to be the same person, and associates it with the user ID The individual face image parts, individual face image individual part positions, and personal face image individual part area occupancy rates recorded are obtained.

  On the other hand, when it is not determined that the user is the same person as another user (in the case of “NO” in step S2-6), the control unit 21 of the love target matching server 20 has face image data to which a face preference score is assigned. A determination process of whether or not it is already registered as non-member face image data is executed (step S2-8). Specifically, the preference analysis unit 212 of the control unit 21 includes non-member face image data recorded in the non-member image management data 231 of the preference target storage unit 23 and face image data to which a face preference score is given. Execute matching process of When it is determined that the face image data has already been registered as non-member face image data (in the case of “YES” in step S2-8), the preference analysis unit 212 of the control unit 21 receives face image data to which a face preference score is assigned. Is executed in association with the registered non-member image ID (step S2-9). Specifically, a non-member image recorded from the non-member image management data 231 of the preference target storage unit 23 in association with non-member face image data determined to be the same person as the face image to which the face preference score is given. The ID is extracted, and is recorded in the non-member image management data 231 in association with the face image data to which the face preference score is assigned.

  Next, the control unit 21 of the love target matching server 20 executes a process of extracting each nonmember face image part data from the image to which the face preference score is given (step S2-10). Specifically, the preference analysis unit 212 of the control unit 21 decomposes the non-member face image data into parts such as eyes, nose, mouth, ears, eyebrows, hairstyle, and outline.

  Next, the control unit 21 of the love target matching server 20 calculates face image site coordinates and face image site area occupancy rates from the resolved site data, and non-member face image site coordinate data and non-member A process of adding to the face image part area occupancy rate data is executed (step S2-11). Specifically, coordinates are added to the entire nonmember face image data, and coordinates indicating the position of each part data divided are specified, and at the same time, the ratio of the area occupied by each part data in the entire nonmember face image data is calculated Do. Next, the non-member image ID associated with the non-member face image data is extracted from the non-member image management data 231 of the preference object storage unit 23, and the existing non-member face image part coordinate data and the non member face image parts Statistical processing is performed by adding to the area occupancy rate data (for example, calculating an average value). Then, the non-member face image each part coordinate data and the non-member face image each part area occupancy rate data calculated after the statistical processing are recorded in the non-member image management data 231 of the preference object storage unit 23.

  On the other hand, when it is determined that the face image data is not registered as non-member image data (in the case of “NO” in step S2-8), the control unit 21 of the love target matching server 20 A process of newly registering as non-member image data is executed (step S2-12). Specifically, the preference analysis unit 212 of the control unit 21 newly issues a non-membership image ID to the face image to which the face preference score is given, and associates the nonmembership image ID with the non-membership image ID. The nonmember image management data 231 is recorded.

  Next, as in step S2-10, the control unit 21 of the love target matching server 20 executes a process of extracting the non-member face image part data from the non-member face image data (step S2-13).

  Next, the control unit 21 of the love target matching server 20 executes processing for calculating non-member face image part coordinate data and non-member face image part area occupancy data from the non-member face image part data (step S2-14). Specifically, the coordinates are given to the entire nonmember face image data, and the coordinates indicating the position of each part data of the nonmember face image in the entire nonmember face image are specified, and at the same time, the nonmember face in the entire nonmember face image The ratio occupied by the area of each part of the image is calculated. Next, the calculated non-member face image part coordinate data and the non-member face image part area occupancy rate data are recorded in the non-member image management data 231 of the preference target storage unit 23 in association with the non-member image ID.

  Next, the control unit 21 of the love target matching server 20 executes a process of registering the calculated or acquired face image part coordinates and area occupancy rate in association with the user ID of the user (step S2-15). Specifically, the preference analysis unit 212 of the control unit 21 extracts the user ID recorded in the user management data 220 of the user information storage unit 22, associates it with the user ID, and calculates or acquires each part of the face image Coordinates and area occupancy rate data are recorded in the face preference management data 230 of the preference target storage unit 23.

(Coupling process)
Next, the procedure of the coupling process will be described with reference to FIG.

  First, as shown in FIG. 5, the control unit 21 of the love target matching server 20 associates the user with the user by preference analysis processing, and the other image, the other image, each image position, and the other image are highly evaluated. Execute matching processing of the person image area occupancy rate with each person's face image region, the person's face image each portion position, and the person's face image area occupancy rate recorded in association with the other person user by the person's face image registration process (Step S3-1). Specifically, the coupling processing unit 213 of the control unit 21 controls the user management of the user information storage unit 22 and the other image of each other image recorded in the face preference management data 230 of the preference target storage unit 23 in association with the user. User's information storage unit with user's personal-face image each part data recorded in association with other user in data 220, other-person image each part position data recorded in association with user in face preference management data 230 of preference object storage unit 23 22. The user's personal-face image each part position data recorded in association with another user in the user management data 220 and the other-body image each-part area occupied in the face preference management data 230 of the preference object storage unit 23 in association with the user. Rate data and user face data of each person's face image recorded in the user management data 220 of the user information storage unit 22 in association with other users It performs a process of comparing preparative respectively.

  Next, the control unit 21 of the love target matching server 20 executes a process of determining whether or not the difference in each item resulting from the comparison is within a predetermined standard (S3-2). When the predetermined standard is not exceeded (in the case of “NO” in step S3-2), the control unit 21 ends the coupling process.

  On the other hand, when the predetermined standard is exceeded (in the case of “YES” in step S3-2), the control unit 21 of the love target matching server 20 records the individual face image parts and the individual face image parts recorded in association with the user. Matching processing of each position of the other person image, the position of the other person image, the position of the other person image, and the other person image area occupancy rate, in which the position and personal face image area occupancy rate are associated with the other person user (Step S3-3). Specifically, the coupling processing unit 213 of the control unit 21 controls the personal preference image each part data recorded in association with the user in the user management data 220 of the user information storage unit 22 and the face preference management of the preference target storage unit 23 Other-body image each-part data recorded in association with another-user in data 230, personal-face image each-part position data recorded in association with the user in user management data 220 of user information storage unit 22, and preference object storage unit 23 The other person image each part position data recorded in association with the other user in the face preference management data 230 and the personal face image each part area occupancy rate recorded in the user management data 220 of the user information storage unit 22 in association with the user Data of each other part area area occupancy rate data recorded in association with other user in data and face preference management data 230 of preference object storage unit 23 It performs a process of comparing preparative respectively.

  Next, the control unit 21 of the love target matching server 20 executes a process of determining whether or not the difference in each item resulting from the comparison is within the predetermined standard (S3-4). When the predetermined standard is not exceeded (“NO” in step S3-4), the control unit 21 ends the coupling process.

  On the other hand, when the predetermined reference is exceeded (in the case of "YES" in step S3-4), the control unit 21 of the love target matching server 20 executes a process of registering the user and the other user in combination with each other (S3- 5). Specifically, the coupling processing unit 213 of the control unit 21 extracts the user ID of the user who exceeded the predetermined criteria and the user of the other user from the user management data 220 of the user information storage unit 22, and the coupling information storage unit 24. In combination with the coupling data 240 of FIG.

(Induction process)
Next, the procedure of the induction process will be described with reference to FIG.

  First, as shown in FIG. 6, the control unit 21 of the love target matching server 20 executes processing for acquiring position information of both users recorded in combination by coupling processing from the user terminal 10 (step S4-1). ). Specifically, the guidance instruction unit 214 of the control unit 21 acquires, from the user terminal 10, information on the current position in the GPS or the like together with the user IDs of both users. This process is performed periodically (for example, once per second).

  Next, the control unit 21 of the love target matching server 20 executes a latitude / longitude recording process (step S4-2). Specifically, the guidance instruction unit 214 of the control unit 21 generates user location data 250 in which the user ID, the location date and time, and the location are recorded, and records the user location data 250 in the user location information storage unit 25.

  Next, the control unit 21 of the love target matching server 20 executes calculation processing of the location frequency and the stay time in latitude and longitude (step S4-3). This process is executed periodically (several times / day) by sequentially specifying each user recorded in the user information storage unit 22 as a process target user. Specifically, the guidance instruction unit 214 of the control unit 21 extracts from the user location information storage unit 25 user location data 250 for a predetermined period (for example, the past three months) including the user ID of the processing target user. Then, the guidance instruction unit 214 calculates the location frequency and the stay time according to each latitude and longitude of the extracted user location data 250.

  Next, the control unit 21 of the love target matching server 20 executes a process of specifying a point and a route that the user routinely uses from the latitude and longitude where the location frequency is high or the stay time is long (step S4-4). Specifically, the guidance instruction unit 214 of the control unit 21 associates the latitude and longitude where both the location frequency and the stay time exceed the predetermined reference with the user ID, and the user location data 250 of the user location information storage unit 25. The daily spot flag data is attached to and recorded. At the same time, the guidance instruction unit 214 of the control unit 21 associates the latitude / longitude whose location frequency exceeds a predetermined standard and the stay time does not exceed the predetermined standard with the user ID, and the user location data of the user location information storage unit 25 Daily route flag data is attached to 250 and recorded.

  Next, the control unit 21 of the love target matching server 20 executes a process of comparing everyday points between the coupled two users (step S4-5). Specifically, the guidance instruction unit 214 of the control unit 21 extracts the user location data 250 in which the daily spot flag data is recorded in association with the user ID from the user location information storage unit 25 and between the coupled users A determination process is performed to determine whether there is location data having the same latitude and longitude. When there is matching user location data 250 (in the case of “YES” in step S4-6), control unit 21 records overlapping point flag data for a guidance destination that matches the location data of user location data 250. Execute the process Specifically, guidance destination management data 260 in which location data matching the same latitude and longitude are recorded is extracted from the guidance destination information storage unit 26, and guidance destination evaluation data 261 is generated in association with the guidance destination ID. The user ID and the overlapping point flag data of both users coupled to the guidance destination evaluation data 261 are recorded.

  Next, the control unit 21 of the love target matching server 20 executes a process of calculating the required time for moving from the current location of both coupled users to the overlapping point (step S4-7). This processing is executed by sequentially specifying each guidance destination in which overlapping point flag data is recorded as a processing target. Specifically, the guidance instruction unit 214 of the control unit 21 extracts the location data of the guidance destination management data 260 related to the overlapping point from the guidance destination information storage unit 26, and the latest time of both users from the user location information storage unit 25. The location data of the user location data 250 in is extracted, and the time required for movement between the respective location data is calculated based on the map data and route search data stored in advance in the guidance instruction unit 214.

  Next, the control unit 21 of the love target matching server 20 executes a process of calculating an average value of the required time, the location frequency, and the staying time acquired for the overlapping points among the coupled users (step S4-8). ). This processing is executed by sequentially specifying each guidance destination in which overlapping point flag data is recorded as a processing target. Specifically, the guidance instruction unit 214 of the control unit 21 stores the required time calculated from the current location of the user and the location frequency data and the stay time recorded in the user location data 250 of the user location information storage unit 25 in association with the user ID. From the data, the average value between the two users coupled separately for each data is calculated, and the guidance destination ID stored in the guidance destination management data 260 of the same latitude and longitude as the location data of the user location data 250 is guidance destination information storage In the guide destination evaluation data 261 extracted from the unit 26 and recorded in association with the same guide destination ID, the average required time data, the average location frequency data and the average stay time data are related to the guide destination ID, the user ID and the location data. Record

  Next, the control unit 21 of the love target matching server 20 executes a process of giving a lead destination score to the lead destination candidate based on the calculated data (step S4-9). Specifically, the average required time data, the average location frequency data, and the average stay time data recorded in the guide destination evaluation data 261 of the guide destination information storage unit 26 are extracted, and the score increases in inverse proportion to the average required time data. And the score which increases in proportion to the average location frequency data and the average stay time data is calculated, and the average value of each score is associated with the guidance destination ID of the guidance destination evaluation data 261 and recorded as guidance destination score data. Note that instead of averaging each score, a slope may be set for any element or user.

  On the other hand, when there is no user location data 250 whose latitude and longitude match among the coupled users (in the case of “NO” in step S4-6), the control unit 21 of the love target matching server 20 is coupled A process is executed to compare the category of the daily spot between both users (step S4-10). Specifically, the guidance instruction unit 214 of the control unit 21 extracts the user location data 250 in which the daily spot flag data is recorded from the user location information storage unit 25 in association with the user ID and the other user ID, respectively, The guidance destination management data 260 matching the longitude is extracted from the guidance destination information storage unit 26, the category data of the guidance destination management data 260 is extracted, and it is determined whether or not there is a matching category among the coupled users. Execute the process Then, if there is a matching category (in the case of “YES” in step S4-10), control unit 21 executes a process of specifying all the guidance destinations belonging to the category as guidance destination candidates. Specifically, the guidance destination ID of the guidance destination management data 260 in which category data matching category data matched among the coupled users is recorded is extracted from the guidance destination information storage unit 26, and the guidance destination ID is extracted as the guidance destination ID. Coupling ID and overlapping category flag data are recorded in the guidance destination evaluation data 261 in association with each other.

  Next, the control unit 21 of the love target matching server 20 calculates the required time for moving from the current location of both users who are coupled to the overlapping point, for the guidance destination candidate to which the overlapping category flag is added. Execute (step S4-11). This processing is executed by sequentially specifying each guidance destination in which the overlapping category flag data is recorded as a processing target. Specifically, the guidance instruction unit 214 of the control unit 21 extracts the guidance destination ID of the guidance destination evaluation data 261 in which the overlapping category data is recorded from the guidance destination information storage unit 26, and relates the guidance destination ID to the guidance destination ID. The location data recorded in the destination management data 260 is specified, the location data of the user location data 250 at the latest time of both users is extracted from the user location information storage unit 25, and the required time for movement between the respective location data Is calculated based on map data and route search data stored in advance in the guidance instruction unit 214.

  Next, the control unit 21 of the love target matching server 20 calculates an average value of the required time, the location frequency, and the staying time acquired for the guidance destination candidate to which the overlapping category flag is added among the coupled users. The process is executed (step S4-12). This processing is executed by sequentially specifying each guidance destination in which the overlapping category flag data is recorded as a processing target. Specifically, the guidance instruction unit 214 of the control unit 21 stores the required time calculated from the current location of the user and the location frequency data and the stay time recorded in the user location data 250 of the user location information storage unit 25 in association with the user ID. From the data, the average value between the two users coupled separately for each data is calculated, and the guidance destination ID stored in the guidance destination management data 260 of the same latitude and longitude as the location data of the user location data 250 is guidance destination information storage In the guide destination evaluation data 261 extracted from the unit 26 and recorded in association with the same guide destination ID, the average required time data, the average location frequency data and the average stay time data are related to the guide destination ID, the user ID and the location data. Record

  Next, the control unit 21 of the love target matching server 20 executes a process of giving a lead destination score to the lead destination candidate based on each calculated data (step S4-13). Specifically, the guidance instruction unit 214 of the control unit 21 extracts the average required time data, the average location frequency data, and the average stay time data recorded in the guidance destination evaluation data 261 of the guidance destination information storage unit 26, and averages A score that increases in inverse proportion to the required time data and a score that increases in proportion to the average location frequency data and the average stay time data are calculated, and the average value of each score is correlated with the guidance destination ID of the guidance destination evaluation data 261 for guidance Record as first point data. Note that instead of averaging each score, a slope may be set for any element or user.

  On the other hand, when there is no user location data 250 that matches the category of the everyday spot among the coupled users (in the case of "NO" in step S4-10), the control unit 21 of the love target matching server 20 performs step S4-. Re-execute processing from step 3 onwards.

  Next, the control unit 21 of the love target matching server 20 executes a process of selecting a lead destination where the highest score is recorded in the lead destination points (step S4-14). Specifically, the guidance instructing unit 214 of the control unit 21 extracts guidance destination score data recorded in the guidance destination evaluation data 261 of the guidance destination information storage unit 26 in association with the guidance destination ID of the guidance destination candidate, and guiding The candidate candidates are compared with each other, and the ID of the highest candidate guidance destination candidate is selected.

  Next, the control unit 21 of the love target matching server 20 executes a process of transmitting a guidance instruction to the user terminal 10 for the selected guidance destination (step S4-15). Specifically, the guidance instruction unit 214 of the control unit 21 extracts the category data recorded in the guidance destination management data 260 in association with the guidance destination ID of the selected guidance destination, and the category data is recorded in advance in the guidance instruction unit 214 The guidance instruction data 262 associated with the category data is selected from the guidance instruction group which is present, the user ID recorded in the guidance destination evaluation data 261 recorded in association with the same guidance destination ID is extracted, and the same user ID is extracted. The selected guidance instruction data 262 is transmitted to the associated user terminal 10.

  Next, the user terminal 10 executes a process of receiving the guidance instruction transmitted by the control unit 21 of the love target matching server 20 (step S4-16). Specifically, the user terminal 10 receives the guidance instruction data 262 transmitted by the guidance instruction unit 214 of the control unit 21 and records the guidance instruction data 262 in the temporarily provided storage unit.

  Next, the user terminal 10 executes processing for notifying the user of the received guidance instruction via the user terminal 10 (step S4-17). Specifically, the guidance instruction data 262 is transmitted via an audible voice or a bone conduction function provided in the user terminal 10 to announce an automatic voice to the user or a transmission lens type display function provided as a display unit. The user is notified of guidance instruction content data.

  Next, the user terminal 10 executes a process of determining whether the user has accepted the guidance instruction (step S4-18). Specifically, a reply to an acceptance for an automatic voice announcement notifying a guidance instruction by a user is input via a directional microphone provided as an input unit in the user terminal 10 or a button on a display provided in the user terminal 10 The intention of the user is detected by indicating the intention of acceptance through the input unit such as the display. When the user accepts the guidance instruction (in the case of “YES” in step S4-18), the user terminal 10 transmits the information for which the guidance instruction has been accepted to the control unit 21 of the love target matching server 20. Execute (step S4-19). Specifically, the user terminal 10 records acceptance / non-acceptance data of acceptance in the guidance instruction data 262, and transmits the data to the guidance instruction unit 214 of the control unit 21 in association with the guidance destination ID and the user ID.

  Next, the control unit 21 of the love target matching server 20 executes a process of receiving information on acceptance of the guidance instruction transmitted by the user terminal 10 (step S4-20). Specifically, the guidance instruction unit 214 of the control unit 21 receives the guidance instruction data 262 transmitted by the user terminal 10, extracts the guidance destination ID and the user ID, and is stored in advance in the guidance destination information storage unit 26. In the guidance instruction data 262, the acceptance / rejection data is recorded as consent in association with the same guidance destination ID and user ID.

  Next, the control unit 21 of the love target matching server 20 executes a process of transmitting the received information regarding the guidance instruction consent and the personal face image of the consenting user to the corporation terminal 30 (step S4-21). Specifically, the guidance instruction unit 214 of the control unit 21 extracts the user ID recorded in the guidance instruction data 262 of the guidance destination information storage unit 26, and the same user ID from the user information storage unit 22 user management data 220. The face image data associated with the personal information is extracted and transmitted to the corporation terminal 30.

  Next, the corporation terminal 30 executes a process of receiving the information on acceptance of the guidance instruction sent by the control unit 21 of the love target matching server 20 and the personal face image of the consenting user (step S4-22). Specifically, the corporation terminal 30 receives the personal face image data of the user transmitted from the guidance instructing unit 214 of the control unit 21 in association with the user ID, and records the image data in the storage unit provided in the corporation terminal 30 in advance. .

  Next, the corporation terminal 30 executes a process of notifying the employee of the store or facility of the guide destination of the accepted personal facial image of the accepted user (step S4-23). Specifically, based on the calculated required time, the person's face image of the user who accepted the guidance instruction to the employee of the store or facility which is the guidance destination through the display display function etc. of the corporation terminal 30. Display the estimated arrival time and a message instructing you to receive a coupled user (for example, "Please prepare to be next to each other at the counter seat as these 2 users will come to the store in 10 minutes, etc.") .

  On the other hand, when the user does not accept the guidance instruction (in the case of “NO” in step S4-18), the user terminal 10 transmits the information for which the guidance instruction is rejected to the control unit 21 of the love target matching server 20 To execute the process (step S4-24). Specifically, the user terminal 10 extracts the user ID recorded in the terminal, and transmits the information for which the guidance instruction is rejected in association with the user ID to the guidance instruction unit 214 of the control unit 21.

  Next, the control unit 21 of the love target matching server 20 executes a process of receiving the information on the refusal of the guidance instruction transmitted by the user terminal 10 (step S4-25). Specifically, the guidance instruction unit 214 of the control unit 21 receives the guidance instruction data 262 transmitted by the user terminal 10, extracts the guidance destination ID and the user ID, and is stored in advance in the guidance destination information storage unit 26. In the guidance instruction data 262, guidance instruction acceptance data is recorded as rejection in association with the same guidance destination ID and user ID.

  Next, the control unit 21 of the love target matching server 20 executes a process of reflecting the evaluation of the guidance destination for which the guidance instruction has been rejected (step S4-26). Specifically, the guidance instruction unit 214 of the control unit 21 records the guidance destination ID and the guidance ID of the guidance instruction data 262 in which the acceptance / rejection data of rejection is recorded in the guidance destination information storage unit 26 in association with the user ID. The evaluation data 261 is extracted, and the negative score recorded in advance in association with the rejection data is added to the guidance destination score data. Then, the process is re-executed from step S4-3.

(Action instruction processing)
Next, the processing procedure of action instruction processing will be described using FIG. 7.

  First, as shown in FIG. 7, the control unit 21 of the love target matching server 20 has the user terminal 10 provided with the approach information of the users who are guided to the guidance destination by the guidance processing. A process of acquiring from the designated beacon sensor is executed (step S5-1). Specifically, the action instruction unit 215 of the control unit 21 detects an approach of users coupled via a near field communication radio wave such as Bluetooth (registered trademark) from a beacon sensor provided in the user terminal 10 When it does, approach information is acquired, action indication data 270 is generated in action indication information storage section 27, beacon approach flag data is recorded.

  Next, the control unit 21 of the love target matching server 20 executes a process of transmitting an action instruction to visually recognize the partner user coupled to the user terminal 10 (step S5-2). Specifically, the action instruction unit 215 of the control unit 21 causes the action instruction data 270 of the action instruction information storage unit 27 to execute the action instruction content data (for example, “male or female sitting in the next seat is attractive. Or the like) in association with the user ID of both coupled users and recorded, and transmit them to the user terminals 10 of both users respectively, and the automatic voice announcement function or display display provided on the user terminal 10 Notify the user through the function.

  Next, the control unit 21 of the love target matching server 20 acquires an image recorded from the user terminal 10, and executes face recognition processing when a person's face is shown in the image (step S5). 3). Specifically, the action instructing unit 215 of the control unit 21 compares the image received from the user terminal 10 with the face recognition determination value stored in advance, and if the reference is satisfied, the face recognition is performed on the image Register the completed flag.

  Next, the control unit 21 of the love target matching server 20 executes a process of comparing the acquired face image data with the face image of the coupled user (step S5-4). Specifically, the action instruction unit 215 of the control unit 21 compares the face image acquired from the viewpoint image of the user with the face image of the other user coupled with the user. Then, as a result of comparison, when the matching rate does not exceed the predetermined value (in the case of “NO” in step S5-5), the action instructing unit 215 of the control unit 21 re-executes the action instructing process from step S5-1. Do.

  On the other hand, when the match rate exceeds the predetermined value (in the case of “YES” in step S5-5), the control unit 21 of the love target matching server 20 executes a process of searching for the action instruction history (step S5-6) ) Specifically, the action instruction unit 215 of the control unit 21 searches the action instruction information storage unit 27 for the presence of the action instruction data 270 in which the action instruction acceptance rate data and the success rate data are recorded.

  Then, when there is an action instruction history (in the case of “YES” in step S5-7), the control unit 21 of the joint object matching server 20 determines from the action instruction history the probability that the user accepted the past action instruction and the past action A process of acquiring the probability that the instruction has succeeded is executed (step S5-8). Specifically, the action instruction unit 215 of the control unit 21 associates the action instruction acceptance rate data recorded in the action instruction data 270 of the action instruction information storage unit 27 in association with the user ID and the user ID of the other user. Obtain the recorded success rate data.

  Next, the control unit 21 of the love target matching server 20 executes a process of calculating an action instruction score based on the acquired consent rate and success rate (step S5-9). Specifically, the action instructing unit 215 of the control unit 21 calculates the sum of the acquired action instructing acceptance rate data and the success rate data according to a predetermined equation, and the sum is stored in the action instructing data 270 of the action instructing information storage unit 27. It associates with the user ID of the user and records it. Weighting may be applied to one of the data in calculating the success rate and the total value.

  Next, the control unit 21 of the love target matching server 20 executes a process of selecting an action instruction based on the calculated action instruction score (step S5-10). Specifically, the action instructing unit 215 of the control unit 21 selects, from the action instructing information storage unit 27, the action instructing data 270 in which the highest action instructing score is recorded.

  Next, the control unit 21 of the love target matching server 20 executes a process of transmitting the action instruction of the highest score to the user terminal 10 (step S5-11). Specifically, the action instruction unit 215 of the control unit 21 transmits, to the user terminal 10, the action instruction data 270 recorded in association with the action instruction score data of the highest score in the action instruction information storage unit 27.

  On the other hand, when there is no action instruction history (in the case of "NO" in step S5-7), step S5-8, step S5-9 and step S5-10 are omitted without referring to the past action instruction history, and it is made in advance. The action instruction is selected from the action instruction group recorded, and the process of transmitting to the user terminal 10 is executed. Specifically, the action instruction unit 215 of the control unit 21 randomly selects one from the plurality of action instruction data 270 recorded in the action instruction information storage unit 27 and transmits it to the user terminal 10 .

  Next, the control unit 21 of the love target matching server 20 executes a process of determining whether the transmitted action instruction has been accepted by the user (step S5-12). Specifically, after receiving the action instruction, the action instructing unit 215 of the control unit 21 instructs the user to perform the action via a display display function or an automatic voice announcement function as an output unit with which the user terminal 10 is equipped. , And the user responds via the touch display function or directional microphone as an input unit whether or not to accept the notified action instruction, and the user terminal 10 sends the result to the love target matching server 20. It transmits to the control unit 21. If there is no reply, it is determined that it has been rejected.

  When the user refuses (in the case of "NO" in step S5-12), the control unit 21 of the love target matching server 20 executes a process of excluding the action instruction transmitted to the user terminal 10 (step S5-13) . Specifically, the action instruction unit 215 of the control unit 21 specifies the action instruction ID of the action instruction data 270 rejected by the user and excludes it from the action instruction group recorded in the action instruction information storage unit 27. Then, the process of searching for the action instruction history in step S5-6 is re-executed.

  On the other hand, when the user consents (in the case of “YES” in step S5-12), the control unit 21 of the love target matching server 20 executes a process of acquiring an action instruction acceptance flag. Specifically, the action instruction unit 215 of the control unit 21 records action instruction acceptance flag data in the action instruction data 270 of the action instruction information storage unit 27.

  Next, the control unit 21 of the love target matching server 20 executes a process of detecting the movement of both coupled users (step S5-15). Specifically, the action instructing unit 215 of the control unit 21 acquires position information from the user terminals 10 of both the coupled users, and stores the location data recorded in the guidance destination data 250 of the guidance destination information storage unit 26. When the distance between the position information of the user terminal 10 and the location data of the guidance destination exceeds a predetermined value, it is determined and detected that the user has moved from the guidance destination.

  Next, the control unit 21 of the love target matching server 20 executes a process of determining whether the beacon approach information is maintained (step S5-16). Specifically, the action instruction unit 215 of the control unit 21 starts the action instruction data of the action instruction information storage unit 27 from the time point when the approach of the users coupled via the beacon sensor included in the user terminal 10 is detected. Whether or not beacon approach flag data recorded in 270 has been released due to the departure of both users, or after the beacon approach flag data is not recorded again, the predetermined continuous time number is exceeded Determine if there is. If the position information is sufficiently accurate, the position information may be used instead of the beacon approach information.

  When the beacon approach information is maintained (in the case of “YES” in step S5-16), the control unit 21 of the love target matching server 20 is notified to both coupled users and both users. A success registration process is executed for the action instruction (steps S5-17). Specifically, the coupling processing unit 213 of the control unit 21 extracts the coupling ID recorded in the coupling data 240 of the coupling information storage unit 24, associates it with the coupling ID, and transmits the success flag data. Record. Further, the action instruction unit 215 of the control unit 21 extracts the action instruction ID recorded in the action instruction data 270 of the action instruction information storage unit 27 and records success flag data in association with the action instruction ID.

  Next, the control unit 21 of the love target matching server 20 executes a process of calculating and reflecting the action instruction success rate for the successful action instruction (step S5-18). Specifically, the action instruction unit 215 of the control unit 21 extracts the action instruction data 270 in which the success flag data is updated from the action instruction information storage unit 27, and among the numbers notified to the user, the success flag data Calculate the ratio of the number of recorded cases and record it as success rate data.

According to the present embodiment, the following effects can be obtained.
(1) In the present embodiment, when the control unit 21 of the love target matching server 20 executes the face recognition processing of the image acquired from the user terminal 10 (step S1-1), the face recognition completed image and the user's gaze Of the face recognition (step S1-2), the process of determining whether the face-recognized image faces the front (step S1-3), and the user terminal 10 shown in the face image A determination process (step S1-4) is performed to determine whether the left and right sides of the face center line of the user's face are reversed. Then, if predetermined conditions are satisfied in these determination processes, the personal-person's face image registration process is executed. As a result, the face image can be detected and recorded as the face image only when the face image as the virtual image of the user in the mirror is recorded without making the user conscious of service use and member registration. When the face image of another person other than the user is recorded, the face image can be processed so as not to be recorded as the user.

  (2) In the present embodiment, when the control unit 21 of the love target matching server 20 executes the face recognition processing of the image acquired from the user terminal 10 (step S2-1), the face recognition completed image and the user of the user A determination process (step S2-2) is performed to determine whether or not the face images match. Then, when the user's face image does not match, a process of registering the face image of the other person is executed (step S2-3), and the time and the number of times for which the user looks at the face image of the other person are Obtain points (step S2-4), give points according to the degree (step S2-5), and the coordinates and area of each part constituting the face image of the face image of the other person who exceeds the predetermined reference point The occupancy rate is calculated (steps S2-7, S2-8). In this way, the user registers the face image of the other person who sees unknowingly for a long time or repeatedly as the preference object of the user without consciously selecting the face image of the other person himself, and each part constituting the face image Can be analyzed.

  (3) In the present embodiment, the control unit 21 of the love target matching server 20 determines the shape, coordinates, and area occupancy of each part of the face image registered and analyzed as the user's preference target with the face image of another user. When the matching process is executed (step S3-1) and the matching rate is equal to or higher than a predetermined reference value (in the case of "YES" in step S3-2), the user and another user of preference object are registered for coupling Do. As a result, the determination process can be executed with other users who are not directly viewing the user as matching candidates, and a large number of users can be coupled through the Internet while considering the user's unconscious preference.

  (4) In the present embodiment, the control unit 21 of the love target matching server 20 acquires position information from the user terminal 10 (step S4-1), and calculates the location frequency and stay time of the user at a specific latitude and longitude (Step S4-2), and execute a process of comparing points or routes routinely used among the coupled users (step S4-5), the location frequency, the stay time, and the time required from the current location And give points in consideration of the point category etc. (steps S4-9, S4-13), and execute processing to transmit to the user terminal 10 an instruction to guide the user coupled to the highest score induction destination (Step S4-15). Then, when both coupled users accept the guidance instruction (in the case of “YES” in step S4-18), the employee of the store or facility who is the guidance destination browses the accepted fact and the personal face image of both users And a process of transmitting to the corporation terminal 30 which can be operated (step S4-21). As a result, the guidance instruction can be easily accepted by both of the coupled users, and after acceptance, the corporate side operating the store or facility of the induction destination accepts both users in advance, and places both users in the adjacent seat. Information can be obtained.

  (5) In the present embodiment, the control unit 21 of the love target matching server 20 acquires beacon approach information from the user terminal 10 (step S5-1), and detects that both coupled users approached. Sends an action instruction to the user terminal 10 to look at the next seat (step S5-2), and compares the face image detected at the end of the user's viewpoint with the face image of the coupled partner user. To execute the process (step S5-4). Then, if the face images match (in the case of "YES" in step S5-5), the action instruction having a high action instruction acceptance rate and action instruction success rate by the user from the action instruction history that has been transmitted in the past 10 (steps S5-6, S5-7, S5-8, S5-9, S5-10, S5-11), and the user accepts the action instruction ("YES" in step S5-12) ), The process of detecting movement based on the position information of both the coupled users (step S5-15), and the process of determining whether beacon approach information is maintained (step S5-16). Thus, after detecting the approach of both coupled users, the action instruction having the highest success rate is selected and transmitted from the past history, and after the action instruction is accepted, the short distance between both users is maintained. The movement can be detected from the position information as it is, and it can be determined whether the action instruction has contributed to the development of the relationship between the two coupled users.

Second Embodiment
Next, a second embodiment of the love target matching system will be described using FIG. In the first embodiment, the preference of the user is analyzed and coupled based on the gaze time and the number of gazes of the user in the face image of another user or a nonmember. In the present embodiment, preference analysis is performed based on the gaze time and the number of times of the user not only in the face image of the other person but also in the figure image by including the movement of the user's line of sight immediately after viewing the other person's face image Perform processing and coupling processing. In the present embodiment, the same parts as those in the above-described embodiment are denoted by the same reference numerals, and the detailed description thereof is omitted.

In the present embodiment, in addition to each data described as being recorded in the user management data 220 of the user information storage unit 22 of the love target matching server 20 in the first embodiment, the data and figure regarding the present humanoid image are It contains the user ID of the preferred user.
In the present human-body-type image data area, data relating to an image in which the user's own figure is photographed is recorded.
In the user ID area, data relating to the user ID of another user is recorded among identifiers (user ID) for specifying each user.

The preference analysis process according to the present embodiment will be described with reference to FIG. This process is performed when a face image and a figure image are acquired from a user terminal.
First, as in step S2-1, the control unit 21 of the love target matching server 20 executes a process of acquiring a face image of a person whose face is recognized from the user terminal 10 (step S6-1).

  Next, the control unit 21 of the love target matching server 20 executes a process of acquiring an image recognized as a figure of a person from the user terminal 10 (step S6-2). Specifically, when it is detected that the shape of the limbs or clothes or the color of human skin is reflected, the image is recognized as a figure-shaped image.

  Next, the control unit 21 of the love target matching server 20 executes processing for acquiring the continuous time for which the user gazes at the face image whose face is recognized and the number of times to repeat the face image and the figure image recognized as the body type. (Step S6-3). Specifically, the preference analysis unit 212 of the control unit 21 determines from the user terminal 10 whether the viewpoint of the user is placed in the face image, and measures the number of continuous times placed and the number of times placed. At the same time, the continuous time and the number of times the viewpoint is placed in the figure image are measured, and the number of figure gaze hours is stored in the preference face image management data 230 of the preference object storage unit 23 as face gaze time number data and face sighting number data. It is recorded in the preference figure type image management data 232 as data and figure recognition frequency data.

  Next, the control unit 21 of the love target matching server 20 executes a process of determining whether the movement of the viewpoint repeating the face image and the figure image is within a predetermined range (step S6-4). Specifically, the preference analysis unit 212 of the control unit 21 determines that the viewpoint of the user who repeats the face image data and the body type image data from the user terminal 10 has an average height and width of the human body with respect to the position of the face image. Whether moving within the range is determined while calculating the distance between the user and the face image. And when it judges with out of the range (in the case [Step S6-4] of "NO"), control part 21 ends taste analysis processing.

  On the other hand, when it is determined that the range is within the range (in the case of “YES” in step S6-4), the control unit 21 of the love target matching server 20 counts the number of times the viewpoint repeats the face image and the body type image A determination process of whether or not the value exceeds a predetermined reference is executed (step S6-5). Specifically, the preference analysis unit 212 of the control unit 21 controls the face recognition frequency data and the body shape recognition frequency data recorded in the preference management data 230 of the preference object storage unit 23 and the face gaze time recorded in the preference management data 232 The number data and the figure gaze time number data are compared to predetermined criteria (e.g., the average number of times a person moves the viewpoint when viewing another person's whole body). Note that it is more effective for specific patterns such as how to move the viewpoint when the user gazes at the face image and figure image, as well as the number of fixation times and the number of repetitions. You may add the criterion judged to be. Then, if the criteria for the number of repetitions and the number of continuous times are not exceeded (in the case of “NO” in step S6-5), the control unit 21 ends the preference analysis process.

  On the other hand, when the criteria for the number of repetitions and the number of continuous times are exceeded (in the case of “YES” in step S6-5), the control unit 21 of the love target matching server 20 associates the face image and the figure image as those of the same person. The process is executed (step S6-6). Specifically, the face image data and the figure image data are mutually associated and recorded in the preference object storage unit 23.

  Next, the control unit 21 of the love target matching server 20 executes a process of giving a score for the preference regarding the figure (step S6-7). Specifically, the preference analysis unit 212 of the control unit 21 sets a higher score on the figure image data as the figures of the figure gaze time number data and the figure recognition frequency data acquired in step S6-3 increase. It is given as preference score data and recorded in the preference object storage unit 23. In addition to the number of fixation times and the number of times, a higher score is given to a specific pattern such as how to move the viewpoint when the user gazes at the figure image or one fixation time. It is also good.

  Next, the control unit 21 of the love target matching server 20 executes a determination process as to whether or not the body shape preference score given to the body shape image data exceeds a predetermined standard (step S6-8). Specifically, the preference analysis unit 212 of the control unit 21 performs predetermined criteria (for example, the figure preference score data recorded in all preference management data) on the figure preference score data attached to the figure image in the preference target area 23 Compare with the average value of Then, when the shape preference score data does not exceed the predetermined standard (in the case of “NO” in step S6-8), the control unit 21 ends the preference analysis process.

  On the other hand, when the body shape preference score data exceeds the predetermined reference (in the case of “YES” in step S6-8), the control unit 21 of the love target matching server 20 detects the face image associated with the body shape image in step S6-6. Then, a process of judging whether the user's personal face image is the same person or not is executed (step S6-9). Specifically, the preference analysis unit 212 of the control unit 21 extracts face image data recorded in the preference target storage unit 23 in association with the body shape image data to which the body shape preference score is given, and the person's own face image registration processing Thus, matching processing with the personal-face image data recorded in the user management data 220 of the user information storage unit 22 in association with the user ID of the user is executed. Then, when it is determined that the person is the same person (in the case of “YES” in step S6-9), the control unit 21 ends the preference analysis process.

  On the other hand, when the user is not determined to be the same person as the user (in the case of “NO” in step S6-9), the control unit 21 of the love target matching server 20 determines that the face image data and the face image of the other user are the same person A determination process is performed (step S6-10). Specifically, the preference analysis unit 212 of the control unit 21 uses the face image associated with the physical image in step S6-6 and the user management data 220 of the user information storage unit 22 by the personal-face image registration processing of another user. A matching process with personal face image data recorded in association with the user ID is executed. Then, when it is determined that the same person as the other user (in the case of "YES" in step S6-10), the preference analysis unit 212 of the control unit 21 executes processing to associate the figure image with the user ID of the other user (Step S6-11). Specifically, the preference analysis unit 212 of the control unit 21 extracts the user ID of the other user who is determined to be the same person from the user management data 220 of the user information storage unit 22, associates it with the user ID, and the figure image data. The user management data 220 is recorded.

  On the other hand, when it is not determined to be the same person as another user (in the case of “NO” in step S6-10), the control unit 21 of the love target matching server 20 matches the person shown in the existing nonmember image A determination process is performed (step S6-12). Specifically, the preference analysis unit 212 of the control unit 21 selects the face image associated with the physical image in step S6-6 and the non-member face already recorded in the non-member image management data 231 of the preference target storage unit 23. Execute matching processing with image data. Then, when it is determined that the person in the non-member image is the same person (in the case of “YES” in step S6-12), the preference analysis unit 212 of the control unit 21 associates the physical image with the non-member image ID. A recording process is executed (step S6-13). Specifically, the preference analysis unit 212 of the control unit 21 extracts the non-member image ID recorded in association with the non-member face image determined to be the same person from the non-member image management data 231 of the preference target storage unit 23 In step S6-6, the figure type image associated with the face image is associated and recorded in the non-member image management data 231.

  On the other hand, when it is determined that the person is not the same person as the non-member image (in the case of “NO” in step S6-12), the control unit 21 of the love target matching server 20 does not become a member for the face image associated with the figure image. The process of newly registering the image ID is executed (step S6-14). Specifically, the preference analysis unit 212 of the control unit 21 newly issues a non-membership image ID to the face image associated with the figure-shaped image in step S6-6, and the preference-member storage unit 23 generates a non-membership image Management data 231 is generated, each face image part is extracted from face image data, coordinates and area occupancy of each face image part are calculated, non-member image data, non-member face image data each part data, non-member face The image data is recorded as each part coordinate, non-member face image data each part area occupancy, and non-member type image data.

  Next, the control unit 21 of the love target matching server 20 executes a process of associating the other user ID or the non-member image ID with the user as the figure preference (step S6-15). Specifically, the preference analysis unit 212 of the control unit 21 associates the user ID of another user recorded in step S6-11 in association with the figure image data or the figure image data in step S6-13 or step S6-14. The recorded nonmember image ID is recorded in the body shape preference object management data 232 of the preference object storage unit 23. Further, when the physical image data is associated with the user ID of another user (in the case of “YES” in step S6-10), the preference analysis unit 212 records the user ID of the user in the user information storage unit 22 The user management data 220 of the other user is recorded as the user ID of the user who prefers the figure.

  The control unit 21 of the love target matching server 20 executes a process of searching for another user whose image ID of the preferred physical shape overlaps or approximates (step S6-16). Specifically, the preference analysis unit 212 of the control unit 21 extracts the non-member image ID recorded in association with the user ID of the user or the user ID of another user from the preference type management data 232 of the preference target storage unit 23. The same ID is searched for the user ID of another user recorded in the preference type management data 232 as the preference type.

  Next, the control unit 21 of the love target matching server 20 executes a process of determining whether the duplication rate of the image ID of the body type to be preferred exceeds a predetermined standard (step S6-17). Specifically, the preference analysis unit 212 of the control unit 21 extracts the other users whose overlap rate exceeds a predetermined reference, among the other users whose image IDs of preferred physical shapes overlap or approximate. Then, when the overlapping rate of the image ID of the body shape to be preferred does not exceed the predetermined reference (in the case of “NO” in steps S6-17), the control unit 21 ends the preference analysis process.

  On the other hand, when the overlap rate exceeds the predetermined reference (in the case of “YES” in step S6-17), the control unit 21 of the love target matching server 20 determines the preference figure information of the other user who exceeds the predetermined reference of the overlap A process of recording an unregistered image ID in the preference type information of the user of the registered image IDs is executed (step S6-18). Specifically, the preference analysis unit 212 of the control unit 21 is recorded in the preference type management data 232 of the preference target storage unit 23 in association with the user ID of another user whose preference ratio overlaps with a predetermined standard. Among the non-member image ID and the user ID of another user, one not associated with the user ID of the user is associated with the user ID of the user and recorded in the preference type management data 232.

According to the present embodiment, in addition to the same effects as (1) to (5) of the above embodiment, the following effects can be obtained.
(6) In the present embodiment, when the figure image is acquired from the user terminal 10 together with the face image, and the movement of the line of sight moving between the two images is within the range (“YES” in step S6-4), When the number of times the line of sight moves back and forth or the continuous time exceeds a predetermined reference (in the case of “YES” in step S6-5), the control unit 21 of the love target matching server 20 associates the face image with the figure image Are recorded (step S6-6), and the body type image is also evaluated by giving a score regarding preference. Then, preference shape information of another user whose pattern of the preferred figure image overlaps or approximates is extracted, and unregistered preference shape information is newly recorded (steps S6-16, steps S6-17, steps S6-18). . Thus, not only the face image but also the preference for the figure type image can be included in the preference analysis target.

  In addition, the above embodiments may be modified as follows.

In the first embodiment, the control unit 21 of the love target matching server 20 executes a process of giving a face preference score to the face image data (step S2-3). In this case, the preference analysis unit 212 of the control unit 21 assigns a higher score to the face image data as face preference score data as the numerical value of the data relating to the number of continuous times and the number of times the user gazes at the face image is larger. Do. In addition to this, when the user terminal 10 is provided with a function of acquiring data reflecting the user's mental state such as heart rate and body temperature, these data are combined to calculate face preference score data. You may do so.
In the first embodiment, the control unit 21 of the love target matching server 20 executes a process of notifying the user of the received guidance instruction via the user terminal 10 (step S4-17). In this case, the guidance instruction of the guidance instruction data 262 via the transparent lens type display function provided as a function or an announcement unit that announces an automatic voice to the user using an earphone or bone conduction etc. provided in the user terminal 10 Notify the user of content data. The means for notifying the user is not limited to these. For example, a schedule for going to a guide destination may be registered in a calendar function provided in advance in the user terminal 10.

  DESCRIPTION OF SYMBOLS 10 ... User terminal, 20 ... Love object matching server, 30 ... Corporation terminal, 21 ... Control part, 22 ... User information storage part, 23 ... Preference object storage part, 24 ... Coupling information storage part, 25 ... User location information storage Part 26: Guidance destination information storage part 27: Behavior instruction information storage part 211: Person determination part 212: Preference analysis part 213: Coupling processing part 214: Guidance instruction part 215: Behavior instruction part 220 ... User management data 220, face preference management data ... 230, nonmember image management data ... 231, body type preference management data ... 232, coupling management data ... 240, user location data ... 250, guidance destination data ... 260, visit record data ... 261, guidance destination evaluation data ... 262, action instruction data ... 270.

Claims (7)

A user information storage unit having a storage area associated with a user's face and image information of each part constituting the user;
A control unit connected to a user terminal capable of capturing the viewpoint of the user, photographing an object the user is looking at, and recognizing a face when the object is a human face and recording the object Love matching system,
The control unit
Obtaining face recognized image information recorded by the user terminal;
It is determined whether the line-of-sight coincidence rate between the image information and the user exceeds a predetermined standard,
Determining whether the user terminal appearing in the image information is facing forward;
Determining whether the user terminal reflected in the image information is mirror-reversed by a mirror surface;
When all the conditions of the determination are satisfied, the face-recognized image information is recorded as the face image information in the user information storage unit,
Extracting an image of each part constituting the face shown in the personal-face image information;
Calculating coordinates and area occupancy of the entire face of each part;
A love object matching system characterized in that it is recorded in the user information storage unit as individual face image individual part coordinates and the personal face image area occupancy rate in association with the user. The control unit is connected to a preference target storage unit that records preferences related to the face of another person in association with the user,
The control unit
Obtaining face recognized image information recorded by the user terminal;
Acquiring the number of continuous times and the number of times the viewpoint is placed on the image information of the other person recorded by the user terminal;
According to the number of continuous times and the number of times, a score on preference is given
When the score regarding the preference exceeds a predetermined standard, it is determined whether the image information matches the personal-face image information.
If they match, the area coordinates of the individual face image of the other user and the area ratio of the individual face image are acquired.
If they do not match, it is determined whether a non-member image ID has already been registered,
If it is registered, it is added to the non-member face image each part coordinates and the non-member face image each part area occupancy in association with the existing non-member image,
If not registered, the non-member image ID is newly registered to calculate the non-member face image each region coordinates and the non-member face image each region area occupancy rate,
The love object matching system according to claim 1, wherein the preference object storage unit records the information in association with the user. The control unit is connected to a coupling information storage unit that records a combination of a plurality of users whose preferences match or approximate each other,
The control unit
The individual face image each part coordinates and the individual face image each part area occupancy rate recorded in the preference object storage unit in association with the user, and the user information storage unit are recorded in association with the other user Executing matching processing between the individual face image each part coordinates and the individual face image each part area occupancy rate,
3. The love target matching system according to claim 2, wherein when the matching rates mutually exceed a predetermined reference, coupling processing is performed on the combination of the users, and the combination is recorded in the coupling information storage unit. The control unit is connected to a user location information storage unit for storing a location in association with the user, and a guidance destination information storage unit for storing a store, a facility, and a category associated with them on map data.
The control unit
Obtain location information from the user terminal,
Record the latitude and longitude and their history,
Calculate the location frequency and stay time at the latitude and longitude,
Identifying a point and a route that the user uses on a daily basis and recording the same in the user location information storage unit;
Similarly, for other users recorded in the coupling information storage unit in combination with the user, points and travel paths with high usage frequency are similarly calculated, and are recorded in the user location information storage unit.
Compare the point and the travel path between both coupled users,
If there is a duplication point, a destination score is assigned based on the number of visits of both users and the time taken from the current position,
If there is no overlapping point, the guidance destination score is assigned based on point category information where the number of visits by both users is large and the required time,
Selecting a point where the guidance destination score is higher and transmitting a guidance instruction to the user terminals of the two users;
The user terminal notifies both of the users of the guidance instruction by the provided voice announcement function and display display function.
If the two users agree to the guidance instruction, consent information is transmitted from the user terminal to the controller.
The consent information and the face image of the two users are transmitted to the corporation terminal provided at the guidance destination, and the corporation terminal is notified of an instruction to cause the employee of the guidance destination who browses the corporation terminal to approach the two users. ,
When any one or both of the two users do not accept the guidance instruction, rejection information is transmitted from the user terminal to the control unit,
The love target matching according to claim 3, wherein the control unit executes again the processing of comparing the point and the movement route between both users excluding the point rejected based on the refusal information. system. The control unit is connected to an action instruction information storage unit that records an action instruction history in association with the both users,
The control unit
Acquiring beacon approach information from the user terminal;
When the two users approach each other, an action instruction is sent to the user terminal to visually recognize the other user,
Acquiring viewpoint image information of an object viewed by the two users via the user terminal;
Performing matching processing on the face image information of the other user coupled to the viewpoint image information;
If the coincidence rate exceeds a predetermined criterion, an action instruction for talking to the other user is retrieved from the past action instruction history,
If the action instruction is found, the action instruction acceptance rate and the success rate associated with the action instruction are acquired,
Assigning a behavioral instruction score based on the behavioral instruction acceptance rate and the success rate, and selecting a behavioral instruction with the highest score,
If there is no action instruction history, an action instruction is selected at random from a pre-registered action instruction group,
The action instruction is transmitted to the user terminal, and the user terminal notifies the user by the voice announcement function and the display display function.
When the user does not accept the action instruction, the action instruction is excluded and the action instruction history is re-searched.
When the user accepts the action instruction, position information of both users is acquired from the user terminal, and movement of both users is detected.
The beacon approach information is acquired from the user terminal, and it is determined whether the approach information of both the users is maintained,
If the approach information is maintained, it is determined that the user has met the partner user who is coupled as a result of following the action instruction, and a success flag is registered in the coupling,
The love object matching system according to claim 4, wherein the process is executed again from the process of reflecting the success rate of the action instruction. A user information storage unit having a storage area associated with a user's face and image information of each part constituting the user;
A control unit connected to a user terminal capable of capturing the viewpoint of the user, photographing an object the user is looking at, and recognizing a face when the object is a human face and recording the object A method for analyzing a user's preference for a love subject without making the user aware, finding a love subject matching it, and guiding the user to meet each other. ,
The control unit
Obtaining face recognized image information recorded by the user terminal;
It is determined whether the line-of-sight coincidence rate between the image information and the user exceeds a predetermined standard,
Determining whether the user terminal appearing in the image information is facing forward;
Determining whether the user terminal reflected in the image information is mirror-reversed by a mirror surface;
When all the conditions for the determination are satisfied, the face-recognized image information is recorded as the personal-face image information in the user information storage unit.
Extracting an image of each part constituting the face shown in the personal-face image information;
Calculating coordinates and area occupancy of the entire face of each part;
A love object matching method characterized in that it is stored in the user information storage unit as individual face image individual part coordinates and the personal face image area occupancy rate in association with the user. A user information storage unit having a storage area associated with a user's face and image information of each part constituting the user;
A control unit connected to a user terminal capable of capturing the viewpoint of the user, photographing an object the user is looking at, and recognizing a face when the object is a human face and recording the object A program for analyzing a user's preference for a love subject without making the user aware, using the love subject matching system, discovering a love subject matching it, and guiding them to meet and meet each other ,
The control unit
Obtaining face recognized image information recorded by the user terminal;
It is determined whether the line-of-sight coincidence rate between the image information and the user exceeds a predetermined standard,
Determining whether the user terminal appearing in the image information is facing forward;
Determining whether the user terminal reflected in the image information is mirror-reversed by a mirror surface;
When all the conditions for the determination are satisfied, the face-recognized image information is recorded as the personal-face image information in the user information storage unit.
Extracting an image of each part constituting the face shown in the personal-face image information;
Calculating coordinates and area occupancy of the entire face of each part;
A love object matching program, characterized in that it functions as a means for recording in the user information storage unit as individual face image part coordinates and the personal face image area occupancy rate in association with the user.

Images