JP2022085730A - Matching system, glasses-type device, matching server and program - Google Patents

Abstract

To provide a matching system configured to obtain a type of a person gazed by acquiring data of a line of sight of a person using a glasses-type device, such as an AR glasses.SOLUTION: A matching system 10 includes glasses-type devices 100 and a matching server 300. The glasses-type device includes a line-of-sight detection unit which detects a line of sight of a service registrant, and a face image acquisition unit which acquires a face image from a camera of the glasses-type device. The matching server includes: a registrant information storage unit which stores face images of service registrants; a collected information storage unit which stores face images received from the glasses-type devices; a face image specifying unit which specifies a face image similar to face images corresponding to the service registrants stored in the collected information storage unit from among the face images stored in the registrant information storage unit; and a recommendation execution unit which recommends other service registrants to one service registrant on the basis of the specified face image.SELECTED DRAWING: Figure 1

Description

The present invention relates to matching systems, eyeglass-type devices, matching servers and programs.

Patent Document 1 describes that a person who is watching by a user is specified and information related to the person is displayed.
[Prior Art Document]
[Patent Document]
[Patent Document 1] Japanese Unexamined Patent Publication No. 2012-008290

According to one embodiment of the present invention, a matching system is provided. The matching system may include a matching server and a plurality of eyeglass-type devices. Each of the plurality of spectacle-type devices may include a line-of-sight detection unit that detects the line of sight of a service registrant of the matching service wearing the spectacle-type device. Each of the plurality of spectacle-type devices may include a face image acquisition unit that acquires a face image from the captured image captured by the camera of the spectacle-type device based on the line of sight of the service registrant. Each of the plurality of eyeglass-type devices may include a face image transmission unit that transmits the face image acquired by the face image acquisition unit to the matching server. The matching server may include a registrant information storage unit that stores facial images of a plurality of service registrants of the matching service. The matching server may include a collection information storage unit that stores face images received from each of the plurality of spectacle-type devices in association with each service registrant of the plurality of spectacle-type devices. The matching server identifies a face image similar to a plurality of face images corresponding to one service registrant stored in the collected information storage unit from a plurality of face images stored in the registrant information storage unit. An image specific part may be provided. The matching server may include a recommendation execution unit that executes recommendations of another service registrant to one service registrant based on the face image specified by the face image identification unit.

The face image acquisition unit may acquire a face image of a face in which the number of times the service registrant's line of sight is directed is greater than a predetermined number of times. The face image acquisition unit may acquire a face image of a face in which the time when the service registrant's line of sight is directed is longer than a predetermined time. The face image acquisition unit may acquire a face image of a face designated by the service registrant, which is a face to which the service registrant's line of sight is directed. The face image acquisition unit displays an icon at a position on the lens of the eyeglass-type device corresponding to the face to which the line of sight of the service registrant is directed, and the face of the face to which the icon is designated by the service registrant. You may get an image.

The face image specifying unit learns the favorite facial features of the one service registrant based on a plurality of face images corresponding to the one service registrant stored in the collected information storage unit. Based on the learning data, a face image similar to the plurality of face images corresponding to the one service registrant may be specified from the plurality of face images stored in the registrant information storage unit. The recommendation execution unit may recommend the service registrant corresponding to the face image specified by the face image identification unit to the service registrant, with the service registrant as the preferred partner. The recommendation execution unit applies the face image similar to the plurality of face images corresponding to the other service registrants stored in the collection information storage unit specified by the face image identification unit to the one service registrant. Another service registrant including the face image of the above may be recommended to the above-mentioned one service registrant as a person who prefers the face of the above-mentioned one service registrant. The recommendation execution unit is another service registrant corresponding to a plurality of face images similar to the face image corresponding to the one service registrant specified by the face image identification unit, and the face image identification unit. Another service registrant whose face image similar to a plurality of face images corresponding to other service registrants stored in the collected information storage unit specified by the department includes the face image of the above one service registrant. May be recommended to the above-mentioned one service registrant as a person who likes the above-mentioned one service registrant and also likes the above-mentioned one service registrant.

The recommendation execution unit is similar to a plurality of face images corresponding to the one service registrant specified by the face image identification unit within the imaging range of the eyeglass-type device worn by one service registrant. When another service registrant corresponding to the face image is included, the other service registrant may be recommended to the above-mentioned one service registrant. The matching server may have a location information collection unit that collects the location information of each of the plurality of service registrants, and the recommendation execution unit may be within a predetermined range from the position of one service registrant. , When another service registrant corresponding to a face image similar to a plurality of face images corresponding to the one service registrant specified by the face image specifying unit is included, the other service registrant is referred to as the above. You may recommend it to one service registrant.

According to one embodiment of the present invention, a spectacle-type device is provided. The spectacle-type device may include a line-of-sight detection unit that detects the line of sight of a service registrant of the matching service wearing the spectacle-type device. The spectacle-type device may include a face image acquisition unit that acquires a face image from the captured image captured by the camera of the spectacle-type device based on the line of sight of the service registrant. The spectacle-type device may include a face image transmission unit that transmits the face image acquired by the face image acquisition unit to a matching server that provides a matching service.

According to one embodiment of the present invention, a program for making a spectacle-type device function as a control device for the spectacle-type device is provided.

According to one embodiment of the present invention, a matching server is provided.
The matching server may include a registrant information storage unit that stores facial images of a plurality of service registrants of the matching service. The matching server receives the face image included in the captured image captured by the camera of the spectacle-type device acquired by the spectacle-type device based on the line of sight of the service registrant from each of the spectacle-type devices of the plurality of service registrants. It may be provided with a face image receiving unit. The matching server may include a collection information storage unit that stores the face image received from the spectacle-type device by the face image receiving unit in association with the service registrant of the spectacle-type device. The matching server identifies a face image similar to a plurality of face images corresponding to one service registrant stored in the collected information storage unit from a plurality of face images stored in the registrant information storage unit. An image specific part may be provided. The matching server may include a recommendation execution unit that executes recommendations of another service registrant to one service registrant based on the face image specified by the face image identification unit.

According to one embodiment of the present invention, a program for making a computer function as the matching server is provided.

According to one embodiment of the invention, a system is provided. The system may include the control device and the spectacle-type device.

The outline of the above invention does not list all the necessary features of the present invention. A subcombination of these feature groups can also be an invention.

An example of the matching system 10 is shown schematically. An example of the processing flow of the matching system 10 is shown schematically. It is explanatory drawing for demonstrating the face identification processing by a spectacles type device 100. An example of the configuration of the spectacle-type device 100 is schematically shown. An example of the functional configuration of the control device 200 is schematically shown. An example of the functional configuration of the matching server 300 is shown schematically. A display example of the notification icon 410 by the eyeglass-type device 100 is schematically shown. A display example of the notification icon 420 by the eyeglass-type device 100 is schematically shown. An example of the hardware configuration of the computer 1200 functioning as the control device 200 or the matching server 300 is schematically shown.

Eyeglass-type devices such as AR (Augmented Reality) glasses will become more widespread in the future, and it will be possible to acquire data (what is being viewed) of the wearer's line of sight by the eyeglass-type device. For example, you will be able to understand what kind of people you have focused on among those who have passed by. The matching system 10 according to the present embodiment provides a matching service using such information.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention within the scope of the claims. Also, not all combinations of features described in the embodiments are essential to the means of solving the invention.

FIG. 1 schematically shows an example of a matching system 10. The matching system 10 includes a plurality of eyeglass-type devices 100 and a matching server 300.

The spectacle-type device 100 may be any spectacle-type device as long as it has an image pickup function and a line-of-sight detection function of the user 102 wearing the spectacle-type device 100. The image pickup function may be a function of capturing a range corresponding to the field of view of the user 102 by the camera included in the spectacle type device 100. The range corresponding to the field of view of the user 102 may be, for example, substantially the same range as the field of view of the user 102.

The spectacle-type device 100 may be, for example, an AR glass. The spectacle-type device 100 may be a device capable of giving the user 102 the feeling that the content is arranged in the real space by displaying the content according to the imaging range on the transparent or translucent glass. .. That is, the spectacle-type device 100 may be a so-called transmissive type (see-through type) device. Further, the spectacle-type device 100 may be a so-called pass-through type device. In this case, the spectacle-type device 100 may always display the captured image capturing the range corresponding to the field of view of the user 102 on the non-transmissive display.

The matching server 300 provides a matching service to the user 102. The matching service may be a service that supports finding a lover, a marriage partner, or the like. The matching server 300 introduces a person having a favorite facial feature of the user 102 to the user 102, introduces a partner who likes the facial feature of the user 102, and agrees with each other. You may provide a service that introduces the person who made the call.

The eyeglass-type device 100 and the matching server 300 may communicate with each other via the network 20. The network 20 includes a cloud. The network 20 may include a mobile communication network. The mobile communication network may comply with any of the LTE (Long Term Evolution) communication method, the 3G (3rd Generation) communication method, the 5G (5th Generation) communication method, and the 6G (6th Generation) communication method or later. good. The network 20 may be compatible with the Wi-Fi (registered trademark) communication method. The network 20 may be accessible via a Wi-Fi access point. The network 20 may be accessible by using other wireless communication in general. The spectacle-type device 100 may be connected to the network 20 by mobile communication, Wi-Fi communication, and other wireless communication in general. The matching server 300 may be connected to the network 20 by wire or wirelessly.

FIG. 2 schematically shows an example of the processing flow in the matching system 10. Here, the flow from the user 102 registering to the matching service of the matching server 300 to receiving the recommendation of another service registrant that suits the user 102's preference is schematically shown.

In the step (the step may be abbreviated as S) 102, the user 102 registers the user with the matching server 300 by the eyeglass-type device 100. The eyeglass-type device 100 may transmit the registrant information of the user 102 to the matching server 300 according to the instruction of the user 102.

The user 102 may register the user on the matching server 300 by using a communication terminal other than the eyeglass-type device 100. The user 102 registers a user on the matching server 300 by using, for example, a smartphone, a tablet terminal, a PC (Personal Computer), or the like.

The registrant information includes the face image of the user 102. The face image may be captured by the spectacle-type device 100. Further, the face image may be captured by another device or service. The face image may be a 3D scan of the face of the user 102. The registrant information may include demographic information of the user 102. The demographic information may include at least one of the user 102's name, address, gender, telephone number, date of birth, age, blood type, income, occupation, and educational background. In addition, the registrant information may include information on a love target. The information of the romance target may indicate whether the romance target is a woman or a man.

The matching server 300 registers the user 102 with the received registrant information. For example, the matching server 300 assigns the user identification information that can identify the user 102 to the user 102, and stores the registrant information of the user 102 in association with the user identification information. The matching server 300 may receive registrant information from a plurality of users 102 and register users of the plurality of users 102.

In S104, the eyeglass-type device 100 transmits a face image of a person of interest to the user 102 to the matching server 300 while the user 102 is living a daily life. The spectacle-type device 100 may acquire a face image of a person of interest from the user 102 from an image captured by the camera of the spectacle-type device 100 and transmit it to the matching server 300.

In S106, the matching server 300 learns the user's favorite facial features based on the plurality of facial images received from the user 102's eyeglass-type device 100. In S108, the matching server 300 extracts service registrants having favorite facial features of the user 102 from a plurality of service registrants based on the learning data learned in S106.

In S110, the matching server 300 executes the recommendation of the service registrant extracted in S108 to the user 102. The matching server 300 transmits, for example, the registrant information of the service registrant extracted in S108 to the eyeglass-type device 100 as the registrant information of the service registrant who is assumed to have a favorite face of the user 102. The matching server 300 may transmit the extracted registrant information of the service registrant to the smartphone, tablet terminal, PC, or the like of the user 102.

FIG. 3 is an explanatory diagram for explaining the face identification process by the eyeglass-type device 100. The spectacle-type device 100 may identify the face of interest to the user 102 based on the line of sight of the user 102.

The spectacle-type device 100 displays, for example, the icon 400 of the person at a position on the lens corresponding to the person to which the line of sight of the user 102 is directed. The icon 400 may include a face image of a person. The spectacle-type device 100 may extract a face image of the person from the captured image of the person and include it in the icon 400.

Then, when the icon 400 is designated by the user 102, the eyeglass-type device 100 identifies the face corresponding to the designated icon 400 as the face that the user 102 pays attention to. The eyeglass-type device 100 may include a so-called like button in the icon 400, and the face corresponding to the icon 400 is specified as the face that the user 102 pays attention to in response to the designation of the like button by the user 102. You may.

As described above, the spectacle-type device 100 may manually register the face of interest to the user 102. By manually registering, the matching server 300 can collect the facial image of the user's favorite face with high accuracy.

The spectacle-type device 100 may automatically register the face of interest to the user 102. For example, the spectacle-type device 100 identifies the face that the user 102 pays attention to based on the number of times the user 102 turns his / her line of sight. As a specific example, the spectacle-type device 100 specifies a face in which the number of times the user 102's line of sight is directed is greater than a predetermined number of times as the face that the user 102 pays attention to.

Further, for example, the spectacle-type device 100 identifies the face that the user 102 pays attention to based on the time when the user 102 turns his / her line of sight. As a specific example, the spectacle-type device 100 specifies a face in which the time the line of sight of the user 102 is directed is longer than a predetermined time as the face that the user 102 pays attention to.

As a result, the matching server 300 can collect facial images of the face, which is likely to be the user's preference, with high accuracy. Further, by performing automatic registration, the matching server 300 can collect facial images of faces that are likely to be preferred by the user 102 without imposing a load on the user 102.

FIG. 4 schematically shows an example of the configuration of the spectacle-type device 100. The spectacle-type device 100 includes a frame 110 having a rim 112 and a temple 118. The spectacle-type device 100 includes a control device 200 that executes various controls in the spectacle-type device 100. The spectacle-type device 100 may include a wired and wireless connection portion for connecting to an external information communication device, that is, a smartphone to receive information and electric power.

The arrangement of the control device 200 in FIG. 4 is an example, and the control device 200 may be arranged at another position of the frame 110. For example, the control device 200 may be arranged outside the frame 110. Further, for example, the control device 200 may be arranged in the temple 118. As a specific example, the control device 200 may be arranged at the tip of the temple 118, that is, in a modern manner. The control device 200 may include a battery. The control device 200 and the battery may be separately arranged at different positions on the frame 110.

The spectacle-type device 100 includes a camera 120. The arrangement of the camera 120 in FIG. 4 is an example, and the camera 120 may be arranged at another position.

The spectacle-type device 100 may include a sensor 122. The sensor 122 may be a sensor for identifying the environment around the spectacle-type device 100. Sensor 122 may include LiDAR. The sensor 122 may include a ranging sensor. Although FIG. 4 illustrates the case where the sensor 122 is arranged on the bridge 114, the arrangement of the sensor 122 in FIG. 4 is an example, and the sensor 122 may be arranged at another position.

The spectacle-type device 100 includes a line-of-sight detection unit 124. The line-of-sight detection unit 124 detects the line of sight of the user 102 who is the wearer of the spectacle-type device 100. The line-of-sight detection unit 124 detects the line of sight of the user 102, for example, by capturing and monitoring the eyes of the user 102. The arrangement of the line-of-sight detection unit 124 in FIG. 3 is an example, and the line-of-sight detection unit 124 may be arranged at another position.

The control device 200 may include various sensors. The control device 200 may specify the position, orientation, and posture of the spectacle-type device 100 by using various sensors. The spectacle-type device 100 may include a positioning sensor. The control device 200 includes, for example, a GNSS (Global Navigation Satellite System) sensor such as a GPS (Global Positioning System) sensor. The control device 200 may include an acceleration sensor. The control device 200 may include a gyro sensor. The control device 200 may include other sensors.

The control device 200 may accept various inputs. The control device 200 may accept various inputs from the user 102 via an operation unit arranged at an arbitrary position of the spectacle-type device 100. The control device 200 receives various inputs from the user 102, for example, via an input unit such as a button arranged at an arbitrary position of the frame 110. The control device 200 may accept various inputs from the user 102 via a mobile terminal such as a smartphone, for example. The spectacle-type device 100 may establish a wireless connection with a mobile terminal by using a short-range wireless communication method such as Wi-Fi, Bluetooth (registered trademark) and Zigbee (registered trademark).

The control device 200 may have a display function on the lens 116. The lens 116 may be an example of a display unit of the spectacle-type device 100. The lens 116 may be a transparent or translucent display, and the control device 200 may cause the lens 116 to perform various displays. That is, the spectacle-type device 100 may be a transparent or translucent display-type device. Further, the control device 200 may have a function of projecting a display onto the lens 116. That is, the spectacle-type device 100 may be a projection-type device.

The control device 200 may execute communication via the network 20. The control device 200 may communicate with the matching server 300 via the network 20.

FIG. 5 schematically shows an example of the functional configuration of the control device 200. The control device 200 includes a storage unit 202, an image capture image acquisition unit 204, a user registration unit 206, a line-of-sight information acquisition unit 210, a face image acquisition unit 212, a face image transmission unit 214, a designated reception unit 216, a display control unit 218, and an image pickup. It includes an image transmitting unit 220, a notification information receiving unit 222, and a position information transmitting unit 224. It is not always essential that the control device 200 includes all of these.

The captured image acquisition unit 204 acquires the captured image captured by the camera 120. The captured image acquisition unit 204 stores the acquired captured image in the storage unit 202.

The user registration unit 206 registers the user with the matching server 300 according to the instruction of the user 102. The user 102 captures his / her face by, for example, the camera 120. The captured image acquisition unit 204 stores the face image of the user 102 in the storage unit 202. Further, the user 102 inputs the demographic information of the user 102 and the information of the romance target into the eyeglass-type device 100. The storage unit 202 stores the input demographic information and the information of the romance target. The user registration unit 206 may transmit the registrant information including the face image of the user 102, the demographic information, and the information of the romance target stored in the storage unit 202 to the matching server 300.

The line-of-sight information acquisition unit 210 acquires line-of-sight information indicating the line of sight of the user 102. The line-of-sight information acquisition unit 210 may acquire line-of-sight information from the line-of-sight detection unit 124.

The face image acquisition unit 212 acquires a face image from the captured image captured by the camera 120 based on the line of sight of the user 102. The face image acquisition unit 212 may acquire the face image of the face that the user 102 has paid attention to.

For example, the face image acquisition unit 212 acquires a face image of a face in which the number of times the user 102's line of sight is directed is greater than a predetermined number of times. The predetermined number of times may be arbitrarily set or may be changeable. The face image acquisition unit 212 may acquire, for example, a face image of a face in which the number of times the user 102's line of sight is directed within a predetermined time is greater than the predetermined number of times. Further, in the face image acquisition unit 212, for example, the number of times the user 102's line of sight is directed is larger than the predetermined number of times between being included in the image pickup range of the camera 120 and going out of the image pickup range. A facial image of a face may be acquired. Since the face to which the user 102 has a lot of eyes is likely to be the face that the user 102 likes, it is possible to automatically identify the face that the user 102 is likely to like.

For example, the face image acquisition unit 212 acquires a face image of a face in which the time when the line of sight of the user 102 is directed is longer than a predetermined time. The predetermined time may be arbitrarily set or may be changeable. The face image acquisition unit 212 may acquire, for example, a face image of a face in which the time when the line of sight of the user 102 is continuously directed is longer than a predetermined time. Further, the face image acquisition unit 212 may acquire, for example, a face image of a face whose total time for which the line of sight of the user 102 is directed is longer than a predetermined time. Since the face to which the user 102's line of sight is directed for a long time is likely to be the face that the user 102 likes, this makes it possible to automatically identify the face that the user 102 is likely to like.

The face image transmission unit 214 transmits the face image acquired by the face image acquisition unit 212 to the matching server 300. The face image transmission unit 214 may transmit the face image to the matching server 300 each time the face image acquisition unit 212 acquires the face image. Further, the face image transmission unit 214 may transmit the face image acquired by the face image acquisition unit 212 to the matching server 300 between the previous timing and the current timing according to a predetermined timing.

The designated reception unit 216 receives the designation of the face in the captured image acquired by the captured image acquisition unit 204 by the user 102. The designated reception unit 216 may accept the designation of the face by the user 102 via the operation unit arranged at an arbitrary position of the spectacle-type device 100. The designated reception unit 216 may accept the face designation by the user 102 via the mobile terminal. The designated reception unit 216 may accept the designation of the face by the line-of-sight input of the user 102.

The face image acquisition unit 212 may acquire a face image of a face designated by the user 102, which is a face to which the line of sight of the user 102 is directed. For example, the face image acquisition unit 212 causes the display control unit 218 to display an icon at a position on the lens 116 corresponding to the face to which the line of sight of the user 102 is directed, and the face image of the face designated by the user 102. To get. The face image acquisition unit 212 causes the display control unit 218 to display an icon including a like button at a position on the lens 116 corresponding to the face to which the line of sight of the user 102 is directed, and the like button is designated by the user 102. Depending on what has been done, the face image of the face corresponding to the icon may be acquired.

The captured image transmission unit 220 continuously transmits the captured image captured by the captured image acquisition unit 204 to the matching server 300. The matching server 300 may analyze the captured images continuously received from the spectacle-type device 100 to determine whether or not the service registrant who is presumed to have the favorite facial features of the user 102 is included. The matching server 300 may transmit notification information to the spectacle-type device 100 when it is determined that the matching server 300 is included. The notification information may include content indicating that the service registrant having the favorite facial features of the user 102 is included in the imaging range. The notification information may include information indicating the position of the service registrant within the imaging range. The notification information may include the registrant information of the service registrant.

Further, the matching server 300 may analyze the captured image continuously received from the spectacle-type device 100 to determine whether or not the service registrant who presumes that the face of the user 102 is preferred is included. The matching server 300 may transmit notification information to the spectacle-type device 100 when it is determined that the matching server 300 is included. The notification information may include content indicating that the face of the user 102 includes a favorite service registrant within the imaging range. The notification information may include information indicating the position of the service registrant within the imaging range. The notification information may include the registrant information of the service registrant.

Further, the matching server 300 analyzes the captured image continuously received from the spectacle-type device 100, estimates that the user 102 has the favorite facial features, and estimates that the user 102 likes the face. It may be determined whether or not the service registrant who has completed the service is included. The matching server 300 may transmit notification information to the spectacle-type device 100 when it is determined that the matching server 300 is included. The notification information may include content indicating that the image pickup range has the characteristics of the user's favorite face and that the user 102's face includes the favorite service registrant. The notification information may include information indicating the position of the service registrant within the imaging range. The notification information may include the registrant information of the service registrant.

The notification information receiving unit 222 receives the notification information from the matching server 300. The display control unit 218 may display a notification icon on the lens 116 when the notification information receiving unit 222 receives the notification information. The display control unit 218 displays, for example, a notification icon at a position corresponding to the position of the target service registrant. The notification icon may include a face image of the target service registrant.

The position information transmission unit 224 transmits the position information of the eyeglass-type device 100 to the matching server 300. The position information transmission unit 224 may transmit the position information of the spectacle-type device 100 to the matching server 300 according to a predetermined timing. For example, the position information transmission unit 224 periodically transmits the position information of the eyeglass-type device 100 to the matching server 300. For example, the position information transmission unit 224 transmits the position information of the spectacle-type device 100 to the matching server 300 every time the position of the spectacle-type device 100 changes.

The matching server 300 may monitor the positions of the plurality of service registrants based on the position information received from each of the plurality of eyeglass-type devices 100. When the matching server 300 includes a service registrant presumed to have the user's favorite facial features within a predetermined range from the position of the user 102, the matching server 300 notifies the eyeglass-type device 100 of the user 102 of the notification information. May be sent. The notification information may include the location information of the service registrant. The notification information may include the registrant information of the service registrant.

Further, when the matching server 300 includes a service registrant who presumes that the face of the user 102 is preferred within a predetermined range from the position of the user 102, the matching server 300 notifies the eyeglass-type device 100 of the user 102 of the notification information. May be sent. The notification information may include the location information of the service registrant. The notification information may include the registrant information of the service registrant.

Further, the matching server 300 is estimated to have the characteristics of the user's favorite face within a predetermined range from the position of the user 102, and the service registrant estimated that the user 102's face is preferred. Is included, the notification information may be transmitted to the eyeglass-type device 100 of the user 102. The notification information may include the location information of the service registrant. The notification information may include the registrant information of the service registrant.

The display control unit 218 may display a notification icon on the lens 116 when the notification information receiving unit 222 receives the notification information. The notification icon may include a face image of the target service registrant. The notification icon may include a directional object indicating the direction in which the target service registrant is located with respect to the position of the spectacle-type device 100.

FIG. 6 schematically shows an example of the functional configuration of the matching server 300. The matching server 300 includes a registration reception unit 302, a registrant information storage unit 304, a face image reception unit 308, a collection information storage unit 310, a face image identification unit 312, a recommendation execution unit 314, and a location information collection unit 316. It is not always essential that the matching server 300 includes all of these.

The registration reception unit 302 accepts registration for the matching service by the user 102. The registration reception unit 302 may receive registrant information from the eyeglass-type device 100 or the communication terminal of the user 102.

The registrant information storage unit 304 stores the registrant information received by the registration reception unit 302. The registrant information storage unit 304 may store the registrant information of each of the plurality of users 102. The registrant information storage unit 304 may store the registrant information in association with the user identification information of the user 102.

The face image receiving unit 308 receives the face image acquired by the face image acquisition unit 212 based on the line of sight of the user 102 from each of the eyeglass-type devices 100 of the plurality of users 102.

The collection information storage unit 310 stores the face image received by the face image receiving unit 308 from the spectacle-type device 100 in association with the user 102 of the spectacle-type device 100. The collection information storage unit 310 may store the face image received by the face image receiving unit 308 from the spectacle-type device 100 in association with the user identification information of the user 102 of the spectacle-type device 100.

The face image specifying unit 312 has a face image similar to a plurality of face images corresponding to one user 102 stored in the collected information storage unit 310 from a plurality of face images stored in the registrant information storage unit 304. To identify. The face image specifying unit 312 stores each of the plurality of users 102 registered in the matching service in the collected information storage unit 310 from the plurality of face images stored in the registrant information storage unit 304. A face image similar to a plurality of face images corresponding to the user 102 may be specified.

The face image specifying unit 312 learns and learns the favorite facial features of the one user 102 based on, for example, a plurality of face images corresponding to the one user 102 stored in the collected information storage unit 310. Based on the data, a face image similar to the plurality of face images corresponding to the one user 102 may be specified from the plurality of face images stored in the registrant information storage unit 304. The face image specifying unit 312 extracts, for example, a feature common to a plurality of face images stored in the collected information storage unit 310, and the feature is extracted from the plurality of face images stored in the registrant information storage unit 304. Identify facial images with. The face image specifying unit 312 may use a method such as weighting each of a plurality of facial features such as eyes, nose, mouth, and contour.

The recommendation execution unit 314 executes the recommendation of another service registrant to one user 102 based on the face image specified by the face image identification unit 312.

The recommendation execution unit 314 recommends, for example, a service registrant corresponding to the face image specified by the face image identification unit 312 to one user 102 as a favorite partner by one user 102. The recommendation execution unit 314 transmits, for example, the registrant information of the service registrant corresponding to the face image specified by the face image identification unit 312 to the glasses-type device 100 or the communication terminal of one user 102. As a result, the one user 102 can know the service registrant having his / her favorite facial features estimated from the person who has paid attention to in the past among the plurality of service registrants. As described above, according to the matching system 10 according to the present embodiment, the user 102 contributes to efficiently searching for a favorite partner as compared with the case of checking all the facial images of a plurality of service registrants. be able to.

The recommendation execution unit 314 is, for example, a user 102 for a face image similar to a plurality of face images corresponding to other service registrants stored in the collection information storage unit 310 specified by the face image identification unit 312. Another service registrant including the face image of the above is recommended to one user 102 as a person who prefers the face of one user 102. The recommendation execution unit 314 transmits, for example, the registrant information of such another service registrant to the spectacle-type device 100 or the communication terminal of one user 102. As a result, the one user 102 can know the service registrant who is likely to like his / her face among the plurality of service registrants. As described above, according to the matching system 10 according to the present embodiment, it is possible to contribute to the search for a partner who likes oneself, and it is possible to increase the possibility that matching is established.

The recommendation execution unit 314 is, for example, another service registrant corresponding to a face image similar to a plurality of face images corresponding to one user 102 specified by the face image identification unit 312, and is a face image identification unit. Another service registrant whose face image similar to the plurality of face images corresponding to the other service registrants stored in the collection information storage unit 310 specified by 312 includes the face image of one user 102. It is recommended to one user 102 as a person who likes the face of one user 102 and prefers the face of one user 102. The recommendation execution unit 314 transmits, for example, the registrant information of such another service registrant to the spectacle-type device 100 or the communication terminal of one user 102. As a result, the one user 102 can know a service registrant who likes himself / herself and who is likely to like himself / herself among a plurality of service registrants.

The recommendation execution unit 314 may recommend a service registrant in response to a request from the user 102. For example, the recommendation execution unit 314 executes the recommendation according to the request transmitted by the user 102 by the glasses-type device 100 or the communication terminal.

As a specific example, when the user 102 requests the recommendation of the other party of his choice, the recommendation execution unit 314 recommends the service registrant corresponding to the face image specified by the face image identification unit 312. Further, when the user 102 requests the recommendation of the other party who prefers the user 102, the recommendation execution unit 314 is another service registrant stored in the collection information storage unit 310 specified by the face image identification unit 312. The other service registrants including the face image of the user 102 in the face image similar to the plurality of face images corresponding to the above are recommended. Further, when the user 102 requests the recommendation of the other party that the user 102 likes and the user 102 likes, the recommendation execution unit 314 corresponds to a plurality of users 102 specified by the face image specifying unit 312. A plurality of faces corresponding to other service registrants corresponding to a face image similar to a face image and stored in the collection information storage unit 310 specified by the face image identification unit 312. It recommends other service registrants whose face image similar to the image includes the face image of the user 102.

The recommendation execution unit 314 may execute a more real-time recommendation. For example, the recommendation execution unit 314 executes a recommendation based on the captured image continuously transmitted by the captured image transmitting unit 220.

For example, the recommendation execution unit 314 resembles a plurality of face images corresponding to one user 102 specified by the face image identification unit 312 within the imaging range of the eyeglass-type device 100 worn by one user 102. When another service registrant corresponding to the face image is included, the other service registrant is recommended to one user 102. Further, for example, when the recommendation execution unit 314 includes a service registrant who presumes that the face of the one user 102 is preferred within the imaging range of the eyeglass-type device 100 worn by the one user 102. In addition, the other service registrant is recommended to one user 102. Further, for example, the recommendation execution unit 314 has the facial features that the one user 102 likes within the imaging range of the eyeglass-type device 100 worn by the one user 102, and the one user. When a service registrant who presumes that the face of 102 is preferred is included, the other service registrant is recommended to one user 102.

Whether or not the service registrant is disclosed to the outside may be changed according to the setting of the service registrant. For example, the registration reception unit 302 accepts the user 102 to set whether or not to disclose that he / she is a service registrant to the outside. The registrant information storage unit 304 may register the setting in association with the user identification information of the user 102. The user 102 may change the setting as appropriate, for example, according to his / her situation. Whether or not the recommendation execution unit 314 executes the recommendation of the second user 102 to the first user 102 based on the setting of the second user 102 to be recommended to the first user 102. May be determined.

For example, the recommendation execution unit 314 resembles a plurality of face images corresponding to one user 102 specified by the face image identification unit 312 within the imaging range of the eyeglass-type device 100 worn by one user 102. If other service registrants corresponding to the face image are included, check the settings of the service registrant. If it is set to disclose the service registrant to the outside, the other service registrant is recommended to one user 102, and the service registrant is set not to be disclosed to the outside. If so, do not make recommendations. As a result, it is possible to prevent the user 102 from being suddenly called when he / she does not want to be called, for example, when he / she is in a hurry in the city, and the convenience of the user 102 can be improved. can. It should be noted that whether or not the user 102 is disclosed to the outside as a service registrant and whether or not the user 102 can receive the recommendation may be irrelevant. That is, the user 102 may be able to receive the recommendation regardless of whether the service registrant is set to be disclosed to the outside or not to be disclosed to the outside. Further, whether or not the user 102 is disclosed to the outside as a service registrant may be related to whether or not the user 102 can receive the recommendation. That is, when the user 102 is set to disclose that he / she is a service registrant to the outside, he / she is allowed to receive a recommendation and is set not to disclose that he / she is a service registrant to the outside. If so, it may be configured so that it cannot receive recommendations.

The location information collection unit 316 collects the location information of each of the plurality of service registrants. The location information collecting unit 316 may collect location information from each of the eyeglass-type devices 100 of the plurality of service registrants.

The recommendation execution unit 314 corresponds to a face image similar to a plurality of face images corresponding to the one user 102 specified by the face image identification unit 312 within a predetermined range from the position of one user 102, and the like. If the service registrant of the above is included, the other service registrant may be recommended to one user 102. Further, for example, when the recommendation execution unit 314 includes a service registrant who presumes that the face of the one user 102 is preferred within a predetermined range from the position of the one user 102, the other The service registrant of is recommended to one user 102. Further, for example, in the recommendation execution unit 314, the one user 102 has a favorite facial feature within a predetermined range from the position of the one user 102, and the face of the one user 102 is a face. When a service registrant presumed to be preferred is included, the other service registrant is recommended to one user 102.

FIG. 7 schematically shows a display example of the notification icon 410 by the eyeglass-type device 100. The eyeglass-type device 100 is a notification transmitted by the matching server 300 in response to the condition that the image pickup range of the camera 120 includes a service registrant presumed to have facial features preferred by the user 102. Based on the information, the notification icon 410 is displayed on the lens 116. As shown in FIG. 7, the notification icon 410 may include a message such as "a person who likes it is nearby". As a result, the user 102 can recognize a person who is a service registrant and has facial features that he / she likes. As described above, according to the matching system 10 according to the present embodiment, the chances of encounter can be increased.

The spectacle-type device 100 is based on the notification information transmitted by the matching server 300 in response to the condition that the image pickup range of the camera 120 includes the service registrant who presumes that the user 102 likes the face. The notification icon 410 may be displayed on the lens 116. The notification icon 410 in this case may include, for example, a message such as "the one who likes you is nearby".

The eyeglass-type device 100 is a service registrant who presumes that the user 102 has a favorite facial feature within the imaging range of the camera 120, and the service registrant who presumes that the user 102 likes the face. The notification icon 410 may be displayed on the lens 116 based on the notification information transmitted by the matching server 300 according to the condition to be included. In this case, the notification icon 410 may include, for example, a message such as "the one with the same preference is nearby".

FIG. 8 schematically shows a display example of the notification icon 420 by the eyeglass-type device 100. The spectacle-type device 100 corresponds to the condition that the service registrant presumed to have the facial features preferred by the user 102 is included within a predetermined range from the position of the spectacle-type device 100. The notification icon 420 is displayed on the lens 116 based on the notification information transmitted by the matching server 300. The notification icon 420 may include a directional object 422 indicating the direction in which the target service registrant is located. Further, the notification icon 420 may include a message such as "Preference is in this direction" as shown in FIG. As a result, the user 102 can recognize the direction in which there is a person who is a service registrant and has facial features that he / she likes. As described above, according to the matching system 10 according to the present embodiment, the chances of encounter can be increased.

The spectacle-type device 100 is a matching server 300 according to the condition that a service registrant who presumes that the user 102's face is preferred is included within a predetermined range from the position of the spectacle-type device 100. The notification icon 420 may be displayed on the lens 116 based on the notification information transmitted by. The notification icon 420 in this case may include, for example, a message such as "People who like you are in this direction".

The spectacle-type device 100 is a service registrant presumed to have facial features preferred by the user 102 within a predetermined range from the position of the spectacle-type device 100, and the user 102's face is preferred. The notification icon 420 may be displayed on the lens 116 based on the notification information transmitted by the matching server 300 in response to the condition that the presumed service registrant is included. The notification icon 420 in this case may include, for example, a message such as "the one with the same preference is in this direction".

After recommending another service registrant to the user 102, the recommendation execution unit 314 may specify whether or not the matching between the user 102 and the other service registrant is established. The recommendation execution unit 314 receives, for example, notification information indicating whether or not matching has been established from the eyeglass-type device 100 of the user 102.

The eyeglass-type device 100 may transmit notification information to the matching server 300 in response to an input from the user 102. For example, the spectacle-type device 100 displays a UI (User Interface) for transmitting a match with the recommended partner. Then, the spectacle-type device 100 transmits the notification information notifying that the user 102 and the other service registrants have been matched to the matching server 300 in response to the reception of the designation of the user 102 for the UI. The eyeglass-type device 100 may transmit, for example, notification information indicating that matching has not been established to the matching server 300 when a time-out occurs without accepting the designation of the user 102 for the UI. The spectacle-type device 100 may display a UI for transmitting that it has matched or did not match the recommended partner.

The spectacle-type device 100 may automatically determine whether or not matching between the user 102 and another service registrant is established. In the eyeglass-type device 100, for example, another recommended service registrant may see the user 102 in the line of sight for a longer time than a predetermined time, or the distance between the user 102 and the other service registrant may be predetermined. When the state shorter than the specified distance continues for a predetermined time or longer, it is considered that the user 102 and the other service registrants are matched, and the user 102 and the other service registrants are matched. The notification information is transmitted to the matching server 300.

The recommendation execution unit 314 identifies that the matching between the user 102 and another service registrant is established by the notification information received from the eyeglass-type device 100. The recommendation execution unit 314 may register in the registrant information storage unit 304 that matching has been established for each of the user 102 and the other service registrants. The recommendation execution unit 314 may temporarily stop the recommendation when the matching is established.

As a result, matching is performed by the recommendation by the recommendation execution unit 314, and when the user 102 and another service registrant have a meal together, the recommendation that "the person who likes it is nearby" is received during the meal. It is possible to prevent the person from being notified that he / she likes himself / herself even though he / she is matched. The recommendation execution unit 314 may release the temporary suspension of the recommendation in response to receiving the notification information notifying that the matching is completed from the eyeglass-type device 100. Thereby, for example, when the meal or the like is finished and the user 102 is in a state where he / she may receive the recommendation, the recommendation can be restarted. The determination that the matching has been completed may be based on the input of the user 102, as in the determination that the matching has been completed, and the eyeglass-type device 100 may automatically determine. In the eyeglass-type device 100, for example, the time when the matching other service registrant does not appear in the field of view of the user 102 is longer than the predetermined time, or the distance between the user 102 and the other service registrant is predetermined. If the state longer than the specified distance continues for a predetermined time or longer, it is considered that the matching between the user 102 and other service registrants is completed.

The matching system 10 in the embodiment described with reference to FIGS. 1 to 8 is configured so that the family, friends, colleagues, and the like of the user 102 can be arbitrarily excluded from the target for collecting facial images and the target for recommendation. You may. For example, the user registration unit 206 registers the face image of the person to be excluded in the matching server 300.

The user registration unit 206 may accept the registration of the facial image of the person to be excluded by the user 102. The user 102 registers, for example, by taking an image of a person to be excluded by the camera 120. Further, the user 102 may register a face image of a person to be excluded, which is held in advance. Further, the icon displayed by the display control unit 218 may be configured so that it can be accepted that it is out of scope. For example, when the face image included in the icon displayed by the display control unit 218 is the face image of the person to be excluded, the user 102 selects the non-target. The user registration unit 206 may register the face image selected to be excluded from the matching server 300 as the face image of the person to be excluded.

When the face image acquired by the face image acquisition unit 212 is a face image of a person to be excluded, the face image transmission unit 214 may be configured not to transmit to the matching server 300. This makes it possible to prevent the faces of family members, friends, colleagues, etc., who are often seen on a daily basis, from being registered as favorite faces, regardless of whether or not they are favorite faces.

The matching server 300 may store the face image of the person to be excluded for the user 102 in the registrant information storage unit 304 in association with the user identification information of the user 102. The face image specifying unit 312 is stored in the collection information storage unit 310 from a plurality of face images excluding the face image of the person to be excluded from the plurality of face images stored in the registrant information storage unit 304. A face image similar to a plurality of face images corresponding to one user 102 may be specified. As a result, even if the faces of the user 102's family, friends, colleagues, etc. have the characteristics of the user 102's preference, they can be excluded from the recommendation.

The face image specifying unit 312 may specify the face image without considering the face image of the person to be excluded, and the recommendation executing unit 314 may consider it. For example, the recommendation execution unit 314 determines whether or not the other service registrant who is the target of recommendation to the user 102 is a person who is the target of exclusion for the user 102. Then, if it is determined that the person is the target of exclusion, the recommendation for the person is not executed. This makes it possible to prevent the user 102 from recommending a person who does not want to be recommended, such as a family member, a friend, and a colleague of the user 102.

FIG. 9 schematically shows an example of a hardware configuration of a computer 1200 that functions as a control device 200 or a matching server 300. A program installed on the computer 1200 causes the computer 1200 to function as one or more "parts" of the apparatus according to the present embodiment, or causes the computer 1200 to perform an operation associated with the apparatus according to the present embodiment or the one or the like. A plurality of "parts" can be executed and / or a computer 1200 can be made to execute a process according to the present embodiment or a stage of the process. Such a program may be run by the CPU 1212 to cause the computer 1200 to perform certain operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphic controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes an input / output unit such as a communication interface 1222, a storage device 1224, and an IC card drive, which are connected to the host controller 1210 via the input / output controller 1220. The storage device 1224 may be a hard disk drive, a solid state drive, or the like. The computer 1200 also includes an input / output unit such as a ROM 1230 and a keyboard or touch panel, which are connected to the input / output controller 1220 via an input / output chip 1240.

The CPU 1212 operates according to a program stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphic controller 1216 acquires the image data generated by the CPU 1212 in a frame buffer or the like provided in the RAM 1214 or itself so that the image data is displayed on the display device 1218.

The communication interface 1222 communicates with other electronic devices via the network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The IC card drive reads the program and data from the IC card and / or writes the program and data to the IC card.

The ROM 1230 stores in it a boot program or the like executed by the computer 1200 at the time of activation, and / or a program depending on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

The program may be provided by a computer-readable storage medium such as an IC card. The program is read from a computer-readable storage medium, installed in a storage device 1224, RAM 1214, or ROM 1230, which is also an example of a computer-readable storage medium, and executed by the CPU 1212. The information processing described in these programs is read by the computer 1200 and provides a link between the program and the various types of hardware resources described above. The device or method may be configured to implement the operation or processing of information in accordance with the use of the computer 1200.

For example, when communication is executed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded in the RAM 1214, and performs communication processing with respect to the communication interface 1222 based on the processing described in the communication program. You may order. Under the control of the CPU 1212, the communication interface 1222 reads the transmission data stored in the transmission buffer area provided in the recording medium such as the RAM 1214, the storage device 1224, or the IC card, and transfers the read transmission data to the network. The received data transmitted or received from the network is written in the reception buffer area or the like provided on the recording medium.

Further, the CPU 1212 makes the RAM 1214 read all or necessary parts of the file or the database stored in the external recording medium such as the storage device 1224 and the IC card, and various types of processing for the data on the RAM 1214. May be executed. The CPU 1212 may then write back the processed data to an external recording medium.

Various types of information such as various types of programs, data, tables, and databases may be stored in recording media and processed. The CPU 1212 describes various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, and information retrieval described in various parts of the present disclosure with respect to the data read from the RAM 1214. Various types of processing may be performed, including / replacement, etc., and the results are written back to the RAM 1214. Further, the CPU 1212 may search for information in a file, a database, or the like in the recording medium. For example, when a plurality of entries each having an attribute value of the first attribute associated with the attribute value of the second attribute are stored in the recording medium, the CPU 1212 is the first of the plurality of entries. The attribute value of the attribute of is searched for the entry that matches the specified condition, the attribute value of the second attribute stored in the entry is read, and the attribute value of the second attribute is changed to the first attribute that satisfies the predetermined condition. You may get the attribute value of the associated second attribute.

The program or software module described above may be stored on a computer 1200 or in a computer readable storage medium near the computer 1200. Further, a recording medium such as a hard disk or RAM provided in a dedicated communication network or a server system connected to the Internet can be used as a computer-readable storage medium, whereby the program can be transferred to the computer 1200 via the network. offer.

The blocks in the flowcharts and block diagrams of this embodiment may represent the stage of the process in which the operation is performed or the "part" of the device responsible for performing the operation. Specific steps and "parts" are supplied with a dedicated circuit, a programmable circuit supplied with computer-readable instructions stored on a computer-readable storage medium, and / or with computer-readable instructions stored on a computer-readable storage medium. It may be implemented by the processor. Dedicated circuits may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. Programmable circuits include logical products, logical sums, exclusive logical sums, negative logical sums, negative logical sums, and other logical operations, such as, for example, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and the like. , Flipflops, registers, and reconfigurable hardware circuits, including memory elements.

The computer readable storage medium may include any tangible device capable of storing instructions executed by the appropriate device, so that the computer readable storage medium having the instructions stored therein may be in a flow chart or block diagram. It will be equipped with a product that contains instructions that can be executed to create means for performing the specified operation. Examples of the computer-readable storage medium may include an electronic storage medium, a magnetic storage medium, an optical storage medium, an electromagnetic storage medium, a semiconductor storage medium, and the like. More specific examples of computer-readable storage media include floppy (registered trademark) disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), and erasable programmable read-only memory (EPROM or flash memory). , Electrically Erasable Programmable Read Only Memory (EEPROM), Static Random Access Memory (SRAM), Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD), Blu-ray® Disc, Memory Stick , Integrated circuit cards and the like may be included.

Computer-readable instructions include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcodes, firmware instructions, state-setting data, or Smalltalk®, JAVA®, C ++, etc. Object-oriented programming language, and either source code or object code written in any combination of one or more programming languages, including traditional procedural programming languages such as the "C" programming language or similar programming languages. May include.

Computer-readable instructions are used to generate means for a general-purpose computer, a special-purpose computer, or the processor of another programmable data processing device, or a programmable circuit, to perform an operation specified in a flowchart or block diagram. General purpose computers, special purpose computers, or other programmable data processing locally or via a local area network (LAN), a wide area network (WAN) such as the Internet, etc. to execute such computer-readable instructions. It may be provided to the processor of the device or a programmable circuit. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various changes or improvements can be made to the above embodiments. It is clear from the description of the claims that the form with such changes or improvements may be included in the technical scope of the present invention.

The order of execution of each process such as operation, procedure, step, and step in the apparatus, system, program, and method shown in the claims, specification, and drawings is particularly "before" and "prior to". It should be noted that it can be realized in any order unless the output of the previous process is used in the subsequent process. Even if the scope of claims, the specification, and the operation flow in the drawings are explained using "first", "next", etc. for convenience, it means that it is essential to carry out in this order. It's not a thing.

10 systems, 20 networks, 100 eyeglass devices, 102 users, 110 frames, 112 rims, 114 bridges, 116 lenses, 118 temples, 120 cameras, 122 sensors, 124 line-of-sight detectors, 200 controllers, 202 enclosures, 204 imaging Image acquisition unit, 206 user registration unit, 210 line-of-sight information acquisition unit, 212 face image acquisition unit, 214 face image transmission unit, 216 designated reception unit, 218 display control unit, 220 image capture image transmission unit, 222 notification information reception unit, 300 matching server, 302 registration reception unit, 304 registrant information storage unit, 308 face image reception unit, 310 collection information storage unit, 312 face image identification unit, 314 recommendation execution unit, 316 location information collection unit, 400 icon, 410 notification Icon, 420 Notification Icon, 422 Directional Object, 1200 Computer, 1210 Host Controller, 1212 CPU, 1214 RAM, 1216 Graphic Controller, 1218 Display Device, 1220 I / O Controller, 1222 Communication Interface, 1224 Storage Device, 1230 ROM, 1240 I / O Chip

Claims (15)

Matching server and
Equipped with multiple eyeglass-type devices,
Each of the plurality of eyeglass-type devices
A line-of-sight detection unit that detects the line of sight of a service registrant of a matching service wearing the glasses-type device, and
A face image acquisition unit that acquires a face image from an image captured by the camera of the eyeglass-type device based on the line of sight of the service registrant.
It has a face image transmission unit that transmits the face image acquired by the face image acquisition unit to the matching server.
The matching server is
A registrant information storage unit that stores facial images of multiple service registrants of the matching service,
A collection information storage unit that stores facial images received from each of the plurality of spectacle-type devices in association with each service registrant of the plurality of spectacle-type devices.
Face image identification that identifies a face image similar to a plurality of face images corresponding to one service registrant stored in the collected information storage unit from a plurality of face images stored in the registrant information storage unit. Department and
It has a recommendation execution unit that executes recommendations of other service registrants to the one service registrant based on the face image specified by the face image identification unit.
Matching system. The matching system according to claim 1, wherein the face image acquisition unit acquires a face image of a face in which the number of times the service registrant's line of sight is directed is greater than a predetermined number of times. The matching system according to claim 1 or 2, wherein the face image acquisition unit acquires a face image of a face in which the time when the service registrant's line of sight is directed is longer than a predetermined time. The face image acquisition unit is the face to which the line of sight of the service registrant is directed, and the face image of the face designated by the service registrant is acquired, according to any one of claims 1 to 3. Matching system. The face image acquisition unit displays an icon at a position on the lens of the eyeglass-type device corresponding to the face to which the service registrant's line of sight is directed, and the face of the face to which the icon is designated by the service registrant. The matching system according to claim 4, wherein an image is acquired. The face image specifying unit learns the favorite facial features of the one service registrant based on a plurality of face images corresponding to the one service registrant stored in the collected information storage unit. Claims 1 to 5 for identifying a face image similar to the plurality of face images corresponding to the one service registrant from a plurality of face images stored in the registrant information storage unit based on the learning data. The matching system described in any one of the above. The recommendation executing unit recommends a service registrant corresponding to a face image specified by the face image specifying unit to the one service registrant as a favorite partner of the one service registrant. The matching system according to any one of 6 to 6. The recommendation execution unit is the one service registrant for a face image similar to a plurality of face images corresponding to other service registrants stored in the collection information storage unit specified by the face image identification unit. The other service registrant including the face image of the above is recommended to the one service registrant as a person who prefers the face of the one service registrant, according to any one of claims 1 to 6. Matching system. The recommendation execution unit is another service registrant corresponding to a plurality of face images similar to a plurality of face images corresponding to the one service registrant specified by the face image identification unit, and is the face image identification unit. Another service registrant whose face image similar to a plurality of face images corresponding to other service registrants stored in the collected information storage unit specified by the department includes the face image of the one service registrant. The present invention is described in any one of claims 1 to 8, wherein the service registrant is preferred and the service registrant is recommended to the service registrant as a person who prefers the service registrant. Matching system. The recommendation execution unit resembles a plurality of face images corresponding to the one service registrant specified by the face image identification unit within the imaging range of the eyeglass-type device worn by one service registrant. The matching system according to any one of claims 1 to 9, which recommends the other service registrant to the one service registrant when the other service registrant corresponding to the face image is included. The matching server includes a location information collecting unit that collects the location information of each of the plurality of service registrants.
The recommendation execution unit creates a face image similar to a plurality of face images corresponding to the one service registrant specified by the face image identification unit within a predetermined range from the position of one service registrant. The matching system according to any one of claims 1 to 10, which recommends the other service registrant to the one service registrant when the corresponding other service registrant is included. It ’s a glasses-type device,
A line-of-sight detection unit that detects the line of sight of a service registrant of a matching service wearing the glasses-type device, and
A face image acquisition unit that acquires a face image from an image captured by the camera of the eyeglass-type device based on the line of sight of the service registrant.
A spectacles-type device including a face image transmission unit that transmits the face image acquired by the face image acquisition unit to a matching server that provides the matching service. A program for making a spectacle-type device function as the spectacle-type device according to claim 12. A registrant information storage unit that stores facial images of multiple service registrants of the matching service,
From each of the spectacle-type devices of the plurality of service registrants, the face image included in the captured image captured by the camera of the spectacle-type device acquired by the spectacle-type device based on the line of sight of the service registrant is received. Face image receiver and
A collection information storage unit that stores the face image received by the face image receiving unit from the spectacle-type device in association with the service registrant of the spectacle-type device.
Face image identification that identifies a face image similar to a plurality of face images corresponding to one service registrant stored in the collected information storage unit from a plurality of face images stored in the registrant information storage unit. Department and
A matching server including a recommendation execution unit that executes recommendations of other service registrants to the one service registrant based on the face image specified by the face image identification unit. The program for making a computer function as the matching server according to claim 14.

Images