JP2013219666A - Information sharing system, collation device, terminal, information sharing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To share photograph or information with other person photographed together.SOLUTION: An information sharing system 1 includes image pick-up devices (100-1 through 10N-M) for capturing the image of a person, image storage devices (200-1 through 200-N) for storing the person images obtained by the image pick-up devices (100-1 through 10N-M), and a collation device 300. The collation device 300 includes a collation unit for specifying a person photographed in the person image, by collating a person image stored in the image storage devices (200-1 through 200-N) with an image prestored in a specific system, and an information transmission unit for transmitting information to a plurality of persons when the collation unit specifies a plurality of persons from one person image.

Description

  The present invention relates to an information sharing system, a collation device, a terminal device, an information sharing method, and an information sharing program.

  In facilities such as an amusement park, visitors may have other people, such as employees, press the camera shutter to take photos. In addition, as an auto-photographed image, an attraction such as a roller coaster, the facility automatically shoots the visitors who are in the middle of the attraction with the camera installed at the outlet, and the image taken when leaving the attraction Is printed and provided to visitors.

  Moreover, in patent document 1, the image of the visitor image | photographed with the several camera in a facility is memorize | stored in the server in a facility, and the face and other site | part of the said visitor image image | photographed with another camera when the facility leaving A system is disclosed in which a person is identified, the attendee pays cash at a cash machine at the facility, and prints and provides images of the visitor taken by a plurality of cameras in the facility.

JP 2009-278534 A

  However, Patent Document 1 only outputs or reads an image automatically captured in a facility only to the user himself / herself. For this reason, when a photograph is shared among people who are photographed together in the facility, there is a trouble that the representative sends it to another person photographed together. In addition, it is difficult to contact or share a photo with a person who does not know the information of the person who was photographed together in the facility.

  Accordingly, the present invention has been made in view of the above problems, and provides an information sharing system, a collation device, a terminal device, an information sharing method, and an information sharing program that enable information to be shared with others photographed together. The issue is to provide.

  (1) The present invention has been made in view of the above circumstances, and one aspect of the present invention is an image storage device that captures images of a plurality of persons and an image storage that stores human images obtained by the image capture device. An information sharing system comprising a device and a collation device, wherein the collation device collates a person image stored in the image storage device with an image stored in advance in a specific system, and the person image A collation unit that identifies a person shown in the figure, and an information transmission unit that transmits information to the plurality of identified persons when the collation unit identifies a plurality of persons from one person image. Information sharing system.

  (2) In the information sharing system described above, according to one aspect of the present invention, the collation unit identifies the first person and the second person appearing in the person image, and the information transmission unit includes: When the first person and the second person specified by the verification unit are registered in the same system, the person image is transmitted to the first person and the second person.

  (3) In the information sharing system described above, according to one aspect of the present invention, the collating unit specifies the first person and the second person appearing in the person image, and the information transmitting unit The information transmitted to the first person is information introducing the second person, and the information transmitted to the second person by the information transmission unit introduces the first person. It is characterized by being information.

  (4) In the information sharing system described above, according to one aspect of the present invention, the information transmission unit includes the first person included in the person specified by the verification unit as the person specified by the verification unit. When the second person is not in a friendship relationship in the same system, information for introducing the first person to the second person is transmitted.

  (5) In the information sharing system described above, one aspect of the present invention is that the information transmission unit is configured such that the information transmission unit is connected to a plurality of persons from one person image in the same system. It is possible to share photos on the Internet.

  (6) In the information sharing system described above, according to one aspect of the present invention, it is determined whether or not the information transmission unit transmits information according to whether or not a person included in a plurality of captured persons is smiling. It is characterized by providing the judgment part to perform.

  (7) In the information sharing system described above, according to one aspect of the present invention, the information transmission unit transmits information according to whether or not there is a line of sight among persons included in a plurality of captured persons. It is characterized by providing the judgment part which judges whether it is.

  (8) In the information sharing system described above, according to one aspect of the present invention, the information transmission unit determines whether to transmit information according to a distance between persons included in a plurality of captured persons. A determination unit is provided.

  (9) According to one aspect of the present invention, a collation unit that collates a human image stored in the image storage device with an image stored in advance in a specific system and identifies a person reflected in the human image; And an information transmitting unit that transmits information to the specified plurality of persons when the comparing unit specifies a plurality of persons from one person image.

  (10) In the collation device described above, according to one aspect of the present invention, the collation unit identifies each person appearing in the person image, and the information transmission unit includes a first of the identified persons. When one person has no friendship in the system with respect to the second person among the specified persons, information for introducing the first person to the second person is transmitted. .

  (11) In the collation device described above, according to one aspect of the present invention, the collation unit registers each target person reflected in each of a plurality of person images captured in the same facility in the system. The determination unit determines whether or not the target person is a friend in the system, and the information transmission unit determines that the target person is a friend in the system by the friend determination unit. If it is, the target person is notified that a person other than himself / herself is visiting the facility.

  (12) In the collation device described above, according to one aspect of the present invention, the collation unit collates an image captured when a crime occurs with an image registered in a preset system, and The system includes a friend extraction unit that identifies a suspect in an image captured when a crime occurs and extracts a friend on the system of the suspect identified by the collation unit.

  (13) In the collation device described above, one aspect of the present invention includes a position information acquisition unit that acquires position information indicating a position of a user registered in the system, and the verification unit includes the person image. If it is determined that the target person reflected in the system is registered in the system, it is the same as the target person among the users registered in the system based on the position information acquired by the position information acquisition unit. A similar user extracting unit that extracts similar users having similar attributes to the target person, and the information transmitting unit selects the similar users extracted by the similar user extracting unit as the target It is characterized by notifying a person.

  (14) According to one aspect of the present invention, a collation unit that collates a human image stored in an image storage device with an image stored in advance in a specific system and identifies a person shown in the human image; When the collation unit identifies a plurality of persons from one person image, an information transmission unit that transmits information to the plurality of identified persons, an acquisition unit that acquires the information transmitted by the verification device, And a display unit that displays the information acquired by the acquisition unit.

  (15) In one aspect of the present invention, the image storage device includes a collation unit that collates a human image stored in the image storage device with an image stored in advance in a specific system, and displays the person image. A procedure for identifying a person who has been identified, and a procedure for transmitting information to the plurality of identified persons when the collating unit identifies a plurality of persons from a single person image. Information sharing method.

  (16) One embodiment of the present invention is a collation in which a person image stored in an image storage device and an image stored in advance in a specific system are collated in a computer to identify a person shown in the person image. An information sharing program for executing a step and an information transmission step of transmitting information to the plurality of specified persons when a plurality of persons are specified from one person image by the collation step.

  According to the present invention, information can be shared with others photographed together.

It is a figure for demonstrating the basic concept of the information sharing system of 1st Embodiment. It is a schematic block diagram of the information sharing system in 1st Embodiment. It is a schematic block diagram of the imaging device in 1st Embodiment. 1 is a schematic block diagram of an image storage device according to a first embodiment. It is a schematic block diagram of the collation apparatus in 1st Embodiment. It is an example of table T1 memorize | stored in the memory | storage part of a collation apparatus. It is a schematic block diagram of the terminal device in 1st Embodiment. It is an example of the screen displayed on the display part of the terminal device in 1st Embodiment. It is a flowchart which shows an example of the flow of a process of the information sharing system in 1st Embodiment. 10 is a flowchart illustrating an example of a flow of image arrangement processing in step S102 of FIG. It is a flowchart which shows an example of the flow of the collation process in step S103 of FIG. It is a schematic block diagram of the information sharing system in 2nd Embodiment. FIG. 10 is a diagram for describing processing in which an image is stored in an image storage device in the second embodiment. It is a schematic block diagram of the collation apparatus in 2nd Embodiment. It is a schematic block diagram of the portable terminal device in 2nd Embodiment. In 2nd Embodiment, it is a figure which shows an example of a display of a portable terminal device. It is a flowchart which shows an example of the collation process in 2nd Embodiment. It is a schematic block diagram of the information sharing system in 3rd Embodiment. It is a schematic block diagram of the collation apparatus in 3rd Embodiment. In 3rd Embodiment, it is a figure which shows an example of the display of a terminal device. It is a flowchart which shows an example of the collation process in 3rd Embodiment. It is a schematic block diagram of the information sharing system in 4th Embodiment. It is a figure which shows the basic concept of the information sharing system 1d in 4th Embodiment. It is a schematic block diagram of the collation apparatus in 4th Embodiment. It is a schematic block diagram of the portable terminal device in 4th Embodiment. It is an example of the display of the portable terminal device in 4th Embodiment. It is a flowchart which shows an example of the collation process in 4th Embodiment.

<First Embodiment>
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram for explaining a basic concept of the information sharing system 1 according to the first embodiment. In the image 11 on the left side of the figure, three visitors (persons) are shown by three imaging devices 101-1 to 101-3 installed in a certain facility (for example, an amusement park called XX land). ) Is captured with two characters. The imaging devices 101-1 to 101-3 capture an image or a moving image of a person when the person is smiling. Here, in addition to a person smiling, it may be possible to shoot if the distance between each other is within a specific distance, for example, 10 cm. Further, images or moving images may be always taken and accumulated, and a smiling image or moving image may be extracted later, or an image or moving image within a specific distance between persons may be extracted later.

  In addition, in the same figure, a display screen displayed when a target user who is one of the visitors accesses a specific SNS (Social Network Service) with a certain terminal device after returning home An example of 12 is shown. Here, SNS is a service for building a social network on the Internet. On the display screen 12 shown on the left side of the figure, an example of a message “Mr. Ai who was photographed together in XX Land uses SNS” is displayed. In addition, an example of a question “Would you like to share photos with Ai?” Is displayed. When the target user performs an approval operation to accept this question, the target user can share a photo with Mr. Ai on the SNS. Thereby, the information sharing system 1 of 1st Embodiment is the person who was taken together with the photograph in a certain facility, Comprising: A target user specifies an unknown person beforehand, and notifies a specified person to a target user. Can do. As a result, even if the target user does not know the information of the other person who was photographed together in the facility, the target user can share the photograph with the person or send it to each other. SNS registered users will be described in detail later.

FIG. 2 is a schematic block diagram of the information sharing system 1 in the first embodiment. The information sharing system 1 includes N imaging units 100-i (i is an integer from 1 to N) up to imaging units 100-1, ..., 100-N (N is a positive integer greater than or equal to 1). , 200-N, N image storage devices 200-i, collation device 300, and L terminal devices 400 up to terminal devices 400-1,..., 400-L. -K (k is an integer from 1 to L). Each terminal device 400-k is connected to the verification device 300 via the communication network 500.
In the present embodiment, as an example, when each imaging unit 100-i detects a smiling person, the imaging unit 100-i images the smiling person. When the image storage device 200-i satisfies a predetermined condition, the image storage unit 100-i stores a person image obtained by capturing an image of a person in a storage device within the device. And the collation apparatus 300 specifies the person who appeared in the person image based on collation with a person image and the image registered into the system (for example, SNS) set beforehand.

Each imaging unit 100-i includes M imaging devices 10i-j (j is 1 to M) up to imaging devices 10i-1, ..., 10i-M (M is a positive integer greater than or equal to 1). Integer). Note that the number of the imaging devices 10i-1,..., 10i-M in each imaging unit 100-i may be the same or different. For example, the M imaging devices 10i-j in the imaging unit 100-i are arranged in a predetermined area (for example, a peripheral area of an attraction) in a certain facility (for example, an amusement park). They are arranged together. Specifically, for example, the M imaging devices 101-j of the imaging unit 100-1 are arranged together in the peripheral area of the roller coaster. On the other hand, for example, the M imaging devices 102-j of the imaging unit 100-2 are arranged together in the peripheral area of the merry-go-round.
The image storage device 200-i is managed by a facility manager as an example. Moreover, the collation apparatus 300 is managed by the administrator of specific SNS as an example.

  Each imaging device 10i-j captures an image when a smiling face of a person is detected. And each imaging device 10i-j outputs the image data obtained by imaging to the image storage device 200-i of the same index i, respectively. For example, the imaging devices 101-1 to 101-M output the image data to the image storage device 200-1.

  In the present embodiment, the imaging device 10i-j is installed on the equipment in the facility. However, the imaging device 10i-j is not limited to this, and some or all of the imaging devices 10i-j may be staff or visitors of the facility. May be an imaging device held by the camera.

  Each image storage device 200-i stores images input from M imaging devices up to the imaging devices 10i-1, ..., 10i-M. Each image storage device 200-i extracts an image that matches a predetermined condition from the stored images, and outputs the extracted image to the collation device 300 as a person image.

  The collation device 300 collates the person image input from each image storage device 200-i with the image of the SNS registered user held by the own device, and identifies the person shown in the image. Here, the SNS registered user is a user registered in the SNS. And the collation apparatus 300 determines whether all the specified persons have registered into this SNS. When all the members are registered in this SNS, the collation apparatus 300 holds a message addressed to each person and its image. The message is, for example, a message “Ai-san, who was photographed together in XX Land, uses SNS. Would you like to share photos with Ai-san?”

Thereby, when there is an access from the terminal device 400-i, the message and the image are read, and the read message and image are transmitted to the accessed terminal device 400-i. Then, the terminal device 400-i displays the message and image received from the verification device 300.
In addition, although the collation apparatus 300 hold | maintained the image of a SNS registration user, it does not need to hold | maintain, the other server apparatus hold | maintains the image of a SNS registration user, You may collate a person image and the image of the SNS registered user which another server apparatus hold | maintains.

FIG. 3 is a schematic block diagram of the imaging device 10i-j in the first embodiment. The imaging device 10i-j includes an imaging unit 111, an A / D conversion unit 112, a communication unit 114, and a control unit 120.
The imaging unit 111 captures a moving image and outputs a moving image signal indicating the captured moving image to the A / D conversion unit 112.
The A / D conversion unit 112 converts the moving image signal input from the imaging unit 111 from an analog signal to a digital signal, and outputs the digital moving image signal obtained by the conversion to the control unit 120.

  The control unit 120 causes the imaging unit 111 to capture an image when a smile of a person is detected based on the digital moving image signal input from the A / D conversion unit 112. Here, the control unit 120 includes a face area extraction unit 121, a smile determination unit 122, an imaging control unit 123, and an image generation unit 124.

  The face area extraction unit 121 extracts an image area of a human face (hereinafter also referred to as a face image area) from an image indicated by the digital moving image signal input from the A / D conversion unit 112 based on a known image technique. To do. Then, the face area extraction unit 121 outputs face image area information indicating the extracted face image area to the smile determination unit 122.

  The smile determination unit 122 determines whether the face image in the face image region indicated by the face image region information input from the face region extraction unit 121 is a smile. Specifically, for example, the smile determination unit 122 determines that the face is smiling when the mouth corner (the joint between the upper lip and the lower lip) of the face image region is higher than a predetermined angle. Then, smile determination unit 122 outputs the determination result to imaging control unit 123.

The imaging control unit 123 causes the imaging unit 111 to capture an image when it is determined that the determination result input from the smile determination unit 122 is a smile.
Thereby, the imaging unit 111 can capture an image when the person is smiling. Then, the imaging unit 111 outputs an image signal indicating an image captured by the control of the imaging control unit 123 to the A / D conversion unit 112. The A / D conversion unit 112 converts the image signal input from the imaging unit 111 from an analog signal to a digital signal, and outputs the digital image signal obtained by the conversion to the image generation unit 124 of the control unit 120.

The image generation unit 124 generates image data from the digital image signal input from the A / D conversion unit 112, and transmits the generated image data from the communication unit 114 to the image storage device 200-i.
The communication unit 114 transmits the image data input from the image generation unit 124 of the control unit 120 to the image storage device 200-i under the control of the control unit 120.

FIG. 4 is a schematic block diagram of the image storage device 200-i in the first embodiment. The image storage device 200-i includes a storage unit (storage device) 210, a communication unit 220, and a control unit (image storage unit) 230.
The storage unit 210 stores various programs that are read out and executed by the control unit 230.

  The communication unit 220 outputs the image data received from the imaging devices 10 i-j to the control unit 230. In addition, the communication unit 220 transmits the image data input from the control unit 230 to the collation device 300 under the control of the control unit 230.

  The control unit 230 extracts image data that satisfies a predetermined criterion from the image data input from the communication unit 220 and causes the storage unit 210 to store the extracted image data. Note that the control unit 230 deletes image data that does not meet the criteria. Further, the control unit 230 transmits the extracted image data from the communication unit 220 to the collation device 300.

Here, the control unit 230 includes a first determination unit 231, a second determination unit 232, and a first filter unit 233.
The first determination unit 231 determines whether two or more persons are included in the image indicated by the image data input from the communication unit 220. The first determination unit 231 outputs the image data to the second determination unit 232 when two or more (plural) persons are shown in the image. On the other hand, when two or more persons are not shown in the image, the first determination unit 231 deletes the image data.
The second determination unit 232 determines whether or not two or more faces can be identified among the persons in the image indicated by the image data input from the first determination unit 231. If the second determination unit 232 determines that two or more faces can be discriminated, the second determination unit 232 outputs the image data to the first filter unit 233. On the other hand, when two or more faces cannot be discriminated, the second determination unit 232 deletes the image data.

  If the determination result input from the second determination unit 232 indicates that two or more faces can be determined, the first filter unit 233 determines whether the eyes of the persons in the image data are facing each other. Specifically, for example, the first filter unit 233 estimates a person's eye line from the position of the black eye with reference to the center position of the eye. For example, when the person's line of sight is within a predetermined range, the first filter unit 233 determines that the person's lines of sight in the image data are facing each other, and the person's line of sight is determined in advance. If it is not within the range, it is determined that the human eyes are not facing each other.

  The first filter unit 233 causes the communication unit 220 to transmit the image data to the verification device 300 when the lines of sight are facing each other. On the other hand, when the eyes are not facing each other, the first filter unit 233 deletes the image data. Accordingly, the first filter unit 233 can delete an image in which a clearly unrelated person appears in the corner of the photo. As a result, the information sharing system 1 can be prevented from introducing a person unrelated to the user.

In the present embodiment, the first filter unit 233 determines whether the eyes are facing each other, but is not limited thereto. The first filter unit 233 may determine whether everyone is smiling, may determine whether two or more are smiling, and may determine whether the face is hidden by a hand. . Accordingly, the first filter unit 233 can delete an image in which a clearly unrelated person appears in the corner of the photo. As a result, the information sharing system 1 can be prevented from introducing a person unrelated to the user.
In the present embodiment, the control unit 230 makes the above determination using a single piece of image data, but the present invention is not limited to this. The control unit 230 may perform determination using a plurality of image data captured from two or more different angles.

  In addition, when the first filter unit 233 determines that the eye lines are facing each other from the image data, the control unit 230 determines that the image capturing apparatuses 10i-j other than the image capturing apparatus that captured the image data have the eye lines facing each other. It is also possible to pick up an image of a subject and store an image obtained by the image pickup. Thereby, since the imaging device 10i-j can capture the subject from different angles, it is possible to generate a plurality of types of images of a person looking at the front or a profile image. Note that a plurality of types of images in which a person looks at the front or a profile image may be used from images already captured. And the collation apparatus 300 can use the image imaged from this different angle for collation with the image registered on specific SNS, and can improve the specific precision of the person reflected in the image.

FIG. 5 is a schematic block diagram of the matching device 300 in the first embodiment. The collation device 300 includes a storage unit 310, a communication unit 320, and a control unit 330.
The storage unit 310 stores registration information of a specific SNS. Here, the registration information of the SNS includes an image registered in the SNS, user identification information for identifying the user, user attribute information (for example, first name, gender, incumbent, university of origin, etc.), user identification information of a friend, etc. It is. The storage unit 310 stores various programs that are read out and executed by the control unit 330.

  The communication unit 320 receives image data from the image storage device 200-i and outputs the received image data to the control unit 330. In addition, the communication unit 320 transmits information indicating a WEB page including a message and image data to the terminal device 400-k that has requested the control unit 330.

The control unit 330 compares the person in the image indicated by the image data input from the communication unit 320 with an image registered in the SNS (for example, a face photograph), and identifies the person. Identify. And the control part 330 notifies the person different from the specified person among the persons reflected in the person image that the specified person is registered into the SNS.
Specifically, for example, when the persons A, B, and C appear in the same photograph, the control unit 330 indicates that the person A and the person B are included in the person A, and the person B The person A, the person B, and the person C are notified on the SNS that the person A and the person C are shown in FIG. 2, and the person A and the person B are shown in the person C together.

  As another example, the control unit 330 notifies the person A that the person B and the person C are using the SNS when the persons A, B, and C are in the same photo. Similarly, for example, the control unit 330 notifies the persons B and C that the other two persons who are shown together use a specific SNS. Further, for example, the control unit 330 notifies the person A whether to share the photos with the persons B and C through the SNS, notifies the person B through the SNS whether to share the pictures with the persons A and C, and the person C. Whether or not to share the photos with the persons A and B may be notified through the SNS. For example, the control unit 330 may notify each of the persons A, B, and C through SNS whether or not to apply for a friend with another user.

Here, the control unit 330 includes a matching unit 331, a specific determination unit 332, a second filter unit (determination unit) 333, and a communication unit (information transmission unit) 334.
The collation unit 331 collates a person image in which a person is photographed with an image registered in a specific SNS, and determines whether each person in the person image is registered in the SNS. Here, since the SNS is one of membership systems, in other words, the collation unit 331 collates a person image in which a person is photographed with an image registered in a preset membership system. Then, it is determined whether or not a person shown in the person image is registered in the system. Thereby, the collation part 331 specifies the person who is reflected in the person image. Then, the collation unit 331 outputs user identification information and a person image corresponding to the identified person to the identification determination unit 332.
That is, the collation unit 331 identifies each person appearing in the person image based on the collation between the person image in which the person is photographed and an image registered in a preset system.

  Based on the user identification information input from the collation unit 331, the identification determination unit 332 determines whether or not two or more persons can be identified among the persons shown in the person image. The identification determination unit 332 outputs the user identification information and the person image input from the collation unit 331 to the second filter unit 333 when two or more persons can be identified. On the other hand, the identification determining unit 332 deletes the person image input from the collating unit 331 when two or more persons cannot be identified.

The second filter unit 333 determines whether all of the persons in the person image are smiling in the person image input from the specific determination unit 332. When all the persons are smiling, the second filter unit 333 stores the person image in the storage unit 310 in association with the user identification information input from the identification determination unit 332. Further, the second filter unit 333 causes the storage unit 310 to store the user identification information of the person photographed together as contact user identification information in association with the user identification information.
On the other hand, when all the persons are not smiling, the second filter unit 333 deletes the person image input from the specific determination unit 332.

In the present embodiment, the second filter unit 333 determines whether everyone is smiling, but the present invention is not limited to this. The second filter unit 333 may determine whether two or more people are smiling, determine whether the eyes are facing each other, and determine whether the face is hidden by a hand. Also good. From this, the second filter unit 333 may determine whether or not the communication unit 334 transmits information according to whether or not a person included in the plurality of photographed persons is smiling. Further, the second filter unit 333 may determine whether or not the communication unit 334 transmits information depending on whether or not there is a line of sight among the persons included in the plurality of captured persons. Further, the second filter unit 333 may determine whether or not the communication unit 334 transmits information according to the distance between persons included in the plurality of captured persons.
Moreover, the 2nd filter part 333 may change the above-mentioned determination system for every different SNS.

The contact unit 334 confirms that the person identified by the collation unit 331 is registered in the system (for example, SNS), and the person shown in the person image is different from the person identified by the collation unit 331. contact.
Specifically, for example, when receiving the login request information and the login ID via the communication unit 320, the contact unit 334 refers to the contact user identification information associated with the user identification information received in the storage unit 310. . Here, the login ID is identification information set for logging in to the SNS.

In addition, the communication unit 334 reads the top page after the SNS login from the storage unit 310. Then, the contact unit 334 reads the first and last name corresponding to the referred contact user identification information from the storage unit 310. For example, the communication unit 334 inserts the read first name and last name in the corresponding portion of the read top page. As a result, for example, the communication unit 334 can generate a top page including a sentence in which the name of the person to be introduced is inserted, such as “It is a photo with Mr. B who met at XX Land”. Then, the communication unit 334 causes post-login page information indicating a page obtained by insertion to be transmitted from the communication unit 320 to the terminal device 400-i to which the log-in request information has been transmitted. Thereby, the terminal device 400-i can display the post-login page indicated by the post-login page information.
That is, when the first person among the persons identified by the collating unit 331 is not a friend in the system for the second person among the identified persons, the contact unit 334 identifies the first person as the first person. Introduce to the second person. At that time, the communication unit 334 introduces the first person to the second person in the system. In addition, the communication unit 334 enables photo sharing between the first person and the second person.

  FIG. 6 is an example of the table T <b> 1 stored in the storage unit 310 of the verification device 300. In the figure, a set of user identification information, contact user identification information, login ID, first and last name, gender, current job, registered image file name, and person image file name is shown. For example, if the user identification information is “1”, the contact user identification information is “2,3”, the login ID is “taro”, the first and last name is “Taro”, the gender is “male”, and the current job is It is indicated that the file name of the registered image is “Taro.jpg” and the file name of the person image is “12111420.jpg” for “Company D”. For this reason, the users whose user identification information is “1” are “△ Hanako” and “□□ Jiro” whose contact user identification information is “2, 3”. I understand that.

  In the example shown in the figure, the communication unit 334 informs “XXX Taro” on the SNS that the “ΔΔ Hanako” and “□□ Jiro” are registered in the SNS. At that time, for example, the contact unit 334 may show the image indicated by the person image file “12111420.jpg” associated with the user identification information “1” to “Taro XX” on the SNS. To do.

FIG. 7 is a schematic block diagram of the terminal device 400-k in the first embodiment. The terminal device 400-k includes a storage unit 410, an input unit 420, a control unit (acquisition unit) 430, a communication unit 440, and a display unit 450.
The storage unit 410 stores various programs that are read out and executed by the control unit 430.

The input unit 420 receives input (for example, URL) by a user operation. Then, input information indicating the received input (for example, URL information indicating a URL) is output to the control unit 430.
The control unit 430 controls the communication unit 440 and the display unit 450 based on the input information input from the input unit 420.

  For example, the control unit 430 causes the URL information input from the input unit 420 to be transmitted from the communication unit 440 to the verification device 300. Communication unit 440 receives the login page information transmitted from matching device 300 in response to the transmission of URL information, and outputs the received login page information to control unit 430. Then, control unit 430 causes display unit 450 to display a login page indicated by the login page information.

For example, the input unit 420 receives an input of a login ID by the user. Input unit 420 outputs the accepted login ID to control unit 430. Further, the input unit 420 outputs login pressing information to the control unit 430 when the login button displayed on the display unit 450 is pressed by a user operation.
When receiving the login pressing information from the input unit 420, the control unit 430 transmits a login request from the communication unit 440 to the verification device 300 together with the login ID input from the input unit 420.
Then, in response to the transmission of the login request, the communication unit 440 receives the post-login page information transmitted from the verification device 300, and outputs the received post-login page information to the control unit 430. Then, control unit 430 causes display unit 450 to display the post-login page indicated by the post-login page information. Here, for example, the post-login page includes a link to the notification page.

When the control unit 430 receives an input indicating that the link to the notification page has been clicked from the input unit 420 while the post-login page is displayed on the display unit 450, the control unit 430 issues a notification page request from the communication unit 440. Send it.
Then, in response to the transmission of the notification page request, the communication unit 440 receives the notification page information transmitted from the collation device 300 and outputs the received notification page information to the control unit 430. Then, control unit 430 causes display unit 450 to display a notification page indicated by the notification page information.

  FIG. 8 is an example of a screen displayed on the display unit 450 of the terminal device 400-i in the first embodiment. In the figure, it is shown that the user A is viewing the post-login page 21 displayed on the display unit 450 of the terminal device 400-i. In the post-login page 21 in the same figure, a link 22 to an information page and a friend introduction message 23 are shown. In the friend introduction message 23, a sentence entitled “Introduction of a friend to Mr. A”, “This is a picture of Mr. B who met at XX Land” is shown.

  In addition, in the figure, a notification page 24 displayed on the display unit 450 when the link 22 to the notification page is opened is shown. On the notification page 24, a “Become friends with B” button 25 is displayed. The user A can become a friend on the user B and the SNS by pressing the “become a friend with Mr. B” button 25. Here, the friend on SNS is the relationship which can share an image or a message, for example.

  FIG. 9 is a flowchart illustrating an example of a processing flow of the information sharing system 1 according to the first embodiment. First, the imaging device 10i-j captures an image (step S101). Specifically, the imaging device 10i-j captures an image when it detects a smile. Next, the image storage device 200-i performs image arrangement processing (step S102). Specifically, the image storage device 200-i organizes image data obtained by imaging by the imaging device 10i-j. Next, the collation apparatus 300 performs image collation processing (step S103). Specifically, the collation apparatus 300 collates the person image remaining after the image storage apparatus 200-i has arranged and the image registered in the SNS. And the collation apparatus 300 introduces a person who is shown together with the user in the person image in the SNS to the user. Above, the process of this flowchart is complete | finished.

  FIG. 10 is a flowchart illustrating an example of the flow of image arrangement processing in step S102 of FIG. First, the first determination unit 231 determines whether two or more people are included in the image (step S201). When two or more people are shown in the image (YES in step S201), the first determination unit 231 proceeds to step S202. On the other hand, when two or more people are not shown in the image (NO in step S201), the control unit 230 deletes the image (step S204).

  Next, in step S202, the second determination unit 232 determines whether two or more faces can be determined in the image (step S202). When two or more faces can be discriminated in the image (YES in step S202), the process proceeds to step S203. On the other hand, when two or more faces cannot be identified in the image (NO in step S202), the control unit 230 deletes the image (step S204).

  Next, in step S203, the first filter unit 233 determines whether or not the human eyes are facing each other in the image (step S203). If the human eyes are facing each other in the image (YES in step S203), the first filter unit 233 ends the process and proceeds to step S103. On the other hand, when the human eyes are not facing each other in the image (NO in step S203), the control unit 230 deletes the image (step S204). Above, the process of this flowchart is complete | finished.

  As a result, the image storage device 200-i can extract only images in which two or more people appear in the image, two or more faces can be discriminated, and the eyes of the people in the image are facing each other. it can. By imposing such conditions, the image storage device 200-i can narrow down the images by deleting images that do not meet the conditions, and thus can reduce the processing load on the subsequent collation device 300. In addition, the image storage device 200-i can extract only images in which two or more persons whose relationships are inferred are extracted by extracting images under the condition that the eyes are facing each other. it can. Thereby, the image storage device 200-i can improve the accuracy of friend introduction in the collation device 300.

  FIG. 11 is a flowchart showing an example of the flow of collation processing in step S103 of FIG. First, the collation unit 331 collates the person image received from the image storage device 200-i with the image of the SNS registered user held by the own device to identify the person (step S301). Next, the determination unit 332 determines whether two or more persons have been specified (step S302). When two or more persons can be identified (YES in step S302), the identification determining unit 332 proceeds to the process in step S303. On the other hand, when two or more persons cannot be identified (NO in step S302), the person image is deleted (step S305).

  Next, in step S303, the second filter unit 333 determines whether all of the people in the person image are smiling (step S303). If everyone in the person image is smiling (YES in step S303), the contact unit 334 informs the person in the SNS of the person in the SNS. On the other hand, if all the people shown in the person image are not smiling (NO in step S303), the person image is deleted (step S305). Above, the process of this flowchart is complete | finished.

  As described above, in the information sharing system 1 of the present embodiment, the collation device 300 collates the person image in which the person is photographed with the image registered in the specific SNS, and the person who has moved to the person image is registered in the SNS. It is determined whether or not it is done, and a person is specified. Thereby, the collation apparatus 300 can identify the person who met in the facility but does not know the person's information.

  And the collation apparatus 300 notifies the person different from the specified person among the persons reflected in the person image that the specified person is registered into the SNS. Thereby, the collation apparatus 300 can introduce the person in SNS when it acquaints in the facility but does not know the person's information. As a result, even when the user has met in the facility but does not know the information of the person, the user can contact the person or share the image.

It should be noted that even a person who does not use SNS is a person who has previously registered user identification information and a mail address (for example, a mail address of a mobile phone) in association with the image storage device 200-i. The image storage device 200-i may transmit a mail indicating that a person shown together uses the SNS to the mail address.
In that case, for example, it may be realized as follows. The image storage device 200-i stores user identification information, the face image data of the user, and an email address in association with each other. The image storage device 200-i receives from the collation device 300 a set of image data registered in the SNS and at least one person registered in the SNS. The image storage device 200-i collates the person shown in the image data with the face image data held by the image storage device 200-i. When there is matching face image data as a result of the collation, the image storage device 200-i indicates that the person who is shown together with the mail address associated with the matching face image data uses the SNS. send an email.

Further, the image storage device 200-i may hold a face image of the user's SNS in advance. Then, when the image storage device 200-i recognizes the user based on the face image of the user's SNS, the image storage device 200-i may photograph the user with the imaging device 10i-j preferentially installed in the facility.
In that case, you may implement | achieve as follows. The control unit 230 of the image storage device 200-i further includes an imaging control unit. Then, it is assumed that the face image registered in the SNS is stored in advance in the storage unit 210- of the image storage device 200-i. In that case, the imaging control unit may cause the imaging device 10i-j to preferentially capture the person of the face image stored in the storage unit 210.

  Further, the image storage device 200-i may hold a face image of a user who has visited in the past. Then, when the image storage device 200-i recognizes the user based on the face image of the user who has visited in the past, the image storage device 200-i may photograph the user with the imaging device 10i-j preferentially installed in the facility. Good.

<Second Embodiment>
Next, the second embodiment will be described. FIG. 12 is a schematic block diagram of the information sharing system 1b according to the second embodiment. Elements common to those in FIG. 2 are denoted by the same reference numerals, and detailed description thereof is omitted. The configuration of the information sharing system 1b in FIG. 12 is different from the configuration of the information sharing system 1 in FIG. 2 in that the verification device 300 is changed to the verification device 300b and the terminal device 400-k is changed to the portable terminal device 400b-k. It has become a thing.

  The collation device 300b in the information sharing system 1 in the second embodiment is different from the collation device 300 in the first embodiment in the following points. When the collation device 300b collates the image captured in the same facility with the image registered in the SNS, when a friend on the SNS of the target user has also visited the facility, the verification device 300b informs the target user of that fact in the SNS. Notice.

  FIG. 13 is a diagram for describing processing in which an image is stored in the image storage device 200-i in the second embodiment. In an area 30-1 surrounded by a broken line in the drawing, it is shown that the user A is photographed together with the character in the facility in a certain area in the facility. Specifically, it is shown that the imaging apparatus 101-1 captures an image 31 in which the user A and the first character are captured at the first time. Further, it is shown that the imaging device 101-2 captures an image 32 in which the user A and the second character are captured at a second time which is a time different from the first time. Further, it is shown that the imaging apparatus 101-3 captures the image 33 in which the user A and the third character are captured at a third time that is a time different from the first time and the second time. ing.

  In addition, in an area 30-2 surrounded by a broken line in the figure, it is shown that the user B is photographed together with a character in the facility in a certain area in the facility. Specifically, it is shown that the imaging device 101-4 captures the image 34 in which the user A and the fourth character are captured at the fourth time. Further, it is shown that the imaging apparatus 101-5 captures an image 35 in which the user B and the fifth character are captured at a fifth time that is a different time from the fourth time. Further, it is shown that the imaging device 101-6 captures the image 36 in which the user A and the sixth character are captured at a sixth time that is different from the fourth time and the fifth time. ing. It is shown that images 31 to 36 are stored in the image storage device 200-i.

  FIG. 14 is a schematic block diagram of a collation device 300b according to the second embodiment. In addition, the same code | symbol is attached | subjected to the element which is common in FIG. 5, and the specific description is abbreviate | omitted. The configuration of the collation device 300b in FIG. 14 is the same as the configuration of the collation device 300 in FIG. 5 except that the control unit 330 is changed to a control unit 330b. The filter unit 333 and the communication unit 334 are deleted, the friend determination unit 335 and the notification unit (information transmission unit) 336 are added, and the collation unit 331 is changed to the collation unit 331b.

  When the control unit 330b determines that different target persons appearing in each of the plurality of person images captured in the same facility are registered in a specific SNS, the target persons are friends with each other in the SNS. In this case, the SNS is notified to each of the plurality of target persons that a person other than himself / herself is visiting the facility among the plurality of target persons.

  For example, the control unit 330b determines that the user A reflected in the first person image among the two person images captured in the same facility is registered in the SNS, and the two person images When it is determined that the user B shown in the second person image is registered in the SNS, the following processing is performed. When the user A and the user B are friends in the SNS, the control unit 330b indicates that the user B is visiting the user A, and that the user A is visiting the user SNS. Inform at.

  The verification unit 331b has the same function as the verification unit 331 of the first embodiment, but differs in the following points. The collation unit 331b determines whether or not different target persons shown in each of a plurality of person images captured in the same facility are registered in a specific SNS. Then, the collation unit 331b outputs the determination result to the friend determination unit 335.

  When the determination result input from the collation unit 331b indicates that the target person appearing in each of the plurality of person images is registered in the SNS, the friend determination unit 335 is a friend of the target person in the SNS. It is determined whether or not. In other words, when the friend determination unit 335 is registered in a specific system (for example, a certain SNS), each of the target persons shown in each of a plurality of person images captured in the same facility by the collation unit 331b. If determined, it is determined whether or not the target persons are friends in the specific system (for example, the SNS). Then, friend determination unit 335 outputs the determination result to notification unit 336.

  In the case where the determination result input from the friend determination unit 335 indicates that the plurality of target persons are friends in the SNS, the notifying unit 336 determines, for each target person, of the plurality of target persons. The SNS is notified that a person other than yourself is visiting the facility. In other words, when the friend determination unit 335 determines that the target persons are friends in the SNS, the notification unit 336 has a person other than itself among the target persons for each of the target persons. Notify the SNS that you are visiting the facility.

  In addition, although the notification part 336 of this embodiment notified in SNS, you may notify not only to this but to e-mail address of a mobile phone, a tablet computer, or a personal computer, for example. In that case, for example, it may be realized as follows. The storage unit 310 stores in advance at least one mail address of a mobile phone, a tablet computer, or a personal computer in association with user identification information, and the notification unit 336 stores a mail address corresponding to the user identification information. Read from 310. And the notification part 336 may notify mail to the read mail address by transmitting the mail to the effect that the friend on the SNS is visiting the same facility.

  FIG. 15 is a schematic block diagram of the mobile terminal device 400b-k in the second embodiment. In addition, the same code | symbol is attached | subjected to the element which is common in FIG. 7, and the specific description is abbreviate | omitted. The configuration of the mobile terminal device 400b-k in FIG. 15 is such that the communication unit 440 is changed to a wireless communication unit 440b with respect to the configuration of the terminal device 400-k in FIG.

  Under the control of the control unit 430, the wireless communication unit 440b encodes data input from the control unit 430, modulates the encoded data, and wirelessly transmits the modulated signal to the verification device 300. Also, the wireless communication unit 440b demodulates and decodes the wireless signal received wirelessly from the verification device 300 and returns the original transmission data. Then, the wireless communication unit 440b outputs the original transmission data to the control unit 430.

FIG. 16 is a diagram illustrating an example of display on the terminal device 400-i in the second embodiment. This figure is an example of the display of the terminal device 400-i held by the user A. In the figure, a notice 41 from the application is displayed on the SNS Home screen. In the notice 41 from the application, a message “Notice to Mr. A in XX Land: A friend B is also in XX Land!” Is shown.
In the example of the figure, the notification unit 336 receives message information indicating a message “Notice to Mr. A in XX Land: Friend B is also in XX Land!” From the communication unit 320 by the user A. It transmits to the terminal device 400-i to hold | maintain. Thereby, since the terminal device 400-i held by the user A displays the message, it can be known that the friend B is visiting the same facility (XX Land).

  FIG. 17 is a flowchart illustrating an example of a collation process in the second embodiment. First, the collation unit 331b determines whether different target persons appearing in a plurality of person images captured in the same facility are registered in the SNS (step S401). When different target persons are not registered in the SNS (NO in step S401), the control unit 330b deletes the person image (step S404).

  On the other hand, when different target persons are registered in the SNS (step S401 YES), the friend determination unit 335 determines whether the target persons are friends in the SNS (step S402). When the target persons are friends in the SNS (step S402 YES), the notification unit 336 confirms that a person other than the target person has visited the facility for each of the target persons. Is notified in SNS. On the other hand, when the target persons are not friends in the SNS (NO in step S402), the control unit 330b deletes the person image (step S404). Above, the process of this flowchart is complete | finished.

  As described above, when the collation device 300b in the second embodiment determines that each of the target persons reflected in each of the plurality of person images captured in the same facility is registered in the SNS, the target persons are in the SNS. It is determined whether or not it is a friend. When it is determined that the target persons are friends in the SNS, each target person is notified that a person other than himself / herself is visiting the facility. Thereby, the target person can know that a friend on SNS is visiting the same facility.

  Note that the collation device 300b determines from which background image the person image was captured from the background image captured in the person image captured by the imaging device, and indicates which attraction is the target person. The user position information may be transmitted to the mobile terminal devices 400b-k of other users. And the other user's portable terminal device 400b-k displays the received user position information, so that the other user can grasp where the target person is near the attraction. As a result, other users can easily join the target person in the facility.

  In addition, the mobile terminal device 400b-k held by the target person detects the position of the own device by GPS (Global Positioning System), and collates the target person position information indicating the detected position of the own device. May be transmitted wirelessly. In this case, the collation device 300b may transmit the received target person position information to another user's mobile terminal device 400b-l (l is an integer other than k). Accordingly, the position of the target person indicated by the target person position information is displayed on the mobile terminal device 400b-l of the other user. Thereby, since the other user can grasp the position of the target person, the other user can easily join the target person in the same facility.

<Third Embodiment>
Subsequently, a third embodiment will be described. FIG. 18 is a schematic block diagram of an information sharing system 1c in the third embodiment. Elements common to those in FIG. 2 are denoted by the same reference numerals, and detailed description thereof is omitted. The configuration of the information sharing system 1c in FIG. 18 is the same as the configuration of the information sharing system 1 in FIG. 2 except that the verification device 300 is changed to a verification device 300c.

  The collation device 300c in the information sharing system 1 in the third embodiment is different from the collation device 300 in the first embodiment in the following points. In addition to specifying the person shown in the captured image, the matching device 300c further specifies a friend on the SNS of the specified person. As an example of the process, the following application example will be described in the third embodiment. The application example is that when a crime occurs in a certain facility, the collation device 300c collates the image captured at the time of the crime with the image registered in the SNS, and identifies the suspect in the image captured at the time of the crime. In addition, a friend on the SNS of the suspect is specified.

  FIG. 19 is a schematic block diagram of a collation device 300c in the third embodiment. In addition, the same code | symbol is attached | subjected to the element which is common in FIG. 5, and the specific description is abbreviate | omitted. The configuration of the collation device 300c in FIG. 19 is the same as the configuration of the collation device 300 in FIG. 5 except that the control unit 330 is changed to a control unit 330c. The filter unit 333 and the contact unit 334 are deleted, the friend extraction unit 337 is added, and the collation unit 331 is changed to the collation unit 331c.

  When a crime occurs at a certain facility, the control unit 330b collates an image captured when the crime occurs with an image registered in the SNS, and identifies a suspect in the image captured when the crime occurs. Then, the control unit 330b extracts a friend on the identified suspect's SNS, and transmits the suspect information indicating the suspect and the friend information indicating the extracted friend from the communication unit 320 to the terminal device 400-k. Here, the control unit 330b includes a collation unit 331c and a friend extraction unit 337.

  When a crime occurs in a certain facility, the collation unit 331c receives an image captured when the crime occurs from the communication unit 320. The collation unit 331c collates the image captured when the crime occurs with the image registered in the SNS, and identifies the suspect in the image captured when the crime occurs. The collation unit 331 c outputs the identified criminal user identification information to the friend extraction unit 337.

The storage unit 310 stores user identification information and friend identification information in association with each other for each user. The friend identification information is user identification information of a friend on the SNS of the target user.
The friend extraction unit 337 refers to the user identification information of the friend corresponding to the user identification information input from the collation unit 331c in the storage unit 310, and extracts the identified friend on the SNS of the criminal. And the friend extraction part 337 transmits the criminal information regarding the specified criminal and the friend information regarding the extracted friend to the terminal device 400-k which the communication part 320 requested | required.

  Thereby, in terminal device 400-k, the information regarding a criminal and the information regarding the criminal's friend can be displayed. For example, the police officer can grasp the relatives and friendships of the suspects identified from the SNS friend list, and can use the suspect's relatives and friendships for criminal investigations such as demonstration of alibi. it can.

  FIG. 20 is a diagram illustrating an example of display on the terminal device 400-k in the third embodiment. In the figure, the face image of the identified suspect's face image is the face image of the father, sister, mother, brother, friend in school days, aunt, her, junior at work, who are friends on the suspect's SNS. It is shown. As in this example, the terminal device 400-k can display the suspect's relative and friendship based on the information received from the verification device 300.

  FIG. 21 is a flowchart illustrating an example of a collation process in the third embodiment. First, the collation unit 331c collates the image captured when the crime occurs with the image registered in the SNS, and identifies the suspect in the image captured when the crime occurs (step S501). Next, the friend extracting unit 337 extracts the identified suspect's friend (step S502). Next, the friend extraction unit 337 transmits the criminal information and the friend information to the terminal device 400-k requested from the communication unit 320 (step S503). Above, this flowchart is complete | finished.

  As described above, the collation device 300c in the third embodiment collates a captured image with an image registered in a preset system, and identifies a person shown in the captured image. And the collation apparatus 300c specifies the friend on SNS of the specified person. Thereby, the collation apparatus 300c can specify an unknown person shown in the image, and can further specify a person (for example, a relative or a friend) connected to the person.

  As an example, in the third embodiment, the collation device 300c collates an image captured when a crime occurs with an image registered in a preset system to obtain an image captured when the crime occurs. The suspect was identified. And the collation apparatus 300c extracted the friend on SNS of the identified suspect. Thereby, the police officer can grasp the relative and friendship of the suspect from the extracted friend, and can use the relative and friendship of the suspect for criminal investigation.

<Fourth Embodiment>
Next, FIG. 22 is a schematic block diagram of an information sharing system 1d according to the fourth embodiment. Elements common to those in FIG. 2 are denoted by the same reference numerals, and detailed description thereof is omitted. The configuration of the information sharing system 1d in FIG. 22 is different from the configuration of the information sharing system 1 in the first embodiment in FIG. 2 in that the verification device 300 is changed to the verification device 300d, and each terminal device 400-1,. 400-L is changed to portable terminal devices 400d-1, ..., 400d-L, respectively.
The information sharing system 1d according to the fourth embodiment introduces users having similar attributes among other users in the same facility in the same time zone when the user is in a certain facility. .

The verification device 300d in the information sharing system 1d in the fourth embodiment is different from the verification device 300 in the first embodiment in the following points.
The collation device 300d acquires position information indicating the position of the user registered in the SNS. When the verification device 300d determines that the target person shown in the person image is registered in the SNS, the target person is selected from the users registered in the SNS based on the acquired position information. Extract users with similar attributes. Then, the verification device 300 notifies the target person of the extracted user.

  The mobile terminal devices 400b-k in the fourth embodiment detect the position of the own device by GPS and wirelessly transmit the detected position to the verification device 300d.

  FIG. 23 is a diagram illustrating a basic concept of an information sharing system 1d according to the fourth embodiment. In the amusement park 51, it is shown that the mobile terminal device (400d-1, 400d-2, or 400d-3) is transmitting position information to the verification device 300 by the user's operation. Thereby, collation device 300d can acquire the position information of each portable terminal device 400d-i.

  FIG. 24 is a schematic block diagram of a collation device in the fourth embodiment. In addition, the same code | symbol is attached | subjected to the element which is common in FIG. 5, and the specific description is abbreviate | omitted. The configuration of the collation device 300d in FIG. 19 is the same as the configuration of the collation device 300 in FIG. 5 except that the control unit 330 is changed to a control unit 330d. The filter unit 333 and the contact unit 334 are deleted, the position information acquisition unit 338, the similar user extraction unit 339, and the notification unit (information transmission unit) 336d are added, and the collation unit 331 is changed to the collation unit 331d. Yes.

The storage unit 310 stores user identification information, user attribute information, and user registration images in association with each other. Here, the user attribute information is information indicating the attribute of the user, such as age, gender, place of residence, comment on a favorite item (for example, “healed by character P”), and the like. In addition, the storage unit 310 stores a latitude range and a longitude range and a place name in the facility in association with each other.
The communication unit 320 receives the position information transmitted wirelessly from each mobile terminal device 400d-k, and outputs the received position information to the position information acquisition unit 338 of the control unit 330d.

The control unit 330d includes a collation unit 331d, a position information acquisition unit 338, a similar user extraction unit 339, and a notification unit 336d.
The collation unit 331d refers to the storage unit 310 to collate a person image in which a person is photographed with an image registered in a specific SNS, and whether the person in the person image is registered in the SNS. It is determined whether or not a person is identified. Then, the collation unit 331d outputs person information indicating the identified person to the similar user extraction unit 339.

  The position information acquisition unit 338 acquires position information indicating the position of the user registered in the specific SNS. Specifically, the position information acquisition unit 338 acquires the position information by receiving the position information from the communication unit 320. Here, the position information is position information of each mobile terminal device 400d-k. The position information acquisition unit 338 outputs the acquired position information to the similar user extraction unit 339.

  When the collation unit 331d determines that the target person shown in the person image is registered in the SNS, the similar user extraction unit 339 stores the storage unit 310 based on the position information acquired by the position information acquisition unit 338. Referring to FIG. 5, a similar user who is in the same facility as the target person and has similar attributes to the target person is extracted from the users registered in the SNS.

  Specifically, for example, when the position information indicates the position in the facility where the target person is located, the similar user extraction unit 339 extracts a user who satisfies the conditions such as age, sex, and residence as a similar user. For example, the similar user extraction unit 339 determines the prefecture or residence where the age is within the range of plus or minus 3 years of the age of the target person, the gender is the same as the gender of the target person, and the residence is the residence of the target person. Users who satisfy the extraction condition that they are neighboring prefectures of the ground are extracted as similar users. The similar user extraction unit 339 reads out user attribute information (for example, a comment on a place of residence, age, sex, favorite thing) corresponding to the extracted user from the storage unit 310. Moreover, the similar user extraction part 339 calculates the position in a facility based on position information, for example. Specifically, for example, the similar user extraction unit 339 checks whether the latitude and longitude indicated by the position information correspond to the latitude range and the longitude range stored in the storage unit 310, and the applicable latitude range and Read the location name corresponding to the longitude range. The similar user extraction unit 339 outputs the read user attribute information together with the place name to the notification unit 336d.

  This extraction condition may vary depending on the size of the facility, the number of visitors, or the ability to attract customers. For example, the similar user extraction unit 339 may adjust the number of users to be extracted such that the narrower the facility, the greater the number of visitors, or the higher the ability to attract customers, the greater the narrowing down.

  For example, in the storage unit 310, facility identification information, facility location information, and the facility size are stored in association with each other, and the facility size and extraction conditions are stored in association with each other. . In this case, the similar user extraction unit 339 refers to the storage unit 310 and reads the size of the facility where the target person is located from the position information of the target person. Then, the similar user extraction unit 339 may change the extraction condition according to the facility size by reading the extraction condition corresponding to the read size with reference to the storage unit 310.

  The extraction condition may be set by each SNS user. For example, the user may be allowed to set the age range of the user to be extracted.

  The notification unit 336d notifies the target person of the similar user extracted by the similar user extraction unit 339. The notification unit 336d receives a wireless signal indicating the user attribute information and the place name input from the similar user extraction unit 339, in response to a request from the mobile terminal device 400d-k. To 400d-k. Accordingly, since the requested mobile terminal device 400d-k can display the user attribute information and the place name, the target person holding the requested mobile terminal device 400d-k has an attribute similar to the target person. It is possible to grasp the attribute information of a similar user who has and the place where the similar user is present.

  FIG. 25 is a schematic block diagram of the mobile terminal device 400d-k in the fourth embodiment. In addition, the same code | symbol is attached | subjected to the element which is common in FIG. 15, and the specific description is abbreviate | omitted. The configuration of the mobile terminal device 400d-k in FIG. 25 is the same as the configuration of the mobile terminal device 400b-k in FIG. 15 except that a position detection unit 460 is added and the control unit 430 is changed to the control unit 430d. ing.

The storage unit 410 has the same function as the storage unit 410 of the second embodiment shown in FIG. 15, but differs in the following points. In the storage unit 410, a friend introduction application is stored in advance. It is assumed that the friend introduction application is downloaded in advance from a certain server device as an example.
The input unit 420 has the same function as the input unit 420 of the second embodiment shown in FIG. 15, but differs in the following points. An input of a friend introduction application activation instruction is received from the input unit 420, and the accepted friend introduction application activation instruction is output to the control unit 430d.

The position detection unit 460 detects the position (for example, latitude and longitude) of the own device. Specifically, for example, the position detection unit 460 detects the latitude and longitude of its own device by the GPS function. Then, the position detection unit 460 outputs position information indicating the detected position to the control unit 430d.
The control unit 430d causes the wireless communication unit 440b to wirelessly transmit the position information input from the position detection unit 460 to the verification device 300.

  In addition, when the activation instruction for the friend introduction application is input from the input unit 420, the control unit 430d reads the friend introduction application from the storage unit 410 and executes the friend introduction application. Then, the control unit 430d wirelessly transmits a request for similar user information from the wireless communication unit 440b to the verification device 300d. In response to the request for similar user information, the wireless communication unit 440b receives a wireless signal indicating the user attribute information and the place name from the matching device 300, and reproduces the user attribute information and the place name from the received wireless signal. The wireless communication unit 440b outputs the reproduced user attribute information and the place name to the control unit 430d.

  The control unit 430d causes the display unit 450 to display the user attribute information and the place name input from the wireless communication unit 440b. Thereby, since the mobile terminal device 400d-k displays the user attribute information and the place name, the target person holding the requested mobile terminal device 400d-k is a similar user having an attribute similar to the target person. And the location where the similar user is present can be grasped.

  FIG. 26 is an example of display on the mobile terminal device 400d-k in the fourth embodiment. In the figure, it is shown that similar user information is displayed when a friend application is launched. In the screen area 60 of the figure, as an example of a message by the friend introduction application, it is shown that “Such a person is nearby! In the screen area 61 in the figure, as one of similar users near a certain user, the face images of Mr. B and Mr. B are shown, Mr. B's residence is Tokyo, age is 27 years old, and what he likes The comment for is “I like XX land”, indicating that the current location is a harbor. Here, the harbor is the name of a place in the facility.

In addition, in the screen area 62 in the figure, as one of similar users near the user, the face images of Mr. C and Mr. C are shown, Mr. C's residence is Tokyo, age is 28 years old, and likes The comment on “Nana” is “Healed by Character P”, indicating that the current location is a port. Here, the port is the name of a place in the facility.
In addition, in the screen area 63 in the figure, as one of similar users near the user, D and D's face images are shown, D's residence is Yokohama, age is 27 and likes The comment on the thing is “Character Q is cute!”, Indicating that the current location is coast. Here, the coast is the name of a place in the facility.

In this way, the mobile terminal device 400d-k displays the name of the place in the facility, so that the user of the mobile terminal device 400d-k who has seen it can search for a similar user.
Moreover, the portable terminal device 400d-k displays a comment for a favorite item, so that the user of the portable terminal device 400d-k who sees the comment can easily find a favorite user. Thereby, it is possible to apply for a friend to the similar user in the SNS or search for a similar user.

  FIG. 27 is a flowchart illustrating an example of a collation process in the fourth embodiment. First, the collation unit 331d collates a person image with an image registered in a specific SNS, and identifies a person shown in the person image (step S601). Next, the similar user extraction unit 339 extracts a similar user having an attribute similar to the identified person (step S602). Next, the notification unit 336d notifies similar user information to the mobile terminal device 400d-k of the identified person (step S603). Above, the process of this flowchart is complete | finished.

As described above, in the fourth embodiment, when the verification apparatus 300d determines that the target person shown in the person image is registered in the SNS, the user registered in the SNS based on the acquired position information. Among them, a similar user who is in the same facility as the target person and has an attribute similar to the target person is extracted. Then, the collation device 300d notifies the target person of the extracted similar user. As a result, the target person can grasp similar users whose attributes are similar to those of the target person among users who visit the same facility as the target person in the same time zone. Thereby, the target person can be a friend and share a photo with the similar user and the SNS.
In addition, since the collation device 300d notifies the target person of the current location of the similar user, the similar user can be searched for in the facility where the user is visiting.

  As described above, in the collation device in each embodiment, the collation unit collates the person image stored in the image storage device with the image stored in advance in the specific system, and specifies the person shown in the person image. . When the collation unit identifies a plurality of persons from one person image, the information transmission unit transmits information to the specified plurality of persons. Thereby, information can be shared with others photographed together.

  The collating unit identifies the first person and the second person appearing in the person image, and the information transmitting unit includes the first person and the second person identified by the collating unit in the same system. If registered, the person image is transmitted to the first person and the second person. This makes it possible to share a person image taken together with another person photographed together.

  The collating unit identifies the first person and the second person appearing in the person image, and the information transmitted to the first person by the information transmitting unit is information for introducing the second person. The information transmitted to the second person by the information transmitting unit is information for introducing the first person. This allows you to receive introductions from other people who have been photographed together and make friends with others.

  Note that the image storage device 200-i stores the position of each imaging device 10i-j in advance. Then, the image storage device 200-i may transmit the image data and the imaging position of the imaging device 10i-j that captured the image indicated by the image data to the verification device 300. The image storage device 200-i may estimate the position of the subject based on the image captured by the imaging device.

  Moreover, the collation apparatus 300d may include a personal information acquisition unit that acquires personal information of a user who is determined by the verification unit 331d to be registered in the SNS. In that case, the similar user extraction unit 339 is a user who is in the same facility as the target person among the users registered in the SNS based on the position information and the personal information acquired by the personal information acquisition unit. A user having an attribute similar to that of the target person may be extracted.

In each embodiment, the image storage device 200-i and the collation device 300 have been described as separate devices. However, the present invention is not limited to this, and may be realized as a single device. When realized as one device, for example, the collation device 300 may have the function of each image storage device 200-i, or each image storage device 200-i may have the function of the collation device 300. .

In each embodiment, the information sharing system (1, 1b, 1c, 1d) may process a plurality of processes in the photo storage device 200-i according to each embodiment in a distributed manner. In the embodiment, the information sharing system (1, 1b, 1c, 1d) may process a plurality of processes in the collation devices (300, 300b, 300c, 300d) in a distributed manner by a plurality of apparatuses.
Further, in each embodiment, the information sharing system (1, 1b, 1c, 1d) is configured so that one apparatus processes the processing in the photo storage device 200-i and the collation device (300, 300b, 300c, 300d). It may be configured.
Further, a program for executing each process of the information sharing system (1, 1b, 1c, 1d) of the present embodiment is recorded on a computer-readable recording medium, and the program recorded on the recording medium is stored in the computer system. The above-described various processes related to the information sharing system (1, 1b, 1c, 1d) may be performed by reading the data into and executing.

  Here, the “computer system” may include an OS and hardware such as peripheral devices. Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used. The “computer-readable recording medium” means a flexible disk, a magneto-optical disk, a ROM, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, a hard disk built in a computer system, etc. This is a storage device.

  Further, the “computer-readable recording medium” refers to a volatile memory (for example, DRAM (Dynamic) in a computer system serving as a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Random Access Memory)) that holds a program for a certain period of time is also included. The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

  As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the concrete structure is not restricted to this embodiment, The design etc. of the range which does not deviate from the summary of this invention are included.

1, 1b, 1c, 1d Information sharing system 100-1, ..., 100-N Imaging units 101-1, 101-2, ..., 101-M, ..., 10N-1, 10N-2, ..., 10N-M DESCRIPTION OF SYMBOLS 10i-j Image pick-up device 111 Image pick-up part 112 A / D conversion part 114 Communication part 120 Control part 121 Face area extraction part 122 Smile determination part 123 Image pick-up control part 124 Image generation part 200-1, ..., 200-N Image storage apparatus 210 Storage unit (storage device)
220 communication unit 230 control unit (image storage unit)
231 1st determination part 232 2nd determination part 233 1st filter part 300, 300b, 300c, 300d Collation apparatus 310 Storage part 331, 331d Collation part 332 Specific determination part 333 2nd filter part (determination part)
334 Contact Department (Information Department)
335 Friend determination unit 336, 336d Notification unit (information transmission unit)
337 Friend extraction unit 338 Location information acquisition unit 339 Similar user extraction unit 400-1, ..., 400-L terminal device 400b-1, ..., 400b-L, 400d-1, ..., 400d-L portable terminal device 410 storage unit 420 Input unit 430 Control unit (acquisition unit)
440 communication unit 440b wireless communication unit 450 display unit 500 communication network

Claims (16)

An information sharing system comprising: an imaging device that captures a plurality of persons; an image storage device that stores a person image obtained by imaging by the imaging device; and a verification device;
The verification device is
A collation unit that collates a human image stored in the image storage device with an image stored in advance in a specific system, and identifies a person shown in the human image;
An information transmitting unit that transmits information to the plurality of specified persons when the verification unit specifies a plurality of persons from one person image;
An information sharing system comprising: The verification unit identifies a first person and a second person appearing in the person image;
The information transmitting unit transmits the person image to the first person and the second person when the first person and the second person specified by the matching unit are registered in the same system. The information sharing system according to claim 1. The verification unit identifies a first person and a second person appearing in the person image;
The information sent by the information sending unit to the first person is information introducing the second person, and the information sent by the information sending unit to the second person is the first person. The information sharing system according to claim 1, wherein the information sharing system is information that introduces one person.   When the first person included in the person specified by the verification unit is not a friend in the same system for the second person included in the person specified by the verification unit, The information sharing system according to any one of claims 1 to 3, wherein information for introducing the first person to the second person is transmitted.   2. The information transmission unit according to claim 1, wherein the information transmission unit enables the collation unit to share a photo from one person image to a plurality of persons in the same system. 5. The information sharing system according to any one of 4.   6. The determination unit according to claim 1, further comprising: a determination unit configured to determine whether or not the information transmission unit transmits information according to whether or not a person included in the plurality of photographed persons is smiling. Information sharing system.   The determination unit according to any one of claims 1 to 5, further comprising: a determination unit that determines whether or not the information transmission unit transmits information according to whether or not there is a line of sight among the persons included in the plurality of captured persons. The information sharing system according to one item.   6. The determination unit according to claim 1, further comprising: a determination unit configured to determine whether the information transmission unit transmits information according to a distance between persons included in the plurality of captured persons. Information sharing system. A collation unit that collates a human image stored in the image storage device with an image stored in advance in a specific system, and identifies a person shown in the human image;
An information transmitting unit that transmits information to the plurality of specified persons when the verification unit specifies a plurality of persons from one person image;
A collation device comprising: The verification unit identifies each person in the person image,
When the first person among the identified persons is not in a friendship relationship in the system with respect to the second person among the identified persons, the information transmitting unit identifies the first person as the second person. The collation apparatus according to claim 9, wherein information to be introduced to the person is sent. If the collation unit determines that each target person shown in each of a plurality of person images captured in the same facility is registered in the system, whether the target persons are friends in the system. A friend determination unit for determining whether
When the target determination unit determines that the target person is a friend in the system by the friend determination unit, a person other than the target person visits the facility for each of the target persons. The collation apparatus according to claim 9, wherein the collation apparatus notifies that it is in progress. The collating unit collates an image captured when a crime occurs with an image registered in a preset system, and identifies a suspect in the image captured when the crime occurs,
The collation apparatus according to claim 9, further comprising a friend extraction unit that extracts a friend on the system of the suspect identified by the collation unit. A position information acquisition unit that acquires position information indicating a position of a user registered in the system;
When the collation unit determines that the target person shown in the person image is registered in the system, based on the position information acquired by the position information acquisition unit, the user registered in the system A similar user extraction unit that extracts users who are in the same facility as the target person and have similar attributes to the target person,
With
The collation apparatus according to claim 9, wherein the information transmission unit notifies the target person of the similar user extracted by the similar user extraction unit. A collation unit that collates a human image stored in an image storage device with an image stored in advance in a specific system and identifies a person shown in the human image, and a plurality of collation units from one human image An information transmitting unit that transmits information to the plurality of specified persons, and an acquisition unit that acquires the information transmitted by the verification device;
A display unit for displaying the information acquired by the acquisition unit;
A terminal device comprising: A procedure for a collation unit to collate a human image stored in the image storage device with an image stored in advance in a specific system to identify a person shown in the human image;
When the information transmitting unit specifies a plurality of persons from one person image by the matching unit, a procedure for transmitting information to the specified plurality of persons;
An information sharing method characterized by comprising: On the computer,
A collation step of collating a human image stored in the image storage device with an image stored in advance in a specific system and identifying a person shown in the human image;
When a plurality of persons are identified from one person image by the collating step, an information transmission step of transmitting information to the plurality of identified persons;
Information sharing program to execute.

Images