JP2013077110A - Server device, program and communication system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To support interchange on an SNS to provide a user with a chance to be connected to interchange in real society on the basis of an action of the user himself/herself in the real society.SOLUTION: Communication terminals 10-1 to 10-3 generate predetermined meta data corresponding to image data in photography of an image, and uploads the image data and the metadata to a server device at a linked state. The server device compares the updated image data with other pieces of already registered image data to specify other users who photograph similar images. User list information for displaying and selecting a list of the specified users in the communication terminals is generated, distributed to the communication terminals, and thus, a list of other users with matched hobbies and tastes is displayed, and recommended as friend candidates in the communication terminals.

Description

  The present invention relates to a server device, a program, and a communication system that provide a service that supports exchanges between persons in a virtual space constructed on the Internet.

  In recent years, with the development of network technology such as WWW (World Wide Web) and the progress of portable information communication terminal devices represented by smartphones and the like, social networking services (hereinafter abbreviated as “SNS”) are widely used. The number of users (hereinafter referred to as “users”) is increasing year by year.

  For example, in the virtual space on the WWW, the SNS includes information such as photographs, hobbies, diaries, workplaces, occupations, and residences (hereinafter, “user information”) And so on, soliciting friends, sharing information and sharing information among the gathered friends, and sharing various data such as moving images, still images, music or games. ing.

  In particular, since this SNS can complete the exchange in the virtual space, the exchange is actively performed even between users who are not acquainted with the real world, and the encounter of the virtual space can be realized. In many cases, so-called “off-line meetings” (off-line meetings) are held in order to develop exchanges.

  On the other hand, in addition to encounters in real society, for example, encounters at work, school, etc., encounters at various events such as parties, shows, hobby gatherings (hereinafter simply referred to as “events”), The number of cases where exchanges on SNS start is increasing.

  There is a difference between these two cases, the encounter on the SNS or the encounter in the real world, but in either case, the exchange in the virtual space and the exchange in the real world will eventually link (ie, There is a common point that virtual space and real-world interaction are connected.

  In particular, recently, a system has been proposed for recommending a product that matches each user's preference using the SNS characteristic that the user registers his / her user information (for example, Patent Document 1). ).

  For example, in addition to the profile information, this system acquires various information such as message exchange status with other users and user actions (for example, access status to various information and data) on the SNS. By this, it is configured to estimate a product that suits each user's preference and distribute an advertisement of the product. With such a configuration, the system distributes advertisements useful for the user and makes it possible to recommend products that meet the user's preference.

JP 2010-537323 A

  However, in the system disclosed in the above-mentioned Patent Document 1, although it is possible to provide information on products to users, it is not possible to support exchanges between users. It is difficult to satisfy the user's desire to establish the purpose of exchange or networking.

  Further, in such a system, the user's preference is estimated based only on the registration information on the network and the user's action (that is, the user's action in the virtual space). In many cases, information that does not necessarily match the user's intention is not recommended because the user's preference based on behavior in society is not recognized.

  The present invention has been made to solve the above-mentioned problems, and its purpose is to support the exchange on the SNS based on the behavior of the user himself / herself in the real world, to activate the exchange on the SNS, and to realize the real world It is to provide a server device or the like that can realize a service that can provide a user with an opportunity to connect to an exchange in the Internet.

  (1) In order to solve the above-described problem, the server device of the present invention is connected to a network and sends predetermined information to a plurality of communication terminal devices having at least photographing means for photographing an image via the network. A server device to provide, connection point identification information indicating a connection point on the network used when a communication line with the communication terminal device is established, and an image corresponding to an image photographed in the communication terminal device Data acquisition means for associating data and user identification information for uniquely identifying a user of the communication terminal apparatus, and acquiring the data from each communication terminal apparatus, the acquired image data, and the user identification information And a plurality of the connection point identification information recorded in association with each other, and recorded in the image database at a given timing Of the plurality of image data, the extraction means for extracting the image data having the same connection point identification information and the similarity between the extracted image data and the comparison target image data Image comparing means for generating similarity information indicating values, specifying means for specifying image data having a predetermined condition for the generated similarity information, and the image data associated with the specified image data List information generating means for generating user list information indicating a list of user identification information; user recommendation means for distributing the user list information to the communication terminal device of the user included in the generated user list information; , Has a configuration comprising.

  With this configuration, the server device of the present invention can acquire and record a plurality of data including connection point identification information, user identification information, and image data from the communication terminal device in association with each other. The image data satisfying a predetermined condition can be specified among the plurality of image data at a given timing.

  Usually, when a user of a communication terminal device is located in the same space or a surrounding space, there is a high possibility that the connection point identification information matches. Therefore, it is assumed that the image data associated with the matching connection point identification information is taken in the same or surrounding space. In general, when taking an image, the user shoots an object to be photographed that is interesting for him / her, so it is assumed that photographers of the same or similar images share a common hobby. The

  As described above, the server device of the present invention extracts the same image data taken in the surrounding space that is matched with the matching connection point identification information, and is the same as the extracted image data, or A photographer of similar image data can be specified.

  In other words, the server device of the present invention can reliably specify a user who has a taste or affinity from the similarity of image data, and generates user list information from user identification information corresponding to the specified user. Can be distributed to the user's communication terminal device included in the user list information. Therefore, the server device of the present invention specifies other users who have a taste or compatibility with the user based on the behavior of the user in the real world, and recommends it as a friend candidate to the user of the communication terminal device. Can do.

  As a result, in the real world, the server device of the present invention can surely find a user compatible with the user based on the image data taken by the user, and can start an exchange on the SNS. Based on the behavior of the user himself / herself in the real world, an exchange on the SNS can be activated and an opportunity to connect to the real world exchange can be provided to each user.

  (2) Moreover, the server apparatus of this invention is further comprised so that it may have the user management database in which the said user identification information and the user information which is the information regarding the said user are recorded at least.

  With this configuration, when the list information generating means generates the user list information, the server device of the present invention can include the user information in the user list information. Therefore, the communication terminal that has received the user list information. It is also possible to realize a function for displaying user information in the apparatus.

  (3) In the server device of the present invention, the user management database records the user identification information of other users registered under predetermined conditions for each user identification information as other user information. It has become the composition.

  With this configuration, the server device of the present invention can reliably specify, for example, other users who are registered as friends for each user, and can appropriately manage various types of information related to the users.

  (4) Further, the server device of the present invention associates (A) the image data with the comparison target when the image data having a predetermined condition for the similarity information is specified by the specifying unit. And (B) determining means for determining whether or not (B) the other user information registered in the user management database corresponding to the user identification information of (A) matches. The list information generating means is configured to generate the user list information based only on the user identification information of (A) determined to be inconsistent with the other user information of (B).

  With this configuration, when the list information generating unit generates the user list information, the server device of the present invention can exclude other user information corresponding to other users having a predetermined condition from the user list information. it can.

  Therefore, for example, the server device of the present invention can efficiently recommend only a user who is not registered as a friend by excluding a user who has already been registered as a friend from a recommendation target of a friend candidate.

  (5) Further, in the server device of the present invention, when the image data satisfying a predetermined condition is specified by the specifying unit, the list information generating unit performs the above processing on all the image data to be compared. The list information generating means is configured to change the user list information in accordance with the ratio of image data that satisfies the conditions.

  With this configuration, when the list information generating unit generates the user list information, the server device of the present invention can, for example, based on the user other than general image data that is photographed by more than half of the users. List information can be generated.

  For example, it is merely a symbolic or general photographing object that everyone is interested in, and has not yet expressed the hobbies and preferences of each user. Based on such image data, compatibility between users Alternatively, it is assumed that a hobby preference cannot be specified.

  Therefore, the server device of the present invention can generate user list information based on image data other than general images, and generates user list information by surely identifying only users who have a taste or affinity. It becomes possible.

  (6) Further, in the server device of the present invention, the data acquisition unit acquires date / time information indicating a shooting date / time together with the image data, and the extraction unit matches the connection point identification information, and The image data in which the shooting date and time specified by the date and time information falls within a predetermined time range is extracted.

  With this configuration, the server device of the present invention can generate similarity information between image data captured within a predetermined time, and can efficiently narrow down image data to be compared.

  (7) In order to solve the above-described problem, the program of the present invention provides predetermined information to a plurality of communication terminal devices that are connected to a network and have at least an image capturing unit that captures an image via the network. A connection point identification information indicating a connection point on the network used when a communication line with the communication terminal device is established, and an image taken by the communication terminal device. Corresponding image data and user identification information that uniquely identifies a user of the communication terminal device are acquired in association with each other from the communication terminal device, data acquisition means, the acquired image data, and the user Recording control means for recording a plurality of identification information and the connection point identification information in the image database in association with each other, at a given timing Extracting means for extracting image data having the same connection point identification information from among the plurality of image data recorded in the image database, and comparing the extracted image data with each other for comparison Image comparison means for generating similarity information indicating values of similarity to data, specifying means for specifying image data having a predetermined condition for the generated similarity information, corresponding to the specified image data A list information generating means for generating user list information indicating a list of the attached user identification information, and distributing the user list information to the communication terminal device of the user included in the generated user list information The user recommendation means is configured to function as a user recommendation means.

  Therefore, the program of the present invention can surely find a user who is compatible with the user based on the image data taken in the real world, and can start an exchange on the SNS. Based on the behavior of the user himself / herself, the exchange on the SNS can be activated and an opportunity to connect to the exchange in the real society can be provided to each user.

  (8) In order to solve the above-described problem, a communication system according to the present invention includes a network, a plurality of communication terminal devices that perform communication via the network, and a predetermined number of the communication terminal devices via the network. And the communication terminal device is a connection point identification information indicating a connection point on the network used when performing communication via the network and a photographing unit that generates image data. And the user identification information that uniquely identifies the user of the communication terminal device, the attached information generating means that generates at least the attached information, the image data, and the attached information are associated with each other and transmitted to the server device. And the server device records the image data transmitted by the communication terminal device and the attached information in association with each other. Image data that matches the connection point identification information among the plurality of image data recorded in the image database at a given timing, and compares the extracted image data with each other Then, image comparison means for generating similarity information each indicating a value of similarity with the image data to be compared, and image data having a predetermined condition with respect to the generated similarity information Identification means, list information generation means for generating user list information indicating a list of the user identification information associated with the specified image data, and the communication terminal of the user included in the generated user list information And a user recommendation unit that distributes the user list information to the apparatus.

  Therefore, the communication system of the present invention can surely find a user who is compatible with the user based on the image data taken by himself / herself in the real world, and can start an exchange on the SNS. Based on the behavior of the user himself / herself in society, it is possible to provide each user with an opportunity to activate exchange on the SNS and lead to exchange in the real world.

  The present invention can support the exchange on the SNS based on the behavior of the user himself / herself in the real world and provide the user with an opportunity to connect to the real world exchange.

1 is a system configuration diagram showing a configuration of a communication system in an embodiment of the present invention. It is a conceptual diagram which shows the operation | movement outline | summary of the communication system in one Embodiment. It is a figure which shows an example of the image displayed on a communication terminal device based on user list information in one Embodiment. It is a block diagram which shows the structure of the communication terminal device in one Embodiment. It is a conceptual diagram which shows notionally the data recording state of the image data recording part of the communication terminal device in one Embodiment. It is a block diagram which shows the structure of the server apparatus in one Embodiment. It is a figure which shows an example of the data recorded on the SNS user management database in the server apparatus in one Embodiment. It is a figure which shows an example of the data recorded on the image data management database in the server apparatus in one Embodiment. It is a flowchart (the 1) which shows each process performed in the communication terminal device and server apparatus of this embodiment of one embodiment. It is a flowchart (the 2) which shows each process performed in the communication terminal device and server apparatus of this embodiment of one embodiment. It is a figure for demonstrating the process in the case of calculating a similarity value using the pattern matching in one Embodiment. It is a figure explaining the process in the case of calculating a similarity value using the color space vector based on the difference between the images in one Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following embodiments, a server device, a program, and a communication system according to the present invention are applied to a communication system having a communication terminal device and a server device connected to the communication terminal device via a network. This is an embodiment.

[1] Configuration and Overview of Communication System First, the configuration and overview of the communication system 1 in the present embodiment will be described with reference to FIGS. 1 and 2.

  FIG. 1 is a system configuration diagram showing a configuration of the communication system 1 in the present embodiment, and FIG. 2 is a conceptual diagram showing an operation outline of the communication system 1 in the first embodiment. Further, in order to prevent the figure from becoming complicated, only some users are shown in FIGS. 1 and 2. That is, in the actual communication system 1, there are more communication terminal devices than displayed. 1 and 2, PE is an event venue (hereinafter referred to as “event venue”), and an imaging target OB is an object that is imaged by a user in the event venue PE. It is shown.

  The communication system 1 of the present embodiment specifies other users who have a hobby preference with the user based on the actual behavior of each user (that is, a registered user of SNS) located in the event venue PE. This is a system for supporting the exchange on the SNS between users and the exchange in the real world by recommending the identified user as a friend candidate on the SNS.

  In other words, the communication system 1 can provide each user of the SNS with information on other users whose hobbies and preferences are compatible with each other (in other words, compatible with each other). It is a system that can create opportunities to expand friendships. And the communication system 1 performs the application (friend application) etc. as a friend in SNS between the said users about the user who collided via SNS after event in the event venue PE, It is a system that can start an exchange on SNS or in the real world.

  Note that the friend application is an action for applying for an exchange start in the SNS, and since the SNS function itself including the friend application function is well known, description thereof is omitted.

  Specifically, as shown in FIG. 1, the communication system 1 according to the present embodiment includes a plurality of communication terminal devices 10, a network 20, and communication terminal devices 10 possessed by a user who is visiting the event venue PE. A server device 30 that generates and distributes a list of recommended friend candidates as user list information based on the provided image data, and a wireless LAN (Local Area Network) laid in the event venue PE and connected to the network 20 ) Access point (hereinafter abbreviated as “AP”) 50.

  Note that the network 20 is configured by interconnecting a public telephone line network and an IP (Internet Protocol) network, for example. However, the configuration of the network 20 is not limited to this.

  In the communication system 1 according to the present embodiment, the event venue PE usually exists indoors, and the communication terminal device 10 cannot be connected to the public mobile phone network or is difficult to connect. The structure which interconnects is adopted.

  The communication terminal device 10 is, for example, a digital camera having a communication function, a tablet information terminal device, a smartphone, a mobile phone, or the like, and at least a still image (hereinafter simply referred to as “image”) photographing function (hereinafter simply referred to as “image”). This is a communication terminal device having a “camera function”) and portable by a user.

  In addition, the communication terminal device 10 includes resource data for the WWW system described in a markup language such as XML (extensible Markup Language), and a unique URL (Uniform Resource Locator) indicating a network address of the resource data. And a browsing function for performing data communication with the server device 30.

  Then, the communication terminal device 10 displays the content corresponding to the data based on the XML data received from the server device 30 using the browsing function, and communicates with the server device 30 via the AP 50 and the network 20. However, the server device 30 is configured to receive SNS service provision.

  For example, as shown in FIG. 2, the communication terminal device 10 connects to the AP 50 in the event venue PE via a wireless communication line and accesses the server device 30 via the AP 50 based on a user operation. However, it is configured so that login to the SNS can be executed. Then, when the communication terminal device 10 captures the photographing target OB that matches the user's own hobbies and preferences while maintaining the login state to the SNS based on the user operation, the photographing is performed at a given timing. The image data corresponding to the captured image is uploaded to the server device 30 via the AP 50 and the network 20, and is registered (recorded) in the server device 30.

  In the present embodiment, the upload timing of image data is arbitrary, and is normally uploaded immediately after shooting. However, it is not limited to this timing.

  Further, when uploading the image data to the server device 30, the communication terminal device 10 generates predetermined metadata in the image data, and executes the upload while associating the metadata with the image data. Thus, image data and metadata can be registered in the server device 30 in association with each other.

The metadata includes at least (1) a wirelessly connected AP 50 such as Bssid (Basic Service Set Identifier) or MAC address (Media Access Control Address) at the time of image data generation (that is, at the time of shooting). Connection point identification information for identification;
(2) Information assigned by the server device 30 when the user of the communication terminal device 10 performs SNS use registration, and user identification information for uniquely identifying the user on the SNS (hereinafter referred to as “user”) ID ”).
(3) shooting date and time information indicating the shooting date and time of the image;
Is included.

  Whether or not the shooting date / time information is included in the metadata is arbitrary, but in the present embodiment, it is assumed that the information (1) to (3) are all included in the metadata. I do.

  Then, for example, as illustrated in FIG. 3, the communication terminal device 10 may include information on a list of other users with a hobby preference that are generated by the server device 30 based on image data and metadata registered by uploading ( (Hereinafter referred to as “user list information” or “user list”) and can be displayed as a friend candidate so as to be viewable.

  In addition, when the communication terminal device 10 receives a selection of another user who desires to start exchange from the recommended user list through the user operation, the communication terminal device 10 described above with respect to the server device 30. A request message corresponding to the friend application that has been made is transmitted, and the exchange can be started on the SNS.

  The request message uses, for example, a GET method used in HTTP (Hypertext Transfer Protocol) or FTP (File Transfer Protocol).

  The server device 30 is a computer system connected to the network 20 and is configured to be able to provide SNS services to users of the communication terminal devices 10.

  The server device 30 compares the image data uploaded from the communication terminal device 10 with other image data that has already been registered, identifies other users who have taken similar images, and identifies the identified user. The communication terminal device 10 generates user list information for display and selection, and distributes the list to the communication terminal device 10.

  That is, the server device 30 according to the present embodiment compares the uploaded image data with other image data that has already been registered, generates user list information based on the comparison result, and suits each user with hobbies and preferences. Other users can be specified, and is configured to realize a function for supporting exchanges between users on the SNS (hereinafter referred to as “exchange support function”).

  In particular, the server device 30 of the present embodiment includes an SNS user management database (hereinafter, “database” is abbreviated as “DB”) for managing SNS users, image data uploaded by the communication terminal device 10, and The image data management DB is used to associate and register metadata.

  And the server apparatus 30 implement | achieves the said exchange assistance function based on the data corresponding to the various information registered into these DB.

[2] Configuration of Communication Terminal Device Next, the configuration of each communication terminal device 10 according to the present embodiment will be described with reference to FIGS. 4 and 5. 4 is a block diagram showing the configuration of the communication terminal apparatus 10 in the present embodiment, and FIG. 5 is a conceptual diagram conceptually showing the data recording state of the image data recording unit 102 provided in the recording unit 100. It is.

  As illustrated in FIG. 4, the communication terminal device 10 according to the present embodiment includes a recording unit 100, a network communication unit 110, a connection point identification information detection unit 120, a metadata generation unit 130, a display unit 140, and a display. It has a control unit 150, a timer 160 for specifying the current date and time, an operation unit 170, an imaging / image data generation unit 180, and a terminal management control unit 190.

  The above-described units are connected to each other by a bus B, and data transfer is performed between the components.

  The recording unit 100 includes, for example, a hard disk drive (hereinafter abbreviated as “HDD”), or a nonvolatile flash memory such as a NAND type or a NOR type. The recording unit 100 also includes a RAM (Random Access Memory) and a ROM (Read Only Memory) as work areas in the metadata generation unit 130, the imaging / image data generation unit 180, and the terminal management control unit 190.

  The recording unit 100 includes at least an application recording unit 101, an image data recording unit 102, and an SNS usage management data recording unit 103.

  The application recording unit 101 includes various applications including application programs (hereinafter referred to as “applications”) executed by the terminal management control unit 190 in conjunction with the metadata generation unit 130 and the imaging / image data generation unit 180. And a browser for realizing the browsing function are also recorded.

  As illustrated in FIG. 5, the image data recording unit 102 records image data captured by the communication terminal device 10 and metadata corresponding to each image data in association with each other.

  FIG. 5 shows a state in which image data “0001” obtained by photographing flowers and image data “0002” obtained by photographing cakes are recorded, and metadata corresponding to each image data is illustrated. .

  This metadata is taken in the vicinity of the AP 50 identified by the user identified by the user ID “taro” and the connection point identification information “Bssid101”. Information indicating that the image is taken, and information indicating the date and time of each image.

  The SNS usage management data recording unit 103 records various types of management data required when the user of the communication terminal device 10 receives SNS service provision. In particular, as described above, in the present embodiment, when the user visits the event venue PE, the SNS is logged in. At this login, the communication terminal device 10 is connected from the server device 30. A user ID corresponding to the user of the own device is acquired. The user ID acquired at this time is recorded in the SNS usage management data recording unit 103.

  In addition to the user ID, the SNS usage management data recording unit 103 includes, for example, a URL corresponding to the SNS site of each user, an e-mail address used by the user, and the user ID. And a login password for an account corresponding to. However, if these are not recorded, the user needs to input a login password or the like necessary for the login to the operation unit 170 when logging in to the SNS.

  The network communication unit 110 establishes a wireless communication channel with the AP 50 according to a communication standard compliant with the AP 50, and exchanges various data with the server device 30 via the network 20.

  The connection point identification information detection unit 120 detects the connection point identification information for identifying the AP 50 wirelessly connected by the network communication unit 110 and supplies the detected connection point identification information to the metadata generation unit 130.

  The operation unit 170 includes various confirmation buttons, operation buttons for inputting each operation command, a number of keys such as a numeric keypad, and a touch panel, and is used when performing each operation.

  The imaging / image data generation unit 180 is based on an optical system, a CCDI sensor (Charge Coupled Device Image Sensor) that converts an optical image input from the optical system into an electrical signal, and an electrical signal generated by the CCDI sensor. A generating unit that generates image data.

  The timer 160 is used to specify the current date and time, generates shooting date / time information indicating the date and time corresponding to the imaging timing by the imaging / image data generation unit 180, and provides it to the metadata generation unit 130.

  The metadata generation unit 130, when an image is captured, the connection point identification information supplied from the connection point identification information detection unit 120, the user ID recorded in the SNS usage management data recording unit 103, and the timer 160. 5 generates metadata as illustrated in FIG. However, the timing for generating the metadata is basically at the time of imaging, but may be other timing.

  The display unit 140 is configured by, for example, a panel of a liquid crystal element or an organic EL (Electro Luminescence) element, and displays a predetermined image based on display data generated by the display control unit 150.

  The display control unit 150 generates display data necessary for display on the display unit 140, and outputs the generated display data to the display unit 140.

  The terminal management control unit 190 is mainly configured by a central processing unit (CPU) and includes various input / output ports such as a key input port and a display control port, and stores various applications recorded in the application recording unit 101. By executing, overall functions of the communication terminal device 10 are controlled.

  In particular, the terminal management control unit 190 reads out an imaging application from the application recording unit 101 based on a user operation input via the operation unit 170 and captures an image (hereinafter referred to as “imaging processing”). A process of uploading the captured image to the server device 30 (hereinafter referred to as “upload process”) is executed.

  Specifically, the terminal management control unit 190 performs a predetermined area while interlocking with the imaging / image data generation unit 180 based on a user instruction input to the operation unit 170 when executing the imaging application. The image capturing process is performed to generate image data, and the image capturing process is performed to generate metadata in conjunction with the metadata generation unit 130. And the terminal management control part 190 performs the upload process which uploads the imaged image to the server apparatus 30 with the metadata produced | generated as data, interlock | cooperating with the server apparatus 30. FIG.

  Details of imaging processing and upload processing by the imaging application of this embodiment will be described later.

[3] Configuration of Server Device Next, the configuration of the server device 30 according to the present embodiment will be described with reference to FIGS. FIG. 6 is a block diagram showing the configuration of the server device 30 of this embodiment, and FIG. 7 is a diagram showing an example of data recorded in the SNS user management DB 331 in the server device 30 of this embodiment. is there. FIG. 8 is a diagram illustrating an example of data recorded in the image data management DB 332 in the server device 30 according to the present embodiment.

  As illustrated in FIG. 6, the server device 30 of the present embodiment includes a communication control unit 310, a ROM / RAM 320, a recording device 330, and a server management control unit 340.

  The above-described units are connected to each other by a bus B, and data transfer is performed between the components.

  The communication control unit 310 is a predetermined network interface, establishes a communication line with the communication terminal device 10, and exchanges various data.

  Various programs necessary for driving the server device 30 are recorded in the ROM / RAM 320. The ROM / RAM 320 is used as a work area when various processes are executed.

  The recording device 330 is configured by an HDD, and an SNS user management DB 331 and an image data management DB 332 are constructed in the recording area.

The SNS user management DB 331 is a DB having various data for SNS usage registration and storing various information for managing each user as data. For example, in the SNS user management DB 331, as shown in FIG.
(1) a user ID corresponding to each user;
(2) a user ID corresponding to a user who has already been registered as a friend of the user specified by the user ID;
(3) user information of the user;
Are recorded in association with each other.

  Specifically, in the case of the example shown in FIG. 7, three users specified by user IDs “jiro”, “hanako”, and “shiro” are friends as users specified by the user ID “taro”. Registered and recorded as user information of “the user (ie,“ taro ”) in association with data“ taro's profile ”.

  Similarly, two users “yosho” and “michiko” are registered as friends for the user specified by the user ID “hanako”, and data “hanako's profile” is stored as user information. Are recorded in association with each other.

  In the SNS user management DB 331, the number of user IDs of users registered as friends also increases or decreases in accordance with the increase or decrease of users registered as friends.

  The image data management DB 332 is a DB for managing the image data to be imaged captured by the communication terminal device 10 at the event venue PE and the metadata uploaded together with the image data in association with each other.

For example, in the image data management DB 332, as shown in FIG.
(1) An image ID assigned to each image data to identify the image data;
(2) image data body;
(3) Metadata corresponding to the image data is recorded in association with each other.

  Note that the metadata includes the connection point identification information, the user ID, and the shooting date / time information as described above.

  The server management control unit 340 is mainly configured by a central processing unit (CPU). In particular, the server management control unit 340 executes the program to perform integrated control of each unit of the server device 30, and also includes management of the SNS service provision and management and control of the recording device 330. Manages image data and metadata uploaded from.

  Specifically, the server management control unit 340 is associated with the recording device 330 for management of image data and metadata for management of SNS service provision and management of image data and the like. Based on the login request from 10, each user's login to the SNS is performed, and a user ID is transmitted to each communication terminal device 10. Then, the server management control unit 340 performs processing for realizing the exchange support function based on the image data and metadata uploaded from the communication terminal device 10 in conjunction with the recording device 330.

  In particular, the server management control unit 340 includes, as processing for realizing the AC support function, each uploaded image data and image data captured within a predetermined period, and has already been image data management DB 332. Are compared with the metadata in the registered image data, and image data including connection point identification information that matches the connection point identification information is extracted. Then, the server management control unit 340 calculates the similarity by comparing the image data associated with the extracted metadata with the uploaded image data, and sets the calculated similarity to a predetermined threshold. The user ID that captured the image data exceeding is specified. In addition, the server management control unit 340 lists the identified user IDs (that is, user list information) and distributes the target image data to the communication terminal device 10 that uploaded the target image data.

  In the present embodiment, the server management control unit 340 should recommend other users already registered as friends on the SNS as user list information in order to simplify the process and prevent useless recommendation. Exclude from friend candidates. That is, the server management control unit 340 uses the similarity for image data associated with metadata including a user ID already registered as a friend in the SNS user management DB 331 among the metadata extracted in the SNS. It is comprised so that it may exclude from comparison object.

[4] Operations of Communication Terminal Device and Server Device Next, imaging processing and upload processing executed by the communication terminal device 10 in the present embodiment in conjunction with the server device 30 will be described with reference to FIGS. 9 and 10. To do. 9 and 10 are flowcharts showing each process executed in the communication terminal device 10 and the server device 30 of the present embodiment.

  Each process executed in the communication terminal device 10 is executed at the event venue PE, and the communication terminal device 10 receives the connection point identification information transmitted from the AP 50 from the network communication unit 110. It shall be. In addition, the server device 30 executes each process while interlocking with the communication terminal device 10.

  First, in the communication terminal device 10, when the terminal management control unit 190 detects an imaging application activation instruction via the operation unit 170 (step S101), the terminal management control unit 190 reads and activates the imaging application from the application recording unit 101 (step S102). ). At this time, the terminal management control unit 190 executes work memory initialization and other necessary processing.

  Next, when the connection point identification information detection unit 120 detects the reception of the connection point identification information (step S103), the terminal management control unit 190 displays the login instruction to the SNS by the user, and the input is input to the operation unit 170. It waits for execution (step S104).

  Next, when the terminal management control unit 190 detects a login instruction to the SNS based on a user operation on the operation unit 170 (step S111), the terminal management control unit 190 reads the browser from the application recording unit 101 and requests the server device 30 to log in. Is performed (step S112).

  At this time, the terminal management control unit 190 interlocks with the operation unit 170 and the display control unit 150 to access the server device 30 and accept input of information necessary for various logins such as a login password for logging in to the SNS. . In addition, after making this login request, the terminal management control unit 190 shifts to a state of waiting for data reception from the server device.

  On the other hand, in the server device 30, when the server management control unit 340 receives a login request via the communication control unit 310 (step S200), the server management control unit 340 searches the SNS user management DB 331 and reads the user ID of the login user (step S200). S201).

  Next, the server management control unit 340 transmits the read user ID to the communication terminal device 10 (step S202), and shifts to a data reception standby state.

  At this time, when the network communication unit 110 receives the user ID in the communication terminal device 10 (step S113), the terminal management control unit 190 records the received user ID in the SNS usage management data recording unit 103 (step S114). .

  Next, the terminal management control unit 190 executes an imaging process in cooperation with the metadata generation unit 130 and the imaging / image data generation unit 180 based on a user operation on the operation unit 170 (step S115). Specifically, the imaging / image data generation unit 180 generates image data in accordance with a shooting instruction input to the operation unit 170, and the metadata generation unit 130 includes the connection point identification information detected in step S103, a timer, and the like. Metadata is generated based on the shooting date / time information acquired from 160 and the user ID recorded in the SNS usage management data recording unit 103.

  Next, the terminal management control unit 190 shifts to a state of waiting for the user's upload instruction input to the operation unit 170 to be executed, and when detecting the instruction input (step S116), the image data generated in the imaging process Then, the metadata is uploaded to the server device 30 in the associated state (step S117). The terminal management control unit 190 shifts to a reception standby state for user list information distributed from the server device 30.

  Next, in the server device 30, when the server management control unit 340 detects upload of image data and metadata (step S 203), the received image data and metadata are registered in the image data management DB 332, thereby managing the image data management. The DB 332 is updated (step S204).

  Next, the server management control unit 340 expands the received metadata and image data on the RAM of the ROM / RAM 320 (step S210).

  Next, the server management control unit 340 searches the image data management DB 332 based on the developed metadata, and identifies the image data recorded in association with the predetermined metadata as the comparison target image data (step). S211). Specifically, the server management control unit 340 matches the developed metadata with the connection point identification information among the metadata already registered in the image data management DB 332, and displays the information by the shooting date / time information. The metadata whose shooting date and time is within a predetermined time range is specified, the image ID associated with the specified metadata is read, and the image data corresponding to the image ID is used as comparison target image data Identify.

  Next, the server management control unit 340 extracts the user ID from the metadata developed on the RAM, and excludes the image data satisfying a predetermined condition from the comparison target image data based on the extracted user ID (step). S212). Specifically, the server management control unit 340 reads a user ID (that is, other user information) registered as a friend on the SNS or the real space in association with the user ID extracted from the SNS user management DB 331, and the user Image data associated with the metadata including the ID is excluded from the comparison target.

  Next, the server management control unit 340 compares the uploaded image data with each of the identified image data, and generates similarity information indicating the similarity S between the two (step S214). At this time, the server management control unit 340 determines the similarity S using a color space vector based on pattern matching or a difference between images. Details of the similarity calculation processing in the server management control unit 340 in the present embodiment will be described later.

  Next, the server management control unit 340 specifies image data for which the similarity S has a predetermined condition, for example, the similarity S is equal to or greater than a predetermined threshold. (Step S214).

  Next, the server management control unit 340 determines whether the image data expanded on the RAM is a general image based on the specified image data (step S215), and determines that the image data is not a general image. Shifts to the process of step S216, and if it is determined that the image is a general image, the process shifts to the process of step S217.

  In the process of step S215, the server management control unit 340, specifically, the ratio of the number of image data “B” determined to be larger than a predetermined threshold to the number of comparison target image data “A”. (Ie, “B / A”) is calculated, and when “B / A” is 0.5 or more, it is determined as a general image, and when “B / A” is smaller than 0.5, The image is determined not to be a general image but to reflect the user's preference.

  That is, when “B / A” is 0.5 or more, more than half of the users are shooting the same or similar shooting target OB, and the image data expanded on the RAM is the user. It can be determined that the user's taste is not expressed, that is, it is a general image, and if not, it can be determined that the user's preference is reflected instead of the general image It has become.

  Next, the server management control unit 340 generates user list information from the extracted user ID while extracting the user ID from the metadata associated with the image data having the similarity S equal to or greater than the threshold (step S216). .

  Next, when the user list information is generated, the server management control unit 340 transmits the user list information to the communication terminal apparatus 10 that uploaded the image data, and when the user list information is not generated. Transmits a message to that effect to the communication terminal device 10 (step S217), and ends this operation.

  Next, in the communication terminal device 10, when the network communication unit 110 receives that the user list information or the user list information has not been generated (step S121), the terminal management control unit 190 receives the received user list information or user list information. Is displayed on the display unit 140 (step S122).

  At this time, when receiving the user list information, the terminal management control unit 190 displays an image as shown in FIG. 3 on the display unit 140 by using the browser function, and interlocks with the operation unit 170. The request for friend application can be transmitted to the server device 30.

  Finally, the terminal management control unit 190 determines whether or not to continue imaging based on the operation of the operation unit 170 (step S123). If it is determined that imaging is to be continued, the terminal management control unit 190 proceeds to the process of step S115 and performs imaging. If it is determined not to continue, that is, it is determined that the imaging has been completed, this operation is terminated.

[5] Similarity Information Generation Processing Next, a method for generating similarity S and similarity information in step S213 in FIG. 10 will be described with reference to FIGS. FIG. 11 is a diagram showing a processing image when using pattern matching, and FIG. 12 is a diagram showing a processing image when using a color space vector based on the difference between images.

  In the pattern matching of the present embodiment, as shown in FIGS. 11A and 11B, two image data to be compared are compared, and the similarity is calculated. Specifically, the pattern matching process of the present embodiment is performed by shifting the comparison target image and the comparison target image while shifting the comparison target image by a plurality of blocks on one comparison target image (comparison source image). The correlation value in the image is calculated. Then, a mean square value, a simple average value, or a simple sum value of the calculated correlation values is calculated, and a value obtained as a result of this calculation is used as the similarity S.

  For example, in FIG. 11A, when the comparison source image and the comparison destination image are not similar (match), the comparison destination image is shifted by a plurality of blocks on the comparison source image. Even if is calculated, a high correlation value cannot be obtained in any block, and the similarity S becomes low and does not exceed a predetermined threshold value. On the other hand, in FIG. 11B, when the comparison source image and the comparison destination image are similar (match), the comparison destination image is shifted by a plurality of blocks on the comparison source image. When calculated, since a high correlation value can be obtained in a block where the images match, the similarity S becomes high and becomes equal to or greater than a predetermined threshold value. As a result, in the case of FIG. 11B, it can be determined that the comparison source image and the comparison destination image are similar.

  In the present embodiment, a color space vector may be used instead of pattern matching. In the color space vector of the present embodiment, as shown in FIG. 12, while representing the pixel array 500 of image data with a vector matrix 510, the vector distance between image data to be compared is represented for each pixel using the vector matrix. Calculate to

  Usually, the image data can be displayed as a vector matrix for each pixel unit. Therefore, in the color space vector of the present embodiment, for this image-displayed image data, as shown in FIG. 12, a vector distance 520 between the image data to be compared is calculated for each pixel based on the Pythagorean theorem. Then, the average value or the total value of the calculated vector distances is used as the similarity S.

  In addition, the calculation method of the similarity S of this embodiment is not limited to the above. As other methods. For example, H.M. As in H.264, the difference value for each block is calculated for each object in the image, and DCT (Discrete Cosine Transform) or DFT (Discrete Fourier Transform) is performed to calculate the difference value and motion vector between the images. It is also possible to use the calculation result as the similarity S.

  As described above, in the communication system 1 according to the present embodiment, the hobby preference or other compatible user is specified according to the similarity of the image data photographed at the event site PE in the real society, and the specified user is identified. The user list information is distributed to the communication terminal device 10. Moreover, since the friend application in SNS can be performed based on this user list information, based on the user's behavior in the real society, other hobbies or other compatible users are specified, and the user of the communication terminal device is identified. It can be recommended as a friend candidate, and exchange support between persons in the virtual space and the real society can be performed.

  In the present embodiment, user list information for finally applying for a friend is abolished, but it is not essential to apply for a friend.

  Further, in the present embodiment, the case where image data similarity determination is performed at the time of image data upload is illustrated, but the timing of similarity determination is not limited thereto. For example, the similarity determination may be performed after a predetermined number or more of image data has been uploaded.

  In the present embodiment, the date / time information is included in the metadata, but even if there is no date / time information, a similar function can be realized based only on the user ID and the connection point identification information.

DESCRIPTION OF SYMBOLS 1 ... Communication system 10 ... Communication terminal device 30 ... Server apparatus 100 ... Recording part 101 ... Application recording part 102 ... Image data recording part 103 ... SNS utilization management data recording part 110 ... Network communication part 120 ... Connection point identification information detection part 130 ... Metadata generation unit 140 ... Display unit 150 ... Display control unit 160 ... Timer 170 ... Operation unit 180 ... Imaging / image data generation unit 190 ... Terminal management control unit 310 ... Communication control unit 330 ... Recording device 331 ... SNS user management DB
332 ... Image data management DB
340 ... Server management control unit

Claims (8)

A server device that is connected to a network and provides predetermined information to a plurality of communication terminal devices having at least an image capturing unit that captures an image via the network,
Connection point identification information indicating a connection point on the network used when a communication line with the communication terminal device is established, image data corresponding to an image photographed in the communication terminal device, and the communication terminal device Data acquisition means for associating and acquiring user identification information for uniquely identifying a user from each of the communication terminal devices;
An image database in which the acquired image data, the user identification information, and the connection point identification information are recorded in association with each other;
Extraction means for extracting image data having the same connection point identification information from among the plurality of image data recorded in the image database at a given timing;
Image comparison means for comparing each of the extracted image data to generate similarity information indicating a similarity value with the image data to be compared;
A specifying means for specifying image data having a predetermined condition for the generated similarity information;
List information generating means for generating user list information indicating a list of the user identification information associated with the identified image data;
User recommendation means for distributing the user list information to the communication terminal device of the user included in the generated user list information;
A server device comprising: The server device according to claim 1,
A server apparatus further comprising: a user management database in which at least user identification information and user information that is information about the user are recorded. The server device according to claim 2,
The server apparatus in which the user identification information of other users registered under a predetermined condition for each user identification information is recorded in the user management database as other user information. The server device according to claim 3,
When image data having a predetermined condition for the similarity information is specified by the specifying unit,
(1) user identification information associated with the image data to be compared;
(2) The apparatus further includes a determination unit that determines whether or not the other user information registered in the user management database corresponding to the user identification information of (1) matches.
The server apparatus in which the list information generating unit generates the user list information based only on the user identification information of (1) determined to be inconsistent with the other user information of (2). In the server apparatus in any one of Claims 1 thru | or 4,
When image data having a predetermined condition is specified by the specifying means,
The server apparatus in which the list information generation unit changes the user list information in accordance with a ratio of image data that satisfies the condition with respect to all image data to be compared. In the server apparatus in any one of Claims 1 thru | or 5,
The data acquisition means acquires date and time information indicating a shooting date and time together with the image data,
The server device, wherein the extraction unit extracts the image data in which the connection point identification information matches and the shooting date and time specified by the date and time information falls within a predetermined time range. A computer device mounted on a server device that provides predetermined information to a plurality of communication terminal devices connected to a network and having at least a photographing unit that captures an image via the network,
Connection point identification information indicating a connection point on the network used when a communication line with the communication terminal device is established, image data corresponding to an image photographed in the communication terminal device, and the communication terminal device Data acquisition means for associating and acquiring user identification information for uniquely identifying a user from each of the communication terminal devices;
Recording control means for recording a plurality of the acquired image data, the user identification information, and the connection point identification information in an image database in association with each other,
Extracting means for extracting image data having the same connection point identification information from the plurality of image data recorded in the image database at a given timing;
Image comparison means for comparing each of the extracted image data to generate similarity information indicating a value of similarity with the image data to be compared;
Specifying means for specifying image data having a predetermined condition for the generated similarity information;
List information generating means for generating user list information indicating a list of the user identification information associated with the specified image data, and the communication terminal device of the user included in the generated user list information , User recommendation means for distributing the user list information,
A program characterized by functioning as A communication system comprising a network, a plurality of communication terminal devices that perform communication via the network, and a server device that provides predetermined information to the plurality of communication terminal devices via the network,
The communication terminal device
Photographing means for generating image data;
Generating attachment information including at least connection point identification information indicating a connection point on the network used when performing communication via the network, user identification information uniquely identifying a user of the communication terminal device, and An information generating means, a transmitting means for associating the image data and the attached information with each other, and transmitting to the server device;
Have
The server device
An image database that records the image data transmitted by the communication terminal device and the attached information in association with each other;
Of the plurality of image data recorded in the image database at a given timing, image data having the same connection point identification information is extracted, and each of the extracted image data is compared and compared. Image comparison means for generating similarity information respectively indicating similarity values with the image data,
A specifying means for specifying image data having a predetermined condition for the generated similarity information;
List information generating means for generating user list information indicating a list of the user identification information associated with the specified image data;
User recommendation means for distributing the user list information to the communication terminal device of the user included in the generated user list information;
A communication system comprising: