JP6225494B2 - Information processing server, information processing system, and information processing method - Google Patents

Description

  The technology of the present disclosure relates to an information processing server, an information processing system, and an information processing method used when publishing content on a network.

  2. Description of the Related Art Conventionally, with the increase in content published on a network such as the Internet, infringement of copyright and privacy by content on the network has become a problem. For example, Patent Document 1 proposes a method for finding illegally copied content from content published on a network.

JP 2005-332273 A

  By the way, the content causing the infringement on the network is not limited to the content illegally copied. In a posting site such as a social networking service (SNS), content posted by a user is posted on a web page. As a result, for example, when a user posts a photograph taken by himself / herself on a posting site, the third party image accidentally reflected in the photograph is released on the network regardless of the intention of the third party, Can violate the privacy of the person. Therefore, it is necessary to appropriately protect the information included in the content posted by the user.

  An object of the technology of the present disclosure is to provide an information processing server, an information processing system, and an information processing method capable of suppressing disclosure of information that is not suitable for disclosure included in posted content. .

One aspect of the information processing server in the techniques of this disclosure, an information processing server connected via a web server and a network for publishing content posted by the user terminal, permit the release of information contained in content A storage unit that stores a first publication condition as a publication condition that is a condition to be received, an image that is a content that is subject to publication determination, and a reception unit that receives the second publication condition as the publication condition; A determination unit that determines whether or not a person's face can be disclosed as information included in the content received by the reception unit based on the first disclosure condition and the second disclosure condition; and the reception unit receives with the transmission unit that transmits the information allowed by said determining unit to the web server of the information included in the content and the first public conditions, Oh by the content Among the faces of a person included in an image, a condition for publishing the face of the user who sets the disclosure condition is disclosed. The second disclosure condition is an image that is the content posted by the user who sets the disclosure condition. Is a condition for publicizing faces other than the user among the faces of the persons included in .

According to the information processing server, it is determined whether or not the information included in the content can be disclosed, and as a result of the determination, information permitted to be disclosed is transmitted to the web server that publishes the content. Therefore, it is possible to suppress the disclosure of information that is not suitable for publication included in the posted content. Further, the determination by the determination unit is performed using two release conditions, that is, the first release condition stored in the storage unit and the second release condition set for the content to be determined. Therefore, since the conditions for permitting the disclosure of the information included in the content are determined by the two disclosure conditions, the degree of freedom regarding the setting of the disclosure conditions is increased.

  According to one aspect of the information processing server in the technology of the present disclosure, the transmission unit makes the information determined not to be permitted to be private when the determination unit determines that the information is not permitted to be disclosed. Processing is performed on the content received by the receiving unit, and the processed content is transmitted to the web server.

  According to the information processing server, when the content is processed, information that is not suitable for publication included in the content is not disclosed, so that it is possible to appropriately suppress the disclosure of information that is not suitable for publication. . In addition, since the content processing is performed by the information processing server, the amount of communication required for content transmission and processing part instruction is suppressed as compared to the case where the content processing is performed by a device different from the information processing server. Content can be processed efficiently.

  One aspect of the information processing server in the technology of the present disclosure is that the content is an image, and the transmission unit is not permitted to disclose the image when the determination unit determines that the information is not permitted to be disclosed. The image that has been determined to be unpublished is processed on the image, and the processed image is transmitted to the web server.

  According to the information processing server, information that is not suitable for publication is partially processed by processing an image that is content, so that it is possible to prevent information included in the content from being excessively disclosed.

In one aspect of the information processing server in the technology of the present disclosure, the disclosure condition is stored in the storage unit in association with identification information assigned for each user.
According to the information processing server, the disclosure condition can be set for each user, so that the degree of freedom regarding the setting of the disclosure condition is increased.

One aspect of the information processing server in the techniques of this disclosure, the front term memory unit, and the face data of the first disclosure condition and the user is stored in association with the identification information assigned to each user, the A face recognizing unit that identifies the face data corresponding to the face included in the image and identifies the identification information associated with the identified face data; and the determination unit includes the second disclosure condition The first disclosure condition associated with the identification information specified by the face recognition unit for the face determined to be permitted to be released after determining whether or not the face included in the image is disclosed using determines whether publication of the face by using the transmission unit, the public face included in the image based on the first public conditions or the second disclosure condition by the determining unit is not authorized If judged, the previous The processing of the a determined face portion said public in the image is not permitted to privately subjected to the image, and transmits the image to the processing is applied to the web server.

  According to the information processing server, whether or not the face included in the image can be disclosed is determined based on the disclosure condition associated with the identification information of the user corresponding to the face included in the image. Then, when it is determined that disclosure of the face included in the image is not permitted, the face portion in the image is not disclosed. Therefore, for each face included in the image, whether or not disclosure is possible is determined and processed, so that it is possible to appropriately suppress the disclosure of a face that is not suitable for disclosure. As a result, it is also possible to protect rights related to personal faces such as privacy.

In one aspect of the information processing server in the technology of the present disclosure, the disclosure condition includes a condition regarding a target to which the content is disclosed.
According to the information processing server, conditions for permitting disclosure of information included in content can be appropriately set.

In one aspect of the information processing server in the technology of the present disclosure, the disclosure condition includes a condition related to a standard value of data in the content.
According to the information processing server, conditions for permitting disclosure of information included in content can be appropriately set.

One aspect of the information processing system in the technology of the present disclosure is an information processing system including a web server that publishes content posted from a user terminal, and an information processing server connected to the web server via a network. the information processing server includes a storage unit for storing the first public conditions as the disclosure conditions is a condition for permitting the release of information contained in the content, and the image is content to be published determination, the A receiving unit that receives a second disclosure condition as a disclosure condition, and whether or not a person's face can be disclosed as information included in the content received by the reception unit is determined based on the first disclosure condition and the second disclosure condition. wherein the determination unit based on the disclosure condition, the information allowed by said determining unit of the information which the receiving unit is included in the content received web server And a transmission unit for transmitting the first public conditions, among the face of a person included in the a content image, a condition that exposes the face of the user himself for setting the disclosure condition, the first The disclosure condition of 2 is a condition for exposing a face other than the user among the faces of persons included in the image that is the content posted by the user who sets the disclosure condition, and the web server Publish the content received from the server.

One aspect of the information processing method in the technology of the present disclosure is an information processing method performed using a web server that publishes content posted from a user terminal, and an information processing server connected to the web server via a network. The first publication condition and the second publication condition are used as the publication conditions that allow the publication of the information contained in the content , and are included in the image that is the content that is subject to publication determination. A step of determining whether or not a person's face as information can be disclosed, and a step of performing a process of making information determined to be unpublishable as a result of the determination undisclosed on the content that is subject to the disclosure determination When the look-containing a step of publishing a work is subjected content and the first public conditions, a person included in an image which is the content Among the faces, a condition for publishing the face of the user who sets the publishing condition is disclosed. The second publishing condition is a face of a person included in the image that is the content posted by the user who sets the publishing condition. Among these, the condition for exposing faces other than the user is disclosed .

  According to the information processing system and the information processing method, it is determined whether or not the information included in the content can be disclosed. As a result of the determination, the information permitted to be disclosed is disclosed by the web server. Therefore, it is possible to suppress the disclosure of information that is not suitable for publication included in the posted content.

  According to the technique of the present disclosure, it is possible to suppress the disclosure of information that is not suitable for publication included in the posted content.

It is a system configuration figure showing the composition of the information processing server in one embodiment in the art of this indication, and the information distribution system containing an information processing server. It is a figure which shows an example of the others public conditions in one Embodiment. It is a figure which shows the structure of the public condition data registered into the public condition database in one Embodiment. It is a sequence diagram which shows the procedure of registration with face recognition data and disclosure condition data in the information processing system of one embodiment. It is a sequence diagram which shows the procedure by which content is published on the posting site in the information processing system of one embodiment. It is a flowchart which shows the process sequence of the open determination by the information processing server in one Embodiment. In one embodiment, it is a figure which shows an example of the image before the protection process by an information processing server is performed. In an embodiment, it is a figure showing an example of an image after protection processing by an information processing server was performed.

An embodiment of an information processing server, an information processing system, and an information processing method will be described with reference to FIGS.
With reference to FIG. 1, the configuration of an information processing system and the configuration of an information processing server included in the information processing system will be described.

  As shown in FIG. 1, the information processing system includes an information processing server 10, a user terminal 20, a posting site server 30, and a signature server 40. The information processing server 10, the user terminal 20, the posting site server 30, and the signature server 40 transmit and receive data to and from each other via a network NW such as the Internet.

  The user terminal 20 is a terminal such as a smartphone or a personal computer. In response to a user operation, the user terminal 20 posts content such as text and images to the posting site server 30.

  The posting site server 30 is a web server that provides a posting site that is a member-based website such as a miniblog or SNS. The posting site includes a web page for each user who is a member. The content posted from the user terminal 20 is posted on the web page.

  A user who is a member of the posting site is assigned a member ID, which is user identification information, for each user. When the authentication information such as the member ID and password is input to the posting site server 30, the posting site server 30 authenticates the user as a member. The authenticated user can receive services provided by the posting site server 30 such as browsing the posting site and posting content. In the following, of the functions of the posting site server 30, functions related to content posting will be described.

The posting site server 30 includes a data processing unit 31 that performs processing of posting from the user terminal 20 and a data storage unit 32 that stores data of posted content.
The data processing unit 31 accepts content posting from the user terminal 20. When the content posted from the user terminal 20 includes an image, the data processing unit 31 requests the information processing server 10 to perform image protection processing. When the image protected by the information processing server 10 is transmitted from the information processing server 10 to the posting site server 30, the data processing unit 31 stores the content including the protected image in the data storage unit 32. Post on the posting site. As a result, the protected image is released on the network. If the content does not include an image, the data processing unit 31 posts the content on the posting site without requesting the information processing server 10 for protection processing.

  The user can classify other users into categories such as “friends” and “company colleagues” on the posting site. In the posting site server 30, the attribute corresponding to the classified category is assigned to the member ID of the other user, and the member ID of the user who is the subject of the classification, and the member ID of the other user to which the attribute is assigned, Are associated.

  When posting the content, the user selects from among the above categories a disclosure range that is a range that includes the content to be disclosed, and inputs the selected range to the user terminal 20. The input disclosure range is transmitted from the user terminal 20 to the posting site server 30. For example, when the user A posts the content B, when “friend” is selected as the disclosure range, only the user classified into the “friend” category by the user A can view the content B.

  In addition, when posting an image as content, the user inputs other person disclosure conditions, which are conditions for disclosing the face portion of a person other than himself / herself included in the image, to the user terminal 20. The entered other person disclosure conditions are transmitted from the user terminal 20 to the posting site server 30.

  The data storage unit 32 includes a first image database 32a and a second image database 32b. The first image database 32a stores images that have not been processed as a result of the protection processing by the information processing server 10. The second image database 32b stores images processed as a result of the protection processing by the information processing server 10. The first image database 32a is more secure than the second image database 32b.

  The information processing server 10 includes a communication unit 11, a storage unit 12, and a control unit 13. The communication unit 11 executes connection processing between the information processing server 10 and a connection destination device. In addition, the communication unit 11 transmits and receives data to and from a device that is a connection destination.

The storage unit 12 stores a face recognition database 12a and a disclosure condition database 12b.
In the face recognition database 12a, face recognition data in which a member ID and face data are associated is registered. The member ID is a member ID of a posting site provided by the posting site server 30. The face data is data used for recognizing a person's face included in an image requested to be protected by the posting site server 30 and is based on the front, back, left, and right photographs of each user. The face data may be the user's photograph itself, or may be data obtained by digitizing the facial features extracted from the user's photograph. In short, the face data may be any data that can be used for face recognition. In the face recognition data, each member ID is associated with the face data of the user to whom each member ID is assigned.

  In the public condition database 12b, public condition data in which a member ID is associated with a self public condition is registered. The self-publishing condition is a condition for publishing the face portion of the user himself / herself included in the image posted to the posting site server 30. In the disclosure condition data, each member ID is associated with the self-disclosure condition of the user to whom each member ID is assigned.

The control unit 13 includes a registration unit 13a, a face recognition unit 13b, a determination unit 13c, and a processing unit 13d.
The registration unit 13 a registers face recognition data in the face recognition database 12 a of the storage unit 12 based on the user photograph received by the information processing server 10. Further, the registration unit 13 a registers the disclosure condition data in the disclosure condition database 12 b of the storage unit 12 based on the self disclosure condition received by the information processing server 10.

  The face recognition unit 13b performs face recognition of a person included in an image requested for protection processing from the posting site server 30 using face data registered in the face recognition database 12a. The face recognition unit 13b identifies a member ID corresponding to the recognized person based on the face recognition database 12a.

  Based on the disclosure condition database 12b, the determination unit 13c identifies the self-disclosure condition associated with the member ID identified by the face recognition unit 13b. Then, the determination unit 13c determines whether the image for which the protection process is requested from the posting site server 30 satisfies the specified self-disclosure condition and the other person's disclosure condition set when the image is posted. I do.

The processing unit 13d processes an image by blurring a face portion of a person who does not satisfy the disclosure condition for the image determined by the determination unit 13c that the disclosure condition is not satisfied.
The signature server 40 encrypts a photo used for the face data and performs a signature. The signed data is transmitted from the user terminal 20 to the information processing server 10 together with the self-publication condition and the member ID. The information processing server 10 decrypts the data transmitted from the user terminal 20 using the public key transmitted from the signature server 40, confirms that the sender of the photograph is the user, and discloses the face recognition data and the information. Condition data is registered in the storage unit 12.

  The disclosure conditions will be described with reference to FIGS. FIG. 2 is a diagram illustrating an example of other person disclosure conditions, and FIG. 3 is a diagram illustrating an example of a data configuration of disclosure condition data in the disclosure condition database 12b.

  As shown in FIG. 2, the other person disclosure condition includes items of disclosure range, disclosure availability, image size, number of pixels, and data size. In the other person disclosure condition, a condition for exposing the face portion of the other person who is a person other than the user who is the setting subject is set for each category that can be set as the disclosure range.

  In the item “open / close”, any of “permitted”, “impossible”, and “conditional” is set. “Permitted” indicates that disclosure of the face portion of another person is permitted. “No” indicates that disclosure of the face portion of another person is not permitted. “Conditional” indicates that disclosure of the face portion of the other person is permitted when the image satisfies a predetermined condition. This condition is set in the items of image size, number of pixels, and data size.

  For example, in the other person disclosure condition Da shown in FIG. 2, the disclosure permission / inhibition is set to “permitted” for the category of “friend”. That is, in an image in which the disclosure range is set to “friend”, disclosure of the face portion of another person is permitted.

  In addition, in the other person disclosure condition Da, for the category “company colleague”, the availability of disclosure is set to “conditional”, the image size is set to “500 in or less”, and the number of pixels is set to “300 dpi or less”. The data size is set to “1 GB or less”. In other words, in the case of an image in which the disclosure range is set to “company colleague”, the image size is “500 in or less”, the number of pixels is “300 dpi or less”, and the data size is “1 GB or less”. Is allowed to reveal the face of others.

  In addition, for the “out of range” in the above category, the availability of disclosure is set to “impossible”. In other words, when an image is disclosed to all users, and when users who are not included in the scope of “friends” and “company colleagues” are included in the image disclosure target, disclosure of the face part of others is permitted. Absent.

  In addition, when multiple categories are set as the disclosure range of an image, and these multiple categories include categories that are permitted to be published and categories that are not permitted to be published, disclosure of the face part of others is not permitted. . In addition, when the disclosure permission / prohibition is “conditional”, the conditions used to determine whether the disclosure is permitted or not need only be set for at least one of the image size, the number of pixels, and the data size. The same condition may be set for all categories that can be set as the disclosure range.

  As shown in FIG. 3, in the public condition data Db, the member ID and the self public condition are associated with each other. The self-disclosure condition is composed of items of disclosure range, disclosure availability, image size, number of pixels, data size, and necessity of contact. In the self-disclosure condition, a condition for disclosing the face part of the user who is the main subject of setting is set for each category that can be set as the disclosure range.

  In the item “open / close”, any of “permitted”, “impossible”, and “conditional” is set. “Yes” indicates that disclosure of the face portion of the user himself / herself is permitted. “No” indicates that disclosure of the face portion of the user himself / herself is not permitted. “Conditional” indicates that disclosure of the face portion of the user himself / herself is permitted when a predetermined condition is satisfied. This condition is set in the items of image size, number of pixels, data size, and necessity of contact. The item of necessity of communication indicates whether or not a notification for confirming whether or not the face part can be disclosed to the user is necessary when the image does not satisfy the conditions of the image size, the number of pixels, and the data size.

  For example, in the disclosure condition data Db shown in FIG. 3, in the self-disclosure condition associated with the member ID “A1486”, disclosure permission / inhibition is set to “permitted” for the category of “friend”. . That is, when the image disclosure range is included in the range of the “friend” category set by the user corresponding to the member ID “A1486”, disclosure of the face portion of the user corresponding to the member ID is permitted. The

  Further, in the self-publication condition associated with the member ID “A1486”, for the category of “classmate”, whether or not to disclose is set to “conditional”, and the image size is set to “10 in or less”, The number of pixels and the data size are set to “all range acceptable”, and the necessity of communication is set to “necessary”. That is, when the image disclosure range is included in the category range of “classmate” set by the user corresponding to the member ID “A1486”, when the image size is within the range of “10 in or less”, Release of the user's face corresponding to the member ID is permitted. When the image size is out of the range of “10 in or less”, the user corresponding to the member ID is notified to confirm whether the image can be disclosed. If the user's permission is obtained as a result of the notification, disclosure of the user's face corresponding to the member ID is permitted. On the other hand, when the user's permission cannot be obtained as a result of the notification, the disclosure of the user's face corresponding to the member ID is not permitted. The notification is performed using a method such as e-mail or notification on a posting site.

  In addition, in the self-publication condition associated with the member ID “A1486”, for the “acquaintance” category, the availability of disclosure is set to “conditional”, the image size is set to “20 in or less”, and The number of pixels is set to “100 dpi or less”, the data size is set to “50 MB or less”, and the necessity of contact is set to “No”. That is, when the disclosure range of the image is included in the “acquaintance” category range set by the user corresponding to the member ID “A1486”, the image size is “20 in or less” and the number of pixels is “100 dpi”. Below "and when the data size is within the range of" 50 MB or less ", disclosure of the user's face corresponding to the member ID is permitted. When the image size, the number of pixels, and the data size are out of the above ranges, disclosure of the user's face corresponding to the member ID is not permitted. At this time, the user corresponding to the member ID is not notified to confirm whether the image can be disclosed.

  In addition, in the self-publication condition associated with the member ID “A1486”, the availability of disclosure is set to “impossible” for “out of range” in the above category. That is, when a user who is not included in the range of “friend”, “classmate”, and “acquaintance” is included in the image disclosure target, disclosure of the user's face corresponding to the member ID is not permitted.

  Also, in the self-publication condition associated with the member ID “A3782”, whether or not to disclose is set to “conditional” for the public range of “all range”, and the image size, the number of pixels, and the data size are “All range not possible” is set and “Need to contact” is set to “Required”. That is, for all the images to be disclosed, regardless of the image size, the number of pixels, and the data size, a notification corresponding to whether the image can be disclosed is sent to the user corresponding to the member ID. If the user's permission corresponding to the member ID is obtained as a result of the notification, disclosure of the user's face corresponding to the member ID is permitted. On the other hand, if the user's permission corresponding to the member ID is not obtained as a result of the notification, disclosure of the user's face corresponding to the member ID is not permitted.

  In addition, in the self-publication condition associated with the member ID “C5007”, the disclosure permission / prohibition is set to “permitted” for the disclosure range “all ranges”. In other words, the disclosure of the face portion of the user corresponding to the member ID is permitted for all the images to be disclosed.

  In the public condition database 12b, in addition to the public condition data, an unregistered public condition indicating a condition for publicizing a face part of a person for which no self public condition is registered is registered. The unregistered release condition has the same items as the self-release condition. For example, in the unregistered disclosure condition, when the disclosure possibility of “all range” is set to “impossible”, the disclosure of the face portion of the person whose self disclosure condition is not registered is not permitted.

A procedure for registering face recognition data and disclosure condition data will be described with reference to FIG.
As shown in FIG. 4, the user's own photo data and member ID are transmitted from the user terminal 20 to the signature server 40, for example, by the user's operation guided at the posting site (step S10). As the user's own photograph, a photograph taken of the user from the four directions of front, rear, left and right is used.

  When the signature server 40 receives the photo data and the member ID, the signature server 40 encrypts the photo data and the hash value of the photo data using the secret key that the signature server 40 has. Thereby, the signature is executed (step S11). The signature server 40 transmits the public key corresponding to the secret key obtained by encrypting the photo data and the hash value, and the member ID received from the user terminal 20 to the information processing server 10 (step S12). Further, the signature server 40 transmits a certificate including the encrypted photo data and the hash value to the user terminal 20 (step S13).

  When the information processing server 10 receives the public key and the member ID, the information processing server 10 stores the public key in the storage unit 12 in association with the member ID (step S14). The user terminal 20 transmits the certificate received from the signature server 40, the self-publication condition input by the user, and the member ID to the information processing server 10 (step S15).

  The information processing server 10 decrypts the certificate photo data and the hash value received from the user terminal 20 by using the public key stored in association with the member ID received from the user terminal 20 (step). S16). At this time, the information processing server 10 verifies the photograph data and the hash value to confirm that the sender of the photograph data is the user himself and that the photograph data has not been tampered with. As a result, it is possible to prevent other people from impersonating the user and transmitting the photo data, and the security for registering the face recognition data and the disclosure condition data can be increased.

  The registration unit 13a of the information processing server 10 registers the face data based on the decrypted photo data in the face recognition database 12a in association with the member ID received from the user terminal 20. Also, the registration unit 13a registers the self-public condition received from the user terminal 20 and the member ID in the public condition database 12b in association with each other (step S17). Thereby, the face recognition database 12a and the disclosure condition database 12b are constructed.

  With reference to FIG. 5 and FIG. 6, a procedure for publishing content on a posting site when an image is posted as content will be described. Note that when the content includes data other than the image in addition to the image, the processing in the information processing server 10 is performed only on the image data. In the following, a user who posts content is a posting user, and a user other than the posting user is a browsing user.

  As shown in FIG. 5, for example, by the operation of the posting user according to the instruction at the posting site, the image data, the other person disclosure conditions and the image disclosure input by the posting user from the user terminal 20 to the posting site server 30. The range and the member ID of the posting user are transmitted (step S20). The others disclosure condition may be set every time an image is posted, or a preset condition may be used for posting all images. As a result, an image as content is posted from the user terminal 20 to the posting site server 30.

  When the posting site server 30 receives the image data, the others disclosure conditions, the disclosure range, and the member ID, the posting site server 30 transmits these data to the information processing server 10 and requests the information processing server 10 for image protection processing. (Step S21).

  When the information processing server 10 receives the protection processing request, the image data, the other person's disclosure conditions, the disclosure range, and the member ID, the face recognition unit 13b of the information processing server 10 uses the face recognition database 12a. , Perform face recognition processing. In the face recognition process, the face recognition unit 13b recognizes a face included in the image and specifies face data in the face recognition database 12a corresponding to the recognized face. And the face recognition part 13b specifies member ID matched with the specified face data in the face recognition database 12a. The face recognition unit 13b extracts a member ID received by the information processing server 10 from the identified member IDs, that is, a member ID that is different from the posting user's member ID. Thereby, the member ID of the browsing user corresponding to the face included in the image is specified (step S22).

  When the face recognition unit 13b specifies the member ID of the browsing user, the determination unit 13c specifies the self-publication condition associated with the specified member ID in the public condition database 12b. The determination unit 13c determines whether or not disclosure of the face part included in the image is permitted using the other person disclosure conditions received by the information processing server 10 and the specified self disclosure conditions (step S23). .

  The information processing server 10 processes the image data according to the determination result of the determination unit 13c. As a result of the determination by the determination unit 13c, if the image includes a face part that is not permitted to be disclosed, the processing unit 13d performs a process of blurring the face part that is not permitted to be disclosed in the image. Then, the image data processed by the processing unit 13d and the member ID are transmitted from the information processing server 10 to the posting site server 30. As a result of the determination by the determination unit 13c, if the image does not include a face part that is not permitted to be published, the image data and the member ID are transmitted from the information processing server 10 to the posting site server 30 without being processed by the processing unit 13d. (Step S24).

  In addition, when the face of the person is not included in the image, that is, when the face recognition unit 13b cannot recognize the face, the processing unit 13d is not processed, and the image data and the member ID are processed by the information processing server. 10 to the posting site server 30.

  When the posting site server 30 receives the image data and the member ID from the information processing server 10, the posting site server 30 posts the image on the web page of the user corresponding to the member ID. At this time, when the image data is not processed by the processing unit 13d, the posting site server 30 stores the image data in the first image database 32a. When the image data is processed by the processing unit 13d, the posting site server 30 stores the image data in the second image database 32b (step S25). As a result, the image protected by the information processing server 10 is released on the network.

  With reference to FIG. 6, the process procedure of the open determination performed by the determination unit 13c of the information processing server 10 in step S23 of FIG. 5 will be described. The flow shown in FIG. 6 is performed for each of the self-publication conditions associated with the browsing user's member ID specified by the face recognition unit 13b. Below, the case where determination is performed using the self-publication conditions matched with the member ID of the browsing user C is demonstrated.

  In the process of step S30, based on the other person disclosure conditions and the disclosure range received by the information processing server 10, it is determined whether or not the disclosure of the face portion other than the posting user included in the image is permitted. If disclosure of the face part other than the posting user is permitted (YES in step S30), the process proceeds to step S31. When the face part other than the posting user is not permitted to be released (NO in step S30), the process proceeds to step S38, and the face part recognized as the viewing user C is assumed to be not permitted to be revealed. A command to perform processing is issued to the processing unit 13d, and the processing ends.

  In the process of step S31, in the self-publication condition associated with the member ID of the browsing user C, the disclosure range that is the target of the determination of the process after step S32 is specified. The narrowest category including all browsing users included in the disclosure range received by the information processing server 10 among the categories in the disclosure range item in the self-disclosure condition is set as the disclosure range to be determined.

  In the process of step S32, it is determined whether or not there is a limitation on the disclosure for the disclosure range specified in step S31. When there is a restriction on publication, that is, when publication permission / inhibition is set to “conditional” or “no” (YES in step S32), the process proceeds to step S33. If there is no restriction on disclosure, that is, whether disclosure is permitted or not is set to “permitted” (NO in step S32), the processing unit 13d is instructed to disclose the facial part of the browsing user C is permitted to be disclosed. The process ends without issuing.

  In the process of step S33, it is determined whether or not the disclosure possibility is “conditional” for the disclosure range specified in step S31. If the disclosure is “conditional” (YES in step S33), the process proceeds to step S34. If the disclosure permission is “NO” (NO in step S33), the process proceeds to step S38, a command to process the face portion recognized as the browsing user C is issued to the processing unit 13d, and the process ends. .

  In the process of step S34, it is determined whether or not the image is out of the setting range with respect to the items related to the standard value of the data in the self-publication condition, that is, the items of the image size, the number of pixels, and the data size. If the image is out of the setting range (YES in step S34), the process proceeds to step S35. If the image data is within the set range (NO in step S34), the process ends without issuing a processing command to processing unit 13d.

  In the process of step S35, as a result of the process of step S34, it is determined whether or not the viewing user C needs to be notified of whether or not the face part can be disclosed. If notification is necessary, that is, if the item “necessity of contact” in the self-publishing condition is “necessary” (YES in step S35), the process proceeds to step S36, and the browsing user C is notified of confirmation of whether or not disclosure is possible. Done. When the notification is not required, that is, when the item “necessity of contact” in the self-publication condition is “no” (NO in step S35), the process proceeds to step S38, and the face portion recognized as the browsing user C A command to perform processing is issued to the processing unit 13d, and the processing ends.

  In the process of step S37, it is determined as a result of the notification in step S36 whether or not the viewing user C's face part is not permitted to be disclosed. If the publication is not permitted (YES in step S37), the process proceeds to step S38, a command for processing the face portion recognized as the browsing user C is issued to the processing unit 13d, and the process ends. If disclosure is permitted (NO in step S37), the processing ends without a processing command being issued to processing unit 13d.

  When the member ID of the viewing user corresponding to the face included in the image cannot be specified, that is, when the face data corresponding to the face included in the image is not registered in the face recognition database 12a, the determination unit 13c Judgment is performed using unregistered disclosure conditions instead of disclosure conditions.

  The operation of this embodiment will be described with reference to FIGS. FIG. 7 shows an example of an image before the protection processing by the information processing server 10 is performed, and FIG. 8 shows an example of an image after the protection processing by the information processing server 10 is performed.

  In the image Ia shown in FIG. 7, the faces of four people, the person D, the person E, the person F, and the person G, are shown. Here, the person D is a posting user who has posted the image Ia to the posting site server 30. Also, the person D sets the other person disclosure condition Da shown in FIG. 2 as the other person disclosure condition for the image Ia, sets the disclosure range for the image Ia to “friend”, and posts the image Ia. Post to site server 30.

  Further, the disclosure condition data Db shown in FIG. 3 is registered in the disclosure condition database 12b of the information processing server 10. In the unregistered disclosure condition of the disclosure condition database 12b, the disclosure permission / inhibition is set to “impossible” for the disclosure range of “all range”.

  Further, the person E is a browsing user assigned with the member ID “A1486”, the person F is a browsing user assigned with the member ID “C5007”, and the person G has face data stored in the face recognition database 12a. The person is not registered. The browsing users included in the public range of “friends” set by the person D are categories “friends”, “classmates”, and “acquaintances” in the public range of the self-publication conditions associated with the member ID “A1486”. Not included.

  When the posting site server 30 requests the information processing server 10 to protect the image Ia, the face recognition process is performed on the image Ia by the face recognition unit 13b. Thereby, the member ID of the user corresponding to the faces of the person D, the person E, and the person F is specified. Of the identified member IDs, “A1486” and “C5007” are identified as the member IDs of the browsing users. Further, it is determined that the user member ID corresponding to the face of the person G is not registered. Therefore, the determination by the determination unit 13c is performed for the self-publication condition and the unregistered public condition associated with the member IDs “A1486” and “C5007”.

  In the others disclosure condition Da, the disclosure of the face portion of others in the image in which the disclosure range is set to “friend” is permitted. Then, under the self-publication condition associated with the member ID “A1486”, if the image disclosure range includes users who are not included in the categories of “friends”, “classmates”, and “acquaintances”, the user's face Partial disclosure is not permitted. Accordingly, disclosure of the face portion of the person E is not permitted.

  Further, under the self-publication condition associated with the member ID “C5007”, the public disclosure of the user's face portion is permitted for all images. Accordingly, disclosure of the face portion of the person F is permitted. Also, under unregistered disclosure conditions, disclosure of the user's face portion is not permitted for all images. Accordingly, disclosure of the face portion of the person G is not permitted.

  As a result of the determination by the determination unit 13c, the face portions of the person E and the person G are not permitted to be disclosed, so the processing unit 13d performs a blurring process on the face portions of the person E and the person G in the image Ia.

  As shown in FIG. 8, in the image Ib after the processing by the processing unit 13d, the face portions of the person E and the person G are blurred. Therefore, when the image Ib is posted on the posting site, the face portions of the person D and the person F are released, while the face portions of the person E and the person G are not released.

  As described above, according to the present embodiment, among the face parts included in the image, only the face part that satisfies the disclosure condition is disclosed, and thus it is possible to suppress the disclosure of information that is not suitable for publication included in the image. Can do.

  Further, among the disclosure conditions, the self-disclosure conditions accumulated in the information processing server 10 are conditions set by each user as a condition for disclosing the user's own face part. Therefore, it is possible to determine whether or not the face part of the browsing user other than the posting user included in the image can be disclosed by reflecting the intention of the browsing user. As a result, the browsing user's privacy is appropriately protected.

  In addition, among the disclosure conditions, the others disclosure condition transmitted together with the image data is a condition set by the posting user as a condition for exposing the face portion of a person other than the posting user included in the posted image. Therefore, it is possible to determine whether or not the face portion of a person other than the posting user included in the image can be disclosed by reflecting the intention of the posting user.

  As described above, the self-publication condition and the other person's public condition are used as the public conditions, so that the degree of freedom regarding the setting of the public conditions is increased and the image reflecting the intentions of both the posting user and the viewing user. It is possible to determine whether or not can be released.

In the present embodiment, the communication unit 11 functions as a reception unit, and the communication unit 11 and the processing unit 13d function as a transmission unit.
As described above, according to the present embodiment, the following effects can be obtained.

  (1) The information processing server 10 determines whether an image posted from the user terminal 20 satisfies the disclosure condition, and transmits image data including information permitted to be published to the posting site server 30. Therefore, it is possible to suppress the disclosure of information that is not suitable for publication included in the posted content.

  (2) Since the face part which is not permitted to be disclosed included in the image is not disclosed by processing the image, it is possible to appropriately suppress the disclosure of information unsuitable for disclosure. Further, since the image processing is performed by the information processing server 10, compared to the case where the image processing is performed by a device different from the information processing server 10, it is possible to transmit image data, instruct the processing portion, and the like. It is possible to efficiently process an image while reducing the amount of communication required.

(3) Since only the face portion that is not permitted to be disclosed included in the image, that is, only a part of the image, is processed, it is possible to prevent the information included in the image from being excessively disclosed.
(4) The self-publication condition is stored in association with the user's member ID. That is, since the self-disclosure condition is set for each user, the degree of freedom regarding the setting of the disclosure condition is increased.

  (5) Since it is determined whether or not the face portion of a person included in the image is open to the public, rights such as privacy can be protected with respect to the individual face. In addition, since each face included in the image is subjected to processing by determining whether or not it can be disclosed, it is possible to appropriately suppress the disclosure of a face that is not suitable for disclosure.

(6) Since the condition for permitting the face part to be disclosed is determined by the two disclosure conditions of the others disclosure condition and the self-disclosure condition, the degree of freedom regarding the setting of the disclosure condition is increased.
(7) Since the disclosure condition includes a condition related to an object to which the image is disclosed and a condition related to the standard value of the image data, the condition for permitting the disclosure of the face portion can be appropriately set.

The above embodiment can be implemented with the following modifications.
In the above embodiment, the protection process by the information processing server 10 is performed on the image posted from the user terminal 20 and before the posting site server 30 places it on the posting site. Instead of this, or in addition to this, an image posted from the user terminal 20 that has been posted on the posting site by the posting site server 30 is protected by the information processing server 10. It may be broken. That is, the image that is subject to disclosure determination may be an image before posting site server 30 posted on the posting site, or an image after posting site server 30 posted on the posting site.

  For example, the posting site server 30 may periodically request protection processing from the information processing server 10. Alternatively, when the information processing server 10 registers a new publishing condition or updates the registered publishing condition, the information processing server 10 notifies the posting site server 30, and based on this notification The posting site server 30 may request the information processing server 10 for protection processing.

  At this time, the posting site server 30 may request protection processing for all the images stored in the first image database 32a and the second image database 32b, or may request protection processing for some images. May be. When requesting a protection process for some images, the posting site server 30 may extract an image for which the protection process is requested by the posting time of the image, the image posting user, or the like, and the posting site server 30 may recognize the face. When the function is provided, the posting site server 30 may extract images including a person's face and request protection processing for these images. Alternatively, a predetermined publication condition may be stored in the posting site server 30, and a protection process may be requested for an image that does not satisfy the publication condition.

  When the posting site server 30 requests protection processing for an image after being posted on the posting site, the other person's disclosure condition set when the image is posted is used as the other person's disclosure condition. Alternatively, other person disclosure conditions common to all images may be used. Further, the other person disclosure condition may not be transmitted to the information processing server 10.

  According to such a configuration, when new disclosure conditions are registered or the registered disclosure conditions are updated, these disclosure conditions can be reflected in the disclosure of the face portion included in the image. Therefore, information suitable for publication is more appropriately selected.

In the above embodiment, the determination unit 13c performs the determination based on the self-disclosure condition when the disclosure is permitted under the other-person disclosure condition after the determination based on the other-person disclosure condition. The procedure is not limited to the above-described procedure. For example, the determination unit 13c may perform the determination based on the self-publication condition first, and may perform the determination based on the other person's public condition according to the determination result. Further, the determination unit 13c creates a determination disclosure condition to which the stricter condition among the disclosure conditions, that is, the condition where the disclosure is difficult to be permitted, is applied from the other person disclosure condition and the self disclosure condition. The determination may be made using the public disclosure conditions. In short, the determination unit 13c may perform the disclosure determination based on the others disclosure condition and the self disclosure condition.

-Other person disclosure conditions may not be set, and only the self disclosure conditions may be used for determination by the determination unit 13c.
-As a self-disclosure condition, the disclosure of the face part may be restricted by a condition common to all users. That is, the self-publication condition may not be set for each user in association with the user identification information.

-The determination part 13c may perform public determination about the self-publication conditions matched with all member IDs identified by face recognition also including a contribution user.
-Unregistered disclosure conditions may not be provided, and all face parts of persons whose face data is not registered in the face recognition database 12a may be disclosed.

  The items constituting the disclosure condition are not limited to the items listed in the above embodiment, and any item can be set. For example, in the other person disclosure conditions, it may be set to permit the disclosure of the face portion of the user himself / herself only for images posted from a specific posting user.

  -The face of the user himself / herself may be disclosed to the user himself / herself who has set the self-publication condition regardless of the content of the self-publication condition. In this case, image data processed by the processing unit 13d and image data not processed by the processing unit 13d are generated for each face portion determined by the determination unit 13c not to satisfy the self-publication condition. To the posting site server 30. At this time, the image data that has not been processed by the processing unit 13d is transmitted together with the member ID of the user corresponding to the face portion that is determined not to satisfy the self-publication condition in the image data but is not processed. The The posting site server 30 stores the image data and the member ID in association with each other, and when accessed from the member ID, the face portion of the user corresponding to the member ID associated with the member ID Display data composed of image data that has not been processed is transmitted to the user terminal 20.

  -The processing by the processing unit 13d is not limited to blur processing, but processing that makes the face part private, such as processing to put a mosaic in the face part of the image, or processing to hide the face part of the image with another image such as a mark, etc. That's fine.

-If the image includes a face part that is not permitted to be disclosed, the entire image may be made private.
The information processing server 10 may determine whether the content includes an image, that is, whether the content needs to be protected. In this case, the posting site server 30 transmits all posted content to the information processing server 10, and the information processing server 10 determines whether protection processing is necessary. Further, the protection process may be requested from the information processing server 10 only for an image for which the posting site server 30 has a face recognition function and the posting site server 30 determines to include a human face.

The image posted from the user terminal 20, other person disclosure conditions, disclosure range, and member ID may be sent directly to the information processing server 10 without going through the posting site server 30.
The information processing server 10 may not include the face recognition database 12a and the face recognition unit 13b, and the posting site server 30 may include the face recognition database 12a and the face recognition unit 13b to perform face recognition processing. In this case, the posting site server 30 identifies the member ID associated with the face data corresponding to the face included in the image, and notifies the information processing server 10 of the identified member ID.

  The information processing server 10 may not include the processing unit 13d, and the posting site server 30 may include the processing unit 13d to perform image processing. In this case, the posting site server 30 is notified of a face portion processing command that is determined not to be disclosed by the determination unit 13 c of the information processing server 10.

  The member ID used in the information processing server 10, that is, the member ID registered in the face recognition database 12a and the disclosure condition database 12b is set by the information processing server 10 as identification information different from the member ID of the posting site server 30. ID may be sufficient.

  -The function of the posting site provided by the posting site server 30 is not limited to the above-described function. For example, the posting site may not include a web page for each user, and may not have a function of classifying other users into categories or a function of specifying a content disclosure range. In short, the posting site may be a website that accepts posting of content from the user and publishes the posted content.

Photo data that has not been signed may be transmitted from the user terminal 20 to the information processing server 10. That is, the signature server 40 may be omitted.
The target for which the information processing server 10 determines whether or not to disclose is not limited to a human face. For example, any object that can be recognized by a known pattern recognition technique, such as characters and marks included in an image, can be determined.

  The content targeted for the protection process in the information processing server 10 is not limited to an image, and may be a sentence, a moving image, or a combination thereof.

  DESCRIPTION OF SYMBOLS 10 ... Information processing server, 11 ... Communication part, 12 ... Memory | storage part, 12a ... Face recognition database, 12b ... Disclosure condition database, 13 ... Control part, 13a ... Registration part, 13b ... Face recognition part, 13c ... Determination part, 13d ... Processing unit, 20 ... User terminal, 30 ... Posting site server, 31 ... Data processing unit, 32 ... Data storage unit, 31a ... First image database, 31b ... Second image database, 40 ... Signature server.

Claims (9)

An information processing server connected via a network to a web server that publishes content posted from a user terminal ,
A storage unit for storing a first publication condition as a publication condition that is a condition for permitting publication of information included in the content;
A receiving unit that receives an image that is a content to be disclosed and a second disclosure condition as the disclosure condition;
A determination unit that determines whether or not a person's face can be disclosed as information included in the content received by the reception unit based on the first disclosure condition and the second disclosure condition ;
A transmission unit that transmits information permitted by the determination unit to the web server among information included in the content received by the reception unit;
Equipped with a,
The first disclosure condition is a condition for publishing the face of the user who sets the disclosure condition among human faces included in the image that is the content,
The second public condition is a condition for publicizing a face other than the user among human faces included in an image that is the content posted by the user who sets the public condition.
Information processing server. Before SL in the storage unit, the face data of the first disclosure condition and the user associated with the identification information assigned to each user is stored,
A face recognition unit that identifies the face data corresponding to the face included in the image and identifies the identification information associated with the identified face data;
The determination unit determines whether the face included in the image can be disclosed using the second disclosure condition, and then identifies the identification information specified by the face recognition unit for a face determined to be permitted to be disclosed. determines whether publication of the face using the associated first public conditions,
The transmission unit permits the disclosure in the image when the determination unit determines that disclosure of a face included in the image is not permitted based on the first disclosure condition or the second disclosure condition. the face portion is determined not to be subjected to processing for private to the image, the information processing server according to claim 1 for transmitting image the processing is performed on the web server. When the determination unit determines that disclosure of information is not permitted, the transmission unit applies a process for making the information determined not to be permitted disclosure private to the content received by the reception unit. The information processing server according to claim 1, wherein the processed content is transmitted to the web server. When the determination unit determines that disclosure of information is not permitted, the transmission unit performs a process on the image to make a part of the image that is determined not to be permitted to be disclosed private. the information processing server according to claim 1 or 3 transmits an image in which the processing is applied to the web server. The first public conditions, the information processing server according to any one of claims 1, 3 and 4 in association with the identification information assigned to each user are stored in the storage unit. The disclosure condition is, the information processing server according to any one of claims 1 to 5 including the condition relating to the target which the content is published. The disclosure condition is, the information processing server according to any one of claims 1 to 6 including the condition relating to standard values of data in the content. An information processing system including a web server that publishes content posted from a user terminal, and an information processing server connected to the web server via a network,
The information processing server,
A storage unit for storing a first publication condition as a publication condition that is a condition for permitting publication of information included in the content;
A receiving unit that receives an image that is a content to be disclosed and a second disclosure condition as the disclosure condition;
A determination unit that determines whether or not a person's face can be disclosed as information included in the content received by the reception unit based on the first disclosure condition and the second disclosure condition ;
A transmission unit that transmits, to the web server, the information permitted by the determination unit among the information included in the content received by the reception unit;
The first disclosure condition is a condition for publishing the face of the user who sets the disclosure condition among human faces included in the image that is the content,
The second publishing condition is a condition for publishing a face other than the user among the faces of a person included in the image that is the content posted by the user who sets the publishing condition,
The web server publishes the content received from the information processing server. An information processing method performed using a web server that publishes content posted from a user terminal, and an information processing server connected to the web server via a network,
The person as the information included in the image that is the content that is the target of the release determination using the first release condition and the second release condition as the release conditions that allow the release of the information included in the content. Determining whether or not to reveal the face of
As a result of the determination, performing a process for unpublishing information determined to be unpublished on the content that is subject to the disclosure determination;
Publishing the processed content;
Only including,
The first release condition is that the public face is included in the face of a person included in the image that is the content.
It is a condition to disclose the face of the user who sets the opening condition,
The second public condition is a condition for publicizing a face other than the user among human faces included in an image that is the content posted by the user who sets the public condition.
Information processing method.

Images