JP2016066121A - Information processing device, imaging apparatus, and image disclosing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily set a disclosure range obtained by agreements between both of a discloser and a subject, when disclosing image data between users through a network.SOLUTION: An information processing device acquires first information indicating the disclosure permission range of an image associated with the subject photographed in the image and second information indicating the disclosure desire range of the image by the user requesting the disclosure of the image respectively. The information processing device determines the disclosure range which is the disclosure object of the image on the basis of the acquired first information and second information.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an information processing apparatus, an imaging apparatus, and an image disclosure system, and is particularly suitable for use in sharing an image among a plurality of users.

  In recent years, as the number of cameras connected to a network increases, cases in which images taken by cameras are shared and exchanged between users via an image sharing site or the like via the network are increasing. However, problems have arisen when publishing, such as publishing a photo without the subject's approval, or depending on the common sense / moral of the image publishing user. From the viewpoint of privacy protection, the intention of whether or not the subject can be disclosed must be reflected.

  Thus, there is a technique described in Patent Document 1 as a system for image disclosure that reflects the intention of whether or not a subject can be disclosed. In this technology, when publishing an image, an image processing is performed so as to inquire whether or not to publish a subject for each image taken from a user (public user) requesting publishing, and to protect the privacy of the subject according to the intention. (Mosaic processing, etc.).

JP 2007-18386 A

In the technique described in Patent Document 1, an image to be disclosed is simply presented from a public user to a subject and an inquiry is made as to whether or not to disclose the image. At this time, the subject cannot reply in consideration of the range that the public user desires to disclose (the desired range of disclosure). Therefore, the image may be disclosed to a person whose subject is not intended.
Further, the public user can obtain only whether or not each image is publicly available (OK / NG) from the subject, and cannot know the range that the subject permits to publish (public permission range). That is, the public user cannot know the reason why the image publication is NG (NG etc. because there is a person X). Therefore, even if the public user may change the desired disclosure range or edit the public image depending on the reason for the public NG of the subject, the image is not disclosed without making these adjustments. End up.

As described above, in the technique described in Patent Document 1, since it is not determined whether the disclosure is permitted or not in consideration of both the disclosure desired range of the disclosure user and the disclosure permission range of the subject, an appropriate disclosure range is set. I can't. In addition, it is impossible to find a compromise in setting the disclosure range, and the opportunity to publish many images is missed.
Therefore, an object of the present invention is to easily set a disclosure range corresponding to a user's desired disclosure range and a disclosure permission range associated with a subject when sharing an image.

  In order to solve the above-described problem, an aspect of the information processing apparatus according to the present invention provides a first acquisition for acquiring first information indicating a public permission range of an image associated with a subject captured in the image. Means, second acquisition means for acquiring second information indicating a desired disclosure range of the image by a user who requests the disclosure of the image, and the first information acquired by the first acquisition means, Determination means for determining a disclosure range to be disclosed of the image based on the second information acquired by the second acquisition means.

  Thus, since the disclosure permission range and the desired disclosure range are used, it is possible to determine the common range and the difference between the disclosure permission range and the desired disclosure range. Both the subject and the requester can agree because each group of users who request the disclosure of the subject and the image can collate with the group of candidates to be disclosed that they want to disclose. The published range can be determined.

  According to the present invention, when sharing an image, it is possible to easily set a disclosure range corresponding to a user's desired disclosure range and a disclosure permission range associated with a subject.

It is a system configuration figure showing an example of an image publicity system in a first embodiment. It is a functional block diagram of the information disclosure apparatus in a first embodiment. It is a sequence diagram which shows the exchange of the message between each apparatus. It is a figure which shows the example of imaging | photography subject person recognition. It is a flowchart which shows the information disclosure process procedure which an information disclosure process performs. It is an example of the public desire information of a public user. It is an example of the public permission information of a photographing subject. It is an example of the availability information. It is a flowchart which shows an adjustment process procedure. It is an example of the list display screen which shows the determination result of availability. It is an example of the detailed display screen which shows the determination result of availability. It is an example of a display after a release desired range change. It is an example of a display after a photographic subject change. It is an example of a display after extending the desired disclosure range. It is an example of a display when the publication desired information is not set. It is an example of a display after automatic setting of a public range. It is a display example when there is no openable range. It is the example which displayed the determination result in the live view of an imaging device. It is a system block diagram which shows an example of the image disclosure system in 2nd embodiment. It is a block block diagram of the information disclosure apparatus in 2nd embodiment. It is a figure which shows an example of the hardware constitutions of information processing apparatus.

DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments for carrying out the present invention will be described in detail with reference to the accompanying drawings.
The embodiment described below is an example as means for realizing the present invention, and should be appropriately modified or changed depending on the configuration and various conditions of the apparatus to which the present invention is applied. It is not limited to the embodiment.

(First embodiment)
FIG. 1 is a system configuration diagram illustrating an example of an image disclosure system according to the first embodiment.
The image disclosure system 10 includes a server device 20, an information disclosure device (information processing device) 30, and terminal devices 40A to 40C. Server device 20, information disclosure device 30, and terminal devices 40 </ b> A to 40 </ b> C are connected by network 50. Here, the network 50 can be realized by, for example, the Internet, a WAN (Wide Area Network), a LAN (Local Area Network), or a combination thereof.

  The server device 20 provides an image publishing service and an exchange service such as an online photo album and SNS (Social Networking Service). The server device 20 stores images that can be browsed by service users who use the image disclosure service, and registers and holds information (public permission information) indicating the disclosure permission ranges set by the service users. Yes. Here, the disclosure permission range is a disclosure permission range of an image associated with a subject, for example, a range in which a service user who can be a subject permits the disclosure of an image taken by himself / herself. The public permission range can be set for each user and for each group (friends, family members, business colleagues, etc.).

The information disclosure device 30 is a terminal device used by a disclosure requester (public user) who requests image disclosure, and makes a determination as to whether or not a captured image can be disclosed and requests the server device 20 to disclose a captured image. The public requester (public user) is, for example, an image photographer or an image owner.
The hardware of the information disclosure device 30 is realized by a computer system including a CPU, a ROM, a RAM, an HDD, and various interfaces. In the present embodiment, the information disclosure apparatus 30 is a personal computer (PC). The information disclosure device 30 may be an information device having a communication function, and may be a smartphone or a tablet PC (hereinafter simply referred to as “tablet”).

Further, the information disclosure apparatus 30 registers and holds information (public function information) indicating a desired disclosure range set by a public user. Here, the disclosure desired range is a range in which a public user desires to disclose an image, and can be set for each user and each group (friends, family members, company colleagues, etc.).
The terminal devices 40A to 40C are, for example, a smartphone, a tablet, and a PC, respectively, and are used by service users of the image disclosure service. These terminal devices 40 </ b> A to 40 </ b> C can browse (share) images published by the server device 20. These terminal devices 40A to 40C are used when the service user registers the public permission range. The terminal devices 40A to 40C may be any information device having a communication function.
FIG. 2 is a functional block diagram of the information disclosure apparatus 30.
The information disclosure apparatus 30 includes a photographing target recognition unit 31, a disclosure permission information acquisition unit 32, a disclosure request information acquisition unit 33, a disclosure range determination unit 34, a display control unit 35, an input information acquisition unit 36, and a disclosure. Unit 37.

The shooting target recognition unit 31 acquires shot image data and recognizes a subject (shooting target user) from the shot image data. For example, the photographing target recognition unit 31 acquires photographed image data from a digital camera or the like connected to a PC, and performs person recognition by collating with user information such as a face image of a service user registered in advance.
The user information may be acquired from the server device 20. In addition, the photographing target recognition unit 31 may recognize a photographing target user by acquiring a result (photographing target user information) obtained by performing person recognition processing with an external device (for example, a digital camera) from the external device. Alternatively, the photographing target user information input by the public user may be acquired.

The public permission information acquisition unit 32 acquires public permission information for each photographing target user recognized by the photographing target recognition unit 31 from the server device 20.
The disclosure request information acquisition unit 33 receives and stores input of disclosure request information from a disclosure user. The disclosure request information acquisition unit 33 may acquire the disclosure request information preset by the disclosure user and stored in the memory or the like in the information disclosure apparatus 30 from the memory.
The disclosure range determination unit 34 determines the disclosure range using the disclosure permission information acquired by the disclosure permission information acquisition unit 32 and the disclosure request information acquired by the disclosure request information acquisition unit 33. Here, the disclosure range is a range in which an image is disclosed (the image can be browsed), and can be set for each user and each group. The disclosure range determination unit 34 outputs the determination result of the disclosure range to the display control unit 35.

The display control unit 35 performs display control so that the determination result of the disclosure range determination unit 34 is displayed on the display included in the information disclosure device 30. It may be controlled to display on an external display different from the information disclosure apparatus 30.
The input information acquisition unit 36 acquires information (adjustment of desired disclosure range, adjustment of subject) for adjusting the disclosure range input by the disclosure user in response to the determination result displayed on the display by the display control unit 35, This is transferred to the adjustment unit 34 a of the disclosure range determination unit 34. The adjustment input may be performed using a touch pen or the like on the screen displayed on the touch panel by the display control unit 35, or may be performed using a pointing device such as a mouse. When the adjustment unit 34 a receives the adjustment input from the input information acquisition unit 36, the adjustment unit 34 a re-determines the disclosure range based on the adjustment input, and outputs the result to the display control unit 35.

  Further, the input information acquisition unit 36 acquires information indicating the public intention input by the public user in response to the determination result displayed by the display control unit 35, and transfers this information to the public range determination unit 34. For example, the public user indicates a public intention by pressing a public button displayed on the screen by the display control unit 35, and the input information acquisition unit 36 inputs the public intention information when it is determined that the public user has pressed the public button. Judge that At this time, the disclosure range determination unit 34 outputs the disclosure intention information and information indicating the final disclosure range to the disclosure unit 37.

When the disclosure intention information is input, the disclosure unit 37 publishes the image to the final disclosure range determined by the disclosure range determination unit 34. That is, the image data on which the information indicating the disclosure range is superimposed is transmitted to the server device 20.
The server device 20 includes a receiving unit that receives image data on which information indicating the disclosure range transmitted by the information disclosure device 30 is superimposed, and publishes the received image data to the set disclosure range by an image disclosure service.

FIG. 3 is a message exchange sequence according to this embodiment, focusing on the information disclosure device 30 used by the user 0 who is a public user.
First, in step S101, the user 1, the user 2, and the user 3 who are service users set the registration permission information for the server device 20 using the smartphone 40A, the tablet 40B, and the PC 40C that are used in advance. Do.
When a public user designates a captured image to be disclosed, the information disclosure apparatus 30 recognizes a subject to be imaged with respect to the image in step S102. At this time, as shown in FIG. 4, it is assumed that the user 1, the user 2, and the user 3 are recognized as subjects to be photographed with respect to the photographed image 200.

  In this case, the information disclosure apparatus 30 acquires the disclosure user's own disclosure request information and the disclosure permission information of all the photographing subjects (users 1 to 3). First, in step S103, the information disclosure apparatus 30 acquires the disclosure request information of the disclosure user. Next, the information disclosure apparatus 30 transmits an acquisition request for the disclosure permission information of the person to be imaged (users 1 to 3) to the server apparatus 20 in step S104, and receives each of the image captures transmitted by the server apparatus 20 in response thereto. The subject person's disclosure permission information is received in step S105.

  Then, in step S106, the information disclosure apparatus 30 collates the desired disclosure range and the permitted disclosure range using the acquired disclosure request information and the disclosure permission information, and obtains a common range and a difference between both ranges. In addition, the information disclosure apparatus 30 uses the above-described collation result to determine whether or not to disclose a photographed image to be disclosed (disclosure range determination). In step S107, the information disclosure apparatus 30 displays the determination result on the screen and presents it to the public user.

In step S108, the information disclosure apparatus 30 receives an adjustment input (an input for adjusting the disclosure range) from the disclosure user with respect to the displayed determination result. In step S109, the information disclosure apparatus 30 uses the input information to determine the disclosure range again. Do. The adjustment processing in step S108 and the disclosure range determination processing in step S109 are repeated until adjustment of the disclosure range is not necessary or until the disclosure user indicates disclosure intention.
When the information disclosure device 30 receives the disclosure intention of the public user, the information disclosure device 30 reacquires the public permission information of the photographing subject who is finally the candidate for disclosure among the photographing subjects (users 1 to 3). That is, the information disclosure apparatus 30 transmits an acquisition request for the disclosure permission information of the photographing subject who is a candidate for disclosure to the server apparatus 20 in step S110, and the disclosure permission transmitted by the server apparatus 20 in response thereto. Information is received in step S111.

Then, in step S112, the information disclosure apparatus 30 re-determines whether or not to disclose the photographed image to be disclosed using the re-acquired disclosure permission information.
If the subject person has not changed the disclosure permission information during the adjustment process, the determination result in step S112 is the same as the determination result in step S109. Therefore, in this case, the information disclosure apparatus 30 transmits the captured image to the server apparatus 20 in order to disclose the captured image in step S113.
On the other hand, if the person to be imaged has changed the disclosure permission information during the adjustment process and the determination result in step S112 is different from the determination result in step S109, the disclosure range needs to be readjusted. The disclosure device 30 displays the determination result again and prompts the disclosure user to make an adjustment input.
Note that the processing of steps S110 to S112 can be omitted.

  FIG. 5 is a flowchart showing an information disclosure processing procedure executed by the information disclosure apparatus 30. The flowchart is realized by the CPU 1001 reading and executing a program stored in a ROM 1002, RAM 1003, or external memory 1004, which will be described later. In addition, the information disclosure process is started when, for example, an image to be disclosed is designated by the publishing user, and is performed to determine whether or not to publish the image, adjust the disclosure range, and publish the image (publish request). It is.

First, the information disclosing device 30 acquires the information desired to be disclosed by the disclosing user. Here, the release request information is acquired by an input operation of the release user. The public request information may be acquired from the server device 20 by the public user registering with the server device 20 in advance. Here, a case where the public user is the user 0 and the user 0 sets the public desire information shown in FIG. 6 will be described.
First, in step S1, the information disclosure apparatus 30 acquires disclosure request relation information included in the disclosure request information of the disclosure user. Here, the disclosure desired relationship information of the disclosure user is information indicating the disclosure destination user or group desired by the disclosure user, and is the information shown in the disclosure desired relationship information column of FIG.

In step S2, the information disclosure apparatus 30 acquires related user information included in the disclosure request information of the public user. Here, the related user information of the public user is information indicating a user (such as a friend of the public user) related to the public user, and is information indicated in the related user information column of FIG.
In step S <b> 3, the information disclosure apparatus 30 acquires related group information included in the disclosure request information of the public user. Here, the related group information of the public user is information indicating a group related to the public user (such as a group to which the public user belongs), and is information indicated in the related group information column of FIG.
In step S4, the information disclosing device 30 determines whether or not acquisition of the public user's disclosure request information (disclosure request relation information, related user information, and related group information) has been successful. If the information acquisition of the public user fails, the process proceeds to step S5, an error screen is displayed, and the process ends. On the other hand, when the information acquisition of the public user is successful, the process proceeds to step S6.

In step S6, the information disclosure apparatus 30 performs a process of recognizing the shooting target user from the image designated by the public user. If the shooting target user is recognized, the process proceeds to step S7. The process proceeds to step S13. Here, the case where the photographing target user is not recognized is a case where a person is not a subject such as a landscape.
In step S7, the information disclosure apparatus 30 determines whether or not the disclosure permission information has been acquired for all the photographing target users. If not, the information disclosure apparatus 30 proceeds to step S8, and if it has been obtained, proceeds to step S13 described later. To do. For example, as shown in FIG. 4, when user 1, user 2, and user 3 are recognized as shooting targets, it is determined whether or not the public permission information of all of these users 1 to 3 has been acquired.
In step S <b> 8, the information disclosure device 30 transmits a disclosure permission information acquisition request to the server device 20, and acquires the disclosure permission relation information included in the disclosure permission information of the photographing target user from the server device 20. Here, the public permission relation information of the photographing target user is information indicating a public destination user or group permitted by the photographing target user, and is information indicated in the public permission relation information column of FIG.

Next, in step S <b> 9, the information disclosure device 30 transmits a disclosure permission information acquisition request to the server device 20, and acquires related user information included in the disclosure permission information of the photographing target user from the server device 20. Here, the related user information of the shooting target user is information indicating a user (such as a friend of the shooting target user) related to the shooting target user, and is information indicated in the related user information sequence of FIG.
In step S <b> 10, the information disclosure apparatus 30 transmits a disclosure permission information acquisition request to the server apparatus 20, and acquires related group information included in the disclosure permission information of the photographing target user from the server apparatus 20. Here, the related group information of the shooting target user is information indicating a group related to the shooting target user (such as a group to which the shooting target user belongs), and is information shown in the related group information column of FIG.

In step S11, the information disclosing device 30 determines whether or not the acquisition permission information (public permission relation information, related user information, related group information) of the photographing target user has been successfully acquired. Then, if the acquisition of information about the user to be imaged has succeeded, the process proceeds to step S7, and if the information acquisition has failed, the process proceeds to step S12.
In step S12, the information disclosure apparatus 30 sets a default value for the disclosure permission relation information of the photographing target user for whom the disclosure permission information could not be acquired, and proceeds to step S7. Here, the default value of the disclosure permission relation information is, for example, “shooting target”, that is, the shooting target user permits only the shooting target to be released.

  In step S <b> 13, the information disclosure apparatus 30 acquires all users and groups included in the disclosure request relationship information of the disclosure user and the disclosure permission relationship information of the photographing target user as disclosure target candidate users. In the case where the desired release relationship information shown in FIG. 6 and the release permission relationship information shown in FIG. 7 are acquired, as the release target candidate user, as shown in the release target candidate user column of FIG. In addition to 0, user 1, user 2, user 3, user 4, user 5, group 1, group 2, and group 3 are acquired.

In step S14, the information disclosure apparatus 30 determines whether or not the disclosure permission determination has been completed for all the disclosure target candidate users. If not, the information disclosure apparatus 30 proceeds to step S15. Control goes to step S19.
In step S15, the information disclosure apparatus 30 calculates and records the relationship information of the candidate users to be disclosed. The disclosure target candidate user relationship information is information indicating a relationship with each of the disclosure target candidate users as viewed from a public user (here, user 0) and a photographing target user (here, user 1, user 2, user 3). Yes, it is the information shown in the relationship information sequence of FIG.

Next, in step S16, the information disclosure apparatus 30 calculates and records the disclosure permission information of the disclosure target candidate user. The publishing permission information of the publishing target candidate user is disclosed to each publishing target candidate user as viewed from the publishing user (here, user 0) and the photographing target user (here, user 1, user 2, user 3). This is information indicating whether permission is present or not, and is information indicated in the disclosure permission information column of FIG.
In step S <b> 17, the information disclosure apparatus 30 calculates and records the disclosure request information of the disclosure target candidate user. The disclosure target information of the disclosure target candidate user is information indicating whether or not there is a disclosure request for each of the disclosure target candidate users when viewed from the disclosure user (user 0 in this case). Information shown in the information column.

In step S18, the information disclosing device 30 calculates and records information on whether images can be disclosed to the candidate users to be disclosed. Here, the disclosure permission / inhibition information is calculated by combining the disclosure permission information calculated in step S16 with the disclosure request information calculated in step S17. This disclosure permission / inhibition information is information shown in the disclosure permission / inhibition information column of FIG.
Specifically, when the permission information is “present” and the information desired to be published is “present”, the permission information is “public”. When the permission information is “none” and the desired information is “not present”, The disclosure permission / inhibition information is “private”. Also, if the release permission information is “None” and the release request information is “Yes”, it will be released without the agreement of the user to be imaged as it is, and it is necessary to adjust (reduce) the release desired range. The availability information is “warning”. Further, in the case where the publication permission information is “present” and the publication desired information is “none”, the publication permission information becomes “information” because it can be made public by adjusting (expanding) the publication desired range.

In step S19, the information disclosing apparatus 30 displays the disclosure permission / inhibition determination result calculated in steps S15 to S18, and proceeds to step S20.
In step S20, the information disclosure apparatus 30 adjusts the disclosure range based on the adjustment input of the disclosure user by the adjustment process illustrated in FIG.
First, in step S201, the information disclosure apparatus 30 displays in detail items (adjustment items that need to be adjusted) that need to be adjusted in order to set an appropriate disclosure range agreed by both the disclosure user and the user to be imaged. Here, the difference between the disclosure permission information of the photographing target user and the disclosure request information of the disclosure user is displayed as an adjustment item. Adjustment-necessary items include, for example, user information and group information that are included in the public permission range of the photographing target user and not included in the public user's desired disclosure range, and are not included in the public permission range of the photographing target user and are disclosed to the public user. The user information and group information included in the desired range, and the information of the photographing target user including the user group not included in the public user's desired disclosure range in the disclosure permitted range.

Next, in step S202, the information disclosure apparatus 30 waits for adjustment input (adjustment of the desired disclosure range and shooting target (subject)) by the public user, and proceeds to step S203 when receiving the adjustment input.
In step S203, the information disclosure apparatus 30 performs the same processing as the disclosure permission / inhibition determination shown in steps S15 to S18 of FIG. 5 using the adjustment input information acquired in step S202, and displays the result.

In step S <b> 204, the information disclosure apparatus 30 determines whether there are still adjustment items that need to be adjusted. If there is an adjustment item that is required, the process proceeds to step S201. If there is no adjustment item that is required, the adjustment process is terminated because it is possible to set an appropriate disclosure range agreed by both the open user and the user to be photographed. To do.
Returning to FIG. 5, in step S21, the information disclosure process 30 receives the result of the adjustment process in step S20 and sends the image to the server device 20 in order to publish the image in the finally set disclosure range. Send. At this time, information indicating the disclosure range is superimposed on the image data, and the image data is transmitted to the server device 20.

In FIG. 5, the processes of steps S <b> 1 to S <b> 4 correspond to the process of the disclosure request information acquisition unit 33, and the process of step S <b> 6 corresponds to the process of the imaging target recognition unit 31. Further, the processing of steps S7 to S12 corresponds to the processing of the disclosure permission information acquisition unit 32, and the processing of steps S13 to S18 corresponds to the processing of the disclosure range determination unit 34. Furthermore, the process of step S19 corresponds to the process of the display control unit 35, and the process of step S21 corresponds to the process of the disclosure unit 37.
In FIG. 9, the process of step S201 corresponds to the process of the display control unit 35, the process of step S202 corresponds to the process of the input information acquisition unit 36, and the process of step S203 corresponds to the process of the disclosure range determination unit 34. It corresponds.

(Operation of the first embodiment)
Next, the operation of the first embodiment will be described.
When the public user (user 0) designates an image to be disclosed, the information disclosure apparatus 30 starts the information disclosure process of FIG. 5 to acquire the public user's disclosure request information and the photographing target user's disclosure permission information. , And determination of the disclosure range (determination of availability). At this time, if the public user designates a plurality of images, the above processing is performed for each image, and the result is displayed.
FIG. 10 is an example of a list display screen showing the determination result of availability. As shown in FIG. 10, for example, a list display unit 310 and a thumbnail image display unit 320 are provided on the output screen 300, and a list of a plurality of images designated by a public user in the list display unit 310 is displayed in the thumbnail image display unit 320. A plurality of thumbnail images 321 designated by the public user are displayed. In addition, the thumbnail image display unit 320 displays a warning mark 322 and an information mark 323 together with an image whose publishability information is “warning” or “information”, and the publishing user needs to adjust the publishing range. Notify that an image exists.

  Further, the output screen 300 is provided with a batch release button 324 for batch release of a plurality of images designated by the public user. Suppose that it is determined that all images can be disclosed as a result of the determination as to whether or not disclosure is possible, and there are no adjustment items. In this case, when the publishing user presses the collective publish button 324, the information publishing apparatus 30 receives the publishing request information, superimposes information indicating each publishing range on each image data, and transmits them to the server apparatus 20. To do. As a result, a plurality of images designated by the public user are disclosed to the users and groups belonging to the public range set by the public availability determination process.

  From this list display screen, the publishing user determines that the image 009. When jpg is selected, for example, a detailed screen as shown in FIG. 11 is displayed. This detail screen is provided with a detail display unit 330 for displaying in detail the results of whether or not each image can be disclosed. The detail display unit 330 includes an image display unit 331 that displays an image selected from the list list, an information display unit 332 that displays information on whether or not to disclose the image, and whether or not each user and group included in the desired disclosure range can be disclosed. A determination result display unit 333 that displays a determination result, a determination result display unit 334 that displays a determination result of whether or not to publish for each photographing target user, and a disclosure button 335 that instructs the disclosure of the image are provided.

  As shown in FIG. 11, the users to be captured of the selected image are user 1, user 2, and user 3, and these users to be captured have set the public permission information shown in FIG. ) Sets the desired disclosure range shown in FIG. 6, the information disclosure apparatus 30 obtains the disclosure permission determination result shown in FIG. 8. Therefore, in this case, the information disclosing apparatus 30 displays the contents of the determination result of disclosing availability in FIG. 8 on the detail display unit 330 in FIG. To do.

Specifically, as shown in FIG. 11, “common friends”, “common group”, “user 4”, “user 5”, “user 2”, and “user 3” are displayed as adjustment items. The Information such as “NG” and “CHECK” is displayed in the determination result column of the adjustment item requiring adjustment so that it can be distinguished from items other than the adjustment item required.
Here, the adjustment items A (common friend) and D (user 5) that are required are included in the public permission range of the photographing target user and are not included in the public user's desired disclosure range, as shown in FIG. It is an item. Further, adjustment required items B (common group) and C (user 4) are items that are not included in the disclosure permission range of the photographing target user and are included in the disclosure request range of the disclosure user. Furthermore, the adjustment items E (user 2) and F (user 3) that are required are photographing target users that include a range that is not included in the disclosure desired range of the public user in the disclosure permission range.

The release user confirms the release permission / inhibition determination result shown in FIG. 11 and adjusts the release desired range and the subject so that the adjustment items to be eliminated are eliminated.
At this time, it is assumed that the public user unchecks the adjustment item C to be required and removes “user 4” from the desired disclosure range. Then, the information disclosure apparatus 30 receives this adjustment input, and again determines whether or not to disclose based on the reduced desired disclosure range. Then, the information disclosure apparatus 30 displays this determination result.
FIG. 12 is a diagram showing a disclosure permission / inhibition result output screen after reduction of the desired disclosure range. As shown in FIG. 12, when the disclosure user reduces the desired disclosure range, the warning display of the adjustment item C required disappears, and the determination result of whether or not the user 2 (adjustment item E) is open is OK.

Next, it is assumed that the public user unchecks the adjustment item F that needs adjustment and performs image processing to delete the user 3 from the subject of the image (shooting target user). Then, the information disclosure apparatus 30 receives this adjustment input, and again determines whether or not to disclose based on the adjusted shooting target user information. Then, the information disclosure apparatus 30 displays this determination result.
FIG. 13 is a diagram illustrating a disclosure availability determination result output screen after subject adjustment. As shown in FIG. 13, the image display unit 331 displays an image after image processing, for example, an image that has been subjected to trimming processing T that cuts out and deletes the shooting region of the user 3. Further, since the public user limits the user to be photographed, the warning display of the adjustment item B that is required disappears, and the determination result of whether or not the user 3 (adjustment item F) needs to be disclosed is OK. Furthermore, since the only items that need to be adjusted are items whose disclosure permission information is “information” (A and D in FIG. 11), the disclosure permission information displayed on the information display unit 332 is also changed from the warning content to the information content. Change.
Although the case where the trimming process is performed has been described as the image process, an editing process such as a mosaic process, a blur process, or a process of adding a stamp or an illustration can also be used. The image processing may be directly performed by a public user, or may be performed by the information disclosure apparatus 30 based on an adjustment input for deleting a photographing target user from the public user.

Next, it is assumed that the public user adds a check for the adjustment item A requiring adjustment and adds “common friend” to the disclosure desired range. Then, the information disclosure apparatus 30 receives this adjustment input, and again determines whether or not to disclose based on the expanded desired disclosure range. Then, the information disclosure apparatus 30 displays this determination result.
FIG. 14 is a diagram illustrating a disclosure permission / determination result output screen after the desired disclosure range is extended. As shown in FIG. 14, when the public user expands the desired disclosure range, the information display of the adjustment items A and D that are necessary to disappear disappears, and the user 5 who is a common friend is added as a public object.

Then, as shown in FIG. 14, when there are no adjustment items to be required and the publishing user presses the publish button 335, the information disclosing device 30 receives the publishing request information, superimposes information indicating the publishing range on the image data, and The image data is transmitted to the server device 20. As a result, the image after trimming editing shown in FIG. 14 is disclosed to users and groups (user 1, user 2, user 5, group 1) belonging to the final disclosure range.
As another example, a case will be described in which a public user does not include a user to be photographed in a desired disclosure range. In this case, the disclosure permission / inhibition information is “information”, and the detailed display screen of the disclosure permission / inhibition determination result is as shown in FIG. 15, for example. That is, as shown in FIG. 15, items included in the disclosure permission range of the photographing target user are displayed as adjustment items that are necessary.

From the state shown in FIG. 15, it is assumed that the public user operates the setting switching unit 336 and switches the setting mode of the public desire information to the automatic setting mode as shown in FIG. 16. Then, the information disclosure apparatus 30 receives this adjustment input, automatically sets the disclosure desired range of the disclosure user from the disclosure permission range of the photographing target user, and displays the result.
FIG. 16 shows a case where the disclosure range in accordance with the intention of all the imaging target users from the disclosure permission range of the imaging target users (user 4, user 5, user 6) is the imaging target user and a common friend. Yes.
If the information disclosure device 30 automatically sets the disclosure user's desired disclosure range from the disclosure permission range of the photographing target user and there is no applicable disclosure range, warning information is displayed as shown in FIG. .

(Effect of the first embodiment)
As described above, in the present exemplary embodiment, the disclosure permission range of the photographing target user who is captured in the image and the disclosure user's desired disclosure range are acquired, and the acquired disclosure permission range and the desired disclosure range are collated. Determine the scope of disclosure. In this way, since the group of the candidates for disclosure that each of the user to be photographed (subject) and the public user (publishing requester) may want to disclose (will want to be disclosed) are collated, It is possible to determine the disclosure range agreed upon by both users. In addition, it is possible to grasp a person who is permitted to publish by the photographing target user and a person the public user does not want to publish, and a person who the photographing target user refuses to publish and the public user desires to publish.

In addition, since the common range between the disclosure permission range and the desired disclosure range is determined as the disclosure range, it is possible to reliably prevent the image target user from releasing the image to a person who has not permitted the image disclosure.
Furthermore, since the disclosure permission range of the photographing target user is acquired, there is no need to repeatedly inquire about the intention of disclosure of the photographing target user. In addition, by obtaining the disclosure permission range that is set and registered in advance in the server device 20, it is not necessary for the user to be photographed to reply whether the disclosure is permitted or not every time the disclosure user requests the disclosure of the image. Therefore, it is possible to easily determine the disclosure range.

Furthermore, since the information disclosure apparatus 30 notifies the disclosure user of the disclosure range determination result and gives an opportunity for adjustment of the disclosure range (adjustment of the disclosure desired range and subject), the disclosure user searches for a compromise in the range setting. You can publish images with
Specifically, the information disclosure apparatus 30 notifies, for example, whether disclosure is necessary or not for persons belonging to a range that is included in the disclosure permission range of the photographing target user and that is not included in the disclosure user's disclosure request range. Thereby, the public user can consider extending the desired disclosure range. In other words, if a public user wishes to make a public view reflecting the intention of the user to be photographed even for a person who does not want to be public at the beginning, the image is disclosed in a form agreed by both the public user and the user to be photographed. can do. In this way, it is possible to minimize the disapproval of disclosure due to the narrow disclosure desired range, and the public user has an opportunity to publish more images.

  Furthermore, the information disclosure apparatus 30 notifies, for example, whether or not disclosure is desired for a person who is not included in the disclosure permission range of the user to be imaged and that is included in the disclosure user's desired disclosure range. As a result, the public user can consider reducing the desired disclosure range. In other words, if the public user does not wish to be disclosed by reflecting the intention of the user to be imaged to the person who originally wanted to be publicized, the image is disclosed in a form agreed by both the public user and the user to be imaged. be able to. In this way, it is possible to minimize the disapproval of disclosure due to the wide disclosure desired range.

  In addition, the information disclosure apparatus 30 notifies, for example, whether disclosure is necessary or not for a person who includes a range that is not included in the disclosure desired range of the disclosure user among the imaging target users. Thereby, the public user can consider the reduction of the subject. In other words, if a shooting target user who sets a public permission range that does not match the public user's desired disclosure range is deleted from the subject (image processing), only the shooting target user who has agreed to release has been shot. You can publish images with In this way, the public user has an opportunity to publish more images.

  Furthermore, the information disclosure apparatus 30 notifies, for example, whether or not disclosure is desired for a user to be imaged that is not included in the disclosure range of the disclosure user. Thereby, the public user can consider extending the desired disclosure range. That is, if the public user wishes to publish to the photographing target user who does not want to be initially disclosed, the photographing target user can confirm the disclosure of the image taken by himself / herself.

As described above, when there is a difference between the public user's desired disclosure range and the photographing target user's disclosure permission range, the difference information is highlighted on the screen, for example, to notify the public user, and the disclosure range is adjusted. Is possible. Therefore, the public user can publish the image after searching for a compromise of range setting. Further, by notifying the difference information in detail, redundant adjustment can be omitted, leading to time saving.
In addition, when there are a plurality of photographing target users in the image that the public user requests to disclose, the information disclosure apparatus 30 acquires the disclosure permission range for each of the photographing target users. Therefore, it is possible to grasp in detail which photographing target user's disclosure permission range does not match the desired disclosure range. Therefore, the disclosure range can be adjusted appropriately.

(Application examples)
In the first embodiment, the case where the information disclosure device 30 is a PC, the disclosure permission / non-permission determination is performed on the captured image, and the determination result is displayed has been described, but the determination result is displayed in the live view. Also good. In other words, the information disclosure apparatus 30 described above may be mounted on an imaging apparatus having a live view function for displaying image data from a photographing element such as a digital camera in real time. In this case, whether or not disclosure is possible is performed before the image is captured, and the determination result is displayed on the live view of the imaging apparatus.

FIG. 18 is an example in which the determination result is displayed in the live view of the imaging apparatus. As shown in FIG. 18, it is assumed that the user 1, the user 2, and the user 3 are recognized as shooting target users on the live view screen 400, and there is a warning for the user 2 and the user 3 among them. In this case, the determination result (information on users and groups not included in the disclosure permission range and included in the disclosure desired range) is superimposed and displayed for each user to be imaged (determination result display 401 and 402), and the warning content is displayed. Display (warning content display 403).
In this way, since the result of the availability determination is displayed in the live view, the photographer can take an image while grasping the disclosure range. For example, it is possible to shoot while adjusting the subject so that the disclosure range matches the desired disclosure range.

(Second embodiment)
Next, a second embodiment of the present invention will be described.
In the second embodiment, in the first embodiment described above, the determination as to whether or not the disclosure is possible is performed by the terminal device used by the public user. The result is displayed on the terminal device used by the public user.
FIG. 19 is a system configuration diagram illustrating an example of an image disclosure system according to the second embodiment.

The image disclosure system 10 includes an information disclosure device (information processing device) 130, an information device 60, and terminal devices 40A to 40C. The information disclosure device 130, the information device 60, and the terminal devices 40 </ b> A to 40 </ b> C are connected by a network 50. In FIG. 19, parts having the same configurations as those in the system configuration diagram shown in FIG.
The information disclosure device 130 has the function of the server device 20 of the first embodiment described above, and provides an image disclosure service. The information disclosure apparatus 130 registers and holds the service user's disclosure permission information.

In addition, the information disclosure apparatus 130 performs determination of whether or not to disclose an image designated by the disclosure user and a disclosure process in response to a request from the disclosure user. In this way, the information disclosure apparatus 130 is equipped with an information processing apparatus that determines whether or not to disclose.
The information device 60 is a terminal device used by a public user, requests the information disclosure device 130 to determine whether an image can be disclosed, and displays the determination result. The information device 60 is a terminal having a communication function such as a smartphone.
FIG. 20 is a block configuration diagram of the information disclosure apparatus 130 and the information device 60.
The information device 60 includes a determination request unit 61 and a display control unit 62.
The determination request unit 61 transmits the disclosure user's disclosure request information and the disclosure permission / inhibition determination request to the information disclosure apparatus 130. In addition, the determination request unit 61 transmits image data requested to be published by the public user to the information disclosure apparatus 130.

The display control unit 62 receives the result of the availability determination from the information disclosure device 30 and displays it on the display unit (display) of the information device 60.
The information disclosure apparatus 130 includes an imaging target recognition unit 131, a disclosure permission information acquisition unit 132, a disclosure request information acquisition unit 133, a disclosure range determination unit 134, an input information acquisition unit 136, and a disclosure unit 137. The information disclosure apparatus 130 further includes a determination request receiving unit 138.
Each unit 131, 132, 133, 134, 134a, 136, and 137 of the information disclosure device 130 has the same function as each unit 31, 32, 33, 34, 34a, 36, and 37 of the information disclosure device 30 shown in FIG. .

The determination request receiving unit 138 receives the disclosure request information, the disclosure permission determination request, and the image data transmitted from the determination request unit 61 of the information device 60, and the received disclosure request information is received by the disclosure request information acquisition unit 133. The availability determination request and the image data are transmitted to the imaging target recognition unit 131.
Upon receiving the disclosure permission determination request and the image data from the determination request receiving unit 138, the shooting target recognition unit 131 performs a process of recognizing the shooting target user from the image.

The disclosure request information acquisition unit 133 receives and stores the disclosure request information from the determination request reception unit 138.
The disclosure range determination unit 134 determines the disclosure range using the disclosure permission information acquired by the disclosure permission information acquisition unit 132 and the disclosure request information acquired by the disclosure request information acquisition unit 133, and the result is determined by the information device 60. The data is output to the display control unit 62.
The input information acquisition unit 136 receives the determination result displayed on the display unit by the display control unit 62 of the information device 60, and adjusts the disclosure range input by the disclosure user (adjustment of the desired disclosure range, adjustment of the subject). ) And is transferred to the adjustment unit 134a of the disclosure range determination unit 134. That is, the information device 60 includes a transmission unit for the adjustment input information. This adjustment input is performed, for example, using a finger, a touch pen, or the like on the screen displayed on the touch panel by the display control unit 62. When receiving the adjustment input from the input information acquisition unit 136, the adjustment unit 134a re-determines the disclosure range based on the adjustment input, and outputs the result to the display control unit 62 of the information device 60.

In addition, the input information acquisition unit 136 receives the determination result displayed on the display unit by the display control unit 62 of the information device 60, acquires the public intention information input by the public user, and receives this information from the public range determination unit 134. hand over. At this time, the disclosure range determination unit 134 outputs the disclosure intention information and information indicating the final disclosure range to the disclosure unit 137.
When the disclosure intention information is input, the disclosure unit 137 releases the image to the final disclosure range determined by the disclosure range determination unit 134.

(Operation of Second Embodiment)
Next, the operation of the second embodiment will be described.
Assume that a public user photographs a subject with an information device 60 having a photographing function, such as a smartphone operated by the public user, and transmits a disclosure permission determination request together with photographed image data to the information disclosure device 130. Then, the information disclosure apparatus 130 receives the disclosure permission determination request transmitted from the information device 60, and determines whether the disclosure is permitted for the image requested by the disclosure user. Then, the information disclosure apparatus 130 transmits the determination result to the information device 60.

The information device 60 receives the disclosure permission / inhibition determination result transmitted from the information disclosure device 130 and displays it on the display. The publishing user adjusts the publishing range based on the displayed publishability determination result, and transmits the adjustment input information to the information publishing apparatus 130. The information disclosure apparatus 130 determines again whether or not to disclose based on the adjustment input information transmitted from the information device 60, and transmits the result to the information device 60 as a result.
The adjustment process is repeated until the disclosure range does not need to be adjusted. When the disclosure user inputs the disclosure intention, the information device 60 transmits the disclosure intention information of the disclosure user to the information disclosure apparatus 130. When the information disclosure apparatus 130 receives the disclosure intention information transmitted from the information device 60, the information disclosure apparatus 130 publishes the image requested by the disclosure user to the disclosure range after adjustment.

(Effect of the second embodiment)
As described above, in the second embodiment, the information disclosure apparatus 130 operated by the disclosure user transmits a disclosure permission determination request to the information disclosure apparatus 130 on the network, and the information disclosure apparatus 130 that receives the request transmits the disclosure permission / inhibition. The determination is performed, and the determination result is returned to the information device 60 of the public user. In this way, by installing the information disclosure device 130 on the network, it is not necessary to mount the information disclosure device on the service user's terminal device, and any service user can determine whether the image can be disclosed. .
In the second embodiment, the case where the information disclosure apparatus 130 has a function of providing an image disclosure service has been described. However, this image disclosure function is different from that on the network that is communicably connected to the information disclosure apparatus 130. The server device may be provided.

(Hardware configuration)
FIG. 21 is an example of a hardware configuration of the information processing apparatus in each of the above embodiments.
The information processing apparatus 1000 that performs the above-described disclosure propriety determination includes a CPU 1001, a ROM 1002, a RAM 1003, an external memory 1004, an input unit 1005, a display unit 1006, a communication I / F 1007, and a system bus 1008.
The CPU 1001 controls the overall operation of the information processing apparatus 1000 and controls each component (1002 to 1007) via the system bus 1008.

The ROM 1002 is a nonvolatile memory that stores a control program and the like necessary for the CPU 1001 to execute processing. The program may be stored in the external memory 1004 or a removable storage medium (not shown).
The RAM 1003 functions as a main memory, work area, and the like for the CPU 1001. That is, the CPU 1001 implements various functional operations by loading a program or the like necessary from the ROM 1002 into the RAM 1003 when executing the processing, and executing the program or the like.

The external memory 1004 stores, for example, various data and various information necessary for the CPU 1001 to perform processing using a program. Also, the external memory 1004 stores, for example, various data and various information obtained by the CPU 1001 performing processing using a program or the like.
The input unit 1005 includes a pointing device such as a keyboard and a mouse, and a user of the video display apparatus 1000 can give an instruction to the information processing apparatus 1000 via the input unit 1005.

The display unit 1006 includes a monitor such as a liquid crystal display (LCD).
A communication I / F 1007 is an interface for communicating with an external device.
The system bus 1008 connects the CPU 1001, the ROM 1002, the RAM 1003, the external memory 1004, the input unit 1005, the display unit 1006, and the communication I / F 1007 so that they can communicate with each other.
The information processing apparatus 1000 may be mounted on a terminal device (such as a PC) operated by a public user, or may be mounted on a server device on a network. Furthermore, the information processing apparatus 1000 may be mounted on an imaging apparatus (such as a digital camera) operated by a public user.

The functions of the units of the information disclosure apparatus 30 shown in FIG. 2 and the functions of the units of the information disclosure apparatus 130 shown in FIG. 20 are realized by the CPU 1001 executing a program stored in the ROM 1002.
When the information processing apparatus is mounted on an imaging apparatus having a live view function, an imaging unit that includes an imaging element as a hardware configuration and converts light from a subject into a digital electrical signal is provided. Added. Further, when the information processing apparatus is mounted on a server apparatus, the display unit 1006 can be omitted.

(Other embodiments)
Although the embodiment has been described in detail above, the present invention can take an embodiment as a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices (for example, a host computer, an interface device, an imaging device, a web application, etc.), or may be applied to an apparatus including a single device.
In the above-described embodiment, the case where the subject himself / herself sets the disclosure permission range of the image has been described. However, the present invention is not limited to this. For example, when the subject is a pet, the pet owner may set the public permission range. For example, when the subject is a child, a guardian (such as a parent) of the child may set the disclosure permission range. Furthermore, for example, when the subject is a thing, the owner of the thing may set the disclosure permission range.

In this way, even if the subject himself / herself does not set the image disclosure permission range, the image disclosure permission range associated with the subject can be set.
Also, a process of supplying a program that realizes one or more functions of the above-described embodiment to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus reading and executing the program But it is feasible. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.
The present invention has several effects from one or more of the above.

  DESCRIPTION OF SYMBOLS 10 ... Image disclosure system, 20 ... Server device, 30 ... Information disclosure device, 40A to 40C ... Terminal device, 31 ... Imaging object recognition unit, 32 ... Release permission information acquisition unit, 33 ... Release desired information acquisition unit, 34 ... Release Range determination unit, 34a ... adjustment unit, 35 ... display control unit, 36 ... input information acquisition unit, 37 ... disclosure unit, 60 ... information device, 61 ... determination request unit, 62 ... display control unit, 130 ... information disclosure device, 131 ... Shooting target recognition unit, 132 ... Release permission information acquisition unit, 133 ... Release desired information acquisition unit, 134 ... Release range determination unit, 134a ... Adjustment unit, 136 ... Input information acquisition unit, 137 ... Release unit, 138 ... Determination Request receiver

Claims (17)

First acquisition means for acquiring first information indicating a public permission range of the image associated with a subject photographed in the image;
Second acquisition means for acquiring second information indicating a desired disclosure range of the image by a user who requests the disclosure of the image;
Determining means for determining a disclosure range to be disclosed of the image based on the first information acquired by the first acquiring means and the second information acquired by the second acquiring means; ,
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the determination unit determines a common range between the disclosure permission range and the desired disclosure range as the disclosure range.   The information processing apparatus according to claim 1, further comprising a first notification unit that notifies a user of a determination result by the determination unit.   4. The apparatus according to claim 1, further comprising a second notifying unit that notifies a user of a person who is included in the disclosure permission range and that is not included in the desired disclosure range. 5. The information processing apparatus described in 1.   5. The apparatus according to claim 1, further comprising a third notification unit that notifies a user of a person who is not included in the disclosure permission range and that belongs to the range included in the desired disclosure range. The information processing apparatus described.   4. The apparatus according to claim 4, further comprising: fourth notification means for notifying a user of a subject whose range is not included in the desired disclosure range among the subjects photographed in the image. The information processing apparatus according to any one of 1 to 5.   The information processing apparatus according to claim 1, further comprising a fifth notification unit that notifies the subject that is not included in the desired disclosure range. Third acquisition means for acquiring adjustment instruction information for adjusting the disclosure range input by the user;
Adjusting means for adjusting the disclosure range based on the adjustment instruction information acquired by the third acquiring means;
The information processing apparatus according to claim 1, further comprising:   The said 1st acquisition means acquires the said disclosure permission range about each of this some subject, when the some subject is image | photographed to the said image, The any one of Claim 1 to 8 characterized by the above-mentioned. The information processing apparatus described in 1. An imaging apparatus having a live view function for displaying image data from an imaging element on a display unit,
Recognizing means for recognizing a subject photographed in an image displayed in the live view function;
First acquisition means for acquiring first information indicating a public permission range of the image associated with the subject recognized by the recognition means;
Second acquisition means for acquiring second information indicating a desired disclosure range of the image by a user who requests the disclosure of the image;
Determining means for determining a disclosure range to be disclosed of the image based on the first information acquired by the first acquiring means and the second information acquired by the second acquiring means; ,
Display control means for superimposing a determination result by the determination means on an image displayed in the live view function and displaying the image on the display unit;
An imaging device comprising:   The imaging apparatus according to claim 10, wherein the live view function displays image data from the imaging element on the display unit in real time. Obtaining first information indicating a public permission range of the image associated with a subject photographed in the image;
Obtaining second information indicating a desired disclosure range of the image by a user who requests the disclosure of the image;
Determining a disclosure range to be disclosed of the image based on the acquired first information and the second information;
An information processing method comprising: An image publishing system for publishing an image by a server device on a network,
The information processing apparatus according to any one of claims 1 to 9 and the server apparatus are connected to be communicable,
The information processing apparatus further includes transmission means for transmitting the information on the disclosure range determined by the determination means to the server apparatus,
The server device
Receiving means for receiving information of the disclosure range transmitted from the transmitting means;
Publishing means for publishing the image in the publishing range corresponding to the information of the publishing range received by the receiving means;
An image publishing system comprising:   The image disclosure system according to claim 13, wherein the information processing apparatus is a terminal apparatus operated by the user. The information processing apparatus further includes an information device that is communicably connected and operated by a user,
The information device has request means for requesting the disclosure range to the information processing apparatus,
15. The image disclosure system according to claim 13 or 14, wherein the information processing apparatus determines the disclosure range by the determination unit in response to the request by the request unit.   The program for functioning a computer as each means of the information processing apparatus of any one of Claim 1 to 9. The program for functioning a computer as each means of the imaging device of Claim 10 or 11.

Images