JP2016085594A - Portrait right protection program, information communication apparatus and portrait right protection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portrait right protection program capable of allowing a user to utilize a picked up image after completing the portrait right processing.SOLUTION: The portrait right protection program causes a computer to execute a processing including the steps of: acquiring a first image data obtained by picking up an image before being stored in a state usable by a user; and when the acquired first image data includes a person from whom no imaging permission is obtained, storing a second image data in a first storage area after processing the image so that the person cannot be identified.SELECTED DRAWING: Figure 1

Description

  The present invention relates to portrait right protection technology.

  With the recent development of information-communication technology (ICT) devices represented by smartphones, high-definition digital photography is possible anytime and anywhere. Furthermore, as a mobile ICT device following a smartphone, attention is focused on a wearable device that can be worn. The wearable device can shoot an image without performing an explicit shooting operation. Therefore, it can be said that the infringement of portrait rights by voyeurism is more likely to occur than before. In addition to intentional sneak shots, the user may unconsciously infringe on portrait rights.

  Regarding the protection of portrait rights, it can be said that one of the problems is that there is no recognition that the user himself is infringing on the portrait rights of others. When there is a recognition that another person's portrait rights have been infringed, the person's face is recognized from the image after shooting, and processing such as blurring, black eyes, whitening, etc. is performed, and protection by post processing is implemented There are many cases.

  In recent years, many surveillance cameras tend to be installed on the streets for the purpose of crime prevention and accident recording. It is thought that personal photography with such a surveillance camera is also an infringement of portrait rights, but as a countermeasure, research has been made to try to white out the face portion of the surveillance camera image.

Regarding the protection of portrait rights, there are the following techniques.
As a first technique, determination means for determining whether or not another person appears in the image to be disclosed, and when the determination result is affirmative, the other person is not specified for the image to be determined. There is an image processing apparatus provided with a processing means for performing processing (for example, Patent Document 1).

  As a second technique, there is a technique for recognizing a human face reflected in captured video information and performing a removable blur image process (for example, Patent Document 2).

  As a third technique, a face detector is used to detect a face based on the captured image, and a privacy mask process such as mosaic / blurring / painting is performed on the detected face or its background image in the output processing unit. There is a technology for protecting privacy by this (for example, Patent Document 3).

JP 2013-171311 A JP 2006-148842 A JP 2009-194687 A

  In the first technique, an image taken by a camera is recorded in an image storage unit, and all of the images stored and stored in the image storage unit or a part of images selected by the user are uploaded to the server and registered in the server. And we are processing to protect portrait rights.

  In the second technique, a video signal from the CCD camera means is encoded and recorded in an encode server means that can be recorded, and a human face reflected in the picked-up video information is recognized and subjected to removable blur image processing. .

However, in the first and second techniques, the image stored and stored in the storage unit is not subjected to the portrait right protection process, and whether or not these images are subjected to the process for the portrait right protection. It is up to the user's will.
In addition, the images stored and stored in the storage unit are not processed to protect portrait rights, so they are disclosed by the user's carelessness, stolen by malicious users, or hacked from the network. There is a risk of spillage.

  In addition, the third technology assumes privacy protection and confidentiality protection for users who do not want their communication partners to see their faces and their surroundings in video calls, video conferences, video chats, etc. It is not intended to protect the portrait rights of others.

  The present invention provides, as one aspect, a technique for making a captured image available to a user for the first time after completion of a right processing relating to a portrait right.

  The portrait right protection program according to one aspect of the present invention causes a computer to execute the following processing. That is, the computer acquires the first image data obtained by imaging before being stored in a state where the user can use it. When the acquired first image data includes a person who has not obtained permission for imaging, the computer stores the second image data that has been subjected to image processing so that the person cannot be identified in the first storage area.

  According to the present invention, as one aspect, the captured image can be made available to the user for the first time after the right processing relating to the portrait right is completed.

An example of the portrait right protection system in this embodiment is shown. 2 shows a system configuration in a registration phase and a portrait right processing phase in the present embodiment. The hardware structure of the ICT device in this embodiment is shown. An example of the memory of the ICT device in this embodiment is shown. An example of the device user registration screen in this embodiment is shown. An example of a structure example of the imaging | photography permission setting screen in this embodiment is shown. An example of the portrait edit screen in this embodiment is shown. An example of the device edit screen in this embodiment is shown. An example of device registration DB in this embodiment is shown. An example of permission list DB in this embodiment is shown. An example of user portrait DB in this embodiment is shown. The permission list database registration flow (the 1) in this embodiment is shown. The permission list database registration flow (the 2) in this embodiment is shown. The permission list database registration flow (the 3) in this embodiment is shown. It is a figure for demonstrating the process between ICT device-servers in this embodiment (Example 1). The whole flow of the portrait right process in this embodiment (Example 1) is shown. The flow of the resolution related image process (S60) in this embodiment (Example 1) is shown. It is a figure for demonstrating the process between ICT device-image processing server-DB server in this embodiment (Example 2). It is a figure for demonstrating the process between ICT device-servers in this embodiment (Example 3). The whole flow of the portrait right process in this embodiment (Example 3) is shown. It is a figure for demonstrating the process between ICT device-servers in this embodiment (Example 4). The whole flow of the portrait right process in this embodiment (Example 4) is shown. It is a figure for demonstrating the process between ICT device-servers in this embodiment (Example 5). An example of user portrait DB in this embodiment (Example 5) is shown. The whole flow of the portrait right process in this embodiment (Example 5) is shown. It is a figure for demonstrating the process between ICT device-servers in this embodiment (Example 6). An example of the wanted person / missing person portrait DB in this embodiment (Example 6) is shown. The whole flow of the portrait right process in this embodiment (Example 6) is shown. It is a block diagram of the hardware environment of the server in this embodiment.

  FIG. 1 shows an example of a portrait right protection system in the present embodiment. The portrait right protection system 1 includes an information communication device 2 and a server device 8. The information communication device 2 includes a first storage unit 3, an imaging unit 4, and a storage control unit 5.

  The first storage unit 3 stores information. As an example of the 1st memory | storage part 3a, the user accessible area 22a and the memory 22c are mentioned.

  The imaging unit 4 captures an image and outputs image data. An example of the imaging unit 4 is a camera 23.

  The storage control unit 5 acquires the first image data output from the imaging unit 4 before it is stored in a state usable by the user. The storage control unit 5 stores, in the first storage unit 3a, the second image data that has been subjected to image processing so that the person cannot be identified when the acquired first image data includes a person who does not have permission to capture images. To do. An example of the storage control unit 5 is a processor 21.

  By configuring in this way, the captured image can be made available to the user for the first time after the rights processing relating to the portrait right is completed. In other words, it is possible to prevent the user from using the captured image until the right processing regarding the portrait right is completed.

  The information communication device 2 includes a second storage unit 3b that cannot be accessed by the user. As an example of the second storage unit 3b, a user inaccessible area 22b and a memory 22d can be cited. The storage control unit 5 stores the acquired first image data in the second storage unit 3b, and stores the second image data subjected to image processing in the first storage unit 3a accessible by the user.

  By configuring in this way, the captured image can be made available to the user for the first time after the rights processing relating to the portrait right is completed.

  The information communication device 2 further includes a communication unit 6. The communication unit 6 transmits the acquired first image data to the server device 8 and receives the second image data subjected to image processing by the server device 8. An example of the communication unit 6 is a wireless device 27. At this time, the storage control unit 5 stores the received second image data in the first storage unit 3a.

  With this configuration, it is possible to provide the user with an image that has been subjected to right processing by the server device for the image captured by the user.

  The information communication device 2 further includes a face detection unit 7. The face detection unit 7 detects a human face from the acquired first image data. An example of the face detection unit 7 is a processor 21. The communication unit 6 transmits the first image data to the server device 8 when a face is detected from the acquired first image data. When no face is detected from the acquired first image data, the storage control unit 5 stores the first image data in the first storage unit 3a.

  With this configuration, it is possible to transmit to the server device 8 only images for which a right processing for portrait rights is required.

  The face detection unit 7 may extract face portion image data from the first image data when a human face is detected from the acquired first image data. In this case, the communication unit 6 transmits the extracted image data of the face portion to the server device 8. The storage control unit 5 generates second image data obtained by combining the image data of the face portion subjected to the image processing received from the server device 8 and the acquired first image data, and the generated second image data is generated. Save in the first storage unit 3a.

  With this configuration, the amount of communication data between the information communication device and the server device can be reduced.

Hereinafter, this embodiment will be described in detail.
An ICT device such as a wearable device provided to a user is registered in a server having an authentication function in the registration phase. In the right processing phase for the portrait right, image data such as a still image or a moving image captured by the ICT device is transmitted to the server once without being stored in a format usable by the user in the ICT device body. Hereinafter, still images and moving images are simply referred to as images.

  Here, in the present embodiment, the right processing (portrait right processing) for the portrait right means that when a person is reflected in a photographed image, permission for photographing has been received from the photographed person in advance. The image processing is performed according to the above. For example, when the photographing permission is received in advance from the reflected person, the face image of the person displayed in the photographed image is displayed as it is. When the photographing permission is not received in advance from the reflected person, processing for not displaying the face image is performed.

  The server identifies the ICT device and the user using the device information and user information transmitted together with the image data. The server checks whether the face of a person other than the person who is permitted to shoot using the ICT device (person who is not allowed to shoot) is captured in the shot image. When a person who is not allowed to take a picture is shown, the server corrects the face portion. Here, the server leaves the person associated with the ICT device registered in advance among the persons photographed in the image, and corrects the faces of other persons. The server transmits the corrected image data to the ICT device. Through this process, the ICT device can store the captured image data, and the user can view the image data.

  With this series of mechanisms, the user can take a picture of a person registered in association with his / her own ICT device, but cannot take a picture of a person who is not, so the portrait right is not noticed by the user himself / herself. Can be considered. More details will be described in the following examples.

  Provided is a system in which a user can acquire an image in consideration of protection of a portrait right in real time for each device and user without being conscious of the user.

  FIG. 2 shows a system configuration in the registration phase and the portrait right processing phase in the present embodiment. FIG. 2A shows a system configuration in the registration phase in the present embodiment.

  In FIG. 2A, the personal computer (PC) 12 and the server 13 are connected by a communication network 17 such as the Internet. The PC 12 and the ICT device 11 are connected by a communication cable based on a communication protocol such as a universal serial bus (USB).

  In the registration phase shown in FIG. 2 (A), using the personal computer (PC) 12 connected to the ICT device 11, the user uses various information in advance for the portrait right processing phase shown in FIG. 2 (B). Register. For example, the user uses the PC 11 to set user information in the ICT device 11, register information related to the ICT device 11 and user information in the server 13, register a portrait image of the user, Register information related to shooting permission.

  The server 13 stores a device registration database 14, a permission list database 15, and a user portrait database 16 in a storage device. Hereinafter, the database is referred to as “DB”. Information related to the ICT device 11 and user information are registered in the device registration DB 14. In the permission list DB 15, information related to a person who has permitted photographing for the photographing by the ICT device is registered. User portrait data is registered in the user portrait DB 16.

  FIG. 2B shows a system configuration in the portrait right processing phase in the present embodiment. In FIG. 2B, the ICT device 11 communicates with the server 13 using wireless communication. The server 13 performs portrait rights processing on the image transmitted from the ICT device 11 and returns the processed image to the ICT device 11.

  FIG. 3 shows the hardware structure of the ICT device in this embodiment. The ICT device 11 includes a processor 21, a memory 22, a camera 23, a user ID memory 24, a device ID memory 25, a battery 26, a wireless device 27, and a sensor 28. Further, the ICT device 11 has a reset button 29, an operation button 1 (30), an operation button 2 (31), and a power button 32 on the housing surface.

  The processor 21 is an arithmetic device such as an MCU (Micro Control Unit) or an MPU (Micro Processing Unit). The processor 21 includes a storage unit 21a such as a flash memory that stores a program and the like according to the present embodiment. The processor 21 executes the program according to the present embodiment and performs various processes.

  The memory 22 is a storage device including a data storage area, and has an area that can be accessed by the user and an area that cannot be accessed. Alternatively, the memory 22 may be a memory group of a memory device accessible by the user and a memory device not accessible by the user.

  The camera 23 is an imaging device such as a charge coupled device (CCD). The camera 23 may be a built-in type or an external type.

  The user ID memory 24 is a storage device that holds information for identifying a user (user ID). The device ID memory 25 is a storage device that holds device-specific identification information (device ID) such as a device serial number.

  The battery 26 is a rechargeable battery that supplies power to the electronic components that constitute the ICT device. The wireless device 27 is a communication device for performing wireless communication. The sensor 28 is a sensor group such as an acceleration sensor, a gravity sensor, and a gyroscope.

  The reset button 29 is a button for resetting the main body of the ICT device 11. The operation button 1 (30) and the operation button 2 (31) are buttons for operating the ICT device 11, respectively. The power button 32 is a button for starting or shutting down the ICT device 11 main body.

  The ICT device 11 is not limited to a mobile device such as a wearable device, a smartphone, or a tablet terminal, and may be a desktop PC, a notebook PC, or the like.

  FIG. 4 shows an example of the memory of the ICT device in this embodiment. As shown in FIG. 4A, the memory 22 includes a storage area (user not accessible area) 22b that cannot be accessed by the user and a storage area (user accessible area) 22a that can be accessed by the user.

  As shown in FIG. 4B, the memory 22 is a memory group of a memory 22d that cannot be accessed by the user (memory that cannot be accessed by the user) 22d and a memory that can be accessed by the user (memory that can be accessed by the user) 22c. There may be.

  Access to the user inaccessible area 22b and the memory 22d based on user operations is restricted by control by an operating system (OS), firmware, or the like. Therefore, the user cannot access the data held in the user inaccessible area 22b or the memory 22d.

  On the other hand, access based on user operations to the user accessible area 22a and the memory 22c is not restricted. Therefore, the user can access the data held in the user accessible area 22a and the memory 22c.

  Image data that has been captured by the camera 23 and has not yet been subjected to the right processing for the portrait right is stored by the processor 21 in the user inaccessible area 22b and the memory 22d. If the specification guarantees that the image data captured by the camera 23 and the image data that has not been subjected to the right processing for the portrait right will not be accessed by the user, the user inaccessible area 22b or The memory 22d may not be provided.

  The image data captured by the camera 23 and having undergone the right processing for the portrait right is stored by the processor 21 in the user accessible area 22a and the memory 22c.

  In the following, the registration phase of FIG. 2A will be described first, and then the portrait right processing phase of FIG. 2B will be described.

<Registration phase>
FIG. 5 shows an example of a device user registration screen in the present embodiment. As shown in FIG. 2A, the user connects the ICT device 11 to the PC 12 using a USB cable or a wireless local area network (LAN), and accesses the server 13 using a WEB browser.

  At this time, the device user registration screen 41 of FIG. 5 is displayed on the display of the PC 12 based on the WEB browser. The device user registration screen 41 is provided with a user ID input field 42, a user password input field 43, and a login button 44.

  The user logs in to the server 13 by inputting a user ID and a user password registered in advance on the server 13 in the user ID input field 42 and the user password input field 43 and pressing the login button 44. Then, the device ID of the ICT device 11 connected to the PC 12 is registered in the server 13, and the user ID is registered in the ICT device 11.

  Here, the user ID is stored in the user ID memory 24 of the ICT device 11. The device ID is written in the device ID memory 25 at the time of shipment, and information unique to the device such as a device name and a serial number is written in the device ID memory 25. These pieces of information are read from the device ID memory 25, associated with the user ID, and registered in the device registration DB 14 of the server 13.

  FIG. 6 shows an example of the configuration example of the photographing permission setting screen in the present embodiment. The photographing permission setting screen 51 shows an example of a screen displayed by the WEB browser in the server 13 when photographing is permitted between users.

  The photographing permission setting screen 51 includes a photographing permission application list 52, a photographing permission acceptance list 53, a friend list 54, a user ID search input field 55, a search button 56, an “edit portrait” button 57, and an “edit device” button 58. including.

  In order to apply for permission for photographing between users, friend registration as in an existing social networking service (SNS) is made in advance. The friend inputs the user ID of the friend in the user ID search input field 55, presses the search button 56, searches for the user ID, and makes a friend application.

  The friend list 54 displays the user ID of the user who registered as a friend. The photographing permission application list 52 displays information for allowing a friend's photographing to be permitted to a device owned by the photographing permission application list 52. For example, by pressing a button for permission application, a photographing permission request is issued to the corresponding user by e-mail or push communication.

  The shooting permission application list 52 includes a “friend user ID” 52-1, “device ID” 52-2, “shooting permission application (HD image)” 52-3, “shooting permission application (SD image)” 52-4, It includes an item of “photographing permission application (SD image / month 10 images)” 52-5.

  In “Friend user ID” 52-1, the user ID of the friend user is displayed. The “device ID” 52-2 displays the device ID of the logged-in user.

  In the “photographing permission application (HD image)” 52-3, an application for permission of photographing with HD (High Definition) image quality by the ICT device displayed in the “device ID” 52-2 is made to a friend user. Button is displayed. In addition, the “photographing permission application (HD image)” 52-3 displays statuses such as “applying permission”, “permitted”, “NA (Not Applicable)” from a friend user after the permission application. . For example, if “permitted” for an HD image, the resolution (SD image, number limit of SD images) lower than that is automatically permitted, and “NA” is displayed as a status.

  In “photographing permission application (SD image)” 52-4, an application for permission of photographing with SD (Standard Definition) image quality by the ICT device displayed in “device ID” 52-2 is made to a friend user. Button is displayed. In addition, in the “photographing permission application (SD image)” 52-4, after permission application, statuses such as “permitting permission” and “permitted” from a friend user are displayed.

  In the “photographing permission application (SD image / 10 images per month)” 52-5, the ICT device displayed in the “device ID” 52-2 is photographed with SD (Standard Definition) image quality (monthly) to the friend user. A button for applying for permission (up to 10) is displayed. In addition, a status such as “Applying for permission” or “Allowed” from a friend user is displayed in “Photographing permission application (SD image / 10 images per month)” 52-5.

  The photographing permission acceptance list 53 indicates information as to whether or not photographing of the logged-in user is permitted for devices owned by other users. For example, by pressing a permission button, permission is given for a photographing permission request coming from another user.

  The photographing permission acceptance list 53 includes “friend user ID” 53-1, “owned device ID” 53-2, “permit HD image photographing” 53-3, “permit SD image photographing” 53-4, “ "SD image / 10 images per month" 53-5 included.

  In “Friend User ID” 53-1, the user ID of the friend user is displayed. The “owned device ID” 53-2 displays the device ID of the device owned by the friend user. In “Permit HD image shooting” 53-3, an “Allow” button is displayed when a shooting permission application is made from another user to a device owned by another user. When the “permit” button is pressed, “permitted” is displayed. When there is no application for photographing permission from another user, “NA” is displayed in “Permit HD image photographing” 53-3.

  In “Permit SD image shooting” 53-4, an “Allow” button is displayed when another user has made a shooting permission application to a device owned by another user. When the “permit” button is pressed, “permitted” is displayed. When there is no photographing permission application from another user, “NA” is displayed in “Permit SD image photographing” 53-4.

  In “permit SD image / 10 images per month” 53-5, a “permit” button is displayed when there is an application for photographing permission from another user to a device owned by another user. The When the “permit” button is pressed, “permitted” is displayed. When there is no photographing permission application from another user, “NA” is displayed in “Permit SD image photographing” 53-4.

  When the “edit portrait” button 57 is pressed, a transition is made to a screen for editing the user's own portrait (FIG. 7). When the “edit device” button 58 is pressed, a transition is made to a screen (FIG. 8) for editing an ICT device owned by the login user.

The contents registered in the photographing permission setting screen 51 of FIG. 6 are registered in the permission list DB 15.
FIG. 7 shows an example of a portrait editing screen in the present embodiment. The portrait edit screen 61 is displayed by a WEB browser. The portrait editing screen 61 includes a user portrait list 62 and a “return” button 63. In the user portrait list 62, the user can register (upload) and update portrait data such as his / her front image, right image, and left image in the user portrait DB 16. When the “return” button 63 is pressed, the screen returns to the screen of FIG.

  FIG. 8 shows an example of a device editing screen in the present embodiment. The device editing screen 71 is a screen on which a registered ICT device can be updated or deleted. The device editing screen 71 is displayed by a WEB browser. The device editing screen 71 includes a device registration list 72 and a “return” button 73. When the “return” button 73 is pressed, the screen returns to the screen of FIG.

  The device registration list 72 includes items of “device ID” 72-1, “device update” 72-2, “device takeover” 72-3, and “device deletion” 72-4. The “device ID” 72-1 displays the device ID of the device registered by the login user.

  When the “update” button of “device update” 72-2 is pressed, a predetermined screen is displayed, and the device ID can be updated by inputting a new device ID on the screen. When the “takeover” button of “device takeover” 72-3 is pressed, a predetermined screen is displayed. When the device ID of the ICT device that is the data takeover destination is input to this screen, the “device ID” 72-1 is displayed. Data can be transferred from the connected device to the transfer destination. When the “Delete” button of “Delete Device” 72-4 is pressed, the registration of the device itself can be deleted.

  FIG. 9 shows an example of a device registration DB in the present embodiment. The device registration DB 14 includes data items of “device registration No.” 14-1, “user ID” 14-2, and “owned device ID” 14-3.

  In “Device Registration No.” 14-1, a number (device registration No.) uniquely determined from the combination of the user ID and the owned device ID is registered. The “user ID” 14-2 stores information for identifying the user (user ID). In the “owned device ID” 14-3, the device ID of the ICT device 11 is registered.

  FIG. 10 shows an example of the permission list DB in the present embodiment. The permission list DB 15 is a database indicating who has permitted photographing for each of the devices owned by the user.

  The permission list DB 15 includes “permission list No.” 15-1, “device registration number” 15-2, “permitted user ID” 15-3, “HD resolution” 15-4, “SD resolution” 15-5, The data item of “SD resolution / 10 images per month” 15-6 is included.

  In the “permission list No.” 15-1, information for identifying each entry registered in the permission list DB is registered. The “device registration number” 15-2 includes a device registration number, which is a number indicating who owns what device. Is registered. The “permitted user ID” 15-3 includes the device registration number. The user ID of the user who has permitted photographing in the photographing using the device indicated by is registered. In “HD resolution” 15-4, information on whether or not shooting is permitted at HD resolution is registered. In “SD resolution” 15-5, information indicating whether or not photographing is permitted at the SD resolution is registered. In the “SD resolution / 10 images per month” 15-6, the number of images that can be shot at the SD resolution in the month is registered in the range of up to 10 images in one month.

  For example, in FIG. For “000001”, three people, Jack, Michael and Emily, are registered as authorized users.

  FIG. 11 shows an example of the user portrait DB in the present embodiment. The user portrait DB 16 includes “user ID” 16-1, “front view” 16-2, “right image 1” 16-3, “right image 2” 16-4, “left image 1” 16-5, “left”. Data items of “Image 2” 16-6, “Upper image” 16-7, and “Lower image 16-8” are included.

  A user ID is registered in the “user ID” 16-1. In the “front view” 16-2, an image (binary data) obtained by photographing the user from the front is registered. In “right image 1” 16-3 and “right image 2” 16-4, an image (binary data) obtained by photographing the user from the right side is registered. In “left image 1” 16-5 and “left image 2” 16-6, images (binary data) obtained by photographing the user from the left side are registered. In the “upper image” 16-7, an image (binary data) obtained by photographing the user from the upper side is registered. In the “lower image 16-8”, an image (binary data) obtained by photographing the user from the lower side is registered.

  Here, the front image and the right image are not limited to this, but are merely shown as an example of the configuration, and the configuration and data accuracy vary depending on the requirements of the system. It is also conceivable to install a dedicated studio for creating the user portrait DB and provide a portrait creation service to the user there.

  12 to 14 show a permission list DB registration flow in the present embodiment. In the shooting permission setting screen 51 of FIG. 6, when the user applies to a friend for shooting permission for a registered model, that is, when the “permission application” button in the shooting permission application list 52 is pressed (“Yes” in S1). ) The server 13 performs a permission application process (S2).

  When the user presses the “permit” button in the photographing permission acceptance list 53 (“Yes” in S3), the server 13 performs a permission process (S4).

  When the permission application process (S2) is performed, the server 13 uses the user ID of the logged-in user and the owned device ID of the user from the device registration DB 14 to register the device registration number. Is acquired (S11).

  The server 13 acquires the device registration No. acquired from the permission list DB 15. The entry corresponding to is searched (S12). In the permission list DB 15, the acquired device registration No. If there is no entry corresponding to “No” in S12, the server 13 sets the permission list No. of the last entry in the permission list DB 15. A new entry is created by adding 1 to (S13).

  The server 13 adds the device registration No. to the newly created entry. Then, the user ID (friend) of the user who requested the photographing permission is registered (S14), and each entry of HD resolution, SD resolution, SD resolution / month 10 images is initialized with “NO” (S15).

  In the permission list DB 15, the acquired device registration No. If there is an entry corresponding to (Yes in S12), or after the processing in S15, the server 13 determines to which resolution the permission application is a permission application (S16).

  When the permission application is an HD resolution permission application (“Yes” in S16), the server 13 performs the following process on the photographing permission setting screen 51 on the friend side where the friend has logged in. That is, the server 13 “permits” “permit HD resolution” 53-3 corresponding to the user ID of the user who has applied for permission in the photographing permission acceptance list 53 of the photographing permission setting screen 51 on the friend side. Display the button. At this time, the server 13 displays “NA” in the entries of “Allow SD resolution” 53-4 and “Allow SD images / per month 10” 53-4 (S17).

  When the permission application is an SD resolution permission application (“No” in S16, “Yes” in S18), the server 13 performs the following process on the photographing permission setting screen 51 on the friend side where the friend has logged in. That is, the server 13 “permits” “permit SD resolution” 53-4 corresponding to the user ID of the user who has applied for permission in the photographing permission acceptance list 53 of the photographing permission setting screen 51 on the friend side. Display the button. At this time, the server 13 displays “NA” in the entry “SD image / permit 10 images per month” 53-4 (S19).

  If the permission application is an SD image / month permission application (“No” in S18), the server 13 performs the following process on the photographing permission setting screen 51 on the friend side where the friend has logged in. That is, the server 13 sets “SD image / permit 10 images per month” 53-5 corresponding to the user ID of the user who applied for permission in the photographing permission acceptance list 53 on the photographing permission setting screen 51 on the friend side. The “permit” button is displayed (S20).

  When the permission process is performed (S4), the server 13 determines which resolution is the permission button in the shooting permission reception list 53 of the shooting permission setting screen 51 (S21, S25).

  When the “permit” button displayed in the “permit HD resolution” 53-3 of the photographing permission acceptance list 53 is pressed (“Yes” in S 21), the server 13 selects “HD” in the corresponding permission list DB 15. “YES” is set in the entry of “resolution” 15-4. Further, the server 13 sets “-” in the entries of “SD resolution” 15-5 and “SD resolution / 10 sheets per month” 15-6 of the corresponding permission list DB 15 (S22).

  The server 13 sets the entry “Allow HD resolution” 53-3 in the photographing permission acceptance list 53 of the photographing permission setting screen 51 of the login user to “permitted”. Further, the server sets “NA” in the entries of “Allow SD image capture” 53-4 and “Allow SD image / 10 images per month” 53-5 (S23).

  The server 13 sets the entry for “shooting permission application (HD image)” 52-3 in the shooting permission application list 52 on the friend-side shooting permission setting screen 51 to “permitted”. Further, the server 13 sets “NA” in the entries of “shooting permission application (SD image)” 52-4 and “shooting permission application (SD image / 10 images per month)” 52-5 (S24).

  When the “permit” button displayed in the “permit SD resolution” 53-4 of the photographing permission acceptance list 53 is pressed (“Yes” in S25), the server 13 selects “SD” in the corresponding permission list DB 15. “YES” is set in the entry of “resolution” 15-5. Further, the server 13 sets “-” in the entry of “SD resolution / 10 images per month” 15-6 of the corresponding permission list DB 15 (S22).

  The server 13 sets the entry “permitted SD resolution” 53-4 in the photographing permission acceptance list 53 of the photographing permission setting screen 51 of the login user to “permitted”. Also, the server sets “NA” in the entry of “Allow SD image / 10 images per month” 53-5 (S27).

  The server 13 sets the entry for “shooting permission application (SD image)” 52-4 in the shooting permission application list 52 on the shooting permission setting screen 51 on the friend side to “permitted”. Further, the server 13 sets “NA” in the entry of “photographing permission application (SD image / 10 images per month)” 52-5 (S28).

  When the “permit” button displayed in the “permit SD image / permit 10 images” 53-5 of the photographing permission acceptance list 53 is pressed (“No” in S25), the server 13 displays the corresponding permission list. “YES” is set in the entry of “SD resolution / 10 images per month” 15-6 in the DB 15 (S29).

  The server 13 sets the entry “Allow SD images / 10 images per month” 53-5 in the photographing permission acceptance list 53 of the photographing permission setting screen 51 of the login user to “permitted” (S30).

  The server 13 sets the entry for “photographing permission application (SD image / 10 images per month)” 52-5 in the photographing permission application list 52 of the photographing permission setting screen 51 on the friend side to “permitted” (S31).

<Portrait processing phase>
In the following, for a picture taken by a user using an ICT device, the portrait right process is performed on the server side without the user actively performing the portrait right process, and the user uses the image subjected to the portrait right process. Will be described.

Example 1
The first embodiment provides a mechanism in which the system automatically protects privacy on a device basis and on a user basis, regardless of whether or not the user is aware of privacy.

  FIG. 15 is a diagram for explaining processing between the ICT device and the server in the present embodiment (Example 1). The user takes a still image or a moving image using the ICT device 11. The captured image is held in the user inaccessible area 22b or the user inaccessible memory 22d. In the following description, the user inaccessible area 22b is used as an example. However, the user inaccessible memory 22c may be used instead of the user inaccessible area 22b.

  In the ICT device 11, face detection processing (S41) is performed on the image temporarily held in the user inaccessible area 22b. In the face detection process (S41), when a human face is not photographed in the photographed image held in the user inaccessible area 22b, the ICT device 11 performs the following process. That is, the ICT device 11 stores the image data held in the user inaccessible area 22b in the user accessible area 22a or the user accessible memory 22c. In the following description, the user accessible area 22a is used as an example, but a user accessible memory 22c may be used instead of the user accessible area 22a. At this time, the image data held in the user inaccessible area 22b may be deleted or overwritten by newly acquired captured image data.

  When a person's face is photographed in the photographed image, the ICT device 11 sets the device ID of the ICT device 11 and the user ID of the user who uses the device to the device ID memory 25 and the user ID memory. Read from 24 respectively. The ICT device 11 reads captured image data from the user inaccessible area 22b. Then, the ICT device 11 transmits the read device ID and user ID together with the captured image data to the server 13 (S42).

  Here, the algorithm of the face detection process (S41) is determined by actual system requirements, and is not limited to a specific algorithm.

  When the server 13 receives the captured image, the device ID, and the user ID (S43), the device registration No. registered in the device registration DB 14 using the device ID and the user ID. Search for.

  From the device registration DB 14, the device registration No. Is obtained, the server 13 obtains the obtained device registration number. Is used to retrieve the user ID (permitted user ID) of the user who has permitted photographing from the permission list DB 15.

  Next, the server 13 acquires a portrait image for the authorized user from the user portrait DB 16 using the authorized user ID obtained from the authorized list DB 15.

  The server 13 uses the user image obtained from the user portrait DB 16 to perform person image processing (S44) for correcting the captured image.

  In the person image processing (S44), the server 13 leaves an image of the face portion of the person determined to match the image obtained from the user portrait DB 16 in the captured image. On the other hand, the server 13 performs image processing that masks the image of the face portion of the person determined not to match the image obtained from the user portrait DB 16 in S44 so that the person cannot be identified. The masking process is performed by, for example, performing a masking process that deletes the face part, applies mosaic or blur to the face part, and covers and hides the periphery of the eyes. The corrected image is transmitted from the server 13 to the ICT device 11 (S45).

  When receiving the corrected image from the server 13, the ICT device 11 stores it in the user accessible area 22a and displays the image on the display (S46). At this time, the image data held in the user inaccessible area 22b may be deleted or overwritten with a newly acquired captured image. Through this series of processing, the user can access the captured image for the first time.

  FIG. 16 shows an overall flow of portrait right processing in the present embodiment (Example 1). A user takes a picture using the camera 23 of the ICT device. Then, the processor 21 of the ICT device acquires the captured image data output from the camera 23 (S50) and stores it in the user inaccessible area 22b (S51).

  The processor 21 performs face detection processing to determine whether or not a human face is included in the captured image held in the user inaccessible area 22b (S52). If the photographed image does not include a human face (“No” in S52), the processor 21 stores the photographed image in the user accessible area 22a (S63).

  When the photographed image includes a human face (“Yes” in S52), the processor 21 reads out the device ID and the user ID from the device ID memory 25 and the user ID memory 24, respectively. The ICT device 11 reads captured image data from the user inaccessible area 22b. The processor 21 transmits the captured image data, device ID, and user ID to the server 13 (S53).

  The server 13 receives the captured image data, device ID, and user ID transmitted from the ICT device 11 (S54). The server 13 uses the received device ID and user ID from the device registration DB 14 to register the device registration number. Is searched (S55).

  From the device registration DB 14, a device registration No. corresponding to the received combination of device ID and user ID. Is not searched (“No” in S56), the server 13 performs image processing for deleting all the human images from the captured image (S59).

  From the device registration DB 14, a device registration No. corresponding to the received combination of device ID and user ID. Is retrieved (“Yes” in S56), the server 13 obtains the device registration No. acquired in S55. Is used to retrieve the permitted user ID from the permitted list DB 15 (S57).

  From the permission list DB 15, the device registration No. acquired in S55 is registered. If the permitted user ID corresponding to is not found (“No” in S58), the server 13 performs image processing for deleting all human images from the captured image (S59).

  From the permission list DB 15, the device registration No. acquired in S55 is registered. When the permitted user ID corresponding to is searched (“Yes” in S58), the server 13 performs resolution-related image processing (S60). The process of S60 will be described later.

  After the process of S59 or S60, the server 13 transmits the corrected image to the ICT device 11 (S61).

  When the processor 21 receives the corrected captured image data transmitted from the server 13 (S62), the processor 21 stores it in the user accessible area 22a (S63). Depending on the user's operation, the processor 21 may output the captured image stored in the user accessible area 22a to an output device such as a display of the ICT device 11 (S64).

  FIG. 17 shows a flow of resolution-related image processing (S60) in the present embodiment (Example 1). From the permission list DB 15, the device registration No. acquired in S55 is registered. When the authorized user ID corresponding to is retrieved (S57, S58), the server 13 determines the resolution permitted by the authorized user for photographing. That is, the server 13 determines the permitted contents of “HD resolution” 15-4, “SD resolution” 15-5, and “SD resolution / 10 sheets per month” 15-6 corresponding to the retrieved permitted user ID (S71). To S73).

  When “YES” is registered in “HD resolution” 15-4 corresponding to the retrieved permitted user ID (“Yes” in S 71), the server 13 permits HD resolution for the permitted user ID. Information is added (S74).

  When “YES” is registered in the “SD resolution” 15-5 corresponding to the retrieved permitted user ID (“Yes” in S72), the server 13 permits the SD resolution to the permitted user ID. Information is added (S75).

  When one or more values are registered in the “SD resolution / 10 images per month” 15-6 corresponding to the retrieved permitted user ID (“Yes” in S71), the server 13 determines that “SD resolution / month 10”. 1 is subtracted from the value registered in “sheet” 15-6 (S76). Further, the server 13 adds information for permitting the SD resolution to the permitted user ID (S75).

  The server 13 searches the user portrait DB 16 for a corresponding user image using the permitted user ID (S77). When the user image corresponding to the permitted user ID is not searched from the user portrait DB 16 (“No” in S78), the server 13 corrects the image by masking so that the faces of all persons cannot be identified from the captured image. Processing is performed (S83).

  When a user image corresponding to the permitted user ID is searched from the user portrait DB 16 (“Yes” in S78), the server 13 determines whether the resolution of the captured image is HD resolution or SD resolution (S79).

  When the resolution of the captured image is the HD resolution (“Yes” in S79), the server 13 determines whether the permitted user ID includes additional information that permits the HD resolution (S81). If the permitted user ID includes additional information that permits HD resolution (“Yes” in S81), the server 13 uses the acquired user image to leave the face of the corresponding user and the faces of all other persons. Is corrected by masking so that it cannot be specified (S82). If there is no additional information that permits HD resolution in the permitted user ID (“No” in S81), the server 13 performs image processing for correcting by masking so that all human faces cannot be specified from the captured image ( S83).

  When the resolution of the captured image is the SD resolution (“No” in S79), the server 13 determines whether the permitted user ID includes additional information that permits the SD resolution (S80). When the permitted user ID includes additional information that permits SD resolution (“Yes” in S80), the server 13 uses the acquired user image to leave the face of the corresponding user and the faces of all other persons. Is corrected by masking so that it cannot be specified (S82). If there is no additional information for permitting SD resolution in the permitted user ID (“No” in S80), the server 13 performs image processing for correcting by masking so that all human faces cannot be identified from the captured image ( S83).

  In addition, when the radio wave condition around the ICT device is bad and out of service area, the ICT device 11 cannot communicate with the server 13 and cannot transmit a captured image to the server 13. In this case, the ICT device 11 may hold the captured image in the user inaccessible area 22b until the radio wave state is improved, and may transmit the captured image to the server 13 when the radio wave state is improved.

  By performing the series of processes described above, the user can leave the face image of a person (for example, a family member or friend) registered in association with the user's own ICT device. The face image is automatically deleted or a mosaic is added. Therefore, according to the system according to the present embodiment (Example 1), an image in consideration of the portrait right can be obtained without the user being conscious.

(Example 2)
In the second embodiment, a system in which the configuration on the server side is changed will be described. In the second embodiment, the same configurations, the same functions, or the same processes as those in the first embodiment are denoted by the same reference numerals as those in the first embodiment, and the description thereof is omitted.

  FIG. 18 is a diagram for explaining processing between the ICT device, the image processing server, and the DB server in the present embodiment (Example 2). In the system of the second embodiment, the server 13 of the first embodiment is divided into an image processing server 13a and a DB server 13b, and other configurations and functions are the same as the system configuration and functions of FIG. The image processing server 13a corrects the image. The DB server 13b manages user information. The processing flow of the second embodiment is the same as that of the first embodiment.

(Example 3)
In the first embodiment, when a human face is detected from a captured image, the captured image is transmitted to the server to perform portrait right processing. On the other hand, in the third embodiment, regardless of whether or not a human face has been detected from the captured image, the captured image is transmitted to the server to perform portrait right processing. In the third embodiment, the same configurations, the same functions, or the same processes as those in the first or second embodiment are given the same reference numerals as those in the first or second embodiment, and the description thereof is omitted.

  FIG. 19 is a diagram for explaining processing between the ICT device and the server in the present embodiment (Example 3). In the third embodiment, the face detection process (S41) in the ICT device of the first embodiment is not performed, and other configurations and functions are the same as the system configuration and functions of FIG. An image photographed by the ICT device is temporarily stored in the user inaccessible area 22b and then transmitted to the server 13 regardless of whether or not a human face is included in the image.

  FIG. 20 shows an overall flow of portrait right processing in the present embodiment (Example 3). In the flow of FIG. 20, the determination process of S52 is deleted from the flow of FIG. Therefore, the ICT device 11 temporarily holds the captured image in the user inaccessible area 22b (S51), and then transmits it to the server 13 regardless of whether a human face is included (S53).

  According to the third embodiment, since the face detection process is not performed by the ICT device 11, the processing load on the ICT device 11 can be reduced.

Example 4
In the first embodiment, the entire captured image is sent to the server 13. On the other hand, in Example 4, the image of the face portion extracted from the captured image is sent to the server 13 to perform the portrait right process. In the fourth embodiment, the same configurations, the same functions, or the same processes as those in the first to third embodiments are denoted by the same reference numerals as those in the first to third embodiments, and the description thereof is omitted.

  FIG. 21 is a diagram for explaining processing between the ICT device and the server in the present embodiment (Example 4). In the fourth embodiment, the processes of S71 to S73 are added to the process of the ICT device 11 in the first embodiment.

  In the ICT device 11, the captured image data captured by the camera 23 is temporarily held in the user inaccessible area 22b. Face detection processing is performed on the captured image held in the user inaccessible area 22b (S41). When a human face is detected from the photographed image data by the face detection process, the ICT device 11 cuts out an image (face image) of only the detected face portion from the photographed image held in the user inaccessible area 22b. (S71). The ICT device 11 transmits the cut face image together with the device ID and the user ID to the server 13 (S42).

  Upon receiving the face image, device ID, and user ID transmitted from the ICT device (S43), the server 13 performs correction processing (person image processing) on the face image as in the first embodiment (S44). After performing the person image processing on the face image, the server 13 transmits the face image processed for the person image to the ICT device 13 (S45).

  When the ICT device 11 receives the human image processed face image transmitted from the server 13 (S72), the ICT device 11 combines the human image processed face image and the captured image held in the user inaccessible area 22b ( S73). As a result, an entire image with the face part corrected is obtained. The obtained entire image is stored in the user accessible area 22a and output so that the user can view it.

  FIG. 22 shows an overall flow of portrait right processing in the present embodiment (Example 4). In the flow of FIG. 20, the processes of S81 and S82 are added to the flow of FIG. In the flow of FIG. 22, the image data of S53 to S62 is image (face image) data of the face portion extracted from the photographed image.

  In S52, the processor 21 performs face detection processing to determine whether or not a human face is included in the captured image held in the user inaccessible area 22b. When the photographed image includes a human face (“Yes” in S52), the processor 21 performs face extraction processing, and from the photographed image, an image (face image) of only the detected face portion. Extract (S81).

  The processor 21 reads the device ID and the user ID from the device ID memory 25 and the user ID memory 24, respectively. The processor 21 transmits image (specifically, face image) data, device ID, and user ID to the server 13 (S53). Thereafter, the processes of S53 to S62 are performed on the face image, similarly to the flow of FIG.

  The ICT device 11 receives the face image processed with the person image from the server 13 (S62), combines the face image processed with the person image and the captured image held in the user inaccessible area 22b (S82), Save in the user accessible area 22a (S63). Depending on the user's operation, the ICT device 11 may output the captured image stored in the user accessible area 22a to an output device such as a display of the ICT device 11 (S64).

  According to the fourth embodiment, the amount of communication data between the ICT device 11 and the server 13 can be reduced, which is suitable for a system having a narrow communication line bandwidth.

(Example 5)
In the fifth embodiment, in addition to the first embodiment, the name of the authorized user is further given to the image. In the fifth embodiment, the same configurations, the same functions, or the same processes as those in the first to fourth embodiments are denoted by the same reference numerals as those in the first to fourth embodiments, and the description thereof is omitted.

  FIG. 23 is a diagram for explaining processing between the ICT device and the server in the present embodiment (Example 5). In the fifth embodiment, the process of S91 is added to the process of the server 13 in the first embodiment, and the user portrait DB 16 is replaced with the user portrait DB 16a.

  When performing person image processing, if it is possible to add names of persons (persons permitted to shoot) that can be left in the image, convenience for the user may be improved. Therefore, in the fifth embodiment, following the person image process (S44), by adding a person name addition process (S91) using the user portrait DB 16a, it is possible to clearly indicate the names of users who can be imaged. . Since other processes are the same as those in the first embodiment, description thereof is omitted.

  FIG. 24 shows an example of a user portrait DB in the present embodiment (Example 5). The user portrait DB 16a is obtained by adding a “name” column 16-11 to the user portrait DB 16 of FIG. The “name” column 16-11 stores the name of the person identified by the user ID.

  FIG. 25 shows the overall flow of portrait right processing in the present embodiment (Example 5). In the flow of FIG. 24, the process of S101 is added between S60 and S61 of the flow of FIG. After the resolution-related image processing in S60, the server 13 acquires a “name” corresponding to the permitted user ID from the user portrait DB 16a, and adds the acquired name to the resolution-processed image processed image (S101). The user name may be added on the image, may be added as header information of the image, or may be output as data different from the image.

  After the processing of S59 or S101, the server 13 transmits the corrected image to the ICT device 11 (S61). Since the subsequent processing is the same as that in FIG. 16, the description thereof is omitted.

(Example 6)
In the sixth embodiment, in addition to the first embodiment, when a wanted person or a missing person is reflected in the captured image, alert information is added to the captured image. In the sixth embodiment, the same configurations, the same functions, or the same processes as those in the first to fifth embodiments are given the same reference numerals as those in the first to fifth embodiments, and the description thereof is omitted.

  FIG. 26 is a diagram for explaining processing between the ICT device and the server in the present embodiment (Example 6). In the sixth embodiment, the processing of S111 is added to the processing of the server 13 in the first embodiment, and the wanted person / missing person portrait DB 81 is added to the storage device of the server 13.

  In Example 5, when searching for a person's face, the person's name was also acquired, and name information was added to the image. On the other hand, in the sixth embodiment, a wanted person / missing person portrait DB 81 is added to the server 13. As a result, portrait rights are protected, and at the same time, it is checked whether the wanted person or missing person is photographed in the image taken by the user, and if the wanted person or missing person is photographed , Add an alert to the shot image and output it.

  FIG. 27 shows an example of the wanted person / missing person portrait DB in the present embodiment (Example 6). The wanted person / missing person portrait DB 81 includes “name” 81-1, “attribute” 81-2, “front view” 81-3, “right image 1” 81-4, and “right image 2” 81-5. , “Left image 1” 81-6, “left image 2” 81-7, “upper image” 81-8, and “lower image” 81-9.

  “Name” 81-1 stores the nomination of the wanted person or the missing person. The “attribute” 81-2 stores information indicating whether the person with the name stored in the “name” 81-1 is a wanted person or a missing person.

  “Front Image” 81-3, “Right Image 1” 81-4, “Right Image 2” 81-5, “Left Image 1” 81-6, “Left Image 2” 81-7, “Upper Image” 81- 8. In the column of “lower image” 81-9, face image data of the person with the name stored in “name” 81-1 is stored. Here, the front image and the right image are not limited to this, but are shown as an example, and the configuration and data accuracy vary depending on the requirements of the system.

  FIG. 28 shows the entire flow of portrait right processing in the present embodiment (Example 6). In the flow of FIG. 28, the processes of S121 to S123 are added between S60 and S61 of the flow of FIG.

  After the resolution-related image processing in S60, the server 13 collates the person image included in the image data received in S54 with each portrait data of the person registered in the wanted person / missing person portrait DB 81. Thereby, the server 13 searches for the person registered in the wanted person / missing person portrait DB 81 from the image data received in S54 (S121).

  When a person registered in the wanted person / missing person portrait DB 81 is searched from the image data received in S54 (“Yes” in S122), the server 13 adds alert information to the image after the process in S59 or S101. It is added (S123). Here, the alert information includes information indicating that the searched person is a wanted person or missing person, or information indicating that the searched person is a wanted person or missing person. In addition, the name of the retrieved person may be added.

  After the process of S123, the server 13 transmits the corrected image to the ICT device 11 (S61). Since the subsequent processing is the same as that in FIG. 16, the description thereof is omitted.

  FIG. 29 is a block diagram showing the hardware environment of the server in this embodiment. The server 13 includes an output I / F 91, a CPU 92, a ROM 93, a communication I / F 94, an input I / F 95, a RAM 96, a storage device 97, a reading device 98, and a bus 99. The server 13 can be connected to the output device 101 and the input device 102.

  Here, CPU indicates a central processing unit. ROM indicates a read-only memory. RAM indicates random access memory. I / F indicates an interface. An output I / F 91, CPU 92, ROM 93, communication I / F 94, input I / F 95, RAM 96, storage device 97, and reading device 98 are connected to the bus 99. The reading device 98 is a device that reads a portable recording medium. The output device 101 is connected to the output I / F 91. The input device 102 is connected to the input I / F 95.

  As the storage device 97, various types of storage devices such as a hard disk drive, a flash memory device, and a magnetic disk device can be used.

  For example, the storage device 97 or the ROM 93 stores a program that realizes the server-side processing described in the present embodiment. Alternatively, the storage device 97 or the ROM 93 stores a device registration DB 14, a permission list DB 15, user portrait DBs 16 and 16 a, and a wanted person / missing person portrait DB 81.

  The CPU 92 reads a program that realizes the server-side processing described in the present embodiment, which is stored in the storage device 97 or the like, and executes the program.

  The program that realizes the server-side processing described in the present embodiment may be stored, for example, in the storage device 97 via the communication network 100 and the communication I / F 94 from the program provider side. Moreover, the program which implement | achieves the process demonstrated in 1st or 2nd embodiment may be stored in the portable storage medium marketed and distribute | circulated. In this case, the portable storage medium may be set in the reading device 98 and the program read by the CPU 92 and executed. As the portable storage medium, various types of storage media such as a CD-ROM, a flexible disk, an optical disk, a magneto-optical disk, an IC (integrated circuit) card, and a USB (Universal Serial Bus) memory device can be used. The program stored in such a storage medium is read by the reading device 98.

  As the input device 102, a keyboard, a mouse, an electronic camera, a web camera, a microphone, a scanner, a sensor, a tablet, a touch panel, or the like can be used. The output device 101 can be a display, a printer, a speaker, or the like. The network 100 may be a communication network such as the Internet, a LAN, a WAN, a dedicated line, a wired line, and a wireless line.

  According to the present embodiment, the user can use the device with more peace of mind by considering the system side without making the user aware of the user side. Further, if the user of the ICT device 11 uses the registered ICT device, the use is not restricted for the purpose of protecting the privacy. In addition, as the number of registered ICT devices increases, it is possible to reduce the risk of infringement of portrait rights on the side where the image is taken. For device manufacturers, a registered ICT device is recognized as a privacy-friendly device, which is one of the criteria for reliability for general consumers.

  The present invention is not limited to the above-described embodiment, and various configurations or embodiments can be taken without departing from the gist of the present invention.

Regarding the above embodiment, the following additional notes are disclosed.
(Appendix 1)
On the computer,
First image data obtained by imaging is acquired before being stored in a state where the user can use it,
When the acquired first image data includes a person who does not have imaging permission, the second image data subjected to image processing so that the person cannot be specified is stored in the first storage area. Portrait rights protection program.
(Appendix 2)
In the acquisition of the first image data, the first image data is held in a second storage area that cannot be accessed by a user;
The portrait right protection program according to appendix 1, wherein the second image data is saved by executing a process of saving the second image data in the first storage area accessible to the user.
(Appendix 3)
In addition to the computer,
Transmitting the acquired first image data to a server device;
Receiving the second image data on which the image processing has been performed by the server device;
3. The portrait right protection program according to appendix 1 or 2, wherein, in storing the second image data, the received second image data is stored in the first storage area.
(Appendix 4)
In the transmission, when a human face is detected from the acquired first image data, the first image data is transmitted to the server device,
In addition to the computer,
The portrait right protection program according to appendix 1 or 2, wherein a process of storing the first image data in the first storage area is executed when the face is not detected from the acquired first image data.
(Appendix 5)
In the transmission, when a human face is detected from the acquired first image data, the image data of the face portion extracted from the first image data is transmitted to the server device,
Processing for storing the second image data, which is an image obtained by combining the image data of the face portion that has been subjected to the image processing received from the server device and the acquired first image data, in the first storage area The portrait right protection program according to supplementary note 1 or 2, wherein
(Appendix 6)
A first storage unit for storing information;
An imaging unit for imaging and outputting image data;
When the first image data output from the imaging unit is acquired before being stored in a usable state by the user, and a person who does not have imaging permission is reflected in the acquired first image data, A storage control unit that stores, in the first storage unit, second image data that has been subjected to image processing so that the person cannot be identified;
An information communication device comprising:
(Appendix 7)
The information communication device further includes:
A second storage unit that the user cannot access,
The storage control unit stores the acquired first image data in the second storage unit, and stores the second image data subjected to the image processing in the first storage unit accessible by the user. The information communication apparatus according to appendix 6, wherein the information communication apparatus is executed.
(Appendix 8)
The information communication device further includes:
A communication unit that transmits the acquired first image data to a server device and receives the second image data that has been subjected to the image processing by the server device;
The information communication device according to appendix 6 or 7, wherein the storage control unit stores the received second image data in the first storage unit.
(Appendix 9)
The information communication device further includes:
A face detection unit for detecting a human face from the acquired first image data;
When the face is detected from the acquired first image data, the communication unit transmits the first image data to the server device,
The information communication apparatus according to appendix 8, wherein the storage control unit executes a process of storing the first image data in the first storage unit when the face is not detected from the acquired first image data.
(Appendix 10)
The information communication device further includes:
A face detection unit that extracts face image data from the first image data when a human face is detected from the acquired first image data;
The communication unit transmits the extracted image data of the face part to the server device,
The storage control unit generates the second image data obtained by combining the image data of the face portion that has been subjected to the image processing received from the server device and the acquired first image data, The information communication apparatus according to appendix 6, wherein the second image data is stored in the first storage unit.
(Appendix 11)
The information communication device acquires the first image data obtained by imaging before being stored in a state where the user can use it, and transmits the first image data to the server device.
The server device performs image processing so that the person cannot be identified when a person who does not have imaging permission is captured in the first image data, and the second image data subjected to the image processing is transmitted to the information communication To the device,
The information communication device stores the second image data received from the information communication device in a first storage area accessible by the user.
(Appendix 12)
In the acquisition of the first image data, the first image data is held in a second storage area that cannot be accessed by a user;
12. The portrait right protection method according to appendix 11, wherein the second image data is stored by executing a process of storing the second image data in the first storage area accessible to the user.
(Appendix 13)
The information communication device further includes:
When a human face is detected from the first image data, the first image data is transmitted to the server device,
The portrait right protection method according to appendix 9, wherein the acquired first image data is stored in the first storage area when the face is not detected from the first image data.
(Appendix 14)
The information communication device further includes:
When a human face is detected from the acquired first image data, the image data of the face portion extracted from the first image data is transmitted to the server device,
The second image data, which is image data obtained by combining the image data of the face portion that has been subjected to the image processing received from the server device and the acquired first image data, is stored in the first storage area. The method for protecting a portrait right according to appendix 9, wherein

DESCRIPTION OF SYMBOLS 1 Portrait right protection system 2 Information communication apparatus 3 Memory | storage part 3a 1st memory area 3b 2nd memory | storage area 4 Imaging part 5 Storage control part 6 Communication part 7 Face detection part 8 Server apparatus 11 ICT device 12 PC
13 Server 14 Device registration DB
15 Allow list DB
16 User portrait DB
21 processor 22 memory 22a user accessible area 22b user inaccessible area 22c user accessible memory 22d user inaccessible memory 23 camera 24 user ID memory 25 device ID memory 26 battery 27 wireless device 28 sensor

Claims (7)

On the computer,
First image data obtained by imaging is acquired before being stored in a state where the user can use it,
When the acquired first image data includes a person who does not have imaging permission, the second image data subjected to image processing so that the person cannot be specified is stored in the first storage area. Portrait rights protection program. In the acquisition of the first image data, the first image data is held in a second storage area that cannot be accessed by a user;
2. The portrait right protection program according to claim 1, wherein in storing the second image data, a process of saving the second image data in the first storage area accessible by the user is executed. 3. In addition to the computer,
Transmitting the acquired first image data to a server device;
Receiving the second image data on which the image processing has been performed by the server device;
3. The portrait right protection program according to claim 1, wherein in storing the second image data, the received second image data is stored in the first storage area. 4. In the transmission, when a human face is detected from the acquired first image data, the first image data is transmitted to the server device,
In addition to the computer,
The portrait right protection program according to claim 1 or 2, wherein when the face is not detected from the acquired first image data, a process of storing the first image data in the first storage area is executed. In the transmission, when a human face is detected from the acquired first image data, the image data of the face portion extracted from the first image data is transmitted to the server device,
Processing for storing the second image data, which is an image obtained by combining the image data of the face portion that has been subjected to the image processing received from the server device and the acquired first image data, in the first storage area The portrait right protection program according to claim 1 or 2, wherein: A storage unit for storing information;
An imaging unit for imaging and outputting image data;
When the first image data output from the imaging unit is acquired before being stored in a usable state by the user, and a person who does not have imaging permission is reflected in the acquired first image data, A storage control unit that stores, in the first storage area, second image data that has been subjected to image processing so that the person cannot be identified;
An information communication device comprising: The information communication device acquires the first image data obtained by imaging before being stored in a state where the user can use it, and transmits the first image data to the server device.
The server device performs image processing so that the person cannot be identified when a person who does not have imaging permission is captured in the first image data, and the second image data subjected to the image processing is transmitted to the information communication To the device,
The information communication device stores the second image data received from the information communication device in a first storage area accessible by the user.

Images