JP2014082695A - Portable terminal device, portable terminal system, control method of portable terminal device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal device capable of protecting the privacy of a person photographed by a camera part.SOLUTION: The portable terminal device comprises: a camera part 5; an arithmetic part 10 which performs image processing on photographed image data 8 photographed by the camera part 5 to generate processed image data 23; and a memory 20 for storing the photographed image data 21 and the processed image data 23. The arithmetic part 10 detects a face included in the photographed image data 8, determines whether the detected face is included in identification information 22 being face information of a specific person, and if the detected face is not included in the identification information 22, performs image processing for making individual identification difficult, on the detected face included in the photographed image data 8, to generate the processed image data 23.

Description

  The present invention relates to a mobile terminal device, a mobile terminal system, a control method for a mobile terminal device, and a program, and more particularly to a mobile terminal device having a camera function, a mobile terminal system, a control method for a mobile terminal device, and a program.

  In recent years, portable terminal devices having a camera function have been widely used. For example, users can easily share images taken with a mobile terminal device with others. On the other hand, there is a case where an unintended person is reflected in an image taken by the user. In such a case, for example, if an image taken by the user is uploaded to the web or the like, there is a possibility that an unintended person's privacy problem may occur.

  Patent Document 1 discloses a technique related to an electronic camera that can perform image processing without taking time and effort on a captured image. Patent Document 2 discloses a technology related to a face collation device that protects the privacy of a person other than a specific person and can easily check information other than the face of the specific person and the situation around the specific person. Patent Document 3 discloses a technology related to an information processing apparatus capable of reducing privacy problems that occur to users when sharing image data.

JP 2010-21922 A JP 2004-62560 A JP 2012-18557 A

  As described in the background art, when a user who possesses a mobile terminal device takes a picture with the camera unit, an unintended person may appear in the taken image. In such a case, for example, when a user uploads a captured image to the web or the like, there is a possibility that an unintended person's privacy problem may occur.

  In view of the above problems, an object of the present invention is to provide a mobile terminal device, a mobile terminal system, a control method for the mobile terminal device, and a program capable of protecting the privacy of a person photographed by a camera unit.

  A portable terminal device according to the present invention includes a camera unit, a calculation unit that performs image processing on the first image data captured by the camera unit to generate second image data, and the first and second And a memory for storing image data. The calculation unit detects a face included in the first image data, determines whether or not the detected face is included in identification information that is face information of a specific person, and performs the detection If the identified face is not included in the identification information, the detected image included in the first image data is subjected to image processing that makes it difficult to identify an individual, and the second image data is Generate.

  A portable terminal system according to the present invention includes a first portable terminal device and a second portable terminal device. The first portable terminal device includes: a camera unit; an arithmetic unit that performs image processing on the first image data captured by the camera unit to generate second image data; and the first and second A first memory for storing image data, and the second portable terminal device includes at least a second memory for storing identification information which is face information of a specific person. When the first portable terminal device requests the second portable terminal device to provide the identification information, and the second portable terminal device permits the provision of the identification information, the first portable terminal device The mobile terminal device acquires the identification information from the second mobile terminal device. The calculation unit detects a face included in the first image data, determines whether or not the detected face is included in the identification information, and the detected face is the identification information. Is not included in the first image data, the detected image included in the first image data is subjected to image processing that makes it difficult to identify an individual to generate second image data.

  The control method of the mobile terminal device according to the present invention detects a face included in the first image data photographed by the camera unit, and the detected face is used as identification information that is face information of a specific person. If it is determined whether or not the detected face is included in the identification information, it is difficult to identify an individual in the detected face included in the first image data. Image processing is performed to generate second image data.

  The program according to the present invention detects a face included in the first image data photographed by the camera unit, and whether or not the detected face is included in identification information that is face information of a specific person. If the detected face is not included in the identification information, image processing that makes it difficult to identify an individual is performed on the detected face included in the first image data. It is a program for making a portable terminal device perform processing which generates the 2nd image data.

  According to the present invention, it is possible to provide a portable terminal device, a portable terminal system, a portable terminal device control method, and a program capable of protecting the privacy of a person photographed by the camera unit.

1 is a block diagram illustrating a mobile terminal device according to a first exemplary embodiment; 3 is a flowchart for explaining an operation of the mobile terminal device according to the first exemplary embodiment; 3 is a flowchart for explaining an operation of the mobile terminal device according to the first exemplary embodiment; FIG. 3 is a diagram illustrating an example of captured image data captured by the mobile terminal device according to the first exemplary embodiment. FIG. 3 is a diagram illustrating an example of processed image data processed by the mobile terminal device according to the first exemplary embodiment; FIG. 6 is a diagram showing another example of processed image data processed by the mobile terminal device according to the first exemplary embodiment; It is a block diagram which shows the portable terminal system concerning Embodiment 2. FIG. 6 is a flowchart for explaining an operation of the mobile terminal system according to the second exemplary embodiment; It is a figure which shows an example of the processed image data processed with the portable terminal system concerning Embodiment 2. FIG. It is a figure which shows the other example of the processed image data processed with the portable terminal system concerning Embodiment 2. FIG. It is a figure which shows an example of identification information.

<Embodiment 1>
Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram of the mobile terminal device 1 according to the first embodiment. A mobile terminal device 1 according to the present embodiment includes a camera unit 5, a communication unit 6, a calculation unit 10, and a memory 20. The calculation unit 10 includes a face detection unit 11, a face determination unit 12, and an image processing unit 13. The memory 20 stores captured image data 21, identification information 22, and processed image data 23.

  The mobile terminal device 1 according to the present embodiment may be any mobile terminal device as long as the mobile terminal device has a camera function. The mobile terminal device 1 according to the present embodiment is, for example, a smartphone, a tablet-type mobile terminal device, a mobile phone, a game machine, an electronic book terminal, or the like. The mobile terminal device 1 according to the present embodiment may be a digital camera.

  The camera unit 5 captures a subject to be imaged, generates captured image data (first image data) of the captured subject, and outputs the generated captured image data 8 to the arithmetic unit 10. The camera unit 5 can capture still images and moving images, and the generated captured image data 8 may be a still image or a moving image.

  The calculation unit 10 performs image processing on the captured image data 8 captured by the camera unit 5. Specifically, the calculation unit 10 detects a face included in the captured image data 8, and determines whether or not the detected face is included in identification information that is face information of a specific person. If the detected face is not included in the identification information, the detected face included in the captured image data 8 is subjected to image processing that makes it difficult to identify an individual, and processed image data (second Image data). The calculation unit 10 will be described in detail below.

  As illustrated in FIG. 1, the calculation unit 10 includes a face detection unit 11, a face determination unit 12, and an image processing unit 13. The face detection unit 11 detects a face included in the captured image data 8 captured by the camera unit 5. For example, the face detection unit 11 can detect a face by determining whether or not the photographed image data 8 includes a human face characteristic part (such as eyes, nose, and mouth). Note that any other method may be used as the face detection method. In particular, in the present embodiment, the face detection unit 11 can determine whether or not the captured image data 8 includes face information that can identify an individual.

  The face detection unit 11 sets an access restriction on the captured image data 8 when the captured image data 8 does not include a face, that is, when the captured image data 8 does not include face information that can identify an individual. The captured image data 8 is stored in the memory 20 without doing so. In other words, in this case, the photographed image data 21 stored in the memory 20 does not include face information that can identify an individual, so that there is no privacy problem. Therefore, the user of the mobile terminal device 1 can use the captured image data 21 without limitation. For example, the user transmits the captured image data 21 to another mobile terminal device via the communication unit 6 or the captured image data to another electronic device via an external interface (not shown) provided in the mobile terminal device 1. Data 21 can be moved or printed.

  On the other hand, the face detection unit 11 restricts access to the captured image data 8 when the captured image data 8 includes a face, that is, when the captured image data 8 includes face information that can identify an individual. And the captured image data 8 is stored in the memory 20. That is, in this case, since the captured image data 21 stored in the memory 20 includes face information that can identify an individual, a privacy problem arises. Therefore, in order to protect the privacy of the individual shown in the photographed image data 21, it is necessary to provide a predetermined access restriction for the photographed image data 21.

  For example, the computing unit 10 can set access restrictions by disabling the use of the captured image data 21 outside the mobile terminal device 1. In other words, the user transmits the captured image data 21 to another mobile terminal device via the communication unit 6, or the captured image is transmitted to another electronic device via an external interface (not shown) provided in the mobile terminal device 1. Moving or printing the data 21 can be prohibited. Further, as an example of access restriction, the captured image data 21 may be displayed only on a display unit (not shown) provided in the mobile terminal device 1.

  When the face detection unit 11 determines that the captured image data 8 includes a face, the face determination unit 12 determines whether the face detected by the face detection unit 11 is a face of a specific person. . That is, the face determination unit 12 reads the captured image data 21 including the face from the memory 20 and extracts the face information included in the captured image data 21. Also, the identification information 22 stored in the memory 20 is acquired. Then, the face information (that is, the face detected by the face detection unit 11) included in the captured image data 21 is compared with the identification information 22, and the face information included in the captured image data 21 is identified. Can be determined that the face information included in the captured image data 21 is included in the identification information 22. When the similarity between the face information included in the captured image data 21 and the identification information 22 is equal to or greater than a predetermined threshold, the face determination unit 12 uses the face information included in the captured image data 21 as the identification information 22. It may be determined that it is included.

  Here, the identification information 22 is face information of a specific person, and even if the face of the specific person is included in the captured image data 21 captured by the camera unit 5, the identification information 22 does not cause a privacy problem. It is face information. For example, it is assumed that the owner of the mobile terminal device 1 is the person A and the friend of the person A is the person B. In this case, the face information (face image data) of the person A and the person B is stored in the memory 20 in advance as the identification information 22 in the mobile terminal device 1.

  When the face determination unit 12 determines that the face detected by the face detection unit 11 is not included in the identification information 22, the image processing unit 13 identifies the identification information 22 among the faces included in the captured image data 21. Image processing that makes it difficult to identify an individual is applied to a face that is not included. Then, the image data obtained by performing image processing on the captured image data 21 is stored in the memory 20 as processed image data 23. Here, the image processing that makes it difficult to identify an individual is, for example, processing (masking processing, blurring processing, or the like) that masks a face area that is not included in the identification information 22. Further, for example, trimming may be performed so as not to include a face area not included in the identification information 22. These processes can be selected by the user.

  Note that these image processes are merely examples, and the process performed on the face that is not included in the identification information 22 may be any image process as long as it is difficult to identify an individual. In addition, for example, when a large number of faces are included in one captured image data such as a group photo, the content of default image processing is set in advance in order to reduce the operation load on the user. Also good.

  The image processing unit 13 performs image processing on all faces not included in the identification information 22 among the faces included in the captured image data 21, and then processes the image data subjected to the image processing into processed image data 23. Is stored in the memory 20. Here, since the processed image data 23 has already undergone image processing, there is no privacy problem. Therefore, it is not necessary to set an access restriction on the processed image data 23, and the user can use the processed image data 23 by an arbitrary method. For example, the user transmits the processed image data 23 to another portable terminal device via the communication unit 6 or processes the processed image data 23 to another electronic device via an external interface (not shown) provided in the portable terminal device 1. The completed image data 23 can be moved or printed.

  The memory 20 stores captured image data 21, identification information 22, and processed image data 23. The captured image data 21 is image data obtained by capturing with the camera unit 5. As described above, when the face detection unit 11 determines that the photographed image data 8 includes a face, access restriction is set on the photographed image data 21. On the other hand, when the face detection unit 11 determines that no face is included in the captured image data 8, no access restriction is set for the captured image data 21.

  The identification information 22 is face information of a specific person. The mobile terminal device 1 may register the identification information 22 acquired via the communication unit 6 or an external interface (not shown) in the memory 20, and the captured image data 8 captured by the camera unit 10 as the identification information 22. You may register.

  The processed image data 23 is image data after being processed by the image processing unit 13. As described above, since the processed image data 23 has already undergone image processing, there is no privacy problem. Therefore, it is not necessary to set an access restriction on the processed image data 23, and the user can use the processed image data 23 by an arbitrary method.

  For example, when the captured image data 21 and the processed image data 23 are stored in the memory 20, folders to be stored may be divided depending on whether access is restricted. Specifically, the captured image data 21 for which access restrictions are not set and the processed image data 23 are stored in a folder for which access restrictions are not set, and the captured image data 21 for which access restrictions are set are stored. May be stored in a folder in which access restrictions are set.

  Next, operation | movement of the portable terminal device 1 concerning this Embodiment is demonstrated using the flowchart shown to FIG. 2, 3, and the image data shown to FIGS. In the following, it is assumed that the identification information 22 of the person A and the person B is stored in the memory 20 in advance.

  As shown in the flowchart of FIG. 2, the camera unit 5 is used to photograph a subject to be photographed (step S1). The camera unit 5 generates captured image data 8 of the captured subject, and outputs the generated captured image data 8 to the arithmetic unit 10. FIG. 4 shows the captured image data 8 at this time (the captured image data 8 and the captured image data 21 stored in the memory 20 are the same). The captured image data includes person A, person B, The background is shown with four persons, Person C and Person D.

  The face detection unit 11 of the calculation unit 10 detects a face included in the captured image data 8 captured by the camera unit 5 (step S2). For example, the face detection unit 11 can detect a person's face by determining whether or not the photographed image data 8 includes a characteristic part (eyes, nose, mouth, etc.) of the person's face. . In the present embodiment, the face detection unit 11 can determine whether or not the captured image data 8 includes face information that can identify an individual.

  When the captured image data 8 includes a face, that is, when the captured image data 8 includes face information that can identify an individual (step S3: Yes), the face detection unit 11 captures the captured image data. The access restriction is set to 8 (step S4). Then, the captured image data 8 after the access restriction is set is stored in the memory 20 (step S5). For example, since the captured image data shown in FIG. 4 includes the faces of the person A, person B, person C, and person D, a privacy problem arises. Therefore, in order to protect the privacy of the individual shown in the captured image data, a predetermined access restriction is set for the captured image data.

  On the other hand, when the captured image data 8 does not include a face, that is, when the captured image data 8 does not include face information that can identify an individual (step S3: No), the face detection unit 11 captures an image. The captured image data 8 is stored in the memory 20 without setting access restrictions on the image data 8 (step S5). That is, in this case, since the photographed image data 21 stored in the memory 20 does not include a face, there is no privacy problem. Therefore, the user can use the captured image data 21 without limitation.

  Next, image processing will be described using the flowchart shown in FIG. If it is determined in step S3 in FIG. 2 that the captured image data 8 includes a face, the captured image data 8 needs to be subjected to image processing.

  First, the face determination unit 12 of the calculation unit 10 reads the captured image data 21 including the face from the memory 20 and extracts the face information included in the captured image data 21 (step S11). Also, the identification information 22 stored in the memory 20 is acquired. Then, the face determination process is performed by comparing the face information (that is, the face detected by the face detection unit 11) included in the captured image data 21 with the identification information 22 (step S12).

  When the face determination unit 12 determines that the face information included in the captured image data 21 is not included in the identification information 22 (step S13: No), the image processing unit 13 displays an image in the captured image data 21. Processing is performed (step S14). On the other hand, when the face determination unit 12 determines that the face information included in the captured image data 21 is included in the identification information 22 (step S13: Yes), the image processing unit 13 adds an image to the captured image data 21. Do not process.

  Thereafter, when the face information included in the captured image data 21 includes face information that has not been determined by the face determination unit 12 (step S15: Yes), the processes after step S11 are repeated. Then, after all face determination processing of the face information included in the captured image data 21 is completed (step S15: No), the image processing unit 13 stores the image data after the image processing as processed image data 23. 20.

  Hereinafter, the operation of the mobile terminal device 1 according to the present embodiment will be specifically described with reference to FIGS. 4 to 6. First, the face determination unit 12 of the calculation unit 10 reads out the captured image data 21 shown in FIG. 4 from the memory 20 and extracts the face information of the person A included in the captured image data 21 (step S11). Further, the identification information 22 of the persons A and B stored in the memory 20 is acquired. Then, it is determined whether or not the face information of the person A included in the captured image data 21 is included in the identification information 22 (that is, the face information of the person A and the person B) (step S12). In this case, since the face information of the person A is included in the identification information 22 (step S13: Yes), the image processing unit 13 does not perform image processing on the face of the person A.

  At this point in time, since the undetermined face is included in the captured image data 21, the operations after step S11 are repeated. That is, the face determination unit 12 extracts the face information of the person B included in the captured image data 21 (step S11). Further, the identification information 22 of the persons A and B stored in the memory 20 is acquired. Then, it is determined whether or not the face information of the person B included in the captured image data 21 is included in the identification information 22 (step S12). In this case, since the face information of the person B is included in the identification information 22 (step S13: Yes), the image processing unit 13 does not perform image processing on the face of the person B.

  At this time, since the undetermined face is included in the captured image data 21 (step S15: Yes), the operations after step S11 are repeated again. That is, the face determination unit 12 extracts the face information of the person C included in the captured image data 21 (step S11). Further, the identification information 22 of the persons A and B stored in the memory 20 is acquired. Then, it is determined whether or not the face information of the person C included in the captured image data 21 is included in the identification information 22 (step S12). In this case, since the face information of the person C is not included in the identification information 22 (step S13: No), the image processing unit 13 performs image processing on the face of the person C (step S14). For example, the image processing unit 13 performs a mask process 31 on the face area of the person C as shown in FIG. Such image processing can prevent the person C from being identified.

  At this time, since the undetermined face is included in the captured image data 21 (step S15: Yes), the operations after step S11 are repeated again. That is, the face determination unit 12 extracts the face information of the person D included in the captured image data 21 (Step S11). Further, the identification information 22 of the persons A and B stored in the memory 20 is acquired. Then, it is determined whether or not the face information of the person D included in the captured image data 21 is included in the identification information 22 (step S12). In this case, since the face information of the person D is not included in the identification information 22 (step S13: No), the image processing unit 13 performs image processing on the face of the person D (step S14). For example, the image processing unit 13 performs a mask process 32 on the face area of the person D as shown in FIG. By such image processing, it is possible to prevent the person D from being specified.

  At this point, since the face determination process is completed for all of the face information of the persons A to D included in the captured image data 21 (step S15: No), the image processing unit 13 performs the image data after image processing ( 5) is stored in the memory 20 as processed image data 23.

  In FIG. 5, the case where the mask processing 31, 32 is performed on the face areas of the persons C, D in the image processing unit 13 has been described as an example. However, the image processing unit 13 stores the processed image data 23 ′ in FIG. As shown, the trimming process may be performed so that the faces of the persons C and D are not included. The image processing in the image processing unit 13 may be any processing as long as it is difficult to specify an individual. The contents of the image processing in the image processing unit 13 can be appropriately selected by the user.

  Since the processed image data 23 stored in the memory 20 has already undergone image processing, there is no privacy problem. Therefore, it is not necessary to set access restrictions on the processed image data 23, and the user (for example, the person A) can use the processed image data 23 by an arbitrary method. For example, the user transmits the processed image data 23 to another portable terminal device via the communication unit 6 or processes the processed image data 23 to another electronic device via an external interface (not shown) provided in the portable terminal device 1. The completed image data 23 can be moved or printed.

  As described in the background art, when a user who possesses a mobile terminal device takes a picture with the camera unit, an unintended person may appear in the taken image. In such a case, for example, when a user uploads a captured image to the web or the like, there is a possibility that an unintended person's privacy problem may occur.

  Specifically, referring to FIG. 4, for example, when a person A and a person B who are friends take a picture together, a person C and a person D which are others may be unintentionally reflected in the photograph. is there. In such a case, if the person A uploads the photograph shown in FIG. 4 to the web or the like without reflecting the intentions of the person C and the person D, the privacy of the person C and the person D may be infringed.

  Therefore, in the mobile terminal device 1 according to the present embodiment, identification information that is face information of a person that does not cause a privacy problem is registered in advance, and a face is included in the captured image data captured by the camera unit. It is determined whether the face included in the captured image data is included in the identification information. When the face included in the captured image data is not included in the identification information, image processing that makes it difficult to identify an individual is performed on the face included in the captured image data. Therefore, it is possible to protect the privacy of a person photographed by the camera unit.

  Further, in the mobile terminal device 1 according to the present embodiment, when a face is included in the captured image data captured by the camera unit, access restriction is set for the captured image data. For example, the captured image data cannot be used outside the mobile terminal device 1. Therefore, it is possible to suppress the spread of captured image data including an unintended person, and to protect the privacy of this person.

  In addition, the process demonstrated above can be implemented by running the program for performing the said processing content in the portable terminal device 1. FIG.

  The invention according to the present embodiment described above can provide a mobile terminal device, a control method for the mobile terminal device, and a program that can protect the privacy of a person photographed by the camera unit.

<Embodiment 2>
Next, a second embodiment of the present invention will be described. FIG. 7 is a block diagram showing a portable terminal system according to the present embodiment. The mobile terminal system according to the present embodiment includes a mobile terminal device 1 and a mobile terminal device 2. The mobile terminal system according to the present embodiment is different in that the identification information 22 stored in the memory 20 of the mobile terminal device 1 described in the first embodiment can be acquired from another mobile terminal device 2. . Since other than this is the same as the portable terminal device described in the first embodiment, the same constituent elements are denoted by the same reference numerals, and redundant description is omitted.

  The mobile terminal device 2 includes at least a calculation unit 41, a memory 42, and a communication unit 44. The mobile terminal device 2 may be any terminal that can communicate with the mobile terminal device 1. The mobile terminal device 2 is, for example, a smartphone, a tablet-type mobile terminal device, a mobile phone, a game machine, an electronic book terminal, or the like. The mobile terminal device 2 itself may also have a camera function. The mobile terminal device 2 may be a digital camera.

  The calculation unit 41 executes various processes in the mobile terminal device 2. The memory 42 stores programs and data necessary for executing various processes in the mobile terminal device 2. The memory 42 stores identification information 43. The identification information 43 is face information of a specific person. The mobile terminal device 2 can acquire the identification information 43 via the communication unit 44 or an external interface (not shown). When the mobile terminal device 2 has a camera function, captured image data captured by the camera unit may be registered as the identification information 43.

  The communication unit 44 performs wireless communication with other mobile terminal devices. In the present embodiment, the communication unit 44 performs wireless communication with the communication unit 6 of the mobile terminal device 1. That is, in the present embodiment, the identification information 43 stored in the memory 43 of the mobile terminal device 2 can be added to the memory 20 of the mobile terminal device 1 via the communication unit 44 and the communication unit 6. The communication unit 44 and the communication unit 6 can communicate using, for example, WLAN (Wireless LAN), Bluetooth (registered trademark), infrared communication, or the like. Further, the communication unit 44 and the communication unit 6 may communicate using wide area communication such as 3G (third generation mobile communication system).

  Next, the operation of the mobile terminal system according to the present embodiment will be described. First, the operation in the case of registering the identification information 43 from the mobile terminal device 2 to the mobile terminal device 1 will be described using the flowchart shown in FIG.

  The mobile terminal device 1 searches for mobile terminal devices in the vicinity using the communication function (step S21). When there is the mobile terminal device 2 in the vicinity (step S22: Yes), the mobile terminal device 1 requests the mobile terminal device 2 to provide identification information (step S23). For example, the user can specify a mobile terminal device for which identification information is to be obtained from mobile terminal devices in the vicinity using a MAC (Media Access Control) address or a terminal name. On the other hand, when there is no other portable terminal device in the vicinity (step S22: No), the process of acquiring identification information is terminated.

  When the user of the portable terminal device 2 permits the request for identification information by the portable terminal device 1 (step S24: Yes), the portable terminal device 2 transmits the identification information 43 to the portable terminal device 1. The mobile terminal device 1 receives the identification information 43 transmitted from the mobile terminal device 2 (step S25). And the portable terminal device 1 stores the received identification information 43 in the memory 20 (step S26). On the other hand, when the user of the mobile terminal device 2 does not permit the request for the identification information by the mobile terminal device 1 (step S24: No), the process of acquiring the identification information ends.

  When the user of the mobile terminal device 2 determines permission / non-permission for the request for the identification information, for example, instead of selecting “Yes” or “No”, the display unit of the mobile terminal device 1 that is the request source By inputting the password displayed on the mobile terminal device 2, an erroneous operation can be prevented. In addition, for example, by performing identity verification using biometric authentication, only the owner of the mobile terminal device 2 can permit it.

  Thereafter, the mobile terminal device 1 can generate processed image data reflecting the identification information 43 acquired from the mobile terminal device 2 by performing the processing described in FIG. That is, the face determination unit 12 of the mobile terminal device 1 reads the captured image data 21 (see FIG. 4) stored in the memory 20 and extracts the face information of the person A included in the captured image data 21 ( Step S11). In addition, identification information 22 of person A, person B, and person C stored in the memory 20 is acquired. Then, it is determined whether or not the face information of the person A included in the captured image data 21 is included in the identification information 22 (that is, the face information of the person A, the person B, and the person C) (step S12). ). In this case, since the face information of the person A is included in the identification information 22 (step S13: Yes), the image processing unit 13 does not perform image processing on the face of the person A.

  At this time, since the undetermined face is included in the captured image data 21 (step S15: Yes), the operations after step S11 are repeated. That is, the face determination unit 12 extracts the face information of the person B included in the captured image data 21 (step S11). In addition, identification information 22 of person A, person B, and person C stored in the memory 20 is acquired. Then, it is determined whether or not the face information of the person B included in the captured image data 21 is included in the identification information 22 (step S12). In this case, since the face information of the person B is included in the identification information 22 (step S13: Yes), the image processing unit 13 does not perform image processing on the face of the person B.

  At this time, since the undetermined face is included in the captured image data 21 (step S15: Yes), the operations after step S11 are repeated again. That is, the face determination unit 12 extracts the face information of the person C included in the captured image data 21 (step S11). In addition, identification information 22 of person A, person B, and person C stored in the memory 20 is acquired. Then, it is determined whether or not the face information of the person C included in the captured image data 21 is included in the identification information 22 (step S12). In this case, since the face information of the person C is included in the identification information 22 (step S13: Yes), the image processing unit 13 does not perform image processing on the face of the person C.

  At this time, since the undetermined face is included in the captured image data 21 (step S15: Yes), the operations after step S11 are repeated again. That is, the face determination unit 12 extracts the face information of the person D included in the captured image data 21 (Step S11). In addition, identification information 22 of person A, person B, and person C stored in the memory 20 is acquired. Then, it is determined whether or not the face information of the person D included in the captured image data 21 is included in the identification information 22 (step S12). In this case, since the face information of the person D is not included in the identification information 22 (step S13: No), the image processing unit 13 performs image processing on the face of the person D (step S14). For example, as illustrated in FIG. 9, the image processing unit 13 performs a mask process 33 on the face area of the person D. Such an image processing can prevent the person D from being specified.

  At this point, since the face determination process is completed for all of the face information of the persons A to D included in the captured image data 21 (step S15: No), the image processing unit 13 performs the image data after image processing ( 9) is stored in the memory 20 as processed image data 23.

  In FIG. 9, the case where the mask processing is performed on the face area of the person D in the image processing unit 13 has been described as an example. However, as illustrated in the processed image data 23 ′ in FIG. The trimming process may be performed so that the face of D is not included. The contents of the image processing in the image processing unit 13 can be appropriately selected by the user.

  Through the processing described above, the mobile terminal device 1 can generate processed image data 23 reflecting the identification information 43 (person C) acquired from the mobile terminal device 2.

  Since the processed image data 23 stored in the memory 20 has already undergone image processing, there is no privacy problem. Therefore, it is not necessary to set access restrictions on the processed image data 23, and the user (for example, the person A) can use the processed image data 23 by an arbitrary method. For example, the user transmits the processed image data 23 to another portable terminal device via the communication unit 6 or processes the processed image data 23 to another electronic device via an external interface (not shown) provided in the portable terminal device 1. The completed image data 23 can be moved or printed.

  FIG. 11 is a diagram illustrating an example of identification information. The identification information includes a registration ID, registration date and time, expiration date start date, expiration date end date, name data length, name data, face identification information data length, face identification information data, and record end information. For example, the identification information 43 transmitted from the mobile terminal device 2 to the mobile terminal device 1 is invalidated by setting an expiration date (expiration start date, expiration date) to the identification information 43 that has passed a predetermined period. It can be. Thereby, the identification information 43 of the mobile terminal device 2 can be reflected only on the captured image data 21 captured during a specific period. For example, the mobile terminal device 1 collates Exif (Exchangeable Image File Format) information of the captured image data 21 with the identification information 43 so that only the captured image data 21 captured during a specific period is stored in the mobile terminal. The identification information 43 of the device 2 can be reflected.

  In addition, the process demonstrated above can be implemented by running the program for performing the said processing content in the portable terminal device 1 and the portable terminal device 2. FIG.

  With the portable terminal system according to the present embodiment described above, it is possible to protect the privacy of a person photographed by the camera unit. In particular, in the mobile terminal system according to the present embodiment, the identification information included in the mobile terminal device 2 can be easily added to the mobile terminal device 1 after obtaining the permission of the user of the mobile terminal device 2. Therefore, while protecting the privacy of the person photographed by the camera unit, the person included in the photographed image data can be easily excluded from the image processing target, and the convenience of the mobile terminal device can be improved.

  For example, it is assumed that a person A and a person C meet by chance on a trip and the person C appears in a photograph taken by the mobile terminal device 1 of the person A. In this case, by transmitting identification information from the mobile terminal device 2 of the person C to the mobile terminal device 1 of the person A, the person C included in the captured image data captured by the mobile terminal device 1 is excluded from the image processing target. Can do. Therefore, it is possible to leave in the photograph that the person A meets the person C on the trip. Moreover, a new community is formed by exchanging identification information.

  Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention. For example, in the above description, face information is used when specifying a person, but information such as clothes and body shape may be combined with face information. Thus, the accuracy of person identification can be improved by using a plurality of information.

  Although the present invention has been described with reference to the above embodiment, the present invention is not limited only to the configuration of the above embodiment, and within the scope of the invention of the claims of the present application. It goes without saying that various modifications, corrections, and combinations that can be made by a trader are included.

DESCRIPTION OF SYMBOLS 1, 2 Portable terminal device 5 Camera part 6 Communication part 8 Photographed image data 10 Calculation part 11 Face detection part 12 Face determination part 13 Image processing part 20 Memory 21 Photographed image data 22 Identification information 23 Processed image data 31, 32, 33 Mask processing 41 Calculation unit 42 Memory 43 Identification information 44 Communication unit

Claims (19)

A camera unit;
An arithmetic unit that performs image processing on the first image data captured by the camera unit to generate second image data;
A memory for storing the first and second image data,
The computing unit is
Detecting a face included in the first image data;
Determining whether the detected face is included in identification information which is face information of a specific person;
If the detected face is not included in the identification information, the detected image included in the first image data is subjected to image processing that makes it difficult to identify an individual, and the second image Generate data,
Mobile terminal device.   The mobile terminal device according to claim 1, wherein when the first image data includes a face, the arithmetic unit sets an access restriction on the first image data.   The portable terminal device according to claim 2, wherein the calculation unit sets an access restriction on the first image data by disabling the use of the first image data outside the portable terminal device. .   The mobile terminal device according to claim 3, wherein the first image data can be displayed only on a display unit included in the mobile terminal device.   The portable terminal device according to claim 1, wherein the image processing is processing for masking the detected face area.   5. The portable terminal device according to claim 1, wherein the image processing is a process of performing trimming so as not to include the detected face area. 6.   The portable terminal device according to any one of claims 1 to 6, wherein when the first image data does not include a face, the calculation unit does not set an access restriction on the first image data.   The mobile terminal device according to claim 1, wherein the identification information is stored in the memory in advance.   The mobile terminal device according to claim 1, wherein the mobile terminal device acquires the identification information from another mobile terminal device.   The mobile terminal device according to claim 9, wherein the identification information acquired from the other mobile terminal device is set to be invalid after a predetermined period has elapsed. A mobile terminal system comprising a first mobile terminal device and a second mobile terminal device,
The first portable terminal device is:
A camera unit;
An arithmetic unit that performs image processing on the first image data captured by the camera unit to generate second image data;
A first memory for storing the first and second image data,
The second portable terminal device includes at least a second memory for storing identification information that is face information of a specific person,
When the first portable terminal device requests the second portable terminal device to provide the identification information, and the second portable terminal device permits the provision of the identification information, the first portable terminal device The terminal device acquires the identification information from the second mobile terminal device,
The computing unit is
Detecting a face included in the first image data;
Determining whether the detected face is included in the identification information;
When the detected face is not included in the identification information, the detected image is subjected to image processing that makes it difficult to identify an individual on the detected face included in the first image data, and the second image data Generate
Mobile terminal system.   The mobile terminal system according to claim 11, wherein when the first image data includes a face, the calculation unit sets an access restriction on the first image data.   The calculation unit according to claim 12, wherein the calculation unit sets an access restriction on the first image data by disabling use of the first image data outside the first portable terminal device. Mobile terminal system.   The portable terminal system according to claim 11, wherein the image processing is processing for masking the detected face area.   The mobile terminal system according to claim 11, wherein the image processing is a process of performing trimming so as not to include the detected face area. Detecting a face included in the first image data photographed by the camera unit;
Determining whether the detected face is included in identification information which is face information of a specific person;
When the detected face is not included in the identification information, the detected image is subjected to image processing that makes it difficult to identify an individual on the detected face included in the first image data, and the second image data Generate
Control method of portable terminal device.   The method of controlling a mobile terminal device according to claim 16, wherein when the first image data includes a face, an access restriction is set for the first image data.   The method of controlling a mobile terminal device according to claim 17, wherein an access restriction is set on the first image data by disabling use of the first image data outside the mobile terminal device. Detecting a face included in the first image data photographed by the camera unit;
Determining whether the detected face is included in identification information which is face information of a specific person;
When the detected face is not included in the identification information, the detected image is subjected to image processing that makes it difficult to identify an individual on the detected face included in the first image data, and the second image data A program for causing a mobile terminal device to execute processing.

Images