JP5500639B2 - Terminal device, authentication system, and program - Google Patents

Description

  The present invention relates to a terminal device, an authentication system using the terminal device, and a program.

At present, digital cameras and mobile phones with camera functions are widely spread, so criminal activities such as voyeurism are performed, or even if it is not voyeur, the person is photographed as a subject by another person, and the captured image is There is a growing risk that it will be disseminated to the network and so on. In order to prevent such a situation, it is considered that only a specific person can use an electronic device having a camera function in advance.

That is, a face image of a person who can use the electronic device is stored in advance in the electronic device, and when the electronic device is used, the face image stored in advance by capturing the face image of the user with a camera The electronic device is put into a usable state only when it matches ( see, for example, Patent Document 1). Therefore, if such a technology is applied to a digital camera or a mobile phone with a camera function, an image captured by a person other than the owner of the digital camera or the mobile phone with a camera function may be copied or copied without permission. And so on.

JP 2006-081147 A

  However, in the method of photographing the user's face when using the electronic device and permitting the use when it matches the pre-registered face image as described in Patent Document 1, the person himself / herself is not the other person's When taken with a digital camera or the like, it has not been possible to prevent the captured image from being arbitrarily copied by a user of the digital camera and transferred to an external personal computer or a network.

  The present invention has been made to solve the above-described problem, and a terminal device, an authentication system, and a program that can prevent unauthorized copying or transmission to the outside without obtaining the approval of the photographed person. Is to provide.

  In order to solve the above-described problem, a terminal device according to claim 1 of the present invention identifies an imaging unit capable of imaging a person, a display unit that displays a photographed image captured by the imaging unit, and a person Personal information storage means for associating and storing person identification information to be performed and image information of the person, an image of a person photographed in a photographed image photographed by the imaging means and displayed on the display means, and the personal information memory A person identifying means for identifying a person photographed by determining similarity to image information of a person stored in the means, an authentication information input means for inputting authentication information, and an authentication input by the authentication information input means A determination result acquisition unit that acquires a determination result as to whether or not the information matches the authentication information of the person specified by the person specifying unit; and a determination result acquired by the determination result acquisition unit. Characterized in that it comprises a control means for controlling to allow or disallow copying or external transmission of the captured image Te.

  In a second aspect of the present invention, when a plurality of persons are photographed in the photographed image, processing by the person identifying means, the authentication information input means, and the discrimination result obtaining means is executed for all the photographed persons. The control means permits copying or external transmission of the photographed image only when discrimination for all persons being photographed is permitted.

  According to a third aspect of the present invention, the discrimination result acquisition unit is configured to associate the person identification information stored in the personal information storage unit with the person specified from the photographed image by the person specifying unit and the authentication information input unit. The authentication information input by the transmission means for transmitting to the external authentication device, and the authentication information input by the authentication information input means sent by the external authentication device of the person specified by the person specifying means Receiving means for receiving a determination result obtained by authenticating whether or not the authentication information matches.

  According to a fourth aspect of the present invention, the person information storage means further stores inquiry destination information that enables transmission / reception with an inquiry destination electronic device in association with the person identification information, and the determination result acquisition means comprises: Inquiry destination electronic equipment using the inquiry destination information stored in the person information storage means in association with the person specified by the person specifying means from the photographed image by the authentication information input by the authentication information input means And whether or not the authentication information input by the authentication information input means transmitted from the inquiry electronic device matches the authentication information of the person specified by the person specifying means. Receiving means for receiving.

  According to a fifth aspect of the present invention, the person information storage means further stores authentication information corresponding to the person identification information, and the discrimination result acquisition means is the authentication information input by the authentication information input means. Is determined by determining whether or not authentication is performed according to whether or not it matches the authentication information stored in the person information storage unit in association with the identification information of the person specified by the person specifying unit The result is obtained.

The invention of claim 6, further corresponding to the obtained determination result the captured image of the copy or whether the shooting image discrimination information indicating whether the Allow External transmitted by the determination result obtaining means Storage means for saving and allowing or not permitting according to the discriminating information stored corresponding to copying or external transmission of the captured image reproduced when the captured image stored in the storage means is reproduced And a reproduction control means.

  According to a seventh aspect of the present invention, there is provided a terminal device for displaying a subject image in which a person is a subject, a person for storing person identification information for identifying a person and image information of the person in association with each other. The information storage means and the image of the person who is the subject of the subject image displayed on the display means and the image information of the person stored in the person information storage means are discriminated to form a subject. A person specifying means for specifying a person, an authentication information input means for inputting authentication information, and whether or not the authentication information input by the authentication information input means matches the authentication information of the person specified by the person specifying means. A discrimination result acquisition means for acquiring the discrimination result, and copying or external transmission of the subject image is permitted or not permitted based on the discrimination result acquired by the discrimination result acquisition means. Characterized in that it comprises a control means for performing control.

Further, the invention of the authentication system according to claim 8 is an authentication comprising a terminal device and an authentication device for authenticating whether the authentication information transmitted from the terminal device matches the registered authentication information. In the system, the authentication device includes authentication storage means for storing identification information of a person and the authentication information of the person in association with each other, information specifying the person transmitted from the terminal device, and authentication information. Whether to authenticate according to whether the identification information of the corresponding person from the received authentication receiving means, the authentication information stored in the authentication storage means, and the authentication information received by the authentication receiving means match And an authentication transmission means for transmitting a determination result by the authentication determination means to the terminal device. The terminal device is capable of capturing an image of a person, Display means for displaying the taken image, person information storage means for storing the person identification information for identifying the person and the image information of the person in association with each other, and photography taken by the imaging means and displayed on the display means Person identifying means for identifying a person photographed by determining similarity between an image of a person photographed in the image and image information of the person stored in the person information storage means, and authentication information for inputting authentication information input means, a terminal transmission means for transmitting the information of the person identified by the authentication information input by the input means authentication information and the person specifying means to the authentication device, the authentication device from a sent the incoming person Terminal receiving means for receiving the determination result of whether or not the identification information matches, and copying or external transmission of the photographed image based on the determination result received by the terminal receiving means Characterized in that it comprises a control means for controlling to variable or non-permission.

  According to a ninth aspect of the present invention, there is provided a computer-readable recording medium comprising: an image capturing function capable of capturing a person on a computer; a display function for displaying a captured image captured by the image capturing function; A person information storage control function for storing person image information in association with each other, a person image captured by the image capturing function and displayed by the display function and the person image stored in the person information storage means Person identification function for identifying a person photographed by determining similarity to image information of a person, authentication information input by an authentication information input means for inputting authentication information, and authentication information for the person specified by the person identification function A determination result acquisition function for acquiring a determination result of whether or not they match, a copy of the captured image based on the determination result acquired by the determination result acquisition function There is characterized in that to realize the control function for controlling to allow or disallow external transmission.

  According to a tenth aspect of the invention, there is provided a display function for displaying a subject image in which a person is a subject on a computer, and personal identification information for identifying a person and image information of the person are associated with a personal information storage means. A person information storage control function to be stored; a person image that is a subject of a subject image displayed in the display function and a person image information that is stored in the person information storage means are determined to be similar to each other A person identification function for identifying a person who is a person, and a determination result as to whether or not the authentication information input by the authentication information input means for inputting authentication information matches the authentication information of the person specified by the person identification function A determination result acquisition function that performs copying or external transmission of the subject image based on the determination result acquired by the determination result acquisition function. Control function of controlling that, characterized in that to realize.

  According to the present invention, it is possible to prevent copying or transmission to the outside without obtaining the approval of the photographed person.

The system block diagram of the authentication system using the mobile telephone apparatus 1 and the authentication apparatus 3 which are the terminal devices of this invention. The figure which shows the memory area and memory content of the address book memory | storage part 25 of FIG. The figure which shows the memory area and memory content of the authentication database 35 of FIG. The operation | movement flowchart figure of the mobile telephone apparatus 1 of FIG. The operation | movement flowchart figure of the mobile telephone apparatus 1 similarly. The detailed flowchart figure of the person specific process of step S9 of FIG. The detailed flowchart figure of the authentication discrimination | determination process of FIG.4 S12. The operation | movement flowchart figure of the authentication apparatus 3 of FIG. The system block diagram of the authentication system using the mobile telephone apparatus 1 and the other mobile telephone apparatus 4 in the 2nd Embodiment of this invention. The figure which shows the memory area and memory content of the authentication information memory | storage part 50 of FIG. The detailed flowchart figure of the person specific process in 2nd Embodiment. The detailed flowchart figure of the authentication discrimination | determination process in 2nd Embodiment. FIG. 10 is an operation flowchart of the mobile phone device 4 of FIG. 9. The block diagram of the mobile telephone apparatus 5 in the 3rd Embodiment of this invention. FIG. 15 is a diagram showing a storage area and storage contents of the address book storage unit 52 of FIG. 14. The detailed flowchart figure of the authentication discrimination | determination process in 3rd Embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a system configuration diagram of an authentication system using a terminal device according to the present invention. A mobile phone device 1 as a terminal device, a wireless communication network 2 including a network such as a wireless telephone circuit network and the Internet, The authentication apparatus 3 is connected to the wireless communication network 2.

  The control unit (CPU) 12 of the cellular phone device 1 is provided with a ROM (Read Only Memory) (not shown) in which various programs are stored. The control unit 12 is stored in the ROM. By operating the program, the overall operation of the mobile phone device 1 is controlled.

  That is, in the ROM, an application for executing various functions such as a program for executing various flowcharts to be described later, a call function, an e-mail function, an Internet connection function, a camera function, an address book function, a schedule function, etc. A program is stored, and the control unit 12 controls the overall operation of the mobile phone device 1 based on the program stored in the ROM.

  The display unit 13 is composed of, for example, a dot matrix type liquid crystal display device or EL display device, and displays information necessary for the telephone function (information such as the other party's phone number, radio wave reception status, remaining battery level, etc.). Display the contents of e-mails and websites. In the address book function, address book information is displayed, and in the camera function, a through image display and a reproduced image of the captured and stored image are displayed.

  The operation unit 14 is an operation key provided in the cellular phone device 1, and although not shown in detail, a power ON key for turning on / off the power, a power OFF key, numeric information, and character information are input. Keys for operating each function such as a numerical character input key, various application keys for selecting activation and termination of various functions (applications), a call on-hook and off-hook key, and a shutter key in a camera function are provided.

  The power supply unit 15 includes a rechargeable secondary battery (not shown) and a backup battery that supplies a backup voltage to each circuit unit when the battery voltage of the secondary battery decreases. Supply.

  The telephone unit 16 captures a voice radio signal from a base station (not shown) through the antenna 17 and the radio communication unit 18 during operation of the telephone function, and demodulates the received voice radio signal into a reception baseband signal. The voice is output from the reception speaker 19 via the voice signal processing unit. Further, the audio signal input from the transmission microphone 20 is processed by the audio signal processing unit and then sent to the radio communication unit 18. The radio communication unit 18 encodes the audio signal into a transmission baseband signal, and then from the antenna 17. Send output.

  During the operation of the e-mail function, the Internet connection function, etc., it is possible to send and receive e-mails, browse web sites or connect to the authentication device 3 described above via the antenna 17 and the wireless communication unit 18. Transmission / reception information, Web site browsing information, and information sent from the authentication device 3 are sent to the display unit 13 for display output.

  The authentication input unit 21 includes a fingerprint sensor (not shown), and outputs fingerprint information based on detection by the fingerprint sensor as authentication information for authenticating an individual.

  Although not shown in detail, the imaging unit 22 includes various configurations for operating as a camera function. That is, the imaging unit 22 displays the subject image on the imaging device via an optical system such as a lens, displays the subject image captured on the imaging device on the display unit 13, and also uses the shutter key of the operation unit 14. Is operated, the subject image captured at that time is stored in the saved image storage unit 24 of the storage unit 23 described later.

  The storage unit 23 includes a storage area for storing various types of information. The storage unit 23 includes a work area (not shown) for calculating various types of information and temporarily storing various types of information. A book storage unit 25 is provided.

  The stored image storage unit 24 stores the captured image captured by the imaging unit 22 as described above. The stored captured image also has a permission flag for permitting or not permitting copying or external transfer. Corresponding to be memorized. Details of this point will be described later.

  FIG. 2 shows a detailed configuration of the address book storage unit 25. The address book storage unit 25 includes a name information storage area 25A for storing personal name information, and names stored in the name information storage area 25A. A mail address information storage area 25B for storing the mail address information of the person with the full name provided corresponding to the information, a telephone number information storage area 25C for storing the telephone number information of the person with the full name, and identifying the person with the full name ( It is composed of an image information storage area 25D that stores a specific ID number to be identified and face image information of the person with the name.

  The specific ID number and the face image information for identifying the individual with the name stored in the image information storage area 25D are obtained by receiving the specific ID number and the face image information from the person with the name in advance and storing them.

  Returning to FIG. 1, the authentication device 3 includes a control unit 31, a communication unit 32 that performs communication connection with the wireless communication network 2, an operation unit 33, and a storage unit 34. A database 35 is provided.

  FIG. 3 shows a detailed configuration of the authentication database 35. The authentication database 35 includes an ID number storage area 35A for storing a specific ID number that is an identification number of each individual and identifies each individual. An identification / authentication information storage area 35B and an image information storage area 35C are provided corresponding to the ID numbers stored in the number storage area 35A.

  The identification / authentication information storage area 35B stores the fingerprint information of the individual as authentication information for identifying the individual indicated by the ID number stored in the ID number storage area 35A, and the image information storage area 35C stores the personal information. Is stored.

  Thus, in the above-described system, each person is allowed to register his / her specific ID number, fingerprint information and face image information in advance in the authentication device 3, and the above-described mobile phone The telephone device 1 sends the same information as the specific ID number and face image information registered in the authentication device 3 and stores them in the image information storage area 25D of the address book storage unit 25. .

  Next, operations of the cellular phone device 1 and the authentication device 3 of the present system configured as described above will be described with reference to the flowcharts of FIGS.

  FIG. 4 is an operation flowchart of the cellular phone device 1. When it is detected that the power ON key of the operation unit 14 is operated, standby state processing is set in step S1, and the process proceeds to step S2. In step S2, it is determined whether there is an incoming call function of the telephone. If there is an incoming call, the process proceeds to step S3 where an incoming call notification process is performed and whether an off-hook key is operated is determined.

  If the off-hook key has not been operated even after the predetermined time has elapsed, the process returns to step S2, but if the off-hook key has been operated, the process proceeds to step S4 where call processing is executed and a call with the caller is made. It becomes possible. The call process is continued until the operation of the on-hook key is detected in the next step S5. When the operation of the on-hook key is detected, the process proceeds to step S6, where the call termination process is performed and the process returns to step S2.

  If no incoming call is detected in step S2, the process proceeds to step S7. In this step S7, it is detected whether or not an imaging operation for imaging a subject using the imaging unit 22, that is, whether or not a shutter key is operated in the camera function. If an imaging operation is performed, an image is captured. The subject image is stored in the saved image storage unit 24, and the subject image stored in the next step S8 is read and displayed on the display unit 13.

  When the subject image is displayed by the process of step S8, the process proceeds to step S9, and the person specifying process is executed.

  FIG. 6 shows a detailed flowchart of the person specifying process in step S9. First, in step S9A, the person imaged in the subject image in the subject image displayed on the display unit 13 is displayed by the user operation. The specified process is performed.

  That is, in step S9A, first, it is determined whether or not a face image exists in the subject image displayed on the display unit 13. If the face image exists, a display such as surrounding the face image with a frame, for example, is performed. To do.

  In this case, a face image in which a person cannot be specified only by looking at a very small face image or a face image in which a person cannot be specified because it is out of focus and so-called blurred is excluded.

  In this way, the user designates one of the face images surrounded by the frame. This designation is performed by, for example, a method of operating the enter key in accordance with the frame of the face image of the person who designates the cursor, or the display unit 13 is configured by a display device and a transparent touch switch arranged on the front surface thereof. By adopting a method of touching the frame position of the displayed face image, the position information is sent to the control unit 12, and the control unit 12 determines which person on the subject screen has been designated.

  In the next steps 9B and 9C, the address book storage unit 25 is referred to, and a process is performed for collating the face image of the designated person with the face image stored in the image information storage area 25D of the address book storage unit 25. In step 9D, it is determined whether there is a face image similar or identical to the face image of the designated person.

  If there is no similar or identical face image, the specific person process of FIG. 6 is directly exited and the process proceeds to step S10 of FIG. 4. If there is, the ID number of the person is specified in step S9E. Proceed to step S10 of step 4.

  In step S10 of FIG. 4, it is determined whether or not the ID number is specified in step S9E. If so, the process proceeds to step S11 to perform authentication information input processing by user operation.

  The authentication information input process in step S11 is performed so that the person who is imprinted in the subject image and designated in step S9A in FIG. 6 permits the copy of the subject image or the transfer to the outside as described later. This is a process for inputting authentication information such as a person's fingerprint. Accordingly, the person designation in step S9A may be a user who has taken an image, a person photographed as a subject image, or a third party, but the authentication information input in step S11 is designated in step S9A. The person himself (the person himself / herself shown in the photographed image) needs to input his / her fingerprint from the authentication input unit 21.

  Thus, after the authentication information is input in step S11, the process proceeds to step S12 to execute the authentication determination process.

  FIG. 7 is a detailed flowchart of the authentication determination process in step S12.

  First, in step S12A, the ID number and face image information stored in the image information storage area 25D of the address book storage unit 25 of the person who is determined to have similar or identical images in steps S9D and 9E in FIG. The authentication information is transmitted to the authentication device 3 together with the input authentication information input in step S11.

  In the authentication device 3, as shown in FIG. 3, personal ID numbers, face image information, and authentication information are registered and stored in the information database 35 in correspondence with each other, and the ID numbers sent from the mobile phone device 1, When the face image information and the input authentication information match the ID number, the face image information and the authentication information stored in the authentication database 35, determination result data indicating whether or not the authentication is OK is sent back to the mobile phone device 1.

  FIG. 8 is a flowchart of the operation of the authentication device 3.

  When the standby state is set in step S31, the process proceeds to step S32, and it is determined whether or not an ID number, face image information, and authentication information are received. If received, the authentication database 35 is referenced (searched) in step S33, and the authentication information sent in step S34 is collated with the authentication information stored in the authentication information storage area 25B. In S35, it is determined whether there is matching authentication information.

  If there is no matching authentication information, authentication NG (impossible) data is created in step S36 and sent to the transmission source in step S37.

  On the other hand, if there is matching authentication information in step S35, the process proceeds to step S38, where the ID number in the ID number storage area 35A corresponding to the matching authentication information is read, and the read ID number is received in the next step S39. It is determined whether or not the ID number matches.

  If the ID numbers do not match, the process proceeds to step S36. If the ID numbers match, the process proceeds to step S40, and the face image in the image information storage area 35C corresponding to the ID number in the ID number storage area 35A is read. It is determined whether or not it matches the received face image.

  If they do not match, the process proceeds to step S36, but if they match, the process proceeds to step S42 to create authentication OK data and transmit the data in step S37.

  As described above, in the authentication device 3, the ID number, face image information, and input authentication information transmitted from the mobile phone device 1 respectively match the ID number, face image information, and authentication information registered in the authentication database 35. If all match, the authentication OK determination result data is sent back to the mobile phone device 1. If no match is found, the authentication NG determination result is sent back.

  Therefore, after transmitting the ID number, the face image information, and the input authentication information in step 12A of FIG. 7, the cellular phone device 1 receives the determination result from the authentication device 3 in the next step S12B, and proceeds to step S13 of FIG.

  In step S13, it is determined whether or not the authentication determination result sent from the authentication device 3 is OK. If the result is OK, the process proceeds to step S14. In step S14, the frame frame display of the face image that is OK in step 13 is deleted from the face images surrounded by the frame frame, and the frame frame is still included in the face image of the displayed subject image. It is determined whether there is a face image on which is displayed.

  That is, it is determined whether or not there is an unauthenticated person as a face image. If an unauthenticated person is imprinted, the process returns to step S9, and the processes of steps S9 to S14 described above are performed. repeat.

  In this case, in step 9A, the frame frame is not displayed for the face image that is OK in step S13, and the frame is displayed only for the remaining face images to allow the user to specify a person.

  The reason why the processes in steps S9 to S14 are repeated in this way is that, when a plurality of persons are copied in the subject image, copying and transfer of the image is performed only after obtaining the consent of all the persons being copied. It is for making possible. However, if the person's face image or the like is too small or out of focus and the person cannot be identified, consent is not required.

  In the authentication operation of any person, if the authentication result is not OK in step S13, that is, if the authentication by the authentication device 3 is not obtained, the process proceeds from step S13 to step S15, and the photograph is taken. The permission flag “0” is associated with the subject image, and when the image is stored in the next step S16, the captured image is associated with the permission flag in step S17. The processing to be stored in 24 is executed.

On the other hand, if authentication of all the persons imprinted as the subject image is obtained in step S14, the permission flag “1” is associated with the photographed subject image, and the image is displayed in next step S16. When the save operation is performed, a process of associating the subject image captured in step S17 with the permission flag and storing them in the saved image storage area 24 is executed.

  If it is determined in step S16 that the operation is not a save operation, the process proceeds to step S18, where it is determined whether a copy operation or a transmission operation on a network or an external device has been performed.

  If a copy or transmission operation is performed, it is determined in step S19 whether or not a permission flag “1” is attached to the subject image. If a permission flag “1” is attached, step S20 is performed. Go to and execute copy or send operation.

  If the permission flag “1” is not attached and the permission flag is “0”, the process proceeds to step S21 to display on the display unit 13 that copying or transmission is not permitted.

  If it is determined in step S7 that the camera is not in a shooting operation, the process proceeds to step 22 in FIG. In step S22, it is determined whether the operation is a stored image browsing start operation for reproducing and browsing the image stored and stored in step S17 of FIG.

  When the browsing start operation is performed, the process proceeds to step S23, and a process of sequentially switching and displaying the images stored by the display switching operation by the user on the display unit 13 is executed.

  Thereafter, it is determined whether or not a copy operation or a transmission operation has been performed in step S24. If these operations are not performed, for example, if an end key is operated, the process returns to step S2 in FIG. Alternatively, when a transmission operation is performed, the process proceeds to steps S25 to S27.

  Steps S25 to S27 are the same as the processes of steps S19 to S21 in FIG. 4, that is, when the permission flag stored corresponding to the image being viewed is “1”, copy or transmission is executed. When the permission flag is “0”, copying or transmission is not permitted.

  If it is determined in step S22 that the stored image viewing start operation is not performed, the process proceeds to step S28, and operations of functions other than those described above are detected. For example, a mail text creation operation or a mace transmission operation is detected in the mail function, and a Web browsing operation is detected in the Internet function.

  Further, in step S7 in FIG. 4, the operation of the shutter key at the time of imaging is detected, but the operation for starting the previous camera function, the operation of zoom adjustment, exposure adjustment, etc. are detected in this step S28, and the next Processing corresponding to the operation detected in step S29 is executed.

  As described above, according to the above embodiment, a person is selected from the photographed subject images, whether or not the person is stored in his / her address book, and Only when the person has entered the authentication information, and whether the authentication information is registered in the external authentication device or other conditions are cleared, the photographed subject image can be copied or Since the transfer is permitted, it is possible to prevent the photographed image from being distributed in a state that the photographer does not know, contrary to the intention of the photographed person.

  In addition, when multiple persons are photographed in the photographed subject image, all the photographed persons are authenticated and authorized, so unless all the photographed persons have permission. It is possible to prevent the photographed image from spreading unintentionally.

  Further, the input authentication information is transmitted to an external authentication device that stores the person identification information and the person authentication information in association with each other, and is stored in the external authentication device by the external authentication device. From the authentication information and the transmitted authentication information, the determination result of whether or not to authenticate is received according to whether or not the corresponding person identification information matches, and the determination result is obtained by receiving the determination result As a result, authentication information is stored only in an external authentication device, so that leakage or misuse of authentication information can be prevented.

  Further, the external authentication device further stores the face image of the person in association with the information for identifying the person, further transmits the face image of the person specified from the photographed image to the external authentication device, and performs external authentication. The apparatus receives the determination result determined by the apparatus whether or not to authenticate according to whether or not the identification information of the corresponding person further matches from the image stored in the external authentication apparatus and the transmitted image. By doing so, it is possible to prevent spoofing by another person who illegally obtains and registers authentication information.

(Second Embodiment)
9 to 13 show a second embodiment of the present invention. In the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals as those in the first embodiment, and detailed description thereof is omitted.

  FIG. 9 is a system configuration diagram of the second embodiment. In the figure, the system configuration shown in FIG. 1 is different from the authentication apparatus 3 receiving the authentication shown in FIG. 1 in that a terminal device that can be controlled by a person shown in the subject image, for example, a mobile phone of the person The device 4 is used as an inquiry-destination electronic device that inquires about the authentication result.

  In addition, although not shown in the address book storage unit 25 of the cellular phone device 1, connection information to a terminal device owned by each name, for example, a cellular phone device, corresponding to each name information is an inquiry number. Is remembered as

  The mobile phone device 4 includes a control unit 40, a display unit 41, an operation unit 42, a power supply unit 43, a telephone unit 44, an antenna 45, a wireless communication unit 46, a reception speaker 47, and a microphone 48, which are portable. Since the control unit 12, the display unit 13, the operation unit 14, the power supply unit 15, the telephone unit 16, the antenna 17, the wireless communication unit 18, the reception speaker 19, and the microphone 20 of the telephone device 1 have the same configuration, detailed description thereof is omitted. To do.

  The storage unit 49 of the mobile phone device 4 is provided with an authentication information storage unit 50. The authentication information storage unit 50 includes authentication information of the owner of the mobile phone device 4, as shown in FIG. For example, fingerprint information is registered and stored.

  Thus, in the above configuration, the mobile phone device 1 performs the same operation process as the operation flowchart shown in FIG. 4, but the person identification process in step S9 and the authentication determination process in step S12 are shown in FIG. This embodiment is different from the first embodiment in that the person specifying process and the authentication determination process shown in FIG. 12 are executed.

  That is, in FIG. 11, which is a detailed flowchart of step S9, steps 9A to 9D are the same as steps 9A to 9D of FIG. 6, but after step 9D, the process proceeds to step 9F to designate the designated person. Is obtained from the address book storage unit 25.

  Thereby, in the authentication determination process of step S12, the authentication information input as shown in step S12C of FIG. 12 is transmitted to the inquiry destination. In this case, if the person designated in the subject image is the owner of the mobile phone device 4, the authentication information is transmitted to the mobile phone device 4.

  In the mobile phone device 4, the flowchart shown in FIG. 13 is executed. That is, when the standby state is set in step S51, in the next step S52, it is determined whether or not authentication information is received. If there is reception, the process proceeds to step S53, and the received authentication information and the stored information are stored. A verification process with the authentication information stored in the authentication information storage unit 50 of the unit 49 is performed.

  If the collation results match in step S54, the process proceeds to step S55, where authentication OK data is created and sent back to the mobile phone device 1 in the next step S56.

  On the other hand, if the collation results do not match, the process proceeds to step S57, where authentication NG data is created and sent back to the mobile phone device 1 in the next step S56.

  As a result, the cellular phone device 1 receives the authentication determination result in step S12D in FIG. 12, and controls permission or non-permission of copying and transfer based on the result in step S13 and subsequent steps in FIG. ,

  As described above, in the second embodiment, the person to be identified is further associated with the information for identifying the person and stored, and the determination result acquiring unit is associated with the information for identifying the person identified from the photographed image. The authentication information input to the inquiry destination device stored in the communication is transmitted, and the authentication information stored in the inquiry destination device by the inquiry destination device and the corresponding authentication information from the transmitted authentication information are transmitted. By receiving the determination result of whether to authenticate according to whether the identification information matches or not, and acquiring the determination result by receiving the determination result, the authentication information is sent to the inquiry destination device. Since only information is stored, it is possible to prevent leakage or misuse of authentication information.

(Third embodiment)
14 to 16 show a third embodiment of the present invention. In the third embodiment, only a terminal device, for example, a mobile phone device, can be used to prevent copying or transferring of a subject image when the subject person is not approved.

  FIG. 14 is a block diagram of the cellular phone device 5 of the present invention in the third embodiment. In the figure, the same components as those of the cellular phone device 1 shown in FIG.

  Therefore, the cellular phone device 5 is the same as the configuration of FIG. 1 except for the configuration of the address book storage unit 52 of the storage unit 51 and a part of the explanation of a flowchart described later.

  FIG. 15 shows the configuration of the address book storage unit 52 of the mobile phone device 4. The address book storage unit 52 is provided with a name information storage area 52A, a mail address information storage area 52B, a telephone number information storage area 52C, and an image information storage area 52D, each of which is shown in FIG. This is the same as the name information storage area 25A, mail address information storage area 25B, telephone number information storage area 25C, and image information storage area 25D of the storage unit 25.

  The address book storage unit 52 is provided with an authentication information storage area 52E for registering and storing the fingerprint information of the person of the name as authentication information in association with each name stored in the name information storage area 52A. ing.

  In the authentication information storage area 52E, fingerprint information is registered in advance by having the person of the name input the fingerprint information from the authentication input unit 21.

  In such a configuration, processing similar to the flowchart shown in FIG. 4 and the subsequent steps is executed, but only the authentication determination processing in step S12 executes the flowchart shown in FIG.

  First, in step S61, the authentication information storage area 52E of the address book storage unit 52 is referred to. In step S62, the authentication information of the person is obtained based on the ID number of the person whose face image is similar or identical. The authentication information read out and input is verified.

  If it is detected in the next step 63 that the authentication is successful, the authentication is OK in step S64, and if they do not match, the authentication proceeds to NG in step S65 and the process proceeds to step S13 in FIG. In step S13 and subsequent steps in FIG. 4, permission or non-permission of copying or transfer is controlled based on the result.

  Thus, in the third embodiment, authentication information is further stored in association with information for identifying a person, and the input authentication information is stored in association with identification information for the identified person. Since the determination result is obtained by determining whether or not to authenticate according to whether or not it matches the authentication information, the authentication process can be performed only within the own terminal device.

  In any of the embodiments, the captured image is stored in association with information indicating whether copying or transmission of the captured image is permitted according to the determination result whether the acquired authentication is performed, By controlling whether or not to copy or transmit the stored captured image according to the information indicating whether or not to permit the stored captured image to be associated, It is possible to prevent the photographed image from spreading unintentionally.

  In the above embodiment, fingerprint information is used as authentication information input from the authentication input unit 21. However, the present invention is not limited to fingerprint information, and other biological information such as vein information and iris information may be used. Alternatively, it is not limited to biometric information, and may be information obtained by keying a password made up of characters, symbols, and the like.

  In the above-described embodiment, permission for copying, external transmission, and the like is obtained for the image captured by the imaging unit 22, but for example, an image in which a person is captured from an external device such as a digital camera or a personal computer is obtained. It is also possible to receive the received image, identify the person in the image, enter authentication information, and obtain permission to copy the image or send it externally.

  In addition, when an image is picked up by the image pickup unit 22, an authentication operation for obtaining permission to perform copying or external transmission is immediately performed on the picked-up image. And an authentication operation for obtaining permission to perform copying, external transmission, or the like may be performed when an image stored with the reproduction mode set is reproduced.

  Further, in the above embodiment, the specific ID number and the face image information are stored in the address book storage unit 25 that stores the mail address and the telephone number. A part may be provided and stored there.

  In addition, images that have been approved for copying and external transmission can be copied and externally transmitted at a later date by storing them together with a permission flag. It is also possible to provide a time measuring means for measuring a period such as the number of days from now on, or a calculating means for calculating the number of days so that the permission is canceled when a predetermined number of days elapses.

  Furthermore, in the above-described embodiment, an example in which a mobile phone device is used as a terminal device has been described. However, the present invention can also be applied to other terminal devices such as a digital camera, a video camera, a personal computer, a PDA, and a music player. is there.

DESCRIPTION OF SYMBOLS 1 Cellular phone apparatus 3 Authentication apparatus 4 Cellular phone apparatus 5 Cellular phone apparatus 12 Control part 13 Display part 14 Operation part 16 Telephone part 17 Antenna 18 Wireless communication part 23 Memory | storage part 24 Storage image memory | storage part 25 Address book memory | storage part 25D Image information memory | storage Area 34 Storage section 35 Authentication database 40 Control section 41 Display section 42 Operation section 44 Telephone section 45 Antenna 46 Wireless communication section 49 Storage section 50 Authentication information storage section 52 Address book storage section 52D Image information storage area 52E Authentication information storage area

Claims (10)

Imaging means capable of imaging a person;
Display means for displaying a photographed image photographed by the imaging means;
Person information storage means for storing person identification information for identifying a person and image information of the person in association with each other;
A person photographed by discriminating the similarity between the image of the person photographed in the photographed image taken by the imaging means and displayed on the display means and the image information of the person stored in the person information storage means A person identification means to identify;
An authentication information input means for inputting authentication information;
A determination result acquisition means for acquiring a determination result as to whether or not the authentication information input by the authentication information input means matches the authentication information of the person specified by the person specifying means;
Control means for performing control to permit or disallow copying or external transmission of the captured image based on the determination result acquired by the determination result acquisition means;
A terminal device comprising:   When a plurality of persons are photographed in the photographed image, the processing by the person specifying means, the authentication information input means, and the determination result obtaining means is executed for all photographed persons. The terminal device according to claim 1, wherein copying or external transmission of the photographed image is permitted only when discrimination for all the persons being photographed is permitted. The discrimination result acquisition means includes
The personal identification information stored in the personal information storage means and the authentication information input by the authentication information input means in association with the person specified from the photographed image by the person specifying means and the authentication information input by the authentication information input means are transmitted to an external authentication device. A transmission means;
Receiving means for receiving a determination result for authenticating whether or not the authentication information input by the authentication information input means sent from the external authentication device matches the authentication information of the person specified by the person specifying means When,
The terminal device according to claim 1, further comprising: The person information storage means further stores inquiry destination information that enables transmission / reception with the inquiry destination electronic device in association with the person identification information,
The discrimination result acquisition unit associates the authentication information input by the authentication information input unit with the contact information stored in the person information storage unit in association with the person specified from the photographed image by the person specifying unit. A transmission means for transmitting to the inquiry electronic device using,
Receiving means for receiving a determination result as to whether or not the authentication information input by the authentication information input means sent from the inquiry electronic device matches the authentication information of the person specified by the person specifying means;
The terminal device according to claim 1, further comprising: The person information storage means further stores authentication information corresponding to the identification information of the person,
The discrimination result acquisition unit matches the authentication information input by the authentication information input unit with the authentication information stored in the person information storage unit in association with the identification information of the person specified by the person specifying unit. The terminal device according to claim 1, wherein the determination result is obtained by determining whether or not to authenticate depending on whether or not to perform authentication. Further, a storage unit for the discrimination result acquisition unit determination results obtained by the saving in correspondence with the shooting image discrimination information indicating which whether to permit copying or external transmission of the captured image ,
Reproduction control means for permitting or not permitting the copy or external transmission of the captured image reproduced when the captured image stored in the storage means is reproduced, according to the discrimination information stored correspondingly;
The terminal device according to claim 1, further comprising: Display means for displaying a subject image in which a person is a subject;
Person information storage means for storing person identification information for identifying a person and image information of the person in association with each other;
A person who identifies the person who is the subject by determining the similarity between the image of the person who is the subject of the subject image displayed on the display means and the image information of the person stored in the person information storage means Specific means,
An authentication information input means for inputting authentication information;
A determination result acquisition means for acquiring a determination result as to whether or not the authentication information input by the authentication information input means matches the authentication information of the person specified by the person specifying means;
Control means for performing control to permit or disallow copying or external transmission of the subject image based on the determination result acquired by the determination result acquisition means;
A terminal device comprising: An authentication system comprising a terminal device and an authentication device for authenticating whether or not the authentication information transmitted from the terminal device matches the registered authentication information,
The authentication device
Authentication storage means for storing identification information of a person and authentication information of the person in association with each other;
Authentication receiving means for receiving information identifying the person transmitted from the terminal device and authentication information;
Authentication discrimination means for discriminating whether or not to authenticate according to whether or not the identification information of the corresponding person matches from the authentication information stored in the authentication storage means and the authentication information received by the authentication receiving means; ,
Authentication transmitting means for transmitting the determination result by the authentication determining means to the terminal device;
With
The terminal device
Imaging means capable of imaging a person;
Display means for displaying a photographed image photographed by the imaging means;
Person information storage means for storing person identification information for identifying a person and image information of the person in association with each other;
A person photographed by discriminating the similarity between the image of the person photographed in the photographed image taken by the imaging means and displayed on the display means and the image information of the person stored in the person information storage means A person identification means to identify;
An authentication information input means for inputting authentication information;
And terminal transmission means for transmitting the information of the person identified by the authentication information input by the input means authentication information and the person identification unit to the authentication device,
Terminal receiving means for receiving the determination result of whether or not the identification information of the person sent from the authentication device matches;
Control means for performing control for permitting or not permitting copying or external transmission of the captured image based on the determination result received by the terminal receiving means;
An authentication system comprising: On the computer,
An imaging function that can capture people,
A display function for displaying a photographed image photographed by this imaging function;
A person information storage control function for storing person identification information for identifying a person and image information of the person in association with each other in a person information storage means;
A person photographed by discriminating the similarity between the image of the person photographed in the photographed image taken by the imaging function and displayed by the display function and the person image information stored in the person information storage means Person identification function to identify,
A determination result acquisition function for acquiring a determination result as to whether or not the authentication information input by the authentication information input means for inputting the authentication information matches the authentication information of the person specified by the person specifying function;
A control function for performing control to permit or disallow copying or external transmission of the captured image based on the determination result acquired by the determination result acquisition function;
A program to realize On the computer,
A display function that displays subject images of human subjects
A person information storage control function for storing person identification information for identifying a person and image information of the person in association with each other in a person information storage means;
A person who identifies the person who is the subject by determining the similarity between the image of the person who is the subject of the subject image displayed in the display function and the image information of the person stored in the person information storage means Specific functions,
A determination result acquisition function for acquiring a determination result as to whether or not the authentication information input by the authentication information input means for inputting the authentication information matches the authentication information of the person specified by the person specifying function;
A control function for performing control to permit or disallow copying or external transmission of the subject image based on the determination result acquired by the determination result acquisition function;
A program to realize

Images