JP2016051981A - Imaging apparatus and imaging system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus having high safety by preventing image data from being illegally used and an imaging system.SOLUTION: The imaging apparatus having an image pickup device 41 for imaging object light, includes: a generating section 44 for generating an identification code on the basis of image data of an image photographed with the image pickup device; a transmission section 32 for transmitting the identification code generated with the generating section to a display device registered in a predetermined server by being associated with the imaging apparatus; a recognition section 41 for recognizing the identification code displayed on a display screen of the display device; a decoding section 45 for generating decoded image data obtained by decoding the identification code recognized with the recognition section; a collation section 30 for collating the decoded image data with the image data; and a determination section 30 for determining whether to permit outputting of the image data to an external device on the basis of the collation result obtained with the collation section.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an imaging apparatus and an imaging system.

  Conventionally, a digital camera capable of data communication with a server or another communication terminal is known (see, for example, Patent Document 1). According to this digital camera, the owner can print a photographed image with a printer or upload it to a predetermined site operated by a server.

JP 2003-319327 A

  By the way, in this digital camera, when the digital camera is acquired by a third party, the image data stored in the digital camera is transferred to an external device against the intention of the owner. There was a risk of being used.

  An object of the present invention is to provide an imaging apparatus and an imaging system with high safety so that image data is not illegally used.

  The imaging device of the present invention is an imaging device having an imaging device that images subject light, a generation unit that generates an identification code based on image data of an image captured by the imaging device, and a generation unit that generates the identification code A transmission unit that transmits the identification code to a predetermined server; and the display unit that is transferred from the predetermined server to the predetermined server in association with the imaging device and displayed on the display screen of the display device A recognition unit for recognizing the identification code, a decoding unit for generating decoded image data obtained by decoding the identification code recognized by the recognition unit, and comparing the decoded image data with the image data. The image processing apparatus includes: a collation unit; and a determination unit that determines whether the image data is output to an external device based on a collation result by the collation unit.

  The imaging system of the present invention includes an imaging device having an imaging element that images subject light, a display device having a display screen for displaying an identification code, and a management server that manages the imaging device and the display device. In the imaging system, the imaging device generates an identification code based on image data of an image captured by the imaging element, and the identification code generated by the generation unit via the server. A transmission unit for transmitting to the display device, a recognition unit for recognizing the identification code displayed on the display screen of the display device, and decoded image data obtained by decoding the identification code recognized by the recognition unit A decoding unit for generating the image, a matching unit for matching the decoded image data with the image data, and the image for the external device based on a matching result by the matching unit. A determination unit that determines whether or not to allow data output, and the display device receives the identification code from the imaging device via the management server, and the identification code received by the reception unit. A display control unit for displaying on the display screen, wherein the management server associates and registers the imaging device and the display device, and the identification code transmitted from the transmission unit of the imaging device. And a transfer unit for transferring to the display device.

  In addition, the imaging apparatus of the present invention is received by the information storage unit that stores an information file including person characteristic information, a reception unit that receives new characteristic information of the person from a predetermined server, and the reception unit A file update unit that updates the information file with the new feature information, an image sensor that captures the person, and a feature of the person from the image of the person included in the image data of the image captured by the image sensor. A feature recognition unit for recognizing, and a determination for determining whether or not the information file of the person updated by the file update unit includes the feature information that matches the feature of the person recognized by the feature recognition unit And an authentication unit that performs personal authentication of the person based on the determination result of the determination unit.

  The imaging system of the present invention is an imaging system including an imaging device having an imaging element that images subject light, and a server that can communicate with the imaging device, wherein the server captures human feature data. A personal information storage unit that is registered in association with the address of the device, an extraction unit that extracts feature information of a person included in image data of an image uploaded to a predetermined site provided by the server, and the extraction unit A transmission unit configured to transmit the feature information of the person to an address of the imaging device when feature data matching the feature information of the person is registered in the personal information storage unit, and the imaging device The information storage unit that stores the person information file in advance, the reception unit that newly receives the person characteristic information from the server, and the reception unit A file updating unit that updates the information file with the received characteristic information of the person, and when the person is imaged by the imaging device, the image of the person included in the captured image data of the captured image A feature recognition unit for recognizing a feature of a person, and whether or not feature information that matches the feature of the person recognized by the feature recognition unit exists in the information file of the person updated by the file update unit. It is characterized by comprising a determination unit for determining and an authentication unit for performing personal authentication of the person based on the determination result of the determination unit.

  An imaging apparatus according to the present invention includes an imaging unit that captures a subject, and includes a personal information storage unit that stores in advance personal information of a user of the imaging apparatus, and an activation command that activates the imaging apparatus. The acquisition unit that acquires the starter information of the starter who has input the start command when being executed, the starter information acquired by the acquisition unit, and the personal information stored in the personal information storage unit A personal authentication unit that performs personal authentication of the starter, an image storage unit that stores image data of an image photographed by the starter, and the image data stored in the image storage unit to an external device. When the transfer command to be transferred is input, an instruction acquisition unit that acquires the transfer instruction information of the transfer instructioner who has input the transfer command, and the personal authentication unit acquired by the instruction acquisition unit Using the transfer instructor information and the personal information stored in the personal information storage unit, an authentication control unit that re-authenticates the transfer instructor, the personal authentication result of the initiator, and the transfer instructor's Based on the re-authentication result, a determination unit that determines whether the initiator and the transfer instructor are the same person, and the determination unit determines that the initiator and the transfer instructor are the same person And a transfer unit that transfers the image data to the external device when it is performed.

  According to the present invention, it is possible to provide an imaging apparatus and an imaging system with high safety that do not illegally use image data.

It is a figure which shows the structure of the imaging system which concerns on 1st Embodiment. It is a block diagram which shows the structure of the management server which concerns on 1st, 2nd embodiment. It is a block diagram which shows the structure of the digital camera which concerns on 1st, 2nd embodiment. It is a block diagram which shows the structure of the smart phone which concerns on 1st, 2nd embodiment. It is a flowchart which shows the process of the imaging system which concerns on 1st Embodiment. It is a flowchart which shows the process of the imaging system which concerns on 2nd Embodiment. It is a figure which shows the structure of the imaging system which concerns on 3rd Embodiment. It is a block diagram which shows the structure of the imaging device which concerns on 3rd Embodiment. It is a block diagram which shows the structure of the web server which concerns on 3rd Embodiment. 14 is a flowchart illustrating an initial registration process in the imaging apparatus according to the third embodiment. It is a flowchart which shows the update process of the information file in the imaging system which concerns on 3rd Embodiment. It is a flowchart which shows the personal authentication process when a person is image | photographed using the imaging device which concerns on 3rd Embodiment. It is a figure which shows the structure of the digital camera which concerns on 4th Embodiment. It is a flowchart which shows the process of the digital camera which concerns on 4th Embodiment. It is a flowchart which shows the process of the digital camera which concerns on 5th Embodiment. It is a flowchart which shows the image reproduction process when the digital camera which concerns on 5th Embodiment is started by the user who registered personal information, and image | photographing was performed. It is a flowchart which shows the image reproduction process when the digital camera which concerns on 5th Embodiment is started by the third party and imaging | photography was performed. It is a flowchart which shows the process of the digital camera which concerns on 6th Embodiment.

(First embodiment)
The imaging system according to the first embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram illustrating a configuration of an imaging system 2 according to the first embodiment. The imaging system 2 includes a management server 4 that manages communication devices, and the management server 4 is connected to a digital camera 8 and a smartphone 10 via a network 6 so as to communicate with each other.

  FIG. 2 is a block diagram illustrating a configuration of the management server 4 according to the first embodiment. The management server 4 provides an image posting site (not shown) that accepts image postings, and includes a CPU 20 that comprehensively controls each unit of the management server 4. Uploaded to the CPU 20 from the digital camera 8 via the network 6, the communication unit 22 that communicates with the smartphone 10, the registration unit 24 that registers information related to the managed communication device, and the digital camera 8 via the network 6. An image storage unit 26 that stores image data of the image is connected.

  FIG. 3 is a block diagram showing a configuration of the digital camera 8 according to the first embodiment. The digital camera 8 includes a CPU 30 that comprehensively controls each unit of the digital camera 8. The CPU 30 includes an operation unit 31 including a power switch (not shown), a shutter button (not shown), and the like, a communication unit 32 that communicates with the management server 4 via the network 6, and short-range wireless communication. A short-range communication unit 33 that communicates with the smartphone 10, a GPS 34 that measures the current position based on a signal received from a GPS satellite, an LCD display unit 38 that displays images and icons, and icons displayed on the LCD display unit 38 A touch panel 39 that detects touch with a finger or the like, an image sensor 41 that images subject light and generates an image signal, and an image storage unit 42 that stores image data generated by the image signal output from the image sensor 41 , An information generation unit 44 that generates an identification code using image data stored in the image storage unit 42, and an arithmetic unit that performs a decoding process of the identification code 5, a memory card slot 53 for mounting a memory card 52 for storing device information or information storage unit 46 stores information relating to the digital camera 8, such as a communication address, and image data, are connected.

  Here, the information generation unit 44 generates a two-dimensional code such as a QR code (registered trademark) as an identification code.

  FIG. 4 is a block diagram illustrating a configuration of the smartphone 10 according to the first embodiment. The smartphone 10 includes a CPU 60 that comprehensively controls each unit of the smartphone 10. The CPU 60 includes an operation unit 61 including a power switch (not shown), a communication unit 62 that communicates with the management server 4 via the network 6, and short-range communication that communicates with the digital camera 8 by short-range wireless communication. Unit 63, LCD display unit 68 for displaying images and icons, touch panel 69 for detecting that the icon displayed on LCD display unit 68 is touched with a finger, and the like, and an image sensor for imaging subject light to generate an imaging signal 71, an image storage unit 72 that stores image data generated by an imaging signal output from the image sensor 71, an information storage unit 76 that stores information about the smartphone 10 such as device information and a communication address, and image data. A memory card slot 83 into which the memory card 82 is inserted is connected.

  Next, processing of the imaging system 2 according to the first embodiment will be described with reference to the flowchart shown in FIG. First, when the operator uses the digital camera 8 for the first time, a pairing process for specifying the smartphone 10 as a connection partner is performed as an initial setting. When the pairing process is successful, the CPU 30 of the digital camera 8 acquires information related to the smartphone 10 via the short-range communication unit 33.

  Next, when the operator performs an operation of registering the paired device combination in the management server 4, the CPU 30 reads information on the digital camera 8 from the information storage unit 46, and the communication unit 22 performs the digital camera operation. The information regarding 8 is transmitted to the management server 4 via the network 6 with the information regarding the smart phone 10 (step S1).

  When the CPU 20 of the management server 4 receives the information about the digital camera 8 and the information about the smartphone 10, the CPU 20 associates them and registers them in the registration unit 24 (step S21).

  Here, the operator sets the mode of the digital camera 8 to a posting mode in which the captured image is immediately uploaded to the image posting site. Next, when the shutter button is operated by the operator and an image of the subject is captured (step S2), the CPU 30 stores the captured image data in the image storage unit. Next, the CPU 30 reads the photographed image data from the image storage unit 42, and the information generation unit 44 generates a two-dimensional code based on the photographed image data (step S3). Here, the generation of the two-dimensional code is performed using a known technique.

  Next, CPU30 transmits a two-dimensional code to the management server 4 via the network 6 by the communication part 32 (step S4).

  When the CPU 20 of the management server 4 receives the two-dimensional code from the digital camera 8 (step S22), the communication address of the smartphone 10 registered in association with the digital camera 8 from the information stored in the registration unit 24. Is identified. Next, the CPU 20 uses the communication unit 22 to transfer the two-dimensional code to the communication address of the smartphone 10 (step S23).

  When receiving the two-dimensional code (step S31), the CPU 60 of the smartphone 10 displays an image of the two-dimensional code on the LCD display unit 68 (step S32).

  Next, when the operator brings a photographing lens (not shown) of the digital camera 8 close to the smartphone 10 and photographs an image of the two-dimensional code displayed on the LCD display unit 68 (step S5), the CPU 30 of the digital camera 8 is photographed. The two-dimensional code is recognized from the image data by analyzing the image data of the obtained image. Next, the CPU 30 uses the calculation unit 45 to decode the two-dimensional code (step S6), and reconverts the two-dimensional code into image data (hereinafter referred to as decoded image data). Note that the decoding process of the two-dimensional code is performed using a known decoding technique.

  Next, the CPU 30 collates the captured image data stored in the image storage unit 42 with the decoded image data (step S7). Then, it is determined whether or not the decoded image based on the decoded image data matches the captured image based on the captured image data (step S8).

  When the decoded image matches the photographed image (step S8: Yes), the CPU 30 permits uploading of the photographed image (step S9), and the photographed image data stored in the image storage unit 42 is networked by the communication unit 32. 6 to the management server 4 (step S10). When the CPU 20 of the management server 4 receives the captured image data (step S24), the captured image based on the captured image data is made public on the image posting site so that it can be viewed (step S25), and the captured image data is converted into an image. Store in the storage unit 26. Thereby, the upload of the photographed image to the image posting site is completed.

  The CPU 30 of the digital camera 8 determines whether or not an operation for ending the shooting has been performed after transmitting the shot image data to the management server 4 (step S11). When the operation for ending the shooting is not performed (step S11: No), the process returns to step S2. On the other hand, when an operation for ending photographing is performed (step S11: Yes), a series of processes is ended.

  If the decoded image does not match the captured image (step S8: No), the CPU 30 prohibits uploading of the captured image data (step S12), and then proceeds to the process of step S11.

  According to the invention according to the first embodiment, if the operator of the digital camera 8 does not have the specific smartphone 10 registered in the management server 4, the photographed image taken using the digital camera 8 is taken. Since uploading cannot be performed, it is possible to provide the digital camera 8 and the imaging system 2 with high safety so that image data is not illegally used by a third party.

  In addition, since the management server 4 manages the smartphone 10 that displays the image of the two-dimensional code and the digital camera 8 that reads the image of the two-dimensional code displayed on the smartphone 10, the authentication system is not complicated. can do.

(Second Embodiment)
Next, processing of the imaging system according to the second embodiment will be described. In the imaging system according to the second embodiment, one two-dimensional code is generated using a plurality of photographed image data in the first embodiment. Here, as illustrated in FIGS. 2 to 4, the management server 204, the digital camera 208, and the smartphone 210 according to the second embodiment are respectively the management server 4, the digital camera 8, and the digital camera 8 according to the first embodiment. And a configuration similar to that of the smartphone 10. Therefore, in the second embodiment, portions different from the first embodiment will be described in detail, and descriptions of overlapping portions will be omitted as appropriate.

  First, when the operator uses the digital camera 208 for the first time, a pairing process is performed as an initial setting. Next, when an operation for registering the paired device combination in the management server 204 is performed, information on the digital camera 8 is transmitted to the management server 204 together with information on the smartphone 10 (step S51), and these are registered in association with each other. Registered in the unit 24 (step S71).

  Here, when a plurality of images are captured by the operator operating the shutter button (step S52), the captured image data for the number of captured images is stored in the image storage unit. Next, when the operator selects a plurality of captured image data to be uploaded to the image posting site from the captured image data stored in the image storage unit 42, the CPU 30 selects the selected captured image data. It is specified as a target for generating a two-dimensional code (step S53). Next, the CPU 30 causes the information generation unit 44 to generate one two-dimensional code based on the plurality of identified captured image data (step S54).

  Next, the CPU 30 transmits the two-dimensional code to the management server 204 via the network 6 by the communication unit 32 (step S55).

  When receiving the two-dimensional code (step S72), the CPU 20 of the management server 204 transfers the two-dimensional code to the communication address of the smartphone 210 registered in association with the digital camera 208 (step S73).

  When receiving the two-dimensional code (step S81), the CPU 60 of the smartphone 210 displays an image of the two-dimensional code on the LCD display unit 68 (step S82).

  Next, when the operator brings the photographing lens of the digital camera 208 close to the smartphone 210 and photographs an image of the two-dimensional code displayed on the LCD display unit 68 (step S56), the CPU 30 of the digital camera 208 captures the captured image. The two-dimensional code is recognized from the image data by analyzing the image data. Next, the CPU 30 causes the calculation unit 45 to decode the two-dimensional code (step S57), and reconverts the two-dimensional code into a plurality of decoded image data.

  Next, the CPU 30 reads the plurality of captured image data selected in step S53, and collates each captured image data with all the decoded image data decoded in step S57 (step S58). Then, it is determined whether or not all the decoded images match the captured image (step S59).

  When all the decoded images coincide with the photographed image (step S59: Yes), the CPU 30 permits uploading of the photographed image (step S60), and the communication unit 32 obtains the plurality of photographed image data selected in step S53. The data is transmitted to the management server 204 via the network 6 (step S61). When receiving the captured image data (step S74), the CPU 20 of the management server 204 releases the captured image based on the captured image data on the image posting site so that it can be viewed (step S75), and the captured image data is converted into an image. Store in the storage unit 26. Thereby, the upload of the photographed image to the image posting site is completed.

  If there is a decoded image that does not match the captured image (step S59: No), the CPU 30 prohibits uploading of the captured image data (step S63), and then proceeds to the process of step S62. Since the process of step S62 is the same as the process of step S11 according to the first embodiment, the description thereof is omitted.

  According to the imaging system and the digital camera 208 according to the second embodiment, an operator can generate a two-dimensional code using the smartphone 210 in order to generate one two-dimensional code based on a plurality of captured image data. Multiple authentication images can be uploaded to an image posting site safely and efficiently with only one authentication.

  In each of the embodiments described above, when a captured image is captured, reduced image data such as thumbnail image data is generated based on the captured image data, and a two-dimensional code is generated from the reduced image data. Good. In this case, since the capacity of the reduced image data is smaller than the capacity of the captured image data, the burden on the information generation unit 44 can be reduced, and a two-dimensional code can be generated quickly.

  In the above-described embodiments, the file name of the captured image data and the file name of the two-dimensional code may be related to each other. For example, when the file name of the captured image data is “DSC — 0001.jpg”, the CPU 30 of the digital camera sets “DSC — 0001−A.jpg” to the two-dimensional code generated from the captured image data “DSC — 0001.jpg”. Give a file name like this. Accordingly, when the smartphone receives a plurality of two-dimensional codes, the operator can easily grasp which two-dimensional code is displayed on the smartphone and which captured image can be uploaded.

  In the second embodiment described above, when the power is turned on, the digital camera 8 starts positioning by the GPS 34 and acquires position information of the current position and date / time information of the date and time at the time of positioning. Also good. And when an image is image | photographed, CPU30 adds the positional information and date information acquired from GPS34 to picked-up image data.

  Next, the CPU 30 groups the captured image data based on at least one of position information and date / time information. For example, photographed image data photographed at the same place and time is recorded in the internal memory as one image group. Next, the operator selects photographed image data of one or a plurality of photographed images to be uploaded from the image group. Here, the operator can select the captured image data captured at the same place and time from the image group, so that even if a large number of captured images are captured, the captured image data of the captured image to be uploaded can be easily obtained. Can be selected.

  Next, the CPU 30 causes the information generation unit 44 to generate one two-dimensional code based on the selected captured image data. In this case, one two-dimensional code may be generated based on a plurality of photographed image data included in one image group even if the operator does not select the photographed image data.

  In each of the above-described embodiments, the two-dimensional code may be generated from the entire photographed image data or a part of the image data. Further, a two-dimensional code may be generated based on the file name of the captured image data.

  In each of the above-described embodiments, a two-dimensional code may be generated on the smartphone side. In this case, the CPU 30 of the digital camera extracts the material necessary for generating the two-dimensional code from the captured image data, and transmits the extracted material to the smartphone via the management server. The CPU 60 of the management server generates a two-dimensional code using the material and displays an image of the generated two-dimensional code on the LCD display unit 68.

  In each of the above-described embodiments, a digital camera is described as an example of the imaging device. However, the imaging device decodes the two-dimensional code and a function for generating a two-dimensional code using captured image data. Other devices such as a smartphone or a tablet terminal may be used as long as they have a function and the like and can execute the series of processes described above. Similarly, a device paired with a digital camera is not limited to a smartphone, and may be another device such as a digital camera, a mobile phone, or a tablet terminal.

  Further, in each of the above-described embodiments, whether or not uploading of a photographed image to an image posting site is determined by comparing the photographed image and the decoded image is not limited to whether or not uploading is permitted. A determination may be made as to whether or not output of captured image data to the apparatus is permitted. For example, whether or not to transfer the captured image data to a printer or personal computer (not shown) may be determined. Alternatively, the memory card 52 may be interpreted as an external device, and whether or not to record the captured image data in the memory card 52 may be determined.

  In each of the above-described embodiments, the two-dimensional code is described as an example of the identification code. However, the identification code may be a one-dimensional code (for example, a barcode) or a three-dimensional code.

(Third embodiment)
The imaging system according to the third embodiment will be described below with reference to the drawings. 2. Description of the Related Art Conventionally, there is known a personal authentication device that recognizes an individual by calculating similarity by comparing feature information of a photographed person with feature information stored in advance in a database (for example, Japanese Patent Laid-Open No. 2003-2003). No. -319327).

  By the way, in this personal recognition apparatus, when the person who is the subject of personal authentication grows up or when the makeup is changed, there is a possibility that the personal characteristics change and accurate personal authentication cannot be performed.

  An object of the invention according to the third embodiment is to provide an imaging apparatus and an imaging system that can perform individual authentication accurately even if the characteristics of a person change.

  FIG. 7 is a block diagram illustrating a configuration of an imaging system 302 according to the third embodiment. The imaging system 302 includes an imaging device 304 and a web server 308 that is communicably connected to the imaging device 304 via a network 306.

  Here, the imaging device 304 includes a plurality of imaging devices of a digital camera 304a, a digital camera 304b, a digital camera 304c, a digital camera 304d,. Note that the digital camera 304a, the digital camera 304b, the digital camera 304c, the digital camera 304d,... Are examples, and in addition, a smartphone, a tablet terminal, a mobile phone, and the like are included in the imaging device 304. Also good.

  FIG. 8 is a block diagram illustrating a configuration of an imaging apparatus 304 according to the third embodiment. The imaging device 304 includes a CPU 330 that controls each part of the imaging device 304 in an integrated manner. The CPU 330 includes an operation unit 331 including a power switch and a shutter button (not shown), a communication unit 332 that communicates with the web server 308 via the network 306, an LCD display unit 338 that displays an image, and an LCD display unit 338. Touch panel 339 for detecting a position touched by a finger or the like, a storage unit 340 for temporarily storing personal information input by operating the touch panel 339, an image sensor 341 for imaging subject light and generating an image signal, an image sensor An image storage unit 342 that temporarily stores image data generated from the imaging signal output from the image data 341, a feature recognition unit 344 that recognizes features of a person's face and clothes worn by the person from the image data, and information to be described later Equipped with an information storage unit 346 for storing files and a memory card 352 for storing image data Memory card slot 353 is connected to that.

  FIG. 9 is a block diagram illustrating a configuration of the web server 308 according to the third embodiment. The web server 308 is a server that provides a predetermined social networking service site (hereinafter referred to as an SNS site), and includes a CPU 360 that comprehensively controls each unit of the web server 308. The CPU 360 receives image data of images uploaded to the SNS site, a communication unit 362 that communicates with the imaging device 304 via the network 306, a personal information database 364 that stores personal information such as a person's profile and feature information, and the like. An image storage unit 366 for storing and a feature recognition unit 368 for recognizing features such as a person's face and clothing worn by the person from the image data are connected.

  Here, as the feature information of the person, for example, feature information of various scenes such as feature information of the front of the face, feature information of the side face, feature information of the face and clothes when photographed in a low luminance environment, and the like. It is registered. The profile also includes the name of the person and the date of birth.

  Next, with reference to the flowchart shown in FIG. 10, the user A of the digital camera 304a sets the daughter X in the initial registration process for first registering the person to be personally authenticated in the imaging apparatus 304 according to the third embodiment. An example of registration as a person subject to personal authentication will be described. First, an operation for starting the initial registration is performed (step S301), and a message such as “Perform personal authentication registration. Please photograph the target person” is displayed on the LCD display unit 338. Next, when the user A operates the shutter button to photograph the face of the daughter X (step S302), the CPU 330 stores the image data of the image of the face of the daughter X in the image storage unit 342.

  Next, the CPU 330 displays a predetermined input screen after displaying a message such as “Please input the name and date of birth of the photographed person” on the LCD display unit 338. Here, when the name and date of birth of the daughter X are input through the input screen by the operation of the touch panel 339 of the user A (step S303), the CPU 330 displays the input name and date of birth as personal information. Is temporarily stored in the storage unit 340.

  Next, the CPU 330 reads out the image data from the image storage unit 342, and the feature recognition unit 344 causes the feature information of the face of the daughter X from the image data (for example, the size and position of the eyes and nose relative to the size of the entire face). Information) is extracted (step S304). Next, the CPU 330 reads out the personal information of the daughter X from the storage unit 340, creates an information file of the daughter X by adding the personal information of the daughter X to the facial feature information, and registers it in the information storage unit 346 (step S305). ).

  In addition, the CPU 330 transmits the daughter X information file together with the communication address of the digital camera 304a to the web server 308 via the network 306 (step S306). When the CPU 360 of the web server 308 receives the daughter X information file, the CPU 360 retrieves the personal information of the daughter X from the personal information database 364 based on the personal information of the daughter X included in the information file. When the personal information of the daughter X is detected, the CPU 360 associates the personal information of the daughter X with the information file and the communication address of the digital camera 304a.

  Next, information file update processing in the imaging system 302 according to the third embodiment will be described with reference to the flowchart shown in FIG. The information file is updated by uploading an image of the face of daughter X (for example, an image taken at an event such as an athletic meet or a cultural festival) from the imaging device 304 that can communicate with the web server 308 to the SNS site. Every time it is done.

  First, when an image showing the face of the daughter X is uploaded to the SNS site (step S311), the CPU 360 of the web server 308 uses the feature recognition unit 368 to face the faces of the daughters X and the like shown in the uploaded image. And the feature information of the faces of the daughters X are extracted from the image data (step S312).

  Next, the CPU 360 searches the personal information database 364 and specifies personal information including feature information that matches the facial feature information extracted from the image data (step S313). Thereby, the personal information of the daughters X is specified.

  If the communication address is associated with the personal information, the CPU 360 transmits the facial feature information extracted from the image data to the communication address associated with the personal information (step S314). For example, when the communication address of the digital camera 304a is associated with the personal information of the daughter X, the CPU 360 transmits the feature information of the face of the daughter X extracted from the image data to the communication address of the digital camera 304a. The feature information of the face of the daughter X is added to the personal information database 364.

  When the CPU 330 of the digital camera 304a receives the feature information of the daughter X's face (step S321), the CPU 330 updates the information file of the daughter X in the information storage unit 346 based on the received feature information (step S322).

  Next, referring to the flowchart shown in FIG. 12, when a person is photographed by the imaging apparatus 304 according to the third embodiment, personal authentication processing when performing personal authentication using an updated information file explain. Hereinafter, a case where the user A photographs the daughter X using the digital camera 304a will be described as an example.

  First, when the power of the digital camera 304a is turned on, the CPU 330 communicates with the web server 308 via the network 306 to access the SNS site. Here, at the SNS site, each time an image showing the face of the daughter X is uploaded, the feature information of the face of the daughter X is extracted from the image and transmitted to the digital camera 304a. The digital camera 304a updates the daughter X information file each time the daughter X facial feature information is received from the web server 308.

  Here, when the face of the daughter X is photographed by the user A (step S331), the CPU 330 causes the feature recognition unit 344 to extract the feature information of the face of the daughter X from the image data of the image of the face of the daughter X ( Step S332). Next, the CPU 330 determines whether or not feature information that matches the extracted feature information is stored in the information storage unit 346 (step S333).

  If feature information that matches the extracted feature information is stored in the information storage unit 346 (step S333: Yes), that is, if the daughter X can be recognized from the image data, the CPU 330 registers it in the information file of the daughter X. The personal information such as the name of the daughter X and the date of birth are displayed on the LCD display unit 338 (step S334). Then, after adding the daughter X person information to the image data as tag information, the image data is stored in the memory card 352 in a predetermined file format such as Exif.

  On the other hand, if feature information that matches the extracted feature information is not stored in the information storage unit 346 (step S333: No), that is, if the daughter X cannot be recognized from the image data, the CPU 330 displays the personal information of the daughter X. The image data is stored in the memory card 352 in a predetermined file format such as Exif without being displayed on the LCD display unit 338 or tagging the image data.

  According to the invention according to the third embodiment, every time an image showing the face of the daughter X is uploaded to the SNS site, the information about the daughter X stored in the information storage unit 346 of the imaging device 304 is displayed. Since the file is updated, for example, even when the daughter X grows and the facial features change, the daughter X can be accurately recognized at the time of shooting. Further, since the user A does not need to update the feature information of the daughter X with his / her hand each time the daughter X grows, the user A's effort to update the feature information can be reduced.

  In the third embodiment described above, feature information may be classified and registered for each scene. For example, it is assumed that the feature information of the front face of the daughter X has already been registered in the information file. Here, when the digital camera 304a newly receives the front feature information of the face of the daughter X from the web server 308, the CPU 330 has already registered the front feature information of the front face of the daughter X of the daughter X. The feature information of the front face of X is overwritten and updated.

  On the other hand, when the digital camera 304a newly receives the profile information of the profile of the daughter X from the web server 308, the CPU 330 newly registers the profile information of the profile of the daughter X in the information file. Similarly, when the feature information of the face of the daughter X when photographed in the low-luminance environment is newly received, the CPU 330 causes the face of the daughter X when photographed in the newly received low-luminance environment. Is registered in the information file.

  Thus, by registering various scene feature information in the information file, it is possible to accurately perform personal authentication even if the shooting environment changes.

  In the third embodiment described above, the feature information registered in the information file may be deleted when a predetermined time has elapsed. For example, when a predetermined time has elapsed from the initial registration, the feature information extracted from the image data at the time of initial registration is deleted from the information file. In addition, when a predetermined time has elapsed since the feature information received from the web server 308 is registered in the information file, the feature information received from the web server 308 is deleted from the information file.

  Thereby, for example, when the daughter X grows and the facial features change, unnecessary information such as feature information before the facial features change is deleted, and the capacity of the information storage unit 346 can be saved. it can. In addition, since the number of feature information necessary for personal authentication can be limited, feature information used for personal authentication is not excessive, and authentication processing can be performed quickly. Note that the predetermined time may be arbitrarily set by the user, or may be set in the imaging device 304 in advance.

  In the third embodiment described above, features other than the face, such as clothing worn by a person and accessories, may be registered in the information file as auxiliary feature information. In this case, for example, when the personal authentication cannot be performed based on the feature of the person's face, the CPU 330 performs the personal authentication using the auxiliary feature information. Specifically, clothes features (such as polka dots) are extracted from the image data, and it is determined whether or not auxiliary feature information that matches the extracted clothes feature information is stored in the information storage unit 346. Thus, for example, even when a person is photographed from a distance and it is difficult to recognize the person's face from the image data, personal authentication can be reliably performed.

  In the third embodiment described above, the feature information may be classified and registered in the information file for each period. For example, when the initial registration of the daughter X is performed in the spring, the CPU 330 of the digital camera 304a creates an information file of the daughter X using the feature information of the daughter X's face as spring feature information, and stores it in the information storage unit 346. Remember. When new feature information of the face of the daughter X is received from the web server 308 in the spring, the CPU 330 overwrites and updates the spring feature information acquired at the time of initial registration. On the other hand, when the feature information of the face of the new daughter X is received from the web server 308 in summer, autumn, and winter, the CPU 330 stores the feature information for summer, the feature information for autumn, and the feature information for winter in the information file of the daughter X. Add and register each.

  Next, suppose that daughter X was photographed in the spring. In this case, the CPU 330 extracts the feature information of the daughter X's face from the image data, determines whether there is spring feature information that matches the extracted feature information, and performs personal authentication of the daughter X. Accordingly, the daughter X can be accurately recognized even when the makeup of the daughter X varies greatly from season to season and the facial features change depending on the season.

  Further, auxiliary feature information may be registered for each season. Thereby, even when the characteristics of clothes, accessories, and the like worn by the daughter X vary depending on the season, the daughter X can be accurately recognized. Also, the feature information of the previous season may be deleted each time the season changes. For example, when summer comes, the spring feature information is deleted.

  In the third embodiment described above, the information file in which the image is uploaded to the SNS site is updated even in the imaging device 304 that has not transmitted the information file to the web server 308 at the time of initial registration. May be. For example, it is assumed that the user A transmits the communication address of the digital camera 304b of the user B who is his wife to the web server 308 in addition to the information file of the daughter X and the communication address of the digital camera 304a at the time of initial registration. In this case, the CPU 360 of the web server 308 associates the personal information of the daughter X stored in the personal information database 364 with the information file and the communication addresses of the digital camera 304a and the digital camera 304b. When an image showing the face of the daughter X is uploaded to the SNS site, the CPU 360 transmits the feature information of the face of the daughter X to the communication addresses of both the digital camera 304a and the digital camera 304b. When the digital camera 304a and the digital camera 304b receive the feature information of the daughter X's face, the digital camera 304a updates the information file of the daughter X based on the received feature information.

  In this case, the user A and the user B may directly associate the communication address of the imaging device 304 owned by the user A and the user B with the personal information of the daughter X stored in the personal information database 364 at the SNS site.

  In the third embodiment described above, the information file may be updated without using the web server 308. For example, the imaging device 304 includes a short-range communication unit that performs short-distance wireless communication so that data can be transmitted and received between the imaging devices 304. For example, when the information file of the person Z is updated in one imaging device 304, the one imaging device 304 transmits the updated information file of the person Z to the other imaging device 304 via the short-range communication unit. Send to. When the other imaging device 304 receives the information file of the person Z, it updates the information file of the person Z stored in the information storage unit 346.

  In the third embodiment described above, when the personal authentication is successful at the time of shooting, the exposure control operation (AE) or the focus adjustment operation (AF) may be performed in accordance with the authenticated person. For example, in the case where an image of person E and an image of person F are displayed in the through image, it is assumed that person E is not authenticated and only person F is authenticated. Here, when the shutter button is operated, the CPU 330 of the imaging device 304 performs AE so that proper exposure is obtained at the position of the face of the person F, and the focus of the photographing lens is adjusted to the position of the face of the person. AF is performed to determine the shutter speed and aperture value.

  In the third embodiment described above, the information transmitted together with the information file from the imaging device 304 to the web server 308 at the time of initial registration is not limited to the communication address as long as the information can identify the imaging device 304.

  In the third embodiment, face image data of a person's face may be registered in the information file instead of the face feature information. When an image is uploaded to the SNS site, the CPU 360 of the web server 308 extracts face image data of a region including a person's face from the image data, and transmits the face image data to the imaging device 304. Upon receiving new face image data, the imaging device 304 updates the information file based on the received face image data.

  In the third embodiment described above, the person information added to the feature information by the input of the touch panel 339 may not necessarily be the name and date of birth as long as the information can identify an individual.

(Fourth embodiment)
Hereinafter, an imaging device according to a fourth embodiment will be described with reference to the drawings. 2. Description of the Related Art Conventionally, an image transmission apparatus that transfers an image to a destination terminal associated with an authenticated user after performing user authentication is known (see, for example, Japanese Patent No. 4315023).

  However, in this image transmission device, when the device is left with user authentication or when a password is leaked, an image can be transferred by impersonating the user authenticated by a third party, etc. There was a problem.

  An object of the present invention is to provide an imaging apparatus with high safety that prevents a third party from impersonating a person and transferring an image.

  FIG. 13 is a block diagram illustrating a configuration of a digital camera 408 according to the fourth embodiment. The digital camera 408 includes a CPU 430 that comprehensively controls each unit of the digital camera 408. The CPU 430 includes a power switch (not shown), a shutter button (not shown), an operation unit 432 including a zoom lever (not shown), and a communication unit that communicates with a server (not shown) via a network. 433, an LCD display unit 434 for displaying images and icons, a touch panel 436 for performing an input operation by touching an icon displayed on the LCD display unit 434 with a finger, a fingerprint sensor 438 for recognizing the fingerprint of the user's finger, a subject A camera 440 for photographing the camera, a rear camera 442 for photographing the face of the user provided on the back of the digital camera 2, an image storage unit for storing image data of images photographed by the camera 440 and the rear camera 442. 444, an information storage unit 446 for storing information to be added to the image data, and an individual for storing personal information such as the owner in advance Information storage unit 448, the image processing unit 449 performs the alteration of the image data, a memory card slot 456 for mounting a memory card 454 for storing the microphone 450, and the image data for obtaining the audio is connected.

  Here, the server is a server that provides a predetermined social networking service site (hereinafter referred to as an SNS site).

  The personal information storage unit 448 stores personal information of users who can use the digital camera 408 (for example, the user A1 who is the owner of the digital camera 408 and the user B1 of his wife) in advance. ing. As personal information, user voiceprint information, user fingerprint information, user face feature information, user ID and password at the SNS site, and the like are stored. Note that these pieces of personal information are stored in association with identification information for identifying other users.

  Further, power is supplied to the CPU 430, the microphone 450, the rear camera 442, the fingerprint sensor 438, and the like even when the power is turned off. For this reason, the CPU 430 can acquire sound through the microphone 450, photograph a person with the rear camera 442, and acquire a fingerprint with the fingerprint sensor 438 even when the power is turned off. Based on the acquired information User authentication.

  Next, processing of the digital camera 408 according to the fourth embodiment will be described with reference to a flowchart shown in FIG. First, when the user gives an instruction to activate the digital camera 408 by voice while the power is turned off, a voice command is input via the microphone 450 (step S401).

  Next, the CPU 430 detects the user's voiceprint from the voice command, and performs user authentication based on the detected voiceprint (step S402). For example, the CPU 430 searches the personal information storage unit 448 for voiceprint information that matches the detected voiceprint, and authenticates the user who activated the digital camera 408 based on the identification information associated with the searched voiceprint information.

  Here, when the identification information associated with the searched voiceprint information is, for example, the identification information “A1” assigned to the user A1, the CPU 430 recognizes that the digital camera 408 has been activated by the user A1. The recognized identification information “A1” of the user A1 is temporarily stored in the information storage unit 446 together with the method information “001” indicating that the user authentication is performed by voice.

  Next, the CPU 430 turns on the power of the digital camera 408 according to the voice command input to the microphone 450 (step S403). When the power is turned on, the CPU 430 starts shooting a through image by the shooting camera 440 and displays the shot through image on the LCD display unit 434.

  Here, when the shutter button is operated by the user, the CPU 430 captures an image of the subject with the capturing camera 440 (step S404). Next, the CPU 430 adds the method information and the identification information stored in the information storage unit 446 as tag information to the image data of the photographed image (step S405), and the image data to which the tag information is added is added. It memorize | stores in the memory card 454 (step S406).

  Next, when a voice command for uploading an image captured by the user is input via the microphone 450 (step S407), the CPU 430 detects the user's voiceprint from the voice command, and the user's replay is performed based on the detected voiceprint. Authentication is performed (step S408). Here, the re-authentication is performed by searching the personal information storage unit 448 for voice print information that matches the detected voice print, and referring to the identification information associated with the searched voice print information in the same manner as when the digital camera 408 is activated. By doing so, the user who gives an instruction to upload the image is authenticated.

  Next, based on the re-authentication result, the CPU 430 determines whether or not the user who has instructed to upload an image and the user who has activated the digital camera 408 and photographed are the same person (step S409). For example, it is assumed that identification information “A1” and method information “001” are stored in the information storage unit 446. In this case, the CPU 430 is identification information in which the identification information recognized at the time of re-authentication matches the identification information “A1”, and the command method recognized at the time of re-authentication matches the method based on the method information “001”. It is determined whether or not.

  When the user who has instructed to upload an image and the user who has activated the digital camera 408 and photographed are the same person (step S409: Yes), the CPU 430 executes image upload (step S410). For example, when the upload instruction is given by the user A1, the CPU 430 first reads out the ID and password of the user A1 associated with the identification information “A1” from the personal information storage unit 448, and the user A1 of the SNS site. Log in to the page.

  Next, the CPU 430 adds identification information “A1” that matches the identification information recognized at the time of re-authentication among the image data of the image that has not yet been uploaded to the page of the user A1, and is recognized at the time of re-authentication. The image data to which the method information “001” of the voice command that matches the command method is added is detected from the memory card 454. Then, an image based on the detected image data is uploaded to the user A1 page. Note that information indicating that the upload has already been performed is added to the image data of the uploaded image.

  On the other hand, if the user who instructed the image upload and the user who started the digital camera 408 and photographed are not the same person (step S409: No), the CPU 430 prohibits the image upload and informs the user accordingly. Notification is made (step S411). For example, a message such as “Image cannot be uploaded” is displayed on the LCD display unit 434.

  According to the fourth embodiment, the user is re-authenticated when the image is uploaded, and the re-authenticated user is the same person as the user who was authenticated when the digital camera 408 was activated. In order to confirm, it is possible to prevent a third party from pretending to be the person who started the digital camera 408 and performing the upload. For example, when the user A1 activates the digital camera 408 and is currently using it, the image is prevented from being uploaded by the user B1 who does not use the digital camera 408 or another third party.

  Further, when uploading an image, it is confirmed that the re-authentication of the user is performed by the same method as the authentication at the time of activation, so that the accuracy of person confirmation can be further improved. For example, it is assumed that the user A1 leaves the digital camera 408 activated by a method other than voice. Here, it is assumed that the wife user B1 performs an operation of uploading an image by using the voice command of the user A1 recorded in secret to the user A1. In such a case, it is possible to accurately prevent the user B1 from impersonating the user A1 and uploading an image.

  Also, when an image is taken, identification information and method information of the user authenticated by the user are added to the image data, and only the image taken by the person based on the identification information and method information is uploaded. The image captured by the user A1 is prevented from being uploaded by the user B1 or another third party.

(Fifth embodiment)
Next, an imaging device according to a fifth embodiment will be described. The imaging apparatus according to the fifth embodiment is such that, in the first embodiment, a captured image can be further reproduced. Here, as shown in FIG. 13, a digital camera 508 according to the fifth embodiment has the same configuration as the digital camera 408 according to the first embodiment. Therefore, in the fifth embodiment, portions different from those in the first embodiment will be described in detail, and descriptions of overlapping portions will be omitted as appropriate.

  FIG. 15 is a flowchart showing processing of the digital camera 508 according to the fifth embodiment. First, when the user gives an instruction to activate the digital camera 408 by voice while the power is turned off, a voice command is input via the microphone 450 (step S501).

  Next, the CPU 430 searches the personal information storage unit 448 for voiceprint information that matches the detected voiceprint, and authenticates the user who activated the digital camera 508 based on the identification information associated with the searched voiceprint information ( Step S502).

  Here, when the identification information associated with the searched voiceprint information is, for example, the identification information “A1” assigned to the user A1, the CPU 430 recognizes that the digital camera 408 has been activated by the user A1. The recognized identification information “A1” of the user A1 is temporarily stored in the information storage unit 446 together with the method information “001” indicating that the user authentication is performed by voice.

  If the voice information corresponding to the detected voice print cannot be retrieved from the personal information storage unit 448, the CPU 430 recognizes that the digital camera 508 has been activated by a third party whose personal information is not registered. In this case, the method information and the identification information are not stored in the information storage unit 446.

  Next, the CPU 430 turns on the power of the digital camera 508 in accordance with the voice command input to the microphone 450 (step S503), and starts shooting a through image by the shooting camera 440.

  Here, when the shutter button is operated by the user, the CPU 430 captures an image of the subject with the capturing camera 440 (step S504). Next, the CPU 430 adds the method information and the identification information stored in the information storage unit 446 as tag information to the image data of the photographed image (step S505). Further, the CPU 430 uses the image processing unit 449 to modify the image data into a data format in which the image cannot be browsed (step S506), and the modified image data (hereinafter referred to as modified image data) is stored in the memory card 454. Store (step S507). Here, the modification of the image data is performed using a predetermined method such as compressing the image data or encoding the image data.

  When the method information and the identification information are not stored in the information storage unit 446, that is, when the digital camera 508 is activated and taken by a third party, the CPU 430 does not add tag information. The image data is stored in the memory card 454 as the image data.

  Next, when an audio command for reproducing an image is input by the user via the microphone 450 (step S508), the CPU 430 shifts the mode of the digital camera 508 to a reproduction mode for reproducing an image in accordance with the audio command (step S508). S509).

  When the mode is changed to the reproduction mode, the CPU 430 reproduces the image with reference to the result of user authentication at the time of activation (step S510). Here, as described below, the processing at the time of image reproduction is performed when the digital camera 508 is activated by a user whose personal information is registered and when the digital camera 508 is operated by a third party whose personal information is not registered. It differs from the case where is started.

  FIG. 16 is a flowchart showing an image reproduction process when the digital camera 508 according to the fifth embodiment is activated by the user A1 and the digital camera 508 is activated. When the reproduction mode is entered, first, the CPU 430 searches the memory card 454 for the modified image data to which the identification information “A1” and the method information “001” stored in the information storage unit 446 are added (step S521). Then, the retrieved modified image data is restored to the original image data by the image processing unit 449 (step S522). Further, the image data to which the identification information and the method information are not added is searched from the memory card 454 (that is, image data of an image taken by a third party) (step S523).

  Next, the CPU 430 specifies the restored image data and the image data photographed by a third party as candidate image data of a reproduction candidate image (step S524). Next, the CPU 430 recognizes the candidate image data with the latest shooting date from the identified candidate image data, and displays the candidate image based on the recognized candidate image data on the LCD display unit 434 (step S525).

  Here, when the user A1 performs an operation to display four images on the LCD display unit 434 using the zoom lever, the CPU 430 displays four candidate image data in the order of the latest shooting date / time from among the identified candidate image data. Recognize and display four candidate images on the LCD display unit 434. Further, when the user A1 further performs an operation for displaying nine frames on the LCD display unit 434, the CPU 430 recognizes nine candidate image data in the order of the latest shooting date and time, and displays the nine candidate images on the LCD display unit 434. To display.

  On the other hand, FIG. 17 is a flowchart showing image reproduction processing in the case where the digital camera 508 according to the fifth embodiment is activated by the third party and the digital camera 508 is activated. In this case, when the mode is changed to the reproduction mode, the CPU 430 searches the memory card 454 for image data of an image taken by a third party to which identification information and method information are not added (step S531). Then, the image data with the newest shooting date is recognized from the searched image data, and an image based on the recognized image data is displayed on the LCD display unit 434 (step S532). The processing for displaying a plurality of images is the same as that when the user A1 operates the zoom lever, and thus the description thereof is omitted.

  According to the invention according to the fifth embodiment, when the digital camera 508 is activated, user authentication is performed, and an image is reproduced based on the user authentication result. It is possible to accurately prevent the captured image from being viewed by a third party. For example, an image captured by the user A1 can be prevented from being browsed by the user B1 or other third parties. On the other hand, since anyone can browse images taken by a third party, browsing of images is not restricted more than necessary.

(Sixth embodiment)
Next, an imaging device according to a sixth embodiment will be described. The imaging apparatus according to the sixth embodiment is such that, in the fifth embodiment, the user is re-authenticated during image reproduction. Here, as shown in FIG. 13, a digital camera 608 according to the fifth embodiment has the same configuration as the digital camera 508 according to the second embodiment. Therefore, in the sixth embodiment, parts different from the second embodiment will be described in detail.

  FIG. 18 is a flowchart showing processing of the digital camera 608 according to the sixth embodiment. Since the processing from step S551 to S559 is the same as that of the fifth embodiment, the description thereof is omitted.

  In step S559, when the playback mode is entered, the CPU 430 detects the user's voiceprint from the voice command, and re-authenticates the user based on the detected voiceprint (step S560). Next, based on the re-authentication result, the CPU 430 determines whether or not the user who gives an instruction to shift to the playback mode and the user who starts the shooting with the digital camera 408 are the same person (step). S561).

  When the user who has instructed the transition to the playback mode and the user who has activated the digital camera 408 and photographed are the same person (step S561: Yes), the CPU 430 is authenticated based on the result of re-authentication. The image taken by the person himself and the image taken by the third party are reproduced (step S562). For example, it is assumed that the digital camera 508 is activated by the user A1 and shooting is performed, and the mode is changed to the reproduction mode in accordance with an instruction from the user A1. In this case, the CPU 430 first sends the modified image data to which the identification information “A1” recognized at the time of re-authentication and the method information “001” assigned to the voice command at the time of re-authentication are added from the memory card 454. The image processing unit 449 searches and restores the searched modified image data to the original image data. Further, the image data to which the identification information and the method information are not added is searched from the memory card 454 (that is, image data of an image taken by a third party).

  Next, the CPU 430 specifies the restored image data and the image data taken by a third party as candidate image data of a candidate image for reproduction. Next, CPU 430 recognizes the candidate image data with the latest shooting date from the identified candidate image data, and displays a candidate image based on the recognized candidate image data on LCD display unit 434.

  On the other hand, if the user who has instructed the transition to the playback mode and the user who started the digital camera 408 and photographed are not the same person (step S561: No), the CPU 430 displays only an image captured by a third party. Playback is performed (step S563). That is, the image data to which the identification information and the method information are not added is retrieved from the memory card 454, and an image based on the image data having the latest shooting date is displayed on the LCD display unit 434 from the retrieved image data.

  According to the sixth embodiment, the user is re-authenticated when the image is reproduced, and the re-authenticated user is the same person as the user who was authenticated when the digital camera 408 was activated. Therefore, it is possible to accurately prevent an image taken by the person who has the authority to use the digital camera 508 from being viewed by a third party. For example, it is assumed that the digital camera 408 activated by the user A1 is acquired by a third party, and the third party inputs a voice command for shifting to the playback mode. In this case, the third party cannot view the image taken by the user A1.

  Also, when playing back an image, in order to confirm that the re-authentication of the user was done by the same method as the authentication at the time of start-up, when a third party impersonates the user and plays the image In addition, it is possible to prevent an image taken by the person from being viewed by a third party. For example, it is assumed that the user A1 leaves the digital camera 408 activated by a method other than voice and the user B1 performs an operation of reproducing an image using the voice command of the user A1 recorded in advance. In this case, the user B1 cannot browse the image captured by the user A1.

  In the fifth and sixth embodiments described above, device identification information such as a serial number may be added to image data when an image is taken. At the time of image reproduction, only modified image data to which the same serial number as that of the digital camera being operated is added may be restored to the original image data.

  Thereby, for example, an image captured by the user A1 activating the digital camera 508 with a voice command can be viewed only when the user A1 instructs the digital camera 508 to shift to the playback mode with a voice command. . In this case, even if the user A1 removes the memory card 454 from the digital camera 508 and attaches it to another digital camera, the user A1 cannot view images with the other digital camera.

  In the fourth embodiment described above, the method information and the identification information may be added to the image data of the photographed image as tag information, and then the image data may be modified. In this case, when image upload is executed, the modified image data is restored to the original image data and transmitted to the server.

  Further, in each of the above-described fourth to sixth embodiments, as a method of performing user authentication by means other than voice, a method of performing user authentication based on fingerprints or facial features is conceivable. When performing user authentication with a fingerprint, for example, when the user gives an instruction to activate the digital camera 408 by operating the touch panel 436 in a state where the power is turned off, a command to turn on the power is input. The fingerprint of the user's finger is detected by the fingerprint sensor 438.

  Next, the CPU 430 performs user authentication based on the detected fingerprint. For example, the CPU 430 searches the personal information storage unit 448 for fingerprint information that matches the detected fingerprint, and authenticates the user who activated the digital camera 408 based on the identification information associated with the searched fingerprint information. Next, the CPU 430 stores, in the information storage unit 446, method information “002” indicating that user authentication has been performed using a fingerprint together with the recognized user identification information.

  Further, when performing user authentication based on facial features, for example, when a command to turn on the power by operating the power switch is input in a state where the power is turned off, the CPU 430 causes the rear camera 442 to input the user's face. Shoot.

  Next, the CPU 430 performs user authentication based on the photographed face. For example, the CPU 430 searches the personal information storage unit 448 for facial feature information that matches the captured facial feature, and activates the digital camera 408 based on the identification information associated with the retrieved facial feature information. Authenticate. Next, the CPU 430 stores, in the information storage unit 446, method information “003” indicating that user authentication has been performed by face recognition, together with the recognized user identification information.

  Further, in each of the above-described fourth to sixth embodiments, the case where image data is transferred to an external device is described by taking the case of uploading an image as an example, but the transfer mode to the external device is upload. It is not limited. For example, instead of uploading, image data may be transferred to a printer or personal computer (not shown).

  In each of the above-described fourth to sixth embodiments, a digital camera is described as an example of the imaging device. However, instead of the digital camera, a smartphone, a tablet terminal, a mobile phone, or the like is used as the imaging device. Also good.

DESCRIPTION OF SYMBOLS 2 ... Imaging system 4, 204 ... Management server, 6 ... Network, 8, 208 ... Digital camera 10, 210 ... Smartphone, 20 ... CPU, 22 ... Communication part, 24 ... Registration part, 30 ... CPU, 32 ... Communication , 41 ... imaging device, 42 ... image storage unit, 44 ... information generation unit, 45 ... calculation unit, 46 ... information storage unit, 62 ... communication unit, 68 ... LCD display unit 302 ... imaging system, 304 ... imaging device, 306 ... Network, 308 ... Web server, 330 ... CPU, 332 ... Communication unit, 338 ... LCD display unit, 341 ... Image sensor, 342 ... Image storage unit, 344 ... Feature recognition unit, 346 ... Information storage unit, 360 ... CPU 362: Communication unit, 364 ... Personal information database, 366 ... Image storage unit 408, 508, 608 ... Digital camera, 430 ... CPU, 432 ... Communication Department, 434 ... LCD display unit, 440 ... photographing camera, 442 ... rear camera, 446 ... image storage unit, 448 ... personal information storage unit, 450 ... microphone, 454 ... memory card

Claims (32)

An imaging apparatus having an imaging device for imaging subject light,
A generating unit that generates an identification code based on image data of an image captured by the image sensor;
A transmission unit that transmits the identification code generated by the generation unit to a predetermined server;
A recognition unit that recognizes the identification code that is transferred from the predetermined server to the display device that is registered in association with the imaging device and displayed on the display screen of the display device;
A decoding unit for generating decoded image data obtained by decoding the identification code recognized by the recognition unit;
A collation unit for collating the decoded image data with the image data;
An image pickup apparatus comprising: a determination unit that determines whether to permit output of the image data to an external device based on a collation result by the collation unit.   The imaging apparatus according to claim 1, wherein the determination unit determines whether to upload an image based on the image data with respect to the predetermined server based on a collation result by the collation unit.   The imaging apparatus according to claim 1, wherein the generation unit generates the identification code based on at least one of the image data. A data generation unit that generates reduced image data from the image data;
The imaging device according to claim 1, wherein the generation unit generates the identification code based on the reduced image data.   The imaging apparatus according to claim 1, further comprising a determination unit that determines a file name of the identification code based on a file name of the image data. A positioning unit that measures the current position;
A control unit for adding position information of a current position measured by the positioning unit to the image data together with date / time information of a positioning date;
A classification unit that classifies a plurality of the image data based on at least one of the position information and the date and time information added to the image data, and generates an image data group;
The imaging device according to claim 3, wherein the generation unit generates the identification code based on the image data included in the image data group. An imaging system comprising: an imaging device having an imaging device that images subject light; a display device having a display screen for displaying an identification code; and a management server that registers the imaging device and the display device in association with each other.
The imaging device
A generating unit that generates an identification code based on image data of an image captured by the image sensor;
A transmission unit that transmits the identification code generated by the generation unit to the server;
A recognition unit that recognizes the identification code transferred from the server to the display device and displayed on the display screen of the display device;
A decoding unit for generating decoded image data obtained by decoding the identification code recognized by the recognition unit;
A collation unit for collating the decoded image data with the image data;
A determination unit that determines whether the output of the image data to an external device is permitted or not based on a verification result by the verification unit;
The display device
A receiving unit that receives the identification code transmitted from the imaging device to the management server and transferred from the management server;
A display control unit for displaying the identification code received by the receiving unit on the display screen,
The management server
A registration unit that associates and registers the imaging device and the display device;
An imaging system comprising: a transfer unit that transfers the identification code transmitted from the imaging device to the display device.   The imaging system according to claim 7, wherein the determination unit determines whether to permit uploading of an image based on the image data with respect to the server based on a collation result by the collation unit.   The imaging system according to claim 7 or 8, wherein the generation unit generates the identification code from at least one of the image data. The imaging apparatus includes a data generation unit that generates reduced image data from the image data,
The imaging system according to claim 7, wherein the generation unit generates the identification code from the reduced image data.   The imaging system according to any one of claims 7 to 10, wherein the imaging device includes a determining unit that determines a file name of the identification code based on a file name of the image data. The imaging device
A positioning unit that measures the current position;
A control unit for adding position information of a current position measured by the positioning unit to the image data together with date / time information of a positioning date;
A classification unit that classifies a plurality of the image data based on at least one of the position information and the date and time information added to the image data, and generates an image data group;
The imaging system according to claim 9, wherein the generation unit generates the identification code based on the image data included in the image data group. An information storage unit for storing an information file including characteristic information of a person;
A receiving unit that receives new feature information of the person from a predetermined server;
A file updating unit for updating the information file with the new feature information received by the receiving unit;
An image sensor for imaging the person;
A feature recognition unit for recognizing the characteristics of the person from the image of the person included in image data of an image captured by the image sensor;
A determination unit that determines whether or not the feature information that matches the feature of the person recognized by the feature recognition unit is included in the information file of the person updated by the file update unit;
An imaging apparatus comprising: an authentication unit that performs personal authentication of the person based on a determination result of the determination unit. The information storage unit classifies the feature information for each scene and registers it in the information file,
The update unit overwrites and updates the feature information when the feature information of the same scene as the new feature information is registered in the information file, and updates the feature information of the same scene as the new feature information. 14. The imaging apparatus according to claim 13, wherein when the feature information is not registered in the information file, the new feature information is newly registered in the information file. The information storage unit classifies the feature information according to time and registers it in the information file,
When the feature of the person is extracted from the image data, the determination unit registers the feature information that matches the feature of the person and the time when the feature of the person matches. 15. The image pickup apparatus according to claim 13, wherein it is determined whether or not the feature information thus obtained exists in the information file.   The imaging apparatus according to any one of claims 13 to 15, further comprising a storage control unit that deletes, from the information file, the feature information for which a predetermined time has elapsed since being registered in the information file.   The imaging apparatus according to claim 13, wherein the feature information includes facial feature information.   The imaging apparatus according to claim 17, wherein the feature information further includes at least one of clothing feature information and accessory feature information. An imaging system comprising an imaging device having an imaging element that images subject light, and a server that can communicate with the imaging device,
The server
A personal information storage unit that registers human feature data in association with the address of the imaging device;
An extraction unit for extracting feature information of a person included in image data of an image uploaded to a predetermined site provided by the server;
A transmission unit configured to transmit the feature information of the person to the address of the imaging device when feature data matching the feature information of the person extracted by the extraction unit is registered in the personal information storage unit; With
The imaging device
An information storage unit for storing the person information file in advance;
A receiver that newly receives the feature information of the person from the server;
A file updating unit for updating the information file with the feature information of the person newly received by the receiving unit;
A feature recognition unit for recognizing the characteristics of the person from the image of the person included in the captured image data of the captured image when the person is imaged by the imaging element;
A determination unit that determines whether or not feature information that matches the feature of the person recognized by the feature recognition unit exists in the information file of the person updated by the file update unit;
An imaging system comprising: an authentication unit that performs personal authentication of the person based on a determination result of the determination unit. The imaging device
A file transmission unit that transmits the information file to the server when the information file of the person is first registered in the information storage unit;
The server
An information receiving unit for receiving the information file;
And a specifying unit that specifies an address of the imaging device associated with the feature data of the person from the personal information storage unit using the information file received by the information receiving unit. 19. The imaging system according to 19. An imaging device including an imaging unit for imaging a subject,
A personal information storage unit for storing in advance personal information of the user of the imaging apparatus;
An acquisition unit for acquiring the starter information of the starter who inputs the start command when the start command for starting the imaging apparatus is input;
A personal authentication unit for performing personal authentication of the starter using the personal information stored in the personal information storage unit and the personal information stored in the personal information storage unit acquired by the acquisition unit;
An image storage unit for storing image data of an image taken by the starter;
An instruction acquisition unit that acquires transfer instruction information of a transfer instructioner who has input the transfer command when a transfer command for transferring the image data stored in the image storage unit to an external device is input;
An authentication control unit that re-authenticates the transfer instructor using the transfer instructor information acquired by the instruction acquisition unit and the personal information stored in the personal information storage unit; ,
A determination unit that determines whether the initiator and the transfer instruction person are the same person based on the personal authentication result of the initiator and the re-authentication result of the transfer instruction person;
An image pickup apparatus comprising: a transfer unit configured to transfer the image data to the external device when the determination unit determines that the starter and the transfer instruction person are the same person. The personal information storage unit stores identification information for identifying the user in association with the personal information,
The personal authentication unit performs the personal authentication of the starter by specifying the identification information based on the initiator information and the transfer instruction information, and the re-authentication of the transfer instruction,
The determination unit determines whether the initiator and the transfer instructor are the same person based on the identification information specified at the time of the personal authentication and the identification information specified at the time of the re-authentication. The imaging apparatus according to claim 21, wherein: A method recognizing unit for recognizing the method by which the activator information is acquired by the acquiring unit and the method by which the transfer instructor information is acquired by the instruction acquiring unit;
The determination unit determines whether the starter and the transfer instructor are the same person according to whether the method from which the starter information is acquired matches the method from which the transfer instructor information is acquired. 23. The imaging apparatus according to claim 22, wherein the determination is made. An addition control unit that adds, to the image data of the image captured by the imaging unit, the identification information specified based on the initiator information and method information relating to a method by which the initiator information is acquired;
The transfer unit adds the identification information that matches the identification information specified based on the transfer instruction information, and adds the method information of the method that matches the method from which the transfer instruction information is acquired. 24. The imaging apparatus according to claim 23, wherein the processed image data is transferred to the external apparatus. An image processing unit for modifying the image data into a data format in which the image cannot be reproduced;
A storage control unit for storing the modified image data in the image storage unit;
25. A process control unit that causes the image processing unit to restore the modified image data when the image data is transferred to the external device. Imaging device. An information acquisition unit for acquiring reproduction instruction information of a reproduction instruction person who has input the reproduction command when a reproduction command for reproducing the image data stored in the image storage unit is input;
A specifying unit that specifies the identification information stored in the personal information storage unit in association with the personal information based on the reproduction instructor information;
A method based on the method information added to the image data in which the identification information added to the image data matches the identification information specified based on the reproduction instruction information, and The imaging apparatus according to any one of claims 21 to 25, further comprising: a reproduction unit that reproduces an image based on the image data when the information matches the acquired method. The processing control unit restores the image data modified when the reproduction unit reproduces the image,
27. The imaging apparatus according to claim 26, wherein the reproduction unit reproduces an image based on the image data restored by the image processing unit. The authentication control unit re-authenticates the reproduction instructor when the reproduction unit reproduces an image based on the image data,
The determination unit determines whether the reproduction instruction person re-authenticated by the authentication control unit is the same person as the starter,
28. The imaging apparatus according to claim 27, wherein the reproduction unit reproduces an image based on the image data when the reproduction instruction person is the same person as the starter. The addition control unit adds device identification information of the device to the image data,
30. The imaging apparatus according to claim 28, wherein the reproduction unit reproduces the image when the apparatus identification information added to the image data matches an identification code of the imaging apparatus.   The acquisition unit, the instruction acquisition unit, and the information acquisition unit acquire information related to a voice feature of a user who has input the command, a function of acquiring information related to the fingerprint of the user, and facial feature information of the user. The imaging apparatus according to any one of claims 21 to 29, comprising at least one of the functions.   The personal information storage unit stores at least one of feature information of the user's voice, fingerprint information of the user, and feature information of the user's face as the personal information. The imaging device according to any one of claims 21 to 30.   The imaging device according to any one of claims 21 to 31, wherein the imaging device is any one of a digital camera, a smartphone, a tablet terminal, and a mobile phone.