US12500773B2 - Imaging apparatus, information processing apparatus, information processing method, and program - Google Patents

Imaging apparatus, information processing apparatus, information processing method, and program

Info

Publication number
US12500773B2
US12500773B2 US17/914,103 US202117914103A US12500773B2 US 12500773 B2 US12500773 B2 US 12500773B2 US 202117914103 A US202117914103 A US 202117914103A US 12500773 B2 US12500773 B2 US 12500773B2
Authority
US
United States
Prior art keywords
captured image
hash value
image
imaging apparatus
section
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US17/914,103
Other versions
US20240214209A1 (en
Inventor
Masayuki Imanishi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Publication of US20240214209A1 publication Critical patent/US20240214209A1/en
Application granted granted Critical
Publication of US12500773B2 publication Critical patent/US12500773B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60—Protecting data
    • G06F21/64—Protecting data integrity, e.g. using checksums, certificates or signatures
    • G06F21/645—Protecting data integrity, e.g. using checksums, certificates or signatures using a third party
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N5/9201—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
    • H04L9/3236—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using cryptographic hash functions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4023—Scaling of whole images or parts thereof, e.g. expanding or contracting based on decimating pixels or lines of pixels; based on inserting pixels or lines of pixels
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/06—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols the encryption apparatus using shift registers or memories for block-wise or stream coding, e.g. DES systems or RC4; Hash functions; Pseudorandom sequence generators
    • H04L9/0643—Hash functions, e.g. MD5, SHA, HMAC or f9 MAC
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/08—Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
    • H04L9/0816—Key establishment, i.e. cryptographic processes or cryptographic protocols whereby a shared secret becomes available to two or more parties, for subsequent use
    • H04L9/0819—Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s)
    • H04L9/0825—Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s) using asymmetric-key encryption or public key infrastructure [PKI], e.g. key signature or public key certificates
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
    • H04L9/3236—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using cryptographic hash functions
    • H04L9/3239—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using cryptographic hash functions involving non-keyed hash functions, e.g. modification detection codes [MDCs], MD5, SHA or RIPEMD
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
    • H04L9/3247—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials involving digital signatures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
    • H04L9/3263—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials involving certificates, e.g. public key certificate [PKC] or attribute certificate [AC]; Public key infrastructure [PKI] arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera

Definitions

  • the present disclosure relates to an imaging apparatus, an information processing apparatus, an information processing method, and a program, and in particular, to an imaging apparatus, an information processing apparatus, an information processing method, and a program that are intended to suppress an increase in a load.
  • the present disclosure is intended to suppress such an increase in a load caused by linking of electronic signature.
  • An imaging apparatus is an imaging apparatus including a linking section that links a captured image with a hash value for a part of the captured image and part identification information for identifying the part.
  • An information processing method is an information processing method including linking a captured image with a hash value for a part of the captured image and part identification information for identifying the part.
  • a program according to an aspect of the present technology is a program causing functioning as a linking section that links a captured image with a hash value for a part of the captured image and part identification information for identifying the part.
  • An information processing apparatus is an imaging apparatus including an extraction section that extracts a part of a captured image from the captured image in reference to part identification information for identifying the part, the part identification information being linked with the captured image along with a hash value for the part and the part identification information, a hash value generation section that generates a hash value for the part extracted by the extraction section and the part identification information, and a comparison section that compares the hash value generated by the hash value generation section with the hash value linked with the captured image.
  • the captured image is linked with the hash value for a part of the captured image and part identification information for identifying the part.
  • FIG. 1 is a diagram depicting a main configuration example of a falsification detection system.
  • FIG. 4 is a functional block diagram depicting functions implemented in the imaging apparatus.
  • FIG. 5 is a flowchart illustrating an example of a flow of imaging processing.
  • FIG. 6 is a block diagram depicting a main configuration example of a verification apparatus and the like.
  • FIG. 7 is a functional block diagram depicting functions implemented in the verification apparatus.
  • FIG. 8 is a flowchart illustrating an example of a flow of processing related to verification.
  • FIG. 9 is a functional block diagram depicting functions implemented in the imaging apparatus.
  • FIG. 10 is a flowchart illustrating an example of flow of imaging processing.
  • FIG. 12 is a flowchart illustrating an example of a flow of the imaging processing.
  • FIG. 13 is a functional block diagram depicting functions implemented in the verification apparatus.
  • FIG. 14 is a flowchart illustrating an example of a flow of processing related to verification.
  • FIG. 15 is a functional block diagram depicting functions implemented in the imaging apparatus.
  • FIG. 16 is a flowchart illustrating an example of a flow of the imaging processing.
  • PTL 1 describes a method in which a digital camera or the like generates a hash for the entire captured image and uses the hash to associate an electronic signature with the captured image, thereby using the electronic signature for detection of falsification.
  • information regarding the imaging apparatus can also be included in the electronic signature.
  • a hash value for a part of the captured image and part identification information for identifying the part is linked with the captured image. This allows suppression of an increase in the load related to generation of the electronic signature to suppress an increase in processing time for the electronic signature.
  • the part for which the hash is generated may be any part of the captured image.
  • the part may be a more important part of the captured image.
  • the important part of the captured image is identified, the identified part is extracted from the captured image, a hash is generated for the extracted image, and the hash is used for generation of an electronic signature. This allows authenticity of the important part of the captured image to be ensured, while an increase in the load is suppressed.
  • the important part may be a part of the captured image focused on a subject (also referred to as a focused part).
  • focus information for example, depth data including a depth map, distance measurement information, and the like
  • a hash may be generated. This allows the authenticity of the focused part of the captured image to be ensured, while an increase in the load is suppressed.
  • the important part may be a partial region of a predetermined position in the captured image.
  • the important part may be a partial region at a position where an important subject is likely to be present.
  • the important part may be a partial region near the center of the captured image.
  • the important part may be a partial region close to any of four corners of the captured image.
  • the important part may be a partial region randomly selected from multiple partial regions at different positions such as regions near the center and the four corners of the captured image. This allows the authenticity of the partial region at the predetermined position in the captured image to be ensured, while an increase in the load is suppressed.
  • the important part may be a part of the captured image resulting from decimation of some pixels from the captured image.
  • the important part may be an image obtained by decimating any pixels from the captured image at a predetermined rate.
  • the important part may be an image resulting from decimation of pixels from the captured image with a 4K resolution into an HD resolution.
  • the important part may be an image resulting from decimation of any pixel columns (or pixel rows) from the captured image at a predetermined rate. This allows authenticity to be ensured for a range substantially similar to the entire captured image while an increase in the load is suppressed.
  • image analysis may be performed on the captured image to identify the important part.
  • image analysis may be performed on the captured image to identify a part of the captured image in which an important subject is present, the identified part may be extracted as an important part, and a hash may be generated for the important part.
  • image analysis may be performed to identify a subject (person), and a region of the captured image in which the person is present may be designated as an important part.
  • the subject to be detected is optional and is not limited to a person.
  • the subject to be detected may be a face of the person or a site other than the face.
  • the subject to be detected may be an animal or a plant.
  • the subject to be detected may be inorganic matter such as a building. This allows ensuring of authenticity of a part of the captured image in which the important subject appears, while suppressing an increase in the load.
  • the captured image may be associated with the hash value for a part of the captured image and the part identification information for identifying the part. This allows the authenticity of the important part to be ensured for I frames having larger amount of data, while an increase in the load is suppressed.
  • the captured image may be associated with the hash value for a part of the captured image and the part identification information for identifying the part. This allows, for more important frames with intense movement, the authenticity of the important part to be ensured, while an increase in the load is suppressed.
  • the captured image may be associated with the hash value for a part of the captured image and the part identification information for identifying the part, and in a case where the imaging mode is not the continuous shooting mode, the captured image may be associated with the hash value for the entire captured image. This allows an increase in processing time to be suppressed for the continuous shooting mode, which has a short processing time.
  • the hash value may be generated using a part of the captured image and the part identification information for identifying the part. Moreover, the hash value generated may be linked with the captured image. Further, an electronic signature including the hash value may be generated, and the electronic signature generated may be linked with the captured image.
  • the part identification information for identifying the part may be used to update metadata for the captured image, and the updated metadata may be linked with the captured image. Further, the captured image may be associated with a public key used to generate the electronic signature and a certificate for the public key.
  • a part of the captured image may be extracted from the captured image in reference to the part identification information for identifying the part, the part identification information being linked with the captured image along with the hash value for the part and the part identification information, the hash value for the part extracted and the part identification information may be generated, and the hash value generated may be compared with the hash value linked with the captured image. This allows suppression of an increase in the load related to verification of the electronic signature generated using the hash for the part of the captured image.
  • FIG. 1 is a diagram depicting a main configuration example of a falsification detection system corresponding to an embodiment of an information processing system to which the present technology is applied.
  • a falsification detection system 100 depicted in FIG. 1 is a system that detects falsification of a captured image or the like.
  • the falsification detection system 100 includes, for example, an imaging apparatus 101 , a verification apparatus 102 , and a certification authority 103 .
  • FIG. 1 depicts one imaging apparatus 101 , one verification apparatus 102 , and one certification authority 103 but the numbers of imaging apparatuses 101 , the verification apparatuses 102 , and certification authorities 103 , constituting the falsification detection system 100 , are each optional.
  • the imaging apparatus 101 , the verification apparatus 102 , and the certification authority 103 may be provided in plural number.
  • the imaging apparatus 101 , the verification apparatus 102 , and the certification authority 103 are connected to one another in a manner allowing communication therebetween, for example, via a network not illustrated.
  • the imaging apparatus 101 executes processing related to imaging of a subject (generation of a captured image), generation of a hash for the captured image, generation of a signature to be associated with the captured image, and the like.
  • the imaging apparatus 101 applies for issuance of a certificate with the certification authority 103 , causes the certification authority 103 to issue the certificate, and acquires the certificate.
  • the imaging apparatus 101 can transmit the captured image (photograph), metadata of the captured image, and the like to the verification apparatus 102 .
  • the verification apparatus 102 executes processing related to detection of falsification of the captured image generated in the imaging apparatus 101 .
  • the verification apparatus 102 may acquire a captured image (photograph) and metadata of the captured image fed from the imaging apparatus 101 . Further, the verification apparatus 102 can verify the electronic signature.
  • the certification authority 103 can issue a certificate for the captured image. Moreover, the certification authority 103 can distribute, to the verification apparatus 102 , a certificate from the certification authority and a certificate expire list. In reference to the certificate from the certification authority and the certificate expire list, the verification apparatus 102 can verify the certificate used by the imaging apparatus 101 .
  • the “linking” of pieces of data herein refers to “associating” of pieces of data with each other.
  • the term “associating” as used herein means that when one of the pieces of data is processed, the other piece of data may be used (may be linked with the one of the pieces of data). In other words, pieces of data associated with each other may be compiled into one piece of data or may be used as separate pieces of data.
  • multiple pieces of information associated with one another may be transmitted on different transmission paths. Further, for example, multiple pieces information associated with one another may be recorded in different recording media (or different recording areas in the same recording medium).
  • the “associating” may be intended for a part of the data rather than the entire data. For example, an image and information corresponding to the image may be associated with each other in any units such as multiple frames, one frame, or a portion within a frame.
  • FIG. 2 is a diagram depicting an example of data fed from the imaging apparatus 101 to the verification apparatus 102 .
  • a captured image 111 is associated with such information as metadata 112 , an electronic signature 113 , and a certificate/public key 114 .
  • the metadata 112 includes the serial number of a camera, a photographer, a photographing time, a focal length, an aperture value, a shutter speed, a photographing location, and the like. Furthermore, the metadata 112 also includes extracted region information.
  • FIG. 3 is a diagram depicting a main configuration example of the imaging apparatus 101 corresponding to an embodiment of the information processing apparatus to which the present technology is applied.
  • the imaging apparatus 101 depicted in FIG. 3 is a computer in which an application program (software) for performing processing related to imaging (generation of a captured image), generation of an electronic signature, and the like is installed and executed.
  • examples of the computer include a computer integrated into dedicated hardware, for example, a general-purpose personal computer in which various programs are installed and which can execute various functions, and the like.
  • the imaging apparatus 101 executes the application programs to perform processing related to imaging (generation of a captured image), generation of an electronic signature, and the like.
  • a CPU Central Processing Unit
  • ROM Read Only Memory
  • RAM Random Access Memory
  • An input/output interface 210 is also connected to the bus 204 .
  • the input/output interface 210 connects to an input section 211 , an output section 212 , a storage section 213 , a communication section 214 , and a drive 215 .
  • the input section 211 includes, for example, a keyboard, a mouse, a microphone, a touch panel, an input terminal, and the like.
  • the output section 212 includes, for example, a display, a speaker, an output terminal, and the like.
  • the storage section 213 includes, for example, a hard disk, a RAM disk, a nonvolatile memory, and the like.
  • the communication section 214 includes, for example, a network interface.
  • the drive 215 drives a removable recording medium 221 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
  • an imaging section 231 and a sensor 232 are connected to the input/output interface 210 .
  • the imaging section 231 includes, for example, an optical system, such as a lens and a diaphragm, and an image sensor, and images a subject to generate a captured image. Note that the imaging section 231 may further include components other than those described above, such as an image processing section that executes image processing on the captured image generated and a memory that stores the data regarding the captured image.
  • the sensor 232 includes, for example, a distance measurement sensor or the like to measure the distance to the subject. Note that the sensor 232 may generate a depth map and the like.
  • the CPU 201 loads into the RAM 203 and executes, for example, an application program stored in the storage section 213 , via the input/output interface 210 and the bus 204 , thus performing a series of processing operations described above.
  • the RAM 203 also appropriately stores data required for the CPU 201 to execute various processing operations, for example.
  • the application program executed by the imaging apparatus 101 can be recorded in the removable recording medium 221 , used as a package medium or the like, for example, for application.
  • the application program can be installed in the storage section 213 via the input/output interface 210 by mounting the removable recording medium 221 in the drive 215 .
  • the application program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting.
  • the application program can be received by the communication section 214 and installed in the storage section 213 .
  • the application program can be installed in the ROM 202 or the storage section 213 in advance.
  • FIG. 4 depicts, as functional blocks, functions implemented by execution of application programs in the imaging apparatus 101 .
  • the imaging apparatus 101 can be provided with an imaging control section 251 , a partial data extraction section 252 , a metadata update section 253 , a hash generation section 254 , an electronic signature generation section 255 , a linking section 256 , and an output control section 257 .
  • the imaging control section 251 controls and causes the imaging section 231 to execute processing related to imaging.
  • the partial data extraction section 252 executes processing related to extraction of partial data of the captured image (data of a partial image of the captured image).
  • the metadata update section 253 executes processing related to information update of metadata associated with the captured image.
  • the hash generation section 254 executes processing related to generation of a hash.
  • the electronic signature generation section 255 executes processing related to generation of an electronic signature.
  • the linking section 256 executes processing related to linking of the captured image with other data.
  • the output control section 257 executes processing related to control of data output.
  • the imaging control section 251 controls and causes, in step S 101 , the imaging section 231 to image the subject and generate a captured image. Further, the imaging control section 251 controls and causes the sensor 232 to measure the distance to the subject and generate focus information (depth data). Then, the imaging control section 251 acquires the captured image and focus information generated.
  • step S 102 in reference to the focus information acquired in step S 101 , the partial data extraction section 252 extracts a focused part of the captured image also acquired.
  • the metadata update section 253 includes, in the metadata, extracted region information indicating the region extracted in step 102 (that is, partial identification for identifying a part of the captured image).
  • the “extracted region information” is applied to the metadata 112 .
  • the metadata thus updated is applied to the partial image (focused part) of the captured image.
  • the metadata is linked (associated) with the partial image.
  • step S 104 the hash generation section 254 generates a hash for data of a combination of the partial image extracted in step S 102 and the metadata updated in step S 103 .
  • a hash for the partial image and the metadata linked with each other is generated.
  • step S 105 the electronic signature generation section 255 uses a private key to encrypt the hash generated in step S 104 (hash for the partial image and the metadata linked with each other), to generate an electronic signature.
  • step S 106 the linking section 256 links (associates), with one another, the captured image acquired in step S 101 , the metadata updated in step S 103 , the electronic signature and certificate generated in step S 105 , and the public key corresponding to the private key used in step S 105 .
  • step S 107 the output control section 257 outputs the captured image, the metadata, the electronic signature, the certificate, and the public key linked (associated) with one another by the processing in step S 106 .
  • the imaging processing ends.
  • the imaging processing executed as described above allows the electronic signature to be generated with use of a part of the captured image.
  • the captured image can be linked with the hash value for a part of the captured image and the part identification information for identifying the part. Consequently, an increase in the load can be suppressed.
  • a part of the captured image is identified in reference to the focus information, and the hash for the part is generated.
  • the method for identifying the part is optional, and is not limited to the example of the focus information.
  • a partial image at a predetermined position in the captured image may be the “part” described above.
  • an image obtained by decimation of some pixels from the captured image may be the “part” described above.
  • FIG. 6 is a diagram depicting a main configuration example of the verification apparatus 102 corresponding to an embodiment of the information processing apparatus to which the present technology is applied.
  • the verification apparatus depicted in FIG. 6 is a computer in which an application program (software) for executing processing related to verification of the electronic signature is installed and executed.
  • examples of the computer include a computer integrated into dedicated hardware, for example, a general-purpose personal computer in which various programs are installed and which can execute various functions, and the like.
  • the verification apparatus 102 executes the application programs to perform processing related to verification of the electronic signature.
  • a CPU 301 In the verification apparatus 102 depicted in FIG. 6 , a CPU 301 , a ROM 302 , and a RAM 203 are connected to one another via a bus 304 .
  • An input/output interface 310 is also connected to the bus 304 .
  • the input/output interface 310 connects to an input section 311 , an output section 312 , a storage section 313 , a communication section 314 , and a drive 315 .
  • the input section 311 includes, for example, a keyboard, a mouse, a microphone, a touch panel, an input terminal, and the like.
  • the output section 312 includes, for example, a display, a speaker, an output terminal, and the like.
  • the storage section 313 includes, for example, a hard disk, a RAM disk, a nonvolatile memory, and the like.
  • the communication section 314 includes, for example, a network interface.
  • the drive 315 drives a removable recording medium 321 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
  • the CPU 301 loads into the RAM 303 and executes, for example, an application program stored in the storage section 313 , via the input/output interface 310 and the bus 304 , thus performing a series of processing operations described above.
  • the RAM 303 also appropriately stores data required for the CPU 301 to execute various processing operations, and the like.
  • the application program executed by the verification apparatus 102 can be recorded in the removable recording medium 321 , used as a package medium or the like, for example, for application.
  • the application program can be installed in the storage section 313 via the input/output interface 310 by mounting the removable recording medium 321 in the drive 315 .
  • the application program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting.
  • the application program can be received by the communication section 314 and installed in the storage section 313 .
  • the application program can be installed in the ROM 302 or the storage section 313 in advance.
  • the certification authority 103 is configured similarly to the verification apparatus 102 depicted in FIG. 3 .
  • the block diagram depicted in FIG. 3 may also be used for description of the certification authority 103 .
  • FIG. 7 depicts, as functional blocks, functions implemented by execution of application programs in the verification apparatus 102 .
  • the verification apparatus 102 can be provided with an acquisition control section 351 , a certificate verification section 352 , an electronic signature decoding section 353 , a partial data extraction section 354 , a hash generation section 355 , a comparison section 356 , and an output control section 357 .
  • the acquisition control section 351 executes processing related to acquisition of data such as the captured image and the electronic signature by, for example, control of the communication section 314 and the like.
  • the certificate verification section 352 executes processing related to verification of the certificate.
  • the electronic signature decoding section 353 executes processing related to decoding of the electronic signature.
  • the partial data extraction section 354 executes processing related to extraction of partial data.
  • the hash generation section 355 executes processing related to generation of a hash.
  • the comparison section 356 executes processing related to comparison of the electronic signature.
  • the output control section 357 executes processing related to data output.
  • step S 201 by control of the communication section 314 and the like, the acquisition control section 351 of the verification apparatus 102 acquires the captured image, the metadata, the electronic signature, the certificate, and the public key fed from the imaging apparatus 101 and linked with one another.
  • the electronic signature generated using a part of the captured image (the electronic signature including a hash value for a part (partial image) of the captured image corresponding to the extracted region information of the metadata and the part identification information for identifying the partial image (that is, the metadata)) is acquired.
  • step S 202 the certificate verification section 352 requests a certificate expire list from the certification authority 103 via the communication section 314 .
  • step S 221 the certification authority 103 receives the request from the verification apparatus 102 . Then, in response to the request, the certification authority 103 feeds the certificate expire list to the verification apparatus 102 .
  • step S 203 the acquisition control section 351 of the verification apparatus 102 acquires the certificate expire list via the communication section 314 .
  • step S 204 the certificate verification section 352 uses the certificate expire list acquired in step S 203 , to check the validity of the certificate.
  • step S 205 the electronic signature decoding section 353 uses the public key to decode the electronic signature acquired in step S 201 .
  • a hash value for the partial image of the captured image corresponding to the extracted region information of the metadata and the metadata (part identification information) is obtained.
  • step S 206 the partial data extraction section 354 extracts the partial image from the captured image in reference to the extracted region information of the metadata.
  • step S 207 the hash generation section 355 generates a hash for the partial image extracted and the metadata.
  • step S 208 the comparison section 356 compares the hash obtained by the processing in step S 205 with the hash generated by the processing in step S 207 , and according to a comparison result, determines whether or not falsification has been performed.
  • step S 209 the output control section 357 outputs a verification result obtained in step S 208 .
  • the verification processing ends.
  • the verification processing executed as described above allows the verification apparatus 102 to perform verification of the electronic signature using the hash for the partial image of the captured image. Consequently, an increase in the load can be suppressed.
  • image analysis may be performed on the captured image and that, according to a result of the analysis, the “part” of the captured image for which a hash is to be generated may be identified.
  • the region of a person (or a face) in the captured image may be identified, the region may be designated as the “part” described above, and a hash may be generated for the region.
  • FIG. 9 depicts, as functional blocks, functions implemented by execution of the application programs in the imaging apparatus 101 in the above-described case.
  • the imaging apparatus 101 includes an image analysis section 401 in addition to the functional blocks in the case of FIG. 4 .
  • the image analysis section 401 executes processing related to image analysis for the captured image and the like.
  • the imaging control section 251 controls and causes, in step S 301 , the imaging section 231 to image the subject and generate a captured image of the subject. Further, the imaging control section 251 controls and causes the sensor 232 to measure the distance to the subject and generate focus information (depth data). Then, the imaging control section 251 acquires the captured image and focus information generated.
  • step S 302 the image analysis section 401 performs image analysis on the captured image to identify a region with a person (person region).
  • step S 303 the partial data extraction section 252 extracts the identified person region of the captured image.
  • Processing operations in steps S 304 to S 308 are executed in a manner similar to that of the processing operations in steps S 103 to S 107 in FIG. 5 .
  • the imaging processing executed as described above allows the imaging apparatus 101 to generate an electronic signature with use of a part of the captured image corresponding to an image analysis result.
  • a hash for a more important part of the captured image can be generated and associated with the captured image. Consequently, an increase in the load can be suppressed.
  • image analysis is used to identify a person region.
  • any region other than a person region may be identified by image analysis.
  • verification processing in this case is similar to the verification processing in the case of the first embodiment, and the description of the verification processing is thus omitted.
  • the captured image with which the electronic signature is to be associated may be a moving image.
  • the hash for the partial image may be linked with the captured image as described above.
  • the hash for the partial image may be linked with the captured image.
  • FIG. 11 depicts, as an example of functional blocks, functions implemented by execution of the application programs in the imaging apparatus 101 in the above-described case.
  • the imaging apparatus 101 includes a sort buffer 411 and a coding section 412 in addition to the functional blocks in the case of FIG. 4 .
  • the sort buffer 411 holds multiple frames of a moving image to be coded and changes the order of arrangement of the frames from a reproduction order to a decoding order.
  • the coding section 412 executes processing related to coding of the captured image (moving image) with use of, for example, a coding scheme for two-dimensional moving images such as AVC (Advanced Video Coding) or HEVC (High Efficiency Video Coding).
  • AVC Advanced Video Coding
  • HEVC High Efficiency Video Coding
  • the imaging control section 251 controls and causes, in step S 341 , the imaging section 231 to image the subject and generate a captured image of the subject. Further, the imaging control section 251 controls and causes the sensor 232 to measure the distance to the subject and generate focus information (depth data). Then, the imaging control section 251 acquires the captured image and focus information generated.
  • step S 342 the sort buffer 411 holds multiple frame images and changes the order of arrangement of the frames from the reproduction order to the coding order.
  • step S 343 the partial data extraction section 252 determines whether or not the frame to be processed is an I frame. In a case where the partial data extraction section 252 determines that the frame to be processed is an I frame, the processing proceeds to step S 344 .
  • steps S 344 to S 347 are performed in a manner similar to that of the processing operations in steps S 102 to S 105 .
  • the coding section 412 codes the captured image to be processed, to generate coded data.
  • step S 349 the linking section 256 links, with one another, the coded data of the captured image, the metadata, the electronic signature, the certificate, and the public key.
  • step S 350 the output control section 257 outputs the data.
  • step S 3350 When the processing in step 3350 ends, the processing proceeds to step S 353 .
  • step S 343 in a case where the partial data extraction section 252 determines that the frame to be processed is not an I frame, the processing proceeds to step S 351 .
  • step S 351 the coding section 412 codes the captured image to generate coded data.
  • step S 352 the output control section 257 outputs the coded data.
  • the processing in step S 352 ends, the processing proceeds to step S 353 .
  • step S 353 the imaging control section 251 determines whether or not all the frames have been processed. In a case where the imaging control section 251 determines that there is a frame yet to be processed, the processing returns to step S 341 , and the subsequent processing is executed. Alternatively, in a case where the imaging control section 251 determines in step S 353 that all the frames have been processed, the imaging processing ends.
  • the imaging processing executed as described above allows a hash for a part of the captured image to be generated only for I frames of the moving image and used for generation of an electronic signature. Consequently, an increase in the load can be suppressed.
  • FIG. 13 depicts, as an example of functional blocks, functions implemented by execution of the application programs in the verification apparatus 102 in the above-described case.
  • the verification apparatus 102 includes a decoding section 421 in addition to the functional blocks in the case of FIG. 7 .
  • the decoding section 421 executes processing related to decoding of coded data of the moving image.
  • the sort buffer 411 holds multiple frames of the moving image to be coded and changes the order of arrangement of the frames from the reproduction order to the decoding order.
  • the coding section 412 executes processing related to coding of the captured image (moving image) with use of, for example, a coding scheme for two-dimensional moving images such as AVC (Advanced Video Coding) or HEVC (High Efficiency Video Coding).
  • AVC Advanced Video Coding
  • HEVC High Efficiency Video Coding
  • step S 371 by control of the communication section 314 and the like, the acquisition control section 351 of the verification apparatus 102 acquires the coded data and the metadata of the captured image and the electronic signature, the certificate, and the public key for the captured image that are linked with one another.
  • step S 372 the decoding section 421 decodes the coded data to generate a frame image.
  • step S 373 the decoding section 421 determines where or not the frame to be processed is an I frame. In a case where the frame to be processed is determined to be an I frame, the processing proceeds to step S 374 .
  • Processing operations in steps S 374 to S 381 are executed in a manner similar to that of the processing operations in steps S 202 to S 209 in FIG. 8 . Further, processing operations in steps S 391 and S 392 are executed by the certification authority 103 in a manner similar to that of the processing operations in steps S 221 and S 222 in FIG. 8 .
  • step S 381 ends, the processing proceeds to step S 382 .
  • step S 373 in a case where the frame to be processed is determined not to be an I frame, the processing proceeds to step S 382 .
  • step S 382 the output control section 357 determines whether or not all the frames have been processed. In a case where the output control section 357 determines that there is a frame yet to be processed, the processing returns to step S 371 to repeat the subsequent processing. Alternatively, in step S 382 , in a case where the output control section 357 determines that all the frames have been processed, the verification processing ends.
  • the verification processing executed as described above allows the verification apparatus 102 to perform the verification of the electronic signature using the hash for the partial image of the captured image only for the I frames of the moving image. Consequently, an increase in the load can be suppressed.
  • the method of generating an electronic signature may be controlled according to the imaging mode. For example, in an imaging mode in which a moving image is captured or in an imaging mode for what is generally called continuous shooting, the electronic signature is generated using the hash for the partial image as described above. In an ordinary still image imaging mode, the electronic signature may be generated using the hash for the entire captured image.
  • FIG. 15 depicts, as an example of functional blocks, functions implemented by execution of the application programs in the imaging apparatus 101 in the above-described case.
  • the imaging apparatus 101 includes an imaging mode control section 431 in addition to the functional blocks in the case of FIG. 11 .
  • the imaging mode control section 431 performs control related to generation of an electronic signature according to the imaging mode.
  • the imaging mode control section 431 sets the imaging mode in step S 401 .
  • the imaging mode control section 431 determines whether or not the imaging mode is a moving image imaging mode in which a moving image is captured. In a case where the imaging mode is determined to be the moving image imaging mode, the processing proceeds to step S 403 .
  • step S 403 the imaging apparatus 101 performs the imaging processing in the moving image imaging mode.
  • the imaging apparatus 101 executes imaging processing similar to that described with reference to the flowchart in FIG. 12 .
  • the processing in step S 403 ends, the imaging processing ends.
  • step S 402 in a case where the imaging mode is determined not to be the moving image imaging mode, the processing proceeds to step S 404 .
  • the imaging mode control section 431 determines whether or not the imaging mode is a continuous shooting imaging mode in which a captured image of a still image is captured multiple times during a short period of time (what is generally called continuous shooting is performed). In a case where the imaging mode is determined to be the continuous shooting imaging mode, the processing proceeds to step S 405 .
  • step S 405 the imaging apparatus 101 executes the imaging processing in the continuous shooting imaging mode.
  • the imaging apparatus 101 executes imaging processing similar to that described with reference to the flowchart in FIG. 5 or FIG. 10 , and generates an electronic signature with use of the hash of the partial image.
  • the imaging processing ends, the imaging processing ends
  • step S 404 in a case where the imaging mode is determined not to be the continuous shooting imaging mode, the processing proceeds to step S 406 .
  • an electronic signature is generated with use of the hash for the entire captured image.
  • step S 406 the imaging control section 251 controls and causes the imaging section 231 to image the subject and generate a captured image of the subject. Then, the imaging control section 251 acquires the captured image generated.
  • step S 407 the hash generation section 254 generates a hash for the entire captured image.
  • step S 408 the electronic signature generation section 255 uses the private key to encrypt the hash generated in step S 407 and generates an electronic signature.
  • step S 409 the linking section 256 links, with one another, the captured image acquired, the electronic signature generated in step S 408 , the certificate, and the public key.
  • step S 410 the output control section 257 outputs the captured image, the electronic signature, the certificate, and the public key that have been associated with one another by the processing in step S 409 .
  • the processing in step S 410 ends, the imaging processing ends.
  • the imaging processing executed as described above allows the appropriate imaging processing to be executed according to the imaging mode. Consequently, an increase in the load can be suppressed more appropriately.
  • the series of processing operations can be executed by software (application programs) or by hardware.
  • the present technology can be applied to any configuration.
  • the present technology can be implemented as a partial configuration of an apparatus such as a processor used as system LSI (Large Scale Integration) or the like, a module using multiple processors or the like, a unit using multiple modules or the like, or a set including the unit to which other functions are added.
  • LSI Large Scale Integration
  • the present technology can also be applied to a network system including multiple apparatuses.
  • the present technology may be implemented as cloud computing in which multiple apparatuses share and cooperate in processing via a network.
  • the present technology may be implemented in a cloud service in which services are provided to any terminals such as computers, portable information terminals, and IoT (Internet of Things) devices.
  • the system means a set of multiple components (apparatuses, modules (parts), or the like) regardless of whether all the components are located in the same housing. Consequently, multiple apparatuses placed in separate housings and connected to each other via a network constitute a system, and one apparatus including multiple modules placed in one housing also constitutes a system.
  • a system, an apparatus, processing, or the like to which the present technology is applied can be used in any fields such as transportation, medical care, crime prevention, agriculture, livestock industry, mining, beauty care, factories, home electrical appliances, meteorology, and nature monitoring. Further, the system, apparatus, processing, or the like may have any use.
  • the configuration described as one apparatus (or processing section) may be divided into multiple apparatuses (or processing sections).
  • the configurations described as multiple apparatuses (or processing sections) may be combined into one apparatus (or processing section).
  • components other than those described above may be added.
  • a part of the configuration of a certain apparatus (or processing section) may be included in the configuration of another apparatus (or another processing section) as long as the configuration or operation of the system as a whole remains substantially unchanged.
  • the programs described above may be executed in any apparatus.
  • the apparatus is only required to include required functions (functional blocks or the like) and be configured to obtain required information.
  • the steps in one flowchart may be executed by one apparatus or may be shared by multiple apparatuses.
  • the multiple processing operations may be executed by one apparatus or may be shared by multiple apparatuses.
  • multiple processing operations included in one step can be executed as processing in multiple steps.
  • the processing described as multiple steps can be collectively executed as one step.
  • processing in steps describing the program may be chronologically executed in the order described herein or may be executed in parallel or separately at required timings such as the time when the program is invoked.
  • the processing in the steps may be executed in an order different from the one described above unless this leads to contradiction.
  • the processing in the steps describing the program may be executed in parallel with or in combination with processing of another program.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Power Engineering (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • Health & Medical Sciences (AREA)
  • Studio Devices (AREA)

Abstract

There is provided an imaging apparatus, an information processing apparatus, an information processing method, and a program that are intended to suppress an increase in a load. A captured image is linked with a hash value for a part of the captured image and part identification information for identifying the part. Further, the part of the captured image is extracted from the captured image in reference to the part identification information for identifying the part, the part identification information being linked with the captured image along with the hash value for the part and the part identification information, a hash value for the part extracted and the part identification information is generated, and the hash value generated is compared with the hash value linked with the captured image. The present disclosure can be applied to, for example, an image processing apparatus, an information processing apparatus, an imaging apparatus, electronic equipment, an information processing method, a program, or the like.

Description

CROSS REFERENCE TO PRIOR APPLICATION
This application is a National Stage Patent Application of PCT International Patent Application No. PCT/JP2021/010490 (filed on Mar. 16, 2021) under 35 U.S.C. § 371, which claims priority to Japanese Patent Application No. 2020-060928 (filed on Mar. 30, 2020), which are all hereby incorporated by reference in their entirety.
TECHNICAL FIELD
The present disclosure relates to an imaging apparatus, an information processing apparatus, an information processing method, and a program, and in particular, to an imaging apparatus, an information processing apparatus, an information processing method, and a program that are intended to suppress an increase in a load.
BACKGROUND ART
In the known art, there has been proposed a method in which a digital camera or the like converts a captured image or the like into a hash value and links the captured image with an electronic signature using the hash value, thereby using the electronic signature for detection of falsification (see, for example, PTL 1).
CITATION LIST Patent Literature
[PTL 1]
    • Japanese Paten Laid-open No. 2008-22372
SUMMARY Technical Problem
The present disclosure is intended to suppress such an increase in a load caused by linking of electronic signature.
Solution to Problem
An imaging apparatus according to an aspect of the present technology is an imaging apparatus including a linking section that links a captured image with a hash value for a part of the captured image and part identification information for identifying the part.
An information processing method according to an aspect of the present technology is an information processing method including linking a captured image with a hash value for a part of the captured image and part identification information for identifying the part.
A program according to an aspect of the present technology is a program causing functioning as a linking section that links a captured image with a hash value for a part of the captured image and part identification information for identifying the part.
An information processing apparatus according to another aspect of the present technology is an imaging apparatus including an extraction section that extracts a part of a captured image from the captured image in reference to part identification information for identifying the part, the part identification information being linked with the captured image along with a hash value for the part and the part identification information, a hash value generation section that generates a hash value for the part extracted by the extraction section and the part identification information, and a comparison section that compares the hash value generated by the hash value generation section with the hash value linked with the captured image.
An information processing method according to another aspect of the present technology is an information processing method including extracting a part of a captured image from the captured image in reference to part identification information for identifying the part, the part identification information being linked with the captured image along with a hash value for the part and the part identification information, generating a hash value for the part extracted and the part identification information, and comparing the hash value generated with the hash value linked with the captured image.
A program according to another aspect of the present technology is a program causing a computer to function as an extraction section that extracts a part of a captured image from the captured image in reference to part identification information for identifying the part, the part identification information being linked with the captured image along with a hash value for the part and the part identification information, a hash value generation section that generates a hash value for the part extracted by the extraction section and the part identification information, and a comparison section that compares the hash value generated by the hash value generation section with the hash value linked with the captured image.
In the imaging apparatus, the information processing method, and the program according to an aspect of the present technology, the captured image is linked with the hash value for a part of the captured image and part identification information for identifying the part.
In the information processing apparatus, the information processing method, and the program according to another aspect of the present technology, a part of the captured image is extracted from the captured image in reference to the part identification information for identifying the part, the part identification information being linked with the captured image along with the hash value for the part and the part identification information, the hash value for the part extracted and the part identification information is generated, and the hash value generated is compared with the hash value linked with the captured image.
BRIEF DESCRIPTION OF DRAWINGS
FIG. 1 is a diagram depicting a main configuration example of a falsification detection system.
FIG. 2 depicts diagrams illustrating an example of information transmitted and received between apparatuses.
FIG. 3 is a block diagram depicting a main configuration example of an imaging apparatus.
FIG. 4 is a functional block diagram depicting functions implemented in the imaging apparatus.
FIG. 5 is a flowchart illustrating an example of a flow of imaging processing.
FIG. 6 is a block diagram depicting a main configuration example of a verification apparatus and the like.
FIG. 7 is a functional block diagram depicting functions implemented in the verification apparatus.
FIG. 8 is a flowchart illustrating an example of a flow of processing related to verification.
FIG. 9 is a functional block diagram depicting functions implemented in the imaging apparatus.
FIG. 10 is a flowchart illustrating an example of flow of imaging processing.
FIG. 11 is a functional block diagram depicting functions implemented in the imaging apparatus.
FIG. 12 is a flowchart illustrating an example of a flow of the imaging processing.
FIG. 13 is a functional block diagram depicting functions implemented in the verification apparatus.
FIG. 14 is a flowchart illustrating an example of a flow of processing related to verification.
FIG. 15 is a functional block diagram depicting functions implemented in the imaging apparatus.
FIG. 16 is a flowchart illustrating an example of a flow of the imaging processing.
 DESCRIPTION OF EMBODIMENTS
Forms for implementing the present disclosure (hereinafter referred to as embodiments) will be described below. Note that the description is given in the following order.
    • 1. Generation of Hash for Partial Image
    • 2. First Embodiment (Identification of Partial Region Based on Focus Information)
    • 3. Second Embodiment (Identification of Partial Region Based on Image Analysis Result)
    • 4. Third Embodiment (Case of Moving Image)
    • 5. Fourth Embodiment (Control Depending on Imaging Mode)
    • 6. Supplementary Note
1. Generation of Hash for Partial Image
<Generation of Hash>
For example, PTL 1 describes a method in which a digital camera or the like generates a hash for the entire captured image and uses the hash to associate an electronic signature with the captured image, thereby using the electronic signature for detection of falsification. For example, information regarding the imaging apparatus can also be included in the electronic signature.
However, in recent years, improved information processing technologies have the tendency to increase the amount of data for the imaging apparatus. Such an increased amount of data for the imaging apparatus tends to increase a load on processing for generating a hash for the entire captured image. This increases processing time related to generation of the electronic signature, and in a case where multiple captured images are generated in a short period of time particularly in a continuous shooting imaging mode or a moving image imaging mode, the processing for generating an electronic signature may not be performed in time.
Hence, a hash for a part of the captured image is generated and used to detect falsification. This enables suppression of an increase in the amount of data of a target (image) for which the hash is to be generated, thus allowing suppression of an increase in the load related to generation of the electronic signature.
For example, a hash value for a part of the captured image and part identification information for identifying the part is linked with the captured image. This allows suppression of an increase in the load related to generation of the electronic signature to suppress an increase in processing time for the electronic signature.
The part for which the hash is generated may be any part of the captured image. For example, the part may be a more important part of the captured image. In other words, the important part of the captured image is identified, the identified part is extracted from the captured image, a hash is generated for the extracted image, and the hash is used for generation of an electronic signature. This allows authenticity of the important part of the captured image to be ensured, while an increase in the load is suppressed.
A reference for the important part of the captured image is optional. For example, the important part may be a part of the captured image focused on a subject (also referred to as a focused part). For example, focus information (for example, depth data including a depth map, distance measurement information, and the like) indicating the focal position of the captured image may be used to identify the focused part, the focused part identified may be extracted, and a hash may be generated. This allows the authenticity of the focused part of the captured image to be ensured, while an increase in the load is suppressed.
Further, for example, the important part may be a partial region of a predetermined position in the captured image. For example, the important part may be a partial region at a position where an important subject is likely to be present. For example, the important part may be a partial region near the center of the captured image. Further, the important part may be a partial region close to any of four corners of the captured image. Further, the important part may be a partial region randomly selected from multiple partial regions at different positions such as regions near the center and the four corners of the captured image. This allows the authenticity of the partial region at the predetermined position in the captured image to be ensured, while an increase in the load is suppressed.
Further, for example, the important part may be a part of the captured image resulting from decimation of some pixels from the captured image. For example, the important part may be an image obtained by decimating any pixels from the captured image at a predetermined rate. For example, the important part may be an image resulting from decimation of pixels from the captured image with a 4K resolution into an HD resolution. Further, for example, the important part may be an image resulting from decimation of any pixel columns (or pixel rows) from the captured image at a predetermined rate. This allows authenticity to be ensured for a range substantially similar to the entire captured image while an increase in the load is suppressed.
Further, image analysis may be performed on the captured image to identify the important part. For example, image analysis may be performed on the captured image to identify a part of the captured image in which an important subject is present, the identified part may be extracted as an important part, and a hash may be generated for the important part. For example, image analysis may be performed to identify a subject (person), and a region of the captured image in which the person is present may be designated as an important part. Needless to say, the subject to be detected is optional and is not limited to a person. For example, the subject to be detected may be a face of the person or a site other than the face. Further, the subject to be detected may be an animal or a plant. Furthermore, the subject to be detected may be inorganic matter such as a building. This allows ensuring of authenticity of a part of the captured image in which the important subject appears, while suppressing an increase in the load.
Further, in a case where the captured image is a moving image, for only I frames of the moving image, the captured image may be associated with the hash value for a part of the captured image and the part identification information for identifying the part. This allows the authenticity of the important part to be ensured for I frames having larger amount of data, while an increase in the load is suppressed.
Further, in a case where the captured image is a moving image, for only frames of the moving image which involve intense movement (for example, frames between which the movement is more intense than a predetermined value (higher than a threshold) (movement from the preceding frame is more intense than the predetermined threshold)), the captured image may be associated with the hash value for a part of the captured image and the part identification information for identifying the part. This allows, for more important frames with intense movement, the authenticity of the important part to be ensured, while an increase in the load is suppressed.
Further, in a case where the imaging mode is a continuous shooting mode, the captured image may be associated with the hash value for a part of the captured image and the part identification information for identifying the part, and in a case where the imaging mode is not the continuous shooting mode, the captured image may be associated with the hash value for the entire captured image. This allows an increase in processing time to be suppressed for the continuous shooting mode, which has a short processing time.
Note that the hash value may be generated using a part of the captured image and the part identification information for identifying the part. Moreover, the hash value generated may be linked with the captured image. Further, an electronic signature including the hash value may be generated, and the electronic signature generated may be linked with the captured image.
Further, the part identification information for identifying the part may be used to update metadata for the captured image, and the updated metadata may be linked with the captured image. Further, the captured image may be associated with a public key used to generate the electronic signature and a certificate for the public key.
Further, a part of the captured image may be extracted from the captured image in reference to the part identification information for identifying the part, the part identification information being linked with the captured image along with the hash value for the part and the part identification information, the hash value for the part extracted and the part identification information may be generated, and the hash value generated may be compared with the hash value linked with the captured image. This allows suppression of an increase in the load related to verification of the electronic signature generated using the hash for the part of the captured image.
2. First Embodiment
<Falsification Detection System>
FIG. 1 is a diagram depicting a main configuration example of a falsification detection system corresponding to an embodiment of an information processing system to which the present technology is applied. A falsification detection system 100 depicted in FIG. 1 is a system that detects falsification of a captured image or the like. As depicted in FIG. 1 , the falsification detection system 100 includes, for example, an imaging apparatus 101, a verification apparatus 102, and a certification authority 103. Note that FIG. 1 depicts one imaging apparatus 101, one verification apparatus 102, and one certification authority 103 but the numbers of imaging apparatuses 101, the verification apparatuses 102, and certification authorities 103, constituting the falsification detection system 100, are each optional. For example, the imaging apparatus 101, the verification apparatus 102, and the certification authority 103 may be provided in plural number.
The imaging apparatus 101, the verification apparatus 102, and the certification authority 103 are connected to one another in a manner allowing communication therebetween, for example, via a network not illustrated. The imaging apparatus 101 executes processing related to imaging of a subject (generation of a captured image), generation of a hash for the captured image, generation of a signature to be associated with the captured image, and the like. Moreover, the imaging apparatus 101 applies for issuance of a certificate with the certification authority 103, causes the certification authority 103 to issue the certificate, and acquires the certificate. Furthermore, the imaging apparatus 101 can transmit the captured image (photograph), metadata of the captured image, and the like to the verification apparatus 102.
The verification apparatus 102 executes processing related to detection of falsification of the captured image generated in the imaging apparatus 101. For example, the verification apparatus 102 may acquire a captured image (photograph) and metadata of the captured image fed from the imaging apparatus 101. Further, the verification apparatus 102 can verify the electronic signature.
The certification authority 103 can issue a certificate for the captured image. Moreover, the certification authority 103 can distribute, to the verification apparatus 102, a certificate from the certification authority and a certificate expire list. In reference to the certificate from the certification authority and the certificate expire list, the verification apparatus 102 can verify the certificate used by the imaging apparatus 101. Note that the “linking” of pieces of data herein refers to “associating” of pieces of data with each other. The term “associating” as used herein means that when one of the pieces of data is processed, the other piece of data may be used (may be linked with the one of the pieces of data). In other words, pieces of data associated with each other may be compiled into one piece of data or may be used as separate pieces of data. For example, multiple pieces of information associated with one another may be transmitted on different transmission paths. Further, for example, multiple pieces information associated with one another may be recorded in different recording media (or different recording areas in the same recording medium). Note that the “associating” may be intended for a part of the data rather than the entire data. For example, an image and information corresponding to the image may be associated with each other in any units such as multiple frames, one frame, or a portion within a frame. Note that, in the specification, besides the “linking” described above, for example, such terms as “synthesizing,” “multiplexing,” “adding,” “integrating,” “including,” “storing,” “putting into,” “plugging into,” and “inserting” mean organizing multiple objects into one and mean one method for the “associating” described above.
<Data>
FIG. 2 is a diagram depicting an example of data fed from the imaging apparatus 101 to the verification apparatus 102. As depicted in A of FIG. 2 , a captured image 111 is associated with such information as metadata 112, an electronic signature 113, and a certificate/public key 114.
An example of the metadata 112 is depicted in B of FIG. 2 . As depicted in B of FIG. 2 , the metadata 112 includes the serial number of a camera, a photographer, a photographing time, a focal length, an aperture value, a shutter speed, a photographing location, and the like. Furthermore, the metadata 112 also includes extracted region information.
<Imaging Apparatus>
FIG. 3 is a diagram depicting a main configuration example of the imaging apparatus 101 corresponding to an embodiment of the information processing apparatus to which the present technology is applied. The imaging apparatus 101 depicted in FIG. 3 is a computer in which an application program (software) for performing processing related to imaging (generation of a captured image), generation of an electronic signature, and the like is installed and executed. Here, examples of the computer include a computer integrated into dedicated hardware, for example, a general-purpose personal computer in which various programs are installed and which can execute various functions, and the like. In other words, the imaging apparatus 101 executes the application programs to perform processing related to imaging (generation of a captured image), generation of an electronic signature, and the like.
In the imaging apparatus 101 depicted in FIG. 3 , a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, and a RAM (Random Access Memory) are connected to one another via a bus 204.
An input/output interface 210 is also connected to the bus 204. The input/output interface 210 connects to an input section 211, an output section 212, a storage section 213, a communication section 214, and a drive 215.
The input section 211 includes, for example, a keyboard, a mouse, a microphone, a touch panel, an input terminal, and the like. The output section 212 includes, for example, a display, a speaker, an output terminal, and the like. The storage section 213 includes, for example, a hard disk, a RAM disk, a nonvolatile memory, and the like. The communication section 214 includes, for example, a network interface. The drive 215 drives a removable recording medium 221 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
Further, an imaging section 231 and a sensor 232 are connected to the input/output interface 210.
The imaging section 231 includes, for example, an optical system, such as a lens and a diaphragm, and an image sensor, and images a subject to generate a captured image. Note that the imaging section 231 may further include components other than those described above, such as an image processing section that executes image processing on the captured image generated and a memory that stores the data regarding the captured image.
The sensor 232 includes, for example, a distance measurement sensor or the like to measure the distance to the subject. Note that the sensor 232 may generate a depth map and the like.
In the imaging apparatus 101 configured as described above, the CPU 201 loads into the RAM 203 and executes, for example, an application program stored in the storage section 213, via the input/output interface 210 and the bus 204, thus performing a series of processing operations described above. The RAM 203 also appropriately stores data required for the CPU 201 to execute various processing operations, for example.
The application program executed by the imaging apparatus 101 can be recorded in the removable recording medium 221, used as a package medium or the like, for example, for application. In that case, the application program can be installed in the storage section 213 via the input/output interface 210 by mounting the removable recording medium 221 in the drive 215.
In addition, the application program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. In that case, the application program can be received by the communication section 214 and installed in the storage section 213.
Alternatively, the application program can be installed in the ROM 202 or the storage section 213 in advance.
FIG. 4 depicts, as functional blocks, functions implemented by execution of application programs in the imaging apparatus 101. As depicted in FIG. 4 , by executing the application programs, the imaging apparatus 101 can be provided with an imaging control section 251, a partial data extraction section 252, a metadata update section 253, a hash generation section 254, an electronic signature generation section 255, a linking section 256, and an output control section 257.
The imaging control section 251 controls and causes the imaging section 231 to execute processing related to imaging. The partial data extraction section 252 executes processing related to extraction of partial data of the captured image (data of a partial image of the captured image). The metadata update section 253 executes processing related to information update of metadata associated with the captured image. The hash generation section 254 executes processing related to generation of a hash. The electronic signature generation section 255 executes processing related to generation of an electronic signature. The linking section 256 executes processing related to linking of the captured image with other data. The output control section 257 executes processing related to control of data output.
<Flow of Imaging Processing>
An example of a flow of imaging processing executed by the imaging apparatus 101 will be described with reference to a flowchart in FIG. 5 .
When the imaging processing is started, the imaging control section 251 controls and causes, in step S101, the imaging section 231 to image the subject and generate a captured image. Further, the imaging control section 251 controls and causes the sensor 232 to measure the distance to the subject and generate focus information (depth data). Then, the imaging control section 251 acquires the captured image and focus information generated.
In step S102, in reference to the focus information acquired in step S101, the partial data extraction section 252 extracts a focused part of the captured image also acquired. In step S103, the metadata update section 253 includes, in the metadata, extracted region information indicating the region extracted in step 102 (that is, partial identification for identifying a part of the captured image). In other words, as depicted in B of FIG. 2 , the “extracted region information” is applied to the metadata 112. Then, the metadata thus updated is applied to the partial image (focused part) of the captured image. In other words, the metadata is linked (associated) with the partial image.
In step S104, the hash generation section 254 generates a hash for data of a combination of the partial image extracted in step S102 and the metadata updated in step S103. In other words, a hash for the partial image and the metadata linked with each other is generated.
In step S105, the electronic signature generation section 255 uses a private key to encrypt the hash generated in step S104 (hash for the partial image and the metadata linked with each other), to generate an electronic signature.
In step S106, the linking section 256 links (associates), with one another, the captured image acquired in step S101, the metadata updated in step S103, the electronic signature and certificate generated in step S105, and the public key corresponding to the private key used in step S105.
In step S107, the output control section 257 outputs the captured image, the metadata, the electronic signature, the certificate, and the public key linked (associated) with one another by the processing in step S106.
When the processing in step S107 ends, the imaging processing ends. The imaging processing executed as described above allows the electronic signature to be generated with use of a part of the captured image. In other words, the captured image can be linked with the hash value for a part of the captured image and the part identification information for identifying the part. Consequently, an increase in the load can be suppressed.
In the above description, a part of the captured image is identified in reference to the focus information, and the hash for the part is generated. However, the method for identifying the part is optional, and is not limited to the example of the focus information. For example, a partial image at a predetermined position in the captured image may be the “part” described above. Alternatively, an image obtained by decimation of some pixels from the captured image may be the “part” described above.
<Verification Apparatus and the Like>
FIG. 6 is a diagram depicting a main configuration example of the verification apparatus 102 corresponding to an embodiment of the information processing apparatus to which the present technology is applied. The verification apparatus depicted in FIG. 6 is a computer in which an application program (software) for executing processing related to verification of the electronic signature is installed and executed. Here, examples of the computer include a computer integrated into dedicated hardware, for example, a general-purpose personal computer in which various programs are installed and which can execute various functions, and the like. The verification apparatus 102 executes the application programs to perform processing related to verification of the electronic signature.
In the verification apparatus 102 depicted in FIG. 6 , a CPU 301, a ROM 302, and a RAM 203 are connected to one another via a bus 304.
An input/output interface 310 is also connected to the bus 304. The input/output interface 310 connects to an input section 311, an output section 312, a storage section 313, a communication section 314, and a drive 315.
The input section 311 includes, for example, a keyboard, a mouse, a microphone, a touch panel, an input terminal, and the like. The output section 312 includes, for example, a display, a speaker, an output terminal, and the like. The storage section 313 includes, for example, a hard disk, a RAM disk, a nonvolatile memory, and the like. The communication section 314 includes, for example, a network interface. The drive 315 drives a removable recording medium 321 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
In the verification apparatus 102 configured as described above, the CPU 301 loads into the RAM 303 and executes, for example, an application program stored in the storage section 313, via the input/output interface 310 and the bus 304, thus performing a series of processing operations described above. The RAM 303 also appropriately stores data required for the CPU 301 to execute various processing operations, and the like.
The application program executed by the verification apparatus 102 can be recorded in the removable recording medium 321, used as a package medium or the like, for example, for application. In that case, the application program can be installed in the storage section 313 via the input/output interface 310 by mounting the removable recording medium 321 in the drive 315.
In addition, the application program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. In that case, the application program can be received by the communication section 314 and installed in the storage section 313.
Alternatively, the application program can be installed in the ROM 302 or the storage section 313 in advance.
Note that the certification authority 103 is configured similarly to the verification apparatus 102 depicted in FIG. 3 . In other words, the block diagram depicted in FIG. 3 may also be used for description of the certification authority 103.
FIG. 7 depicts, as functional blocks, functions implemented by execution of application programs in the verification apparatus 102. As depicted in FIG. 7 , by executing the application programs, the verification apparatus 102 can be provided with an acquisition control section 351, a certificate verification section 352, an electronic signature decoding section 353, a partial data extraction section 354, a hash generation section 355, a comparison section 356, and an output control section 357.
The acquisition control section 351 executes processing related to acquisition of data such as the captured image and the electronic signature by, for example, control of the communication section 314 and the like. The certificate verification section 352 executes processing related to verification of the certificate. The electronic signature decoding section 353 executes processing related to decoding of the electronic signature. The partial data extraction section 354 executes processing related to extraction of partial data. The hash generation section 355 executes processing related to generation of a hash. The comparison section 356 executes processing related to comparison of the electronic signature. The output control section 357 executes processing related to data output.
<Flow of Verification Processing>
Now, an example of a flow of verification processing executed by the verification apparatus 102 and the certification authority 103 will be described with reference to a flowchart in FIG. 8 .
When the verification processing is started, in step S201, by control of the communication section 314 and the like, the acquisition control section 351 of the verification apparatus 102 acquires the captured image, the metadata, the electronic signature, the certificate, and the public key fed from the imaging apparatus 101 and linked with one another. In other words, the electronic signature generated using a part of the captured image (the electronic signature including a hash value for a part (partial image) of the captured image corresponding to the extracted region information of the metadata and the part identification information for identifying the partial image (that is, the metadata)) is acquired.
In step S202, the certificate verification section 352 requests a certificate expire list from the certification authority 103 via the communication section 314. In step S221, the certification authority 103 receives the request from the verification apparatus 102. Then, in response to the request, the certification authority 103 feeds the certificate expire list to the verification apparatus 102. In step S203, the acquisition control section 351 of the verification apparatus 102 acquires the certificate expire list via the communication section 314.
In step S204, the certificate verification section 352 uses the certificate expire list acquired in step S203, to check the validity of the certificate.
In step S205, the electronic signature decoding section 353 uses the public key to decode the electronic signature acquired in step S201. In other words, a hash value for the partial image of the captured image corresponding to the extracted region information of the metadata and the metadata (part identification information) is obtained. In step S206, the partial data extraction section 354 extracts the partial image from the captured image in reference to the extracted region information of the metadata.
In step S207, the hash generation section 355 generates a hash for the partial image extracted and the metadata.
In step S208, the comparison section 356 compares the hash obtained by the processing in step S205 with the hash generated by the processing in step S207, and according to a comparison result, determines whether or not falsification has been performed.
In step S209, the output control section 357 outputs a verification result obtained in step S208. When the processing in step S209 ends, the verification processing ends.
The verification processing executed as described above allows the verification apparatus 102 to perform verification of the electronic signature using the hash for the partial image of the captured image. Consequently, an increase in the load can be suppressed.
3. Second Embodiment
<Identification of Partial Region Based on Image Analysis Result>
Note that image analysis may be performed on the captured image and that, according to a result of the analysis, the “part” of the captured image for which a hash is to be generated may be identified. For example, by performing the image analysis, the region of a person (or a face) in the captured image may be identified, the region may be designated as the “part” described above, and a hash may be generated for the region.
<Functional Blocks>
FIG. 9 depicts, as functional blocks, functions implemented by execution of the application programs in the imaging apparatus 101 in the above-described case. As depicted in FIG. 9 , in this case, the imaging apparatus 101 includes an image analysis section 401 in addition to the functional blocks in the case of FIG. 4 . The image analysis section 401 executes processing related to image analysis for the captured image and the like.
<Flow of Imaging Processing>
An example of a flow of imaging processing in this case will be described with reference to a flowchart in FIG. 10 . When the imaging processing is started, the imaging control section 251 controls and causes, in step S301, the imaging section 231 to image the subject and generate a captured image of the subject. Further, the imaging control section 251 controls and causes the sensor 232 to measure the distance to the subject and generate focus information (depth data). Then, the imaging control section 251 acquires the captured image and focus information generated.
In step S302, the image analysis section 401 performs image analysis on the captured image to identify a region with a person (person region). In step S303, the partial data extraction section 252 extracts the identified person region of the captured image.
Processing operations in steps S304 to S308 are executed in a manner similar to that of the processing operations in steps S103 to S107 in FIG. 5 .
The imaging processing executed as described above allows the imaging apparatus 101 to generate an electronic signature with use of a part of the captured image corresponding to an image analysis result. In other words, a hash for a more important part of the captured image can be generated and associated with the captured image. Consequently, an increase in the load can be suppressed.
Note that, in the above description, image analysis is used to identify a person region. However, any region other than a person region may be identified by image analysis.
Moreover, verification processing in this case is similar to the verification processing in the case of the first embodiment, and the description of the verification processing is thus omitted.
4. Third Embodiment
<Moving Image>
Note that the captured image with which the electronic signature is to be associated may be a moving image. In this case, only for some frames, the hash for the partial image may be linked with the captured image as described above. For example, only for I frames, the hash for the partial image may be linked with the captured image.
<Functional Blocks>
FIG. 11 depicts, as an example of functional blocks, functions implemented by execution of the application programs in the imaging apparatus 101 in the above-described case. As depicted in FIG. 11 , in this case, the imaging apparatus 101 includes a sort buffer 411 and a coding section 412 in addition to the functional blocks in the case of FIG. 4 . The sort buffer 411 holds multiple frames of a moving image to be coded and changes the order of arrangement of the frames from a reproduction order to a decoding order. The coding section 412 executes processing related to coding of the captured image (moving image) with use of, for example, a coding scheme for two-dimensional moving images such as AVC (Advanced Video Coding) or HEVC (High Efficiency Video Coding).
<Flow of Imaging Processing>
An example of a flow of imaging processing in this case will be described with reference to a flowchart in FIG. 12 . Note that here, as an example, described will be a case in which focus information is used to set the partial image for which a hash is to be generated.
When the imaging processing is started, the imaging control section 251 controls and causes, in step S341, the imaging section 231 to image the subject and generate a captured image of the subject. Further, the imaging control section 251 controls and causes the sensor 232 to measure the distance to the subject and generate focus information (depth data). Then, the imaging control section 251 acquires the captured image and focus information generated.
In step S342, the sort buffer 411 holds multiple frame images and changes the order of arrangement of the frames from the reproduction order to the coding order.
In step S343, the partial data extraction section 252 determines whether or not the frame to be processed is an I frame. In a case where the partial data extraction section 252 determines that the frame to be processed is an I frame, the processing proceeds to step S344.
The processing operations in steps S344 to S347 are performed in a manner similar to that of the processing operations in steps S102 to S105. In step S348, the coding section 412 codes the captured image to be processed, to generate coded data.
In step S349, the linking section 256 links, with one another, the coded data of the captured image, the metadata, the electronic signature, the certificate, and the public key. In step S350, the output control section 257 outputs the data.
When the processing in step 3350 ends, the processing proceeds to step S353. Alternatively, in step S343, in a case where the partial data extraction section 252 determines that the frame to be processed is not an I frame, the processing proceeds to step S351.
In step S351, the coding section 412 codes the captured image to generate coded data. In step S352, the output control section 257 outputs the coded data. When the processing in step S352 ends, the processing proceeds to step S353.
In step S353, the imaging control section 251 determines whether or not all the frames have been processed. In a case where the imaging control section 251 determines that there is a frame yet to be processed, the processing returns to step S341, and the subsequent processing is executed. Alternatively, in a case where the imaging control section 251 determines in step S353 that all the frames have been processed, the imaging processing ends.
The imaging processing executed as described above allows a hash for a part of the captured image to be generated only for I frames of the moving image and used for generation of an electronic signature. Consequently, an increase in the load can be suppressed.
<Functional Blocks of Verification Apparatus>
Further, FIG. 13 depicts, as an example of functional blocks, functions implemented by execution of the application programs in the verification apparatus 102 in the above-described case. As depicted in FIG. 13 , in this case, the verification apparatus 102 includes a decoding section 421 in addition to the functional blocks in the case of FIG. 7 . The decoding section 421 executes processing related to decoding of coded data of the moving image. The sort buffer 411 holds multiple frames of the moving image to be coded and changes the order of arrangement of the frames from the reproduction order to the decoding order. The coding section 412 executes processing related to coding of the captured image (moving image) with use of, for example, a coding scheme for two-dimensional moving images such as AVC (Advanced Video Coding) or HEVC (High Efficiency Video Coding).
<Flow of Verification Processing>
Now, an example of verification processing executed by the verification apparatus 102 and the certification authority 103 in the above-described case will be described with reference to a flowchart in FIG. 14 .
When the verification processing is started, in step S371, by control of the communication section 314 and the like, the acquisition control section 351 of the verification apparatus 102 acquires the coded data and the metadata of the captured image and the electronic signature, the certificate, and the public key for the captured image that are linked with one another.
In step S372, the decoding section 421 decodes the coded data to generate a frame image.
In step S373, the decoding section 421 determines where or not the frame to be processed is an I frame. In a case where the frame to be processed is determined to be an I frame, the processing proceeds to step S374.
Processing operations in steps S374 to S381 are executed in a manner similar to that of the processing operations in steps S202 to S209 in FIG. 8 . Further, processing operations in steps S391 and S392 are executed by the certification authority 103 in a manner similar to that of the processing operations in steps S221 and S222 in FIG. 8 .
When the processing in step S381 ends, the processing proceeds to step S382. Alternatively, in step S373, in a case where the frame to be processed is determined not to be an I frame, the processing proceeds to step S382.
In step S382, the output control section 357 determines whether or not all the frames have been processed. In a case where the output control section 357 determines that there is a frame yet to be processed, the processing returns to step S371 to repeat the subsequent processing. Alternatively, in step S382, in a case where the output control section 357 determines that all the frames have been processed, the verification processing ends.
The verification processing executed as described above allows the verification apparatus 102 to perform the verification of the electronic signature using the hash for the partial image of the captured image only for the I frames of the moving image. Consequently, an increase in the load can be suppressed.
5. Fourth Embodiment
<Control Corresponding to Imaging Mode>
Note that the method of generating an electronic signature may be controlled according to the imaging mode. For example, in an imaging mode in which a moving image is captured or in an imaging mode for what is generally called continuous shooting, the electronic signature is generated using the hash for the partial image as described above. In an ordinary still image imaging mode, the electronic signature may be generated using the hash for the entire captured image.
<Functional Blocks>
FIG. 15 depicts, as an example of functional blocks, functions implemented by execution of the application programs in the imaging apparatus 101 in the above-described case. As depicted in FIG. 15 , in this case, the imaging apparatus 101 includes an imaging mode control section 431 in addition to the functional blocks in the case of FIG. 11 . The imaging mode control section 431 performs control related to generation of an electronic signature according to the imaging mode.
<Flow of Imaging Processing>
A flow of the imaging processing in this case will be described with reference to a flowchart in FIG. 16 . When the imaging processing is started, the imaging mode control section 431 sets the imaging mode in step S401. In step S402, the imaging mode control section 431 determines whether or not the imaging mode is a moving image imaging mode in which a moving image is captured. In a case where the imaging mode is determined to be the moving image imaging mode, the processing proceeds to step S403.
In step S403, the imaging apparatus 101 performs the imaging processing in the moving image imaging mode. In other words, the imaging apparatus 101 executes imaging processing similar to that described with reference to the flowchart in FIG. 12 . When the processing in step S403 ends, the imaging processing ends.
Further, in step S402, in a case where the imaging mode is determined not to be the moving image imaging mode, the processing proceeds to step S404. In step S404, the imaging mode control section 431 determines whether or not the imaging mode is a continuous shooting imaging mode in which a captured image of a still image is captured multiple times during a short period of time (what is generally called continuous shooting is performed). In a case where the imaging mode is determined to be the continuous shooting imaging mode, the processing proceeds to step S405.
In step S405, the imaging apparatus 101 executes the imaging processing in the continuous shooting imaging mode. In other words, the imaging apparatus 101 executes imaging processing similar to that described with reference to the flowchart in FIG. 5 or FIG. 10 , and generates an electronic signature with use of the hash of the partial image. When the processing in step S405 ends, the imaging processing ends
Alternatively, in step S404, in a case where the imaging mode is determined not to be the continuous shooting imaging mode, the processing proceeds to step S406. In this case, an electronic signature is generated with use of the hash for the entire captured image.
Consequently, in step S406, the imaging control section 251 controls and causes the imaging section 231 to image the subject and generate a captured image of the subject. Then, the imaging control section 251 acquires the captured image generated.
In step S407, the hash generation section 254 generates a hash for the entire captured image. In step S408, the electronic signature generation section 255 uses the private key to encrypt the hash generated in step S407 and generates an electronic signature.
In step S409, the linking section 256 links, with one another, the captured image acquired, the electronic signature generated in step S408, the certificate, and the public key.
In step S410, the output control section 257 outputs the captured image, the electronic signature, the certificate, and the public key that have been associated with one another by the processing in step S409. When the processing in step S410 ends, the imaging processing ends.
The imaging processing executed as described above allows the appropriate imaging processing to be executed according to the imaging mode. Consequently, an increase in the load can be suppressed more appropriately.
6. Supplementary Note
<Hardware>
The series of processing operations can be executed by software (application programs) or by hardware.
<Application Target of Present Technology>
The present technology can be applied to any configuration. For example, the present technology can be implemented as a partial configuration of an apparatus such as a processor used as system LSI (Large Scale Integration) or the like, a module using multiple processors or the like, a unit using multiple modules or the like, or a set including the unit to which other functions are added.
Further, for example, the present technology can also be applied to a network system including multiple apparatuses. For example, the present technology may be implemented as cloud computing in which multiple apparatuses share and cooperate in processing via a network. For example, the present technology may be implemented in a cloud service in which services are provided to any terminals such as computers, portable information terminals, and IoT (Internet of Things) devices.
Note that, in the present specification, the system means a set of multiple components (apparatuses, modules (parts), or the like) regardless of whether all the components are located in the same housing. Consequently, multiple apparatuses placed in separate housings and connected to each other via a network constitute a system, and one apparatus including multiple modules placed in one housing also constitutes a system.
<Fields and Uses to which Present Technology is Applicable>
A system, an apparatus, processing, or the like to which the present technology is applied can be used in any fields such as transportation, medical care, crime prevention, agriculture, livestock industry, mining, beauty care, factories, home electrical appliances, meteorology, and nature monitoring. Further, the system, apparatus, processing, or the like may have any use.
Other Embodiments
The embodiments of the present technology are not limited to the embodiments described above, and various changes may be made to the embodiments without departing from the spirit of the present technology.
For example, the configuration described as one apparatus (or processing section) may be divided into multiple apparatuses (or processing sections). In contrast, the configurations described as multiple apparatuses (or processing sections) may be combined into one apparatus (or processing section). Further, needless to say, to the configuration of each apparatus (or each processing section), components other than those described above may be added. Moreover, a part of the configuration of a certain apparatus (or processing section) may be included in the configuration of another apparatus (or another processing section) as long as the configuration or operation of the system as a whole remains substantially unchanged.
Further, for example, the programs described above may be executed in any apparatus. In that case, the apparatus is only required to include required functions (functional blocks or the like) and be configured to obtain required information.
Further, for example, the steps in one flowchart may be executed by one apparatus or may be shared by multiple apparatuses. Moreover, in a case where one step includes multiple processing operations, the multiple processing operations may be executed by one apparatus or may be shared by multiple apparatuses. In other words, multiple processing operations included in one step can be executed as processing in multiple steps. In contrast, the processing described as multiple steps can be collectively executed as one step.
Further, for example, for the program executed by the computer, processing in steps describing the program may be chronologically executed in the order described herein or may be executed in parallel or separately at required timings such as the time when the program is invoked. In other words, the processing in the steps may be executed in an order different from the one described above unless this leads to contradiction. Further, the processing in the steps describing the program may be executed in parallel with or in combination with processing of another program.
Further, for example, multiple technologies related to the present technology can be independently and solely implemented unless this leads to contradiction. Needless to say, any multiple present technologies may be implemented together. For example, a part or all of the present technology described in one of the embodiments can be combined for implementation with a part or all of the present technology described in another embodiment. Further, a part or all of any of present technologies described above can be implemented with another technology not described above.
Note that the present technology can also be configured as follows.
    • (1) An imaging apparatus including:
    • a linking section that links a captured image with a hash value for a part of the captured image and part identification information for identifying the part.
    • (2) The imaging apparatus according to (1), in which
    • the part is a focused part of the captured image.
    • (3) The imaging apparatus according to (1), in which
    • the part is a partial region at a predetermined position in the captured image.
    • (4) The imaging apparatus according to (1), in which
    • the part is a part resulting from decimation of some pixels from the captured image.
    • (5) The imaging apparatus according to (1), in which the part is a part identified according to a result of image analysis of the captured image.
    • (6) The imaging apparatus according to any one of (1) to (5), further including:
    • an extraction section that extracts the part from the captured image.
    • (7) The imaging apparatus according to (6), in which
    • the extraction section extracts the focused part of the captured image in reference to focus information.
    • (8) The imaging apparatus according to (6), in which
    • the extraction section extracts the part from the captured image according to the result of image analysis of the captured image.
    • (9) The imaging apparatus according to any one of (1) to (8), further including:
    • a hash value generation section that generates the hash value by using the part of the captured image and the part identification information, in which
    • the linking section links the captured image with the hash value generated by the hash value generation section.
    • (10) The imaging apparatus according to any one of (1) to (9), further including:
    • an electronic signature generation section that generates an electronic signature including the hash value, in which
    • the linking section links the captured image with the electronic signature generated by the electronic signature generation section.
    • (11) The imaging apparatus according to (10), further including:
    • an update section that updates metadata of the captured image by using the part identification information, in which
    • the linking section applies, to the captured image, the metadata updated by the update section, to link the metadata with the captured image.
    • (12) The imaging apparatus according to any one of (1) to (11), in which
    • the linking section links the captured image with a public key used to generate the electronic signature and a certificate for the public key.
    • (13) The imaging apparatus according to any one of (1) to (12), in which
    • the captured image is a moving image, and
    • the linking section links, only for an I frame of the moving image, the captured image with the hash value for the part of the captured image and the part identification information.
    • (14) The imaging apparatus according to any one of (1) to (12), in which
    • the captured image is a moving image, and
    • the linking section links, only for a frame of the moving image including movement more intense than a threshold, the captured image with the hash value for the part of the captured image and the part identification information.
    • (15) The imaging apparatus according to any one of (1) to (12), in which,
    • in a continuous shooting mode, the linking section links the captured image with the hash value for the part of the captured image and the part identification information, and,
    • in a mode other than the continuous shooting mode, the linking section links the captured image with a hash value for the entire captured image.
    • (16) An information processing method including:
    • linking a captured image with a hash value for a part of the captured image and part identification information for identifying the part.
    • (17) A program causing a computer to function as:
    • a linking section that links a captured image with a hash value for a part of the captured image and part identification information for identifying the part.
    • (18) An information processing apparatus including:
    • an extraction section that extracts a part of a captured image from the captured image in reference to part identification information for identifying the part, the part identification information being linked with the captured image along with a hash value for the part and the part identification information;
    • a hash value generation section that generates a hash value for the part extracted by the extraction section and the part identification information; and
    • a comparison section that compares the hash value generated by the hash value generation section with the hash value linked with the captured image.
    • (19) An information processing method including:
    • extracting a part of a captured image from the captured image in reference to part identification information for identifying the part, the part identification information being linked with the captured image along with a hash value for the part and the part identification information;
    • generating a hash value for the part extracted and the part identification information; and
    • comparing the hash value generated with the hash value linked with the captured image.
    • (20) A program causing a computer to function as:
    • an extraction section that extracts a part of a captured image from the captured image in reference to part identification information for identifying the part, the part identification information being linked with the captured image along with a hash value for the part and the part identification information;
    • a hash value generation section that generates a hash value for the part extracted by the extraction section and the part identification information; and
    • a comparison section that compares the hash value generated by the hash value generation section with the hash value linked with the captured image.
REFERENCE SIGNS LIST
    • 100: Falsification detection system
    • 101: Imaging apparatus
    • 102: Verification apparatus
    • 103: Certification authority
    • 231: Imaging section
    • 232: Sensor
    • 251: Imaging control section
    • 252: Partial data extraction section
    • 253: Metadata update section
    • 254: Hash generation section
    • 255: Electronic signature generation section
    • 256: Linking section
    • 257: Output control section
    • 351: Acquisition control section
    • 352: Certificate verification section
    • 353: Electronic signature decoding section
    • 354: Partial data extraction section
    • 355: Hash generation section
    • 356: Comparison section
    • 357: Output control section
    • 401: Image analysis section
    • 411: Sort buffer
    • 412: Coding section
    • 421: Decoding section
    • 431: Imaging mode control section

Claims (15)

The invention claimed is:
1. An imaging apparatus comprising:
circuitry configured to
link a captured image with a hash value for a part of the captured image and part identification information for identifying the part, the captured image being a moving image,
select only frames of the moving image in which movement is higher than movement of a preceding frame of the moving image by a predetermined threshold,
link, for only the selected frames, the captured image with the hash value for the part of the captured image and the part identification information,
generate an electronic signature by using a private key to encrypt the hash value, and
link the captured image with the electronic signature.
2. The imaging apparatus according to claim 1, wherein
the part is a focused part of the captured image.
3. The imaging apparatus according to claim 1, wherein
the part is a partial region at a predetermined position in the captured image.
4. The imaging apparatus according to claim 1, wherein
the part is a part resulting from decimation of some pixels from the captured image.
5. The imaging apparatus according to claim 1, wherein
the part is identified according to a result of image analysis of the captured image.
6. The imaging apparatus according to claim 1, wherein
the circuitry is further configured to extract the part from the captured image.
7. The imaging apparatus according to claim 6, wherein
the circuitry is further configured to extract a focused part of the captured image in reference to focus information.
8. The imaging apparatus according to claim 6, wherein
the circuitry is further configured to extract the part from the captured image according to a result of image analysis of the captured image.
9. The imaging apparatus according to claim 1, wherein
the circuitry is further configured to generate the hash value by using the part of the captured image and the part identification information, and link the captured image with the hash value.
10. The imaging apparatus according to claim 1, wherein
the circuitry is further configured to
update metadata of the captured image by using the part identification information, and
apply, to the captured image, the metadata, to link the metadata with the captured image.
11. The imaging apparatus according to claim 1, wherein
the circuitry is further configured to link the captured image with a public key used to generate an electronic signature and a certificate for the public key.
12. The imaging apparatus according to claim 1, wherein
the circuitry is further configured to link, only for an I frame of the moving image, the captured image with the hash value for the part of the captured image and the part identification information.
13. The imaging apparatus according to claim 1, wherein,
in a continuous shooting mode, the circuitry is further configured to link the captured image with the hash value for the part of the captured image and the part identification information, and,
in a mode other than the continuous shooting mode, the circuitry is further configured to link the captured image with a hash value for the entire captured image.
14. An information processing method comprising:
linking a captured image with a hash value for a part of the captured image and part identification information for identifying the part, the captured image being a moving image;
generating an electronic signature by using a private key to encrypt the hash value; and
linking the captured image with the electronic signature, wherein
the linking of the captured image includes selecting only frames of the moving image in which movement is higher than movement of a preceding frame of the moving image by a predetermined threshold, and linking, for only the selected frames, the captured image with the hash value for the part of the captured image and the part identification information.
15. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute an information processing method, the method comprising:
linking a captured image with a hash value for a part of the captured image and part identification information for identifying the part, the captured image being a moving image;
generating an electronic signature by using a private key to encrypt the hash value; and
linking the captured image with the electronic signature, wherein
the linking of the captured image includes selecting only frames of the moving image in which movement is higher than movement of a preceding frame of the moving image by a predetermined threshold, and linking, for only the selected frames, the captured image with the hash value for the part of the captured image and the part identification information.
US17/914,103 2020-03-30 2021-03-16 Imaging apparatus, information processing apparatus, information processing method, and program Active 2041-10-28 US12500773B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020-060928 2020-03-30
JP2020060928 2020-03-30
PCT/JP2021/010490 WO2021200092A1 (en) 2020-03-30 2021-03-16 Imaging device, information processing device, information processing method, and program

Publications (2)

Publication Number Publication Date
US20240214209A1 US20240214209A1 (en) 2024-06-27
US12500773B2 true US12500773B2 (en) 2025-12-16

Family

ID=77927624

Family Applications (1)

Application Number Title Priority Date Filing Date
US17/914,103 Active 2041-10-28 US12500773B2 (en) 2020-03-30 2021-03-16 Imaging apparatus, information processing apparatus, information processing method, and program

Country Status (6)

Country Link
US (1) US12500773B2 (en)
EP (1) EP4109437A4 (en)
JP (1) JP7582300B2 (en)
KR (1) KR20220160583A (en)
CN (1) CN115336228A (en)
WO (1) WO2021200092A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7757145B2 (en) * 2021-11-15 2025-10-21 キヤノン株式会社 Imaging device, information processing method, and program
US20240242471A1 (en) * 2023-01-18 2024-07-18 Nec Corporation Of America Authenticating video
JP2024154900A (en) * 2023-04-20 2024-10-31 キヤノン株式会社 Image capture device, image capture device control method and program

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008022372A (en) 2006-07-13 2008-01-31 Canon Inc Falsification detection information generation device, imaging device, falsification detection information generation method, program, and storage medium
US20120237180A1 (en) * 2011-03-18 2012-09-20 Fujitsu Limited Signature device and signature method
US20120288204A1 (en) * 2011-05-12 2012-11-15 Canon Kabushiki Kaisha Image processing apparatus and image processing method
US8392975B1 (en) * 2008-05-29 2013-03-05 Google Inc. Method and system for image-based user authentication
WO2015115074A1 (en) 2014-01-30 2015-08-06 株式会社モフィリア Image capture system and image capture apparatus
WO2017022121A1 (en) 2015-08-06 2017-02-09 三菱電機株式会社 Authentication device, authentication system, and authentication method
US20170206523A1 (en) * 2015-11-06 2017-07-20 Cable Television Laboratories, Inc Systems and methods for digital asset security ecosystems
CN108781270A (en) 2015-12-14 2018-11-09 梦想四有限公司 Digital Forensics Image Verification System
US20190109834A1 (en) * 2017-10-10 2019-04-11 Truepic Inc. Methods for authenticating photographic image data
US20190378142A1 (en) * 2018-06-07 2019-12-12 International Business Machines Corporation Biometric token for blockchain
JP2020022150A (en) 2018-11-14 2020-02-06 株式会社Ａｒｔｒｉｇｇｅｒ Information processing system and information processing method
US20200099926A1 (en) * 2019-11-29 2020-03-26 Intel Corporation Method and system of video coding with intra block copying
US20200193609A1 (en) * 2018-12-18 2020-06-18 Qualcomm Incorporated Motion-assisted image segmentation and object detection
US20200344064A1 (en) * 2017-10-18 2020-10-29 Crosbil Ltd. Method and device for electronic signature
US20200372184A1 (en) * 2017-11-17 2020-11-26 Telefonaktiebolaget Lm Ericsson (Publ) Method and arrangement for detecting digital content tampering

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008022372A (en) 2006-07-13 2008-01-31 Canon Inc Falsification detection information generation device, imaging device, falsification detection information generation method, program, and storage medium
US8392975B1 (en) * 2008-05-29 2013-03-05 Google Inc. Method and system for image-based user authentication
US20120237180A1 (en) * 2011-03-18 2012-09-20 Fujitsu Limited Signature device and signature method
US8971691B2 (en) 2011-03-18 2015-03-03 Fujitsu Limited Signature device and signature method
US20120288204A1 (en) * 2011-05-12 2012-11-15 Canon Kabushiki Kaisha Image processing apparatus and image processing method
WO2015115074A1 (en) 2014-01-30 2015-08-06 株式会社モフィリア Image capture system and image capture apparatus
WO2017022121A1 (en) 2015-08-06 2017-02-09 三菱電機株式会社 Authentication device, authentication system, and authentication method
US20170206523A1 (en) * 2015-11-06 2017-07-20 Cable Television Laboratories, Inc Systems and methods for digital asset security ecosystems
CN108781270A (en) 2015-12-14 2018-11-09 梦想四有限公司 Digital Forensics Image Verification System
US20190109834A1 (en) * 2017-10-10 2019-04-11 Truepic Inc. Methods for authenticating photographic image data
US10375050B2 (en) 2017-10-10 2019-08-06 Truepic Inc. Methods for authenticating photographic image data
US20200344064A1 (en) * 2017-10-18 2020-10-29 Crosbil Ltd. Method and device for electronic signature
US20200372184A1 (en) * 2017-11-17 2020-11-26 Telefonaktiebolaget Lm Ericsson (Publ) Method and arrangement for detecting digital content tampering
US20190378142A1 (en) * 2018-06-07 2019-12-12 International Business Machines Corporation Biometric token for blockchain
JP2020022150A (en) 2018-11-14 2020-02-06 株式会社Ａｒｔｒｉｇｇｅｒ Information processing system and information processing method
US20200193609A1 (en) * 2018-12-18 2020-06-18 Qualcomm Incorporated Motion-assisted image segmentation and object detection
US20200099926A1 (en) * 2019-11-29 2020-03-26 Intel Corporation Method and system of video coding with intra block copying

Also Published As

Publication number Publication date
US20240214209A1 (en) 2024-06-27
EP4109437A4 (en) 2023-07-26
WO2021200092A1 (en) 2021-10-07
EP4109437A1 (en) 2022-12-28
KR20220160583A (en) 2022-12-06
JPWO2021200092A1 (en) 2021-10-07
JP7582300B2 (en) 2024-11-13
CN115336228A (en) 2022-11-11

Similar Documents

Publication Publication Date Title
US12500773B2 (en) Imaging apparatus, information processing apparatus, information processing method, and program
US12177342B2 (en) Cipher key generation apparatus and cipher key generation method
JP6024952B2 (en) Image transmission apparatus, image transmission method, image transmission program, and image recognition authentication system
CN113330499B (en) Sensor device and encryption method
US8938095B2 (en) Verification method, verification device, and computer product
US11302045B2 (en) Image processing apparatus, image providing apparatus,control methods thereof, and medium
KR102629732B1 (en) Apparatus for Privacy Masking based on Contour, Apparatus for Privacy Unmasking based on Contour and Method for Sharing Privacy Masking Area Descriptor
US12087033B2 (en) Information processing system, information processing method, image-capturing apparatus, and information processing apparatus
KR20210119982A (en) Sensor device, encryption method
JP7255841B2 (en) Information processing device, information processing system, control method, and program
KR20200003971A (en) Image Processing Apparatus and Image Verification Apparatus for Protecting Privacy and Preventing Alteration, and Method thereof
JP2013126189A (en) Image processor, alteration prevention method, and alteration detection method
CN113170043B (en) Image capturing element, image capturing device and method
US20240169087A1 (en) Secure search method, system thereof, apparatus thereof, encryption apparatus, searcher terminal, and program
CN113469095A (en) Gait-based person secondary verification method and device
US20250329107A1 (en) Image processing apparatus and method
CN115861888A (en) Legitimacy verification method and legality verification device of camera device
Nixon et al. SPN dash: Fast detection of adversarial attacks on mobile via sensor pattern noise fingerprinting
JP2013197889A (en) Image processing device and image processing method
CN117041641B (en) Remote interrogation screen control analysis method and system based on blockchain
EP4632613A1 (en) Image processing device and method
CN112084881B (en) Cross-domain pedestrian re-identification method and device and storage medium
US20240020787A1 (en) Imaging element, imaging method, imaging device, and image processing system
CN118283298A (en) Video transmission method, processing method, apparatus, device, medium, and program product
WO2026071899A1 (en) Method and system for protecting the authenticity of machine learning model-generated video

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: SONY GROUP CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IMANISHI, MASAYUKI;REEL/FRAME:061225/0753

Effective date: 20220922

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ALLOWED -- NOTICE OF ALLOWANCE NOT YET MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE