WO2025041484A1 - 画像処理装置および方法 - Google Patents

画像処理装置および方法 Download PDF

Info

Publication number
WO2025041484A1
WO2025041484A1 PCT/JP2024/025484 JP2024025484W WO2025041484A1 WO 2025041484 A1 WO2025041484 A1 WO 2025041484A1 JP 2024025484 W JP2024025484 W JP 2024025484W WO 2025041484 A1 WO2025041484 A1 WO 2025041484A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
processing
authenticity
authenticity determination
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2024/025484
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
陽介 平塚
翼 松田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Priority to JP2025541340A priority Critical patent/JPWO2025041484A1/ja
Priority to EP24856178.9A priority patent/EP4769196A1/en
Publication of WO2025041484A1 publication Critical patent/WO2025041484A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60—Protecting data
    • G06F21/64—Protecting data integrity, e.g. using checksums, certificates or signatures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/10—Protecting distributed programs or content, e.g. vending or licensing of copyrighted material ; Digital rights management [DRM]
    • G06F21/16—Program or content traceability, e.g. by watermarking

Definitions

  • the present disclosure relates to an image processing device and method, and in particular to an image processing device and method that can guarantee the authenticity of an image that has been subjected to permissible processing.
  • Patent Document 1 there has been a method that makes it possible to detect tampering by adding a digital signature to an image when it is captured (see, for example, Patent Document 1). There has also been a method that makes it possible to trace a history when an image is generated or edited by leaving a history with a digital signature (see, for example, Non-Patent Document 1). There has also been a method that makes it possible to detect tampering with an image by adding 3D information and a signature to an image, as well as the detection of forgery in which a tampered image is projected onto a panel and then photographed (see, for example, Patent Document 2).
  • authentication of an image means “that the target image is identical to its original image (i.e., that the original image has not been tampered with)” and “that the image is not obtained by illegal imaging (i.e., that so-called trick imaging, etc., has not been performed).”
  • any time it is detected that any processing has been performed on the original image it is determined to be illegal tampering.
  • image editing is a common practice, and not all cases of image manipulation are necessarily illegal. For example, in news reports, it was common for images taken at the scene to be edited without any malicious intent to make them look better.
  • An image processing device is an image processing device that includes a signature verification unit that verifies the signature of an unprocessed image before the image is processed, a processing identification unit that identifies the content of the processing based on the unprocessed image and a processed image obtained by processing the pre-processed image, and an authenticity determination unit that determines whether or not to guarantee the authenticity of the processed image based on the signature verification result and the identified content of the processing.
  • An image processing method includes verifying a signature of an unedited image before the image is edited, identifying the details of the editing based on the unedited image and an edited image in which the preedited image is edited, and determining whether or not to guarantee the authenticity of the edited image based on the signature verification result and the identified details of the editing.
  • the signature of an unedited image before any editing is applied to the image is verified, the details of the editing are identified based on the unedited image and the edited image obtained by editing the pre-edited image, and a determination is made as to whether or not to guarantee the authenticity of the edited image based on the signature verification result and the identified details of the editing.
  • FIG. 1 is a diagram illustrating an example of a main configuration of an authenticity determination system.
  • 1 is a block diagram showing an example of a main configuration of an image processing device
  • FIG. 13 is a diagram showing an example of image transmission.
  • FIG. 13 is a diagram showing an example of an output state of an authenticity determination result.
  • 11 is a flowchart illustrating an example of a flow of processes executed in the authenticity determination system.
  • FIG. 13 is a diagram showing an example of image transmission.
  • 11 is a flowchart illustrating an example of a flow of processes executed in the authenticity determination system.
  • FIG. 13 is a diagram showing an example of image transmission.
  • 11 is a flowchart illustrating an example of a flow of processes executed in the authenticity determination system.
  • FIG. 2 is a block diagram showing an example of the main configuration of an authenticity determination server; 13 is a flowchart illustrating an example of the flow of an authenticity determination process. 13 is a flowchart illustrating an example of the flow of a processing specification process.
  • FIG. 13 is a diagram showing an example of a display image. 13 is a flowchart illustrating an example of the flow of an authenticity determination process. 13 is a flowchart illustrating an example of the flow of a processing specification process.
  • FIG. 13 is a diagram showing an example of a display image. 13 is a flowchart illustrating an example of the flow of an authenticity determination process. 13 is a flowchart illustrating an example of the flow of a processing specification process.
  • FIG. 13 is a diagram showing an example of a display image.
  • FIG. 13 is a flowchart illustrating an example of the flow of an authenticity determination process.
  • 13 is a flowchart illustrating an example of the flow of a processing specification process.
  • FIG. 13 is a diagram showing an example of a display image.
  • 13 is a flowchart illustrating an example of the flow of an authenticity determination process.
  • 13 is a flowchart illustrating an example of the flow of a processing specification process.
  • FIG. 13 is a diagram showing an example of a display image.
  • 13 is a flowchart illustrating an example of the flow of an authenticity determination process.
  • 13 is a flowchart illustrating an example of the flow of a processing specification process.
  • FIG. 13 is a diagram showing an example of a display image.
  • 13 is a flowchart illustrating an example of the flow of an authenticity determination process.
  • FIG. 13 is a flowchart illustrating an example of the flow of a processing specification process.
  • FIG. 13 is a diagram showing an example of a display image.
  • 13 is a flowchart illustrating an example of the flow of an authenticity determination process.
  • 13 is a flowchart illustrating an example of the flow of a processing specification process.
  • FIG. 13 is a diagram showing an example of a display image.
  • 13 is a flowchart illustrating an example of the flow of an authenticity determination process.
  • 13 is a flowchart illustrating an example of the flow of a processing specification process.
  • FIG. 13 is a diagram illustrating an example of a GUI.
  • FIG. 11 is a flowchart illustrating an example of a flow of processing executed in the image processing system.
  • FIG. 13 illustrates an example of a certification Web page.
  • 1 is a block diagram showing an example of a main configuration of an image processing device;
  • FIG. 13 is a diagram illustrating an example of a GUI.
  • 11 is a flowchart illustrating an example of a flow of processing executed in the image processing system.
  • FIG. 13 illustrates an example of a certification Web page.
  • FIG. 2 is a block diagram showing an example of a main configuration of a computer.
  • Patent Document 1 (mentioned above)
  • Patent Document 2 (mentioned above)
  • Non-patent document 1 (mentioned above)
  • Non-Patent Document 1 there was a method that leaves a history with an electronic signature when generating or editing an image, making it possible to trace the history.
  • Patent Document 2 there was a method that adds 3D information and a signature to an image, making it possible to detect tampering with an image and to detect counterfeiting by projecting a tampered image on a panel and shooting it.
  • authentication of an image means “that the target image is identical to its original image (i.e., that the original image has not been tampered with)” and “that the image is not obtained by illegal imaging (i.e., that so-called trick imaging, etc., has not been performed).”
  • any time it is detected that any processing has been performed on the original image it is determined to be illegal tampering.
  • First embodiment ⁇ Identifying the details of editing and judging the authenticity based on the details of editing> Therefore, the content of the processing applied to the before-processing image is identified based on the before-processing image and the after-processing image, and based on the content of the processing, it is determined whether or not the authenticity of the after-processing image is guaranteed. In other words, it is identified whether or not the processing is permissible.
  • authentication means that the subject is legitimate, that is, that the subject is real.
  • authentication of the original image means that the original image is legitimate.
  • authentication of the edited image means that the edited image is the same as the legitimate original image, or that the edited image is an image that has been edited in an acceptable manner with respect to the legitimate original image.
  • processing refers to general processing performed on image data, and includes not only processing that changes the contents of an image (processing that involves a visual change) but also processing that changes data.
  • This "processing that changes the contents of an image” includes so-called image processing such as image trimming and synthesis, image enlargement and reduction, image rotation and deformation, lens aberration correction, color and brightness correction, white balance adjustment, etc., as well as image replacement (changing image data), etc.
  • processing that changes data includes, for example, changing the compression rate, format conversion, and metadata tampering.
  • processing includes all processing that makes it impossible to consider image data after processing to be the same as image data before processing.
  • processing that changes the contents of an image will be used as an example of processing.
  • the present technology can be applied to the case of “processing that changes data” as well as the case of “processing that changes the contents of an image” described below.
  • processing is also referred to as “editing (or image editing)” or “tampering.”
  • An image before processing is also referred to as an “image before processing.”
  • An image after processing is also referred to as an “image after processing.”
  • transmissible processing refers to processing that is not detected as unauthorized tampering in image tampering detection (image authenticity determination).
  • Unpermissible processing refers to processing that is detected as unauthorized tampering in image tampering detection (image authenticity determination).
  • the tampering detection method authentication determination method
  • the authenticity of the edited image is guaranteed if "permissible processing” is applied.
  • "unpermissible processing” is applied to the unedited image, it is determined that the authenticity of the edited image cannot be guaranteed.
  • Perfectible processing and “unpermissible processing” can each be any type of processing.
  • non-malicious editing refers to editing that should not be detected as unauthorized tampering in image tampering detection (image authenticity determination). For example, editing to improve appearance, which does not change the contents of the image (the meaning of the image), may be included in “non-malicious editing". For example, cropping to a specified aspect ratio, color correction, lens aberration correction, etc. may be included in “non-malicious editing”.
  • malicious editing refers to editing that should be detected as unauthorized tampering in image tampering detection (image authenticity determination). For example, editing that changes the contents of the image (the meaning of the image), such as so-called fake images, may be included in “malicious editing”. For example, editing to replace, erase, or add objects or people in an image may be included in “malicious editing”.
  • the criteria for distinguishing between "non-malicious editing” and “malicious editing” may be any criteria.
  • the type of editing, the scale of editing, the target of editing, the number of editings, the impact on the meaning of the image, and the like may determine which one is identified as.
  • cutting and pasting may be determined to be “malicious editing”
  • color correction may be determined to be "non-malicious editing”.
  • Editing that erases a person who appears large in a captured image to express a false event may be determined to be “malicious editing”
  • editing that erases a person who appears small in a captured image to improve the design may be determined to be “non-malicious editing”.
  • the criteria for distinguishing between "non-malicious editing” and “malicious editing” may be determined in advance or may change depending on the situation. For example, even if the editing is the same, editing by the photographer may be determined to be “non-malicious editing", and editing by another user may be determined to be “malicious editing”.
  • the identification result may also change depending on any condition, such as the time or device on which the editing was performed.
  • the criteria may also be subjective and determined by the user or system that determines authenticity.
  • malicious processing is also referred to as “malicious tampering” or “unauthorized tampering,” etc.
  • non-malicious processing is also referred to as “non-malicious tampering,” etc.
  • transmissible processing and unpermissible processing can each be any type of processing, but in the following, as an example, we will explain that "non-malicious processing” is “permissible processing” and “malicious processing” is “unpermissible processing.”
  • Fig. 1 is a diagram showing a main configuration example of an authenticity determination system which is an embodiment of an image processing system to which the present technology is applied.
  • the authenticity determination system 100 shown in Fig. 1 executes processing related to determining the authenticity of an image.
  • the authenticity determination system 100 has an imaging device 101, a file conversion device 102, an image processing device 103, an authenticity determination server 104, a Web server 105, a terminal device 106, and a network 110.
  • Each device from the imaging device 101 to the terminal device 106 is connected to the network 110 so as to be able to communicate with each other.
  • the network 110 is a communication network that serves as a communication medium between the devices.
  • the network 110 may be a wired communication network, a wireless communication network, or may include both.
  • the network 110 may be a wired LAN (Local Area Network), a wireless LAN, a public telephone line network, a wide area communication network for wireless mobile devices such as a so-called 4G line or 5G line, or the Internet, or a combination of these.
  • the network 110 may be a single communication network or multiple communication networks.
  • the network 110 may be partially or entirely composed of a communication cable of a specified standard, such as a USB (Universal Serial Bus) (registered trademark) cable or an HDMI (High-Definition Multimedia Interface) (registered trademark) cable.
  • USB Universal Serial Bus
  • HDMI High-Definition Multimedia Interface
  • each device from the imaging device 101 to the terminal device 106 has a communication function and is connected to be able to communicate with each other via the network 110.
  • each device may have a wired communication function, a wireless communication function, or both.
  • the imaging device 101 performs processing related to capturing an image of a subject, i.e., generating a captured image (image file). For example, the imaging device 101 may capture an image of a subject and generate a captured image. The imaging device 101 may generate an image file that stores the captured image, etc. The imaging device 101 may generate a signature for tamper detection and store it in the image file. The imaging device 101 may supply the image file to another device via the network 110 or a recording medium (not shown).
  • the file conversion device 102 executes processing related to format conversion of an image file. For example, the file conversion device 102 may acquire an image file from another device via the network 110 or a recording medium (not shown). The file conversion device 102 may convert the format of the acquired image file from a first format to a second format different from the first format. The file conversion device 102 may supply the converted image file to the other device via the network 110 or a recording medium (not shown).
  • the image processing device 103 executes processing related to image processing.
  • the image processing device 103 may acquire an image file from another device via the network 110 or a recording medium not shown.
  • the image processing device 103 may perform processing on image data stored in the acquired image file.
  • the image processing device 103 may supply an image file storing an image after processing to another device via the network 110 or a recording medium not shown.
  • the image processing device 103 may also acquire authenticity determination result display information supplied from another device via the network 110 or a recording medium not shown.
  • the authenticity determination result display information is information for displaying the authenticity determination result, and is information for generating a determination result display image that is a display image showing the determination result.
  • the image processing device 103 may acquire authenticity determination result display information supplied from the authenticity determination server 104.
  • the image processing device 103 may access a URL (Uniform Resource Locator) provided by the Web server 105, and obtain a certification Web page published at that URL as authenticity determination result display information.
  • the certification Web page is a Web page that includes authenticity determination result display information.
  • the image processing device 103 may generate a determination result display image based on the authenticity determination result display information obtained from the authenticity determination server 104, and display it on a display device, etc.
  • the image processing device 103 may also generate a determination result display image based on the certification Web page obtained from the Web server 105, and display it on a display device, etc.
  • the authenticity determination server 104 executes processes related to authenticity determination. For example, the authenticity determination server 104 may acquire an image file from another device via the network 110 or a recording medium (not shown). The authenticity determination server 104 may determine the authenticity of an edited image stored in the acquired image file, and generate authenticity determination result display information. The authenticity determination server 104 may supply the authenticity determination result display information to another device via the network 110 or a recording medium (not shown). For example, the authenticity determination server 104 may generate a certification web page as the authenticity determination result display information, and supply it to the web server 105.
  • the Web server 105 executes processing related to a certification Web page, which is an example of authenticity determination result display information.
  • the Web server 105 may obtain a certification Web page provided as authenticity determination result display information from another device (e.g., the authenticity determination server 104) via the network 110 or a recording medium (not shown).
  • the Web server 105 may publish the certification Web page at a specified URL (Uniform Resource Locator) so that it can be referenced from other devices.
  • a specified URL Uniform Resource Locator
  • the terminal device 106 executes processing related to viewing the certification web page. For example, the terminal device 106 may access a URL provided by the web server 105 and obtain the certification web page published at that URL as authenticity determination result display information. The terminal device 106 may generate a determination result display image including the contents of the certification web page and display the determination result display image on a display device. This allows the user of the terminal device 106 to view information related to the authenticity determination result provided as the certification web page.
  • the authenticity determination system 100 is shown as having one of each of the devices from the imaging device 101 to the terminal device 106, but the authenticity determination system 100 may have multiple imaging devices 101. Similarly, the authenticity determination system 100 may have multiple file conversion devices 102. Similarly, the authenticity determination system 100 may have multiple image processing devices 103. Similarly, the authenticity determination system 100 may have multiple authenticity determination servers 104. Similarly, the authenticity determination system 100 may have multiple Web servers 105. Similarly, the authenticity determination system 100 may have multiple terminal devices 106. The number of devices from the imaging device 101 to the terminal device 106 included in the authenticity determination system 100 may be the same as the other devices, or may be different from the number of the other devices.
  • each of the above-mentioned devices from the imaging device 101 to the terminal device 106 may be configured as a single device or may be configured as multiple devices.
  • the authenticity determination server 104 and the Web server 105 may be implemented as cloud computing (i.e., a cloud server) in which multiple devices share and jointly process via a network.
  • the authenticity determination server 104 and the Web server 105 may be configured as terminal devices, and the imaging device 101, the file conversion device 102, the image processing device 103, and the terminal device 106 may be configured as servers.
  • any multiple devices may be configured as one device.
  • the functions of any multiple devices from the imaging device 101 to the terminal device 106 may be implemented in one device. Furthermore, some of the devices from the imaging device 101 to the terminal device 106 described above may be omitted. Furthermore, the authenticity determination system 100 may further include devices other than the above-mentioned imaging device 101 to terminal device 106.
  • FIG. 2 is a block diagram showing an example of the main configuration of the image processing device 103 in Fig. 1. As shown in Fig. 2, the image processing device 103 has an image acquisition unit 131, an image processing unit 132, an authenticity determination request unit 133, and an authenticity determination result display unit 134.
  • the image acquisition unit 131 executes processing related to image acquisition.
  • the image acquisition unit 131 may acquire an image file supplied from another device via the network 110 or a recording medium (not shown).
  • the image acquisition unit 131 may supply the acquired image file to the image processing unit 132.
  • the image processing unit 132 executes processing related to image processing.
  • the image processing unit 132 may acquire an image file supplied from the image acquisition unit 131.
  • the image processing unit 132 may acquire an image file including an unprocessed image to be processed.
  • This unprocessed image may be an original image that is an image in a generated state (unprocessed), or may be an image in which some processing has been performed on the original image.
  • the image processing unit 132 may execute processing on the image file.
  • the image processing unit 132 may process the unprocessed image to generate a processed image.
  • the image processing unit 132 may supply the unprocessed image and the processed image to the authenticity determination request unit 133.
  • the unprocessed image and the processed image may be supplied to the authenticity determination request unit 133 in a state stored in one image file, or may be supplied to the authenticity determination request unit 133 in a state stored in different image files.
  • the authenticity determination request unit 133 executes processing related to a request for authenticity determination of an image.
  • the authenticity determination request unit 133 may acquire an unedited image and an edited image supplied from the image processing unit 132.
  • the unedited image and the edited image may be stored in a single image file, or may be stored in different image files.
  • the authenticity determination request unit 133 may request a determination of the authenticity of the edited image by supplying the acquired unedited image and edited image to the authenticity determination server 104 via the network 110 or a recording medium (not shown).
  • the unedited image and the edited image may be supplied to the authenticity determination server 104 in a state stored in a single image file, or may be supplied to the authenticity determination server 104 in a state stored in different image files.
  • the authenticity determination result display unit 134 executes processing related to displaying the determination result of the authenticity of the image.
  • the authenticity determination result display unit 134 may acquire authenticity determination result display information provided as a response to the above-mentioned request via the network 110 or a recording medium (not shown). That is, the authenticity determination result display unit 134 may acquire authenticity determination result display information indicating the authenticity determination result of the processed image.
  • This authenticity determination result display information may be provided from the authenticity determination server 104 or may be provided from other devices.
  • the authenticity determination result display unit 134 may access a URL provided by the Web server 105 and acquire a certification Web page published at the URL as the authenticity determination result display information.
  • the authenticity determination result display unit 134 generates a determination result display image based on the acquired authenticity determination result display information and displays it on a display device. This allows the user of the image processing device 103 to confirm the requested authenticity determination result. Therefore, the authenticity determination result display unit 134 is also referred to as the display processing unit.
  • FIG. 3 shows an example of image transmission in the process of executing the determination of the authenticity of an image in the above-mentioned authenticity determination system 100.
  • the imaging device 101 generates an image file 141 with a digital signature and supplies it to the file conversion device 102.
  • the image file 141 with a digital signature shown in FIG. 3 is an image file that stores the main image and its digital signature.
  • the image file 141 with a digital signature may store SOI (Start Of Image), APP1, APP11, an original image, and a screen nail.
  • SOI is a start marker that indicates the start point of a JPEG (Joint Photographic Experts Group) file.
  • APP1 and APP11 are application data set by an application.
  • information of Exif Exchangeable Image File Format
  • a signature for detecting tampering Multi hash for each area and Signature
  • the original image is stored as the main image of this image file 141 with a digital signature.
  • a screennail is a reduced image of a main image (original image).
  • the image size of a screennail may be any size as long as it is smaller than the main image, but it is generally set to a size larger than a reduced image called a thumbnail.
  • the file conversion device 102 converts the file format of the digitally signed image file 141 to generate a history-retaining format image file 142.
  • the file conversion device 102 then supplies the generated history-retaining format image file 142 to the image processing device 103.
  • the history-retaining format image file 142 is a file format that can retain the history of processing from the original image.
  • the history-retaining format image file 142 may be a file format that complies with the C2PA standard described in Non-Patent Document 1.
  • a metadata (C2PA meta) area and a vendor extension area (Vender Extension) are formed, and the above-mentioned SOI, APP1, APP11, and screen nail, etc. may be stored in this vendor extension area.
  • the original image is stored as the main image.
  • the image processing device 103 regards the main image of the acquired history-retaining format image file 142 as an unprocessed image, and processes the unprocessed image to generate an processed image.
  • the image processing device 103 requests the authenticity determination server 104 to determine the authenticity of the processed image by supplying the history-retaining format image file 143, which stores the processed image as the main image, to the authenticity determination server 104.
  • the history-retaining format image file 143 has the same file format as the history-retaining format image file 142. In other words, the history-retaining format image file 143 contains the electronic signature of the original image and information regarding the history of processing from the original image to the processed image.
  • the processed image is stored as the main image. Information regarding the processing by the image processing device 103 is also stored in the history-retaining format image file 143.
  • the authenticity determination server 104 acquires the pre-edited image and the post-edited image from the acquired history-retaining format image file 143.
  • the authenticity determination server 104 also determines the authenticity of the pre-edited image based on the electronic signature (information on the history of editing) stored in the history-retaining format image file 143.
  • the authenticity determination server 104 identifies the content of the editing applied to the pre-edited image (i.e., the editing performed when generating the post-edited image from the pre-edited image; the difference between the post-edited image and the pre-edited image).
  • the authenticity determination server 104 determines the authenticity of the post-edited image based on the result of the determination of the authenticity of the pre-edited image and the content of the editing identified.
  • the image processing device 103 may store the unprocessed image and the processed image in different image files and supply them to the authenticity determination server 104.
  • Fig. 4 is a diagram showing an example of the output of authenticity determination result display information.
  • the authenticity determination server 104 may generate authenticity determination result display information and supply the authenticity determination result display information to the image processing device 103 that is the request source in response to the request for authenticity determination.
  • the image processing device 103 acquires the authenticity determination result display information, generates a determination result display image based on the authenticity determination result display information, and displays it.
  • the authenticity determination server 104 may generate a certification web page as authenticity determination result display information and provide the certification web page to the web server 105.
  • the web server 105 publishes the certification web page at a specified URL.
  • step S111 the imaging device 101 captures an image of a subject to generate a captured image (original image) and stores it in an electronically signed image file 141.
  • step S112 the imaging device 101 supplies the electronically signed image file 141 to the file conversion device 102.
  • step S121 the file conversion device 102 acquires the digitally signed image file 141.
  • step S122 the file conversion device 102 converts the file format of the digitally signed image file 141 to generate a history-retaining format image file 142.
  • step S123 the file conversion device 102 supplies the history-retaining format image file 142 to the image processing device 103.
  • step S131 the image processing device 103 acquires the history-retaining format image file 142.
  • step S132 the image processing device 103 processes the main image of the history-retaining format image file 142 as a pre-processing image to generate a processed image.
  • step S133 the image processing device 103 supplies the history-retaining format image file 143, which stores the processed image as a main image, to the authenticity determination server 104, thereby requesting a determination of the authenticity of the processed image.
  • step S141 the authenticity determination server 104 acquires the history-retaining format image file 143 (i.e., a request for authenticity determination).
  • step S142 the authenticity determination server 104 executes an authenticity determination process using the history-retaining format image file 143 and determines the authenticity of the processed image.
  • step S143 the authenticity determination server 104 outputs authenticity determination result display information generated by the authenticity determination process.
  • the authenticity determination server 104 may supply the authenticity determination result display information to the image processing device 103 that made the request as a response to the authenticity determination request.
  • the authenticity determination server 104 may also supply a certification web page to the web server 105 as the authenticity determination result display information.
  • step S134 the image processing device 103 receives the response (i.e., the authenticity determination result display information).
  • step S135 the image processing device 103 generates and displays a determination result display image based on the authenticity determination result display information.
  • step S151 the Web server 105 acquires the certification Web page (i.e., the authenticity determination result display information).
  • step S152 the Web server 105 publishes the certification Web page at a specified URL. In this way, the terminal device 106 can access the URL to acquire the certification Web page, and generate and display a determination result display image based on the acquired certification Web page.
  • Each device in the authenticity determination system 100 may execute the processes described above.
  • FIG. 6 shows another example of the state of image transmission in the process up to the execution of the determination of the authenticity of the image in that case.
  • the imaging device 101 generates a history-retaining format image file 142 and supplies it to the image processing device 103. That is, the image processing device 103 obtains the history-retaining format image file 142 supplied from the imaging device 101.
  • the subsequent process is the same as in the case of FIG. 3.
  • the output of the authenticity determination result display information is also executed in the same manner as in the example of FIG. 4.
  • step S211 the imaging device 101 captures an image of the subject to generate a captured image (original image) and stores it in the history-retaining format image file 142.
  • step S212 the imaging device 101 supplies the history-retaining format image file 142 to the image processing device 103.
  • step S231 the image processing device 103 acquires the history-retaining format image file 142.
  • step S232 the image processing device 103 processes the main image of the history-retaining format image file 142 as a pre-processing image to generate a processed image.
  • step S233 the image processing device 103 supplies the history-retaining format image file 143, which stores the processed image as a main image, to the authenticity determination server 104, thereby requesting a determination of the authenticity of the processed image.
  • step S241 the authenticity determination server 104 acquires the history-retaining format image file 143 (i.e., a request for authenticity determination).
  • step S242 the authenticity determination server 104 executes an authenticity determination process using the history-retaining format image file 143 and determines the authenticity of the processed image.
  • step S243 the authenticity determination server 104 outputs authenticity determination result display information generated by the authenticity determination process.
  • the authenticity determination server 104 may supply the authenticity determination result display information to the image processing device 103 that made the request as a response to the authenticity determination request.
  • the authenticity determination server 104 may also supply a certification web page to the web server 105 as the authenticity determination result display information.
  • step S234 the image processing device 103 receives the response (i.e., the authenticity determination result display information).
  • step S235 the image processing device 103 generates and displays a determination result display image based on the authenticity determination result display information.
  • Each device in the authenticity determination system 100 may execute the processes described above.
  • the image processing device 103 acquires the digitally signed image file 141.
  • the image processing device 103 sets the main image of the acquired digitally signed image file 141 as an unedited image, and processes the unedited image to generate an edited image.
  • the image processing device 103 generates a digitally signed image file 141' that stores the edited image as the main image. In other words, the image processing device 103 stores the edited image in an image file different from the unedited image.
  • the image processing device 103 supplies both the digitally signed image file 141 and the generated digitally signed image file 141' to the authenticity determination server 104, requesting a determination of the authenticity of the edited image.
  • step S311 the imaging device 101 captures an image of the subject to generate a captured image (original image) and stores it in the digitally signed image file 141.
  • step S312 the imaging device 101 supplies the digitally signed image file 141 to the image processing device 103.
  • step S331 the image processing device 103 acquires the digitally signed image file 141.
  • step S332 the image processing device 103 processes the main image of the digitally signed image file 141 as an unprocessed image, generates a processed image, and stores it in the digitally signed image file 141'.
  • step S333 the image processing device 103 supplies the digitally signed image file 141 and the digitally signed image file 141' to the authenticity determination server 104, thereby requesting a determination of the authenticity of the processed image.
  • step S334 the image processing device 103 receives the response (i.e., the authenticity determination result display information).
  • step S335 the image processing device 103 generates and displays a determination result display image based on the authenticity determination result display information.
  • step S351 the Web server 105 acquires the certification Web page (i.e., the authenticity determination result display information).
  • step S352 the Web server 105 publishes the certification Web page at a specified URL. In this way, the terminal device 106 can access the URL to acquire the certification Web page, and generate and display a determination result display image based on the acquired certification Web page.
  • Each device in the authenticity determination system 100 may execute the processes described above.
  • the authenticity determination server 104 identifies the content of the editing applied to the pre-edited image based on the pre-edited image and the post-edited image, and determines whether or not to guarantee the authenticity of the post-edited image based on the content of the editing.
  • the first image processing device includes a signature verification unit that verifies the signature of an unedited image before any editing is applied to the image, an editing specification unit that specifies the details of the editing based on the unedited image and an edited image obtained by editing the pre-edited image, and an authenticity determination unit that determines whether or not to guarantee the authenticity of the edited image based on the signature verification result and the specified details of the editing.
  • an image processing method is applied in which a first image processing device verifies a signature of an unedited image before any editing is applied to the image, identifies the details of the editing based on the unedited image and an edited image obtained by editing the pre-edited image, and determines whether or not to guarantee the authenticity of the edited image based on the signature verification result and the identified details of the editing.
  • the first image processing device can guarantee the authenticity of an image that has been permissibly processed.
  • the image processing device 103 (or the terminal device 106) displays the result of the determination as to whether or not the authenticity of the processed image executed as described above is guaranteed.
  • the second image processing device is provided with a display processing unit that uses authenticity determination result display information indicating the result of the determination as to whether or not the authenticity of the processed image is guaranteed to generate a display image indicating the result of the determination, and displays the display image.
  • an image processing method is applied in which a first image processing device uses authenticity determination result display information that indicates the result of the determination as to whether or not the authenticity of the processed image is guaranteed to be guaranteed to generate a display image that indicates the result of the determination, and displays the display image.
  • the processed image is an image that has been processed on the pre-processing image.
  • the second image processing device can notify that the authenticity of an image that has been permissibly processed has been guaranteed.
  • Fig. 10 is a block diagram showing an example of the main configuration of the authenticity determination server 104 in Fig. 1.
  • the authenticity determination server 104 has an image acquisition unit 211, a signature verification unit 212, a processing specification unit 213, an authenticity determination unit 214, and an authenticity determination result display information output unit 215.
  • the image acquisition unit 211 executes processing related to image acquisition.
  • the image acquisition unit 211 may acquire an image file supplied from another device via the network 110 or a recording medium (not shown).
  • the image acquisition unit 211 may acquire the pre-processed image and the post-processed image stored in that image file. Note that the pre-processed image and the post-processed image may be stored in different image files.
  • the image acquisition unit 211 may supply the acquired pre-processed image and the post-processed image to the signature verification unit 212 together with the image file, etc.
  • the signature verification unit 212 executes a process related to the verification of the electronic signature.
  • the signature verification unit 212 may acquire the unedited image, the edited image, and the image file supplied from the image acquisition unit 211.
  • the signature verification unit 212 may determine the authenticity of the unedited image by verifying the electronic signature stored in the image file. That is, the signature verification unit 212 may verify the signature of the unedited image before the image is edited. For example, if no tampering is detected by the verification of the electronic signature, the signature verification unit 212 may determine that the authenticity of the unedited image is guaranteed. Also, if tampering is detected by the verification of the electronic signature, the signature verification unit 212 may determine that the authenticity of the unedited image is not guaranteed.
  • the signature verification unit 212 may supply the signature verification result (the determination result of the authenticity of the unedited image) to the processing identification unit 213 together with the unedited image, the edited image, the image file, and the like.
  • the processing identification unit 213 executes processing related to identifying the content of the processing applied to the pre-processed image (the difference between the processed image and the pre-processed image). For example, the processing identification unit 213 may acquire the signature verification result (the determination result of the authenticity of the pre-processed image), the pre-processed image, the processed image, and the image file supplied from the signature verification unit 212. The processing identification unit 213 may identify the content of the processing using the pre-processed image and the processed image. In other words, the processing identification unit 213 may identify the content of the processing (what kind of processing was performed) based on the pre-processed image and the processed image obtained by processing the pre-processed image. Any method may be used to identify the processing content.
  • the processing identification unit 213 may acquire the signature verification result (the determination result of the authenticity of the pre-processed image), the pre-processed image, the processed image, and the image file supplied from the signature verification unit 212.
  • the processing identification unit 213 may identify the content of
  • the content to be identified may be anything. For example, it may be the type of processing to be performed, or the value of a parameter applied in the processing. Furthermore, the number of processes to be identified may be any number, and a single processing may be identified, or multiple processing may be identified.
  • the processing identification unit 213 may supply information indicating the content of the processing identified to the authenticity determination unit 214 together with the signature verification result (the determination result of the authenticity of the unprocessed image), the unprocessed image, the processed image, the image file, etc.
  • the authenticity determination unit 214 executes processing related to authenticity determination. For example, the authenticity determination unit 214 may acquire information indicating the content of the processing supplied from the processing identification unit 213, the signature verification result (the determination result of the authenticity of the unprocessed image), the unprocessed image, the processed image, and the image file. The authenticity determination unit 214 may determine whether or not to guarantee the authenticity of the processed image based on the signature verification result (the determination result of the authenticity of the unprocessed image) and the identified content of the processing.
  • the authenticity determination unit 214 may determine that the authenticity of the edited image is guaranteed if the signature verification result guarantees the authenticity of the pre-edited image and the editing of the pre-edited image is identified as permissible. The authenticity determination unit 214 may also determine that the authenticity of the edited image is not guaranteed if the signature verification result does not guarantee the authenticity of the pre-edited image. The authenticity determination unit 214 may also determine that the authenticity of the edited image is not guaranteed if the editing of the pre-edited image is identified as permissible.
  • the "contents of processing” may include parameters (values) applied in the processing.
  • the authenticity determination unit 214 may determine whether or not to guarantee the authenticity of the processed image based on whether or not the values of the parameters applied in the processing are at an acceptable level.
  • the determination result is not limited to the binary value of whether or not the authenticity is guaranteed, but may be multi-valued.
  • the authenticity determination unit 214 may divide the accuracy (certainty) of the authenticity guarantee into three or more levels, and derive the level (also referred to as the authenticity guarantee level) as the determination result. In other words, ambiguity may be added to the guarantee of authenticity.
  • the criteria for this determination may be determined in advance. Furthermore, the criteria for this determination may be able to be set or changed as appropriate. Furthermore, the criteria for this determination may be a common criterion that is not dependent on the image, device, etc. Furthermore, the criteria for this determination may be a criterion that is set in the device that performs the authenticity determination (for example, a criterion that is set by the user of the device). Furthermore, the criteria for this determination may be a criterion that is set in the device that requests the authenticity determination (for example, a criterion that is set by the user of the device).
  • the authenticity determination unit 214 may supply such a determination result to the authenticity determination result display information output unit 215.
  • the authenticity determination result display information output unit 215 executes processing related to the output of authenticity determination result display information. For example, the authenticity determination result display information output unit 215 may acquire the authenticity determination result of the processed image supplied from the authenticity determination unit 214. The authenticity determination result display information output unit 215 may generate authenticity determination result display information indicating the determination result of whether or not to guarantee the authenticity of the processed image based on the determination result. The authenticity determination result display information output unit 215 may supply (output) the generated authenticity determination result display information to another device. For example, the authenticity determination result display information output unit 215 may supply the generated authenticity determination result display information to the image processing device 103, or may supply a certification web page to the web server 105. Note that the authenticity determination result display information may be displayed on the authenticity determination server 104 without being supplied to another device.
  • the authenticity determination result display information may include any information related to the display of the authenticity determination result.
  • the authenticity determination result display information may specify the content to be displayed in the determination result display image.
  • the authenticity determination result display information may specify that the processing content is to be displayed in the determination result display image.
  • information indicating the processing content to be displayed (for example, the type of processing or the parameter values applied) may be specified.
  • the displayed content and design may be different depending on whether authenticity is guaranteed or not.
  • the settings of color, shape, size, thickness, position, emphasis/non-emphasis (prominent/inconspicuous), display/non-display, etc. may be different depending on whether authenticity is guaranteed or not. Furthermore, such settings may be different for each authenticity assurance level.
  • the authenticity determination server 104 can guarantee the authenticity of images that have been permissibly edited. For example, when providing a service that guarantees the authenticity of images, if it is not possible to guarantee the authenticity of images that have been permissibly edited, as with conventional methods, there is a risk that any editing will not be permitted in order to guarantee authenticity, and there is a risk that the practicality and convenience of the service will be reduced. In contrast, by applying the present technology, the authenticity determination server 104 can guarantee the authenticity of images that have been permissibly edited. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a reduction in the practicality and convenience of such services.
  • step S401 the image acquisition unit 211 acquires an image file, and acquires the pre-edited image and post-edited image stored in the image file.
  • step S402 the signature verification unit 212 verifies the signature of the unedited image stored in the image file.
  • step S403 the processing specification unit 213 executes a processing specification process and specifies the processing to be performed on the pre-processing image using the pre-processing image and the post-processing image.
  • step S404 the authenticity determination unit 214 determines the authenticity of the edited image based on the identified editing content.
  • step S405 the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result and outputs it to another device.
  • step S405 When the processing of step S405 is completed, the authenticity determination process ends.
  • step S421 the processing specification unit 213 determines whether or not angle of view processing, which is processing that changes the angle of view, is performed. Note that any method may be used to determine whether or not angle of view processing is performed.
  • step S422 the processing specification unit 213 determines whether or not brightness processing, which is processing that changes the brightness of the image, has been performed. Note that any method may be used to determine whether or not brightness processing has been performed.
  • step S423 the processing specification unit 213 determines whether or not color processing, which is processing that changes the color of the image, has been performed. Note that any method may be used to determine whether or not color processing has been performed.
  • step S424 the processing specification unit 213 determines whether or not an object addition/deletion process has been performed, which is processing that adds an object to an image or deletes an object from an image. Note that any method may be used to determine whether or not an object addition/deletion process has been performed.
  • step S424 When the processing of step S424 is completed, the processing specification process ends and the process returns to FIG. 11.
  • the content of the processing identified in this processing identification process may be any type of processing, and is not limited to the example of FIG. 12.
  • the presence or absence of angle of view processing, brightness processing, color processing, and object addition/deletion processing are detected, but the presence or absence of processing other than these examples may also be detected.
  • the values of parameters applied in the processing may be specified.
  • the authenticity determination server 104 can guarantee the authenticity of an image that has been permissibly edited. For example, when providing a service that guarantees the authenticity of an image, if it is not possible to guarantee the authenticity of an image that has been permissibly edited, as in the conventional method, there is a risk that any editing will not be permitted in order to guarantee authenticity, and there is a risk that the practicality and convenience of the service will be reduced. In contrast, by applying the present technology, the authenticity determination server 104 can guarantee the authenticity of an image that has been permissibly edited. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a reduction in the practicality and convenience of such services.
  • the judgment result display image may include information indicating the judgment result of whether or not the authenticity of the processed image is guaranteed.
  • the authenticity judgment result display information in this case may include information for generating a judgment result display image indicating the judgment result of whether or not the authenticity of the processed image is guaranteed.
  • the authenticity judgment result display unit 134 uses the authenticity judgment result display information indicating the judgment result of whether or not the authenticity of the processed image is guaranteed to generate a display image indicating the judgment result, and displays it on the display device.
  • the image processing device 103 can notify that the authenticity of an image that has been processed in an acceptable manner is guaranteed. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • the judgment result display image 230 includes information indicating the judgment result of whether or not the authenticity of the processed image is guaranteed.
  • whether or not the authenticity of the processed image is guaranteed may be expressed in any way. For example, information about the processing may be displayed only when the authenticity is guaranteed. In other words, only information about the permissible processing may be included in the judgment result display image.
  • the authenticity judgment result display information may include information for generating a judgment result display image that includes only information about the permissible processing.
  • the authenticity judgment result display unit 134 may generate a judgment result display image so as to include only information about the permissible processing. In this way, it is possible to easily identify that the authenticity of the processed image is guaranteed (that the processing is permissible).
  • information about the editing may be displayed only when authenticity is not guaranteed.
  • only information about unacceptable editing may be included in the judgment result display image 230.
  • the authenticity judgment result display information may include information for generating a judgment result display image that includes only information about unacceptable editing.
  • the authenticity judgment result display unit 134 may generate a judgment result display image that includes only information about unacceptable editing. In this way, it is possible to easily identify that the authenticity of the edited image is not guaranteed (that the editing is unacceptable).
  • the judgment result display image 230 may be displayed in a different manner depending on whether the authenticity is guaranteed or not guaranteed. For example, the settings of color, shape, size, thickness, position, emphasis/non-emphasis (prominent/not conspicuous), etc. may be different in each case.
  • the judgment result display image 230 may include "information about permissible processing” and “information about unacceptable processing” that are displayed in different ways.
  • the authenticity judgment result display information may include both "information about permissible processing” and "information about unacceptable processing", and may include information for generating a judgment result display image that displays them in different ways.
  • the judgment result display image 230 may have an area 231 in which the original image is displayed. That is, the judgment result display image may include the unprocessed image.
  • the authenticity judgment result display information may include information for generating a judgment result display image including the unprocessed image.
  • the authenticity judgment result display unit 134 may generate a judgment result display image that further includes the unprocessed image (e.g., area 231).
  • the judgment result display image 230 may have an area 232 in which the processed image is displayed. That is, the processed image may be included in the judgment result display image.
  • the authenticity judgment result display information may include information for generating a judgment result display image including the processed image.
  • the detection processing list 233 may display the type of processing, such as trimming or white balance, and its parameter value, such as 20% or 10%.
  • the detection processing list 233 may also display information about permissible processing, information about unpermissible processing, or both. The information about permissible processing and information about unpermissible processing may be displayed in different designs.
  • the configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as the example ( Figure 10) described in the first embodiment.
  • the authenticity determination unit 214 may also treat such a processing target area as an authenticity determination target area, and determine the authenticity of the authenticity determination target area based on the processing details of the authenticity determination target area. In other words, the authenticity determination unit 214 may determine whether or not to guarantee the authenticity of the processing target area, which is a partial area where processing of the processed image is performed. Note that, if there are multiple authenticity determination target areas (processing target areas), the authenticity determination unit 214 may determine the authenticity of each of those areas. In the case of authenticity determination for such partial areas, the authenticity determination unit 214 may also determine whether or not to guarantee the authenticity, or may determine the authenticity guarantee level.
  • the authenticity determination unit 214 may also perform both an authenticity determination for the entire area of an image, as in the example of the first embodiment, and an authenticity determination for this partial area.
  • step S441 the image acquisition unit 211 acquires an image file, and acquires the pre-edited image and the post-edited image stored in the image file.
  • step S442 the signature verification unit 212 verifies the signature of the pre-edited image stored in the image file.
  • step S443 the processing specification unit 213 executes a processing specification process and specifies the processing of the processing target area using the pre-processing image and the post-processing image.
  • step S444 the authenticity determination unit 214 determines the authenticity of the authenticity determination target area of the processed image based on the identified processing content.
  • step S445 the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result and outputs it to another device.
  • step S445 When the processing of step S445 is completed, the authenticity determination process ends.
  • the processing specification unit 213 executes the processing of each step from step S461 to step S464 in the same manner as the processing of each step from step S421 to step S424 ( Figure 12).
  • step S465 the processing identification unit 213 identifies the processing target area on which processing has been performed.
  • step S465 When the processing of step S465 is completed, the processing specification process ends and the process returns to FIG. 14.
  • the content of the processing identified in this processing identification process may be any type of processing.
  • the values of parameters to be applied in the processing may be identified.
  • the authenticity determination server 104 can guarantee the authenticity of partial areas of an image that have been subjected to acceptable processing. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • the determination result display image may include information indicating the processed image and a processing target area, which is a partial area of the processed image to be processed.
  • the determination result display image may further include information indicating the content of the processing applied to the processing target area of the processed image.
  • the authenticity determination result display information in this case may include information for generating a determination result display image that includes a processed image and information indicating a processing target area, which is a partial area of the processed image to be processed.
  • the authenticity determination result display information may also include information for generating a determination result display image that further includes information indicating the content of the processing applied to the processing target area of the processed image.
  • the authenticity judgment result display unit 134 may generate a display image including a processed image and information indicating a processing target area, which is a partial area of the processed image to be processed.
  • the authenticity judgment result display unit 134 may also generate the display image further including information indicating the content of the processing applied to the processing target area of the processed image.
  • the judgment result display image 240 shown in FIG. 16 shows an example of the judgment result display image in this case.
  • this judgment result display image 240 may be provided with an area 241 showing the processed image and the area to be processed.
  • the area to be processed is shown with a diagonal line pattern.
  • the judgment result display image 240 may be provided with a detection processing list 242 showing the content of the processing applied to the area to be processed of the processed image.
  • the image processing device 103 can notify that the authenticity of a partial area of an image that has been subjected to acceptable processing is guaranteed. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • this detection processing list 242 may also show the type of processing and the parameter values applied in that processing. Furthermore, this detection processing list 242 may display information showing the content of processing for the entire area and information showing the content of processing for the partial area. In other words, the information showing the content of processing may be displayed classified into processing for the entire area and processing for the partial area. The information showing the content of processing for the partial area may be displayed classified for each area to be processed, or classified for each content of processing. Furthermore, the information showing the content of processing for the partial area may be associated with the area to be processed shown in area 241.
  • an image synthesis area which is a partial area where images are synthesized, may be identified based on the unprocessed image and the processed image, and the image synthesis area may be determined to be an area whose authenticity is not guaranteed.
  • the image to be composited with the processing target image is also referred to as the composite target image.
  • the composite target image may be any image.
  • the composite target image may include characters or marks such as so-called logos or subtitles.
  • the composite target image may also include an image different from the processing target image, such as a so-called wipe image.
  • the composite target image may also include a duplicate image of a partial area of the processing target image.
  • the composite target image may also include a cut-out image cut out from a partial area of the processing target image.
  • the process of combining a composite image with a processing target image is also referred to as image composition.
  • the processing target area where the image composition is performed is also referred to as an image composition area.
  • the processing target image after image composition i.e., the processed image obtained by image composition
  • a composite image is also referred to as a composite image.
  • the configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as the example ( Figure 10) described in the first embodiment.
  • the processing specification unit 213 may specify an image synthesis area (position, size, shape, etc.) which is the processing target area where image synthesis is performed.
  • the position, size, and shape of the image synthesis area are each arbitrary.
  • any method may be used to specify the image synthesis area (range).
  • the image synthesis area may be specified using coordinates, or may be specified in predetermined block units.
  • the processing specification unit 213 may specify the image synthesis area using any method.
  • the authenticity determination unit 214 may also determine that such an image synthesis area is an authenticity determination target area, and determine that the authenticity determination target area is an area for which authenticity is not guaranteed. In other words, the authenticity determination unit 214 may determine that the authenticity of the image synthesis area, which is a partial area where image synthesis of the processed image is performed, is not guaranteed. Note that, when there are multiple authenticity determination target areas (image synthesis areas), the authenticity determination unit 214 may determine that the authenticity of each of these areas is not guaranteed.
  • the authenticity determination unit 214 may perform both an authenticity determination for the entire area of the image as in the example of the first embodiment, and an authenticity determination for this image synthesis area.
  • the authenticity determination server 104 can choose not to guarantee the authenticity of the image synthesis area of the image. Therefore, for example, it is possible not to guarantee the authenticity of only the portion where a logo mark or text caption is synthesized. In other words, the authenticity determination server 104 can separately determine the authenticity of other areas. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • step S481 the image acquisition unit 211 acquires an image file, and acquires the pre-edited image and the post-edited image stored in the image file.
  • step S482 the signature verification unit 212 verifies the signature of the pre-edited image stored in the image file.
  • step S483 the processing specification unit 213 executes a processing specification process and specifies the processing of the processing target area using the pre-processing image and the post-processing image.
  • step S484 the authenticity determination unit 214 determines that the image synthesis area of the processed image is an area for which authenticity is not guaranteed.
  • step S485 the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination based on the identified processing content.
  • step S486 the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result and outputs it to another device.
  • step S486 the authenticity determination process ends.
  • the processing specification unit 213 executes the processing of each step from step S501 to step S504 in the same manner as the processing of each step from step S421 to step S424 ( Figure 12).
  • step S505 the processing specification unit 213 determines whether or not images are to be combined. Note that any method may be used to determine whether or not images are to be combined.
  • step S506 the processing identification unit 213 identifies the image synthesis area where image synthesis was performed.
  • step S507 the processing identification unit 213 identifies other processing target areas that have been processed.
  • step S507 When the processing of step S507 is completed, the processing specification process ends and the process returns to FIG. 17.
  • the content of the processing identified in this processing identification process may be any type of processing.
  • the values of parameters to be applied in the processing may be identified.
  • the authenticity determination server 104 can choose not to guarantee the authenticity of the image synthesis area of the image. Therefore, for example, it is possible to choose not to guarantee the authenticity of only the portion where a logo mark or text caption is synthesized. In other words, the authenticity determination server 104 can separately determine the authenticity of other areas. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • the determination result display image may include information indicating the processed image and an image synthesis area, which is a partial area where the processed image is to be image-synthesized.
  • the determination result display image may further include information indicating the content of the image synthesis applied to the image synthesis area of the processed image.
  • the authenticity determination result display information in this case may include information for generating a determination result display image that includes the processed image and information indicating an image synthesis area, which is a partial area where image synthesis of the processed image is performed.
  • the authenticity determination result display information may also include information for generating a determination result display image that further includes information indicating the content of the image synthesis performed in the image synthesis area of the processed image.
  • the authenticity judgment result display unit 134 may generate a display image including the processed image and information indicating an image synthesis area, which is a partial area where image synthesis of the processed image is performed.
  • the authenticity judgment result display unit 134 may also generate a display image including information further indicating the content of the image synthesis performed in the image synthesis area of the processed image.
  • the judgment result display image 250 shown in FIG. 19 shows an example of the judgment result display image in this case.
  • this judgment result display image 250 may be provided with an area 251 showing the processed image and the image synthesis area.
  • the image synthesis area is shown with a diagonal line pattern.
  • the judgment result display image 250 may be provided with a detection processing list 252 showing the content of the image synthesis applied to the image synthesis area of the processed image.
  • the image processing device 103 can notify that the authenticity of the image synthesis area of the image is not guaranteed. Therefore, for example, it is possible to not guarantee the authenticity of only the portion where a logo mark or text caption is synthesized. In other words, the authenticity of other areas can be determined separately. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • this detection processing list 252 may indicate the type of processing (e.g., type of image synthesis) and parameter values applied to that processing (e.g., image synthesis). Furthermore, this detection processing list 252 may display information indicating the content of processing for the entire area and information indicating the content of image synthesis in the image synthesis area. In other words, the information indicating the content of processing may be displayed classified into processing for the entire area and processing for a partial area (e.g., image synthesis area). The information indicating the content of image synthesis for the image synthesis area may be displayed classified for each image synthesis area, or classified for each content of image synthesis. Furthermore, the information indicating the content of image synthesis for the image synthesis area may be associated with the image synthesis area shown in area 251.
  • the information indicating the content of image synthesis for the image synthesis area may be associated with the image synthesis area shown in area 251.
  • a 2D area which is a partial area formed by a plane
  • the 2D area may be determined to be an area for which authenticity is not guaranteed.
  • a 2D area formed by a plane is easier to process than a portion (also called a 3D area) formed by an object having a 3D shape. Therefore, in general, malicious processing (unacceptable processing) is more likely to be applied to a 2D area than to other areas. Therefore, the 2D area may be determined to be an area for which authenticity is not guaranteed.
  • the configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as the example ( Figure 10) described in the first embodiment.
  • the processing specification unit 213 may also specify a 2D area (position, size, shape, etc.) that is a partial area configured on a plane.
  • the position, size, and shape of the 2D area are each arbitrary.
  • any method may be used to specify the 2D area (range).
  • the 2D area may be specified using coordinates, or may be specified in predetermined block units.
  • the processing specification unit 213 may specify the 2D area using any method.
  • the authenticity determination unit 214 may also determine such a 2D region as an authenticity determination target region, and determine that the authenticity determination target region is a region for which authenticity is not guaranteed. In other words, the authenticity determination unit 214 may determine that the authenticity of a 2D region that is a partial region formed by the plane of the processed image is not guaranteed. Note that, when there are multiple authenticity determination target regions (2D regions), the authenticity determination unit 214 may determine that the authenticity of each of those regions is not guaranteed.
  • the authenticity determination server 104 can choose not to guarantee the authenticity of the 2D region of the image. Therefore, for example, it is possible to choose not to guarantee the authenticity of only that 2D region. In other words, the authenticity determination server 104 can separately determine the authenticity of other regions. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • step S521 the image acquisition unit 211 acquires an image file, and acquires the pre-edited image and the post-edited image stored in the image file.
  • step S522 the signature verification unit 212 verifies the signature of the pre-edited image stored in the image file.
  • step S523 the processing specification unit 213 executes a processing specification process and specifies the processing of the processing target area using the pre-processing image and the post-processing image.
  • step S524 the authenticity determination unit 214 determines that the 2D area of the processed image is an area for which authenticity is not guaranteed.
  • step S525 the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination based on the identified processing content.
  • step S526 the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result and outputs it to another device.
  • step S526 When the processing of step S526 is completed, the authenticity determination process ends.
  • the processing specification unit 213 executes the processing of each step from step S541 to step S544 in the same manner as the processing of each step from step S421 to step S424 ( Figure 12).
  • step S545 the processing specification unit 213 specifies the 2D region. Any method may be used to specify this 2D region.
  • step S546 the processing identification unit 213 identifies other processing target areas that have been processed.
  • step S546 When the processing of step S546 is completed, the processing specification process ends and the process returns to FIG. 20.
  • the content of the processing identified in this processing identification process may be any type of processing.
  • the values of parameters to be applied in the processing may be identified.
  • the authenticity determination server 104 can choose not to guarantee the authenticity of the 2D area of the image. In other words, the authenticity determination server 104 can separately determine the authenticity of other areas. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • the judgment result display image may include information indicating the processed image and a 2D region that is a partial region formed on the plane of the processed image.
  • the authenticity judgment result display information in this case may include information for generating a judgment result display image that includes the processed image and information indicating the 2D region that is a partial region formed on the plane of the processed image.
  • the authenticity judgment result display unit 134 may generate a display image including the processed image and information indicating a 2D area that is a partial area formed on a plane of the processed image.
  • the judgment result display image 260 shown in FIG. 22 shows an example of the judgment result display image in this case.
  • the judgment result display image 260 may be provided with an area 261 showing the processed image and the 2D area.
  • the 2D area is shown with a diagonal line pattern.
  • the judgment result display image 260 may be provided with a detection processing list 262 showing the content of the processing performed on the 2D area of the processed image.
  • the image processing device 103 can notify that the authenticity of the 2D area of the image is not guaranteed. In other words, the authenticity of the other areas can be determined separately. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • this detection processing list 262 may also display the type of processing and the parameter values applied in that processing. Furthermore, this detection processing list 262 may display information indicating the content of processing applied to the entire area and information indicating the content of processing in the 2D area. In other words, the information indicating the content of processing may be displayed classified into processing applied to the entire area and processing applied to a partial area. The information indicating the content of image synthesis for the 2D area may be displayed classified for each 2D area, or classified for each content of processing. Furthermore, the information indicating the content of processing applied to the 2D area may be associated with the 2D area displayed in area 261.
  • the content of the processing applied to a partial area of the before-processing image may be specified based on the before-processing image and the after-processing image, and it may be determined whether or not the content of the processing corresponds to the processing history information added to the before-processing image. In other words, it may be determined whether or not the authenticity is guaranteed depending on whether or not the processing actually applied to the processing target area matches the content of the processing history information.
  • this verification of the processing history may be performed for each of the processed image areas.
  • the configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as the example ( Figure 10) described in the first embodiment.
  • the processing specification unit 213 may specify the processing target area (its position, size, shape, etc.).
  • the processing target area may be any area as long as it is a partial area of the entire area of the image, and its position, size, and shape are each arbitrary.
  • any method may be used to specify the processing target area (range).
  • the processing target area may be specified using coordinates, or may be specified in predetermined block units.
  • the processing specification unit 213 may specify the processing content for the processing target area. If there are multiple processing target areas, the processing specification unit 213 may specify the processing content for each processing target area.
  • the authenticity determination unit 214 may also determine the authenticity of such a processing target area as an authenticity determination target area based on the processing content and processing history of the authenticity determination target area. For example, the authenticity determination unit 214 may determine whether to guarantee the authenticity depending on whether the processing content of the authenticity determination target area matches the processing history. In other words, the authenticity determination unit 214 may determine that the authenticity of the processing target area of the processed image is guaranteed when the processing content of the processing target area between the original image and the pre-processing image corresponds to the processing history information added to the pre-processing image. The authenticity determination unit 214 may also determine that the authenticity of the processing target area of the processed image is not guaranteed when the processing content of the processing target area between the original image and the pre-processing image does not correspond to the processing history information.
  • the authenticity determination unit 214 may derive the authenticity assurance level based on the degree of match between the processing content and the processing history.
  • the criteria for authenticity determination are the same as those described in the first embodiment. However, the criteria may be set independently for each area to be subjected to authenticity determination.
  • the authenticity determination result display information may display the authenticity determination result for the authenticity determination target area. If there are multiple authenticity determination target areas (areas to be processed), the authenticity determination result may be displayed for each of those areas.
  • the authenticity determination unit 214 may also perform both an authenticity determination for the entire area of an image, as in the example of the first embodiment, and an authenticity determination for this partial area.
  • the authenticity determination server 104 can guarantee the authenticity of partial areas of an image that have been subjected to acceptable processing.
  • the content of the processing can be confirmed based on the history data. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • step S561 the image acquisition unit 211 acquires an image file, and acquires the pre-edited image and the post-edited image stored in the image file.
  • step S562 the signature verification unit 212 verifies the signature of the pre-edited image stored in the image file.
  • step S563 the processing specification unit 213 executes a processing specification process and specifies the processing of the processing target area using the pre-processing image and the post-processing image.
  • step S564 the authenticity determination unit 214 determines the authenticity of the authenticity determination target area of the processed image based on the identified processing content.
  • step S565 the authenticity determination unit 214 determines the authenticity of the authenticity determination target area of the edited image based on the consistency between the editing history and the editing content.
  • step S566 the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result and outputs it to another device.
  • step S566 When the processing of step S566 is completed, the authenticity determination process ends.
  • the processing specification unit 213 executes the processing of each step from step S581 to step S584 in the same manner as the processing of each step from step S421 to step S424 ( Figure 12).
  • step S585 the processing identification unit 213 identifies the processing target area on which processing has been performed.
  • step S586 the processing identification unit 213 determines whether the identified processing content matches the processing history.
  • step S586 When the processing of step S586 is completed, the processing specification process ends and the process returns to FIG. 23.
  • the content of the processing specified in this processing specification process may be any processing.
  • the values of the parameters to be applied in the processing may be specified.
  • the authenticity determination server 104 can guarantee the authenticity of partial areas of an image that have been subjected to acceptable processing.
  • the content of the processing can be confirmed based on the history data. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • the determination result display image may include information indicating the details of the processing and processing history information added to the processed image as metadata.
  • the information may be information about the processing target area. When there are multiple processing target areas, the information may be information for each processing target area.
  • the authenticity determination result display information in this case may include information for generating a determination result display image that includes information indicating the details of the processing and processing history information added as metadata to the processed image.
  • the authenticity judgment result display unit 134 may generate a display image including information indicating the content of the processing and processing history information added as metadata to the processed image.
  • the judgment result display image 270 may be provided with a detection processing list 273 that shows information indicating the processing content and processing history information added to the processed image as metadata.
  • the judgment result display image 270 may also be provided with an area 271 in which the original image is displayed. That is, the pre-processing image may be included in the judgment result display image.
  • the authenticity judgment result display information may include information for generating a judgment result display image including the pre-processing image.
  • the authenticity judgment result display unit 134 may generate a judgment result display image that further includes the pre-processing image (e.g., area 271).
  • the judgment result display image 270 may also be provided with an area 272 in which the post-processing image is displayed. That is, the post-processing image may be included in the judgment result display image.
  • the authenticity judgment result display information may include information for generating a judgment result display image including the post-processing image.
  • the authenticity determination result display unit 134 may generate a determination result display image that further includes the processed image (e.g., area 272).
  • the image processing device 103 can notify the matching status (whether they match or not, or the degree of matching) between the processing content and the processing history, or the authenticity judgment result according to the matching status. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity judgment in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.
  • this detection processing list 273 may also display the type of processing and the parameter values applied in that processing. Furthermore, this detection processing list 273 may display information indicating the content of processing for the entire area and information indicating the content of processing for partial areas. In other words, the information indicating the content of processing may be displayed classified into processing for the entire area and processing for partial areas. The information indicating the content of processing for partial areas may be displayed classified for each area to be processed, or classified for each content of processing. Furthermore, the information indicating the content of processing for partial areas may be associated with the area to be processed.
  • a face area which is a partial area including a person's face and which is set as the area to be processed, may be detected in the processed image, and it may be determined whether or not the authenticity of the face area is guaranteed depending on whether the processing is a "change due to health condition, etc.”
  • the area of a person's head, including the face, in an image is also referred to as the face area.
  • face areas it is not uncommon for face areas to be modified to improve their appearance. This type of modification generally does not change the general nature of the event depicted in the image (the meaning of the image), so it can also be called “harmless modification.” Therefore, even when such modification is performed, authenticity may be guaranteed. In other words, if the modification to the face area is "changes due to health condition, etc.”, it may be determined that authenticity is guaranteed, and if the modification to the face area is other than that, it may be determined that authenticity is not guaranteed.
  • These "changes due to health conditions, etc.” may include, for example, processing to correct rough skin, processing to correct facial expressions due to lack of sleep, etc., processing to suppress or exaggerate sunburn, etc., and processing to change hair color, shape, hair volume, etc.
  • other processing may include, for example, processing to change the facial contours or bone structure, face replacement (synthesizing the face of another person), etc.
  • the configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as the example ( Figure 10) described in the first embodiment.
  • the processing specification unit 213 may specify a face area (position, size, shape, etc.) to be processed.
  • the position, size, and shape of the face area are each arbitrary. Any method may be used to specify the face area (range).
  • the face area may be specified using coordinates, or may be specified in predetermined block units. Any method may be used to specify the face area.
  • the authenticity determination unit 214 may also determine whether or not to guarantee the authenticity of such a face region as an authenticity determination target region, based on whether the processing of the face region is a "change due to health condition, etc.” For example, the authenticity determination unit 214 may determine that the authenticity of the face region in the processed image is guaranteed if the processing of the face region, which is a partial region including a person's face, is a change due to the person's health condition, etc. The authenticity determination unit 214 may also determine that the authenticity of the face region in the processed image is not guaranteed if the processing of the face region is not a change due to the person's health condition, etc. If there are multiple authenticity determination target regions (face regions), the authenticity determination unit 214 may determine whether or not to guarantee the authenticity of each of those regions.
  • the authenticity determination unit 214 may perform both an authenticity determination for the entire area of the image as in the example of the first embodiment, and an authenticity determination for this face area.
  • the authenticity determination server 104 can determine the authenticity of the face area of the image based on unique criteria that are suitable for that face area. In other words, the authenticity determination server 104 can determine the authenticity of other areas by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria that are more appropriate for the contents of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • step S601 the image acquisition unit 211 acquires an image file, and acquires the pre-edited image and post-edited image stored in the image file.
  • step S602 the signature verification unit 212 verifies the signature of the pre-edited image stored in the image file.
  • the edit identification unit 213 executes an edit identification process, and identifies the edit of the area to be edited using the pre-edited image and the post-edited image.
  • step S604 the authenticity determination unit 214 determines the authenticity of the face area of the processed image based on whether or not there has been a change due to health condition, etc.
  • step S605 the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination based on the identified processing content.
  • step S606 the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result and outputs it to another device.
  • step S606 When the processing of step S606 is completed, the authenticity determination process ends.
  • the processing specification unit 213 executes the processing of each step from step S621 to step S624 in the same manner as the processing of each step from step S421 to step S424 ( Figure 12).
  • step S625 the processing specification unit 213 specifies the area to be processed.
  • step S626 the processing identification unit 213 identifies the face area and determines whether the change is due to a health condition.
  • step S626 When the processing of step S626 is completed, the processing specification process ends and the process returns to FIG. 26.
  • the content of the processing specified in this processing specification process may be any processing.
  • the values of the parameters to be applied in the processing may be specified.
  • the authenticity determination server 104 can determine the authenticity of the face area of the image based on unique criteria that are suitable for that face area. In other words, the authenticity determination server 104 can determine the authenticity of other areas by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria that are more appropriate for the contents of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • the determination result display image may include the processed image and information indicating a face area, which is a partial area including a person's face, included in the processed image.
  • the determination result display image may further include information indicating the content of the processing applied to the face area.
  • the authenticity determination result display information in this case may include information for generating a determination result display image that includes a processed image and information indicating a facial area contained in the processed image.
  • the authenticity determination result display information may also include information for generating a determination result display image that further includes information indicating the type of processing applied to the facial area.
  • the authenticity judgment result display unit 134 may generate a display image including the processed image and information indicating a face area, which is a partial area including the face of a person in the processed image.
  • the authenticity judgment result display unit 134 may also generate a display image including information indicating the content of the processing applied to the face area of the processed image.
  • the judgment result display image 280 shown in FIG. 28 shows an example of the judgment result display image in this case.
  • the judgment result display image 280 may be provided with an area 281 showing the processed image and the face area.
  • the face area is shown with a diagonal line pattern.
  • the judgment result display image 280 may be provided with a detection processing list 282 showing the content of the processing applied to the face area.
  • the image processing device 103 can notify the judgment result of the authenticity of the face area of the image, which is judged based on unique judgment criteria suitable for the face area. In other words, the image processing device 103 can notify the judgment result of the authenticity of other areas, which is judged by applying different judgment criteria. Therefore, the image processing device 103 can notify the judgment result of the authenticity, which is judged by applying judgment criteria that are more appropriate for the contents of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness of the requirements for authenticity judgment in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • this detection processing list 282 may indicate the type of processing and the parameter values applied in that processing. Furthermore, information indicating the content of processing applied to the face area may be displayed categorized for each face area, or may be displayed categorized for each type of processing. Furthermore, information indicating the content of processing applied to the face area may be associated with the face area shown in area 281.
  • socially understandable editing may include, for example, applying makeup to a person's facial area.
  • other editing may include, for example, editing that changes the contours or bone structure of the face, or face replacement (synthesizing the face of another person).
  • face replacement synthetically understandable editing
  • This type of editing generally does not change the general nature of the phenomenon represented by the image (the meaning of the image), so it can also be said to be “non-malicious editing.” Therefore, even when such editing is performed, authenticity may be guaranteed.
  • the configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as the example ( Figure 10) described in the first embodiment.
  • the processing specification unit 213 may specify a face area (position, size, shape, etc.) to be processed.
  • the position, size, and shape of the face area are each arbitrary. Any method may be used to specify the face area (range).
  • the face area may be specified using coordinates, or may be specified in predetermined block units. Any method may be used to specify the face area.
  • the authenticity determination unit 214 may also determine whether or not to guarantee the authenticity of such a face region as an authenticity determination target region, based on whether the processing of the face region is "within a range that is easily socially understandable.” For example, the authenticity determination unit 214 may determine that the authenticity of the face region in the processed image is guaranteed if the processing of the face region, which is a partial region including a person's face, is within a range that is easily socially understandable. The authenticity determination unit 214 may also determine that the authenticity of the face region in the processed image is not guaranteed if the processing of the face region is not within a range that is easily socially understandable. Note that when there are multiple authenticity determination target regions (face regions), the authenticity determination unit 214 may determine whether or not to guarantee the authenticity of each of those regions.
  • the authenticity determination unit 214 may perform both an authenticity determination for the entire area of the image as in the example of the first embodiment, and an authenticity determination for this face area.
  • the authenticity determination server 104 can determine the authenticity of the face area of the image based on unique criteria that are suitable for that face area. In other words, the authenticity determination server 104 can determine the authenticity of other areas by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria that are more appropriate for the contents of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • step S641 the image acquisition unit 211 acquires an image file, and acquires the pre-edited image and post-edited image stored in the image file.
  • step S642 the signature verification unit 212 verifies the signature of the pre-edited image stored in the image file.
  • the edit identification unit 213 executes an edit identification process, and identifies the edit of the area to be edited using the pre-edited image and the post-edited image.
  • step S644 the authenticity determination unit 214 determines the authenticity of the face area of the edited image based on whether the editing is within a range that is socially understandable.
  • step S645 the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination based on the identified processing content.
  • step S646 the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result and outputs it to another device.
  • step S646 When the processing of step S646 is completed, the authenticity determination process ends.
  • the processing specification unit 213 executes the processing of each step from step S661 to step S664 in the same manner as the processing of each step from step S421 to step S424 ( Figure 12).
  • step S665 the processing specification unit 213 specifies the area to be processed.
  • step S666 the processing identification unit 213 identifies the face area and determines whether the processing is within a range that is socially understandable.
  • step S666 When the processing of step S666 is completed, the processing specification process ends and the process returns to FIG. 29.
  • the content of the processing identified in this processing identification process may be any type of processing.
  • the values of parameters to be applied in the processing may be identified.
  • the authenticity determination server 104 can determine the authenticity of the face area of the image based on unique criteria that are suitable for that face area. In other words, the authenticity determination server 104 can determine the authenticity of other areas by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria that are more appropriate for the contents of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • the determination result display image may include the processed image and information indicating a face area, which is a partial area including a person's face, included in the processed image.
  • the determination result display image may further include information indicating the content of the processing applied to the face area.
  • the authenticity determination result display information in this case may include information for generating a determination result display image that includes a processed image and information indicating a facial area contained in the processed image.
  • the authenticity determination result display information may also include information for generating a determination result display image that further includes information indicating the type of processing applied to the facial area.
  • the authenticity judgment result display unit 134 may generate a display image including the processed image and information indicating a face area, which is a partial area including the face of a person in the processed image.
  • the authenticity judgment result display unit 134 may also generate a display image including information indicating the content of the processing applied to the face area of the processed image.
  • the judgment result display image 290 shown in FIG. 31 shows an example of the judgment result display image in this case.
  • the judgment result display image 290 may be provided with an area 291 showing the processed image and the face area.
  • the face area is shown with a diagonal line pattern.
  • the judgment result display image 290 may be provided with a detection processing list 292 showing the content of the processing applied to the face area.
  • the image processing device 103 can notify the judgment result of the authenticity of the face area of the image, which is judged based on unique judgment criteria suitable for the face area. In other words, the image processing device 103 can notify the judgment result of the authenticity of other areas, which is judged by applying different judgment criteria. Therefore, the image processing device 103 can notify the judgment result of the authenticity, which is judged by applying judgment criteria that are more appropriate for the contents of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness of the requirements for authenticity judgment in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • this detection processing list 292 may indicate the type of processing and the parameter values applied in that processing. Furthermore, information indicating the content of processing applied to the face area may be displayed categorized for each face area, or may be displayed categorized for each type of processing. Furthermore, information indicating the content of processing applied to the face area may be associated with the face area shown in area 291.
  • an object identification information area which is a partial area containing object identification information and which is set as the area to be processed in the processed image, may be detected, and for that object identification information area, it may be determined whether or not to guarantee the authenticity depending on whether the processing is "processing that does not involve a change in the object identification information" or not.
  • identification information for identifying an object is also referred to as object identification information.
  • the object identification information may include a vehicle license plate.
  • an area in a target image that includes the object identification information is also referred to as an object identification information area.
  • processing involving a change in object identification information refers to processing that changes the vehicle number, etc., printed on the "vehicle license plate.” Because object identification information is meaningful information, changing this information can be said to change the events depicted in the image. In other words, “processing involving a change in object identification information” can also be called “malicious processing.” In contrast, in the case of “processing not involving a change in object identification information,” the object identification information does not change, so it can be said that the events depicted in the image do not change significantly. In other words, “processing not involving a change in object identification information” can also be called “non-malicious processing.” Therefore, even when such "processing not involving a change in object identification information" is performed, authenticity may be guaranteed.
  • processing that does not change the object identification information may include image processing such as changing color or brightness, adjusting sharpness or white balance, etc.
  • the configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as the example ( Figure 10) described in the first embodiment.
  • the processing specification unit 213 may specify the object identification information area (its position, size, shape, etc.) to be the area to be processed.
  • the position, size, and shape of the object identification information area are each arbitrary.
  • any method may be used to specify the object identification information area (its range).
  • the object identification information area may be specified using coordinates, or may be specified in predetermined block units.
  • the processing specification unit 213 may specify the object identification information area using any method.
  • the authenticity determination unit 214 may also determine whether or not to guarantee authenticity by treating such an object identification information region as an authenticity determination target region and based on whether the processing of the object identification information region is "processing that does not involve a change in the object identification information.” For example, the authenticity determination unit 214 may determine that the authenticity of the object identification information region of the processed image is guaranteed when processing of an object identification information region that is a partial region containing object identification information is processing that does not involve a change in the object identification information. The authenticity determination unit 214 may also determine that the authenticity of the object identification information region of the processed image is not guaranteed when processing of the object identification information region is processing that involves a change in the object identification information.
  • the authenticity determination unit 214 may perform both an authenticity determination for the entire area of the image as in the example of the first embodiment, and an authenticity determination for this object identification information area.
  • the authenticity determination server 104 can determine the authenticity of the object identification information region of the image based on unique criteria that are suitable for that object identification information region. In other words, the authenticity determination server 104 can determine the authenticity of other regions by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria that are more appropriate for the content of the region to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • step S681 the image acquisition unit 211 acquires an image file, and acquires the pre-edited image and post-edited image stored in the image file.
  • step S682 the signature verification unit 212 verifies the signature of the pre-edited image stored in the image file.
  • the edit identification unit 213 executes an edit identification process, and identifies the edit of the area to be edited using the pre-edited image and the post-edited image.
  • step S684 the authenticity determination unit 214 determines the authenticity of the object identification information area of the processed image based on whether the processing does not involve a change in the object identification information.
  • step S685 the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination based on the identified processing content.
  • step S686 the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result and outputs it to another device.
  • step S686 When the processing of step S686 is completed, the authenticity determination process ends.
  • the processing specification unit 213 executes the processing of each step from step S701 to step S704 in the same manner as the processing of each step from step S421 to step S424 ( Figure 12).
  • step S705 the processing specification unit 213 specifies the area to be processed.
  • step S706 the processing specification unit 213 specifies the object identification information area and determines whether the processing does not involve a change in the object identification information.
  • step S706 When the processing of step S706 is completed, the processing specification process ends and the process returns to FIG. 32.
  • the content of the processing specified in this processing specification process may be any processing.
  • the values of the parameters to be applied in the processing may be specified.
  • the authenticity determination server 104 can determine the authenticity of the object identification information area of the image based on unique criteria that are suitable for that object identification information area. In other words, the authenticity determination server 104 can determine the authenticity of other areas by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying more appropriate criteria for the contents of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • the determination result display image may include the processed image and information indicating an object identification information region that is a partial region including object identification information contained in the processed image.
  • the determination result display image may further include information indicating the content of the processing applied to the object identification information region.
  • the authenticity determination result display information in this case may include information for generating a determination result display image that includes a processed image and information indicating an object identification information area contained in the processed image.
  • the authenticity determination result display information may also include information for generating a determination result display image that further includes information indicating the content of the processing applied to the object identification information area.
  • the authenticity judgment result display unit 134 may generate a display image including the processed image and information indicating an object identification information area, which is a partial area including object identification information of the processed image.
  • the authenticity judgment result display unit 134 may also generate a display image including information indicating the content of the processing applied to the object identification information area of the processed image.
  • the judgment result display image 310 shown in FIG. 34 shows an example of the judgment result display image in this case.
  • the judgment result display image 310 may be provided with an area 311 showing the processed image and the object identification information area.
  • the object identification information area is shown with a diagonal line pattern.
  • the judgment result display image 310 may be provided with a detection processing list 312 showing the content of the processing applied to the object identification information area.
  • the image processing device 103 can notify the judgment result of the authenticity of the object identification information area of the image, which is judged based on unique judgment criteria suitable for the object identification information area.
  • the image processing device 103 can notify the judgment result of the authenticity, which is judged by applying judgment criteria different from those for the other areas. Therefore, the image processing device 103 can notify the judgment result of the authenticity, which is judged by applying judgment criteria that are more appropriate for the contents of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness of the requirements for authenticity judgment in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • this detection processing list 312 may indicate the type of processing and the parameter values applied in that processing. Furthermore, information indicating the content of processing applied to the object identification information area may be displayed categorized for each object identification information area, or may be displayed categorized for each type of processing. Furthermore, information indicating the content of processing applied to the object identification information area may be associated with the object identification information area shown in area 311.
  • a personal identification information area which is a partial area containing personal identification information and which is set as a processing target area in the processed image, may be detected, and for that personal identification information area, it may be determined whether or not to guarantee the authenticity depending on whether the processing is "processing that does not involve a change in the personal identification information" or not.
  • identification information for identifying a person is also referred to as personal identification information.
  • personal identification information may include the person's identification card.
  • an area in the target image that includes the personal identification information is also referred to as a personal identification information area.
  • processing involving a change in personal identification information refers to processing that changes an individual's name or identification number, etc., written on the "ID card.” Because personal identification information is meaningful information, changing this information can be said to change the events depicted in the image. In other words, “processing involving a change in personal identification information” can also be called “malicious processing.” In contrast, in the case of “processing not involving a change in personal identification information,” the personal identification information does not change, so it can be said that the events depicted in the image do not change significantly. In other words, “processing not involving a change in personal identification information” can also be called “non-malicious processing.” Therefore, even when such "processing not involving a change in personal identification information" is performed, authenticity may be guaranteed.
  • processing that does not change personal identification information may include image processing such as changing color or brightness, adjusting sharpness or white balance, etc.
  • the configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as the example ( Figure 10) described in the first embodiment.
  • the processing specification unit 213 may specify a personal identification information area (its position, size, shape, etc.) to be the area to be processed.
  • the position, size, and shape of the personal identification information area are each arbitrary.
  • any method may be used to specify the personal identification information area (its range).
  • the personal identification information area may be specified using coordinates, or may be specified in predetermined block units.
  • the processing specification unit 213 may specify the personal identification information area using any method.
  • the authenticity determination unit 214 may also determine whether or not to guarantee authenticity by treating such a personal identification information region as an authenticity determination target region and based on whether the processing of the personal identification information region is "processing that does not involve a change in the personal identification information.” For example, the authenticity determination unit 214 may determine that the authenticity of the personal identification information region of the processed image is guaranteed when processing of the personal identification information region, which is a partial region that includes personal identification information, is processing that does not involve a change in the personal identification information. The authenticity determination unit 214 may also determine that the authenticity of the personal identification information region of the processed image is not guaranteed when processing of the personal identification information region is processing that involves a change in the personal identification information.
  • the authenticity determination unit 214 may perform both an authenticity determination for the entire area of the image as in the example of the first embodiment, and an authenticity determination for this personal identification information area.
  • the authenticity determination server 104 can determine the authenticity of the personal identification information area of the image based on unique criteria that are suitable for that personal identification information area. In other words, the authenticity determination server 104 can determine the authenticity of other areas by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria that are more appropriate for the content of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • step S721 the image acquisition unit 211 acquires an image file, and acquires the pre-edited image and post-edited image stored in the image file.
  • step S722 the signature verification unit 212 verifies the signature of the pre-edited image stored in the image file.
  • the edit identification unit 213 executes an edit identification process, and identifies the edit of the area to be edited using the pre-edited image and the post-edited image.
  • step S724 the authenticity determination unit 214 determines the authenticity of the person identification information area of the processed image based on whether the processing does not involve a change in the person identification information.
  • step S725 the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination based on the identified processing content.
  • step S726 the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result and outputs it to another device.
  • step S726 When the processing of step S726 is completed, the authenticity determination process ends.
  • the processing specification unit 213 executes the processing of each step from step S741 to step S744 in the same manner as the processing of each step from step S421 to step S424 ( Figure 12).
  • step S745 the processing specification unit 213 specifies the area to be processed.
  • step S746 the processing specification unit 213 specifies the personal identification information area and determines whether the processing does not involve a change in the personal identification information.
  • step S746 When the processing of step S746 is completed, the processing specification process ends and the process returns to FIG. 35.
  • the content of the processing specified in this processing specification process may be any processing.
  • the values of the parameters to be applied in the processing may be specified.
  • the authenticity determination server 104 can determine the authenticity of the personal identification information area of the image based on unique criteria that are suitable for that personal identification information area. In other words, the authenticity determination server 104 can determine the authenticity of other areas by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria that are more appropriate for the content of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • the determination result display image may include the processed image and information indicating a personal identification information area that is a partial area including personal identification information included in the processed image.
  • the determination result display image may further include information indicating the content of the processing applied to the personal identification information area.
  • the authenticity determination result display information in this case may include information for generating a determination result display image that includes an edited image and information indicating a personal identification information area included in the edited image.
  • the authenticity determination result display information may also include information for generating a determination result display image that further includes information indicating the content of the editing applied to the personal identification information area.
  • the judgment result display image 320 shown in FIG. 37 shows an example of the judgment result display image in this case.
  • the judgment result display image 320 may be provided with an area 321 showing the processed image and the person identification information area.
  • the person identification information area is shown with a diagonal line pattern.
  • the judgment result display image 320 may be provided with a detection processing list 322 showing the content of the processing applied to the person identification information area.
  • the image processing device 103 can notify the judgment result of the authenticity of the personal identification information area of the image, which is judged based on unique judgment criteria suitable for the personal identification information area.
  • the image processing device 103 can notify the judgment result of the authenticity, which is judged by applying judgment criteria different from those for the other areas. Therefore, the image processing device 103 can notify the judgment result of the authenticity, which is judged by applying judgment criteria that are more appropriate for the contents of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness of the requirements for authenticity judgment in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.
  • this detection processing list 322 may indicate the type of processing and the parameter values applied in that processing. Furthermore, information indicating the content of processing applied to the personal identification information area may be displayed categorized for each personal identification information area, or may be displayed categorized for each type of processing. Furthermore, information indicating the content of processing applied to the personal identification information area may be associated with the personal identification information area shown in area 321.
  • Tenth embodiment> ⁇ Request to generate a verification web page>
  • the authenticity determination result display information may be made public as a certification Web page.
  • the original image may be concealed in the certification Web page.
  • This certification web page is published by the web server 105 at a specified URL.
  • the image processing device 103 may instruct the generation of this URL.
  • the image processing device 103 has a configuration as shown in FIG. 38. That is, the image processing device 103 has a certification web page processing unit 331 in addition to the configuration described with reference to FIG. 2.
  • the proof web page processing unit 331 executes processing related to a request to generate a proof web page. For example, the proof web page processing unit 331 requests the authenticity determination server 104 to generate a proof web page. The proof web page processing unit 331 makes this request based on, for example, a user instruction. For example, the proof web page processing unit 331 may display a GUI screen 340 as shown in FIG. 39 on a display device, and accept an instruction to generate a URL from the user on this GUI screen 340.
  • GUI screen 340 is provided with GUI button 343 for accepting user instructions.
  • this GUI button 343 is labeled "Button for generating URL for public display of determination result," indicating that it is a GUI button for accepting an instruction to generate a URL for publishing a certification web page.
  • certification web page processing unit 331 accepts the user instruction. Based on the instruction, certification web page processing unit 331 requests authenticity determination server 104 to generate a URL for publishing a certification web page.
  • this GUI screen 340 has a URL display field 344, which displays the "public display URL of the determination result" generated based on the above-mentioned request. This display allows the user to understand the URL at which the certification web page will be made public.
  • the GUI screen 340 may also be provided with an area 342 in which the edited image to be judged for authenticity is displayed, and an area 341 in which the unedited image corresponding to the edited image is displayed.
  • step S761 the image processing device 103 (proof Web page processing unit 331) displays the GUI screen 340 in FIG. 39 and accepts an instruction to generate a URL.
  • the image processing device 103 (proof Web page processing unit 331) requests the authenticity determination server 104 to generate the URL.
  • the authenticity determination server 104 (authenticity determination result display information output unit 215) receives the request in step S771, it requests the web server 105 to generate the URL in step S772.
  • the Web server 105 When the Web server 105 receives the request in step S781, it generates a URL for publishing the certification Web page in step S782. In step S783, the Web server 105 provides the generated URL to the authenticity determination server 104.
  • step S763 When the image processing device 103 (certification web page processing unit 331) acquires the URL in step S763, it displays the URL in the URL display field 344 of the GUI screen 340 in step S764.
  • the authenticity determination server 104 (authenticity determination result display information output unit 215) generates, in step S775, a certification Web page to be made public at a predetermined URL (the URL generated in the processing of step S782) as authenticity determination result display information showing the determination result.
  • the authenticity determination server 104 (authenticity determination result display information output unit 215) supplies (outputs) the generated certification Web page to the Web server 105.
  • the Web server 105 acquires the certification Web page in step S784.
  • the Web server 105 publishes the acquired Web page at a specified URL (the URL generated in the processing of step S782) in step S785.
  • the certification web page (i.e., authenticity determination result display information) can be acquired from any terminal device, such as the image processing device 103 or the terminal device 106. That is, the authenticity determination result can be viewed on any device.
  • the authenticity determination result display information is a certification web page that shows the determination result.
  • the authenticity determination result display unit 134 uses the acquired certification web page to generate and display a determination result display image. This makes it possible to improve the practicality and convenience of the service that guarantees the authenticity of images.
  • FIG. 41 is a diagram showing an example of the display of a certification web page.
  • the certification web page may be displayed in a configuration like display screen 351 shown in FIG. 41A.
  • the URL, the unprocessed image (original image), the processed image, the analysis results, a list of detection results, etc. are displayed.
  • the certification web page may also be displayed in a configuration like display screen 352 shown in FIG. 41B.
  • the unprocessed image (original image) may be concealed.
  • the authenticity determination server 104 authentication determination result display information output unit 215) may generate a certification web page that does not include the original image.
  • the authenticity of the processed image may be guaranteed by a party other than (the user or administrator of) the authenticity determination server 104.
  • a party in a position of sufficient credibility such as a news organization or an image distribution responsible organization, may guarantee the authenticity of the processed image.
  • an image distribution responsible organization when it manages (captured images to be used in news reports, etc.), it may process the captured images and use the authenticity determination service provided by the authenticity determination system 100 (authenticity determination server 104) to ensure the authenticity of the processed captured images.
  • the image distribution responsible organization that processed the captured image can naturally guarantee the authenticity of the processed image.
  • the reliability of a guarantee by the party who processed the captured image is not high.
  • the guarantee is made by a sufficiently trustworthy party, such as the image distribution responsible organization mentioned above, a certain degree of reliability can be obtained.
  • the user receiving the captured image can have a certain degree of reliability that the captured image is a legitimate image.
  • the image distribution responsible organization guarantees the authenticity of the second processing target area
  • the authenticity of the captured image as a whole is guaranteed jointly by the authenticity determination system 100 (authenticity determination server 104) and the image distribution responsible organization.
  • authenticity can be guaranteed with a sufficiently high degree of reliability.
  • the image processing device 103 (or its user, etc.) guarantees authenticity in this way, the image processing device 103 has a configuration such as that shown in FIG. 42, for example. That is, in this case, the image processing device 103 has an authenticity determination unit 361 in addition to the configuration described with reference to FIG. 2.
  • the authenticity determination unit 361 executes processing related to determining the authenticity of the processed image. For example, the authenticity determination unit 361 may notify the authenticity determination server 104 that the authenticity of the processed image is guaranteed. For example, the authenticity determination unit 361 may perform this notification based on a user instruction. For example, the authenticity determination unit 361 may display a GUI screen 370 as shown in FIG. 43 on a display device, and accept an instruction to guarantee authenticity from the user on this GUI screen 370.
  • the GUI screen 370 is provided with a GUI button 373 for accepting user instructions.
  • this GUI button 373 is labeled "Authenticity Guarantee Button,” indicating that it is a GUI button for accepting an instruction to guarantee authenticity.
  • the authenticity determination unit 361 accepts the user instruction. Based on that instruction, the authenticity determination unit 361 notifies the authenticity determination server 104 that it will guarantee the authenticity of the processed image.
  • the GUI screen 370 may also be provided with an area 372 in which the edited image to be judged for authenticity is displayed, and an area 371 in which the unedited image corresponding to the edited image is displayed.
  • step S811 the image processing device 103 (authenticity determination unit 361) displays the GUI screen 370 in FIG. 43 and accepts an instruction to guarantee authenticity. Upon accepting the instruction to guarantee authenticity, the image processing device 103 (authenticity determination unit 361) notifies the authenticity determination server 104 of the receipt in step S812.
  • the authenticity determination server 104 (authenticity determination result display information output unit 215) receives the notification in step S821, in step S822 it generates a certification Web page to be published at a specified URL as authenticity determination result display information.
  • This certification Web page stores information about the image processing device 103 (or its user) as the guarantor of the authenticity of the processed image.
  • the authenticity determination server 104 (authenticity determination result display information output unit 215) supplies (outputs) the generated certification Web page to the Web server 105.
  • the authenticity determination server 104 (authenticity determination result display information output unit 215) generates and outputs authenticity determination result display information including information about the external authenticity guarantor. Also, the authenticity determination server 104 (authenticity determination result display information output unit 215) generates and outputs authenticity determination result display information including information about the external authenticity guarantor based on a request from the external authenticity guarantor.
  • the Web server 105 acquires the certification Web page in step S831.
  • the Web server 105 publishes the acquired Web page at a predetermined URL (the URL generated in the processing of step S782) in step S832.
  • the authenticity determination result display unit 134 generates and displays a determination result display image including information indicating the guarantor who guarantees the authenticity of the processed image.
  • the authenticity determination result can be viewed on any device. This makes it possible to improve the practicality and convenience of the service that guarantees the authenticity of images.
  • FIG. 45 is a diagram showing an example of the display of a certification web page.
  • the certification web page may be displayed in a configuration like the display screen 380 shown in FIG. 45.
  • the URL, the unedited image (original image), the edited image, the analysis results, a list of detection results, etc. are displayed.
  • this display screen 380 displays information about the guarantor who guarantees the authenticity of the edited image.
  • multiple guarantors are shown, such as "Guarantor A" and "Guarantor B.”
  • authenticity can be guaranteed not only by the owner of the authenticity determination system 100 (authenticity determination server 104) (such as the provider of the authenticity determination service), but also by others.
  • the authenticity of the processed image may be guaranteed by (the user of) the image processing device 103.
  • the user of the image processing device 103 may be, for example, the image distribution responsible organization that distributes the processed image.
  • guarantees can be made by multiple guarantors as shown in FIG. 45. Therefore, for example, guarantees can be made under the joint responsibility of the owner of the authenticity determination system 100 (authenticity determination server 104) (the provider of the authenticity determination service, etc.) and the image distribution responsible organization.
  • the above-mentioned series of processes can be executed by hardware or software.
  • the programs constituting the software are installed in a computer.
  • the computer includes a computer built into dedicated hardware, and a general-purpose personal computer, etc., capable of executing various functions by installing various programs.
  • FIG. 46 is a block diagram showing an example of the hardware configuration of a computer that executes the above-mentioned series of processes using a program.
  • a CPU Central Processing Unit
  • ROM Read Only Memory
  • RAM Random Access Memory
  • An input/output interface 910 Also connected to the bus 904 is an input/output interface 910.
  • An input unit 911, an output unit 912, a memory unit 913, a communication unit 914, and a drive 915 are connected to the input/output interface 910.
  • the input unit 911 includes, for example, a keyboard, a mouse, a microphone, a touch panel, an input terminal, etc.
  • the output unit 912 includes, for example, a display, a speaker, an output terminal, etc.
  • the storage unit 913 includes, for example, a hard disk, a RAM disk, a non-volatile memory, etc.
  • the communication unit 914 includes, for example, a network interface.
  • the drive 915 drives removable media 921 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
  • the CPU 901 loads a program stored in the storage unit 913, for example, into the RAM 903 via the input/output interface 910 and the bus 904, and executes the program, thereby carrying out the above-mentioned series of processes.
  • the RAM 903 also stores data necessary for the CPU 901 to execute various processes, as appropriate.
  • the program executed by the computer can be applied by recording it on removable media 921 such as package media, for example.
  • the program can be installed in the storage unit 913 via the input/output interface 910 by inserting the removable media 921 into the drive 915.
  • the program can also be provided via a wired or wireless transmission medium, such as a local area network, the Internet, or digital satellite broadcasting. In that case, the program can be received by the communication unit 914 and installed in the storage unit 913.
  • a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
  • the program can be received by the communication unit 914 and installed in the storage unit 913.
  • this program can also be pre-installed in the ROM 902 or memory unit 913.
  • This technology can be applied to any encoding/decoding method.
  • this technology can be applied to any configuration.
  • this technology can be applied to various electronic devices.
  • the present technology can be implemented as part of an apparatus, such as a processor (e.g., a video processor) as a system LSI (Large Scale Integration), a module using multiple processors (e.g., a video module), a unit using multiple modules (e.g., a video unit), or a set in which other functions are added to a unit (e.g., a video set).
  • a processor e.g., a video processor
  • system LSI Large Scale Integration
  • modules using multiple processors e.g., a video module
  • a unit using multiple modules e.g., a video unit
  • a set in which other functions are added to a unit e.g., a video set.
  • the present technology can also be applied to a network system consisting of multiple devices.
  • the present technology may be implemented as cloud computing in which multiple devices share and collaborate on processing via a network.
  • the present technology may be implemented in a cloud service that provides image (video) related services to any terminal, such as a computer, AV (Audio Visual) equipment, portable information processing terminal, or IoT (Internet of Things) device.
  • a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.
  • Systems, devices, processing units, etc. to which the present technology is applied can be used in any field, for example, transportation, medical care, crime prevention, agriculture, livestock farming, mining, beauty, factories, home appliances, weather, nature monitoring, etc.
  • the applications thereof are also arbitrary.
  • this technology can be applied to systems and devices used to provide ornamental content, etc.
  • this technology can be applied to systems and devices used for transportation purposes, such as monitoring traffic conditions and automatic driving control.
  • this technology can be applied to systems and devices used for security purposes.
  • this technology can be applied to systems and devices used for automatic control of machines, etc.
  • this technology can be applied to systems and devices used for agriculture and livestock farming.
  • this technology can be applied to systems and devices that monitor natural conditions such as volcanoes, forests, and oceans, and wildlife, etc.
  • this technology can be applied to systems and devices used for sports.
  • a "flag” refers to information for identifying multiple states, and includes not only information used to identify two states, true (1) or false (0), but also information capable of identifying three or more states.
  • the value that this "flag” can take may be, for example, two values, 1/0, or three or more values. That is, the number of bits constituting this "flag” is arbitrary, and may be one bit or multiple bits.
  • identification information including flags
  • identification information includes flags
  • “flag” and “identification information” include not only the information itself, but also difference information with respect to the reference information.
  • association means, for example, making one piece of data available (linked) when processing the other piece of data.
  • data associated with each other may be combined into one piece of data, or each piece of data may be individual data.
  • information associated with encoded data (image) may be transmitted on a transmission path different from that of the encoded data (image).
  • information associated with encoded data (image) may be recorded on a recording medium different from that of the encoded data (image) (or on a different recording area of the same recording medium).
  • this "association" may be a part of the data, not the entire data.
  • an image and information corresponding to that image may be associated with each other in any unit, such as multiple frames, one frame, or a part of a frame.
  • the configuration described above as one device (or processing unit) may be divided and configured as multiple devices (or processing units).
  • the configurations described above as multiple devices (or processing units) may be combined and configured as one device (or processing unit).
  • configurations other than those described above may be added to the configuration of each device (or processing unit).
  • part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).
  • the above-mentioned program may be executed in any device.
  • the device has the necessary functions (functional blocks, etc.) and is capable of obtaining the necessary information.
  • each step of a single flowchart may be executed by a single device, or may be shared among multiple devices.
  • the multiple processes may be executed by a single device, or may be shared among multiple devices.
  • multiple processes included in a single step may be executed as multiple step processes.
  • processes described as multiple steps may be executed collectively as a single step.
  • the processing of the steps describing a program executed by a computer may be executed chronologically in the order described in this specification, or may be executed in parallel, or individually at the required timing, such as when a call is made. In other words, as long as no contradiction arises, the processing of each step may be executed in an order different from the order described above. Furthermore, the processing of the steps describing this program may be executed in parallel with the processing of other programs, or may be executed in combination with the processing of other programs.
  • the multiple technologies related to the present technology can be implemented independently and individually, so long as no contradictions arise.
  • any multiple of the present technologies can also be implemented in combination.
  • part or all of the present technology described in any embodiment can be implemented in combination with part or all of the present technology described in another embodiment.
  • part or all of any of the present technologies described above can be implemented in combination with other technologies not described above.
  • the present technology can also be configured as follows. (1) a signature verification unit that verifies a signature of an unprocessed image before processing the image; a processing specification unit that specifies the content of the processing based on the pre-processing image and a processed image obtained by performing the processing on the pre-processing image; and an authenticity determination unit that determines whether or not to guarantee the authenticity of the processed image based on a result of the signature verification and the specified content of the processing.
  • the authenticity determination unit If the verification result indicates that the authenticity of the unedited image is guaranteed and the editing is specified as an acceptable editing, it is determined that the authenticity of the edited image is guaranteed;
  • the image processing device according to claim 1, wherein if the verification result does not guarantee the authenticity of the pre-processed image, or if the processing is identified as unacceptable processing, it is determined that the authenticity of the processed image is not guaranteed.
  • (3) The image processing device further comprising: an authenticity determination result display information output unit that generates and outputs authenticity determination result display information indicating a determination result as to whether or not the authenticity of the processed image is guaranteed.
  • the authenticity determination unit If the content of the processing of the processing target area between the original image and the pre-processed image corresponds to the processing history information added to the pre-processed image, it is determined that the authenticity of the processing target area of the post-processed image is guaranteed; An image processing device as described in any of (4) to (6), which determines that the authenticity of the processing target area of the processed image cannot be guaranteed if the content of the processing of the processing target area between the original image and the pre-processing image does not correspond to the processing history information.
  • the authenticity determination unit If the processing of a face region, which is a partial region including a face of a person, is a change due to the health condition of the person or the like, it is determined that the authenticity of the face region of the processed image is guaranteed;
  • the image processing device according to any one of (4) to (7), wherein if the processing of the face area is not a change due to the person's health condition or the like, it is determined that the authenticity of the face area of the processed image cannot be guaranteed.
  • the image processing device according to (8) wherein the changes due to the person's health condition, etc.
  • the authenticity determination unit If the processing of a face region, which is a partial region including a face portion of a person, is within a range that is socially understandable, it is determined that the authenticity of the face region of the processed image is guaranteed;
  • the image processing device according to any one of (4) to (9), wherein if the processing of the face area is not within the range of processing that is socially easy to understand, it is determined that the authenticity of the face area of the processed image cannot be guaranteed.
  • the authenticity determination unit When the processing of a personal identification information region, which is a partial region including personal identification information, it is determined that the authenticity of the personal identification information region of the processed image is guaranteed;
  • the image processing device according to any one of (4) to (13), further comprising: determining that the authenticity of the personal identification information area of the processed image cannot be guaranteed if the processing of the personal identification information area involves a change in the personal identification information.
  • the personal identification information includes an identification card.
  • the authenticity determination result display information output unit generates and outputs a certification Web page to be made public at a predetermined URL as the authenticity determination result display information.
  • (21) verifying a signature of an unprocessed image before processing is performed on the image; Identifying the details of the processing based on the pre-processing image and a processed image obtained by performing the processing on the pre-processing image; and determining whether or not to guarantee authenticity of the processed image based on a result of the signature verification and the specified content of the processing.
  • a display processing unit that generates a display image showing a judgment result by using authenticity judgment result display information showing a judgment result of whether or not to guarantee the authenticity of the processed image, and displays the display image;
  • the processed image is an image obtained by subjecting a pre-processing image to processing.
  • the image processing device 31), wherein the display processing unit generates the display image such that display content is different between a case where authenticity of the processed image is guaranteed and a case where authenticity of the processed image is not guaranteed.
  • the display processing unit generates the display image further including information indicating a content of the processing.
  • the image processing device according to (38), wherein the display processing unit generates the display image further including information indicating a content of the image synthesis performed in the image synthesis area of the processed image.
  • the display processing unit generates the display image including the processed image and information indicating a 2D region that is a partial region formed on a plane of the processed image.
  • the display processing unit generates the display image including information indicating the content of the processing and history information of the processing added as metadata to the processed image.
  • the authenticity determination result display information is a certification Web page showing the authenticity determination result
  • the image processing device according to any one of (31) to (47), wherein the display processing unit is configured to generate the display image using the acquired certification Web page and display the display image.
  • the image processing device according to any one of (31) to (48), wherein the display processing unit generates the display image including information indicating a guarantor who guaranties authenticity of the processed image, and displays the display image.
  • (50) A method for generating and displaying a display image showing a result of a judgment as to whether or not to guarantee the authenticity of a processed image, using authenticity judgment result display information showing the result of the judgment,
  • the image processing method wherein the processed image is an image obtained by subjecting a pre-processing image to processing.
  • 100 Authenticity determination system 101 Imaging device, 102 File conversion device, 103 Image processing device, 104 Authenticity determination server, 105 Web server, 106 Terminal device, 110 Network, 131 Image acquisition unit, 132 Image processing unit, 133 Authenticity determination request unit, 134 Authenticity determination result display unit, 211 Image acquisition unit, 212 Signature verification unit, 213 Processing specification unit, 214 Authenticity determination unit, 215 Authenticity determination result display information output unit, 331 Proof Web page processing unit, 361 Authenticity determination unit, 900 Computer

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Technology Law (AREA)
  • Editing Of Facsimile Originals (AREA)
PCT/JP2024/025484 2023-08-24 2024-07-16 画像処理装置および方法 Ceased WO2025041484A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2025541340A JPWO2025041484A1 (cg-RX-API-DMAC7.html) 2023-08-24 2024-07-16
EP24856178.9A EP4769196A1 (en) 2023-08-24 2024-07-16 IMAGE PROCESSING DEVICE AND METHOD

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202363578393P 2023-08-24 2023-08-24
US63/578,393 2023-08-24

Publications (1)

Publication Number Publication Date
WO2025041484A1 true WO2025041484A1 (ja) 2025-02-27

Family

ID=94731624

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2024/025484 Ceased WO2025041484A1 (ja) 2023-08-24 2024-07-16 画像処理装置および方法

Country Status (3)

Country Link
EP (1) EP4769196A1 (cg-RX-API-DMAC7.html)
JP (1) JPWO2025041484A1 (cg-RX-API-DMAC7.html)
WO (1) WO2025041484A1 (cg-RX-API-DMAC7.html)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008124668A (ja) * 2006-11-09 2008-05-29 Canon Inc コンテンツ編集装置及びコンテンツ検証装置
JP2009265927A (ja) * 2008-04-24 2009-11-12 Canon Inc 電子文書制御装置、方法、プログラム、並びに、システム
WO2022137798A1 (ja) 2020-12-21 2022-06-30 ソニーグループ株式会社 画像処理装置および方法
WO2023248807A1 (ja) 2022-06-21 2023-12-28 ソニーグループ株式会社 画像処理装置および方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008124668A (ja) * 2006-11-09 2008-05-29 Canon Inc コンテンツ編集装置及びコンテンツ検証装置
JP2009265927A (ja) * 2008-04-24 2009-11-12 Canon Inc 電子文書制御装置、方法、プログラム、並びに、システム
WO2022137798A1 (ja) 2020-12-21 2022-06-30 ソニーグループ株式会社 画像処理装置および方法
WO2023248807A1 (ja) 2022-06-21 2023-12-28 ソニーグループ株式会社 画像処理装置および方法

Also Published As

Publication number Publication date
EP4769196A1 (en) 2026-07-01
JPWO2025041484A1 (cg-RX-API-DMAC7.html) 2025-02-27

Similar Documents

Publication Publication Date Title
US12002127B2 (en) Robust selective image, video, and audio content authentication
US12158929B1 (en) Watermarking digital media for authenticated content verification
EP1249002B1 (en) Authenticating metadata and embedding metadata in watermarks of media signals
JP5143896B2 (ja) 画像修飾及びフレームレート変換に反応しないビデオ署名の導出
KR100335308B1 (ko) 워터마크를 이용한 인간 지각가능 데이터 세트의 배포와 인증 방법 및 그 장치
US20090316894A1 (en) Method and apparatus for checking consistency between digital contents
US12511439B2 (en) Digital forensic image verification system
US8904184B2 (en) Certification of authenticity of media signals
Liew et al. Tamper localization and lossless recovery watermarking scheme with ROI segmentation and multilevel authentication
JP2002232685A (ja) 電子透かし処理装置、情報処理装置、ディジタルコンテンツ配布システム、電子透かし挿入方法、及び記憶媒体
US10891702B2 (en) Duplicate image evidence management system for verifying authenticity and integrity
WO2024161895A1 (ja) 真正性検証システム、コンテンツ管理装置、コンテンツ生成装置、これらの制御方法およびこれらのプログラム
JP2024124337A (ja) 管理システム、情報処理装置、管理方法、情報処理装置の制御方法、及びプログラム
KR20200018159A (ko) 사진 위변조 및 도용 방지 방법
US20200272748A1 (en) Methods and apparatus for validating media content
JP2019205140A (ja) 撮像装置、情報処理装置、生成方法、及び検証方法
CN119182974B (zh) 一种基于边缘像素隐蔽性的视频防篡改水印方法及装置
JP2002158865A (ja) 画像情報処理方法及び画像情報処理装置
JP2001078013A (ja) 電子透かし合成装置及び画像改ざん判定装置
JP2002198958A (ja) 画像の改竄防止方法
JP2024076326A (ja) 管理システム、コンテンツ生成装置、コンテンツの管理方法、コンテンツ生成装置の制御方法、及びプログラム
CN120091162A (zh) 一种视频加密防伪方法、系统、设备及介质
WO2024243113A1 (en) A method for detecting false or synthesized media
CN119011161A (zh) 一种客户端验证授权处理方法
JP2003032477A (ja) 属性情報処理方法およびそのシステム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24856178

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2025541340

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2025541340

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2024856178

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE