JP2002369190A - Authentication station and image inputting and transmitting equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable judgement that image data are not image data which are captured at present or at least preserve the evidence, when the image data of an image captured in the past and have been kept are transmitted to an authentication station, just like data captured at present. SOLUTION: Information changing by day and time is transmitted to image inputting and transmitting equipment which captures an image and outputs the image data of the image, via a network. Image data which are outputted from the image inputting and transmitting equipment and changed by the information changing by day and time are received via the network. The image inputting and transmitting equipment captures an image and transmits image data of the image to the authentication station via the network. The equipment receives information changing by day and time via the network. The image data are changed by contents of the information changing by day and time.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a certification authority and an image input / transmission device for authenticating image data, and more particularly to a certification authority and an image input / transmission device suitable for improving the proof power as evidence of image data. About.

[0002] In the present specification, a certificate authority is any device that performs data authentication.

[0003] The image input / transmission device in this specification is:
Any device that captures an image and sends the image data of the image to the network. As an example of the image input transmission device, a camera system including a digital video camera and a computer having a network connection function,
A computer with a camera having a network connection function,
Including, but not limited to, a camera-equipped mobile phone, a camera-equipped information portable terminal, a camera-equipped robot having a network connection function, a surveillance camera having a network connection function, a digital video camera having a network connection function, a digital camera having a network connection function, and the like. Not limited.

[0004] In this specification, all devices are computers, microprocessors, electronic devices, storage devices, portable terminals, portable telephones, electric appliances, electronic circuits, etc. Includes, but is not limited to, all systems connected by communications, wireless communications, etc.

[0005]

2. Description of the Related Art Conventionally, as a method for authenticating image data, an image is acquired by an information authentication device to acquire image data, authentication information is added to the image data, and the image data is transmitted to a certificate authority. Authentication has been proposed (Japanese Patent Application Laid-Open No. 2001-10632).

However, it is possible to take an image of a subject which has been taken and stored with a digital camera at a certain point in the past, and take a picture of the subject with video at a certain point in the past. However, there is a problem that an image captured in the past can be disguised as if it is currently captured, for example, by inputting it to a digital camera that has been modified at the present time.

[0007]

SUMMARY OF THE INVENTION An object of the present invention is to store image data of an image captured in the past and transmit the image data to a certificate authority as if the image data is currently captured. It is an object of the present invention to provide a certificate authority that makes it possible to determine that the image is not a currently captured image or at least to leave evidence of the image, and an image input / transmission device.

[0008]

According to the present invention, there is provided an image input / transmission apparatus which captures an image and outputs image data of the image via a network. A certificate authority is provided, which receives, via a network, the output image data changed by the information that changes according to the date and time.

An image input / transmission apparatus for receiving an image, transmitting the image data of the image to a certificate authority via a network, receiving information that changes according to date and time via the network, There is provided an image input / transmission device which changes according to the content of the information which changes according to the date and time.

[0010] In the present specification, the information that changes depending on the date and time refers to any information that may change depending on the date and time. It is preferable that different information correspond to different days, but the same information may correspond to different days.

In this specification, a network refers to any communication network including a wide area network such as the Internet and a telephone communication network, as well as a local network such as a LAN, and includes a wired communication network and a wireless communication network. .

In the present specification, image data refers to any data representing an image, and includes not only moving image data but also still image data and an aggregate thereof, which is compressed or encrypted. Including data.

In this specification, the image data changed by the information that changes with the date and time refers to any image data when the content of the image data changes with the content of the information that changes with the date and time.

[0014]

BEST MODE FOR CARRYING OUT THE INVENTION As an embodiment of a certificate authority and an image input / transmission apparatus of the present invention, a case where a certificate authority 100 and a camera system 200 are used will be described as an example.

FIG. 1 is a block diagram schematically showing a certificate authority 100 according to the present embodiment. Referring to FIG. 1, certificate authority 100
Will be described below.

In this specification, the date and time information section refers to a part of a certificate authority that generates and outputs information that changes according to the date and time.

The date and time information section 101 of this embodiment is a part of the certificate authority 100 that generates and outputs information that changes according to the date and time.

In this embodiment, a random number updated every hour is used as the information that changes according to the date and time. That is, the date and time information unit 101 generates a random number every hour using a random number generator. The random numbers generated include
"39598502", "98160432", "02
Eight numbers such as "138485".

Here, in this embodiment, the meaning of each number of the generated random numbers is as follows: "0 means right movement, 1 means left movement, 2 means up movement, 3 means down movement, 4 means right rotation, 5 means Left rotation, 6 moves lower left, 7 moves upper right, 8 moves upper left, 9 moves lower right. "
It is.

In this embodiment, the date and time information section 101 stores "3
The random number “95598502” is output to the transmission / reception unit 102 (151).

In this specification, the transmission / reception unit is a part of a certificate authority that transmits and receives information to and from an image input / transmission device via a network.

In the present embodiment, when an authentication request is issued from the camera system 200, the transmission / reception unit 102 transmits to the camera system 200, information that changes according to the date and time of the generated random number "39598502" to the camera system 200 via a network. (152).

The camera system 200 is described as "3659595".
02, that is, images are captured while moving the camera unit according to the information of “downward movement, lower leftward movement, left rotation, lower rightward movement, upper leftward movement, leftward rotation, rightward movement, upward movement”. Each move is performed for 2 seconds. Thus, "36
After the operation of "598502" is completed, the camera unit is returned to the home position, which is the initial position, within one second. While the camera is returned to the home position, no image is captured. Then, returning to the beginning, "36598502"
Is repeated.

Then, the image of the subject captured by the moved camera unit is captured by the camera system 200 and transmitted to the transmitting / receiving unit 102 in the form of digital data (153). This digital data corresponds to image data changed by information that changes according to date and time.

The transmission / reception unit 102 stops the authentication if no image data is transmitted from the camera system 200 within 30 seconds after the transmission of the information that changes according to the date and time. If the data is transmitted within 30 seconds after transmitting the information that changes according to the date and time,
The image data of the subject is received, and a set of the received image data of the subject and information that changes with the date and time is determined by the determination unit 103.
(154).

In the present specification, the determination unit is a certification authority that receives information that changes according to date and time and image data and determines whether the image data has changed according to the information that changes according to the date and time. Some say.

The determination unit 103 of the present embodiment uses the image data of the subject and the information “36598” that changes with the date and time.
502 ”from the transmission / reception unit 102 (15
4).

The image data of the subject is "365"
98502 ", that is, whether it was created by the movement of the camera section of" downward movement, lower leftward movement, left rotation, lower right movement, upper left movement, left rotation, right movement, upward movement ".

For this determination, a pattern recognition device is used. At the current level of pattern recognition, it is difficult to set the correct rate (recognition rate) to 100%, so that the result of the determination is not absolute but indicates a high probability.

A specific example of the pattern recognition method will be described. First, one frame is extracted from the image data every quarter second. Then, by comparing a certain frame with the next frame, one of the above-described camera unit movements of “downward movement, lower leftward movement, left rotation, lower rightward movement, upper leftward movement, left rotation, rightward movement, upward movement” was performed. Is determined.

This is a frame obtained by applying a certain amount of parallel movement to a certain frame or performing a right and left rotation for a vertical / left / right diagonal movement and a left / right rotation (using mathematical operations of a parallel movement and a rotation matrix). Are generated, and a correlation coefficient with the next frame is obtained to detect. That is, when the moving amount and the rotating amount are gradually changed,
If a high correlation coefficient appears, it is likely that the certain amount of translation or rotation has been performed. Then, the one having the highest correlation coefficient is selected, and it is recognized whether each frame is in the process of diagonal up / down / left / right or right / left rotation. When each frame of the frame is recognized in this manner, if the number of captured frames is, for example, 133, each recognition result for the 132 frames except the first is, for example, “3332”.
333366666666555555555999999
99888888885555555550000000000
0022222222 ****** 333333333666
66666555555555999998998888
88885555555550000000022422
222 ". In this example, although misrecognition has appeared (for example, 3 is correct instead of 2 in the fourth frame), each operation lasts for 2 seconds, and one frame is output every quarter second. Operation continues for eight frames. Therefore, erroneous recognition is corrected by taking a majority decision every eight frames. In addition, for one second (4 frames) of “****”, the camera unit is returned to the home position.
Images have not been imported. Thus, the starting point and the ending point of the operation are known, and it is recognized that the operation “36598502” has been performed.

The thus recognized "3655985"
02 "is compared with" 36598502 ", which is information that changes according to the date and time received from the transmission / reception unit 102. If they match, the judgment is successful, and if they do not match, the judgment is failure. This corresponds to determining whether or not the changed image data has been changed based on information that changes with the date and time.

However, the subject is photographed at a certain point in the past using video or the like and stored, and the camera unit is moved in accordance with the signal "36598502", and the stored past image is captured by the camera unit, and it is as if the current There is a possibility that camouflage is performed to make the subject look as if it were taken.
You can also take a video of a subject at some point in the past,
Save it as image data, "Move down, move down left,
Digital data is created by applying mathematical operations such as rotation and translation corresponding to `` left rotation, lower right movement, upper left movement, left rotation, right rotation, upward movement '' to image data and creating this as the current shot There is a possibility that the camouflage is performed. As described above, there is a risk that in some way, an image taken in the past may be disguised as imitating the present subject.

In this case as well, mathematical operations have been performed on images taken by moving the camera unit in front of the current subject, images of saved past images taken by the camera unit, and past images. Images often differ. For example, if a distant pillar and a nearby pillar appear to overlap, if you shoot the current subject with the camera, for example, if you move the camera sideways, the nearby pillar will move quickly,
The distant pillars move slowly, so that their overlap is eliminated (for example, if you move your eyes to the moon and move your eyes sideways, the moon will move away from your fingers). On the other hand, an image of a subject taken at a certain point in the past is stored and taken by the camera unit, or an image taken and saved at a certain point in the past is rotated or translated. If you add the mathematical operation described above to make the moving camera unit look as if you were shooting a subject, both pillars will remain overlapped even if you move the camera unit sideways.

The following method is used to detect a camouflage act using such a difference. First, a plurality of objects are cut out from an image frame using an image recognition technique. Then, the plurality of cut out objects are compared in a plurality of frames, and an object that is always moving in the opposite direction to the movement of the camera is selected as a stationary object. For example, an object that always moves to the left when the camera moves to the right, always moves to the right when the camera moves to the left, always moves down when the camera moves up, and always moves up when the camera moves down,
Even if it is stationary or moving, it can be treated as stationary because the movement is relatively slow when viewed from the camera unit. Alternatively, an object may be recognized using image recognition, and a stationary object may be selected using heuristic knowledge used in artificial intelligence such that an object such as the sky or a background wall does not move. Next, it is determined whether or not the plurality of stationary objects move at different speeds as the camera unit moves. If a real three-dimensional image is taken, it is rare that all of the stationary objects are all at the same distance from the camera unit. Therefore, the multiple stationary objects move at different speeds as the camera unit moves. Is usually visible. If the plurality of selected still objects appear to move at the same speed with the movement of the camera unit, it is added to the determination that there is a possibility that a camouflage act has been performed.

As another determination method, a contour is extracted from a frame of an image by using an image recognition technique to form a three-dimensional model of the subject, and the appearance of the subject as the camera moves. Is expected to change, and this is compared with the change in the appearance of the subject caused by the actual movement of the camera unit. Is added to the judgment.

With the current level of pattern recognition and artificial intelligence technology, it is difficult to detect 100% of camouflage. There are also images for which it is originally difficult to detect camouflage such as an image in which all objects having no depth are almost equidistant from the camera unit. As described above, it cannot be guaranteed that 100% of the impersonation has been detected, but in order to warn that the impersonation has been performed, information indicating that the impersonation has been performed is included in the authentication result. It is instructive to add. The information on whether or not there is a possibility that the impersonation has been performed corresponds to the information on the possibility that the determination is wrong.

As described above, the determination section 103 outputs the image data of the subject, information that changes according to the date and time, and the determination result (155).

In this specification, the digital signature unit is:
It refers to data that specifies image data changed by information that changes with date and time, and part of a certificate authority that digitally signs data that specifies information that changes with date and time.

The digital signature unit 104 receives the image data of the subject, information that changes according to the date and time, and a determination result (155). Then, using a public key cryptosystem, a digital signature is formed by encrypting a set of image data of a subject, information that changes according to date and time, and a determination result with a secret key of a certificate authority, and transmits the digital signature to the camera system 200. (1
56, 152). For example, "The Certification Authority has 36598
Information 502 (downward movement, lower left movement, left rotation, lower right movement, upper left movement, left rotation, right movement, upward movement) is transmitted and 2
At 23:34 on April 29, 001, we receive the attached image data and prove that the result of the judgment was successful, but the result of the possibility of spoofing was obtained. " , With the digital signature of the certificate authority.

FIG. 2 is a block diagram schematically showing a camera system 200 as an example of the image input / transmission device of the present invention. The outline of the camera system 200 will be described below with reference to FIG.

In this specification, the data transmission / reception unit is:
Refers to a part of an image input / transmission device that transmits / receives data to / from a certification authority via a network.

In this embodiment, the data transmitting / receiving unit 201
It is a computer provided with network connection means.

The data transmitting / receiving unit 201 receives, via the network, information transmitted from the certificate authority 100 that changes depending on the date and time (251). Here, it is assumed that the certificate authority transmits “395598502”, that is, information that changes depending on the date and time, that is, downward movement, lower left movement, left rotation, lower right movement, upper left movement, left rotation, right movement, and upward movement. .

[0045] In this specification, the camera driving unit refers to a part of an image input / transmission device provided with a mechanism for moving the camera unit.

In this embodiment, the camera driving section 202 is a motor attached to a digital video camera.
The motor is connected and controlled by a computer provided with network connection means.

The camera driving section 202 receives information for controlling the movement of the camera section 203 (252), and moves the camera section 203 in accordance with the received information (253).
That is, the camera unit 203 is moved diagonally up, down, left, and right for 2 seconds by a motor for the diagonal movement of the camera unit 203, and the camera unit 20 is rotated for the right and left rotations.
3 is rotated by a motor for 2 seconds to move the camera unit 203 by about 5 cm.

[0048] In this specification, the camera unit is a part of an entrance for taking in an image from the outside world, and refers to a part of an image input / transmission device for converting an image taken from the outside world into an electric signal.

In this embodiment, the camera section 203 is a section from an opening of a camera for taking in an image of a digital video camera to a CCD for outputting an electric signal. Camera unit 2
03 is moved by the camera driving unit 202 (25
3) Capture the subject 204 and capture the video (25
4) Output image data (255).

The camera unit 203 captures an image of one frame every quarter second, and captures an image of eight frames every movement of two seconds. After the operation corresponding to “39598502” is completed, the camera unit 203 is returned to the home position within one second. During the time to return to the home position, no image is captured. And go back to the beginning,
The operation “36598502” is repeated.

The data transmitting / receiving unit 201 includes a camera unit 203
(255), the format of the data is appropriately converted, and the image data is transmitted to the certificate authority 100 via the network (25).
6).

FIG. 3 is an external view showing a device configuration example of a camera system 200 which is an example of the image input / transmission device of the present invention. An example of a device configuration of the camera system 200 will be described below with reference to FIG.

The computer 301 is a computer provided with network connection means for connecting to the certificate authority 100 via a network, and receives information that changes with the date and time from the certificate authority 100 via a LAN cable connected to the network (351). Computer 301
Is the motor 3 by the cable coming out of the serial port.
02, and sends a signal for driving the motor 302 in accordance with information that changes according to the date and time (35
2).

The motor 302 is a motor controlled by the computer 301 to move the digital video camera 303, and includes a driving rod 35 connected to the motor 302.
3 moves the digital video camera 303 up, down, left and right or rotates obliquely by rotating the gear (not shown) at the upper end of the drive rod 353 in accordance with the movement of the motor 302 or rotating the gear (not shown) at the upper end of the drive rod 353 (353). .

The digital video camera 303 is a video camera having a function of recording a moving image.
And transmits the image data to the computer 301 through the USB cable (35).
4).

The camera unit 304 is a part of the digital video camera 303 and serves as an entrance when capturing an image from the outside world.

The computer 301 converts the received image data into an appropriate data format, and transmits the image data to the certificate authority 100 through a LAN cable connected to a network.
(355).

In the correspondence with FIG.
Corresponds to the computer 301, the camera drive unit 202 corresponds to the motor 302, and the camera unit 203 corresponds to the camera unit 304 of the digital video camera 303.

In this embodiment, the motor 302 is provided separately from the digital video camera 303 and the drive rod 35
The camera unit 304 of the digital video camera 303 is moved by moving
However, the configuration may be such that a motor is built in the digital video camera 303 and the camera unit 304 of the digital video camera is moved by an internal driving mechanism. In this embodiment, the digital video camera 30
Although the computer 3 and the computer 301 are provided separately, a configuration in which the computer 301 is built in the digital video camera 303 may be adopted.

The certificate authority 100 of the embodiment described above,
The camera system 200 can authenticate that the image of the subject was taken at a specific date and time. This can be used, for example, to record and certify the evidence video of the accident site or to record and authenticate the evidence video of the building process.

Advantageous effects of the embodiment described above will be described.

First, since the information that changes with the date and time is composed of random numbers that are updated every hour, even if the information that changes with the past date and time is collected, the information that changes with the future date and time cannot be predicted. Therefore, the date and time at which the user wants to be certified (for example, 11:30 pm on June 1, 2002)
Minutes), the information that changes depending on the date and time is predicted in advance (for example, 5:30 pm on January 1, 2001), and at 5:30 pm on January 1, 2001, 6
The image data obtained by controlling and capturing the camera unit according to the information that changes according to the date and time at 11:30 pm on January 1 is stored, and at 11:30 pm on June 1, 2002,
By transmitting the stored digital data to the certificate authority, the image data captured at 5:30 pm on January 1, 2001 is as if at 11:30 pm on June 1, 2002. It is not possible to disguise as if it were image data taken in. As described above, it is preferable to use information in which future information is not predicted from past information as information that changes depending on the date and time.

The image data of the subject taken at 5:30 pm on January 1, 2001 is stored, and
After receiving information that changes according to the date and time from the certification authority 100 at 11:30 pm on June 1, 4th, the stored image data is changed using the information that changes according to the date and time.
It is also difficult to disguise the image captured on January 1, 2001 as if it were an image captured on June 1, 2002. This is for the following reason.

Although it is generally difficult to save a three-dimensional image of a subject as it is, even if image data of the subject is stored, it is difficult to record the video data or take a picture with a camera. You will save the image. Since the information that changes according to the date and time as of June 1, 2002 cannot be predicted as of January 1, 2001, all the two-dimensional images corresponding to all assumed movements of the camera unit are obtained. It is difficult to take and save in advance. Therefore, it is general to store only one two-dimensional image data of a subject taken from a certain direction. However, not all information of the three-dimensional subject is included in the two-dimensional image data. For example, information in the depth direction is lost. Therefore, as of June 1, 2002, if the camera unit is moved by information that changes according to the date and time, the camera unit is moved in front of the two-dimensional image data, and the camera unit is moved in front of the three-dimensional object. There is a difference between the moving part. Therefore,
It is difficult to disguise image data stored in advance on January 1, 2002 as if it were an image captured on June 1, 2002.

However, from the two-dimensional image data of the object taken as of January 1, 2001, three-dimensional image data of the object is created by using an image recognition technique, and computer graphics such as ray tracing are used. Using the method, create an image that looks as if it was an image taken by a camera part that moved according to the information that changes with the date and time at 11:30 pm on June 1, 2002. Such complicated and elaborate camouflage may be performed. However, does such elaborate camouflage look as if the image created by the computer graphics had changed due to the time-varying information at 11:30 pm on June 1, 2002? In general, it takes a certain amount of time and labor, for example, a human checks the visual check and repeats the fine adjustment. In this embodiment, the information that changes according to the date and time is updated every hour, and if the image data is not transmitted within 30 seconds after the certificate authority transmits the information that changes according to the date and time, the authentication is terminated. It is difficult to impersonate by performing such a task after receiving the information that changes due to a short time.
Thus, it is preferable that the information that changes with the date and time changes in a short time.

As described above, according to the present embodiment, it is difficult in terms of time to disguise image data captured in the past as if it is currently captured, thereby improving the reliability of authentication. There is an effect of doing.

The certificate authority 100 of the embodiment described above,
The camera system 200 is merely an embodiment of the certificate authority and the image input / transmission device of the present invention, and can be changed without departing from the spirit of the present invention. Modification examples will be described below, but the modification examples are also examples, and those not cited as the modification examples are not excluded from the present invention.

In this embodiment, a random number is used as the information that changes according to the date and time. However, a sequence generated by a function such as a polynomial, a numerical value generated by a function that outputs a numerical value when a date and time is input, and the like may be used. it can. Further, the information that changes depending on the date and time can be of variable length, for example, from “1:00 pm on May 3, 2000 to 2:00 pm,
948503394593285389 (omitted) ",
"May 3, 2000 from 2:00 pm to 3:00 pm, 2949
For example, an infinitely long sequence may correspond to one date and time, such as "59494543232." In addition, the information that changes according to the date and time can take any data format such as hexadecimal data, character data, and voice data, in addition to numerical values and a sequence, and describes an instruction to move the camera unit in a certain method. It is also possible to take the form of a command sequence or a program.

In this embodiment, parallel movement and rotational movement are used as the movement of the camera unit.
Use any movement such as approaching the subject, turning right toward the subject, turning left toward the subject, turning around the upper part of the subject, turning around the lower part of the subject, up and down vibration, left and right vibration, figure eight movement, etc. be able to.

In this embodiment, the movement of the camera section is performed for a fixed time of 2 seconds, but the movement time can be made variable. For example, one movement may be performed in three seconds and another movement may be performed in one second.

In the present embodiment, each number of "36598502", which is information that changes with the date and time, corresponds to the direction in which the camera unit moves, but each number corresponds to the time interval at which the camera unit moves. You can also. For example, the movement of the camera unit is always vertical vibration, but the vibration frequency of the camera unit may be changed according to each number.
Also, a vibrator is attached to the camera system 200 to vibrate irregularly, but the number of vibrations of the camera unit may be changed according to each number.

In the present embodiment, each numeral of "36598502" corresponds to one movement of the camera section, but it is not necessary that each numeral corresponds to one movement. For example, each number may be represented by a set of a plurality of movements. 3659
8502 is converted into a binary number to obtain data of 0 and 1, and 0
The camera unit may be moved upward by 1 and the camera unit may be moved downward by 1. Alternatively, “36598502” may be converted into a rhythm pattern using a Morse code, and the camera unit may be vibrated by the rhythm pattern.

In the present embodiment, the camera unit is returned to the home position. However, an operation for returning to the home position may not be provided. For example, each number of “36598502” is 3 degrees, 6 degrees as the clockwise rotation angle of the camera unit.
Degrees, 5 degrees, (omitted), 5 degrees, 0 degrees, 2 degrees, etc.
The rotation of the camera unit may be repeated forever.

In the present embodiment, the information "36598502" of a relatively short fixed length is repeated as the information that changes according to the date and time, and a time period during which no image is captured is provided to provide a repetition break. There is no need, and there is no need to put repeat breaks. For example, information that changes with the date and time may be used only once as a long fixed-length one such as a 300-digit number, or information that changes with the date and time may be converted into a variable-length sequence instead of a fixed-length number. Then, it may be terminated at the time when the image capture is completed.

In the present embodiment, the movement of the camera section is repeated throughout the time when image data is being captured, but the camera section may be moved during a part of the time when image data is being captured. When to move the camera unit may change according to information that changes with the date and time. For example, "36
598502 ", after capturing the image data, the camera unit may be moved upward in the third frame, 3 + 6 = 9th frame, 3 + 6 + 5 = 14th frame, 3 + 6 + 5 + 9 = 23th frame, and the like.

The certificate authority of this embodiment receives the image data changed by the information that changes with the date and time when the image input / transmission device moves the camera unit.
By converting the information “36598502” into audio information, image information, or character information of “downward movement, lower leftward movement, left rotation, lower right movement, upper left movement, left rotation, rightward movement, upward movement”, and presenting the information. Alternatively, the certification authority may receive the image data changed by the information that changes with the date and time when the owner of the image input transmission device moves the image input transmission device by hand.

In this embodiment, the information that changes according to the date and time is sent from the transmission / reception unit 102 to the determination unit 103. The information that changes according to the date and time is stored in the date and time information unit 101, and the determination unit 103 sets Information that changes according to the corresponding date and time may be read from the date and time information unit 101. For example, the date / time information unit 101 stores a set of a date / time and a generated random number corresponding to the date / time. That is,
"May 10, 2001, 7:00 to 8:00, 36598
502 "," May 10, 2001, 8:00 to 9:00,
The random number and the date and time are stored in association with each other, for example, "25048353", "9 PM to 10 PM, May 10, 2001, 104838955". For example, when the reception date and time when the transmission / reception unit 102 receives the image data is 8:23 pm on May 10, 2001, the determination unit 1
03 reads out “2504835” and determines whether or not the changed image data is image data generated by the movement of the camera unit corresponding to the read out “2504835”.

In this embodiment, the image data is fetched as a group of frames which are still images obtained by dividing the image data at a fixed time of 1/4 second, but it is not necessary to fetch the image data as a group of frames. . For example, it is also possible to capture moving image data in a format that does not rely on a frame, and then sample a still image from the moving image data at regular or variable intervals to analyze the movement of the subject.

In the present embodiment, the determination unit 103 is provided, but it is also possible to not provide the determination unit 103. In this case, the digital signature unit 104, for example, states that “the certification authority is 36598502 (downward movement, lower leftward movement, left rotation,
(Lower right movement, upper left movement, left rotation, right movement, upward movement), and at 23:34 on April 29, 2001,
Prove that you have received the attached image data. Check whether the attached image data has been changed by the above information. With a digital signature. The user of the certificate authority can determine the received attached image data by actually checking it visually or by activating a separate determination program.

In the present embodiment, the presence or absence of the possibility of impersonation is used as the information on the possibility of erroneous determination. However, the information on the possibility of erroneous determination can be omitted. , Detailed information such as the possibility of impersonation and an estimate of how likely it was to be impersonated can be added as information on the possibility of incorrect judgment It is. In addition, the information on the possibility of erroneous determination may be generated in consideration of not only the possibility of forgery but also the error rate of pattern recognition.

In the present embodiment, the digital signature unit 104
The image data changed according to the date and time is encrypted with a secret key and a digital signature is attached. However, a digital signature may be attached to data specifying the image data changed according to the date and time, instead of the image data itself changed according to the date and time. For example, the digital signature may be performed after compressing the image data of the subject, reducing the image quality, extracting a part, or using a hash function to reduce the data amount. Also, a storage device such as a hard disk is provided in the digital signature unit 104, and image data of the subject and a set of information that changes according to date and time are stored in the storage device, and a storage number that specifies the image data and information that changes according to date and time are stored. May be digitally signed. In this case, for example, “the certification authority is 36598502
(Downward movement, lower left movement, left rotation, lower right movement, upper left movement, left rotation, right movement, upward movement), and is specified by the storage number April 29, 2001, 23: 34: 0031. The image data is received, and the result of the determination is successful, but the result that there is a possibility of forgery is proved. " At this time, a password is issued to the user,
A password may be input to the image data specified by the above storage number so that the image data can be viewed on a homepage on the Internet.

Similarly, as for the information that changes with the date and time, a digital signature may be applied to the data that specifies the information that changes with the date and time, instead of the information itself that changes with the date and time. For example, "The Certification Authority is 2001
The information that changes according to the date and time specified at 23: 00293 on April 29, 2001 is transmitted, and the storage number is stored on April 29, 2001.
The image data specified by day 23: 34: 0031 is received, and the result of the judgment is successful, but it proves that the result that there is a possibility of spoofing has been obtained. " With a digital signature. At this time, the information that changes depending on the date and time may be made available on a homepage of the Internet by inputting data specifying the information on the homepage of the Internet.

In the present embodiment, a moving object may be included in the subject, but it is also possible to handle a subject composed of only stationary objects. In the present specification, the subject refers to an object reflected on a camera unit. For example, in the case of an image of an accident site, the subject includes a background sky, trees, buildings, an accident vehicle, a falling victim, and a moving witness around. Includes people and passers-by.

In this embodiment, the image data is changed by changing the movement of the camera unit according to the information that changes with the date and time. However, there are various other means for changing the image data according to the information that changes with the date and time.

First, a light emitting device that emits light, such as a strobe or a lamp, is provided in the camera system 200, and light emission is changed according to information that changes according to date and time, thereby changing image data.

For example, in response to the information “36598502” that changes depending on the date and time, the light emitting device is turned on for three seconds.
It may be made to blink twice, five times, nine times, eight times, five times, zero times, twice. Or 3 is red, 6 is yellow, 5
May emit light of a different color such as green. In this case, the determination unit 103 analyzes the number of times and color of light that has changed the image from the luminosity and color of the captured image, and compares it with “36598502” that is information that changes depending on the date and time.
If they match, the judgment is successful, and if they do not match, the judgment is failure.

The camouflage of illuminating an image captured and stored in the past with a light emitting device, taking a current image with a digital camera or the like, and transmitting the image to a certificate authority is performed when a subject, which is a three-dimensional object, is illuminated. When the image is illuminated, the degree of light scattering, reflection, and the like is different, so that it is possible to determine. For example, if an object having a high reflectance such as a metal or a mirror is included, the effect of reflected light exists when a three-dimensional object is taken, but when a recorded two-dimensional image is taken, The image data changes differently depending on the color of the light from the light emitting device, such as the absence of the influence of the reflected light. In the determination unit 103, the colors of all objects in all image data are
If there is a certain change depending on the color of the light of the light emitting device, the possibility of forgery is added to the determination result. In addition, an image when light is applied to the three-dimensional model of the object is calculated by a rendering technique such as ray tracing,
Compared to the actual image, when there is a great difference, the possibility of spoofing may be added to the determination result.

Various other variations can be considered for the change in light emission due to the information that changes with the date and time. For example, with the information that changes with the date and time, the intensity of the light can be changed according to the location of the subject by moving the slit through which the light passes. In addition, it is also possible to irradiate a part of light having directivity such as a laser beam and change the position by information that changes with the date and time. Also, "3
"6598502" can be converted into a binary number, and light can be turned on and off in correspondence with 0 and 1.

Further, a very small fluctuation can be applied to the light intensity instead of the light ON / OFF. For example, according to information that changes with the date and time, the light intensity is reduced to 1/16.
It can be changed little by little every second.

According to the first method of emitting light as described above, it is not necessary to move the camera unit based on information that changes with the date and time, so that there is an effect that natural image data can be obtained. In particular, when the light intensity, frequency, and the like are slightly changed, it is possible to make subtle changes in the image data that cannot be seen at a glance, so that it is the same as when an electronic watermark is added to the image data. In addition, it is possible to obscure that information for authentication is contained.

Second, a robot arm can be attached to the camera system 200, and the robot arm can be moved in front of the camera unit in accordance with information that changes according to the date and time, so that the robot arm and the robot arm can be captured in an image to be captured. This corresponds to imprinting the object on the captured image.

For example, the arm can be translated or rotated in accordance with the information that changes depending on the date and time of "36598502". In this case, the determination unit 1
Reference numeral 03 denotes information that changes according to the date and time by analyzing the movement of the arm in the captured image.
2), and if they match, the judgment is successful, and if they do not match, the judgment is failure.

In the case of a camouflage in which an image captured in the past is stored, photographed by a digital camera and transmitted to a certificate authority, the arm cannot be imprinted on the stored two-dimensional image in the past. It is difficult to create such a composite image in a short time even if is used, so that it is possible to determine. Further, when the arm collides with the subject, the velocity vector of the arm and the subject changes. However, it is possible to make a determination using the fact that such an interaction does not occur in the recorded two-dimensional image. The moving object is not limited to the robot arm, and any object can be used.

Third, it is possible to mount a ball throwing device on the camera system 200, throw the ball according to information that changes according to date and time, and imprint the ball on an image to be captured. This corresponds to imprinting the object on the captured image.

For example, the speed and direction of the throwing ball are changed in accordance with the information "36598502" which changes depending on the date and time. In this case, the determination unit 103 analyzes the trajectory of the ball in the captured image to determine the initial speed and the direction, and the information “365” that changes depending on the date and time.
98502 ". If they match, the judgment is successful, and if they do not match, the judgment is failure.

Regarding the camouflage of saving an image captured in the past, taking a picture with a digital camera and transmitting it to a certificate authority, a ball cannot be projected on the saved past two-dimensional image, and computer graphics It is difficult to create such a composite image in a short time even if is used, so that it is possible to determine. Further, when the ball collides with the subject, the velocity vector between the ball and the subject changes. However, the discrimination can be made by utilizing the fact that such an interaction does not occur in the stored two-dimensional image. The object to be thrown is not limited to a ball, and any object can be used regardless of solid, liquid, or gas.

According to the above-described second and third methods, the image is captured in the captured image. Even if the object is located at substantially the same distance from the camera unit, the image captured in the past can be saved. At present, there is an effect that it is possible to easily prevent camouflage of taking a picture with a digital camera and transmitting it to a certificate authority. For example, even if graffiti written on a wall or a comet floating in the sky is the subject, impersonation can be easily made difficult by imprinting the object on the captured image. Also,
By using a small object or an inconspicuous color to be imprinted, naturalness of the image data can be maintained.

Fourth, a plurality of camera units can be provided in the camera system 200, and the camera unit that captures an image can be switched according to information that changes according to date and time. Thus, the position of the camera unit that captures an image can be changed without moving the camera unit. For example, it is possible to switch the camera unit that has ten camera units and captures images into the third, sixth, fifth, and other camera units in response to information that changes according to the date and time “36598502”. In this case, the determination unit 103 determines the position of the used camera unit from the captured image and compares it with “36598502”, which is information that changes depending on the date and time. Is the determination result.

Regarding camouflage in which an image captured in the past is stored, photographed by a digital camera and transmitted to a certificate authority, depth information is not obtained even when a stored two-dimensional image is photographed from a camera unit at a different position. Since the object is lost, it differs from an object that is a three-dimensional object taken from a camera unit at a different position. Therefore, it can be determined. For example, the size of a moving object differs between a near object and a distant object when the position of the camera unit changes. This is the same as when the camera unit is moved.

By switching the plurality of camera units as described above, there is no need to move the camera units, and there is an effect that the danger of abrasion of the camera drive unit can be eliminated.

The method of changing the image data according to the information that changes with the date and time is not limited to the above, and any method can be used. As an example, changing the amount of light collected by the camera unit of the camera system 200 based on information that changes according to the date and time.
A mirror is provided in the camera unit, and the pattern for moving the mirror is changed according to the information that changes according to the date and time, and the reflected light from the mirror is changed. The camera system 200 is provided with a focal length adjusting mechanism to focus on the information that changes according to the date and time. Examples include a device that changes the distance and a device that includes a vibration device that vibrates the ground in the camera system 200 and changes the vibration pattern of the ground according to information that changes according to date and time. In addition, while imprinting the stationary robot arm on the captured image,
Image data can be changed by information that changes with the date and time by combining several methods, such as moving the camera unit or adjusting the amount of light emitted by the camera unit while emitting light.

In the present embodiment, the camera system 200 is used as the image input device, but any image input transmission device can be used.

First, as an image input / transmission device, there is one using a mobile phone with a camera. FIG. 4 is an external view showing a device configuration example of a camera-equipped mobile phone as an example of the image input / transmission device of the present invention. With reference to FIG. 4, an example of the device configuration of the camera-equipped mobile phone will be described below.

The antenna unit 401 receives information that changes with the date and time from the certificate authority 100 via the wireless communication network (451). Information that changes depending on the date and time of reception is obtained by an IC inside the camera-equipped mobile phone 400.
The signal is converted into a signal that causes the vibrator unit 402 to vibrate.
Here, the information that changes depending on the date and time is “36559850”.
2 ", 3 seconds, 6 seconds, 5 seconds, 9 seconds, 8 seconds, 5 seconds, 2 seconds
The signal is converted into a signal that vibrates the vibrator unit 402 right and left eight times per second at intervals of seconds.

Vibrator section 40 receiving this signal
No. 2 vibrates right and left eight times in one second with the above interval. The vibration of the vibrator unit 402 causes the entire camera-equipped mobile phone 400 to vibrate, and as a result, the camera unit 40
3 is also vibrated.

The camera section 403 is a section for capturing an image from the outside world, and is a section including a lens and a CCD. The camera unit 403 is directed to the subject 404, captures an image of the subject, and outputs image data. This image data is appropriately format-converted by an IC inside the mobile phone 400, and then transmitted from the antenna unit 401 to the certificate authority 100 via the wireless communication network (452).

In this way, the image data changed by the information that changes with the date and time is transmitted to the certificate authority 100.

The certification authority 100 receives the image changed by the information that changes with the date and time, and
The number of seconds during which vibration does not occur during the period of eight vibrations per second is sequentially extracted, and this is compared with "36598502", which is information that changes depending on the date and time. If this is the case, the result of the determination is a failure.

According to this embodiment, if the mobile phone 400 is carried around and a traffic accident occurs suddenly and it is desired to authenticate the image of the accident site, the mobile phone 400 immediately sends the certificate to the certificate authority 100. By making a phone call and pointing the camera unit 403 of the mobile phone to the subject 404,
There is an effect that the image of the subject 404 can be authenticated by the authentication station 100 with high reliability. Also,
By setting the vibration of the vibrator unit to a specific frequency different from the vibration due to camera shake or the like, the certification authority 100 extracts the vibration of the specific frequency, so that the hand shakes when the camera unit 403 is pointed at the subject 404. However, the vibration of the vibrator can be distinguished from the vibration due to hand shake and the like, and more stable authentication can be realized.

In addition to the camera system 200 and the camera-equipped mobile phone 400, various image input devices can be used. Examples include an information portable terminal with a camera, a computer with a camera having a network connection function, a robot with a camera having a network connection function,
There is a surveillance camera having a network connection function, a digital video camera having a network connection function, a digital camera having a network connection function, and the like, but is not limited thereto.

[0111]

As is apparent from the above description, according to the present invention, the image data of an image captured in the past is recorded, and the certificate authority is set as if the image data is currently captured. In the case where the image data is transmitted to a certificate authority, it is possible to provide a certificate authority that can determine that the image is not a currently captured image or at least leave evidence of the image, and an image input / transmission device.

[Brief description of the drawings]

FIG. 1 is a block diagram schematically showing a certificate authority which is an embodiment of the certificate authority of the present invention.

FIG. 2 is a block diagram schematically showing a camera system, which is one embodiment of the information input device of the present invention.

FIG. 3 is an external view showing a device configuration example of a camera system as an example of the image input / transmission device of the present invention.

FIG. 4 is an external view showing a configuration example of a camera-equipped mobile phone as an example of the image input / transmission device of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 certificate authority 101 date / time information section 102 transmission / reception section 103 determination section 104 digital signature section 200 camera system 201 data transmission / reception section 202 camera drive section 203 camera section 204 subject 301 computer 302 motor 303 digital video camera 304 camera section 353 drive rod 400 with camera Cellular phone 401 Antenna unit 402 Vibrator unit 403 Camera unit 404 Subject

Claims (10)

[Claims] An information which changes according to a date and time is transmitted via a network to an image input and transmission device which captures an image and transmits image data of the image, and the information which changes according to the date and time transmitted from the image input and transmission device. A certificate authority, which receives image data changed by information to be transmitted via a network. 2. The certificate authority according to claim 1, further comprising a digital signature unit for digitally signing the data specifying the changed image data and the data specifying the information that changes according to the date and time. . 3. The certificate authority according to claim 1, further comprising a date and time information section for generating and outputting the information that changes according to the date and time. 4. The method according to claim 1, wherein
The information processing apparatus further includes a determination unit that receives the information that changes according to the date and time and the changed image data, and determines whether the changed image data has changed according to the information that changes according to the date and time. Certificate Authority. 5. The certificate authority according to claim 4, wherein the determination unit outputs information on a possibility that the determination is wrong. 6. An image input / transmission device for capturing an image and transmitting the image data of the image to a certificate authority via a network, wherein the image input / transmission device receives information that changes according to date and time via the network, and An image input / transmission device, which changes according to the content of the information that changes according to the date and time. 7. The image input and transmission device according to claim 6, further comprising a camera unit that moves in accordance with the information that changes according to the date and time. 8. The image input / transmission apparatus according to claim 6, wherein light is emitted according to the information that changes according to the date and time. 9. The method according to claim 6, wherein
An image input / transmission device, wherein an object is imprinted on an image to be taken in accordance with the information that changes according to the date and time. 10. The image input device according to claim 6, further comprising a plurality of camera units for capturing an image, wherein the camera unit for capturing an image is switched according to the information that changes according to the date and time. Transmission device.