JP2016181744A - Moving picture burying device, method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To bury electronic watermark information into a moving picture of high resolution.SOLUTION: An electronic watermark image representing electronic watermark information of each frame is generated according to an error diffusion method by an electronic watermark generator 24, an extended electronic watermark image for an electronic watermark image of each frame is generated by extending the amplitude of the pixel value of the electronic watermark image, the extended electronic watermark image generated for the electronic watermark image of each frame is superimposed on an image of each frame of a moving picture at a specific mixing degree by an electronic watermark superimposition unit 26, and an image in which the extended electronic watermark image is superimposed on each frame of the moving picture is output by a buried image output unit 90.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a moving image embedding apparatus, method, and program for embedding at least one of electronic watermark information and a marker in a moving image.

  Digital watermark information technology that embeds other information in the content so that it is not perceived by human eyes for the purpose of content identification / management, copyright protection / management, and related information provision when distributing content such as images and videos A method of using is known.

  In particular, in the digital watermark information technology for image / video content, a method based on minute changes in pixel values is common. As a specific method, for example, when embedding digital watermark information, based on embedding target component position information, spectrum spreading is performed to change the real component and imaginary component of the complex matrix independently, and the watermark pattern is independent of the input image. To generate an embedded image by adding the actual image pattern, generating an embedded image by adding the actual image pattern, and detecting the digital watermark information, Generate detection target sequence based on component position information, extract offset information, correct detection target sequence, perform spectrum despreading, and detect digital watermark information embedded in cut out pixel block There is a digital watermark information system (Patent Document 1).

  In addition, when detecting digital watermark information, there is a method of embedding an invisible marker or the like separately from the digital watermark information as means for identifying and normalizing an area where the digital watermark information exists from the camera capture video (see FIG. Patent Document 2).

JP 2003-219148 A JP 2014-82678 A

  Up to now, in order to embed digital watermark information and markers in live video in real time, an approach in which a watermark embedding algorithm or marker embedding algorithm as described in Patent Document 1 and Patent Document 2 is implemented in hardware has been the mainstream. It was.

  However, in the case of high-definition video such as 4K / 8K video that has been attracting attention in recent years, it takes a lot of time to embed digital watermark information and encode video. .

  The present invention provides a moving image embedding apparatus, method, and program that are made to solve the above-described problems and can embed at least one of digital watermark information and invisible markers in a high-resolution moving image. The purpose is to do.

  In order to achieve the above object, a moving image embedding device according to a first aspect of the present invention includes an image obtained by superimposing a digital watermark image representing digital watermark information of each frame on an image of each frame of the input moving image. A moving image embedding device that outputs an electronic watermark image representing digital watermark information of each frame according to an error diffusion method, and for each digital watermark image of each frame, the amplitude of the pixel value of the digital watermark image is expanded A digital watermark generation unit that generates an expanded digital watermark image, and for each frame image of the moving image, the expanded watermark image generated for the digital watermark image of each frame by the digital watermark generation unit is identified A digital watermark superimposing unit that superimposes using the degree of mixture of the image, and superimposing the expanded digital watermark image on each frame of the moving image It includes a embedded image output unit for outputting an image, a is configured.

  A moving image embedding method according to a second aspect of the present invention includes a digital watermark generation unit, a digital watermark superimposition unit, and an embedded image output unit. A moving image embedding method in a moving image embedding device for outputting an image on which a digital watermark image representing digital watermark information is superimposed, wherein the digital watermark generation unit is a digital watermark representing digital watermark information of each frame according to an error diffusion method An image is generated, and an expanded digital watermark image is generated by expanding the amplitude of the pixel value of the digital watermark image for the digital watermark image of each frame, and the digital watermark superimposing unit adds the image of each frame of the moving image to the image of each frame. On the other hand, the decompressed digital watermark image generated for the digital watermark image of each frame by the digital watermark generation unit has a specific mixing degree. There superimposed, the embedded image output unit, for each frame of the moving image, and outputs an image obtained by superimposing the decompressed digital watermark image.

  According to the first and second inventions, the digital watermark generation unit generates a digital watermark image representing the digital watermark information of each frame according to the error diffusion method, and the digital watermark image pixels of the digital watermark image of each frame are generated. Generates an expanded digital watermark image with the amplitude of the value expanded, and identifies the expanded digital watermark image generated for each frame digital watermark image for each frame image by the digital watermark superimposing unit. And the embedded image output unit outputs an image in which the expanded digital watermark image is superimposed on each frame of the moving image.

  In this way, according to the error diffusion method, a digital watermark image representing the digital watermark information of each frame is generated, and an expanded digital watermark image in which the amplitude of the pixel value of the digital watermark image is expanded for the digital watermark image of each frame is generated. Then, the expanded digital watermark image generated for the digital watermark image of each frame is superimposed on the image of each frame of the moving image using a specific mixing degree, and the expanded electronic image for each frame of the moving image is superimposed. By outputting an image on which a watermark image is superimposed, digital watermark information can be embedded in a high-resolution moving image.

  A moving image embedding device according to a third aspect of the present invention is a moving image embedding device that outputs an image in which a marker image representing a marker of each frame is superimposed on an image of each frame of the input moving image. In accordance with the diffusion method, a marker image representing a marker of each frame is generated, and for each marker image of each frame, a marker generation unit that generates an expanded marker image in which the amplitude of the pixel value of the marker image is expanded; For each frame image, for each frame of the moving image, a marker superimposing unit that superimposes the expanded marker image generated for the marker image of each frame by the marker generation unit using a specific degree of mixing. An embedded image output unit that outputs an image on which the expanded marker image is superimposed.

  A moving image embedding method according to a fourth aspect of the present invention includes a marker generating unit, a marker superimposing unit, and an embedded image output unit. A moving image embedding method in a moving image embedding device that outputs an image on which a marker image to be expressed is superimposed, wherein the marker generation unit generates a marker image representing a marker of each frame according to an error diffusion method, and For the image, an expanded marker image in which the amplitude of the pixel value of the marker image is expanded is generated, and the marker superimposing unit generates the marker image of each frame by the marker generating unit with respect to the image of each frame of the moving image. The expanded marker image generated for the image is superimposed using a specific degree of mixing, and the embedded image output unit outputs each frame of the moving image. For, and it outputs the image obtained by superimposing the decompressed marker image.

  According to the third and fourth inventions, the marker generation unit generates a marker image representing the marker of each frame according to the error diffusion method, and expands the amplitude of the pixel value of the marker image for the marker image of each frame. An expanded marker image is generated, and the marker superimposing unit superimposes the expanded marker image generated for the marker image of each frame on the image of each frame of the moving image using a specific degree of mixing. An image in which the expanded marker image is superimposed on each frame of the image is output.

  As described above, according to the error diffusion method, a marker image representing the marker of each frame is generated, and an expanded marker image in which the amplitude of the pixel value of the marker image is expanded is generated for each marker image of each frame. The expanded marker image generated for the marker image of each frame is superimposed on the frame image using a specific degree of mixing, and an image in which the expanded marker image is superimposed on each frame of the moving image is output. Thus, an invisible marker can be embedded in a high-resolution moving image.

  The moving image embedding device according to the fifth aspect of the invention superimposes a digital watermark image representing the digital watermark information of each frame and a marker image representing the marker of each frame on the image of each frame of the input moving image. A moving image embedding device that outputs an image, a digital watermark generation unit that generates a digital watermark image representing digital watermark information of each frame according to an error diffusion method, and a marker image that represents a marker of each frame according to an error diffusion method Generating a composite image by synthesizing the digital watermark image generated by the digital watermark generation unit and the marker image generated by the marker generation unit for each frame image Then, for the generated composite image of each frame, an expanded composite image is generated by expanding the amplitude of the pixel value of the composite image. The decompressed composite image generated for the image of each frame by the digital watermark marker summation unit is superimposed on the image of each frame of the moving image and the sub watermark marker summation unit using a specific degree of mixing. The digital watermark marker superimposing unit and an embedded image output unit that outputs an image obtained by superimposing the expanded composite image on each frame of the moving image are configured.

  A moving image embedding method according to a sixth aspect of the present invention includes an input moving image including a digital watermark generation unit, a marker generation unit, a digital watermark marker summation unit, a digital watermark marker superimposition unit, and an embedded image output unit A moving image embedding method in a moving image embedding device that outputs an image in which a digital watermark image representing digital watermark information of each frame and a marker image representing a marker of each frame are superimposed on an image of each frame of the image. The digital watermark generation unit generates a digital watermark image representing the digital watermark information of each frame according to the error diffusion method, and the marker generation unit generates a marker image representing the marker of each frame according to the error diffusion method. The digital watermark marker summation unit, for each frame image, the digital watermark image generated by the digital watermark generation unit, Generating a synthesized image obtained by synthesizing the marker image generated by the marker generating unit, and generating an expanded synthesized image in which the amplitude of the pixel value of the synthesized image is expanded for the generated synthesized image of each frame. The digital watermark marker superimposing unit uses the specific mixed degree for the decompressed synthesized image generated for the image of each frame by the digital watermark marker summation unit with respect to the image of each frame of the moving image. The embedded image output unit outputs an image in which the expanded composite image is superimposed on each frame of the moving image.

  According to the fifth and sixth inventions, the digital watermark generation unit generates a digital watermark image representing the digital watermark information of each frame according to the error diffusion method, and the marker generation unit generates the digital watermark image according to the error diffusion method. A marker image representing a marker is generated, and a combined image is generated by combining the generated digital watermark image and the generated marker image with the image of each frame by the digital watermark marker summation unit. For each synthesized image of each frame, an expanded synthesized image in which the amplitude of the pixel value of the synthesized image is expanded is generated, and generated by the digital watermark marker superimposing unit for each frame image with respect to each frame image of the moving image. The stretched composite image is superimposed using a specific degree of mixing, and the stretched composite image for each frame of the moving image is output by the embedded image output unit. And outputs an image obtained by superimposing.

  In this way, a digital watermark image representing the digital watermark information of each frame is generated, a marker image representing the marker of each frame is generated, and the generated digital watermark image is generated for each frame image. A composite image is generated by combining the marker image, and an expanded composite image in which the amplitude of the pixel value of the composite image is expanded is generated for the generated composite image of each frame. A high-resolution moving image is generated by superimposing the expanded composite image generated for each frame image using a specific degree of mixing, and outputting an image in which the expanded composite image is superimposed on each frame of the moving image. It is possible to embed digital watermark information and invisible markers.

  Further, in the moving image embedding device according to the fifth and sixth inventions, the digital watermark marker summing unit calculates, for each frame image, the amplitude of the pixel value of the digital watermark image and the pixel value of the marker image. The composite image may be generated so that a product of a larger one of the amplitudes and a predetermined value becomes the maximum value of the amplitude of the pixel value of the composite image.

  In the moving image embedding device according to the fifth aspect of the invention, the digital watermark marker summation unit is a mixture calculated based on the amplitude of the pixel value of the digital watermark image and the maximum amplitude value of the representable pixel value. The larger mixing degree among the mixing degrees calculated based on the degree, the amplitude of the pixel value of the marker image, and the maximum amplitude value of the representable pixel value may be set as the specific mixing degree.

  The program of the present invention is a program for causing a computer to function as each unit constituting the moving image embedding apparatus.

  As described above, according to the moving image embedding apparatus, method, and program of the present invention, it is possible to embed at least one of digital watermark information and invisible marker in a high-resolution moving image.

It is a figure which shows the example of expansion | extension and return of the amplitude of a pixel value. It is a figure which shows the example of a synthesis | combination with a digital watermark image and a marker image. It is a block diagram which shows the functional structure of the moving image embedding apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart figure showing the moving image embedding process routine in the moving image embedding device which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the functional structure of the moving image embedding apparatus which concerns on the 2nd Embodiment of this invention. It is a flowchart figure showing the moving image embedding process routine in the moving image embedding device which concerns on the 2nd Embodiment of this invention. It is a block diagram which shows the functional structure of the moving image embedding apparatus which concerns on the 3rd Embodiment of this invention. It is a flowchart figure showing the moving image embedding processing routine in the moving image embedding device which concerns on the 3rd Embodiment of this invention. It is a flowchart figure showing the moving image embedding processing routine in the moving image embedding device which concerns on the 3rd Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<Principle of the present invention>

  First, the principle of the moving image embedding device according to the embodiment of the present invention will be described.

  In this embodiment, separately from the video to be embedded, a digital watermark pattern and an invisible marker pattern are generated in advance as video, and the embedding strength (representing the magnitude of the pattern amplitude) is set. Separately generated and added as an α channel.

  Then, the digital watermark pattern video and the invisible marker pattern are added based on the strength of each embedding, and a new appropriate α channel is added again to generate a digital watermark marker combined video. Next, for example, digital watermark information and a marker are superimposed on the video using a device such as a video switcher.

  Here, the video switcher has a function of mixing two videos according to the following equation (1).

  Here, “Input 1” represents an embedding target video, and “Input 2” represents a digital watermark marker combined video. C is a parameter indicating the degree of mixing, defined by 0 or more and 1 or less. “Input 2” represents a digital watermark information video or a marker video when the digital watermark information and the marker are not added together.

  Then, the embedded video is output to a video terminal such as HDMI (registered trademark).

  Here, there are two problems in mixing two images. The first is an error diffusion problem. As a method for expressing a signal component exceeding the bit depth of the video, for example, there is a method of performing error diffusion in the digital watermark generation unit and the marker generation unit so that the signal component exceeding the bit depth of the video can be expressed. (Patent Document 3: Japanese Patent No. 4205737).

  However, a fine pattern due to error diffusion may be crushed at the time of mixing. Therefore, in the present embodiment, a method of error diffusion is devised. Specifically, the above-described α channel is used to appropriately set the parameter c in the above equation (1).

  Therefore, in this embodiment, the digital watermark pattern and the marker pattern are generated so as to have the maximum amplitude. Here, the digital watermark pattern and the marker pattern are finally generated to be equal to the amplitude after mixing by the video switcher, and error diffusion is also performed at the time of the generation.

  Then, as shown in the center of FIG. 1, the generated pattern is expanded so as to have the maximum amplitude. Here, since the α channel reflects information on the embedding strength, the original embedding strength can be reproduced by using the information on the α channel as the parameter c. In other words, since the expanded portion returns to the original strength as shown in the right of FIG. 1 through the α channel, the error diffusion information is not crushed.

  The second problem is that when the digital watermark pattern and the marker pattern are summed, if the sum of the maximum amplitudes of both is normalized so as to be the maximum amplitude after the summation, the contrast of the output video after mixing is increased. There is a risk of unnecessarily large damage. Specifically, it will be whitish and blurry if it is described sensuously. Therefore, in this embodiment, the reduction in contrast is suppressed to the maximum.

  In this embodiment, the general phenomenon that “the sum of the amplitude of the digital watermark pattern and the marker pattern does not necessarily require the sum of the maximum amplitudes of both” is used. In other words, the larger of both amplitudes × constant b (where b ≧ 1) is defined as the maximum amplitude after the summation, and when a value exceeding the maximum amplitude occurs, saturation is performed at the maximum amplitude (maximum amplitude). Replace with value). A specific example is shown in FIG. In the example of FIG. 2, b is 1.

  In the present embodiment, the α channel having the larger amplitude is applied to the α channel. As a result, both detection of digital watermark information and suppression of contrast reduction can be achieved.

<Configuration of Moving Image Embedding Apparatus According to First Embodiment>
Next, the configuration of the moving image embedding device according to the first embodiment of the present invention will be described. As shown in FIG. 3, the moving image embedding device 100 according to the first embodiment of the present invention includes a CPU, a RAM, and a ROM that stores programs and various data for executing a moving image embedding processing routine to be described later. And a computer including Functionally, the moving image embedding device 100 includes an image input unit 10, a calculation unit 20, and an embedded image output unit 90 as shown in FIG. In the first embodiment, the bit depth per channel of the video signal is 8 bits.

  The moving image embedding device 100 according to the first embodiment embeds digital watermark information in which digital watermark information that is an embedded digital watermark pattern also serves as a marker.

  The image input unit 10 accepts live video shot by a video camera or video content prepared in advance (hereinafter referred to as a moving image) as digital data. One frame image is received as a frame image continuous in time series of moving images.

  The calculation unit 20 includes a storage unit 22, a digital watermark generation unit 24, and a digital watermark superimposition unit 26.

The storage unit 22 stores a predetermined amplitude n _w of digital watermark information and an ID number corresponding to the video.

The digital watermark generation unit 24 receives the image input unit 10 based on the size of the moving image received by the image input unit 10 and the amplitude _nw and ID number of the digital watermark information stored in the storage unit 22. For each frame image of the moving image, each of the digital watermark images representing the digital watermark information corresponding to the ID number to be embedded is generated according to the error diffusion method.

  Specifically, first, the digital watermark generation unit 24 uses the digital watermark information embedding method disclosed in Patent Document 1 to generate a flat gray image for each frame image of the moving image received by the image input unit 10. A digital watermark image is generated by superimposing digital watermark information corresponding to the embedding ID number on (an image in which the pixel value of the image is an intermediate value of 128). Here, in the present embodiment, digital watermark information is embedded in an image by the error diffusion method of Patent Document 3 above.

In addition, the digital watermark generation unit 24 inputs information about the watermark strength to the α channel of each pixel of the generated digital watermark image. Specifically, the digital watermark generation unit 24 calculates the mixing degree α _w by the following equation (2), and all the α channels of each pixel of the digital watermark image are calculated by the following equation (2). _{Replace with} the value of αw. Note that it is necessary to normalize the mixing degree α _w according to the bit depth of the moving image received by the image input unit 10. For example, when the bit depth is 8 bits, a value obtained by multiplying the value calculated by the lower expression (2) by 256 is used as the value of the α channel. In the description regarding the α channel, which will be described later, it is assumed that all α channels are normalized, and detailed description thereof is omitted.

Here, _{n w} is the amplitude of the electronic watermark information, _{N w} is the maximum amplitude value watermark image that can be expressed (e.g., if the bit depth of 8bit, the Nw = 256/2 = 128) Represent.

The electronic watermark generating unit 24, for each pixel of the generated electronic watermark image, extending the range of the amplitude of the pixel value of the pixel from the ± n _w to ± N _w. Specifically, as shown in the left of FIG. 1 and the center of FIG. 1, for each pixel, the pixel value range ± n _w of the pixel is expanded to ± N _w that is a representable range. Then, the digital watermark generation unit 24 outputs each expanded digital watermark image in which the value of the α channel is replaced to the digital watermark superimposition unit 26.

  The digital watermark superimposing unit 26 decompresses the expanded digital watermark image corresponding to the image of each frame acquired from the digital watermark generation unit 24 with respect to the image of each frame of the moving image received by the image input unit 10. The image is superimposed using the α channel set in the completed image, and is output to the embedded image output unit 90. Specifically, the digital watermark superimposing unit 26 is a function of mixing two images by the above equation (1) among various functions of the video switcher in order to superimpose the frame image of the moving image and the digital watermark image. (Fader function or keyer function, etc.) is used. Note that the value of c in the above equation (1) uses the value of the α channel embedded in the digital watermark image. As described above, by superimposing the corresponding digital watermark image on the image of each frame of the moving image, the digital watermark information can be superimposed on the moving image received by the image input unit 10.

  The embedded image output unit 90 combines the frame images of the moving image on which the digital watermark information acquired by the digital watermark superimposing unit 26 is superimposed in the order of input, and the digital watermark information is superimposed. A moving image is output as a video signal such as HDMI (registered trademark) or SDI.

<Operation of Moving Image Embedding Device According to First Embodiment>
Next, the operation of the moving image embedding device 100 according to the first embodiment will be described. When the image input unit 10 accepts each frame image continuous in time series for the moving image one by one, the moving image embedding device 100 executes the moving image embedding processing routine shown in FIG.

First, in step S100, the digital watermark generating unit 24, from the storage unit 22, has a predetermined amplitude _nw and a digital watermark represented by an ID number corresponding to each frame image of the moving image received by the image input unit 10. Read information.

  Next, in step S <b> 102, the digital watermark generation unit 24 determines a frame image to be processed among images of each frame received by the image input unit 10.

Next, in step S104, the digital watermark generation unit 24 calculates a digital watermark image corresponding to the frame image to be processed, based on the amplitude _nw and digital watermark information acquired in step S100, according to the error diffusion method. A digital watermark image is generated.

Next, in step S106, the digital watermark generating unit 24, a maximum amplitude value N _w calculated from the bit depth of each frame image of the moving image received by the image input unit 10, an amplitude n _w obtained in step S100 Based on the above, the value of the mixing degree α _w is calculated according to the above equation (2).

Next, in step S108, the digital watermark generation unit 24 obtains the α channel value of each pixel of the digital watermark image corresponding to the processing target frame image acquired in step S104, and the mixing degree α acquired in step S106. _{Replace with} the value of _w .

Next, in step S110, the digital watermark generating unit 24 acquired in step S104, each pixel value from a range ± n _w of the amplitude of the pixels of the electronic watermark image corresponding to the frame image to be processed, in step S106 extending the scope ± N _w of the maximum amplitude values obtained.

  Next, in step S116, the digital watermark superimposing unit 26 acquires, in step S108, the frame image to be processed and the decompressed digital watermark image corresponding to the frame image to be processed acquired in step S110. Based on the value of the α channel, superimposition is performed according to the above equation (1).

  Next, in step S118, the digital watermark superimposing unit 26 determines whether or not the processing in steps S104 to S116 has been completed for all the frame images. If the digital watermark superimposing unit 26 determines that the processing in steps S104 to S116 has been completed for all the frame images, the moving image embedding processing proceeds to step S120. On the other hand, when the digital watermark superimposing unit 26 determines that the processing in steps S104 to S116 has not been completed for all the frame images, the moving image embedding processing proceeds to step S102 and becomes a processing target. A frame image is determined, and the processing from step S104 to step S118 is repeated.

  Next, in step S120, the embedded image output unit 90 combines the frame images obtained by superimposing the digital watermark information acquired in step S116 in the order received by the image input unit 10, and outputs them as moving images. Then, the moving image embedding processing routine is finished.

  As described above, according to the moving image embedding device according to the first embodiment, the digital watermark image representing the digital watermark information of each frame is generated according to the error diffusion method, and the amplitude of the pixel value of the digital watermark image and Based on the maximum amplitude value of pixel values that can be expressed, the degree of mixing is set, and for each digital watermark image of each frame, an expanded digital watermark image in which the amplitude of the pixel value of the digital watermark image is expanded is generated. The expanded digital watermark image generated for the digital watermark image of each frame is superimposed on the image of each frame of the image using the set mixing degree, and the expanded digital watermark image for each frame of the moving image The digital watermark information can be embedded in a high-resolution moving image by outputting an image on which is superimposed.

  Further, it is possible to provide a method for embedding digital watermark information without being perceived by human eyes, and embedding digital watermark information in a real-time video or the like.

  Also, by mixing the original video and the digital watermark information video by the mixer function that is a function of the video switcher, the digital watermark information can be embedded in a high-resolution video in real time.

  Further, by adjusting the ratio of the mix via the α channel, the expanded portion returns to the original strength, and the digital watermark information can be embedded without destroying the error diffusion information.

  Note that the present invention is not limited to the above-described embodiment, and various modifications and applications are possible without departing from the gist of the present invention.

  For example, in the first embodiment, a case has been described in which the bit depth per channel of the video signal is 8 bits. However, the present invention is not limited to this. For example, the bit depth may be another bit. .

  In the first embodiment, the case where the pixel values of digital watermark images corresponding to the same ID number are constant has been described. However, the present invention is not limited to this. For example, the pixel value of each digital watermark image corresponding to the same ID number may be temporally changed.

  In the first embodiment, the case where the information on the α channel is embedded in each pixel has been described. However, the present invention is not limited to this. For example, the α channel data may be stored as a separate file separately from the moving image. However, in this case, a means for synchronizing moving images is required.

  In the first embodiment, a case has been described in which a moving image on which digital watermark information is superimposed is output as a video signal such as HDMI (registered trademark) or SDI. However, the present invention is not limited to this. For example, it may be stored as an image file in an electronic medium such as an HDD.

  In the first embodiment, the case where the embedded position of the digital watermark information is embedded in each frame of the moving image has been described. However, the present invention is not limited to this. For example, it may be embedded in a specific frame of a moving image.

  In the first embodiment, the case where the value of the α channel is calculated according to the above equation (2) has been described. However, the present invention is not limited to this. For example, when the value of the α channel can be a constant value, a numerical value may be manually input.

  Next, a moving image embedding device according to the second embodiment will be described.

  The second embodiment is different from the first embodiment in that only the marker is embedded. In addition, about the structure and effect | action similar to the moving image embedding apparatus based on 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

<Configuration of Moving Image Embedding Device According to Second Embodiment>
Next, the configuration of the moving image embedding device according to the second embodiment of the present invention will be described. As shown in FIG. 5, a moving image embedding device 200 according to the second embodiment of the present invention includes a CPU, a RAM, and a ROM that stores a program and various data for executing a moving image embedding processing routine described later. And a computer including Functionally, the moving image embedding apparatus 100 includes an image input unit 10, a calculation unit 220, and an embedded image output unit 290 as shown in FIG. In the second embodiment, the bit depth per channel of the video signal is 8 bits.

  In the second embodiment, for example, a case where only a marker is necessary and digital watermark information is not necessary in the case where a marker is used as preprocessing for image recognition will be described.

  The calculation unit 220 includes a storage unit 222, a marker generation unit 224, and a marker superimposition unit 226.

The storage unit 222, an amplitude n _m a defined marker is stored in advance.

Marker generating unit 224, the size of the moving image received by the image input unit 10, based on the amplitude n _m of the markers stored in the storage unit 222, each frame image of the moving image received by the image input unit 10 , Each of the marker images representing the markers is generated according to the error diffusion method.

  Specifically, first, the marker generation unit 224 uses, for example, a flat gray image (the image) for each frame image of the moving image received by the image input unit 10 by using the marker embedding method described in Patent Document 2 above. A marker image representing a marker is generated by superimposing a marker on an image whose pixel value is an intermediate value of 128). Here, in the present embodiment, the marker is embedded in the image by the error diffusion method of Patent Document 3 above.

In addition, the marker generation unit 224 inputs information on the marker strength to the α channel of each pixel of the generated marker image. Specifically, the marker generator 224, the degree of mixing alpha _m calculated by the following equation (3), degree of mixing, which is calculated alpha channel of each pixel in all the following equation (3) of each of the marker image alpha _m Replace with the value of. It is necessary to normalize the mixing degree α _m according to the bit depth of the moving image received by the image input unit 10. For example, when the bit depth is 8 bits, a value obtained by multiplying the value calculated by the lower expression (3) by 256 is used as the value of the α channel.

Here, _{n m} is the amplitude of the marker, _{N m} represents the maximum amplitude value marker image can represent (e.g., if the bit depth of _8bit, the N m = 256/2 = 128 ).

Further, the marker generator 224, for each pixel of the generated marker image, extending the range of the amplitude of the pixel value of the pixel from the ± n _m to ± N _m. Specifically, FIG. 1 left, and as shown in FIG. 1 center, for each pixel, extends up to ± N _m is a range that can be expressed a range ± n _m of the pixel values of the pixel. Then, the marker generation unit 224 outputs each expanded marker image in which the α channel value is replaced to the marker superimposing unit 226.

  The marker superimposing unit 226 adds an expanded marker image corresponding to the image of each frame acquired from the marker generation unit 224 to the expanded image for each frame image of the moving image received by the image input unit 10. Superimpose using the set α channel and output to the embedded image output unit 290. Specifically, the marker superimposing unit 226 is a function (fader) that mixes two images according to the above equation (1) among various functions of the video switcher in order to superimpose the frame image of the moving image and the marker image. Function or keyer function). It should be noted that the value of the α channel embedded in the marker image is used as the value of c in the above equation (1). As described above, by superimposing the corresponding marker image on the image of each frame of the moving image, the marker can be superimposed on the moving image received by the image input unit 10.

  The embedded image output unit 290 combines the frame images of the moving image on which the marker acquired by the marker superimposing unit 226 is superimposed in the order of input, and the moving image on which the marker is superimposed is HDMI. (Registered trademark), SDI, etc. are output as video signals.

<Operation of Moving Image Embedding Device According to Second Embodiment>
Next, the operation of the marker embedding device 200 according to the second embodiment will be described. When the image input unit 10 accepts each frame image continuous in time series for the moving image one by one, the moving image embedding device 200 executes a moving image embedding processing routine.

First, in step S200, the marker generator 224, from the storage unit 222, reads the amplitude _{n m} which is determined in advance.

  Next, in step S <b> 202, the marker generation unit 224 determines a frame image to be processed among the images of each frame received by the image input unit 10.

Next, in step S204, the marker generator 224, a marker image corresponding to the frame image to be processed, based on the amplitude n _m obtained in step S200, according to the error diffusion method to generate a marker image.

Next, in step S206, the marker generator 224, and a maximum amplitude value N _m which is calculated from the bit depth of each frame image of the moving image received by the image input unit 10, into an amplitude n _m obtained in step S200 Based on the above equation (3), the value of the mixing degree α _m is calculated.

Next, in step S208, the marker generation unit 224 obtains the α channel value of each pixel of the marker image corresponding to the frame image to be processed, acquired in step S204, of the mixing degree α _m acquired in step S206. Replace with a value.

Next, in step S210, the marker generator 224, acquired in step S204, each pixel value of the marker image corresponding to the frame image to be processed from a range ± n _m of the amplitude of the pixel, acquired in Step S206 Extends to the range of the maximum amplitude value ± N _m .

  Next, in step S216, the marker superimposing unit 226 acquires the frame image to be processed and the expanded marker image corresponding to the frame image to be processed acquired in step S210, the α channel acquired in step S208. Is superimposed according to the above equation (1).

  Next, in step S218, the marker superimposing unit 226 determines whether or not the processing of step S204 to step S216 has been completed for all frame images. When the marker superimposing unit 226 determines that the processing in steps S204 to S216 has been completed for all the frame images, the moving image embedding processing proceeds to step S220. On the other hand, if the marker superimposing unit 226 determines that the processing in steps S204 to S216 has not been completed for all the frame images, the moving image embedding processing proceeds to step S202, and the frame to be processed. An image is determined and the processing from step S204 to step S218 is repeated.

  Next, in step S220, the embedded image output unit 290 combines the frame images obtained by superimposing the markers acquired in step S216 in the order received by the image input unit 10, and outputs them as moving images. The moving image embedding processing routine is terminated.

  As described above, according to the moving image embedding device according to the second embodiment, a marker image representing the marker of each frame is generated according to the error diffusion method, and the pixel value amplitude of the marker image can be expressed. Based on the maximum amplitude value of the pixel value, the degree of mixing is set, and for the marker image of each frame, an expanded marker image is generated by expanding the amplitude of the pixel value of the marker image, and the image of each frame of the moving image is generated. On the other hand, the expanded marker image generated for the marker image of each frame is superimposed using the set degree of mixing, and a high-level image is output by superimposing the expanded marker image for each frame of the moving image. An invisible marker can be embedded in a resolution moving image.

  Further, by mixing the moving image and the marker image by the mixer function which is a function of the video switcher, the marker can be embedded in a high-resolution video in real time.

  Further, by adjusting the ratio of the mix via the α channel, the expanded portion returns to the original strength, and the marker can be embedded without destroying the error diffusion information.

  Further, the marker can be embedded without being perceived by human eyes, and the marker can be embedded in real time in a live video or the like.

  Note that the present invention is not limited to the above-described embodiment, and various modifications and applications are possible without departing from the gist of the present invention.

  For example, in the second embodiment, the case where each pixel value of the marker image is constant has been described. However, the present invention is not limited to this, and the pixel value of each marker image may be temporally varied. .

  In the second embodiment, a case has been described in which a moving image on which a marker is superimposed is output as a video signal such as HDMI (registered trademark) or SDI. However, the present invention is not limited to this. For example, it may be stored as an image file in an electronic medium such as an HDD.

  In the second embodiment, the case where the marker embedding position is embedded in each frame of the moving image has been described. However, the present invention is not limited to this. For example, it may be embedded in a specific frame of a moving image.

  In the second embodiment, the case where the value of the α channel is calculated according to the above equation (3) has been described. However, the present invention is not limited to this. For example, when the value of the α channel can be a constant value, a numerical value may be manually input.

  Next, a moving image embedding device according to a third embodiment will be described.

  The third embodiment is different from the first and second embodiments in that digital watermark information and a marker are embedded. In addition, about the structure and effect | action similar to the moving image embedding apparatus which concerns on 1st and 2nd embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

<Configuration of Moving Image Embedding Device According to Third Embodiment>
Next, the configuration of the moving image embedding device according to the third embodiment of the present invention will be described. As shown in FIG. 7, a moving image embedding device 300 according to the third embodiment of the present invention includes a CPU, a RAM, and a ROM that stores a program and various data for executing a moving image embedding processing routine described later. And a computer including The moving image embedding device 300 functionally includes an image input unit 10, a calculation unit 320, and an embedded image output unit 390 as shown in FIG. In the third embodiment, the bit depth per channel of the video signal is 8 bits.

  In the third embodiment, a case will be described in which the moving image embedding device 300 embeds both digital watermark information and a marker in a moving image.

  The calculation unit 320 includes a storage unit 322, a digital watermark generation unit 323, a marker generation unit 324, a digital watermark marker summation unit 325, and a digital watermark marker superimposition unit 326.

The storage unit 322 stores predetermined digital watermark information amplitude _nw and marker amplitude _nm , an ID number corresponding to a video, and a predetermined parameter b.

The digital watermark generation unit 323 receives the image input unit 10 based on the size of the moving image received by the image input unit 10 and the amplitude _nw and ID number of the digital watermark information stored in the storage unit 322. For each frame image of the moving image, each of the digital watermark images representing the digital watermark information corresponding to the ID number to be embedded is generated according to the error diffusion method.

Marker generating unit 324, the size of the moving image received by the image input unit 10, based on the amplitude n _m of the markers stored in the storage unit 322, each frame image of the moving image received by the image input unit 10 , Each of the marker images representing the markers is generated according to the error diffusion method.

  Based on the parameter b stored in the storage unit 322, the digital watermark marker adding unit 325 acquires each of the digital watermark images acquired by the digital watermark generation unit 323 and the marker generation unit 324 corresponding to the electronic image. Each synthesized image is generated by synthesizing each of the marker images.

Specifically, first, the digital watermark marker summation unit 325 is based on the amplitude n _w of the digital watermark information stored in the storage unit 322 and the amplitude n _{m of} the marker, 5) The range of the amplitude of the composite image is calculated according to the equation.

Next, for each digital watermark image, the digital watermark marker summation unit 325 calculates, for each pixel of the digital watermark image to be processed, the sum of the pixel value of the pixel and the pixel value of the corresponding marker image pixel. Calculate to generate a composite image. Next, when the calculated sum exceeds the value calculated by the above equation (4), the digital watermark marker summing unit 325 determines the pixel value of the target pixel of the composite image as the above equation (4). Replaced with the value of _ng calculated in step (b). On the other hand, when the calculated sum is lower than the value calculated by the above equation (5), the digital watermark marker summing unit 325 determines the pixel value of the target pixel of the composite image by the above equation (5). replace the calculated -n _g. That is, saturation is performed with a value of ± _ng . By performing the above saturation processing, as shown in the right of FIG. 2, the range of the amplitude of the pixel value of the composite image falls within the range of ± _ng .

Then, electronic watermark marker summation unit 325, for each of the saturation synthesis image, extending the amplitude of ± n _g to ± N _g. Here, N _g represents the maximum amplitude value that can be represented by the composite image.

Also, the digital watermark marker summing unit 325 replaces the α channel of each pixel of the expanded composite image with the value of the mixing degree α _g calculated by the following equation (6), and the expanded α channel has been replaced. Each of the synthesized images is output to the digital watermark marker superimposing unit 326. In the following description, it is assumed that the mixing degree α _g calculated by the following equation (6) is normalized.

The digital watermark marker superimposing unit 326 adds an expanded composite image corresponding to the image of each frame acquired from the digital watermark marker adding unit 325 to the image of each frame of the moving image received by the image input unit 10. The image is superimposed using the α channel set in the decompressed composite image, and is output to the embedded image output unit 390. Specifically, the digital watermark marker superimposing unit 326 is a function of mixing two images by the above equation (1) among various functions of the video switcher in order to superimpose a frame image of a moving image and a synthesized image. (Fader function or keyer function, etc.) is used. Note that the value of the α channel embedded in the composite image (mixing degree α _g ) is used as the value of c in the above equation (1). As described above, by superimposing the corresponding composite image on the image of each frame of the moving image, the digital watermark information and the marker can be superimposed on the moving image received by the image input unit 10.

  The embedded image output unit 390 synthesizes the digital watermark information acquired by the digital watermark marker superimposing unit 326 and each frame image of the moving image on which the marker is superimposed in the input order, The moving image on which the marker is superimposed is output as a video signal such as HDMI (registered trademark) or SDI.

<Operation of Moving Image Embedding Device According to Third Embodiment>
Next, the operation of the moving image embedding device 300 according to the third embodiment will be described. When the image input unit 10 receives each frame image that is continuous in time series for the moving image, the moving image embedding device 300 executes the moving image embedding processing routine shown in FIGS. 8 and 9.

First, in step S300 of FIG. 8, the digital watermark generation unit 323, an amplitude n _w and the amplitude n _m of the markers of the electronic watermark information determined in advance from the storage unit 322, and the ID number corresponding to the video, a predetermined Parameter b is read.

  Next, in step S302, a frame to be processed is determined from each frame received by the image input unit 10.

Next, in step S306, the digital watermark marker summing unit 325 calculates _ng according to the above equation (4) based on n _m , n _w , and parameter b acquired in step S300.

Next, in step S308, the electronic watermark marker adder 325, _n m obtained in step S300, _{n w,} based on the parameter b, according to the above (5), calculates the -n _g.

  Next, in step S312, the digital watermark marker adding unit 325 determines a pixel to be processed of the digital watermark image acquired in step S104.

  Next, in step S314, the digital watermark marker adding unit 325 calculates the pixel value of the pixel of the digital watermark image acquired in step S104 and the pixel value of the marker image acquired in step S204 corresponding to the pixel of the digital watermark image. The sum with the pixel value is calculated as the pixel value of the pixel of the composite image, and the process proceeds to step S316 in FIG.

Next, in step S316, the digital watermark marker adding unit 325 determines whether the sum of the pixel values acquired in step S314 is within the range of ± _ng acquired in steps S306 and S308. When the digital watermark marker summation unit 325 determines that the sum of the pixel values is within a range of ± _ng , the digital watermark marker summation unit 325 determines the pixel value as the pixel value of the composite image, Control goes to step S320. On the other hand, if the digital watermark marker adding unit 325 determines that the sum of the pixel values is not within the range of ± _ng , the moving image embedding process proceeds to step S318.

In step S318, the digital watermark marker adding unit 325 converts the pixel value of the pixel to be processed into the value of ± _ng acquired in steps S306 and S308 and the sum of the pixel values acquired in step S314. Based on this, saturation processing is performed, the value subjected to the saturation processing is replaced with the pixel value of the composite image, and the moving image embedding processing proceeds to step S320.

  Next, in step S320, the digital watermark marker adding unit 325 determines whether or not the processing from step S312 to step S316 or step S318 has been completed for all pixels of the digital watermark image acquired in step S104. If the digital watermark marker adding unit 325 determines that the processing from step S312 to step S316 or step S318 has been completed for all the pixels of the digital watermark image acquired in step S104, The process proceeds to S322. On the other hand, when the digital watermark marker adding unit 325 determines that the processing from step S312 to step S316 or step S318 has not been completed for all pixels of the digital watermark image acquired in step S104, FIG. The process proceeds to step S312, the pixel to be processed is changed, and the processes from step S314 to step S320 are repeated.

Next, in step S322, the digital watermark marker summation unit 325 uses the digital watermark image acquired in step S104 and the pixel value of the pixel of the composite image acquired in at least one of step S316 and step S318 in step S104. of the acquired marker images, a large value of the maximum amplitude value which can be expressed as the maximum amplitude value N _g, up to a maximum amplitude value N _g, is extended.

Next, in step S326, the electronic watermark marker summation unit 325, a _{n g} obtained in step S306, based on the _{N g} of the maximum amplitude value acquired in step S322, according to the above (6), degree of mixing α Calculate the value of _g .

Next, in step S328, the digital watermark marker summing unit 325 replaces the α channel value of each pixel of the expanded composite image acquired in step S322 with the value of the mixing degree α _g acquired in step S326.

  Next, in step S332, the digital watermark marker superimposing unit 326 adds the expanded composite image corresponding to the frame image acquired in step S322 to the frame image to be processed and the α channel acquired in step S328. Is superimposed according to the above equation (1).

  Next, in step S334, the digital watermark marker superimposing unit 326 determines whether or not the processing from step S104 to step S332 has been completed for all frame images. If the digital watermark marker superimposing unit 326 determines that the processing from step S104 to step S332 has been completed for all the frame images, the moving image embedding processing proceeds to step S336. On the other hand, if the digital watermark marker superimposing unit 326 determines that the processing from step S104 to step S332 has not been completed for all the frame images, the moving image embedding processing proceeds to step S302 in FIG. The frame image to be processed is determined, and the processing from step S104 to step S334 is repeated.

  Next, in step S336, the embedded image output unit 390 combines the frame images obtained by superimposing the digital watermark information and the markers acquired in step S332 in the order received by the image input unit 10 to obtain a moving image. And the moving image embedding processing routine is terminated.

  As described above, according to the moving image embedding device according to the third embodiment, a digital watermark image representing the digital watermark information of each frame is generated, a marker image representing the marker of each frame is generated, and each frame is generated. A composite image is generated for each of the images, an expanded composite image in which the amplitude of the pixel value is expanded is generated for the generated composite image, the degree of mixing is set, and the image of each frame of the moving image is generated. A high-resolution moving image is generated by superimposing the expanded composite image generated for each frame image using the set mixing degree and outputting an image in which the expanded composite image is superimposed on each frame of the moving image. Digital watermark information and invisible markers can be embedded in the image.

  In addition, by mixing a moving image, a digital watermark image, and a marker image by a mixer function that is a function of a video switcher, a marker can be embedded in a high-resolution video in real time.

  Further, by adjusting the ratio of the mix via the α channel, the expanded portion returns to the original strength, and the digital watermark information and the marker can be embedded without destroying the error diffusion information.

  Further, it is possible to embed digital watermark information and a marker without being perceived by human eyes, and it is possible to embed the digital watermark information and the marker in real time in a live video or the like.

  In addition, when the digital watermark information and the marker are added together, the larger amplitude of both of them × constant b (where b ≧ 1) is defined as the maximum amplitude after addition, and a value exceeding the maximum amplitude is generated. In such a case, saturation with the maximum amplitude enables both detection of digital watermark information and suppression of contrast reduction.

  Also, it is possible to embed digital watermark information and invisible markers in real time using video-related equipment such as a video switcher for high-resolution live video such as 4K / 8K.

  Note that the present invention is not limited to the above-described embodiment, and various modifications and applications are possible without departing from the gist of the present invention.

  For example, in the third embodiment, the case where the pixel values of the digital watermark image and the marker image are constant has been described. However, the present invention is not limited to this. Pixel value may be changed over time

  In the third embodiment, the case where the digital watermark information and the moving image on which the marker is superimposed is output as a video signal such as HDMI (registered trademark) or SDI is described. However, the present invention is not limited to this. is not. For example, it may be stored as an image file in an electronic medium such as an HDD.

  In the third embodiment, the case where the digital watermark information and the marker embedding position are embedded in each frame of the moving image has been described. However, the present invention is not limited to this. For example, it may be embedded in a specific frame of a moving image.

  In the third embodiment, the case where the value of the α channel is calculated according to the above equation (6) has been described. However, the present invention is not limited to this. For example, when the value of the α channel can be a constant value, a numerical value may be manually input.

In the third embodiment, a case is described where, in generating a digital watermark image, the digital watermark image is not expanded using the maximum amplitude value _Nw of the digital watermark image, and the α channel is not replaced. However, the present invention is not limited to this. For example, as in the first embodiment, in generating a digital watermark image, the digital watermark image is expanded using the maximum amplitude value Nw of the digital watermark image, and the α channel of each pixel of the digital watermark image is calculated. They were, may be replaced by a degree of mixing α _w. In this case, at the time of synthesis with the marker image, as shown in the center and right of FIG. 1, each pixel of the digital watermark image is multiplied by the mixing degree α _w to the amplitude of each pixel of the digital watermark image. It is necessary to return the value to the original amplitude.

In the third embodiment, in the generation of the marker image, without extending the marker image using the maximum amplitude value N _m of the marker image, and has described the case of not performing the replacement of α channels, It is not limited to this. For example, as in the second embodiment, in the generation of the marker image, is extended marker image using the maximum amplitude value N _m of the marker image, was calculated each α channel of the pixel of the marker image, mixed The degree α _m may be replaced. In this case, when combining with the digital watermark image, as shown in the center and right of FIG. 1, the pixel value of each pixel of the marker image is multiplied by the mixing degree α _m to the amplitude of each pixel of the marker image. Needs to be restored to the original amplitude.

  Also, a storage medium storing software program codes for realizing the functions of the first to third embodiments is supplied to a system or apparatus, and a program (CPU (MPU)) of the system or apparatus is stored in the storage medium. This can also be realized by reading and executing the code. In that case, the program code itself read from the storage medium realizes the functions of the first to third embodiments described above, and a storage medium storing the program code, such as a CD-ROM or a DVD-ROM. , CD-R, CD-RW, MO, HDD, etc. constitute the above-described present invention.

DESCRIPTION OF SYMBOLS 10 Image input part 20,220,320 Operation part 22,222,322 Storage part 24,323 Digital watermark production | generation part 26 Digital watermark superimposition part 90,290,390 Embedded image output part 100,200,300 Moving image embedding apparatus 224 324 Marker generating unit 226 Marker superimposing unit 325 Digital watermark marker adding unit 326 Digital watermark marker superimposing unit

Claims (10)

A moving image embedding device that outputs an image in which a digital watermark image representing digital watermark information of each frame is superimposed on an image of each frame of an input moving image,
According to the error diffusion method, a digital watermark image representing digital watermark information of each frame is generated, and a digital watermark image is generated by expanding the amplitude of the pixel value of the digital watermark image for the digital watermark image of each frame A generator,
A digital watermark superimposing unit that superimposes the decompressed digital watermark image generated for the digital watermark image of each frame by the digital watermark generation unit on the image of each frame of the moving image using a specific degree of mixing;
An embedded image output unit that outputs an image in which the decompressed digital watermark image is superimposed on each frame of the moving image;
A moving image embedding device. A moving image embedding device that outputs an image in which a marker image representing a marker of each frame is superimposed on an image of each frame of an input moving image,
A marker generation unit that generates a marker image representing a marker of each frame according to an error diffusion method, and generates an expanded marker image in which the amplitude of the pixel value of the marker image is expanded for the marker image of each frame;
A marker superimposing unit that superimposes the expanded marker image generated for the marker image of each frame by the marker generating unit on the image of each frame of the moving image using a specific degree of mixing;
An embedded image output unit that outputs an image in which the expanded marker image is superimposed on each frame of the moving image;
A moving image embedding device. A moving image embedding device that outputs an image in which a digital watermark image representing digital watermark information of each frame and a marker image representing a marker of each frame are superimposed on an image of each frame of the input moving image,
In accordance with an error diffusion method, a digital watermark generation unit that generates a digital watermark image representing the digital watermark information of each frame;
In accordance with an error diffusion method, a marker generation unit that generates a marker image representing a marker of each frame;
For each frame image, a composite image is generated by combining the digital watermark image generated by the digital watermark generation unit and the marker image generated by the marker generation unit, and each of the generated frames Digital watermark marker summing unit for generating an expanded composite image obtained by expanding the amplitude of the pixel value of the composite image,
A digital watermark marker superimposing unit that superimposes the expanded composite image generated for the image of each frame by the digital watermark marker summation unit using a specific degree of mixing on the image of each frame of the moving image;
An embedded image output unit that outputs an image in which the expanded composite image is superimposed on each frame of the moving image;
A moving image embedding device.   The digital watermark marker summation unit calculates, for each frame image, a product of a larger one of the amplitude of the pixel value of the digital watermark image and the amplitude of the pixel value of the marker image and a predetermined value. The moving image embedding device according to claim 3, wherein the synthesized image is generated so as to have a maximum amplitude of pixel values of the synthesized image.   The digital watermark marker summation unit includes a degree of mixing calculated based on the amplitude of the pixel value of the digital watermark image and the maximum amplitude value of the representable pixel value, and the amplitude of the pixel value of the marker image. The moving image embedding apparatus according to claim 4, wherein a mixing degree which is greater among mixing degrees calculated based on a maximum amplitude value of possible pixel values is set as the specific mixing degree. An image in which a digital watermark image representing digital watermark information of each frame is superimposed on an image of each frame of the input moving image, including a digital watermark generation unit, a digital watermark superimposition unit, and an embedded image output unit A moving image embedding method in a moving image embedding device that outputs
The digital watermark generation unit generates a digital watermark image representing the digital watermark information of each frame in accordance with an error diffusion method, and for the digital watermark image of each frame, the expanded digital image obtained by expanding the amplitude of the pixel value of the digital watermark image Generate a watermark image,
The digital watermark superimposing unit superimposes the expanded digital watermark image generated for the digital watermark image of each frame by the digital watermark generation unit on the image of each frame of the moving image using a specific degree of mixing. And
The embedded image output unit outputs an image in which the expanded digital watermark image is superimposed on each frame of the moving image.
Video embedding method. A moving image that outputs an image in which a marker image representing a marker of each frame is superimposed on an image of each frame of the input moving image, including a marker generation unit, a marker superimposing unit, and an embedded image output unit A moving image embedding method in an embedding device,
The marker generation unit generates a marker image representing a marker of each frame according to an error diffusion method, generates an expanded marker image in which the amplitude of the pixel value of the marker image is expanded for the marker image of each frame,
The marker superimposing unit superimposes the expanded marker image generated for the marker image of each frame by the marker generating unit on the image of each frame of the moving image using a specific mixing degree,
The embedded image output unit outputs an image in which the expanded marker image is superimposed on each frame of the moving image.
Video embedding method. Each frame for an image of each frame of the input moving image including a digital watermark generation unit, a marker generation unit, a digital watermark marker summation unit, a digital watermark marker superimposition unit, and an embedded image output unit A moving image embedding method in a moving image embedding device that outputs an image obtained by superimposing a digital watermark image representing the digital watermark information and a marker image representing a marker of each frame,
The digital watermark generation unit generates a digital watermark image representing digital watermark information of each frame according to an error diffusion method,
The marker generation unit generates a marker image representing a marker of each frame according to an error diffusion method,
The digital watermark marker summation unit generates a composite image obtained by synthesizing the digital watermark image generated by the digital watermark generation unit and the marker image generated by the marker generation unit for each frame image. And generating an expanded composite image obtained by expanding the amplitude of the pixel value of the composite image for the generated composite image of each frame,
The digital watermark marker superimposing unit superimposes the decompressed synthesized image generated for the image of each frame by the digital watermark marker summation unit on the image of each frame of the moving image using a specific degree of mixing. And
The embedded image output unit outputs an image obtained by superimposing the expanded composite image on each frame of the moving image.
Video embedding method.   The process of generating the composite image by the digital watermark marker summing unit is performed in advance with respect to the image of each frame, whichever is greater between the amplitude of the pixel value of the digital watermark image and the amplitude of the pixel value of the marker image. 9. The moving image embedding method according to claim 8, wherein the synthesized image is generated so that a product of the determined value is a maximum value of an amplitude of a pixel value of the synthesized image.   The program for functioning a computer as each part which comprises the moving image embedding apparatus of any one of Claims 1-5.