JP2010157914A - Broadcast result acquisition system, information embedding device, information detecting device and broadcast result acquisition method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To confirm that overall broadcast material is broadcasted. <P>SOLUTION: An information embedding device 100 produces embedding broadcast material by embedding a plurality of attribute information items regarding the broadcast material in a predetermined order from the head of the broadcast material to the tail. An information detecting device 200 inputs the embedding broadcast material transmitted by a broadcast sending system 1 and received by a broadcast receiving system 2, detects the plurality of attribute information items in the embedding broadcast material and produces, when the plurality of attribute information items are embedded in the predetermined order in the broadcast material, broadcast result information indicating that the overall broadcast material is broadcasted. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a broadcast performance acquisition system that acquires the broadcast performance of a broadcast material such as a commercial (CM) in terrestrial digital broadcasting or broadcast in IP retransmission, an information embedding device that constitutes the broadcast performance acquisition system, and information detection The present invention relates to a broadcast record acquisition method in the broadcast record acquisition system.

  As a method for obtaining broadcast results of broadcast materials such as CMs, there are methods described in Patent Document 1 and Patent Document 2. In the method described in Patent Document 1, an apparatus on the broadcast receiving side grasps characteristics such as the level of the audio signal and the fundamental frequency in a part of the actually broadcasted broadcast material and prepares the broadcast material prepared in advance. The broadcast material broadcasted is identified by comparing it with master data that summarizes the characteristics of the audio signal.

Further, in the method described in Patent Document 2, a broadcast transmission side device encodes a unique code of a broadcast material, adds it to the broadcast material, and transmits it. On the other hand, when the broadcast receiving device detects a unique code added to the broadcast material when broadcasting the broadcast material, the device determines that the broadcast material has been broadcast.
Japanese Patent No. 3222103 JP 2000-59824 A

  By the way, when the broadcast material is a CM, it is very important that the CM is broadcast not only partially but also from the viewpoint of advertisement effect by the CM. However, in the methods described in Patent Document 1 and Patent Document 2 described above, it is possible to confirm that part of the broadcast material has been broadcast, but it is not possible to confirm that the entire broadcast material has been broadcast. .

  In view of the above problems, an object of the present invention is to provide a broadcast performance acquisition system, an information embedding device, an information detection device, and a broadcast performance acquisition method capable of confirming that the entire broadcast material has been broadcast.

  In order to solve the above-described problems, the present invention has the following features. First, a first aspect of the present invention is a broadcast performance acquisition system that acquires a broadcast performance of a broadcast material, and an information embedding device (information embedding device 100) that embeds information in a broadcast material to be transmitted by a broadcast transmission system. ) And an information detection device (information detection device 200) that is connected to a broadcast receiving system and detects the information embedded in the broadcast material, the information embedding device from the beginning to the end of the broadcast material Information embedding unit (information embedding processing unit 152 and embedded data generating unit 155) for embedding a plurality of attribute information about the broadcast material in a predetermined order and generating an embedded broadcast material, and the information embedding unit. An output unit (signal output unit 159) that outputs the embedded broadcast material, and the information detection device includes the reception system. And an input unit (signal input unit 251) for inputting the embedded broadcast material received by the program, and detecting the plurality of attribute information in the embedded broadcast material input by the input unit. An embedding determination unit (embedding information detection unit 253 and detection information determination unit 254) that determines whether or not attribute information is embedded in the predetermined order, and the embedding determination unit adds the plurality of attribute information to the broadcast material. A broadcast performance information generation unit (detection information determination unit 254) that generates broadcast performance information indicating that the entire broadcast material has been broadcast when it is determined that the broadcast material is embedded in the predetermined order; Is the gist.

  According to such a broadcast record acquisition system, the information embedding device embeds a plurality of attribute information about broadcast material in a predetermined order from the beginning to the end of the broadcast material. On the other hand, when it is determined that a plurality of pieces of attribute information are embedded in a predetermined order in the received broadcast material, the information detection device considers that the entire broadcast material has been broadcast and displays broadcast performance information indicating that fact. Generate. Therefore, it is possible to confirm that the entire broadcast material has been broadcast based on the broadcast performance information.

  A second aspect of the present invention is an information embedding device that embeds information in a broadcast material that is a transmission target of a broadcast transmission system, and includes a plurality of attributes about the broadcast material from the beginning to the end of the broadcast material. The gist includes an information embedding unit that embeds information in a predetermined order and generates an embedded broadcast material, and an output unit that outputs the embedded broadcast material generated by the information embedding unit.

  Such an information embedding device embeds a plurality of pieces of attribute information about broadcast material in a predetermined order from the beginning to the end of the broadcast material. As a result, when the information detection device connected to the broadcast receiving system determines that a plurality of attribute information is embedded in the broadcast material in a predetermined order, the information detection device considers that the entire broadcast material has been broadcast, and accordingly. Broadcast performance information indicating can be generated. Therefore, it is possible to confirm that the entire broadcast material has been broadcast based on the broadcast performance information.

  According to a third aspect of the present invention, the broadcast material is multiplexed with time code information indicating a lapse of time during the broadcast of the broadcast material, and the time code information multiplexed on the broadcast material is detected. A time code information detection unit (time information determination unit 154), and the information embedding unit detects the attribute information by time code information corresponding to a predetermined embedding start timing and the time code information detection unit; The gist of the invention is to start embedding the attribute information in the broadcast material when the time code information matches.

  Such an information embedding device, when time code information corresponding to a predetermined embedding start timing of attribute information matches the time code information detected by the time code information detection unit, By embedding attribute information, the temporal embedding position of the attribute information is accurately determined, and the information detection device accurately identifies the broadcast time of the broadcast material based on the temporal embedding position of the attribute information. It becomes possible to do.

  According to a fourth aspect of the present invention, based on the embedded broadcast material generated by the information embedding unit, it is determined whether or not the attribute information is normally embedded in the broadcast material by the information embedding unit. The gist is to include a normality determination unit (information detection unit 158).

  The gist of a fifth aspect of the present invention is that the information embedding unit embeds digital watermark information corresponding to the attribute information in the broadcast material.

  According to a sixth aspect of the present invention, there is provided an image level detection unit (image analysis processing unit 153) that detects luminance and definition of an image corresponding to the broadcast material, and the broadcast material detected by the image level detection unit. A setting unit (image analysis processing unit 153) that sets the embedding strength of the digital watermark information based on the brightness and definition of the corresponding image, and the information embedding unit sets the embedding set by the setting unit The gist is to embed the digital watermark information in the broadcast material with strength.

  In a seventh aspect of the present invention, the information embedding unit generates a frequency domain image by frequency-converting a predetermined area of the image corresponding to the broadcast material, and the frequency domain image includes a single predetermined frequency component. The gist is to embed the digital watermark information that is a predetermined multiple of the base signal or the digital watermark information that is a predetermined multiple of the sum of the base signals of a plurality of predetermined frequency components.

  The gist of the eighth aspect of the present invention is that the frequency transform is a discrete cosine transform.

  The ninth aspect of the present invention is summarized in that the information embedding unit enlarges the predetermined area as the resolution of an image corresponding to the broadcast material is higher.

  In a tenth aspect of the present invention, the plurality of attribute information includes a head code that is information for identifying a head portion of the broadcast material, a material length code that is information indicating a time length of the broadcast material, and the broadcast The gist consists of a material information code that is material identification information and an end code that is information that makes it possible to identify the last part of the broadcast material.

  An eleventh aspect of the present invention is an information detection device that is connected to a broadcast receiving system and detects information embedded in broadcast material, and an input unit that inputs the embedded broadcast material received by the reception system; The embedded broadcast material is generated by embedding a plurality of attribute information about the broadcast material in a predetermined order from the beginning to the end of the broadcast material, and the embedded broadcast material in the embedded broadcast material input by the input unit An embedding determination unit that detects a plurality of attribute information and determines whether or not the plurality of attribute information is embedded in the predetermined order in the broadcast material; and the embedding determination unit determines the plurality of attributes in the broadcast material. When it is determined that the information is embedded in the predetermined order, broadcast result information indicating that the entire broadcast material has been broadcast is generated. And summarized in that and a broadcast record information generating unit.

  When it is determined that a plurality of attribute information is embedded in the broadcast material in a predetermined order, such an information detection device considers that the entire broadcast material has been broadcast and generates broadcast performance information indicating that fact. . Therefore, it is possible to confirm that the entire broadcast material has been broadcast based on the broadcast performance information.

  A twelfth aspect of the present invention includes a switching timing detection unit (material leading candidate detection unit 252) that detects switching timing of the broadcast material, and the broadcast performance information generation unit is detected by the switching timing detection unit. The predetermined attribute information when a difference between the broadcast material switching timing and the timing of the leading portion of the predetermined attribute information among the plurality of attribute information detected by the embedding determination unit is within a predetermined range. The timing of the head part of the broadcast material is calculated as the broadcast time of the broadcast material, and the broadcast performance information including the broadcast time of the broadcast material is generated.

  Such an information detection apparatus can accurately calculate the broadcast time of the broadcast material, and further, by including the broadcast time of the broadcast material in the broadcast performance information, the broadcast material is based on the broadcast performance information. Can be confirmed.

  In a thirteenth aspect of the present invention, the embedded broadcast material is generated by embedding digital watermark information corresponding to the attribute information in the broadcast material, and the embedding determination unit is the embedding determination unit input by the input unit. The gist is to detect the digital watermark information in a broadcast material.

  According to a fourteenth aspect of the present invention, the embedded broadcast material has a predetermined base signal of a single predetermined frequency component into a frequency domain image generated by performing discrete cosine transform on a predetermined area of the image corresponding to the broadcast material. The digital watermark information that is doubled or generated by embedding the digital watermark information that is a predetermined multiple of the sum of the base signals of a plurality of predetermined frequency components, and the embedding determination unit adds to the image signal corresponding to the predetermined region Discrete cosine transform is performed on the digital watermark information that is a predetermined multiple of the base signal of a single predetermined frequency component or the digital watermark information that is a predetermined multiple of the sum of the base signals of a plurality of predetermined frequency components The gist is to do.

  According to a fifteenth aspect of the present invention, the embedded broadcast material is a frequency domain image generated by frequency-converting a predetermined area of an image corresponding to the broadcast material, and a predetermined multiple of a base signal of a single predetermined frequency component. The digital watermark information, or the digital watermark information that is a predetermined multiple of the sum of base signals of a plurality of predetermined frequency components is embedded and generated, and the embedding determination unit includes an image signal corresponding to the predetermined region, The gist is to detect a correlation coefficient with the base signal used for embedding the digital watermark information as the digital watermark information.

  In a sixteenth aspect of the present invention, the plurality of attribute information includes a head code that is information for identifying a head portion of the broadcast material, a material length code that is information indicating a time length of the broadcast material, and the broadcast The gist consists of a material information code that is material identification information and an end code that is information that makes it possible to identify the last part of the broadcast material.

  According to a seventeenth aspect of the present invention, there is provided an information embedding device for embedding information in a broadcast material to be transmitted by a broadcast transmission system, and information for detecting the information embedded in the broadcast material, connected to a broadcast reception system. A broadcast performance acquisition method in a broadcast performance acquisition system that includes a detection device and acquires the broadcast performance of a broadcast material, wherein the information embedding device includes a plurality of broadcast materials from the beginning to the end of the broadcast material. And embedding the attribute information in a predetermined order to generate an embedded broadcast material, and the information embedding device outputting the generated embedded broadcast material. A step of inputting the received embedded broadcast material; and the information detection device includes the input embedded broadcast element. Detecting the plurality of attribute information in the broadcast material and determining whether or not the plurality of attribute information is embedded in the predetermined order in the broadcast material; and And a step of generating broadcast performance information indicating that the entire broadcast material has been broadcast when it is determined that the attribute information is embedded in the predetermined order.

  According to the present invention, by generating broadcast performance information indicating that the entire broadcast material has been broadcast, it is possible to confirm that the entire broadcast material has been broadcast based on the broadcast performance information. It becomes.

  Next, an embodiment of the present invention will be described with reference to the drawings. Specifically, (1) Configuration and operation of a broadcast performance acquisition system, (2) Actions and effects, and (3) Other embodiments will be described. In the description of the drawings in the following embodiments, the same or similar parts are denoted by the same or similar reference numerals.

(1) Configuration and Operation of Broadcast Performance Acquisition System (1.1) Overall Schematic Configuration and Operation of Broadcast Performance Acquisition System FIG. 1 is an overall schematic configuration of a broadcast system including a broadcast performance acquisition system according to an embodiment of the present invention. FIG.

  As shown in FIG. 1, the broadcast system 10 includes a broadcast transmission system 1, a broadcast reception system 2, an information embedding device 100, and an information detection device 200. The broadcast record acquisition system includes the information embedding device 100 and the information detecting device 200 among the broadcast sending system 1, the broadcast receiving system 2, the video tape 3, the information embedding device 100, and the information detecting device 200. Among these, the information detection apparatus 200 is connected to the broadcast receiving system 2 which is a home television receiver or the like.

  Commercial (CM) broadcast material is stored on the video tape 3 by the information embedding device 100. Here, the video tape 3 means all storage media such as a hard disk and a non-volatile memory, and is not limited to a general video tape. This video tape 3 is conveyed to the broadcast transmission system 1. Further, the CM broadcast material stored on the video tape 3 is reproduced by the broadcast transmission system 1 and transmitted (broadcast) from the broadcast transmission system 1. Further, the CM broadcast material is received by the broadcast receiving system 2 and output from the broadcast receiving system 2 to the information detecting apparatus 200.

(1.2) Configuration and operation of information embedding device Next, regarding the configuration and operation of the information embedding device 100, (1.2.1) Schematic configuration and operation of the information embedding device 100, (1.2.2) Information The detailed configuration and operation of the embedding device 100 will be described in order.

(1.2.1) Schematic Configuration and Operation of Information Embedding Device FIG. 2 is a schematic configuration diagram of the information embedding device 100. As illustrated in FIG. 2, the information embedding device 100 includes a control unit 102, a storage unit 103, an I / F unit 104, and an I / F unit 106.

  The control unit 102 is configured by a CPU, for example, and controls various functions included in the information embedding device 100. The storage unit 103 is configured by a memory, for example. The storage unit 103 stores information used for control and the like in the information embedding device 100.

  The I / F unit 104 is connected to an external device. The I / F unit 104 inputs CM broadcast material from an external device (not shown). The I / F unit 106 outputs CM broadcast material for storage on the video tape 3.

(1.2.2) Detailed Configuration and Operation of Information Embedding Device Next, the detailed configuration and operation of the information embedding device 100, specifically, the functional block configuration and operation of the control unit 102 will be described. FIG. 3 is a functional block configuration diagram of the control unit 102 of the information embedding device 100.

  As illustrated in FIG. 3, the control unit 102 includes a signal input unit 151, an information embedding processing unit 152, an image analysis processing unit 153, a time information determination unit 154, an embedded data generation unit 155, an input / output control unit 156, and an external communication unit. 157, an information detection unit 158, and a signal output unit 159.

  The signal input unit 151 inputs a broadcast material signal including a CM broadcast material to be embedded with information from an external device. The information embedded in the CM broadcast material is a plurality of attribute information related to the CM broadcast material. The format of the broadcast material signal is in the form of a serial digital signal in which time code information and the like are multiplexed by time division multiplexing on a broadcast material composed of images and sound. The time code information is information indicating the passage of time when the CM broadcast material is broadcast.

  The signal input unit 151 generates a clock signal and a synchronization signal based on the input broadcast material signal. Furthermore, the signal input / output unit 151 converts the broadcast material signal into a parallel signal based on the clock signal and the synchronization signal.

  Further, the signal input unit 151 outputs the broadcast material signal converted into the parallel signal to the information embedding processing unit 152, the image analysis processing unit 153, and the time information determination unit 154.

  The image analysis processing unit 153 reads a template (described later) indicating the coordinates of a predetermined area in which information is embedded in an image corresponding to the CM broadcast material included in the broadcast material signal from the storage unit 103. Next, in the image corresponding to the CM broadcast material, the image analysis processing unit 153 selects an image of a predetermined area determined by the coordinates indicated by the template or a predetermined area determined by the coordinates calculated based on the coordinates indicated by the template. Extract images.

  The image analysis processing unit 153 generates a frequency domain image by performing frequency conversion on the extracted image of the predetermined area. Next, the image analysis processing unit 153 sets the embedding strength of the attribute information corresponding to the luminance and definition of the image in the predetermined area indicated by the coefficient value of the frequency domain image. At this time, it is preferable that the image analysis processing unit 153 sets the embedding strength so as to suppress the influence on the image quality as much as possible. The image analysis processing unit 153 outputs the set embedding strength to the embedding data generation unit 155.

  The time information determination unit 154 extracts multiplexed time code information from the broadcast material signal. Further, the time information determination unit 154 outputs the time code information to the embedded data generation unit 155 via the input / output control unit 156.

  The external communication unit 157 inputs a command including CM broadcast material attribute information from an external device. Further, the external communication unit 157 outputs the command to the embedded data generation unit 155 via the input / output control unit 156.

  The embedded data generation unit 155 inputs the embedding strength from the image analysis processing unit 153, the time code information from the time information determination unit 154, and the command from the external communication unit 157. Next, the embedded data generation unit 155 generates time code information of the embedding start timing of each attribute information included in the command based on the time code information. Further, the embedded data generation unit 155 generates digital watermark information corresponding to each attribute information according to the embedding strength.

  FIG. 4 is a diagram illustrating an example of a format of broadcast material, attribute information, and embedding start timing of the attribute information. This example is based on the format of a general CM broadcast material defined by the CM import standards of the Japan Commercial Broadcasters Association and the Japan Advertising Association.

  The broadcast material is composed of credit, first cut, CM broadcast material, and last cut. Credits exist for 12 seconds from 15 seconds to 3 seconds before the timing (IN point) at the top of the CM broadcast material. This credit includes information such as the name, sponsor name, and material length of the CM broadcast material. The first cut exists for 3 seconds after the credit, from 3 seconds before the IN point to the IN point. This first cut is for absorbing timing fluctuation at the time of transmission.

  The CM broadcast material is the main part of the CM, and after the first cut, there are material seconds from the IN point (here, 15 seconds). The last cut exists for 3 seconds after the CM broadcast material, 15 seconds after the IN point.

  The attribute information includes a head code, a material length code, a material information code, and an end code. In the head code, material length code, material information code and end code, corresponding digital watermark information is embedded in the CM broadcast material by the information embedding processing unit 152 in this order.

  The head code is attribute information indicating the head part of the CM broadcast material, and includes an identifier indicating the head code. The digital watermark information corresponding to the head code is the first cut and the CM broadcast in the time zone including the timing (IN point) of the head part of the CM broadcast material, that is, α + β seconds from the IN point−α seconds to the IN point + β seconds. Embedded in the material.

  The material length code is attribute information indicating the time length of the CM broadcast material, and includes an identifier indicating the material length code. The digital watermark information corresponding to the material length code is embedded in the CM broadcast material for γ seconds from IN point + β seconds to IN point + β + γ seconds after the digital watermark information corresponding to the head code.

  The material information code is attribute information as identification information of the CM broadcast material, and includes an identifier indicating the material information code. The digital watermark information corresponding to the material information code is embedded in the CM broadcast material after the digital watermark information corresponding to the material length code, from the IN point + β + γ seconds to the timing of the last cut at the start of −δ seconds.

  The end code is attribute information indicating the last part of the CM broadcast material, and includes an identifier indicating the end code. The digital watermark information corresponding to the end code is, after the digital watermark information corresponding to the material information code, δ + α seconds from the timing of the leading end of the last cut−δ seconds to the leading end of the last cut + α, that is, the leading end of the last cut. It is embedded in the CM broadcast material and the last cut in the time zone including the timing of the part.

  The embedded data generation unit 155 uses the time code information of the embedding start timing of the digital watermark information corresponding to the head code, material length code, material information code, and end code as the number of material seconds that is a parameter of the command from the external device. Calculate in advance based on

  Further, the embedded data generation unit 155 matches the time code information from the time information determination unit 154 with the time code information at the corresponding embedding start timing for each of the head code, material length code, material information code, and end code. At the timing, digital watermark information corresponding to the code is generated and output to the information embedding processing unit 152.

  Also, the embedded data generation unit 155 acquires the frequency domain image generated by the image analysis processing unit 153, and digital watermark information that is a predetermined multiple of the base signal of a single predetermined frequency component in the frequency domain image, or Then, digital watermark information that is a predetermined multiple of the sum of a plurality of predetermined frequency components is generated. In this case, the digital watermark information is MPEG2, H.264, etc. on a broadcast path such as digital broadcast. It becomes difficult to be affected by image compression such as H.264, and compression resistance can be improved.

  The predetermined area corresponding to the frequency domain image is enlarged as the resolution of the CM broadcast material is higher. For example, when the CM broadcast material is in the HD (High Definition) format, the information detection device 200 can also detect the digital watermark information even when the CM broadcast material is down-converted. The corresponding predetermined area is enlarged as compared with the case of SD (Standard-Definition).

  When digital watermark information corresponding to a bit of “0” or “1” is embedded, it is possible to specify a position on an image in which digital watermark information corresponding to each bit is embedded based on a template described later. It is. Alternatively, different digital watermark information can be embedded at the same position on the image by changing the polarity of the waveform pattern of the digital watermark information according to the bit information of “0” or “1”.

  Each time the information embedding processing unit 152 inputs the digital watermark information corresponding to the head code, the material length code, the material information code, and the end code from the embedded data generation unit 155, the input digital watermark information is CM broadcast. Embed in material.

  Specifically, the template stored in the storage unit 103 is a predetermined area that is predetermined as a candidate for an embedded position of digital watermark information in an image corresponding to a CM broadcast material, for example, a digital watermark in the information detection apparatus 200. Indicates the coordinates of the detectable range of information. Note that the information detection apparatus 200 also holds the same template.

  The information embedding processing unit 152 sets a predetermined area determined by coordinates indicated by the template as an embedding position, and adds or subtracts the pixel value of the image in the predetermined area according to the digital watermark information. Alternatively, the information embedding processing unit 152 sets the predetermined area determined by the coordinates calculated based on the coordinates indicated by the template as an embedding position, and adds or adds to the pixel value of the image of the predetermined area according to the digital watermark information. Perform subtraction. In this way, the digital watermark information is embedded in the CM broadcast material. The information embedding processing unit 152 outputs the broadcast material signal (embedded broadcast material signal) in which the digital watermark information is embedded to the signal output unit 159 and the information detection unit 158.

  The template has coordinates of N pattern embedding positions. The information embedding processing unit 152 cyclically selects the coordinates of the embedding positions of these N patterns. Thereby, the embedded position of the digital watermark information changes cyclically in units of N frame images. Therefore, it is possible to prevent the digital watermark information from being intensively embedded in a specific portion of the image, and further to prevent image quality deterioration due to the visual integration effect.

  In the case of television broadcasting, the time may be displayed in a supermarket depending on the broadcast time zone. Therefore, the influence of the time display is suppressed by cyclically changing the embedding position of the digital watermark information in units of N frame images.

  FIG. 5 is a diagram illustrating an example of embedding position candidates when N = 4. When digital watermark information is embedded in the first to fourth frame images, the embedding position in the first frame image is the region 1, the embedding position in the second frame image is in the region 2, and the third frame image. The embedding position is area 3, and the embedding position in the image of the fourth frame is area 4.

  FIG. 5 shows an embedding position corresponding to one piece of information (bit). When a plurality of pieces of information (bits) are embedded, the number of pieces of information or the number of pieces of information is shown. The above embedding positions may exist. A template may be prepared for each attribute information corresponding to embedded digital watermark information.

  In addition, for each of the coordinates of the embedding positions of the N patterns included in the template, a plurality of embedding blocks indicating areas where the coordinates of the embedding positions (reference positions) are shifted by a predetermined shift amount may be configured. In this case, the shift amount corresponding to each embedded block is stored in the storage unit 103.

  FIG. 6 is a diagram illustrating an example of an embedded block. A thin solid line area in FIG. 6 indicates a detectable range of digital watermark information in the information detection apparatus 200. An area surrounded by a thick solid line within the detectable range of the digital watermark information indicates an embedded block. The six embedded blocks # 1 to # 6 shown in FIG. 6 correspond to different shift amounts, and have different positions within the detectable range.

  The information embedding processing unit 152 shifts the reference position of the embedding position from the reference position of the embedding position within the storage unit 103 within the detectable range of the digital watermark information of the image of one frame corresponding to the CM broadcast material. The digital watermark information is embedded in each of the embedded blocks shifted by the amount.

  The signal output unit 159 outputs the embedded broadcast material signal from the information embedding processing unit 152 to the video tape 3 via the I / F unit 106 in order to store the video signal on the video tape 3. The broadcast transmission system 1 reproduces and transmits the embedded broadcast material signal stored in the video tape 3.

  The information detection unit 158 receives the embedded broadcast material signal from the information embedding processing unit 152. Further, the information detection unit 158 determines whether or not the digital watermark information is normally embedded in the CM broadcast material.

  Specifically, the information detection unit 158 determines whether the temporal embedding position of the digital watermark information corresponding to each of the head code, material length code, material information code, and end code is in accordance with FIG. Furthermore, when the temporal embedding position of the digital watermark information does not conform to FIG. 4, the information detection unit 158 notifies the external device of the abnormality via the input / output control unit 156 and the external communication unit 157. As a result, an operator of the external device can recognize the abnormality and can quickly take measures such as re-embedding of the digital watermark information.

(1.3) Configuration and Operation of Information Detection Device Next, regarding the configuration and operation of the information detection device 200, (1.3.1) Schematic configuration and operation of the information detection device 200, (1.3.2) Information The detailed configuration and operation of the detection apparatus 200 will be described in order.

(1.3.1) Schematic Configuration and Operation of Information Detection Device FIG. 7 is a schematic configuration diagram of the information detection device 200. As illustrated in FIG. 7, the information detection apparatus 200 includes a control unit 202, a storage unit 203, and an I / F unit 204.

  The control unit 202 is configured by a CPU, for example, and controls various functions provided in the information detection apparatus 200. The storage unit 203 is configured by a memory, for example. The storage unit 203 stores information used for control and the like in the information detection apparatus 200.

  The I / F unit 204 is connected to the broadcast receiving system 2. The I / F unit 204 inputs an embedded broadcast material signal from the broadcast receiving system 2 and outputs it to the control unit 202.

(1.3.2) Detailed Configuration and Operation of Information Detection Device Next, a detailed configuration and operation of the information detection device 200, specifically, a functional block configuration and operation of the control unit 202 will be described. FIG. 8 is a functional block configuration diagram of the control unit 202 of the information detection apparatus 200.

  As shown in FIG. 8, the control unit 202 includes a signal input unit 251, a material head candidate detection unit 252, an embedded information detection unit 253, a detection information determination unit 254, an input / output control unit 255, and an external communication unit 256.

  The signal input unit 251 inputs an embedded broadcast material signal. The signal input unit 251 includes a converter that performs analog / digital conversion on an image signal and an audio signal included in the embedded broadcast material signal, and a regenerator that reproduces a clock necessary for analog / digital conversion. The signal input unit 251 has a function of detecting a synchronization signal component of an image signal and determining whether the image signal is in the HD format or the SD format.

  In addition, the signal input unit 251 performs processing according to the transmission method, separates the image signal and the audio signal included in the embedded broadcast material signal, and extracts each as a digital signal. Further, the signal input unit 251 outputs the digitized image signal and audio signal to the material leading candidate detection unit 252 and the embedded data detection unit 253 in the subsequent stage.

  The material head candidate detection unit 252 analyzes the image signal and the audio signal from the signal input unit 251 and detects the head candidate of the CM broadcast material. When detecting the head candidate of the CM broadcast material based on the image signal, the material head candidate detection unit 252 detects a scene change that is very likely to occur at the timing when the broadcast material is switched. Also, when detecting the head candidate of the CM broadcast material based on the audio signal, the material head candidate detection unit 252 detects a silent section that is highly likely to occur at the timing when the broadcast material is switched, or such as monaural or stereo Detect changes in voice mode. Here, the scene change and the silent section are 0.5 seconds at the head of the CM broadcast material.

  When the material head candidate detection unit 252 detects the head candidate of the CM broadcast material by the above-described processing, the material head candidate detection unit 252 outputs information (time stamp information) of the time at which the head candidate of the CM broadcast material is detected to the detection information determination unit 254. .

  The embedded information detection unit 253 constantly monitors the image signal from the signal input unit 151 and detects digital watermark information corresponding to the attribute information embedded in the CM broadcast material.

  Specifically, when the digital watermark information shown in FIG. 5 is embedded in the CM broadcast material, the embedded information detection unit 253 indicates the template stored in the storage unit 203 from the image corresponding to the CM broadcast material. A predetermined area (for example, a detectable range) determined by the coordinates to be extracted is extracted. Further, the embedded information detection unit 253 detects the digital watermark information by performing discrete cosine transform on the extracted predetermined region and extracting a frequency component corresponding to the embedding process. Alternatively, the embedded information detection unit 253 detects a correlation coefficient between the image signal corresponding to the extracted predetermined area and the base signal used in the embedding process as digital watermark information corresponding to the attribute information.

  As described above, the embedding position of each attribute information in the image corresponding to the CM broadcast material changes periodically as shown in FIG. 5 according to the template. Therefore, the embedded information detection unit 253 attempts to detect the digital watermark information corresponding to the attribute information at the embedded position of the N patterns stored in the storage unit 203 for each frame of the image corresponding to the CM broadcast material. You can do it.

  When the embedded block shown in FIG. 6 is used for embedding the digital watermark information corresponding to the attribute information, the storage unit 203 stores a shift amount corresponding to each embedded block.

  Then, the embedded information detection unit 253 tries to detect the digital watermark information with the reference position of the corresponding embedded position as the detection position for each shift amount in the image corresponding to the CM broadcast material.

  When the digital watermark information embedded in any of the reference positions of the embedded positions is detected, the embedded information detection unit 253 broadcasts a deviation amount corresponding to the reference position of the embedded position in which the digital watermark information is embedded. Measured as the amount of deviation that occurred on the path. Further, in the subsequent detection of the digital watermark information, the embedded information detection unit 253 detects the digital watermark information by setting the position even from the reference position of the embedded position as the detection position by the measured deviation amount. Thereby, the detection accuracy of digital watermark information can be maintained.

  Each time the embedded information detection unit 253 detects the digital watermark information corresponding to the attribute information, the embedded information detection unit 253 outputs the digital watermark information to the detection information determination unit 254.

  The detection information determination unit 254 inputs time stamp information corresponding to the CM broadcast material head candidate from the material head candidate detection unit 252. Further, the detection information determination unit 254 inputs digital watermark information corresponding to the attribute information.

  Next, the detection information determination unit 254 holds the digital watermark information corresponding to the input attribute information for a time determined according to the number of patterns of embedded position candidates in the template. Further, the detection information determination unit 254 determines the significance of the digital watermark information corresponding to the attribute information.

  As shown in FIG. 5, when the number of patterns of embedding positions in the template is N = 4, the cyclic pattern of embedding positions in units of 4 frame images is “area 1 → area 2 → area 3 → area 4”, There are four patterns of “area 2 → area 3 → area 4 → area 1”, “area 3 → area 4 → area 1 → area 2”, and “area 4 → area 1 → area 2 → area 3”. The detection information determination unit 254 performs a significance determination operation for all these four patterns.

  In four consecutive image frames, the cyclic pattern of the embedded position of the digital watermark information should be one of the four patterns described above. If the digital watermark information is determined to be significant in any of the above four patterns, it can be confirmed that no frame loss or the like has occurred in the CM broadcast material.

  Next, the detection information determination unit 254 determines whether or not the entire CM broadcast material has been broadcast. FIG. 9 is a flowchart showing a process for determining whether or not the entire CM broadcast material has been broadcast. FIG. 10 is a diagram showing an outline of a determination process for determining whether or not the entire CM broadcast material has been broadcast.

  The detection information determination unit 254 determines whether the digital watermark information corresponding to the attribute information has been detected in the order of embedding. Specifically, first, the detection information determination unit 254 determines whether or not a head code has been detected based on the identifier (S101). When the head code is detected, the detection information determination unit 254 determines whether a material length code is detected based on the identifier (S102).

  When the material length code is detected, the detection information determination unit 254 determines whether or not the last part of the material length code is detected within γ seconds after detecting the last part of the head code (S103). When the last part of the material length code is detected within γ seconds after the last part of the head code is detected, the detection information determination unit 254 further sets the time position that is back by β + γ seconds from the timing of the last part of the material length code. Is calculated as the broadcast time of the CM broadcast material (S104).

  Here, the detection of the material length code is performed by determining the significance of the accumulated value of the correlation coefficient between the image signal and the base signal. FIG. 11 is a diagram showing the time transition of the cumulative value of the correlation coefficient for the past γ seconds. As shown in FIG. 11, the timing at which the accumulated value for the past γ seconds is maximized is the timing at the end of the material length code. This is due to the peak in the last part of the material length code, which is the timing at which the accumulated range γ seconds coincides with the time length γ seconds of the material length code.

  By adopting this detection method, the detection information determination unit 254 can detect the last part of the material length code even under conditions in which all the attribute codes cannot be normally detected. Therefore, the detection information determination unit 254 performs the back calculation from the timing of the last part of the material length code, thereby accurately calculating the CM broadcasting material based on the timing of the last part of the leading code and further the timing of the last part of the leading code. Broadcast time can be calculated.

  Furthermore, the detection information determination unit 254 may temporarily store the scene change detected by the head candidate detection unit 252 and the generation time of the silent section. In this case, the detection information determination unit 254 obtains the time position that is back by β + γ seconds from the timing of the last part of the material length code as the timing of the head candidate of the CM broadcast material. Further, the detection information determination unit 254 shifts the reproduction timing at the time of broadcasting when a scene change or a silent section occurs within a range of 0.5 seconds before and after the timing of the head candidate of the obtained CM broadcast material. By absorbing the reproduction time error caused by the above and setting the timing of the head candidate of the CM broadcast material as the broadcast time of the CM broadcast material, it is possible to calculate the broadcast time of the CM broadcast material with very high accuracy.

  After calculating the broadcast time of the CM broadcast material, the detection information determination unit 254 next calculates the last part of the material information code based on the identifier within the time corresponding to the material length from the detection timing of the last part of the material length code. It is determined whether or not it has been detected (S105). When the last part of the material information code is detected, the detection information determination unit 254 next detects the end of the end code based on the identifier within the time corresponding to the material length from the detection timing of the last part of the material length code. It is determined whether or not a part has been detected (S106).

  In S106, the fact that the last part of the end code has been detected means that the digital watermark information corresponding to the attribute information has been detected in the order of embedding. In this case, the detection information determination unit 254 generates broadcast performance information including the calculated broadcast time and the detected material information code (S107). The generated broadcast record information is transmitted to a collection device (not shown) at a predetermined timing. The collection device collects broadcast performance information from the plurality of information detection devices 200, and performs aggregation processing and the like. Note that the information detection apparatus 200 may further generate predetermined total information based on the generated broadcast performance information and transmit the total information to a collection apparatus (not shown).

(2) Action / Effect As described above, according to the broadcast record acquisition system 10 according to the embodiment of the present invention, the information embedding device 100 displays a plurality of attribute information about the CM broadcast material at the head of the CM broadcast material. The information detection apparatus 200 transmits the entire CM broadcast material when a plurality of attribute information is embedded in the predetermined order in the received CM broadcast material. The corresponding broadcast performance information is generated. Therefore, it is possible to confirm that the entire broadcast material has been broadcast based on the broadcast performance information.

  Further, according to the broadcast record acquisition system 10 according to the embodiment of the present invention, the information embedding device 100 determines in advance the corresponding time code information for each of the head code, material length code, material information code, and end code. By generating the digital watermark information corresponding to the code at the timing that matches the embedded time code information of the embedding start timing and embedding the digital watermark information in the CM broadcast material, the temporal embedding position of the attribute information is accurate. The information detection apparatus 200 can accurately specify the broadcast time of the CM broadcast material based on the temporal embedding position of the attribute information.

  Moreover, according to the broadcast performance acquisition system 10 according to the embodiment of the present invention, the information detection apparatus 200 performs a back calculation from the timing of scene change and silent period, which are CM broadcast material switching timing, and the last part of the material length code. If the difference between the timing of the first candidate for the CM broadcast material and the timing of the first candidate for the CM broadcast material is within a range of 0.5 seconds, the timing of the first candidate for the CM broadcast material is set as the broadcast time of the CM broadcast material. It is possible to calculate a very accurate broadcast time for the material.

  In addition, according to the broadcast performance acquisition system 10 according to the embodiment of the present invention, a template indicating coordinates of a predetermined area that is predetermined as a candidate for an embedded position of digital watermark information is provided in an image corresponding to a CM broadcast material. ing. The information embedding device 100 sets a predetermined area determined by coordinates indicated by the template or a predetermined area determined by coordinates calculated based on the coordinates indicated by the template (for example, a detectable range) in the image corresponding to the CM broadcast material. The digital watermark information is embedded in the image of the predetermined area as the embedding position. The template has coordinates of N patterns, and the information embedding device 100 cyclically selects the coordinates of the embedding positions of these N patterns. Therefore, the embedded position of the digital watermark information changes cyclically in units of N frame images. Accordingly, the electronic watermark information is intensively embedded in a specific part of the image, and further, an unnecessary signal is continuously mixed in the embedded position on the broadcast path. It can be suppressed that information cannot be detected. Further, image quality deterioration due to the visual integration effect is prevented.

  In addition, according to the broadcast performance acquisition system 10 according to the embodiment of the present invention, the embedding block indicating the amount of deviation from the reference position is configured for each of the coordinates of the embedding positions of the N patterns included in the template. . The information embedding device 100 embeds digital watermark information in each of the embedding blocks shifted from the reference position of the embedding position in one frame image corresponding to the CM broadcast material. On the other hand, the information detection apparatus 200 tries to detect the digital watermark information using the reference position of the embedded position in the image corresponding to the CM broadcast material as the detection position. When the digital watermark information embedded in any of the reference positions of the embedded positions corresponding to the respective embedded blocks is detected, the information detection apparatus 200 generates a shift amount corresponding to the embedded block on the broadcast path. Measure as deviation. Further, in the subsequent detection of the digital watermark information, the information detection apparatus 200 determines the position shifted from the reference position of the embedding position by the measured deviation amount as the detection position, and detects the digital watermark information. Thereby, the detection accuracy of digital watermark information can be maintained.

(3) Other Embodiments As described above, the present invention has been described according to the embodiment. However, it should not be understood that the description and drawings constituting a part of this disclosure limit the present invention. From this disclosure, various alternative embodiments, examples and operational techniques will be apparent to those skilled in the art.

  In the embodiment described above, it is determined whether or not the entire CM broadcast material is broadcast, but it is also possible to determine whether or not the entire broadcast material other than the CM is broadcast.

  In the above-described embodiment, information is embedded only in an image and the information is detected. However, in addition to an image, information is also obtained in a similar manner for an audio signal and other accompanying signals. By adding an embedding function and a function for detecting information on the receiving side, it is possible to make a determination including both signals.

  Thus, it should be understood that the present invention includes various embodiments and the like not described herein. Therefore, the present invention is limited only by the invention specifying matters in the scope of claims reasonable from this disclosure.

It is a whole schematic block diagram of the broadcast performance acquisition system which concerns on embodiment of this invention. 1 is a schematic configuration diagram of an information embedding device according to an embodiment of the present invention. It is a functional block block diagram of the control part in the information embedding apparatus based on embodiment of this invention. It is a figure which shows an example of the format of broadcast material, attribute information, and the embedding start timing of the attribute information. It is a 1st functional block block diagram of the control part in the wireless base station based on embodiment of this invention. It is a figure which shows an example of an embedding block. It is a schematic block diagram of the information detection apparatus which concerns on embodiment of this invention. It is a functional block block diagram of the control part in the information detection apparatus based on embodiment of this invention. It is a flowchart which shows the determination processing whether the whole CM broadcast material was broadcast. It is a figure which shows the outline of the determination process whether the whole CM broadcast material was broadcast. It is a figure which shows the time transition of the cumulative value of the correlation coefficient for the past γ seconds.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Broadcast transmission system, 2 ... Broadcast receiving system, 3 ... Video tape, 10 ... Broadcast system, 100 ... Information embedding apparatus, 102 ... Control part, 103 ... Memory | storage part, 104 ... I / F part, 106 ... I / F 151, signal input unit, 152 ... information embedding processing unit, 153 ... image analysis processing unit, 154 ... time information embedding determination unit, 155 ... embedded data generation unit, 156 ... input / output control unit, 157 ... external communication unit, 158 ... Information detection unit, 159 ... Signal output unit, 200 ... Information detection device, 202 ... Control unit, 203 ... Storage unit, 204 ... I / F unit, 251 ... Signal input unit, 252 ... Material head candidate detection unit, 253 ... embedded information detection unit, 254 ... detection information determination unit, 255 ... input / output control unit, 256 ... external communication unit

Claims (17)

A broadcast performance acquisition system for acquiring broadcast performance of broadcast materials,
An information embedding device for embedding information in broadcast material to be transmitted by a broadcast transmission system;
An information detection device connected to a broadcast receiving system and detecting the information embedded in the broadcast material;
The information embedding device includes:
An information embedding unit that embeds a plurality of attribute information about the broadcast material in a predetermined order from the beginning to the end of the broadcast material, and generates an embedded broadcast material;
An output unit that outputs the embedded broadcast material generated by the information embedding unit,
The information detection device includes:
An input unit for inputting the embedded broadcast material transmitted by the broadcast transmission system and received by the reception system;
An embedded determination unit that detects the plurality of attribute information in the embedded broadcast material input by the input unit, and determines whether the plurality of attribute information is embedded in the predetermined order in the broadcast material;
Broadcast that generates broadcast performance information indicating that the entire broadcast material has been broadcast when the embedding determination unit determines that the plurality of attribute information is embedded in the broadcast material in the predetermined order. A broadcast record acquisition system comprising a record information generator. An information embedding device that embeds information in broadcast material to be transmitted by a broadcast transmission system,
An information embedding unit that embeds a plurality of attribute information about the broadcast material in a predetermined order from the beginning to the end of the broadcast material, and generates an embedded broadcast material;
An information embedding apparatus comprising: an output unit that outputs the embedded broadcast material generated by the information embedding unit. The broadcast material is multiplexed with time code information indicating the passage of time during the broadcast of the broadcast material,
A time code information detection unit for detecting the time code information multiplexed on the broadcast material;
The information embedding unit, with respect to the attribute information, when the time code information corresponding to a predetermined embedding start timing matches the time code information detected by the time code information detection unit, the broadcast material The information embedding apparatus according to claim 2, wherein the embedding of the attribute information into the is started.   3. A normal determination unit that determines whether or not the attribute information is normally embedded in the broadcast material by the information embedding unit based on the embedded broadcast material generated by the information embedding unit. Or the information embedding device according to 3.   The information embedding device according to claim 2, wherein the information embedding unit embeds digital watermark information corresponding to the attribute information in the broadcast material. An image level detection unit for detecting brightness and definition of an image corresponding to the broadcast material;
A setting unit that sets the embedding strength of the digital watermark information based on the brightness and definition of the image corresponding to the broadcast material detected by the image level detection unit,
The information embedding device according to claim 5, wherein the information embedding unit embeds the digital watermark information in the broadcast material with the embedding strength set by the setting unit.   The information embedding unit is the digital watermark information that is a predetermined multiple of a base signal of a single predetermined frequency component in a frequency domain image generated by frequency-converting a predetermined area of an image corresponding to the broadcast material, or The information embedding apparatus according to claim 4, wherein the digital watermark information that is a predetermined multiple of a sum of base signals of a plurality of predetermined frequency components is embedded.   The information embedding apparatus according to claim 7, wherein the frequency transform is a discrete cosine transform.   The information embedding apparatus according to claim 7 or 8, wherein the information embedding unit enlarges the predetermined area as a resolution of an image corresponding to the broadcast material is higher.   The plurality of attribute information includes a head code that is information for identifying a head portion of the broadcast material, a material length code that is information indicating a time length of the broadcast material, and a material information code that is identification information of the broadcast material. 10. The information embedding device according to claim 2, comprising an end code that is information for identifying the last part of the broadcast material. An information detection device connected to a broadcast receiving system and detecting information embedded in broadcast material,
An input unit for inputting the embedded broadcast material received by the receiving system;
The embedded broadcast material is generated by embedding a plurality of attribute information about the broadcast material in a predetermined order from the beginning to the end of the broadcast material,
An embedded determination unit that detects the plurality of attribute information in the embedded broadcast material input by the input unit, and determines whether the plurality of attribute information is embedded in the predetermined order in the broadcast material;
Broadcast that generates broadcast performance information indicating that the entire broadcast material has been broadcast when the embedding determination unit determines that the plurality of attribute information is embedded in the broadcast material in the predetermined order. An information detection apparatus comprising a record information generation unit. A switching timing detection unit for detecting the switching timing of the broadcast material;
The broadcast record information generation unit is configured to switch the broadcast material detected by the switching timing detection unit, and the timing of the beginning of predetermined attribute information among the plurality of attribute information detected by the embedding determination unit. The timing of the head of the predetermined attribute information is calculated as the broadcast time of the broadcast material, and the broadcast performance information including the broadcast time of the broadcast material is generated. Item 12. The information detection device according to Item 11. The embedded broadcast material is generated by embedding digital watermark information corresponding to the attribute information in the broadcast material,
The information detection device according to claim 11, wherein the embedding determination unit detects the digital watermark information in the embedded broadcast material input by the input unit. The embedded broadcast material is the digital watermark information that is a predetermined multiple of a base signal of a single predetermined frequency component in a frequency domain image generated by performing discrete cosine transform on a predetermined area of the image corresponding to the broadcast material, or , Generated by embedding the digital watermark information that is a predetermined multiple of the sum of the base signals of a plurality of predetermined frequency components,
The embedding determination unit performs discrete cosine transform on an image signal corresponding to the predetermined region, and the digital watermark information that is a predetermined multiple of a base signal of a single predetermined frequency component, or a plurality of predetermined frequency components The information detection apparatus according to claim 13, wherein the digital watermark information that is a predetermined multiple of a sum of base signals is detected. In the embedded broadcast material, the digital watermark information that is a predetermined multiple of a base signal of a single predetermined frequency component in a frequency domain image generated by frequency-converting a predetermined area of an image corresponding to the broadcast material, or Generated by embedding the digital watermark information, which is a predetermined multiple of the sum of the base signals of a plurality of predetermined frequency components,
The information according to claim 13, wherein the embedding determination unit detects a correlation coefficient between an image signal corresponding to the predetermined area and the base signal used for embedding the digital watermark information as the digital watermark information. Detection device.   The plurality of attribute information includes a head code that is information for identifying a head portion of the broadcast material, a material length code that is information indicating a time length of the broadcast material, and a material information code that is identification information of the broadcast material. The information detection apparatus according to claim 11, comprising an end code that is information that enables identification of a last part of the broadcast material. An information embedding device that embeds information in broadcast material that is a transmission target of a broadcast transmission system, and an information detection device that is connected to a broadcast reception system and detects the information embedded in the broadcast material. A broadcast performance acquisition method in a broadcast performance acquisition system that acquires broadcast performance,
The information embedding device embeds a plurality of attribute information about the broadcast material in a predetermined order from the beginning to the end of the broadcast material, and generates an embedded broadcast material;
The information embedding device comprises the step of outputting the generated embedded broadcast material;
The information detecting device inputting the embedded broadcast material received by the receiving system;
The information detection device detecting the plurality of attribute information in the embedded broadcast material input, and determining whether the plurality of attribute information is embedded in the broadcast material in the predetermined order;
When the information detection device determines that the plurality of attribute information are embedded in the broadcast material in the predetermined order, the information detection device generates broadcast performance information indicating that the entire broadcast material has been broadcast. A broadcast performance acquisition method comprising the steps.

Images