JP2016032237A - Broadcast collation device, system, method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To determine the program and/or the advertisement of broadcast content viewing or contacting by means of a terminal, from broadcast start, in short time with high accuracy, and to provide the information related to the program and/or the advertisement to the terminal.SOLUTION: By using an intelligent terminal 10, such as a smart phone having a camera function, a television image under reception is captured and sent to a center apparatus 20. The center apparatus 20 determines from which program a video is captured, or which television advertisement is captured for all (or predetermined) programs and television advertisements, in a short time with high precision, and displays the information related to the program and television advertisement on the intelligent terminal 10.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a broadcast collation apparatus, system, method, and program, and more particularly, to a broadcast collation apparatus and system for quickly identifying the contents of a TV video shot by an intelligent terminal for all TV programs and TV advertisements. And a method and a program.

  If the video and audio of the TV screen acquired with the intelligent terminal are compared with the pre-registered TV programs and TV advertisements using the matching technology, it is clear which program is the video or which advertisement is the video. To do. In fact, systems limited to specific programs and specific advertisements have already been put into practical use, and services have also been realized. By expanding the scope of targeted programs and advertisements in response to the increase in computer processing capacity and the increase in hard disk capacity, it is possible to specify all television broadcasts by this method.

As a prior art, Patent Document 1 discloses a television / commercial automatic identification device that automatically identifies TV / CM regardless of broadcasting means and video format (see summary) A receiving site, an image change creation device, and an audio data processing method are described.
Patent Document 2 describes a page information acquisition method that “automatically checks and searches desired page information related to an image to create page information survey data” (see summary).

JP 2006-237817 A JP 2001-188703 A

  However, in the conventional method as described above, when trying to target all programs, it is not practical because it is necessary to register images of programs of all broadcast stations in advance, and in addition, so-called broadcast images of so-called pre- There is a problem that so-called live programs that are difficult to obtain cannot be targeted. Furthermore, there is a problem that even if the advertisement image of the TV advertisement is known, it is not possible to know which broadcast station has been broadcast. From a marketing point of view, it is important information on which broadcast station the advertisement was broadcast.

  Alternatively, there is a method of determining what was broadcast by embedding a signal in a television program or television advertisement in advance and detecting this signal. In this case, all programs and advertisements can be targeted by embedding signals in advance in all programs and all advertisements before broadcasting. However, broadcasting stations or programs and advertisements for embedding signals in advance are targeted. Work management of companies, etc. is enormous, live programs need to embed signals in real time, some device failure may lead to immediate broadcast failure, and signal embedding itself is the copyrighted work of the program or advertisement It may develop into content related to copyrights, which may be equivalent to the alteration of the company, and the same video, such as a corporate logo, is often used in TV advertisements of the same advertiser. If the video taken with the camera is commonly used, such as a company logo, identifying which advertisement was actually Zukashiku, have also remained in limited use.

In view of the above, the present invention determines a program and / or advertisement of a broadcast / content that is viewed / contacted by a terminal with high accuracy in a short time from the start of broadcasting, and information related to the program and / or advertisement is determined. It is intended to be provided to the terminal.

According to the first solution of the present invention,
The broadcast image or sound corresponding to the broadcast station ID and broadcast date and time of the received broadcast is compared with the advertisement image or sound corresponding to the advertisement code stored in advance, and stored in advance based on the advertisement image or sound advertisement code thus verified. Search system for advertisement information including advertisement code and advertisement related information, and advertisement broadcast history data creation system for creating advertisement broadcast history data including the broadcast image ID and broadcast date and time of the advertisement image or sound collated and advertisement information When,
The terminal receives the screen image or sound being received by the terminal and the terminal ID from the terminal, and compares the screen image or sound with the broadcast image or sound for the broadcast station ID and the broadcast date and time of the received broadcast. A broadcast station determination system that specifies the broadcast station ID and broadcast date and time of the broadcast image or audio that have been verified,
If there is advertisement information of the specified broadcast station ID and the broadcast date and time with reference to the advertisement broadcast history data, the advertisement related information of the advertisement information is transmitted to the terminal, and the advertisement related information is displayed on the terminal. On the other hand, if there is no advertisement information of the specified broadcast station ID and the broadcast date and time, refer to the program broadcast schedule information in which program information including program related information for the broadcast station ID and the broadcast date and time is stored in advance. A broadcast content determination system for transmitting program related information of the specified broadcast station ID and program information broadcast on the broadcast date and time to the terminal, and causing the terminal to display the program related information on a screen;
Is provided.

According to the second solution of the present invention,
A broadcast verification device as described above;
There is provided a broadcast verification system comprising a terminal for receiving a broadcast and displaying the advertisement-related information or the program-related information received from the broadcast verification device on a screen.

According to the third solution of the present invention,
The terminal receives the screen image or sound being received by the terminal and the terminal ID from the terminal, and compares the screen image or sound with the broadcast image or sound for the broadcast station ID and the broadcast date and time of the received broadcast. The broadcast image ID and broadcast date and time of the collated broadcast image or audio are identified,
The broadcast station ID and the broadcast specified by referring to the advertisement broadcast history data including the broadcast station ID and broadcast date and time of the broadcast advertisement image or sound stored in advance and the advertisement information including the advertisement related information. If there is date and time advertisement information, the advertisement related information of the advertisement information is transmitted to the terminal, and the advertisement related information is displayed on the screen, while the specified broadcast station ID and the broadcast date and time advertisement information are displayed. If there is no broadcast station ID and broadcast date and time, the program broadcast schedule information in which program information including program related information is stored in advance is referred to, and the specified broadcast station ID and the program information broadcast on the broadcast date and time Transmitting the program related information to the terminal, and causing the terminal to display the program related information on a screen;
Is provided.

According to the fourth solution of the present invention,
The processing unit receives the screen image or sound being received by the terminal during reception of the broadcast and the terminal ID from the terminal, and the screen image or sound and the broadcast image or sound for the received broadcast station ID and broadcast date and time. And a function of specifying the broadcast image ID and broadcast date and time of the broadcast image or sound that has been verified,
The processing unit is identified by referring to advertisement broadcast history data including pre-stored broadcast image ID and broadcast date and time of broadcast advertisement image or sound and advertisement information including advertisement-related information. If there is a station ID and the advertisement information of the broadcast date and time, the advertisement-related information of the advertisement information is transmitted to the terminal, and the advertisement-related information is displayed on the screen on the terminal, while the specified broadcast station ID and the If there is no advertisement information on the broadcast date and time, the broadcast station ID and the broadcast date and time are broadcast with reference to the broadcast station ID and the broadcast date and time specified with reference to the program broadcast schedule information that stores program information including program related information in advance. Transmitting the program related information of the program information to the terminal, and causing the terminal to display the program related information on a screen;
A broadcast collation program for realizing the above on a computer is provided.

  According to the present invention, it is possible to determine a program and / or advertisement of a broadcast / content that is viewed / contacted on a terminal with high accuracy in a short time from the start of broadcasting, and to provide information related to the program and / or advertisement to the terminal. Can do.

The block diagram of the broadcast collation system of this Embodiment. The block diagram of an intelligent terminal. The block diagram of a television advertisement broadcast history data creation system. The block diagram of a television broadcasting station determination system. The block diagram of a television broadcast content determination system. TV advertising information format. TV program broadcast schedule information format. The hardware block diagram of an intelligent terminal. The hardware block diagram of center apparatus. Match result format. TV advertisement broadcast history data format. TV broadcast content format.

1. Overview

In the present embodiment, in particular, by using an intelligent terminal such as a smartphone having a camera function to shoot a television image being received, it is possible to determine which program or which TV advertisement is the captured video. Whether or not all the programs (or predetermined) programs and TV advertisements are determined with high accuracy in a short time, and information related to the programs and TV advertisements is displayed on the intelligent terminal.

  In the present embodiment, all (or predetermined) programs and all (or predetermined) advertisements in television broadcasting are determined with high accuracy a few seconds after the broadcast is started, and the advertisements and the corresponding programs are determined. Related information can be provided, and at the same time, a viewer's attitude survey on the advertisement or the program can be conducted. If it becomes possible to judge programs and advertisements in a short time with high accuracy, users can search for TV broadcast programs and advertisements that users are currently viewing without having to search for keywords using Internet search and browsing software. For example, it is possible to provide services such as providing information related to the program and the advertisement, guiding to a purchase site, and providing premiums. In addition, regarding various awareness surveys regarding programs and advertisements, it is possible to investigate fresh awareness at the same time as viewing or immediately regarding the programs and advertisements without conducting a subsequent questionnaire survey. In addition, survey contents can be switched depending on the contents of advertisements and programs.

[the term]
In the present embodiment, an image / sound collation technique is used as described below. Normally, when collating images and images or sounds and sounds with collation technology, the original data of images and sounds are not directly compared with each other in order to increase the collation speed. Feature quantity data is created, and feature quantity data are collated. The matching technique used in the present embodiment is the same, but for the sake of simplicity, the expression of feature amount data is kept to the minimum necessary, and the expression “matching images and sounds” is simply used. There is.

  In terms of systems and functions / parts, here, a set of functions / parts is expressed as a system. In an actual system, the arrangement and combination of functions / parts is the required reliability, usage frequency, and response. It can change fluidly depending on speed. Therefore, the system according to the present embodiment is not a fixed system, but is provided for convenience of explanation.

  In this embodiment, television broadcasts are mainly composed of programs and advertisements. This means that if the start time and end time of all TV advertisements can be specified, other times can be regarded as programs. It is supposed to mean that it can be done. Since the program schedule is made public for the program, in this embodiment, when a specific time and broadcasting station are arbitrarily given, if the advertisement is not broadcasted at that time, the program is scheduled from the program schedule. It has been found that it can be specified. In addition, television advertisements are broadcast at a rate of, for example, 20% or less of the total broadcast time, and it has also been found that increasing the recognition accuracy of that part is directly linked to improving the recognition accuracy of all broadcasts.

In this embodiment, image collation technology is mainly used. For example, in order to specify a program or advertisement that is broadcast within a few seconds from the start of broadcasting, it is necessary to perform collation in a short time of several seconds. Even in general images such as mountains and sky, it is not related to which mountain or river image in all broadcasts. For example, in the Kanto area, 4000 types of advertisements are broadcast every month. This means that it is only necessary to determine whether or not there are images of the corresponding mountains and rivers among the 4000 types of advertisements that are repeatedly broadcasted for 20% or less of the broadcast time.

2. Broadcast verification system / equipment

FIG. 1 shows a configuration diagram of the broadcast verification system of the present embodiment. This system includes an intelligent terminal (10), a center device (broadcast collation device) (20), and an external data input device (30), and has the following functions and units. However, FIG. 1 does not show the system implementation form. How each function / unit is arranged in the device / apparatus in each actual system depends on the frequency of use and the required system as described above. It is determined by reliability, response speed, usage frequency, etc.

First, the external data input device (30) inputs some data from the outside so that the broadcast collation system functions (external data input function / unit (100)). That is, the data includes the following.
-TV advertisement image (D12) corresponding to the advertisement code of the TV advertisement that is currently or will be broadcast
TV advertisement information (D13) storing an advertisement code relating to the advertisement image (D12), the advertiser name, the name of the advertised product or service, the advertisement length (seconds), information to be provided to the user, and the like ,
-Stores TV program broadcast station ID (broadcast district code, broadcast station code, etc.), broadcast date and time (broadcast date, broadcast start time, broadcast end time, etc.), program information (program name, information to be provided to users, etc.) TV program broadcast schedule information (D14)

  The TV advertisement image (D12), TV advertisement information (D13), and TV program broadcast schedule information (D14) are stored in an appropriate memory. The TV program broadcast schedule information D14 can be created based on, for example, a program guide published by a broadcasting station or the like and information called PSI / SI sent simultaneously with a broadcast wave. In this embodiment, the data input function / unit uses the external data input function / unit (100). However, the data input function / unit is not limited to an external device, and may be provided inside the center device (20). .

  FIG. 6 shows the format of the television advertisement information. The TV advertisement information (D13) includes an advertisement code, advertisement seconds, an advertiser code, an advertiser name, a product / service code, a product / service name, and TV advertisement-related information (URL of the home page of the advertiser / product / service, etc.) including. Here, as the “TV advertisement related information”, for example, the top page of the advertiser, the URL of a dedicated page related to the advertised product or service, survey information such as attitude survey data / purchase data for the advertisement or product, etc. , Provision information such as merchandise monitor recruitment information and various present information, text information introducing the contents related to the advertisement, and the like can be included.

FIG. 7 shows a format of TV program broadcast schedule information. TV program broadcast schedule information (D14)
Broadcast station ID (broadcast district code, broadcast station code),
Broadcast date and time (broadcast date, broadcast start time, broadcast end time),
Program information (program code, program seconds, program name, program type (sports program / drama program, etc.), broadcast format (regular broadcast / single broadcast, etc.), program related information (program homepage URL, etc.))
including. Here, the “program related information” includes, for example, the URL of the top page of the broadcast station and the dedicated page related to the program, text information introducing the content related to the program, viewer (listener) survey data and viewing of the program. (Listening) It can include contact information such as data, provision information such as viewer present information, and the like.

  These three types of information are appropriately input to the center device (20), and the center device (20) stores these information in the memory (D31, D35, D11), and this system operates. First, an intelligent terminal (10) such as a smartphone uses a TV screen image acquisition / transfer system (101) to acquire an image of a TV screen being received using a camera function / unit, and uses the TV screen image as a data center or the like. To the center device (20) installed in the network via the network. The center device (20) does not directly collate the image sent from the intelligent terminal (10) with the image of the program or TV advertisement, but by the TV broadcasting station determination system (102), when the image is transmitted to which broadcast. The broadcast station ID (broadcast station ID and broadcast date and time) is specified. The number of broadcasting stations is limited, and verification can be performed with images in a very limited range of the past few seconds to several tens of seconds of television broadcasting. Compared with collation, a remarkably high collation accuracy is ensured, and the time required for collation is extremely short.

  Next, based on information on when and at which broadcasting station the center device (20) is broadcast, what is actually broadcast at the broadcasting station at that time and by the TV broadcast content determination system (103) Is identified. The identification method refers to the television advertisement broadcast history data created by the television advertisement broadcast history data creation system (104), and confirms whether or not the television advertisement is broadcast on the broadcast station at that time (details will be described later). The center device (20) determines that the image sent from the intelligent terminal (10) is an image of the television advertisement if the television advertisement is broadcast, adds the necessary information, and adds the necessary information to the intelligent terminal (10). ), The intelligent terminal (10) displays the necessary information on the screen.

The center device (20) determines that the program has been broadcast if the TV advertisement is not broadcast to the broadcast station at the time, and converts the program broadcast at the broadcast station to the external data. The TV program broadcast schedule information (D11) (same content as D14) input by the input function / unit 100 is identified and added, information related to the program is added and returned to the intelligent terminal (10), and the intelligent terminal ( 10) displays necessary information on the screen (details will be described later).
By this method, the center device (20) can specify all programs without registering in advance video and audio of the broadcast program.

3. Intelligent terminal (10)

FIG. 8 shows a hardware configuration diagram of the intelligent terminal.
The intelligent terminal (10) includes a processing unit (11), an input display unit (12), an output unit (13), a communication unit (14), and a memory (15). The processing unit (11) has functions and units described below, and the memory (15) stores information, data, and the like.

FIG. 2 shows a configuration diagram of the intelligent terminal.
The system installed in intelligent terminals (10) such as smartphones, tablet terminals, and notebook computers with built-in camera functions / parts is as follows: TV screen image acquisition / transfer system (101), TV broadcast content acquisition / screen display system (106).

The television screen image acquisition / transfer system (101) has the following functions / units.
The TV screen determination function / unit (200) recognizes the TV screen being received from the image of the camera mounted on the intelligent terminal.
The TV screen image acquisition function / unit (201) acquires the recognized TV screen portion as moving image data or still image data (TV screen image (D21)).
TV screen image feature value data creation function The unit (202) is a feature value data (TV screen image feature value data (D22)) to be used for image or voice collation from the acquired moving picture data or still picture data of the TV screen. Create Here, in order to reduce the transmission amount of data and the communication speed of the acquired moving image data or still image data, the feature data is created on the intelligent terminal (10) side. However, the present invention is not limited to this. The image data may be transmitted to the center side device as it is. Usually, the feature amount data can be a size such as a fraction to a few tenths compared to the original image data or still image data. In the following description, a case where image data is used for collation will be described. However, the present invention and the present embodiment can also be applied to a case where audio data is used for collation. The voice can be recorded with the microphone of the intelligent terminal (10) at the same time when the application of the intelligent terminal (10) is started, or can be recorded when the television is received and the image is acquired. is there. The feature amount data can be created for the sound as well as the image. For voice collation, feature data may be used, or original voice data may be used.
The TV screen image feature data transfer function / unit (203) transfers the image feature data of the TV screen created above to the device (center device (20)) specified in advance together with the terminal ID set in advance. Forward.

The television broadcast content acquisition / screen display system (106) has the following functions and units.
The TV broadcast content reception / display function / unit (204) receives the result of processing by the device installed in the center (center device (20)), that is, the broadcast content information (D23) corresponding to the transmitted TV screen. The TV advertisement related information or the program related information included in the broadcast content information (D23) is displayed on the screen of the intelligent terminal (10).

4). Center equipment (20)

FIG. 9 shows a hardware configuration diagram of the center device.
The center device (20) includes a processing unit (21), an input unit (22), an output unit / display unit (23), a communication unit (24), a memory (25), an interface (I / F) (26), and reception. Part (27). The processing unit (21) has functions and units described below, and the memory (25) stores information, data, and the like.

  As shown in FIG. 1, the system which operates in the center device (20) installed in the data center or the like is roughly divided into three. A television advertisement broadcast history data creation system (104), a television broadcast station determination system (102), and a television broadcast content determination system (103).

FIG. 3 shows a configuration diagram of a television advertisement broadcast history data creation system.
The TV advertisement broadcast history data creation system (104) is a system that operates continuously, for example, 24 hours a day, 365 days a year, and stores data stored therein when requested by the TV broadcast content determination system (103) described later. provide. Alternatively, the television broadcast content determination system (103) acquires data stored in the system as needed.

The television advertisement broadcast history data creation system (104) includes the following functions, a television advertisement image (D31), a television broadcast image (feature amount data) (D32), a television advertisement image (feature amount data) (D33), and a matching result. (D34) and a memory for storing TV advertisement information (D35). The TV advertisement image (D31) and the TV advertisement information (D35) are input from the external data input device (30) into the TV advertisement image (D12) and TV advertisement information (D13), and the center device (20) stores them in the memory. Information.
TV broadcast reception / image division function The unit (301) is equipped with an image capture board for receiving TV broadcasts for a plurality of stations, and the TV images of the plurality of stations sent from the image capture board are short intervals such as several seconds. And converted into feature amount data, and stored in the internal memory together with the broadcast station ID and the broadcast date and time (TV broadcast image (feature amount data) (D32)).
TV advertisement image storage function The unit (302) periodically acquires the TV advertisement image (D31) sent from the external data input function / unit (300) or arranged at a predetermined external location. , Converted into feature data, and stored in the internal memory together with the advertisement code (TV advertisement image (feature data) (D33)).
The television advertisement determination function / unit (303) is, for example, the television broadcast image feature data (D32) held at a short interval of about several seconds as described above, and the television advertisement image (feature data) stored in the internal memory ( D33) and collation result (D34) is held inside.

  FIG. 10 shows the format of the collation result. The collation result (D34) includes the broadcast station ID and broadcast date and time when the television advertisement image (D31) is broadcast as the television broadcast image (D32), and the advertisement code of the television advertisement image (D31). The collation result (D34) may further include the number of advertisement seconds (the number of broadcast seconds).

  Since this function / part holds the advertisement judgment result inside, this function / part is held internally from outside without using the TV advertisement broadcast history data creation function / part described below. It is possible to know which advertisement has been broadcast by referring to the advertisement determination result. However, in the present embodiment, this function / part for determining which advertisement is broadcast is the main point of the whole, and images of the broadcasting station and thousands of kinds of advertisements received at short intervals such as several seconds. If the computer is originally heavily loaded to collate the images and the advertisement judgment result held by this function / part is directly referenced for each user of the intelligent terminal from outside, this function / part Therefore, the use of this function / part is enabled by the TV advertisement broadcast history data creation function by setting up the next TV advertisement broadcast history data creation function / part (304). -Only the part (304) is provided, and the load of this function / part is greatly reduced, and the stability of the entire system is achieved.

  The television advertisement broadcast history data creation function / unit (304) identifies the advertisement finally broadcast on the television based on the above-described comparison result, and creates the television advertisement broadcast history data (D36). By dividing and collating the television broadcast at intervals of several seconds, it is possible to identify an advertisement broadcast as early as several seconds after the advertisement starts. However, if there are a plurality of TV advertisements having the same top image, the above-mentioned TV advertisement determination function / unit (303) outputs a plurality of verification results in the first few seconds of verification. In this case, by collating with the next few seconds, and further with the next few seconds, the collation result is narrowed down as the collation progresses. If the collation result is one, the broadcasted advertisement can be specified even if the broadcast of the advertisement has not ended.

  In the TV advertisement broadcast history data creation function / part (304), in order to specify which advertisement was broadcast as soon as possible, the advertiser code or the advertised product / service code is added to the file name of the accumulated advertisement image. May be embedded. If there are multiple advertisements with the same top image in the first few seconds of matching, multiple matching results will be output. At this time, compare the advertiser codes and products / service codes of the multiple matching results To do. If the plurality of matching results are all the same advertiser code, the advertiser of the broadcast advertisement is specified. If the plurality of matching results are all the same product / service code, the product / service of the broadcast advertisement is specified. If the advertised product or service is specified, it becomes possible to provide information or service related to the advertisement or to conduct an awareness survey. There are many cases in which a 15-second advertisement or a 30-second advertisement with the same video at the beginning of the advertisement is broadcast at the same time in a television advertisement related to the same product or service, and this determination method is effective in that case.

  When the advertisement broadcast on the television is specified in this way, the television advertisement broadcast history data creation function / unit (304) refers to the television advertisement information (D35) and refers to the advertisement code (or the advertiser code or the TV advertisement broadcast history data (D36) by adding the TV advertisement information (advertiser name, product / service name, TV advertisement related information, etc.) acquired based on the product / service code etc. to the broadcast station ID and the broadcast date / time. ) And save it to internal memory.

FIG. 11 shows a format of TV advertisement broadcast history data.
TV advertisement broadcast history data (D36)
Broadcast station ID (broadcast district code, broadcast station code, etc.)
Broadcast date and time (broadcast date, broadcast start time, broadcast end time, etc.),
TV advertisement information (advertising code, number of seconds of advertisement, advertiser code, advertiser name, product / service code, product / service name, TV advertisement related information (URL of website of advertiser / product / service, etc.))
including.

FIG. 4 shows a configuration diagram of a television broadcast station determination system.
The television broadcast station determination system (102) includes the following functions / units, television screen image feature data (D41), a television broadcast image (D42) in which television broadcast images are accumulated, and a determination result (broadcast station ID and broadcast date and time). Etc.) and a memory for storing (D43).

TV broadcast reception / image division function The unit (400) is mounted with an image capture board that receives TV broadcasts for a plurality of stations, and a TV image of a plurality of stations sent from the image capture board is short, for example, about several seconds. Divided into intervals, converted into feature data, and stored in the internal memory together with the broadcast station ID and the broadcast date and time (TV broadcast image (feature data) (D42)). This function / unit is equivalent to the television broadcast reception / image division function / unit (301) in the television advertisement broadcast history data creation system (104) described above.
The TV broadcast station determination function / unit (401) includes the TV screen image feature data (D41) transmitted from the intelligent terminal (10) and the TV broadcast image (features) held at a short interval of about several seconds as described above. Amount data) (D42) to determine when and on which broadcast station the transmitted TV screen image feature amount data was broadcast, and a determination result (broadcast station ID, broadcast date, etc.) ( D43) is held in the internal memory.

FIG. 5 shows a configuration diagram of a television broadcast content determination system.
The television broadcast content determination system (103) includes the following functions / units and a memory for storing the television program broadcast schedule information (D11). The TV program broadcast schedule information (D11) is information stored in the memory by the center device (20) when the TV program broadcast schedule information (D14) is input from the external data input device (30).

  The TV broadcast content determination function / unit (503) determines the determination result (broadcast station ID and broadcast date and time of the TV image) sent from the intelligent terminal (10) determined by the TV broadcast station determination system (102) (D43). Referring to the TV advertisement broadcast history data (D36) created by the TV advertisement broadcast history data creation system (104) based on the above, it is confirmed whether or not the TV advertisement is broadcast on the broadcast station ID and the broadcast station ID. . If a TV advertisement is being broadcast, the terminal ID of the terminal that determines that the TV screen image feature data sent from the intelligent terminal (10) is the TV advertisement and sent the TV screen image feature data. And TV broadcast content D54 including the TV advertisement related information of the TV advertisement stored in the TV advertisement broadcast history data (D36). If a TV advertisement is not broadcast to the broadcast station ID at the broadcast date and time, it is determined that the program has been broadcast, and the program broadcast at the broadcast station ID and the broadcast date and time is converted to an external data input function. TV broadcast including the terminal ID and the program related information of the program stored in the TV program broadcast schedule information (D11), specified with reference to the TV program broadcast schedule information (D11) input by the section (300) Contents (D54) are created.

FIG. 12 shows the format of the television broadcast content.
The TV broadcast content (D54) includes a terminal ID and TV advertisement related information or program related information.

  The TV broadcast transmission function / unit (504) returns the TV broadcast content (D54) to the intelligent terminal (10) with the terminal ID immediately or at a predetermined timing, and the intelligent terminal (10) is related to TV advertisement. Broadcast content information such as information / program related information is displayed on the screen.

  The TV broadcast content reception / display function / unit (204) of the intelligent terminal (10) includes, for example, TV advertisement-related information / program-related information, URLs of homepages of TV advertisers, products / services, etc., or broadcasting stations If the URL of the program homepage is included, the server or homepage can be accessed and displayed on the screen according to the URL, or text, image information (moving image, still image), audio information, etc. are included. Then you can display the information screen.

Moreover, the intelligent terminal (10) appropriately provides, for example, survey information such as attitude survey data / purchase data for advertisements and products, provided information such as product monitor recruitment information and various present information as “TV advertisement related information”. When acquired from a server or another device and displayed on the screen, information on survey information / provided information or the like can be input and transmitted to the center device (20). When the intelligent terminal (10) obtains, for example, contact information / provided information from an appropriate server or other device as a “program related information” and displays it on the screen, it inputs information on the contact information / provided information, etc. And can be transmitted to the center device (20). The center device (20) receives survey information, provided information, information on contact information, and other information from the intelligent terminal (10), performs appropriate tabulation processing as necessary, and stores it in an appropriate memory. Can do.

5). Modifications and supplementary notes

The memory for storing each information / data is not limited to the internal memory, and an appropriate memory can be used. In the above description, processing using an image (image feature amount data) has been particularly described. However, processing using sound (speech feature amount data) may be used. Alternatively, the original image or the original sound may be used without using the image or sound feature data.

  Furthermore, in the above description, television broadcasting has been particularly described. However, the present invention and the present embodiment can be applied not only to television but also to contact such as viewing / listening of various content broadcasts.

  The broadcast verification method or the broadcast verification apparatus / system of the present invention includes a broadcast verification program for causing a computer to execute each procedure, a computer-readable recording medium recording the broadcast verification program, and an internal memory of the computer including the broadcast verification program Can be provided by a program product that can be loaded on the computer, a computer such as a server including the program, and the like.

DESCRIPTION OF SYMBOLS 10 Intelligent terminal 20 Center apparatus 30 External data input apparatus 100 External data input function and part 101 Television screen image acquisition / transfer system 102 Television broadcast station determination system 103 Television broadcast content determination system 104 Television advertisement broadcast history data creation system 106 Television broadcast content Acquisition / screen display system D11 TV program broadcast schedule information D12 Advertisement image D13 TV advertisement information D14 TV program broadcast schedule information

Claims (13)

The broadcast image or sound corresponding to the broadcast station ID and broadcast date and time of the received broadcast is compared with the advertisement image or sound corresponding to the advertisement code stored in advance, and stored in advance based on the advertisement image or sound advertisement code thus verified. Search system for advertisement information including advertisement code and advertisement related information, and advertisement broadcast history data creation system for creating advertisement broadcast history data including the broadcast image ID and broadcast date and time of the advertisement image or sound collated and advertisement information When,
The terminal receives the screen image or sound being received by the terminal and the terminal ID from the terminal, and compares the screen image or sound with the broadcast image or sound for the broadcast station ID and the broadcast date and time of the received broadcast. A broadcast station determination system that specifies the broadcast station ID and broadcast date and time of the broadcast image or audio that have been verified,
If there is advertisement information of the specified broadcast station ID and the broadcast date and time with reference to the advertisement broadcast history data, the advertisement related information of the advertisement information is transmitted to the terminal, and the advertisement related information is displayed on the terminal. On the other hand, if there is no advertisement information of the specified broadcast station ID and the broadcast date and time, refer to the program broadcast schedule information in which program information including program related information for the broadcast station ID and the broadcast date and time is stored in advance. A broadcast content determination system for transmitting program related information of the specified broadcast station ID and program information broadcast on the broadcast date and time to the terminal, and causing the terminal to display the program related information on a screen;
Broadcast collation device with
The broadcast verification device according to claim 1,
The advertisement broadcast history data creation system includes:
The received broadcast image or sound is divided into predetermined time intervals into a plurality of broadcast images or sounds, and the broadcast reception / image or sound is stored in a memory for each broadcast image or sound corresponding to the broadcast station and broadcast date and time. A dividing section;
Each broadcast image or sound is compared with an advertisement image or sound corresponding to a pre-stored advertisement code, the broadcast station ID and broadcast date and time of the verified broadcast image or sound, and the verified advertisement image or sound An ad determination unit for obtaining a determination result including an ad code;
Search advertisement information including advertisement code and advertisement related information stored in advance based on the advertisement code, create advertisement broadcast history data including the broadcast station ID, the broadcast date and time, and advertisement information, and store in the memory An advertisement broadcast history data creation unit,
A broadcast collation device characterized by comprising:
The broadcast verification device according to claim 1 or 2,
The broadcast station determination system divides a received broadcast image or sound into a plurality of broadcast images or sounds by dividing the broadcast image or sound into predetermined time intervals, and stores each broadcast image or sound together with a broadcast station ID and a broadcast date and time. Broadcast reception / image or audio division unit held in
A broadcast station determination unit that compares a screen image or sound received from the terminal with each broadcast image or sound and determines a broadcast station ID and a broadcast date and time corresponding to the verified broadcast image or sound;
A broadcast collation device characterized by comprising:
The broadcast verification device according to any one of claims 1 to 3,
The broadcast content determination system includes:
Based on the broadcast station ID and the broadcast date / time determined by the broadcast station determination system, the advertisement broadcast history data created by the advertisement broadcast history data creation system is referred to and broadcast on the broadcast station ID and the broadcast date / time. If there is advertisement information, broadcast content information including advertisement related information and terminal ID included in the advertisement information is created. On the other hand, if there is no advertisement information broadcast on the broadcast station ID and the broadcast date and time, the program Broadcast content that identifies broadcast program ID and program information that was broadcast at the broadcast date and time by referring to broadcast schedule information, and creates broadcast content information that includes program-related information and terminal ID included in the program information A determination unit;
A broadcast verification apparatus comprising: a broadcast content transmission unit configured to transmit the broadcast content information to the terminal and cause the terminal to display the broadcast content information on a screen.
The broadcast verification device according to any one of claims 1 to 4,
The image or sound data is feature amount data,
The broadcast collation apparatus, wherein the broadcast station determination system or the advertisement broadcast history data creation system converts an image or sound into feature amount data and collates the feature amount data.
The broadcast verification device according to claim 1,
The broadcast collating apparatus, wherein the image or the image of the audio data is a moving image or a still image.
The broadcast verification device according to claim 1,
A broadcast verification system comprising: a terminal for receiving a broadcast and displaying the advertisement-related information or the program-related information received from the broadcast verification device on a screen.
The broadcast verification system according to claim 7,
The terminal
A screen image or sound acquisition unit for acquiring a screen image or sound;
A screen image or voice feature quantity data creation unit for creating feature quantity data for use in image or voice collation from the acquired screen image or voice;
A screen image or audio feature data transfer unit for transferring the feature data to the broadcast verification device;
From the broadcast verification device, broadcast content information including advertisement related information or program related information corresponding to the screen image or sound, and a broadcast content receiving / display unit for displaying the broadcast content information on the screen;
A broadcast verification system characterized by comprising:
The broadcast verification system according to claim 7 or 8,
The terminal accesses the server or other device according to the URL or the information included in the advertisement-related information or program-related information, or the information specifying the homepage, and the broadcast content reception / display unit displays the screen, or the advertisement-related A broadcast collation system, wherein the broadcast content reception / display unit displays text, image, or audio information included in information or program-related information on a screen.
The broadcast verification system according to any one of claims 7 to 9,
The terminal inputs information on survey information or provided information or contact information based on advertisement-related information or program-related information displayed on the screen by accessing a server or other device, and transmits the information to the broadcast verification device.
The broadcast verification device receives survey information, provided information or contact information from the terminal and stores it in a memory.
The broadcast verification system according to any one of claims 7 to 10,
The advertising image or sound for the advertising code;
The advertising information including an advertising code and advertising related information;
The program broadcast schedule information including broadcast station ID and broadcast date and time, program information including program related information, and
Is further stored in advance, and further includes an external data input device for outputting to the broadcast content determination system or the advertisement broadcast history data creation system.
The terminal receives the screen image or sound being received by the terminal and the terminal ID from the terminal, and compares the screen image or sound with the broadcast image or sound for the broadcast station ID and the broadcast date and time of the received broadcast. The broadcast image ID and broadcast date and time of the collated broadcast image or audio are identified,
The broadcast station ID and the broadcast specified by referring to the advertisement broadcast history data including the broadcast station ID and broadcast date and time of the broadcast advertisement image or sound stored in advance and the advertisement information including the advertisement related information. If there is date and time advertisement information, the advertisement related information of the advertisement information is transmitted to the terminal, and the advertisement related information is displayed on the screen, while the specified broadcast station ID and the broadcast date and time advertisement information are displayed. If there is no broadcast station ID and broadcast date and time, the program broadcast schedule information in which program information including program related information is stored in advance is referred to, and the specified broadcast station ID and the program information broadcast on the broadcast date and time Transmitting the program related information to the terminal, and causing the terminal to display the program related information on a screen;
Broadcast verification method with
The processing unit receives the screen image or sound being received by the terminal during reception of the broadcast and the terminal ID from the terminal, and the screen image or sound and the broadcast image or sound for the received broadcast station ID and broadcast date and time. And a function of specifying the broadcast image ID and broadcast date and time of the broadcast image or sound that has been verified,
The processing unit is identified by referring to advertisement broadcast history data including pre-stored broadcast image ID and broadcast date and time of broadcast advertisement image or sound and advertisement information including advertisement-related information. If there is a station ID and the advertisement information of the broadcast date and time, the advertisement-related information of the advertisement information is transmitted to the terminal, and the advertisement-related information is displayed on the screen on the terminal, while the specified broadcast station ID and the If there is no advertisement information on the broadcast date and time, the broadcast station ID and the broadcast date and time are broadcast with reference to the broadcast station ID and the broadcast date and time specified with reference to the program broadcast schedule information that stores program information including program related information in advance. Transmitting the program related information of the program information to the terminal, and causing the terminal to display the program related information on a screen;
Broadcast collation program for realizing computer.

Images