JP5726359B1 - Television program-related content providing system and providing method - Google Patents

Abstract

Provided is content related to program content almost simultaneously with the progress of a television program. A system server 1 is connected to a user terminal 3 of a user who is viewing a television program on a television program display device 2 via a communication network. If the video acquired from the broadcasting station 4 is a CM, the server 1 sends content related to the CM to the user terminal 3. Further, keywords included in subtitle information and video acquired from the broadcasting station 4 are extracted, and if a content related to the extracted keyword is produced, the keyword and the URL of the content are transmitted to the user terminal 3. . Furthermore, if advertising content linked to the keyword is submitted, the URL of the advertising content selected in consideration of the advertising profitability score is sent to the user terminal 3. [Selection] Figure 1

Description

  The present invention relates to a technique for providing content related to a television program.

It is convenient if words or topics that you are interested in appearing while watching TV appear and can be examined immediately on the spot. For example, in the case of a variety program, the clothes and accessories worn by the talent; I want to know more widely and deeply. The information that TV provides to viewers is enormous, and viewers' interests change with the contents of the broadcast, and there is a tendency that interest in one matter does not last long. Also, even if you try to check the words you are interested in on the search site, you may not be able to enter an accurate search keyword because of the lack of knowledge.
In view of this, a plurality of patent applications have been filed for systems that allow timely provision of information on topics and words that the viewer is interested in while watching a television broadcast.

For example, Patent Document 1 discloses an information processing that can display a keyword list related to words or topics that the user is interested in in information appearing in a program that is being viewed, and that can be used to search for information from the Internet. An apparatus is disclosed.
Patent Document 2 discloses a system and method capable of receiving information related to a TV program being viewed by a mobile terminal.

JP2013-59038A JP 2013-258439 A

According to the information processing apparatus described in Patent Document 1, if you want to acquire more information about a word or topic you are interested in while watching TV on a personal computer, Press the button you are interested in. When the “interesting button” is pressed, a keyword list is extracted from the document information for a certain period of time immediately before, and the viewer can acquire information by selecting a keyword from this list. However, there is a problem that information cannot be retrieved at all if the user is forgotten to press the “interesting button”.
In view of this problem, an object of the present invention is to provide a mechanism in which a keyword that is anxious can be automatically displayed on the screen without any operation by a viewer and information related to the displayed keyword can be easily obtained. And

A major feature of the system described in Patent Document 2 is a mechanism for outputting content by specifying a timeline (elapsed time from the start of a program). This requires preparation based on the contents of the program in advance.
Accordingly, an object of the present invention is to provide a mechanism that can distribute appropriate keywords according to the progress of a program to viewers without any prior preparation.

In order to achieve the above object, a television program related content providing system according to claim 1 comprises:
A system for providing information related to a TV program (including CM) to a user terminal of a user or a TV program display device via a communication network,
A user input information receiving unit for receiving broadcast station specifying information (eg, channel number) for specifying a broadcast station from the user terminal or the television program display device;
Received packet analysis unit that acquires broadcast data from broadcast station and breaks it down into various packets,
And a related information sending unit for sending information related to information contained in the various packets acquired from the broadcasting station corresponding to the broadcasting station specifying information to the user terminal or the television program display device.
The related information sending unit includes at least one of a live keyword tag sending unit, an advertisement tag sending unit, and a synchronized CM sending unit,
The live keyword tag sending unit sends a live keyword tag to which a live keyword extracted from character information included in the various packets is attached,
The advertisement tag sending unit sends out an advertisement tag with a character string linked to the live keyword,
The sync CM sending unit provides CM sync contents related to CM data included in the various packets.

The information related to the television program of the present invention is displayed on the screen by at least one of the user terminal of the user and the television program display device. That is, the television program related information may be displayed only on the user terminal, displayed only on the television program display device, or displayed on both the user terminal and the television program display device. In the following embodiment, the user terminal may be referred to as a second screen. The present invention is intended to be used by a user who is watching a television. However, when the user does not actually watch the television such as when going out, it is possible to designate a broadcast station of interest and display information related to the broadcast content on the portable terminal. It is also possible to designate a broadcast station different from the broadcast station that is actually viewed and display information related to the current broadcast content of the broadcast station. Further, it can be used by a user who watches a time-shifted program already broadcast.
The present invention is a system that provides information via a communication network, and “via a communication network” has a plurality of aspects. Information is typically provided via the Internet, but information may be provided on radio waves transmitted by a broadcasting station.
In the present invention, methods for acquiring broadcast data include a method of acquiring wirelessly from a broadcast station via a wired or broadcast wave transmitting antenna, a method of acquiring broadcast data provided by a server of the broadcast station, and the like.

In order to achieve the above object, a television program related content providing system according to claim 2 comprises:
A system for providing information relevant to a TV program to a program viewer via a communication network and an external system,
Received packet analysis unit that acquires broadcast data from broadcast station and breaks it down into various packets,
A related information sending unit for sending information related to information contained in the various packets to the external system is provided.
The related information sending unit includes at least one of a live keyword tag sending unit, an advertisement tag sending unit, and a sync CM sending unit, and the live keyword tag sending unit is a live keyword extracted from character information included in the various packets. Is sent, and the advertisement tag sending unit sends an advertisement tag with a character string linked to the live keyword or a character string linked to a character string acquired from the external system. The sync CM sending unit provides CM sync contents related to CM data included in the various packets.
The invention according to claim 1 provides information directly to a user, whereas the invention according to claim 2 provides information to an external system. The provided information is provided to the program viewer who is the user by an external system. Here, “program viewer” is not limited to those who are actually watching the program, but also includes those who are interested in the program after listening to the viewer ’s opinions and reputation about the program. .

When the related information sending unit of the present invention includes a live keyword tag sending unit,
The system of the present invention includes a live keyword tag database that stores a live keyword tag that associates a live keyword with address information of related content of the live keyword,
The live keyword tag sending unit extracts a character string from character information included in broadcast data acquired from a broadcasting station, and if a live keyword matching the extracted character string is stored in the live keyword tag database, The live keyword and related content address information are transmitted.
When the related information sending unit of the present invention includes an advertisement tag sending unit,
The system of the present invention includes an advertisement tag database and an advertisement tag score creation unit,
The advertisement tag database stores an advertisement tag that associates a character string for advertisement posting with address information of advertisement content related to the character string,
The advertisement tag score creating unit generates an advertisement tag posting score based on a bid price of a character string for advertisement posting,
The advertisement tag transmission unit selects an advertisement tag to be transmitted based on the advertisement tag posting score, and transmits a character string attached to the selected advertisement tag and address information of advertisement content related to the character string. .

The “tag” in the present invention is a virtual tag (small piece) to which a character string that expresses the semantic content of the content is attached, and is inseparable from the address information of the content. The character string attached to the tag is displayed on the screen of the user terminal or the TV program display device. When this character string is selected by an operation such as tapping on the display screen, the content of the address information sent earlier is transmitted. come. In other words, the “tag” of the present invention serves to make an image of a tag attached to a tangible product displayed at a storefront for content that is intangible data.
“Address information” is generally a so-called URL indicating the location of content on the Internet.

When the related information sending unit of the present invention includes a synchronized CM sending unit,
The system of the present invention further includes a CM database and a CM identification unit,
The CM database stores still image feature point data extracted from television advertisement data (hereinafter, “CM data”) and address information of CM synchronized content related to the CM data,
The CM identification unit collates the feature point data stored in the CM database with the feature point data of still images extracted at predetermined intervals from video information included in the broadcast data acquired from the broadcast station. While identifying CM data,
The synchronized CM transmission unit transmits CM synchronized content associated with the identified CM data.

In the present invention, information relating to a user of the user is stored in association with information for identifying the user (for example, information relating to the user's age (eg, age range such as birth year, early 30's), gender, broadcast area, etc.) User information database
The user-related information not only includes the received user's personal information, but also categorizes the user into one of a plurality of user groups based on the received user's personal information, and this categorized user group Is included,
When the related information sending unit sends information related to the information included in the various packets acquired from the broadcast station corresponding to the broadcast station specifying information to the user terminal or the television program display device, It is also preferable to refer to information about the user extracted from the user information database. Further, when categorizing the user into any user group, it is preferable to refer to the total result of the access status from the user for the information transmitted by the related information transmission unit.

The present invention further includes a shooting data receiving unit and a program identification unit,
Instead of receiving broadcast station specific information from the user terminal or television program display device,
The user terminal captures the moving image displayed on the screen of the television program display device, and the captured data reception unit receives the feature point data calculated for the still image extracted from the captured moving image from the user terminal. Then, the program identification unit collates the feature point data calculated for the still image extracted from the video information included in the broadcast data and the feature point data received from the user terminal, and if the degree of coincidence is a predetermined value or more. For example, the broadcast station that the user is currently viewing may be identified.

In the present invention, when the user input information receiving unit receives information specifying a program instead of or together with the broadcasting station specifying information, the related information sending unit corresponds to the specified program. Information related to information included in various packets to be transmitted may be transmitted.
Accordingly, it is possible to receive a live keyword tag, an advertisement tag, or CM-synchronized content associated with a program that is of interest to the user regardless of viewing.

  The present invention further includes a natural language processing unit that extracts a keyword from character information included in the broadcast data, and the character information is caption information. The text information may include telop information extracted by video recognition from video information included in the broadcast data, or may include a speech recognition processing result of the speech information included in the broadcast data. The keyword extraction by the natural language processing unit may be performed by morphological analysis using various dictionaries including a fluctuation dictionary.

In the present invention, the advertisement tag score creating unit calculates an advertisement tag posting score for each advertisement tag based on a recommendation score determined based on a recommendation algorithm and a bid price of the advertisement tag, and the advertisement tag sending unit When sending a tag, it is preferable to preferentially select an advertisement tag having a high calculated advertisement tag posting score as a sending target in principle. Here, the advertisement tag score creating unit is configured to categorize the advertisement tag by category based on the result of counting the access status to the content (related content associated with the live keyword tag, advertisement content, or CM synchronized content). A recommendation score may be determined .
The advertisement tag posting score calculated by multiplying the recommendation score and the bid price is referred to as “advertisement profitability score” in the following embodiment.
In addition, when the live keyword tag is sent by the live keyword tag sending unit, when the advertisement tag is also sent by the advertisement tag sending unit, the number of live keyword tags to be sent using a dynamic programming algorithm It is preferable that the ratio of the number of advertisement tags to be within a predetermined range (e.g., no more than 2 advertisement tags for 10 live keyword tags).

  In the present invention, content (related content associated with a live keyword tag, advertising content, or CM-synchronized content) included in the information provided by the related information sending unit is one-way information provision. It is preferable to include not only what is said to be, but also interactive contents represented by issuance of questionnaires and coupons.

  The invention of the television program related content providing method according to claims 18 to 22 also achieves the above-mentioned problem.

  A viewer of a television program can access content related to topics and words that appear in the program via a user terminal or a television program display device, so that the enjoyment of the television program is wider than before. For broadcasters and system operators, there is an opportunity to earn new advertising revenue.

It is a figure which shows the system configuration | structure of the 1st Embodiment of this invention. It is a figure which shows the functional block structure of the user terminal of the embodiment. It is a figure which shows the functional block structure of the television program related content provision apparatus (henceforth "related content provision apparatus") of the embodiment. It is a figure explaining the data structural example of user information DB of the embodiment. It is a figure explaining the data structural example of CM-DB of the embodiment. It is a figure explaining the data structural example of live keyword tag DB of the embodiment. It is a figure explaining the example of a data structure of advertisement tag DB of the embodiment. It is a figure explaining the process performed by the related content provision apparatus of the embodiment, and the flow of data. It is a figure explaining the sending process of the live keyword tag and advertisement tag of the same embodiment, and an advertisement tag posting score table creation process. It is a figure which illustrates the recommendation score table | surface of the embodiment. It is a figure which illustrates the advertisement tag posting score table of the embodiment. In order to explain the processing of the embodiment, (1) is the content of the received broadcast radio wave, (2) is the process that is sequentially performed on the received broadcast radio wave, and (3) is a diagram showing a screen display example of the user terminal. . It is a figure which shows the example of a screen display when a user terminal of the embodiment specifies a channel immediately after starting an application. It is a figure which shows the functional block structure of the related content provision apparatus of 2nd Embodiment. It is a figure which shows the system configuration | structure of 3rd Embodiment. It is a figure explaining each function of the television broadcast receiver which comprises the related content provision apparatus of the embodiment, and a tag transmission apparatus. It is a figure explaining the process of implement | achieving cooperation operation | movement with a television program display apparatus and a user terminal while showing the system configuration | structure of 4th Embodiment. It is a figure which shows the system configuration | structure of 5th Embodiment.

<< First Embodiment >>
Embodiments of a television program-related content providing system (hereinafter referred to as “the present system”) according to the present invention will be described below in detail with reference to the accompanying drawings. The configuration of the description of the present embodiment is as follows.
<< 1. Overview of this system >>
<< 2. Configuration of this system >>
<< 2-1. Configuration of user terminal >>
<< 2-2. Configuration of Related Content Providing Device >>
<< 3. Operation of this system >>
<< 3.1. Live keyword tag transmission and advertisement tag transmission processing >>
<< 3.2. Processing sequentially performed on received broadcast data >>
<< 3.3. Related information provision processing to user terminals >>

<< 1. Overview of this system >>
FIG. 1 shows a user terminal 3 used by a person who is watching a related content providing apparatus 1 and a television program display apparatus (hereinafter “TV”) 2, that is, a user, and broadcasting station equipment 4 (hereinafter “broadcast station 4”). ) And the web server 5. The related content providing apparatus 1 is a server of this system and processes various requests from the user terminal 3 as a client.

The user terminal 3 is connected to the related content providing apparatus 1 via a communication network. In this system, a case where the communication network is the Internet N will be described, but the present invention is not limited to the Internet. Each of the television 2 and the related content providing apparatus 1 is wirelessly connected to the broadcasting station 4 via a wired or broadcast wave transmitting antenna (not shown). A TV program can be viewed on various information processing devices such as a personal computer and a smartphone, not limited to a television receiver, but the devices that can be viewed are collectively referred to as “TV”. Further, depending on broadcasting media such as terrestrial digital, one-segment broadcasting, BS, etc., the television 2 may require a dedicated tuner and decoder, but illustration and description thereof are omitted.
In FIG. 1, the related content providing apparatus 1 receives radio waves from the two broadcasting stations 4A and 4B, but the number is not limited to two. In FIG. 1, it is assumed that the user is watching a program of the broadcasting station 4A.

When the broadcast station 4A transmits a broadcast program, the user's television 2 receives this and displays it on the screen 6. While viewing the screen 6, the user activates predetermined application software (hereinafter “application”) on his / her user terminal 3, and the channel number of the broadcasting station 4 </ b> A viewing the related content providing apparatus 1. Send.
The broadcast program being viewed by the user is also received in real time by the related content providing device 1, and the related content providing device 1 extracts video information, text information, and the like from the received radio waves. The related content providing apparatus 1 transmits to the user terminal 3 information for enabling direct access to the content related to the extracted information without using a search engine. Specifically, a tag with a relatively short character string is displayed in a list, and when a selection operation is performed on the tag, address information associated with the tag is transmitted to the related content providing apparatus 1, The content corresponding to the tag is displayed on the user terminal 3. Here, the selection operation is often expressed by the word tap on a smartphone or tablet terminal, the word click on a personal computer, and the word remote control operation on a smart TV. In this embodiment, since it is assumed that a smartphone or a tablet terminal is used as the user terminal 3, the selection operation by the user is expressed as “tap”.

Tags are often referred to in the following description, so here is a brief description.
As shown in Table 1, there are three types of tags: CM tags, live keyword tags, and advertisement tags.

First, the CM tag will be described.
The CM tag includes a character string (hereinafter referred to as “CM tag keyword”) attached to the CM tag and address information of CM synchronized content.
The CM tag keyword is a word that is considered by the copywriter that characterizes the advertisement within the restricted number of characters, and includes symbols such as white space, comma (,) question mark (?), And exclamation mark (!).
CM-synchronized content is content related to a CM broadcast on a television. For example, there is a secret story about commercial production, comments from talents, and introduction of products related to commercial products. As a related product, if the commercial is related to lipsticks for young women in cosmetics companies, there are products that young women like mascara and teak may be interested in.
When the related content providing apparatus 1 identifies the CM currently being broadcast, the related content providing apparatus 1 transmits the CM synchronized content to the user terminal 3 and displays it on the screen of the user terminal 3. When a CM is broadcast on the television in this way, the content related to this CM is displayed almost simultaneously.
The related content providing device 1 transmits CM synchronized content page data (file described in HTML or the like), and also transmits a CM tag keyword and CM synchronized content address information to the user terminal 3. This is because a user who wants to view the CM-synchronized content later can view the content by tapping the CM tag keyword.

Next, the live keyword tag will be described.
The live keyword tag includes a live keyword, that is, a character string attached to the live keyword tag and address information of related content associated with the live keyword.
Live keywords are words that are listed as nouns in various encyclopedias, words that have become popular in newspapers and magazines in recent years, and words that are frequently accessed on the Internet, many of which are proper nouns.
The related content is information related to the live keyword, which is produced by a broadcast station or a system operator who outputs information necessary for the user on one page. In production, information is acquired also from an external web server 5 or the like.
When the live keyword tag is transmitted to the user terminal 3, that is, when the address information of the live keyword and related content is transmitted, the live keyword is displayed on the screen, and when this is tapped, the related content is transmitted from the related content providing apparatus 1. Is done.

Many of the words that are live keywords are assumed to be proper nouns, because if you include common nouns in live keywords, the concept is too broad to fit in a single page. It is. For example, the range of the common noun “Minato” is too wide to narrow down the information provided to the user, but there is no such worry if the proper noun “Yokohama Port” is used. However, common nouns other than proper nouns and a series of sentences are not completely excluded from live keywords.
By the way, the proper nouns that appear in the broadcast character information are not all live keywords. When the live keyword tag is transmitted to the user, the related content must be displayed whenever the live keyword tag is tapped. Since this related content is always displayed when tapped, it can also be named “tap destination content”. That is, the character string in which the tap destination content is prepared becomes a live keyword.
The point of preparing related contents in advance is a major feature of the present system. In other words, when searching on a conventional search site, information is collected by going back and forth between the search result page and the linked page. In this system, all collected information is compactly combined into one content and displayed. . For this reason, this system provides a separate function for automatically editing or manually editing the tapped content when registering live keywords.

Next, the advertisement tag will be described.
The advertisement tag includes a character string (hereinafter referred to as “advertisement tag keyword”) attached to the advertisement tag and address information of the advertisement content.
Ad tag keywords are, in principle, linked to one of the live keywords and characterize the ad within the limited number of characters. Symbols such as white space, comma (,) question mark (?), And exclamation point (!) Are also included. included.
For example, “Yokohama Port Sea Bus”, “Yokohama Chinese Restaurant”, “Yokohama Motomachi Jewelery Store”, etc., are linked to the live keyword tag “Yokohama Port”.
However, an advertisement tag may be output in response to a character string that is not output as a live keyword. For example, the word “wine” is a common noun and has a broad concept, so it is not suitable for being output as a live keyword. However, it is a keyword for advertising such as “California wine” and “Yamanashi wine”. sell.
When the advertisement tag is sent to the user terminal 3, that is, when the advertisement tag keyword and the address information of the advertisement content are sent, the advertisement tag keyword is displayed on the screen. The advertising content in the external web server 5 prepared by the advertiser is displayed on the screen. Thus, the access to the advertising content from the user terminal 3 is performed through the related content providing device 1 (redirect function) in order to leave a log that the related content providing device 1 is also accessed.
The main purpose of the live keyword tag is to provide information to the user, but the advertisement tag is an advertising means for the advertiser. When the advertisement tag is tapped, an advertisement posting fee is usually paid from the advertiser to the operator of this system or a broadcasting station.

<< 2. Configuration of this system >>
<< 2-1. Configuration of user terminal >>
The user terminal 3 may be a portable information processing apparatus such as a multifunctional mobile phone or a tablet terminal called a smartphone, even a personal computer. However, it is assumed that the user terminal 3 of the present embodiment is an information processing apparatus including a touch panel like a multi-function mobile phone.
As illustrated in FIG. 2, the user terminal 3 includes an operation unit 301, a display unit 302, a storage unit 303, a processing unit 304, a transmission / reception unit 305, and an imaging unit 306.

The operation unit 301 includes a touch panel arranged on the screen of the display unit 302. An instruction to start / end the program, access to the related content providing apparatus 1, and the like are performed via the operation unit 301. In this specification, the input operation via the operation unit 301 is referred to as “tap”.
The display unit 302 must have a display screen, and appropriately include a speaker.

  The storage unit 303 includes a computer program for receiving provision of functions executed by the related content providing apparatus 1, screen display software called a browser, parameters necessary for executing these programs, intermediate results of processing, and the like. Is stored. The storage unit 303 can also store information on tags that are to be viewed later among the tags transmitted from the related content providing apparatus 1. This is a so-called bookmark function.

The processing unit 304 includes means for retrieving information (for example, user ID) for identifying the user when accessing the related content providing device 1 from the storage unit 303 and transmitting the information, and a live keyword tag or advertisement from the related content providing device 1. If a list of tags is sent, it includes means for selecting a tag in the list and accessing content associated with the tag. The processing unit 304 is realized by the user terminal 3 mounting a predetermined program. That is, it is assumed that a person using this system downloads an application for a user terminal from, for example, an official application store. This program is stored in the storage unit 303. The processing unit 304 controls the operation of each unit including the operation unit 301.
However, the function of the user terminal 3 of the present system can be realized not only by the dedicated application but also by a standardly installed web browser.

The transmission / reception unit 305 transmits / receives signals to / from the related content providing apparatus 1 and the web server 5 via the Internet N.
The imaging unit 306 is a camera lens and an imaging element. In this embodiment, the image photographing function is not particularly necessary, but is essential in the second embodiment.

<< 2-2. Configuration of Related Content Providing Device >>
The related content providing apparatus 1 includes a storage medium such as a hard disk and a memory (not shown), a CPU to which a RAM, a ROM, and the like are connected. The program code is expanded in a RAM or a cache memory, and the CPU reads the program code. By executing this, various processes of this system are realized.
The related content providing apparatus 1 is an information processing apparatus having an input / output unit, a communication interface unit, and various buses (not shown) in addition to the CPU and the storage medium.
Although only one related content providing apparatus 1 is displayed in FIG. 1, it may be configured by a plurality of information processing apparatuses. In the case of a plurality of units, they may be concentrated on the communication network or distributed. A third embodiment to be described later is an example of being distributed.

Next, functional blocks of the related content providing apparatus will be described with reference to FIG.
The related content providing apparatus 1 is roughly divided into a storage unit and a processing unit when attention is paid to functions.
In FIG. 3, elements included in the storage unit are represented by ellipses, and elements included in the processing unit are represented by rectangles.
According to the function that the processing unit realizes, as shown in FIG. 3, the received packet analysis unit 101, the CM identification unit 102, the synchronized CM transmission unit 103, the natural language processing unit 104, the live keyword tag transmission unit 105, the advertisement A tag bidding unit 106, an advertisement tag score creating unit 107, an advertisement tag sending unit 108, a distribution processing unit 109, an access log totaling unit 110, a user input information receiving unit 111, and a user information registration unit 112 are included. Note that the “related information sending unit” in claim 1 is the sync CM sending unit 103, the live keyword tag sending unit 105, and the advertisement tag sending unit 108.
The operation of each element of the processing unit is controlled by the control unit 100. However, in the following description, the operation of the control unit 100 is not particularly mentioned.
The description about each element which comprises a process part is given after description of a memory | storage part.

  The storage unit includes a user information database (hereinafter “user information DB”) 151, a CM database (hereinafter “CM-DB”) 152, a live keyword tag database (hereinafter “live keyword tag DB”) 153, an advertisement tag. A database (hereinafter “advertisement tag DB”) 154 and an access log recording database (hereinafter “access log DB”) 155 are included. The storage unit also stores a program for executing various processes of the system, various dictionaries to be referred to in morphological analysis, an advertisement tag posting score table, various intermediate processing results, and the like.

As illustrated in FIG. 4, the user information DB 151 registers a user ID, information on the user attribute, and a user group.
If the user terminal 3 has a terminal ID, this terminal ID may be used as the user ID, or the terminal ID may be registered together with the user ID.
As information about user attributes, registration of at least the year of birth and gender is desirable in order to distribute content suitable for the user. Broadcast area registration is necessary to identify broadcast stations. This is because even if the channel number is the same, the broadcasting station may differ depending on the region. However, if the user terminal 3 has a GPS function, registration of the broadcast area can be omitted.
Here, if the user approves, other items may be input. For example, if an e-mail address or SNS account is entered, convenience and added value can be given, and the system can give points to such users and notify viewing reservations. .

  In the CM-DB 152, as shown in the data configuration example of FIG. 5A, CM data submitted by a CM provider contracted with the present system is registered together with CM identification information (CM-ID). This is the same moving picture material as the CM broadcast on television. Still images are extracted from CM data that is a moving image at predetermined time intervals, and feature point data of each still image is calculated and registered. The feature point data may be registered together with the CM moving image data, or only the feature point data may be registered. In addition to these data, the CM provider and the broadcast period may be registered together. This registration processing in the CM-DB 152 is executed whenever there is a new submission from the CM provider.

  Further, in the CM-DB 152, as exemplified in FIG. 5B, the CM tag keyword and the address information of the page data storing the CM synchronized content are registered in association with the CM-ID. Also, a user group may be registered for each CM synchronized content. Note that the page data itself may also be stored in the CM-DB 152.

In the live keyword tag DB 153, as shown in the data configuration example of FIG. 6, the live keyword and address information of related content are registered in association with the live keyword tag ID.
The related content page data may be stored in the live keyword tag DB 153 or may be stored in a storage means or a database server managed by this system. It is desirable that the live keyword tag DB 153 be created before the operation is started and updated appropriately after the operation. In addition, it is appropriate to prepare two types of live keyword tags DB 153 for broadcasting stations and systems common, and give priority to the live keyword tag DB 153 for broadcasting stations.
When a live keyword is registered in the live keyword tag DB 153, a synonym / synonym / alias of the live keyword is also registered by referring to a thesaurus dictionary provided in the system for natural language processing. These are registered in the user dictionary and referred to during natural language processing.

  In the advertisement tag DB 154, as shown in the data configuration example of FIG. 7, the address information storing the advertisement tag keyword and the page data of the advertisement content submitted by the advertiser is associated with the advertisement tag ID. be registered. In addition, an advertiser, a bid price, and the like are also registered in the advertisement tag DB 154. The page data itself of the advertisement content is usually registered in the advertiser's web server.

  Each time a tag is selected from the user terminal 3 and a content transmission request is made, the access log DB 155 records the access mode such as the user group, time, region, tag keyword, and total number of accesses.

  Next, each element of the processing unit will be described with reference to the data flow of FIG. The process outlined in FIG. 8 is performed for each broadcast station.

The received packet analysis unit 101 receives radio waves (data D1 flowing in the direction of the arrow in FIG. 8, hereinafter referred to as “data D1 in FIG. 8”) from the broadcasting station 4 by hardware such as a capture board (not shown). Then, it is broken down into various packets.
The received packet analysis unit 101 decomposes the radio wave received from the broadcasting station into various packets such as video, audio, captions, and program arrangement information (SI: Service Information).
The received packet analysis unit 101 acquires a moving image and audio from the video packet. The video includes not only the main broadcast but also a CM, and the extracted video becomes input data of the CM identification unit 102.
The received packet analysis unit 101 converts information included in the caption packet into character information according to a predetermined standard. Character information can also be obtained from video packets and audio packets. The information contained in the video packet is decomposed into frames, the difference between the previous and next frames is taken, and the telop information can be extracted by paying attention to the area in which the motion has occurred, but the character information can be acquired from this telop information. The information contained in the voice packet can be converted so that it can be easily recognized, and the converted voice data can be converted into character information by performing acoustic processing and language processing. These extracted character information becomes input data of the natural language processing unit 104.
Further, the received packet analysis unit 101 acquires an electronic program guide (EPG) from the program arrangement information packet. The EPG information is sent to the CM identification unit 102 and the natural language processing unit 104 if necessary.

The CM identification unit 102 collates the video data (data D2 in FIG. 8) input from the received packet analysis unit 101 with the CM data stored in the CM-DB 152, and determines whether or not the current broadcast is a CM. If it is a CM, it is identified who the provider is and what CM. Here, target CMs include both CMs of sponsor companies (time contracts) and CMs of companies other than sponsors (spot contracts).
The CM identification unit 102 extracts still images from the video data at predetermined time intervals, and calculates feature point data. For this feature point extraction, for example, an ORB (Oriented FAST and Rotated BREF) algorithm is used. Since the ORB is a known algorithm and becomes a function usage level, its details are omitted.
The feature point data that matches the calculated feature point data is searched from the CM-DB 152, and if a match is found, the CM is identified. Even if the video data received from the broadcasting station is a CM, if it is a CM provided by a CM provider who has not contracted with this system, it is not registered in the CM-DB 152. Not eligible. However, the character information included in the CM data can be the target of live keyword tag transmission processing and advertisement tag transmission processing described later.

  When the CM identification unit 102 specifies the CM-ID (data D3 in FIG. 8) of the currently broadcasted CM, the synchronized CM transmission unit 103 determines the address information of the CM synchronized content associated with the CM-ID. The page data (data D4 in FIG. 8) taken out from the CM-DB 152 and acquired based on this address information is sent to the distribution processing unit 109. Here, referring to the user information DB 151, it is desirable to send out CM synchronized content suitable for the user group to which the destination user belongs.

The natural language processing unit 104 extracts live keyword candidates from the character information (data D5 in FIG. 8) sent from the received packet analysis unit 101.
When the language of the character information is Japanese, the natural language processing unit 104 performs morphological analysis on the input character information using various dictionaries (including a thesaurus) such as a user dictionary, a system dictionary, and a fluctuation dictionary. Extract words that are live keyword candidates.
Here, an additional note about the fluctuation dictionary. Languages broadcast on television are often exposed with abbreviated names, nicknames, etc. rather than official names. This is compiled from programs broadcast in the past, and a fluctuation dictionary is created. The official name is determined based on the information obtained from the fluctuation dictionary and program information such as EPG. For example, when the word “Hachi” appears in the narration “Hachi was staring at the ticket gate of Shibuya Station” in the program, the program name registered in the EPG is “Life of Tadagi Hachiko” Then, “Hachi” is determined as “Hachiko”.
Among various dictionaries, a user dictionary is prepared for each broadcasting station.
The extracted live keyword candidates (data D6 in FIG. 8) are sent to the live keyword tag sending unit 105.
In addition, the natural language processing unit 104 has a function of regularly registering the latest keyword or the like in the system dictionary, a function of registering words added on the broadcasting station side in the user dictionary as needed, and the description thereof is omitted.

When the live keyword tag sending unit 105 obtains a keyword (data D6 in FIG. 8) that is a live keyword candidate from the natural language processing unit 104, the live keyword tag sending unit 105 matches it with data registered in the live keyword tag DB 153. If the live keyword candidates are not registered in the live keyword tag DB 153, they are not processed. If registered in the live keyword tag DB 153, the live keyword and related content address information are passed to the distribution processing unit 109.
In this way, the live keyword tag sending unit 105 always prepares and distributes the content of the tap destination by the user for the live keyword tag. Therefore, only the live keyword candidates extracted by the natural language processing unit 104 that are present in the live keyword tag DB 153 are output. The “live keyword candidate” is a keyword until this matching process is performed, and the matched keyword is called a live keyword.

  The advertisement tag bidding unit 106 submits advertisement data from the advertiser and registers it in the advertisement tag DB 154 in association with the advertisement tag keyword. This registration process is performed independently of the series of processes shown in FIG.

  The ad tag score creating unit 107 calculates the ad tag based on the result (data D11 in FIG. 8) and the user group of the access status to the content of the live keyword tag accessed by the user and the related ad tag content. Create a posting score table. The advertisement tag score creating unit 107 will be described in detail later together with the advertisement tag bidding unit 106.

  The live keyword (data D8 in FIG. 8) is passed from the live keyword tag sending unit 105 to the advertisement tag sending unit 108. The advertisement tag sending unit 108 retrieves the advertisement tag keyword related to the live keyword from the advertisement tag DB 154, and the advertisement tag posting score table created by the user group of the destination user and the advertisement tag score creating unit 107 (FIG. 8). The advertisement tag to be sent to the user terminal 3 is selected based on the data D9). The selected advertisement tag and the address information (data D10 in FIG. 8) of the advertisement content corresponding to the selected advertisement tag are passed to the distribution processing unit 109. The advertisement tag sending unit 108 will be described in detail later together with the advertisement tag bidding unit 106 and the advertisement tag score creating unit 107.

  The distribution processing unit 109 transmits display data (data D12 in FIG. 8) including a CM tag, a live keyword tag, an advertisement tag, or accessed content to the user terminal 3.

  The access log totaling unit 110 receives information (data D13 in FIG. 8) that has been tapped from the user terminal 3, and totalizes access status logs. Reference data such as the user's preferences can be obtained from this log.

  The user input information receiving unit 111 receives various types of information transmitted from the user terminal 3 in which the system application is installed. The received information includes a user attribute at the time of user registration, a channel number of a broadcasting station being viewed by the user, and the like.

  When user personal information is input via the user input information receiving unit 111, the user information registration unit 112 generates a user ID for identifying the user, and associates the input personal information with the user ID. And stored in the user information DB 151. Here, the user group set based on the user's personal information is also stored. For example, according to gender and age, the user groups of men under 30 years old, men over 30 years old, women under 30 years old, women over 30 years old are group 1, group 2, group 3, group 4, etc. Categorize into

  The processing unit of the related content providing apparatus 1 also has a function of newly registering, deleting, and correcting data in the CM-DB 152 and the live keyword tag DB 153. The main processing content of this system is to receive radio waves from broadcast stations and to provide relevant information to the user in real time, but in order to carry out this main processing smoothly, the enhancement of the database is indispensable. Absent. For this purpose, data is manually input via an input means such as a keyboard or a mouse. Registration and editing in the database are performed before the system operation, and at any time after the operation is started. Words are alive and new words are always born. Therefore, it is desirable to extract new words using various social network services and add them to the user dictionary in advance or add them to the live keyword tag DB 152 based on these new words.

<< 3. Operation of this system >>
This system can be broadly divided into a process in which the related content providing apparatus 1 receives a TV wave, sequentially processes the received radio wave, and a process of receiving a service provision request from the user terminal 3 and transmitting data to be displayed on the second screen. It consists of.
In order for the advertisement tag sending process included in the former series of processes to be executed smoothly, it is a premise that the advertisement tag posting score table is appropriately created and updated.
Therefore, before explaining the two main processes described above, live keyword tag transmission and advertisement tag transmission processing including the creation / update of the advertisement tag posting score table (the portion indicated by the closed curve in FIG. 8). Will be described in detail with reference to FIG.

<< 3.1. Live keyword tag transmission and advertisement tag transmission processing >>
The natural language processing unit 104 outputs the keyword extracted from the caption broadcast or the like to the live keyword tag transmission unit 105 (step S101). Since this keyword has not yet been determined as a live keyword, it should be a live keyword candidate.
If the keyword exists as a live keyword in the live keyword tag DB 153, that is, if the related content that is the tap destination is prepared, the live keyword tag sending unit 105 delivers the address information of the live keyword and the related content. The data is sent to the processing unit 109 (step S102). However, the live keyword tag with the tap destination content is not sent unconditionally. The live keyword tag sending unit 105 appropriately includes a function for controlling the same live keyword not to be sent continuously, a function for setting an upper limit of the number of appearances of the same live keyword in the same program, and the like. . It is also desirable to have a function that allows setting of live keywords that should not be transmitted for each program.
The distribution processing unit 109 to which the live keyword tag is passed sends information “transmit the live keyword tag to the user terminal 3” to the advertisement tag sending unit 108 (step S103). This is to send the live keyword tag and the advertisement tag to the user terminal 3 at the same time.
Next, the advertisement tag sending unit 108 searches the advertisement tag posting score table stored in the advertisement tag DB 154 with live keywords, and has the highest advertisement profitability score (see column C6 in FIG. 11). Is selected and delivered to the distribution processing unit 109 (step S104). The advertisement tag posting score table may be stored in a storage unit (not shown) of the related content providing apparatus 1 or may be stored in the advertisement tag DB 154.

Next, the advertisement tag posting score table will be described with reference to FIG. 11, but FIG. 11 is merely an example. The advertisement tag posting score table differs depending on what is adopted as a recommendation score calculation algorithm (hereinafter, “recommendation algorithm”). Therefore, the recommendation algorithm will be briefly described.
As the recommendation algorithm, there are the following (Algorithm 1) to (Algorithm 6). Since these are known algorithms that have been incorporated in existing search engines and mail-order sites, only the main points are described, and details are omitted.

(Algorithm 1) This is an algorithm for paying attention to the degree of similarity between users and displaying a more suitable advertisement. This is called cooperative recommendation by user category.
(Algorithm 2) This is an algorithm for paying attention to the degree of context suitability and displaying an advertisement more suitable for the contents spoken in the main part of the program.
(Algorithm 3) This is an algorithm for paying attention to the degree of program compatibility and displaying more suitable advertisements for advertisement products / services and their categories that are more easily tapped on a program basis.
(Algorithm 4) This is an algorithm that pays attention to the degree of popularity and posts more suitable advertisements for advertising products / services and their categories that are easy for all users to tap.
(Algorithm 5) This is an algorithm that pays attention to the degree of social sharing, and displays more suitable advertisements for advertising products / services and categories easily shared by users.
(Algorithm 6) This is an algorithm for paying attention to the degree of personal preference and posting an advertisement more suitable for an advertising product / service and its category in which the user tends to tap.

However, since it is not essential for the present invention which recommendation algorithm is adopted, (algorithm 1) will be described below as an example.
In this cooperative recommendation algorithm, users are categorized into several user groups. This categorization not only focuses on the gender and age of the user. Pay attention to tastes and values. For this purpose, a log of access status such as how often the content of the live keyword tag or advertisement tag is accessed is collected and accumulated.
An example of a recommendation score table in which a recommendation score is set for each category of advertisement tag for each user group is shown in FIG.
In the example of FIG. 10, as a recommendation score for a person belonging to the user group UG_A, 8 (a numerical value with a circle) is set for the category CGY3, and 2 (a numerical value with a square mark) is set for the category CGY4. . That is, when posting an advertisement to a person belonging to this user group, it is determined that it is preferable to recommend an advertisement belonging to category CGY3 over an advertisement belonging to category CGY4. When it is not desired to display an advertisement of a specific category, it is possible to perform control such as setting 0 (zero) as a recommendation score.

An advertisement tag posting score table is created based on the above recommendation score.
The advertisement tag posting score table is created for each user group, and FIG. 11 illustrates a case where the user group is UG_A.
Column C1 of this table is a live keyword tag, and column C2 contains an arbitrary number of advertisement tags related to each live keyword tag. For example, when a live keyword tag of LTa is transmitted to the user terminal 3, any one of ATa1, ATa2, ATa3, and ATa4 can be transmitted as an advertisement tag.
Column C3 is the category of the advertisement tag, and the same category appears in the recommendation score table of FIG.
In column C4, the recommendation score (S) of the recommendation score table is posted. In the example of FIG. 10, a value 8 is assigned as a recommendation score to the CGY3 of the advertisement tag category corresponding to the user group UG_A (circled portion in FIG. 10). The same score is transcribed in the circled cell of FIG.
Column C5 is the bid price (CPC).
Column C6 is the advertising profitability score, which is the product of the recommendation score (S) in column C4 and the bid price (CPC) in column C5.

Next, creation of an advertisement tag posting score table will be described with reference to FIG.
The advertisement tag bidding processing unit 106 performs bid management of advertisements from a person who purchased a character string linked to a live keyword tag registered in advance in the live keyword tag DB 153, that is, an advertiser (step S201).
The advertisement tag bidding processing unit 106 stores information on the advertisement tags bid in the advertisement tag DB 154, and the purchased character string (= advertisement tag keyword) is stored in the column C2 of the advertisement tag posting score table, and the column C3 is stored in the column C3. The category of the advertisement tag is recorded, and the input unit price is recorded in the column C5 (step S202).
By the way, the unit price of the advertisement is usually a unit price paid when clicked (CPC = Cost per Click). It is a method of purchase that costs only when it is clicked and does not incur costs just by being displayed on the screen. Therefore, although the unit price differs for each advertising keyword, a higher unit price is assigned to a general noun such as “sale” or “fashion”. This is because other companies also wish to purchase these keywords.

  By the way, whether or not a certain advertisement is posted is not determined only by the unit price at the time of advertisement bidding. The advertisement to be posted is determined in consideration of the relationship between the advertisement and the keyword, user attribute information, and the like. This is because since it is a CPC, even if a keyword that is not clicked is distributed to the user terminal 3, no profit is generated on the operator side of the system. Therefore, what is used as a criterion for placing an advertisement is important. In this system, the determination is made based on the product of the CPC and the above-mentioned recommendation score. This point will be described with reference to FIG. 9 again.

When the user terminal 3 performs a tap operation on any of the CM tag, live keyword tag, and advertisement tag, a content transmission request is sent to the related content providing apparatus 1 (step S301).
The access log totaling unit 110 takes a log of content access status for each user and collects what words and things the user is interested in (step S302). The access log may manage the information for each user. However, since this complicates the system, it is appropriate to manage the access log by forming a user group having the same gender and age.
The advertisement tag score creation unit 107 refers to the access status log for each user group as described above (step S303), and creates a recommendation score table as illustrated in FIG. 10 based on this log (step S304).

The advertisement tag score creating unit 107 records the recommendation score in the column C4 of the advertisement tag posting score table, and records the product of this value and the bid price in the column C5 as the advertisement profitability score in the column C6 (step S305). This advertisement profitability score is a criterion for selecting an advertisement tag posted by the advertisement tag sending unit 108.
For example, the advertisement profitability score of the advertisement tag ATa3 having a bid price of 40 yen shown in the row R1 in FIG. 11 is 80 yen. On the other hand, the advertising profitability score of the advertising tag ATa4 with a bid price of 20 yen shown in the row R2 is 160 yen. In this case, it is appropriate to select the advertisement tag ATa4 having a high advertisement profitability score even though the bid price is low. Thus, the amount of bid price does not match the suitability for posting to the user group.
The advertisement tag posting score table is sequentially updated according to the status of access log aggregation. In this update process, it is preferable to take into account the registration member correspondence on the day and special recommendation correspondence corresponding to rapid access.

Here, it returns to the process of step S104 of FIG. 9 again.
The advertisement tag sending unit 108 searches the advertisement tag posting score table with live keywords, and selects the advertisement having the highest advertisement profitability score. When the live keyword tag is LTa, the advertisement profitability score of the advertisement tag ATa4 is the highest. Therefore, the advertisement tag ATa4 is set as a candidate to be transmitted to the user terminal 3.
However, it should be noted that not all of the advertisement tags selected here are transmitted. If one live keyword tag is attached and one advertisement tag is put out, it is considered to be an application that displays only advertisements to the user and is avoided. In order not to be considered as an advertising application, the display of the advertisement tag is restricted to a ratio of about once every 10 live keyword tags.
With this restriction, an algorithm is required to determine which advertisement is optimal for which timing. Therefore, an advertisement tag to be sent to the user terminal 3 is determined by using a well-known operations research technique which is a kind of dynamic programming and is also called an optimal stop problem (secretary problem, marriage problem).

The distribution processing unit 109 transmits the live keyword tag and the advertisement tag to the user terminal 3 together (step S105). Upon transmission, various transmission restriction conditions are checked as appropriate. This is because there is a time designation for some advertisements, such as advertisements for alcohols. The transmission restriction condition may be stored as a parameter in the storage unit.
It should be noted that the advertisement tag transmitted here may have a lower probability of transmission when the next advertisement tag is selected.

<< 3.2. Processing sequentially performed on received broadcast data >>
When the related content providing apparatus 1 receives a broadcast wave as shown in FIG. 12A, the related content providing apparatus 1 performs the process shown in FIG.

  In step S401, the CM of company A is received from the broadcasting station 4A. However, since the company A has contracted and the CM is registered in the CM-DB 152, the related content providing apparatus 1 is currently receiving the broadcast. The data is identified as CM of Company A. Then, CM-synchronized content of company A is extracted from CM-DB 152.

Subsequently, in step S402, the CM of Company A ends, and the main broadcast data flows. The related content providing apparatus 1 extracts character information from the caption information received together with the main broadcast data and extracts live keyword candidates by natural language processing. Here, if the live keyword candidates LTp, LTq, and LTr are stored in the live keyword tag DB 153, these are set as live keywords. Moreover, the advertisement tag relevant to each live keyword tag refers to the advertisement tag posting score table, and selects the advertisement tag having the highest advertisement profitability score.
In step S403, CM of B company flows from the broadcasting station 4A, but the related content providing apparatus 1 is not registered in the CM-DB 152 since it is not contracted with B company, and the CM cannot be identified. Since the related content providing apparatus 1 cannot recognize the CM of company B as a CM, it handles it in the same way as the main data. Therefore, if character information is included, processing for extracting live keyword candidates, sending live keyword tags, and selecting advertisement tags is performed.

Next, in step S404, CM of company C is received from broadcasting station 4A, but company C is contracted and the CM is registered in CM-DB 152, so that related content providing apparatus 1 is currently receiving it. Broadcast data is identified as CM of company C. Then, the address information of the CM synchronized content of the company C is extracted from the CM-DB 152, and the page data of the CM synchronized content is acquired.
Next, in step S405, since the main data flows, live keyword tag transmission and advertisement tag selection processing is performed as in step S402.
The related content providing apparatus 1 performs the processing illustrated in steps S401 to S405 without interruption while the broadcast radio wave is transmitted for each broadcasting station. In this way, since this system processes the received radio waves in real time, even if it is a variety program where the content of the performer's speaking is not fixed in advance or a sports program with extended or changed broadcast time, the actual broadcast content Can be processed.

<< 3.3. Related information provision processing to user terminals >>
When the user desires to provide information by the related content providing apparatus 1, the user activates an application stored in the storage unit 303 of the user terminal 3, transmits a user ID, and logs in. If the login is permitted, the related content providing apparatus 1 refers to the broadcast area of the user information DB 151, creates screen data that displays the channel number of the broadcast station that can be viewed by the user, and transmits the screen data to the user terminal 3. The transmitted screen data is displayed on the user terminal 3 as illustrated in FIG. The user transmits information specifying the broadcasting station being viewed to the related content providing apparatus 1 via the screen illustrated in FIG. 13 (step S501 in FIG. 12). In the example of FIG. 13, the channel number is transmitted by tapping the button BTN1 corresponding to the channel number. When changing the broadcasting station, the changed channel number may be transmitted to the related content providing apparatus 1. In FIG. 13, there is an “AUTO” button BTN2, which will be described in the second embodiment.

When a broadcast station is designated from the user terminal 3 (screen G1), since the CM of company A is broadcast on the designated broadcast station 4A, the related content providing apparatus 1 uses the CM sync of company A being broadcast. The page data of the content is transmitted to the user terminal 3, and the CM synchronized content of company A is displayed on the user terminal 3 as shown on the screen G2 (step S502).
Here, the related content providing apparatus 1 selects and transmits CM-synchronous content suitable for the user from among a plurality of CM-synchronized content normally prepared in consideration of the user group to which the user belongs.

Next, the live keyword tag extracted in step S402 and the selected advertisement tag are transmitted to the user terminal 3 and displayed on the screen G3 (step S503). Thus, according to this system, the user can acquire information related to the program almost simultaneously with viewing the program.
“Synchronized advertisement of company A” is displayed at the bottom of the tag list on the screen G3. This is a CM tag for making it possible to view the CM-synchronized content of company A that has been displayed most recently even after the broadcast of company A's CM.

  When an operation for selecting the second tag LTp from the bottom in the tag list displayed on the screen G3 is performed (step S504), a signal indicating that the tag is selected is transmitted to the related content providing apparatus 1, The related content providing apparatus 1 extracts the related content associated with the live keyword LTp from the live keyword tag DB 153, transmits it to the user terminal 3, and displays it on the screen G4 (step S505). The related content providing apparatus 1 records a log of access status from the user along with transmission of the tapped content. When the access log is updated, the advertisement tag posting score table is also updated.

Here, what is important is that a specific content is transmitted by performing an operation of selecting the live keyword tag LTp. The search keyword “LTp” is passed to the search engine, and a search result list is transmitted. It does not come. Related content is mainly produced by broadcasting stations, but for that purpose, a huge amount of program production know-how is used. Therefore, when the user browses the related content, the user can collect accurate information about the theme “LTp” without effort.
If a search engine is used, the user must narrow down the search results. Since narrowing down requires knowledge, inappropriate information may be selected or excellent information may be overlooked due to lack of knowledge.
Furthermore, when a search engine is used, a search keyword is input. However, knowledge is insufficient, and a desired search result cannot be obtained if an unrecognized word is input.
Such a problem does not occur in this system. This is because a huge amount of knowledge and know-how on the broadcasting station side covers inexperience and lack of knowledge on the user side.
The related content is information provided to the user in one direction, but it is possible to place an affiliate advertisement for a product or the like related to the content.

All of the CM tag, the live keyword tag, and the advertisement tag are transmitted and displayed by a user's tap, but this content is not necessarily one-way information provision from the system operator to the user. You can answer questionnaires, display quizzes, receive coupon issuance and point grant services, and apply for instant wins, that is, winning prizes on the spot. Also, the CM-synchronized content and the advertising content may be linked to the website of the CM provider or the advertiser so that online shopping can be performed.
By the way, in the recent advertising industry, O2O2O (On Air to Online to Offline), that is, a word meaning “go to a store after watching a TV broadcast and go to a store” is drawing attention. Also in this system, when a coupon is issued through the content provided from the related content providing device 1, information related to the coupon is stored in the smartphone, and the coupon is displayed on the smartphone screen at an actual store. Such a service is feasible. As a result, convenience for the user is enhanced, and the company can also attract customers.

  When the broadcast content from the broadcasting station is switched to CM of company C, the related content providing apparatus 1 transmits CM synchronized content of company C to the user terminal 3 and displays it on the screen G5 (step S506). When the CM-synchronized content is transmitted in this way, the CM-synchronized content is displayed instead of the tag list on the screen of the user terminal 3 and the content display. However, it is possible to switch to a tag list display such as the screen G3 by operating a button (not shown).

  By the way, while the user terminal 3 starts up the application, live keyword tags and advertisement tags are displayed one after another, and old tags are deleted when a certain number of tags are exceeded. Therefore, it is preferable to provide a function for storing the tag so that the user can view content related to the tag that the user likes later. For example, when an operation is performed such that the user likes to trace a favorite tag in the tag list as illustrated on the screen G3 from right to left, the application stores the tag in the storage unit 303 of the user terminal 3. This is a so-called bookmark function, which allows users to browse the information they care about at a free time. The stored information may be erased by a user operation, or may be automatically performed after a predetermined time has elapsed.

<< Second Embodiment >>
In the first embodiment, the user designates a broadcasting station. However, in this embodiment, the user captures his / her own TV screen 6 at the user terminal 3, transmits it to the related content providing apparatus, and identifies the program based on the image received on the related content providing apparatus side, that is, the current Identify the station you are watching. Note that this broadcast station identification process has been patented by the applicant in Japan (Japanese Patent No. 5574556).
Hereinafter, the difference from the first embodiment will be mainly described with reference to FIG. Note that the same reference numerals as those in FIG. 3 are used for elements having the same functions. In FIG. 14, elements different from those in FIG. 3 are represented by double rectangles.

The related content providing device 7 of this embodiment has all the functions of the related content providing device 1 and includes a shooting data receiving unit 701 and a program identification unit 702.
When the user terminal 3 launches the application and taps and transmits the automatic (AUTO) button BTN2 from the channel selection screen illustrated in FIG. 13, the related content providing apparatus 7 subsequently transmits the still image. It is recognized as feature point data.
The user terminal 3 captures a moving image shown on the screen 6 of the television by the imaging function. The application of the user terminal 3 extracts still images from the moving image at appropriate intervals, and calculates feature point data. The algorithm for calculating the feature point data is the same as the feature point extraction process by the CM identification unit 102. The shooting data receiving unit 701 receives feature point data from the user terminal 3.
On the other hand, the program identification unit 702 decomposes the video data extracted by the received packet analysis unit 101 into still images, calculates feature point data of each still image, and collates with the feature point data received from the user terminal 3, If the degree of coincidence is equal to or greater than a predetermined value, it is possible to determine which television station the user is currently viewing. In addition, since the CM identification unit 102 calculates feature point data of a still image extracted from video data from a television station in order to identify a CM, the program identification unit 702 may use this.

  The processing after the related content providing device 7 identifies the broadcasting station being viewed by the program identification is the same as the processing in the first embodiment.

  By the way, the purpose of transmitting the feature point data of the still image by the user terminal 3 is to make the related content providing device 7 recognize the broadcasting station being viewed, so that the feature point data for a short time is transmitted. do it. When changing the broadcasting station, the channel designation button BTN1 may be tapped, or the automatic button BTN2 may be tapped again.

<< Third Embodiment >>
In the first embodiment, the information processing apparatus that implements the service provided to the user terminal 3 has been described as receiving radio waves from the broadcasting station. The third embodiment is different from the first embodiment in that the received packet analysis process is assigned to a dedicated server.
The third embodiment will be described with reference to FIGS. 15 and 16 focusing on the differences from the first embodiment.

As shown in FIG. 15, the related content providing device 8 includes a television broadcast receiving device 8A and a tag sending device 8B. The television broadcast receiving device 8A and the tag sending device 8B are connected to be communicable by wire or wirelessly.
In FIG. 15, the television broadcast receiving device 8A is connected to a plurality of broadcasting stations 4, but a television broadcasting receiving device 8A is installed for each broadcasting station 4, and the plurality of television broadcasting receiving devices 8A are connected to the tag sending device 8B. It may be connected.

FIG. 16 is a diagram illustrating functional blocks of the television broadcast receiving device 8A and the tag sending device 8B. Elements having the same functions as those in FIGS. 3 and 8 are denoted by the same reference numerals.
In the example of FIG. 16, the television broadcast receiving apparatus 8A passes the video data decomposed by the received packet analysis unit 801 to the CM identification unit 802 and collates with the CM data in the CM-DB 153 to identify the CM. When the CM is identified, the CM identification unit 802 transmits the CM-ID to the synchronized CM transmission unit 103 provided in the tag transmission device 8B. The tag transmission device 8B shares the CM synchronized content transmission processing related to this CM. The character information extracted by the received packet analysis unit 801 is transferred to the natural language processing unit 104 provided in the tag transmission device 8B, and a live keyword candidate is extracted. That is, this embodiment is different from the first embodiment only in that an information processing apparatus that receives broadcast radio waves and identifies CM data is independent. By making them independent, system load distribution is realized.

  The function sharing between the television broadcast receiving device 8A and the tag sending device 8B shown in FIG. 16 is only an example. For example, a synchronized CM transmission function, a natural language processing function, and a live keyword tag transmission function may be provided on the television broadcast receiver 8A side.

<< Fourth Embodiment >>
In the first to third embodiments, the user terminal 3 receives and displays television program related information. However, in this embodiment, related information is displayed on the screen of the television broadcasting the broadcast program.

  FIG. 17 is a diagram showing a system configuration example of this embodiment. The user terminal 9, the television program display device 10, and the router 11 constitute a home network HN. The user terminal 9 and the television program display device 10 are connected to the related content providing device 12 and the application server 13 via the Internet N, respectively. Each of the television program display device 10 and the related content providing device 12 is wirelessly connected to the broadcasting station 14 via a wired or broadcast wave transmitting antenna.

In this embodiment, the user terminal 9 and the TV program display device 10 each acquire a dedicated application from the application server 13, and the user terminal 9 and the TV program display device 10 transmit and receive information to and from each other. It is different from other embodiments. Hereinafter, the difference will be mainly described with reference to FIG.

The user terminal 9 finds the television program display device 10 connected to be communicable locally within the home network HN (step S601).
The TV program display device 10 receives the URL of the TV program display device application (hereinafter, “receiver application”) from the broadcast station 14 (step S602). The broadcasting station 14 has a function of transmitting the URL of the receiver application to the broadcasting station 4 of the first embodiment. The television program display device 10 acquires the receiver application and related data from the application server 13 indicated by the URL received from the broadcast station 14 (step S603). The acquired data includes the URL of an application for a terminal device that operates in cooperation with the television program display device 10 (hereinafter, “cooperative terminal application”). Therefore, the television program display device 10 transmits the URL of the cooperation terminal application to the user terminal 9, that is, the cooperation terminal (step S604). The user terminal 9 acquires the cooperation terminal application and related data from the application server 13 indicated by the received URL (step S605). Thereafter, since the user terminal 9 and the TV program display device 10 can be directly connected to each other, it is possible to activate the cooperation terminal application from the receiver application or perform data cooperation (step S606). .

The television program display device 10 in which the receiver application is installed receives information from the related content providing device 12 almost simultaneously with the broadcast of the broadcast station 14 and displays it on the screen 15. The function of the related content providing device 12 is substantially the same as the related content providing devices 1 and 2 of the above embodiment. However, the related content providing apparatus 12 may also have the function of the application server 13.
In this embodiment, the tag list and contents displayed on the screen of the user terminal 3 in the first embodiment are displayed together with the broadcast program on the screen 15 of the television program display device 10. User input operations including tag selection are performed by a television remote control. If a personal computer is also used as the television program display device 10, an input operation including tag selection is performed with a keyboard or a mouse.

  Similarly to the television program display device 10, the user terminal 9 may receive information from the related content providing device 12 and display it on the screen. Alternatively, the information transmitted from the related content providing device 12 may be displayed only by the television program display device 10 and information necessary for the user may be transmitted to the user terminal 9. For example, when there is no time to view the entire content corresponding to the tag displayed on the screen 15, the address information associated with the tag is transmitted to the user terminal 9, and when there is time, the related content providing apparatus 12. It is also possible to receive content from.

<< Fifth Embodiment >>
This embodiment corresponds to the invention according to claim 2. In the first embodiment, the related content providing apparatus 1 directly provides information to the user. On the other hand, in this embodiment, the related content providing apparatus provides information to an external system, and the external system is different in that information is provided to the user.
Hereinafter, differences from the first embodiment will be described with reference to FIG. Note that the same reference numerals as those in FIG. 1 are used for elements having the same functions.

  When the related content providing device 16 acquires broadcast data from the broadcast station 4, the related content providing device 16 executes a process for sending at least one of a live keyword tag, an advertisement tag, or CM-synchronized content. It is sent to the server 17. The server 17 provides the information acquired from the related content providing device 16 to the user terminal 3 of the user of the external system.

There are various ways of providing tags and content to external systems.
For example, if the external system provides the user with only information similar to the live keyword tag, the server 17 of the external system transmits the live keyword that appears as the program progresses to the related content providing device 16. Then, it is conceivable that the related content providing device 16 provides the server 17 with the advertisement tag keyword linked to the received live keyword and the address information of the advertisement content.
As another example, when the broadcast station specifying information is received from the server 17, the related content providing apparatus 16 may identify the CM broadcast on the broadcast station and provide the CM 17 with the CM synchronized content.
For the related content providing device 16, the program related information is provided only by the server 17 of the external system instead of the user terminal 3, and there is no significant difference from the related content providing device 1 of the first embodiment.
Although FIG. 18 shows only one external system server, the related content providing apparatus 16 may be connected to a plurality of external systems. In this case, the type of information provided for each external system is different, such as providing a live keyword tag and an advertisement tag for one external system and providing CM synchronized content for another external system. Also good.

Although five embodiments have been described above, the present invention is not limited to the description of these embodiments, and can be implemented in various other modes. For example, the above system configuration, algorithm, data structure, and the like are merely examples, and various modifications can be considered.
Hereinafter, some modified examples will be described.

In the above embodiment, three types of information of the live keyword tag, the advertisement tag, and the synchronized CM are provided to the user side.
However, only one type or two types may be selected and provided. For example, depending on the broadcasting station participating in the system of the present invention, an advertisement tag may be considered unnecessary.

In the above embodiment, keywords are extracted based on caption information extracted from radio waves received from a broadcast station, telop information and audio information included in video. However, one or both of the telop information and the audio information may be excluded from keyword extraction.
On the other hand, if the system of the present invention can obtain information in advance by partnering with a broadcasting station, this may also be included in the keyword extraction target. For example, in the case of pre-recorded programs, since the program material can be obtained first, you can set a live keyword tag that is output by specifying the timeline (time from the start of the program) while viewing the program material. Send live keyword tags according to the timeline (preset function). In addition, a live keyword tag to be output in advance can be set for a program corner whose broadcast content is known in advance even in a live program. However, in this case, since the output time varies depending on the program progress because it is a live program, a timeline cannot be set. Therefore, it outputs by queuing at the time of program broadcast. Furthermore, in the broadcasting industry, there is a pre-meta service, that is, a service that covers program broadcast contents in advance and advertises programs. Therefore, it is also possible to register in advance the keywords to be output in the program using this service and output them using the cueing function or the preset function as described above.
Further, when a special scene appears during the program broadcast, the live keyword and the immediately edited content are registered in the live keyword tag DB 153 and the live keyword tag can be sent to the user side. For example, when Taiyo Yokozuna decides to win the Grand Sumo Chiaki Raku, a live keyword tag such as “Okuma 6 consecutive championships” can be output. The keyword output in such a necessary scene is not limited to the live keyword, but may be an advertisement tag keyword. This advertisement tag does not necessarily have to be linked to the live keyword tag. For example, let's say that Kafu's favorite cafeteria was introduced in a program based on the theme of famous writer Nagai Kafu. In this case, only the advertisement tag “Asakusa Western Restaurant” may be output without outputting the live keyword tag “Nagai Kafu”.
Furthermore, in addition to the information received from the broadcasting station, information input from the outside may be a target for keyword extraction. For example, in cooperation with a post-meta information service, that is, a service in which the content of a television broadcast is recorded by a human and provided to the outside, a keyword that seems to be important is transmitted to the system of the present invention by human judgment, It may also be captured as text information.

In the above embodiment, the case where the character information is Japanese is targeted. However, it goes without saying that this system can also target languages other than Japanese.
Languages include languages that are not separated such as Japanese and Chinese, and languages that are separated such as English and Hindi. Languages that are separated are clearly identified by the presence of a blank, but words that are not separated can be determined by a combination rule of part of speech and part of speech. For example, in the case of Japanese, there are adjective + noun combinations, but nouns + adjectives are not possible. By using these rules, the part of speech can be specified to some extent.
In other languages, part of speech can be determined by morphological analysis for the following reasons. That is, in the current morphological analysis, the occurrence probability of a combination of part of speech and part of speech is obtained from a large amount of text data (corpus), and the part of speech is specified according to this probability. Therefore, as long as there is digitized text data, the dictionary data that is the basis of the morphological analysis can be constructed regardless of the type of language. Therefore, although it is statistical, morphological analysis can be performed in any language. In short, if statistical language processing is used, parts of speech can be recognized as a problem of statistical probability regardless of grammar.

The above embodiment is based on the assumption that the user terminal 3 is connected to the Internet while the application is being executed. Therefore, various social media may be used via the Internet. For example, if you have a favorite live keyword tag or advertisement tag, you may post it on Twitter.
Although the system may automatically perform a recommendation function based on the access log, recommendation by a friend is effective. This is because there is a lot of information on the Internet, but there are many people who sort out information for reasons such as recommending by peers and attention from peers.

The CM identification function can be used only by the CM provider who has registered the CM in the system in advance. Therefore, in the above-described embodiment, related information that should be called a sub CM corresponding to the user attribute is distributed as CM synchronized content.
However, not only the distribution of the CM-synchronized content, but the CM provider can also use the user terminal 3 as an advertising medium. For example, the user designates a broadcasting station and a time zone and purchases the right to display his own CM or related content on the screen of the user terminal 3 (which should also be called a second CM frame). When a keyword deeply connected to the CM provider is extracted, the related content provider may distribute the content prepared in advance by the CM provider to the user terminal 3. For example, if the CM provider is an automobile manufacturer, when a keyword such as “car” or “drive” is extracted, the CM of the CM provider is distributed. However, it is possible that another automobile manufacturer may be a sponsor of a program being broadcast during that time period, so adjust the display of commercials between companies in the same industry using the CM identification function or sponsor information obtained from the broadcasting station. It becomes necessary to do.

  The above embodiment has been described on the premise that the system server receives a radio wave from a plurality of broadcasting stations in various places and performs a service of distributing information related to the broadcast program to the user terminal. However, the present invention can also be applied when a broadcasting station operates a server of this system and provides only information related to the program of the local station to the user. A broadcasting station that provides such an information providing service can be differentiated from other stations and can improve the audience rating.

  In the above embodiment, the user terminal is assumed to be a portable terminal device such as a smartphone or a tablet terminal. However, a personal computer may be used as a user terminal. In the case of a personal computer, the service of the system of the present invention can be received through a web browser that is mounted as standard, and user input is performed exclusively by a keyboard or mouse.

  In the above embodiment, the user uses a user terminal such as a smartphone in addition to the television program display device, that is, the television receiver. Recently, however, TV programs can be viewed on a personal computer connected to the Internet. If this personal computer is provided with the functions of both the television program display device of the above embodiment and the user terminal, the user terminal is not necessary. Even in the case of such a system configuration in which the user terminal is omitted, the function of the system of the present invention for providing broadcast program related information is not completely different.

In the above embodiment, the user receives the information providing service by the system of the present invention while viewing the television program on the television program display device, that is, the television receiver. However, the user of the system of the present invention does not necessarily have to watch a television program. For example, even when the user is out of the office who cannot watch TV programs, what programs are being broadcast if the system of the present invention is accessed from a user terminal such as a smartphone and CM synchronized content and live keywords are received. Have a clue. If it is an information program, it is also possible to obtain information that is comparable to actual broadcasting.
Further, even when actually watching a television program, if a broadcast station different from the broadcast station being viewed is designated, information regarding the program of the broadcast station not being viewed can be obtained.

In the above embodiment, the user is provided with information via the Internet.
However, when displaying the information provided by the television receiver on the user side, the information may be provided on a radio wave transmitted by the broadcasting station. When the server of this system is in a broadcasting station, the tags and contents sent by this server may be sent on radio waves, for example, by data broadcasting (BML) instead of via the Internet. When the server of this system is outside the broadcasting station, tags and contents may be sent to the broadcasting station via the Internet or the like, and the broadcasting station may provide these to the user by placing them on radio waves.

  In the above embodiment, user attribute information is input at the time of user registration, and users are categorized into user groups based on this attribute information. This categorization has the advantage that content suitable for the user can be provided and advertisement tags can be selected. However, input of user attribute information is not essential for the present invention. This is because the object of the present invention of providing information related to the contents of a television program in real time can be achieved without considering user attributes and preferences. Moreover, if the input of personal information is essential, some people hesitate to register.

  In the above embodiment, character information is extracted exclusively from audio information included in broadcast data. However, a function of recognizing music or BGM from audio information may be included. For example, if the composer of the music is known, this composer name can be transmitted as a live keyword tag.

  In the above embodiment, the CM is identified by image recognition. In the second embodiment, a broadcast station is identified by image recognition. However, it is also possible to identify CMs and broadcasting stations by voice recognition. If voice recognition is used, broadcast stations can be identified continuously. Therefore, it is possible to follow the change of the channel and collect a log of viewing continuation status.

  In the above embodiment, the recommendation score is calculated by the cooperative recommendation algorithm based on the user category. However, any algorithm can be used as long as high advertising revenue can be expected. Depending on the algorithm, the configuration of the recommendation score table and the advertisement tag posting score table may be different. However, in any algorithm, there is no change in selecting the advertisement tag to be displayed based on the advertisement unit price and the recommendation score.

In the above embodiment, it is assumed that the user is watching a television program that is currently being broadcast. However, the system of the present invention can also be applied to television programs that have already been broadcast. As one example, there is a usage mode in which the user records and accesses the server of the present invention when viewing the recorded television program. When the information specifying the TV program is transmitted to the server, the server specifies the broadcasting station of the TV program and the date and time when the TV program was actually broadcast, and based on the specified information, the live keyword tag DB, the advertisement tag DB, or the CM -A tag and content are transmitted to a user side with reference to DB.
In addition, the usage form of the present invention includes simply providing tag information and content regardless of the viewing of a television program. If you want to check the contents of a missed program and specify the name of the program, if all the tag information that has flowed in that program is displayed, you can see the general contents of that program. In this case, since it is irrelevant to the video of the television program, the information to be displayed is sent at a time, not along the timeline. In such a usage mode, it is preferable to have a search function. For example, when it is not possible to remember things introduced in a program that has already been viewed, if it is possible to search for one or more words from among all the displayed items, convenience for the user is improved.

The present invention, which can easily obtain information related to a TV program, provides a viewer with a new way of enjoying a TV program, while providing an efficient advertising medium for a sponsor company that provides a CM. Offers the possibility of acquiring new advertising revenue.

1: Related content providing apparatus 101: Received packet analysis unit 102: CM identification unit 103: Synchro CM transmission unit 104: Natural language processing unit 105: Live keyword tag transmission unit 107: Advertisement tag score creation unit 108: Advertisement tag transmission unit 111 : User input information receiving unit 151: User information DB
152: CM-DB
153: Live keyword tag DB
154: Advertising tag DB
2: TV program display device 3: User terminal 4 (4A, 4B): Broadcast station 7: Related content providing device 701: Shooting data receiving unit 702: Program identification unit 8: Related content providing device 8A: Television broadcast receiving device 8B: Tag sending device 9: User terminal 10: Television program display device 12: Related content providing device 14: Broadcast station 16: Related content providing device 17: External system server N: Internet

Claims (22)

A system for providing information related to a television program to a user terminal of a user or a television program display device via a communication network,
A user input information receiving unit for receiving broadcast station specifying information for specifying a broadcast station from the user terminal or the television program display device;
Received packet analysis unit that acquires broadcast data from broadcast station and breaks it down into various packets,
A related information sending unit for sending information related to information contained in the various packets acquired from the broadcasting station corresponding to the broadcasting station specifying information to the user terminal or the television program display device;
The related information sending unit includes at least one of a live keyword tag sending unit, an advertisement tag sending unit, and a synchronized CM sending unit,
The live keyword tag sending unit sends a live keyword tag to which a live keyword extracted from character information included in the various packets is attached,
The advertisement tag sending unit sends out an advertisement tag with a character string linked to the live keyword,
The TV program related content providing system, wherein the synchronized CM sending unit provides CM synchronized content related to CM data included in the various packets. A system for providing information relevant to a TV program to a program viewer via a communication network and an external system,
Received packet analysis unit that acquires broadcast data from broadcast station and breaks it down into various packets,
A related information sending unit for sending information related to information contained in the various packets to the external system;
The related information sending unit includes at least one of a live keyword tag sending unit, an advertisement tag sending unit, and a synchronized CM sending unit,
The live keyword tag sending unit sends a live keyword tag to which a live keyword extracted from character information included in the various packets is attached,
The advertisement tag sending unit sends a character string linked to the live keyword, or an advertisement tag attached with a character string linked to a character string acquired from the external system,
The TV program related content providing system, wherein the synchronized CM sending unit provides CM synchronized content related to CM data included in the various packets. A live keyword tag database that stores live keyword tags that correlate live keyword and address information of related content of the live keyword,
The live keyword tag sending unit extracts a character string from character information included in broadcast data acquired from a broadcasting station, and if a live keyword matching the extracted character string is stored in the live keyword tag database, 3. The television program related content providing system according to claim 1, wherein the live keyword and related content address information are transmitted. An ad tag database that stores an ad tag that associates a character string for posting an advertisement with address information of an ad content related to the character string;
An ad tag score creating unit that generates an ad tag posting score based on a bid price of a character string for advertising posting,
The advertisement tag transmission unit selects an advertisement tag to be transmitted based on the advertisement tag posting score, and transmits a character string attached to the selected advertisement tag and address information of advertisement content related to the character string. The television program related content providing system according to claim 1, wherein the television program related content providing system is provided. A CM database and a CM identification unit;
The CM database stores still image feature point data extracted from television advertisement data (hereinafter, “CM data”) and address information of CM synchronized content related to the CM data,
The CM identification unit collates the feature point data stored in the CM database with the feature point data of still images extracted at predetermined intervals from video information included in the broadcast data acquired from the broadcast station. While identifying CM data,
The television program related content providing system according to claim 1, wherein the synchronized CM transmission unit transmits CM synchronized content associated with the identified CM data. A user information database that stores information about the user in association with information for identifying the user;
The user-related information not only includes the received user's personal information, but also categorizes the user into one of a plurality of user groups based on the received user's personal information, and this categorized user group Is included,
When the related information sending unit sends information related to the information included in the various packets acquired from the broadcast station corresponding to the broadcast station specifying information to the user terminal or the television program display device, 2. The television program related content providing system according to claim 1, wherein information relating to the user extracted from the user information database is also referred to. 7. The television program according to claim 6, wherein, when the user is categorized into any user group, a result of counting access states from the user with respect to information transmitted by the related information transmitting unit is referred to. Related content provision system. A shooting data receiving unit and a program identification unit;
Instead of receiving broadcast station specific information from the user terminal or television program display device,
The user terminal captures the moving image displayed on the screen of the television program display device, and the captured data reception unit receives the feature point data calculated for the still image extracted from the captured moving image from the user terminal. Then, the program identification unit collates the feature point data calculated for the still image extracted from the video information included in the broadcast data and the feature point data received from the user terminal, and if the degree of coincidence is a predetermined value or more. 2. The television program related content providing system according to claim 1, wherein a broadcasting station that the user is currently viewing is identified. When the user input information receiving unit receives information specifying a program instead of broadcasting station specifying information or together with broadcasting station specifying information,
2. The television program related content providing system according to claim 1, wherein the related information transmitting unit transmits information related to information included in various packets corresponding to the specified program. The television program related content according to claim 1, further comprising a natural language processing unit that extracts a keyword from character information included in the broadcast data, wherein the character information is caption information. Offer system. 11. The television program related content providing system according to claim 10, wherein the character information includes telop information extracted by character recognition from video information included in broadcast data. 11. The television program related content providing system according to claim 10, wherein the character information includes a voice recognition processing result of voice information included in broadcast data. The television program related content providing system according to any one of claims 10 to 12, wherein the natural language processing unit extracts keywords by morphological analysis using various dictionaries including a fluctuation dictionary. The ad tag score creating unit calculates an ad tag posting score for each ad tag based on a recommendation score determined based on a recommendation algorithm and a bid price of the ad tag,
5. The television program-related item according to claim 4, wherein when the advertisement tag is transmitted, the advertisement tag transmission unit preferentially selects an advertisement tag having a high calculated advertisement tag posting score as a transmission target in principle. Content provision system. 15. The television program related content providing system according to claim 14, wherein the advertisement tag score creating unit determines a recommendation score for each category of the advertisement tag based on a result of aggregating the access status to the content. When the live keyword tag is sent by the live keyword tag sending unit, if the advertisement tag is also sent by the advertisement tag sending unit at the same time, an advertisement for the number of live keyword tags to be sent is made using a dynamic programming algorithm. 3. The television program related content providing system according to claim 1, wherein a ratio of the number of tags is within a predetermined range. The content included in the information provided by the related information transmitting unit is not limited to information provided in one direction, but also includes bidirectional content represented by issuing a questionnaire or a coupon. The television program related content providing system according to any one of claims 1 to 5. A method of providing information related to a television program to a user terminal of a user or a television program display device via a communication network,
A computer capable of communicating with the user terminal or the television program display device and the broadcasting station,
Receiving broadcast station specifying information for specifying a broadcast station from the user terminal or the television program display device;
Obtaining broadcast data from a broadcast station and disassembling it into various packets;
Sending information related to the information contained in the various packets acquired from the broadcasting station corresponding to the broadcasting station specifying information to the user terminal or the television program display device; A step of sending a live keyword tag to which a live keyword extracted from included character information is attached; a step of sending an advertisement tag to which a character string linked to the live keyword is attached; A television program-related content providing method, wherein at least one of three steps of providing CM-synchronized content related to CM data included is executed. A method of providing information related to a TV program to a program viewer via a communication network and an external system,
A computer capable of communicating with the external system;
Obtaining broadcast data from a broadcast station and disassembling it into various packets;
Sending information related to information contained in the various packets to the external system, firstly sending live keyword tags to which live keywords extracted from character information contained in the various packets are attached. A second step, a step of sending an advertisement tag attached with a character string linked to the live keyword, or a character string linked to a character string acquired from the external system, and thirdly included in the various packets A television program related content providing method, wherein at least one of three steps of providing CM synchronized content related to CM data is executed. The computer is connectable to a live keyword tag database storing a live keyword tag that associates a live keyword with address information of related content of the live keyword,
In the step of transmitting the live keyword tag, a character string is extracted from character information included in broadcast data acquired from a broadcasting station, and a live keyword matching the extracted character string is stored in the live keyword tag database. 20. The TV program related content providing method according to claim 18, wherein the live keyword and related content address information are transmitted. The computer is connectable to an advertisement tag database that stores an advertisement tag in which an advertisement posting character string is associated with address information of advertisement content related to the character string,
In the step of sending the advertisement tag, an advertisement tag posting score is generated based on a bid price of the character string for posting an advertisement, and an advertisement tag to be sent is selected based on the advertisement tag posting score. 20. The television program related content providing method according to claim 18, wherein the character string attached to the selected advertisement tag and the address information of the advertisement content related to the character string are transmitted. The computer can be connected to a CM database that stores feature point data of still images extracted from CM data and address information of CM synchronized content related to the CM data,
In the step of providing the CM-synchronized content, the feature point data stored in the CM database and the feature point data of the still image extracted at predetermined intervals from the video information included in the broadcast data acquired from the broadcast station are obtained. 20. The TV program-related content providing method according to claim 18, wherein CM data is identified by collation, and CM synchronized content associated with the identified CM data is transmitted. .

Images