WO2016035219A1 - Système de fourniture de contenu associé à un programme de télévision et procédé de fourniture - Google Patents

Système de fourniture de contenu associé à un programme de télévision et procédé de fourniture Download PDF

Info

Publication number
WO2016035219A1
WO2016035219A1 PCT/JP2014/076369 JP2014076369W WO2016035219A1 WO 2016035219 A1 WO2016035219 A1 WO 2016035219A1 JP 2014076369 W JP2014076369 W JP 2014076369W WO 2016035219 A1 WO2016035219 A1 WO 2016035219A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
tag
advertisement
user
data
Prior art date
Application number
PCT/JP2014/076369
Other languages
English (en)
Japanese (ja)
Inventor
浩一 二瓶
稔 出田
亮太 石井
久彌 須賀
曜子 文分
浩二 村尾
英明 春田
松山　宏之
栄 竹内
説男 木村
Original Assignee
株式会社電通
ソフネック株式会社
株式会社イェンドレッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社電通, ソフネック株式会社, 株式会社イェンドレッド filed Critical 株式会社電通
Publication of WO2016035219A1 publication Critical patent/WO2016035219A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2668—Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content

Definitions

  • the present invention relates to a technique for providing content related to a television program.
  • Patent Document 1 discloses an information processing that can display a keyword list related to words or topics that the user is interested in in information appearing in a program that is being viewed, and that can be used to search for information from the Internet.
  • An apparatus is disclosed.
  • Patent Document 2 discloses a system and method capable of receiving information related to a TV program being viewed by a mobile terminal.
  • an object of the present invention is to provide a mechanism in which a keyword that is anxious can be automatically displayed on the screen without any operation by a viewer and information related to the displayed keyword can be easily obtained.
  • a major feature of the system described in Patent Document 2 is a mechanism for outputting content by specifying a timeline (elapsed time from the start of a program). This requires preparation based on the contents of the program in advance. Accordingly, an object of the present invention is to provide a mechanism that can distribute appropriate keywords according to the progress of a program to viewers without any prior preparation.
  • a television program related content providing system comprises: A system for providing information related to a TV program (including CM) to a user terminal of a user or a TV program display device via a communication network, A user input information receiving unit for receiving broadcast station specifying information (eg, channel number) for specifying a broadcast station from the user terminal or the television program display device; Received packet analysis unit that acquires broadcast data from broadcast station and breaks it down into various packets, And a related information sending unit for sending information related to information contained in the various packets acquired from the broadcasting station corresponding to the broadcasting station specifying information to the user terminal or the television program display device.
  • broadcast station specifying information eg, channel number
  • the related information sending unit includes at least one of a live keyword tag sending unit, an advertisement tag sending unit, and a synchronized CM sending unit,
  • the live keyword tag sending unit sends a live keyword tag to which a live keyword extracted from character information included in the various packets is attached
  • the advertisement tag sending unit sends out an advertisement tag with a character string linked to the live keyword
  • the sync CM sending unit provides CM sync contents related to CM data included in the various packets.
  • the information related to the television program of the present invention is displayed on the screen by at least one of the user terminal of the user and the television program display device. That is, the television program related information may be displayed only on the user terminal, displayed only on the television program display device, or displayed on both the user terminal and the television program display device.
  • the user terminal may be referred to as a second screen.
  • the present invention is intended to be used by a user who is watching a television. However, when the user does not actually watch the television such as when going out, it is possible to designate a broadcast station of interest and display information related to the broadcast content on the portable terminal. It is also possible to designate a broadcast station different from the broadcast station that is actually viewed and display information related to the current broadcast content of the broadcast station.
  • the present invention is a system that provides information via a communication network, and “via a communication network” has a plurality of aspects. Information is typically provided via the Internet, but information may be provided on radio waves transmitted by a broadcasting station.
  • methods for acquiring broadcast data include a method of acquiring wirelessly from a broadcast station via a wired or broadcast wave transmitting antenna, a method of acquiring broadcast data provided by a server of the broadcast station, and the like.
  • a television program related content providing system comprises: A system for providing information relevant to a TV program to a program viewer via a communication network and an external system, Received packet analysis unit that acquires broadcast data from broadcast station and breaks it down into various packets, A related information sending unit for sending information related to information contained in the various packets to the external system is provided.
  • the related information sending unit includes at least one of a live keyword tag sending unit, an advertisement tag sending unit, and a sync CM sending unit, and the live keyword tag sending unit is a live keyword extracted from character information included in the various packets.
  • the advertisement tag sending unit sends an advertisement tag with a character string linked to the live keyword or a character string linked to a character string acquired from the external system.
  • the sync CM sending unit provides CM sync contents related to CM data included in the various packets.
  • the invention according to claim 1 provides information directly to a user, whereas the invention according to claim 2 provides information to an external system.
  • the provided information is provided to the program viewer who is the user by an external system.
  • “program viewer” is not limited to those who are actually watching the program, but also includes those who are interested in the program after listening to the viewer ’s opinions and reputation about the program. .
  • the system of the present invention includes a live keyword tag database that stores a live keyword tag that associates a live keyword with address information of related content of the live keyword,
  • the live keyword tag sending unit extracts a character string from character information included in broadcast data acquired from a broadcasting station, and if a live keyword matching the extracted character string is stored in the live keyword tag database, The live keyword and related content address information are transmitted.
  • the system of the present invention includes an advertisement tag database and an advertisement tag score creation unit
  • the advertisement tag database stores an advertisement tag that associates a character string for advertisement posting with address information of advertisement content related to the character string
  • the advertisement tag score creating unit generates an advertisement tag posting score based on a bid price of a character string for advertisement posting
  • the advertisement tag transmission unit selects an advertisement tag to be transmitted based on the advertisement tag posting score, and transmits a character string attached to the selected advertisement tag and address information of advertisement content related to the character string.
  • the “tag” in the present invention is a virtual tag (small piece) to which a character string that expresses the semantic content of the content is attached, and is inseparable from the address information of the content.
  • the character string attached to the tag is displayed on the screen of the user terminal or the TV program display device. When this character string is selected by an operation such as tapping on the display screen, the content of the address information sent earlier is transmitted. come.
  • the “tag” of the present invention serves to make an image of a tag attached to a tangible product displayed at a storefront for content that is intangible data.
  • “Address information” is generally a so-called URL indicating the location of content on the Internet.
  • the system of the present invention further includes a CM database and a CM identification unit
  • the CM database stores still image feature point data extracted from television advertisement data (hereinafter, “CM data”) and address information of CM synchronized content related to the CM data
  • CM data still image feature point data extracted from television advertisement data
  • the CM identification unit collates the feature point data stored in the CM database with the feature point data of still images extracted at predetermined intervals from video information included in the broadcast data acquired from the broadcast station. While identifying CM data, The synchronized CM transmission unit transmits CM synchronized content associated with the identified CM data.
  • user attribute information for example, information related to the user's age (eg, age range such as birth year, early 30's), gender, broadcasting area, etc.) is stored in association with information for identifying the user.
  • User information database When the related information sending unit sends information related to the information included in the various packets acquired from the broadcast station corresponding to the broadcast station specifying information to the user terminal or the television program display device, It is preferable to refer to the user attribute information extracted from the user information database.
  • the present invention further includes a shooting data receiving unit and a program identification unit, Instead of receiving broadcast station specific information from the user terminal or television program display device,
  • the user terminal captures the moving image displayed on the screen of the television program display device, and the captured data reception unit receives the feature point data calculated for the still image extracted from the captured moving image from the user terminal.
  • the program identification unit collates the feature point data calculated for the still image extracted from the video information included in the broadcast data and the feature point data received from the user terminal, and if the degree of coincidence is a predetermined value or more. For example, the broadcast station that the user is currently viewing may be identified.
  • the related information sending unit corresponds to the specified program.
  • Information related to information included in various packets to be transmitted may be transmitted. Accordingly, it is possible to receive a live keyword tag, an advertisement tag, or CM-synchronized content associated with a program that is of interest to the user regardless of viewing.
  • the present invention further includes a natural language processing unit that extracts a keyword from character information included in the broadcast data, and the character information is subtitle information.
  • the text information may include telop information extracted by video recognition from video information included in the broadcast data, or may include a speech recognition processing result of the speech information included in the broadcast data.
  • the keyword extraction by the natural language processing unit may be performed by morphological analysis using various dictionaries including a fluctuation dictionary.
  • the advertisement tag score creating unit calculates an advertisement tag posting score for each advertisement tag based on a recommendation score determined based on a recommendation algorithm and a bid price of the advertisement tag, and the advertisement tag sending unit When sending a tag, it is preferable to preferentially select an advertisement tag having a high calculated advertisement tag posting score as a sending target in principle.
  • the advertisement tag score creating unit may recommend a recommendation score for each category of the advertisement tag based on a log of an access mode to the content (related content associated with the live keyword tag, advertisement content, or CM synchronized content). May be determined.
  • the advertisement tag score creating unit assigns the user to any of a plurality of user groups based on the received user attribute information.
  • the categorized user group may be included in the determination factor when determining the recommendation score.
  • the advertisement tag posting score calculated by multiplying the recommendation score and the bid price is referred to as “advertisement profitability score” in the following embodiment.
  • the live keyword tag is sent by the live keyword tag sending unit
  • the advertisement tag is also sent by the advertisement tag sending unit
  • content included in the information provided by the related information sending unit is one-way information provision. It is preferable to include not only what is said to be, but also interactive contents represented by issuance of questionnaires and coupons.
  • the invention of the television program related content providing method according to claims 18 to 22 also achieves the above-mentioned problems.
  • FIG. 1 shows the system configuration
  • Embodiments of a television program-related content providing system (hereinafter referred to as “the present system”) according to the present invention will be described below in detail with reference to the accompanying drawings.
  • the configuration of the description of the present embodiment is as follows.
  • ⁇ 1. Overview of this system >> ⁇ 2. Configuration of this system >> ⁇ 2-1. Configuration of user terminal >> ⁇ 2-2. Configuration of Related Content Providing Device >> ⁇ 3. Operation of this system >> ⁇ 3.1. Live keyword tag transmission and advertisement tag transmission processing >> ⁇ 3.2. Processing sequentially performed on received broadcast data >> ⁇ 3.3.
  • Related information provision processing to user terminals >>
  • FIG. 1 shows a user terminal 3 used by a person who is watching a related content providing apparatus 1 and a television program display apparatus (hereinafter “TV”) 2, that is, a user, and broadcasting station equipment 4 (hereinafter “broadcast station 4”). ) And the web server 5.
  • the related content providing apparatus 1 is a server of this system and processes various requests from the user terminal 3 as a client.
  • the user terminal 3 is connected to the related content providing apparatus 1 via a communication network.
  • a communication network is the Internet N
  • the present invention is not limited to the Internet.
  • Each of the television 2 and the related content providing apparatus 1 is wirelessly connected to the broadcasting station 4 via a wired or broadcast wave transmitting antenna (not shown).
  • a TV program can be viewed on various information processing devices such as a personal computer and a smartphone, not limited to a television receiver, but the devices that can be viewed are collectively referred to as “TV”.
  • the television 2 may require a dedicated tuner and decoder, but illustration and description thereof are omitted.
  • the related content providing apparatus 1 receives radio waves from the two broadcasting stations 4A and 4B, but the number is not limited to two. In FIG. 1, it is assumed that the user is watching a program of the broadcasting station 4A.
  • the broadcast station 4A transmits a broadcast program
  • the user's television 2 receives this and displays it on the screen 6.
  • the user activates predetermined application software (hereinafter “application”) on his / her user terminal 3, and the channel number of the broadcasting station 4 ⁇ / b> A viewing the related content providing apparatus 1.
  • application predetermined application software
  • the broadcast program being viewed by the user is also received in real time by the related content providing device 1, and the related content providing device 1 extracts video information, text information, and the like from the received radio waves.
  • the related content providing apparatus 1 transmits to the user terminal 3 information for enabling direct access to the content related to the extracted information without using a search engine.
  • a tag with a relatively short character string is displayed in a list, and when a selection operation is performed on the tag, address information associated with the tag is transmitted to the related content providing apparatus 1, The content corresponding to the tag is displayed on the user terminal 3.
  • the selection operation is often expressed by the word tap on a smartphone or tablet terminal, the word click on a personal computer, and the word remote control operation on a smart TV.
  • the selection operation by the user is expressed as “tap”.
  • CM tags are often referred to in the following description, so here is a brief description. As shown in Table 1, there are three types of tags: CM tags, live keyword tags, and advertisement tags.
  • the CM tag includes a character string (hereinafter referred to as “CM tag keyword”) attached to the CM tag and address information of CM synchronized content.
  • CM tag keyword is a word that is considered by the copywriter that characterizes the advertisement within the restricted number of characters, and includes symbols such as white space, comma (,) question mark (?), And exclamation mark (!).
  • CM-synchronized content is content related to a CM broadcast on a television. For example, there is a secret story about commercial production, comments from talents, and introduction of products related to commercial products. As a related product, if the commercial is related to lipsticks for young women in cosmetics companies, there are products that young women like mascara and teak may be interested in.
  • the related content providing apparatus 1 When the related content providing apparatus 1 identifies the CM currently being broadcast, the related content providing apparatus 1 transmits the CM synchronized content to the user terminal 3 and displays it on the screen of the user terminal 3. When a CM is broadcast on the television in this way, the content related to this CM is displayed almost simultaneously.
  • the related content providing device 1 transmits CM synchronized content page data (file described in HTML or the like), and also transmits a CM tag keyword and CM synchronized content address information to the user terminal 3. This is because a user who wants to view the CM-synchronized content later can view the content by tapping the CM tag keyword.
  • the live keyword tag includes a live keyword, that is, a character string attached to the live keyword tag and address information of related content associated with the live keyword.
  • Live keywords are words that are listed as nouns in various encyclopedias, words that have become popular in newspapers and magazines in recent years, and words that are frequently accessed on the Internet, many of which are proper nouns.
  • the related content is information related to the live keyword, which is produced by a broadcast station or a system operator who outputs information necessary for the user on one page. In production, information is acquired also from an external web server 5 or the like.
  • the character string in which the tap destination content is prepared becomes a live keyword.
  • the point of preparing related contents in advance is a major feature of the present system. In other words, when searching on a conventional search site, information is collected by going back and forth between the search result page and the linked page. In this system, all collected information is compactly combined into one content and displayed. . For this reason, this system provides a separate function for automatically editing or manually editing the tapped content when registering live keywords.
  • the advertisement tag includes a character string (hereinafter referred to as “advertisement tag keyword”) attached to the advertisement tag and address information of the advertisement content.
  • Ad tag keywords are, in principle, linked to one of the live keywords and characterize the ad within the limited number of characters. Symbols such as white space, comma (,) question mark (?), And exclamation point (! Are also included. included. For example, “Yokohama Port Sea Bus”, “Yokohama Chinese Restaurant”, “Yokohama Motomachi Jewelery Store”, etc., are linked to the live keyword tag “Yokohama Port”.
  • an advertisement tag may be output in response to a character string that is not output as a live keyword.
  • the word “wine” is a common noun and has a broad concept, so it is not suitable for being output as a live keyword.
  • it is a keyword for advertising such as “California wine” and “Yamanashi wine”. sell.
  • the advertisement tag keyword is displayed on the screen.
  • the advertising content in the external web server 5 prepared by the advertiser is displayed on the screen.
  • the access to the advertising content from the user terminal 3 is performed through the related content providing device 1 (redirect function) in order to leave a log that the related content providing device 1 is also accessed.
  • the main purpose of the live keyword tag is to provide information to the user, but the advertisement tag is an advertising means for the advertiser. When the advertisement tag is tapped, an advertisement posting fee is usually paid from the advertiser to the operator of this system or a broadcasting station.
  • the user terminal 3 may be a portable information processing apparatus such as a multifunctional mobile phone or a tablet terminal called a smartphone, even a personal computer. However, it is assumed that the user terminal 3 of the present embodiment is an information processing apparatus including a touch panel like a multi-function mobile phone. As illustrated in FIG. 2, the user terminal 3 includes an operation unit 301, a display unit 302, a storage unit 303, a processing unit 304, a transmission / reception unit 305, and an imaging unit 306.
  • the operation unit 301 includes a touch panel arranged on the screen of the display unit 302. An instruction to start / end the program, access to the related content providing apparatus 1, and the like are performed via the operation unit 301.
  • the input operation via the operation unit 301 is referred to as “tap”.
  • the display unit 302 must have a display screen, and appropriately include a speaker.
  • the storage unit 303 includes a computer program for receiving provision of functions executed by the related content providing apparatus 1, screen display software called a browser, parameters necessary for executing these programs, intermediate results of processing, and the like. Is stored.
  • the storage unit 303 can also store information on tags that are to be viewed later among the tags transmitted from the related content providing apparatus 1. This is a so-called bookmark function.
  • the processing unit 304 includes means for retrieving information (for example, user ID) for identifying the user when accessing the related content providing device 1 from the storage unit 303 and transmitting the information, and a live keyword tag or advertisement from the related content providing device 1. If a list of tags is sent, it includes means for selecting a tag in the list and accessing content associated with the tag.
  • the processing unit 304 is realized by the user terminal 3 mounting a predetermined program. That is, it is assumed that a person using this system downloads an application for a user terminal from, for example, an official application store. This program is stored in the storage unit 303.
  • the processing unit 304 controls the operation of each unit including the operation unit 301.
  • the function of the user terminal 3 of the present system can be realized not only by the dedicated application but also by a standardly installed web browser.
  • the transmission / reception unit 305 transmits / receives signals to / from the related content providing apparatus 1 and the web server 5 via the Internet N.
  • the imaging unit 306 is a camera lens and an imaging element. In this embodiment, the image photographing function is not particularly necessary, but is essential in the second embodiment.
  • the related content providing apparatus 1 includes a storage medium such as a hard disk and a memory (not shown), a CPU to which a RAM, a ROM, and the like are connected.
  • the program code is expanded in a RAM or a cache memory, and the CPU reads the program code. By executing this, various processes of this system are realized.
  • the related content providing apparatus 1 is an information processing apparatus having an input / output unit, a communication interface unit, and various buses (not shown) in addition to the CPU and the storage medium. Although only one related content providing apparatus 1 is displayed in FIG. 1, it may be configured by a plurality of information processing apparatuses. In the case of a plurality of units, they may be concentrated on the communication network or distributed. A third embodiment to be described later is an example of being distributed.
  • the related content providing apparatus 1 is roughly divided into a storage unit and a processing unit when attention is paid to functions.
  • elements included in the storage unit are represented by ellipses, and elements included in the processing unit are represented by rectangles. According to the function that the processing unit realizes, as shown in FIG.
  • the received packet analysis unit 101, the CM identification unit 102, the synchronized CM transmission unit 103, the natural language processing unit 104, the live keyword tag transmission unit 105, the advertisement A tag bidding unit 106, an advertisement tag score creating unit 107, an advertisement tag sending unit 108, a distribution processing unit 109, an access log totaling unit 110, a user input information receiving unit 111, and a user information registration unit 112 are included.
  • the “related information sending unit” in claim 1 is the sync CM sending unit 103, the live keyword tag sending unit 105, and the advertisement tag sending unit 108.
  • the operation of each element of the processing unit is controlled by the control unit 100. However, in the following description, the operation of the control unit 100 is not particularly mentioned. The description about each element which comprises a process part is given after description of a memory
  • the storage unit includes a user information database (hereinafter “user information DB”) 151, a CM database (hereinafter “CM-DB”) 152, a live keyword tag database (hereinafter “live keyword tag DB”) 153, an advertisement tag.
  • CM-DB CM database
  • live keyword tag DB live keyword tag database
  • a database hereinafter “advertisement tag DB”
  • access log DB access log recording database
  • the storage unit also stores a program for executing various processes of the system, various dictionaries to be referred to in morphological analysis, an advertisement tag posting score table, various intermediate processing results, and the like.
  • the user information DB 151 registers a user ID, information on the user attribute, and a user group. If the user terminal 3 has a terminal ID, this terminal ID may be used as the user ID, or the terminal ID may be registered together with the user ID. As information about user attributes, registration of at least the year of birth and gender is desirable in order to distribute content suitable for the user. Broadcast area registration is necessary to identify broadcast stations. This is because even if the channel number is the same, the broadcasting station may differ depending on the region. However, if the user terminal 3 has a GPS function, registration of the broadcast area can be omitted.
  • the user approves other items may be input. For example, if an e-mail address or SNS account is entered, convenience and added value can be given, and the system can give points to such users and notify viewing reservations. .
  • CM-DB 152 As shown in the data configuration example of FIG. 5 (1), CM data submitted by a CM provider contracted with this system is registered together with CM identification information (CM-ID). This is the same moving picture material as the CM broadcast on television. Still images are extracted from CM data that is a moving image at predetermined time intervals, and feature point data of each still image is calculated and registered. The feature point data may be registered together with the CM moving image data, or only the feature point data may be registered. In addition to these data, the CM provider and the broadcast period may be registered together. This registration processing in the CM-DB 152 is executed whenever there is a new submission from the CM provider.
  • CM-ID CM identification information
  • the CM tag keyword and the address information of the page data storing the CM synchronized content are registered in association with the CM-ID. Also, a user group may be registered for each CM synchronized content. Note that the page data itself may also be stored in the CM-DB 152.
  • the live keyword tag DB 153 As shown in the data configuration example of FIG. 6, the live keyword and address information of related content are registered in association with the live keyword tag ID.
  • the related content page data may be stored in the live keyword tag DB 153 or may be stored in a storage means or a database server managed by this system. It is desirable that the live keyword tag DB 153 be created before the operation is started and updated appropriately after the operation. In addition, it is appropriate to prepare two types of live keyword tags DB 153 for broadcasting stations and systems common, and give priority to the live keyword tag DB 153 for broadcasting stations.
  • a synonym / synonym / alias of the live keyword is also registered by referring to a thesaurus dictionary provided in the system for natural language processing. These are registered in the user dictionary and referred to during natural language processing.
  • the address information storing the advertisement tag keyword and the page data of the advertisement content submitted by the advertiser is associated with the advertisement tag ID. be registered.
  • an advertiser, a bid price, and the like are also registered in the advertisement tag DB 154.
  • the page data itself of the advertisement content is usually registered in the advertiser's web server.
  • an access mode such as a user group, time, region, tag keyword, and total number of accesses is recorded.
  • the received packet analysis unit 101 receives radio waves (data D1 flowing in the direction of the arrow in FIG. 8, hereinafter referred to as “data D1 in FIG. 8”) from the broadcasting station 4 by hardware such as a capture board (not shown). Then, it is broken down into various packets.
  • the received packet analysis unit 101 decomposes the radio wave received from the broadcasting station into various packets such as video, audio, captions, and program arrangement information (SI: Service Information).
  • SI Service Information
  • the received packet analysis unit 101 acquires a moving image and audio from the video packet.
  • the video includes not only the main broadcast but also a CM, and the extracted video becomes input data of the CM identification unit 102.
  • the received packet analysis unit 101 converts information included in the caption packet into character information according to a predetermined standard.
  • Character information can also be obtained from video packets and audio packets.
  • the information contained in the video packet is decomposed into frames, the difference between the previous and next frames is taken, and the telop information can be extracted by paying attention to the area in which the motion has occurred, but the character information can be acquired from this telop information.
  • the information contained in the voice packet can be converted so that it can be easily recognized, and the converted voice data can be converted into character information by performing acoustic processing and language processing.
  • These extracted character information becomes input data of the natural language processing unit 104.
  • the received packet analysis unit 101 acquires an electronic program guide (EPG) from the program arrangement information packet.
  • the EPG information is sent to the CM identification unit 102 and the natural language processing unit 104 if necessary.
  • the CM identification unit 102 collates the video data (data D2 in FIG. 8) input from the received packet analysis unit 101 with the CM data stored in the CM-DB 152, and determines whether or not the current broadcast is a CM. If it is a CM, it is identified who the provider is and what CM.
  • target CMs include both CMs of sponsor companies (time contracts) and CMs of companies other than sponsors (spot contracts).
  • the CM identification unit 102 extracts still images from the video data at predetermined time intervals, and calculates feature point data. For this feature point extraction, for example, an ORB (Oriented FAST and Rotated BREF) algorithm is used.
  • the ORB Since the ORB is a known algorithm and becomes a function usage level, its details are omitted.
  • the feature point data that matches the calculated feature point data is searched from the CM-DB 152, and if a match is found, the CM is identified. Note that even if the video data received from the broadcasting station is a CM, if it is a CM provided by a CM provider who has not contracted with this system, it is not registered in the CM-DB 152. Not eligible.
  • the character information included in the CM data can be the target of live keyword tag transmission processing and advertisement tag transmission processing described later.
  • the synchronized CM transmission unit 103 determines the address information of the CM synchronized content associated with the CM-ID.
  • the page data (data D4 in FIG. 8) taken out from the CM-DB 152 and acquired based on this address information is sent to the distribution processing unit 109.
  • the user information DB 151 it is desirable to send out CM synchronized content suitable for the user group to which the destination user belongs.
  • the natural language processing unit 104 extracts live keyword candidates from the character information (data D5 in FIG. 8) sent from the received packet analysis unit 101.
  • the natural language processing unit 104 performs morphological analysis on the input character information using various dictionaries (including a thesaurus) such as a user dictionary, a system dictionary, and a fluctuation dictionary. Extract words that are live keyword candidates.
  • various dictionaries including a thesaurus
  • a user dictionary such as a user dictionary, a system dictionary, and a fluctuation dictionary.
  • a fluctuation dictionary extract words that are live keyword candidates.
  • an additional note about the fluctuation dictionary Languages broadcast on television are often exposed with abbreviated names, nicknames, etc. rather than official names. This is compiled from programs broadcast in the past, and a fluctuation dictionary is created. The official name is determined based on the information obtained from the fluctuation dictionary and program information such as EPG.
  • the program name registered in the EPG is “Life of Tadagi Hachiko”
  • “Hachi” is determined as “Hachiko”.
  • a user dictionary is prepared for each broadcasting station.
  • the extracted live keyword candidates (data D6 in FIG. 8) are sent to the live keyword tag sending unit 105.
  • the natural language processing unit 104 has a function of regularly registering the latest keyword or the like in the system dictionary, a function of registering words added on the broadcasting station side in the user dictionary as needed, and the description thereof is omitted.
  • the live keyword tag sending unit 105 When the live keyword tag sending unit 105 obtains a keyword (data D6 in FIG. 8) that is a live keyword candidate from the natural language processing unit 104, the live keyword tag sending unit 105 matches it with data registered in the live keyword tag DB 153. If the live keyword candidates are not registered in the live keyword tag DB 153, they are not processed. If registered in the live keyword tag DB 153, the live keyword and related content address information are passed to the distribution processing unit 109. In this way, the live keyword tag sending unit 105 always prepares and distributes the content of the tap destination by the user for the live keyword tag. Therefore, only the live keyword candidates extracted by the natural language processing unit 104 that are present in the live keyword tag DB 153 are output. The “live keyword candidate” is a keyword until this matching process is performed, and the matched keyword is called a live keyword.
  • the advertisement tag bidding unit 106 submits advertisement data from the advertiser and registers it in the advertisement tag DB 154 in association with the advertisement tag keyword. This registration process is performed independently of the series of processes shown in FIG.
  • the ad tag score creating unit 107 calculates the ad tag based on the result (data D11 in FIG. 8) and the user group of the access status to the content of the live keyword tag accessed by the user and the related ad tag content. Create a posting score table.
  • the advertisement tag score creating unit 107 will be described in detail later together with the advertisement tag bidding unit 106.
  • the live keyword (data D8 in FIG. 8) is passed from the live keyword tag sending unit 105 to the advertisement tag sending unit 108.
  • the advertisement tag sending unit 108 retrieves the advertisement tag keyword related to the live keyword from the advertisement tag DB 154, and the advertisement tag posting score table created by the user group of the destination user and the advertisement tag score creating unit 107 (FIG. 8).
  • the advertisement tag to be sent to the user terminal 3 is selected based on the data D9).
  • the selected advertisement tag and the address information (data D10 in FIG. 8) of the advertisement content corresponding to the selected advertisement tag are passed to the distribution processing unit 109.
  • the advertisement tag sending unit 108 will be described in detail later together with the advertisement tag bidding unit 106 and the advertisement tag score creating unit 107.
  • the distribution processing unit 109 transmits to the user terminal 3 display data (data D12 in FIG. 8) including a CM tag, a live keyword tag, an advertisement tag, or accessed content.
  • the access log totaling unit 110 receives information (data D13 in FIG. 8) tapped from the user terminal 3 and totals the access status logs. Reference data such as the user's preferences can be obtained from this log.
  • the user input information receiving unit 111 receives various information transmitted from the user terminal 3 in which the application for this system is installed.
  • the received information includes a user attribute at the time of user registration, a channel number of a broadcasting station being viewed by the user, and the like.
  • the user information registration unit 112 When user personal information is input via the user input information receiving unit 111, the user information registration unit 112 generates a user ID for identifying the user, and associates the input personal information with the user ID. And stored in the user information DB 151.
  • the user group set based on the user's personal information is also stored. For example, according to gender and age, the user groups of men under 30 years old, men over 30 years old, women under 30 years old, women over 30 years old are group 1, group 2, group 3, group 4, etc. Categorize into
  • the processing unit of the related content providing apparatus 1 also has a function of newly registering, deleting, and correcting data in the CM-DB 152 and the live keyword tag DB 153.
  • the main processing content of this system is to receive radio waves from broadcast stations and to provide relevant information to the user in real time, but in order to carry out this main processing smoothly, the enhancement of the database is indispensable. Absent. For this purpose, data is manually input via an input means such as a keyboard or a mouse. Registration and editing in the database are performed before the system operation, and at any time after the operation is started. Words are alive and new words are always born. Therefore, it is desirable to extract new words using various social network services and add them to the user dictionary in advance or add them to the live keyword tag DB 152 based on these new words.
  • This system can be broadly divided into a process in which the related content providing apparatus 1 receives a TV wave, sequentially processes the received radio wave, and a process of receiving a service provision request from the user terminal 3 and transmitting data to be displayed on the second screen. It consists of.
  • the advertisement tag sending process included in the former series of processes it is a premise that the advertisement tag posting score table is appropriately created and updated. Therefore, before explaining the two main processes described above, live keyword tag transmission and advertisement tag transmission processing including the creation / update of the advertisement tag posting score table (the portion indicated by the closed curve in FIG. 8). Will be described in detail with reference to FIG.
  • Live keyword tag transmission and advertisement tag transmission processing The natural language processing unit 104 outputs the keyword extracted from the caption broadcast or the like to the live keyword tag transmission unit 105 (step S101). Since this keyword has not yet been determined as a live keyword, it should be a live keyword candidate. If the keyword exists as a live keyword in the live keyword tag DB 153, that is, if the related content that is the tap destination is prepared, the live keyword tag sending unit 105 delivers the address information of the live keyword and the related content. The data is sent to the processing unit 109 (step S102). However, the live keyword tag with the tap destination content is not sent unconditionally.
  • the live keyword tag sending unit 105 appropriately includes a function for controlling the same live keyword not to be sent continuously, a function for setting an upper limit of the number of appearances of the same live keyword in the same program, and the like. . It is also desirable to have a function that allows setting of live keywords that should not be transmitted for each program.
  • the distribution processing unit 109 to which the live keyword tag is passed sends information “transmit the live keyword tag to the user terminal 3” to the advertisement tag sending unit 108 (step S103). This is to send the live keyword tag and the advertisement tag to the user terminal 3 at the same time.
  • the advertisement tag sending unit 108 searches the advertisement tag posting score table stored in the advertisement tag DB 154 with live keywords, and has the highest advertisement profitability score (see column C6 in FIG. 11). Is selected and delivered to the distribution processing unit 109 (step S104).
  • the advertisement tag posting score table may be stored in a storage unit (not shown) of the related content providing apparatus 1 or may be stored in the advertisement tag DB 154.
  • the advertisement tag posting score table differs depending on what is adopted as a recommendation score calculation algorithm (hereinafter, “recommendation algorithm”). Therefore, the recommendation algorithm will be briefly described.
  • the recommendation algorithm there are the following (Algorithm 1) to (Algorithm 6). Since these are known algorithms that have been incorporated in existing search engines and mail-order sites, only the main points are described, and details are omitted.
  • Algorithm 1 This is an algorithm for paying attention to the degree of similarity between users and displaying a more suitable advertisement. This is called cooperative recommendation by user category.
  • Algorithm 2 This is an algorithm for paying attention to the degree of context suitability and displaying an advertisement more suitable for the contents spoken in the main part of the program.
  • Algorithm 3 This is an algorithm for paying attention to the degree of program compatibility and displaying more suitable advertisements for advertisement products / services and their categories that are more easily tapped on a program basis.
  • Algorithm 4 This is an algorithm that pays attention to the degree of popularity and posts more suitable advertisements for advertising products / services and their categories that are easy for all users to tap.
  • Algorithm 5 This is an algorithm that pays attention to the degree of social sharing, and displays more suitable advertisements for advertising products / services and categories easily shared by users.
  • Algorithm 6 This is an algorithm for paying attention to the degree of personal preference and posting an advertisement more suitable for an advertising product / service and its category in which the user tends to tap.
  • An advertisement tag posting score table is created based on the above recommendation score.
  • the advertisement tag posting score table is created for each user group, and FIG. 11 illustrates a case where the user group is UG_A.
  • Column C1 of this table is a live keyword tag
  • column C2 contains an arbitrary number of advertisement tags related to each live keyword tag. For example, when a live keyword tag of LTa is transmitted to the user terminal 3, any one of ATa1, ATa2, ATa3, and ATa4 can be transmitted as an advertisement tag.
  • Column C3 is the category of the advertisement tag, and the same category appears in the recommendation score table of FIG.
  • the recommendation score (S) of the recommendation score table is posted.
  • FIG. 1 is a live keyword tag
  • S the recommendation score
  • a value 8 is assigned as a recommendation score to the CGY3 of the advertisement tag category corresponding to the user group UG_A (circled portion in FIG. 10). The same score is transcribed in the circled cell of FIG.
  • Column C5 is the bid price (CPC).
  • Column C6 is the advertising profitability score, which is the product of the recommendation score (S) in column C4 and the bid price (CPC) in column C5.
  • the advertisement tag bidding processing unit 106 performs bid management of advertisements from a person who purchased a character string linked to a live keyword tag registered in advance in the live keyword tag DB 153, that is, an advertiser (step S201).
  • the category of the advertisement tag is recorded, and the input unit price is recorded in the column C5 (step S202).
  • whether or not a certain advertisement is posted is not only determined by the unit price at the time of advertisement bidding.
  • the advertisement to be posted is determined in consideration of the relationship between the advertisement and the keyword, user attribute information, and the like. This is because since it is a CPC, even if a keyword that is not clicked is distributed to the user terminal 3, no profit is generated on the operator side of the system. Therefore, what is used as a criterion for placing an advertisement is important. In this system, the determination is made based on the product of the CPC and the above-mentioned recommendation score. This point will be described with reference to FIG. 9 again.
  • the access log totaling unit 110 takes a log of content access status for each user and collects what words and things the user is interested in (step S302).
  • the access log may manage the information for each user. However, since this complicates the system, it is appropriate to manage the access log by forming a user group having the same gender and age.
  • the advertisement tag score creation unit 107 refers to the access status log for each user group as described above (step S303), and creates a recommendation score table as illustrated in FIG. 10 based on this log (step S304).
  • the advertisement tag score creating unit 107 records the recommendation score in the column C4 of the advertisement tag posting score table, and records the product of this value and the bid price in the column C5 as the advertisement profitability score in the column C6 (step S305).
  • This advertisement profitability score is a criterion for selecting an advertisement tag posted by the advertisement tag sending unit 108.
  • the advertisement profitability score of the advertisement tag ATa3 having a bid price of 40 yen shown in the row R1 in FIG. 11 is 80 yen.
  • the advertising profitability score of the advertising tag ATa4 with a bid price of 20 yen shown in the row R2 is 160 yen. In this case, it is appropriate to select the advertisement tag ATa4 having a high advertisement profitability score even though the bid price is low.
  • the advertisement tag posting score table is sequentially updated according to the status of access log aggregation. In this update process, it is preferable to take into account the registration member correspondence on the day and special recommendation correspondence corresponding to rapid access.
  • the advertisement tag sending unit 108 searches the advertisement tag posting score table with live keywords, and selects the advertisement having the highest advertisement profitability score.
  • the advertisement profitability score of the advertisement tag ATa4 is the highest. Therefore, the advertisement tag ATa4 is set as a candidate to be transmitted to the user terminal 3.
  • not all of the advertisement tags selected here are transmitted. If one live keyword tag is attached and one advertisement tag is put out, it is considered to be an application that displays only advertisements to the user and is avoided. In order not to be considered as an advertising application, the display of the advertisement tag is restricted to a ratio of about once every 10 live keyword tags.
  • an advertisement tag to be sent to the user terminal 3 is determined by using a well-known operations research technique which is a kind of dynamic programming and is also called an optimal stop problem (secretary problem, marriage problem).
  • the distribution processing unit 109 transmits the live keyword tag and the advertisement tag to the user terminal 3 together (step S105). Upon transmission, various transmission restriction conditions are checked as appropriate. This is because there is a time designation for some advertisements, such as advertisements for alcohols.
  • the transmission restriction condition may be stored as a parameter in the storage unit. It should be noted that the advertisement tag transmitted here may have a lower probability of transmission when the next advertisement tag is selected.
  • step S401 the CM of company A is received from the broadcasting station 4A.
  • company A since company A is contracted and the CM is registered in the CM-DB 152, the related content providing apparatus 1 receives the currently received broadcast.
  • the data is identified as CM of Company A.
  • CM-synchronized content of company A is extracted from CM-DB 152.
  • step S402 the CM of Company A ends, and the main broadcast data flows.
  • the related content providing apparatus 1 extracts character information from the caption information received together with the main broadcast data and extracts live keyword candidates by natural language processing.
  • the live keyword candidates LTp, LTq, and LTr are stored in the live keyword tag DB 153, these are set as live keywords.
  • the advertisement tag relevant to each live keyword tag refers to the advertisement tag posting score table, and selects the advertisement tag having the highest advertisement profitability score.
  • step S403 CM of company B flows from the broadcasting station 4A, but the related content providing apparatus 1 is not registered in the CM-DB 152 since it is not contracted with company B, and the CM cannot be identified. Since the related content providing apparatus 1 cannot recognize the CM of company B as a CM, it handles it in the same way as the main data. Therefore, if character information is included, processing for extracting live keyword candidates, sending live keyword tags, and selecting advertisement tags is performed.
  • step S404 CM of company C is received from broadcasting station 4A, but company C is contracted, and since the CM is registered in CM-DB 152, related content providing apparatus 1 is currently receiving it. Broadcast data is identified as CM of company C. Then, the address information of the CM synchronized content of the company C is extracted from the CM-DB 152, and the page data of the CM synchronized content is acquired.
  • step S405 since the main data flows, live keyword tag transmission and advertisement tag selection processing is performed as in step S402.
  • the related content providing apparatus 1 performs the processes illustrated in steps S401 to S405 without interruption while the broadcast radio wave is transmitted for each broadcast station. In this way, since this system processes the received radio waves in real time, even if it is a variety program where the content of the performer's speaking is not fixed in advance or a sports program with extended or changed broadcast time, the actual broadcast content Can be processed.
  • the channel number is transmitted by tapping the button BTN1 corresponding to the channel number.
  • the changed channel number may be transmitted to the related content providing apparatus 1.
  • FIG. 13 there is an “AUTO” button BTN2, which will be described in the second embodiment.
  • the related content providing apparatus 1 uses the CM sync of company A being broadcast.
  • the page data of the content is transmitted to the user terminal 3, and the CM synchronized content of company A is displayed on the user terminal 3 as shown on the screen G2 (step S502).
  • the related content providing apparatus 1 selects and transmits CM-synchronous content suitable for the user from among a plurality of CM-synchronized content normally prepared in consideration of the user group to which the user belongs.
  • the live keyword tag extracted in step S402 and the selected advertisement tag are transmitted to the user terminal 3 and displayed on the screen G3 (step S503).
  • the user can acquire information related to the program almost simultaneously with viewing the program.
  • “Synchronized advertisement of company A” is displayed at the bottom of the tag list on the screen G3. This is a CM tag for making it possible to view the CM-synchronized content of company A that has been displayed most recently even after the broadcast of company A's CM.
  • step S504 When an operation for selecting the second tag LTp from the bottom in the tag list displayed on the screen G3 is performed (step S504), a signal indicating that the tag is selected is transmitted to the related content providing apparatus 1, The related content providing apparatus 1 extracts the related content associated with the live keyword LTp from the live keyword tag DB 153, transmits it to the user terminal 3, and displays it on the screen G4 (step S505).
  • the related content providing apparatus 1 records a log of access status from the user along with transmission of the tapped content. When the access log is updated, the advertisement tag posting score table is also updated.
  • a specific content is transmitted by performing an operation of selecting the live keyword tag LTp.
  • the search keyword “LTp” is passed to the search engine, and a search result list is transmitted. It does not come.
  • Related content is mainly produced by broadcasting stations, but for that purpose, a huge amount of program production know-how is used. Therefore, when the user browses the related content, the user can collect accurate information about the theme “LTp” without effort. If a search engine is used, the user must narrow down the search results. Since narrowing down requires knowledge, inappropriate information may be selected or excellent information may be overlooked due to lack of knowledge. Furthermore, when a search engine is used, a search keyword is input.
  • the related content is information provided to the user in one direction, but it is possible to place an affiliate advertisement for a product or the like related to the content.
  • CM tag All of the CM tag, the live keyword tag, and the advertisement tag are transmitted and displayed by a user's tap, but this content is not necessarily one-way information provision from the system operator to the user. You can answer questionnaires, display quizzes, receive coupon issuance and point grant services, and apply for instant wins, that is, winning prizes on the spot.
  • the CM-synchronized content and the advertising content may be linked to the website of the CM provider or the advertiser so that online shopping can be performed.
  • O2O2O On Air to Online to Offline
  • the related content providing apparatus 1 transmits the CM synchronized content of company C to the user terminal 3 and displays it on the screen G5 (step S506).
  • the CM-synchronized content is transmitted in this way, the CM-synchronized content is displayed instead of the tag list on the screen of the user terminal 3 and the content display.
  • the application stores the tag in the storage unit 303 of the user terminal 3.
  • This is a so-called bookmark function, which allows users to browse the information they care about at a free time.
  • the stored information may be erased by a user operation, or may be automatically performed after a predetermined time has elapsed.
  • the user designates a broadcasting station.
  • the user captures his / her own TV screen 6 at the user terminal 3, transmits it to the related content providing apparatus, and identifies the program based on the image received on the related content providing apparatus side, that is, the current Identify the station you are watching.
  • this broadcast station identification process has been patented by the applicant in Japan (Japanese Patent No. 5574556).
  • Japanese Patent No. 5574556 Japan
  • the difference from the first embodiment will be mainly described with reference to FIG. Note that the same reference numerals as those in FIG. 3 are used for elements having the same functions. In FIG. 14, elements different from those in FIG. 3 are represented by double rectangles.
  • the related content providing device 7 of this embodiment has all the functions of the related content providing device 1 and includes a shooting data receiving unit 701 and a program identification unit 702.
  • the related content providing apparatus 7 subsequently transmits the still image. It is recognized as feature point data.
  • the user terminal 3 captures a moving image shown on the screen 6 of the television by the imaging function.
  • the application of the user terminal 3 extracts still images from the moving image at appropriate intervals, and calculates feature point data.
  • the algorithm for calculating the feature point data is the same as the feature point extraction process by the CM identification unit 102.
  • the shooting data receiving unit 701 receives feature point data from the user terminal 3.
  • the program identification unit 702 decomposes the video data extracted by the received packet analysis unit 101 into still images, calculates feature point data of each still image, and collates with the feature point data received from the user terminal 3, If the degree of coincidence is equal to or greater than a predetermined value, it is possible to determine which television station the user is currently viewing.
  • the CM identification unit 102 calculates feature point data of a still image extracted from video data from a television station in order to identify a CM, the program identification unit 702 may use this.
  • the processing after the related content providing apparatus 7 identifies the broadcasting station being viewed by the program identification is the same as the processing in the first embodiment.
  • the purpose of transmitting the feature point data of the still image by the user terminal 3 is to make the related content providing device 7 recognize the broadcasting station being viewed, so that the feature point data for a short time is transmitted. do it.
  • the channel designation button BTN1 may be tapped, or the automatic button BTN2 may be tapped again.
  • the information processing apparatus that implements the service provided to the user terminal 3 has been described as receiving radio waves from the broadcasting station.
  • the third embodiment is different from the first embodiment in that the received packet analysis process is assigned to a dedicated server.
  • the third embodiment will be described with reference to FIGS. 15 and 16 focusing on the differences from the first embodiment.
  • the related content providing device 8 includes a television broadcast receiving device 8A and a tag sending device 8B.
  • the television broadcast receiving device 8A and the tag sending device 8B are connected to be communicable by wire or wirelessly.
  • the television broadcast receiving device 8A is connected to a plurality of broadcasting stations 4, but a television broadcasting receiving device 8A is installed for each broadcasting station 4, and the plurality of television broadcasting receiving devices 8A are connected to the tag sending device 8B. It may be connected.
  • FIG. 16 is a diagram illustrating functional blocks of the television broadcast receiving device 8A and the tag sending device 8B. Elements having the same functions as those in FIGS. 3 and 8 are denoted by the same reference numerals.
  • the television broadcast receiving apparatus 8A passes the video data decomposed by the received packet analysis unit 801 to the CM identification unit 802 and collates with the CM data in the CM-DB 153 to identify the CM.
  • the CM identification unit 802 transmits the CM-ID to the synchronized CM transmission unit 103 provided in the tag transmission device 8B.
  • the tag transmission device 8B shares the CM synchronized content transmission processing related to this CM.
  • the character information extracted by the received packet analysis unit 801 is transferred to the natural language processing unit 104 provided in the tag transmission device 8B, and a live keyword candidate is extracted. That is, this embodiment is different from the first embodiment only in that an information processing apparatus that receives broadcast radio waves and identifies CM data is independent. By making them independent, system load distribution is realized.
  • CM transmission function a synchronized CM transmission function, a natural language processing function, and a live keyword tag transmission function may be provided on the television broadcast receiver 8A side.
  • the user terminal 3 receives and displays television program related information. However, in this embodiment, related information is displayed on the screen of the television broadcasting the broadcast program.
  • FIG. 17 is a diagram showing a system configuration example of this embodiment.
  • the user terminal 9, the television program display device 10, and the router 11 constitute a home network HN.
  • the user terminal 9 and the television program display device 10 are connected to the related content providing device 12 and the application server 13 via the Internet N, respectively.
  • Each of the television program display device 10 and the related content providing device 12 is wirelessly connected to the broadcasting station 14 via a wired or broadcast wave transmitting antenna.
  • the user terminal 9 and the TV program display device 10 each acquire a dedicated application from the application server 13, and the user terminal 9 and the TV program display device 10 transmit and receive information to and from each other. It is different from other embodiments. Hereinafter, the difference will be mainly described with reference to FIG.
  • the user terminal 9 finds the television program display device 10 connected to be communicable locally within the home network HN (step S601).
  • the TV program display device 10 receives the URL of the TV program display device application (hereinafter, “receiver application”) from the broadcast station 14 (step S602).
  • the broadcasting station 14 has a function of transmitting the URL of the receiver application to the broadcasting station 4 of the first embodiment.
  • the television program display device 10 acquires the receiver application and related data from the application server 13 indicated by the URL received from the broadcast station 14 (step S603).
  • the acquired data includes the URL of an application for a terminal device that operates in cooperation with the television program display device 10 (hereinafter, “cooperative terminal application”).
  • the television program display device 10 transmits the URL of the cooperation terminal application to the user terminal 9, that is, the cooperation terminal (step S604).
  • the user terminal 9 acquires the cooperation terminal application and related data from the application server 13 indicated by the received URL (step S605). Thereafter, since the user terminal 9 and the TV program display device 10 can be directly connected to each other, it is possible to activate the cooperation terminal application from the receiver application or perform data cooperation (step S606). .
  • the television program display device 10 in which the receiver application is installed receives information from the related content providing device 12 almost simultaneously with the broadcast of the broadcast station 14 and displays it on the screen 15.
  • the function of the related content providing device 12 is substantially the same as the related content providing devices 1 and 2 of the above embodiment.
  • the related content providing apparatus 12 may also have the function of the application server 13.
  • the tag list and contents displayed on the screen of the user terminal 3 in the first embodiment are displayed together with the broadcast program on the screen 15 of the television program display device 10.
  • User input operations including tag selection are performed by a television remote control. If a personal computer is also used as the television program display device 10, an input operation including tag selection is performed with a keyboard or a mouse.
  • the user terminal 9 may receive information from the related content providing device 12 and display it on the screen.
  • the information transmitted from the related content providing device 12 may be displayed only by the television program display device 10 and information necessary for the user may be transmitted to the user terminal 9. For example, when there is no time to view the entire content corresponding to the tag displayed on the screen 15, the address information associated with the tag is transmitted to the user terminal 9, and when there is time, the related content providing apparatus 12. It is also possible to receive content from.
  • This embodiment corresponds to the invention according to claim 2.
  • the related content providing apparatus 1 directly provides information to the user.
  • the related content providing apparatus provides information to an external system, and the external system is different in that information is provided to the user.
  • FIG. 1 differences from the first embodiment will be described with reference to FIG. Note that the same reference numerals as those in FIG. 1 are used for elements having the same functions.
  • the related content providing device 16 acquires broadcast data from the broadcast station 4, the related content providing device 16 executes a process for sending at least one of a live keyword tag, an advertisement tag, or CM-synchronized content. It is sent to the server 17.
  • the server 17 provides the information acquired from the related content providing device 16 to the user terminal 3 of the user of the external system.
  • the server 17 of the external system transmits the live keyword that appears as the program progresses to the related content providing device 16. Then, it is conceivable that the related content providing device 16 provides the server 17 with the advertisement tag keyword linked to the received live keyword and the address information of the advertisement content.
  • the related content providing apparatus 16 may identify the CM broadcast on the broadcast station and provide the CM 17 with the CM synchronized content.
  • the program related information is provided only by the server 17 of the external system instead of the user terminal 3, and there is no significant difference from the related content providing device 1 of the first embodiment.
  • FIG. 18 shows only one external system server, the related content providing apparatus 16 may be connected to a plurality of external systems. In this case, the type of information provided for each external system is different, such as providing a live keyword tag and an advertisement tag for one external system and providing CM synchronized content for another external system. Also good.
  • three types of information of the live keyword tag, the advertisement tag, and the synchronized CM are provided to the user side.
  • only one type or two types may be selected and provided.
  • an advertisement tag may be considered unnecessary.
  • keywords are extracted based on caption information extracted from radio waves received from a broadcast station, telop information and audio information included in video.
  • one or both of the telop information and the audio information may be excluded from keyword extraction.
  • the system of the present invention can obtain information in advance by partnering with a broadcasting station, this may also be included in the keyword extraction target. For example, in the case of pre-recorded programs, since the program material can be obtained first, you can set a live keyword tag that is output by specifying the timeline (time from the start of the program) while viewing the program material. Send live keyword tags according to the timeline (preset function).
  • a live keyword tag to be output in advance can be set for a program corner whose broadcast content is known in advance even in a live program.
  • a timeline cannot be set. Therefore, it outputs by queuing at the time of program broadcast.
  • a pre-meta service that is, a service that covers program broadcast contents in advance and advertises programs. Therefore, it is also possible to register in advance the keywords to be output in the program using this service and output them using the cueing function or the preset function as described above.
  • the live keyword and the immediately edited content are registered in the live keyword tag DB 153 and the live keyword tag can be sent to the user side.
  • a live keyword tag such as “Okuma 6 consecutive championships” can be output.
  • the keyword output in such a necessary scene is not limited to the live keyword, but may be an advertisement tag keyword.
  • This advertisement tag does not necessarily have to be linked to the live keyword tag. For example, let's say that Kafu's favorite cafeteria was introduced in a program based on the theme of famous writer Nagai Kafu.
  • information input from the outside may be a target for keyword extraction.
  • a post-meta information service that is, a service in which the content of a television broadcast is recorded by a human and provided to the outside, a keyword that seems to be important is transmitted to the system of the present invention by human judgment, It may also be captured as text information.
  • the case where the character information is Japanese is targeted.
  • this system can also target languages other than Japanese.
  • Languages include languages that are not separated such as Japanese and Chinese, and languages that are separated such as English and Hindi.
  • Languages that are separated are clearly identified by the presence of a blank, but words that are not separated can be determined by a combination rule of part of speech and part of speech. For example, in the case of Japanese, there are adjective + noun combinations, but nouns + adjectives are not possible. By using these rules, the part of speech can be specified to some extent. In other languages, part of speech can be determined by morphological analysis for the following reasons.
  • the occurrence probability of a combination of part of speech and part of speech is obtained from a large amount of text data (corpus), and the part of speech is specified according to this probability. Therefore, as long as there is digitized text data, the dictionary data that is the basis of the morphological analysis can be constructed regardless of the type of language. Therefore, although it is statistical, morphological analysis can be performed in any language. In short, if statistical language processing is used, parts of speech can be recognized as a problem of statistical probability regardless of grammar.
  • the above embodiment is based on the assumption that the user terminal 3 is connected to the Internet while the application is being executed. Therefore, various social media may be used via the Internet. For example, if you have a favorite live keyword tag or advertisement tag, you may post it on Twitter. Although the system may automatically perform a recommendation function based on the access log, recommendation by a friend is effective. This is because there is a lot of information on the Internet, but there are many people who sort out information for reasons such as recommending by peers and attention from peers.
  • the CM identification function can be used only by the CM provider who has registered the CM in the system in advance. Therefore, in the above-described embodiment, related information that should be called a sub CM corresponding to the user attribute is distributed as CM synchronized content. However, not only the distribution of the CM-synchronized content, but the CM provider can also use the user terminal 3 as an advertising medium. For example, the user designates a broadcasting station and a time zone and purchases the right to display his own CM or related content on the screen of the user terminal 3 (which should also be called a second CM frame). When a keyword deeply connected to the CM provider is extracted, the related content provider may distribute the content prepared in advance by the CM provider to the user terminal 3.
  • the CM provider is an automobile manufacturer
  • a keyword such as “car” or “drive” is extracted
  • the CM of the CM provider is distributed.
  • another automobile manufacturer may be a sponsor of a program being broadcast during that time period, so adjust the display of commercials between companies in the same industry using the CM identification function or sponsor information obtained from the broadcasting station. It becomes necessary to do.
  • the system server receives a radio wave from a plurality of broadcasting stations in various places and provides a service for distributing information related to the broadcast program to the user terminal.
  • the present invention can also be applied when a broadcasting station operates a server of this system and provides only information related to the program of the local station to the user.
  • a broadcasting station that provides such an information providing service can be differentiated from other stations and can improve the audience rating.
  • the user terminal is assumed to be a portable terminal device such as a smartphone or a tablet terminal.
  • a personal computer may be used as a user terminal.
  • the service of the system of the present invention can be received through a web browser that is mounted as standard, and user input is performed exclusively by a keyboard or mouse.
  • the user apart from the TV program display device, that is, the TV receiver, the user also uses a user terminal such as a smartphone. Recently, however, TV programs can be viewed on a personal computer connected to the Internet. If this personal computer is provided with the functions of both the television program display device of the above embodiment and the user terminal, the user terminal is not necessary. Even in the case of such a system configuration in which the user terminal is omitted, the function of the system of the present invention for providing broadcast program related information is not completely different.
  • the user receives the information providing service by the system of the present invention while viewing the television program on the television program display device, that is, the television receiver.
  • the user of the system of the present invention does not necessarily have to watch a television program. For example, even when the user is out of the office who cannot watch TV programs, what programs are being broadcast if the system of the present invention is accessed from a user terminal such as a smartphone and CM synchronized content and live keywords are received. Have a clue. If it is an information program, it is also possible to obtain information that is comparable to actual broadcasting. Further, even when actually watching a television program, if a broadcast station different from the broadcast station being viewed is designated, information regarding the program of the broadcast station not being viewed can be obtained.
  • the user is provided with information via the Internet.
  • the information may be provided on a radio wave transmitted by the broadcasting station.
  • the server of this system is in a broadcasting station, the tags and contents sent by this server may be sent on radio waves, for example, by data broadcasting (BML) instead of via the Internet.
  • BML data broadcasting
  • tags and contents may be sent to the broadcasting station via the Internet or the like, and the broadcasting station may provide these to the user by placing them on radio waves.
  • user attribute information is input at the time of user registration, and users are categorized into user groups based on this attribute information.
  • This categorization has the advantage that content suitable for the user can be provided and advertisement tags can be selected.
  • input of user attribute information is not essential for the present invention. This is because the object of the present invention of providing information related to the contents of a television program in real time can be achieved without considering user attributes and preferences. Moreover, if the input of personal information is essential, some people hesitate to register.
  • character information is extracted exclusively from audio information included in broadcast data.
  • a function of recognizing music or BGM from audio information may be included. For example, if the composer of the music is known, this composer name can be transmitted as a live keyword tag.
  • the CM is identified by image recognition.
  • a broadcast station is identified by image recognition.
  • voice recognition it is also possible to identify CMs and broadcasting stations by voice recognition. If voice recognition is used, broadcast stations can be identified continuously. Therefore, it is possible to follow the change of the channel and collect a log of viewing continuation status.
  • the recommendation score is calculated by the collaborative recommendation algorithm based on the user category.
  • any algorithm can be used as long as high advertising revenue can be expected.
  • the configuration of the recommendation score table and the advertisement tag posting score table may be different.
  • the system of the present invention can also be applied to television programs that have already been broadcast.
  • the user records and accesses the server of the present invention when viewing the recorded television program.
  • the server specifies the broadcasting station of the TV program and the date and time when the TV program was actually broadcast, and based on the specified information, the live keyword tag DB, the advertisement tag DB, or the CM -A tag and content are transmitted to the user with reference to the DB.
  • the usage form of the present invention includes simply providing tag information and content regardless of the viewing of a television program.
  • the present invention which can easily obtain information related to a TV program, provides a viewer with a new way of enjoying a TV program, while providing an efficient advertising medium for a sponsor company that provides a CM. Offers the possibility of acquiring new advertising revenue.
  • CM identification unit 103 Synchro CM transmission unit 104: Natural language processing unit 105: Live keyword tag transmission unit 107: Advertisement tag score creation unit 108: Advertisement tag transmission unit 111 : User input information receiving unit 151: User information DB 152: CM-DB 153: Live keyword tag DB 154: Advertising tag DB 2: TV program display device 3: User terminal 4 (4A, 4B): Broadcast station 7: Related content providing device 701: Shooting data receiving unit 702: Program identification unit 8: Related content providing device 8A: Television broadcast receiving device 8B: Tag sending device 9: User terminal 10: Television program display device 12: Related content providing device 14: Broadcast station 16: Related content providing device 17: External system server N: Internet

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

L'invention a pour but de recevoir un contenu associé à un programme de télévision presque simultanément avec l'avancement du programme. Pour atteindre ce but, un serveur (1) du système de la présente invention se connecte sur un réseau de communication à un terminal utilisateur (3) d'un utilisateur qui regarde actuellement un programme de télévision sur un dispositif d'affichage de programme de télévision (2). Si une vidéo obtenue d'une station de diffusion (4) est destinée à un message publicitaire, le serveur (1) transmet un contenu associé au message publicitaire au terminal utilisateur (3). Le serveur extrait également des mots-clés inclus dans des informations de sous-titre et la vidéo obtenue de la station de diffusion (4) et, si un contenu associé aux mots-clés extraits a été produit, le serveur transmet les mots-clés et l'adresse URL du contenu au terminal utilisateur (3). En outre, si un contenu de publicité lié aux mots-clés a été soumis, le serveur transmet l'adresse URL du contenu de publicité sélectionné au terminal utilisateur (3), ladite sélection étant faite en prenant en compte des scores de rentabilité de publicité.
PCT/JP2014/076369 2014-09-05 2014-10-02 Système de fourniture de contenu associé à un programme de télévision et procédé de fourniture WO2016035219A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014181354A JP5726359B1 (ja) 2014-09-05 2014-09-05 テレビ番組関連コンテンツ提供システム、および提供方法
JP2014-181354 2014-09-05

Publications (1)

Publication Number Publication Date
WO2016035219A1 true WO2016035219A1 (fr) 2016-03-10

Family

ID=53278012

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/076369 WO2016035219A1 (fr) 2014-09-05 2014-10-02 Système de fourniture de contenu associé à un programme de télévision et procédé de fourniture

Country Status (2)

Country Link
JP (1) JP5726359B1 (fr)
WO (1) WO2016035219A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020061100A (ja) * 2018-10-12 2020-04-16 東京瓦斯株式会社 スケジュール提案システム及びプログラム
CN112818220A (zh) * 2021-01-26 2021-05-18 广州欢网科技有限责任公司 广告推荐方法、装置及计算机设备
CN115243067A (zh) * 2022-07-21 2022-10-25 天比高零售管理(深圳)有限公司 一种珠宝直播平台文件推送方法及管理系统

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101674310B1 (ko) * 2015-07-31 2016-11-22 이성용 영상 콘텐츠와 연관성을 갖는 광고를 제공하기 위한 광고 매칭 시스템 및 방법
JP7269221B2 (ja) * 2018-03-27 2023-05-08 ソニーグループ株式会社 情報処理装置、情報処理方法、送信装置、及び送信方法
JP6817351B2 (ja) * 2019-02-15 2021-01-20 楽天株式会社 サーバ装置、サービス方法、ならびに、プログラム

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005333369A (ja) * 2004-05-19 2005-12-02 Dowango:Kk 端末装置、コンテンツ配信システム、コンテンツ更新方法、コンテンツ更新プログラム
JP2006005897A (ja) * 2004-05-19 2006-01-05 Dowango:Kk 端末装置、コンテンツ配信システム、情報出力方法、情報出力プログラム
JP2013179640A (ja) * 2005-08-04 2013-09-09 Nippon Telegr & Teleph Corp <Ntt> 電子透かし検出方法、電子透かし検出装置、プログラム、及び記録媒体
JP2013201574A (ja) * 2012-03-23 2013-10-03 Fujitsu Ltd データ出力方法、データ出力プログラム及び端末装置
JP2014042159A (ja) * 2012-08-22 2014-03-06 Sumitomo Electric Ind Ltd 番組コンテンツの提供システム及び方法、並びに、番組提供処理装置及び通信ネットワーク端末装置
JP2014116869A (ja) * 2012-12-12 2014-06-26 Hitachi Consumer Electronics Co Ltd 端末装置及びネットワーク端末システムプログラム

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005333369A (ja) * 2004-05-19 2005-12-02 Dowango:Kk 端末装置、コンテンツ配信システム、コンテンツ更新方法、コンテンツ更新プログラム
JP2006005897A (ja) * 2004-05-19 2006-01-05 Dowango:Kk 端末装置、コンテンツ配信システム、情報出力方法、情報出力プログラム
JP2013179640A (ja) * 2005-08-04 2013-09-09 Nippon Telegr & Teleph Corp <Ntt> 電子透かし検出方法、電子透かし検出装置、プログラム、及び記録媒体
JP2013201574A (ja) * 2012-03-23 2013-10-03 Fujitsu Ltd データ出力方法、データ出力プログラム及び端末装置
JP2014042159A (ja) * 2012-08-22 2014-03-06 Sumitomo Electric Ind Ltd 番組コンテンツの提供システム及び方法、並びに、番組提供処理装置及び通信ネットワーク端末装置
JP2014116869A (ja) * 2012-12-12 2014-06-26 Hitachi Consumer Electronics Co Ltd 端末装置及びネットワーク端末システムプログラム

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020061100A (ja) * 2018-10-12 2020-04-16 東京瓦斯株式会社 スケジュール提案システム及びプログラム
CN112818220A (zh) * 2021-01-26 2021-05-18 广州欢网科技有限责任公司 广告推荐方法、装置及计算机设备
CN115243067A (zh) * 2022-07-21 2022-10-25 天比高零售管理(深圳)有限公司 一种珠宝直播平台文件推送方法及管理系统

Also Published As

Publication number Publication date
JP2016058783A (ja) 2016-04-21
JP5726359B1 (ja) 2015-05-27

Similar Documents

Publication Publication Date Title
JP5726359B1 (ja) テレビ番組関連コンテンツ提供システム、および提供方法
JP7214237B2 (ja) プログラム、情報処理方法および情報処理装置
JP5143747B2 (ja) 広告配信システム、広告配信サーバ、広告配信方法、プログラム及び記録媒体
CN103607647B (zh) 多媒体视频的广告推荐方法、系统及广告播放设备
US8191089B2 (en) System and method for inserting advertisement in contents of video program
JP2016059028A (ja) テレビ番組関連コンテンツ提供方法
US20170303010A1 (en) Methods and apparatus for enhancing a digital content experience
US8799097B2 (en) Accessing remote systems using image content
JP5337147B2 (ja) デジタルコンテンツ投稿の換金化
CN101828393B (zh) 基于媒体的推荐
US10299015B1 (en) Time-based content presentation
JP3678422B2 (ja) 配信システム、配信装置及び広告効果集計方法
KR100898142B1 (ko) 컨텐츠에 관련된 정보 키워드/정보 컨텐츠 제공 방법 및검색 방법 그리고 그 시스템
CN101395627A (zh) 具有视频广告创意的改进的广告
KR101530122B1 (ko) 소셜 네트워크 서비스 제공방법 및 이를 위한 서버
WO2019047850A1 (fr) Procédé et dispositif d&#39;affichage d&#39;identificateur, et procédé et dispositif de réponse à une demande
JP5645153B2 (ja) チャットシステム、リンク情報付きログの提供方法、表示装置、表示方法、プログラム、記録媒体、及びリンク情報付きログ
KR100957007B1 (ko) 실시간 개인 방송의 맞춤형 광고 제공 시스템 및 방법
KR102244195B1 (ko) 가상 광고 제공 방법 및 이를 지원하는 서비스 장치
KR20090099439A (ko) 멀티미디어 콘텐츠 정보에 포함된 메타 정보 기반 키워드광고 서비스 방법 및 그 서비스를 위한 시스템
KR20110043568A (ko) 동영상 정보에 대응되어 저장되는 상업적 태그 등의 메타 정보 기반 키워드 광고 서비스 방법 및 그 서비스를 위한 시스템
KR101398812B1 (ko) 양방향 방송을 위한 멀티채널 시청자 의견참여 시스템 및 그 방법
KR102595058B1 (ko) 광고 다시보기 서비스 제공 방법
JP2010233020A (ja) 情報提供システム
JP2002157500A (ja) インターネットを利用した広告宣伝システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14901087

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14901087

Country of ref document: EP

Kind code of ref document: A1