KR20140064165A - A system and a method for providing value-added information based on realtime broadcasting contents recognition - Google Patents

A system and a method for providing value-added information based on realtime broadcasting contents recognition Download PDF

Info

Publication number
KR20140064165A
KR20140064165A KR1020120131179A KR20120131179A KR20140064165A KR 20140064165 A KR20140064165 A KR 20140064165A KR 1020120131179 A KR1020120131179 A KR 1020120131179A KR 20120131179 A KR20120131179 A KR 20120131179A KR 20140064165 A KR20140064165 A KR 20140064165A
Authority
KR
South Korea
Prior art keywords
broadcast content
additional information
user
module
broadcast
Prior art date
Application number
KR1020120131179A
Other languages
Korean (ko)
Inventor
권영도
한호선
Original Assignee
주식회사 에스비에스콘텐츠허브
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 에스비에스콘텐츠허브 filed Critical 주식회사 에스비에스콘텐츠허브
Priority to KR1020120131179A priority Critical patent/KR20140064165A/en
Publication of KR20140064165A publication Critical patent/KR20140064165A/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content

Abstract

According to the present invention, in order to automatically recognize a viewer (or a listener) who watches (or listens to) a specific broadcast content and provide additional information including advertisement information associated with the broadcast content or benefit information of an affiliated provider in real time A broadcast content recognition module for recognizing a broadcast content currently being viewed or listened to by a user, a broadcast content recognition module for recognizing broadcast content currently being viewed or heard by the user, A supplementary information receiving module for receiving supplementary information associated with the recognized broadcast content, and supplementary information identifying module for identifying the supplementary information based on a supplementary information identification standard including at least one of a supplier, a supply time, An identification module, and temporarily storing the identified additional information And a supplementary information display module for displaying the saved supplementary information to the user when the user requests it or at a predetermined time, and a real-time broadcast content recognition-based supplementary information providing system do.

Description

Technical Field [0001] The present invention relates to a system and a method for providing additional information based on real-

The present invention recognizes broadcast program contents or advertisement contents (hereinafter, collectively referred to as "broadcast contents") broadcast on a television or radio through media such as airwaves, cables, and the Internet in real time, To a viewer or a listener, and a method thereof.

According to an embodiment of the present invention, the present invention recognizes broadcast contents being viewed (or listened to) in real time, and provides the viewer (or the listener) with various additional information and / or benefits associated with the broadcast content, And provides a real-time broadcast content recognition-based additional information providing system and method for providing advertisers with effective advertising and / or various marketing opportunities.

Recently, due to the growth of online advertising market including mobile, traditional broadcasting ad market such as TV or radio is stagnating or decreasing. Accordingly, there is a need for an innovative new technology related to a new additional information providing system and method that can effectively and efficiently provide various additional information associated with a product through broadcast contents including advertisements.

According to an aspect of the present invention, a viewer (or a listener) who has viewed (or listened to) a specific broadcast content is automatically recognized, and additional information including advertisement information associated with the broadcast content or benefit information of an affiliated provider is displayed in real time Which can provide a real-time broadcast content recognition-based additional information providing system and a method thereof.

In order to achieve the above object, according to one aspect of the present invention, there is provided a real-time broadcast content recognition-based additional information providing system for recognizing a broadcast content being broadcasted in real time and providing additional information related to the broadcast content, A supplementary information receiving module for receiving the supplementary information related to the recognized broadcast content, and a supplementary information receiving module for receiving the supplementary information, at least one of a supplier, a supply time, A supplementary information storage module for temporarily storing the identified supplementary information and / or a long-term storage module, and a supplementary information storage module for storing the supplementary information when the user requests An additional information display module for displaying to the user at a predetermined time A real time broadcast content recognition based additional information providing system is provided.

According to another aspect of the present invention, there is provided a method for providing additional information related to real-time broadcast content recognition based on recognition of broadcast content being broadcasted in real time and providing additional information related to the broadcast content, Determining whether the user is watching or listening to the broadcast content; recognizing the broadcast content currently being watched or listened to by the user if the user is viewing or listening to the broadcast content; requesting the supplementary information server for the supplementary information associated with the recognized broadcast content; Storing the received supplementary information for each type of the supplementary information, and displaying the supplementary information to a user at a specified time, if the requested supplementary information is received; do.

According to the present invention, a viewer (or a listener) can directly provide benefits and enjoyment of viewing (listening) of broadcast contents, and can provide a large-sized advertiser or a PPL advertiser with a maximization effect of the self- Advertisers can provide television (or radio) ads (effects) as keyword advertising costs.

Further, according to the present invention, various additional information including at least a part of a name of a product or service, a seller, a price, a sale place, a discount information, an online purchase site, etc. associated with the broadcast content being watched or listened to is automatically The effect of being transmitted to at least one or more information devices such as a smart phone, a smart television, a personal computer (PC), a tablet computer, etc. designated by a viewer or a listener Can be achieved.

1 is a block diagram conceptually showing a real-time broadcast content recognition-based additional information providing system according to an embodiment of the present invention.
FIG. 2 is a flowchart conceptually illustrating a method for providing additional information based on real-time broadcast content recognition according to an embodiment of the present invention.
3A is a diagram illustrating a method of receiving additional information when a user is viewing advertisement contents of a television according to an exemplary embodiment of the present invention and a type and contents of the received additional information.
FIG. 3B is a diagram illustrating a method of receiving additional information when a user is watching a program content of a television according to another embodiment of the present invention, and a type and contents of the received additional information.
FIG. 3C is a diagram illustrating a method of receiving additional information when a user is watching a program content of a television according to another embodiment of the present invention, and a type and contents of the received additional information.
FIG. 3D is a diagram illustrating types and contents of additional information received according to a type of broadcast content that a user is viewing according to another embodiment of the present invention.
4 is a block diagram conceptually illustrating a real-time broadcast content recognition-based additional information providing system according to another embodiment of the present invention.
5 is a flowchart conceptually illustrating a method of providing additional information based on real-time broadcast content recognition according to another embodiment of the present invention.

Hereinafter, the technical idea of the present invention will be described in detail with reference to the accompanying drawings.

Referring first to FIG. 1, FIG. 1 is a block diagram conceptually illustrating a real-time broadcast content recognition-based additional information providing system according to an embodiment of the present invention. As shown, the real-time broadcast content recognition-based additional information providing system 100 of the present invention includes a broadcast content recognition module 102 in which a user currently recognizes broadcast content to be viewed or listened to on the TV 200, An additional information identification module 106 that identifies the received additional information based on an additional information identification standard including at least one of a supplier, a supply time, and an associated merchandise item; An additional information storage module 108 for storing the identified additional information temporarily and / or in the long term, and an additional information display module 110 for displaying the saved additional information to the user when requested by the user or at a predetermined time .

The broadcast content recognition module 102 detects at least a part of broadcast content data including at least a part of audio data, image data, and meta data of a broadcast content currently viewed or listened to by the user, And identifies the congestion of the broadcast content with reference to the date and time. In this case, the broadcast content recognition module 102 may further include a broadcast content database (not shown) for temporarily or periodically storing information about the congestion of the broadcast content.

In addition, the real-time broadcast content recognition-based additional information providing system 100 according to the present invention may further include a central processing unit 114 for performing various logical operations and / or numerical calculations as necessary, A communication module 116 for exchanging data, a storage device 118 for storing data, a display 122 for displaying data, and other hardware 120 required to perform these functions. Furthermore, the real-time broadcast content recognition-based additional information providing system 100 of the present invention further includes an operating system 124 for controlling the operation of the hardware and various other software 126 as needed.

According to an embodiment of the present invention, the real-time broadcast content recognition-based additional information providing system 100 of the present invention can be applied to a smart phone, a smart television, a personal computer (PC), a tablet computer, Or the like, in the form of at least one or more information devices. For example, if the real-time broadcast content recognition-based additional information providing system 100 of the present invention is implemented in the form of a smartphone, the operating system 124 may be an operating system such as Android, iOS, Windows Mobile, The hardware of the system can also be selected as an enemy corresponding thereto. It should be understood, however, that specific examples of such hardware or software are for illustrative purposes only and are not intended to limit the scope of the present invention.

According to another embodiment of the present invention, when the broadcast content recognition module 102 recognizes the broadcast content currently watched or listened to by the user, the supplementary information receiving module 104 may receive the additional information associated with the recognized broadcast content, And a user gesture processing module 112 that sweeps the touch pad while touching the touch pad. However, it should be noted that the user gesture processing module 112 may selectively utilize the functions supported by the application system 124 according to the designer's selection, so that the user gesture processing module 112 is shown as a dotted line for visual representation.

In addition, the real-time broadcast content recognition-based additional information providing system 100 of the present invention may include a supplementary information server (not shown) for storing supplementary information associated with broadcast contents through a network 400 such as a wired or wireless communication network The additional information associated with the currently recognized broadcast content can be supplied from the user terminal 300. [ In this case, the additional information receiving module 104 provides identification information of the broadcast content recognized by the broadcast content recognition module 102 to the additional information server 300, and receives additional information supplied from the additional information server 300. The identification information of the recognized broadcast content may be the identification data selected by extracting the audio data of the content, or the image data extracted through the screen capture, but it is not limited thereto.

2, FIG. 2 is a flowchart conceptually illustrating a method of providing additional information based on real-time broadcasting contents recognition according to an exemplary embodiment of the present invention. Referring to FIG. As shown in the figure, the real-time broadcast content recognition-based additional information providing method S100 of the present invention determines whether the current user is watching or listening to the broadcast content, for example, on the TV 200 (step S102). If it is not watching or listening, it waits for a preset time or immediately judges whether it is watching or listening to the broadcast contents immediately. If it is determined that the user is watching or listening to the broadcast content, a process of recognizing the broadcast content currently being watched or listened to is performed (step S104). Next, it is judged whether or not the recognition processing of the broadcast content is successful (step S106). If it is not successful, it is waited for a preset time or immediately executes the recognition processing of the broadcast contents again. If the recognition of the broadcast content is successful, the supplementary information server 300 requests the supplementary information associated with the recognized broadcast content (step S110). Next, it is judged whether or not the requested additional information (associated with the recognized broadcast content) has been received, and if it has failed, waiting for a predetermined time or immediately requesting additional information associated with the broadcast content . If the requested additional information is received, the received additional information is identified based on the additional information identification standard (step S114), and the identified additional information is temporarily and / or stored for each type S116). Next, it is determined whether the user requests to display the saved additional information (step S118). If not, the process waits for a predetermined time or returns to the initial state. This depends on the user's settings or the designer's initial settings. On the other hand, if it is determined that the user has requested to display the saved additional information, the additional information requested to be displayed is displayed to the user (step S120).

The receiving of the additional information may be performed automatically when the viewing or listening broadcast content is recognized. However, according to another embodiment of the present invention, the user may process the user gesture to sweep down while touching the touch pad, Lt; / RTI > The step of processing the user gesture is shown as step S108 in FIG. 2, and is marked with a dotted line to indicate that this step is optional.

The user may request to immediately display the received additional information, but may request the additional information at a later time. Therefore, the received additional information may be stored for each type, It is desirable to allow the users at the time to identify each other. The method and type of receiving the additional information will be described in more detail below with reference to FIGS. 3A to 3D.

Referring to FIGS. 3A to 3D, FIGS. 3A to 3D are views illustrating, by way of example, a receiving method, a type, and contents of sub information provided according to an embodiment of the present invention. 3A is a diagram illustrating a method of receiving additional information when the user is viewing the advertisement content of the television and a type and contents of the received additional information. As shown in the figure, the real-time broadcast content recognition-based additional information providing system 100 of the present invention confirms that the current user is watching broadcast content (advertisement content in the illustrated example) and recognizes the broadcast content being watched by the user One). Next, the user touches the ribbon-shaped object at the top right of the screen and is swept down to request additional information related to the broadcast content (advertisement content) (of course, this operation may be set to be performed automatically, same.). When the associated additional information is received in response thereto, the received additional information is identified and stored in a suitable position according to the type thereof (screen 2). Finally, when the user requests to display the received additional information (such as a method of touching a tag object or the like to display specific additional information), the additional information is displayed on the screen (screen 3).

3B is a diagram illustrating a method of receiving the additional information when the user is viewing the program content of the television according to another embodiment of the present invention, to be. As shown in the figure, the real-time broadcast content recognition-based additional information providing system 100 of the present invention confirms that the current user is watching broadcast content (program content of the television in the example shown) and recognizes the broadcast content being watched by the user . In this state, the user touches the ribbon-shaped object at the upper right of the screen and is swept down to request additional information associated with the broadcast content (television program content) As shown in Fig. When the additional information associated with the television program content is received in response thereto, the received additional information is identified and stored in a suitable location according to the type of the additional information (screen 1). The additional information is displayed on the screen immediately when the additional information is received or when the user requests to display the received additional information (such as a method of touching a tag object or the like for displaying specific additional information) (Screen 2). Such additional information can be used in a manner of inputting a coupon number or the like included in the additional information at a web site of an additional information provider, an online commerce site, or the like according to a user's selection (screen 3).

FIG. 3C is a diagram illustrating a method of receiving additional information when a user is watching a program content of a television according to another embodiment of the present invention, and a type and contents of the received additional information. In this embodiment, an example of receiving additional information related to a scene being broadcasted on the screen of the television program instead of the additional information associated with the television program content itself will be described. As shown in the figure, the real-time broadcast content recognition-based additional information providing system 100 of the present invention confirms that the current user is watching broadcast content (program content of the television in the example shown) and recognizes the broadcast content being watched by the user . It can be determined that a specific scene of the television program content currently being broadcast is being watched according to the recognized time point. In this state, the user touches the ribbon-shaped object at the upper right of the screen and is swept down to request to receive additional information associated with the broadcast content (the current scene of the television program content in the illustrated example) As described above). Upon receipt of the additional information associated with the scene of the television program content in response thereto, the received additional information is identified and stored in a suitable location according to the type of the additional information (screen 1). The additional information is displayed on the screen immediately when the additional information is received or when the user requests to display the received additional information (such as a method of touching a tag object or the like for displaying specific additional information) (Screen 2). The user can confirm the content of the displayed additional information and utilize it in a manner such as moving to the website provided in the additional information according to the selection (screen 3 and screen 4).

FIG. 3D is a diagram illustrating types and contents of additional information received according to a type of broadcast content that a user is viewing according to another embodiment of the present invention. As shown in the figure, when viewing the advertisement contents of the television, a coupon (sample exchange coupon) for exchanging product samples of the sponsor company or a coupon (price benefit coupon) for providing price discount benefit can be provided. On the other hand, when viewing the program content of the television, a price benefit coupon of a product such as a broadcaster or a sponsor, product information related to a specific scene, a prize benefit coupon, and the like may be provided. Of course, the type and contents of the additional information shown are merely examples, and the type and contents of the additional information such as hyperlink information, moving picture information, and the like may vary according to the designer's selection.

4 is a block diagram conceptually illustrating a real-time broadcast content recognition-based additional information providing system according to another embodiment of the present invention. As shown in the figure, the real-time broadcast content recognition-based additional information providing system 100b according to another embodiment of the present invention includes a broadcast content recognition module 102b for recognizing a broadcast content that the current user is watching or listening to, A broadcast content recognition request module 1024 for requesting the broadcast content recognition server 500 to identify the congestion of the broadcast content detected from the broadcast content recognition server 500, And differs from the embodiment shown in FIG. 1 in that it further includes a broadcast content recognition result reception module 1026 that receives recognition results of broadcast content.

The broadcast content recognition server 500 compares a part of the broadcast content data detected and transmitted by the broadcast content detection module 1022 with the broadcast content data that is being stored referring to the detection time or the like, (Or the name of a broadcast program or a broadcast advertisement) of the broadcast content, additional information associated with the broadcast content itself such as the producer, sender, sponsor, performer, etc. of the broadcast content, It is possible to extract related additional information. 1 and 2, in the above-described embodiment, this operation is assumed to be performed by the real-time broadcast content recognition-based additional information providing system 100. However, according to the present embodiment, The above operation such as determination of congestion is delegated to the broadcast content recognition server 500 through the network 400 in real time so that more concise software or hardware configuration can be realized and high speed operation can be performed. Other components are the same as those of the above-described embodiment with reference to FIG. 1, and therefore, a detailed description thereof will be omitted.

5, FIG. 5 is a flowchart conceptually illustrating a method of providing additional information based on real-time broadcasting contents recognition according to another embodiment of the present invention. The real-time broadcast content recognition-based additional information providing method S100b according to this embodiment is a method for providing a real-time broadcast content recognition-based additional information providing method in which, in order to recognize a broadcast content that the user is currently watching or listening to, A broadcast content recognition request step S1044 for requesting the broadcast content recognition server 500 to distinguish the congestion of the detected broadcast content, a broadcast content recognition result reception step for receiving the recognition result regarding the broadcast content from the broadcast content recognition server 500 And differs from the embodiment shown in Fig. 2 in that it includes a receiving step S1046. The other steps are the same as those of the above-described embodiment with reference to FIG. 2, and a detailed description thereof will be omitted.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of illustration, It should be noted that the present invention is not limited thereto.

Claims (4)

A real-time broadcast content recognition-based additional information providing system for recognizing a broadcast content being broadcast in real time and providing additional information related to the broadcast content,
A broadcast content recognition module for recognizing a broadcast content currently viewed or listened to by a user;
An additional information receiving module for receiving additional information associated with the recognized broadcast content;
An additional information identification module for identifying the received additional information based on an additional information identification standard including at least one of a supplier, a supply time, and an associated product;
An additional information storage module for temporarily storing the identified additional information and / or for a long term; And
An additional information display module for displaying the saved additional information to the user when the user requests it or at a predetermined time,
Based on the broadcast information,
The method according to claim 1,
Wherein the broadcast content recognition module comprises:
A broadcast content detection module for detecting a portion of data of the broadcast content;
A broadcast content recognition request module for requesting a broadcast content recognition server to distinguish the detected congestion of the broadcast content; And
A broadcast content recognition result reception module for receiving a recognition result of the broadcast content from the broadcast content recognition server;
Based on the broadcast information, the real-time broadcast content recognition-based additional information providing system.
A real-time broadcast content recognition-based additional information providing method for recognizing a broadcast content being broadcasted in real time and providing additional information related to the broadcast content,
Determining whether the current user is watching or listening to the broadcast content;
Recognizing the broadcast content currently being watched or listened if the user is determined to be watching or listening to the broadcast content;
Requesting the additional information server for additional information associated with the recognized broadcast content;
Storing the received additional information according to the requested additional information if the requested additional information is received; And
And displaying the additional information to the user at a specified time
Based on the received broadcast information.
The method of claim 3,
Wherein the step of recognizing the broadcast content comprises:
A broadcast content detection step of detecting broadcast content data;
A broadcast content recognition request step of requesting the broadcast content recognition server to distinguish the detected congestion of the broadcast content; And
A broadcast content recognition result reception step of receiving a recognition result of the broadcast content from the broadcast content recognition server
Based on the received broadcast information.
KR1020120131179A 2012-11-19 2012-11-19 A system and a method for providing value-added information based on realtime broadcasting contents recognition KR20140064165A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120131179A KR20140064165A (en) 2012-11-19 2012-11-19 A system and a method for providing value-added information based on realtime broadcasting contents recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120131179A KR20140064165A (en) 2012-11-19 2012-11-19 A system and a method for providing value-added information based on realtime broadcasting contents recognition

Publications (1)

Publication Number Publication Date
KR20140064165A true KR20140064165A (en) 2014-05-28

Family

ID=50891655

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120131179A KR20140064165A (en) 2012-11-19 2012-11-19 A system and a method for providing value-added information based on realtime broadcasting contents recognition

Country Status (1)

Country Link
KR (1) KR20140064165A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017160062A1 (en) * 2016-03-16 2017-09-21 삼성전자 주식회사 Method and device for recognizing content
KR20180084750A (en) * 2015-09-18 2018-07-25 소렌슨 미디어, 인크. Digital overlay offers on connected media devices

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180084750A (en) * 2015-09-18 2018-07-25 소렌슨 미디어, 인크. Digital overlay offers on connected media devices
KR20200070431A (en) * 2015-09-18 2020-06-17 더 닐슨 컴퍼니 (유에스) 엘엘씨 Digital overlay offers on connected media devices
US10863222B2 (en) 2015-09-18 2020-12-08 The Nielsen Company (Us), Llc Digital overlay offers on connected media devices
US10863223B2 (en) 2015-09-18 2020-12-08 The Nielsen Company (Us), Llc Digital overlay offers on connected media devices
US10869078B2 (en) 2015-09-18 2020-12-15 The Nielsen Company (Us), Llc Digital overlay offers on connected media devices
US11218761B2 (en) 2015-09-18 2022-01-04 Roku, Inc. Digital overlay offers on connected media devices
WO2017160062A1 (en) * 2016-03-16 2017-09-21 삼성전자 주식회사 Method and device for recognizing content
US11012739B2 (en) 2016-03-16 2021-05-18 Samsung Electronics Co., Ltd. Method and device for recognizing content

Similar Documents

Publication Publication Date Title
US11159849B2 (en) System and method for providing information related to an advertisement included in a broadcast through a network to a client terminal
US8577399B2 (en) Systems and methods for facilitating a commerce transaction over a distribution network
CA2806881C (en) Universally interactive request for information
US20070136773A1 (en) Systems and methods for providing television services using implicit content to indicate the availability of additional content
US10674230B2 (en) Interactive advertising and marketing system
CA2879522C (en) Systems, methods and computer-readable media for determining outcomes for program promotions
JP2010178176A (en) Information distribution server, portable terminal, information distribution system equipped with these, and information distribution method
US20230119695A1 (en) Online advertising and promotional coordination system
KR20170059260A (en) Apparatus for mobile commerce platform and method for operating the same
KR20120076673A (en) Method and apparatus for providing advertisement serbvice in mobile communication system
KR20140078010A (en) Apparatus and Method for Measuring Advertising Effect
KR20080085677A (en) Apparatus and method for providing contents
US8952791B2 (en) Method and system for tracking RFID tags for use in advertising and marketing
KR20040098630A (en) Content delivery apparatus and content creation method
KR20140064165A (en) A system and a method for providing value-added information based on realtime broadcasting contents recognition
JP5870503B2 (en) Terminal device, information providing program and method
US20190130439A1 (en) Website traffic tracking system
KR20170080550A (en) System for selling goods using PPL and method for selling the same
KR101909253B1 (en) Device and method for displaying advertisment indicator during zapping time
KR20090109153A (en) System for order, payment and delivery throuth information and advertising to each local area in detile by IP TV and processing method for the same
KR20150055128A (en) Advertising Method Using Mobile Device by Advertisement Managing Server and Server for Distributing Program therefor
KR20150121732A (en) Method for Advertising on Advertising Tower, and Advertisement Managing Server therefor
TWI568287B (en) Message notification method and system, notification server
JP2019201366A (en) Information processing system, broadcasting device, receiving device, terminal device, server device, method, and computer program
JP2014194600A (en) Information provision device, system, method and program

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination