KR101544547B1 - Method, system and computer-readable recording medium for providing advertisement based on content usage by user - Google Patents

Abstract

The present invention relates to a method, system and computer-readable recording medium for providing advertisements based on content usage by a user.
According to an aspect of the present invention there is provided a method for providing an advertisement based on content usage by a user, the method comprising: recognizing content received data from a content data sending device by automatic content recognition; The method comprising: determining an advertisement and an area in which the advertisement is to be provided; and providing an advertisement in accordance with the determination, wherein the advertisement determination step determines whether the recognized content is non-advertisement content, Or recommending content of a genre similar to the recognized content or relating to a product that reminds the recognized content or determining an advertisement that is an advertiser's sponsoring the recognized content, And if the recognized content is an advertisement content, the content is similar to the recognized content Determining whether an advertisement of the recognized content is the same as or similar to the advertiser of the recognized content or an advertisement of the same or similar product and product of the recognized content, Determining an advertisement providing area within the application, and determining an advertisement providing area within the application.

Description

METHOD, SYSTEM AND COMPUTER READABLE RECORDING MEDIUM FOR PROVIDING ADVERTISEMENT BASED ON CONTENT USAGE BY USER BACKGROUND OF THE INVENTION 1. Field of the Invention [0001]

The present invention relates to a method, system and computer-readable recording medium for providing advertisements based on content usage by a user.

Recently, various contents are supplied to users by various TV media such as broadcast TV, cable TV, IP TV, and the like. Such contents include (broadcast) program contents, VOD contents, music contents, and various other advertisement contents.

On the other hand, TV providers (for example, broadcasting stations, IP TV providers, etc.), advertisers, and advertising agencies actively engaged in various kinds of TV media such as those mentioned above have been constantly interested in how contents are used by users . However, according to the related art, only when a user responds to an online questionnaire specifically given through his / her mobile terminal, or when a dedicated device is attached to a user's TV terminal, only a TV provider, an advertiser, The information about the user's use of the content can be obtained with very limited interest.

In order to solve the above problems, the present inventors have found that by automatically recognizing digital content and inputting it to a query engine, and inputting a digital fingerprint from reference contents collected in advance into the query engine, (See also an overview of the automatic content recognition technology of FIG. 1) to extract information about the recognized digital content (of course, according to another known technique, digital The content may be automatically recognized based on the watermark or the ultrasonic data instead of the fingerprint). The conventional technology for recognizing the above-described automatic contents is disclosed in Korean Patent Laid-Open Publication No. 10-2008-0098878.

Accordingly, the present inventors have already proposed the invention of Korean Patent Application No. 2013-100677 entitled "METHOD, SYSTEM AND COMPUTER READABLE RECORDING MEDIUM FOR OBTAINING INFORMATION ABOUT UTILIZATION OF USE BY USER" There is.

On the other hand, the present inventor has further proposed, through this specification, the invention of a new advertisement technique achieved between devices (i.e. between a TV terminal and a mobile terminal) based on automatic content recognition technology, in addition to the above invention I want to.

As a result of examining the present invention, the following two prior arts have been investigated.

Korean Patent Laid-Open Publication No. 10-2012-0034378 discloses a system for providing advertisement information through sound recognition, comprising: a sound receiving unit for receiving an external sound, which is a sound recognized from a mobile terminal through a mobile terminal; An information providing unit for searching for advertisement information, an information providing unit for providing the advertisement information to the mobile terminal, and a billing performing unit for performing billing based on the provision of the advertisement information to the advertiser corresponding to the advertisement information. There is a bar.

Next, Korean Patent Laid-Open Publication No. 10-2012-0108377 discloses a system for synchronizing advertisement information, which comprises a media device for outputting advertisement sound information, a mobile device provided with a sound recognition sensor, And using an audio performed in an environment including an advertisement database for storing advertising sound information and corresponding content information.

The above conventional technologies have reached the idea of providing advertisement information to a mobile terminal based on automatic content recognition technology, but they have also had disadvantages such as inconvenience of a user or inability of a user to experience advertisement in a timely manner.

SUMMARY OF THE INVENTION The present invention has been made to solve all the problems of the prior art described above.

It is another object of the present invention to provide an advertisement effectively based on content usage by a user, which is grasped by employing automatic content recognition technology.

It is another object of the present invention to maximize the advertisement effect of a user who uses a mobile terminal while receiving content through a TV terminal.

In order to accomplish the above object, a representative structure of the present invention is as follows.

According to an aspect of the present invention there is provided a method for providing an advertisement based on content usage by a user, the method comprising: recognizing content received data from a content data sending device by automatic content recognition; The method comprising: determining an advertisement and an area in which the advertisement is to be provided; and providing an advertisement in accordance with the determination, wherein the advertisement determination step determines whether the recognized content is non-advertisement content, Or recommending content of a genre similar to the recognized content or relating to a product that reminds the recognized content or determining an advertisement that is an advertiser's sponsoring the recognized content, And if the recognized content is an advertisement content, the content is similar to the recognized content Determining whether an advertisement of the recognized content is the same as or similar to the advertiser of the recognized content or an advertisement of the same or similar product and product of the recognized content, Determining an advertisement providing area within the application, and determining an advertisement providing area within the application.

In addition to this, another method for implementing the present invention, another system, and a computer-readable recording medium for recording a computer program for executing the method are further provided.

According to the present invention, an advertisement can be effectively provided based on content usage by a user, which is grasped by employing an automatic content recognition technology.

According to the present invention, it is possible to maximize the advertising effect on the user who uses the mobile terminal while receiving the content through the TV terminal.

1 is a schematic diagram of an automatic content recognition technique.
2 is a diagram showing a schematic configuration of an overall system for providing an advertisement based on content usage by a user according to an embodiment of the present invention;
3 is a detailed diagram illustrating an internal configuration of an advertisement providing system according to an embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, the specific shapes, structures, and characteristics described herein may be implemented by changing from one embodiment to another without departing from the spirit and scope of the invention. It should also be understood that the location or arrangement of individual components within each embodiment may be varied without departing from the spirit and scope of the present invention. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention should be construed as encompassing the scope of the appended claims and all equivalents thereof. In the drawings, like reference numbers designate the same or similar components throughout the several views.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention.

[Preferred Embodiment of the Present Invention]

In the present specification, content is a concept of collectively referred to as digital information or individual information elements, which are accessible through a communication network, such as characters, codes, sounds, sounds, images, and moving pictures. Such content may comprise, for example, data such as text, images, animations, audio, links (e.g., web links), or a combination of at least two of these data. In particular, typical content in the present invention may include program content, VOD content, music content, and the like, and ad content whose provision is associated with the provision of such content.

Configuration of the entire system

2 is a diagram showing a schematic configuration of an overall system for providing an advertisement based on content usage by a user according to an embodiment of the present invention.

2, an overall system according to an embodiment of the present invention includes a communication network 100, an advertisement providing system 200, a user's mobile terminal 300, and a user's TV terminal 400, .

First, the communication network 100 according to an embodiment of the present invention may be configured without regard to communication modes such as wired communication and wireless communication, and may be a LAN (Local Area Network), a Metropolitan Area Network ), A wide area network (WAN), and the like. Preferably, the communication network 100 referred to herein may be the well-known Internet or World Wide Web (WWW). However, the communication network 100 may include at least one of a known wired and wireless television communication network, a known wired and wireless data communication network (including a near-near wireless data communication network such as an RF communication network and a Bluetooth communication network) But may be included in some cases.

Next, an advertisement providing system 200 according to an embodiment of the present invention is a system in which when a dedicated application (not shown) of the user's mobile terminal 300 is activated, the content provided by the user's TV terminal 400 (Or a dedicated application of the mobile terminal 300) of the mobile terminal 300 and thereby recognize the content of the TV terminal 400 by the automatic content recognition technology. The advertisement providing system 200 may also function to provide the mobile terminal 300 with an advertisement associated with the recognized content. Such advertisements may be provided to the user via dedicated applications as described above or other applications (not shown) of the mobile terminal 300.

The configuration and function of the advertisement providing system 200 according to the present invention will be described in detail through the following detailed description.

Next, a mobile terminal 300 of a user according to an embodiment of the present invention is a digital device including a function of accessing the advertisement providing system 200 and communicating with the mobile terminal 300. The digital device includes a mobile phone (in particular, a smart phone) A digital device equipped with a memory means such as a web pad (especially a smart pad), a tablet computer, a notebook computer, a PDA, a wearable device (particularly, smart watch, smart glass, Can be adopted as the mobile terminal 300 according to the present invention.

Particularly, the mobile terminal 300 may include a dedicated application program for causing the advertisement providing system 200 to receive data (mainly tone data of the content) of the content provided by the user's TV terminal 400 have.

Preferably, the dedicated application directly receives the data of the content being provided in the TV terminal 400 and then transmits it to the advertisement providing system 200 according to the automatic content recognition technology as described above, The sound data of the content of the TV terminal 400 received through the microphone (not shown) of the mobile terminal 300 in cooperation with the microphone module (not shown) and the communication module (not shown) To the advertisement providing system 200 via the Internet.

Lastly, the user's TV terminal 400 according to an embodiment of the present invention may be a device that transmits data (i.e., TV data) of one of the above-described various kinds of contents May be general data capable of extracting a digital fingerprint as described above, but it may also be data including a watermark or ultrasound data). The TV terminal 400 may be a conventional terminal 400 for a broadcast TV, a cable TV, an IP TV, a home theater system, or the like.

Meanwhile, although the present invention is broadly exemplified as an apparatus for transmitting data of contents according to the present invention as the TV terminal 400, it is also possible to use content data (e.g., a movie projection system, a digital signage, Transmitters should also be regarded as falling within the scope of the present invention.

Configuration of the advertisement providing system

Hereinafter, the internal configuration of the advertisement providing system 200 and the functions of the respective components will be described.

3 is a detailed diagram illustrating an internal configuration of an advertisement providing system 200 according to an embodiment of the present invention.

3, an advertisement providing system 200 according to an embodiment of the present invention includes a content recognizing unit 210, an advertisement providing unit 220, a database 230, a communication unit 240, and a controller 250 ). ≪ / RTI > According to an embodiment of the present invention, at least a part of the content recognition unit 210, the advertisement providing unit 220, the database 230, the communication unit 240, and the control unit 250 may communicate with the mobile terminal 300 Lt; / RTI > Such a program module may be included in the advertisement providing system 200 in the form of an operating system, an application program module or other program module, and may be physically stored in various known memory devices. Such a program module may also be stored in a remote storage device capable of communicating with the advertisement providing system 200. [ Such program modules, on the other hand, encompass but are not limited to routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types as described below in accordance with the present invention.

First, the content recognition unit 210 according to an embodiment of the present invention can receive data of the content provided from the TV terminal 400 through the mobile terminal 300 and perform a function of recognizing the corresponding content . The contents recognition unit 210 transmits the data of the contents of the TV terminal 400 to the mobile terminal 300 (or the mobile terminal 300) only when the dedicated application of the mobile terminal 300 is activated Application), and thus can recognize the content of the TV terminal 400. [ For this purpose, the content recognition unit 210 may include a known automatic content recognition engine (not shown) or may execute a known process for recognizing an automatic content. However, it is apparent to those skilled in the art that at least a part of the function of content recognition may be performed by a dedicated application of the mobile terminal 300. [

Next, the advertisement providing unit 220 according to an embodiment of the present invention determines an advertisement associated with the recognized content, determines an area where the advertisement is to be provided, processes the advertisement in accordance with the decisions as necessary , And to provide the advertisement to the mobile terminal 300. The details will be described below.

1. Decision of advertising

First, the advertisement to be provided may be determined according to the type of the recognized content.

(1) When the recognized content is non-advertisement content such as program content, VOD content, music content, and the like

In this case, the recognized content may serve as basic information for making a determination as to which content the user prefers and more likely to be concerned about which ad. Therefore, the advertisement providing unit 220 may search for an advertisement inventory (not shown) included in the database 230 or managed separately as described later, and determine an advertisement to be provided among the plurality of advertisements. The advertisements that can be determined include, for example, advertisements that recommend content of a similar type to the recognized content, advertisements that recommend content of a genre similar to the recognized content, advertisements about products that remind the recognized content, An advertisement of an advertiser who sponsors the advertiser, and the like. A plurality of such bases may be referred to in some cases.

(2) the recognized content is an advertisement content

In this case, the recognized content can serve as basic information for making a decision as to whether or not the advertisement effect should be generated by providing any advertisement to the user. The advertisement providing unit 220 may search the advertisement inventory to determine an advertisement to be provided among the plurality of advertisements. An advertisement that can be determined may be, for example, an advertisement of a kind similar to the recognized content, an advertisement of the same or similar advertiser as the advertiser of the recognized content, an advertisement of the same or similar product of the product of the recognized content, A plurality of such bases may be referred to in some cases.

Meanwhile, in order to determine the advertisement to be provided as described above, the advertisement providing unit 220 may refer to the meta information as described later with respect to the reference content that can be matched with the content that can be recognized according to the technical idea of the present invention have.

2. Determining the advertising area

Next, the advertisement providing unit 220 can determine the specific area in which the advertisement is to be provided. This area may preferably be specified as a dedicated application of the mobile terminal 300 or a predetermined area of another application.

(1) Determining the application

First, it is possible to determine which application to provide the advertisement. In the simplest case, a dedicated application with a high possibility that the practitioner of the present invention will have sufficient access and design authority can be determined as an object of advertisement provision. Alternatively, the user may determine another application that is taking an action at the time of providing the advertisement on the mobile terminal 300 as an object of advertisement provision. In this case, the dedicated application is activated at least at the time when the other application is activated, and can transmit the information on the dedicated application to the advertisement providing unit 220 after detecting the action taken by the user with respect to the other application. Actions that can be detected may be touch, slide, scroll, keystroke, etc. In this case, the other application can be determined as an object of advertisement provision. Of course, even if there is no user action particularly for the other application, if it is activated by the user and displayed on the front side of the mobile terminal 300, it can be determined as an object of advertisement provision.

(2) Determination of advertisement providing area

Once a specific application has been determined as an advertisement provision target, it is possible to determine which region (in many cases, a visual region) in the application provides advertisement through the region. This area may most typically be the area in which other ads were previously available. On the other hand, this area may be an area where no information has been previously provided (for example, it may be an empty area).

3. Processing of advertising

After the advertisement providing area is determined in step 2, the advertisement providing unit 220 determines whether the advertisement data from the advertisement inventory (i.e., the image file, the moving picture file, the thumbnail file, the link display, etc.) And then, if necessary, perform such processing. Such processing can be image resizing, image clipping, video compression, resolution reduction, iconization, and the like.

4. Providing Ads

The advertisement providing unit 220 may provide the advertisement to the mobile terminal 300, following steps 1-3. The dedicated application of the mobile terminal 300 may insert or overlay the provided advertisement in its own ad serving area or in the ad serving area of another application according to the determination. FIG. 4 is a diagram showing a state (a) and a state (b) before a new advertisement is provided to one area 410 of a music streaming application according to an embodiment of the present invention.

Next, the database 230 according to an embodiment of the present invention is provided with various kinds of information as described above, in particular digital fingerprints, watermark, or ultrasound data of reference contents referenced in an engine or process engine for automatic content recognition Various types of meta information (e.g., information regarding the type of content, content, providers, related products, schedules, etc.) related to the reference content can be stored. Meanwhile, the database 230 may further include the advertisement inventory as described above. Such ad inventory may be pre-registered by a group of advertisers according to the prior art. Although the database 230 is shown in FIG. 3 as comprised and configured in the ad serving system 200, the database 230 may be provided separately from the ad serving system 200, according to the needs of those skilled in the art implementing the present invention. . Meanwhile, the database 230 in the present invention is a concept including a computer-readable recording medium, and may be a broad database including not only a consultation database but also a data record based on a file system, Even if a set can retrieve it and extract data, it can be a database 230 in the present invention.

Next, the communication unit 240 according to an embodiment of the present invention can perform a function of enabling data transmission / reception to / from the content recognition unit 210, the advertisement providing unit 220, and the database 230 .

The control unit 250 controls the flow of data between the content recognition unit 210, the advertisement providing unit 220, the database 230, and the communication unit 240 . That is, the control unit 250 according to the present invention controls the flow of data from / to the outside of the advertisement providing system 200 or the data flow between the respective components of the advertisement providing system 200, thereby enabling the content recognizing unit 210, The advertisement providing unit 220, the database 230, and the communication unit 240, respectively.

The embodiments of the present invention described above can be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer-readable recording medium may be those specifically designed and configured for the present invention or may be those known and used by those skilled in the computer software arts. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROM and DVD, magneto-optical media such as floptical disks, medium, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code, such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be modified into one or more software modules for performing the processing according to the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, Those skilled in the art will appreciate that various modifications and changes may be made thereto without departing from the scope of the present invention.

Accordingly, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all ranges that are equivalent to or equivalent to the claims of the present invention as well as the claims .

210:
220: Ad serving
240:
250:

Claims (5)

A method implemented in an advertisement providing system for providing an advertisement based on content usage by a user, the advertisement providing system including a content recognizing unit and an advertisement providing unit,
The content recognition unit recognizing the content received data from the content data transmitting apparatus by automatic content recognition,
The advertisement providing unit determining an advertisement associated with the recognized content and an area where the advertisement is to be provided,
Wherein the advertisement providing unit, in response to the determination,
Lt; / RTI >
Wherein the advertisement determination step comprises:
Wherein the advertisement providing unit is configured to recommend a content of a kind similar to the recognized content when the recognized content is a non-advertisement content, recommend a content of a genre similar to the recognized content, Or an advertisement that is of an advertiser that sponsors the recognized content,
Wherein the advertisement providing unit is of a type similar to the recognized content when the recognized content is an advertisement content, or is the same as or similar to the advertiser of the recognized content, or the product and the product of the recognized content are the same Or determining similar advertisements,
Wherein the advertisement area determination step comprises:
The advertisement providing unit determining the application, and
The advertisement providing unit may include a step of determining an advertisement providing area within the application
Containing
Ad serving method. The method according to claim 1,
Wherein the application determining step comprises the step of the advertisement providing unit determining an application in which the user is taking action. 3. The method of claim 2,
Wherein the advertisement providing area determining step includes the step of the advertisement providing part determining an area in which the other advertisement has been provided in the application. A system for providing advertisements based on content usage by a user,
A content recognition unit for recognizing the content from which the data is received from the content data transmission apparatus by automatic content recognition, and
Determining an advertisement associated with the recognized content and an area where the advertisement is to be provided, and providing an advertisement according to the determination,
Lt; / RTI >
Wherein the advertising decision comprises:
A recommendation of a content of a kind similar to the recognized content when the recognized content is a non-advertisement content, recommendation of a content of a genre similar to the recognized content, or a product which reminds the recognized content, The content being executed by determining an advertisement that is of an advertiser that sponsors the recognized content,
If the recognized content is an advertisement content, the advertiser of the recognized content is of the same kind as the recognized content, or the advertisement of the recognized content is the same as or similar to the advertiser, or the advertisement of the recognized content is the same or similar to the product of the recognized content As a result,
The advertisement area determination is executed by determining the application and determining the advertisement providing area within the application
Ad serving system. A computer-readable recording medium recording a computer program for executing the method according to any one of claims 1 to 3.

Images