KR102244195B1 - Providing Method for virtual advertisement and service device supporting the same - Google Patents

Abstract

The service apparatus of the present invention may include a communication circuit and a processor functionally connected to the communication circuit. The processor receives video content provided according to a playback request of a terminal device from a content providing server using the communication circuit, obtains content information of the video content, extracts a keyword from the content information, and adds a keyword to the keyword. It may be set to obtain a corresponding advertisement material and control the virtual advertisement information corresponding to the advertisement material to be viewed on the terminal device.

Description

[Providing Method for virtual advertisement and service device supporting the same}

The present invention relates to a virtual advertisement, and more particularly, to a virtual advertisement providing method for adaptively providing a virtual advertisement corresponding to a content content during content reproduction, and a service device supporting the same.

Virtual advertisements are applied in various forms in conventional broadcasting or media services. Virtual advertisement refers to the technique of advertising a product by inserting a virtual image that is not in the field or original filming using computer graphics into a program. In the past, virtual advertisements were allowed only for sports broadcasts, but virtual advertisements are also allowed for dramas and entertainment in recent years, and they are being subdivided into pop-up advertisements and trigger advertisements. In addition, as the broadcasting law enforcement decree on the introduction of the Korea Communications Commission's total advertising system and the improvement of regulations on virtual advertisements has been amended, the genre that allows virtual advertisements for terrestrial and paid broadcasting is expanding from existing sports broadcasting programs to entertainment, drama, and sports coverage. In addition, in the case of pay-per-view broadcasting such as cable or satellite broadcasting, the available time for virtual advertisements is increasing.

Virtual advertisements are attracting much attention in that virtual advertisements that are naturally exposed during playback have higher acceptance of advertisements than conventional advertisements of a fixed execution method such as pre-roll, mid-roll, and post-roll that hinder the usability of viewers. In such existing virtual advertisements, it is not easy to select the location where the virtual advertisement is inserted, and it is not easy to select an appropriate virtual advertisement because the image logo or short video to insert the actual virtual advertisement is handled manually by the advertisement organizer. There was.

Korean Patent Publication No. 10-2010-0072750 (Name: Method of providing customized advertisement, Publication date: 2010.07.01.)

In order to solve the above-described problem, the present invention automatically selects a virtual advertisement material suitable for the context of the video content and a virtual advertisement insertion point suitable for the context of the video content so that the virtual advertisement can be efficiently executed, and the virtual advertisement is executed. It is to provide a virtual advertisement providing method that can improve immersion in advertisement and a service device supporting the same.

However, the object of the present invention is not limited to the above object, and other objects not mentioned will be clearly understood from the following description.

The service apparatus of the present invention for achieving the above object may include a communication circuit and a processor functionally connected to the communication circuit. The processor receives, based on the communication circuit, video content provided according to a playback request of a terminal device from a content providing server, obtains content information of the video content, extracts a keyword from the content information, and adds a keyword to the keyword. It is possible to obtain a corresponding advertisement material and control the terminal device to view virtual advertisement information corresponding to the advertisement material by using the communication circuit.

In particular, the processor may be configured to provide the keyword to the virtual advertisement server and obtain an advertisement material corresponding to the keyword.

Alternatively, after providing the advertisement material to the virtual advertisement server, the processor may control the virtual advertisement server to transmit the virtual advertisement information to the terminal device according to designated time information.

Meanwhile, the processor may control to provide the virtual advertisement information to the content providing server, synthesize it into a specific frame of video content provided to the terminal device, and transmit it to the terminal device.

Alternatively, the processor may provide a virtual advertisement including the advertisement material and at least one object acquired from the partial frame to the terminal device.

As another example, the processor may be configured to acquire the content information in a predetermined section previously played based on a time point in which the terminal device is currently playing among the video content.

Alternatively, the processor may map the virtual advertisement information corresponding to the advertisement material with an arbitrary keyword, and select an advertisement material using the virtual advertisement information mapped to the arbitrary keyword and the keyword generated based on the video content. Can be set.

Additionally, the processor may automatically schedule the virtual advertisement to be displayed at a time when the video content is reproduced from which the keyword is acquired.

The virtual advertisement providing method of the present invention comprises: obtaining, by a service device, content information of video content provided from a content providing server according to a playback request from a terminal device, extracting a keyword from the content information, and responding to the keyword The step of obtaining the advertising material, and controlling the virtual advertisement information corresponding to the advertising material to be viewed on the terminal device.

The virtual advertisement providing method may further include acquiring additional information related to the video content, and acquiring advertisement materials corresponding to the additional information as candidate groups. In this case, obtaining the advertisement material may include obtaining the advertisement material corresponding to the keyword within the candidate group.

Alternatively, the method of providing the virtual advertisement may further include extracting sentiment analysis information of a context including the keyword from the content information. In this case, obtaining the advertisement material may include obtaining the advertisement material based on the keyword and the emotion analysis information.

In addition, the controlling may include automatically organizing the virtual advertisement so that the virtual advertisement is displayed at a time when the video content is played.

According to the present invention, the present invention improves the conventional labor-intensive process when executing virtual advertisements in video content (eg, broadcasting or video service), It automatically selects the insertion point to efficiently execute virtual advertisements, and improves the degree of immersion in virtual advertisements so that advertisers' intentions can be better communicated.

In addition, various effects other than the above-described effects may be directly or implicitly disclosed in the detailed description according to an embodiment of the present invention to be described later.

1 is a diagram illustrating an example of a configuration of a system for providing a virtual advertisement according to an embodiment of the present invention.
2 is a diagram illustrating an example of a configuration of a service device according to an embodiment of the present invention.
3 is a diagram illustrating an example of a configuration of a processor among configurations of a service device according to an embodiment of the present invention.
4 is a diagram illustrating an example of a method of providing a virtual advertisement according to an embodiment of the present invention.
5 is a diagram illustrating another example of a method of providing a virtual advertisement according to an embodiment of the present invention.
6 is a diagram illustrating another example of a method of providing a virtual advertisement according to an embodiment of the present invention.

In order to clarify the features and advantages of the problem solving means of the present invention, the present invention will be described in more detail with reference to specific embodiments of the present invention shown in the accompanying drawings.

However, in the following description and the accompanying drawings, detailed descriptions of known functions or configurations that may obscure the subject matter of the present invention will be omitted. In addition, it should be noted that the same components are denoted by the same reference numerals as much as possible throughout the drawings.

The terms or words used in the following description and drawings should not be interpreted as being limited to their usual or dictionary meanings, and the inventor may appropriately define the concept of terms for describing his or her invention in the best way. It should be interpreted as a meaning and concept consistent with the technical idea of the present invention based on the principle that there is. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are only the most preferred embodiments of the present invention, and do not represent all the technical ideas of the present invention. It should be understood that there may be equivalents and variations.

In addition, terms including ordinal numbers such as first and second are used to describe various elements, and are used only for the purpose of distinguishing one element from other elements, and to limit the elements. Not used. For example, without departing from the scope of the present invention, the second element may be referred to as the first element, and similarly, the first element may be referred to as the second element.

In addition, terms used in the present specification are used only to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In addition, terms such as "comprises" or "have" described herein are intended to designate the existence of features, numbers, steps, actions, components, parts, or a combination thereof described in the specification. It is to be understood that the above other features or the possibility of the presence or addition of numbers, steps, actions, components, parts, or combinations thereof are not preliminarily excluded.

In addition, terms such as "unit", "group", and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software, or a combination of hardware and software. In addition, "a or an", "one", "the" and similar related words are different from the present specification in the context of describing the present invention (especially in the context of the following claims). Unless indicated or clearly contradicted by context, it may be used in the sense of including both the singular and the plural.

In addition to the above terms, specific terms used in the following description are provided to aid understanding of the present invention, and the use of these specific terms may be changed in other forms without departing from the technical spirit of the present invention.

In addition, embodiments within the scope of the present invention include computer-readable media having or transferring computer-executable instructions or data structures stored in the computer-readable media. Such computer-readable media may be any available media accessible by a general purpose or special purpose computer system. By way of example, such computer readable media may be in the form of RAM, ROM, EPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage, or computer executable instructions, computer readable instructions, or data structures. It may include, but is not limited to, physical storage media such as any other media that can be used to store or deliver certain program code means of the computer and can be accessed by a general purpose or special purpose computer system. .

1 is a diagram illustrating an example of a configuration of a system for providing a virtual advertisement according to an embodiment of the present invention.

Referring to FIG. 1, a virtual advertisement providing system 10 according to an embodiment of the present invention includes a terminal device 100, a service device 200, a virtual advertisement server 300, and a content providing server 400. The service device 200 and the terminal device 100, or the service device 200 and the virtual advertisement server 300, or the service device 200 and the content providing server 400 are network 150 ) Through. The virtual advertisement providing system 10 including such a configuration extracts and extracts meaningful keywords and timecodes that are well suited to the content context of the content from the closed caption (subtitle) of the video content (eg, broadcast signal or video file). After identifying the sentiment information (eg, positive/neutral/negative) of the context in which the keyword appears, at least one of the advertising material meta information and the keyword of the video content (eg, broadcast or video program), timecode information, and sentiment information Based on the program context, a highly relevant advertisement material is selected, and a virtual advertisement based on the selected advertisement material can be displayed at an appropriate point.

Then, each component will be described with reference to FIG. 1.

First, the network 150 serves to transmit data to transmit and receive data between the terminal device 100 and the service device 200, or transmit data to transmit and receive data between the content providing server 400 and the service device 200. It can play a role of conveying. Alternatively, the network 150 may serve as a data transmission channel for content transmission between the terminal device 100 and the virtual advertisement server 300 or between the terminal device 100 and the content providing server 400. This network 150 is wired communication such as Ethernet, xDSL (ADSL, VDSL), HFC (Hybrid Fiber Coaxial Cable), FTTC (Fiber to The Curb), FTTH (Fiber To The Home), etc. You can also use WLAN (Wireless LAN), Wi-Fi, Wibro, Wimax, HSDPA (High Speed Downlink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution Advanced) may be used, and in addition to the above-described communication method, all types of communication methods that are well-known or developed in the future may be included. Alternatively, when the terminal device 100 receives a broadcast signal transmitted from the virtual advertisement server 300 and the content providing server 400 using a broadcast antenna or based on a set-top box, the network 150 May include an example of a broadcast network. The network 150 may support delivery of video content between the terminal device 100 and the content providing server 400. In addition, the network 150 may support delivery of virtual advertisement information between the terminal device 100 and the virtual advertisement server 300. In addition, the network 150 may establish a communication channel between the service device 200 and the virtual advertisement server 300 or a communication channel between the service device 200 and the content providing server 400.

The terminal device 100 refers to a device of a user capable of transmitting and receiving various data to and from the service device 200 through the network 150 according to the user's manipulation. Alternatively, the terminal device 100 may receive and output at least one video content from the content providing server 400 according to a user manipulation. In this case, the terminal device 100 may receive virtual advertisement information provided by the virtual advertisement server 300 and output it together with the video content. Such a terminal device 100 may perform transmission and reception of video content through the network 150 (Internet network or broadcasting network), and a memory for storing programs and protocols for transmission and reception of video content, and execution of various programs for calculation And a processor for controlling and the like. In addition, the terminal device 100 of the present invention may be implemented in various forms. For example, the terminal device 100 described herein is a mobile terminal such as a smart phone, a tablet PC, a personal digital assistant (PDA), a portable multimedia player (PMP), and an MP3 player. Of course, fixed terminals such as smart TV, IPTV, IPTV set-top, laptop computer, desktop computer, etc. may be used, and data related to video content to which the virtual advertisement according to the present invention is applied can be received. Any device that can be used may be used as the terminal device 100 according to an embodiment of the present invention.

On the other hand, the terminal device 100 according to the embodiment of the present invention includes a configuration of a communication circuit, a display, an input device, an audio device, a processor, a memory, etc., and uses a communication circuit according to a user's manipulation. For example, it may be connected to at least one of the virtual advertisement server 300, the content providing server 400, and the service device 200 through an Internet network or a broadcasting network). For example, the terminal device 100 executes a web browser or an application corresponding thereto in response to a user input, and the service device 200 or content based on pre-input Internet address information or address information input by the user. It is possible to access the provision server 400. The terminal device 100 may receive a designated web page from the service device 200 or the content providing server 400 and output it to a display. For example, the web page may include a virtual page through which at least one video content can be searched. As another example, the terminal device 100 includes an IPTV or an IPTV set-top, and may receive and output video content to which a virtual advertisement is applied through an antenna.

The terminal device 100 may request input of login information through a display in response to user authentication requested by the service device 200. The terminal device 100 may transmit login information to the service device 200 in response to a user input, receive a logged-in web page in response to approval completion, and output it to the display. The terminal device 100 may generate an image content search request message in response to a user input and transmit it to the service device 200. The terminal device 100 may receive a video content list from the service device 200. The terminal device 100 selects a video content from a specific video content list in response to a user input, generates a play request message for the video content or a purchase request message for a specific video content, and transmits it to the service device 200 I can. The terminal device 100 may receive and output video content from the service device 200 in a streaming or download method. In this operation, the terminal device 100 may receive a virtual advertisement from the virtual advertisement server 300 and output it together with the video content. Alternatively, the terminal device 100 may receive a URL for receiving video content from the service device 9200 and receive the video content from the content providing server 400 through the URL. In this case, the video content provided by the content providing server 400 to the terminal device 100 may be a content including a virtual advertisement.

Meanwhile, in the above description, the content providing server 400 provides video content to the service device 200, and the service device 200 transmits the video content received from the content providing server 400 to the terminal device 100. Although described in the form provided, the present invention is not limited thereto. For example, the content providing server 400 and the virtual advertisement server 300 may be provided in an integrated configuration with the service device 200. Alternatively, the service device 200 may perform a role of relaying video content delivery between the terminal device 100 and the content providing server 400. Alternatively, the service device 200 is integrated with the content providing server 400, or the service device 200 controls the content providing server 400 and the virtual advertisement server 300 to request the terminal device 100 Accordingly, while providing video content according to the request to the terminal device 100 by controlling the content providing server 400, and transmitting virtual advertisement information corresponding to the content of the video content to the terminal device 100 at a specified time point You can also control it to do. In this regard, the service device 200 establishes a control communication channel between the virtual advertisement server 300 and the content providing server 400, and accesses the terminal device 100 (for example, the content providing server 400). Access to the terminal device 100) and the virtual advertisement server 300 may control provision of virtual advertisements.

The virtual advertisement server 300 may establish a communication channel with an advertisement client terminal, and receive an advertisement material related to an advertisement request from the advertisement client terminal. The virtual advertisement server 300 may classify and store the received advertisement material based on a specified keyword. Here, the advertisement material may be provided as virtual advertisement information to be provided to the video content. When the service device 200 performs the virtual advertisement providing operation, the virtual advertisement providing operation of the virtual advertisement server 300 may be omitted. In this case, the virtual advertisement server 300 may serve to provide the advertisement material received from the advertisement client to at least one of the service device 200 and the content providing server 400.

The virtual advertisement server 300 may be connected to the service device 200 or the content providing server 400 through the network 150. The virtual advertisement server 300 transmits at least one advertisement material or virtual advertisement information corresponding thereto in response to the request of the service device 200 (or the content providing server 400). )) or to the terminal device 100 receiving video content. As another example, the virtual advertisement server 300 may provide various advertisement materials to the service device 200, and may receive and store time information to which various advertisement materials are applied from the service device 200. In response to the control of the service device 200, the virtual advertisement server 300 provides an advertisement material designated at a specific time point to the terminal device 100 while the content providing server 400 transmits the video content to the terminal device 100. can do. Alternatively, the virtual advertisement server 300 provides an advertisement material to the content providing server 400, and the content providing server 400 receives from the virtual advertisement server 300 while providing the video content to the terminal device 100 An advertisement material may be added to a specific frame of video content and provided to the terminal device 100 as a virtual advertisement.

The content providing server 400 may store and manage at least one video content. At least one video content stored in the content providing server 400 may include subtitle information. Alternatively, the at least one video content may include various voice information or text information. The content providing server 400 may transmit video content to the terminal device 100 as a broadcast signal or a data streaming method according to the request of the specific terminal device 100. In this operation, the content providing server 400 delivers the video content requested to be played by the terminal device 100 to the service device 200 and receives a specific advertisement material from the service device 200 or controls the service device 200 Accordingly, a specific advertisement material may be received from the virtual advertisement server 300.

The service device 200 may be integrated with at least one of the virtual advertisement server 300 and the content providing server 400. Alternatively, the service device 200 is provided in a configuration independent from the virtual advertisement server 300 and the content providing server 400, and can control the operation of the virtual advertisement server 300 and the content providing server 400. have. For example, the service device 200 may control the virtual advertisement server 300 to receive, store and manage at least one advertisement material and cost from an advertisement client. When receiving at least one advertisement material from the virtual advertisement server 300, the service device 200 may generate and store a virtual advertisement corresponding to the advertisement material, or provide it to the virtual advertisement server 300.

In addition, the service device 200 controls the access to the terminal device 100 by controlling the content providing server 400, and in response to a request from the terminal device 100, a specific video content is played back on the terminal device 100. Thus, the content providing server 400 may control data transmission or broadcast signal transmission. In this operation, the service device 200 may control the terminal device 100 to output at least one advertisement material corresponding to the video content provided to the terminal device 100 together with the video content.

As another example, while the terminal device 100 receives and plays specific video content from the content providing server 400, the service device 200 checks the content during playback of the video content, and corresponds to the content. An advertisement material may be selected from among advertisement materials stored in the virtual advertisement server 300, and the selected advertisement material may be overlaid on the video content or synthesized with the video content to be provided to the terminal device 100. In this regard, the service device 200 may perform at least one of a pre-playback analysis or a post-playback analysis of the video content requested by the terminal device 100, and may select and provide an advertisement material according to the execution result. . When providing a virtual advertisement, the service device 200 may synthesize and provide not only the advertisement material, but also at least one object included in the video content being played back into the advertisement material. Additionally, the virtual advertisement providing system 10 collects voice information uttered by the user while the user is watching video content from the terminal device 100, and at least a part of the material or contents of the advertisement based on the collected voice information. Can be changed.

The above-described virtual advertisement providing system 10 of the present invention can increase the suitability of the virtual advertisement and the scene by providing a virtual advertisement corresponding to the playing scene among the corresponding video contents in real time while the user is watching the video content. As a result, advertisement immersion can be improved. The virtual advertisement providing system 10 of the present invention applies virtual advertisements to live broadcast contents as well, and supports providing appropriate virtual advertisements according to the contents of the contents.

In addition, the virtual advertisement providing system 10 of the present invention extracts in advance the time to apply various advertisement materials to a specific video content, and selects a pre-selected advertisement material in response to at least one pre-extracted keyword when playing the video content. It can be provided as a virtual advertisement. Accordingly, the virtual advertisement providing system 10 of the present invention processes the selection of advertisement materials to be provided for each content of video contents such as VOD and application of virtual advertisements during playback, without grasping the contents of the video contents for selection of advertisement materials, Virtual advertisements can also be provided based on previously identified information.

2 is a diagram illustrating an example of a configuration of a service device according to an embodiment of the present invention.

First, referring to FIG. 2, a service device 200 according to an embodiment of the present invention may include a communication circuit 210, a memory 240, and a processor 250. Meanwhile, as described above, the service device 200 may be integrated with the content providing server 400, and accordingly, the device structure described in FIG. 2 may also be used as a configuration of the content providing server 400. .

The communication circuit 210 may support a communication function of the service device 200. The communication circuit 210 may support the formation of a communication channel with the virtual advertisement server 300 and the content providing server 400 through the network 150. Alternatively, the communication circuit 210 may form a communication channel with the terminal device 100 when the service device 200 performs the role of the content providing server 400 or is integrated with the content providing server 400. The communication circuit 210 may support at least one communication method among various communication methods. For example, the communication circuit 210 may support various generations of mobile communication channels, Internet communication channels, and broadcast channels. When the communication circuit 210 forms a communication channel with the virtual advertisement server 300 in response to the control of the processor 250, it receives at least one advertisement material from the virtual advertisement server 300, and the at least one advertisement material Virtual advertisement information corresponding to may be transmitted to the virtual advertisement server 300 or the content providing server 400. Alternatively, in response to the control of the processor 250, the communication circuit 210 may receive the video content requested to be played by the specific terminal device 100 from the content providing server 400.

The memory 240 may store at least one application or program related to the operation of the service device 200. In addition, the memory 240 may store an advertisement material 241, content information 243, and a matching DB 245 in connection with a virtual advertisement providing function according to an embodiment of the present invention. The memory 240 may store, for example, the advertisement material 241 received from the virtual advertisement server 300. Alternatively, the advertisement material 241 may not be stored in the memory 240 of the service device 200, but may be stored in the memory of the virtual advertisement server 300 and referred to by the service device 200.

The advertisement material 241 relates to content requested by the advertisement client, and may include various advertisement materials such as shoes, clothing, alcoholic beverages, and toys. The advertisement material 241 may be used to generate a virtual advertisement. When the service device 200 generates a virtual advertisement, the memory 240 may store virtual advertisements corresponding to the advertisement material 241. The virtual advertisement stored in the memory 240 is based on the advertisement material 241 and may include at least one object included in a specific scene of the video content.

The content information 243 may include information obtained through scene analysis of the video content when the service device 200 receives video content from the content providing server 400 using the communication circuit 210. have. For example, the content information 243 may include text information (eg, caption information, etc.) extracted from a specific scene of a specific video content. Alternatively, the content information 243 may include information obtained by converting an audio signal extracted from a specific scene of a specific video content into text. Various text information included in the content information 243 may be used for keyword generation and sentiment analysis. Alternatively, the content information 243 may include address information (URL) for receiving content through the content providing server 400. When the terminal device 100 requests to play video content, the service device 200 provides address information on the video content to the terminal device 100, and the advertisement material and advertisement applied to the video content corresponding to the address information When the terminal device 100 requests video content from the content providing server 243 by providing time information to which the material is applied to the content providing server 243, the corresponding video content is provided to the terminal device 100 while providing service The advertisement material received from the device 200 may be provided as a virtual advertisement according to time information.

The matching DB 245 may include information obtained by matching the advertisement material 241 and the content information 243. Alternatively, the matching DB 245 may include information obtained by matching time information to which the advertisement material 241 is applied and keyword information generated through the content information 243. The matching information included in the matching DB 245 may include, for example, a type of advertisement material 241 to be output to a specific scene of a specific video content and time information of the corresponding scene. As another example, the service device 200 may map arbitrary keywords corresponding to the advertisement materials 241 and store them in the matching DB 245. In this case, the arbitrary keywords may be obtained from meta information of the advertisement material 241.

The processor 250 may process data related to operation of the service device 200 or transmit data. For example, the processor 250 may perform connection with the virtual advertisement server 300 or the content providing server 400 according to an operator request. For example, when the terminal device 100 accesses the content providing server 400 to view specific video content, the processor 250 may receive the corresponding video content from the content providing server 400. The processor 250 may analyze the video content received from the content providing server 400 and receive an advertisement material from the virtual advertisement server 300 according to the analysis content. The processor 250 may provide an advertisement material to the terminal device 100 through the content providing server 400.

Alternatively, the processor 250 receives content (for example, VOD content) from the content providing server 400, analyzes the received content content, and collects information on the advertisement material to be applied to the content and time information to which the advertisement material is applied. I can. When a specific terminal device 100 requests viewing of VOD content in which advertisement material and time information are set, the processor 250 provides the advertisement material and time information to the content providing server 400, and the terminal device 100 When the content providing server 400 provides the content, the advertisement material and time information may be provided together to support a virtual advertisement corresponding to the advertisement material to be output in response to the time information when playing VOD content. The processor 250 of the service device 200 may include a configuration as shown in FIG. 3.

3 is a diagram illustrating an example of a configuration of a processor among configurations of a service device according to an embodiment of the present invention.

3, a processor 250 according to an embodiment of the present invention includes an advertisement material meta-collector 251, an information extractor 253, a matching engine 255, a programming processor 257, and a keyword generator 258. And a sentiment analyzer 259.

The advertisement material meta collector 251 may collect advertisement materials. In this regard, the advertisement material meta collector 251 may periodically form a communication channel with the virtual advertisement server 300 and check whether a new advertisement material has been uploaded. Alternatively, when a new advertisement material is uploaded, the virtual advertisement server 300 transmits a guide message to the service device 200, and the advertisement material meta-collector 251 accesses the virtual advertisement server 300 to access the newly uploaded advertisement. You can check the material. Alternatively, the creative meta collector 251 provides reference information (eg, at least one of keyword information and sentiment analysis information) related to the creative request to the virtual advertisement server 300 according to the request of the matching engine 255, and , The advertisement material corresponding to the reference information may be received from the virtual advertisement server 300. The advertisement material meta-collector 251 may include a keyword related to an advertisement material including text information describing the advertisement material (eg, advertisement material title, type of advertisement material, name of the advertiser who provided the advertisement material, etc.) when collecting advertisement material, Alternatively, explanatory information describing the advertisement material) may be collected. The text information collected by the advertisement material meta collector 251 may be used to establish a matching DB 245. For example, a similarity mapping between title information or keyword information related to a specific creative and a keyword extracted from at least part of a specific video content is performed, and at least a part of the video content and the creative material having a similarity greater than or equal to a reference value (e.g. Section information) may be mapped and stored in the matching DB 245. The advertisement material meta collector 251 may receive additional information related to a specific video content from the information extractor 253. In this case, the advertisement material meta collector 251 may acquire advertisement materials related to the additional information as a candidate group. Further, the advertisement material meta collector 251 may select at least one advertisement material from the candidate group based on information (eg, subtitle information) acquired from the video content and transmit it to the matching engine 255.

The information extractor 253 acquires extraction information on at least some scenes from the video content (for example, content information including at least one of text information such as subtitle information, text included in a screen, text through voice recognition, etc.) can do. In this regard, the information extractor 253 may receive a specific video content transmitted to the terminal device 100 from the content providing server 400. When the specific terminal device 100 requests to play the video content, the content providing server 400 provides the video content to the terminal device 100 and provides the video content to the service device 200 for selection of an advertisement material. Can provide. When the information extractor 253 receives video content from the content providing server 400, the information extractor 253 may extract information to obtain the extracted information. Additionally or alternatively, the information extractor 253 provides additional information related to the video content from the content providing server 400 (e.g., the title of the video content, the category (or type, genre, etc.) of the video content) and the video content. Content information including a plot (or summary, synopsis, etc.), voice information included in the video content, video content content information, and actor information appearing in the video content) may be collected. The information extractor 253 may transmit the above-described additional information to the advertisement material meta collector 251. The information extractor 253 may provide keyword or sentiment analysis information extracted from a specific playback time point in the video content being played to the matching engine 255. Alternatively, the information extractor 253 may provide keywords or emotion analysis information accumulated in units of a predetermined reproduction section to the matching engine 255.

The keyword generator 258 may receive content information including at least one of extraction information and additional information extracted from video content from the information extractor 253. The keyword generator 258 may generate a keyword for at least a partial reproduction section of the video content based on the extracted information. In this case, the keyword generator 258 may also record the reproduction time information at which the corresponding keyword is generated. Alternatively, the keyword generator 258 may extract a key keyword based on the additional information and the extracted information. For example, the keyword generator 258 may extract terms that appear relatively frequently as core keywords. Alternatively, the keyword generator 258 extracts keywords based on terms extracted from the additional information and terms obtained from the extraction information, but the weight of terms obtained from the extraction information is higher than the weight of terms extracted from the additional information ( Example: 1:5 ratio), and based on this, you can create key keywords. The keyword generator 258 may support to select an advertisement material more suitable for the playback section by increasing the weight of terms appearing in the playback section of the video content.

The sentiment analyzer 259 may analyze the sentiment in the context of the acquired keyword. Alternatively, the sentiment analyzer 259 may collect comment information related to video content or appreciation review information related to video content. In this regard, the emotion analyzer 259 may be connected to the content providing server 400 to collect comment information or appreciation information recorded by the user in relation to the corresponding video content. The sentiment analyzer 259 may generate sentiment analysis information based on the comment information and appreciation information. For example, the sentiment analyzer 259 may perform sentiment analysis on whether comment information or appreciation information is friendly or hostile to at least a partial playback section of the corresponding video content. In this regard, the sentiment analyzer 259 constructs a term DB according to each emotion so that each sentence can be distinguished favorably, hostile, or neutral, and affirmative, negative, etc. for specific comments or sentiment reviews based on the term DB. Judgment can be carried out. Alternatively, the sentiment analyzer 259 may perform sentiment analysis on comments or sentiment reviews based on various algorithms for sentiment analysis, and may generate sentiment analysis information. As another example, the sentiment analyzer 259 may not generate separate sentiment analysis information when the sentiment analysis result does not appear or if sentiment analysis such as positive or negative is similar.

The matching engine 255 may select an advertisement material based on at least one of keyword information provided by the keyword generator 258 and sentiment analysis information provided by the emotion analyzer 259. In this regard, the matching engine 255 may receive an advertisement material or advertisement material candidate group from the advertisement material meta collector 251 and select an advertisement material corresponding to the keyword information or emotion analysis information. The matching engine 255 may provide the selected advertisement material as a virtual advertisement to the programming processor 257. Alternatively, the matching engine 255 may synthesize an object acquired in a specific playback section of the video content with the selected advertisement material and provide it to the programming processor 257.

The programming processor 257 may control to provide the advertisement material received from the matching engine 255 to the content providing server 400 together with the provision of video content. In this regard, the programming processor 257 collects time information regarding acquisition of the extraction information, and transmits the time information to the content providing server 400 so that the virtual advertisement corresponding to the advertisement material can be displayed at the corresponding time information. Can provide. As another example, the programming processor 257 may provide the advertisement material to the virtual advertisement server 300 or determine a timing at which the advertisement material is provided to the terminal device 100 as the time information. That is, the scheduling processor 57 checks the acquired time information, and when the corresponding time arrives, provides the advertisement material to the virtual advertisement server 300 or the content providing server 400, and automatically sends the advertisement material to the terminal device. It can be controlled to be provided to 100. The advertisement material may be provided to the terminal device 100 by combining the video content by the content providing server 400, or the terminal device 100 generates a frame corresponding to a partial reproduction section of the advertisement material and the video content. After receiving, it can be synthesized and output to a monitor (or display). As described above, the knitting processor 257 of the present invention can improve the inefficiency of a labor-intensive process that mechanically performs a job regardless of a virtual advertisement item (or advertisement material) through simple repetitive labor of a worker. That is, the scheduling processor 257 of the present invention automatically collects advertisement materials from the video content, and automatically organizes the time to provide the advertisement material to the terminal device 100 based on the advertisement material collection time information, so that it is more efficient. Can support virtual advertisement service. Additionally, advertisement materials organized by the programming processor 257 may be stored in a memory together with the video content and then provided to other video content viewers. In this case, the service device 200 may support providing an advertisement material to be used for a virtual advertisement automatically according to previously used advertisement materials and time information without analyzing the video content and determining the advertisement material. As another example, when the user of the terminal device 100 viewing the video content is different, the service device 200 collects the content usage history of the user related to the terminal device 100, and the user content usage history and the video It is also possible to change the advertisement material of the virtual advertisement by integrated analysis of the information analyzed in the content.

The programming processor 257 automatically provides virtual advertisement information corresponding to the selected advertisement material, content analysis for a certain playback section, selection of advertisement material, and video content in which subtitles are available, such as content being played, VOD content, and live broadcasting. I can organize to do it. For example, in a music program, the programming processor 257 may select an advertisement material related to a singer immediately after a specific singer sings a song in a music program, and automatically organize it to be output as a virtual advertisement.

4 is a diagram for describing an operation of providing a virtual advertisement according to an embodiment of the present invention.

Referring to FIG. 4, the video content stored in the content providing server 400 and provided to the terminal device 100 according to the request of the terminal device 100 may include a playback time from t0 to tn as shown. have.

The processor 250 of the service device 200 may operate a time window TW corresponding to a designated playback section related to provision of a virtual advertisement. The time window TW may have a size of a reproduction section of video content between t1 and t2. Here, the processor 250 analyzes the frames of the video content included in the time window (TW) section from t1 to t2 prior to the current playback time when the current video content is played back, for example, t2, and stores text information. Can be obtained. For example, the processor 250 may acquire text information included in frames in the interval t1 to t2, and select a term appearing with the highest frequency from the acquired text information. In this operation, the processor 250 selects a term with a relatively high frequency from among meaningful terms (eg, excluding a term referring to a partner such as survey, period, special character, “I”, “you”, etc.). I can.

Alternatively, the processor 250 may generate one keyword by collecting terms that appear more than a certain number of times and analyzing the meanings of a plurality of terms. For example, the processor 250 may generate an “umbrella” as a keyword when a plurality of terms such as rainy season, rain, and cloud appear more than a certain number of times. In this regard, the processor 250 may apply a neural network analysis algorithm for a plurality of terms and select a word having a high correlation with the plurality of terms as a keyword based on the application of the algorithm. Alternatively, the processor 250 may generate keywords based on terms mentioned by the protagonist in a scene in which a plurality of persons appear. Additionally or alternatively, the processor 250 may extract sentiment analysis information from the obtained text information. Alternatively, the processor 250 may extract sentiment analysis information from comment information or appreciation information related to the video content.

The processor 250 may select an advertisement material based on the keyword information. For example, the processor 250 performs a similarity mapping between the advertisement material or meta information related to the advertisement material (ad material title, type, genre, tag, description, advertiser information, etc.) and the extracted keywords, and calculates the similarity of a specified size or more. Branches may select at least one advertisement material. When the advertisement material is selected, the processor 250 synthesizes the advertisement material into a specific playback scene of the video content, but may transform the advertisement material according to the color or structures of the area in which the virtual advertisement is displayed. The processor 250 may select an advertisement material based on matching information stored in the matching DB 245.

The processor 250 may output the obtained advertisement material at time t2. As another example, the service device 200 may receive a frame of a playback section earlier than a playback time played by the terminal device 100 from the content providing server 400. For example, when the terminal device 100 is receiving a frame of the 1:10 minute playback period, the service device 200 may receive the frame of the 1:11 minute playback period from the content providing server 400. In this case, the processor 250 may generate a keyword by extracting text information in the playback section for one minute ahead of the terminal device 100 by one minute, and select an advertisement material based on this. The virtual advertisement corresponding to (or applied to) the selected advertisement material may be applied to the corresponding scene and output while the 1:11 minute video is played on the terminal device 100.

As another example, the size of the time window TW is maintained, and the time window TW may be moved on the replay timeline according to the reproduction of the video content. Here, the processor 250 may discard text information belonging to a frame of a section outside the time window TW, and obtain text information included in a frame of a newly added section. For example, when the time window TW is set to the interval t2 to t3, the processor 250 discards the text information acquired in the interval t1 to t2, newly collects the text information of the interval t2 to t3, and A new keyword may be extracted from text information of frames included in the time window TW, and an advertisement material corresponding to the newly extracted keyword may be selected and output at a current playback time.

5 is a diagram illustrating another example of a method of providing a virtual advertisement according to an embodiment of the present invention.

Referring to FIG. 5, in relation to the method of providing a virtual advertisement according to an embodiment of the present invention, the processor 250 of the service device 200 may check the media service type in step 501. For example, the processor 250 may check whether the video content includes subtitle information or whether it is a content to which a virtual advertisement can be applied. In the case of content applicable to a virtual advertisement, the processor 250 may read the caption of the media identified in step 503 and obtain caption information. In connection with obtaining the caption information, the processor 250 may decode a broadcast signal in the case of a real-time broadcast channel of terrestrial, vertical, or cable, and extract and analyze a closed caption for the hearing impaired contained therein. In the case of a satellite broadcasting channel, the processor 250 may decode a broadcast signal and extract and analyze a subtitle subtitle (DVB-Subtitle) contained therein. The processor 250 may directly acquire a caption file such as smi/srt when it is directly accessible through a content management system (CMS) or a caption management server.

The processor 250 may calculate the word and document frequency in step 505. In this regard, the processor 250 collects meaningful words (e.g., nouns, adjectives, adverbs, etc., or place names, device or tool names, etc.) You can calculate the frequency. Alternatively, the processor may extract a noun, adjective, and compound noun word to generate a keyword for the secured subtitle, calculate the frequency of occurrence of the word, and calculate the number of files in which the word appears among the existing collection subtitle files. .

In step 507, the processor 250 may check whether homogeneous synonyms exist. When homogeneous synonyms exist, the processor 250 may divide word scores for each meaning in step 509. Regarding scoring, the processor 250 may score and extract the central keyword from the broadcast program caption using a frequency-based method. When homomorphic synonyms exist, the processor 250 may acquire words around a sentence in which each word is arranged, and determine what the words mean through the surrounding words. In the scoring process, the processor 250 may resolve word ambiguity using an algorithm (eg, Sense2Vec or dictionary-based supervised learning), and then grasp the exact meaning of the word and score.

If there is no homogeneous synonym, the processor 250 may perform a keyword context sentiment analysis in step 511. For example, the processor 250 may analyze the context of a sentence including the keyword and analyze whether the context has a propensity such as positive/negative/neutral. Alternatively, the processor 250 collects and utilizes program viewing impressions, comment information, and real-time broadcasting channel chat information for section context sentiment analysis as a program subtitle in which the corresponding word appears, and a person such as cast information for correcting the accuracy of context relevance. Meta and script information can also be collected and used as character graph relationship information. When the context sensitivity including the keyword is positive, the processor 250 may set the weight of the keyword relatively high, and when the context sensitivity is negative, the weight of the corresponding keyword may be set relatively low. Alternatively, the processor 250 sets a virtual context section based on a fixed short period of time or based on the number of sentences in the script or the number of sentences in the caption/subtitle while the real-time broadcast is in progress, and creates a list of representative keywords of the section. You can get it. Alternatively, the processor 250 may obtain material information, advertisement synop, and performer information contained in the inventory of the virtual advertisement server 300, and collect corresponding advertisement material and current date/time/weather information. Alternatively, the processor 250 may include item similarity obtained from information in the context of broadcast content, positive/negative information, person graph relationship information, adjective atmosphere keyword, weather when a plurality of the same advertisement material exists in the inventory in the virtual advertisement server 300 By performing a weight calculation based on information, a ranking list can be obtained in an order suitable for the context of a corresponding broadcast section.

Next, the processor 250 may obtain the advertisement material and meta information to be applied to the virtual advertisement in step 513. In step 515, the processor 250 may calculate a degree of association between the advertisement material and the program context positive keyword. In this regard, the processor 250 may select at least one core keyword from among the acquired keywords and select an advertisement material matching the selected core keyword. For the above-described operation, the processor 250 provides a key keyword to the virtual advertisement server 300 to receive an advertisement material, or receives and stores the advertisement material from the virtual advertisement server 300, and maps it to the core keyword. You can select the creative material that is used.

In step 517, the processor 250 may update the virtual advertisement scheduling information based on a keyword and a time code point (a specific time point) with high relevance. The processor 250 may periodically perform the above-described operation, select virtual advertisement item information (or advertisement material) most suitable for a real-time section, and update an advertisement scheduling schedule.

The processor 250 may check whether broadcasting or video is ended in step 519. If there is no event related to the end of broadcasting or video, the processor 250 may branch to step 503 and perform the following operation again.

6 is a diagram illustrating another example of a method of providing a virtual advertisement according to an embodiment of the present invention.

Referring to FIG. 6, in relation to the method of providing a virtual advertisement according to an embodiment of the present invention, the processor 250 of the service device 200 may check whether a content (eg, video content) is requested to be played in step 601. have. If there is no request to play the content, the processor 250 may perform a function designated in step 603. For example, the processor 250 may control the virtual advertisement server 300 to receive a new advertisement material from an advertisement client.

If there is a request to play content, the processor 250 may extract content information in step 605. The content information may include, for example, text information (eg, at least one of subtitle information, dialogue information, and voice-to-text information) related to at least a partial reproduction section of the video content. Alternatively, the processor 250 may extract, as content information, text information related to at least some frames before and after the video content is currently being played. When the processor 250 receives video content through the communication circuit 210, the processor 250 may collect content information through the video content analysis. Alternatively, the processor 250 may collect content information by performing analysis on the video content previously stored in the memory 240.

The processor 250 may generate a keyword in step 607. For example, the processor 250 may select, as a keyword, a word having a relatively high frequency of appearance among words included in the content information.

The processor 250 may check whether an advertisement material corresponding to the keyword generated in step 609 exists in the memory 240. When an advertisement material corresponding to the generated keyword exists in the memory 240, the processor 250 may process to obtain the advertisement material from the memory 240 and provide it to the terminal device 100 in step 611. For example, the processor 250 may provide the obtained advertisement material to the content providing server 400 and request to be synthesized and provided when a specific frame of video content is provided.

If the advertisement material corresponding to the generated keyword does not exist in the memory 240, the processor 250 may obtain the advertisement material in step 613. Here, the processor 250 may use the obtained advertisement material as a virtual advertisement as it is. Alternatively, the processor 250 may extract at least one object included in a frame currently being played from among the acquired advertisement material and video content, and provide the object by synthesizing the object with the advertisement material.

Next, the processor 250 may check whether an event related to the end of content playback occurs in step 615. If there is no event related to the end of content playback, the processor 250 may branch to step 605 and repeat the following process.

As explained above, the specification includes details of a number of specific implementations, but these should not be construed as limiting to the scope of any invention or claimable, but rather, which may be peculiar to specific embodiments of the particular invention. It should be understood as a description of features.

Further, although the operations are depicted in the drawings in a specific order, it should not be understood that such operations must be performed in the specific order or sequential order shown, or that all illustrated operations must be performed in order to obtain a desired result. In certain cases, multitasking and parallel processing can be advantageous. In addition, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the program components and systems described are generally integrated together into a single software product or packaged in multiple software products. It should be understood that you can.

The present description presents the best mode of the present invention, and provides examples to illustrate the present invention and to enable those skilled in the art to make and use the present invention. The written specification is not intended to limit the present invention to the specific terms presented. Accordingly, although the present invention has been described in detail with reference to the above-described examples, those of ordinary skill in the art can make modifications, changes, and modifications to these examples without departing from the scope of the present invention.

Therefore, the scope of the present invention should not be determined by the described embodiments, but should be determined by the claims.

According to the present invention, the present invention provides a virtual advertisement to a terminal device for viewing video content in real time or by providing it in advance, so that a user can naturally watch the virtual advertisement while watching the video content. Accordingly, the present invention can maximize advertisement efficiency by increasing advertisement efficiency while maintaining user immersion with respect to video content. As a result, the present invention can reduce waste of unnecessary advertisement generation and transmission, and support efficient advertisement provision.

150: network
100: terminal device
200: service device
210: communication circuit
240: memory
250: processor
251: creative meta collector
253: information extractor
255: matching engine
257: knitting processor
258: keyword generator
259: sentiment analyzer
300: virtual ad server
400: content providing server

Claims (12)

Communication circuit;
Includes; a processor functionally connected to the communication circuit,
The processor is
Obtaining content information of video content from a content providing server through the communication circuit,
Extracting a keyword from the content information,
Acquire an advertisement material corresponding to the keyword,
Generate virtual advertisement information corresponding to the advertisement material,
Collecting comment information or appreciation review information on the video content from the content providing server, generating sentiment analysis information by analyzing the comment information or terms included in the appreciation review information, and generating the sentiment analysis information through the keyword and the sentiment analysis information A service device, characterized in that acquiring an advertisement material. The method of claim 1,
The processor is
A service device configured to provide the keyword to a virtual advertisement server and obtain an advertisement material corresponding to the keyword. The method of claim 1,
The processor is
After providing the advertisement material to a virtual advertisement server, the service apparatus controls the virtual advertisement server to transmit the virtual advertisement information to a terminal device according to specified time information. The method of claim 3,
The processor is
A service device configured to provide the virtual advertisement information to the content providing server, synthesize it into a specific frame of video content provided to the terminal device, and transmit it to the terminal device. The method of claim 3,
The processor is
A service device that controls to provide a virtual advertisement including the advertisement material and at least one object acquired in some frames to the terminal device. The method of claim 3,
The processor is
A service device configured to acquire the content information in a predetermined section previously played based on a time point in which the terminal device is currently playing among the video content. The method of claim 1,
The processor is
Mapping virtual advertisement information corresponding to the advertisement material with an arbitrary keyword,
A service device configured to select the advertisement material using virtual advertisement information mapped to the arbitrary keyword and a keyword generated based on the video content. The method of claim 1,
The processor is
A service device that automatically organizes the virtual advertisement information to be output at a time when the video content is reproduced from which the keyword is acquired. Service unit
Obtaining content information of video content from a content providing server through a communication circuit;
Extracting a keyword from the content information;
Obtaining an advertisement material corresponding to the keyword;
Including; generating virtual advertisement information corresponding to the advertisement material,
Obtaining an advertisement material corresponding to the keyword,
Collecting comment information or appreciation review information on the video content from the content providing server, generating sentiment analysis information by analyzing the comment information or terms included in the appreciation review information, and generating the sentiment analysis information through the keyword and the sentiment analysis information A virtual advertisement providing method, characterized in that acquiring an advertisement material. The method of claim 9,
Obtaining additional information related to the video content;
Further comprising; obtaining advertisement materials corresponding to the additional information as candidate groups,
The step of obtaining the creative
Obtaining an advertisement material corresponding to the keyword in the candidate group; virtual advertisement providing method comprising a. delete The method of claim 9,
The generating step
And automatically organizing the virtual advertisement information so that the virtual advertisement information is output at a time when the video content is reproduced from which the keyword is acquired.

Images