KR20130069322A - Apparatus and method for providing advertisement by interacting with motion - Google Patents

Abstract

PURPOSE: An advertisement providing device and a method thereof are provided to receive advertisement without controlling a portable terminal through a recognition technology such as audio signal recognition or motion recognition. CONSTITUTION: A transmission and reception unit(130) transmits audio data to an advertisement server. The transmission and reception unit receives advertisement information corresponding to the audio data from the advertisement server. An output unit outputs the received advertisement information. A control unit(160) controls an audio processing unit to record an advertisement audio signal according to the motion recognition. The control unit controls the transmission and reception unit in order to transmit the recorded audio data to the advertisement server. [Reference numerals] (110) User input unit; (120) Audio processing unit; (130) Transmission and reception unit; (140) Motion recognition unit; (150) Storage unit; (152) DB manager; (154) Audio data DB; (156) User information DB; (160) Control unit; (170) Display unit

Description

Apparatus and method for providing advertisement using motion recognition {APPARATUS AND METHOD FOR PROVIDING ADVERTISEMENT BY INTERACTING WITH MOTION}

The present invention relates to an advertisement providing apparatus and method for providing an advertisement, and more particularly, to an advertisement providing apparatus and method for providing an advertisement using motion recognition.

Mobile terminals that users can use while moving, such as smartphones, are frequently used by many people, comparable to mass media such as TVs and newspapers, and generate revenue by providing advertisements through mobile terminals. Efforts are being made at various angles.

For example, there are methods of providing advertisements through a mobile terminal. For example, there is a method of unilaterally delivering an advertisement including a coupon, mileage, discount service, etc. to a mobile terminal. In addition, there is a method of recognizing the pre-produced mobile advertising site to the user, and then allow users to visit the mobile site directly through the mobile terminal. In addition, there is a method of allowing a user to recognize visual information (QR code, etc.) through a mobile terminal, request transmission of an advertisement, and receive a requested advertisement.

However, a push method of receiving advertisements unilaterally among the conventional advertisement providing methods as described above has a problem in that an advertisement that a user does not want may be provided. In addition, the method of providing an advertisement through a pre-produced mobile advertisement site has a cumbersome problem because the user must directly find and access the advertisement site. In addition, even when requesting an advertisement transmission using visual information such as a QR code, the user operates the camera of the mobile terminal to capture visual information and transmits the captured visual information. Mobile terminal operation has to be taken many times, which is inconvenient.

On the other hand, with the recent development of mobile terminal technology and various recognition technologies, the mobile terminal is capable of recognizing a voice or audio signal or allowing for motion recognition. Voice or audio recognition technology is a technology that can recognize a user's voice or audio signal to convert the voice or audio signal to a character, or recognize a command corresponding to the voice or audio signal. In addition, the motion recognition technology is a technology for detecting a motion (motion) of the mobile terminal, recognizing a command corresponding to the detected motion, or performing a function. This technique is conveniently used because the mobile terminal can perform a specific function or recognize a command through voice or motion recognition even if the user does not perform any mobile terminal operation.

Therefore, it would be convenient if the user could be provided with an advertisement without a mobile terminal manipulation through recognition technology such as voice or audio signal recognition and motion recognition.

Accordingly, an object of the present invention is to provide an advertisement providing apparatus and method for providing an advertisement using motion recognition so that the user can be provided with the advertisement through motion recognition without annoying key input or touch. .

According to an aspect of the present invention, there is provided an advertisement providing apparatus for receiving and providing an advertisement using motion recognition, comprising: an audio processor for receiving and recording an advertisement audio signal and converting the recorded audio signal into audio data; A motion recognition unit for recognizing a motion by the controller, a transmission / reception unit for transmitting the audio data to an advertisement server, receiving advertisement information corresponding to the audio data from the advertisement server, and an output unit for outputting the received advertisement information. And a controller configured to control the audio processor to record the advertisement audio signal as the motion recognition is recognized, and to transmit the recorded audio data to the advertisement server.

In another aspect, the present invention provides a method for providing an advertisement using motion recognition in the advertisement providing apparatus, receiving and recording an advertisement audio signal, converting the recorded advertisement audio signal and storing the recorded advertisement audio signal as audio data; Recognizing a motion of the; and if the predetermined motion is recognized, transmitting the audio data to the advertising server, receiving advertising information corresponding to the audio data from the advertising server, and outputting the advertising information It is characterized by.

In another aspect, the present invention provides an advertisement server for providing an advertisement to an advertisement providing apparatus, comprising: a transceiver for receiving advertisement audio data by motion recognition from the advertisement providing apparatus, and transmitting advertisement information corresponding to the advertisement audio data; An advertisement sound source extracting unit extracting an advertisement sound source corresponding to the received advertisement audio data, and searching the advertisement information corresponding to the advertisement sound source among the advertisement information stored in the advertisement DB using the extracted advertisement sound source, It characterized in that it comprises an advertisement information providing unit for transmitting to the advertisement providing apparatus.

In another aspect, the present invention provides an advertisement server for providing an advertisement to an advertisement providing apparatus, comprising: a transceiver for receiving advertisement audio data by motion recognition from the advertisement providing apparatus, and transmitting advertisement information corresponding to the advertisement audio data; An advertising audio data character conversion unit for converting the received advertising audio data into text, a keyword extraction unit for extracting a keyword from the converted text, and a keyword among advertisement information previously stored in an advertisement DB using the extracted keywords. And an advertisement information providing unit for retrieving corresponding advertisement information and transmitting the retrieved advertisement information to the advertisement providing apparatus.

In another aspect, the present invention provides an advertisement server for providing an advertisement to an advertisement providing apparatus, comprising: a transceiver for receiving advertisement audio data by motion recognition from the advertisement providing apparatus, and transmitting advertisement information corresponding to the advertisement audio data; An index information extracting unit for extracting index information corresponding to the received advertisement audio data, and searching for the advertisement information corresponding to the index information among the advertisement information previously stored in the advertisement DB by using the extracted index information, and searching the retrieved advertisement information. It characterized in that it comprises an advertisement information providing unit for transmitting to the advertisement providing apparatus.

In another aspect, the present invention provides a method for providing an advertisement to the advertisement providing apparatus in the advertisement server, the process of receiving the advertisement audio data by motion recognition from the advertisement providing apparatus, and in advance in the advertisement DB using the received advertisement audio data And receiving the corresponding advertisement information among the stored advertisement information, and transmitting the received advertisement information to the advertisement providing device.

According to the present invention, while the user listens to an advertisement through a medium such as a TV, a PC, or a radio, the user can receive the corresponding advertisement information through the mobile terminal only by shaking or moving the mobile terminal.

In addition, the present invention provides a new method, such as a motion recognition method for recognizing the shaking or moving of the mobile terminal, rather than a conventional click, touch, search, etc. in the advertising agency's approach, and audio recognition method using audio data By introducing a new advertising business is possible, and accordingly advertising revenue can be generated.

1 is a view for explaining the concept of an advertisement providing method using motion recognition of a mobile terminal according to an embodiment of the present invention.
2 is a block diagram of an advertisement providing system using motion recognition according to an embodiment of the present invention.
3 is a flowchart illustrating a method for providing advertisement using motion recognition according to the first embodiment of the present invention.
4 is a flowchart illustrating an advertisement providing method using motion recognition according to a second embodiment of the present invention.
5 is a flowchart illustrating an advertisement providing method using motion recognition according to a third embodiment of the present invention.
6 is a flowchart illustrating an advertisement providing method using motion recognition according to a fourth embodiment of the present invention.
7 is a configuration diagram of an advertisement server, a charging server, and an advertisement DB according to an embodiment of the present invention.
8 is a block diagram of a mobile terminal for providing an advertisement using motion recognition according to an embodiment of the present invention.
9 is an operation flowchart for providing an advertisement using motion recognition in a mobile terminal according to an embodiment of the present invention.
10A illustrates an example in which an advertisement audio signal is recorded in response to a user request in a mobile terminal according to an embodiment of the present invention.
10B illustrates an example in which advertisement information is output from a mobile terminal according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, specific matters such as specific elements are shown, which are provided to help a more general understanding of the present invention. It is self-evident to those of ordinary knowledge in Esau. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

The present invention discloses an advertisement providing apparatus and method for recording an advertisement audio signal using motion recognition and providing advertisement information using the recorded advertisement audio data.

According to an embodiment of the present invention, the advertisement providing apparatus may be a mobile terminal or the like, recognizes a predetermined motion, records an advertisement audio signal, and requests advertisement information corresponding to the recorded advertisement audio data. Accordingly, the advertisement server includes an advertisement server that provides advertisement information corresponding to the advertisement audio data recorded by the mobile terminal to the mobile terminal and charges the provided advertisement information.

In the present invention, the advertisement audio signal may be an audio signal included in an advertisement output from an advertisement medium such as a TV, a PC, or a radio. The advertisement audio signal may be any audio signal indicating an advertisement regardless of the advertisement medium. . 1 is a diagram illustrating a concept of an advertisement providing method using motion recognition of a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG. 1, when the advertisement audio signal is output from the advertisement medium 10 such as a TV, the mobile terminal 100 may perform a predetermined motion as the user performs an operation such as shaking or moving the mobile terminal 100. Recognize and record the advertising audio signal as the motion is recognized. The mobile terminal 100 receives advertisement information corresponding to the recorded advertisement audio signal from the advertisement server and outputs the advertisement information.

Accordingly, when a user watches an advertisement through an advertisement medium 10 such as a TV, and wants to obtain more detailed information or additional information about the advertisement, the user takes a motion by using the mobile terminal 100. Information or additional information can be provided.

Referring to the configuration of the advertisement providing apparatus for providing an advertisement using motion recognition of the present invention, Figure 2 is a block diagram of an advertisement providing system for providing an advertisement using motion recognition according to an embodiment of the present invention.

Referring to FIG. 2, the content provider 50 provides advertisement content. The advertising content may include an audio advertisement. The content provider 50 may receive the advertisement content from the advertisement server 300 and transmit the advertisement content to the advertisement medium 10.

The advertisement medium 10 is an advertisement medium that receives and outputs advertisement content including an audio signal from the content provider 50, and may be any device capable of outputting an audio signal as well as a TV, a PC, and a radio.

The mobile terminal 100 records the advertisement audio signal output by the advertisement medium 10, stores the advertisement audio signal as advertisement audio data, and provides the advertisement audio data to the advertisement server 300. The mobile terminal 10 may provide a keyword corresponding to the advertisement audio data to the advertisement server 300. The mobile terminal 100 receives and outputs advertisement information from the advertisement server 300 through the communication network 50. For example, the mobile terminal 100 displays an advertisement screen corresponding to the received advertisement information or outputs an advertisement audio signal.

The advertisement server 300 receives advertisement information provided by the at least one advertiser 500 and stores the advertisement information in the advertisement DB 350. The advertisement server 300 receives the advertisement audio data from the mobile terminal 100 through the communication network 50, receives the advertisement information corresponding to the advertisement audio data from the advertisement DB 350, and provides the advertisement audio data to the mobile terminal 100. do. In addition, the advertisement server 300 provides the advertisement providing result to the charging server 400 so that charging for the advertisement may be performed. The advertisement DB 350 stores advertisement information about advertisements that the at least one advertiser 500 wants to advertise. The advertisement information includes advertisement data such as video, photo, text, website address, etc. to express the contents of each advertisement, and similar words about the category of each advertisement, keywords (keywords) for each advertisement, keywords (keywords) for each advertisement. And recommended key words. The advertisement DB 350 may provide advertisement data corresponding to a keyword to the ad server 300, or, if there is no advertisement data corresponding to the keyword, provide a similar keyword corresponding to the advertisement category to which the keyword belongs to the ad server 300. do.

The advertisement sound source DB 360 stores advertisement sound sources for at least one advertisement. The advertisement sound source may be a sound source corresponding to some or all of audio included in the advertisement when there is an advertisement. The advertisement sound source DB 360 may associate and store the advertisement sound source with the advertiser information of the corresponding advertisement, associate the advertisement sound source with the advertisement title of the corresponding advertisement, or store the advertisement sound source with the content of the corresponding advertisement.

Index information DB 370 stores the index information for at least one advertisement. The index information refers to index information that can distinguish or identify audio data corresponding to the advertisement when there is an advertisement. The index information DB 370 may associate and store the index information with the advertisement title, advertiser information, or content of the corresponding advertisement.

The targeting information DB 380 includes at least one targeting information for the advertisement. The targeting information refers to information on a target to which the advertisement is to be provided from the viewpoint of providing the advertisement. For example, according to an embodiment of the present invention, it may be determined what kind of target the device user belongs to by using the device ID and the user information, and the information on this may be targeting information. For example, if the device ID and the user information are female users in their twenties using a smartphone, the targeting information may be information indicating what advertisement is targeted to the smartphone or twenties. The targeting information DB 380 extracts targeting information corresponding to the device ID and the user information from among the previously stored targeting information, and provides the targeting information to the advertisement server 300.

The charging server 400 stores charging policy information related to providing advertisement information according to motion recognition, and performs charging based on providing advertisement information according to the charging policy information.

Hereinafter, a method for providing an advertisement using motion recognition in the advertisement providing apparatus as described above will be described. According to the present invention, a method for providing an advertisement using motion recognition may be implemented in various embodiments. In the description of the present invention, the first to fourth embodiments will be described.

In the advertisement providing method according to the first embodiment of the present invention, when the mobile terminal 100 records the advertisement audio output from the advertisement medium 10 and transmits the advertisement audio to the advertisement server 300, the advertisement server 300 transmits the advertisement audio data. And extracts an advertisement sound source corresponding to the advertisement audio data, and provides advertisement information corresponding to the advertisement sound source to the mobile terminal 100.

In the advertisement providing method according to the second embodiment of the present invention, when the mobile terminal 100 records the advertisement audio output from the advertisement medium 10 and transmits the advertisement audio to the advertisement server 300, the advertisement server 300 transmits the advertisement audio data. And extracts a keyword corresponding to the advertisement audio data, and provides advertisement information corresponding to the keyword to the mobile terminal 100.

In addition, in the advertisement providing method according to the third embodiment of the present invention, when the mobile terminal 100 records the advertisement audio output from the advertisement medium 10 and transmits the advertisement audio to the advertisement server 300, the advertisement server 300 receives the advertisement audio. Receiving data to detect the index information corresponding to the advertisement audio data, and provides the advertisement information corresponding to the index information to the mobile terminal (100).

In addition, in the advertisement providing method according to the fourth embodiment of the present invention, the mobile terminal 100 transmits its device ID, targeting information, and index information corresponding to the advertisement audio output from the advertisement medium 10 to the advertisement server 300. When transmitting, the advertisement server 300 provides the mobile terminal 100 with advertisement information corresponding to the device ID, the targeting information, and the index information of the mobile terminal 100.

Hereinafter, the advertisement providing method according to the first to fourth embodiments of the present invention as described above will be described in detail for each embodiment.

First, a method for providing an advertisement using motion recognition according to a first embodiment of the present invention will be described in detail. FIG. 3 is a flowchart illustrating a method for providing an advertisement using motion recognition according to the first embodiment of the present invention. to be.

Referring to FIG. 3, the content provider 50 provides the advertisement content to the advertisement medium 10 in step 202. The advertisement medium 10 outputs the advertisement audio included in the advertisement content provided from the content provider 50 in step 204.

The mobile terminal 100 records the advertising audio output from the advertising medium 10 in step 206 and stores the recorded advertising audio data.

In this case, the mobile terminal 100 may recognize a predetermined motion in the idle screen state, and if the predetermined motion is recognized, execute the advertisement providing application for receiving the advertisement to record the advertisement audio signal.

Alternatively, the mobile terminal 100 may recognize a predetermined motion in a state where the advertisement application is executed, and record the advertisement audio signal when the predetermined motion is recognized.

As another method, the mobile terminal 100 may execute an advertisement application according to an input by a user such as a key input or a touch input, recognize a predetermined motion, and record an advertisement audio signal when the predetermined motion is recognized. .

After recording the advertisement audio signal as described above, the mobile terminal 100 transmits the recorded advertisement audio data to the advertisement server 300 in step 208.

At this time, according to an embodiment of the present invention, the mobile terminal 100 converts the recorded advertising audio signal into an advertising audio signal of a frequency band by processing a Fast Fourier Transform (FFT) every predetermined time unit (for example, 10 seconds), and converts it. The encoded advertisement audio signals may be encoded by using a hash function, and the encoded advertisement audio data may be compressed by using a BASE64 compression scheme to transmit the encoded and compressed advertisement audio data to the advertisement server 300. In addition, according to another embodiment of the present invention, the mobile terminal 100 may directly transmit the advertisement audio data representing the waveform of the recorded advertisement audio signal to the advertisement server 300.

When the advertisement audio data is received, the advertisement server 300 extracts an advertisement sound source corresponding to the advertisement audio data from the advertisement sound source DB 360 that stores at least one advertisement sound source in step 210. At this time, according to an embodiment of the present invention, when the encoded and compressed advertisement audio data is received from the mobile terminal 100, the advertisement server 300 decompresses the encoded and compressed advertisement audio data, and decompresses the advertisement audio data. After decoding (restore) the data into the advertisement audio signal, the advertisement sound source corresponding to the restored audio signal may be extracted from the advertisement sound source DB 360. According to another embodiment of the present invention, when the advertisement server 300 receives the waveform of the advertisement audio signal from the mobile terminal 100, the advertisement server 300 extracts the advertisement sound source corresponding to the waveform of the advertisement audio signal from the advertisement sound source DB 360. You may.

When the advertisement sound source is extracted, the advertisement server 300 requests advertisement information corresponding to the advertisement sound source from the advertisement DB 350 in step 212. In this case, the advertisement server 300 may request advertisement information corresponding to the advertisement information of the advertisement sound source or the advertisement title of the advertisement sound source.

The advertisement DB 350 provides the advertisement information corresponding to the advertisement sound source to the advertisement server 300 in step 214. In this case, the advertisement DB 350 may provide advertisement information matching the advertiser information on the advertisement sound source to the advertisement server 300, or provide advertisement information matching the advertisement title on the advertisement sound source to the advertisement server 300. .

The advertisement server 300 receives the advertisement information provided from the advertisement DB 350 and transmits the advertisement information to the mobile terminal 100 in step 216.

When the mobile terminal 100 receives the advertisement information from the advertisement server 300, the mobile terminal 100 outputs the advertisement information in step 218. For example, the mobile terminal 100 outputs a video, photo, text, website address, etc. corresponding to the received advertisement information.

Meanwhile, after providing the advertisement information to the mobile terminal 100, the advertisement server 300 notifies the charging server 400 that the advertisement information has been delivered to the mobile terminal 100 in step 220. The billing server 400 performs billing for providing an advertisement according to the motion recognition of the mobile terminal 100 in step 220.

Hereinafter, a method for providing an advertisement using motion recognition according to a second embodiment of the present invention will be described in detail. FIG. 4 is a flowchart illustrating a method for providing an advertisement using motion recognition according to a second embodiment of the present invention. to be. 4, the content provider 50 provides the advertisement content to the advertisement medium 10 in step 302. The advertisement medium 10 outputs the advertisement audio included in the advertisement content provided from the content provider 50 in step 304.

The mobile terminal 100 records the advertisement audio output from the advertisement medium 10 in step 306 and stores the recorded advertisement audio data.

In this case, the mobile terminal 100 may recognize a predetermined motion in the idle screen state, and if the predetermined motion is recognized, execute the advertisement providing application for receiving the advertisement to record the advertisement audio signal.

Alternatively, the mobile terminal 100 may recognize a predetermined motion in a state where the advertisement application is executed, and record the advertisement audio signal when the predetermined motion is recognized.

As another method, the mobile terminal 100 may execute an advertisement application according to an input by a user such as a key input or a touch input, recognize a predetermined motion, and record an advertisement audio signal when the predetermined motion is recognized. .

After recording the advertisement audio signal as described above, the mobile terminal 100 transmits the recorded advertisement audio data to the advertisement server 300 in step 308.

When the advertisement audio data is received, the advertisement server 300 extracts a keyword using the advertisement audio data in step 310. At this time, the advertisement server 300 converts the advertisement audio data into the text data, and extracts a keyword for the advertisement search from the converted text data.

 When the keyword is extracted, the advertisement server 300 requests advertisement information corresponding to the keyword to the advertisement DB 350 in step 312.

The advertisement DB 350 provides advertisement information corresponding to the keyword or a similar keyword corresponding to the keyword in step 314. In detail, according to an embodiment of the present invention, the advertisement DB 350 stores advertisement information about advertisements to be advertised by at least one advertiser 500, and the advertisement information includes a video, a photo, Ad data, such as text and website address, may be included in the advertisement, categories for each advertisement, keywords for each keyword (keywords), keywords for advertisements, and keywords for keywords (recommendations). The advertisement DB 350 may provide advertisement data corresponding to a keyword to the ad server 300, or, if there is no advertisement data corresponding to the keyword, provide a similar keyword corresponding to the advertisement category to which the keyword belongs to the ad server 300. do.

The ad server 300 determines whether advertisement information is provided from the advertisement DB 350 in step 316, and returns to step 312 to request advertisement information corresponding to the keyword if similar keywords belonging to the advertisement category other than the advertisement information are provided. .

In addition, when the advertisement information is provided, the advertisement server 300 transmits the advertisement information to the mobile terminal 100 in step 318. When the advertisement information is received from the advertisement server 300, the mobile terminal 100 outputs the advertisement information in step 320. For example, the mobile terminal 100 outputs a video, photo, text, website address, etc. corresponding to the received advertisement information.

Meanwhile, after providing the advertisement information to the mobile terminal 100, the advertisement server 300 notifies the charging server 400 that the advertisement information has been delivered to the mobile terminal 100 in step 322. In operation 324, the charging server 400 charges an advertisement according to the motion recognition of the mobile terminal 100.

Hereinafter, a method for providing an advertisement using motion recognition according to a third embodiment of the present invention will be described in detail. FIG. 5 is a flowchart illustrating a method for providing an advertisement using motion recognition according to a third embodiment of the present invention. to be.

Referring to FIG. 5, in operation 402, the advertisement server 300 provides the content provider 50 with advertisement content including an advertisement identified or identified by an advertisement index.

The content provider 50 provides the advertising content to the advertising medium 10 in step 404. The advertisement medium 10 outputs the advertisement audio included in the advertisement content provided from the content provider 50 in step 406.

The mobile terminal 100 records the advertisement audio output from the advertisement medium 10 in step 408 and stores the recorded advertisement audio data.

In this case, the mobile terminal 100 may recognize a predetermined motion in the idle screen state, and if the predetermined motion is recognized, execute the advertisement providing application for receiving the advertisement to record the advertisement audio signal.

Alternatively, the mobile terminal 100 may recognize a predetermined motion in a state where the advertisement application is executed, and record the advertisement audio signal when the predetermined motion is recognized.

As another method, the mobile terminal 100 may execute an advertisement application according to an input by a user such as a key input or a touch input, recognize a predetermined motion, and record an advertisement audio signal when the predetermined motion is recognized. .

After recording the advertisement audio signal as described above, the mobile terminal 100 transmits the recorded advertisement audio data to the advertisement server 300 in step 410.

When the advertisement audio data is received, the advertisement server 300 extracts index information corresponding to the advertisement audio data from the index information DB 370 that stores at least one index information in step 412. At this time, according to an embodiment of the present invention, when the encoded and compressed advertisement audio data is received from the mobile terminal 100, the advertisement server 300 decompresses the encoded and compressed advertisement audio data, and decompresses the advertisement audio data. After decoding (restoring) the data into an advertisement audio signal, index information corresponding to the restored audio signal may be extracted from the advertisement sound source DB 360. According to another embodiment of the present invention, when the advertisement server 300 receives the waveform of the advertisement audio signal from the mobile terminal 100, the advertisement server 300 extracts index information corresponding to the waveform of the advertisement audio signal from the advertisement sound source DB 360. You may.

When the index information is extracted, the advertisement server 300 requests advertisement information corresponding to the index information from the advertisement DB 350 in step 414. The advertisement DB 350 provides the advertisement information corresponding to the advertisement index to the advertisement server 300 in step 416. In this case, the advertisement DB 350 may provide advertisement information matching the advertiser information on the advertisement index to the advertisement server 300 or may provide advertisement information matching the advertisement title on the advertisement index to the advertisement server 300. .

The advertisement server 300 receives advertisement information provided from the advertisement DB 350 and transmits the advertisement information to the mobile terminal 100 in step 418.

When the advertisement information is received from the advertisement server 300, the mobile terminal 100 outputs the advertisement information in step 420. For example, the mobile terminal 100 outputs a video, photo, text, website address, etc. corresponding to the received advertisement information.

Meanwhile, after providing the advertisement information to the mobile terminal 100, the advertisement server 300 notifies the charging server 400 that the advertisement information has been delivered to the mobile terminal 100 in step 422. In step 424, the charging server 400 charges for providing an advertisement according to the motion recognition of the mobile terminal 100.

Hereinafter, a method for providing an advertisement using motion recognition according to a fourth embodiment of the present invention will be described in detail. FIG. 6 is a flowchart illustrating a method for providing an advertisement using motion recognition according to a fourth embodiment of the present invention. to be.

Referring to FIG. 6, in operation 502, the advertisement server 300 provides the content provider 50 with advertisement content including advertisement audio that is distinguished or identified by index information.

The content provider 50 provides the advertising content to the advertising medium 10 in step 504. The advertisement medium 10 outputs the advertisement audio included in the advertisement content provided from the content provider 50 in step 506.

When the mobile terminal 100 receives a motion corresponding to the advertisement request for the advertisement audio signal in step 508, the mobile terminal 100 recognizes the corresponding motion, and transmits the device ID and user information of the mobile terminal 100 according to the motion recognition. Send to 300. This is for the advertisement server 300 to collect targeting information according to the device ID and user information in advance. The targeting information refers to information on a target to which an advertisement is to be provided from the viewpoint of providing the advertisement. For example, according to an embodiment of the present invention, it may be determined what kind of target the device user belongs to by using the device ID and the user information, and the information on this may be targeting information.

In this case, the mobile terminal 100 may recognize a predetermined motion in the idle screen state, and transmit a device ID and user information to the advertisement server 300 when the predetermined motion is recognized.

Alternatively, the mobile terminal 100 may recognize a predetermined motion in a state where the advertisement application is executed, and transmit a device ID and user information to the advertisement server 300 when the predetermined motion is recognized.

As another method, the mobile terminal 100 recognizes a predetermined motion by executing an advertisement application according to an input by a user such as a key input or a touch input, and when the predetermined motion is recognized, the device ID and the user information. May be transmitted to the ad server 300.

As described above, when the device ID and the user information are provided so that the advertisement server 300 collects the targeting information, the advertisement server 300 corresponds to the device ID and the user information in the targeting information DB 380 in step 510. Request targeting information.

The targeting information DB 380 extracts targeting information corresponding to the device ID and the user information from among the previously stored targeting information, and provides the targeting information to the advertisement server 300.

Meanwhile, the mobile terminal 100 provides the device ID and the user information so that the advertisement server 300 can collect the targeting information. In step 514, the mobile terminal 100 records the advertisement audio output from the advertisement medium 10 and records the recorded audio. Stores advertising audio data.

In operation 516, the mobile terminal 100 extracts index information corresponding to the advertisement audio data, and transmits the index information extracted in operation 518 to the advertisement server 300.

The advertisement server 300 receives the targeting information corresponding to the device ID and the user information and the index information corresponding to the advertisement audio data, and the advertisement information corresponding to the index information and the targeting information to the advertisement DB 350 in step 520. Ask.

The advertisement information DB 300 searches for advertisement information corresponding to the index information and the targeting information in step 522 and provides corresponding advertisement information.

The advertisement server 300 transmits the advertisement information provided from the advertisement DB 350 to the mobile terminal 100 in step 524.

When the advertisement information is received from the advertisement server 300, the mobile terminal 100 outputs the advertisement information in step 526. For example, the mobile terminal 100 outputs a video, photo, text, website address, etc. corresponding to the received advertisement information.

Meanwhile, after providing the advertisement information to the mobile terminal 100, the advertisement server 300 notifies the charging server 400 that the advertisement information has been delivered to the mobile terminal 100 in step 528. In operation 530, the charging server 400 charges an advertisement according to the motion recognition of the mobile terminal 100.

Hereinafter, the configuration of the mobile terminal 100, the advertisement server 300, the advertisement DB 350, the charging server 400 for providing an advertisement using the motion recognition as described above will be described in detail.

First, the advertisement server 300, the advertisement DB 350, and the charging server 400 will be described. FIG. 7 illustrates the advertisement server 300, the advertisement DB 350, and the charging server 400 according to an exemplary embodiment of the present invention. It is a figure which shows a structure.

Referring to FIG. 7, the advertisement DB 350 stores advertisement information about advertisements that are to be advertised by at least one advertiser 500. The advertisement information includes advertisement data 352 for representing an advertisement, such as a video, a photo, text, and a website address for representing each advertisement content, a category for each advertisement 354, keywords for each advertisement (keyword) 358, Similar keywords for keyword-specific keywords (keywords) and recommended keywords 356 may be included. The advertisement DB 350 may provide advertisement data corresponding to a keyword to the ad server 300, or, if there is no advertisement data corresponding to the keyword, provide a similar keyword corresponding to the advertisement category to which the keyword belongs to the ad server 300. do.

The advertisement server 300 receives advertisement audio data from the mobile terminal 100 and provides advertisement information for the advertisement audio data. The advertisement server 300 may include a user manager 312, a transceiver 314, an audio data character converter 316, a keyword extractor 318, an advertisement information provider 320, a DB manager 332, and a match. The information DB 324, the audio file DB 326, the keyword matching DB 328, the advertisement sound source extractor 332, the index information extractor 334, and the targeting information extractor 336 may be configured. .

The user manager 312 manages user information of the user of the mobile terminal 100, manages access information, monitors access of the user of the mobile terminal 100, and manages advertisement information used by the user of the mobile terminal 100. The transceiver 314 receives the advertisement audio data from the mobile terminal 100 and transmits the advertisement information corresponding to the advertisement audio data to the mobile terminal 100.

The audio file DB 326 stores the received advertising audio data in a file. The key word matching DB 328 stores key words that match the keywords extracted from the advertisement audio data. The matching information DB 324 stores the key word information previously matched.

The DB manager 322 manages information storage and output of the stored information of the audio file DB 326, the key word matching DB 328, and the matching information DB 324.

The advertisement information providing unit 320 requests a search for the advertisement information corresponding to the key word to the advertisement DB 350 by using a key word matching the keyword extracted by the keyword extractor 318, and receives the retrieved advertisement information. It is transmitted to the mobile terminal 100 through the transceiver 314. The advertisement information provider 320 retrieves advertisement information corresponding to the advertisement sound source extracted by the advertisement sound source extractor 332. In addition, the advertisement information provider 320 retrieves advertisement information corresponding to the index information extracted by the index information extractor 334. In addition, the advertisement information providing unit 320 searches for advertisement information corresponding to the targeting information extracted by the targeting information extracting unit 336. In addition, the advertisement information provider 320 notifies the charging server 400 that the advertisement information has been transmitted to the mobile terminal 100.

The advertisement sound source extractor 332 extracts an advertisement sound source corresponding to the advertisement audio data from the advertisement sound source DB 360 and provides the advertisement sound source to the advertisement information provider 320.

The index information extractor 334 extracts index information corresponding to the advertisement audio data from the index information DB 370 and provides the extracted index information to the advertisement information provider 320.

The targeting information extractor 336 extracts the targeting information from the targeting information DB 380 using the device ID and the user information, and provides the targeting information to the advertisement information providing unit 320.

The billing server 400 includes a billing policy manager 412 and a bill processor 414. The charging policy manager 412 stores the charging policy for each advertisement to be provided by the motion recognition of the mobile terminal 100. The charging processing unit 414 processes the charging according to the charging policy of the charging policy management unit 412 as the advertisement information is provided. For example, according to an embodiment of the present invention, as motion recognition occurs, billing may be performed, and many advertisers may set a higher unit price advertising amount through an auction method for keywords that they want to purchase. In addition, it is possible to measure how much the user requests the advertisement while watching or listening to the advertisement, and thus the advertisement effect can be measured according to the motion recognition. Advertising effect measurement means, for example, measuring the number of times an advertisement is provided through motion recognition or a result of a user performing a purchase, an action, etc. due to an advertisement.

On the other hand, the configuration of the mobile terminal 100 according to an embodiment of the present invention will be described in more detail. 8 is a block diagram of a mobile terminal 100 for providing an advertisement using motion recognition according to an embodiment of the present invention.

Referring to FIG. 8, the mobile terminal 100 includes a user input unit 110, an audio processor 120, a transceiver 130, a motion recognition unit 140, a storage unit 150, a controller 160, and a display unit ( 170).

The user input unit 110 may be configured as a keypad or a touch screen composed of a combination of a plurality of keys for inputting various numbers, letters and symbols and inputting various user commands. The user input unit 110 receives an advertisement providing application execution request or an audio recording request by the user according to an embodiment of the present invention and delivers it to the controller 160.

The audio processor 120 receives and records an advertisement audio signal through the microphone 132 under the control of the controller 160, and converts the recorded advertisement audio signal into advertisement audio data.

The transceiver 130 performs wired / wireless communication, transmits the advertisement audio data to the advertisement server 300 under the control of the controller 160, and receives advertisement information corresponding to the advertisement audio data from the advertisement server 300.

The motion recognition unit 140 includes a motion sensor for detecting a motion (movement) of the mobile terminal 100, and recognizes the motion of the mobile terminal 100 detected by the motion sensor. In this case, the motion recognition unit 140 determines whether the detected motion corresponds to a predetermined motion, and provides the detected motion to the controller 160 in the case of the predetermined motion. For example, the predetermined motion may be a predetermined motion in response to the advertisement audio data transmission, or may be a predetermined motion in response to the advertisement providing request input.

The storage unit 150 may be configured as a nonvolatile memory implemented as a flash memory, a hard disk, or the like, and stores data or programs necessary for the operation of the mobile terminal 100. In particular, the DB manager 152, the audio data DB 154, and the user information DB 156 are stored according to an embodiment of the present invention. The DB manager 152 manages input and output and data storage of the audio data DB 154 and the user information DB 156. The audio data DB 154 stores the advertisement audio data by the audio processor 132. The user information DB 156 stores user's basic information for identification of the user or the mobile terminal 100, such as user's personal information and mobile terminal ID.

The controller 160 performs an overall control operation for the operation of the mobile terminal 100. In addition, the controller 160 records the advertisement audio signal and stores the audio data when there is a request input through the user input unit 110, for example, an advertisement providing application execution request input or an audio recording request input, according to an embodiment of the present invention. The processing unit 120 is controlled. In this case, when a predetermined motion is detected through the motion recognition unit 140, the controller 160 may control the audio processor 120 to record an advertisement audio signal and store audio data. Specifically, for example, the controller 160 controls to recognize the predetermined motion in the idle screen state, and if the predetermined motion is recognized, executes an advertisement providing application for receiving the advertisement and records the advertisement audio signal. Can be. Alternatively, the controller 160 may control to recognize a predetermined motion in a state where the advertisement application is executed, and control to record the advertisement audio signal when the predetermined motion is recognized. As another method, the controller 160 controls to recognize the predetermined motion by executing the advertisement application according to an input by the user such as a key input or a touch input, and to record the advertisement audio signal when the predetermined motion is recognized. can do.

 In addition, the controller 160 controls to store the recorded advertisement audio signal, and controls the transceiver 130 to transmit the stored audio data to the advertisement server 300. In addition, the controller 160 controls to output the received advertisement information when the advertisement information is received.

The display unit 170 may include a liquid crystal display (LCD), an organic electroluminescence display (OELD), and the like , and display advertisement information received from the advertisement server 300 under the control of the controller 160.

Referring to the operation of the mobile terminal 100 configured as described above in more detail, Figure 9 is a flow chart of the operation of the mobile terminal 100 according to an embodiment of the present invention.

Referring to FIG. 9, the mobile terminal 100 determines whether a predetermined motion is recognized in step 602. For example, the user may listen to an advertisement including an audio signal provided through a medium such as a TV, a PC, or a radio, and then take a motion to receive advertisement information about the advertisement being listened to.

In this case, the mobile terminal 100 may recognize a predetermined motion according to a user's motion in the idle screen state. Alternatively, the mobile terminal 100 may recognize a predetermined motion according to a user's motion while the advertisement application is executed. As another method, the mobile terminal 100 may recognize the predetermined motion according to the user's motion after executing the advertisement application in response to an input by the user such as a key input or a touch input.

When the predetermined motion is recognized, the mobile terminal 100 records the advertisement audio signal in step 604, converts the recorded advertisement audio signal into advertisement audio data, and stores the advertisement audio signal.

10A illustrates an example in which an advertisement audio signal is recorded in a mobile terminal according to an embodiment of the present invention. Referring to FIG. 10A, when an advertisement is provided with an advertising audio signal such as an XX car having good fuel efficiency for an automobile called 'XX' in a TV, for example, when a predetermined motion is recognized, the mobile terminal ( 100) records the advertising audio signal, and converts and stores the advertising audio signal into the advertising audio data.

Then, the mobile terminal 100 transmits the advertisement audio data to the advertisement server 300 in step 606.

In operation 608, the mobile terminal 100 determines whether advertisement information corresponding to the advertisement audio data is received from the advertisement server 300. If the advertisement information is not received, the mobile terminal 100 notifies the user of the retry request, and returns to step 608.

Meanwhile, when the advertisement information is received, the mobile terminal 100 outputs the received advertisement information in step 612. 10B illustrates an example in which advertisement information is output from a mobile terminal according to an embodiment of the present invention. Referring to FIG. 10B, the mobile terminal 100 may display a video, a photo, a text, a website, etc. corresponding to the received advertisement information through the display unit 170.

Therefore, according to the present invention as described above, the user can receive the advertisement information through the mobile terminal 100 by only shaking or moving the mobile terminal 100 while listening to the advertisement through a medium such as a TV, a PC, or a radio. It is convenient. In addition, the present invention allows a new advertising business by introducing a new method of motion recognition that recognizes shaking or moving the mobile terminal 100, rather than the conventional click, touch, search, etc. in the advertising agency's approach. And, accordingly there is an effect that can generate advertising revenue.

Meanwhile, in the above description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. For example, in the exemplary embodiment of the present invention, the keyword detection from the audio data has been described as an example in the advertisement server. However, the keyword detection from the audio data may be performed in the mobile terminal. In addition, in the exemplary embodiment of the present invention, the advertising medium is described using TV, PC, and radio as an example. Any advertising medium capable of advertising through an audio signal may be used.

Claims (29)

In the advertisement providing apparatus for receiving and providing an advertisement using motion recognition,
An audio processor for receiving and recording an advertisement audio signal and converting the recorded audio signal into audio data;
A motion recognition unit for recognizing a motion by a user,
A transmitter / receiver for transmitting the audio data to an advertisement server and receiving advertisement information corresponding to the audio data from the advertisement server;
An output unit for outputting the received advertisement information;
And a controller configured to control the audio processor to record the advertisement audio signal as the motion recognition is recognized and to transmit the recorded audio data to the advertisement server. Providing advertisement providing device. The method of claim 1,
The advertisement audio signal is an advertisement providing apparatus for providing an advertisement using motion recognition, characterized in that the audio signal for the advertisement output from any one of the TV, PC, radio. The method of claim 1,
The predetermined motion, the advertisement providing apparatus for providing an advertisement using motion recognition, characterized in that the motion shaking the mobile terminal. The method of claim 1,
The advertisement information apparatus for providing an advertisement using motion recognition, characterized in that at least one of a video, a photo, a text, a website. The method of claim 1,
The control unit controls to recognize a predetermined motion in a standby screen state, and when the predetermined motion is recognized, executes an advertisement providing application for receiving an advertisement and records the advertisement audio signal. Advertisement providing device for providing an advertisement. The method of claim 1,
The control unit controls to recognize a predetermined motion in a state in which the advertisement application is executed, and controls to record an advertisement audio signal when the predetermined motion is recognized. . The method of claim 1,
Further comprising a user input unit for receiving an advertisement providing request signal from the user,
The control unit executes an advertisement application according to an input by a user and controls to recognize a predetermined motion, and when the predetermined motion is recognized, the controller controls to record an advertisement audio signal. Ad serving device. The method of claim 1,
The controller is configured to extract a keyword by using the recorded audio data and to transmit the extracted keyword to the advertisement server.
The transmitting and receiving unit provides an advertisement using motion recognition, characterized in that for transmitting the extracted keyword to the advertisement server, and receives the advertisement information corresponding to the extracted keyword. The method of claim 1,
The controller may be configured to extract index information for identifying the recorded audio data using the recorded audio data and to transmit the extracted index information to the advertisement server.
And the transmitting / receiving unit transmits the extracted index information to the advertisement server, and receives advertisement information corresponding to the index information. In the method for providing an advertisement using motion recognition in the advertisement providing apparatus,
Receiving and recording an advertising audio signal, converting the recorded advertising audio signal and storing the audio data;
Recognizing a motion of the advertisement providing device;
If the predetermined motion is recognized, transmitting the audio data to an advertisement server, and receiving advertisement information corresponding to the audio data from the advertisement server;
And outputting the advertisement information. The method for providing an advertisement using motion recognition in a mobile terminal. The method of claim 10, wherein the recognizing a motion of the advertisement providing device comprises:
Determining, by the advertisement providing device, whether there is a motion operation by a user in a standby screen state;
And a step of recognizing whether a motion motion by the user is a predetermined motion. The method of claim 10, wherein the recognizing a motion of the advertisement providing device comprises:
Determining whether there is a motion operation by a user while an advertisement application is executed in the advertisement providing apparatus;
And a step of recognizing whether a motion motion by the user is a predetermined motion.
The method of claim 12, wherein the recognizing a motion of the advertisement providing device comprises:
And providing an advertisement using motion recognition, further comprising executing the advertisement application in response to a request for executing the advertisement application by a user. The method of claim 10,
The advertisement audio signal is an audio signal for an advertisement output from any one of TV, PC, and radio advertising media. The method of claim 10,
The predetermined motion is a method for providing an advertisement using motion recognition in the advertisement providing apparatus, characterized in that the motion shaking the advertisement providing apparatus. The method of claim 10,
The advertisement information may include at least one of a video, a photo, a text, and a website. An ad server for providing an advertisement to an advertisement providing device,
A transceiver for receiving advertisement audio data by motion recognition from the advertisement providing device and transmitting advertisement information corresponding to the advertisement audio data;
An advertisement audio data character converter for converting the received advertisement audio data into characters;
A keyword extraction unit for extracting a keyword from the converted characters;
An advertisement server for searching for advertisement information corresponding to a keyword among advertisement information previously stored in an advertisement DB by using the extracted keyword, and including an advertisement information providing unit for transmitting the retrieved advertisement information to the advertisement providing apparatus. . 18. The advertisement server of claim 17, wherein the advertisement DB stores advertisement information provided from at least one advertiser. 18. The method of claim 17,
The advertisement information providing unit, the advertisement server, characterized in that to provide to the charging server to provide information indicating that the advertisement information by the motion recognition to the billing server. 20. The method of claim 19,
The billing server stores a billing policy for each advertisement to be provided by motion recognition of the advertisement providing device, and processes the billing according to the stored billing policy when advertisement information based on the motion recognition is provided to the advertisement providing device. Ad server, characterized in that. 21. The method of claim 20,
And the billing server measures an advertisement performance including the number of advertisements provided using information indicating that the advertisement information is provided by the motion recognition. An ad server for providing an advertisement to an advertisement providing device,
A transceiver for receiving advertisement audio data by motion recognition from the advertisement providing device and transmitting advertisement information corresponding to the advertisement audio data;
An advertisement sound source extractor extracting an advertisement sound source corresponding to the received advertisement audio data;
And an advertisement information providing unit for retrieving advertisement information corresponding to an advertisement sound source from among advertisement information previously stored in an advertisement DB using the extracted advertisement sound source, and transmitting the retrieved advertisement information to the advertisement providing apparatus. Ad server. An ad server for providing an advertisement to an advertisement providing device,
A transceiver for receiving advertisement audio data by motion recognition from the advertisement providing device and transmitting advertisement information corresponding to the advertisement audio data;
An index information extraction unit for extracting index information corresponding to the received advertisement audio data;
And an advertisement information providing unit for retrieving advertisement information corresponding to the index information among the advertisement information stored in the advertisement DB using the extracted index information and transmitting the retrieved advertisement information to the advertisement providing apparatus. Ad server. 24. The method of claim 23,
The transceiver further receives a device ID and user information of the advertisement providing autonomy from the advertisement providing device,
The advertisement information providing unit extracts targeting information from a targeting DB by using the device ID and user information, and applies the targeting information and index information among the advertisement information previously stored in the advertisement DB by using the targeting information and the index information. And an advertisement server for searching for corresponding advertisement information. In the method for providing an advertisement to the advertisement providing device in the ad server,
Receiving advertisement audio data by motion recognition from the advertisement providing device;
Receiving corresponding advertisement information from among advertisement information previously stored in an advertisement DB by using the received advertisement audio data;
And transmitting the received advertisement information to the advertisement providing apparatus. The method of claim 25, wherein the receiving of the corresponding advertisement information from among the advertisement information previously stored in the advertisement DB by using the received advertisement audio data,
Converting the received advertising audio data into text;
Extracting keywords from the converted characters;
And providing advertisement information corresponding to a keyword among advertisement information stored in advance from an advertisement DB using the extracted keyword. The method of claim 25, wherein the receiving of the corresponding advertisement information from among the advertisement information previously stored in the advertisement DB by using the received advertisement audio data,
Extracting an advertisement sound source corresponding to the received advertisement audio data;
And receiving advertisement information corresponding to an advertisement sound source from among advertisement information pre-stored in an advertisement DB by using the extracted advertisement sound source. The method of claim 25, wherein the receiving of the corresponding advertisement information from among the advertisement information previously stored in the advertisement DB by using the received advertisement audio data,
Extracting index information corresponding to the received advertisement audio data;
And providing advertisement information corresponding to the index information among the advertisement information stored in the advertisement DB in advance by using the extracted index information. 26. The method of claim 25,
And receiving a device ID and user information of the advertisement providing autonomy from the advertisement providing device.
The process of receiving the corresponding advertisement information among the advertisement information pre-stored in the advertisement DB by using the received advertisement audio data,
Extracting index information corresponding to the received advertisement audio data;

Extracting targeting information from a targeting DB using the device ID and user information;
And receiving advertisement information corresponding to the targeting information and the index information among the advertisement information pre-stored in the advertisement DB by using the targeting information and the index information. How to give it.

Images