KR20180107814A - Method and apparatus for providing advertising content - Google Patents

Abstract

Disclosed is a method to enable a portable terminal to recognize a sound source of video content viewed by a user so as to provide an advertisement image or a moving picture related to the corresponding video content. In particular, according to the present invention, the method comprises: a step of identifying a sound source group matched with an external audio signal based on a sensor value detected in a gyro sensor; a step of turning on a microphone when the sound source group is identified; a step of comparing a sound wave signal detected through the microphone with a sound wave signal of each sound source included in the sound source group to identify the sound source matched with the external audio signal; a step of acquiring an advertisement image or moving picture preset to video content including the sound source based on the identified sound source; and a step of providing the advertisement image or moving picture in a preset timing wherein the advertisement image or moving picture is related to the content of the video content played at the preset timing.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a method for providing an advertisement image or a moving image,

The present invention relates to a method and an apparatus for providing an advertisement image or a moving image, and more particularly, to a method and apparatus for identifying a sound source of a specific video content using a gyro sensor, Or moving picture, and a portable terminal.

Recently, the use of digital multimedia contents (audio, video, image, music video, etc.) has been rapidly increasing along with the development of internet, wireless network and high-speed network, and various contents such as education, entertainment, It is being used in applications such as multimedia database, digital TV, Internet broadcasting, music video and so on. The rise of such multimedia information has a great influence on modern life. Particularly, it is utilized to grasp the context of a user by recognizing multimedia contents being played around by giving a great change to the way of using the media. As such a utilization method, a method of providing advertisement contents related to video contents being watched by a user is emerging. However, conventional methods require a somewhat greater amount of processing to recognize the video content that the user is watching. In addition, in the conventional methods, the user experience (UX) provided by the video content is provided by identifying the video content being played back in the portable terminal, and then providing the related advertisement content in a form overlapped with a part of the playback area of the video content. As shown in Fig.

In this connection, Korean Patent Application No. 10-2015-0116970 (entitled " Apparatus and method for providing advertisement based on user characteristics using a content reproduction apparatus ") collects information of a sound source or a moving picture reproduced by a user's content reproduction apparatus Thereby providing an advertisement image related thereto. Particularly, the patent extracts basic information such as a music name of a sound source using metadata of the sound source, and collects the lyrics information and the score information through a route such as the Internet or an affiliate music site using the extracted basic information Thereby identifying the sound source. In addition, the patent analyzes a number of times a user reproduces and / or edits content, a use time, and the like in a user's content reproducing apparatus, and requests a somewhat large amount of processes by selecting an advertisement content based on a user's preference.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a portable terminal capable of identifying a sound source of content being watched by a user through the portable terminal or an external device using a gyro sensor, And a method of recognizing a user's context while minimizing a process amount of the portable terminal. The present invention also provides a method for enabling a user to intuitively recognize that the advertisement image or video is associated with the video content by providing an advertisement image or a video associated with the content of a specific video frame from the video content the user is viewing .

According to another aspect of the present invention, there is provided a method for providing an advertisement image or a moving picture of a portable terminal, the method comprising: identifying a sound source group matching an external audio signal based on a sensor value sensed by a gyro sensor; step; If the sound source group is identified, turning on a microphone; Comparing a sound wave signal detected through the microphone with a sound wave signal of each sound source included in the sound source group to identify a sound source matching the external audio signal; Obtaining a preset advertisement image or moving picture for the video content including the sound source, based on the identified sound source; And providing the advertisement image or moving image at a predetermined timing. At this time, the advertisement image or moving image is associated with the content of the video content to be reproduced at the preset timing.

In addition, the step of acquiring the advertisement image or the moving image may acquire a video frame to be reproduced at the predetermined timing in the video content.

In addition, the step of providing the advertisement image or the moving image may be to display the advertisement image or the moving image together with the video frame.

When the video content is being played back in the portable terminal, the advertisement image can be displayed adjacent to the reduced area as the area in which the video content is being played back at the preset timing is reduced.

Also, the advertisement image or moving image may be provided in a notification window or a pop-up window.

The step of identifying the sound source group may include: subtracting and correcting a motion of the portable terminal from the sensor value; And searching for a common pattern value matching a change pattern of the corrected sensor value from common pattern values of previously stored sound source groups.

The step of identifying a sound source mapped to the audio signal may include comparing a sound wave signal sensed by the microphone with a sound wave signal of each sound source included in the sound source group, Comparing sensor values sensed by the gyro sensor with intrinsic pattern values of the respective sound sources; And determining a sound source matching the external audio signal based on at least one of the sound signal comparison result and the unique pattern value comparison result.

Meanwhile, a computer-readable recording medium according to an exemplary embodiment of the present invention may record a program for causing a computer to execute the above-described method.

According to another aspect of the present invention, there is provided a portable terminal including: a gyro sensor; MIC; A memory for storing an advertisement image or a video providing program; And a processor for executing the program. At this time, as the program is executed, the processor identifies a sound source group matching an external audio signal based on the sensor value sensed by the gyro sensor, and turns on the microphone when the sound source group is identified , Comparing sound wave signals detected through the microphone with sound wave signals of respective sound sources included in the sound source group to identify sound sources matched with the external audio signals, and based on the identified sound sources, The advertisement image or the moving image preset for the content is obtained, and the advertisement image or the moving image is provided at the preset timing. Here, the advertisement image or moving image is related to the content of the video content to be reproduced at the preset timing.

In addition, the processor may execute the advertisement image or the moving image providing program in the background.

According to various exemplary embodiments of the present invention, the gyro sensor, which is always driven in the portable terminal, may be used to first identify one or more sound sources matched to an external audio signal, and then a sound source matching the external audio signal using a microphone The amount of power consumed and the amount of processing consumed by the microphone can be reduced.

In addition, the mobile terminal may provide an advertisement image or a moving image associated with a specific image frame of the video content including the identified sound source, wherein the advertisement image or the moving image is notified or popped up pop-up) to provide a new user experience.

1 is a diagram illustrating an advertisement image or moving picture providing system according to an embodiment of the present invention,
2 is a flowchart illustrating a method of providing an advertisement image or a moving image according to an exemplary embodiment of the present invention,
3 is an example in which the wireless terminal generates a variation pattern of sensor values according to an embodiment of the present invention,
FIG. 4 is a diagram illustrating a timing at which a mobile terminal identifies a sound source of video content and provides an advertisement image or a moving image according to an embodiment of the present invention,
FIG. 5 is an example in which a mobile terminal provides an advertisement image or a moving image according to an embodiment of the present invention,
FIG. 6 is an example in which the mobile terminal displays video content together with an advertisement image or a moving image according to an embodiment of the present invention,
FIG. 7 is an example in which a mobile terminal provides an advertisement image or a moving image by reducing a video content playback screen according to an embodiment of the present invention,
FIG. 8 is a block diagram illustrating a configuration of a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In addition, numerals (e.g., first, second, etc.) used in the description of the present invention are merely an identifier for distinguishing one component from another.

1 is a diagram illustrating an advertisement image or moving picture providing system 10 according to an embodiment of the present invention. Referring to FIG. 1, an advertisement image or moving picture providing system 10 includes a portable terminal 100 and a server 200.

The portable terminal 100 detects an external audio signal of video content output from the portable terminal 100 or an external device (e.g., a display device such as a TV or a kiosk) through a specific application installed in the portable terminal 100 And then provides an advertisement image or video associated with the video content. At this time, the portable terminal 100 may sense the external audio signal through a sensor value of a gyro sensor that is always driven to detect the movement of the portable terminal 100. [ In addition, the specific application may operate in the background of the portable terminal 100 to periodically acquire the sensor value from the gyro sensor, so that the specific application does not operate in the foreground in the portable terminal 100 The external audio signal can be detected.

The server 200 stores advertisement images or moving pictures related to various video contents, or stores address information in which advertisement images or moving pictures are stored. At this time, the server 200 may store an advertisement image or moving picture (or address information stored therein) related to each video content based on the sound source of the video contents. Accordingly, the server 200 provides the mobile terminal 100 with an advertisement image or a moving image related to each video content, based on the external audio signal detected by the portable terminal 100. [ Meanwhile, the server 200 may provide the advertisement image or information about the timing at which a video frame highly related to the moving image is displayed, thereby inducing the user to be exposed to the advertisement image or moving image at the time of playing the video frame .

Meanwhile, the portable terminal 100 is a wireless communication device that is guaranteed to be portable and portable, for example, as a handheld device such as a smart phone, a mobile phone, a personal digital assistant (PDA), a navigation device, a portable medical device, ) Based wireless communication device. In addition, the portable terminal 100 and the server 200 can transmit and receive information (i.e., data) through the network 300. The network 300 may be a wired network such as a Local Area Network (LAN), a Wide Area Network (WAN), or a Value Added Network (VAN) network, or satellite communication network, or the like.

2 is a flowchart illustrating a method of providing an advertisement image or a moving image according to an exemplary embodiment of the present invention.

Referring to FIG. 2, first, the portable terminal 100 acquires a sensor value of a gyro sensor of the portable terminal 100 (S110). The gyro sensor is a sensor for measuring a rotation angle (i.e., an angular velocity) in accordance with the movement of the portable terminal 100, and can detect a rotated angle with respect to each reference direction. For example, the gyro sensor 110 senses each of the rotation angles, azimuth, pitch and roll, relative to an axis in three reference directions (i.e., x, y, z directions) . That is, the sensor value of the gyro sensor may be an angular velocity value.

On the other hand, the gyro sensor is generally always driven in the portable terminal 100. Accordingly, the portable terminal 100 collects and processes angular velocity values of the mobile terminal 100 sensed by the gyro sensor during a desired time and / or period without separately turning on / off the gyro sensor . Also, the gyro sensor responds to the external audio signal in addition to the motion of the portable terminal 100. Using the characteristics of the gyro sensor, the portable terminal 100 identifies a sound source group matching an external audio signal based on the sensor value (S120). The external audio signal includes an audio signal output from a speaker of the portable terminal 100 as well as an audio signal output from an external device (e.g., a display device such as a TV or a kiosk).

The size and period of the sensor value detected according to the external audio signal are very small as compared with the sensor value according to the movement of the portable terminal 100. [ For example, the sensor value of the gyro sensor according to the motion of the portable terminal 100 is about 200 to 1000 times larger than the sensor value according to the external audio signal. Using the difference between the two values, the portable terminal 100 can subtract and correct the motion of the portable terminal 100 from the sensor value of the gyro sensor. For example, the portable terminal 100 may calculate an angular value for each of the reference directions (i.e., x, y, and z directions) with respect to the sensor value, and then calculate a sensor value outside the preset threshold angle range from the sensor value Subtraction correction can be performed.

Thereafter, the portable terminal 100 searches for a common pattern value that matches the change pattern of the corrected sensor value among the common pattern values of the sound source group stored in advance. Here, the change pattern of the sensor value includes a form in which angular values change from positive (+) to negative (-) or negative (-) to positive (+) in each reference direction, And can be represented by a set number of binary numbers. For example, in Fig. 3, the change pattern of the sensor value may be [10, 10, 01]. That is, the change pattern of the angular value 301 in the x direction is' 10 ', the change pattern of the angular value 302 in the y direction is' 10', and the change pattern of the angular value 303 in the z direction is' 'to be.

Also, the common pattern value may be a change pattern commonly appearing in one or more sound sources among the change patterns of the sensor values sensed by the gyro sensor as different sound sources are reproduced. For example, the common pattern value may include a change pattern or the like generated by a specific musical instrument (drum, piano, etc.). On the other hand, sound sources having a common pattern value are grouped into the same sound source group. That is, each sound source group is a set of sound sources having the same common pattern value.

When the common pattern value matching the variation pattern of the sensor value is retrieved, the portable terminal 100 determines that the sound source group having the common pattern value matches the audio signal. If the common pattern value is not found, the portable terminal 100 determines that the sound source group matching the audio signal does not exist, and then performs step S110 again.

When the common pattern value is found, the portable terminal 100 turns on the microphone (S130). Then, the portable terminal 100 compares the sound wave signals (i.e., the waveforms of the external audio signals) received via the microphone with the sound wave signals of the respective sound sources included in the identified sound source group (S140). If there is a sound wave signal of a sound source matching the sound wave signal received through the microphone, the mobile terminal 100 determines that the sound source matches the external audio signal (S150). Then, the portable terminal 100 turns off the microphone.

However, if it is determined in operation S140 that there is no sound wave signal corresponding to the sound wave signal received through the microphone, the portable terminal 100 turns off the microphone and then performs step S110 again.

Meanwhile, according to the embodiment, after the microphone is turned on in step S130, the portable terminal 100 can continuously acquire the sensor value of the gyro sensor. In this case, the portable terminal 100 may compare the sensor value with a unique pattern value of each sound source included in the sound source group identified in step S120. Here, the inherent pattern value may be a change pattern that appears only in each sound source among the change patterns of the sensor values sensed by the gyro sensor as each of the different sound sources is reproduced. In addition, the inherent pattern value may appear after the common pattern value appears in each sound source. Accordingly, the portable terminal 100 obtains the time-specific angular value from the sensor value (i.e., the angular velocity value), and then calculates a unique pattern value of each sound source included in the identified sound source group based on the change pattern of the angle value Can be compared. In this case, the portable terminal 100 can determine the sound source matching the external audio signal based on at least one of the sound signal comparison result and the unique pattern value comparison result. As described above, the portable terminal 100 can improve the identification accuracy of the sound source by identifying the sound source by considering both the sound wave signal of the sound source and the unique pattern value.

Thereafter, the mobile terminal 100 acquires a preset advertisement image or moving image for the video content including the sound source based on the identified sound source (S160). For example, the portable terminal 100 provides the server 200 with information on the identified sound source (e.g., identification information of the sound source), and the server 200 generates a sound source corresponding to the received sound source (Or address information thereof) preset for the embedded video content.

Then, the portable terminal 100 provides the obtained advertisement image or moving image at a preset timing (S170). Here, the preset timing may be preset in the server 200 as a time point at which a video frame most related to the advertisement image or the moving image is reproduced in the video content. FIG. 4 is a view showing a timing at which the portable terminal 100 identifies a sound source of video content and provides an advertisement image or a moving image. Specifically, the video content is composed of M video frames and a sound source corresponding to each video frame, and the portable terminal 100 is matched to the sound source 410 of the i-th video frame (i <M) using the gyro sensor Identify the sound source group. Then, the portable terminal 100 identifies a sound source that matches the sound source 420 of the jth video frame (j < i) in the sound source group using a microphone and / or a gyro sensor. The mobile terminal 100 provides information on the identified sound source to the server 200, and then receives advertisement images or moving image information preset in the corresponding video content. At this time, the mobile terminal 100 may be further provided with timing information for displaying the corresponding advertisement image or moving image. The mobile terminal 100 may display an advertisement image or a moving image at a time point when the Nth video frame (N < M) is reproduced based on the provided timing information. That is, the advertisement image or moving image provided from the portable terminal 100 may be related to the content of the Nth video frame.

Meanwhile, the portable terminal 100 may display the advertisement image or the moving image through a notification window or a pop-up window. More specifically, the portable terminal 100 can perform the above-described process (i.e., S110 to S160) by executing a daemon program regardless of whether a specific application is executed in the foreground. Accordingly, when the advertisement image or the moving image is provided from the server 200, the portable terminal 100 can display the advertisement image using the notification image or the pop-up window even when the execution image of the specific application is not displayed in the foreground, Or a moving picture. For example, as shown in FIG. 5, after the notification mark 530 is displayed on the notification bar 510, the user may drag the notification bar 510 the advertisement image or moving image can be displayed in one area 540 of the notification window 520. [ Accordingly, the portable terminal 100 can allow the user to reproduce the advertisement image or the moving image at a desired time. Accordingly, even when the video content is being played on the portable terminal 100, the portable terminal 100 can provide the advertisement image or the moving image without interfering with the user experience of the user watching the video content.

Meanwhile, the portable terminal 100 may further acquire a video frame to be reproduced at a predetermined timing within the video content including the audio signal. Here, the video frame may be a captured image or still image of the video content, and may be an image most associated with the advertisement image or video within the video content. The video frame may be stored in the server 200 in advance. When the video frame is provided, the mobile terminal 100 can display an advertisement image or a moving image together with the video content. Accordingly, the user can intuitively perceive the association between the video content being viewed and the advertisement image or the moving image. 6 is an example in which the portable terminal 100 displays an advertisement image or a moving image together with a video frame. Specifically, the portable terminal 100 divides the notification window or the pop-up window into a plurality of areas, displays an advertisement image or a moving image in the first area 610, and displays a video frame in the second area 620 . In addition, the portable terminal 100 may display identification information and / or detailed information of a specific application providing the advertisement image or moving image through the third area 630. [

In addition, according to an embodiment, when the video content is being played back on the mobile terminal 100, the portable terminal 100 may provide an advertisement image or a moving picture on a playback screen of the video content as well as a notification window or a popup window. For example, the portable terminal 100 may display the advertisement image adjacent to the reduced area after reducing the area in which the video content is being reproduced (i.e., the video content reproduction screen) at a preset timing. 7A and 7B, the entire area 700a or 700b in which video content is being reproduced is changed to a reduced area 710 or 730 at a predetermined timing, and the portable terminal 100 May display the advertisement image in the remaining area 720 or 740 in which the entire area 710 or 730 has been changed. The portable terminal 100 may not limit the user experience of the user viewing the video content by enlarging the video content playback screen after providing the advertisement image for a predetermined period of time. In addition, the portable terminal 100 may further provide the advertisement image in a notification window or a pop-up window. At this time, the portable terminal 100 may provide a pop-up window in the remaining area except for the video content playback screen.

On the other hand, in the above example, since the mobile terminal 100 is playing back the video content, the video content and the advertisement video can not be displayed together. Accordingly, the portable terminal 100 can provide a user interface for stopping the video content and for guiding the reproduction of the advertisement video. For example, the portable terminal 100 may provide link information for moving to another page where the advertisement video can be reproduced, in the area where the advertisement image of FIG. 7 is displayed. Alternatively, the portable terminal 100 may convert the video content into the advertisement video for a short time at a predetermined timing, and then play back the video content again.

In this way, the mobile terminal 100 according to the disclosed embodiment can display a specific video frame of the video content being watched by the user and the advertisement image (or moving image) of the video content to be viewed, without executing a specific application in the foreground, A new user experience can be provided. In addition, the portable terminal 100 according to the disclosed embodiment firstly identifies a sound source group using a gyro sensor that operates at all times, and then identifies a sound source using a microphone, thereby determining the amount of power consumed and the amount of process consumed by the microphone Can be minimized.

1 to 7, the portable terminal 100 identifies the sound source using the sensor value of the gyro sensor and the sound wave signal of the microphone. However, the present invention is not limited thereto. The portable terminal 100 transmits the sensor value (or the common pattern value and / or the unique pattern value) of the gyro sensor and the sound wave signal of the microphone to the server 200. When the server 200 receives the sound value signal from the portable terminal 100 (Or a common pattern value and / or a unique pattern value) and an acoustic wave signal provided from a sound source.

On the other hand, steps S110 through S170 in the above description may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

FIG. 8 is a block diagram illustrating a configuration of a mobile terminal 100 according to an embodiment of the present invention. The configurations of the portable terminal 100 shown in Fig. 8 relate to the embodiments described in Figs. 1 to 7 described above. Therefore, the contents described above in FIGS. 1 to 7 can be applied to the configuration of the portable terminal 100 of FIG. 8, even if omitted below.

8, the portable terminal 100 includes a gyro sensor 110, a microphone 120, a display 130, a processor 140, (150).

The gyro sensor 110 is a sensor for measuring a rotation angle (that is, an angular velocity) according to the movement of the portable terminal 100, and can detect a rotated angle with respect to each reference direction. For example, the gyro sensor 110 senses each of the rotation angles, azimuth, pitch and roll, relative to an axis in three reference directions (i.e., x, y, z directions) .

On the other hand, the gyro sensor 110 is always driven and reacts to an external audio signal in addition to movement of the portable terminal 100. The processor 140 uses the characteristics of this gyro sensor 110 to identify an external audio signal.

The microphone 120 receives an external audio signal and processes it as electrical voice data. For example, the microphone 120 may convert the input audio signal into an electrical signal and output the electrical signal to the processor 140. At this time, the microphone 120 may use various noise elimination algorithms for eliminating the noise generated in receiving the external audio signal.

The display 130 displays information processed in the mobile terminal 100 under the control of the processor 140. [ The display 130 displays an advertisement image or a moving image, a video frame, and the like under the control of the processor 140. In addition, the display 130 may output various graphic user interfaces under the control of the processor 140. Meanwhile, in the case where the display 130 includes a touch screen having a layer structure of a touch pad, the display 130 may be used as an input device in addition to the output device.

The processor 140 controls the overall operation of the portable terminal 100. For example, the processor 140 may include at least one component for controlling the operation of the gyro sensor 110, the microphone 120, the display 130, and the memory 150. For example, the processor 140 may include a random access memory (RAM) (not shown), a ROM (Read Only Memory) (not shown), a CPU (not shown), a GPU (Graphic Processing Unit) (Not shown). At this time, the RAM, the ROM, the CPU and the GPU can be connected to each other via the bus.

The processor 140 also executes a program that provides the advertisement image or moving image stored in the memory 150. [ At this time, the program can be executed in the background. For example, the program may be a daemon program.

As the program is executed, the processor 140 acquires the sensor value of the gyro sensor 110. The processor 140 identifies the sound source group that matches the audio signal based on the sensor value. Specifically, the processor 140 subtracts and corrects the motion of the portable terminal 100 from the sensor value of the gyro sensor 110. [ Thereafter, the processor 140 searches for a common pattern value matching the variation pattern of the corrected sensor value among the common pattern values of the sound source group stored in advance. Here, the change pattern of the sensor value includes a shape in which the angular values change from positive (+) to negative (-) or negative (-) to positive (+) in each reference direction. In addition, the common pattern value may be a change pattern commonly appearing in one or more sound sources among the change patterns of sensor values sensed by the gyro sensor 110 as different sound sources are reproduced. That is, each sound source group is a set of sound sources having the same common pattern value.

Next, the processor 140 turns on the microphone 120 as the sound source group is identified. The processor 140 compares the sound wave signals (i.e., the waveforms of the external audio signals) received via the microphone 120 with the sound wave signals of the respective sound sources included in the identified sound source group. If there is a sound wave signal of a sound source matching the sound wave signal received through the microphone, the processor 140 determines that the sound source matches the external audio signal. Thereafter, the processor 140 turns off the microphone 120.

Next, the processor 140 acquires a preset advertisement image or moving picture for the video content including the sound source based on the identified sound source. For example, the processor 140 communicates with the server 200 through a communication circuit (not shown) to provide information on the identified sound source to the server 200, And obtain an advertisement image or a moving image associated with the content. In particular, the server 200 may provide an advertising image or moving picture associated with a particular video frame of video content.

Thereafter, the processor 140 provides the obtained advertisement image or moving image at a preset timing. Here, the predetermined timing may be a time at which the video frame is reproduced in the video content, and may be a value obtained from the server 200. [

Meanwhile, the processor 140 may provide the advertisement image or the moving image through a notification window or a pop-up window. For example, the processor 140 controls the display 130 to display a notification mark on the notification bar indicating that the advertisement image or moving image has been provided, and then, when a drag input for the notification bar is received, And may provide the advertisement image or moving image.

The memory 150 stores various programs for controlling the portable terminal 100 by the processor 140. For example, the memory 150 stores a program for providing an advertisement image or a moving image. At this time, the memory 150 collectively refers to a non-volatile storage device that keeps stored information even when power is not supplied, and a volatile storage device that requires power to maintain stored information.

Meanwhile, the portable terminal 100 may further include other components than the configuration shown in FIG. For example, the portable terminal 100 may further include a speaker (not shown) for outputting an audio signal to the outside, a user input unit (not shown) for receiving a user input (e.g., a drag input) .

On the other hand, the advertisement image or moving picture providing methods according to the various embodiments described above can be generated by software and mounted on various electronic devices.

For example, identifying a sound source group that matches an external audio signal based on a sensor value sensed by a gyro sensor; If the sound source group is identified, turning on the microphone; Comparing the sound wave signal detected by the microphone with the sound wave signal of each sound source included in the sound source group to identify a sound source matching the external audio signal; Acquiring a preset advertisement image or moving picture for video content including the sound source based on the identified sound source; And providing the advertisement image or moving picture at a predetermined timing, wherein the advertisement image or moving picture is associated with the content of the video content being reproduced at a preset timing. A non-transitory computer readable medium may be installed.

Here, the non-transitory readable medium is not a medium for storing data for a short time such as a register, a cache, a memory, etc., but means a medium that semi-permanently stores data and is readable by a device. In particular, the various middleware or programs described above may be stored and provided in non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. It should be noted that the embodiments disclosed in the present invention are not intended to limit the scope of the present invention and are not intended to limit the scope of the present invention. Accordingly, the scope of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as being included in the scope of the present invention.

100: portable terminal
110: gyro sensor
120: microphone
130: display
140: processor
150: memory

Claims (10)

A method for providing an advertisement image or a moving picture based on a sound source of video content in a portable terminal,
Identifying a sound source group matching an external audio signal based on a sensor value sensed by a gyro sensor;
If the sound source group is identified, turning on a microphone;
Comparing a sound wave signal detected through the microphone with a sound wave signal of each sound source included in the sound source group to identify a sound source matching the external audio signal;
Obtaining a preset advertisement image or moving picture for the video content including the sound source, based on the identified sound source; And
And providing the advertisement image or moving image at a preset timing,
The advertisement image or video
Wherein the content is associated with the content of the video content being played back at the predetermined timing. The method according to claim 1,
The step of obtaining the advertisement image or moving image
And acquiring a video frame to be played back at the predetermined timing among the video contents. 3. The method of claim 2,
The step of providing the advertisement image or moving image
And displaying the advertisement image or the moving image together with the video frame. The method according to claim 1,
When the video content is being played back on the portable terminal,
The advertisement image
Wherein the video content is displayed adjacent to the reduced area as the area in which the video content is being reproduced is reduced at the predetermined timing. The method according to claim 1,
The advertisement image or video
Wherein the notification is provided in a notification window or a pop-up window. The method according to claim 1,
The step of identifying the sound source group
Subtracting the motion of the portable terminal from the sensor value; And
And searching for a common pattern value that matches a variation pattern of the corrected sensor value among common pattern values of the sound source groups stored in advance. The method according to claim 6,
The step of identifying a sound source mapped to the audio signal
Comparing a sound wave signal sensed by the microphone with a sound wave signal of each sound source included in the sound source group;
Comparing sensor values sensed by the gyro sensor with intrinsic pattern values of the respective sound sources; And
And determining a sound source matching the external audio signal based on at least one of the sound signal comparison result and the unique pattern value comparison result. A gyro sensor;
Microphone;
A memory for storing an advertisement image or a video providing program; And
And a processor for executing the program,
The processor, as the program is executed,
A sound source group matching the external audio signal is identified based on the sensor value sensed by the gyro sensor, and when the sound source group is identified, the microphones are turned on, Compares the sound wave signals of the respective sound sources included in the sound source, identifies a sound source matching the external audio signal,
Wherein the advertisement image or the moving image preset for the video content including the sound source is obtained based on the sound source and the advertisement image or the moving image is provided at a preset timing,
The advertisement image or video
The content being associated with the content of the video content being reproduced at the predetermined timing. 9. The method of claim 8,
The processor
And the advertisement image or the movie providing program is executed in the background. 8. A computer-readable recording medium on which a program for implementing the method of any one of claims 1 to 7 is recorded.

Images