KR101770551B1 - Appratus and method for matching video - Google Patents

Abstract

A method for matching a video and an apparatus for matching a video in a karaoke system are disclosed. The method for matching a video includes a step of storing accompaniment metadata including a song name, a song number, an artist, a tempo, a genre, and designated video data for each song in a database, and stores video metadata including a song name, a song number, tempo, category, and image quality for each video; a step of firstly extracting video data matching a song inputted based on a song name, a song number, artist data, and user-designated video information of the inputted song; a step of secondarily extracting video data matching a song based on video category, tempo, and image quality after the first extraction; and a step of randomly selecting one of the secondarily extracted video data and displaying the same together with the selected accompaniment.

Description

[0001] APPARATUS AND METHOD FOR MATCHING VIDEO [0002]

      And more particularly, to an apparatus and method for matching an image suitable for a song selected in a karaoke system.

Unless otherwise indicated herein, the contents set forth in this section are not prior art to the claims of this application and are not to be construed as prior art to be included in this section.

In general, a karaoke system used for karaoke stores a plurality of song accompaniment data, reproduces selected song accompaniment data, and provides lyrics and image data to a video output apparatus. In order for the user to play the accompaniment of the song selected on the karaoke system, the user can search for the song to be searched using the song guide book or the song selection list, directly input the song number selected in the karaoke system, Enter the number of the selected song. When a user selects a song and reproduces the selected song accompaniment data, the image of the karaoke machine is output in advance to the video tape or the compact disc, and the lyrics are output on the video. However, in the video output method described above, a video irrelevant to the selected song is output, so that it can not excite the excitement of the song or produce an atmosphere suitable for the song.

Another method of video output of a karaoke system is that a song and an image corresponding thereto are recorded in the same medium or file, and the sound, the lyrics, and the image are simultaneously output to one frame. This method has the advantage that it does not need to load the lyrics on the image but outputs the video suitable for the song, but all the images suitable for each song should be recorded in different files or media. Since a karaoke machine needs to store a lot of songs, it needs a large amount of memory and is not suitable for all songs.

In addition, when the image is output from the karaoke system, conventionally, the image is not automated by using the designated image for each individual song, or the image displayed by performing only the matching process according to the song genre is not reflected in the song pause, have.

1. Korean Patent Publication No. 10-2009-0011729 (Feb. 2, 2009) 2. Korean Patent Registration No. 10-12053420000 (November 21, 2012)

     And an image matching apparatus and method for matching images according to a tempo, a genre, a singer, and user setting information of the selected song.

As one embodiment, a video matching method in a karaoke system includes storing song accompaniment metadata including a song name, a song number, an artist, a tempo, a genre, and designated video data in a database for each song and storing the song name, song number, Storing image metadata including a tempo, a category, and an image quality for each image; Extracting image data matching the input song based on a song name, a song number, an artist data, and a user-designated image information of the inputted song; Extracting image data matching the input song based on the image category, tempo, and image quality after the first extraction; And randomly selecting one of the images extracted from the second extracted image and displaying the image together with the accompaniment; .

  As another embodiment, the image matching apparatus may store the song accompaniment metadata including the song name, song number, singer, tempo, and designated video data for each song, and store the song name, song number, song number, tempo, A database for storing metadata by video; The image data matching the song is firstly extracted based on the song name, the song number, the song number data, and the song tempo of the song, and the image data matching the song based on the image category, tempo, An image selection module for secondary extraction; A display module for randomly selecting one image from the second extracted image data and displaying the image together with the inputted song; .

The image matching apparatus and method as described above extracts and displays an image suitable for the selected song in consideration of the genre, atmosphere, and tempo of the selected song, thereby producing an atmosphere suitable for the selected song, And automatically perform image matching on a plurality of songs. In addition, it is possible to select a more optimized matching picture based on the subdivided song accompaniment information and the image information.

1 is a block diagram showing a schematic configuration of an image matching apparatus according to an embodiment;
2 is a block diagram showing a specific configuration of an image selection module according to an embodiment;
3 is a data processing flowchart of an image matching method according to an embodiment.
4 is an image matching algorithm according to an embodiment.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like numbers refer to like elements throughout.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions in the embodiments of the present invention, which may vary depending on the intention of the user, the intention or the custom of the operator. Therefore, the definition should be based on the contents throughout this specification.

1 is a block diagram showing a schematic configuration of an image matching apparatus according to an embodiment.

Referring to FIG. 1, the image matching apparatus may include a database 100, an image selection module 200, and a display module 300. The term " module ", as used herein, should be interpreted to include software, hardware, or a combination thereof, depending on the context in which the term is used. For example, the software may be machine language, firmware, embedded code, application software, or a programmable language. As another example, the hardware may be a circuit, a processor, a computer, an integrated circuit, an integrated circuit core, a sensor, a micro-electro-mechanical system (MEMS), a passive device, or a combination thereof.

The database 100 stores song accompaniment data and image data including lyrics accompaniment and lyrics. As shown in FIG. 1, the song accompaniment data includes metadata about a song, such as a song name, a song number, an artist, designated video information, a tempo, and genre information of a song. The image data includes metadata about the image such as a video number, a song number matched with the video, an artist, a tempo of the image, and a category including the image. In the present disclosure, images matching the selected song are extracted through various data such as a song number, a tempo, and a genre. Therefore, it is necessary to perform database matching of the song accompaniment and the metadata of the image in the database 100.

According to an embodiment, the image data may be classified according to a singer, a genre, a tempo, or categorized into natures, celebrities, backgrounds, characters, and the like according to displayed screen contents.

The image selection module 200 selects an image matching the input song based on the song accompaniment metadata. For example, the image selection module 200 performs a first extraction process and a second extraction process to select an image matching the input song, thereby selecting an image matching the song. Specifically, in the first extraction, matching image data is extracted according to the song name, song number, song data, and song tempo of the inputted song, and when the extracted image data exists, matching images of the first extracted images are selected do.

In the second extraction, if there is no extracted image data as the first order, the image data matching the input song is extracted based on the image category, tempo, and user-designated image information, and the matching image is selected from the extracted data . The display module 300 displays the selected image together with the song.

2 is a block diagram showing a specific configuration of an image selection module according to an embodiment.

Referring to FIG. 2, the image selection module 200 may include a first extraction unit 210, a second extraction unit 230, and an image selection unit 250.

The primary extraction unit 210 preferentially extracts an image matching the designated image and the song number matched to the song. If there is no matching image matching the song or an image matching the song number, the first extraction unit 210 recognizes the singing and tempo data of the song, and selects the selected song And extracts images having similar tempo information within a certain range.

When the image data extracted by the first extraction unit 210 does not exist, the secondary extraction unit 230 extracts image data matching the genre and the artist specified in the song, and extracts the selected song And extracts image data having a similar tempo in a certain range. If there is no image data matching the song even after the second extraction, the secondary extraction unit 230 selects a user-specified image included in the category preset by the user. The user-specified image is an image having a tempo similar to the tempo of the song selected in the category of the image designated by the user in a certain range, if there is no image matched to the selected song.

The image selection unit 250 selects one of the extracted image data and transmits the selected image data to the display module 300.

3 is a data processing flowchart of the image matching method according to the embodiment.

First, the music metadata and the image metadata are stored in the database 100 for each piece of music (S210). The song accompaniment metadata includes a song name, a song number, an artist, a tempo, a genre, and designated image data, and the image metadata includes a song name, a song number, an artist, a tempo, a category, and an image quality.

 The first extraction unit 210 of the image selection module 200 firstly extracts image data matched to a song input based on the song name, song number, song data, and user-specified image information of the song input by the user (S220). For example, in the first extraction process, a designated image matched to a song is searched first, or an image matching the song number is searched. If there is no image matching the designated image or song number matched with the search result, Recognizes the singer data and the tempo of the singing song. After the recognition, the image of the singer singing the inputted song can be extracted, and the tempo of the double input song and the image in the proximity range within the predetermined range can be extracted.

After the first extraction, the secondary extraction unit (S230) extracts image data matching the song based on the category including the image, the tempo of the image, and the image quality. The category may be set according to an attribute of an object to be displayed, such as nature, motion, entertainer, character, etc., as a classification criterion including content displayed in a matching image, and a category for preferentially extracting an image Can be set. For example, in the second extraction process, the image data included in the category of the song or the image data included in the category set by the user is extracted, and the tempo of the image data among the extracted image data is divided into a proximity range It is possible to extract the image data existing in the image data. In addition, if there is no matching image with the input song even after the second extraction, the image can be selected in the user-specified category.

The display module 300 randomly selects one image from the secondary extracted image data and displays it together with the song (S250).

4 is an example of an image matching algorithm according to an embodiment.

 Upon receipt of the music selection number from the user in step S310, it is determined whether there is a video having the same number as the music number input in step S311. If there is an image of the same number as the input song number, the image is matched based on image quality and sync match. To do so, in step S312, the graphics display resolution of the image is compared and classified into FHD image, HD image, and SD image in order of image quality, and matching priority is given to the high-quality image. In step S313, a sync of the image included in the specific ranking is recognized in the image quality comparison. In the embodiment, the sync means whether or not the image and the song are lip sync, and extracts an image list in which the song and the song match. Thereafter, an image to be displayed is randomly selected from among the images extracted in step S314.

If no image having the same number as the input song number exists in the image search result identical to the song number input in step S311, it is confirmed whether the song input in step S321 is a special song. If the input song is a special song, the image designated separately in step S314 is selected and displayed. Make sure it is a special song that exists.

If the song input in step S321 is not a special song, the presence or absence of the singer code is checked in step S331. If the artist code exists, it is checked in step S332 whether or not the image is automatically selected. If the artist code is selected, in step S333, whether the music code or live performance image corresponding to the artist code is adopted is confirmed. When a music video or a live performance image corresponding to the singer code is adopted, a priority image considering the image quality and tempo is extracted in step S335. For example, in step S335, the images are matched in consideration of image quality and tempo. Specifically, the matching priority can be given as the image is in high quality and in the proximity range with the tempo of the input song. If the condition is not the automatic image selection condition in step S332, the image in the category of the matching image previously input by the user is extracted in step S334, and the process proceeds to step S335. In step S335, a matching image is extracted with priority given to the high-quality image, the tempo of the input song, and the tempo of the proximity range. In step S314, an image to be displayed is selected from among the extracted images.

  If no singer code exists in step S331, it is determined whether there is a universal image matching the song input in step S341. If there is a general-purpose image, it is checked in step S342 whether or not an image is automatically selected. If it is an automatic image selection condition, a common code of the image is checked in step S345. The common code is data given according to the tempo of the image. For example, according to the tempo of the image, if the tempo is less than 80, the code number 1 may be given as code number 3 if it is 80 or more and less than 110, or code number 2 if it is 110 or more. After checking the common code of the image, in step S347, excluding the images having the common code of 0, the priority image considering the image quality and the tempo is extracted in step S348. For example, in step S348, a matching image may be extracted with priority given to the high-quality image, the tempo of the input song, and the tempo of the proximity range. If it is not the image selection automatic condition in step S342, the image included in the category of the song input in step S343 is extracted. In step S344, it is determined whether or not an image is extracted in the music category. If the image is extracted in the music video category, step S345 is entered. If the image is not extracted in the music video category, it is determined whether the image is extracted from the motion or the nature category in step S346. If the image is extracted from the motion graphic or the natural category, the process proceeds to step S347 Otherwise, the flow advances to step S348 to extract a priority image considering image quality and tempo.

If it is determined in step S341 that the image is not a general-purpose image, a random image according to the song input in step S351 is extracted. For example, in step S351, if the user selects the category to automatically extract the image, the image is extracted from the natural category. On the other hand, when the user sets a specific category for extracting the image, the image included in the set category is extracted. Then, an image to be displayed is selected from among the images extracted in step S314.

The image matching algorithm and the image matching method can extract and display an image suitable for the selected song in consideration of the genre, atmosphere, and tempo of the selected song.

It is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. It is not limited to the embodiment.

100: Database
200: image selection module
210: primary extraction unit
230: Secondary extraction section
250:
300: display module

Claims (10)

A video matching method in a karaoke system,
The song accompaniment metadata including song name, song number, singer, tempo, genre, and designated video data is stored for each song in the database, and video metadata including song name, song number, song number, tempo, category, Storing;
Extracting image data matching the input song based on a song name, a song number, an artist data, and a user-designated image information of the input song;
Extracting image data matching the song based on the image category, tempo, and image quality after the first extraction; And
Selecting one of the secondary extracted image data at random and displaying it with accompaniment; Lt; / RTI >
Extracting the image data first
Searching for a designated image matched with the inputted song, or searching for an image matching the song number;
If there is no image matching the designated image or song number matched with the inputted song, the song data and tempo of the song are recognized, and if the tempo of the song input from among the images of the recognized song is within the predetermined range Extracting an image existing in a close range of the image; Lt; / RTI >
The second extracting step compares graphic pixels of the secondary extracted image data and classifies them into an FHD image, an HD image, and an SD image in order of image quality, and assigns matching priority to a high-quality image; And
Selecting an image having a similarity to the inputted song among the images to which the priority is assigned, Wherein the image matching method comprises:
delete 2. The method of claim 1, wherein the step of extracting the image data matching the song
Extracting image data included in a predetermined category;
Selecting image data in which the tempo of the image data among the extracted image data is present and the image data existing in a close range within a predetermined range; Wherein the image matching method comprises:
The method of claim 1, further comprising: extracting the image data; The
And if the result of the secondary extraction does not exist, the image included in the predetermined category is selected.
The method of claim 1, further comprising: extracting image data matching the input song; The
Comparing the pixels of the image stored in the database with each other, and assigning matching priority to the high-quality image.
In an image matching apparatus,
A database for storing song accompaniment metadata including song names, song numbers, singers, tempos, and designated video data for each song, and storing image metadata including song names, song numbers, artists, tempos, categories, and image qualities;
The image data matching the song is firstly extracted based on the song name, the song number, the song number data, and the song tempo of the song, and based on the image category, tempo, and user- An image selection module for secondarily extracting data;
A display module for randomly selecting one image from the secondary image data and displaying the image together with the input song; And
The image selection module
If a matching image matching the input song is searched or an image matching the song number is searched and there is no image matching the image or song number matched to the song as a result of the search, A first extracting unit for recognizing data and tempo and extracting the tempo of the input song and the image data existing in a close range within a preset range from images of recognized singers; And
Extracting image data in a predetermined category when the image data extracted by the primary extracting unit does not exist,
The tempo of the song and the tempo of the song are detected and the tempo of the input song and the image in the proximity range within the predetermined range are extracted from the images of the recognized singers and the graphic pixels of the extracted image data are compared, A high priority image is classified into a FHD image, an HD image, and an SD image, a matching priority is given to a high-quality image, and an image having a priority level of more than a predetermined level is selected Image matching device.
delete delete The apparatus as claimed in claim 6, wherein the second extraction unit
And if the secondary extraction result does not exist, selects an image included in a predetermined category.
delete

Images