KR20090074573A - System and method for processing time code of karaoke - Google Patents

Abstract

A karaoke system and a time code processing method thereof are provided to reduce the data amount of time codes by applying the concept of a relative time which is not an absolute time. A karaoke system comprises: an analysis part(400) classifying audio packets and marker objects by analyzing karaoke files coded with a time code of a bit unit; an audio decoder(500) extracting the playtime of audio signals by decoding the audio packets into the audio signals; an event generator(600) generating an event corresponding to the marker; and a controller(900) indicating the result of the event synchronized with the audio signal on a display part by controlling the playtime of the audio signal and the generation time of the event.

Description

Karaoke system and its time code processing method

The present invention relates to a time code of a karaoke file, and more particularly, to a karaoke system and a time code processing method thereof for processing data of a time code using a relative time between neighboring time codes.

Karaoke is a form of public entertainment in which only the accompaniment is recorded without a song and sings along with it. The most distinctive feature of this karaoke system is that the lyrics are synchronized with music.

In such a karaoke system, various methods, such as Synchronized Multimedia Integration Language (SMIL), Flexi Interactive Interactive Presentation Synchronization (FLIPS), and SureStream, are used to store synchronization information such as time code.

In general, the time code, which plays an important role among the synchronization information of the karaoke system, is widely used for synchronization in multimedia content, and may be referred to as a sequence of numeric codes generated at regular intervals by the timing system. The time code indicates the time, in hours, minutes, seconds, and milliseconds (00: 00: 00: 000), in which events such as display and painting of lyrics occur. In addition, the time code is given to each letter constituting the lyrics so that the words synchronized with the music are painted in sequence over time.

However, the time code coded as described above has the following problems.

First, since a fixed byte for each time unit is allocated to be displayed in units of hours, minutes, seconds, and milliseconds, the data amount of the time code increases. In particular, in the case of a mobile device providing a karaoke service, this amount of time code data is very burdensome.

In addition, even when the number of letters and the number of syllables are different, as in English, a time code is provided for each letter, and thus a duplicate time code occurs. In Korean, the number of letters and the number of syllables are generally the same, whereas in English, the number of letters and the number of syllables are not the same. For example, in the case of 'apple', the number of letters, that is, the number of spellings is 5, while the number of syllables is 2 when the word 'apple' is pronounced. In this case, a time code is given every five spells, and a time code indicating the same time is generated.

Accordingly, an object of the present invention is to solve the above-described problem, and the time code is represented as a variable bit string to significantly reduce the data amount of the time code.

In addition, another object of the present invention is to delete time codes that are redundantly unnecessary by assigning time codes in syllable units in consideration of language characteristics constituting lyrics.

According to a feature of the present invention for achieving the above object, the present invention is to analyze the karaoke file coded by the time code of the bit unit and to decode the audio packet into an audio signal and an analysis unit for separating into an audio packet and a marker object An event generator for generating an event corresponding to the marker during a relative time between an audio decoder extracting a reproduction time of an audio signal and each marker in the marker object, and adjusts a reproduction time of the audio signal and an occurrence time of the event. And a controller for displaying a result of the event synchronized with the audio signal on a display unit.

The time code is inserted into the marker based on the syllable.

The time code represents a time difference between each marker as a ratio with respect to a reference time, and includes a bit string indicating the ratio in binary bit form. In this case, the bit string has a variable number of bits according to a ratio to be displayed.

In addition, the time code includes a distinguishing tag added to distinguish between the bit strings. In this case, the distinguishing tag is preferably a bit string of '100'.

On the other hand, the event generating unit is configured to include a time code decoder for decoding the time code to extract the relative time between each marker.

The time code decoder obtains the bit string by dividing a variable storage unit for storing the values of the first variable and the second variable and the time code into the distinguishing tag when decoding the respective time codes, and obtains the obtained bit string. A parsing unit that parses continuously, a determining unit that determines whether there is a parsed bit as a result of the parsing, and when the parsed bit exists as a result of the determination, storing the variable through an update formula determined according to the type of the parsed bit A calculation unit for updating the first variable and the second variable stored in the unit, and if the parsed bit is not present as a result of the determination, the first variable and the second variable stored in the variable storage unit are substituted into an expression for extracting And an extraction unit for calculating and extracting the relative time.

Herein, the update calculation equation is Equation 1 when the parsed bit is 1, and Equation 2 when the parsed bit is 0.

Second Variable = Second Variable + 1 (Equation 1)

First variable = first variable + 0.5 ^{The 2 variables} (Equation 2)

The extraction formula is as follows.

Relative time = (first variable + 0.5 ^{second 2 variables} ) * reference time (Equation 3)

In this case, the reference time may be set differently according to the song characteristic selected by the user, and the event may include an event in which the lyrics synchronized with the audio signal are painted.

The karaoke file includes an ASF file.

According to another aspect of the present invention for achieving the above object, the present invention provides a method of coding a time code that encodes a time code of a karaoke file in the form of a binary bit, and the time code encoded by the bit as a relative time between each marker. And a method of decoding a time code to be decoded.

Here, the time code is inserted into the marker on a syllable basis.

The coding method of the time code may include setting a reference time of the karaoke file, extracting a time difference between markers requiring time information from the karaoke file, converting the time difference into a ratio with respect to the reference time, and Converting the converted ratio into a variable bit string and adding a distinct tag to the end of the bit string.

In the step of converting the converted ratio into a variable bit string, the variable bit string is converted with reference to the information table in which the variable bit string is arranged one-to-one to each ratio according to a preset codeword generation rule.

On the other hand, the decoding method of the time code comprises the steps of initializing a first variable and a second variable for decoding the codeword consisting of the bit string and the distinguishing tag in a relative time, parsing the codeword and the parsing result Determining whether there is a bit parsed in the bit string, and if there is a bit parsed in the bit string, updating the first variable and the second variable according to the parsed bit and in the bit string. And if the parsed bits do not exist, obtaining the relative time through the final values of the first variable and the second variable.

When the parsed bit is 1 in the step of updating the first variable and the second variable, the first variable and the second variable are updated by applying Equation 1, and when the parsed bit is 0, the equation Apply 2 to update the first and second variables, respectively.

In the obtaining of the relative time, the relative time is obtained by applying Equation 3.

In this case, the reference time may be set differently according to the tune characteristic to be reproduced.

In addition, it is preferable to set the distinguishing tag to '100'.

In the karaoke system and the time code processing method according to the present invention configured as described above, the following effects can be obtained.

By applying the concept of relative time rather than absolute time, the amount of time code data can be greatly reduced. This facilitates the implementation of karaoke services on mobile devices.

In addition, there is an effect of minimizing the number of time codes of the karaoke file.

In addition, there is an effect of simply acquiring a time code by only adding and shifting operations.

In addition, there is an effect that it is easy to apply different composite contents to the time code.

Hereinafter, a karaoke system and a time code processing method thereof according to the present invention will be described in detail with reference to a preferred embodiment shown in the accompanying drawings.

1 illustrates a configuration of a karaoke system according to a preferred embodiment of the present invention.

Referring to FIG. 1, the present invention includes a storage unit 100 that represents a time difference between markers as a ratio with respect to a reference time, and stores a karaoke file in which the ratio is coded by a time code of a bit unit. The karaoke file is composed of a header object and a data object, and the data object includes audio data and a marker object. Thus, the karaoke file is preferably a file of an active streaming format (ASF), which is widely used recently. In addition, the storage unit 100 may include one or more storage media, and may store video files related to the karaoke file.

The time code is inserted into the marker based on a syllable and includes a bit string and a distinguishing tag. Here, when the time difference between each marker is expressed as a ratio with respect to the reference time, the bit string is expressed in binary bit form, and it is preferable to have a variable number according to the ratio to be displayed. In addition, the distinguishing tag is added to distinguish between the bit strings, and is preferably a bit string of '100'.

If a song to receive karaoke service is selected from the songs stored in the storage unit 100 through the input unit 200 for inputting at least one data and command, the retriever unit 300 corresponds to the storage unit 100. After loading the karaoke file, the header object and the data object of the karaoke file are separated. The retriever unit 300 transmits the data object to the analysis unit 400. In this case, the header object is transmitted to a header decoder (not shown), and thus description thereof will be omitted because it is not related to the present invention.

The analysis unit 400 analyzes the transmitted data object, divides the data object into an audio packet and a marker object, and transmits the data object to the audio decoder 500 and the event generator 600, respectively.

The audio decoder 500 decodes the audio packet into an audio signal and extracts a reproduction time of the audio signal.

The event generator 600 generates an event corresponding to the marker during the relative time between the markers in the marker object. In particular, the event generator 600 is configured to include a time code decoder 700 for decoding the time code to extract the relative time between each marker.

In addition, the present invention includes a control unit 900 for adjusting the playback time of the audio signal and the time at which the event occurs to display a result of the event synchronized with the audio signal on the display unit 800.

Meanwhile, the time coder decoder will be described with reference to FIG. 2.

The time code decoder 700 includes a variable storage unit 710, a parser 720, a determiner 730, an operator 740, and an extractor 750, as shown.

First, the variable storage unit 710 stores values of a first variable (hereinafter referred to as RT) and a second variable (hereinafter referred to as WFRT) when decoding each time code. The RT and WFRT continuously change their values according to a decoding operation to be described later.

The parser 720 obtains a bit string by dividing the time code through a distinguishing tag, and continuously parses the bits of the obtained bit string from the upper bits.

The determination unit 730 determines whether there is a bit parsed by the parser 720, and a subsequent process is determined according to the determination result. That is, when the parsed bit is present as a result of the determination, the decoding process of the time code is performed by the operation unit 740, whereas when the parsed bit is not present, the extraction unit 750 determines the time. The decoding process of the code proceeds.

The operation unit 740 updates the RT and the WFRT stored in the variable storage unit 710 through an update calculation formula determined according to the type of the bit. In this case, when the parsed bit is 1, the update calculation formula is as follows. When the parsed bit is 0, the update calculation formula is as follows.

WFRT = WFRT + 1

RT = RT + 0.5 ^WFRT

On the other hand, the extractor 750 extracts the relative time by substituting the RT and the WFRT stored in the variable storage unit 710 into Equation 3 below.

Relative time = (RT + 0.5 ^WFRT ) * reference time

Next, the time code processing method according to the embodiment of the present invention having the above configuration will be described in detail. For reference, a marker relating to lyrics painting closely related to the present invention and a time code assigned to the marker are described first, and then a coding and decoding method of the time code will be described.

FIG. 3 shows various markers related to lyrics painting supported by the karaoke system. Markers such as SS (Start Song), ES (End Song) and SI (Start Interbide) shown in the figure are used to notify the beginning of the song, the end of the song, and the start of the consideration. Then, when DT (Display Text) is called, letters are displayed on the screen, and when ST (Start Text) is called, the first letter shown on the screen starts to be painted. In particular, to smoothly paint the letters, each letter is divided equally into several segments. To paint this segment, SL (Start painting a Letter) is called. When EL (End Line) is called, the line of character is deleted. The unexplained Start Counter (SC) is a marker for counting the counter before the letters are painted.

 The markers are given the time code as needed. That is, in the related art, the time code is assigned to each start segment of the spelling as shown in FIG. 4 (a). However, in the present invention, the time code is assigned to the start segment of each syllable as shown in FIG. 4 (b). In this case, the time code is in the form of a binary bit rather than an hour: minute: second: millisecond. As such, since the time code is assigned to the marker in syllable units, the number of time codes of the karaoke file is minimized.

5 shows a method of coding a time code for encoding the time code in binary bit form.

As shown in FIG. 5, a reference time of the karaoke file is set (S100). In this case, the reference time is preferably set to a period of two-minute, four-minute, and eighth notes used mainly in music so as to reduce the data amount of the time code. As such, when the reference time is set as the period of the notes, the ratio with respect to the reference time can be expressed more simply, and thus the data amount of the time code can be reduced.

Next, a time difference between markers for which time information is required is extracted (S110). Here, when the time information is given to the markers, the painting time of the letters forming one syllable is the same, and therefore, time information is preferably given to the first marker of the syllable. If the absolute time of two neighboring markers is 02: 34: 40: 2000 and 02: 34: 40: 0000, respectively, the time difference between the markers is 2000 milliseconds.

Then, the time difference between the extracted markers, that is, the relative time is converted into a ratio with respect to the reference time (S120). If the time difference between the markers is 2000 milliseconds and the reference time is set to 1000 milliseconds as in the above example, the ratio to the reference time is 2.

Then, the ratio of the converted reference time is converted back into a variable bit string (S130). At this time, it is preferable to switch with reference to the information table in which the bit strings are arranged to match one-to-one to each ratio according to a preset codeword generation rule. The information table is shown in Table 1, and when the bit string of the above example is obtained, the bit string is '0' because the ratio of the converted reference time is 2.

ratio Bit string + distinct tag Bit length 1/2 1 + 100 4 1/4 11 + 100 5 1/8 111 + 100 6 One 'none' + 100 3 2 0 + 100 4 3 00 + 100 5 3/4 101 + 100 6 5/8 1011 + 100 7 33/16 001111 + 100 9

Finally, a distinguishing tag is added at the end of the bit string (S140). The distinguishing tag must consist of a unique sequence to distinguish each bit string. Therefore, the bit string '100' may be used as the distinguishing tag, considering that the continuous bit '0' is never generated after the bit '1' due to the nature of the codeword generation rule. For reference, the bit string and the distinguishing tag are sequentially listed as codewords.

Hereinafter, a method of decoding a time code that decodes a bit coded time code into a relative time between events according to lyrics painting will be described with reference to FIG. 6. For convenience of description, it is assumed that the bit string excluding the distinguishing tag in the codeword is '1011'.

First, prior to decoding the time code through the time code decoder 700, the karaoke file selected according to the command input to the input unit 200 is loaded from the storage unit 100 to the retriever unit 300. The data object of the loaded karaoke file is transmitted to the analysis unit 400 by the retriever unit 300. The analyzer 400 analyzes the data object and divides the data object into an audio packet and a marker object, and the marker object is transmitted to the time code decoder 700, and the codeword with various markers in the marker object Included.

In this state, when the codeword including the bit string is input to the time code decoder 700, the variable storage unit 710 initializes the values of the RT and the WFRT (S200). In this case, the RT and WFRT preferably has a value of 0, respectively.

After the initialization, the parser 720 parses the codeword including the bit string (S210). In this example, the first parsed bit is '1'.

Then, the determination unit 730 determines the existence of the bits parsed in the bit string (S220). In this case, the determination unit 730 distinguishes a plurality of codewords using the distinguishing tag, and determines a bit string excluding the distinguishing tag from one codeword as the bit string.

As a result of the determination, when there are bits parsed from the bit string, the operation unit 740 classifies the types of the parsed bits and applies different calculation expressions accordingly (S230). If the parsed bit is '1' as in the above example, the operation unit 740 updates the WFRT stored in the variable storage unit 710 through Equation 1 (S240). That is, the calculator 740 updates the WFRT from an initial value of 0 to 1. The parser 720 then parses the next bit.

Since the next bit of the assumed bit string is '0' for convenience of description, the operation unit 740 updates the RT stored in the variable storage unit 710 through Equation 2 (S242). That is, the calculator 740 updates the RT from 0 to 1/2. The parser 720 then parses the next bit.

Thereafter, the operation unit 740 updates the WFRT from 1 to 2 by an operation of the third parsed bit '1', and updates the WFRT from 2 to 3 by an operation of the fourth parsed bit '1'. Let's do it.

Thereafter, when there is no bit parsed from the bit string, the extractor 750 obtains a relative time by substituting RT and WFRT stored in the variable storage unit 710 in Equation 3 (S250). In the above example, since the values of RT and WFRT finally stored in the variable storage unit 710 are 1/2 and 3, respectively, the relative time becomes (5/8 * reference time). When the relative time is obtained, the variable storage unit 710 initializes the RT and the WFRT to parse the next codeword.

As described above, after the time code is decoded by the time coder decoder to obtain a relative time, the event generator 600 refers to the time information transmitted from the audio decoder 500 to detect an event corresponding to the marker. Generated and run for the relative time.

Then, the controller 900 displays the painting result of the lyrics synchronized with the audio signal on the display unit 800.

Although described with reference to the illustrated embodiment of the present invention as described above, this is merely exemplary, those skilled in the art to which the present invention pertains various modifications without departing from the spirit and scope of the present invention. It will be apparent that other embodiments may be modified and equivalent. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

1 is a block diagram of a karaoke system according to a preferred embodiment of the present invention.

2 is a block diagram of a time code decoder of FIG. 1;

3 is an application example of a marker associated with the housework painting supported by the karaoke system.

4 is a comparison diagram for explaining a method of minimizing the number of time codes.

5 is a coding sequence diagram of a time code for a preferred embodiment of the present invention.

6 is a flowchart illustrating decoding of a time code for a preferred embodiment of the present invention.

* Description of the symbols for the main parts of the drawings *

100: storage unit 200: input unit

300: Retriever 400: Analysis

500: audio decoder 600: event generator

700: time code decoder 710: variable storage unit

720: Parsing unit 730: Determination unit

740: calculation unit 750: extraction unit

800 display unit 900 control unit

Claims (22)

An analysis unit for analyzing a karaoke file coded with a time code of a bit unit and classifying the karaoke file into an audio packet and a marker object; An audio decoder for decoding the audio packet into an audio signal and extracting a reproduction time of the audio signal; An event generator for generating an event corresponding to the marker during a relative time between the markers in the marker object; And a controller configured to adjust a reproduction time of the audio signal and an occurrence time of the event to display a result of the event synchronized with the audio signal on a display unit. The method of claim 1, The time code is, Karaoke system, characterized in that inserted into the marker based on the syllable. The method of claim 2, The time code is, Karaoke system, characterized in that it comprises a bit string representing the time difference between each marker as a ratio to the reference time, the ratio in the form of binary bits. The method of claim 3, wherein The bit string is, Karaoke system characterized by having a variable number of bits according to the ratio to be displayed. The method of claim 2, The time code is, And a distinguishing tag added to distinguish between the bit strings. The method of claim 5, The distinguishing tag is Karaoke system characterized in that the bit string of '100'. The method according to claim 4 or 6, The event generator, And a time code decoder to decode the time code to extract the relative time between each marker. The method of claim 7, wherein The time code decoder, A variable storage unit for storing values of a first variable and a second variable when decoding each time code; A parsing unit for dividing the time code into the distinguishing tag to obtain the bit string and to continuously parse the obtained bit string; A determination unit which determines whether there is a parsed bit as a result of the parsing; An operation unit for updating the first variable and the second variable stored in the variable storage unit through an update calculation formula determined according to the type of the parsed bit when the parsed bit exists as a result of the determination; And an extracting unit extracting the relative time by substituting the first variable and the second variable stored in the variable storage unit into an expression for extracting when the parsed bit does not exist. Featuring a karaoke system. The method of claim 8, The update calculation formula, When the parsed bit is 1, it is applied by the following equation 1, If the parsed bit is 0, the karaoke system, characterized in that applied by the following equation 2. Second Variable = Second Variable + 1 ----- (Equation 1) First variable = first variable + 0.5 ^{The 2 variables} ------ (Equation 2) The method of claim 9, The calculation formula for the extraction is that Featuring a karaoke system. Relative time = (first variable + 0.5 ^{second 2 variables} ) * Reference time ----- (Equation 3) The method of claim 10, The reference time is, Karaoke system, characterized in that can be set differently according to the characteristics of the song selected by the user. The method of claim 7, wherein The event, And an event where the lyrics synchronized with the audio signal are painted. The method of claim 1, The karaoke file, Karaoke system characterized by including the ASF file. A time code coding method for encoding the time code of the karaoke file in binary bit form; And a time code decoding method for decoding the time coded by the bit into the relative time between the markers. The method of claim 14, The time code processing method of the karaoke system, characterized in that the time code is inserted into the marker on the basis of the syllable. The method of claim 14, The coding method of the time code is, Setting a reference time of the karaoke file; Extracting a time difference between markers requiring time information from the karaoke file; Converting the time difference into a ratio relative to the reference time; Converting the converted ratio into a variable bit string; Adding a distinguishing tag to the end of the bit string; wherein the time tag processing method of the karaoke system comprises a. The method of claim 16, Converting the converted ratio into a variable bit string, And a variable bit string is converted with reference to an information table arranged so that one-to-one matching of each ratio is performed according to a preset codeword generation rule. The method of claim 14, The decoding method of the time code, Initializing a first variable and a second variable for decoding the codeword consisting of the bit string and the distinguishing tag in relative time; Parsing the codeword; Determining whether there is a bit parsed from the bit string as a result of the parsing; If there are bits parsed in the bit string, updating the first variable and the second variable according to the parsed bits; And if the bits parsed in the bit string do not exist, obtaining the relative time through the final value of the first variable and the second variable. 2. The method of claim 18, In the updating of the first variable and the second variable, When the parsed bit is 1, the first variable and the second variable are updated by applying Equation 1 below. And when the parsed bit is 0, applying the following Equation 2 to update the first variable and the second variable, respectively. Second Variable = Second Variable + 1 ----- (Equation 1) First variable = first variable + 0.5 ^{The 2 variables} ----- (Equation 2) The method of claim 18, In acquiring the relative time, Apply the following relative time to the relative time Time code processing method of a karaoke system, characterized in that obtained. Relative time = (first variable + 0.5 ^{second 2 variables} ) * Reference time ----- (Equation 3) The method of claim 16 or 18, And the reference time can be set differently according to the characteristics of a music to be played. The method of claim 21, And the distinguishing tag is set to '100'.

Images