KR100625212B1 - Text information service method for multimedia contents - Google Patents

Abstract

The present invention relates to a text information providing system for multimedia contents. In particular, when using time information of an audio file in a conventional lyrics information providing system, the time may be different and there may be no time information. It was difficult and uncomfortable because the text representation was not synchronized according to the LCD size of the user's device. In order to solve this problem, the present invention is to detect the actual sound source size and bit rate instead of the time information, and to use the device information as search information to serve text information that is accurate to the audio sound source and matches the display device. To this end, the present invention constructs a database of song names, singers, sound source sizes, and bitrates of audio files to be searched, and text information for synchronizing device information for playing audio files with each audio file using key values. The user terminal generates a song name, a singer, a sound source size and a bit rate, and device information as search information, and retrieves and downloads the text information from the text information web service server and inserts and stores the text information into an audio file. The link control program is installed and configured.

Music, MP3, Lyrics, Web Service, Sound Source Size, Device Information, LCD

Description

Text information service method and multimedia contents of multimedia contents             

1 is a block diagram of a text information service system for multimedia content according to the present invention;

2 is a block diagram of a text search and link control program of a user terminal according to the present invention;

3 is a flowchart illustrating a text information service method of multimedia contents according to the present invention.

<Description of the symbols for the main parts of the drawings>

10: user terminal 20: text information web service server

30: text information database server

40: MP3 Player

 The present invention relates to a system and method for providing text information of multimedia contents, and more particularly, to multimedia text contents which are edited according to the display size of a user's terminal and synchronized with the actual length of a sound source of an audio file. A text information providing system and method.

In case of digital audio file service among multimedia contents service, when music comes out from PC web browser through streaming service or streaming service, search lyrics DB separately and buffer the lyrics to express lyrics by time information as music is played. It provides a service, but it also has a limitation that it is available only on a PC, and in the case of a download music file, only a sound source (music) is serviced, so the user manually adjusts the music + lyrics through the editing program for the PC. The lyrics can be created as a single file, or the lyrics DB, which has been previously synced, is searched for and combined with the lyrics synced with the music, and then the device (e.g. MP3 player, PDA, mobile phone, etc.). ) To download the text and listen to the music (text) is configured.

However, the method of manually synchronizing the lyrics to the music as described above is difficult and difficult for the general public to use, even if the lyrics are synchronized (sync) through the lyrics service due to differences in the user's music and time There is a difficulty to be motivated or to double the manual work.

The process of finding information about the music on the computer and searching the lyrics and text for the song from the DB of the server is possible only if the information of the music to be found has the correct value.

Generally, if you bring the lyrics and text information corresponding to the song by using the artist name and the song title extracted from the tag, find the exact lyrics and text data because the lyrics and text information are stored differently according to the time information. it's difficult.

The conventional technique for this part is a case of bringing lyrics and text information from a DB of a server composed of data of a singer's name, song title, and time information by giving time information to information extracted from a tag. In this case, when the time information is not included in the tag part, the correct lyrics and text information cannot be brought, and after several times of exchange of information, the lyrics and text information of the adjacent time zone can be obtained.

Also, even in the case of an audio file in which time information is included in the tag portion, the time information is inserted before or after the sound source file because most of the time information is calculated and inserted into the time information when the sound source file is produced. If the length of the header part, tag part, or additional information insertion part is included, it cannot be guaranteed that the length exactly matches the length of the sound source. There may be cases where there is a mismatch.

In addition, how to express the lyrics and text information found through the web service in the above manner to the user will be a key. Your computer and mobile devices (MP3 players, PDAs, mobile phones, etc.) have LCD screens that can display lyrics and text. The screens are unique, depending on the specifications of the device, because of the design and cost of the device, many manufacturers use various LCDs.

In this case, the lyrics and text DB in the server is limited, and the user can download the data to the PC and display the lyrics and text according to the LCD size of the user's device. You can edit the resulting lyrics DATA.

If the device has 16-character, 3-line LCD (24-character Korean), the data downloaded from the server's lyrics and text DB can be configured in a form that can be expressed on the LCD 3 * 16 that the user has. The TEXT character should be configured to be displayed without being broken or deleted.

Likewise, if the user LCD has 2 * 16 (expressed in 16 characters), it should be possible to compose it as shown above.

The conventional technology for this part downloads the lyrics and text data produced only to a fixed arbitrary LCD size without considering the user's LCD size to the user's PC, and then re-edits the lyrics and text to fit the device. If you use it without re-editing, the test displayed on the LCD may not be synchronized with the sound source, and if it is different from the fixed LCD size during text input, the content may not be displayed at the correct time.

The present invention is to overcome the conventional problems as described above, instead of the time information included in the tag to configure the DB with information on the length of the sound source and the bandwidth (bit rate) of the sound source and the desired lyrics from the lyrics DB configured in the server and Provided are a method and a system for providing a multimedia content text information service for finding and linking text information.

Another object of the present invention is to provide a text information service method and a system for providing synchronized text information corresponding to a digital audio file according to a displayable LCD size in real time through LCD windows of different devices.

The object of the present invention as such,

A text information web service server for serving text information of an audio file requested to be searched through the web; In the text information providing system of the multimedia content comprising a user terminal for synchronizing the text information to the audio file to download the text information online to the service server,

The text information web service server includes text information for synchronizing each audio file with a key value of a song name, a singer, a size and a bit rate of an audio file to be searched, and a display information of a terminal for playing an audio file. And a database configured to store one line character and one line at the time of playing an audio file differently based on the display information.

In the user terminal,

An audio file search control module for selecting an audio file for searching text information and transmitting the search information to download the text information from the service server;

A sound source information detection module detecting a sound source size and bit rate of an audio file for searching for text information;

A display information setting module for automatically or manually setting display information of reproduction terminal information for use by a user for reproduction of a digital audio file;

A search information generation module for generating music name and artist information detected from tag definitions of an audio file for text information search, sound source information of the sound source information detection module, and display information of the display information setting module as search information;

And a text retrieval and link control program including a text synchronization module for retrieving and downloading the text information downloaded from the web service server into a corresponding audio file and resave it as an audio file containing the synchronized text information. It is done.

Meanwhile, in the method of downloading text information through a web service and inserting text information in synchronization with an audio file,

Selecting an audio file to search for text information;

Detecting a sound source section size and bit rate information of the selected audio file;

Setting display information of a playback terminal to play back the audio file;

Song name and singer information is detected from tag information of the selected audio file, and the song name and singer information, the sound source size, bit rate and display information of the playback terminal are generated as search information, and the text information of the audio file is recorded on the web. Transmitting to the serviced text information web service server;

And when the text information matching the search information is retrieved from the text information web service server, downloading and inserting the downloaded text information into the audio file and restoring it into an audio file including synchronized text information. It features.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a text information providing system for multimedia content according to the present invention.

The user terminal 10 is connected to the service server 20 through the wired / wireless Internet and retrieves the text information, and the text information is searched by the search information of the audio file requested from the user terminals 10 through the web. It is composed of a text information web service server 20 to search and provide from the database server (30).

The user terminal 10 includes a wireless internet enabled terminal such as a mobile phone or a PDA, and a PC capable of wired internet. The mobile phone or PDA is a direct playback device for digital audio files, and the PC may be a playback terminal. An MP3 player 40 or the like dedicated to playback only by downloading an audio file from a PC connected to the PC can be used as a playback terminal.

According to the present invention, in the general text information retrieval system as described above, the format of the text information stored in the database server 40 includes the song name, singer, size and bit rate of the audio file to be retrieved, Text information for synchronizing each audio file with the display information of the terminal for playing the audio file as a key value is stored in the database server 30, and on the basis of the display information, one line character and line number are displayed. Set up differently to build a database server (30).

A text search and link control program that loads and selects an audio file to search for text information, generates search information, transmits the search information to the server, downloads the text information, synchronizes it with a music file, and inserts the text information. Install and configure

2 is a block diagram of a text search and link control program of a user terminal according to the present invention.

An audio file search control module 11 which selects an audio file for searching text information, transmits the search information and downloads the text information from the service server, and a sound source size and bit rate of the audio file for searching text information. A sound source information detection module 12 for detecting a signal, a display information setting module 13 for automatically or manually setting display information of playback terminal information for use by a user for playback of a digital audio file, and text information search. A search information generation module 14 for generating, as search information, song names and artist information detected from tag definitions of audio files for the audio file, sound source information of the sound source information detection module, and display information of the display information setting module; The text information retrieved from the web service server is downloaded. Comprises a text synchronization module 15 to re-stored in the audio file containing the text information are synchronized by inserting the audio file.

3 is a flowchart illustrating a text information service method of multimedia contents according to the present invention.

As shown here,

Meanwhile, in the method of downloading text information through a web service and inserting text information in synchronization with an audio file,

Selecting an audio file for which text information is to be searched for (S10), detecting a sound source section size and bit rate information of the selected audio file (S20), and displaying a playback terminal for reproducing the corresponding audio file Setting information (S30), detecting a song name and singer information from tag information of the selected audio file, and using the song name and singer information, the sound source size, bit rate and display information of the reproduction terminal as search information; Generating and transmitting text information of the audio file to a text information web service server for web service (S40), and when text information matching the search information is found from the text information web service server, the text information is downloaded and downloaded into the audio file. Audio with synchronized text information by inserting downloaded text information It comprises the step (S50) of re-stored as a file.

The main feature of the present invention configured as described above is, firstly, as a condition for searching text information, instead of time information of the audio file, sound source information of the audio file is directly detected and the sound source information is used. Second, the device information for displaying text information, that is, display information is automatically extracted and set, and the text information is searched using the display information.

The user file can contain not only music information but also various information such as artist name, song title and album information. The above information is usually stored in the information insertion space called TAG, and the recorded contents are expressed through the play software (S / W) of the PC or the LCD of the product, and the playback time can be known in this manner.

In the existing method of searching the lyrics information (TEXT) from the music selected by the user, the synchronized lyrics information from the server was downloaded to the detection device using the TAG information and the time information of the music selected by the user and displayed on the LCD. .

The problem occurs when there is no TAG information or the time information is different or the user modifies the time information of the TAG according to the search condition. do.

In order to overcome such a search error, in the present invention, when the information contained in the TAG information among search information for the artist name, title, and time brought from the TAG information is used, the artist name and song title are used and the header of the audio digital sound source is used. The remaining part except the additional information including the part and tag information is regarded as the length of the sound source, and the length of each sound source is extracted by converting the bit rate extracted from the header part. That is, in the case of standardized audio digital sound source, the remaining part except the header part and other additional information part including tag information is regarded as the length of the sound source, and the length and information of each sound source are converted by converting the bit rate extracted from the header part. How to extract?

On the other hand, how to find the sync lyrics and text information that the user wants to be configured for their LCD (product),

ex) Select the artist name, song title in PC-> Music folder, time (time is determined by the length and bandwidth of the sound source) and device information (LCD information, which is the device's display). Is automatically set up to match the LCD expression line or text embroidery.) Is automatically set and transmitted as search information.

If your MP3 device is EMP-200, the LCD size of your MP3 device can display TEXT in 3 LINEs, so in SYNC DATA (Internet DB), find the lyrics for 3 lines to your PC. You can download it.

If the user does not have the lyrics information of the LCD information he / she wants, find the lyrics in the DB, download them to the user's PC, and redeploy the downloaded SYNC DATA in the PC program according to the LCD of the user device. At this time, if the LCD of user's device is composed of 4 lines, the lyrics are automatically readjusted to fit the user's LCD to correct the information and insert the lyrics into the digital data.

Even if the synchronized information of the same song is created, the lyrics automation information created by the user may be different according to the Editer.

Ex) Synchronized text data, which is implemented to display 16 characters of 2 * 16 sized Korean characters with 2 lines of LCD information at one time on the LCD, is displayed on the LCD by 3 lines. Even in the 24-character representation, only 16 characters can be represented and the rest can be left as a space process, or random text is extracted from the 16 characters of the next SYNC text information. It is also possible to automatically reestablish sync information to represent characters = 24 characters. However, there is a difficulty in making accurate information at this time. Therefore, in the database where the user configured for LCD, the user can get accurate synchronized data in the previous way without re-establishing the sync information when another user requests the same information in the future. have.

By this method, the database server 30 of the present invention includes text information synchronized with the sound source and synchronized with the LCD size according to the song name, singer, sound source size and bandwidth (bit rate), and device information (display information). Build as a database.

When the user receives the text information web service using a PC or a mobile phone, the user can receive the search and download service from the text information web service server 20 by the text search and link control program. First, a process of selecting an audio file is performed (S10), which is controlled by the audio file retrieval control module 13 to open a list of audio files stored in the user terminal 10 and to display text information in the list. Select the audio file you want to search.

Subsequently, the sound source information detection process S20 of the audio file is performed, which is controlled by the sound source mumbo detection module 11, except for the header portion, the tag portion, and other additional information portions of the selected audio file. The length (size) of the information and the bit rate (bandwidth) information are detected. This is to detect the length information of the sound source by converting the bandwidth extracted from the header unit.

Then, the process of setting the display information of the device for playing the audio file (S30) is performed by the control of the display information setting module 12. The display information of the device is to change the text information synchronized according to the LCD size. When using the PC as a user terminal, when the MP3 player 40 is connected to the PC, the device information is automatically recognized by the PC. Then, the LCD information can be known by the device information. In other words, when constructing a database, text information synchronized with device information is formatted. If a separate device is connected to a PC, the device information is detected. If no separate device is currently connected to the PC, the previously set device information is set as the default value. In addition, mobile phone or PDA can set their own device information when receiving the initial search service and use this as the default value.

If the device information cannot be recognized, the user selects and sets the most similar type of display information.

When the audio file is selected and sound source information is detected as described above, and the device information is set, after generating search information, a search process of searching and downloading the corresponding text information from the text information web service server 20 (S40). This generates the song name, singer, the sound source information, and the device information of the audio file selected by the search information generation module 13 as search information. The generated search information is transmitted from the audio file search control module 12 to the text information web service server 20 and from the database server 30 by the corresponding key value in the text information web service server 20. Retrieve text information. It displays the searched information, displays the corresponding information if there is a matched text information, and provides a searched list if there is no matched information so that similar text information can be selected and downloaded even if the service is not completely synchronized data. do.

When the text information is searched and downloaded as described above, the text information is automatically inserted into the selected audio file and the text information is automatically stored as a synchronized audio file (S50). By the control of the module 14.

As described in detail above, according to the present invention, a user is composed of search data including a singer, a title (song name), a sound source size, a bandwidth (bit rate), and device information (display information), and gives detection information to a server DB. Reconstruction of detected lyrics and text data due to LCD information of the user can download the desired lyrics and text data directly to the device without the need to see the desired lyrics and text through the user's device LCD have.

In addition, you do not need to edit lyrics or text data on the user's computer or reorganize the music and lyrics into a single file and download them directly to the user's device (eg, MP3 player) connected by USB or communication module. It is possible to use, so that the user has unnecessary programs or double-checked modules are integrated into one.

Claims (3)

A text information web service server for serving text information of an audio file requested to be searched through the web; In the text information providing system of the multimedia content consisting of a user terminal that is connected to the service server online to download the text information, and synchronizes the text information to the audio file, The text information web service server may include a database including song names, singers, sound source sizes, and bitrates of audio files to be searched, and text information for synchronizing device information for reproducing the audio file with the key information. To build, The user terminal automatically detects the size and bit rate of the sound source of the audio file, sets device information for reproducing the audio file, generates a song name, singer, sound source size and bit rate, and device information as search information. And a text search and link control program for accessing the text information web service server online to search and download the text information of the corresponding audio file, and inserting and storing the text information in the audio file. . The text search and link control program installed in the user terminal, An audio file search control module for selecting an audio file for searching text information and transmitting the search information to download the text information from the service server; A sound source information detection module detecting a sound source size and bit rate of an audio file for searching for text information; A display information setting module for automatically or manually setting display information of reproduction terminal information for use by a user for reproduction of a digital audio file; A search information generation module for generating music name and artist information detected from tag definitions of an audio file for text information search, sound source information of the sound source information detection module, and display information of the display information setting module as search information; And a text synchronization module which inserts the text information downloaded from the web service server into a corresponding audio file and restores the text information as an audio file including the synchronized text information. In a method of downloading text information through a web service and inserting text information in synchronization with an audio file, The database of the text information web service server includes a song name, a singer, a size and a bit rate of an audio file to be searched, and text information for synchronizing each audio file with a device value for reproducing the audio file. Built to provide web services by storing as The user terminal, Selecting an audio file to search for text information; Detecting a sound source section size and bit rate information of the selected audio file; Setting display information of a playback terminal to play back the audio file; Song name and singer information is detected from tag information of the selected audio file, and the song name and singer information, the sound source size, bit rate and display information of the playback terminal are generated as search information, and the text information of the audio file is recorded on the web. Transmitting to the serviced text information web service server; And when the text information matching the search information is retrieved from the text information web service server, downloading and inserting the downloaded text information into the audio file and restoring it into an audio file including synchronized text information. Characterized by the text information providing method of the multimedia content.

Images