KR20060114895A - Computer recordable medium recording data file for sound/image syncronization and method for inserting image data sample into audio file - Google Patents

Abstract

A computer-recordable recording medium in which a data file for music/image tuning is recorded and a method for inserting an image data sample into an audio file are provided to insert a video data string distinguished from an audio data string by a tag and include various data specification information and process information in a tag data string to easily analyze and process a data file irrespective of a kind of an audio/video tuning device when a multimedia data reproducing apparatus like a mobile communication terminal has the audio/video tuning device. A recording medium includes an audio data string(A), a tag data string(B), and an image data string(C). The audio data string(A) is decoded with a certain format. The tag data string(B) is located following the audio data string(A). The tag data string(B) includes name information of an image tag, size information of the image tag, synchronization period information of an image data sample, and image header information. The image data string(C) is located following the tag data string(B). The image data samples are successively located in the image data string(C).

Description

Computer recordable medium recording data file for sound / image syncronization and method for inserting image data sample into audio file }

1 is a diagram showing a data structure of a computer-readable recording medium on which a music / image tuning data file is recorded according to an embodiment of the present invention.

2 is a block diagram schematically showing the components of an audio / video synchronizing apparatus having a computer-readable recording medium having recorded thereon a music / image tuning data file according to an embodiment of the present invention;

3 is a diagram illustrating a form in which image data samples are matched with expression characteristic grade information of PCM data by information of a tag data string according to an exemplary embodiment of the present invention.

4 is a flowchart illustrating a method of inserting an image data sample into an audio file according to an embodiment of the present invention.

<Explanation of symbols for main parts of drawing>

A: Audio data string B: Tag data string

B1: Tag name of image data sample B2: Tag size of image data sample

B3: Sync cycle of image data samples B4: Image header information

b1: number of image data samples b2: format of image data samples

b3: Size of image data sample b4: Resolution of image data sample

C: image data string

The present invention relates to a data file for music / image tuning used on an audio / video synchronizing apparatus provided in a multimedia data reproducing apparatus such as a mobile communication terminal.

At present, personal handheld devices such as mobile phones, PDAs (Personal Digital Assistants), smart phones, etc. are recognized as essential living devices in the real world, and in addition to basic communication functions, such personal handheld devices include e-mail functions, game functions, and camera photography It provides various functions such as function, voice recording function, music playback function, still image or video playback function.

In particular, recently, a personal portable terminal product has been developed that provides a function of displaying a predetermined image as the music is played as well as a music playback function such as an MP-1 (MPEG-1 Audio Layer 3) player. As the music is played, a technology of synchronizing and displaying images corresponding thereto is used.

Conventionally, in order to extract the characteristics of the music mainly uses the wave waveform of the music, for reference, domestic patent application No. As described in 2002-0023140, techniques for synchronizing multiple images and music using a maximum wave pitch value per frame in a digital audio device have been proposed.

In addition, domestic patent application No. Referring to 2003-0084428, a technique of extracting a PCM level of music and indexing an image according to a set section to display a synchronized image with the playing music has been proposed.

However, according to the known technologies, the function and configuration of the audio / video synchronization device are described in detail on the mobile communication terminal, but the configuration and function of the data file processed by the audio / video synchronization device are not specifically mentioned. It is not.

In particular, the configuration and function of the audio / video synchronization device may be differentiated according to the type of information included in the music / image tuning data file, the recording form of the information, the recording position, and the like. In order to efficiently use the hardware resources of the mobile communication terminal equipped with the need to specialize the configuration and function of the data file for music / image tuning.

Therefore, there is a need to improve the structure and function of the music / image tuning data file to minimize the burden of computation and to efficiently use the storage space while naturally synchronizing and reproducing music and images.

Accordingly, in the present invention, when a multimedia data reproducing apparatus such as a mobile communication terminal is provided with a basic audio / video synchronizing apparatus, the data file can be easily distinguished from the audio data sequence by a tag so as to easily analyze and process the data file. A video data string is inserted, and a tag data string is provided with various data specification information and processing information, and an object thereof is to provide a recording medium on which a standardized music / image tuning data file is recorded.

In addition, the present invention allows the user to directly select the image data to be used as a synchronization sample and input a variety of information on the personal computer and an external device, and the image data sample to record the various information in an accessible data structure to the audio file Another object is to provide a method of insertion.

In order to achieve the above object, the computer-readable recording medium on which the music / image tuning data file according to the present invention is recorded, analyzes the expression characteristics of the reproduced audio data, and analyzes the expression characteristics of the analyzed expression characteristics. And a recording medium for recording the audio data and the image data sample included in the audio / video synchronizing apparatus for selecting and outputting the image data samples and sequentially synchronizing the selected image data samples with the audio data. Decoded audio data strings; A tag data string positioned after the audio data string and including name information of an image tag, size information of the image tag, synchronization period information of the image data sample, and image header information; And an image data sequence positioned after the tag data sequence and in which the image data samples are sequentially located.

Further, the image header information of the computer-readable recording medium on which the music / image tuning data file according to the present invention is recorded may include the format information of the image data sample, the size information of the image data sample, and the image data sample. At least one information from the number information, the resolution information of the image data sample is characterized in that it comprises.

The image header information of the computer-readable recording medium on which the music / image tuning data file according to the present invention is recorded includes the size information of the image data sample and the number information of the image data sample. The number information of the data samples and the size information of the data samples are used by the audio / video synchronization device to number the image data samples, so that the image data samples match the grade information of the expression characteristic.

In addition, the synchronization period information of the image data samples of the computer-readable recording medium on which the music / image tuning data file according to the present invention is recorded, the audio / video synchronizing apparatus expresses the expression characteristics of the reproduced audio data. Characterized in that it is used as a cycle to analyze.

In addition, the synchronization period information of the image data samples of the computer-readable recording medium on which the music / image tuning data file according to the present invention is recorded is recorded as a value of " 0 " Characterized in that only data is reproduced.

In order to achieve the above object, the method of inserting an image data sample according to the present invention into an audio file comprises analyzing the expression characteristics of the reproduced audio data and selecting the image data samples based on the grade information of the analyzed expression characteristics. And a method for producing an audio file for use in an audio / video synchronization device for sequentially outputting selected image data samples in synchronization with audio data, the method comprising: recording an audio data string decoded in a predetermined format; Recording a tag data string including name information of an image tag, size information of the image tag, synchronization period information of the image data sample, and image header information; And sequentially recording the image data samples.

The recording of the tag data string of the method of inserting an image data sample into an audio file may include: format information of the image data sample, size information of the image data sample, and number information of the image data sample. And the image header information including at least one of the resolution information of the image data sample is recorded.

Hereinafter, a computer-readable recording medium on which a music / image tuning data file is recorded and a method of inserting an image data sample into an audio file will be described in detail with reference to the accompanying drawings.

1 is a diagram showing a data structure of a computer-readable recording medium having recorded thereon a music / image tuning data file according to an embodiment of the present invention.

A computer-readable recording medium having recorded thereon a music / image tuning data file according to an embodiment of the present invention relates to a recording medium on which an audio file provided in an audio / video synchronization device is recorded.

The audio / video synchronizing apparatus analyzes the expression characteristics of the reproduced audio data, selects image data samples based on the grade information of the analyzed expression characteristics, and sequentially outputs each of the selected image data samples in synchronization with the audio data. As a device, a detailed description thereof will be described later with reference to FIG. 2.

1, a music / image tuning data file recorded on a computer-readable recording medium according to an embodiment of the present invention is largely divided into an audio data string (A), a tag data string (B), and an image data string (C). It is configured to include).

The audio data string A is composed of audio data decoded in a predetermined format, for example, "wav (wave file)", "wma (windows media audio)", "mp3 (mpeg audio layer-3)", " Audio formats such as ogg (compressed music files with VBR support) "and" mid (SMF files) "can be used.

That is, the audio data string A refers to a data area corresponding to a general audio file, and the tag data string B and the image data string C are further inserted to allow music / image tuning data according to the present invention. The file may be functional in the audio / image synchronizing device.

The tag data string B is positioned next to the audio data string A to distinguish the audio data string A from the image data string C and includes various additional information.

The tag data string B includes name information B1 of an image tag, size information B2 of the image tag, synchronization period information B3 of the image data sample, and image header information B4. The image header information B4 is composed of the number information b1 of the image data samples, the format information b2 of the image data samples, the size information b3 of the image data samples, and the resolution information b4 of the image data samples.

Further, the image data string C is positioned after the tag data string B, and image data samples are sequentially recorded.

Hereinafter, the audio data sequence A, the tag data sequence B, and the image data sequence C are processed by processing the music / image tuning data file according to the present invention on the audio / video synchronization apparatus. And the function will be described.

2 is a block diagram schematically illustrating the components of an audio / video synchronizing apparatus 100 having a computer-readable recording medium having recorded thereon a music / image tuning data file according to an embodiment of the present invention.

Referring to FIG. 2, the audio / video synchronization apparatus 100 includes a storage unit 110, a decoding unit 120, an audio output unit 130, a representation characteristic analyzing unit 140, a tuning unit 160, and an image output unit. It comprises a means 180, a first memory 150 and a second memory 170.

First, when the image output means 180 transmits a series of image data samples C to the reproduction of the music file from the synchronization means 160 (this will be described in "synchronization means 160"). The transferred image data sample (C) is displayed in real time.

The storage means 110 stores a data file for music / image tuning according to the present invention.

When the music / image tuning data file is selected, the decoding means 120 accesses audio data constituting the audio data string A from the storage means 110 on a frame-by-frame basis, and decodes (decodes) the PCM ( Pulse Code Modulation) data. The PCM method is a method of quantizing a frequency waveform of a music signal and expressing its amplitude value in binary. Usually, it is used for recording and reproducing digital music data by sampling at 44.1 KHz and 16-bit quantization method.

The audio output unit 130 receives the PCM data from the decoding unit 120, converts the PCM data into an analog signal, and outputs the analog signal through the speaker (or earphone).

As the decoding unit 120 operates, the synchronization means 160 distinguishes the image data string C by the tag data string B, and stores the image data samples constituting the image data string C in a second memory. Copy to 170 and record.

At this time, the synchronizing means 160 identifies the tag data string B by the name information B1 of the image tag of the tag data string B, and the image data string by the size information B2 of the image tag. Find the starting position of (C).

In addition, the synchronizing means 160 synchronizes the audio data and the sample of the image data by a predetermined time unit (for example, 0.5 second or 1 second unit) by the synchronization period information B3 of the image data sample. B3 is transmitted to the expression characteristic analyzing means 140, and the expression characteristic analyzing means 140 analyzes the expression characteristic of the audio data by the predetermined time unit to generate grade information.

Therefore, the expression characteristic grade information of the audio data is generated by the synchronization period information B3 of the image data sample, and the image data sample C according to the grade information can be selected and synchronized.

For reference, in the case where the synchronization period information B3 of the image data sample is recorded with the value " 0 ", the expression characteristic analyzing means 140 and the synchronization means 160 are not operated, so that only the audio data A is reproduced. do.

The expression characteristic analyzing unit 140 receives the PCM data from the decoding unit 120 and stores the PCM data in the first memory 150 in units of data according to synchronization period information. The frequency value is analyzed and the grade (for example, steps 1 to 10) set for each sound pressure section is given.

When the music / image tuning data file starts to be converted / outputted (played back) by the audio output means 130, the synchronization means 160 includes an image data sample (C) inserted into the music / image tuning data file (C). ) Are extracted and stored in the second memory 170.

Herein, the synchronization means 160 receives the expression characteristic grade information of the PCM data frame reproduced from the expression characteristic analysis means 140 and the image data sample C corresponding to the grade information as the audio data is reproduced. Select.

At this time, the synchronizing means 160 includes the number information of the image data samples (because the grade information is made in 10 steps) (the number of image data samples is also preferably provided as 10) (b1) and the size information of the data samples (b3). ), Each image data sample constituting the image data string C may be classified and numbered in order. The numbered image data samples may be matched with the grade information of the expression characteristic.

FIG. 3 is a diagram illustrating a form in which image data samples are matched with expression characteristic grade information of PCM data by information of a tag data string B according to an exemplary embodiment of the present invention.

Referring to FIG. 3, as the audio data is reproduced in the audio output unit 130, the expression characteristic analyzing unit 140 generates the grade information E in a time unit D based on the synchronization period information. The synchronization means 160 is shown a process of matching the numbered (G) image data sample (F) with the rating information (E).

The synchronizing means 160 synchronizes the selected image data sample F with the reproduced audio data A and transmits the same to the image output means 180.

The image output means 180 decodes the image data sample transmitted by the format information (b2 of FIG. 2) of the image data sample, and decodes the image data sample through the resolution information (b4 of FIG. 2) of the image data sample. Perform preprocessing, such as adjusting the output size.

For example, when the audio / video synchronization device 100 according to the embodiment of the present invention is provided in various types of mobile communication terminals, the screen size provided in each mobile communication terminal is different, and thus the above-described preprocessing process is required.

Hereinafter, a method of inserting an image data sample into an audio file according to an embodiment of the present invention will be described with reference to the accompanying drawings.

4 is a flowchart illustrating a method of inserting an image data sample into an audio file according to an embodiment of the present invention.

First, the music / image tuning data file according to an embodiment of the present invention is for efficient use of hardware resources when played back in a mobile communication terminal, and the tag data string (B) and image data sample ( C) can be inserted to minimize the computational burden during synchronization.

Therefore, the music / image tuning data file is preferably created on an external computer such as a PC before being downloaded to the mobile communication terminal equipped with the audio / video synchronizing apparatus 100.

For this reason, it is assumed that the music / image tuning data file according to the present invention is produced on a PC, and the PC is provided with an application program for producing the tuning data file.

In addition, the PC is provided with existing audio data (audio file) decoded in a predetermined format and image data to be used as a sample.

First, when a file space for generating a tuning data file according to the present invention is set (S100), the audio data is read and recorded from the first field of the file space (S110).

When the audio data string A is generated, the tag data string B is recorded from the next data field, which is the name information B1 of the image tag, the size information B2 of the image tag, and the synchronization period information of the image data sample. (B3) is recorded sequentially (S120).

Subsequently, when the image data to be used as a sample is selected and ordered among the image data provided in the PC by the user (S130), the image header information B4 constituting the tag data string B is recorded. In B4), the format information b2 of the image data sample, the size information b3 of the image data sample, the number information b1 of the image data sample, the resolution information b4 of the image data sample, and the like are recorded (S140). .

For example, as image data to be used as a sample is selected and ordered, the name information B1 of the image tag and the size information of the image tag (tag data string B are recorded in byte units according to the respective information). Field is defined) (B2) may be generated automatically.

However, the synchronization period information B3 of the image data sample can be adjusted by the user.

The image header information B4 may also be automatically generated by analyzing the selected image data sample. That is, since information such as a compression format, a size, a resolution, and the like are recorded in the existing image data used as a sample, the tag data string B may be generated using these information.

As described above, when the tag data string B is recorded, the image data samples C are recorded from the next field. At this time, the header information of the existing image data is excluded (S150) and only the playable image data field is separated. It is recorded (S160).

Finally, when the end marker is written in the file space and the final data field is completed, the music / image tuning data file according to the present invention is stored in the recording medium (S170).

The music / image tuning data file stored in the recording medium of the PC is downloaded and played on the mobile communication terminal equipped with the audio / video synchronizing apparatus 100 to output music and the corresponding image.

The present invention has been described above with reference to the preferred embodiments, which are merely examples and are not intended to limit the present invention, and those skilled in the art to which the present invention pertains do not depart from the essential characteristics of the present invention. It will be appreciated that various modifications and applications are not possible that are not illustrated above. For example, each component specifically shown in the embodiment of the present invention can be modified. And differences relating to such modifications and applications will have to be construed as being included in the scope of the invention defined in the appended claims.

The present invention has the following effects.

First, since the music / image tuning data file according to the present invention has an easily accessible data structure and can be generated in advance with optimized information on an external device, hardware of a mobile communication terminal equipped with an audio / video synchronization device is provided. Resources can be used efficiently.

Second, since the music / image tuning data file according to the present invention does not require a special function of the synchronization device, the burden of hardware resources of the mobile communication terminal can be reduced, and various mobile communication terminals can be added without adding a separate device or software. The advantage is that synchronized playback of music and images on the screen is possible.

Third, according to the present invention, the user can designate the type, number, synchronization period, format, size, etc. of the image data to be used as a sample in advance, so that more diverse music / images can be synchronized and reproduced. There is an effect that you can enjoy the music more interesting by reflecting.

Claims (7)

An audio / video synchronizing apparatus for analyzing the expression characteristics of the reproduced audio data, selecting image data samples based on the grade information of the analyzed expression characteristics, and sequentially outputting the selected image data samples in synchronization with the audio data. A recording medium on which the audio data and the image data sample are recorded, An audio data string decoded in a predetermined format; A tag data string positioned after the audio data string and including name information of an image tag, size information of the image tag, synchronization period information of the image data sample, and image header information; And And an image data sequence positioned after the tag data sequence, wherein the image data samples are sequentially positioned. 2. The computer-readable recording medium having recorded thereon a music / image tuning data file. The method of claim 1, wherein the image header information Music / image tuning data file, characterized in that it comprises at least one of the format information of the image data sample, the size information of the image data sample, the number information of the image data sample, the resolution information of the image data sample. This recorded computer-readable recording medium. The method of claim 1, The image header information includes size information of the image data sample and number information of the image data sample, The number information of the image data samples and the size information of the data samples are used by the audio / video synchronizing apparatus to number the image data samples, so that the image data samples match the grade information of the expression characteristic. Computer-readable recording media on which music / image sync data files are recorded. The method of claim 1, wherein the synchronization period information of the image data sample, And the audio / video synchronizing apparatus is used as a period for analyzing a representation characteristic of the reproduced audio data. The method of claim 1, wherein the synchronization period information of the image data sample is A computer-readable recording medium having recorded thereon a music / image tuning data file, wherein the audio / video synchronizing apparatus reproduces only the audio data by recording a numerical value as "0". Analyze the presentation characteristics of the reproduced audio data, select the image data samples based on the grade information of the analyzed expression characteristics, and use them in the audio / video synchronization device to output the selected image data samples in synchronization with the audio data sequentially. In the audio file production method, Recording the decoded audio data string in a predetermined format; Recording a tag data string including name information of an image tag, size information of the image tag, synchronization period information of the image data sample, and image header information; And And recording the image data samples sequentially. The method of claim 6, wherein the recording of the tag data string is performed. And the image header information including at least one of format information of the image data sample, size information of the image data sample, number information of the image data sample, and resolution information of the image data sample. How to insert an image data sample into an audio file.

Images