KR20030061640A - A storage medium storing multimedia contents and apparatus and method for reproducing the same - Google Patents

Abstract

PURPOSE: A recording medium storing multimedia contents, an apparatus and a method for playing the same are provided to play the multimedia contents requiring a large capacity of memory by efficiently using a memory space. CONSTITUTION: A memory(330) stores an image database, a voice dictionary database relationally storing voice index and groups of voice data and explanation data corresponding to the voice index, and a voice index file storing extract information of the voice dictionary database, and multimedia contents including a program code calling each voice data by using the voice index file. An information selecting unit(370) receives an operating signal of a user. A central processing unit(310) accesses the memory for processing the image and voice data to proceed multimedia contents. A voice output unit(350) converts the voice data output from the central processing unit into analog data. A display unit(390) outputs the image data output from the central processing unit. The multimedia contents are manufactured in a program method and each voice and image objects are managed in the dictionary database to be repeatedly reutilized.

Description

A storage medium storing multimedia contents and apparatus and method for reproducing the same}

The present invention relates to a technology for playing multimedia content, and more particularly, to a technology for playing multimedia content that can be interactively progressed.

In multimedia contents using a sequential storage medium such as a conventional cassette tape, all reproduction contents need to be recorded sequentially. Therefore, huge storage capacity is required.

Recently, in digital multimedia contents, there are attempts to store frequently repeated sections and to call them repeatedly. This allows more efficient use of memory space.

However, there is still a necessity to produce multimedia contents including a large amount of information such as voice and images to make use of a more economical memory space.

On the other hand, in the reproduction of multimedia contents by a sequential storage medium such as a cassette tape, it is very easy to repeatedly play the previously played portion. That is, it only needs to repeatedly play back a certain section of the storage medium in which all the information is sequential.

However, the situation is different in interactive multimedia contents that have been recently introduced. Such interactive multimedia content includes, for example, digital video stored in a digital video disc (DVD) whose scenario development is different depending on the viewer's selection, or content such as a game whose progress is changed every moment according to the user's selection. Furthermore, this includes interactive multimedia educational contents whose educational contents are varied according to a user's selection.

In these, since various scenario branches are possible according to the user's selection, it is impossible to reproduce the previously reproduced situation without storing the history information.

SUMMARY OF THE INVENTION The present invention is derived from such a situation, and an object of the present invention is to propose a multimedia content technology capable of reproducing multimedia information requiring a large capacity while using a memory space very efficiently.

Furthermore, an object of the present invention is to provide a method and apparatus for reproducing a multimedia content that can repeatedly reproduce a part of a scenario previously developed in an interactive multimedia content.

1 illustrates an appearance of a multimedia content playing apparatus 100 according to an exemplary embodiment of the present invention.

2 illustrates an embodiment of a screen displayed when a description screen selection key is pressed.

3 is a schematic block diagram of an apparatus for reproducing multimedia contents according to an exemplary embodiment of the present invention.

4A and 4B illustrate an embodiment of the structure of a voice and image dictionary database according to a preferred embodiment of the present invention, respectively.

5 illustrates a structure of multimedia content according to an exemplary embodiment of the present invention.

6 is a flowchart schematically illustrating a method of playing multimedia content according to the present invention.

7 is a flowchart illustrating a part of a method of playing multimedia content according to another aspect of the present invention.

<Explanation of symbols for the main parts of the drawings>

100: multimedia content playback device

110: display unit 120: speaker

130: microphone 140: cursor movement key

150: key button 160: interface

310: central processor 311: microprocessor

313: digital signal processor 320: interface unit

330: memory 331: auxiliary memory

333: main memory 350: audio output unit

351: DAC 353: amplifier

355: Speaker 370: Information selector

391: liquid crystal drive unit 393: liquid crystal display device

Multimedia content according to an aspect of the present invention for achieving the above object is produced in the form of a program code executable by a computer, the program code is

Calling a function to play a corresponding speech file in the speech dictionary database from the speech index, waiting for a playback unit interval to elapse, and playing back a corresponding image file in the image dictionary database from the image index It is characterized by including.

According to this aspect of the present invention, a large-capacity voice file is registered in a dictionary database, which can be identified by an index and used as a resource that can be repeatedly called and reused in any part of the content. This allows for very efficient use of the memory space.

According to this aspect of the present invention, a large-capacity image file is registered in a dictionary database, which can be identified as an index and utilized as a resource that can be repeatedly called and reused in any part of the content. This allows for very efficient use of the memory space.

Furthermore, according to this aspect of the present invention, the voice file and the image file may be reproduced in synchronization for each play unit time.

Method of playing multimedia content according to an aspect of the present invention

Extracting a program code constituting multimedia content, storing a voice index in a history buffer if the program code is a voice output command, playing a voice file corresponding to the voice index, and a description screen selection key And a description presenting step of presenting speech description information related from the stored at least one speech index if selected.

A portion of the scenario that proceeds in accordance with this aspect of the present invention is stored to obtain basic information from which various reproduction techniques can be applied.

According to a further aspect of the present invention, there is provided a method of reproducing multimedia contents, the method comprising: repeatedly selecting at least one of the voice description information according to a signal input from a playback selection means, and voices associated with voice indexes corresponding to the selected voice description information The method may further include a repeat play step of playing the file.

Accordingly, by repeating the contents previously performed also in the interactive multimedia contents, for example, the educational contents can double the effect of learning, and in the case of game contents, it is possible to check the contents of the contents.

According to another aspect of the present invention, a method of playing multimedia content

If the program code is an image output command, storing the image index in a history buffer; and if the description presentation step selects the description screen selection key, displaying the related image from the stored at least one image index. It is characterized by including. Accordingly, it becomes possible to efficiently utilize memory space by resourceizing image information such as computer graphics or moving images.

According to an additional aspect of the present invention, by storing an index in the history file, such image information may be reproduced in addition to the voice when the section is repeated.

According to the auxiliary aspect of the present invention, such a history repetition may be repeated by about one sentence based on one index file, and may be repeated by a scenario related to a situation including a plurality of consecutive sentences. Do. This iteration technique can be specified in various ways as needed.

In accordance with an aspect of the present invention, there is provided an apparatus for reproducing multimedia contents, comprising: a memory storing multimedia contents and a dictionary database, an information selection unit to receive a user's operation signal, and the memory according to the operation signal of the information selection unit; A central processing unit which processes the multimedia contents by processing the image and the audio data to access the audio signal, a voice output unit which converts and outputs the audio data output from the central processing unit into analog data, and outputs the image data output from the central processing unit. It characterized in that it comprises a display unit.

In one preferred embodiment of the present invention, the central processing unit may be a single microprocessor or a digital signal processor.

In another embodiment, the central processing unit is a microprocessor for controlling the entire system according to the operation signal of the information selection unit, and the digital to restore and output the compressed voice data input from the memory in accordance with the control signal of the microprocessor It may be configured as a signal processor.

According to an aspect of the present invention, there is provided an apparatus for reproducing multimedia contents, wherein the information selection unit includes a description screen selection key, and wherein the central processing unit extracts the history information when the description screen selection key is input, and describes at least one description of the latest contents. It is characterized by presenting information.

Furthermore, according to a further aspect of the present invention, the information selection unit further comprises playback selection means for selecting one of the description information, wherein the central processing unit extracts multimedia information selected by the playback selection means from the dictionary database. It is characterized by reproducing.

These and further aspects of the present invention will become more apparent through the preferred embodiments described below with reference to the accompanying drawings. Hereinafter, the present invention will be described in detail to enable those skilled in the art to easily understand and reproduce the present invention.

1 illustrates an appearance of a multimedia content playing apparatus 100 according to an exemplary embodiment of the present invention. However, the present invention is not limited to such a portable playback device, and can be used in any environment in which interactive multimedia content can be played back, such as a personal computer or a personal digital assistant (PDA) that executes multimedia content, and moreover, a branchable scenario. DVD players and the like for playing digital video discs.

As shown in FIG. 1, the device has a size suitable for portable use, a display unit 110 such as, for example, a liquid crystal display, on which a graphic or video can be displayed, and a speaker 120 through which audio is output. ), A microphone 130 capable of inputting voice, a cursor movement key 140 used to select an object or a menu on the screen, and a plurality of key buttons 150 including selection of information, menu movement, and specific commands. And an interface unit 160 for updating a dictionary database from the outside or transmitting and receiving multimedia contents. In another embodiment, the cursor movement key 140 may be one of various pointing devices such as, for example, a touch screen, a tablet, or a trackball.

When you first turn it on, you'll see a screen similar to Windows Explorer on your personal computer. When the user selects the interactive content on the application selection screen, a list of the multimedia content according to the present invention is presented. When the user selects specific content, it is loaded into memory and executed. Multimedia content supports audio output synchronized with graphic data such as animation.

In each situation, the user can select one of a plurality of branching scenarios using the cursor movement key 140. Or answer a question, such as a kind of quiz, presented in each branch situation, and different scenarios may proceed according to the result of the response.

Furthermore, if the content is, for example, foreign language learning, the character and the learner appearing in each learning situation have a conversation, and the speech is recognized to determine the optimal branching scenario among a plurality of presenting branching scenarios. Can be made. Current advanced speech recognition technology enables such content.

On the other hand, this divergent situation can be repeated so that the development of complex scenarios can continue in an unpredictable situation. At this time, for example, if the learning content learning language or learning a specific technology, it may be helpful to increase the learning efficiency by repeating the scenario that is developed. One of the main ideas of the present invention makes this possible.

FIG. 2 illustrates a display unit when a user presses a specific key, that is, an explanation screen selection key in a situation where an unpredictable scenario has been sufficiently progressed in the case of interactive foreign language education content using voice recognition, for example, among a plurality of embodiments. An embodiment of a screen displayed on 110 is shown.

As shown in the figure, the information of the data responded by the user and the data presented in the content are presented as a list. When the user manipulates the cursor movement key 140 up and down to select one or more of them and presses the play command key, corresponding voice information is output. In addition, the animation data displayed in the situation can also be synchronized and played. By such a function, learner's learning can proceed very effectively.

3 is a schematic block diagram of an apparatus for reproducing multimedia contents according to an exemplary embodiment of the present invention. As shown, the apparatus includes a central processing unit 310, a memory 330, an audio output unit 350, and an image output unit 390. In addition, an information selecting unit 370 for inputting a user's operation signal, and an interface unit 320 for transmitting and receiving content from an information providing server, a personal computer, a content vending device, or the like. Although not shown, it includes a power supply, and in the case of a portable device, the power supply may include a battery.

The central processing unit 310 controls the entire system and plays the multimedia file read from the memory 330. When the multimedia file is in a compressed form, the central processing unit 310 performs signal processing to restore the compressed file. In a preferred embodiment, the central processing unit 310 may be implemented as a single digital signal processor (DSP). In another embodiment, the central processing unit 310 may be implemented as a single high performance microprocessor. In another embodiment, the central processing unit 310 may include a general purpose microprocessor 311 and a digital signal processor 313 that executes a voice codec and / or an image codec core program. Modern advanced microprocessor manufacturing technology has enabled the integration of these two processors into a single chip, and furthermore, products are being integrated into chips including several peripheral circuits in addition to the DAC 351. By allocating the execution of complex algorithms such as reproduction of compressed files to a dedicated chip or signal processor, the processing load of the microprocessor 311 controlling the system can be lowered, and real-time processing is made easier, resulting in more processing. It is possible to play a wide variety of multimedia content.

The voice output unit 350 is known and converts digital voice data output from the central processing unit 310 into an audible sound that can be heard by a human. The digital voice data is converted into an analog voice signal by the DAC 351, amplified by the amplifier 353, and output to the speaker 355 and / or the earphone jack.

The memory 330 includes a main memory 333 and an auxiliary memory 331. The main memory 333 may be a kind of RAM that can be randomly accessed by a high speed storage device. The auxiliary memory 331 may be embodied as a medium such as a flash memory from a medium such as a hard disk or a compact disk. In a preferred embodiment, the secondary memory 331 is implemented as flash memory of several to hundreds of megabytes of capacity, suitable for portable use.

The information selector 370 includes a conventional pointing device such as a trackball, a tablet, and a cursor key and some buttons to receive a user's operation signal.

The image output unit 390 is hardware for outputting an animation or a moving image. In an exemplary embodiment, the image output unit 390 includes a liquid crystal display 393 and a liquid crystal driver 391 for driving the device. However, various display devices such as CRTs and organic EL devices are known and can be appropriately selected in consideration of product characteristics and prices.

The interface unit 320 is an input / output interface for transmitting and receiving content from an information providing server, a personal computer, a content vending device, or the like. Various interface ports such as a serial transmission / reception port such as USB or RS-232 or a parallel transmission / reception port are known. Can be one of

Hereinafter, the multimedia content embodying the aspect of the present invention executable in the apparatus for reproducing the multimedia content according to the above-described embodiment or another modified embodiment will be described in detail.

Multimedia content according to an aspect of the present invention is produced by a program method, rather than sequentially arranged data to be reproduced as in the prior art. In accordance with an advantageous aspect of the present invention for more efficiently supporting programmatic implementation, respective voice and image components constituting multimedia content are provided in advance.

4A illustrates one embodiment of the structure of a voice dictionary database according to a preferred embodiment of the present invention. As shown, each voice file is assigned an identifier including a number or text for easy understanding, and at least one description of the content pronounced by the voice file identified by the identifier is stored in association. In the drawing, such a structure is presented in the form of a database table, but it is not necessarily necessary. The index parts are collected, and the index file is stored together with the start pointer of the description file and the start pointer of the voice data file for each index. The file and the voice data file can be stored in one or several file formats.

Figure 4B illustrates one embodiment of the structure of an image dictionary database according to one preferred embodiment of the present invention. As shown, each image file is assigned an identifier including a number or a text for easy understanding, and at least one description of the content displayed by the image file identified by the identifier is stored in association.

The image file is a still image as an example in the illustrated embodiment. It is possible to implement animation by displaying a plurality of still images. However, the present invention is not limited thereto, and may include a video file or a video animation.

In the drawing, such a structure is presented in the form of a database table, but it is not necessarily necessary. The index parts are collected, and the index file is stored together with the start pointer of the description file and the start pointer of the voice data file for each index. The file and the voice data file can be stored in one or several file formats.

5 illustrates a structure of content according to an exemplary embodiment of the present invention. In a preferred embodiment, the multimedia content according to the present invention includes a voice playback function and an image display function.

For example, the voice playback function

D_Celp_Play (index);

It is implemented in the form This function is to play the indexed file in the digital signal processor. In a preferred embodiment, the voice file is compressed and stored in a CELP manner, in particular in an MP3 manner, which requires a significant amount of computation. In another embodiment, this function may be a software routine included in a library that plays a file designated by an index.

Image display functions are, for example,

D_Show (index);

It is implemented in the form This function displays the file specified by the index on the display. In the preferred embodiment, since the image file is stored as a bitmap, the processing for display is merely a memory dump and is executed by the microprocessor in software in DMA, or memory read / write format. However, if the image file is a compressed movie, this routine can be a complex operation involving the processing of a digital signal processor.

Since the voice output and image display techniques are well known techniques that can be implemented by those skilled in the art, detailed descriptions thereof will be omitted.

The multimedia content according to an aspect of the present invention implements multimedia playback by frequently calling such a voice output function and an image display function. When the image is a bitmap, the frame is updated every predetermined time interval, for example, 240 msec, to realize a moving image. Since the audio output usually lasts for a few seconds, the digital signal processor 313 uses a wait command to synchronize and display the image while playing the voice. This wait command is for example PUT (); This function is such that the function causes the microprocessor 311 to stop executing the next command and wait until the next time interval, that is, 240 msec. As a result, the audio output and the image display can be synchronized and progressed according to the scenario.

As shown in FIG. 5, the content includes a plurality of such instructions. When the microprocessor 311 reads a command included in the content and outputs a voice output command, the microprocessor 311 receives the start pointer of the corresponding voice file from the voice index included in the parameter and passes it to the digital signal processor 313. The digital signal processor 313 restores the voice file starting from this pointer and outputs it to the DAC 351 as digital data.

On the other hand, if the read command is an image display command, display control is performed by receiving the start pointer of the corresponding image file from the image index included in the parameter and writing it to the frame memory of the liquid crystal driver 391. Frame memory has a hierarchical structure to support a plurality of graphic layers, and a sequential memory dump between layers is performed every frame.

6 is a flowchart schematically illustrating a method of playing multimedia content according to the present invention. The microprocessor loads the contents stored in the auxiliary memory 331 into the main memory 333 and sequentially fetches and executes the instructions. If a new command is read (step 601), and the command is a voice output command (step 602), the corresponding index is stored (step 603) and control is made to output a voice (step 604). The index may be stored in a specific area of the main memory 333. However, backup or direct storage may be performed to the auxiliary memory 331 to maintain information even when the power is turned off. This memory area is preferably managed in a first-in first-out (FIFO) format. In this area, a history of reproduced multimedia information is stored.

If the patched command is an animation command, the indexes are compared and there is no need to save the index if it is identical to the previously displayed screen. But if it's not the same, save the index and display the animation. Since the animation and the audio output should be synchronized, the history memory area for animation is preferably the same area as the history memory area for the audio output, and the type of index and the index information are sequentially stored in the chronological order.

If the patched command is any other command, other processing is performed. In order to synchronize voice and animation, the above-described waiting command PUT () may also be stored together in a history file.

7 is a flowchart illustrating a part of a method of playing multimedia content according to another aspect of the present invention. 6, the indices stored in the history area are called when the explanation screen selection key is pressed (steps 701 and 702) (step 703). The corresponding voice description is extracted from the voice database stored in the auxiliary memory 331 by reading the index in the history area (step 704) and displayed on the screen sequentially (step 705).

An example of this screen has been presented in FIG. From this screen itself, the user can check what he / she has learned. In the case of learning a foreign language, it can be a function of checking the text in case of failure of listening. Such a function is well known for sequential playback such as a cassette tape, but a special technique like the present invention is required when the progress scenario is variable because the bidirectional various branches to which the present invention is applied are possible.

On the other hand, the user can select one or more from this list to select playback. Selection in the list may be performed using a pointing device such as a tablet or cursor movement key and / or a selection key.

When a key to play for the selected list is entered (step 706), a pointer indicating the location of the voice file and / or image file is extracted from each voice and / or image index by opening the index file (step 707). Alternatively, if it is implemented as a table-type database, the file can be called directly from the index. As a result, the voice file and the animation are reproduced sequentially in synchronization with the order stored in the history file in a hardware or software manner (step 708). At this time, as described above, the standby command may be inserted for synchronization.

As described in detail above, the present invention has proposed a novel apparatus and method for synchronizing and reproducing voice and animation in digital content with variable scenario progression such as games or interactive educational content. Also, by repeatedly playing back the history progressed in such contents, a method for showing great effects in, for example, educational contents was presented.

According to the present invention, it is possible to significantly reduce the size of digital content by pre-objecting voice and image files that occupy a large capacity. Updating dictionaries also enables much higher performance multimedia content playback using the same hardware.

Furthermore, in the present invention, since the history of the voice and the image is managed by storing only the index file, it is possible to occupy a separate memory space to a minimum.

The invention has been described with reference to the preferred embodiments described with reference to the accompanying drawings, but is not limited thereto, and is intended in the appended claims to cover many variations that can be readily applied by those skilled in the art.

Claims (13)

Image database, A voice dictionary database for storing a voice index and a corresponding set of voice data and description data, a voice index file for storing extraction information of the voice dictionary database, Multimedia content including program code for calling each voice data using the voice index file Stored memory; An information selecting unit to input a user's operation signal; A central processing unit which accesses the memory and processes images and audio data according to an operation signal of the information selecting unit to process multimedia contents; A voice output unit converting the voice data output from the central processing unit into analog data and outputting the analog data; And a display unit for outputting image data output from the central processing unit. The method of claim 1, An image dictionary database in which the image database of the memory is stored as an image index and a corresponding set of image data, The memory further stores an image index file for storing extraction information of the image dictionary database, And a program code for synchronizing and calling each voice data and image data using a memory and an image index file. The method according to claim 1 or 2, The memory includes an area for storing history information related to content progression, The information selection unit includes a description screen selection key, And when the description screen selection key is input, the central processing unit extracts the history information and presents at least one description information of the latest contents. The apparatus of claim 3, wherein the history information comprises voice indices executed on recently executed contents. 5. The apparatus of claim 4, wherein the history information further comprises image indexes executed on recently executed contents. The method of claim 5, The information selection unit further includes reproduction selection means for selecting one of the description information, And the central processing unit extracts and reproduces the multimedia information selected by the reproduction selecting means from the dictionary database. The method of claim 1, 2, 5, 6, wherein the central processing unit: A microprocessor for controlling the entire system according to an operation signal of the information selection unit; A digital signal processor for restoring and outputting compressed voice data input from the memory according to a control signal of the microprocessor; Multimedia content playback apparatus comprising a. Extracting program code constituting the multimedia content; Storing a voice index in a history buffer if the program code is a voice output command; Playing a voice file corresponding to the voice index; A description presentation step of presenting speech description information associated with the stored at least one speech index when the description screen selection key is selected; Multimedia content playback method comprising the. The method of claim 8, wherein the method is: A repetition selection step of selecting at least one of the voice description information according to a signal input from a reproduction selection means; And reproducing the voice file associated with the voice indices corresponding to the selected voice description information. The method of claim 8, wherein the method is: If the program code is an image output command, storing the image index in a history buffer; The steps outlined above are: If the screen selection key is selected, the method further comprises displaying an image associated with the stored at least one image index. The method of claim 9, And displaying the image corresponding to the stored image indexes in association with the voice indexes corresponding to the selected voice description information. The method according to any one of claims 9 and 11, And repeating selection step is a step of selecting a plurality of consecutive description information from the presented list. Calling a function to play a corresponding speech file in a speech dictionary database from the speech index; Waiting for a regeneration unit interval to elapse; Playing back the corresponding image file in the image dictionary database from the image index; And a computer readable recording medium storing multimedia contents executable on a computer.