KR0126590B1 - Mheg engine and activation method - Google Patents

Abstract

An engine for presenting multimedia information is provided to enhance performance of multimedia presentation, which comprises a ASN. 1 decoder(10) for converting MHEG(Multimedia and Hyper-media information coding Expert Group) formatted mono-media information into an ASN .1 defined data format; a MHEG class library(30) storing the converted MHEG object; a mapping processor(20) for storing the converted data in the library and producing a look-up table(70); a link processor(80) for transferring the MHEG object information list and the command list therefor to a operation processor(100) performing multimedia presentation on an users' media based on the command and object information; a time-stone processor(90) for informing the link processor of the time of occurring of presentation of multimedia information; a synchronization information table(110); and an action process module(120) for storing a program module for performing operation commands of the operation processor.

Description

Engine for multimedia information presentation using multimedia information processing system and its operation method

1 is a block diagram of a multimedia information processing computer to which the present invention is applied.

2 is a block diagram of an MHEG engine according to the present invention.

3 is a process flow diagram for an operating method according to the present invention.

The present invention relates to an engine for multimedia information presentation using a multimedia information processing system and a method of operating the same.

Multimedia refers to the integration of media such as text, audio, video, graphics and audio / visual in a single digital environment. In other words, multimedia is simply a mixture of various media such as text, audio, video, graphics and audio / visual. Rather, they mean that they are stored, retrieved and presented in digital form and handled within a single unified environment.

Among such multimedia applications, there is an application using a communication such as a multimedia mail system between a plurality of multimedia systems. In this case, a multimedia information processing system for exchanging or processing multimedia information using communication needs to express standardized multimedia information. The Multimedia and Hypermedia Information coding Expert Group (MHEG) is an international standard expression and object-oriented concept of multimedia information currently being formulated by the International Organization for Standardization / International Electrotechnical Commission (ISO / IEC), the international standardization organization for telecommunications. ) To define multimedia information as an Object.

An object of the present invention is an engine for multimedia information presentation using a multimedia information processing system capable of interpreting multimedia information expressed in the international standard MHEG format and presenting synchronization as intended by the first information producer, and its operation. To provide a way.

In order to achieve the above object, the configuration of the present invention provides an ASN. Protocol which reads a data stream encoding monomedia information in the form of (Multimedia and Hypermedia Information coding Expert Group) representation from a storage device and converts the data stream into a structure defined in ASN.1. 1 Decoder, MHEG class library that stores MHEG object information converted into internal data structure, Mapping processor that converts decoded data into internal data structure, stores in MHEG Class Library (MCL) and generates lookup table An element table that stores the address of another MHEG object element associated with the presentation presented in the MHEG object, a status table indicating the progress of the MHEG object to be presented, The conditional statements and this conditional statement can be used to present the MHEG object in the next order. Link table that stores the address of the relevant MHEG object, look-up table that allows the operation processor to be described later to quickly retrieve the information object that needs to present the multimedia information, and the conditional statement of the link table A link processor that passes a list of MHEG object information satisfying a conditional statement and a list of operation instructions to be performed on the target processor, and a time when an action occurs when the multimedia information is presented. Time-Stone Processor for informing the processor, an operation processor for performing a multimedia presentation on the presentation media recognized by the user by using the operation instructions and MHEG object information received from the link processor, multimedia Intended time and space Storing synchronization information in time and space so that the presentation information can be presented to the synchronization processor, and storing a synchronization information table for referencing by the operation processor and a program module to execute the operation command of the operation processor The Action Module is included.

In the method of the present invention, when the operation of the MHEG engine for the multimedia presentation is started, the first step of changing the decoded information into an internal data structure, stored in the MHEG class library and configure the lookup table, the first step After performing the step, the second step of analyzing the object having an internal data structure stored in the MHEG class library to store the synchronization information in a plurality of tables and timestone processor, and after performing the second step, the created link table is examined and the next step A third step of link processing to find an action action to be performed in the operation processor and to perform an action on the action processor, and after performing the third step, receive the action command and perform the action processing using the information object having the associated multimedia information and synchronization information. Four steps were included.

Hereinafter, with reference to the accompanying drawings will be described an embodiment of the present invention; FIG. 1 is a block diagram of a multimedia information processing computer to which the present invention is applied. FIG. 1 is a program for controlling the input / output devices under the Windows operating system. RAM input / output control routine (2), multimedia output processor (3) that matches multimedia presentation information generated through MHEG engine with input / output control routine in Windows, and text, audio, video, graphics, audio / visual, etc., respectively. Mono media generation processor (4), which enables the creation and editing of mono media information, MPEG / JPEG (5), which performs compression and playback functions, and reconstructs mono media information into MHEG standard format. The MHEG object generation processor 6 encodes the MHEG object information according to the Abstract Suntax Notation / One (ASNI) rule, which is a digital data type. ASN.1 encoder (7) converting into a data stream, mono media information, MHEG object information, a storage device (8) storing data streams, and MHEG object information converted into a data stream between multimedia information processing computers through a communication network. And a network management processor 9 for supporting the multimedia information, an MHEG engine A for performing the presentation function of the multimedia information, and a multimedia user interface B for controlling the respective functions in the multimedia information processing computer.

2 is a schematic configuration diagram of an MHEG engine, in which the MHEG engine A reads a data stream encoding MHEG object information from a storage device and converts the data stream into a structure defined in ASN.1; Converts the decoded data into an internal data structure for use within the MHEG engine, stores it in the MHEG Class Library (MCL), and looks up for real-time access to multimedia information used by the action processor. A mapping processor 20 for generating a table, an MHEG class library 30 that stores MHEG object information converted into an internal data structure, and stores the address of another MHEG object element associated with the presentation contained within the MHEG object. Element Table 40, Status Table 50 showing the progress of the MHEG object to be presented, If the condition is repeated and the condition is repeated, the link table (60), which stores the address of the conditional statements and the MHEG object associated with the conditional statement, allows the corresponding MHEG object to be presented in the next order. Link-up look-up table (70) for linking between the state address used in the operation processor and the physical address where the actual information object is stored so that information objects needed for presentation of multimedia information can be quickly obtained. The link processor 80 performs a function of passing the list of MHEG object information satisfied with the conditional statement and the list of operation instructions to be executed to the operating processor by examining the conditional statements of the table, and the screen when the multimedia information is presented. Remember the time when the action, such as the start of printing or the end of screen printing, occurs. Time-Stone Processor (90) that tells the link processor to find the next action to be performed, and the user is aware of it using the MHEG object information and the action command received from the link processor. An operation processor 100 for performing a multimedia presentation on the presentation media; time and space synchronization information (GTU) so that the multimedia can be presented in the intended time and space; Synchronization Information Table (110) stored in the General Time Unit (GDU) and the General Spatial Unit (GDU) for reference by the motion processor, and a program module that will execute the motion instructions of the motion processor. It consists of an Action Process Module 120 that is stored.

3 is a flowchart illustrating a process of performing a multimedia presentation function of an MHEG engine according to the present invention.

First, an MHEG engine operation start command is given to the multimedia user interface 11, which is an application program (31).

When the MHEG engine starts to run, the MHEG class library 30 receives the data stream encoded by the ASN.1 rule from the storage device 8 in object units and decodes the data stream in the form of an internal data structure by the mapping processor 20. The state and physical addresses of related objects are stored in the lookup table (32).

The process 32 is repeated until there are no more objects to read from the storage (33).

If there are no more objects, the initial value of the MHEG object address to be presented to the pointer is set (34).

The element table stores the elements of the MHEG object pointed to by the pointer, and the link table stores the link portion of the MHEG object pointed to by the pointer.

At this time, the link part is composed of a conditional statement and a list of operation instructions to be processed when the conditional statement is satisfied (35).

In the next process, the time when the operation instructions should be started is recorded in the timestone processor (36).

A value of 'not ready' is set in the preparation status table and 'not performing' in the action status table (37).

The link processor examines the conditional statements in the link table using various state tables to check whether the condition is satisfied (38).

When the condition is satisfied, the action list is composed of the action instruction associated with the satisfied link and the target that is the target of the action to be used by the action processor.

In this case, the target represents an element and an MHEG object stored in the element table (41).

If there is no satisfied link in the link table, the timestone processor waits (39) and checks whether the time input from the timer is the time to take the next action.

At this time, if the operation time, the process 38 repeats the process 39 while continuing to wait until the operation time, if not the operation time (38). The action processor checks if the action instruction in the action list corresponds to 'execute' (42).

If it is 'execution', the motion state table is set to 'executing' and the motion processing module is called on the time and space coordinate axes for the target of the action list to perform a presentation (43).

After the operation command is executed, the operation state table value is set to 'not running' and the process of checking the link condition statement of the link table (38) is repeated (44).

If the operation command is 'end', the operation of the MHEG engine is terminated and control is passed to the multimedia user interface B (46).

If the command examined in step 46 is not 'terminated', an error message is output and control of the MHEG engine is transferred to the multimedia user interface B.

According to the present invention, the MHEG engine expresses mono media information constituting a multimedia presentation such as text, audio, video, audio / visual, etc. as an object, and synchronizes the mutual relationship therebetween to operate the multimedia presentation easily. Can be controlled.

At this time, the MHEG engine presents multimedia using the start and end points of each monomedia on the time axis and the space axis.

The MHEG object expressing such mono media information has the advantage that it can be used again in another multimedia presentation, and has an effect that can be controlled in units of objects when the MHEG engine is running.

Claims (5)

In an information processing computer for presenting multimedia information, a data stream encoding monomedia information in the form of a multimedia and hypermedia information coding expert group (MHEG) is read from a storage device and converted into a structure defined in ASN.1. An ASN.1 decoder 10, an MHEG class library 30 storing MHEG object information converted into an internal data structure, and converting the decoded data into an internal data structure to an MHEG Class Library (MCL). A mapping processor 20 for storing and generating a lookup table, an Element Table 40 contained within the MHEG object and storing the address of another MHEG object element associated with the presentation, of the MHEG object to be presented. Status table (50) indicating progress, the corresponding MHEG object will be presented in the next order Link Table 60, which stores the conditional statements and the address of the MHEG object associated with the conditional statement, which allows the motion processor, which will be described later, to quickly retrieve the information objects needed to present multimedia information. The link processor 80 which examines the lookup table 70, the conditional statements of the link table, and passes the list of MHEG object information satisfying the conditional statement and a list of operation instructions to be executed to the target processor, the multimedia information. Time-Stone Processor 90, which remembers the time at which an action occurs when presented, and informs the link processor at the corresponding time, using operation instructions and MHEG object information received from the link processor. Presenting multimedia presentations to presentation media The operation processor 100, a synchronization information table 110 for storing the synchronization information in time and space so that the multimedia can be presented in the intended time and space for reference by the operation processor; and Engine processing for multimedia information presentation using a multimedia information processing system, characterized in that it comprises an action process module (Action Process Module) (120) for storing a program module to perform the operation command of the operation processor. In the operation method applied to the engine for multimedia information presentation using the multimedia information processing system, when the operation of the MHEG engine is started for the multimedia presentation, the decoded information is changed into an internal data structure, stored in the MHEG class library, and locked up. A second step of constructing a table, and after performing the first step, analyzing the object having an internal data structure stored in the MHEG class library and storing synchronization information in a plurality of tables and a timestone processor; After performing the third step of link processing to examine the created link table to find an operation action to be performed in the next order and to take action on the operation processor, and after the operation of the third step, the operation command receives information related to multimedia information. Action program using object and synchronization information Multimedia information presentation method for the operation of the presentation engine using a multimedia information processing systems, characterized in that it comprises a fourth step of sesing. The method of claim 2, wherein the first step comprises: a command to start operation of the MHEG engine by a multimedia user interface; receiving a data stream encoded according to the ASN.1 rule from a storage device in units of objects, decoding the mapping processor; Storing in the MHEG class library in the form of an internal data structure and storing the relative and physical addresses of the related objects in the lookup table, the state addresses of the related objects in the lookup table until there are no more objects to read from storage. And repeatedly performing a step of storing a physical address. 3. The method of claim 2, wherein the second step comprises: setting an initial value of an MHEG object address to be presented to a pointer when there are no more objects to map, the element table stores elements of the MHEG object pointed to by the pointer and links table The method includes storing the link portion of the MHEG object pointed to by the pointer, recording the time at which the operation instructions should be started in the timestone processor, and setting values of the ready state table and the action state table. Operation method of multimedia information presentation engine using information processing system. 3. The method of claim 2, wherein the third step comprises: checking, by a ring processor, condition statements in a link table using a state table to determine whether a condition is satisfied; an operation instruction associated with a satisfied link when the condition is satisfied; The action list is composed of action targets to be used by action targets. If there is no satisfied link in the link table, the timestone processor waits. And a step of investigating whether the input time is a time to take the next operation action and processing the data according to the operation time point.