KR20060060133A - Multimedia player and authoring tool - Google Patents

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia player and an authoring tool, and more particularly, to a multimedia player and an authoring tool for bidirectional multimedia transmission for transmitting a general user's requirements to a server side. The present invention allows a client, which is a wearable PC, to retrieve MPEG-4 content on the server side using a keyword to retrieve and stream a desired content. Preferably, when a keyword to be searched is input from the wearable PC, the MPEG-4 file can be played from the searched position in the scene tree structure of the keyword.

Description

Multimedia player and authoring tool

1 is a block diagram of an MPEG-4 system to which the present invention is applied.

2 is a block diagram illustrating an MPEH-4 player and an authoring tool according to the present invention.

3 is a conceptual diagram illustrating input of a scene keyword into a video stream according to the present invention.

4 is a block diagram illustrating a structure of a wearable PC to which the present invention is applied.

<Description of main parts of drawing>

10 ... Input information 20 ... Authoring tool

26 ... BIFS node generator 30 ... Database for output

40 ... MPEG-4 Player 50 ... Display

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia player and an authoring tool, and more particularly, to a multimedia player and an authoring tool for bidirectional multimedia transmission for transmitting a general user's requirements to a server side.

Recently, multimedia applications using MPEG-4 have been activated. However, unidirectional multimedia streaming transmission has been mostly used.

MPEG-4 is an international standard for new multimedia coding that integrates broadcast media delivery capability, communication bidirectionality, and computer interactive user interface, and is a key technology in the next generation of multimedia services. See also Information technology-Coding of audio-visual objects Part 1: Systems, ISO / IEC 14496-1: 2001.1 and "Overview of the MPEG-4 Standard," http: // mpeg. See telecomitalialab.com/standards/mpeg-4/mpeg-4.htm.

MPEG-4 technology combines various multimedia information such as composite image of graphic as well as natural image to communicate interactively, provides advanced content-based interaction, and can be applied to network and mobile environment with low transmission rate. Core technology is essential for multimedia services, including Internet information services.

 Multimedia information communication services include video telephony, internet broadcasting, distance education, remote games / entertainment, virtual shopping, and VOD. In most service contents, media streams are generally played sequentially in file units. For such application development, an authoring tool that can be used by a general user is required. Existing MPEG-4 authoring tools include MPEG-Pro (Boughoufalah S., Dufourd JC., Bouilhaguet F., "MPEG-Pro, an Authoring System for MPEG-4 with Temporal Constraints and Template Guided Editing," developed by ENST, France. ", Proceedings of ICME2000, Vol. 1, pp.175-178, 2000), 3D MPEG-4 authoring tool developed by ITI in Greece, EBS and 2D MPEG-4 authoring tool by envivio. However, these existing authoring tools do not provide a function of searching the contents of the stream by inputting a keyword of a user.

An object of the present invention is to provide a multimedia player and its authoring tool for configuring a multimedia to retrieve the desired content of the media stream.

Another technical problem to be solved by the present invention is to provide a structure for delivering information for searching in a media stream in order to search for a desired part of the media stream. Another object of the present invention is to provide a multimedia player and its authoring tool, which are configured to transmit and retrieve information in synchronization with each other so as to receive a necessary stream according to a user's request.

Another technical problem to be solved by the present invention is not only to play multimedia using MPEG-4 technology, which is an international standard for multimedia services, but also to play a multimedia player based on a user's choice. And another object thereof to provide the authoring tool.

In order to achieve the above technical problem, the present invention provides a multimedia player for retrieving and reproducing multimedia data, by inputting a desired keyword including a keyword searcher, so that the server side can use the keyword input device in the authoring tool to properly select a video stream. A multimedia player that inputs a keyword inserted at a location into a scene description and searches a desired file corresponding to the input keyword from a stored multimedia data file database composed of scenes by a binary format for scene (BIFS) node generator. To provide.

According to an aspect of the present invention, there is provided an authoring tool for creating and storing multimedia data played in a multimedia player, comprising: a keyword input unit for inputting a keyword as a scene description at an appropriate position of a video stream; And a binary scene format (BIFS) node generator configured to construct a video stream into which the input keyword is inserted, as a scene, and store the video stream in a multimedia file database, according to the keyword input from the multimedia player. An authoring tool is provided for retrieving a desired file corresponding to the entered keyword from a data file database.

Preferably, the multimedia file further includes a time processing node for time synchronization of the multimedia file and reproduction of a specific part, in addition to the binary scene format information necessary for searching a scene.

Preferably, the multimedia generation method of the MPEG-4 authoring tool comprises: 1) inserting a media file, a text or image file, or a sound file into a scene; 2) constructing a scene; 3) inserting a keyword into each specific frame; 4) constructing a scene with keyword information; 5) encoding a BIFS node; And 6) creating an MP4 file.

Preferably, the multimedia playback method of the MPEG-4 player comprises the following steps: 1) opening an MP4 file; 2) decoding the MP4 file; 3) checking the network in the DMIF stack; 4) synchronization layer management step; 5) scanning the memory image of the scenegraph; 6) retrieving the decoded media unit from the synthesis buffer; 7) outputting the synthesized scene to the output device; 8) When the user searches for the keyword, the keyword search is performed by the BIFS node, and the synchronization and reproduction are performed from the searched BIFS node.

Hereinafter, with reference to the accompanying drawings it will be described in detail the configuration and operation of a preferred embodiment of a multimedia player and its authoring tool operating in a personal wearable terminal of the present invention.

First, the MPEG-4 system will be described before describing the multimedia player and the authoring tool of the present invention. In the MPEG-4 system, multimedia standardization must be performed to handle multimedia data. Multimedia standardization is a coding standard that supports new methods for communicating with AV data, accessing AV databases, and handling AV data at bit rates ranging from 4.8 to 64 kbps. Work is currently underway to standardize the industrialization and improved tools of the MPEG-4 standard. MPEG-4 chose coding scheme that considers the content of image, different from block-oriented coding schemes such as H.261, MPEG-1, and MPEG-2 technology (Reference: Seung-Joon Oh, "ISO / IEC JTC1 / SC29 / WG11 MPEG-4 Standard Trend Analysis ").

MPEG-4 is a multimedia coding standard that integrates various objects such as AV, 2D, and 3D graphics. MPEG-4 system is composed of two layers of scene technology and multiplexing. There is a layer that defines the interface. DMIF is referenced by reference to MPEG-4 DMIF Group, "Generic Coding of Audio-Visual Objects: Part 6-DMIF", ISO / IEC JTC1 / SC29 / WG11 N2506 FDIS of ISO / IEC 14496-6, November 1998.

The MPEG-4 system handles multiplexing and synchronization of encoded bitstreams of multiple objects (media objects in a broad sense, including audio, video, CG and still images), as well as synthesis according to scene description (http: // www. patentmap.or.kr/pm_inquiry/2002/2002-ee/2002-EE-07/EE07_html_chap_1/EE07-114_na.htm).

In FIG. 1, on the server side, the composite information 90 is encoded in the BIFS encoder 110, and the audio stream 92, the image data 94, and the video stream 96 are encoders 112, 114, and 116, respectively. Each encoded various multimedia data and encoded audio-visual object data 150, which are encoded in SYNC, are synchronized and multiplexed in the synchronization / multiplexer 100 and transmitted to the client side via a network 400 such as the Internet. do. On the client side, the composite information 90, the audio stream 92, the image data 94, and the video stream 96 are decoded by the BIFS decoder 210 and the decoders 212, 214, and 216, respectively, via the demultiplexer 200. And synthesized by the synthesizer 300 such as the audio-visual object data 250 passed through the decoder 210 and output to the audio 302 and the composite video content 304.

The Binary Format for Scene (BIFS) of the MPEG-4 system is a language for expressing an audio visual scene using content written using MPEG-4 ("MPEG-4's Binary Format for Scene Description," / http: // ailab.chonbuk.ac.kr/~sjmun/mpeg4/tutorial/ 5-BIFS_paper.htm).

BIFS was developed based on VRML (Virtual Reality Modeling Language), but to facilitate the development of MPEG-4 applications, some of the VRML nodes were deleted or modified, and nodes for streaming and 2D scenes were added. In addition, by expressing the scene in a concise binary format, the amount of memory used to describe the scene is minimized.

The multimedia player and its authoring tool according to the present invention implement an MPEG-4 content generation method capable of keyword search. Two functions must be included to configure MPEG-4 contents to be keyword searchable.

The first function requires the BIFS reconstruction method, which is a scene description language related to the definition of spatial synchronization of media that composes contents. BIFS, which describes scenes, provides a way of organizing multimedia for playback, but it is not defined for organizing information for some stream retrieval. To provide this functionality, BIFS must contain additional information needed to retrieve the scene in addition to the information of the scene itself. To this end, the present invention adds a node for constructing keyword information to BIFS. In this node, the corresponding position of the stream and the reproduction related information can be retrieved by keywords.

As a second feature, BIFS does not provide a time synchronization method, which requires additional time processing nodes for time synchronization of media and playback of specific portions of the media stream. This node configuration includes the functions for real time control within objects as well as the time synchronization function between objects. BIFS provides nodes that control and monitor each media object, and nodes that manage multiple objects and adapt their time changes. The MediaContorl node is responsible for object control such as playback, looping, and sound inactivation. The MediaSensor node controls the activation and inactivity of the object during playback. The TemporalGroup node stores information about the simultaneous start and end of objects constituting the screen, and the Temporal Transform node stores the changing information of the object being played. This information is supported on a per-object basis and time synchronization between and within objects is not defined. In the present invention, in addition to the function of handling the time information between objects as described above, to support the playback of some streams for a given time from a specified position.

The MPEG-4 system according to the present invention will be described with reference to FIG.

In order for an MPEG-4 stream to have the above functions, an MPEG-4 authoring system must include scene composition, keyword inputters, timeline editors, object descriptors, multimedia players, and BIFS node generators, including generic media objects. 2 is a block diagram of an MPEG-4 authoring tool system for enabling keyword search proposed in the present invention.

As shown in FIG. 2, the multimedia input data 10 is encoded 28 using the MPEG-4 authoring tool 20, stored in the output database 30 as an MP4 file, and the user installs the MPEG in a wearable PC. -4 decodes data 35 from output database 30 using multimedia player 40 to display via display control unit 50 in wearable PC.

In the present invention, the authoring tool 20 includes a scene definition unit 21, a keyword input unit 22, a content input unit 23, a timeline editor 24, a multimedia player 25, and a BIFS node generator 26. The multimedia player 40 is configured to include a keyword searcher 42, a content searcher 44, and a time searcher 46.

In order to search for a keyword, a keyword must be input at an appropriate location using a keyword inputter in the authoring tool. As shown in FIG. 3, a keyword (32, 34, 36) is input as a scene description at a location where a keyword of a video stream is to be input. . The inputted keyword constitutes a scene by the BIFS generator 26 and allows the MPEG-4 file information and the keyword information to be simultaneously stored together with the MPEG-4 file.

Searching by inputting keyword information as described above may be equally applied to an online MPEG-4 player and an offline MPEG-4 player. An online MPEG-4 player refers to a case where MPEG-4 is streamed and reproduced from a server, and an offline MPEG-4 player refers to a case where an MPEG-4 file is independently reproduced. Keyword search in MPEG-4 player accesses BIFS information and searches for the entered keyword. As a search result, the MPEG-4 file name and the playing time are searched. If a user selects from the desired keyword search result, playback is possible from the searched position.

In the present invention, it is possible to search the time together with the keyword search so that the user can input the desired time and play from the corresponding time. Table 1 shows the information organization of keyword node and time node added to BIFS.

4 shows a system configuration diagram of a WPS that is a wearable PC. In FIG. 4, the main memory 460, the system installation memory 470, and the auxiliary storage device 450 are connected to the CPU 410, and various software operation programs and input buttons 480, a CMOS camera 424, a microphone / The data input from the speaker 430 or the Bluetooth device 440 is processed and stored. The CPU 410 is also connected with a TFT-LCD 422 for outputting processing data, a buzzer 426, a vibrator 428, a microphone / speaker 430, and the like. In addition, the CPU 410 is connected to the USB host 412, USB OTG 414, JTAG 416, UART console 418, VGA video card 432, the power supply 490, and the battery unit 495 However, the detailed description thereof will be omitted since it is well known to those skilled in the art. Table 2 shows the hardware specifications of the WPS and Table 3 shows the software specifications. Here, the hardware and software specifications of the WPS are shown as shown in Tables 2 and 3 to the extent that the specifications of the wearable PC to which the present invention is applied are referred to.

Table 4 below shows the input and output data of the MPEG-4 player and the authoring tool in the present invention.

Input data Output data MPEG-4 Player MP4 file Multimedia stream MPEG-4 Authoring Tool Video, audio, image, text, 2D / 3D graphics MP4 file

Hereinafter, the multimedia generation algorithm of the authoring tool of the present invention and the multimedia reproduction algorithm of the player.

First, the multimedia generation algorithm of the MPEG-4 authoring tool will be described.

1) Insert a media file, text or image file, or sound file into the scene.

2) Configure the scene (BIFS node)

3) Insert a keyword in each specific frame.

4) The scene is composed together with keyword information.

5) Encode the BIFS node.

6) Create an MP4 file.

Next, the multimedia reproduction algorithm of the MPEG-4 player will be described.

1) Open an MP4 file.

2) Decode MP4 files (video, audio, BIFS / OD decoding)

3) Check the network in the DMIF stack. (Local or remote)

4) Synchronization layer management (time information extraction and synchronization processing start)

5) Scan the contents of the scenegraph.

6) The decoded media unit is taken from the synthesis buffer.

7) The synthesized scene is output to the output device.

8) When the user searches for a keyword, the keyword search is performed with the BIFS node, and the user synchronizes and reproduces the searched BIFS node.

As described above, the present invention has described an authoring tool that allows general users to develop MPEG-4 applications and an MPEG-4 player in WPS so that MPEG-4 applications can be played in a wearable PC, WPS. The authoring tool allows you to create multimedia authorings, including keyword entry, and play the results on an MPEG-4 player. An advantage of the present invention is that a user can input a keyword and compose a multimedia stream through an interactive interface when authoring content, so that a desired position can be searched to play the stream. The result of the present invention is expected to utilize the Internet broadcasting application field such as distance education under the mobile computing environment.

Claims (5)

In a multimedia player that retrieves and plays multimedia data, By inputting a desired keyword including a keyword searcher, the keyword inserted at an appropriate position of the video stream using the keyword input device in the authoring tool on the server side is inputted as a scene description and a binary format for scene (BIFS) node generator. And searching for a desired file corresponding to the input keyword from a multimedia data file database stored in a scene. The method of claim 1, wherein the multimedia playback method of the MPEG-4 player comprises: 1) opening an MP4 file; 2) decoding the MP4 file; 3) checking the network in the DMIF stack; 4) synchronization layer management step; 5) scanning the memory image of the scenegraph; 6) retrieving the decoded media unit from the synthesis buffer; 7) outputting the synthesized scene to the output device; 8) When the user performs a keyword search, performing a keyword search with the BIFS node, and synchronizing and playing from the searched BIFS node. In the authoring tool for creating and storing multimedia data played in the multimedia player, A keyword input unit for inputting a keyword as a scene description at an appropriate position of the video stream; And And a binary scene format (BIFS) node generator configured to construct a video stream into which the input keyword is inserted, and store the scene in a multimedia file database. Authoring tool used to produce a multimedia application service to retrieve a desired file corresponding to the input keyword from a file database. 4. The authoring tool of claim 3, wherein the multimedia file further comprises a time processing node for time synchronization of the multimedia file and reproduction of a specific part, in addition to the binary scene format information necessary for searching a scene. The method of claim 3, wherein the multimedia generation method of the MPEG-4 authoring tool comprises: 1) inserting a media file, a text or image file, or a sound file into a scene; 2) constructing a scene; 3) inserting a keyword into each specific frame; 4) constructing a scene with keyword information; 5) encoding a BIFS node; And 6) creating an MP4 file.

Images