JPH1040204A - Distributed multimedia system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a distributed multimedia system by which plural servers cooperatively realize multimedia information providing service. SOLUTION: This system is provided with an information providing system for executing multimedia service and plural conversion servers for processing media data. Then, a processing assignment deciding part 107 of a information providing server 101 decides to which one of the conversion servers 102A or 102B a processing is requested as against a request from a terminal 103 by negotiating with another processing assignment deciding part so that various kinds of media data are efficiently processed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system for providing multimedia information, and more particularly, to a system in which recording media data processing is performed by a plurality of servers and which processing is dynamically determined by which server. The present invention relates to a distributed multimedia system that enables a multimedia service without concentrating a load on a multimedia system.

[0002]

2. Description of the Related Art In recent years, various multimedia server systems have been developed with the development of digital technology, and users can receive multimedia information on demand. In these systems, the server can supply a plurality of videos at the same time, enabling a smooth video service without interruption.

Japanese Patent Application Laid-Open No. Hei 5-216800 discloses an invention in which a fixed central management server converts a compression method and a display color of media data at the request of a client terminal.

[0004]

However, if media data conversion processing is concentrated on one centralized management server, the server cannot execute the processing completely and there is a problem that some terminals cannot receive the multimedia service. There is.

Further, if one server supports conversion of all compression methods, various compression / decompression modules are required, and there is a problem in cost.

Further, if one server supports conversion into various transmission bands, it must be transmitted to the network at various transmission speeds, which causes a problem that real-time transmission becomes difficult. This is because time scheduling of real-time transmission becomes irregular.

Further, if one server supports the synthesis of a plurality of media data, there is a problem that a large amount of video memory and a load of processing for accessing the memory increase.

In a configuration in which one server supports various types of media processing functions, there is a problem that the cost performance is reduced due to scalability.

[0009]

SUMMARY OF THE INVENTION Therefore, according to the present invention, there is provided processing assignment determining means for determining which multimedia device performs media data processing at the time of a multimedia service, so that various types of compression system conversion, Generation of media data in various transmission bands, synthesis of a large amount of media data, and the like can be realized, and a configuration with high expandability and good cost performance can be provided.

[0010]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention according to claim 1 of the present invention provides an information providing server for providing multimedia services in a distributed multimedia system in which a plurality of multimedia devices cooperate to provide information providing services; A conversion server that processes the media data, one or more of each of three types of multimedia devices of a display terminal that performs a transmission request and display of the media data, and a network that transmits information, and the multimedia device includes: , A media processing unit that performs media data processing in real time, a processing allocating unit that negotiates with other multimedia devices to determine what processing is actually performed by which multimedia device, and a processing allocation unit Communication unit that exchanges important information and media data with other multimedia devices via a network. The information providing server includes a media recording unit that records and reproduces media data, and the display terminal includes a display unit that displays the media data. By performing the negotiation and determining the allocation of the media processing by the processing allocation determining unit, it is possible to efficiently process various media data.

[0011] The invention according to claim 2 is characterized in that the media data is video, audio or still image.

According to a third aspect of the present invention, the processing allocating unit allocates the processing so that the processing is performed by a multimedia device having the largest processing capability of the media processing unit, thereby further improving the processing of the media data. It is possible to do well.

[0013] The invention described in claim 4 is characterized in that the processing performed by the media processing unit of the conversion server is a processing for converting the compression method of the media data, so that the terminal uses a compression method that cannot be reproduced by the terminal. The service of the compressed media data can be efficiently performed.

[0015] The invention according to claim 5 is characterized in that the processing performed by the media processing unit of the conversion server is a conversion processing of a transmission band of the media data, whereby a terminal connected to a low-speed network is provided. However, the service of media data compressed in a high transmission band can be efficiently provided.

[0015] The invention according to claim 6 is characterized in that the processing performed by the media processing unit of the conversion server is processing of synthesizing a plurality of media data and creating new synthesized media data. Combination can be realized efficiently.

(Embodiment 1) The first embodiment relates to a distributed multimedia system. This system is designed to record the media data requested by the display terminal, the quality of the media data, the compression method, and the like. It is realized by the cooperative operation of the server and provided to the display terminal.

As shown in FIG. 1, this system includes an information providing server 101 for providing multimedia services and conversion servers 102A and 102B for processing media data.
And a display terminal 103 for requesting and displaying media data
One or more of the three types of multimedia devices 104, and a network 105 for transmitting information. The multimedia device 104 includes a media processing unit 106 for processing media data, A process allocation determining unit 107 for negotiating and determining with which multimedia device the process is to be executed by another multimedia device, and exchanging information and media data necessary for process allocation with other multimedia devices via a network. The information providing server includes a media recording unit 109 for recording and reproducing media data, and the display terminal includes a display unit 110 for displaying media data.

The information flowing through the network 105 includes a packet 201 shown in FIG. 2 for the processing allocating unit 107 to negotiate with another multimedia device and a packet shown in FIG. 3 for transferring media data to another multimedia device. 3
01 and two types.

The operation of the distributed multimedia system will be described. First, the display terminal 103 requests the information providing server 101 to transmit media data in response to a request from a user, a timer operation, or the like.

The request from the display terminal 103 is
The request is transmitted to the network 105 via the third communication unit 108, and the communication unit 108 of the information providing server 101 receives the request, and is transmitted to the process assignment determining unit 107 of the information providing server 101. Hereinafter, all information transmission between multimedia is performed via the communication unit 108.

In addition to the media data transmission request, the display terminal 103 can declare the desired media data format to the information providing server 101. The form of the media data includes, for example, a compression method, display resolution, and the number of audio channels.

Here, conversion of the compression method will be described as an example. A request packet from the terminal 103 at this time is shown at 401 in FIG. The packet 401 indicates a request for the video A and a compression method (JPEG) that can be reproduced by the own display terminal.

Processing assignment determining unit 1 of information providing server 101
In step 07, the compression system of the video A stored in the media recording unit 109 is checked, and if the compression system (JPEG) is declared from the display terminal 103, the video A is transmitted to the display terminal 103 as it is.

However, here, the image A is compressed by the compression method (MP
EG1) is assumed to have been compressed. At this time, the process allocation determining unit 107 of the information providing server 101
An inquiry is made to the process allocation determining unit 107 of the 02A and 102B as to whether the compression method (MPEG1) can be converted to the compression method (JPEG) using the packet 501 of FIG.

When the conversion of the compression method is possible, the processing allocation determining unit 107 of the conversion servers 102A and 102B returns a conversion enable notification to the information providing server 101.

Processing assignment determining unit 1 of information providing server 101
07 determines which conversion server to request the conversion of the compression method based on this response.

When there is only one conversion server that has returned a response, the request is sent to that server. In the case of a plurality of conversion servers, there is a method of requesting the conversion server that returned the response first.

Further, the processing allocation determining units of the conversion servers 102A and 102B each measure the processing amount (load level) being executed by the media processing unit in its own device, and measure it by the processing allocation determining unit of the information providing server 101. You can also reply to. In this case, the information providing server 101 requests the conversion server having room to perform the processing.

Here, it is assumed that conversion server 102A has returned reply packet 601 shown in FIG. 6, and conversion server 102B has returned reply packet 701 shown in FIG.

Processing assignment determining unit 1 of information providing server 101
07 compares the load level 4 of the conversion server 102A with the load level 5 of the conversion server 102B, and determines a conversion request of the compression method to the conversion server 102A having a smaller load level.

When the request is determined, the information providing server 101 immediately transmits the video A compressed by the compression method (MPEG1) to the conversion server 102A using the packet 801 shown in FIG.

The media processing unit 10 of the conversion server 102A
6 knows that it has been selected from the transfer of the video A, and converts the compression method of the video A from MPEG1 to JPEG. Further, the conversion server 102A converts the compression method (JPEG) video A in real time while converting the compression method into a packet 90 shown in FIG.
1 is transferred.

By this series of operations, the display terminal 103 can receive the video A of the compression system (JPEG),
It can be converted into a format that can be displayed by the media processing unit 106 and displayed on the display unit 110.

(Embodiment 2) FIG. 10 is a conceptual diagram showing a configuration of a distributed multimedia system according to a second embodiment of the present invention. In the second embodiment, the display terminal 1
A method for converting the information amount (transmission band) of media data for a certain period of time when the communication unit of No. 03 supports only a low communication speed or is connected to a network having a low transmission capacity.

In FIG. 10, the display terminal 103 is connected to a low-speed network 120 having a low communication speed. Others are the same as those of the first embodiment.

In this embodiment, the display terminal 103 transmits the media data transmission request together with the communication unit 1 of the display terminal 103.
08 indicates the communication speed that can be actually received by the information providing server 10.
1 to the processing assignment determining unit 107. This transmitted packet is shown at 1101 in FIG.

The packet 1101 describes a transmission request for the video A and a communication speed (1.5 Mbps) at which the user can receive the video A. The processing allocation determining unit 107 of the information providing server 101 checks the transmission band of the video A and
If the communication speed is less than or equal to the communication speed (1.5 Mbps) declared by the user, the video A is transmitted to the display terminal 103 as it is.

However, here, the transmission band of the image A is 5M
bps. At this time, the information providing server 101
Of the conversion server 102A, 102
Using the packet 1201 in FIG. 12, an inquiry is made to the processing allocation determination unit 107 for B as to whether the transmission rate of 5 Mbps can be converted to 1.5 Mbps by increasing the compression rate of the media data or reducing the number of frames. Do it.

When the conversion of the transmission band is possible, the process allocation determining unit 107 of the conversion servers 102A and 102B returns a conversion enable notification to the information providing server 101.

Here, it is assumed that conversion server 102A has returned a reply packet 1301 shown in FIG. 13 and conversion server 102B has returned a reply packet 1401 shown in FIG. The processing allocation determination unit 107 of the information providing server 101 determines the load level 4 of the conversion server 102A and the conversion server 102B
Is compared with the load level 5, and a request for conversion of the transmission band is determined for the conversion server 102A having a smaller load level.

When the request is determined, the information providing server 101 immediately transmits the video A compressed with a transmission bandwidth of 5 Mbps to the conversion server 102A using the packet 1501 shown in FIG.

Media processing unit 10 of conversion server 102A
No. 6 knows that he / she has been selected because the video A has been transferred, and changes the transmission band of the video A from 5 Mbps to 1.5 Mbps.
Convert to ps. Further, the conversion server 102A transfers the video A having the transmission bandwidth of 1.5 Mbps to the display terminal 103 using the packet 1601 shown in FIG.

Through this series of operations, the display terminal 103 can receive the video A having a transmission band of 1.5 Mbps, convert it into a format that can be displayed by the media processing unit 106, and display it on the display unit 110. Becomes

(Embodiment 3) The third embodiment shows a method of synthesizing media data when the display terminal 103 requests new media data obtained by synthesizing a plurality of media data. The configuration is the same as that of the first embodiment.

In this embodiment, the information providing server 101
The image A shown in FIG.
It is assumed that the display terminal 103 has requested the still image A and the still image B shown in FIG.

At this time, the information providing server 101
The positional relationship between the still image A and the still image B is determined as in the composite image shown in FIG. At this time, the method of determining the positional relationship may be uniquely determined from the beginning, or some kind of relationship information may be recorded. There is also a method of determining each time from the display space and the importance of the media data.

First, the display terminal 103 transmits a transmission request for the video A, the still image A, and the still image B to the processing assignment determining unit 107 of the information providing server 101. This transmitted packet is shown at 1101 in FIG.

Processing assignment determining unit 1 of information providing server 101
07 determines the method of synthesizing the video A, the still image A, and the still image B, and determines the processing allocation determining unit 1 of the conversion servers 102A and 102B.
Inquiry as to whether or not media data can be synthesized by the determined synthesis method is sent to packet 2 in FIG.
101.

The processing allocation determining unit 107 of the conversion servers 102A and 102B returns a conversion enable notification to the information providing server 101 when the media data can be combined.

Here, the conversion server 102A transmits the reply packet 2201 of FIG.
It is assumed that the reply packet 2301 has been replied.

Processing allocation determining unit 1 of information providing server 101
07 compares the load level 4 of the conversion server 102A with the load level 5 of the conversion server 102B, and determines a request for conversion of the transmission band to the conversion server 102A having a smaller load level.

When the request is determined, the information providing server 101 immediately sends the packet 2401 of FIG.
, A still image A using the packet 2501 in FIG. 25, and a still image B using the packet 2601 in FIG.

Media processing unit 10 of conversion server 102A
Numeral 6 knows that it has been selected from the transfer of the video A, the still image A, and the still image B, and synthesizes the media data to generate a synthesized image.

Further, the conversion server 102A transfers the synthesized video to the display terminal 103 using the packet 2701 shown in FIG. Through this series of operations, the display terminal 103 can receive the composite video shown in FIG. 27, convert it into a format that can be displayed by the media processing unit 106, and display it on the display unit 110.

[0055]

As is apparent from the above description, the distributed multimedia system of the present invention is provided with a processing assignment determining means for determining which multimedia device processes media data at the time of a multimedia service. As a result, various types of media data can be efficiently processed.

Further, it is possible to realize compression system conversion, generation of media data of various transmission bands, synthesis of a large amount of media data, and the like, thereby improving the cost performance and expandability of the system.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a distributed multimedia system according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating a message packet according to the first embodiment;

FIG. 3 is a configuration diagram of a media packet in the first embodiment.

FIG. 4 is a configuration diagram of a media request packet according to the first embodiment;

FIG. 5 is a configuration diagram of a processing request packet according to the first embodiment;

FIG. 6 is a configuration diagram of a request reply packet from the conversion server A according to the first embodiment.

FIG. 7 is a configuration diagram of a request reply packet from the conversion server B according to the first embodiment.

FIG. 8 is a configuration diagram of an original video packet according to the first embodiment.

FIG. 9 is a configuration diagram of a converted video packet according to the first embodiment;

FIG. 10 is a configuration diagram of a distributed multimedia system according to the first embodiment of the present invention.

FIG. 11 is a configuration diagram of a media request packet according to the second embodiment.

FIG. 12 is a configuration diagram of a processing request packet according to the second embodiment;

FIG. 13 is a configuration diagram of a request reply packet from the conversion server A in the second embodiment.

FIG. 14 is a configuration diagram of a request reply packet from the conversion server B in the second embodiment.

FIG. 15 is a configuration diagram of an original video packet according to the second embodiment.

FIG. 16 is a configuration diagram of a converted video packet according to the second embodiment.

FIG. 17 is a diagram showing an original image according to the third embodiment;

FIG. 18 is a diagram showing an original still image according to the third embodiment.

FIG. 19 is a diagram showing a composite video according to the third embodiment;

FIG. 20 is a configuration diagram of a media request packet according to the third embodiment;

FIG. 21 is a configuration diagram of a processing request packet in the third embodiment.

FIG. 22 is a configuration diagram of a request reply packet from the conversion server A in the third embodiment.

FIG. 23 is a configuration diagram of a request reply packet from the conversion server B in the third embodiment.

FIG. 24 is a configuration diagram of an original video packet according to the third embodiment;

FIG. 25 is a configuration diagram of an original still image A packet according to the third embodiment.

FIG. 26 is a configuration diagram of an original still image B packet according to the third embodiment;

FIG. 27 is a configuration diagram of a composite video packet according to the third embodiment.

[Explanation of symbols]

101 information providing server 102A conversion server A 102B conversion server B 103 display terminal 104 multimedia device 105 network 106 media processing unit 107 processing allocation determining unit 108 communication unit 109 media recording unit 110 media display unit 120 low speed network 201 message packet 301 media packet 401 Media request packet in compression method conversion 501 Processing request packet in compression method conversion 601 Request response packet from conversion server A in compression method conversion 701 Request response packet from conversion server B in compression method conversion 801 Original video packet in compression method conversion 901 Conversion video packet in compression system conversion 1101 Media request packet in transmission band conversion 1201 Processing request packet 1301 request reply packet from conversion server A in transmission band conversion 1401 request response packet from conversion server B in transmission band conversion 1501 original video packet in transmission band conversion 1601 converted video packet in transmission band conversion 2001 in media synthesis Media request packet 2101 Processing request packet in media composition 2201 Request response packet from conversion server A in media composition 2301 Request response packet from conversion server B in media composition 2401 Original video packet in media composition 2501 Original still image A packet in media composition 2601 Original still image B packet in media composition 2701 Composite video packet in media composition

Claims (6)

[Claims] In a distributed multimedia system in which a plurality of multimedia devices cooperate to provide a multimedia information providing service, an information providing server for providing a multimedia service, a conversion server for processing media data, A media processing unit that includes one or more of each of three types of multimedia devices of a display terminal that performs transmission request and display, and a network that transmits information, wherein the multimedia device performs media data processing in real time. And a processing allocating unit that negotiates with other multimedia equipment to determine what processing is actually executed by which multimedia equipment, and information and media data necessary for processing allocation to another multimedia equipment via a network. A communication unit for communicating with the multimedia device, wherein the information providing server A distributed multimedia system, comprising: a media recording unit that records and reproduces media data; and the display terminal includes a display unit that displays the media data. 2. The distributed multimedia system according to claim 1, wherein the media data is video, audio, or a still image. 3. The distributed multimedia system according to claim 1, wherein the processing allocating unit performs the processing allocating so that the processing is performed by the conversion server having the most available processing capacity of the media processing unit. 4. The distributed multimedia system according to claim 1, wherein the processing performed by the media processing unit of the conversion server is a processing for converting a compression method of the media data. 5. The distributed multimedia system according to claim 1, wherein the processing performed by the media processing unit of the conversion server is a conversion processing of a transmission band of the media data. 6. The process according to claim 1, wherein the process performed by the media processing unit of the conversion server is a process of combining a plurality of media data and creating new combined media data.
A distributed multimedia system as described.