WO2004077832A1 - 映像受信装置、映像送信装置および映像伝送システム - Google Patents
映像受信装置、映像送信装置および映像伝送システム Download PDFInfo
- Publication number
- WO2004077832A1 WO2004077832A1 PCT/JP2004/001989 JP2004001989W WO2004077832A1 WO 2004077832 A1 WO2004077832 A1 WO 2004077832A1 JP 2004001989 W JP2004001989 W JP 2004001989W WO 2004077832 A1 WO2004077832 A1 WO 2004077832A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- layer
- band
- receiving
- bandwidth
- Prior art date
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 145
- 230000033001 locomotion Effects 0.000 claims abstract description 37
- 230000003247 decreasing effect Effects 0.000 claims 1
- 238000004364 calculation method Methods 0.000 description 28
- 238000010586 diagram Methods 0.000 description 25
- 238000000034 method Methods 0.000 description 18
- 230000008569 process Effects 0.000 description 11
- 230000008859 change Effects 0.000 description 6
- 238000012508 change request Methods 0.000 description 5
- 238000013523 data management Methods 0.000 description 5
- 238000007726 management method Methods 0.000 description 5
- 230000009467 reduction Effects 0.000 description 5
- 230000015556 catabolic process Effects 0.000 description 3
- 238000006731 degradation reaction Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/637—Control signals issued by the client directed to the server or network components
- H04N21/6377—Control signals issued by the client directed to the server or network components directed to server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6582—Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number
Definitions
- the present invention relates to a video transmission system for transmitting video through a network.
- Video data that has been encoded and encoded once can not change the video quality even if the transmission band changes.
- the band indicates a transmission bit rate.
- MPEG-4 FGS Full Granularity Scalability
- ISO / IEC 14496-2 Amendment 2: 2001 is a layer code having a high degree of freedom especially in band selection.
- the video data encoded by MPEG-4 FGS is a moving picture stream for improving the moving picture quality of the basic layer, which is a moving picture stream that can be decoded alone, and one basic layer. Composed of at least one or more enhancement layers.
- the basic layer is low-band, low-quality image data, and by adding the enhancement layer to this according to the band, high-quality image processing with high freedom is possible.
- the total data size of the enhancement layer to be transmitted is It is possible to control and adapt to various bands, and it is possible to transmit a picture of quality according to the band.
- any video coding method has a role of performing compression coding so that the input video can be transmitted in a predetermined band, and controlling the band of the video data to an appropriate value. Therefore, when the bandwidth of the video data is higher than the bandwidth of the transmission path, the video data can not be transmitted in real time, and the receiving terminal not only causes a delay in the video, but also the video data is lost in the network. The video stops (disruption occurs). Conversely, if the bandwidth of the video data is lower than the bandwidth of the transmission channel, no delay occurs but the video quality is extremely degraded. In particular, when real-time capability and high-quality video are required, such as TV telephone and live relay, it is necessary to match the bandwidth of the video data to the bandwidth of the transmission line.
- the server generates a bit 1 generated in advance and a plurality of video streams of different rates in response to a bit rate change request from the receiving terminal.
- One of them is selected for transmission (refer to, for example, Japanese Patent Application Laid-Open No. 10-36266, page 1, page 1).
- FIG. 1 is a diagram showing an example of the configuration of a conventional video transmission system.
- the server 10 transmitting the video stream 1 and the ream 10 receives the transfer rate change request from the client 20 receiving the video stream in the bit rate switching unit 11, and receives from the different bit rate video data storage unit 13 Select the video data of the corresponding video and send it to the client 20.
- the client 20 receives the video data transmitted from the server 10 by the video data reception unit 21, outputs the data to the data buffer management unit 23, and receives the reception speed to the reproduction data management unit 25. Output.
- the data buffer management unit 23 stores the video data input from the video data reception unit 21 in the overhead buffer, manages the storage status, and outputs the stagnant data status to the reproduction data management unit 25.
- the video data is Read out from the buffer and output to the video decoding display unit 27.
- the video decoding display unit 27 outputs a data read request to the data buffer management unit 23, and decodes and displays the video data input from the data buffer management unit 23.
- the reproduction data management unit 25 judges the transfer bit rate change using the stagnant data state input from the data buffer management 23 and the reception speed input from the video data reception unit 21 and changes the change bit rate Output to request section 29.
- the transfer bit rate change determination method in the reproduction data management unit 25 when the staying data exceeds the upper threshold value, the average value of the reception speeds up until immediately before is calculated to be a bit rate reduction request. If the stagnant data falls below the lower threshold, the average value of the reception rates up to the previous time is calculated and used as the bit rate up request.
- the rate change request unit 29 transmits a bit rate change request to the server 10 using the bit rate input from the reproduction data management unit 25.
- the server 10 selects and transmits suitable data from video data of different bit rates. By this, it is possible to receive the video without interruption at the receiving terminal.
- An object of the present invention is to provide a network including a wireless network whose transmission band varies It is an object of the present invention to provide a video transmission system capable of realizing uninterrupted video transmission even in the case where the bandwidth greatly changes due to the movement of the receiving terminal in the work.
- the video receiving device is a video receiving device for receiving hierarchically encoded data, and the transmitting means for transmitting the specific information of the video receiving device; and based on the transmitted specific information.
- band receiving and receiving means for receiving hierarchically encoded data divided into a plurality of channels.
- a video transmitting apparatus comprises: receiving means for receiving specific information of a video receiving apparatus; and control for controlling a band of hierarchically encoded data divided using the received specific information. And transmission means for transmitting the band control and the divided hierarchically encoded data in another channel.
- a video transmission system is a video transmission system that divides hierarchically encoded data into a plurality of channels and transmits the data from another video transmission apparatus to a video reception apparatus through a network using different channels
- the transmitting device comprises: receiving means for receiving the specific information of the video receiving device; and control means for controlling the bandwidth of the divided layer encoded data using the received specific information, and the video receiving device And transmitting means for transmitting the specific information.
- Fig. 1 is a diagram showing an example of the configuration of a conventional video transmission system
- FIG. 2 is a diagram showing a configuration of a video transmission system according to Embodiment 1 of the present invention
- FIG. 3A is a diagram showing an example of a structure of coded data when using M PEG-4F G S coding.
- FIG. 3B is a diagram showing an example of channel division results for the encoded data of FIG. 3A.
- Fig. 4 is a diagram showing an example of a video list
- FIG. 5 is a diagram for explaining the concept of Embodiment 1;
- FIG. 6 is a flow chart showing the operation of the video transmission apparatus corresponding to the first embodiment,
- FIG. 7 shows the operation of the image receiving apparatus corresponding to the first embodiment.
- FIG. 8A is a sequence diagram showing exchange of main information when the terminal moves in the video transmission system according to the first embodiment.
- FIG. 8B is a sequence diagram showing exchange of main information in a steady state in the video transmission system according to the first embodiment.
- FIG. 9 is a block diagram showing an example of a video transmission system based on MP E G 4 F G S to which the first embodiment is applied.
- FIG. 10 is a diagram showing the configuration of a video transmission system according to Embodiment 2 of the present invention
- FIG. 11 is a diagram for explaining the concept of Embodiment 2.
- Fig. 12 is a flowchart showing the operation of the video transmission apparatus corresponding to the second embodiment
- FIG. 13 is a diagram showing the configuration of a video transmission system according to Embodiment 3 of the present invention
- FIG. 14 is a diagram for explaining the concept of Embodiment 3.
- FIG. 15 is a flow chart showing the operation of the video transmission apparatus corresponding to the third embodiment
- Fig. 16 A is a diagram showing an example of the structure of coded data when using M P E G-4 F G S coding;
- Figure 16 B shows an example of the result of channel division for the coded data of Figure 16 A in steady mode
- Figure 16 C shows an example of the result of channel division for the encoded data of Figure 16 A in mobile mode
- FIG. 17 is a diagram showing a configuration of a video transmission system according to Embodiment 4 of the present invention
- FIG. 18 is a diagram for explaining the concept of Embodiment 4.
- Fig. 19 A is a diagram showing an example of reception layer information
- Fig. 19 B is a diagram showing another example of reception layer information
- FIG. 20 is a flowchart showing an operation of the video transmission apparatus corresponding to the fourth embodiment
- FIG. 21 is a flowchart showing an operation of the video receiving apparatus corresponding to the fourth embodiment.
- the gist of the present invention is a system in which a hierarchically encoded video stream is transmitted to a plurality of terminals, when hierarchically encoded data is divided into a plurality of layers and transmitted on different channels (for example, information from the receiving terminal (eg, Dynamic control of hierarchical bandwidth by using handover, user request, etc.).
- the band of the base layer is used.
- a video transmission system including a radio and transmitting a layer coded video stream in an environment of large band fluctuation
- a large band fluctuation is expected due to movement of a terminal, etc.
- the band of the base layer is used.
- FIG. 2 is a diagram showing a configuration of a video transmission system according to Embodiment 1 of the present invention.
- This video transmission system comprises a video transmission device (hereinafter also referred to as “transmission terminal”) 100 for transmitting video, a video reception device (hereinafter also referred to as “reception terminal”) for reception of video, and video transmission And a network 180 for relaying the video transmitted from the device 100 to the video receiver 150. That is, the video transmitted from the video transmission device 100 is transmitted to the video reception device 150 through the network 180.
- Video transmission device 100 is a video input unit 102, a video coding unit 104, a channel It has a loop division unit 106, a video transmission unit 108, a terminal information reception unit 110, and a band calculation unit 112.
- the video input unit 102 outputs an image provided from the outside or generated by the device 100 to the video coding unit 104 for each frame.
- the video coding unit 104 hierarchically codes the image output from the video input unit 102 as an input image, and outputs the obtained coded data to the channel division unit 106.
- the video coding unit 104 comprises a basic layerer (B) for the input image and an enhancement layer (EL) for improving the image quality.
- EL enhancement layer
- Generate data for example, see Figure 3A.
- the bandwidth of the base layer is given from the bandwidth calculation unit 112.
- the image quality can be improved by adding the enhancement layer to the base layer.
- the enhancement layer can be divided from lower layers, and the quality improvement can be controlled according to the amount of data of the enhancement layer added to the base layer.
- the channel division unit 106 divides the encoded data output from the video coding unit 104 into a plurality of pieces, and outputs the divided data to the video transmission unit 100 together with the video list.
- the division band of the enhancement layer is given from the band calculation unit 112.
- FIG. 3B an example of the channel division result is as shown in FIG. 3B. Details of the process will be described later.
- an example of the video list is, for example, as shown in FIG.
- the video list shows channel numbers, layer names, and the bandwidth required to receive each layer. Note that the video list is not limited to the one shown in FIG. 4 and may be a band for each channel.
- the video transmission unit 108 transmits the divided data and the video list output from the channel division unit 106 to the network 180 by separate channels.
- the band and channel number of each layer are indicated. Multicast the selected video list.
- the channel number is indicated by, for example, a multicast address.
- multicast transmission is a scheme in which data is transmitted only to a terminal that selects reception for a channel on which data is transmitted from one transmitting terminal, and in the case where a plurality of receiving terminals perform reception. Also in the same transmission path, there is no duplication in the data to be transmitted, so it is a transmission method with good transmission efficiency.
- the transmission method of the video stream is not limited to multicast transmission.
- the terminal information receiving unit 110 receives the terminal information transmitted from the receiving terminal (video receiving apparatus 150), and outputs the terminal information to the band calculating unit 112.
- the terminal information is information (terminal movement information) indicating that the receiving terminal is moving or starting moving.
- the band calculation unit 112 calculates the band of the base layer and the division band of the enhancement layer using the terminal information output from the terminal information receiver 110, and the former (the band of the base layer) The latter (division band of the enhancement layer) is output to the channel division unit 106 to the coding unit 104.
- band calculation section 112 reduces the band (bit rate) of the base layer to an extreme and sets it to an ultra-low bit rate (see FIG. 5). As a result, uninterrupted video reception becomes possible. At this time, the image quality is compensated by the enhancement layer. Details of the process will be described later.
- the video receiving apparatus 150 has a terminal information transmitting unit 152, a video receiving unit 154, a video decoding unit 156, and a video display unit 158.
- the terminal information transmission unit 1 52 determines that the terminal is moving or starts moving. When the terminal movement information is disconnected, the terminal movement information is transmitted to the video transmission device 100 and output to the video reception unit 1 5 4.
- the video receiving unit 1 54 receives the video list transmitted from the video transmitting unit 100, selects a plurality of receivable video data in the video list, and receives the video data. Output to
- the video reception unit 154 receives the video list transmitted from the video transmission device 100, compares the band indicated in the video list with the current reception band, and Determine a plurality of receivable channel numbers in order from the bottom.
- the terminal movement information is input from the terminal information transmission unit 152, at least the channel of the base layer is received.
- the unit 154 receives the video data of the determined channel number, outputs the received video data to the video decoding unit 156, and measures the current reception band from the amount of the received video data.
- the video decoding unit 1 56 decodes the video data (coded data) output from the video reception unit 1 5 4 and outputs the video obtained by decoding to the video display unit 1 5 8 .
- the video display unit 1 5 8 displays the video output from the video decoding unit 1 5 6 on the screen.
- the video display unit 1 58 is configured of a display device.
- the flowchart shown in FIG. 6 is stored as a control program in a storage device (for example, ROM, flash memory, etc., not shown) of the video transmission apparatus 100, and is executed by the CPU (not shown).
- a storage device for example, ROM, flash memory, etc., not shown
- step S 1 0 0 the image input unit 1 0 2 2 outputs an image forming the image to the image encoding unit 1 0 4 frame by frame.
- step S 1 0 it is determined whether or not the terminal information receiving unit 1 1 0 has received terminal movement information from the receiving terminal (video receiving apparatus 1 5 0). This format If terminal movement information is not received as a result of disconnection (S1 100: NO), the process proceeds to step S1 200. If terminal movement information is received (S1 100: YES), step S1. Proceed to 300.
- step S 1 200 the band calculation unit 1 12 performs stationary mode band calculation processing. Specifically, since the terminal movement information from the receiving terminal is not received, the band B 1 ⁇ BL of the base layer set in advance and the division band B 1 ⁇ EL (1) to B l_E of the enhancement layer are set. Using L (i) (i is the number of division layers set in advance), the band of the base layer is output to the video encoding unit 104, and the division band of the enhancement layer is output to the channel division unit 106. Then, go to step S1400.
- the band calculation unit 112 performs mobile mode band calculation processing. Specifically, since the terminal movement information from the receiving terminal is received, the divided band B-BL of the base layer and the divided band B-EL (1) to B-EL (i) (i is previously set. The set number of division layers) is calculated, and the band of the base layer is output to the video encoding unit 104, and the division band of the enhancement layer is output to the channel division unit 106. Then, the process proceeds to step S1400.
- the base layer band B— B L is, for example,
- the value of N is set to a value that can ensure the minimum bandwidth that can be received without interruption even if the bandwidth changes significantly due to the movement of the terminal.
- the division band of the enhancement layer is, for example, the same as in the stationary mode. To.
- step S 1400 the video encoding unit 104 performs video encoding processing. Specifically, hierarchical coding is performed on the input video from the video input unit 102 to generate coded data composed of the base layer and the enhancement layer (see FIG. 3A), and the channel division unit 106 Output to At this time, the base layer performs coding in the band B-BL output from the band calculation unit 112.
- channel division section 106 performs channel division processing. Specifically, the encoded data output from the video encoding unit 104 and the divided bands B-EL (1) to B-EL (i) of the enhancement layer output from the band calculation unit 112 The extension layer is divided into a plurality of channels, and the divided data including the basic layer is output to the video transmission unit 108 together with the video list (see FIG. 4).
- the base layer is taken as one channel (BL), and the enhancement layer (EL) is divided by a predetermined data amount, and another channel is used. I assume.
- bit rate of each channel should be set bit rate B-BL, B-EL (1), B-EL (2), B_EL (3)
- the enhancement layer (EL) is divided into EL_1, EL_2, and EL_3 (see Figure 3 B). Naturally, the number of divisions is not limited to four.
- step S1600 the video transmission unit 108 performs video transmission processing. Specifically, the divided data (one base layer and a plurality of divided enhancement layers, see FIG. 3B) output from the channel division unit 106 are multicast transmitted to the network 180 on the corresponding separate channels. At the same time, multicast the video list (see Fig. 4) showing the band and channel number of each printer.
- the flowchart shown in FIG. 7 is stored as a control program in a storage device (for example, a ROM, a flash memory, etc.) (not shown) of the video reception device 150, and is executed by a CPU (not shown).
- a storage device for example, a ROM, a flash memory, etc.
- step S 2000 it is determined whether or not the own terminal is moving, more specifically, whether the own terminal is moving or whether to start moving. This determination is made, for example, using information such as the radio wave condition at the terminal and the handover state across the wireless access point. It is also possible for the user to specify the movement of the terminal. As a result of this determination, if the own terminal is moving (S 2000: Y E S), the process proceeds to step S 220. If the own terminal is not moving (S 2000: NO), the process immediately proceeds to step S 2200. .
- step S2200 the terminal information transmission unit 125 performs terminal movement information transmission processing. Specifically, since the own terminal is moving, the terminal movement information is transmitted to the video transmission device 100 and output to the video reception unit 154. Then, go to step S2200.
- step S2200 the video reception unit 154 performs video reception processing. Specifically, a video list transmitted from the video transmission apparatus 100 is received, the band indicated in the video list is compared with the current reception band, and a plurality of receivable can be received in order from the bottom of the channel number. Determine the channel number. However, as described above, when the terminal movement information is input from the terminal information transmission unit 152, at least the channel of the base layer is received. Then, the video data of the determined channel number is received, the received video data is output to the video decoding unit 156, and the current reception band is measured from the amount of the received video data.
- step S2300 the video decoding unit 156 performs video decoding processing. Specifically, the video data (coded data) output from the video reception unit 154 is decoded, and the video obtained by decoding is output to the video display unit 1 5 8. Then, in step S 2400, the video display processing is performed by the video display unit 1558. Specifically, the video output from the video decoding unit 156 is displayed on the screen.
- Fig. 8 A is the case of movement
- Fig. 8 B is the case of steady state.
- the receiving terminal 150 transmits terminal information (specifically, terminal moving information) to the transmitting terminal 100 via the network 180 ((1)).
- terminal information specifically, terminal moving information
- the transmitting terminal 100 calculates the band, specifically, the band (bit rate) of the base layer is extremely reduced to an extremely low bit rate.
- the video list is sent to the receiving terminal 150 via the network cache 180 ((3)).
- receiving terminal 150 When receiving terminal 150 receives the video list from transmitting terminal 100, receiving terminal 150 determines a receiving channel using the received video list ((4)).
- transmitting terminal 100 performs video encoding and channel division for each frame of the input video, and transmits the divided encoded data to receiving terminal 150 through network 180 by separate channels. Do (5).
- the receiving terminal 150 receives the encoded video data from the transmitting terminal 100 by the above reception channel, decodes it, and displays it on the screen ((6)).
- the transmitting terminal 100 does not receive the terminal movement information from the receiving terminal 150, but calculates the bandwidth. Specifically, the bandwidth (bit rate) of the base layer is set to a predetermined bit rate in the steady state. After being set to (1), the video list is transmitted to the receiving terminal 150 through the network 180 (2). The subsequent processing is the same as in the case of movement shown in FIG. 8A, so the description thereof is omitted (however, the numbers in the figure are incremented by one). As described above, according to the present embodiment, when the receiving terminal 150 is moving, the bandwidth of the base layer of the layer coding data is reduced to the minimum, so that the moving receiving terminal at least only the base layer is By receiving, it is possible to receive uninterrupted video reception.
- FIG. 9 is a block diagram showing an example of a video transmission system based on MP EG-4 FGS to which the present embodiment is applied.
- the video server 100 transmits a video stream composed of a base layer and a plurality of (N) enhancement layers to the network and sends it to various terminals 150 a, 150 b, and 150 c.
- terminal 150 a is a high bandwidth terminal (eg, high definition personal computer, digital television, etc.)
- terminal 150 b is a medium bandwidth terminal (eg, medium definition personal computer, etc.)
- 150 c is a low-bandwidth terminal (eg, a cell phone or PDA).
- the high-bandwidth terminal 150a is connected to the high-bandwidth LAN 180a
- the mid-band terminal 150b is connected to the mid-band internet 180b
- the low-bandwidth terminal 150c is It is connected to a low bandwidth mobile network 180c.
- each terminal 150 a, 150 b, 150 c connected to the high-band LAN 1 80 a, the mid-band Internet 1 80 b, and the low-band mobile network 1 80 c, respectively,
- the high bandwidth terminal 150 a can receive the base layer and all the enhancement layers 1 to N to obtain high quality video.
- the mid-band terminal 150 b can receive the basic layer and the two enhancement layers 1 to 2 to obtain medium-quality video.
- the low-bandwidth terminal 150c can receive the base layer and one enhancement layer 1 to obtain low-quality video.
- the video server 100 lowers the bandwidth of the base layer to the limit, so the moving terminal 150 c must receive at least only the base layer. In the picture without interruption can do.
- the band of the base layer is used.
- the bandwidth of the lowermost (that is, closest to the base layer) bandwidth not only enabling uninterrupted video reception, but also the degradation due to bandwidth change of the base layer
- FIG. 10 is a diagram showing a configuration of a video transmission system according to Embodiment 2 of the present invention.
- the video transmission apparatus 200 in this video transmission system has the same basic configuration as the video transmission apparatus 100 in the video transmission system shown in FIG. 2, and the same constituent elements have the same reference numerals. The explanation is omitted.
- the video receiving apparatus 150 is completely the same as that shown in FIG. 2, the description thereof will be omitted.
- the feature of the present embodiment is that the bandwidth of the base layer is lowered to the limit when the terminal moves in the first embodiment, whereas the bandwidth of the basic layer is lowered to the limit when the terminal moves. Furthermore, the bandwidth of the lowest enhancement layer should be increased to complement the image quality (see Figure 11). For this reason, the video transmission device 200 has a bandwidth calculation unit 202.
- the band calculating unit 202 uses the terminal information output from the terminal information receiving unit 110 to divide the base layer band and the extension layer divided band.
- the former is calculated, and the former (band of the base layer) is output to the video encoding unit 104, and the latter (division band of the enhancement layer) is output to the channel division unit 106.
- the band calculating unit 202 lowers the band of the base layer and raises the band of the lowest enhancement layer. As a result, other terminals due to lowering the bandwidth of the base layer You can reduce the impact on Details of the process will be described later.
- the flowchart shown in FIG. 12 is stored as a control program in a storage device (for example, a ROM, flash memory, etc.) (not shown) of the video transmission device 200, and is executed by a CPU (not shown).
- a storage device for example, a ROM, flash memory, etc.
- step S 1 320 is inserted into the flow chart shown in FIG. 6, and step S 1 300 is deleted.
- Steps S 1 0 0 to S 1 2 0 0 are the same as the steps of the flowchart shown in FIG.
- step S1302 the band calculation unit 202 performs movement mode band calculation processing. Specifically, since it is a case where the terminal movement information from the receiving terminal is received, the divided band B_BL of the base layer and the divided band B_EL (1) to B-EL (i) (i The number of division layers set in advance) is calculated, and the band of the base layer is output to the video encoding unit 104, and the division band of the extension layer is output to the channel division unit 106. Then, go to step S 1 400.
- the bandwidth calculation method of the base layer is calculated using the above (Expression 1), as in the first embodiment.
- B-EL (1) is the bandwidth of the lowest enhancement layer
- B 1-EL (1) is the bandwidth of the lowest enhancement layer in the steady mode
- B-BL is the base layer of the mobility mode.
- the band, B 1 ⁇ BL, is the band of the base layer in the stationary mode.
- the bands B-E L (2) to B-E L (i) of the enhancement layers other than the lowest level are the same as in the steady mode.
- Step S 1 4 0 to step SI 6 0 0 are the same as the respective steps of the flowchart shown in FIG.
- a receiving terminal in motion can not only receive uninterrupted video reception by receiving at least only the basic layer, but other terminals can prevent the degradation of the quality of the received video due to the bandwidth reduction of the basic layer.
- the band of the base layer is used.
- the limit to the limit and finely dividing the bandwidth of the lowermost (that is, closest to the base layer) band it is possible not only to enable uninterrupted video reception, but also to receive the received video when the bandwidth fluctuates.
- FIG. 13 is a diagram showing a configuration of a video transmission system according to Embodiment 3 of the present invention.
- the video transmission device 300 in this video transmission system has the same basic configuration as the video transmission device 100 in the video transmission system shown in FIG. 2, and the same components have the same reference numerals. The explanation is omitted.
- the video receiving apparatus 150 is completely the same as that shown in FIG. 2, the description thereof will be omitted.
- the bandwidth of the basic layer is reduced to the limit when the terminal moves in the embodiment 1, whereas the bandwidth of the basic layer is reduced to the limit when the terminal moves. Furthermore, after raising the bandwidth of the lowermost enhancement layer, it is further subdivided to increase the adaptability to bandwidth when bandwidth changes (see Fig. 14). For this reason, the video transmission device 300 is configured to: 0 has 2
- the band calculating unit 302 uses the terminal information output from the terminal information receiving unit 110 as in the band calculating unit 112 of FIG. 2 to divide the base layer band and the extension layer divided band.
- the former is calculated, and the former (band of the base layer) is output to the video encoding unit 104, and the latter (division band of the enhancement layer) is output to the channel division unit 106.
- the band calculation unit 302 lowers the band of the base layer and increases the band of the lowermost enhancement layer to divide it finely. As a result, it is possible to suppress the influence on other terminals by lowering the bandwidth of the base layer, and to increase the adaptability to the bandwidth at the time of bandwidth fluctuation. Details of the process will be described later.
- the flowchart shown in FIG. 15 is stored as a control program in a storage device (for example, ROM, flash memory, etc., not shown) of the video transmission device 300, and is executed by the CPU (not shown).
- a storage device for example, ROM, flash memory, etc., not shown
- step S 1 340 is inserted into the flowchart shown in FIG. 6, and step S 1 300 is deleted.
- Steps S 1 0 0 to S 1 2 0 0 are the same as the steps of the flowchart shown in FIG.
- step S1304 the band calculation unit 302 performs movement mode band calculation processing. Specifically, since it is a case where the terminal movement information from the receiving terminal is received, the divided band B-BL of the base layer and the divided band B-EL (1) to B- EL (i) (i The number of division layers set in advance) is calculated, and the band of the base layer is output to the video encoding unit 104, and the division band of the enhancement layer is output to the channel division unit 106. Then, go to step S 1 400.
- enhancement layer sub-bands B _ EL (j) for example, the following (Equation 3), ⁇ ⁇ / Bi EL (I) + (BI BL -B BL) ⁇ ⁇ ,
- B-EL (j) is the band of the jth extended rayer with the lowest position being the first
- B 1-EL (1) is the steady-state band of the lowest extension layer
- B-BL is The band of the base layer in the mobile mode
- B 1 ⁇ BL is the band of the base layer in the stationary mode
- M is the number of divisions of the lowermost enhancement layer.
- FIG. 16A shows the structure of encoded data
- FIG. 16B shows an example of band division results in the steady mode, and these correspond respectively to FIGS. 3A and 3B.
- each terminal can be selected from the video list.
- a receivable channel it is possible to adapt the quality of the received video on a fine scale basis.
- Steps S 1 4 0 to S 1 6 0 0 are the same as the steps of the flowchart shown in FIG.
- a mobile receiving terminal when the receiving terminal 150 is moving, the bandwidth of the base layer of the layer coding data is reduced to the limit and the bandwidth of the lowermost enhancement layer is increased to finely
- a mobile receiving terminal can not only receive uninterrupted video reception by selectively receiving a receivable division enhancement layer in addition to the base layer. Video reception can be performed with quality that is finely adapted to the transmission band.
- the video is calculated by calculating the configuration of the enhancement layer according to the layer reception status of the receiving terminal. Transmission efficiency of A video transmission system that can achieve
- FIG. 17 is a diagram showing the configuration of a video transmission system according to Embodiment 4 of the present invention.
- the video transmission apparatus 400 and the video reception apparatus 450 in this video transmission system are basically the same as the video transmission apparatus 100 and the video reception apparatus 150 in the video transmission system shown in FIG. 2, respectively.
- the components have the same configuration, and the same symbols are attached to the same components and the description is omitted.
- a feature of the present embodiment is that the bandwidth of each extension ray is determined using reception layer information (specifically, the rayer information being received by the receiving terminal).
- reception layer information specifically, the rayer information being received by the receiving terminal.
- an enhancement layer with a small number of receiving terminals further divides the layer (see (1) in Fig. 18), and multiple enhancement layers received in common between receiving terminals are combined into one layer (figure 1 of 8 (2)). Therefore, the video transmission device 400 has a video transmission unit 402, a reception status reception unit 404, and a band calculation unit 404, and the video reception device 450 has a reception status transmission unit. It has 4 5 2.
- the video transmission unit 402 transmits the divided data and the video list output from the channel division unit 106 to the network 180 on separate channels, as in the video transmission unit 108 shown in FIG. Furthermore, in the present embodiment, the video list output from the band calculation unit 4 0 6 is also transmitted to the network 1 8 0.
- the video list output from the channel division unit 106 and the video list output from the band calculation unit 406 are similar (see FIG. 4).
- Reception status reception unit 404 receives the reception status transmitted from a plurality of reception terminals (video reception devices 4 5 0), generates reception layer information that summarizes the reception status of each reception terminal, and Output to calculation unit 4 0 6
- the reception status indicates the layer name that each receiving terminal is currently receiving
- the receiving layer information is information indicating the total number of receiving terminals for each layer.
- reception layer information is as shown in, for example, FIGS. 19A and 19B.
- CLIEN T_N UM indicates the total number of receiving terminals
- the band calculating unit 406 calculates the divided band of the enhancement layer using the reception layer information output from the reception status receiving unit 404, and outputs the calculated divided band of the enhancement layer to the channel dividing unit 106. Also, it outputs the band of the basic rate set in advance to the video encoding unit 104.
- the reception status transmission unit 452 transmits information on the layer currently received by the reception terminal 450 as the reception status to the transmission terminal (video transmission device 400).
- the information of the layer currently being received is given from the video receiver 154a.
- the flowchart shown in FIG. 20 is stored as a control program in a storage device (for example, a ROM, a flash memory, etc.) (not shown) of the video transmission device 400, and is executed by a CPU (not shown).
- a storage device for example, a ROM, a flash memory, etc.
- step S 1 120, step S 1 140, step S 1 160, and step S 1 180 are inserted into the flow chart shown in FIG. Step S 1100, step S 1200, and step S 1 300 have been deleted.
- Step S 1000 is the same as the steps of the flowchart shown in FIG.
- the reception status reception unit 404 performs reception status reception processing. Specifically, it receives the reception status sent from multiple reception terminals (video reception device 450), generates reception layer information (see Figure 19 A and 19 B), and outputs it to band calculation section 406. Do.
- the bandwidth calculation unit 406 performs enhancement layer configuration calculation processing.
- the bandwidth of the base layer set in advance is The configuration of the enhancement layer, that is, the division band is calculated using the reception layer information output from the reception status reception unit 404 while being output to the image coding unit 104, and the division band of the obtained enhancement layer is divided into channel division units. Output to 1 0 6
- the division of the enhancement layer is, for example, the following (Expression 4) and (Expression 5),
- Equation 4 when the total number of enhancement layers received at all receiving terminals is 1 or more, (Equation 4) is used.
- B ⁇ EL (i) ′ is the bandwidth of the enhancement layer i after bandwidth calculation
- B ⁇ EL (i) is the bandwidth of the previous enhancement layer i
- m is all receiving terminals Is the total number of enhancement layers received.
- Equation 5 M is a band division parameter, and is a parameter for equally dividing the band of the enhancement layer EL-1.
- K is the terminal proportion parameter
- CLI ENT— NUM is the reception The total number of terminals
- N (EL-1) is the number of terminals receiving the enhancement layer EL-1.
- step S1 160 the bandwidth calculation unit 406 determines whether the layer configuration has been changed as the processing result of step S1 140. This judgment is made based on whether the division band of the enhancement layer is different from the previously calculated band. If the configuration of the enhancement layer is changed as a result of this determination (S1 1 6 0: YE S), a video list (see FIG. 4) is generated and output to the video transmission unit 402, and the process proceeds to step S1 1 80. move on. On the other hand, if the configuration of the enhancement layer does not change (S1 160: ⁇ ), the process immediately proceeds to step S1400.
- step S 1 180 the video transmission unit 402 performs video list transmission processing. Specifically, the video list output from the bandwidth calculation unit 406 is transmitted to the network queue 180. Then, the process proceeds to step S1400.
- Steps S 1 400 to S 1 600 are the same as the steps of the flowchart shown in FIG.
- the flowchart shown in FIG. 21 is stored as a control program in a storage device (for example, ROM, flash memory, etc.) (not shown) of the video reception device 450, and is executed by the CPU (not shown).
- a storage device for example, ROM, flash memory, etc.
- step S 2250 is inserted into the flow chart shown in FIG. 7, and step S 2000 and step S 21 00 are performed. Has been removed.
- Step S2200 is the same as the step of the flowchart shown in FIG. However, in the present embodiment, the video reception unit 1 5 4 a outputs the information of the layer currently being received to the reception status transmission unit 4 5 2.
- the reception status transmission unit 4 52 performs reception status transmission processing. Specifically, information indicating the layer name currently received by the receiving terminal 450 is transmitted to the transmitting terminal (video transmitting apparatus 400) as a reception status.
- the transmission of the reception status is performed every time the video reception processing is performed.
- the present invention is not limited to this, and transmission may be performed at a constant interval to avoid congestion of the transmission path. It is.
- Steps S 2 3 0 0 and S 2 4 0 0 are the same as the steps of the flowchart shown in FIG.
- transmission efficiency can be improved by making a plurality of enhancement layers being commonly received one enhancement layer according to the reception status from the receiving terminal.
- the number of receiving terminals is small, by further dividing the lowermost extension rayer, many terminals can receive higher definition video.
- the present invention is applied to a network including a wireless network or the like in which the transmission band fluctuates, even when the band largely fluctuates due to the movement of the receiving terminal or the like.
- the present invention can be applied to a video transmission system that transmits video through a network, as well as to a video receiving apparatus and a video transmitting apparatus used in the system, which have an effect of realizing video transmission without a noise.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Detection And Prevention Of Errors In Transmission (AREA)
- Communication Control (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Mobile Radio Communication Systems (AREA)
Description
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/515,226 US20060168632A1 (en) | 2004-02-20 | 2004-02-20 | Video reception device, video transmission device, and video transmission system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2003-53779 | 2003-02-28 | ||
JP2003053779A JP4227438B2 (ja) | 2003-02-28 | 2003-02-28 | 映像伝送システム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2004077832A1 true WO2004077832A1 (ja) | 2004-09-10 |
Family
ID=32923444
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2004/001989 WO2004077832A1 (ja) | 2003-02-28 | 2004-02-20 | 映像受信装置、映像送信装置および映像伝送システム |
Country Status (3)
Country | Link |
---|---|
JP (1) | JP4227438B2 (ja) |
CN (1) | CN1698382A (ja) |
WO (1) | WO2004077832A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10270511B2 (en) | 2004-11-17 | 2019-04-23 | Koninklijke Philips N.V. | Robust wireless multimedia transmission in multiple in multiple-out (MIMO) system assisted by channel state information |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4066268B2 (ja) | 2005-03-25 | 2008-03-26 | 船井電機株式会社 | データ伝送システム |
WO2006109508A1 (ja) * | 2005-03-31 | 2006-10-19 | Matsushita Electric Industrial Co., Ltd. | パケット転送方法、外部接続エッジ装置、パケット転送装置及び移動端末 |
JP4687538B2 (ja) * | 2006-04-04 | 2011-05-25 | パナソニック株式会社 | 受信装置、送信装置およびその通信方法 |
CN101688696B (zh) | 2007-04-24 | 2012-05-23 | 开利公司 | 制冷剂蒸气压缩系统及跨临界运行方法 |
CN103634552A (zh) * | 2012-08-28 | 2014-03-12 | 华为技术有限公司 | 一种监控视频存储方法、系统和中心管理服务器 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2744783B2 (ja) * | 1986-04-17 | 1998-04-28 | ブリティッシュ・ブロードキャスティング・コーポレーション | 情報信号を伝達するための伝達方法 |
JPH10304334A (ja) * | 1997-04-25 | 1998-11-13 | Canon Inc | 通信方法、通信装置、送信装置、受信装置、通信システム、及び記憶媒体 |
JP2000092486A (ja) * | 1998-09-10 | 2000-03-31 | Toshiba Corp | 動画像送信装置および動画像再生装置ならびに動画像送信方法および動画像再生方法 |
JP2001222720A (ja) * | 2000-02-10 | 2001-08-17 | Sony Corp | 情報符号化装置 |
-
2003
- 2003-02-28 JP JP2003053779A patent/JP4227438B2/ja not_active Expired - Fee Related
-
2004
- 2004-02-20 WO PCT/JP2004/001989 patent/WO2004077832A1/ja active Application Filing
- 2004-02-20 CN CNA2004800002834A patent/CN1698382A/zh active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2744783B2 (ja) * | 1986-04-17 | 1998-04-28 | ブリティッシュ・ブロードキャスティング・コーポレーション | 情報信号を伝達するための伝達方法 |
JPH10304334A (ja) * | 1997-04-25 | 1998-11-13 | Canon Inc | 通信方法、通信装置、送信装置、受信装置、通信システム、及び記憶媒体 |
JP2000092486A (ja) * | 1998-09-10 | 2000-03-31 | Toshiba Corp | 動画像送信装置および動画像再生装置ならびに動画像送信方法および動画像再生方法 |
JP2001222720A (ja) * | 2000-02-10 | 2001-08-17 | Sony Corp | 情報符号化装置 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10270511B2 (en) | 2004-11-17 | 2019-04-23 | Koninklijke Philips N.V. | Robust wireless multimedia transmission in multiple in multiple-out (MIMO) system assisted by channel state information |
Also Published As
Publication number | Publication date |
---|---|
JP4227438B2 (ja) | 2009-02-18 |
CN1698382A (zh) | 2005-11-16 |
JP2004266502A (ja) | 2004-09-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101557504B1 (ko) | 채널 적응형 비디오 전송 방법, 이를 이용한 장치 및 이를 제공하는 시스템 | |
WO2004077831A1 (ja) | 映像伝送システム、映像送信装置、映像受信装置および映像伝送方法 | |
US20060168632A1 (en) | Video reception device, video transmission device, and video transmission system | |
CN100508606C (zh) | 用于经由无线网络进行通信的服务器系统及其操作方法 | |
JP4028356B2 (ja) | 通信システム、無線通信端末、データ配信装置及び通信方法 | |
RU2516010C2 (ru) | Система многоканальной видеосвязи и способ обработки многоканальной видеосвязи | |
US20110274180A1 (en) | Method and apparatus for transmitting and receiving layered coded video | |
US20090110060A1 (en) | Method and apparatus for performing lower complexity multiple bit rate video encoding using metadata | |
US7769790B2 (en) | Method and device for processing scalable data | |
JPH11225168A (ja) | 画像・音声送信装置、画像・音声受信装置、データ処理装置、及びデータ処理方法、並びに、波形データの送信方法、装置、及び波形データの受信方法、装置、並びに、動画像の送信方法、装置、及び動画像の受信方法、装置 | |
WO2010037310A1 (zh) | 多路视频通信方法与系统 | |
JP2005515714A (ja) | クライアントの帯域又は性能に基づく対象を絞ったスケーラブル映像マルチキャスト | |
MXPA06013210A (es) | Suministro de informacion en un canal de comunicacion. | |
KR100592547B1 (ko) | 스트리밍을 위한 패킷 스케줄링 방법 | |
CN109068187A (zh) | 实时流量传送系统和方法 | |
KR20160108342A (ko) | 계층화된 코딩된 콘텐츠를 멀티플렉싱하기 위한 방법 및 장치 | |
CN108540745B (zh) | 高清双流视频的传输方法、发送端、接收端及传输系统 | |
US8891539B2 (en) | Re-searching reference image for motion vector and converting resolution using image generated by applying motion vector to reference image | |
WO2004077832A1 (ja) | 映像受信装置、映像送信装置および映像伝送システム | |
CN103081530A (zh) | 多媒体传送系统中的跨层优化方法及其抽象层组件 | |
US20070110168A1 (en) | Method for generating high quality, low delay video streaming | |
JP3126956B2 (ja) | 通信サービス品質制御方法及び装置 | |
CN103347201A (zh) | 集群系统组呼中的视频传输方法和视频传输系统 | |
JPWO2009017229A1 (ja) | 動画像データ配信システム、その方法及びそのプログラム | |
KR100565307B1 (ko) | 이동 통신 단말기의 스트리밍 콘텐츠 저장 방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
ENP | Entry into the national phase |
Ref document number: 2006168632 Country of ref document: US Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10515226 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 20048002834 Country of ref document: CN |
|
122 | Ep: pct application non-entry in european phase | ||
WWP | Wipo information: published in national office |
Ref document number: 10515226 Country of ref document: US |