CN1251507C - Wireless image transmission device and image transmission method - Google Patents

Wireless image transmission device and image transmission method Download PDF

Info

Publication number
CN1251507C
CN1251507C CNB028073258A CN02807325A CN1251507C CN 1251507 C CN1251507 C CN 1251507C CN B028073258 A CNB028073258 A CN B028073258A CN 02807325 A CN02807325 A CN 02807325A CN 1251507 C CN1251507 C CN 1251507C
Authority
CN
China
Prior art keywords
place
secondary information
transmission
sector
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB028073258A
Other languages
Chinese (zh)
Other versions
CN1500354A (en
Inventor
石川裕
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp Corp
Original Assignee
Sharp Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Corp filed Critical Sharp Corp
Publication of CN1500354A publication Critical patent/CN1500354A/en
Application granted granted Critical
Publication of CN1251507C publication Critical patent/CN1251507C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/15—Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/152—Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/23805—Controlling the feeding rate to the network, e.g. by controlling the video pump
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2383—Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6156—Network physical structure; Signal processing specially adapted to the upstream path of the transmission network
    • H04N21/6181—Network physical structure; Signal processing specially adapted to the upstream path of the transmission network involving transmission via a mobile phone network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/631—Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Detection And Prevention Of Errors In Transmission (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A wireless image transmission device comprises an encoder 180 which encodes combined image data, and includes quantization means 130 to perform quantization of input data based on a quantization value, and an encoding amount control means to control the encoding amount, comprising: first information portion counting means 100, second information portion counting means 102, first information portion transmission time computation means 105, a second information portion transmission time computation means 110, second information portion transmittable bits computation means 112, untransmitted bits computation means 113, and quantization value computation means 115, so that even when a video bitstream is transmitted using a plurality of modulation methods with different transmission rates, by transmitting in a constant amount of time, bandwidth can be used efficiently.

Description

Wireless image transmission equipment and image transmission method
Technical field
The present invention relates to the radio transmission apparatus of coded image data, relate in particular to wireless channel by using the different transmission rate modulation method with wireless image transmission equipment such as time-sharing procedure transfer encoding view data such as OFDM.
Background technology
In recent years, Radio Transmission Technology has had and has developed rapidly, and especially data transmission bauds obtains to significantly improve.
Up to several years ago, the high transmission rates of personal handy phone system (PHS) is 64Kbps, now 2.4GHz wave band IEEE802.11b technical specification makes transmission speed reach 11Mbps, and 5GHz wave band 802.11a and MMAC (Multimedia Mobile addressing communication system), HiSWANa (high-speed radio networking type a) and BRAN (broadband radio networking) Hiper-LAN/2 realized the transmission speed of 20～30Mbps and Geng Gao.Transmission speed has reached this degree, just makes a plurality of video data streams of using MPEG (Motion Picture Experts Group) 1/MPEG2/MPEG4 or other video coding method coding just might realize wireless real-time Transmission.The modulation method that above IEEE802.11a, HiSWANa and HiperLAN/2 use a kind of OFDM of being called (OFDM).According to user request, this modulation method can time division multiplexing application transport quality height but the channel of the low modulation method of transmission speed and application transport is of poor quality but the channel of the modulation method that transmission speed is high.
Transmission quality is one and is used for assessment data transmission and the parameter of reproducing performance, uses BER (dislocation rate) or other value usually.
In wireless transmission during with certain video coding method (is representative with MPEG1,2,4) image encoded, a kind of to suppress the technology that the picture element amount reduces be that Japan Patent treats that publication number 11-330984 describes " error correction coding equipment and decoding device ".In the above-mentioned publication, when the image stream of the wireless transmission channel transfer encoding of passing through modulation methods such as application OFDM, this stream is divided into important information A and inessential information B.Important information is partly with modulation method α transmission, transmission quality height and speed is low; Inessential information is with modulation method β transmission, the low but speed height of transmission quality.Can keep high image transfer rate like this, and prevent from obviously to disturb picture element.
But the above-mentioned background technology has following point.Generally when coding video frequency data, by two kinds of variable bit rate (VBR) and fixed bit rates (CBR), the bit rate of the former output code flow (transmission speed) sequential becomes with video data content, and the latter then is controlled so as to and makes bit rate constant.These bit rates are selected for use by applied field is incompatible.To online real-time Transmission, suitable with the constant CBR of transmission speed.
In modulation method such as OFDM, for the modulation method of using two kinds of different transmission speeds transmits, even when using the CBR method of constant transmission speed,, then can change transmission speed at any time if above important and inessential information A and the figure place ratio of B unit interval change.
Figure 13 A and 13B show the details of transmission speed.As shown in FIG. 13A, even the ratio of important and inessential information A and B changes, the total bit of unit interval CBR code stream is substantial constant also, but this has got rid of the error that is occurred in the Bit-Rate Control Algorithm algorithm.When the single modulation method of application transmits this information,, in (1) and (2),, then might under condition without a doubt, transmit if can guarantee the regular time amount even the ratio of A and B changes.But shown in Figure 13 B, when transmitting by wireless channel, if the code stream of important information A is modulated with modulation method α, and inessential information B modulates with modulation method B, if the ratio of the unit interval of important information A and inessential B changes as (1) and (2), then because α and the transmission quantity of β unit interval poor, the transmission time will change 0, that is, the total bit (transmission speed) that transmits has become the unit interval.
As mentioned above, if the transmission time frequent variations has just increased the required time of code stream.Can occur to guarantee the situation of the time quantum that increases like this, make the code stream transmission occur postponing and losing, and make the video of reproduction that serious deterioration take place.The not enough situation of transmission time of another communications applications also can take place.The request from video coding apparatus of also may responding one by one is dynamically to guarantee the transmission time; But this can make complex system, increases the load of wireless transmitting-receiving equipments.
The objective of the invention is to,, also can effectively utilize bandwidth by set time amount transmission even when using the modulation method transmission of video code stream of multiple different transmission rate.
Summary of the invention
One aspect of the present invention provides an image encoding apparatus, it exports combined image information with encoding code stream, this information comprises the first information part of first modulation method modulation and the secondary information sector of modulating with second modulation method that is different from first modulation method, and it also comprises the encoder that the combinations thereof view data is encoded, and also comprise based on quantized value and make the encoding amount control device of encoding amount control to the quantization device of input data-measuring with to this encoder, comprising: the first information counting device that calculates above-mentioned first information part figure place; Calculate the second message count device of above-mentioned secondary information sector figure place; According to the first information figure place partly that above-mentioned first information counting device calculates, calculate the first information transmission time calculation element of the coded first information part required time of above-mentioned use first modulation method of transmission; According to required time of first information part of the above-mentioned coding of transmission and the overall transmission time that can be used to transmit, calculating can be used to transmit the secondary information sector of the above-mentioned coding second message transmission time computing device of required time; The device of second information digit that calculating can be transmitted, its calculates the figure place that can transmit above-mentioned secondary information sector according to the time and above-mentioned second modulation method of the secondary information sector that can be used for transmitting above-mentioned coding; The device of the figure place that calculating can not be transmitted, the figure place of the secondary information sector that figure place that it can transmit according to above-mentioned secondary information sector and the above-mentioned second message count device are calculated, calculate surpass that above-mentioned secondary information sector can transmit figure place can not transmit figure place; The quantized value calculation element, it calculates and is used for to above-mentioned quantization device output the quantized value of next image encoding processing according to the above-mentioned figure place that can not transmit.
Another aspect of the present invention provides a kind of wireless image transmission equipment, it comprises: communication control unit, and first modulation method, the modulation that are used for regulation first information part modulation method are different from second modulation method of first information secondary information sector partly and the overall transmission time that can be used to transmit; Modulating device is used for the modulation method modulation image data by separately; Wireless transmitter, the signal of exportable modulating device modulation also receives the wireless signal that is transmitted; Demodulating equipment can receive the signal that is received by wireless transmitter, and according to the received signal of the modulation method demodulation of above-mentioned communication control unit defined; And picture coding device, it is according to the modulation method and the overall transmission time of first and second message part of above-mentioned communication control unit defined, the view data of coding input also produces figure place, also according to the figure place of the coded data that from the secondary information sector data of the first information partial data of first modulation method modulation and the modulation of second modulation method, can not in overall transmission time, transmit, encoding amount control is done in coding control to the total transmission cycle of the next one, wherein, described picture coding device has the encoder that described combined image data is encoded, and comprise the encoding amount control device that quantizes the encoding amount of the quantization device of input data and controlled encoder according to quantized value; And comprise: first information part counting device is used to count described first information figure place partly; The secondary information sector counting device is used to count the figure place of described secondary information sector; First information part transmission time calculation element according to the described first information figure place partly of described first information part counting device counting, calculates the described encoded required time of first information part of using described first modulation method that sends; Secondary information sector transmission time calculation element according to required time of first information part of the described coding of transmission with divide the overall transmission time that is used in transmission, calculates the time of the secondary information sector that is used to transmit described coding; Secondary information sector can be transmitted a calculation element, according to the time and described second modulation method of the secondary information sector that is used to transmit described coding, the figure place of the described secondary information sector that calculating can be transmitted; The calculation element of the position of not transmitting according to the figure place of the described secondary information sector of the figure place of transmitting of described secondary information sector and secondary information sector counting device counting, calculates and surpasses the figure place of not transmitting that described secondary information sector can be transmitted figure place; With the quantized value calculation element, when required time of described first information part and the required time sum of secondary information sector when being constant, it is according to the described figure place of not transmitting, and calculates to be used for the quantized value of next image encoding and to export described quantization device to.
Another aspect of the present invention provides the wireless image transmission system, and it comprises:
The wireless base station, the wireless image transmission equipment that it comprises has communication control unit, but first modulation method of specified modulation first information part, second modulation method of modulating the secondary information sector that is different from first information part and the overall transmission time that is used to transmit; Modulating device can be by above-mentioned modulation method modulation image data; Wireless transmitter, the signal of exportable modulating device modulation also receives the wireless signal that transmits; Demodulating equipment, the modulation method restituted signal that can receive the received signal of wireless transmitter and stipulate according to the above-mentioned institute's use communication control unit that receives; And picture coding device, can be by the overall transmission time of above-mentioned first and second information modulation method and communication control unit regulation, the view data of coding input also produces code stream, also in the middle of the coded data of second information data of modulating first information data that above-mentioned view data draws from first modulation method and drawing from the modulation of second modulation method, figure place according to the coded data that can not in overall transmission time, transmit, encoding amount control is done in coding control in total transmission cycle once, wherein, described picture coding device comprises: encoder, it is encoded to described combined image data, and comprises the quantization device of carrying out the quantification of input data according to quantized value; With the encoding amount control device of the encoding amount of controlling described encoder, and have: first information part counting device is used to count described first information figure place partly; The secondary information sector counting device is used to count the figure place of described secondary information sector; First information part transmission time calculation element according to the described first information figure place partly that described first information part counting device calculates, calculates the encoded required time of first information part that described first modulation method is adopted in transmission; Secondary information sector transmission time calculation element according to required time of first information part of the described coding of transmission with divide the overall transmission time that is used in transmission, calculates the time of the secondary information sector that is used to transmit described coding; Secondary information sector can be transmitted a calculation element, and time and described second modulation method according to the secondary information sector that is used to transmit described coding calculate the figure place that described secondary information sector can be transmitted; The calculation element of the data bit of not transmitting can transmit the figure place of the described secondary information sector of figure place and secondary information sector counting device counting according to described secondary information sector, calculate surpass the described secondary information sector figure place that can transmit do not transmit figure place; With the quantized value calculation element,,, calculate and be used for the quantized value of next image encoding and export described quantization device to according to the described figure place of not transmitting when described first information part required time and described secondary information sector required time sum when being constant.
A plurality of mobile radio stations, it can be decoded by the coded image data that wireless channel transmitted to the wireless base station.
Of the present invention also have an aspect that a kind of image encoding method is provided, it can export combined image information by encoding code stream, this image information can comprise the first information part of using the modulation of first modulation method and use the secondary information sector of second modulation method modulation that is different from first modulation method, but also comprises:
To the coding step of combinations thereof encoding image information, also comprise the quantification treatment that quantizes the input data by quantized value; With
The encoding amount controlled step, this step is controlled at the encoding amount in the coding step, also has the substep that calculates first information part figure place; The first information part transmission time is calculated substep, and the figure place of the first information part that can calculate according to the substep of aforementioned calculation first information part position is calculated the required time of first information part that first modulation method coding is used in transmission; The secondary information sector transmission time is calculated substep, and time and the overall transmission time that can be used to transmit that can be required according to the first information part of transfer encoding, calculating can be used for the time of the secondary information sector of transfer encoding; Can transmit the calculating substep of the figure place of secondary information sector, it can calculate the figure place that secondary information sector can be transmitted according to the time and second modulation method of the secondary information sector that can be used for transfer encoding; Calculate the substep of secondary information sector figure place; Do not transmit the calculating substep of position, the figure place that can transmit according to the secondary information sector that the secondary information sector counting device is calculated and the figure place of secondary information sector, calculate surpass that secondary information sector can transmit figure place do not transmit figure place; Calculate substep with quantized value, can calculate the dyad makeup and put the quantized value that output is used for next image encoding processing according to the figure place of not transmitting.
Of the present invention also have an aspect that another kind of image transfer method is provided, have: the Control on Communication step, it has stipulated to be used to modulate first modulation method of first information part, second modulation method of secondary information sector that is used to be different from described first information part and the overall transmission time that can be effective to transmit; Modulation step is according to described each modulation method correction image data; The wireless receiving and dispatching step, the signal that its output is modulated in modulation step, and receive the signal that is sent; Demodulation step, it is received in signal received in the wireless receiving and dispatching step, and with the described signal of receiving of the modulation method demodulation of stipulating in the described Control on Communication step; With the image encoding step, this is a kind of input image data is encoded and produced the means of code stream, comprise the quantification treatment of importing the quantification of data according to quantized value, with the encoding amount controlled step of encoding amount in the control coding step, and have: the substep that the figure place in the described first information part is counted; First information part transmission time calculation procedure, the described figure place of the first information part of counting in its described substep according to the figure place of the described first information part of counting is calculated the required time of first information part that sends the described coding that adopts described first modulation method; Secondary information sector transmission time calculation procedure, it calculates the time of the secondary information sector transmission of described coding according to required time of first information part of the described coding of transmission and the total transmission time that can be used for transmitting; Substep is calculated in the position that secondary information sector can be transmitted, and wherein, according to the time and described second modulator approach of the secondary information sector of transmitting described coding, calculates the figure place that described secondary information sector can be transmitted; Count the substep of the figure place of described secondary information sector; Do not transmit the calculating substep of position, it can transmit the figure place of the described secondary information sector that figure place and secondary information sector counting device calculate according to described secondary information sector, calculate surpass figure place that described secondary information sector can transmit do not transmit figure place; With quantized value calculation operations substep, when the summation of required time of required time of described first information part and described secondary information sector when being constant, it is according to the described figure place of not transmitting, calculating is used for the quantized value of next image encoding and exports described quantization device to, described image encoding step is according to described first and second modulation method and the described overall transmission time of described communication control unit regulation, when required time of described first information part and described secondary information sector when the required time, sum was constant, in the coded data of the described secondary information sector data that the described first information partial data and described second modulator approach of described first modulator approach modulation are modulated, according to the coded data that can not be transmitted in the described overall transmission time, when the coding control that overall transmission time next time carries out at interval, control described encoding amount.
Brief description
Fig. 1 illustrates the ratio of message part A and message part B and the total time of distribution;
Fig. 2 illustrates the data configuration of MPEG2 hierarchical structure and each layer;
Fig. 3 is the block diagram of the wireless image transmission equipment structure of first aspect present invention;
Fig. 4 illustrates the wireless image transmission equipment of first aspect present invention and the equipment of remote control one side of communicating by letter;
Fig. 5 illustrates the treatment step of the wireless image transmission equipment of first aspect present invention;
Fig. 6 is to use the flow chart of the message transmission time step that the wireless image transmission equipment of first aspect present invention distributed;
Fig. 7 explanation is to the wireless transmission message of the wireless image transmission equipment of application first aspect present invention and the bag establishment step of data;
Fig. 8 is the block diagram of the wireless image transmission equipment picture coding device structure of first aspect present invention;
Fig. 8 A illustrates the overall structure of picture coding device;
Fig. 8 B illustrates the picture coding device part of similar in conventional coders;
Fig. 9 illustrates the structure of image block;
Motion vector in Figure 10 A and the 10B explanation image encoding;
Figure 11 illustrates the ratio of the distribution total time of wireless image transmission equipment among message part A and B and this aspect of application first embodiment;
Figure 12 is the structure chart of the system of second embodiment of the invention, and it has used the described wireless image transmission equipment of first embodiment;
Figure 13 A illustrates the structure of CBR code stream; And
Figure 13 B illustrates the transmission time with two class modulation method transport stream.
The preferred mode that carries out an invention
Before explanation aspects of the present invention, at first explain of carrying out of the present invention with reference to Fig. 1.
In wireless image transmission equipment of the present invention, in each time T (total allocation time) carry out image encoding and transmission process.In addition, also the image encoded data are divided into message part A and B, with modulation method α transmission message part A, with modulation method β transmission message part B.
Fig. 1 has shown that transmission is by the coded data of the output of the picture coding device in the wireless image transmission equipment in " the total allocation time " of how to distribute in each (1)～(3), interval that time T was limited.
In interval (1), picture coding device produces corresponding to the coded data A1 of message part A and B and B1 and temporarily is accumulated in the buffer storage.For all coded datas that are accumulated in the buffer storage, with modulation method α modulation the time, the transmission time of coded data A1 is decided to be transmission time necessary TA1 in " the total allocation time " at interval (2), is transmitting all this data in (2) at interval.Coded data B1 transmitted among the TB1a in the remaining time of " total allocation time "; But as coded data B1 during with modulation method β modulation and TB1＞TB1a, transmission time TB1 is just greater than TB1a remaining time.
At this moment, the time T of transmission residue coded data B1b B1b(=T B1-T B1a) be fixed in the interval (3), that is, data B1 deposits in the buffer in interval (1), is reading the not hop B1b that can not transmit in (2) at interval, and is transmitting in (3) at interval.
On the other hand, transmitting coded data A2 and the B2 that in interval (2), is produced by picture coding device in (3) at interval corresponding to message part A and B.Work as T B1b+ T A2(transmission required time of data A2)+T B2(transmission required time of data B2) must be with the excess time T when surpassing " total allocation time " B2bBe fixed in another (4) at interval, but will be the required time T of maximum prioritised transmission coded data A2 A2Be fixed in (3) at interval.Above-mentioned processing will repeat substantially, but if surpass can be in that " the total allocation time, " state of the encoding amount that transmit the lining continues the amount of picture coding device coding, and buffer storage will be overflowed coded data and it is lost, thereby can not normal running.
In the method for inventor design, in the coded data of the message part B that in appointed interval, is produced corresponding to picture coding device, calculate next amount of coded data that can not transmit at interval and it is added up.If accumulated value becomes greater than a certain value, then when next space coding, deduct amount of coded data corresponding to message part B; If accumulated value is less than a set-point, then the quantization parameter of control image encoding in next space coding increases amount of coded data.
According to the inventor's above-mentioned research, the wireless image transmission equipment of first aspect present invention is described with reference to the accompanying drawings.
In the wireless image transmission equipment of Shuo Ming first aspect present invention, suppose that coded image data is divided into message part A and B below.If when MPEG2 is used as compiling method, can use the following method that is divided into message part A and B.
Fig. 2 illustrates the hierarchical structure of MPEG2 code stream.Approach the layer at figure top more, then the scope of the affected raw image data of this layer data is wide more.As in message part A, sequence layer 1, GOP (set of pictures) layer 3, picture layer 5 and slicing layer 7 have been distributed.In message part B, grand block layer 11 and block layer 15 have been distributed.
To message part A, used the low but modulation method of reliability height (transmission quality is good) of transmission speed.To message part B, used low but the modulation method that transmission speed is high of reliability.This method had both been kept higher transmission speed, can suppress the disturbance of reproduced image again.
Fig. 3 illustrates the structure of graphic transmission equipment of the present invention.Graphic transmission equipment x is divided into message part A and B to image encoded, and each personal different modulation method is made modulation transmissions.This graphic transmission equipment x has picture coding device 200, communication control unit 210, wirelessly builds that packing puts 220, modulating device 230 and wireless transmitter 240, also comprises demodulating equipment 250, wireless data extraction element 260 and buffer 270 in addition.
The following describes the operation of each piece among Fig. 3.Communication control unit 210 is determined the frequency range of modulator approach, demodulation method and distribution, and is similar as the usage when the wireless image transmission equipment 500 of first aspect present invention shown in Figure 4 is communicated by letter with telecommunication equipment 510.Exchange messages according to wireless protocols (IEEE802.a, MMAC HISWANa, BRAN HiperLAN etc.) and telecommunication equipment 510.At this moment, graphic transmission equipment 500 utilizes communication control unit 210 to keep the frequency range of modulation method, demodulation method and distribution, changes up to them.This communication control unit 210 produces and output message and the similar message that depends on wireless protocols, the above-mentioned message of importing and decode.
Before communication control unit 210 images,, comprise for example modulation method and the total allocation time of message part A and B by the image transmission parameter that above-mentioned message is determined.The coded image data of transmission is divided into message part A and B.Here the modulation method of transmission message part A is called " message part A modulation method ", transmission message part B is sent out modulation method call " modulation method of message part B ".
" total allocation time " is the total time amount that can be used to transmit message part A and B in time T is the interval on boundary, as shown in Figure 5.More than three class parameters supply with picture coding device 200.
Communication control unit 210 management are by the sequential of wireless channel transfer encoding view data code stream." time that message part A requires " and " time that message part B requires " (following detailed description again) according to picture coding device 200 settings, consult with telecommunication equipment 510, determine the transmission time of message part A and B, and send the instruction of reading transmission code stream from buffer 270 by the transmission time started.
As shown in Figure 3, the wireless packing of building is put the form (Fig. 7) that code stream 31 (Fig. 7) that message that 220 communication control units 210 produce or picture coding device 200 produce converts bag 37 to, to transmit by wireless channel.This relates generally to augments error detection code 33 and head 35 (Fig. 7).
Modulating device 230 can be done the sequential switching to the input data between such as BPSK (binary phase shift keying), QPSK (Quadrature Phase Shift Keying) and 16QAM modulation methods such as (quadrature amplitude modulations).Except modulation method situation about determining in advance by the wireless protocols that is provided with, modulate with the modulation method of communication control unit 210 defineds.When wireless protocols has determined modulation method, just used this modulation method.
The signal that wireless transmitter 240 is modulated by modulating device 230 to wireless channel output, and accept telecommunication equipment 510 (Fig. 4) and send the wireless signal of passing to demodulating equipment 250.
The demodulation method of demodulating equipment 250 usefulness communication control units 210 regulations, demodulate reception is from the signal of wireless transmitter 240.Similar to modulating device 230, this demodulation method switches with sequential.When demodulation method is stipulated by wireless protocols, just do demodulation with the demodulation method of agreement regulation.
Wireless data extraction element 260 extracts message etc. in the packet radio of demodulation, as shown in Figure 7.This is mainly concerned with decoding, error detection and head deletion.The data of extracting are sent to communication control unit 210.
The view data of picture coding device 200 coding inputs also generates code stream." the total allocation time " that is provided with according to communication control unit 210, " signal section A modulation method and " with " signal section B modulation method; " input picture is encoded, make it become the amount of coded data that in " the total allocation time " of current assurance, to be transmitted, and " message part A wants seeking time " and " message part B wants seeking time " parameter is passed to communication control unit 210.The code stream of coding is write buffer 270, and the latter is storing code stream 31, and exports this code stream by the order of communication control unit 210.
Picture coding device 200 now is described in detail in detail again.Shown in Fig. 8 A, this figure shows in detail the picture coding device 200 of Fig. 3, this picture coding device 200 has message part A counting device 100, message part B counting device 102, message part A time computing device 105, message part B time computing device 110, message part B figure place calculation element 112, does not transmit figure place calculation element 113 and quantized value calculation element 115, also has encoder 180 in addition.
Shown in Fig. 8 B, encoder 180 has variable-length encoding device 125, quantization device 130, DCT device 135, re-quantization device 140, contrary PCT device 145, adder 150, memory 155, locomotion evaluation device 160, motion compensation unit 165 and subtracter 170.This structure is equivalent to the configuration (MPEG1/2/4 etc.) of general video encoder, sees the Saishin MPEGKyoukasho. that Hiroshi Fujiwara for example edits for details
The following describes the details of operation of picture coding device shown in the 8A 200.Picture coding device 200 supposition of explanation here mainly deal with in each image block.As shown in Figure 9, image block 71a is a unit in the picture frame 71, and it comprises 8 * 8 arranged picture 73.
Shown in Fig. 8 B, view data 190 is input to subtracter 170 and locomotion evaluation device 160.In subtracter 170, deduct the output valve of motion compensation unit 165 in the view data.Yet, if do not do motion compensation (in piece), just use " 0 " output valve that replaces motion compensation unit 165, thereby the output of subtracter 170 is exactly the view data of input itself.Be only in the data of same picture frame, to carry out the image encoded piece in the piece, and do not use inter prediction.
The output of subtracter 170 is input to DCT device 135, and carries out DCT (discrete cosine transform) operation, its output is sent to quantization device 130.
In quantization device 130, the quantized value of calculating according to quantized value calculation element 115 is to the input data-measuring.Earlier quantized value is placed certain initial value, (as each picture frame) revises this value in each circulation afterwards.In the video coding method that is similar to such as encoder 180 structures of MPEG, mainly regulate the amount of coded data that is produced by quantization device 130, the data of quantification and quantized value send variable-length encoding device 125 and re-quantization device 140.
Re-quantization device 140 multiply by quantized value with the data that quantize, and makes re-quantization.View data is arranged to limited figure place (as 8), as long as quantized value is not 1, then just the value with former quantification is different for the value of the data that should quantize.Send inverse DCT device 145 data that quantize, the latter is to being done the inverse DCT operation by the data of re-quantization.
After inverse DCT was handled, data were sent adder 150.If the input data have been deducted the output valve of motion compensation unit 165 by subtracter 170 (in non-), adder 150 just adds the output valve of motion compensation unit 165, generation is corresponding to the data of input image data (its value be different from quantize and difference that the re-quantization processing obtains), and it is write memory 155.Subtracter 170 has deducted corresponding to the data in the piece, so will add " 0 ".At this moment, the output of adder 150 is exactly inverse DCT value itself.
Step referring now to Figure 10 A and 10B explanation calculating kinematical vector 195.The data of above-mentioned generation are write memory 155, as the reference picture frame data shown in Figure 10 B, passive movement apparatus for evaluating 160 references in locomotion evaluation is handled, passive movement compensation arrangement 165 references in motion compensation process.
Locomotion evaluation device 160 is searched for the image block A ' (Figure 10 A) of approximate image block A that will be processed from the reference image data (Figure 10 B) that is stored in 155 li of memories, according to the relative position calculating kinematical vector 195 of A and A '.Send the motion vector 195 that so obtains motion compensation unit 165 to make motion compensation process, also send variable-length encoding device 125 to encode.
Motion vector that motion compensation unit 165 provides by locomotion evaluation device 160 195 reads view data from memory, and it is delivered to subtracter 170.
Variable-length encoding device 125 makes the quantized data that receives from quantization device 130 and does variable-length encoding from the motion vector 195 that locomotion evaluation device 160 receives, and generates code stream and with its output.
Sketched the operation of encoder 180 above, but the structure of encoder is not limited to this.
In the picture coding device 200 of Fig. 8 A and 8B, signal section A and B counting device 100 and 102, signal section A and B time computing device 105 and 110, signal section B figure place calculation element 112, do not transmit figure place calculation element 113 and quantized value calculation element 115, it is controlling the encoding amount of encoder 180.Below with reference to Fig. 6 the encoding amount control flow is described.
At step S1, the figure place of message part A in the code stream of message part A counting device 100 calculating variable-length encoding devices 125 outputs, this calculating is carried out at each interval that with certain moment is being the boundary, as shown in Figure 5.When finished at every interval, counting device resetted, beginning new round counting.The figure place of calculating in certain interval end (figure place of coded message part A) offers message part A time computing device 105.
At step S2, in time T is the interval end on boundary, " the message part A modulation method " that message part A time computing device 105 provides according to " the message part A encode figure place " that take from message part A counting device 100 and communication control unit 210, calculate " time that message part A requires ", promptly transmit the required time of message part A, and give message part B time computing device 110 and communication control unit 210 (Fig. 3) this result.
At step S3, above-mentioned be the interval end on boundary with the time T, message part B time computing device 110 deducts " time that message part A requires " that message part A time computing device 105 provides from " total allocation time " (overall transmission time) lining that communication control unit 210 is provided with, calculate " time that message part B requires ".so calculate " message part B require time " give message part B figure place calculation element 112 and communication control unit 210.For example, if " time that message part A requires " is A1 shown in Figure 11, then " time that message part A requires " is A2, and then " time that message part B requires " is B2.Even the ratio of A1 and B1 is different from the ratio of A2 and B2, " time that message part A requires " is always constant substantially with " time that message part B requires " sum.
At step S4, in above-mentioned time T is the interval end on boundary, " the message part B modulation method " that " message part B require time " that provides according to message part B time computing device 110 and communication control unit 210 provide, the figure place (message part B transmits figure place) that message part B figure place calculation element 112 computing information part B can transmit in time T is the interval on boundary, and the result given do not transmit figure place calculation element 113.
At step S4 ', the figure place of message part B in the code stream of message part B counting device 102 calculating variable-length encoding devices 125 outputs.As message part A counting device 100, in each with the time T is the interval on boundary, make this counting, as shown in Figure 5, this counting device each at interval end reset beginning new round counting.Figure place calculation element 113 is not transmitted in the figure place of calculating in above-mentioned interval end (message part B encode figure place) supply.
At step S5, in time T is the interval end on boundary, do not transmit figure place calculation element 113 from " the message part B encode figure place " that calculate at step S4 ' and provide, deduct " message part B transmits figure place " step S4 calculating and that provided by message part B figure place calculation element 112 by message part B counting device 102.When coding continuous images data, this value can add up.Accumulation result (message part B does not transmit figure place) is given quantized value calculation element 115 after determining.The inadvisable negative value of accumulated value.
At step S6, quantized value calculation element 115 monitors that " message part B does not transmit figure place to 125 outputs of variable-length encoding devices: and code stream figure place; calculate and prepare to be used for the quantized value of encoding in next total transmission intercal, make the code flow of coding be fit to transmission, and the result is supplied with quantization device 130.
At step S7, control the coded data amount that is produced by the quantized value of calculating.For example, if " message part B does not transmit figure place " greater than certain standard value, just increases quantized value, reduces the amount of coded data that is produced.If " message part B does not transmit figure place " less than standard value, then the lower quantization value increases amount of coded data.At step S8, do not transmit the position at next total allocation time (overall transmission time) internal transmission information part B.When in next total allocation time (overall transmission time), encoding, use new fixed quantized value.
Wherein, can measure that " message part B does not transmit the mode that figure place increases and decreases with the increase and decrease of the code stream median that generates, and the algorithm of the amount of coded data that the result is produced as control.
The operation of the entire image transmission equipment of first aspect present invention is described below with reference to Fig. 5.
Graphic transmission equipment is carried out processing based on total allocation time (overall transmission time) T.Be used for coding and image transmitted data and be divided into group 1 (as 1GOP is one group, sees Fig. 2), and handle the view data of this group in each time T.At first, in interval 1,200 pairs of image sets of picture coding device, 1 coding.In 1 end at interval, obtain the time (1) that time (1) that the message part A of image sets 1 requires and message part B require, determine the transmission time of images group 1 in interval 2 in view of the above, and set this time.Setting this transmission time is carried out by communication control unit 210.1 end can be guaranteed by information control device 210 at interval.In interval 1 end, also can obtain message part B and not transmit figure place (1), the quantized value of calculating thus is used for to the message part B control coded data amount of image sets 2.
The coded data of image sets 1 is write buffer temporarily in interval 1, entering interval 2 or reading transmission later on.Communication control unit 210 has been stipulated the sequential of read data in buffer storage.
In each time T, repeat above-mentioned processing, with coded image data and transmission.
In the example of said structure, transmission in next interval behind coding; If buffer capacity is enough to can transmit at some intervals behind coding being equal to or greater than the time stored data of 2T.
The wireless system of second embodiment of the invention then, is described with reference to Figure 12.
The wireless system of second aspect present invention uses the structure of the wireless image transmission equipment of first aspect present invention.
Among Figure 12, label 1200 is wireless base stations, has comprised that the wireless image transmission equipment of first aspect (is called for short " the storage device 1200a or the wire/wireless TV tuner 1200b of wireless image transmission equipment "), storage image down.
Label 1210～1250 is first to the 5th wireless mobiles among Figure 12, has the view data that demodulation wireless image transmission equipment sends here the function of (being divided into message part A and B, each personal different modulation methods modulation), recovers raw image data.
The operation of this wireless system of explanation now.1200 usefulness this wireless image transmission equipment in base station is encoded and is transmitted the image of storage such as storage device 1200a or with the image of receptions such as TV tuner 1200b.As described in first aspect, use above-mentioned wireless image transmission equipment, the transmission time can be maintained fixed.
As being decided to be 0.2 second the transmission time, just can send independently image of 5 width of cloth in real time to five wireless mobiles 1210～1250.
That is, can realize allowing first to the 5th wireless mobile 1210～1250 watch the wireless system of different films and television broadcasting.
In original technology, transmitting the needed time of each image is fluctuation, makes that the quantity that can send some images simultaneously is very little.For example, even average transmission time was all 0.2 second as described above, if under situation about necessarily requiring, will require to transmit with 0.3 second with 0.3 second maximum time amount transmission view data.
At this moment, transmit four width of cloth at the same time or more during multilevel image data, if the multiple image of transmission reaches maximum transmission time simultaneously, then partly or entirely obvious deterioration will appear in image transmitted, thereby can only send three width of cloth images simultaneously.Implementing this time branch timing, also reduced the utilization ratio in transmission time in addition.
If use the wireless system of Figure 12, both just when the image transmission exists simultaneously with other class data communication, can prevent that also the image transmission quantity from uprushing and cause the reduction of data signaling rate.
Industrial usability
As mentioned above, when using radio transmission apparatus of the present invention, namely use the different modulation of multiple transfer rate Method transmission of video code stream also can transmit with the regular time amount, can effectively utilize bandwidth, can also be real Existing QoS (service quality).

Claims (10)

1. image encoding apparatus, its output be as the image information of encoding code stream combination, comprises the first information part of first modulation method modulation and be different from the secondary information sector of second modulation method modulation of described first modulation method, it is characterized in that, comprising:
To the encoder that combined image data is encoded, it comprises the quantization device of carrying out the quantification of input data according to quantized value; With
Control the encoding amount control device of the encoding amount of described encoder, have:
First information counting device is used to count described first information figure place partly;
The second message count device is used to count the figure place of described secondary information sector;
First information part transmission time calculation element, it calculates the required time of first information part that the described coding of described first modulation method is used in transmission according to the figure place of the described first information part of described first information counting device counting;
Secondary information sector transmission time calculation element according to transmission required time of the described first coded message part and the overall transmission time that can be used for transmitting, calculates the time of the secondary information sector that can be used for transmitting described coding;
The position calculation element that secondary information sector can be transmitted transmits the described encoded secondary information sector and the time of described second modulation method according to can be used for, and calculates the figure place of the described secondary information sector that can transmit;
The calculation element of the position of not transmitting, according to the figure place of the described secondary information sector of the figure place transmitted of described secondary information sector and described secondary information sector counting device counting, calculate surpass that described secondary information sector can transmit figure place do not transmit figure place; With
The quantized value calculation element according to the described figure place of not transmitting, when the summation of required time of required time of described first information part and secondary information sector when being constant, calculates and is used for the quantized value of next image encoding, and export described quantization device to.
2. image encoding apparatus as claimed in claim 1 is characterized in that, for described first and second modulation methods, no matter is transmission quality or transmission speed or neither identical.
3. wireless image transmission equipment is characterized in that having:
Communication control unit is used to stipulate that first modulation method is that first information modulation method, second modulation method partly is the modulation method that is different from the secondary information sector of described first information part, and the overall transmission time that can be used for transmitting;
Modulating device is according to various described modulation method modulation image data;
Wireless transmitter is used to export the signal by the modulating device modulation, and receives the wireless signal of transmission;
Demodulating equipment is used to receive by the received signal of wireless transmitter, and with the described signal of receiving of modulation method demodulation of described communication control unit regulation; With
Picture coding device, this is a kind of described overall transmission time based on described first and second message part modulation method and described communication control unit regulation, and input image data is encoded and generated the picture coding device of code stream;
In the coded data of the described secondary information sector data that the described first information partial data and described second modulation method of described first modulation method modulation are modulated, figure place according to the coded data that can not in described overall transmission time, transmit, when the summation of required time of described first information part required time and described secondary information sector is constant, be controlled at the encoding amount of the coding control period in next total transmission intercal
Wherein, described picture coding device has the encoder that described combined image data is encoded, and comprises the encoding amount control device that quantizes the encoding amount of the quantization device of input data and controlled encoder according to quantized value; And comprise:
First information part counting device is used to count described first information figure place partly;
The secondary information sector counting device is used to count the figure place of described secondary information sector;
First information part transmission time calculation element according to the described first information figure place partly of described first information part counting device counting, calculates the described encoded required time of first information part of using described first modulation method that sends;
Secondary information sector transmission time calculation element according to required time of first information part of the described coding of transmission with divide the overall transmission time that is used in transmission, calculates the time of the secondary information sector that is used to transmit described coding;
Secondary information sector can be transmitted a calculation element, according to the time and described second modulation method of the secondary information sector that is used to transmit described coding, the figure place of the described secondary information sector that calculating can be transmitted;
The calculation element of the position of not transmitting according to the figure place of the described secondary information sector of the figure place of transmitting of described secondary information sector and secondary information sector counting device counting, calculates and surpasses the figure place of not transmitting that described secondary information sector can be transmitted figure place; With
The quantized value calculation element, when required time of described first information part and the required time sum of secondary information sector when being constant, it is according to the described figure place of not transmitting, and calculates to be used for the quantized value of next image encoding and to export described quantization device to.
4. wireless image transmission equipment as claimed in claim 3, it is characterized in that, described communication control unit distributes the required bandwidth of described first and second message part of transmission according to transmission channel agreement, described required separately time of first and second message part of transmission to described overall transmission time.
5. wireless image transmission equipment as claimed in claim 3 is characterized in that, the transmission quality of described first and second modulation methods or transmission speed or the two are all different.
6. wireless image transmission equipment as claimed in claim 3 is characterized in that, the buffer storage of a storage code stream is arranged, and described code stream is encoded to described first and second message part.
7. wireless image transmission equipment as claimed in claim 6 is characterized in that described communication control unit is also controlled the transmission time sequence of described code stream, and exports the sequential of the code stream of storage to described buffer storage indication.
8. wireless image transmission system comprises a plurality of mobile radio stations that can decode by wireless channel coding and image transmitted data to the wireless base station, it is characterized in that described wireless base station has:
Communication control unit is used to be given for first modulation method of the modulation method of first information part, second modulation method of modulation method of secondary information sector that is different from described first information part and the total transmission time that is used to transmit;
Modulating device is according to described modulation method modulation image data;
Wireless transmitter is used to export the signal with the modulation method modulation of regulation, and receives the wireless signal that is transmitted;
Demodulating equipment is used to receive the signal that wireless transmitter receives, and the signal of described reception of the modulation method of described communication control unit regulation is used in demodulation; With
Picture coding device, this is a kind of input image data is encoded and produced the picture coding device of code stream, and described overall transmission time according to described first and second information modulation method and described communication control unit regulation, in the coded data of the described secondary information sector data of modulating with the described first information partial data and described second modulator approach of described first modulator approach modulation, figure place according to the coded data that can not transmit in the described overall transmission time, when the summation of first information part required time and secondary information sector required time when being constant, control the encoding amount of coding control in the next total transmission time interval
Wherein, described picture coding device comprises:
Encoder, it is encoded to combined image data, and comprises the quantization device of carrying out the quantification of input data according to quantized value; With
Control the encoding amount control device of the encoding amount of described encoder, and have:
First information part counting device is used to count described first information figure place partly;
The secondary information sector counting device is used to count the figure place of described secondary information sector;
First information part transmission time calculation element according to the described first information figure place partly that described first information part counting device calculates, calculates the encoded required time of first information part that described first modulation method is adopted in transmission;
Secondary information sector transmission time calculation element according to required time of first information part of the described coding of transmission with divide the overall transmission time that is used in transmission, calculates the time of the secondary information sector that is used to transmit described coding;
Secondary information sector can be transmitted a calculation element, and time and described second modulation method according to the secondary information sector that is used to transmit described coding calculate the figure place that described secondary information sector can be transmitted;
The calculation element of the data bit of not transmitting can transmit the figure place of the described secondary information sector of figure place and secondary information sector counting device counting according to described secondary information sector, calculate surpass the described secondary information sector figure place that can transmit do not transmit figure place; With
The quantized value calculation element when described first information part required time and described secondary information sector required time sum when being constant, according to the described figure place of not transmitting, calculates and is used for the quantized value of next image encoding and exports described quantization device to.
9. method for encoding images, its output are as the image information of encoding code stream combination, and it comprises with the first information part of first modulator approach modulation and the secondary information sector of modulating with second modulator approach that is different from described first modulator approach; Described method comprises the coding step that the view data of described combination is encoded, and comprises according to quantized value importing the encoding amount controlled step of encoding amount in the quantification treatment of quantification of data and the control coding step, and has:
The substep that figure place in the described first information part is counted;
First information part transmission time calculation procedure, the described figure place of the first information part of counting in its described substep according to the figure place of the described first information part of counting is calculated the required time of first information part that sends the described coding that adopts described first modulation method;
Secondary information sector transmission time calculation procedure, it calculates the time of the secondary information sector transmission of described coding according to required time of first information part of the described coding of transmission and the total transmission time that can be used for transmitting;
Substep is calculated in the position that secondary information sector can be transmitted, and wherein, according to the time and described second modulator approach of the secondary information sector of transmitting described coding, calculates the figure place that described secondary information sector can be transmitted;
Count the substep of the figure place of described secondary information sector;
Do not transmit the calculating substep of position, it can transmit the figure place of figure place and described secondary information sector according to described secondary information sector, calculate surpass figure place that described secondary information sector can transmit do not transmit figure place; With quantized value calculation operations substep, when the summation of required time of required time of described first information part and described secondary information sector when being constant, it calculates the quantized value that is used for next image encoding and also exports to finish described quantification treatment according to the described figure place of not transmitting.
10. image transfer method is characterized in that having:
The Control on Communication step, it has stipulated to be used to modulate first modulation method of first information part, second modulation method of secondary information sector that is used to be different from described first information part and the overall transmission time that can be effective to transmit;
Modulation step is according to described each modulation method correction image data;
The wireless receiving and dispatching step, the signal that its output is modulated in modulation step, and receive the signal that is sent;
Demodulation step, it is received in signal received in the wireless receiving and dispatching step, and with the described signal of receiving of the modulation method demodulation of stipulating in the described Control on Communication step; With
The image encoding step, this is a kind of input image data is encoded and produced the means of code stream, comprises the encoding amount controlled step of importing encoding amount in the quantification treatment of quantification of data and the control coding step according to quantized value, and has:
The substep that figure place in the described first information part is counted;
First information part transmission time calculation procedure, the described figure place of the first information part of counting in its described substep according to the figure place of the described first information part of counting is calculated the required time of first information part that sends the described coding that adopts described first modulation method;
Secondary information sector transmission time calculation procedure, it calculates the time of the secondary information sector transmission of described coding according to required time of first information part of the described coding of transmission and the total transmission time that can be used for transmitting;
Substep is calculated in the position that secondary information sector can be transmitted, and wherein, according to the time and described second modulator approach of the secondary information sector of transmitting described coding, calculates the figure place that described secondary information sector can be transmitted;
Count the substep of the figure place of described secondary information sector;
Do not transmit the calculating substep of position, it can transmit the figure place of figure place and described secondary information sector according to described secondary information sector, calculate surpass figure place that described secondary information sector can transmit do not transmit figure place; With
Quantized value calculation operations substep, when the summation of required time of required time of described first information part and described secondary information sector when being constant, it calculates the quantized value that is used for next image encoding and also exports to finish described quantification treatment according to the described figure place of not transmitting
Described image encoding step is according to described first and second modulation method and the described overall transmission time of described Control on Communication step regulation, when required time of described first information part and described secondary information sector when the required time, sum was constant, in the coded data of the described secondary information sector data that the described first information partial data and described second modulator approach of described first modulator approach modulation are modulated, according to the coded data that can not be transmitted in the described overall transmission time, when overall transmission time is next time encoded control at interval, control described encoding amount.
CNB028073258A 2001-02-06 2002-02-04 Wireless image transmission device and image transmission method Expired - Fee Related CN1251507C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP29808/2001 2001-02-06
JP2001029808 2001-02-06

Publications (2)

Publication Number Publication Date
CN1500354A CN1500354A (en) 2004-05-26
CN1251507C true CN1251507C (en) 2006-04-12

Family

ID=18894113

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB028073258A Expired - Fee Related CN1251507C (en) 2001-02-06 2002-02-04 Wireless image transmission device and image transmission method

Country Status (7)

Country Link
US (1) US7724819B2 (en)
EP (1) EP1360840B1 (en)
JP (1) JP2004524741A (en)
CN (1) CN1251507C (en)
AU (1) AU2002230139A1 (en)
DE (1) DE60200938T2 (en)
WO (1) WO2002063884A2 (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4041442B2 (en) * 2003-09-08 2008-01-30 シャープ株式会社 Wireless communication apparatus and wireless communication system
US7680278B2 (en) * 2004-02-04 2010-03-16 Microsoft Corporation Domino scheme for wireless cryptographic communication and communication method incorporating same
JP4788883B2 (en) * 2005-08-31 2011-10-05 日本電気株式会社 Wireless network system, server, terminal, wireless communication method and program
US9306852B2 (en) * 2006-01-27 2016-04-05 Avaya Inc. Coding and packet distribution for alternative network paths in telecommunications networks
WO2007108624A2 (en) 2006-03-17 2007-09-27 Lg Electronics Inc. Method for transforming data, and method for transmitting and receiving data using the same
EP2285111A1 (en) 2009-08-07 2011-02-16 Canon Kabushiki Kaisha Method for sending compressed data representing a digital image and corresponding device
EP2285112A1 (en) * 2009-08-07 2011-02-16 Canon Kabushiki Kaisha Method for sending compressed data representing a digital image and corresponding device
FR2957743B1 (en) * 2010-03-19 2012-11-02 Canon Kk METHOD FOR MANAGING DATA TRANSMISSION BY TRANSMITTING DEVICE WITH SOURCE ENCODING MANAGEMENT, COMPUTER PROGRAM PRODUCT, STORAGE MEDIUM AND TRANSMITTING DEVICE THEREOF
JP5515968B2 (en) * 2010-03-30 2014-06-11 ソニー株式会社 Transmission apparatus and method, and program
JP5515969B2 (en) * 2010-03-30 2014-06-11 ソニー株式会社 Transmission apparatus and method, and program
GB2526943B (en) 2011-12-20 2016-04-27 Imagination Tech Ltd Method and apparatus for compressing and decompressing data
CN102752058B (en) * 2012-06-16 2013-10-16 天地融科技股份有限公司 Audio data transmission system, audio data transmission device and electronic sign tool

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5592225A (en) * 1993-09-30 1997-01-07 Matsushita Electric Industrial Co., Ltd. Device and method for controlling coding
EP0739138A3 (en) * 1995-04-19 1997-11-05 AT&T IPM Corp. Method and apparatus for matching compressed video signals to a communications channel
US6111863A (en) 1995-12-29 2000-08-29 Lsi Logic Corporation Method and apparatus for the dynamic allocation of signal bandwidth between audio, video and data signals
US6011590A (en) * 1997-01-03 2000-01-04 Ncr Corporation Method of transmitting compressed information to minimize buffer space
KR100560712B1 (en) 1997-06-19 2006-03-16 가부시끼가이샤 도시바 Information data multiplexing transmission system, multiplexer and demultiplexer used therefor, and error correcting encoder and decoder
US6275531B1 (en) * 1998-07-23 2001-08-14 Optivision, Inc. Scalable video coding method and apparatus
JP2001169293A (en) * 1999-12-08 2001-06-22 Nec Corp Picture transmission apparatus
US6798838B1 (en) * 2000-03-02 2004-09-28 Koninklijke Philips Electronics N.V. System and method for improving video transmission over a wireless network

Also Published As

Publication number Publication date
US20040076229A1 (en) 2004-04-22
US7724819B2 (en) 2010-05-25
EP1360840B1 (en) 2004-08-11
DE60200938T2 (en) 2005-07-28
EP1360840A2 (en) 2003-11-12
DE60200938D1 (en) 2004-09-16
WO2002063884A3 (en) 2003-03-06
WO2002063884A2 (en) 2002-08-15
CN1500354A (en) 2004-05-26
JP2004524741A (en) 2004-08-12
AU2002230139A1 (en) 2002-08-19

Similar Documents

Publication Publication Date Title
KR100842544B1 (en) Method for Transmitting Scalable Video Coding in Using and Mobil Communication System Using The Same
Yu et al. Wireless scalable video coding using a hybrid digital-analog scheme
Van der Schaar et al. Optimized scalable video streaming over IEEE 802.11 a/e HCCA wireless networks under delay constraints
Wang et al. Multimedia sensing as a service (MSaaS): Exploring resource saving potentials of at cloud-edge IoT and fogs
CN1268130C (en) Adaptive bandwidth match of multi-compression video stream in fixed bandwidth network
Luna et al. Joint source coding and data rate adaptation for energy efficient wireless video streaming
CN1251507C (en) Wireless image transmission device and image transmission method
CN101835042B (en) Wyner-Ziv video coding system controlled on the basis of non feedback speed rate and method
KR20080080602A (en) Time slicing techniques for variable data rate encoding
Zhao et al. Adaptive hybrid digital–analog video transmission in wireless fading channel
CN1754385B (en) Image data distribution device, method, image data receiving method
US20040240415A1 (en) Base station-centric method for managing bandwidth and QoS in error-prone system
Wang et al. Cross layer resource allocation design for uplink video OFDMA wireless systems
Katsaggelos et al. Energy-efficient wireless video coding and delivery
Fuiihashi et al. Graceful quality improvement in wireless 360-degree video delivery
Fan et al. Hybrid digital-analog video multicast scheme based on H. 264/AVC and SoftCast
Mansour et al. Real-time joint rate and protection allocation for multi-user scalable video streaming
Wen et al. HDA video transmission scheme for DASH
US9088778B2 (en) Method and system for multiview distributed video coding with adaptive syndrome bit rate control
Lin et al. Video multicast with heterogeneous user interests in multi-rate wireless networks
Su et al. Distortion management of real-time mpeg-4 video over downlink multicode cdma networks
Wang et al. Energy-aware joint source-channel coding control for quality-optimized wireless multimedia communications
Nu et al. Soft Video Uploading for Low-Power Crowdsourced Multi-view Video Streaming
Ortega et al. 3 Video Transmission over
Li et al. A cross-layer scheduling algorithm for H. 264 video transmission over wireless networks

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20060412

Termination date: 20120204