CN1767650A - Be used for handling the equipment and the method for picture signal at digital broadcasting transmitter - Google Patents

Be used for handling the equipment and the method for picture signal at digital broadcasting transmitter Download PDF

Info

Publication number
CN1767650A
CN1767650A CNA2005101166274A CN200510116627A CN1767650A CN 1767650 A CN1767650 A CN 1767650A CN A2005101166274 A CNA2005101166274 A CN A2005101166274A CN 200510116627 A CN200510116627 A CN 200510116627A CN 1767650 A CN1767650 A CN 1767650A
Authority
CN
China
Prior art keywords
size
video data
data
video
decoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2005101166274A
Other languages
Chinese (zh)
Other versions
CN1767650B (en
Inventor
徐正旭
李东悦
金焕
朴外镇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of CN1767650A publication Critical patent/CN1767650A/en
Application granted granted Critical
Publication of CN1767650B publication Critical patent/CN1767650B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/015High-definition television systems

Abstract

A kind of being used at the video data method and apparatus of decoding of digital broadcasting transmitter to coding.This method comprises: be identified for the video data that receives is carried out the size adjustment control signal that size is adjusted; Analyze header and the separation and the output video data of the video flowing of own coding; Adjust control signal according to size the video data that separates is carried out size adjustment, and be raw pixel data with the video data decoding of size adjustment with initial data size by use variable length kilsyth basalt; Video data to decoding carries out de-quantization; Adjust control signal according to size the frequency domain video data of de-quantization are carried out size adjustment, and be converted into two-dimensional space territory video data; To carrying out motion compensation with the motion of the corresponding moving compensating data of one of video data that separates with the video data of inverse transformation; Be converted to the video data that is used for display unit with output with inverse transformation block and motion compensation units.

Description

Be used for handling the equipment and the method for picture signal at digital broadcasting transmitter
It is the priority of the korean patent application of " equipment and the method that are used for handling at digital broadcasting transmitter picture signal " that the application requires in the 2004-85860 title that on October 26th, 2004 submitted in Korea S Department of Intellectual Property, and this application is disclosed in this for reference.
Technical field
The present invention relates to a kind of equipment and method that receives and handle broadcast singal of bringing in by portable terminal.
Background technology
Current, portable terminal is equipped with the multimedia function that is used for multimedia application specific processor or has enhancing.In addition, the technology that is used for TV functions is installed to portable terminal is just promoted, and is used to install current being among the research of technology of digital broadcasting transmitter.Therefore, current portable formula terminal must provide various multimedia functions, and this will cause portable terminal to have more complicated structure and must carry out more complicated processing.
Therefore, the portable terminal with camera-enabled and multimedia function must and be handled the data that receive from various devices reception data.Yet such portable terminal preferably also has structure as far as possible little, that be used for multimedia function, and this is to be preserved and carried by the user because of these portable terminals.Therefore, current research focuses on exploitation energetically and can carry out multimedia function and the still less portable terminal of its size effectively, well.
Current, the standardization of digital broadcasting is just carried out in world wide energetically.Digital broadcasting can be divided into DMB (DMB) that uses in the U.S. and the digital video broadcasting of using in Europe (DVB).
The portable terminal that is equipped with digital broadcasting transmitter as mentioned above comprises tuner, demodulator and the decoder that is used for receiving digital broadcast.Tuner, demodulator and the decoder that is used for receiving digital broadcast has the different structure of structure with common RF unit, demodulator and the decoder of portable terminal respectively.That is to say that described digital broadcasting transmitter uses the frequency different with the communication frequency of described portable terminal, and uses different demodulation code plans.Therefore, portable terminal has bigger volume inevitably so that assemble aforesaid digital broadcasting transmitter in addition.
Therefore, if the digital broadcasting that receives is processed with the method for the typical characteristics that is suitable for portable terminal, then when realization is equipped with the portable terminal of digital broadcasting transmitter, can reduces size and improve the processing speed of digital broadcasting transmitter.For example, with respect to the display unit of typical image processing unit, the display unit of portable terminal is less, so the display unit of portable terminal is restricted on the size of its image that can show.Therefore, if portable terminal is equipped with the digital broadcasting transmitter that can handle broadcast singal with the method for the display unit that is suitable for portable terminal, then can reduces size and improve the processing speed of portable terminal.
Summary of the invention
Therefore, the present invention is designed to solve the above and other problem of the prior art that occurs in.The object of the present invention is to provide a kind of method with portable terminal and digital broadcast signal that a kind of processing receives of digital broadcasting receiving function in this portable terminal.
Another object of the present invention is to provide a kind of decoding device and method, it can handle the broadcast singal of reception according to the standard of the portable terminal with digital broadcasting receiving function.
Another object of the present invention is to provide a kind of is used for according to the standard of the portable terminal with digital broadcasting receiving function with the broadcast image signal decoding that receives and with the equipment and the method for its demonstration.
Another object of the present invention is to provide a kind of equipment and method, its can according to the scan type of the signal in the portable terminal with digital broadcasting receiving function come selective reception the broadcast image signal the zone and with this signal decoding.
Another object of the present invention is to provide a kind of equipment and method, its can according to the scan type of the signal in the portable terminal with digital broadcasting receiving function and show size come selective reception the broadcast image signal the zone and with this signal decoding.
In order to realize above and other purpose, provide a kind of Video Decoder of digital broadcasting transmitter.This Video Decoder comprises: the big or small control unit of adjusting is used to produce the video data that receives is carried out the size adjustment control signal that size is adjusted; Header analyzer is used to analyze the header from decoded video stream, and separating video data and with its output; Variable-length decoder, being used for by using the variable length kilsyth basalt will be the raw pixel data with initial data size from the video data decoding of header analyzer output; De-quantizer is used for the video data de-quantization with decoding; Inverse transformation (IT) unit is used for adjusting control signal by size the frequency domain video data of de-quantization is carried out the size adjustment and are converted into two-dimensional space territory video data; With the motion compensator unit, be used for compensating with the motion of a corresponding moving compensating data of the video data of inverse transformation and the video data that separates.
A kind of Video Decoder of digital broadcasting transmitter is provided according to a further aspect in the invention.This Video Decoder comprises: the big or small control unit of adjusting is used to produce the video data that receives is carried out the size adjustment control signal that size is adjusted; Header analyzer is used to analyze the header from decoded video stream, and separating video data and with its output; Variable-length decoder, being used for by using the variable length kilsyth basalt will be the raw pixel data with initial data size from the video data decoding of header analyzer output, described variable-length decoder comprises big or small adjuster, table transducer and buffer, described big or small adjuster is controlled described table transducer and will be included in by the data decode in the piece in the big or small adjustment region of size adjustment control signal setting, and the video data in the controller buffer storage size adjustment region; De-quantizer is used for the video data de-quantization with decoding; Inverse transformation (IT) unit is used for adjusting control signal by size the frequency domain video data of de-quantization is carried out the size adjustment and are converted into two-dimensional space territory video data; The motion compensator unit, comprise a plurality of motion compensators, in the described motion compensator one adjust control signal by size and select, the motion of a corresponding moving compensating data in the video data of the motion compensator of selection pair and inverse transformation and the video data that separates compensates; And color converter, be used for the output of inverse transformation block and motion compensator unit is converted to video data.
According to a further aspect in the invention, a kind of digital broadcasting transmitter of portable terminal is provided, and described portable terminal comprises that the signal up conversion that is used for sending is the signal of RF frequency band and is the RF communication unit of baseband signal with the RF signal down conversion that receives and is used for data processor with baseband signal demodulation and decoding.Described digital broadcasting transmitter comprises: control unit is used for selecting to produce channel selecting signal by the user, and produces the size adjustment control signal that is used for the video data that receives is carried out the size adjustment based on the demonstration size of described portable terminal; Tuner is used for basis is come the digital broadcast signal of selective reception by the channel selecting signal of control unit generation channel; Demodulator is used for the digital broadcast signal demodulation to selecting; Decoder, comprise the demodulation multiplexer that is used for from the digital broadcast signal separating audio of demodulation stream and video flowing, be used for the data decode Video Decoder of the video flowing that will separate and the audio decoder of the data decode of the audio stream that is used for separating, described Video Decoder comes big or small adjustment is carried out and with the video data decoding the big or small adjustment region in the decoding zone of the video data that receives based on adjust control signal from the size of control unit output; Display unit is used to show the video data of decoding; And memory, being used for the digital broadcast signal that storage is exported from demodulator under logging mode, described memory comprises the buffer that is used for temporarily storing by the data of decoder processes.
According to a further aspect in the invention, provide a kind of method that is used for the video data decoding of the coding of digital broadcasting transmitter.This method may further comprise the steps: be identified for the video data that receives is carried out the size adjustment control signal that size is adjusted; Analysis is from the header of decoded video stream; Separating video data and with its output; Adjust control signal by size the video data that separates is carried out size adjustment; Using the variable length kilsyth basalt is the raw pixel data with initial data size with the video data decoding of size adjustment; Video data de-quantization with decoding; Adjusting control signal by size carries out the size adjustment and is converted into two-dimensional space territory video data the frequency domain video data of de-quantization; To with the video data of inverse transformation and the video data that separates in the motion of a corresponding moving compensating data compensate; Be converted to the video data that is used for display unit with data with two-dimensional space territory video data and passive movement compensation.
Description of drawings
By the detailed description of carrying out below in conjunction with accompanying drawing, above and other purpose of the present invention, characteristics and advantage will become apparent, wherein:
Fig. 1 is the block diagram of expression according to the digital broadcasting transmitter of the portable terminal of the embodiment of the invention;
Fig. 2 is the block diagram of the decoder in the presentation graphs 1;
Fig. 3 is the block diagram of the demodulation multiplexer shown in the presentation graphs 2;
Fig. 4 is the block diagram of the audio decoder shown in the presentation graphs 2;
Fig. 5 is the block diagram of the Video Decoder shown in the presentation graphs 2;
Fig. 6 A is the curve chart of RF characteristics of signals of expression digital broadcasting transmitter, and it shows with 386MHz to be the existing of RF signal in each frequency band at center;
Fig. 6 B is the curve chart of the particular physical channel (8MHz) among the RF channel shown in the detailed presentation graphs 6A;
Fig. 6 C represents the characteristic of the IF filter of digital broadcasting transmitter;
Fig. 7 A represents the stream of digital broadcasting transmitter;
Fig. 7 B represents the pack arrangement of digital broadcasting transmitter;
Fig. 8 represents the video layer structure of digital broadcasting transmitter;
Fig. 9 A to Fig. 9 C is the curve chart of the interleaved characteristic of expression;
Figure 10 A and Figure 10 B represent the example of the scanning carried out with different pixel orders based on location of pixels;
Figure 11 A to Figure 11 D represents the characteristic that 4 * 4,8 * 2,4 * 2 and 4 * 2 sizes are adjusted;
Figure 12 represents the banded filter (zonal filter) of IDCT unit;
Figure 13 A to Figure 13 C represents the example by the big or small adjustment region setting of the IDCT unit of Figure 12;
Figure 14 A to Figure 14 D represents the characteristic by 1/2nd picture elements (pel), 1/4th picture elements and 1/8th picture element motion compensation of motion compensator unit execution;
Figure 15 A and Figure 15 B be expression according to the embodiment of the invention be used for image encoded size is adjusted and the block diagram of the Video Decoder of decoding;
Figure 16 is a flow chart of determining the processing of big or small adjustment factor for the size adjustment of control of video decoder;
Figure 17 is the block diagram of expression variable-length decoder;
Figure 18 is the block diagram of the IDCT unit of expression Video Decoder;
Figure 19 is the block diagram of the motion compensator unit of expression Video Decoder;
Figure 20 is the flow chart that is used for the processing of video decode according to the preferred embodiment of the invention;
Figure 21 A to Figure 21 D represents the example according to the screen of 8 * 8 Video Decoders of the embodiment of the invention and 4 * 4 Video Decoders;
Figure 22 A and Figure 22 B are respectively the examples according to the display screen of the Video Decoder with the motion compensator that uses 1/2nd picture elements and 1/4th picture element schemes of the embodiment of the invention;
Figure 23 represents to be used to measure according to embodiment of the invention size and adjusts and the structure of the SNR of the vision signal of decoding;
Figure 24 A to Figure 24 D is the PSNR curve chart relatively according to the vision signal of being adjusted by size in the Video Decoder of the embodiment of the invention;
Figure 25 A to Figure 25 C represents the example according to the result of the size adjustment of the video data of the embodiment of the invention;
Figure 26 A and Figure 26 B represent the structure that the Video Decoder of size adjustment is carried out in use IIT unit of passing through according to the embodiment of the invention; With
Figure 27 represents according to the digital broadcasting transmitter in the portable terminal of the embodiment of the invention.
Embodiment
Below, with reference to the accompanying drawings the preferred embodiments of the present invention are described in detail.In the following description, though same parts is presented in the different accompanying drawings, same parts will be specified by same numeral.
In addition, the various specific definitions in describing below are such as the communication frequency of digital broadcasting transmitter, data structure etc., only be provided for help to general understanding of the present invention, to it will be clear to someone skilled in the art that under the situation that does not have such definition, the present invention still can realize.
The invention provides a kind of like this equipment and method, i.e. demonstration size of the signal of this equipment and methods analyst reception or the like is adjusted the decoding area size of this signal, in the zone of size adjustment data is decoded then.In apparatus and method according to the invention, be alternative in all data that received by digital broadcasting transmitter are decoded, the decoding zone is adjusted by size adaptively according to the characteristic of digital broadcasting transmitter.Therefore, the present invention can reduce the decode operation amount to a great extent according to the characteristic of digital broadcasting transmitter, reduces decode time thus.
The size in the decoding zone of digital broadcast signal is adjusted factor and can be comprised: the demonstration size of digital broadcast signal, image scanning type, block scan type, according to the decoding quality of the state of portable terminal and the communication environment (decoding speed of decoder) of digital broadcasting transmitter.Be used for the control signal that size is adjusted by using in the above-mentioned big or small adjustment factor one or two, can producing.In the following description, for the size adjustment control of decoder, will consider all five big or small adjustment factors.
The size adjustment control of decoder can be applicable to divide screen and show the digital broadcasting transmitter (for example, picture-in-picture (PIP) or multihead display) of a plurality of broadcast singals on this screen.This portable terminal in addition, has less display unit, so needn't or be unsuitable for showing all images of the digital broadcast signal of reception because be equipped with the portable terminal of digital broadcasting transmitter.Therefore, be preferably in decoding and before the broadcast singal size adjusted, so that portable terminal can show this signal on its display unit.As mentioned above, when adjusting, size can consider all size adjustment factors.
Fig. 1 is the block diagram of expression according to the digital broadcasting transmitter of the portable terminal of the embodiment of the invention.Digital broadcasting transmitter shown in Fig. 1 comprises: RF tuner 110, demodulator 120 and decoder 130.The software that decoder 130 can be used as the performance of the decoder that is used for realizing digital broadcasting transmitter is embedded in control unit 100.
Key input unit 170 comprises key that is used for digital information or character information input and the function key that is used for various function setting.Function key comprises the key that is used for selection function, such as the channel selection that is used for receiving digital broadcast, the control of broadcast reception pattern etc.
Control unit 100 is carried out the general control of portable terminal.For example, according to key by key input unit 170 input, control unit 100 produce the channel of digital broadcasting transmitters select control data, be used for demodulator 120 and decoder 130 control data, be used for determining the control data etc. of the demodulation performance of demodulator 120.
Memory 180 can comprise program storage and data storage.Program storage storage be used for digital broadcasting transmitter broadcast reception program and according to the program of the embodiment of the invention.In addition, data storage can be used as the video memory that is used for storing the view data that is received by digital broadcasting transmitter under the control of control unit 100.When control unit 100 comprised another memory that is used for the program execution, memory 180 can be a video memory.
Display unit 150 shows the picture signal of the digital broadcasting transmitter of being handled by decoder 130 under the control of control unit 100.Loud speaker 160 reproduces the audio signal of being handled by decoder 130 under the control of control unit 100.
RF tuner 110 is selected digital broadcast channel based on the channel control data of control unit 100, and with the frequency downconverted of the broadcast singal of the channel selected to produce intermediate-freuqncy signal.Demodulator 120 is demodulated into primary signal with the modulated digital broadcast singal.
Decoder 130 is divided into picture signal and audio signal with the signal of demodulation, to the picture signal told and audio signal decoding and with its output.
With reference to Fig. 1, the digital broadcast signal of the reception of portable terminal can be VHF frequency band (174MHz~230MHz; C5~C12) and/or UHF frequency band (470MHz~862MHz; The signal of C21~C69) and/or L band signal (1GHz~2.6GHz).When the user selects broadcast channel, control unit 100 outputs and the corresponding control data of selecting of channel.RF tuner 110 produces and the blended RF frequency according to channel data, produces the intermediate-freuqncy signal of the channel of selecting thus.Described intermediate frequency (IF) can be 36.17MHz.
Above-mentioned Simulation with I F signal is applied in demodulator 120.Then, demodulator 120 becomes digital signal with this analog signal conversion, according to predetermined demodulation scheme with this digital demodulation signal, and output demodulation signal.Digital broadcasting transmitter can use Coded Orthogonal Frequency Division Multiplexing (COFDM) (COFDM) scheme as modulation scheme.According to a preferred embodiment of the invention, demodulator 120 can use the MT352 that is made and sold by Zarlink Semiconductor Inc TMIn this case, be outputted as 8 MPEG-2TS data by the signal of demodulator 120 demodulation.That is to say that demodulator 120 will become numerical data from the conversion of signals of the channel of the selection of RF tuner 110 output, described numerical data is according to the quantity of additional code element and carrier wave and Be Controlled and along the fast Fourier transform (FFT) looped cycle.In addition, the FFT signal is reproduced as final signal by order and the error correction at interval that is used to rebuild this signal, and this final signal is outputted as the MPEG-2TS signal.
Be applied in decoder 130 from the MPEG-2TS signal of demodulator 120 outputs.Then, decoder 130 is divided into view data and voice data with the MPEG-2TS signal that receives, to them decoding, output image signal and voice signal then.Picture signal can be rgb signal or YUV signal, and it is stereo that audio signal is outputted as pulse-code modulation (PCM) usually.In addition, by display unit 150 outputs and show, audio signal is applied in loud speaker 160 and by its reproduction from the picture signal of decoder 130 output.
As mentioned above, the general operation of control unit 100 control figure broadcasting receivers.For such control, the channel control data that the user of the frequency field of the channel that control unit 100 will be used to select determines and export to RF tuner 110 such as the control data of carrier mode (for example, 2K, 8K etc.).In addition, for demodulator 120, control unit 100 specify code rates, protection interval etc., so that demodulation can normally be carried out, described bit rate, protection interval etc. is the different information according to each national broadcast standard.In addition, for decoder 130, control unit 100 is carried out the initialization of the actual business of watching in the predetermined physical channel that is used to specify, send such as reproduce, stop, the order of record, screen capture etc., and during decoding receiving feedback information.
In addition, can be used as the input/output (i/o) buffer, another memory space of digital broadcast signal or the decoding storage of the temporary buffer during the decoding is essential for the decoding in the decoder 130.Control unit 100 and decoder 130 can be shared this decoding storage.In addition, this decoding storage can be used as the input/output (i/o) buffer of image and voice signal and the information stores of decoding is table.Can be stored in data in this table comprises and comprises picture sequence (GOP sequence; IBBPBBP...) various information, described picture sequence are used as the standard that is used for determining during the decoding and are included in the header of each frame.
Memory 180 can be used as decoding storage.Yet, when memory 180 only is used as video memory, can use independent memory as decoding storage.
Fig. 2 is the block diagram of expression decoder 130.In decoder 130, demodulation multiplexer 210 receives from the MPEG-2TS data of the demodulation of demodulator 120 outputs, and each data is divided into voice data, video data and other data.Among the data of telling, described other data are data except that video data and voice data in the digital broadcast signal, and it can be a routine data.
In the following description, with the description of omitting, and only the video and audio signal of broadcast singal is described described other data.
The information of the broadcasting of the selection that is used for demodulation multiplexer 210 is selected and reported to control unit 100, be product IDs (PID) or traffic ID, demodulation multiplexer 210 also is divided into view data and voice data with this target data based on the PID that selects from select target data among the various data of demodulator 120 outputs.
Input buffer 220 is typical queue buffer, and the quantity that storage can be handled by Video Decoder 230 after the input buffer 220 and audio decoder 250, the data of demultiplexing in real time, described typical queue buffer can be the cyclic buffer that has with the structure of the structural similarity of fifo buffer.Input buffer 220 can have and is used for the two overall structure or have of stored video data and voice data and is used for the structure of stored video data and voice data dividually.
230 pairs of video data decodings of Video Decoder.
In the broadcasting of digital broadcasting transmitter, receive MPEG-2 video-frequency basic flow (ES) usually and convert thereof into YUV 4:2:0 data.Yet according to embodiments of the invention, MPEG-2 video ES is converted into the RGB data as the output that is suitable for the display unit (LCD) of portable terminal.
In addition, according to the present invention, the decoding of vision signal is according to the size of the display unit of portable terminal and optionally carried out.The RGB data of conversion are stored in the video output buffer 240 and at correct output time point and are output.
250 pairs of audio signal decodings of audio decoder.In the mode identical with video decode, audio decoder 250 receives the MPEG-2 audio ES and converts thereof into the pcm audio signal.The pcm audio signal of conversion is temporarily stored in the audio output buffer device 260 and at correct output time point and is output.
Fig. 3 is the block diagram of the demodulation multiplexer 210 shown in the presentation graphs 2.In demodulation multiplexer 210, the MPEG-TS signal of exporting from demodulator 120 is stored in the buffer 211.Buffer 211 uses the high-speed data storage input data such as camera interface.Buffer 211 preferably has the structure of typical queue buffer.PID checker 213 is search audio frequency PID or video PID from the head of MPEG-TS data flow, based on these PID data is divided into the Voice ﹠ Video data, and checks the PID of described other data.According to the output of PID checker 213, select voice data and video data in the TS stream of bit parser 215 from be stored in buffer 211, and with the storage selected in buffer 217.Buffer 217 can be the input buffer 220 shown in Fig. 2.
As mentioned above, demodulation multiplexer 210 is checked the PID from the header of the TS stream of demodulator 120 outputs, TS stream is divided into audio signal and vision signal, with audio signal and the vision signal demultiplexing in the TS stream, and with the signal storage of demultiplexing in input buffer 220.
Fig. 4 is the block diagram of the audio decoder 250 shown in the presentation graphs 2.Audio decoder 250 has the identical structure of structure with MPEG-1 Layer-1/2 decoder.Yet under the situation of the digital broadcasting of for example DVB or DMB, audio decoder can be AAC+ audio decoder, BSAC audio decoder or WHA audio decoder.
With reference to Fig. 4, when the bag data of sufficient amount were buffered in the input buffer 220, the data that header analyzer/bale breaker 253 will be stored in the input buffer 220 were unpacked, and analyzed head, and the result of head analysis is exported to matching unit (list constructor) 254.Matching unit (list constructor) 254 has decoding table, and the header of operational analysis is carried out the bit parsing by the voice data that coupling is stored in the input buffer 220.
Substrip analysis device 255 is analyzed the subband of the voice data of being resolved by bit, and analysis matrix converter 257 produces filtering matrix and carries out filtering calculating by the analysis of subband.Thereafter, data packetizer 259 is arranged and is made up by the time from the voice data of the decoding of analysis matrix converter 257 outputs, and the voice data of exporting from data packetizer 259 is stored in the audio output buffer device 260.
Fig. 5 is the block diagram of the Video Decoder 230 shown in the presentation graphs 2.Video Decoder 230 shown in Fig. 5 has the structure identical with the structure of MPEG-2 Video Decoder.H.264, WMV or MPEG-4 Video Decoder have and the slightly different structure of the structure shown in Fig. 5.H.264, WMV or MPEG-4 Video Decoder have the identical basic element of character yet, the described basic element of character comprises: variable-length decoder (VLD), and the coded data that is used for having variable-length is decoded into the data with original length; Inverse converter is used for the data transaction of two-dimensional frequency is become the view data in two-dimensional space territory; And motion compensator (MC), be used to compensate the motion of described view data.Under the situation of the Video Decoder that is used for the data of mpeg encoded are decoded, inverse converter can use inverse discrete cosine transform (IDCT) scheme.Yet when to when H.264 the scheme coded data is decoded, inverse converter can use inverse integer transform (IIT) scheme.
With reference to Fig. 5, the data that are stored in the demultiplexing in the input buffer 220 are transfused to header analyzer 311.Header analyzer 311 extracts the header that is used for video data stream decoding, and only sends the view data of compressing to buffer 313.313 pairs of information of buffer cushion, and are transmitted fully up to the information of a frame.The two field picture of buffering can be I frame, P frame or B two field picture in buffer 313.The I frame is the intracoded frame (intra frame) that has with the structure of the structural similarity of jpeg image data, and it does not carry out motion compensation.Yet P frame and B two field picture are non-intraframe coding two field pictures, and it must be with reference to former frame image and the motion of next frame image compensation.Therefore, when the vision signal of buffering in buffer 313 was the I frame signal, this I-frame video signal was applied in variable-length decoder to be used for decoding.Yet, when the vision signal of buffering in buffer 313 is B frame or P frame signal, carry out motion compensation.
In decoding, variable-length decoder 315 sequentially reads the input data, carries out decoding by matching list, and sends initial data among the data of decoding to de-quantizer 317.De-quantization is carried out in the output of 317 pairs of variable-length decoders 315 of de-quantizer, only extracts the DC component from frequency domain data, and the DC component that extracts is exported to inverse discrete cosine transformer (IDCT unit) 319.IDCT unit 319 converts frequency domain data to based on the DC component that obtains by de-quantization and is used for other regional special domain data.The value of conversion has the YUV 4:2:0 form of MPEG-2.
Below, discussion is needed the decoding of the P two field picture and the B two field picture of motion compensation.At first, because the P frame needs the former frame image, so motion compensator unit 335 relatively obtains motion vector by the former frame image that will be stored in the previous image memory 331 with input P two field picture, then by using the vector that obtains to come compensating motion.Because the B frame needs former frame image and next frame image, so motion compensator unit 335 relatively obtains motion vector by the next frame image that will be stored in the former frame image in the previous image memory 331 and be stored in next video memory 333 with input B two field picture, then by using the vector that obtains to come compensating motion.P two field picture and B two field picture are applied in variable-length decoder 315, and in variable-length decoder 315, the P two field picture stands with the B two field picture and is used for the identical processing of I frame image signal process of decoding.In addition, the moving compensating datas of 335 outputs are added to the data of extracting by the process from last P frame or B frame to IDCT by adder 337 from the motion compensator unit.The data of addition also have YUV 4:2:0 form.
Because the display characteristic of display unit 150, the video data that has the output of YUV 4:2:0 form as mentioned above need be converted.The display unit 150 of portable terminal is LCD normally.When display unit 150 was LCD (TFT LCD), the video data that must will have YUV 4:2:0 form converted the data with 16 or 18 rgb formats to.
For common cathode ray tube (CRT) monitor, the video data that must will have YUV 4:2:0 form converts the data with 24 rgb formats to.Therefore, transducer 321 video data that will have a YUV 4:2:0 form converts the data with the appropriate format (for example, rgb format) that is used for output unit to.Data with form of conversion are buffered in the video output buffer 240.
Just as common TV signal, the RF signal of the digital broadcasting that receives by antenna has the frequency in VHF frequency band and the UHF frequency band.In addition, each channel has bandwidth, for example 8MHz.
Fig. 6 A is the curve chart of RF characteristics of signals of expression digital broadcasting transmitter, and it shows with 386MHz to be the existing of RF signal in each frequency band at center.Fig. 6 B is the curve chart of the particular physical channel (8MHz) among the RF channel shown in the detailed presentation graphs 6A.Therefore, when a user selects particular channel, the control data that control unit 100 will be used for the channel selection sends RF tuner 110 to, and RF tuner 110 produces channel frequency based on this control data, selects the signal of the channel of the specific selection as shown in Fig. 6 B thus.Be subjected to being used for the filtering of preset channel from the signal of RF tuner 110 output, be used as the intermediate-freuqncy signal of the frequency downconverted of this signal through the signal of filtering.
Fig. 6 C represents that by through the frequency shifts of centre frequency the RF signal filtering of a channel being mixed then with 36.167MHz be the IF signal of the conversion that obtains of the filtered signal at center.
Demodulator 120 converts input signal to digital signal, and converts the IF digital signal of conversion to baseband digital signal.Thereafter, this baseband signal its according to the quantity of additional code element, carrier wave etc. and the controlled while along the FFT looped cycle.In addition, the order of the signal by FFT loop output and at interval for the error correction of this signal and with this signal reproduction be final signal and rebuilt, then, this final signal is outputted as the MPEG2-TS data.The MPEG2-TS data can have as in the structure as shown in Fig. 7 A.In the transport stream (TS) of MPEG2-TS data, 188 bytes are formed a bag (TS bag), and each bag comprises head (TS head) and data field.Data field can comprise video data or voice data, has the order corresponding with multiplexing order, and has not regulation.The structure of the TS head of table 1 presentation graphs 7A.
Table 1
Bag Describe The position is distributed
Sync byte The Ox47 synchronous code 8
Error indicator TS wraps existence or does not have mistake 1
Payload begins indicating device The payload starting position 1
Transmission priority Decoder priority 1
PID The bag type identifier 13
Scrambler control The scrambler pattern 2
The control of self adaptation field The existence of self adaptation field data/payload 2
The continuity counter 4 digit counters 4
Data field in the head shown in Fig. 7 B presentation graphs 7A.With reference to Fig. 7 B, this data field can be a payload field, and it comprises: self adaptation field, Packet Elementary Stream (PES) head and payload (video/audio data).As used herein, term ' payload ' refers to video/audio/data (described data comprise the EPG data) here.
In payload field, the self adaptation field comprises additional information and PCR (clock reference) information that adds during fabrication substantially.In addition, PES field comprises the information that is used for each bag decoding, and comprises the synchronous temporal information that is used for when decoding especially, such as showing time mark (PTS) and decoding time mark (DTS).
The structure of PES field in the following table 2 video data field.
In addition, payload field comprises video or voice data substantially, may also comprise the additional header data field simultaneously.Described video or voice data can be video-frequency basic flow (ES) or audio ES that is commonly referred to the MPEG2 dynamic menu or the binary data that is used for data broadcasting.
Table 2
Bag Describe The position is distributed
Opening code Ox000001 24
Stream ID Flow identifier 8
The PES packet length “10” 2
The control of PES scrambler The scrambler ON/OFF 2
PES priority Decoding priority 1
Data queue's indicating device The decoding order 1
Copyright Copyright exist/does not exist 1
Original paper or copy Original paper/copy 1
The PTS/DTS sign The existence of PTS/DTS/do not exist 2
Other signs According to the sign of MPEG-2, such as ESCR, ES 6
PES data length The total length in PES packet header 8
Additional header data With ' data length-basic the distribution ' as many data -
Be used to receive from the decoder 130 of the MPEG2-TS data of demodulator 120 outputs and comprise: demodulation multiplexer 210, being used for MPEG2-TS data demultiplexing is video and voice data; And audio decoder 250 and Video Decoder 230, be used for Voice ﹠ Video data decode to demultiplexing.Video Decoder 230 is the video data decoding to receiving frame by frame, and the data of decoding are exported to display unit 150.According to the input type of display unit 150, the data that are sent to display unit 150 from decoder 130 can be all kinds.
Following table 3 illustrates the example of the various input types of display unit 150.
Table 3
Main application Show size
Mobile phone (plain old telephone) 128×128
128×160
176×160
176×208
176×220
240×320
Smart phone (smart phone, PDA) 128×160
176×208
176×220
240×320
324×354
Mobile A/V (DSC, DVC, PMP, Car TV, etc.) 320×240
480×234
492×240
561×240
800×480
800×600
Numeral TV 1280×1024
1920×1080
In addition, the signal that exports loud speaker 160 to from decoder 130 passes through the audio coder-decoder chip usually.Therefore, this signal or directly output or be output after being encoded into the PCM signal as simulated audio signal.
Though RF tuner 110 is carried out different functions and operation independently with demodulator 120, they are also referred to as Network Interface Module (NIM).Communication means between control unit 100, RF tuner 110 and the demodulator 120 can be 12C.In addition, based on control data, 230 exchanges of the Video Decoder of control unit 100 and decoder 130 are used for that broadcast reception begins, time-out, record, end, frame per second adjustment, screen size adjustment and color balance are adjusted control data and video decode result.In addition, the exchange of the audio decoder 250 of control unit 100 and decoder 130 is used to begin, record, equalizer, volume, quiet and the control data that frame per second is adjusted and the audio decoder result of described control data.
Input/output signal between table 4 indicative control unit 100 and the decoder 130.
Table 4
Controller → decoder
Controller → Video Decoder
Controller Video Decoder
Beginning (reproduction) Input buffering begins
Screen capture (temporarily stopping) Present image output ﹠ is stored in the memory temporarily
Record (image storage) Complete input buffering is stored in the memory
Finish (stopping) Decoding stops
Frame per second is adjusted Frame-skipping operation ﹠ frame-skipping is provided with
Show size adjustment The size adjuster is operated ﹠ screen output size and adjusts
The rgb color balance is adjusted R, G, B factor are adjusted (adjustment of output color)
Controller → audio decoder
Controller Audio decoder
Beginning (reproduction) Input buffering begins
Record (voice storage) Complete input buffering is stored in the memory
Equalizer Provide the weights of each frequency band
Volume control Volume control
Quiet (decoding continues) closed in voice output
Frame per second is adjusted Frame-skipping operation ﹠ frame-skipping is provided with
Audio/video decoder → controller
Decoder Controller
Too much decoding load Reduce frame per second
Buffer underflow Temporarily stop
The buffering overflow Decoding stops ﹠ and restarts
Cutout Inner alarm
Lose the stream source Temporarily stop the ﹠ user alarm
Hereinafter, with the displaying scheme of describing in detail according to Video Decoder 230, adjust the processing of the size of the picture screen that will be shown by Video Decoder 230.
The method of adjusting the picture screen size according to an embodiment of the invention comprises the factor that some sizes are adjusted, such as showing size, image scanning type, block scan type, decoding speed, decoding quality etc.In the process of the size of the screen picture of adjusting decoding, can use factor that more aforesaid such sizes adjust or all.Hereinafter, will pass the factor of considering all size adjustment through discussion and the situation of adjusting the size of the picture screen that is applied to display unit 150.
Yet, before the processing of describing the size adjustment in detail, will go through the operation of the Video Decoder 230 that is used for the size adjustment.
H.264 and MPEG4 the video encoder of digital broadcast transmitter can use various picture coding schemes, such as MPEG2.In addition, the Video Decoder of digital broadcasting transmitter must use and the corresponding decoding scheme of encoding scheme that uses in the video encoder of digital broadcast transmitter.Present embodiment is based on such hypothesis, and promptly digital broadcasting transmitter is the receiver that is used to receive the MPEG2 picture signal.Therefore, Video Decoder 230 shown in Figure 5 can be the MPEG2 Video Decoder.Yet H.264 Video Decoder 230 also can be or the MPEG4 Video Decoder.
With reference to Fig. 5, header analyzer 311 is divided bag according to each layer of MPEG2 video ES structure shown in Figure 8, and analyzes the head of the layer of dividing.MPEG2 video layer structure comprises six layers, as (a) of Fig. 8 to (f).
With reference to Fig. 8, Video Sequence Layer (a) is the group of screens with series of identical attribute.Sequence head has a kind of major function, and by it, it can make can carry out from the reproduction of the middle beginning of bit stream.Promptly, sequence head is the part that comprises the general information of fundamental sum among the MPEG2, and sequence opening code back is followed information continuously, shows size, the vertical sign that shows size, screen aspect ratio, movie ratings, bit rate, video buffer verifier device (VBV), buffer sizes, parameter sign and be used to load two quantization matrixes such as level.
Image sets (GOP) layer (b) has the version of group of screens and from the information of duration that sequence begins etc., this group of screens is used as random access units.A plurality of signs are followed in the opening code back, such as time_code sign, closed_GOP sign, broken_link sign etc.
Picture frame layer (c) has as the screen coding pattern of the public characteristic of a screen, picture type etc.The D picture that is used for MPEG1 has the screen that tool only is used for the DC assembly of F.F., rewind down etc., and its picture type comprises I, P and B picture.The opening code back and then indicates time reference, picture type, indication encoder or the motion vector of the order of the screen among the GOP whether to have the sign of graduation of whole numbers of units, the frame period of motion vector (F_code) etc.
Lamella (d) comprises the public information that is used for the small screen with predetermined length told from a large-screen, for example, and quantified property.Lamella (d) is some bands with macro block of predetermined length, and this macro block is in the unit with the minimum among a series of data sequences of opening code, can not spread all over a plurality of pictures.Can not skip first and last macro block.Yet, under the situation of the sheet that only comprises a macro block, can skip this macro block.Not reproducible or skip one of sheet.The upright position of sheet is included in the sheet opening code self, and the horizontal level of first macro block of sheet is represented by the macroblock address of macroblock layer.
Macroblock layer (e) is to be linked to a plurality of layers (f), the normally layer of four piece layers.Macroblock layer (e) comprises motion-compensated values and motion vector value etc., and these values are the public informations that are used for from the block of pixels of lamella division.Macroblock layer (e) comprises macro block filling, macro block outlet, macroblock address (MBA), macro block (mb) type of predetermined quantity etc., and they are sequentially arranged.
Piece layer (f) is to be used to the least unit transmitting and compress, and it comprises necessary IDCT coefficient and finishes with block end (EOB).Comprise 64 VLC with such coefficient even work as piece layer (f), EOB also is set up.Interior DC uses independently VLC, other represented by two-dimentional VLC.
Therefore, header analyzer 311 is divided into bag according to each layer with MPEG2 video ES shown in Figure 8, and analytical sequence head, GOP head, picture header, head and macro block head.In addition, result based on aforesaid head analysis, header analyzer 311 is checked: frame per second, picture size, picture coding type (I frame, P frame or B frame), GOP sequence are (by the sequence of the I/P/B frame of MPEG2 canonical representation, such as ' IBBPBBPBBP ' or ' IBPBPBPBPBP '), in decoding processing afterwards, to use this result.
Buffer 313 is stored the real data among the data of being divided as mentioned above by header analyzer 311.The real data that is stored in the buffer 313 comprises that the index of blocks of data is so that blocks of data can be extracted with macro block mode.These data are I frames, and these data are imported into variable-length decoder 315.Variable-length decoder 315 is carried out length-changeable decoding (VLD) based on the information that transmits from header analyzer 311 is resolved.Preferably the length-changeable decoding scheme of being used by header analyzer 311 is the Hoffman decoding scheme of being advised as the MPEG2 standard, and in this scheme, each data is read by bit and is converted based on predetermined standard scale.
When decoding was performed with macro block mode, typical variable length decoding method was at first carried out.Variable-length decoder 315 will become initial data according to the data transaction of compression of variable length code (VLC) scheme and storage.Variable-length decoder 315 continues decoding till its all data complete decoding with a macro block.
Value by variable-length decoder 315 decodings is imported into de-quantizer 317.De-quantizer 317 is extracted the DC value in DCT, this is the core of MPEG2 dynamic image compression.Inverse discrete cosine transformer (IDCT unit) 319 is carried out the decoding of IDCT scheme.In MPEG2, the unit of IDCT is restricted to 8 * 8 pixel regions, and conversion (8 * 8IDCT) can be defined by following equation (1).
f ( x , y ) = 1 4 Σ u = 0 7 Σ v = 0 7 C ( u ) C ( v ) F ( u , v ) cos ( 2 x + 1 ) uπ 16 cos ( 2 y + 1 ) vπ 16 . . . . . . ( 1 )
Two-dimensional transform in the equation (1) is equal to such processing, in this is handled, as having stood in the equation (2) for the data of x transformation of axis by transposition (transpose) and stand identical IDCT for the y axle subsequently.Following equation (2) definition is used for 8 IDCT of x axle, and following equation (3) definition is used for 8 IDCT of y axle.
f ( x ) = 1 2 Σ u = 0 1 C ( u ) F ( u ) cos ( 8 x + 1 ) uπ 16 . . . . . . . . . . . . ( 2 )
f ( y ) = 1 2 Σ v = 0 7 C ( v ) F ( v ) cos ( 2 y + 1 ) vπ 16 . . . . . . . . . . . . ( 3 )
When but the data from buffer 313 outputs were not for the I frame are the non-intracoded frame of P or B frame, the processing that is used for motion compensation was necessary.When these data were P or B frame, the extra processing that is used for motion compensation was performed, and the result of this processing is compared with the final result of IDCT and is output subsequently.
When these data are the P frame, view data and the B two field picture of input of motion compensator unit 335 by will being stored in the former frame in the previous image memory 311 is compared to each other, come calculating kinematical vector, come motion is compensated by the vector value that uses this calculating then.Because the B frame requires former frame image and next frame image, so compare with the B two field picture of input by the next frame image that will be stored in the former frame image in the previous image memory 331 and be stored in next video memory 333 in motion compensator unit 335, obtain motion vector, and use the vector of this calculating that motion is compensated subsequently.
Motion compensation by the MPEG2 standard recommendation is inserted into the correlation between the enhancement frame by using 1/2nd picture element resolution (half-pel resolution).That is, the movable information that sends by channel is calculated according to 1/2nd picture element resolution.As mentioned above the motion-compensated values of Ji Suaning by adder 337 with its with previous IDCT value addition of calculating after be output.
Thereafter, the signal of idct transform (I, B and P two field picture) is converted into the signal that is suitable for display unit 150 by transducer 321, and is shown unit 150 outputs subsequently.When display unit 150 was LCD (LCD), transducer 321 was a rgb video signal with the yuv video conversion of signals.
150 scannings are used for dynamic image for display unit, and especially the method for the signal of Guang Bo dynamic image can be divided into two types, comprising: line by line scan and interlacing scan.
Fig. 9 A is the figure that the feature of lining by line scan is shown, and Fig. 9 B to Fig. 9 C is the figure that interleaved feature is shown.According to lining by line scan among Fig. 9 A, for each row, output signal is scanned.According to the interlacing scan among Fig. 9 B and Fig. 9 C, for even number line and odd-numbered line, output signal is scanned respectively.
Figure 10 A is illustrated in the scan method that is used for 8 * 8 pixels are compressed into the one dimension pixel in the dynamic image compression method such as MPEG2.Be necessary that converting the one dimension value to by the two dimension value with the DCT coefficient comes the DCT coefficient is encoded.In this coding, can improve compression efficiency by respectively low frequency signal being flocked together and high-frequency signal being flocked together.Therefore, such gathering is implemented by above-mentioned scanning.This scanning comprises saw-tooth sweep of all using among MPEG1 and the MPEG2 shown in Figure 10 A and the mixed sweep of only using in MPEG2.Figure 10 A and 10B illustrate based on locations of pixels and the example that scans with different pixel orders.
For the portable terminal with digital broadcasting transmitter, the size of adjusting the picture signal that receives is efficiently.Promptly, the display unit 150 of portable terminal has limited size, its size than the display unit of typical digital broadcasting transmitter is much smaller, and therefore, the size of the picture signal that adjust to receive is so that display image has the size of the display unit 150 that is suitable for portable terminal is efficiently.In addition, the screen display (image scanning) for the image that is received by digital broadcasting transmitter can use lining by line scan and interlacing scan shown in Fig. 9 A to 9C.Therefore, preferably be somebody's turn to do the size of the picture signal that receives according to the image scanning project setting of the picture signal that receives.
In addition, can be by adjust the size of picture signal as the block scan scheme that shows among Figure 10 A and the 10B.
Because portable terminal is the compact apparatus that is different from the Typical Digital broadcasting receiver, portable terminal has limited decoding speed.Therefore, preferably adjust the size of picture signal according to the processing speed of the digital broadcast signal that receives by portable terminal.
Can adjust the size of picture signal according to decoding quality, this can be shown by portable terminal.Therefore, being used for according to an embodiment of the invention, the size adjustment factor of the size adjustment control signal of Video Decoder 230 can be represented as shown in the following Table 5.Certainly, the factor except the size adjustment factor that is shown in Table 5 can be considered.
Table 5
The factor title Factor is described The factor value example
Show size The size of the final screen that shows SD、CIF、QCIF
Image scanning The screen display type Interlacing line by line,
Block scan The block scan type Zigzag, alternately
Decoding speed Decoding speed At a high speed/low speed
Decoding quality Decoding quality High-quality/low quality
Among the size adjustment factor of portable terminal, the size adjustment factor with maximum effect is the size of the display unit 150 of portable terminal.Therefore, in the process of the size that shows size based on the adjustment of size adjustment factor, can consider all big or small adjustment factors as shown in table 5 or consider the factor of at least one selection.Following examples of the present invention are based on such hypothesis, consider that promptly all size adjustment factors adjust the size that shows size.
Video Decoder 230 is adjusted the size of the image of reception by considering big or small adjustment factor as mentioned above.But the size adjustment of the variable-length decoder 315 in the Video Decoder 230, IDCT unit 319 and motion compensator unit 335 carries out image.Yet the variable-length decoder 315 in the Video Decoder 230, IDCT unit 319 and motion compensator unit 335 can consider that different size adjustment factors carries out size and adjust.
The size adjustment control signal of adjusting factor according to size can be as following table 6 to being classified shown in the table 8.
Among size was adjusted control signal, most important signal was that the size of IDCT unit 319 is adjusted control signal, and by it, the size of variable-length decoder 315 and motion compensator unit 335 is adjusted control signal and can be determined.
Table 6 shows the size adjustment control signal of IDCT unit 319, describes the big or small adjustment factor of explaining therein, and such as showing size, image scanning type and decoding quality, according to it, the size of IDCT unit 319 adjustment size (control signal) is determined.
Table 6
Major control (IDCT size) Describe
8×8 SD (720 * 576) output/not output of size adjustment
8×4 360 * 288 export/only are used for alternately
8×2 360 * 288 export/only are used for alternately low quality
4×4 360 * 288 outputs
4×2 360 * 288 output/low quality 180 * 144 export/only are used for alternately
4 * 2 (being modified) 360 * 288 output/low quality, ultrahigh speed 180 * 144 output/high-quality, at a high speed
2×2 180 * 144 outputs
In addition, shown in following table 7A and 7B, according to the size of the IDCT unit 319 of table 6, the size of variable-length decoder 315 is adjusted control signal and is determined.Table 7A shows zigzag type VLD size adjustment and result thereof, and table 7B shows zigzag type and the alternately adjustment of type VLD size, their result and the comparison between their effect.
Table 7A
Major control VLD control Describe
8×8 64 100% load (size fully)
8×4 50 78%
8×2 37 57%
4×4 25 39%
4×2 12 18%
4 * 2 (being modified) 10 15%
2×2 5 8%
Table 7B
Major control Zigzag VLD control Alternately VLD control Description/zigzag (replacing)
8×8 64 64 100% load (size fully)
8×4 50 34 78%(53%)
8×2 37 15 57%(23%)
4×4 25 26 39%(40%)
4×2 12 10 18%(15%)
4 * 2 (being modified) 10 9 15%(14%)
2×2 5 6 8%(9%)
In addition, the size of motion compensator unit 335 is adjusted control signal by showing that size, decoding quality and decoding speed are definite.
Following table 8 shows the size adjustment control signal of motion compensator unit 335.
Table 8
Show size Quality/speed MC control
720×576 - / 2nd picture elements
360×288 High/- / 4th picture elements
360×288 Low/- / 2nd picture elements
180×144 High/- / 8th picture elements
180×144 Low/height / 4th picture elements
180×144 Low/low / 2nd picture elements
Hereinafter, detailed description is used for adjust according to a preferred embodiment of the invention the operation of Video Decoder 230 of the size of image.
At first, will size adjustment operation that use data to skip by variable-length decoder 315 according to the preferred embodiment of the invention be discussed.
As mentioned above, the frame sign that has 720 * 576 pixels as the standard screen of a kind of DVB-T of digital broadcasting broadcasting.In addition, the screen of portable terminal has the frame sign of 176 * 208 pixels.Therefore, when typical digital broadcasting transmitter was handled digital broadcast signal, the big display unit of typical digital broadcasting transmitter can't reproduce the signal with sharp screen quality.Yet, when portable terminal shows image from digital broadcast signal, to the signal decoding that is used for complete Typical Digital broadcasting receiver is poor efficiency, and preferably portable terminal reduces the size of image by the size of adjusting this signal before handling the broadcast singal that receives.In addition, carrying out size adjustment before signal is compressed is efficiently.
Although in the following description only 1/2 nThe example that size such as (1/2,1/4) is adjusted comes into question, but self-evident, under 8 * 8 situation, 1/8~7/8 size adjustment also is feasible.
Use 1/2 nSize is adjusted, and can realize operation faster by using quick IDCT algorithm.Although only 1/2 nSize adjustment is described, and all size adjustment of from 1/8 to 7/8 are feasible.Because can be to such 1/2 nSize adjustment is used fast algorithm (butterfly algorithm), so mainly adopt 1/2 nSize is adjusted.For example, when level and vertical size are reduced to 1/2 respectively, can only carry out IDCT to 4 * 4 zones, thereby produce 4 * 4 spatial domain datas, this spatial domain data is approximately equal to the result's who obtains from 8 * 8IDCT mean value.
Therefore, it is nonsensical carrying out extra operation in order to obtain other data except that 4 * 4 numeric field datas.That is, obtain the end position of final piece and the comparison do not shown by length-changeable decoding and analyzing and processing and only VLD is carried out in the zone of reality decoding simply and IDCT is just enough.As a result, can reduce a large amount of operations.
It should be noted that, because mixed sweep has the effect of the saw-tooth sweep of being similar to, so hereinafter saw-tooth sweep will only be discussed.
Figure 11 A illustrates 4 * 4 scannings when level and vertical size are reduced 1/2 respectively.According to 4 * 4 scannings shown in Figure 11 A, in order to obtain 4 * 4 zones, extract until the index of the 24th index is just enough, this is corresponding to operation is reduced to 25/64.4 * 4 scannings can be applied to lining by line scan shown in Fig. 9 A.Yet when the interlacing scan that this scanning is applied to shown in Fig. 9 B or 9C, but the data of the enough vertical axises of data of trunnion axis only have been transmitted 1/2 of the whole time.Therefore, in order to obtain to be similar to the result that 4 * 4 size is lined by line scan, preferably carry out 8 * 2 size adjustment shown in Figure 11 B.In addition, this method is by experience and such discovery and produce, and promptly right lower quadrant shows more a spot of data in the typical natural image and the result of IDCT.
Figure 11 C illustrates the size adjustment by interleaved 4 * 2.With reference to Figure 11 C, adjust in the size adjustment that is used for interleaved 1/4 horizontal vertical ratio or in the size of 1/2 the horizontal vertical ratio that is used for lining by line scan, be found as mentioned above in the data of right lower quadrant and be in low frequency, be necessary to replenish the data of vertical axis in the interlacing scan.Therefore, in Figure 11 C, the data of right lower quadrant have low frequency, and 4 * 2 scanning areas are replenished the data of vertical axis in the interlacing scan.Scanning area shown in Figure 11 C is corresponding to operational ton is reduced to 12/64.
Figure 11 D illustrates 4 * 2 scannings of modification, and this is a kind of by making up the best approach that above feature obtains, and corresponding to operational ton is reduced to 10/64.
Next, carry out the processing that size is adjusted with describing according to a preferred embodiment of the invention by band shape (zonal) filtering of using IDCT unit 319.
Figure 12 illustrates the banded filter 393 of IDCT unit 319.With reference to Figure 12, when variable-length decoder 315 by only extracting pixel in the part at whole pixel region, when promptly carrying out length-changeable decoding by the size adjustment, IDCT is also carried out to the part of the selection of whole pixel region in IDCT unit 319.In this case, the filter that is used for selection portion subregion (zone of selection) is called as banded filter 393.When n * n zone was selected and processed as shown in figure 12 from N * n-quadrant, this hint size adjustment from N to n was done, and the IDCT equation that is used for every kind of situation can be represented as equation (4) to (6).More particularly, equation (4) is corresponding to 2 IDCT equations, and equation (5) is corresponding to 4 IDCT equations, and equation (6) is corresponding to 8 IDCT equations.
f ( x ) = 1 2 Σ u = 0 1 C ( u ) F ( u ) cos ( 8 x + 1 ) uπ 16 . . . . . . . . . . . . ( 4 )
f ( y ) = 1 2 Σ v = 0 3 C ( v ) F ( v ) cos ( 4 y + 1 ) vπ 16 . . . . . . . . . . . . ( 5 )
f ( y ) = 1 2 Σ v = 0 7 C ( v ) F ( v ) cos ( 2 y + 1 ) vπ 16 . . . . . . . . . . . . ( 6 )
The difference of equation (4) to (6) is that they have adopted respectively twice, four times and eight sigma.Yet if use butterfly algorithm (fast algorithm), only the actual speed of IDCT part becomes faster.
When in the process of coding, carrying out DCT, comprise that the low frequency component of DC value accumulates in upper left quarter.In using this feature, the most numerical value in the piece except 0 is present in the left side.Consider this point, based on such hypothesis, promptly other coefficient has 0 value, and to 8 * 2 part executable operations among 8 * 4 zones of selecting, the great majority operation of using in the processing of being expert at that comprises multiplication, addition and displacement is reduced to 1/2 by only.In addition, to 4 * 2 part executable operations among 4 * 4 zones of selecting, just as in the processing to 8 * 4 parts, the operation during row is handled is reduced to 1/2 by only.The zone of selecting can have with as the identical effect of the set scanning area of Figure 13 A to 13C.
In this case, only select to have difference between 8 * 2 parts at 8 * 2IDCT with in the process of execution IDCT.That is, when the part of selecting 8 * 2,2 * 1 one dimension IDCT for the row processing execution eight times, 8 * 1 one dimension IDCT for the row processing execution four times.Yet, for 8 * 2IDCT, 2 * 1 one dimension IDCT for the row processing execution eight times, 8 * 1 one dimension IDCT for the row processing execution twice.
Below table 9 be presented at the result of the capable IDCT among 8 * 4IDCT and the 4 * 4IDCT, following table 10 is presented at the result of capable IDCT in the zone of the selection among 8 * 4IDCT and the 4 * 4IDCT.
Table 9
blk[0]=((x0+W1*x1+W2*x2+W3*x3)>>8); blk[1]=((x0+W5*x1-W2*x2-W1*x3)>>8); blk[2]=((x0-W7*x1-W6*x2+W5*x3)>>8); blk[3]=((x0-W3*x1+W6*x2+W7*x3)>>8);
Table 10
blk[0]=((x0+W1*x1)>>8); blk[1]=((x0+W5*x1)>>8); blk[2]=((x0-W7*x1)>>8); blk[3]=((x0-W3*x1)>>8);
With reference to table 10, the processed and values that all IDCT handle of the capable IDCT in 8 * 4 or 4 * 4 zones that are used for selecting are stored in four pieces subsequently.Even, blk[2 8 * 2 regional when selected when only having] or blk[3] use 0 filling neither be genuine.That is, although 8 * 4 or the process handled of 4 * 4IDCT in part except the zone of the selection of piece be assumed that 0, whole IDCT that stood of 8 * 4 in the row processing.When horizontal component when among 8 * 2IDCT, being reduced to 1/4, lost too many data in the horizontal direction, thereby even for show carry out interpolation after, the image of conversion still demonstrates the difference excessive with original image.Yet,, can make the minimized results that obtain operational ton simultaneously of mass loss by adopting said method.
The effect that the size of the IDCT of above-mentioned processes and displays in the Video Decoder that uses the mpeg encoded scheme that picture signal is decoded is adjusted.Yet even when using such as H.264 integer transform (IT) when picture signal is decoded, this method still can have similar effects.Under latter event, Video Decoder can be carried out size adjustment by using inverse integer transform device (IIT), and its scale adjusting method will be described later.
Hereinafter, in motion compensator unit 335, carry out the operation that size is adjusted with describing according to a preferred embodiment of the invention by using minimum movement to compensate.
The video compression standard definition of MPEG2: the correlation in the motion compensation can be enhanced by the interpolation of using 1/2nd picture element resolution.That is, the movable information that sends by channel has 1/2nd picture element resolution shown in Figure 14 A.When banded filter is selected 8 * 4 or 4 * 4 zones among 8 * 8, according to decoder of the present invention by interpolation from the movable information of 1/2nd picture element resolution that send to as shown in Figure 14B 1/4th picture element resolution, can significantly reduce the error in the motion compensation, described decoder only flatly is reduced to 1/2 image or all is reduced to 1/2 image horizontally and vertically according to the selection of banded filter is exportable.
In addition, when banded filter is selected 8 * 2 zones among 8 * 8, according to decoder of the present invention by interpolation from the movable information of 1/2nd picture element resolution that send to 1/8th picture element resolution shown in Figure 14 C, can significantly reduce the error in the motion compensation, described decoder is according to exportable 1/4 the image that flatly is reduced to of the selection of banded filter.That is, when image was reduced to 1/2, minimum two of six movable informations of transmission can be interpolated 1/4th picture element resolution.When image was reduced to 1/4, minimum three of six movable informations of transmission can be interpolated 1/8th picture element resolution.
Figure 14 D illustrate be used for motion compensation in be inserted into the example of 1/4th picture element resolution.If 1/2nd picture element positions are that Xh and Yh and 1/4th picture element positions are Xq and Yq, then the position from the most upper left integer pixel is: Xdist=0.5 * Xh+0.25 * Xq; And Ydist=0.5 * Yh+0.25Yq.When motion compensation when 1/4th picture element level of resolution are performed, be positioned at the pixel d[I of 1/4th picture element positions] separated Xdist with the most upper left integer pixel and Ydist is so far away.Therefore, power is respectively 1-Xdist and 1-Ydist.So bilinear interpolation d[i] can be by following table 11 definition.
Table 11
d[i]=xweight*(yweight*s[i]+ydist*s[i+1x])+ xdist*(yweight*s[i+1]+ydist*s[i+1x+1])
According to a preferred embodiment of the invention, Video Decoder 230 comes image encoded is adjusted size and decoding by using size adjustment factor as shown in table 5.From the size adjustment factor shown in the table 5, show size (SD: big or small fully; CIF: 1/2nd sizes; QCIF: 1/4th sizes) and display quality (decoding quality) can be provided with by the user, scan type (image scanning or block scan) can determine that decoding speed can be determined according to the communication environment of portable terminal according to the digital broadcast signal that receives.Therefore, when having by the digital broadcasting transmitter received signal of structure shown in Figure 1 and being presented at the image of this signal on the display unit 150, the user selects to show size and display quality for the image that will be shown.In the case, show that size can be a kind of in aforesaid complete size (SD:720 * 526 pixels), 1/2nd sizes (CIF:360 * 288 pixels) and 1/4th sizes (QCIF:180 * 244 pixels), decoding quality can be high-quality or normal quality.
In addition, Video Decoder 230 comes the analysis scan type according to the head of the video ES that receives, thereby determines big or small adjustment factor.Scan type can be to be used for lining by line scan or interlacing scan (screen display type) of image scanning, can also be sawtooth scan or the mixed sweep that is used for block scan.The present invention only discusses the sawtooth scan that is used for block scan.
In addition, control unit 100 is based on communication environment, and for example the speed of receiving digital broadcast signal is determined decoding quality.That is, when portable terminal was in the good environment that digital broadcasting receives, portable terminal had high communication quality, and Video Decoder 230 can come signal is decoded by high decoding quality.Yet when portable terminal was in the adverse circumstances that digital broadcasting receives, the decoding quality of the signal of reception reduced.
About the size adjustment of as mentioned above Video Decoder 230 being carried out, can be only based on the size of adjusting image encoded from the one or more big or small adjustment factor in the size adjustment factor shown in the table 5.That is, can be only based on carry out size adjustment from the demonstration size in the size adjustment factor.In the case, the size adjustment of being finished by Video Decoder 230 can be performed as 8 * 8,4 * 4 or 2 * 2 size.
In addition, when only carrying out the size adjustment based on and image scanning big or small from the demonstration in the size adjustment factor, the size of adjusting can be used for lining by line scan 8 * 8,4 * 4 and 2 * 2 a kind of, also can be used for interleaved 8 * 4,4 * 2 and 4 * 2 (corrections) a kind of.That is, Video Decoder 230 can be carried out size adjustment based in the size adjustment factor shown in the table 5 at least one.
Below about the description of the embodiment of the invention based on such hypothesis: Video Decoder 230 is carried out size adjustment based on the whole size adjustment factor shown in the table 5.
Figure 15 A and 15B are the Video Decoders 230 that is used for image encoded is carried out size adjustment and decoding that illustrates according to the embodiment of the invention.In Figure 15 A and 15B, be marked at the big or small adjuster that each corresponding parts represented in letter ' R ' in each variable-length decoder 315, IDCT unit 319 and the motion compensation units 335, it serves as corresponding part in the size adjustment.Video Decoder 230 shown in Figure 15 A has the structure that can decode to the image that comprises I, B and P frame, and the Video Decoder 230 shown in Figure 15 B has the structure that can decode to the image that comprises I and B frame.
Figure 16 is a flow chart of determining the processing of big or small adjustment factor for the size adjustment of control of video decoder 230.In process shown in Figure 16, control unit 100 is analyzed big or small adjustment factor, and analyzes the image size of control of video decoder 230 to adjust based on this.
With reference to Figure 16, when the broadcast reception pattern had been set up, control unit 100 was analyzed big or small adjustment factor and control of video decoder 230.Described big or small adjustment factor can be the combination in any of five factors shown in the table 5.
In step 511, control unit 110 determines to show size based on the size of display screen.The big I of display screen is manually determined by user's input, also can automatically be determined by control unit 100 according to the size of display unit 150.Display unit 150 can have different sizes according to the type of portable terminal.More particularly, the display unit that the portable terminal in Europe has 176 * 208 sizes usually, the portable terminal of Korea S has the display unit of 176 * 200 sizes usually.Below about the description of the embodiment of the invention based on such hypothesis: control unit 100 is automatically determined the size of display screen based on the size of the display unit 150 of portable terminal.
Control unit 100 is checked display type (image scanning type).The information of image scanning type is inserted in the head of video image.Therefore, the header analyzer 311 of Video Decoder 230 extracts image scanning information from the head of the image of reception, and sends it to control unit 100.Next, in step 513, control unit 100 can be determined the image scanning type of the picture signal of current reception.The image scanning type can be shown in Fig. 9 A line by line scan or Fig. 9 B and 9C shown in interlacing scan.
Control unit 100 is checked the block scan type.The information of block scan type is inserted in the head of video image.Therefore, the header analyzer 311 of Video Decoder 230 extracts block scan information from the head of the image of reception, and sends it to control unit 100.Next, in step 515, control unit 100 can be determined the block scan type of the picture signal of current reception.The block scan type can be the mixed sweep shown in the sawtooth scan shown in Figure 10 A or Figure 10 B.
In addition, the decoding quality of Video Decoder 230 can be selected by the user.Decoding quality can be influential to the resolution of screen.Though decoding quality can have various ranks, ensuing description is based on such hypothesis: decoding quality only has two-stage, i.e. high-quality or normal quality.Therefore, when decoding quality was determined, the decoding quality that control unit 100 is selected in step 517 affirmation when the decoding quality of selecting is high-quality, improved size adjustment controlling value in step 521.When the decoding quality selected during normal quality, control unit 100 enters step 523 and does not change size and adjust controlling value.
In addition, control unit is determined decoding speed by the environment of analyzing portable terminal.When step 523 need be considered speed as most important factor in decoding, control unit 100 enters therein that control unit 100 reduces the step 525 that size is adjusted controlling value.Yet when need not in step 523 speed considered as most important factor in decoding, control unit 100 does not change size and adjusts controlling value.During most important factor in speed is considered to decode, can decode to the lot of data frame.
In step 527, control unit 100 is determined size adjustment controlling value based on size adjustment factor, and the size that will determine is adjusted the big or small adjuster 410,420 and 450 that controlling value sends to variable-length decoder 315, IDCT unit 319 and motion compensation units device 355 respectively.
In step 529, the decoding video signal of the digital broadcasting of 230 pairs of receptions of control unit 520 control of video decoders.Video Decoder 230 is adjusted the decoding video signal of controlling value to the digital broadcasting of reception according to size, and it is outputed to display unit 150.
In step 531, control unit 100 determines whether to lack the resource that is used for the decoding video signal of the digital broadcasting of current reception.This resource is influential to the decoding speed of Video Decoder 230.Promptly, when because carry out the Another Application program in the combine digital broadcast service time, or because decoded information is insufficient in the digital broadcasting reception environment, for example, the broadcast reception ability is owing to the reduction of the communication environment of portable terminal reduces, and making resource (operating characteristics) when lacking, decoding speed reduces.Therefore, control unit 100 is checked the current state of portable terminal, thereby determines whether to lack resource in step 531.When lacking source or decoded information, control unit 100 reduces size in step 525 and adjusts controlling value.
When resource and decoded information when being sufficient, control unit 100 keeps current size to adjust controlling value when the control decoder keeps decoding, up to stopping being determined in step 533.
Said process according to the size adjustment control of adjusting factor based on size, at first determine to show size according to user's selection or according to the size of display unit 150, stream type according to the digital broadcast signal that receives is determined image scanning type and block scan type, and considers that by the user qualitative factor determines decoding quality.In addition, when control unit was determined to regard decoding speed as most important factor, in order to improve decoding speed, control unit can reduce size and adjust controlling value.
As mentioned above, control unit 100 is determined size adjustment controlling value by analyzing size adjustment controlling value.Table 7A, 7B, 6 and 8 illustrate the size of variable-length decoder 315, IDCT unit 319 and motion compensation units 335 respectively and adjust controlling value.
Adjust the example of the process of controlling value according to the size of the definite IDCT unit 319 of reference table 6, when showing that size is CIF, the image scanning type is to line by line scan, decoding speed is a normal speed, when decoding quality was high-quality, control unit 100 determined that it is as shown in table 64 * 4 that size is adjusted controlling values.In addition, when showing that size is CIF, the image scanning type is interlacing scan, and decoding speed be normal, and when decoding quality was high, control unit 100 determined that size adjustment controlling values are as shown in table 68 * 4.
The size of aforesaid IDCT unit 319 is adjusted controlling value and is applied to variable-length decoder 315 in an identical manner.The size of motion compensator unit 335 is adjusted controlling value and is determined according to demonstration size, decoding quality and decoding speed.That is, when showing that size is QCIF and decoding quality when being high, control unit 100 outputs 1/4th picture element control signals are adjusted controlling value as the size of motion compensator unit 335.When showing that size is QCIF, decoding quality be normal, and decoding speed is for just often, and control unit 100 is exported the size adjustment controlling value of 1/2nd picture element control signals as motion compensation units device 335.
Figure 15 A and 15B are the block diagrams that is used for image encoded is carried out the structure of the big or small Video Decoder 230 of adjusting and decoding that illustrates according to the embodiment of the invention.As mentioned above, the Video Decoder 230 shown in Figure 15 A has the structure that can decode to the image that comprises I, B and P frame, and the Video Decoder 230 shown in Figure 15 B has the structure that can decode to the image that comprises I and B frame.
With reference to Figure 15 A, header analyzer 311 extracts and analyzes the header of the picture signal that receives, and this information is sent to control unit 100.Control unit 100 is determined size adjustment controlling value by carrying out processing shown in Figure 16, thereafter these values is applied to the big or small adjuster 410,420 and 450 of variable-length decoder 315, IDCT unit 319 and motion compensator unit 355 respectively.
Figure 17 is the block diagram that variable-length decoder 315 is shown.With reference to Figure 17, VLD size adjuster 410 receives size from control unit 100 and adjusts controlling values, adjusts the operation that controlling value is come control table transducer 413 based on size, and the output that will show transducer 413 outputs to output buffer 415.Table transducer 413 comprises the table that is used for length-changeable decoding, receives from the view data of buffer 313 outputs, will be converted to initial data with the image input data of variable length code, exports data converted thereafter.The operation of table transducer 413 is by big or small adjuster 410 controls.Under the control of big or small adjuster 410, output buffer 415 bufferings and output are by the initial data of table transducer 413 decodings.
With reference to Figure 17, based on adjusting the decode operation that controlling value is controlled variable-length decoder 230 from the size of control unit 100 outputs.Size adjustment controlling value can be the value shown in table 7A and 7B, and it comprises the information about the block scan type.For example, when size modulations controlling value indication 4 * 4 sawtooth scan types, the data of 413 pairs of variable length codes of size adjuster 410 control table transducers are decoded, until the 24th pixel data, and 16 pixel datas of control output buffer 415 storages the 0th, 1,2,3,4,5,6,7,8,9,11,12,13,17,18 and 24.In addition, when size is adjusted controlling value indication 4 * 4 mixed sweep types, the data of 413 pairs of variable length codes of size adjuster 410 control table transducers are decoded, until the 25th pixel data, and 16 pixel datas of control output buffer 415 storages the 0th, 1,2,3,4,5,6,7,8,9,18,19,10,21,24 and 25.
When size is adjusted controlling value indication 4 * 2 sawtooth scan types, the data of 413 pairs of variable length codes of size adjuster 410 control table transducers are decoded, until the 11st pixel data, and 8 pixel datas of control output buffer 415 storages the 0th, 1,2,3,4,8,9 and 11.In addition, when size is adjusted controlling value indication 4 * 2 mixed sweep types, the data of 413 pairs of variable length codes of size adjuster 410 control table transducers are decoded, until the 9th pixel data, and 8 pixel datas of control output buffer 415 storages the 0th, 1,2,3,4,5,8 and 9.
As mentioned above, only in the presumptive area of adjusting the controlling value setting by size, carry out length-changeable decoding and confirm that the result is enough for variable-length decoder 315.Therefore, when variable-length decoder 315 is initially carried out VLD and the result of VLD is outputed to output buffer 415, when the result exceeded by size adjustment controlling value institute restricted portion, 315 pairs of inlet flows of variable-length decoder carried out bypass, and finish length-changeable decoding.Because the data by bypass are not used in decoding, so even when data are not provided with correct length-changeable decoding value, problem can not take place yet.When size adjustment controlling value had been set up, variable-length decoder 315 was carried out decoding, until the size that is set up is adjusted the last pixel data of controlling value.The last pixel data that corresponding size is adjusted controlling value is according to scan type (sawtooth scan or mixed sweep) and difference.It should be noted that size adjustment has greatly been reduced the decoding calculating quantity of variable-length decoder 315 among the table 7B.
Figure 18 is the block diagram that the IDCT unit 319 of Video Decoder 230 is shown.With reference to Figure 18, buffer 415 can be the output buffer 415 of variable-length decoder 315.The 319 pairs of Y-axis pixels in IDCT unit are carried out IDCT, thereafter the X-axis pixel are carried out IDCT.Therefore, IDCT unit 319 comprises Y-axis size adjuster (Y size adjuster) 421 and X-axis size adjuster (X size adjuster) 431, its each all have the scanning area of determining by banded filter.At first, Y size adjuster 421 is adjusted controlling value according to size and is confirmed Y-axis size adjustment controlling value, next will be sent to from the corresponding IDCT unit the IDCT 423 to 428 from the data of buffer 415 outputs.Corresponding IDCT unit is to carrying out IDCT from the data of buffer 415 output, next with this storage in buffer 429.Next, X size adjuster 431 is adjusted controlling value according to size and is confirmed X-axis size adjustment controlling value, next will be sent to from the corresponding IDCT the IDCT 433 to 438 from the data of buffer 429 outputs.Next, corresponding IDCT unit is to carrying out IDCT from the data of buffer 429 output, next with this storage in buffer 439.By the X-axis data are carried out IDCT, the result of Y-axis and X-axis IDCT is stored in the buffer 439.
Figure 18 illustrates the IDCT unit of being selected by Y-axis size adjustment controlling value and at first carries out the IDCT operation, carries out the IDCT operation by the big or small IDCT unit of adjusting the controlling value selection of X-axis thereafter.Yet, at first carry out the IDCT operation in the IDCT unit of selecting by X-axis size adjustment controlling value, carry out under the situation of IDCT operation by the big or small IDCT unit of adjusting the controlling value selection of Y-axis thereafter, can obtain identical effect.
As shown in the above-mentioned table 6, the size of IDCT unit 319 is adjusted controlling value and is determined.Therefore, when IDCT size adjustment controlling value is 8 * 4, the data that Y size adjuster 421 will be stored in the buffer 415 are sent to 8 IDCT unit 423,8 423 pairs of IDCT unit are sent to 8 Y-axis pixel datas of 8 IDCT unit 423 and carry out IDCT, and with the storage handled in buffer 429.
In addition, the data that X size adjuster 431 will be stored in the buffer 429 are sent to 4 IDCT unit 435,435 pairs of 4 the X-axis pixel datas (being subjected to the data of Y-axis IDCT) from 431 outputs of X size adjuster in 4 IDCT unit are carried out IDCT, and with the storage handled in buffer 439.Similarly, when IDCT size adjustment controlling value was 4 * 2, Y size adjuster 421 was sent to 4 IDCT unit 425 with data, and X size adjuster 431 is sent to 2 IDCT unit 437 with data.
As mentioned above, controlling value is carried out Y-axis and the X-axis size is adjusted operation according to adjusting such as 8 * 8,8 * 4,8 * 2,4 * 4,4 * 2,2 * 2,4 * 1,2 * 1 and 1 * 1 size in the IDCT unit.In the case, because 8 points, are identical with 2 IDCT equatioies,, Y size adjuster 421 and X size adjuster 431 transmit the IDCT coefficient at 4 so being used for adjusting controlling value according to size.In the case, as shown in figure 12, IDCT unit 319 only extracts by size and adjusts the subregion that controlling value is determined, and by the banded filter of use the IDCT of Y-axis and X-axis is carried out in the zone of extracting, and IDCT is not carried out in other zone.Therefore, to shown in the 13C, in the size of IDCT unit 319 is adjusted,, at first carry out Y-axis IDCT, next carry out X-axis IDCT, and other regional pixel is not carried out IDCT for adjusting the zone that controlling value is provided with by size as Figure 13 A.
Table 6 illustrates the IDCT size and adjusts controlling value and effect thereof.
Figure 19 is the block diagram that the motion compensator unit 335 of Video Decoder 230 is shown.With reference to Figure 19, input buffer 461 receives and cushions the motion vector of the video data that receives.MC size adjuster 450 is adjusted control signal based on size and is selected corresponding motion compensator, and transmits the motion vector of input buffer 461.Motion compensator can comprise 1/4th picture element compensators 463,1/2nd picture element compensators 465 and 1/8th picture element compensators 467.Motion compensator compensates this motion by use by the motion vector of the present frame of big or small adjuster 450 selections and input and the motion vector of former frame and next frame.Output buffer 469 cushions and exports the output of the motion compensation of 1/4th picture element compensators 463,1/2nd picture element compensators 465 and 1/8th picture element compensators 467.
In the operation of motion compensation units 335, the control of the size of motion compensation units 335 is determined by demonstration size, decoding quality and decoding speed shown in the table 8.
When motion compensator was fixed to 1/2nd picture element compensators in motion compensator unit 335, motion compensation may be influential to decoding quality.For example, if motion compensation is performed 1.5 location of pixels in 8 * 8 screens, then in 4 * 4 or 8 * 4 screens, motion compensation must be performed 0.75 location of pixels.When carrying out motion compensation with 1/2nd picture element schemes in 4 * 4 or 8 * 4 screens, this motion is by the compensation of 0.5 location of pixels, thereby decoding efficiency may reduce.Therefore, can improve the efficient of motion compensation by 1/4th picture element schemes of Y-axis motion compensation that use is used for motion compensation, 4 * 2 screens of the Y-axis of X-axis motion compensation, 4 * 4 screens of 8 * 4 screens and X-axis.Therefore, in 4 * 4,8 * 4 and 4 * 2 screens, when decoding speed is most important, preferably use 1/2nd picture element schemes, when decoding quality is most important, preferably use 1/4th picture elements or 1/8th picture element schemes.
In addition, in 4 * 2,8 * 2 and 2 * 2 screens, when decoding speed is most important, preferably use 1/2nd picture elements or 1/4th picture element schemes, when decoding quality is most important, preferably use 1/8th picture element schemes.In addition, even the basic Video Decoder that uses such as H.264 1/4th picture element schemes, when it will have image such as 8 * 4,4 * 4 and 4 * 2 sizes when being adjusted into 1/2 size, also can use 1/8th picture element schemes.
Video Decoder 230 can be realized by software.The process shown in Figure 20 that the step 529 of Figure 16 can be used as the flow chart of the processing that is used for video decode according to the preferred embodiment of the invention replaces.
With reference to Figure 20, control unit 100 is determined the size adjustment controlling value of variable-length decoder 315, IDCT unit 319 and motion compensator 335 when carrying out process shown in Figure 16.When receiving the video data of coding, control unit 100 is stored in the video data that receives in the buffer in step 613, and next analyzes this frame in step 615 at the head of the video flowing of step 611 analysis reception.
When two field picture is the I two field picture, in step 617, control unit 100 is adjusted controlling value based on the VLD size of determining size adjustment is carried out in the decoding zone of the video data of reception, and by being decoded as initial data at (the VL coding) pixel data of the variable length code in the big or small adjustment region with reference to the VLD table.Next, in step 619, the video data of 100 pairs of VL decodings of control unit carries out de-quantization, thereby extracts the DC coefficient.
After carrying out de-quantization, in step 621, control unit 100 is adjusted controlling value according to the IDCT size of determining the video data of de-quantization is adjusted size, and Y-axis and X-axis video data that size is adjusted are carried out IDCT.In the size of IDCT unit 319 was adjusted, the big or small adjustment region of Y-axis and X-axis each other can be identical, also can be different.Therefore, the IDCT of point that has the corresponding quantity of quantity of the Y-axis adjusted with size and X-axis pixel by use carries out IDCT.
After carrying out IDCT, in step 623, the result of control unit 100 storage IDCT.
Operation for each (8 * 8) the piece execution in step 617 to 623 shown in Fig. 8 (f).Therefore, carry out length-changeable decoding, de-quantization and IDCT for each piece of view data, the data of the decoding of each piece are stored in step 623.Control unit 100 repeats above-mentioned decoding, up in step 637, finishes the decoding of a frame of video data.
Control unit 100 detects finishing that such frame to video data decodes in step 623, and in step 625 frame of the video data of decoding is converted to the RGB data.That is,,, control unit 100 is converted to the RGB data that can be presented on the display unit 150 so will importing data because the input data are yuv datas.If the video data that receives is the RGB data, then step 625 can be omitted.
Yet in step 615, when two field picture was P or B two field picture, control unit 100 was carried out length-changeable decoding, de-quantization and IDCT in step 627 to 631 in the mode identical with step 617 to 621.Next, control unit 100 compensates in the motion of the frame data of step 633 pair current reception, is added on the video data of decoding at the video data of step 635 with motion compensation, next the data that obtain in step 623 storage.
Identical with step 617 to 623, to the operation of each (8 * 8) the piece execution in step 627 to 635 shown in Fig. 8 (f).Therefore, each piece of view data is carried out length-changeable decoding, de-quantization and IDCT, each piece of the video data of motion compensation is added on the IDCT data, is stored thereafter.Control unit 100 repeats above-mentioned decoding, and up in step 637, the decoding of a frame of video data is finished.
Control unit 100 detects the finishing of decoding of such frame to video data in step 623, thereafter, step 625 with a frame of the video data of decoding be converted to can be on display unit 150 data presented, for example RGB data.
In motion compensation, when the data that receive were the P frame data, these P frame data and previous data compared, and carry out compensation based on the motion difference.When the data that receive were the B frame data, these B frame data compared with data previous and thereafter, and carry out compensation based on the motion difference.
As mentioned above, Video Decoder 230 can be realized by the hardware shown in Figure 15 A and 15B, maybe can realize by the software in the control unit 100.
When the digital broadcasting transmitter that uses in portable terminal according to the embodiment of the invention, before these data were decoded, digital broadcasting transmitter came the coded data of input is carried out size adjustment based on the size of portable terminal display unit.The size adjustment of inputting video data can be provided with in every way according at least one big or small adjustment factor.In size adjustment factor, most important factor can be the demonstration size of display unit 150.In addition, other factors can have the priority according to the order of image scanning type (interlacing scan or line by line scan), block scan type (sawtooth scan or mixed sweep), decoding speed and decoding quality.
Figure 21 A illustrates example according to the screen of 8 * 8 Video Decoders of the embodiment of the invention and 4 * 4 Video Decoders to 21D.Figure 21 A and 21B are respectively the digital broadcasting news screens that shows after by 8 * 8 Video Decoders and 4 * 4 video decoder decodes.Figure 21 C and 21D are respectively the commercial advertisement screens that shows after by 8 * 8 Video Decoders and 4 * 4 video decoder decodes.8 * 8 Video Decoders and 4 * 4 Video Decoders are compared, and 4 * 4 Video Decoders comprise VLD control and big or small adjustment member, and 1/2nd picture element schemes are used in motion compensation.
Figure 22 A and 22B are the examples according to the display screen of the Video Decoder with motion compensation of 1/2nd picture elements of use respectively of the embodiment of the invention and 1/4th picture element schemes.Two screens it should be noted that Figure 22 A and 22B do not demonstrate too big difference.
To the example shown in the 22B, come objectively relatively screen quality for Figure 21 A by using structure measurement Video Decoder 230 Y-PSNRs (PSNR) shown in Figure 23.With reference to Figure 23, primary image has the resolution of calculating based on 8 * 8IDCT (resolution fully), thereby the size adjustment of 4 * 4 sizes can reduce at least 3~4dB with screen quality.
Figure 24 A is the PSNR curve chart relatively of considering this point to 24D.Figure 24 A is the curve chart that illustrates according to the PSNR characteristic of the digital broadcasting news image of 8 * 8 Video Decoders and 4 * 4 Video Decoders, and Figure 24 B is the curve chart that illustrates according to the PSNR characteristic of the commercial advertisement image of 8 * 8 Video Decoders and 4 * 4 Video Decoders.
Figure 24 A and 24B illustrate according to the PSNR result relatively between 4 * 4 Video Decoders of 8 * 8 Video Decoders and size adjustment of the present invention.Figure 24 A and 24B show except the PSNR that reduces to cause owing to resolution reduces almost there is not other decline.
Figure 24 C is the curve chart that illustrates according to the PSNR characteristic of the digital broadcasting news image of 4 * 4 Video Decoders and 4 * 2 Video Decoders, and Figure 24 D is the curve chart that illustrates according to the PSNR characteristic of the commercial advertisement image of 4 * 4 Video Decoders and 4 * 2 Video Decoders.It should be noted that in comparison, adopted the high speed algorithm that can reduce a large amount of operations and not cause the decline of display quality 4 * 4 Video Decoders and 4 * 2 Video Decoders.
Below table 12 illustrate to 15 and adjust comparison between the number of times of operation of size by Video Decoder 230 according to the embodiment of the invention.The operation of software can roughly be divided into displacement, addition, be multiplied each other, be judged and be circulated.Table 12 illustrates the comparison between the operation of variable-length decoder 315 before and after optimizing, table 13 illustrates the comparison between the operation of IDCT 319 before and after optimizing, table 14 illustrates the comparison between the operation of quantizer 317 before and after optimizing, and table 15 illustrates the comparison between the operation of motion compensator 335 before and after optimizing.
Table 12
The VLD module
8 * 4 or 4 * 4 or 8 * 2IDCT (optimize before) 8 * 4 or 4 * 4 or 8 * 2IDCT (optimize back)
Image type Displacement Addition Multiply each other Judge Circulation Displacement Addition Multiply each other Judge Circulation
I 78831 162041 0 257506 0 30761 62575 0 257506 0
P 45981 78561 0 122015 0 18391 30638 0 122015 0
P 48983 84086 0 130496 0 18893 31627 0 130496 0
P 48711 83388 0 129882 0 19484 32521 0 129882 0
Table 13
The IDCT module
8IDCT 4×4IDCT
Image type Displacement Addition Multiply each other Judge Circulation Displacement Addition Multiply each other Judge Circulation
I 834236 269313 269313 269313 269313 269313 1276600 524680 52320 19440
P 770084 137240 137240 137240 137240 137240 833735 330080 49293 14410
P 768396 148716 148716 148716 148716 148716 892185 353388 52683 15420
P 769276 148115 148115 148115 148115 148115 893695 356712 52985 15464
Table 14
The DQ module
8×8 4×4
Image type Displacement Addition Multiply each other Judge Circulation Displacement Addition Multiply each other Judge Circulation
I 70150 43454 43454 43454 43454 43454 109633 83288 118557 9720
P 64723 23709 23709 23709 23709 23709 64034 36878 48553 7205
P 69706 26184 26184 26184 26184 26184 69067 40174 52762 7710
P 69398 25846 25846 25846 25846 25846 68437 39754 52221 7732
Table 15
Motion compensating module
8×8 4×4
Image type Displacement Addition Multiply each other Judge Circulation Displacement Addition Multiply each other Judge Circulation
I 0 0 0 0 0 0 0 0 0 0
P 540001 561772 561772 561772 561772 561772 1310662 11430 33326 55859
P 550747 559464 559464 559464 559464 559464 1330618 11538 34159 55753
P 558964 551922 551922 551922 551922 551922 1338636 11556 34566 55538
The decoding speed of Video Decoder 230 is directly proportional with the amount of operation.
Table 16 is to 18 comparisons that are illustrated between the performance of the decoder of realizing in actual calculation machine and the embedded system.High-speed engine in the actual computer can produce higher speed, and embedded system can provide further improvement to performance.For embedded system, be difficult to calculate definite frame per second, so the table shown in be approximation.In embedded system, 2 * 2 Video Decoders demonstrate the performance that is better than 5~8 times of 8 * 8 Video Decoders.
Table 16
The IDCT type Estimation Frame per second
8 * 8 (fully) / 2nd picture elements 53.93
4×4 / 4th picture elements 71.21
/ 2nd picture elements 78.68
2×2 / 4th picture elements 85.42
/ 2nd picture elements 90.16
Table 17
The IDCT type Estimation Frame per second
8 * 8 (fully) / 2nd picture elements 63.43
4×4 / 4th picture elements 81.15
/ 2nd picture elements 107.64
2×2 / 4th picture elements 128.44
/ 2nd picture elements 136.33
Table 18
The IDCT type Estimation Frame per second
8 * 8 (fully) / 2nd picture elements 3~5 frames
4×4 / 4th picture elements 8~10 frames
/ 2nd picture elements 10~12 frames
2×2 / 4th picture elements 15~20 frames
/ 2nd picture elements 25~28 frames
Usually, the standard of digital video broadcasting (DVB) and digital multimedia (DMB) is arranged for the digital broadcasting that is used for portable terminal.The DVB standard comprises as the DVB-T of received terrestrial digital broadcasting standard with as the DVB-H of satellite broadcast standard.DMB and DVB can use the image of MPEG type and the image of type H.263.In addition, the MPEG scheme is used discrete cosine transform (DCT), and H.263 scheme is used integer transform (IT).Therefore, the portable terminal that is provided with digital broadcasting transmitter must have inverse discrete cosine transform (IDCT) and inverse integer transform (IIT) transducer, and DCT changes or the inverse transformation of the image of IT conversion to be used for.Therefore, best, in being provided with the portable terminal of digital broadcasting transmitter, Video Decoder 230 has the ability with the video data decoding of DCT type or IT type.
In addition, DMB and DVB preferably consider mobile environment.In mobile environment, not only send the image (720 * 576) of SD grade, also send the image (355 * 288) of CIF grade.Therefore, in order the image of CIF grade to be presented on the display unit (for example LCD) of portable terminal with suitable frame per second, size adjustment is necessary.
Because general portable terminal has 176 * 208 resolution, so general portable terminal can not show the image of CIF grade.Therefore, in general portable terminal, preferably be 1/2 to have adjusted big or small image (176 * 144), and will be used for that channel is selected and the graphical representation of electronic service guidebooks (ESG) is 1/4 to have adjusted big or small image (88 * 72) the graphical representation that receives.Among Figure 25 A by red around image be the image that when the CIF image that is used for ESG is adjusted into 1/4 by size, is presented on the display unit 150, among Figure 25 B by red around image be when the image that is used for being presented at when UI image that channel selects is adjusted into 1/4 by size on the display unit 150, among Figure 25 C by blue solid line around image be to be presented at 1/2 on the display unit 150 to have adjusted big or small CIF image (176 * 144).Because by menu UI and use display unit 150 effectively based on the accepting state of portable terminal in fact be not common situation, so preferably other device is used the technology of size adjustment, and not to the isolated plant of processes digital image data, that is, the digital broadcasting transmitter with the display unit that can handle CIF grade or higher image uses this technology.
When the transmitter terminal of digital broadcasting sent vision signal by the video encoder that uses the DCT scheme, the Video Decoder 230 that is used to receive the portable terminal of data can have the structure shown in Figure 15 A or Figure 15 B.But when the transmitter terminal of digital broadcasting sent vision signal by the video encoder that uses the IT scheme, the Video Decoder 230 that is used to receive the portable terminal of data can have the structure shown in Figure 26 A or Figure 26 B.
Figure 26 A or Figure 26 B illustrate to be used for receive using the IT encoded signals and with the block diagram of the Video Decoder of its decoding, this Video Decoder comprises that being used for the IT signal decoding is the IIT unit 710 of primary signal from picture signal.But, before describing Figure 26 A and Figure 26 B, will the operation of IIT unit 710 be described at first.
Usually, because mobile digital broadcast, for example DVB-H uses the picture signal with the size that is lower than the CIF grade, so 4 * 4 transducers can be used for mobile digital broadcast.In this case, this transducer can use DCT or IT to be used for its conversion scheme.Below, 4 * 4 transducers will be described as an example.
The operation of DCT transducer at first will be discussed.
Following equation (7) shows the example of 4 * 4DCT, wherein, X representation space area image, Y represents the frequency domain figure picture.That is, following equation (7) is corresponding with the example that uses 4 dct transform devices, and wherein, Y represents the result of DCT, and X represents 4 * 4 input pictures, and transformation matrix 1 and transformation matrix 2 lay respectively at left side and the right side of input picture X.In addition, transformation matrix 2 is corresponding with the matrix that transformation matrix 1 diagonal ground transposition is obtained.
Y = AXA T a a a a b c - c - b a - a - a a c - b b - c [ X ] a b a c a c - a - b a - c - a b a - b a - c . . . . . . . . . . ( 7 )
In equation (7), the IDCT coefficient of each matrix is defined as follows:
a = 1 2 , b = 1 2 cos ( π 8 ) , And c = 1 2 cos ( 3 π 8 ) .
When receiving as 4 * 4 DCT signals in the equation (7), the IDCT unit 319 of receiver reverses the defined signal of equation (8) that is changed to following with the signal that receives.
X = A T YA = a b a c a c - a - b a - c - a b a - b a - c [ Y ] a a a a b c - c - b a - a - a a c - b b - c . . . . . . . . . . ( 8 )
In equation (8), the coefficient of each matrix of 4 * 4 IDCT unit is defined as follows:
a = 1 2 , b = 1 2 cos ( π 8 ) , And c = 1 2 cos ( 3 π 8 ) .
Equation (7) and (8) promptly, equal the inverse matrix of A: A based on such fact by the matrix that the matrix A transposition is obtained T=inv (A).
If the signal Y by following equation (9) definition is transfused to, can obtain the X that do not adjusted by following equation (10) so by size.
Y = y 11 y 12 y 13 y 14 y 21 y 22 y 23 y 24 y 31 y 32 y 33 y 34 y 41 y 42 y 43 y 44 . . . . . . . . . ( 9 )
X 1 / 2 = a b a c a c - a - b a - c - a b a - b a - c y 11 y 12 y 13 y 14 y 21 y 22 y 23 24 y 31 y 32 y 33 y 34 y 41 y 42 y 43 y 44 a a a a b c - c - b a - a - a a c - b b - c . . . ( 10 )
Under the situation that 1/2 size is adjusted, 2 * 2 scanning areas are established in 4 * 4 zones of matrix Y, therefore can obtain the X that the quilt size is adjusted by following equation (11).
X 1 / 2 = a b a c a c - a - b a - c - a b a - b a - c y 11 y 12 0 0 y 21 y 22 0 0 0 0 0 0 0 0 0 0 a a a a b c - c - b a - a - a a c - b b - c . . . ( 11 )
Equation (11) equates with following equation (12).Shown in equation (12), operand is reduced to 25%.
X 1 / 2 = a b a c a - c a - b y 11 y 12 y 21 y 22 a a a a b c - c - b . . . . . . ( 12 )
Under the situation that 1/4 size is adjusted, 1 * 1 scanning area is established in 4 * 4 zones of matrix Y, therefore can obtain the X that the quilt size is adjusted by following equation (13).
X 1 / 4 = a b a c a c - a - b a - c - a b a - b a - c y 11 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 a a a a b c - c - b a - a - a a c - b b - c . . . ( 13 )
Equation (13) equates with following equation (14).
X 1 / 4 = a a a a [ y 11 ] a a a a = a 2 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 . . . . . ( 14 )
Then, integer transform (IT) will be described.
DCT described above and IDCT are the conversion scheme of using in mpeg encoder and decoder.But, H.264 can use integer transform scheme and inverse integer transform scheme.The integer transform scheme is the DCT scheme of revising, and it is similar to the DCT scheme, but the coefficient difference.Following equation (15) has defined 4 * 4 integer transforms, and it is similar to DCT, but has different coefficients in each matrix.In equation (15), X representation space area image, Y represents the frequency domain figure picture.In the equation below (15), Y represents the result of IT, and X represents 4 * 4 input pictures, and transformation matrix 1 and transformation matrix 2 lay respectively at left side and the right side of input picture X.Should be noted that (a=1, b=2 c=1), are converted to the IT scheme with the DCT scheme by using 1,2 and 1 substitution index a, b and c respectively.Therefore, should be noted that the IT scheme is simpler than DCT scheme.
Y = 1 1 1 1 2 1 - 1 - 2 1 - 1 - 1 1 1 - 2 2 - 1 [ X ] 1 2 1 1 1 1 - 1 - 2 1 - 1 - 1 2 1 - 2 1 - 1 . . . . . . . . . . ( 15 )
The Video Decoder that receives the view data of the IT type that defines as equation (15) must be carried out inverse integer transform (IIT), to find original image signal X from Y.Can be by following equation (16) definition IIT.
X ′ = 1 1 1 1 / 2 1 1 / 2 - 1 - 1 1 - 1 / 2 - 1 1 1 - 1 1 - 1 / 2 [ Y ] 1 1 1 1 1 1 / 2 - 1 / 2 - 1 1 - 1 - 1 1 1 / 2 - 1 1 - 1 / 2 . . . . . . . . . . ( 16 )
If the signal Y by following equation (17) definition is transfused to, can obtain the X ' that do not adjusted by following equation (18) so by size.
Y = y 11 y 12 y 13 y 14 y 21 y 22 y 23 y 24 y 31 y 32 y 33 y 34 y 41 y 42 y 43 y 44 . . . . . . . . . . ( 17 )
X ′ = 1 1 1 1 / 2 1 1 / 2 - 1 - 1 1 - 1 / 2 - 1 1 1 - 1 1 - 1 / 2 y 11 y 12 y 13 y 14 y 21 y 22 y 23 y 24 y 31 y 32 y 33 y 34 y 41 y 42 y 43 y 44 1 1 1 1 1 1 / 2 - 1 / 2 - 1 1 - 1 - 1 1 1 / 2 - 1 1 - 1 / 2 . . . ( 18 )
Under the situation that 1/2 size is adjusted, 2 * 2 scanning areas are established in 4 * 4 zones of matrix Y, therefore can obtain the X ' that the quilt size is adjusted by following equation (19).That is, under the situation that 1/2 size is adjusted, use 2 * 2 banded filters (y11, y12, y21 and y22) shown in equation (19).
X 1 / 2 ′ = 1 1 1 1 / 2 1 1 / 2 - 1 - 1 1 - 1 / 2 - 1 1 1 - 1 1 - 1 / 2 y 11 y 12 0 0 y 21 y 22 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 / 2 - 1 / 2 - 1 1 - 1 - 1 1 1 / 2 - 1 1 - 1 / 2 . . . ( 19 )
Equation (19) equates with following equation (20), but the operand of equation (20) is reduced to 25%.
X 1 / 2 ′ = 1 1 1 1 / 2 1 - 1 / 2 1 - 1 y 11 y 12 y 21 y 22 1 1 1 1 1 1 / 2 - 1 / 2 - 1 . . . . . . ( 20 )
Under the situation that 1/4 size is adjusted, 1 * 1 scanning area is established in 4 * 4 zones of matrix Y, therefore can obtain the X ' that the quilt size is adjusted by following equation (21).
X 1 / 4 ′ = 1 1 1 1 / 2 1 1 / 2 - 1 - 1 1 - 1 / 2 - 1 1 1 - 1 1 - 1 / 2 y 11 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 / 2 - 1 / 2 - 1 1 - 1 - 1 1 1 / 2 - 1 1 - 1 / 2 . . . ( 21 )
Equation (21) equates with following equation (22).
X 1 / 4 ′ = 1 1 1 1 [ y 11 ] 1 1 1 1 = y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 y 11 . . . . . ( 22 )
As mentioned above, Video Decoder 230 has the IIT unit, and its picture signal with two-dimensional frequency is converted to the picture signal in two-dimensional space territory.In this conversion, Video Decoder 230 can use aforesaid IDCT unit 319 or IIT unit.The present invention proposes IDCT or IIT unit are used as inverse converter, but the size adjustment of IDCT and each carries out image data of IIT unit.
Figure 26 A and Figure 26 B show by using IIT unit 710 to carry out the Video Decoder 230 that size is adjusted.More particularly, Figure 26 A shows the Video Decoder 230 that is used for I, B and the decoding of P two field picture, and Figure 26 B shows the Video Decoder 230 that is used for I and the decoding of P two field picture.Except IIT unit 710, other parts are identical with parts among Figure 15 A and Figure 15 B in Figure 26 A and Figure 26 B.
With reference to Figure 26 A, header analyzer 311 extracts and analyzes the header of the picture signal that receives, and sends it to control unit 100 then.Control unit 100 definite size adjustment controlling values are carried out processing as shown in figure 16 simultaneously, then these values are applied to the big or small adjuster 410,420 and 430 of variable-length decoder 315, IIT unit 710 and motion compensator 335 respectively.
Variable-length decoder 315 and motion compensator 335 are to operate with the identical mode shown in Figure 15 A.The IIT unit 710 of Video Decoder 230 can have the structure with the structural similarity shown in Figure 18.IIT unit 710 can have and is used for and 2 IIT unit that size is adjusted 4 of the Y-axis pixel and 2 IIT unit and is used for size adjustment X-axis pixel at 4.The Y size adjuster of IIT unit 710 is adjusted controlling value from size and is confirmed Y-axis size adjustment controlling value, adjusts controlling value corresponding to the Y size of confirming then the VL coded data is sent to the IIT unit.The data of IIT and stores processor are carried out in the IIT unit to these data.The X size adjuster of IIT unit 710 is adjusted controlling value from size and is confirmed the big or small controlling value of adjusting of X-axis, adjusts controlling value corresponding to the X size of confirming then the big or small data of adjusting of Y-axis are sent to the IIT unit.The data of IIT and stores processor are carried out in the IIT unit to these data.When the X-axis data having been carried out IIT as mentioned above, these data have and the identical value of value that obtains by execution Y-axis and X-axis IIT.
In data, adjust controlling value (banded filter) based on size and determine by the big or small scanning area of adjusting by 710 inverse transformations of IIT unit.Consequently, the image of gained can be maintained original image, or is adjusted or the 1/4 big or small image of adjusting by 1/2 size.
Digital broadcasting transmitter according to the embodiment of the invention can be implemented in portable terminal.
Figure 27 shows the structure according to the digital broadcasting transmitter in the portable terminal of the embodiment of the invention.With reference to Figure 27, this portable terminal comprises RF tuner 110, demodulator 120 and the decoder 130 that is used for digital broadcasting.Decoder 130 can be replaced by the software in the control unit 100 of portable terminal.Control unit 100 shown in Figure 25 can be the MSM of portable terminal, and it has the function of the general control of the modem feature that is used for modulation and demodulation, the codec function that is used for Code And Decode and this portable terminal.In addition, this portable terminal can have the digital signal processor that is used to handle modulator-demodulator and codec function, and it separates with control unit 100.
When portable terminal also needs to have the multimedia processor of the special use that is used to handle multi-medium data except having MSM, for example during DM 270, control unit 100 can be used as multimedia processor.In addition, when portable terminal had independent Video Decoder, the control unit of this Video Decoder self can be used as multimedia processor.Following description is based on such hypothesis, that is, portable terminal is that mobile phone and control unit 100 are MSM.
With reference to Figure 27, RF communication unit 195 is carried out the radio communication function of portable terminal.RF communication unit 195 comprises: the RF transmitter is used for the frequency of the signal of up conversion transmission, and amplifies the signal that sends; With the RF receiver, be used for low noise and amplify the signal that receives, and the frequency of the signal of down conversion reception.
Control unit 100 is handled the voice-and-data of the portable terminal that sends, and controls the general operation of this portable terminal.
At first, in order to handle communication data, control unit 100 can comprise can be with the transmitter of the signal encoding that sends and modulation and can be with the receiver of the signal demodulation sign indicating number that receives.Control unit 100 can have the independently data processor that comprises aforesaid modulator-demodulator and coding decoder.This data processor can be according to CDMA scheme, UMTS scheme or GSM scheme processing channel data.
As mentioned above, key input unit 170 comprises key that is used for input digit information or character information and the function key that is used to be provided with various functions.Function key comprises the key of selection such as functions such as the channel selection that is used for receiving digital broadcast, the controls of broadcast reception pattern.
Memory 190 can comprise program storage and data storage.Program storage storage be used for digital broadcasting transmitter broadcast reception program and according to the program of the embodiment of the invention.Data storage can comprise: nonvolatile memory (NYM) is used for the non-volatile data of memory requirement, for example bitmap, font, telephone directory; And random-access memory (ram), be used for being stored in the data that the process of executive program occurs temporarily.
Display unit 150 shows the picture signal of the digital broadcasting transmitter of being handled by decoder 130 and according to the information of the operation of portable terminal under the control of control unit 100.The audio process that comprises loud speaker 160 and microphone is used as the receiver of portable terminal under communication pattern, and reproduces broadcast voice signal under the digital broadcasting receiving mode.
RF tuner 110 produces the broadcasting frequency signal of the digital broadcast channel of selecting based on the channel control data of control unit 100, and the frequency of the broadcast singal of the selected channel of down conversion is to produce intermediate-freuqncy signal.Demodulator 120 is demodulated into primary signal with the modulated digital broadcast singal.
Decoder 130 is picture signal and audio signal with the division of signal of demodulation, and with divided image and audio signal decoding and output.Decoder 130 can have structure as shown in Figure 2.Video Decoder 230 can have the structure shown in Figure 15 A or Figure 15 B.As the replacement of Video Decoder 230, control unit 100 can have the video decode program, to carry out video decode by software.
Video memory 180 comprises buffer, this buffer stores broadcast data and the header that is used to decode.In addition, video memory 180 has the various tables that are used for the broadcast data decoding that will receive.Video memory 180 broadcast singal that storage is exported from decoder 130 under the control of control unit 100 under logging mode, and under reproduction mode, under the control of control unit 100, the broadcast singal of selecting is outputed to decoder 130.
In structure shown in Figure 27, the digital broadcast signal of the reception of portable terminal can be VHF frequency band (174MHz~230MHz; C5~C12) or UHF frequency band (470MHz~862MHz; The signal of C21~C69).In addition, if necessary, this digital broadcast signal can be to comprise L frequency band (1GHz~2.6GHz) and the S frequency band (signal of the high frequency band of 2.6GHz~3.95GHz).
When the user had selected broadcast channel, control unit 100 outputs were corresponding to the control data of the channel of selecting.RF tuner 110 produces and the blended RF frequency according to this control data, produces the intermediate-freuqncy signal of the channel of selecting thus.Intermediate frequency (IF) can be 36.17MHz.
Simulation with I F signal is applied to demodulator 120.Then, demodulator 120 is a digital signal with analog signal conversion, according to predetermined demodulation scheme with digital demodulation signal, and the signal of output demodulation.Digital broadcasting transmitter can use Coded Orthogonal Frequency Division Multiplexing (COFDM) (CODFM) scheme as modulation scheme.
According to a preferred embodiment of the invention, demodulator 120 can use the MT352 that is made and sold by Zarlink semiconductor company TMBe outputted as 8 MPEG-2TS data by the signal of demodulator 120 demodulation.That is, demodulator 120 will be a numerical data from the conversion of signals of the channel of the selection of RF tuner 110 output, and this quantity according to carrier wave and additional code element controls, and circulates along the fast Fourier transform (FFT) loop.In addition, the FFT signal is reproduced as final signal by order and the error correction at interval that is used for reconstruction signal, and final signal is outputted as the MPEG-2TS signal.
Be applied to decoder 130 from the MPEG-2TS signal of demodulator 120 outputs.Decoder 130 is view data and voice data with the MPEG-2TS division of signal that receives, with them decoding, output image signal and audio signal then.Picture signal can be rgb signal or YUV signal, and audio signal is outputted as the pulse code modulation (pcm) stereo sound usually.In addition, by display unit 150 outputs and show, and audio signal is applied to loud speaker 160 and is reproduced by loud speaker 160 from the picture signal of decoder 130 output.
Control unit 100 is identified for size and adjusts the size of video data of the Video Decoder of decoder 130 and adjust controlling value.In size is adjusted, can use the size that is used for Video Decoder 230 to adjust at least one of controlling value.In size adjustment factor, most important factor can be the demonstration size of display unit 150.Because the digital broadcast signal that receives has and the same big resolution of resolution that is shown by general Digital Television usually, so before being preferably in the signal decoding that to receive this signal is carried out size adjustment, thereby this signal can suitably be shown by display unit 150.Even when image is shown with the suitable resolution that is used for portable terminal, according to decoding speed and quality, size adjustment also is necessary, and this is because portable terminal may need different display resolutions.
Except showing size, other big or small adjustment factor comprise digital broadcast signal image scanning type, block scan type, Video Decoder 230 decoding speed and according to the decoding quality of the state of portable terminal.Control unit 100 is adjusted controlling value based on the size that in the above-mentioned factor at least one is identified for decoder 130.
Thereafter, decoder 130 comes the digital broadcast signal of coding is carried out size adjustment based on adjust controlling value from the size of control unit 100 outputs, and with the digital broadcast signal decoding that size is adjusted, the signal with decoding is presented on the display unit 150 then.
Digital broadcasting transmitter according to the present invention carries out size adjustment according to the demonstration size to the picture signal that receives.Therefore, the present invention can significantly reduce the time of image processing, and structure that can simplified receiver.More particularly, the present invention can provide a kind of digital broadcasting transmitter that is used for portable terminal efficiently, its carry out according to the decoding zone of the big young pathbreaker's video data of demonstration of portable terminal size adjust after with the video data decoding of encoding.In addition, before with video data decoding, not only according to the demonstration size of portable terminal but also according to the decoding quality of the image of the scan type (image scanning or block scan) of the broadcast singal that receives, decoding and decoding speed etc., video data is carried out size adjustment according to digital broadcasting transmitter of the present invention or portable terminal with this digital broadcasting transmitter.Therefore, the present invention can make the Video Decoder miniaturization adaptively, keeps the performance of Video Decoder simultaneously, has improved the speed of signal processing thus.
Though the present invention is shown and describes with reference to its specific preferred embodiment, but it should be appreciated by those skilled in the art, under the situation that does not break away from the spirit and scope of the present invention that are defined by the claims, can carry out the various changes of form and details to it.

Claims (50)

1, a kind of Video Decoder of digital broadcasting transmitter comprises:
Size is adjusted control unit, produces the size that is used for the video data size that receives is adjusted and adjusts control signal;
Header analyzer is analyzed header from decoded video stream, and separates and the output video data;
Variable-length decoder is used to use the variable length kilsyth basalt will become to have the raw pixel data of initial data size from the video data decoding of header analyzer output;
De-quantizer is used for the video data de-quantization with decoding;
Inverse transformation block is used to use size to adjust the frequency domain video size of data adjustment of control signal with de-quantization, and converts thereof into two-dimensional space territory video data; With
The motion compensator unit is used to compensate the motion with the video data of the inverse transformation moving compensating data corresponding with one of video data that separates.
2, Video Decoder as claimed in claim 1, wherein, inverse transformation block is the inverse discrete cosine transform unit.
3, Video Decoder as claimed in claim 2, wherein, the inverse discrete cosine transform unit comprises:
Y-axis size adjuster, the Y-axis control signal of using size to adjust control signal is selected N point inverse discrete cosine transformer;
N the Y-axis inverse discrete cosine transformer that comprises the N point inverse discrete cosine transformer of selection is used for the Y-axis video data inverse discrete cosine transform with the zone of size adjustment;
X-axis size adjuster, the X-axis control signal of using size to adjust control signal is selected M point inverse discrete cosine transformer; With
M the X-axis inverse discrete cosine transformer that comprises the M point inverse discrete cosine transformer of selection is used for the X-axis video data inverse discrete cosine transform with the zone of size adjustment, and described X-axis video data is stored in the Y buffer.
4, Video Decoder as claimed in claim 1, wherein, variable-length decoder comprises:
The size adjuster is used for adjusting control signal based on size the video data size of separating is adjusted;
The table transducer is used for the video data that the video data decoding of the variable length code that will receive becomes to have original size; With
Buffer is used to store the video data by the decoding of table transducer,
Wherein, the data in the piece that comprises in the zone of big or small adjuster control table transducer to the size adjustment of being adjusted the control signal setting by size are decoded, and the video data in the zone adjusted of the described size of controller buffer storage.
5, Video Decoder as claimed in claim 1, wherein, the motion compensator unit comprises:
Buffer is used to store the motion compensation vector value of reception;
The previous image memory is used to store previous image with comparing motion compensation vector value;
Next video memory is used to store next image with comparing motion compensation vector value;
A plurality of motion compensators, be used to receive the output of motion compensation vector value and previous image memory and next video memory, wherein, described motion compensator selects signal to operate to carry out 1/2nd picture elements, 1/4th picture elements or 1/8th picture element motion compensation by motion compensation; With
The size adjuster is used for adjusting control signal based on size and selects one of described motion compensator.
6, Video Decoder as claimed in claim 1, wherein, size is adjusted control unit and is come definite size to adjust controlling value based on the demonstration size of digital broadcasting transmitter.
7, Video Decoder as claimed in claim 1, wherein, size is adjusted control unit and is determined size adjustment controlling value based on the demonstration size of digital broadcasting transmitter with by the image scanning type of header analyzer analysis.
8, Video Decoder as claimed in claim 1, wherein, size is adjusted control unit based on the demonstration size of digital broadcasting transmitter, determine size adjustment controlling value by the image scanning type and the block scan type of header analyzer analysis.
9, Video Decoder as claimed in claim 1, wherein, size is adjusted control unit based on the demonstration size of digital broadcasting transmitter, determine size adjustment controlling value by the image scanning type of header analyzer analysis and block scan type and by the decoding speed that the user selects.
10, Video Decoder as claimed in claim 1, wherein, size is adjusted control unit and is determined size adjustment controlling value based on the demonstration size of digital broadcasting transmitter, the decoding speed of selecting by the image scanning type of header analyzer analysis and block scan type and by the user and the decoding speed of digital broadcasting transmitter.
11, Video Decoder as claimed in claim 1, wherein, inverse transformation block is the inverse integer transform unit.
12, Video Decoder as claimed in claim 1, wherein, the inverse integer transform unit comprises:
Y-axis size adjuster, the Y-axis control signal of using size to adjust control signal is selected N point inverse integer transform device;
N the Y-axis inverse integer transform device that comprises the N point inverse integer transform device of selection is used for the Y-axis video data inverse integer transform with the zone of size adjustment;
X-axis size adjuster, the X-axis control signal of using size to adjust control signal is selected M point inverse integer transform device; With
M the X-axis inverse integer transform device that comprises the M point inverse integer transform device of selection is used for the X-axis video data inverse integer transform with the zone of size adjustment, and described X-axis video data is stored in the Y buffer.
13, Video Decoder as claimed in claim 12, wherein, described variable-length decoder comprises:
The size adjuster, the size of the video data that adjustment separates based on size adjustment control signal;
The table transducer is the video data with original size with the video data decoding of the variable length code that receives; With
Buffer, the video data that storage is decoded by the table transducer,
Wherein, big or small adjuster control table transducer is decoded to being included in according to the data in the piece in the big or small adjustment region of size adjustment control signal setting, and controller buffer is with the video data in the storage size adjustment region.
14, Video Decoder as claimed in claim 13, wherein, described motion compensator unit comprises:
Buffer, the motion compensation vector value that storage receives;
The previous image memory, the storage previous image is with comparing motion compensation vector value;
Next video memory is stored next image with comparing motion compensation vector value;
A plurality of motion compensators, receive the output of motion compensation vector value and previous image memory and next video memory, wherein, motion compensator selects signal operation to carry out one of 1/2nd picture element motion compensation, 1/4th picture element motion compensation and 1/8th picture element motion compensation by motion compensation; With
The size adjuster is adjusted control signal based on size and is selected one of motion compensator.
15, Video Decoder as claimed in claim 14, wherein, described size is adjusted control unit and is determined the big or small controlling value of adjusting based on the demonstration size of digital broadcasting transmitter.
16, Video Decoder as claimed in claim 14, wherein, described size is adjusted control unit and is determined size adjustment controlling value based on the demonstration size of digital broadcasting transmitter with by the image scanning type of header analyzer analysis.
17, Video Decoder as claimed in claim 14, wherein, described size is adjusted control unit based on the demonstration size of digital broadcasting transmitter, determine size adjustment controlling value by the image scanning type of header analyzer analysis and block scan type with by the decoding speed that the user selects.
18, Video Decoder as claimed in claim 14, wherein, described size is adjusted control unit and is determined size adjustment controlling value based on the demonstration size of digital broadcasting transmitter, the decoding speed of selecting by the image scanning type of header analyzer analysis and block scan type, by the user and the decoding speed of digital broadcasting transmitter.
19, a kind of Video Decoder of digital broadcasting transmitter comprises:
Size is adjusted control unit, produces the size that is used for the video data size that receives is adjusted and adjusts control signal;
Header analyzer is analyzed header from decoded video stream, and separates and the output video data;
Variable-length decoder, using the variable length kilsyth basalt will be the raw pixel data with initial data size from the video data decoding of header analyzer output, this variable-length decoder comprises big or small adjuster, table transducer and buffer, this size adjuster is controlled described table transducer and is decoded to being included in according to the data in the piece in the big or small adjustment region of size adjustment control signal setting, and controls described buffer with the video data in the storage size adjustment region;
De-quantizer is carried out de-quantization to the video data of decoding;
Inverse transformation block is adjusted control signal by size, the frequency domain video size of data of de-quantization is adjusted, and changed it into two-dimensional space territory video data;
The motion compensator unit that comprises motion compensator is adjusted control signal by size and is selected one of motion compensator, the motion compensator compensation of this selection and the motion of video data with one of the video data that the separates corresponding moving compensating data of inverse transformation; With
Color converter is converted to video data with the output of inverse transformation block and motion compensation units.
20, Video Decoder as claimed in claim 19, wherein, described inverse transformation block comprises the inverse discrete cosine transform unit, this inverse discrete cosine transform unit comprises at least one Y-axis inverse discrete cosine transformer, at least one X-axis inverse discrete cosine transformer,
Wherein, come the video data of length-changeable decoding is carried out size adjustment and inverse discrete cosine transform by the operation of size adjustment control signal corresponding Y-axis inverse discrete cosine transformer and corresponding X-axis inverse discrete cosine transformer.
21, Video Decoder as claimed in claim 20, wherein, inverse transformation block comprises the inverse integer transform unit, this inverse integer transform unit comprises at least one Y-axis inverse integer transform device and at least one X-axis inverse integer transform device,
Wherein, come the video data of length-changeable decoding is carried out size adjustment and inverse integer transform by the operation of size adjustment control signal corresponding Y-axis inverse integer transform device and corresponding X-axis inverse integer transform device.
22, a kind of digital broadcasting transmitter comprises:
Control unit uses user's selection to produce channel selecting signal, and the big or small size of adjusting of video data that generation is used for receiving is adjusted control signal;
Tuner is according to the channel of the digital broadcast signal of channel selecting signal selective reception;
Demodulator, the digital broadcast signal that demodulation is selected;
Decoder comprises: demodulation multiplexer, from the digital broadcast signal of demodulation, isolate audio stream and video flowing; Video Decoder is decoded to the data of the video flowing that separates; And audio decoder, data to the audio stream that separates are decoded, and described Video Decoder carries out size to the decoding zone of the video data that receives and adjusts and the video data the zone of size adjustment is decoded based on adjust control signal from the size of control unit output;
Display unit shows the video data of decoding; With
Memory, storage is from the digital broadcast signal of demodulator output under logging mode, and this memory comprises the buffer that is used for temporarily storing by the data of decoder processes.
23, digital broadcasting transmitter as claimed in claim 22, wherein, described Video Decoder comprises:
Header analyzer is analyzed header from decoded video stream, and separates and the output video data;
Variable-length decoder is adjusted control signal based on size the video data that separates is carried out size adjustment, and use variable length kilsyth basalt is the pixel data with raw pixel data size with the video data decoding of size adjustment;
De-quantizer is carried out de-quantization to the video data of decoding;
Inverse transformation block is adjusted control signal by size, with the size adjustment of the frequency domain video data of de-quantization, and is converted into two-dimensional space territory video data;
The predetermined pixel separation of motion compensation that control signal is a pixel data is adjusted based on size in the motion compensator unit;
Adder is with the output addition of inverse transformation block and motion compensation units; With
Color converter will be converted to the video data that is used for display unit from the video data of adder output.
24, digital broadcasting transmitter as claimed in claim 23, wherein, described inverse transformation block comprises the inverse discrete cosine transform unit.
25, digital broadcasting transmitter as claimed in claim 24, wherein, described inverse discrete cosine transform unit comprises:
Y-axis size adjuster, the Y-axis control signal of using size to adjust control signal is selected N point inverse discrete cosine transformer;
N the Y-axis inverse discrete cosine transformer that comprises the N point inverse discrete cosine transformer of selection is used for the Y-axis video data inverse discrete cosine transform with the zone of size adjustment;
X-axis size adjuster, the X-axis control signal of using size to adjust control signal is selected M point inverse discrete cosine transformer; With
M the X-axis inverse discrete cosine transformer that comprises the M point inverse discrete cosine transformer of selection is used for the X-axis video data inverse discrete cosine transform with the zone of size adjustment, and this X-axis video data is stored in the Y buffer.
26, digital broadcasting transmitter as claimed in claim 23, wherein, inverse transformation block comprises the inverse integer transform unit.
27, digital broadcasting transmitter as claimed in claim 26, wherein, the inverse integer transform unit comprises:
Y-axis size adjuster, the Y-axis control signal that is used to use size to adjust control signal is selected N point inverse integer transform device;
N the Y-axis inverse integer transform device that comprises the N point inverse integer transform device of selection is used for the Y-axis video data inverse integer transform with the zone of size adjustment;
X-axis size adjuster, the X-axis control signal that is used to use size to adjust control signal is selected M point inverse integer transform device; With
M the X-axis inverse integer transform device that comprises the M point inverse integer transform device of selection is used for the X-axis video data inverse integer transform with the zone of size adjustment, and described X-axis video data is stored in the Y buffer.
28, digital broadcasting transmitter as claimed in claim 23, wherein, variable-length decoder comprises:
The table transducer, the video data decoding that is used for the variable length code that will receive is the video data with original size;
Buffer is used to store the video data by the decoding of table transducer; With
The size adjuster is used for the control table transducer and will be included in the pixel data decoding of being adjusted the predetermined big or small adjustment region of control signal setting by size, and controller buffer is stored the video data in the described big or small adjustment region.
29, digital broadcasting transmitter as claimed in claim 23, wherein, the motion compensator unit comprises:
Buffer is used to store the motion compensation vector value of reception;
The previous image memory is used to store previous image with comparing motion compensation vector value;
Next video memory is used to store next image with comparing motion compensation vector value;
A plurality of motion compensators, be used to receive the output of motion compensation vector value and previous image memory and next video memory, wherein, described motion compensator is selected signal operation by motion compensation, one of to carry out in 1/2nd picture element motion compensation, 1/4th picture element motion compensation and 1/8th picture element motion compensation; With
The size adjuster is used for adjusting control signal based on size and selects one of described motion compensator.
30, digital broadcasting transmitter as claimed in claim 23, wherein, control unit is determined size adjustment controlling value based on the demonstration size of digital broadcasting transmitter.
31, digital broadcasting transmitter as claimed in claim 23, wherein, control unit is determined size adjustment controlling value based on the demonstration size of digital broadcasting transmitter with by the image scanning type of header analyzer analysis.
32, digital broadcasting transmitter as claimed in claim 23, wherein, image scanning type that control unit is analyzed based on the demonstration size of digital broadcasting transmitter, by header analyzer and block scan type, the decoding speed of being selected by the user and the decoding speed of digital broadcasting transmitter determine that size adjusts controlling value.
33, a kind of digital broadcasting transmitter of portable terminal, described portable terminal comprises that the signal up conversion that is used for sending is the signal of RF frequency band and is the RF communication unit of baseband signal with the RF signal down conversion that receives and is used for data processor with baseband signal demodulation and decoding that described digital broadcasting transmitter comprises:
Control unit is used for selecting to produce channel selecting signal by the user, and produces the size adjustment control signal that is used for the video data that receives is carried out the size adjustment based on the demonstration size of described portable terminal;
Tuner is used for basis is come the digital broadcast signal of selective reception by the channel selecting signal of control unit generation channel;
Demodulator is used for the digital broadcast signal demodulation to selecting;
Decoder, comprise the demodulation multiplexer that is used for from the digital broadcast signal separating audio of demodulation stream and video flowing, be used for the audio decoder of the data decode of the audio stream that the Video Decoder and being used for of the data decode of the video flowing that will separate will separate, described Video Decoder comes big or small adjustment is carried out and with the video data decoding the big or small adjustment region in the decoding zone of the video data that receives based on adjust control signal from the size of control unit output;
Display unit is used to show the video data of decoding; With
Memory is used for the digital broadcast signal that storage is exported from demodulator under logging mode,
Wherein, memory comprises the buffer that is used for temporarily storing by the data of decoder processes.
34, digital broadcasting transmitter as claimed in claim 33, wherein, Video Decoder comprises:
Header analyzer is used to analyze the header from decoded video stream, and with the video data separation and with its output;
Variable-length decoder, being used for by using the variable length kilsyth basalt will be the raw pixel data with initial data size from the video data decoding of header analyzer output, described variable-length decoder comprises big or small adjuster, table transducer and buffer, described big or small adjuster is controlled described table transducer and will be included in by the data decode in the piece in the big or small adjustment region of size adjustment control signal setting, and controls the video data in the described buffer stores size adjustment region;
De-quantizer is used for the video data de-quantization with decoding;
Inverse transformation block is used for adjusting control signal by size the frequency domain video data of de-quantization is carried out the size adjustment and are converted into two-dimensional space territory video data;
The motion compensator unit, comprise a plurality of motion compensators, in the described motion compensator one adjust control signal by size and select, the motion of a corresponding moving compensating data in the video data of the motion compensator of selection pair and inverse transformation and the video data that separates compensates; With
Color converter is used for the output of inverse transformation block and motion compensator unit is converted to video data.
35, digital broadcasting transmitter as claimed in claim 34, wherein, inverse transformation block is the inverse discrete cosine transform unit, it comprises:
Y-axis size adjuster, the Y-axis control signal that is used to use size to adjust control signal is selected N point inverse discrete cosine transformer;
N the Y-axis inverse discrete cosine transformer that comprises the N point inverse discrete cosine transformer of selection is used for the Y-axis video data inverse discrete cosine transform with the zone of size adjustment;
X-axis size adjuster, the X-axis control signal that is used to use size to adjust control signal is selected M point inverse discrete cosine transformer; With
M the X-axis inverse discrete cosine transformer that comprises the M point inverse discrete cosine transformer of selection is used for the X-axis video data inverse discrete cosine transform with the zone of size adjustment, and described X-axis video data is stored in the Y buffer.
36, digital broadcasting transmitter as claimed in claim 34, wherein, inverse transformation block is the inverse integer transform unit, it comprises:
Y-axis size adjuster, the Y-axis control signal that is used to use size to adjust control signal is selected N point inverse integer transform device;
N the Y-axis inverse integer transform device that comprises the N point inverse integer transform device of selection is used for the Y-axis video data inverse integer transform with the zone of size adjustment;
X-axis size adjuster, the X-axis control signal that is used to use size to adjust control signal is selected M point inverse integer transform device; With
M the X-axis inverse integer transform device that comprises the M point inverse integer transform device of selection is used for the X-axis video data inverse integer transform with the zone of size adjustment, and described X-axis video data is stored in the Y buffer.
37, digital broadcasting transmitter as claimed in claim 34, wherein, variable-length decoder comprises:
The table transducer, the video data decoding that is used for the variable length code that will receive is the video data with original size;
Buffer is used to store the video data by the decoding of table transducer; With
The size adjuster is used for the control table transducer and will be included in the pixel data decoding of being adjusted the predetermined big or small adjustment region of control signal setting by size, and controller buffer is stored the video data in the described big or small adjustment region.
38, digital broadcasting transmitter as claimed in claim 34, wherein, the motion compensator unit comprises:
Buffer is used to store the motion compensation vector value of reception;
The previous image memory is used to store previous image with comparing motion compensation vector value;
Next video memory is used to store next image with comparing motion compensation vector value;
A plurality of motion compensators, be used to receive the output of motion compensation vector value and previous image memory and next video memory, wherein, described motion compensator is selected signal operation by motion compensation, to carry out one of 1/2nd picture element motion compensation, 1/4th picture element motion compensation and 1/8th picture element motion compensation; With
The size adjuster is used for adjusting control signal based on size and selects one of described motion compensator.
39, digital broadcasting transmitter as claimed in claim 34, wherein, control unit is determined size adjustment controlling value based on the demonstration size of digital broadcasting transmitter.
40, digital broadcasting transmitter as claimed in claim 34, wherein, control unit is determined size adjustment controlling value based on the display screen size of digital broadcasting transmitter with by the image scanning type of header analyzer analysis.
41, digital broadcasting transmitter as claimed in claim 34, wherein, control unit is determined size adjustment controlling value based on the demonstration size of digital broadcasting transmitter, the decoding speed of selecting by the image scanning type of header analyzer analysis and block scan type, by the user and the decoding speed of digital broadcasting transmitter.
42, the method for in a kind of digital broadcasting transmitter the video data of coding being decoded, this method may further comprise the steps:
Be identified for the big or small size adjustment controlling value of adjusting of carrying out to the video data that receives;
Analyze the header of the video flowing of own coding;
Separate and the output video data;
Use size to adjust control signal the video data that separates is carried out size adjustment;
Using the variable length kilsyth basalt is the raw pixel data with initial data size with the video data decoding of size adjustment;
Video data to decoding carries out de-quantization;
Adjusting control signal according to size carries out the size adjustment and is converted into two-dimensional space territory video data the frequency domain video data of de-quantization;
To carrying out motion compensation with the motion of the corresponding moving compensating data of one of video data that separates with the video data of inverse transformation; With
The data of two-dimensional space territory video data and motion compensation are converted to video data.
43, method as claimed in claim 42, wherein, scanning area is adjusted control signal to the Y arranged in matrix according to size, and the data of the scanning area of setting are by inverse discrete cosine transform.
44, method as claimed in claim 42, wherein, scanning area is adjusted control signal to the Y arranged in matrix according to size, and the data of the scanning area of setting are by inverse integer transform.
45, method as claimed in claim 42, wherein, size adjustment and the step that the video data of size adjustment is decoded may further comprise the steps:
With the video data decoding of the variable length code that receives is the video data with original size;
Store the data of described decoding;
Interrupt the decoding of other data, the whole pixel datas in being included in the pre-sizing adjustment region of adjusting the control signal setting according to size are decoded; With
The video data of the decoding in the big or small adjustment region of from the data of decoding of storage, exporting.
46, method as claimed in claim 42, wherein, the step of motion compensation may further comprise the steps:
Motion compensation vector value, previous image and next image that storage receives are with comparing motion compensation vector value; With
Carry out motion compensation by the motion compensator of adjusting the control signal selection based on size according to motion compensation vector value, previous image and next image.
47, method as claimed in claim 42 wherein, can be selected to comprise to have with the big or small signal in the zone of the pixel data of size accordingly of the demonstration of display unit to be confirmed as size adjustment control signal.
48, method as claimed in claim 42, wherein, based on the demonstration size of digital broadcasting transmitter, be included in image scanning type in the header and block scan type, the decoding speed selected by the user and the decoding speed of digital broadcasting transmitter determine size adjustment control signal.
49, a kind of method of handling the image in digital broadcasting transmitter, this method may further comprise the steps:
Select to generate channel selecting signal according to the user;
Generation is used for the video data that receives is carried out the size adjustment control signal that size is adjusted;
Select the channel of the digital broadcast signal of selective reception according to the channel of control unit;
The digital broadcast signal of selecting is carried out demodulation;
Digital broadcast signal separating audio stream and video flowing from decoding;
The audio stream of separation and the data of video flowing are decoded; With
Reproduce and show the video and the voice data of decoding,
Wherein, adjust control signal based on size size adjustment is carried out in the decoding zone of video data, thereafter the video data in the zone of size adjustment is decoded.
50, a kind of method that is used to handle the broadcast singal of portable terminal with the wireless communication unit that is used for radio communication, this method may further comprise the steps:
Select to generate channel selecting signal according to the user;
Demonstration size based on portable terminal generates the size adjustment control signal that is used for the digital broadcast signal that receives is carried out the size adjustment;
Select the channel of the digital broadcast signal of selective reception according to the channel of control unit;
The digital broadcast signal of selecting is carried out demodulation;
Separating audio stream and video flowing from the digital broadcast signal of decoding;
The audio stream of separation and the data of video flowing are decoded; With
Reproduce and show the video and the voice data of decoding,
Wherein, adjust control signal based on size size adjustment is carried out in the decoding zone of video data, thereafter the video data in the zone of size adjustment is decoded.
CN2005101166274A 2004-10-26 2005-10-26 Apparatus and method for processing an image signal in a digital broadcast receiver Expired - Fee Related CN1767650B (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
KR1020040085860 2004-10-26
KR10-2004-0085860 2004-10-26
KR20040085860 2004-10-26
KR10-2005-0100299 2005-10-24
KR1020050100299 2005-10-24
KR1020050100299A KR100722972B1 (en) 2004-10-26 2005-10-24 Device and method for processing image signal in digital broadcasting receiver

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN200910171577A Division CN101662610A (en) 2004-10-26 2005-10-26 Device and method for processing image signal in digital broadcasting receiver

Publications (2)

Publication Number Publication Date
CN1767650A true CN1767650A (en) 2006-05-03
CN1767650B CN1767650B (en) 2010-10-06

Family

ID=36743197

Family Applications (2)

Application Number Title Priority Date Filing Date
CN200910171577A Pending CN101662610A (en) 2004-10-26 2005-10-26 Device and method for processing image signal in digital broadcasting receiver
CN2005101166274A Expired - Fee Related CN1767650B (en) 2004-10-26 2005-10-26 Apparatus and method for processing an image signal in a digital broadcast receiver

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN200910171577A Pending CN101662610A (en) 2004-10-26 2005-10-26 Device and method for processing image signal in digital broadcasting receiver

Country Status (2)

Country Link
KR (1) KR100722972B1 (en)
CN (2) CN101662610A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008043210A1 (en) * 2006-09-30 2008-04-17 Zte, Corporation A processing method for mobile multimedia broadcasting video
CN102438135A (en) * 2011-01-14 2012-05-02 展讯通信(上海)有限公司 Down-sampling decoding method and device for high-resolution video on small-size display equipment
CN106533630A (en) * 2016-12-09 2017-03-22 天津大学 High-reliability emergent short message transmission method based on digital broadcasting signal aggregation
CN107318019A (en) * 2011-06-28 2017-11-03 索尼公司 Image processing apparatus and image processing method
CN108989849A (en) * 2018-08-01 2018-12-11 广州长嘉电子有限公司 A kind of DVB-T2+S2 TV signal processing method and system
CN109379169A (en) * 2018-12-07 2019-02-22 中国电子科技集团公司第五十四研究所 A kind of code quick adjusting device of the anti-big error code of burst

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100948413B1 (en) * 2008-03-05 2010-03-19 경희대학교 산학협력단 Method and apparatus for up/down sampling of image block in the integer DCT domain
US8499213B2 (en) 2009-07-10 2013-07-30 Electronics And Telecommunications Research Institute Forward error correction encoding/decoding method and apparatus, digital broadcasting reception appartus, and decoding method thereof
KR101857811B1 (en) * 2011-11-16 2018-05-15 엘지디스플레이 주식회사 Embedded display port interface device and display device including the same

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09149335A (en) * 1995-11-01 1997-06-06 Texas Instr Inc <Ti> Multiformat television receiver system and television picture generating method
KR100263711B1 (en) * 1998-01-14 2000-08-01 구자홍 A decoder apparatus of digital broadcasting receiver
US20030043918A1 (en) * 1999-12-20 2003-03-06 Jiang Hong H. Method and apparatus for performing video image decoding
KR100828342B1 (en) * 2000-06-10 2008-05-08 삼성전자주식회사 Apparatus and method with lower data-rate and less degradation of image quality
KR100370076B1 (en) * 2000-07-27 2003-01-30 엘지전자 주식회사 video decoder with down conversion function and method of decoding a video signal
KR100450939B1 (en) * 2001-10-23 2004-10-02 삼성전자주식회사 Compressed video decoder with scale-down function for image reduction and method thereof
CN1212723C (en) * 2002-06-06 2005-07-27 瑞昱半导体股份有限公司 Digital image processing method and device
KR100474434B1 (en) * 2002-07-19 2005-03-10 삼성전자주식회사 Display system and control method thereof
KR100376060B1 (en) * 2002-10-25 2003-03-17 Humax Co Ltd Method and system for re-setting image size using inverse discrete cosine transform

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008043210A1 (en) * 2006-09-30 2008-04-17 Zte, Corporation A processing method for mobile multimedia broadcasting video
CN102438135A (en) * 2011-01-14 2012-05-02 展讯通信(上海)有限公司 Down-sampling decoding method and device for high-resolution video on small-size display equipment
CN110519592A (en) * 2011-06-28 2019-11-29 索尼公司 Image processing apparatus and image processing method
CN110602492A (en) * 2011-06-28 2019-12-20 索尼公司 Image processing apparatus, image processing method, and program
CN107454400A (en) * 2011-06-28 2017-12-08 索尼公司 Image processing apparatus and image processing method
CN110602492B (en) * 2011-06-28 2021-06-01 索尼公司 Image processing apparatus, image processing method, and program
CN110611812B (en) * 2011-06-28 2021-07-06 索尼公司 Image processing apparatus, image processing method, and program
CN110519592B (en) * 2011-06-28 2021-06-01 索尼公司 Image processing apparatus, image processing method, and program
CN110611810B (en) * 2011-06-28 2021-06-01 索尼公司 Image processing apparatus, image processing method, and program
CN107318019A (en) * 2011-06-28 2017-11-03 索尼公司 Image processing apparatus and image processing method
CN110611811A (en) * 2011-06-28 2019-12-24 索尼公司 Image processing apparatus, image processing method, and program
CN110611810A (en) * 2011-06-28 2019-12-24 索尼公司 Image processing apparatus, image processing method, and program
CN110611812A (en) * 2011-06-28 2019-12-24 索尼公司 Image processing apparatus, image processing method, and program
CN107454400B (en) * 2011-06-28 2020-10-20 索尼公司 Image processing apparatus, image processing method, and program
US11039172B2 (en) 2011-06-28 2021-06-15 Sony Corporation Image processing device and image processing method
CN106533630B (en) * 2016-12-09 2019-08-27 天津大学 A kind of highly reliable emergency short message transmission method based on digital broadcasting signaling aggregation
CN106533630A (en) * 2016-12-09 2017-03-22 天津大学 High-reliability emergent short message transmission method based on digital broadcasting signal aggregation
CN108989849A (en) * 2018-08-01 2018-12-11 广州长嘉电子有限公司 A kind of DVB-T2+S2 TV signal processing method and system
CN108989849B (en) * 2018-08-01 2021-01-29 广州长嘉电子有限公司 DVB-T2+ S2 television signal processing method and system
CN109379169B (en) * 2018-12-07 2021-03-23 中国电子科技集团公司第五十四研究所 Code speed adjusting device for resisting sudden large error code
CN109379169A (en) * 2018-12-07 2019-02-22 中国电子科技集团公司第五十四研究所 A kind of code quick adjusting device of the anti-big error code of burst

Also Published As

Publication number Publication date
KR100722972B1 (en) 2007-05-30
KR20060049312A (en) 2006-05-18
CN101662610A (en) 2010-03-03
CN1767650B (en) 2010-10-06

Similar Documents

Publication Publication Date Title
CN1767650A (en) Be used for handling the equipment and the method for picture signal at digital broadcasting transmitter
CN1251518C (en) Method for converting digital signal and apparatus for converting digital signal
CN1254111C (en) Image coding and decoding device and its method
CN1178509C (en) Image encoder and image encoding method, image decoder and image decoding method, and image processor and image processing method
CN1190081C (en) Method and apparatus for processing, transmitting and receiving dynamic image data
CN1725844A (en) Reverse presentation of digital media streams
CN1219255A (en) Temporal and resolution layering in advanced television
CN100340098C (en) Home network server, home network system, method for transmitting digital broadcasting program, wireless terminal
CN1036430C (en) Wide screen television
CN1132422C (en) Processing and display of images, retrieved from digital still image files generated from digital moving images
CN1199472C (en) Variable length decoder for decoding digitally encoded video signals
CN1537384A (en) Method for sub-pixel valve interpolation
CN1299502C (en) Decoding device and decoding method
CN1240226C (en) Video transcoder with drift compensation
CN1593065A (en) Video encoding and decoding of foreground and background wherein picture is divided into slice
CN1617591A (en) Systems and methods for adaptively filtering DCT coefficients in a video encoder
CN1653822A (en) Method and apparatus for transcoding compressed video bitstreams
CN1479907A (en) Multi-resolution image data management system and method based on wavelet-like transform and sparse data coding
CN1926576A (en) Method and system for digital coding three-dimensional video image
CN1270541C (en) Decoder and method thereof, coding device and method thereof, image processing system and method thereof
CN1722848A (en) Digital signal conversion method and digital signal conversion device
CN1941888A (en) Method and apparatus for processing, transmitting and receiving dynamic image data
CN1856099A (en) Encoding/decoding device for TV set for Internet

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20101006

Termination date: 20181026

CF01 Termination of patent right due to non-payment of annual fee