CN104602002B - Image processing apparatus and method - Google Patents
Image processing apparatus and method Download PDFInfo
- Publication number
- CN104602002B CN104602002B CN201510025568.3A CN201510025568A CN104602002B CN 104602002 B CN104602002 B CN 104602002B CN 201510025568 A CN201510025568 A CN 201510025568A CN 104602002 B CN104602002 B CN 104602002B
- Authority
- CN
- China
- Prior art keywords
- image
- unit
- filter
- orthogonal transformation
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
- H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
- H04N19/122—Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Discrete Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
Abstract
The present invention relates to the image processing apparatus and method of a kind of deterioration for being able to suppress code efficiency.Decoded pixel taxon (152) and input pixel classifications unit (153) execute category classification to each macro block for decoding image or input picture based on the orthogonal transformation size read from orthogonal transformation size buffer (151).4 × 4 pieces of coefficient calculation units (154) and 8 × 8 pieces of coefficient calculation units (155) calculate filter factor in each orthogonal transform block, so that residual error is minimum.The pixel classifications unit (161) of loop filter (113) executes category classification for each macro block of each orthogonal transformation block size to decoding image.Suitable filter factor is applied to its corresponding orthogonal transform block by filter unit (4 × 4) (162) and filter unit (8 × 8) (163), and executes filtering processing.For example, present invention could apply to image processing apparatus.
Description
The application be August in 2010 18 application No. is 201080036453.X, PCT international filing date, denomination of invention
For the divisional application of the application for a patent for invention of " image processing apparatus and method ".
Technical field
The present invention relates to image processing apparatus and method, more particularly to being able to suppress due to carrying out coding reconciliation to image
Code caused by picture quality deterioration and thereby further increase decoding image picture quality image processing apparatus and side
Method.
Background technique
Both in recent years, received as the information in the information distribution such as broadcasted and average family, widely make
With the device for meeting the formats such as MPEG (motion characteristics planning), these devices using image information as digital signal at
Reason, also, in order to execute efficient information transmission and storage at this moment, using the distinctive redundancy of image information come by such as
Image is compressed in the orthogonal transformation and motion compensation of discrete cosine transform etc..
Particularly, MPEG2 (ISO (International Standards Organization))/IEC (International Electrotechnical Commission) 13818-2) it is defined as leading to
With coding format, also, be include both horizontally interlaced image and sequential scan image and standard-resolution image and
The standard of high-definition image.For example, MPEG2 has been used for the application of professional purpose and the wide scope of consumer use now
It is widely used.For example, passing through benefit in the case where the horizontally interlaced image of the standard resolution with 720 × 480 pixels
With MPEG2 compressed format, the size of code (bit rate) of distribution 4 to 8Mbps.In addition, for example, having 1920 × 1088 pixels
High-resolution horizontally interlaced image in the case where, pass through utilize MPEG2 compressed format, distribution 18 to 22Mbps size of code
(bit rate), so as to realize high compression rate and excellent picture quality.
For MPEG2, it mainly is encoded to target to be suitable for the high image quality of broadcast purposes, still, does not handle ratio
The low size of code (bit rate) of the size of code of MPEG1 (that is, coded format with more high compression rate).With personal digital assistant
It is universal, it is envisioned that, the demand of this coded format is started to will increase from now on, also, in response to this, held
The standardization of MPEG4 coded format is gone.About coding format, specification is confirmed to be international standard in December, 1998
ISO/IEC 14496-2。
In addition, in recent years, referred to as H.26L (ITU-T (ITU Telecommunication Standardization Sector) Q6/16VCEG (video volume has been carried out
Code expert group)) standard standardization, script be designed for video conference purposes image coding.For H.26L, it is known that
Compared with the traditional code format of such as MPEG2 or MPEG4, although needing bigger calculation amount for its coding and decoding,
It is to realize higher code efficiency.In addition, current, as the movable part of MPEG4, have been carried out also using not by
H.26L support function (by this H.26L based on) come the standardization of realizing higher code efficiency, as enhancing compression view
The conjunctive model of frequency coding.As standardized timetable, H.264 exist with MPEG-4Part10 (AVC (advanced video coding))
In March, 2003 becomes international standard.
In addition, as its extension name, the industry including such as RGB, 4:2:2 or 4:4:4,8x 8DCT (discrete cosine transform)
It make sures with required encoding tool and the FRExt of the quantization matrix as defined in MPEG-2 (fidelity range extension name) is marked
Standardization, so that AVC may be used as suitably expressing the coded format for the film noise for including in even film, and
For the application of wide scope, for example, Blu-ray disc (Blu-ray Disc, registered trademark) etc..
However, it is current, the demand of further high compression coding is increased, for example, it is desirable to compress with conduct
The image of about 4000 × 2000 pixels of four times of high visual pattern, alternatively, alternatively, being reduced the staff for further high pressure
The demand of code has increased, for example, it is desirable to distribute high vision in the environment with limited transmit capacity of such as internet
Image.Therefore, for the above-mentioned VCEG under the control of ITU-T, grinding about raising code efficiency has been consecutively carried out it
Study carefully.
Additionally, there are the auto-adaptive loop filter (ALF (adaptive loop filters as next-generation video coding technique
Device)), considering the coding techniques recently (for example, with reference to non-patent literature 1 and non-patent literature 2).According to the adaptive ring
Path filter executes optimal filtering processing for each frame, is not gone completely at de-blocking filter and it is possible to reduce
The block noise that removes and due to noise caused by quantization.
Now, for will be by such as UHD (ultrahigh resolution that next-generation coding method is handled；4000 × 2000 pictures
Element) big picture frame, the macroblock size of 16 × 16 pixels is not optimal.It has for instance been proposed that macroblock size is amplified
To the size (for example, non-patent literature 3) of such as 32 × 32 pixels or 64 × 64 pixels.
Quotation list
Non-patent literature
Non-patent literature 1:Yi-Jen Chiu and L.Xu, " Adaptive (Wiener) Filter for Video
Compression,"ITU-T SG16Contribution,C437,Geneva,April 2008
Non-patent literature 2:Takeshi.Chujoh, et al., " Block-based Adaptive Loop Filter "
ITU-T SG16Q6VCEG Contribution,AI18,Germany,July,2008
Non-patent literature 3:Qualcomm Inc, " Video Coding Using Extended Block Sizes "
ITU-T SG16Contribution,C123,English,January 2009
Summary of the invention
Technical problem
In general, image local have various features, so optimal filter factor is locally different.For example, for
AVC coded format, the different images quality deterioration between the case where observing the case where orthogonal transformation size is 4 × 4 and 8 × 8.
For example, for 8 × 8 orthogonal transform blocks, observe for 4 × 4 orthogonal transform blocks not it is observed that mosquito noise (mosquito
noise).Additionally, there are such trend: that is, 8 × 8 orthogonal transform blocks are easily chosen for flat region, and for tool
There is the region of close grain, easily chooses 4 × 4 orthogonal transform blocks.
However, the method for traditionally proposing, identical filter factor is only uniformly applied to whole image, so
The noise remove for being suitable for local property possessed by the image may not be executed, also, there is the picture quality office of decoding image
The worry deteriorated to portion.
The present invention is made in view of this situation, it is an object of the invention to inhibit due to carrying out coding reconciliation to image
The deterioration of picture quality caused by code, to further increase the picture quality of decoding image.
Solution to problem
One aspect of the present invention is a kind of image processing apparatus, which includes: classification element, is configured
For for each scheduled picture size according to the orthogonal transformation size applied in the orthogonal transformation processing executed to image
Classify to described image；And filter part, it is configured as: using according to the orthogonal transformation size with parts of images
The filter factor of the local property setting of corresponding described image, to each described image classified by the classification element
Each of size parts of images executes filtering processing noise to remove.
The filter part can be Wiener filter.
Picture size can be macro block, wherein and the classification element classifies to macro block according to its orthogonal transformation size,
Also, the filter part uses the filtering being arranged according to the local property of the corresponding described image of orthogonal to that transform size
Coefficient to each macro block classified by classification element executes filtering processing.
Image processing apparatus can also include: addressable part, be configured as: encoding, and generate to described image
Coded data.
The addressable part can execute coding to described image with AVC (advanced video coding) format,
Wherein, the classification element is according to described image size to by the orthogonal transformation of the addressable part, quantization, inverse
The decoding image of quantization and inverse orthogonal transformation is classified, also, the filter part is for the portion of the decoding image
Partial image executes the filtering processing, and will filtering processing result as reference pictures store in frame memory.
Image processing apparatus can also include filter factor calculating unit, which is configured with
The filter factor is calculated to the input picture of the addressable part and the decoding image, wherein the filter part makes
The filtering processing is executed with by the calculated filter factor of the filter factor calculating unit.The filter factor meter
Calculating component can also answer for each described image size according in the orthogonal transformation processing executed by the addressable part
Orthogonal transformation size classifies to the input picture and the decoding image；Also, the filter factor calculates
Component calculates the filter factor for each orthogonal transformation size, so that between the input picture and the decoding image
Residual error it is minimum.
The filter factor calculating unit can be answered according to in the orthogonal transformation processing executed by the addressable part
The local property of the corresponding described image of orthogonal transformation size is arranged the value of the filter factor.
The filter factor calculating unit can also according to executed by the addressable part orthogonal transformation processing in
The local property of the corresponding described image of orthogonal transformation size of application is arranged the tap number of the filter factor.
The orthogonal transformation size is bigger, and the filter factor calculating unit can be arranged longer for the filter factor
Tap number, also, the orthogonal transformation size is smaller, and the filter factor calculating unit can be got over for filter factor setting
Short tap number.
Image processing apparatus can also include addition component, which is configured as the filter factor being added to
The coded data generated by the addressable part.The addition component can also will be used to control whether to execute the filtering
The flag information of processing is added to the coded data.
Image processing apparatus can also include: extracting parts, be configured as the coded data from image encoded
It is middle to extract the filter factor；And decoding device, it is configured as being decoded the coded data and generating decoding image；
Wherein, the classification element is produced according to the orthogonal transformation size to by the decoding device for each described image size
The raw decoding image is classified；Also, the filter part uses the filtering system extracted by the extracting parts
Number come to each the described image size classified by the classification element each parts of images execute filtering processing so as to
Remove noise.
Decoding device can execute decoding to the coded data with AVC (advanced video coding) format, wherein described point
Base part is according to described image size to the decoding figure of decoding, inverse quantization and inverse orthogonal transformation Jing Guo the decoding device
As classifying；Also, the filter part executes the filtering processing for the parts of images of the decoding image.
One aspect of the present invention is also a kind of image processing method,
Wherein, the classification element of image processing apparatus is for each scheduled picture size according to executing to image
The orthogonal transformation size applied in orthogonal transformation processing classifies to described image；And the filtering of described image processing unit
Component uses the filtering being arranged according to the local property of described image corresponding with the orthogonal transformation size of parts of images
Coefficient executes filtering processing come each described parts of images each the described image size being classified to go
Except noise.
Using one aspect of the present invention, for each scheduled picture size according in the positive alternation executed to image
The orthogonal transformation size applied in processing is changed to classify to described image, also, using according to parts of images it is described just
Hand over the filter factor of local property setting of the corresponding described image of transform size come described in each being classified
Each of picture size parts of images executes filtering processing noise to remove.
Beneficial effects of the present invention
According to the present invention it is possible to be encoded or decoded to image.Particularly, can inhibit due to being encoded to image
With the deterioration of picture quality caused by decoding, and can be improved decoding image picture quality.
Detailed description of the invention
Fig. 1 is the block diagram of the configuration for the embodiment that diagram applies picture coding device of the invention.
Fig. 2 is the diagram for the example for describing the increment of orthogonal transformation.
Fig. 3 is the diagram for describing the processing in the macro block for executing 4 × 4 orthogonal transformations.
Fig. 4 is the diagram of method of the diagram for realizing integer transform and inverse integer transform by butterfly computing.
Fig. 5 is the diagram for describing the operating principle of de-blocking filter (deblocking filter).
Fig. 6 is the diagram for describing to define the method for Bs.
Fig. 7 is the diagram for describing the operating principle of de-blocking filter.
Fig. 8 is the diagram for illustrating the example of the corresponding relationship between the value of indexA and indexB and α and β.
Fig. 9 is diagram Bs, indexA and tcoBetween corresponding relationship example diagram.
Figure 10 is the diagram for illustrating the example of macro block.
Figure 11 is the block diagram for illustrating the main configuration example of loop filter and filter factor computing unit.
Figure 12 is the flow chart for describing the example of process of coded treatment.
Figure 13 is the flow chart of the example of the process of description prediction processing.
Figure 14 is the flow chart for describing the example of process of loop filtering processing.
Figure 15 is the block diagram for the main configuration example that diagram applies picture decoding apparatus of the invention.
Figure 16 is the diagram for illustrating the main configuration example of loop filter.
Figure 17 is the flow chart for describing the example of process of decoding process.
Figure 18 is the flow chart for describing the example for the process that forecast image generates processing.
Figure 19 is the flow chart for describing the example of process of loop filtering processing.
Figure 20 is the diagram for describing ALF block and filtering block mark.
Figure 21 is the diagram for another example for describing ALF block and filtering block mark.
Figure 22 is the block diagram for the main configuration example that diagram applies personal computer of the invention.
Figure 23 is the block diagram for the main configuration example that diagram applies television receiver of the invention.
Figure 24 is the block diagram for the main configuration example that diagram applies cellular phone of the invention.
Figure 25 is the block diagram for the main configuration example that diagram applies hdd recorder of the invention.
Figure 26 is the block diagram for the main configuration example that diagram applies camera of the invention.
Specific embodiment
Hereinafter, embodiment of the present invention will be described.Note that be described in the following order.
1. first embodiment (picture coding device)
2. second embodiment (picture decoding apparatus)
3. 3rd embodiment (control of ALF block)
4. fourth embodiment (QALF)
5. the 5th embodiment (personal computer)
6. sixth embodiment (television receiver)
7. the 7th embodiment (cellular phone)
8. the 8th embodiment (hdd recorder)
9. the 9th embodiment (camera)
<1. first embodiment>
[configuration of device]
Fig. 1 shows be used as the configuration for applying the embodiment of picture coding device of image processing apparatus of the invention.
Picture coding device 100 shown in Fig. 1 is such picture coding device, and the picture coding device is using for example
H.264 it (is written as H.264/ in hereinafter with MPEG (motion characteristics planning) 4Part10 (AVC (advanced video coding))
AVC) format to carry out compressed encoding to image, and further utilizes auto-adaptive loop filter.
For the example in Fig. 1, picture coding device 100 has A/D (analog/digital) converting unit 101, picture again
Arrange buffer 102, computing unit 103, orthogonal transform unit 104, quantifying unit 105, lossless coding unit 106 and storage
Buffer 107.Picture coding device 100 also has inverse quantization unit 108, inverse orthogonal transformation unit 109,110 and of computing unit
De-blocking filter 111.In addition, there is picture coding device 100 filter factor computing unit 112, loop filter 113 and frame to deposit
Reservoir 114.In addition, picture coding device 100 has selecting unit 115, intraprediction unit 116, motion prediction/compensating unit
117 and selecting unit 118.In addition, picture coding device 100 has Rate control unit 119.
The image data of 101 pairs of A/D converting unit inputs executes A/D conversion, and is output to picture and rearranges
Buffer 102 and storage.Picture rearranges buffer 102 and will be used to show according to storage according to GOP (picture group) structure
The image of frame of sequence be rearranged for the sequence of the frame for coding.Picture rearranges buffer 102 for its frame sequential
The image being rearranged is supplied to computing unit 103, intraprediction unit 116,117 and of motion prediction/compensating unit
Filter factor computing unit 112.
Computing unit 103 is supplied by selecting unit 118 from being rearranged to subtract in the image that buffer 102 is read by picture
Forecast image, and its difference information is output to orthogonal transform unit 104.For example, having executed intraframe coding to it
Image in the case where, computing unit 103 by the forecast image supplied from intraprediction unit 116 with rearranged from picture it is slow
Rush the image addition of the reading of device 102.In addition, for example, computing unit 103 will be from fortune in the case where having executed interframe encode
The forecast image that dynamic prediction/compensating unit 117 is supplied rearranges the image addition that buffer 102 is read with from picture.
Orthogonal transform unit 104 to from computing unit 103 difference information carry out such as discrete cosine transform,
The orthogonal transformation of Karhunen-Lo é ve transformation or the like, and its transformation coefficient is supplied to quantifying unit 105.Orthogonal transformation
Unit 104 will also with each macro block (orthogonal transformation size) is applied in 4 × 4 orthogonal transformations and 8 × 8 orthogonal transformations
Any related information be supplied to filter factor computing unit 112 and loop filter 113.
The transformation coefficient that quantifying unit 105 exports orthogonal transform unit 104 quantifies.Quantifying unit 105 will quantify
Transformation coefficient be supplied to lossless coding unit 106.
The transformation coefficient of 106 pairs of lossless coding unit quantizations carries out such as variable length code, arithmetic coding or the like
Lossless coding.
Lossless coding unit 106 obtains the information of instruction intra prediction etc. from intraprediction unit 116, and from movement
Prediction/compensating unit 117 obtains the information of instruction inter-frame forecast mode etc..It note that the letter for hereinafter indicating intra prediction
Breath will be referred to as intraprediction mode information.Similarly, hereinafter, indicate that the information of inter-prediction will be referred to as inter-prediction
Pattern information.
Lossless coding unit 106 also obtains the filter used at loop filter 113 from filter factor computing unit 112
Wave system number.
The transformation coefficient of 106 pairs of lossless coding unit quantizations encodes, and also takes filter factor, intra prediction mould
The part (multiplexing) as the header information in coded data such as formula information, inter-frame forecast mode information, quantization parameter.Nothing
The coded data obtained by coding is supplied to storage buffer 107 to store by loss coding unit 106.
For example, executing the lossless of such as variable length code, arithmetic coding or the like for lossless coding unit 106
Consume coded treatment.The example of variable length code includes that (context-adaptive is variable by the CAVLC as defined in H.264/AVC format
Length coding).The example of arithmetic coding includes CABAC (context adaptive binary arithmetic coding).
Storage buffer 107 provisionally keeps the coded data supplied from lossless coding unit 106, and scheduled
The record that timing is output to downstream not shown in this Figure as the compression image by H.264/AVC said shank fills
It sets or transmission path etc..
In addition, the transformation coefficient of the quantization exported from quantifying unit 105 is also supplied to inverse quantization unit 108.Inverse quantization
Unit 108 executes inverse quantization to the transformation coefficient of quantization by corresponding to the method for the quantization at quantifying unit 105, and
The transformation coefficient of acquisition is supplied to inverse orthogonal transformation unit 109.
Inverse orthogonal transformation unit 109 is by the method for the orthogonal transformation processing corresponding to orthogonal transform unit 104 come to confession
The transformation coefficient answered executes inverse orthogonal transformation.The output that have passed through inverse orthogonal transformation is supplied to computing unit 110.
Computing unit 110 is by the inverse orthogonal transformation result supplied from inverse orthogonal transformation unit 109 (that is, the difference restored is believed
Breath) it is added with the forecast image supplied from selecting unit 118, also, obtain locally decoded image (decoding image).Example
Such as, in the case where difference information corresponds to the image that execute intraframe coding to it, computing unit 110 will be from intra prediction list
The forecast image of 116 supply of member is added with the difference information.Similarly, for example, frame will be executed to it by corresponding in difference information
Between in the case where the image that encodes, computing unit 110 is by the forecast image supplied from motion prediction/compensating unit 117 and the difference
Information is divided to be added.
Its addition result is supplied to de-blocking filter 111.
De-blocking filter 111 removes block noise from decoding image.Then, de-blocking filter 111 is by noise remove result
It is supplied to loop filter 113 and frame memory 114.
The decoding figure supplied from de-blocking filter 111 is supplied to filter factor computing unit 112 via frame memory 114
Picture.It also supplies to filter factor computing unit 112 from picture and rearranges the input picture that buffer 102 is read.In addition, from just
Converter unit 104 is handed over to supply orthogonal transformation size (4 × 4 orthogonal transformations and 8 × 8 orthogonal transformations to filter factor computing unit 112
In any be applied to each macro block).
Based on the orthogonal transformation size supplied from orthogonal transform unit 104, filter factor computing unit 112 is according to positive alternation
It changes size the macro block of decoding image and input picture is grouped and (executes category classification), also, is directed to each group (classification)
Generate the suitable filter factor of the filtering processing for executing at loop filter 113.Filter factor computing unit 112 is counted
Filter factor is calculated, so that minimum in residual error in each group (orthogonal transformation size) (difference between decoding image and input picture).
Each group of filter factor of generation is supplied to loop filter 113 by filter factor computing unit 112.In addition,
Each group of filter factor of generation is supplied to lossless coding unit 106 by filter factor computing unit 112.As described above,
Filter factor by lossless coding unit 106 by comprising (multiplexing) in coded data.That is, each group of filter
Wave system number is sent to picture decoding apparatus together with coded data.
Loop filter 113 is supplied to from the decoding image that de-blocking filter 111 is supplied via frame memory 114.This
Outside, orthogonal transformation size is supplied from orthogonal transform unit 104 to filter factor computing unit 112 (about 4 × 4 orthogonal transformations and 8
Any information for being applied to each macro block in × 8 orthogonal transformations).
Loop filter 113 is based on the orthogonal transformation size supplied from orthogonal transform unit 104 come according to orthogonal transformation ruler
The very little macro block to decoding image is grouped (execute category classification), also, is directed to each group (classification), using from filter factor
The filter factor that computing unit 112 is supplied to execute filtering processing to decoding image.For example, Wiener filter (Wiener
Filter) it is used as the filter.Of course, it is possible to use the filter in addition to Wiener filter.Loop filter 113 will filter
Processing result is supplied to frame memory 114, and stores as reference picture.
The reference picture of storage is output to intraframe coding via selecting unit 115 in scheduled timing by frame memory 114
Unit 116 or motion prediction/compensating unit 117.For example, in the case where to carry out the image of intraframe coding to it, frame storage
Reference picture is supplied to intraprediction unit 116 via selecting unit 115 by device 114.Similarly, for example, to be carried out to it
In the case where the image of interframe encode, reference picture is supplied to motion prediction/benefit via selecting unit 115 by frame memory 114
Repay unit 117.
For example, rearranging the I picture, B picture and P of buffer 102 from picture for the picture coding device 100
Picture is supplied to intraprediction unit 116 as the image of intra prediction to be carried out (also referred to as processing in frame).In addition, from
The B picture and P picture that picture rearranges the reading of buffer 102 are as inter-prediction to be carried out (also referred to as interframe processing)
Image is supplied to motion prediction/compensating unit 117.
In the case where to carry out the image of intraframe coding to it, ginseng that selecting unit 115 will be supplied from frame memory 114
It examines image and is supplied to intraprediction unit 116, also, in the case where to carry out the image of interframe encode to it, selecting unit
The reference picture supplied from frame memory 114 is supplied to motion prediction/compensating unit 117 by 115.
Intraprediction unit 116 is based on the image that carry out intra prediction for rearranging the reading of buffer 102 from picture
The intra-prediction process of all candidate intra prediction modes is executed, with the reference picture supplied from frame memory 114 to generate
Forecast image.
By intraprediction unit 116, the information about the intra prediction mode for being applied to current blocks/macroblock is transmitted to
Lossless coding unit 106, and it is taken as a part of header information.For luminance signal, defines intra-frame 4 * 4 and predict mould
16 × 16 prediction modes in 8 × 8 prediction modes and frame in formula, frame, in addition, about colour difference signal, it can be with luminance signal independence
Ground is that each macro block defines prediction mode.For intra-frame 4 * 4 forecasting model, a frame is defined for each 4 × 4 luminance block
Inner estimation mode.For 8 × 8 prediction modes in frame, an intra prediction mode is defined for each 8 × 8 luminance block.For frame
Interior 16 × 16 prediction mode and colour difference signal define a prediction mode for each macro block.
Intraprediction unit 116 calculates the cost function value (cost about the intra prediction mode for producing forecast image
Function value), also, select wherein calculated cost function value give the intra prediction mode of minimum value as
Optimal intra prediction mode.Intraprediction unit 116 is by the forecast image generated in best intra prediction mode via choosing
It selects unit 118 and is supplied to computing unit 103.
About the image of interframe encode to be passed through, 117 use of motion prediction/compensating unit rearranges buffer from picture
The input picture of 102 supplies and the decoding image for serving as reference frame supplied from frame memory 114, and calculation of motion vectors.
Motion prediction/compensating unit 117 executes motion compensation process according to calculated motion vector, and generates forecast image
(inter-prediction image information).
Motion prediction/compensating unit 117 executes inter-prediction processing for all candidate inter-frame forecast modes, and produces
Raw forecast image.Inter-frame forecast mode is as the case where intra prediction mode.
Motion prediction/compensating unit 117 is for which create the inter-frame forecast modes of forecast image to calculate cost
Functional value, and its calculated cost function value is selected to generate the inter-frame forecast mode of minimum value as best inter-prediction mould
Formula.Motion prediction/compensating unit 117 supplies the forecast image generated in best inter-frame forecast mode via selecting unit 118
Computing unit 103 should be given.
The motion vector information for indicating calculated motion vector is supplied to lossless by motion prediction/compensating unit 117
Coding unit 106.The motion vector information by lossless coding unit 106 by comprising (multiplexing) in coded data.
That is, motion vector information is sent to picture decoding apparatus together with coded data.
In the case where executing the image of intraframe coding, the output of intraprediction unit 116 is supplied to by selecting unit 118
Computing unit 103, also, in the case where executing interframe encode, selecting unit 118 is defeated by motion prediction/compensating unit 117
It is supplied to computing unit 103 out.
Rate control unit 119 controls quantifying unit 105 based on the compression image stored in storage buffer 107
The rate of quantization operation, so that overflow or underflow will not occur.
[description of orthogonal transformation]
Next, will be described in detail each above-mentioned processing.Firstly, orthogonal transformation will be described.
For MPEG2 coded format, the processing of orthogonal transformation is performed using 8 × 8 pixels as increment.Another party
Face passes through baseline class (Baseline for the picture coding device 100 for executing orthogonal transformation identical with AVC coded format
Profile), main classes (Main Profile) and extension class (Extended Profle) are executed using 4 × 4 pixels as increment
Orthogonal transformation.In addition, picture coding device 100 can be according to macro block in high class (High Profile) or higher class
The increasing of 8 × 8 pixels shown in the orthogonal transformation of increment of increment 4 × 4 pixels shown in the A with Fig. 2 and the B with Fig. 2
Switch between the orthogonal transformation of amount.
[4 × 4 orthogonal transformation]
Firstly, 4 × 4 orthogonal transformations will be described.There are following characteristics with the orthogonal transformation of 4 × 4 pixel increments.
Fisrt feature is, for MPEG2 coded format, it is free can be directed in a certain range each coded format
The computational accuracy of ground setting transformation, to need to implement the measure for the mismatch in inverse transformation, still, for this method,
Transformation and two kinds of inverse transformation are defined in standard, without implementing such measure for being used for mismatch.
Second feature is that it is possible to realize the embodiment for using 16- bit register, so as to use low-power consumption type
Digital signal processor (DSP (digital signal processor)) (for example, with portable terminal etc. be used together) calculates to realize.
Third feature is, although the orthogonal transformation in the increment for passing through 8 × 8 pixels of use of such as MPEG2 or the like
Coding method observed mosquito noise caused by the quantization error at due to high frequency coefficient, still, through the invention not
It can observe this mosquito noise with can be read.
The summary of Fig. 3 diagram orthogonal transformation and quantification treatment.That is, the color for 8 × 8 pixels for including in a macro block
The luminance signal of difference signal and 16 × 16 pixels is each split into 4 × 4 block of pixels, as shown in figure 3, also, carrying out to each piece
Integer transform processing and quantification treatment.In addition, only having accumulated the 2 × 2 of DC component as shown in figure 3, generating for colour difference signal
Matrix, also, 2 Hadamard transform and quantizations are carried out to these matrixes.
In addition, only having accumulated DC points as shown in figure 3, generating in current macro is frame in the case where 16 × 16 mode
4 × 4 matrixes of amount, also, 4 Hadamard transform and quantizations are carried out to these matrixes.
4 sub-orthogonal transforations can be described as in following expression formula (1).
[mathematic(al) representation 1]
Wherein
Expression formula (2) is the variant that can be obtained by the expression formula (1).
[mathematic(al) representation 2]
Wherein
Expression formula (3) is another variant that can be obtained by the expression formula (2).
[mathematic(al) representation 3]
Therefore, matrix [Cf] following expression formula (4) can be expressed as.
[mathematic(al) representation 4]
Become in the matrix shown in the right-hand side in expression formula (4) as integer that is, picture coding device 100 is used
Change matrix.
Therefore, integer transform can pass through addition (addition and subtraction) and displacement (bit shift) Lai Shixian.
In addition, according to expression formula (3), matrix [Ef] following expression formula (5) can be expressed as.
[mathematic(al) representation 5]
The right-hand side item of the expression formula (5) be by picture coding device 100 for each 4 × 4 component hold it is different
Quantification treatment and realize.In other words, picture coding device 100 is realized just by the combination of integer transform and quantification treatment
Alternation changes.
In addition, inverse transformation can be expressed as following expression formula (6).
[mathematic(al) representation 6]
Therefore, the right-hand side of expression formula (6) can be expressed as if following expression formula (7) is as in expression formula (8).
[mathematic(al) representation 7]
[mathematic(al) representation 8]
It is 4 × 4 matrixes obtained as inverse-quantized result in the matrix shown in the right-hand side in expression formula (7), and
4 × 4 matrixes about decoding image are to be calculated by applying in the inverse quantization matrix shown in the right-hand side in expression formula (8)
's.
Inverse integer transform can also be individually through addition (addition and subtraction) and displacement (bit shift) Lai Shixian.
B diagram in A and Fig. 4 in Fig. 4 is for realizing the technology of integer transform and inverse integer transform by butterfly computing.
[8 × 8 orthogonal transformation]
Next, will be described for 8 × 8 orthogonal transformations, which can be with AVC high class and higher
Class is used together.
It is defined as only calculating realization with addition and subtraction and displacement by 100,8 × 8 orthogonal transformation of picture coding device
Integer transform, as the case where 4 × 4 orthogonal transformation.
Firstly, picture coding device 100 executes the calculating of orthogonal transformation for eight points in horizontal direction, next,
Transformation is executed for eight points in vertical direction.
To simplify the description, 8 one-dimensional integer transforms will be described.
Firstly, utilizing the input signal of { d0, d1, d2, d3, d4, d5, d6, d7 }, following expression formula (9) is executed to table
Up to the calculating of formula (16).
E0=d0+d7... (9)
E1=d1+d6... (10)
E2=d2+d5... (11)
E3=d3+d6... (12)
E4=d0-d7... (13)
E5=d1-d6... (14)
E6=d2-d5... (15)
E7=d3-d4... (16)
Next, executing following expression formula (17) to expression formula (24) for { e0, e1, e2, e3, e4, e5, e6, e7 }
Calculating.
E'0=e0+e3... (17)
E'1=e1+e2... (18)
E'2=e0-e3... (19)
E'3=e1-e2... (20)
E'4=e5+e6+ (e4 > > 1+e4) ... (21)
E'5=e4-e7- (e6 > > 1+e6) ... (22)
E'6=e4+e7- (e5 > > 1+e5) ... (23)
E'7=e5-e6+ (e7 > > 1+e7) ... (24)
In addition, executing following expression formula (25) to expression for { e'0, e'1, e'2, e'3, e'4, e'5, e'6, e'7 }
The calculating of formula (32), to obtain the coefficient { D0, D1, D2, D3, D4, D5, D6, D7 } of orthogonal transformation.
D0=e'0+e'1... (25)
D2=e'2+e'3 > > 1... (26)
D4=e'0-e'1... (27)
D6=e'2 > > 1-e'3... (28)
D1=e'4+e'7 > > 2... (29)
D3=e'5+e'6 > > 2... (30)
D5=e'6-e'5 > > 2... (31)
D7=-e'7+e'4 > > 2... (32)
The inverse orthogonal transformation quilt of { d0, d1, d2, d3, d4, d5, d6, d7 } is arrived from { D0, D1, D2, D3, D4, D5, D6, D7 }
It is following to execute.
That is, firstly, equally with following expression formula (34) to expression formula (40), calculate from D0, D1, D2, D3,
D4, D5, D6, D7 } arrive { f0, f1, f2, f3, f4, f5, f6, f7 }.
F0=D0+D4... (33)
F1=-D3+D5- (D7+D7 > > 1) ... (34)
F2=D0-D4... (35)
F3=D1+D7- (D3+D3 > > 1) ... (36)
F4=D2 > > 1-D6... (37)
F5=-D1+D7+ (D5+D5 > > 1) ... (38)
F6=D2+D6 > > 1... (39)
F7=D3+D5+ (D1+D1 > > 1) ... (40)
Next, equally with following expression formula (41) to expression formula (48), calculate from f0, f1, f2, f3, f4, f5,
F6, f7 } arrive { f'0, f'1, f'2, f'3, f'4, f'5, f'6, f'7 }.
F'0=f0+f6... (41)
F'1=f1+f7 > > 2... (42)
F'2=f2+f4... (43)
F'3=f3+f5 > > 2... (44)
F'4=f2-f4... (45)
F'5=f3 > > 2-f5... (46)
F'6=f0-f6... (47)
F'7=f7-f1 > > 2... (48)
Finally, equally with following expression formula (49) to expression formula (56), calculating from { f'0, f'1, f'2, f'3, f'4, f'
5, f'6, f'7 } arrive { d0, d1, d2, d3, d4, d5, d6, d7 }.
D0=f'0+f'7... (49)
D1=f'2+f'5... (50)
D2=f'4+f'3... (51)
D3=f'6+f'1... (52)
D4=f'6-f'1... (53)
D5=f'4-f'3... (54)
D6=f'2-f'5... (55)
D7=f'0-f'7... (56)
[de-blocking filter]
Next, de-blocking filter will be described.Block noise in the removal decoding image of de-blocking filter 111.Therefore, inhibit
Block noise travels to the image referred to by motion compensation process.
Following three kinds of methods (a) to (c) for deblocking filtering processing can pass through include two in coded data
A parameter is selected, and described two parameters are in image parameters group RBSP (original bit sequence payload (Raw Byte
Sequence Payload)) in include deblocking_filter_control_present_flag and in sheet head
The disable_deblocking_filter_idc for including in (Slice Header).
(a) block boundary and macroblock boundaries are applied to
(b) macroblock boundaries are applied only to
(c) do not apply
For quantization parameter QP, in the case where QPY is used to apply following processing to luminance signal, also, QPC is used for color
In the case where difference signal applies.Although in addition, belonging to different pixel values in motion vector coding, intra prediction and entropy coding
(CAVLC/CABAC) it is treated as " not available " in, still, deblocking filtering is handled, or even belong to different pixels
Value is treated as " available ", as long as they belong to identical picture.
Below, we will assume that, the pixel value before deblocking filtering processing is p0 to p3 and q0 to q3, also,
Pixel value after deblocking filtering processing is p0 ' to p3 ' and q0 ' to q3 ', as shown in Figure 5.
Firstly, deblocking filtering processing before, table as shown in Figure 6 is the same, in Fig. 5 p and q define the (side Bs
Boundary's intensity).
Only in the case where meeting condition shown in following expression formula (57) and expression formula (58), in Fig. 5
(p2, p1, p0, q0, q1, q2) carries out deblocking filtering processing.
Bs>0...(57)
|p0-q0|<α；|p1-p0|<β；|q1-10|<β...(58)
In default conditions, α and β in expression formula (58) have its value determined according to QP as described below, still, use
It family can be by the so-called slice_alpha_c0_offset_div2 and slice_ that include in the sheet head of coded data
Two parameters of beta_offset_div2 adjust its intensity, as shown in the arrow in the curve graph in Fig. 7.
As shown in the table in Fig. 8, α is obtained from indexA.In an identical manner, β is obtained from indexB.This
A little indexA are defined as following expression formula (59) to expression formula (61) with indexB.
qPaν=(qPp+qPq+1)>>1...(59)
IndexA=Clip3 (0,51, qPaν+FilterOffsetA)...(60)
IndexB=Clip3 (0,51, qPaν+FilterOffsetB)...(61)
In expression formula (60) and expression formula (61), the tune of FilterOffsetA and FilterOffsetB corresponding to user
Whole amount.
For deblocking filtering processing, as described below, the case where for Bs < 4 and the case where Bs=4, defines mutually different side
Method.In the case where Bs < 4, as following expression formula (62) to expression formula (64), obtain after deblocking filtering processing
Pixel value p'0 and q'0.
Δ=Clip3 (- tc,tc((((q0-p0)<<2)+(p1-q1)+4)>>3))...(62)
P'0=Clip1 (p0+ Δ) ... (63)
Q'0=Clip1 (q0+ Δ) ... (64)
Now, t is calculated as following expression formula (65) or expression formula (66)c.That is,
When the value of chromaEdgeFlag is " 0 ", t is calculated as following expression formula (65)c。
tc=tc0+((ap< β)? 1:0)+((ap< β)? 1:0) ... (65)
In addition, calculating t as following expression formula (66) when the value of chromaEdgeFlag is not " 0 "c。
tc=tc0+1...(66)
According to the value of Bs and indexA, as shown in the table in the B in the A and Fig. 9 in Fig. 9, t is definedc0Value.
In addition, a such as following expression formula (67) as (68), in calculation expression (65)pAnd aqValue.
ap=| p2-p0 | ... (67)
aq=| q2-q0 | ... (68)
Pixel value p'1 after deblocking filtering processing is obtained as follows.That is, in the value of chromaEdgeFlag
It is " 0 " and apValue be also not β in the case where, as following expression formula (69) obtain p'1.
P'1=p1+Clip3 (- tc0,tc0,(p2+((p0+q0+1)>>1)-(p1<<1))>>1)...(69)
In addition, obtaining p'1 as following expression formula (70) in the case where not meeting expression formula (69).
P'1=p1... (70)
Pixel value q'1 after deblocking filtering processing is obtained as follows.That is, in the value of chromaEdgeFlag
It is " 0 " and aqValue be also not β in the case where, as following expression formula (71) obtain q'1.
Q'1=q1+Clip3 (- tc0,tc0,(q2+((p0+q0+1)>>1)-(q1<<1))>>1)...(71)
In addition, obtaining q'1 as following expression formula (72) in the case where not meeting expression formula (71).
Q'1=q1... (72)
According to the value of p2 and q2 before filtering, the value of p ' 2 and q ' 2 are constant.That is, such as following expression formula
(73) p ' 2 is equally obtained, q ' 2 is obtained as following expression formula (74).
P'2=p2... (73)
Q'2=q2... (74)
In the case where Bs=4, the pixel value p'I (i=0..2) after deblocking filtering is obtained as follows.?
In the case where the value of chromaEdgeFlag is " 0 " and meets condition shown in following expression formula (75), such as following table
P ' 0, p ' 1 and p ' 2 are equally obtained up to formula (76) to expression formula (78).
ap<β&&|p0-q0|<((α>>2)+2)...(75)
P'0=(p2+2 × p1+2 × p0+2 × q0+q1+4) > > 3... (76)
P'1=(p2+p1+p0+q0+2) > > 2... (77)
P'2=(2 × p3+3 × p2+p1+p0+q0+4) > > 3... (78)
In addition, in the case where not meeting condition shown in expression formula (75), such as following expression formula (79) to table
P ' 0, p ' 1 and p ' 2 are equally obtained up to formula (81).
P'0=(2 × p1+p0+q1+2) > > 2... (79)
P'1=p1... (80)
P'2=p2... (81)
Pixel value q'i (I=0..2) after deblocking filtering processing is obtained as follows.That is, in chromaEdgeFlag
Value be " 0 " and meet condition shown in following expression formula (82) in the case where, such as following expression formula (83) to express
Formula (85) equally obtains q ' 0, q ' 1 and q ' 2.
aq<β&&|p0-q0|<((α>>2)+2)...(82)
Q'0=(p1+2 × p0+2 × q0+2 × q1+q2+4) > > 3... (83)
Q'1=(p0+q0+q1+q2+2) > > 2... (84)
Q'2=(2 × q3+3 × q2+q1+q0+p4+4) > > 3... (85)
In addition, in the case where not meeting condition shown in expression formula (82), such as following expression formula (86) to table
Q ' 0, q ' 1 and q ' 2 are equally obtained up to formula (88).
Q'0=(2 × q1+q0+p1+2) > > 2... (86)
Q'1=q1... (87)
Q'2=q2... (88)
[loop filter]
Now, in transmission there is the even more high-resolution image of such as 4000 × 2000 pixels or by having
In the case where the route (such as internet) of limited bandwidth transmits existing Hi visual pattern, the compression ratio realized by AVC is still
It is so inadequate.
Now, as a kind of technology for improving code efficiency, loop filter is used together with picture coding device 100
113.For example, using Wiener filter for loop filter 113.Certainly, it for loop filter 113, can be used except dimension
The filter received other than filter.By executing filtering processing, loop filtering for the decoding image by deblocking filtering processing
Device 113 minimizes the residual error about original image.Filter factor computing unit 112 calculates loop filtering coefficient, so that decoding
Residual error between image and original image is minimized by filtering processing.Loop filter 113 is held using the filter factor
Row filtering processing.It note that the filter factor is transmitted to picture decoding apparatus after being added to coded data, and
It is also used for being filtered when decoding.
By executing this filtering processing, the picture quality of decoding image is can be improved in picture coding device 100, and also
The picture quality of reference picture can be improved.
[selection of prediction mode]
Now, for such as UHD (ultrahigh resolution of the target as next-generation coded format；4000 pixels ×
2000 pixels) big picture frame, make macroblock size become 16 pixel × 16 pixels be not optimal.For example, having mentioned
Go out to make macroblock size to become 32 pixel × 32 pixels, 64 pixel × 64 pixels etc..
In order to realize even higher code efficiency, suitable prediction mode is selected to be important.For example, it is contemplated that this
The method of sample, that is, wherein, select one of the both of which of high complexity mode and low-complexity mode technology.In the party
In the case where method, for any one, the cost function value about each prediction mode Mode is calculated, also, selection makes this
The smallest prediction mode of cost function value is as the optimal mode for current block or macro block.
The cost function with high complexity mode can be obtained as following expression formula (89).
Cost (Mode ∈ Ω)=D+ λ × R... (89)
In expression formula (89), Ω is entire group for encoding the candidate pattern of current block or macro block.In addition, with working as
In the case where preceding prediction mode Mode is encoded, D is the differential power decoded between image and input picture.In addition, λ is to make
The Lagrange multiplier provided for the function of quantization parameter.In addition, R is comprising orthogonal transform coefficient with present mode Mode
Total code amount in the case where being encoded.
That is, needing to execute one by all candidate pattern Mode to be encoded with high complexity mode
Secondary exploratory coded treatment needs bigger calculation amount to calculate above-mentioned parameter D and R.
On the other hand, as shown in following expression formula (90), the cost function of low-complexity mode can be obtained.
Cost (Mode ∈ Ω)=D+QP2Quant (QP) × HeaderBit... (90)
In expression formula (90), with high complexity mode the case where is different, and D is between forecast image and input picture
Differential power.In addition, QP2Quant (QP) is provided as the function of quantization parameter QP.In addition, HeaderBit is about such as transporting
The size of code of the information for belonging to the head not comprising orthogonal transform coefficient of moving vector and mode.
That is, need to execute prediction processing for each candidate pattern Mode in low-complexity mode, but
It is not need to go to decoding image all the way, it is therefore not required to go to decoding process always.It therefore, can be with complicated with height
Degree mode is realized compared to lesser calculation amount.
For high class (High Profile), executed such as based on one of above-mentioned high complexity mode and low-complexity mode
Selection between 4 × 4 orthogonal transformation and 8 × 8 orthogonal transformations shown in Fig. 2.
Now, for the big picture frame of such as UHD of the target as next-generation coded format, macroblock size is made to become 16
A pixel × 16 pixel is not optimal.For example, as shown in Figure 10, it has been proposed that make macroblock size become 32 pixels ×
32 pixels.
It is the biggish piece of conduct of 16 × 16 block of pixels or smaller piece of definition by utilizing layer structure as shown in Figure 10
Its superset (superset), while compatibility is kept with the macro block in current AVC.
[detailed configuration example]
As described above, picture coding device 100 applies loop filtering processing to image coded treatment.Picture coding device
100 obtain the optimum filtering coefficients for loop filtering processing for each orthogonal transformation size, also, with being suitable for this just
The filter factor of transform size is handed over to execute the filtering processing of each macro block.
Here is the filter factor computing unit 112 and loop filter as the configuration about this loop filter
The detailed description of 113 configuration.
Figure 11 is the block diagram for illustrating the main configuration example of filter factor computing unit 112 and loop filter 113.
As shown in figure 11, there is filter factor computing unit 112 orthogonal transformation size buffer 151, decoded pixel to classify
Unit 152, input 153,4 × 4 pieces of coefficient calculation unit 154 and 8 × 8 piece coefficient calculation units 155 of pixel classifications unit.
In addition, loop filter 113 have pixel classifications unit 161, filter unit (4 × 4) 162 and filter unit (8 ×
8)163。
Firstly, decoding image is supplied to frame memory 114 from de-blocking filter 111.In addition, about each macro block
The information (being (4 × 4) or (8 × 8)) of orthogonal transformation size is supplied to filter factor from orthogonal transform unit 104 and calculates list
The orthogonal transformation size buffer 151 of member 112.
Decoding image is further supplied to the decoded pixel classification of filter factor computing unit 112 from frame memory 114
Unit 152.In addition, input picture, which rearranges buffer 102 from picture, is supplied to input pixel classifications unit 153.
Decoded pixel taxon 152 reads the information about orthogonal transformation size from orthogonal transformation size buffer 151
And obtain the information.Decoded pixel taxon 152 is executed based on the orthogonal transformation size of acquisition will decode the macro block of image
It is classified as being applied with it macro block (4 × 4 orthogonal transform block) of 4 × 4 orthogonal transformations and is applied with 8 × 8 orthogonal transformations to it
The category classification (grouping) of macro block (8 × 8 orthogonal transform block).Then, decoded pixel taxon 152 by decode image about
The information of 4 × 4 orthogonal transform blocks is supplied to 4 × 4 pieces of coefficient calculation units 154, also, will be about the letter of 8 × 8 orthogonal transform blocks
Breath is supplied to 8 × 8 pieces of coefficient calculation units 155.
In an identical manner, input pixel classifications unit 153 is read from orthogonal transformation size buffer 151 about positive alternation
It changes the information of size and obtains the information.Input pixel classifications unit 153 is executed based on the orthogonal transformation size of acquisition will be defeated
The macro block classification (grouping) for entering image is to be applied with the macro block (4 × 4 orthogonal transform block) of 4 × 4 orthogonal transformations to it and apply to it
The category classification of the macro block (8 × 8 orthogonal transform block) of 8 × 8 orthogonal transformations is added.Then, input pixel classifications unit 153 will be defeated
The information about 4 × 4 orthogonal transform blocks for entering image is supplied to 4 × 4 pieces of coefficient calculation units 154, also, will be about 8 × 8 just
The information of transform block is handed over to be supplied to 8 × 8 pieces of coefficient calculation units 155.
4 × 4 pieces of coefficient calculation units 154 use the decoding image and input picture to its 4 × 4 orthogonal transform block supplied
Filter factor (for example, Wiener filtering coefficient) is calculated, so that the residual error is minimum.4 × 4 pieces of coefficient calculation units 154 will calculate
Filter factor out is supplied to lossless coding unit 106, and is also supplied to the filter unit (4 × 4) of loop filter 113
162。
In an identical manner, 8 × 8 pieces of coefficient calculation units 155 use the decoding to its 8 × 8 orthogonal transform block supplied
Image and input picture calculate filter factor (for example, Wiener filtering coefficient), so that the residual error is minimum.8 × 8 pieces of coefficients calculate
Calculated filter factor is supplied to lossless coding unit 106 by unit 155, and is also supplied to loop filter 113
Filter unit (8 × 8) 163.
The filter factor of supply is added to coded data by lossless coding unit 106.
Now, from orthogonal transform unit 104 to the pixel classifications unit 161 of loop filter 113 supply about with it is each
The information of the related orthogonal transformation size (being (4 × 4) or (8 × 8)) of a macro block.Divide from de-blocking filter 111 to its pixel
The supply decoding image of class unit 161.
Pixel classifications unit 161 is held based on the information about orthogonal transformation size supplied from orthogonal transform unit 104
Be about to decode image macro block classification (grouping) be it is applied with 4 × 4 orthogonal transformations macro block (4 × 4 orthogonal transform block) and
The category classification of the macro block (8 × 8 orthogonal transform block) of 8 × 8 orthogonal transformations is applied with to it.Then, pixel classifications unit 161 will
The information about 4 × 4 orthogonal transform blocks of decoding image is supplied to filter unit (4 × 4) 162, also, will be orthogonal about 8 × 8
The information of transform block is supplied to filter unit (8 × 8) 163.
Filter unit (4 × 4) 162 applies 4 × 4 orthogonal transform blocks supplied from 4 × 4 pieces of coefficient calculation units 154
Suitable filter factor, and filtering processing is executed to 4 × 4 orthogonal transform blocks of decoding image.
Filter unit (8 × 8) 163 applies 8 × 8 orthogonal transform blocks supplied from 8 × 8 pieces of coefficient calculation units 155
Suitable filter factor, and filtering processing is executed to 8 × 8 orthogonal transform blocks of decoding image.
Filter unit (4 × 4) 162 and filter unit (8 × 8) 163 will be stored in frame by the decoding image of filtering processing
In memory 114, so as in scheduled timing output to motion prediction/compensating unit 117.
Filter factor computing unit 112 and loop filter 113 execute processing as described above, with orthogonal for each
Transform size generates filter factor, and executes filtering processing.
It can be said that the local property in image is reflected in orthogonal transformation size.For example, for flat region (frequency
The sparse part of rate), it is likely that 8 × 8 orthogonal transformations of selection, for the region (parts of closely spaced frequencies) comprising close grain, very
It may select 4 × 4 orthogonal transformations.
In addition, observing different picture quality degradation trends between 8 × 8 orthogonal transformations and 4 × 4 orthogonal transformations.Example
Such as, for 8 × 8 orthogonal transformations, it is easily observed that mosquito noise, and for 4 × 4 orthogonal transformations, it is not easy to observe that mosquito formula is made an uproar
Sound.
Therefore, filter factor computing unit 112 is by generating filtering system for each orthogonal transformation size as described above
Number carrys out the local property reflected in image in filter factor.For example, filter factor computing unit 112 can be controlled, with
Just the value of filter factor is adjusted, so that the weaker filtering of part application that loop filter 113 is sparse for frequency, and for
The part of closely spaced frequencies applies stronger filtering.
It note that other than the value for simply changing filter factor, filter factor computing unit 112 can also increase/
Reduce the tap number of filter.For example, the part reduction tap number that filter factor computing unit 112 is sparse for frequency, also,
Tap number is increased for the part of closely spaced frequencies.Certainly, filter factor computing unit 112 can both execute the value of filter factor
Adjustment, and execute increase/reduction of tap number.
In this way, filtering processing is executed using the filter factor of the local property reflected in image, thus, loop filtering
Device 113 can execute the noise remove for being suitable for local property possessed by the image, and can be further improved decoding figure
The picture quality of picture.
It note that in this way, having deposited as grammatical feature based on so-called orthogonal transformation size of picture coding device 100
Value execute switching, it is therefore not required to map information (map information), which is newly added to, will be sent to it filtering
The coded data of coefficient therefore can be in the case where the expense in no increase coded data (in no reduction code efficiency
In the case where) realize high image quality processing.
[process of processing]
Next, description is used the process of the processing of the part configured as described above.Firstly, by referring to Fig.1 2
Flow chart describes the example of the process of the coded treatment executed by picture coding device 100.
In step s101, A/D converting unit 101 input picture from simulation be transformed into number.In step S102
In, picture rearranges the image that buffer 102 stores A/D conversion, and executes from for showing the sequence of picture to being used for
The sequence of coding rearranges.
In step s 103, intraprediction unit 116 and motion prediction/compensating unit 117 etc. determine prediction mode, and
Prediction processing is executed, to generate forecast image.The details of prediction processing will be described later.
In step S104, computing unit 103 calculates the image rearranged by the processing in step S102 and by step
The difference between forecast image that prediction processing in S103 generates.Via selecting unit 118, the case where executing inter-prediction
In, forecast image is supplied to computing unit 103 from motion prediction/compensating unit 117, also, in the feelings for executing intra prediction
In condition, forecast image is supplied to computing unit 103 from intraprediction unit 116.
Compared with raw image data, the data volume of differential data is smaller.Therefore, in the case where no variation to original
The case where beginning image is encoded is compared, can be with amount of compressed data.
In step s105, orthogonal transform unit 104 carries out just the difference information generated by the processing in step S104
Alternation changes.Specifically, executing the orthogonal transformation of discrete cosine transform, Karhunen-Lo é ve transformation etc., also, export
Transformation coefficient.In step s 106, quantifying unit 105 quantifies transformation coefficient.In the quantization, speed control, thus
The processing in step S115 that description is described later on.
In step s 107, lossless coding unit 106 compiles the quantization transform coefficient exported from quantifying unit 105
Code.
In addition, carrying out following local decoder to the difference information quantified in this way.Specifically, in step S108, it is inverse
Quantifying unit 108 using characteristic corresponding with the characteristic of quantifying unit 105 come to the transformation coefficient quantified by quantifying unit 105 into
Row inverse quantization.In step S109, inverse orthogonal transformation unit 109 uses characteristic corresponding with the characteristic of orthogonal transform unit 104
To carry out inverse orthogonal transformation to the inverse-quantized transformation coefficient Jing Guo inverse quantization unit 108.
In step s 110, computing unit 110 is by the forecast image supplied via selecting unit 118 and the difference of local decoder
Divide information to be added, and generates the image (input that the image corresponds to computing unit 103) of local decoder.In step S111
In, de-blocking filter 111 carries out deblocking filtering to the decoding image supplied from computing unit 110.Therefore, block noise is eliminated.
When executing above-mentioned processing to a picture, in step S112, filter factor computing unit 112 and loop filtering
Device 113 executes loop filtering processing.The details of loop filtering processing will be described later.
In step S113, lossless coding unit 106 is embedded in (write-in) for each orthogonal transformation in sheet head
The metadata of filter factor, inter-frame forecast mode information, the intraprediction mode information of block etc..In image decoding, read and
Use the metadata.
In step S114, storage buffer 107 stores coded data.The coded number being stored in storage buffer 107
Decoding side is sent to according to being read in due course, and via transmitting path.
In step sl 15, Rate control unit 119 is executed based on the coded data being stored in storage buffer 107
The rate of the quantization operation of quantifying unit 105, so that overflow or underflow will not occur.
Next, the process for the prediction processing that the flow chart in referring to Fig.1 3 is described to execute in the step S103 in Figure 12
Example.
When starting prediction processing, in step S131,116 use of intraprediction unit is via selecting unit 115 from frame
The reference picture and rearrange the input picture that buffer 102 is supplied from picture to calculate in frame 4 that memory 114 obtains
× 4, in frame 8 × 8 and frame in 16 × 16 each mode (each pre-prepd frame mode) cost function value.
In step S132, cost of the intraprediction unit 116 based on each mode calculated in step S131
Functional value come be directed to intra-frame 4 * 4, in frame 8 × 8 and frame in each of 16 × 16 determine optimal modes.
In step S133, intraprediction unit 116 selects most preferably from 16 × 16 in intra-frame 4 * 4, frame 8 × 8 and frame
Frame mode.
Concurrently with each of step S131 to step S133 processing, motion prediction/compensating unit 117 executes step
Each of S134 to step S137 processing.
In step S134, motion prediction/compensating unit 117 executes motion search.In step S135, motion prediction/
Compensating unit 117 determines motion vector/reference frame for each of interframe 16 × 16 to 4 × 4 mode.
In step S136, motion prediction/compensating unit 117 is for each of interframe 16 × 16 to 4 × 4 mode meter
Calculate cost function value.
In step S137, motion prediction/compensating unit 117 determines best inter mode based on cost function value.
In step S138, selecting unit 118 determines the best frame mode selected in step S133 and in step
One of best inter mode determined in S137 is used as optimal mode.
It is pre- corresponding to the intraprediction unit 116 for the mode for being determined as optimal mode or movement in step S139
Survey/compensating unit 117 generates forecast image.Via selecting unit 118, which is supplied to computing unit 103 and meter
Calculate unit 110.In addition, prediction mode information (intraprediction mode information or the inter-frame forecast mode of optimal mode at this time
Information) it is supplied to lossless coding unit 106.
When generating forecast image, processing terminate for prediction, this process is executed back to the step S103 in Figure 12
The processing of step S104 and subsequent step.
Next, the flow chart in referring to Fig.1 4 is described the loop filtering executed in the step S112 in Figure 12 processing
The example of process.
When starting loop filtering processing, in step S151, decoded pixel taxon 152, input pixel classifications list
Member 153 and pixel classifications unit 161 are every according to applying in the orthogonal transformation processing executed in the step S105 in Figure 12
A kind of input picture of its supply of orthogonal transformation size opposite direction or the macro block for decoding image are grouped and (execute category classification).
In step S152,4 × 4 pieces of coefficient calculation unit 154 and 8 × 8 piece coefficient calculation units 155 are directed to each group of meter
Calculate filter factor.
In step S153, filter unit (4 × 4) 162 and 163 use of filter unit (8 × 8) calculate in step S152
Filter factor out to execute filtering processing to each group.
In step S154, frame memory 114 is stored in the result of the filtering processing executed in step S153 (by filtering
The decoding image of processing).The image is supplied to motion prediction/compensating unit 117 as reference picture in scheduled timing.
When processing terminate by step S154, processing terminate for loop filtering, this process returns to the step S112 in Figure 12,
Also, execute the processing of step S113 and subsequent step.
By executing each above-mentioned processing, filter factor computing unit 112 can be directed to each orthogonal transformation ruler
It is very little to generate suitable filter factor.In addition, the corresponding filtering system of orthogonal to that transform size can be used in loop filter 113
Number executes filtering processing to each macro block.
As a result, picture coding device 100 can execute the noise remove for the local property being suitable in image, also, can
To obtain the reference picture with more high image quality.
In addition, these filter factors are added to coded data by lossless coding unit 106, it is thus possible to use these
Filter factor to execute suitable filtering processing to decoding image, which is by picture decoding apparatus to coded data
It is decoded and obtains.That is, picture coding device 100 can be improved by having produced to picture coding device 100
Raw coded data be decoded and obtain decoding image picture quality.
It note that hereinbefore, " addition " refers to makes control information associated with coded data in the form of optional.Example
Such as, this can be described as the grammer of coded data, alternatively, can be described as user data.In addition, the letter of filter factor etc.
Breath can be used as metadata and be placed in the state linked with coded data.That is, " addition " includes " insertion ", " retouches
State ", " multiplexing ", " link " etc..This is equally applicable to hereafter.
Although being orthogonally transformed ruler in addition, the orthogonal transformation size above for 4 × 4 and 8 × 8 is described
Very little is optional.Similarly, the number of the orthogonal transformation size of application is also optional.
It can be 3 kinds or more in the orthogonal transformation size of application and be grouped (category classification), so that needle
Classification is executed to two kinds in all orthogonal transformation sizes, also, other orthogonal transformation sizes are ignored (being not selected).
In this case, to the group of ignorance without filtering processing.In this case, such as, if executing filtering processing can be with
It is controlled by flag information etc..
In addition, for example, can arrange orthogonal transformation size, two groups can be divided into.That is, at this
In the case of kind, a variety of orthogonal transformation sizes can coexist in a group.In addition, for example, orthogonal transformation size can be divided into
Mutually different group.In this case, group number is 3 or more.In this case, the filter unit and coefficient of preparation calculate
The number (Figure 11) of unit is identical as group number.
It, perhaps can be with press piece or can be according to others side in addition, can be with the increment of the processing of filter by frame
Formula.In addition, the increment (picture size of the parts of images of the increment as processing) for executing category classification can be different from
Macro block.
<2. second embodiment>
[configuration of device]
Next, being filled image decoding corresponding with the picture coding device 100 described by first embodiment is described
It sets.Figure 15 is the configuration example for the embodiment that diagram serves as the picture decoding apparatus for applying image processing apparatus of the invention
Block diagram.
Picture decoding apparatus 200 is decoded the coded data exported from picture coding device 100, and generates decoding
Image.
Picture decoding apparatus 200 is by storage buffer 201, lossless decoding unit 202, inverse quantization unit 203, inverse orthogonal
Converter unit 204, computing unit 205 and de-blocking filter 206 are constituted.Picture decoding apparatus 200 also has loop filter
207.Picture decoding apparatus 200 also there is picture to rearrange buffer 208 and D/A (digital-to-analog I) converting unit 209.Figure
As decoding apparatus 200 has frame memory 210, selecting unit 211, intraprediction unit 212, motion prediction/compensating unit 213
With selecting unit 214.
Storage buffer 201 stores the coded data transmitted to it.Lossless decoding unit 202 uses and the nothing in Fig. 1
The corresponding format of coded format of loss coding unit 106 comes to from the supply of storage buffer 201 and by lossless coding list
The information of 106 coding of member is decoded.
In the case where having carried out intraframe coding to current macro, lossless decoding unit 202 is extracted in coded data
Head point in the intraprediction mode information that stores, and send it to intraprediction unit 212.In addition, to current
In the case where macro block has carried out interframe encode, lossless decoding unit 202 extracts the storage in the head of coded data point
Motion vector information, inter-frame forecast mode information etc., and send it to motion prediction/compensating unit 213.
In addition, lossless decoding unit 202 extracts the filtering system for each orthogonal transformation size from coded data
Number, and these filter factors are supplied to loop filter 207.
Inverse quantization unit 203 is using format corresponding with the quantization format of quantifying unit 105 in Fig. 1 to by lossless solution
The code decoded image of unit 202 carries out inverse quantization.
Inverse orthogonal transformation unit 204 uses format corresponding with the orthogonal transformation format of orthogonal transform unit 104 in Fig. 1
Carry out the output to inverse quantization unit 203 and carries out inverse orthogonal transformation.Inverse orthogonal transformation unit 204 will be by the difference of inverse orthogonal transformation
Information is supplied to computing unit 205.In addition, inverse orthogonal transformation unit 204 will be in the processing of its inverse orthogonal transformation applied to each
The orthogonal transformation size of a macro block is supplied to loop filter 207.
Computing unit 205 by the forecast image supplied from selecting unit 214 and by inverse orthogonal transformation difference information phase
Add, and generates decoding image.De-blocking filter 206 removes the block noise for having passed through and being added the decoding image that processing generates.
For by inverse orthogonal transformation unit 204 in inverse orthogonal transformation processing each inverse orthogonal transformation size for applying,
Loop filter 207 is based on the information supplied from inverse orthogonal transformation unit 204 come to each supplied from de-blocking filter 206
Macro block is grouped (category classification), also, loop filter 207 uses the filtering system supplied from lossless decoding unit 202
Number executes filtering processing to each group (classification).
As described in first embodiment, these filter factors are the filter factor meters in picture coding device 100
It calculates and generates and be calculated in this way so that residual error is all the smallest coefficient for each orthogonal transformation size at unit 112.
That is, the filter factor for each orthogonal transformation size is all set to be suitable for its corresponding orthogonal transformation size
Value.
Therefore, caused by loop filter 207 can be reduced due to quantization, cannot be complete by de-blocking filter 206
The block noise and noise of removal.At this point, loop filter 207 executes the noise remove for the local property being suitable in image, because
This can export the decoding image of more high image quality.
Image after filtering processing is supplied to frame memory 210 to be stored as with reference to figure by loop filter 207
Picture, and also export and rearrange buffer 208 to picture.
Picture rearranges buffer 208 and rearranges to image execution.That is, by by the picture in Fig. 1 again
Arrangement buffer 102 is that the sequence for the frame that coding rearranges is rearranged for original display order.D/A converting unit
209 pairs rearrange the image that buffer 208 is supplied from picture and execute D/A conversion, and output it.For example, D/A conversion is single
Member 209 will be exported by executing the output signal that D/A conversion obtains to unshowned display, and show image.
In the case where intraframe coding has been carried out to present frame, intraprediction unit 212 via selecting unit 211 from
Frame memory 210 obtains reference picture and generates forecast image based on the information supplied from lossless decoding unit 202, and
The forecast image of generation is supplied to computing unit 205 via selecting unit 214 by intraprediction unit 212.
In the case where interframe encode has been carried out to present frame, motion prediction/compensating unit 213 is via selecting unit
211 obtain reference picture and based on the motion vector information supplied from lossless decoding unit 202 from frame memory 210 come to this
Reference picture executes motion compensation process, also, motion prediction/compensating unit 213 generates forecast image.Motion prediction/compensation
The forecast image of generation is supplied to computing unit 205 via selecting unit 214 by unit 213.
In the case where intraframe coding has been carried out to current macro, selecting unit 214 is connected to intraprediction unit
212, and it is supplied to computing unit 205 as forecast image the image supplied from intraprediction unit 212.In addition, right
In the case where interframe encode has been carried out in current macro, selecting unit 214 is connected to motion prediction/compensating unit 213, and
It is supplied to computing unit 205 as forecast image the image supplied from motion prediction/compensating unit 213.
Figure 16 is the block diagram of the detailed configuration example of the loop filter 207 in pictorial image 15.
Loop filter 207 is substantially constituted with configuration identical with picture coding device 100, and executes identical place
Reason.As shown in figure 16, loop filter 207 has pixel classifications unit 251, filter unit (4 × 4) 252 and filter unit (8
×8)253。
Pixel classifications unit 251 is executed based on the orthogonal transformation size supplied from inverse orthogonal transformation unit 204 will be from going
The macro block classification (grouping) for the decoding image that blocking filter 206 is supplied is the macro block (4 × 4 that 4 × 4 orthogonal transformations are applied with to it
Orthogonal transform block) and it is applied with 8 × 8 orthogonal transformations macro block (8 × 8 orthogonal transform block) classification.Then, pixel classifications
The information about 4 × 4 orthogonal transform blocks for decoding image is supplied to filter unit (4 × 4) 252 by unit 251, also, will be closed
Filter unit (8 × 8) 253 is supplied in the information of 8 × 8 orthogonal transform blocks.
It is suitable that filter unit (4 × 4) 252 applies 4 × 4 orthogonal transform blocks supplied from lossless decoding unit 202
Filter factor, and to decoding image 4 × 4 orthogonal transform blocks execute filtering processing.
It is suitable that filter unit (8 × 8) 253 applies 8 × 8 orthogonal transform blocks supplied from lossless decoding unit 202
Filter factor, and to decoding image 8 × 8 orthogonal transform blocks execute filtering processing.
The decoding image that have passed through filtering processing is supplied to by filter unit (4 × 4) 252 and filter unit (8 × 8) 253
Picture rearranges buffer 208 and frame memory 210.
Loop filter 207 carries out each of decoding image macro block according to the orthogonal transformation size of macro block as a result,
Classification, and filtering processing is executed using the filter factor for its orthogonal transformation size.These filter factors are via nothing
Loss decoding unit 202 is extracted from coded data, also, as described in through first embodiment, each in order to be suitable for
The image of a orthogonal transformation sized blocks, has produced these filter factors.Therefore, with the ring that is described by first embodiment
The case where path filter 113 identical mode, loop filter 207, which can execute, is suitable for local property possessed by image
Therefore noise remove obtains the decoding image with more high image quality.
[process of processing]
Referring to Fig.1 7 flow chart is described to the example of the process for the decoding process that the picture decoding apparatus 200 executes.
In step s 201, storage buffer 201 stores the image (coded data) of transmission.It is lossless in step S202
Consumption decoding unit 202 extracts filter factor from coded data.Lossless decoding unit 202 also extracts motion vector information, ginseng
Examine frame information, prediction mode information (intraprediction mode information and inter-frame forecast mode information) etc..
In step S203, lossless decoding unit 202 executes lossless decoding process to coded data.In step S204
In, inverse quantization unit 203 is decoded using characteristic corresponding with the characteristic of quantifying unit 105 in Fig. 1 in step S203
Transformation coefficient carry out inverse quantization.In step S205, inverse orthogonal transformation unit 204 is used and the orthogonal transform unit in Fig. 1
The corresponding characteristic of 104 characteristic to carry out inverse orthogonal transformation to transformation coefficient inverse-quantized in step S204.It means that
Through being decoded to the corresponding difference information of input (output of computing unit 103) with the orthogonal transform unit 104 in Fig. 1.
In step S206, intraprediction unit 212 and motion prediction/compensating unit 213 etc. are executed according to prediction mode
Forecast image generation processing, to generate forecast image.The forecast image will be described later generates the details handled.In step S207
In, computing unit 205 is by the forecast image generated in step S206 and by until the decoded difference of the processing of step S205
Information is added.Therefore, original image is decoded.
In step S208, de-blocking filter 206 is filtered the image exported from computing unit 205.Therefore, it removes
Block noise.
In step S209, loop filter 207 is equal to execute loop filtering processing, and also to have passed through at deblocking filtering
The image of reason executes adaptive-filtering processing.Although will describe details later, loop filtering processing is substantially and in Fig. 1
Loop filter 113 execute processing it is identical.
Due to adaptive-filtering processing, it is possible to reduce by deblocking filtering handle the block noise that cannot completely remove and by
The noise caused by quantization.
In step S210, picture rearranges the execution of buffer 208 and rearranges.Specifically, by by the figure in Fig. 1
As the picture of code device 100 rearrange buffer 102 be coding and the sequence of frame that rearranges be rearranged for it is original
Display sequence.
In step S211, D/A converting unit 209 executes D/A conversion to the image rearranged in step S210.It will
The image is exported to unshowned display, also, shows the image.When processing terminate by step S211, decoding process knot
Beam.
Next, the flow chart in referring to Fig.1 8 is described at the forecast image generation executed in the step S206 in Figure 17
The example of the process of reason.
When starting forecast image generation processing, in step S231, lossless decoding unit 202 is based in step S202
The information of the prediction mode of middle extraction etc. determines whether intraframe coding has been carried out to current block.It is in current block
In the case where block through carrying out intraframe coding, intra prediction mode that lossless decoding unit 202 will be extracted from coded data
Information is supplied to intraprediction unit 212, and the process proceeds to step S232.
In step S232, intraprediction unit 212 obtains the intra prediction mode supplied from lossless decoding unit 202
Information.When obtaining inter-frame forecast mode information, in step S233, intraprediction unit 212 is believed based on intra prediction mode
Breath obtains reference picture from frame memory 210 via selecting unit 211, and generates intra-prediction image.It is pre- in frame generating
When altimetric image, which is supplied to 205 conduct of computing unit via selecting unit 214 by intraprediction unit 212
Forecast image.
In addition, in the case where determination has carried out interframe encode to current block in step S231, lossless decoding
Unit 202 by the motion prediction mode extracted from coded data, reference frame, motion vector information etc. be supplied to motion prediction/
Compensating unit 213, also, this process proceeds to step S234.
In step S234, it is pre- that motion prediction/compensating unit 213 obtains the movement supplied from lossless decoding unit 202
Survey mode, reference frame and motion vector information etc..When obtaining the information, in step S235, motion prediction/compensating unit
213 select interpolation filter according to motion vector information, also, in step S236, motion prediction/compensating unit 213 via
Selecting unit 211 obtains reference picture from frame memory 210, and generates inter-prediction image.Generating inter-prediction image
When, which is supplied to computing unit 205 as pre- by motion prediction/compensating unit 213 via selecting unit 214
Altimetric image.
When processing terminate by step S233 or step S236, processing terminate for forecast image generation, this process returns to
Step S206 in Figure 17, also, execute the processing of step S207 and subsequent step.
Next, the flow chart in referring to Fig.1 9 is described the loop filtering executed in the step S209 in Figure 17 processing
The example of process.
When starting loop filtering processing, in step S251,252 He of filter unit (4 × 4) of loop filter 207
Filter unit (8 × 8) 253 obtains each group of filter factor from lossless decoding unit 202.
In step S252, pixel classifications unit 251 obtains the orthogonal transformation of current macro from inverse orthogonal transformation unit 204
Size.Orthogonal transformation size based on acquisition, pixel classifications unit 251 execute category classification to current macro.
In step S253, filter unit (filter unit (4 × 4) 252 corresponding with the orthogonal transformation size of current macro
Or filter unit (8 × 8) 253) using the filter factor obtained in step S251 come to corresponding with the orthogonal transformation size
Current macro executes filtering processing.
In step S254, the filtering processing result of 210 storing step S253 of frame memory.
When processing terminate by step S254, processing terminate for loop filtering, this process returns to the step S209 in Figure 17,
Also, execute the processing of step S210 and subsequent step.
By executing each processing in this way, loop filter 207 executes filtering processing, and it is possible to subtract
The block noise that cannot be completely removed handled by deblocking filtering less and due to noise caused by quantization.
In addition, at this point, loop filter 207 executes filtering processing using the filter factor extracted from coded data.This
A little filter factors have been generated so that residual error is all the smallest coefficient for each orthogonal transformation size of macro block.Loop filter
Wave device 207 uses the filter factor for the orthogonal transformation size to execute at filtering the current macro as processing target
Reason.Therefore, loop filter 207 can execute the noise remove suitable for the local property in image.As a result, image decoding fills
The decoding image with even higher picture quality can be obtained by setting 200.
In addition, orthogonal transformation size is optional in a manner of identical by with first embodiment the case where.Similarly, it answers
The number of orthogonal transformation size is also optional.
Any method can be to the method that macro block is grouped (category classification), as long as it, which corresponds to, produces coded number
According to picture coding device 100 method.In addition, can be with the increment of the processing of filter by frame, or can be by
Piece, or can be in other ways.
<3. 3rd embodiment>
[description of ALF block control]
It note that other than the control of filter factor as described above, BALF (block-based adaptive ring can be used
Road filtering), wherein do not execute loop filtering processing in the region that picture quality is locally deteriorated due to loop filtering.Under
Face will describe BALF.
Decoding image after deblocking filtering processing is shown in the frame 301 of the A in Figure 20.As shown in the B in Figure 20,
Multiple ALF (adaptive loop circuits of the control block of controlling increment as the adaptive-filtering processing served as locally executing
Filtering) block 302 seamlessly arranges, as they are used to be laid with the whole region of frame 301.The region for placing ALF block 302 need not
It is identical as the region of frame 301, but include at least the whole region of frame 301.As a result, the region of frame 301 is by ALF block 302
Region (multiple control areas) segmentation.
For example, the horizontal direction size (four-headed arrow 303) and vertical direction size (four-headed arrow 304) of ALF block 302 can
To be one of 8 × 8,16 × 16,24 × 24,32 × 32,48 × 48,64 × 64,96 × 96 or 128 × 128.It note that finger
The information for determining the size of ALF block will be referred to as block size index.
Once block size is determined, the number of the ALF block of each frame is also just determined, because frame size is fixed
's.
As shown in the C in Figure 20, setting controls whether to execute the filter block of filtering processing in each ALF block 302
Mark 305.For example, generating the filter block mark with the value of " 1 " for the region for improving picture quality by adaptive-filtering
The filtering block mark with the value of " 0 " is arranged in will 305, also, the region for deteriorating picture quality by adaptive-filtering
305.For filtering block mark 305, the value of " 1 " is the value that instruction will execute filtering processing, and the value of " 0 " is that instruction will not execute filter
The value of wave processing.
For each ALF block 302, control whether to execute loop filtering processing based on the value of filtering block mark 305.Example
Such as, loop filter 113 only executes filtering processing at such region: in this region, for filtering block mark
305, ALF blocks 302 have the value of " 1 ", also, loop filter 113 does not execute filtering processing at such region: described
In region, for filtering block mark 305, ALF block 302 has the value of " 0 ".
For example, such ALF block 302 and filtering block mark 305 are arranged at filter factor computing unit 112, also, ring
Path filter 113 executes above-mentioned filtering processing based on the information.
Therefore, loop filter 113 can prevent to execute at the region for locally deteriorating picture quality in filtering processing
Filtering processing, to further increase the picture quality of reference picture.
It note that and the information about ALF block 302 and filtering block mark 305 is added to coded data, and be supplied to
Picture decoding apparatus 200.Therefore, the loop filter 207 of picture decoding apparatus 200 can also according to loop filter 113
Identical mode executes filtering processing, and it is possible to prevent at the region that filtering processing locally will deteriorate picture quality
Execute filtering processing.As a result, can be further improved the picture quality of decoding image.
<4. fourth embodiment>
[description of QALF]
It can have quarter tree structure by the ALF block that 3rd embodiment describes.The technology is referred to as QALF (based on four points
The auto-adaptive loop filter of tree).Quarter tree structure is such layer structure, wherein at next level, a upper level
The region of one AKF block is divided into 4.
Figure 21 illustrates the example divided by quarter tree structure representation ALF block, and in quarter tree structure, the maximum number of plies is 3,
It wherein, is the specified filtering block mark of each ALF block.
A marker 0 in Figure 21, layer 0 act as the ALF block of the root of quarter tree structure.In quarter tree structure, each
ALF block has instruction its block segmentation mark for whether being divided into 4 at next level.ALF block shown in A in Figure 21
The value of block segmentation mark is " 1 ".That is, the ALF block is divided into 4 at next level (layer 1).B in Figure 21 is shown
Layer 1.That is, forming four ALF blocks in layer 1.
In the case where block segmentation mark is " 0 ", more next level is not divided into 4.I.e., it has no further
Segmentation generate filtering block mark also, for the ALF block.That is, the ALF block that block segmentation mark is " 0 " also has
Filter block mark." 0 " on the left side of " 0-1 " shown in the B in Figure 21 indicates the block segmentation mark of the ALF block, also, the right
" 1 " the filtering block mark of the ALF block is shown.
Block segmentation mark in layer 1 is that two ALF blocks of " 1 " are divided into 4 in next level (layer 2).C in Figure 21 shows
Layer 2 out.That is, forming ten ALF blocks in layer 2.
In an identical manner, to the ALF block distribution filtering block mark of the block segmentation mark with " 0 " in layer 2.In Figure 21
In C in, the block segmentation mark of ALF block is " 1 ".That is, the ALF block is divided into 4 at more next level (layer 3)
It is a.D in Figure 21 shows layer 3.That is, forming 13 ALF blocks in layer 3.
Therefore, in the case where quarter tree structure, for each level, the size of ALF block is different.That is, passing through
Using quarter tree structure, the size of ALF block can be made mutually different in the frame.
The control of filtering block mark in each ALF block is identical as 3rd embodiment.That is, in wave block mark
Value be " 0 " region in do not execute filtering processing.
Therefore, in a manner of identical by with 3rd embodiment the case where, loop filter 113 can be prevented will in filtering processing
It locally deteriorates and executes filtering processing at the region of picture quality, to further increase the picture quality of reference picture.
It note that and the information about control block and filtering block mark is added to coded data, and be supplied to image
Decoding apparatus 200.Therefore, the loop filter 207 of picture decoding apparatus 200 can also be according to identical as loop filter 113
Mode execute filtering processing, and it is possible to prevent to execute at the region that filtering processing locally will deteriorate picture quality
Filtering processing.As a result, can be further improved the picture quality of decoding image.
<5. the 5th embodiment>
[personal computer]
A series of above-mentioned processing can be executed by hardware, can also be executed by software.In this case,
For example, as shown in Figure 22, can be used as personal computer to be configured.
In Figure 22, the CPU 501 of personal computer 500 according to the program stored in ROM (read-only memory) 502 or
Person is loaded into the program of RAM (random access memory) 503 from storage unit 513 to execute various processing.When suitable,
RAM 503 also stores data needed for CPU 501 executes various processing etc..
CPU 501, ROM 502 and RAM 503 are connected with each other by bus 504.The bus 504 be also connected to input/it is defeated
Outgoing interface 510.
Be connected to input/output interface 510 is the input unit 511 consisted of a keyboard, a mouse, etc., by such as CRT (yin
Extreme ray pipe) or LCD (liquid crystal display) etc. the compositions such as display, loudspeaker output unit 512, be constituted by hard disk, etc.
Storage unit 513, and the communication unit 514 being made of modem etc..Communication unit 514 is via the net including internet
Network executes communication process.
When necessary, driver 515 is also connected to input/output interface 510, in due course, such as disk,
The removable medium 521 of CD, magneto-optic disk, semiconductor memory or the like is installed on driver 515, also, in necessity
When, the computer program read from the removable medium 521 is installed in storage unit 513.
In the case where executing a series of above-mentioned processing by software, software is constituted from network or recording medium installation
Program.
As shown in Figure 22, for example, the recording medium is not only made of removable medium 521, also by ROM 502, depositing
Hard disk in storage unit 513 etc. is constituted, and removable medium 521 is by disk (including floppy disk), CD (including CD-ROM (compact disk-
Read-only memory), DVD (digital versatile disc), magneto-optic disk (MD (mini-disk))), semiconductor memory etc. constitute, removable
Record and distributing programs in medium 521, dividually to user's distributing programs, in ROM 502, to be stored with device master unit
In hard disk in unit 513 etc., the logging program and to user's distributing programs in the state being previously positioned in device master unit in advance.
The program that note that computer executes can be wherein according to sequence described in this specification according to time series
The program of processing is executed, or can be and wherein concurrently or in the necessary timing for such as executing calling execute the program of processing.
In addition, for this specification, the step of describing the program recorded in the recording medium includes according to description certainly
Processing sequentially performed in time series, and further include concurrently or independently executing without necessarily being carried out with time series
The processing of processing.
In addition, term " system " indicates the whole device being made of multiple devices (device) for this specification.
In addition, the configuration for having described as a device (or processing unit) above can be divided and be configured to it is multiple
Device (or multiple processing units).On the contrary, the configuration for having described as multiple devices (or multiple processing units) above can
To be integrated and be configured to single device (or processing unit).In addition, the configuration in addition to above-mentioned configuration can be added certainly
It is added to device (or processing unit).In addition, a part of the configuration of a certain device (or processing unit) can be contained in it is another
In the configuration of a device (or another processing unit), as long as the configuration and operation of whole system are substantially the same.That is,
The embodiment of the present invention is not limited to the above embodiments, also, can carry out in the case where not departing from essence of the invention
Various modifications.
For example, above-mentioned picture coding device 100 and picture decoding apparatus 200 can be applied to various electronic devices.Under
Face is the description of its example.
<6. sixth embodiment>
[television receiver]
Figure 23 is main configuration example of the diagram using the television receiver for applying picture decoding apparatus 200 of the invention
Block diagram.
Television receiver 1000 shown in Figure 23 includes terrestrial tuner 1013, Video Decoder 1015, vision signal
Processing circuit 1018, graphics generation circuit 1019, panel drive circuit 1020 and display panel 1021.
Terrestrial tuner 1013 receives the broadcast wave signal of terrestrial analog broadcast via antenna, carries out to the broadcast wave signal
Demodulation obtains vision signal, and these vision signals is supplied to Video Decoder 1015.Video Decoder 1015 is to from ground
The vision signal that face tuner 1013 is supplied is decoded processing, and the digital component signal of acquisition is supplied to vision signal
Processing circuit 1018.
Video processing circuit 1018 carries out such as noise remove to the video data supplied from Video Decoder 1015
Deng predetermined process, also, the video data of acquisition is supplied to graphics generation circuit 1019.
Graphics generation circuit 1019 generates the video data for the program that be shown on display panel 1021, or due to base
In will via the processing of the application of network provisioning caused by image data, also, by the video data or image data of generation
It is supplied to panel drive circuit 1020.In addition, graphics generation circuit 1019 also execute such as will by for user generate video counts
The video data obtained according to (figure) is supplied to the processing of panel drive circuit 1020, the video data in due course
Picture of the display for the selection of project etc., and overlapped on the video data of program.
Panel drive circuit 1020 drives display panel 1021 based on the data supplied from graphics generation circuit 1019, with
The video of display program or above-mentioned various pictures on display panel 1021.
Display panel 1021 is made of LCD (liquid crystal display) etc., and aobvious according to the control of panel drive circuit 1020
Show the video etc. of program.
In addition, television receiver 1000 further includes audio A/D (analog/digital) conversion circuit 1014, Audio Signal Processing
Circuit 1022, echo cancellor/audio synthesizing circuitry 1023 and audio-frequency amplifier circuit 1024 and loudspeaker 1025.
Terrestrial tuner 1013 demodulates the broadcast wave signal received, also obtains to not only obtain vision signal
Audio signal.The audio signal of acquisition is supplied to audio A/D conversion circuit 1014 by terrestrial tuner 1013.
The audio A/D conversion circuit 1014 carries out A/D conversion process to the audio signal supplied from terrestrial tuner 1013,
Also, the digital audio and video signals of acquisition are supplied to audio signal processing circuit 1022.
Audio signal processing circuit 1022 carries out such as noise to the audio data supplied from audio A/D conversion circuit 1014
The predetermined process of removal etc., also, the audio data of acquisition is supplied to echo cancellor/audio synthesizing circuitry 1023.
The audio data supplied from audio signal processing circuit 1022 is supplied to by echo cancellor/audio synthesizing circuitry 1023
Audio-frequency amplifier circuit 1024.
Audio-frequency amplifier circuit 1024 carries out D/A to the audio data supplied from echo cancellor/audio synthesizing circuitry 1023
Conversion process amplifies device processing to adjust scheduled volume, then, will export audio from loudspeaker 1025.
In addition, television receiver 1000 further includes digital tuner 1016 and mpeg decoder 1017.
Digital tuner 1016 receives digital broadcasting (received terrestrial digital broadcasting, BS (broadcasting satellite)/CS (communication via antenna
Satellite) digital broadcasting) broadcast wave signal, it is demodulated to obtain MPEG-TS (motion characteristics planning-transport stream),
And it is supplied into mpeg decoder 1017.
Mpeg decoder 1017 descrambles the scrambling for giving the MPEG-TS supplied from digital tuner 1016, and
Extract the stream of the data comprising being used as the program for playing target (viewing target).1017 pairs of mpeg decoder constitute the stream extracted
Audio packet is decoded, and the audio data of acquisition is supplied to video processing circuit 1022, also, also to composition stream
Video packets are decoded, and the video data of acquisition is supplied to video processing circuit 1018.In addition, mpeg decoder
EPG (electronic program guides) data extracted from MPEG-TS are supplied to CPU 1032 via unshowned path by 1017.
Television receiver 1000 uses above-mentioned picture decoding apparatus 200 as in this way to video packets
The mpeg decoder 1017 being decoded.It note that the MPEG-TS from transmission such as broadcasting stations via picture coding device 100
Coding.
In a manner of identical with picture decoding apparatus 200,1017 use of mpeg decoder is supplied from by picture coding device 100
The filter factor that the coded data answered is extracted executes filtering processing to correspond to its orthogonal transformation size to the macro block of decoding image.
Therefore, mpeg decoder 1017 can execute the noise remove suitable for the local property in image.
By with the video data supplied from Video Decoder 1015 the case where it is identical in a manner of, supplied from mpeg decoder 1017
The video data answered passes through predetermined process at video processing circuit 1018, in due course in graphics generation circuit
It is superimposed at 1019 on video data of generation etc., is supplied to display panel 1021 via panel drive circuit 1020, and
And its image is shown on display panel 1021.
By with the audio data supplied from audio A/D conversion circuit 1014 the case where it is identical in a manner of, from mpeg decoder
The audio data of 1017 supplies passes through predetermined process at audio signal processing circuit 1022, synthesizes via echo cancellor/audio
Circuit 1023 is supplied to audio-frequency amplifier circuit 1024, and passes through D/A conversion process and enhanced processing.As a result,
It will be exported with the audio of predetermined volume adjustment from loudspeaker 1025.
In addition, television receiver 1000 also includes microphone 1026 and A/D conversion circuit 1027.
A/D conversion circuit 1027 receives the audio of the user acquired by the microphone 1026 for being supplied to television receiver 1000
Signal is used for audio session, carries out A/D conversion process to the audio signal that receives, also, by the digital audio-frequency data of acquisition
It is supplied to echo cancellor/audio synthesizing circuitry 1023.
In the feelings of the audio data for the user (user A) for supplying television receiver 1000 from A/D conversion circuit 1027
In condition, echo cancellor/audio synthesizing circuitry 1023 executes echo cancellor using the audio data of user (user A) as target, and
And pass through the audio data and other audio datas of synthesis user A from the output of loudspeaker 1025 via audio-frequency amplifier circuit 1024
Deng and obtain audio data.
In addition, television receiver 1000 further includes audio codec 1028, internal bus 1029, SDRAM (synchronous dynamic
Random access memory) 1030, flash memory 1031, CPU 1032, USB (universal serial bus) I/F 1033 and network I/
F 1034。
A/D conversion circuit 1027 receives the audio of the user acquired by the microphone 1026 for being supplied to television receiver 1000
Signal is used for audio session, carries out A/D conversion process to the audio signal that receives, also, by the digital audio-frequency data of acquisition
It is supplied to audio codec 1028.
The audio data supplied from A/D conversion circuit 1027 is converted to the data of predetermined format by audio codec 1028
To be supplied to network I/F 1034 via internal bus 1029 via transmission of network, also, by it.
Network I/F 1034 is via the cable and network connection being mounted in network terminal 1035.For example, network I/F
The audio data supplied from audio codec 1028 is transmitted to another device being connected to the network with it by 1034.In addition, for example,
Network I/F 1034 is received via network terminal 1035 from the audio data transmitted via network another device connected to it, and
And it is supplied to audio codec 1028 via internal bus 1029.
The audio data supplied from network I/F 1034 is converted to the data of predetermined format by audio codec 1028, and
And it is supplied into echo cancellor/audio synthesizing circuitry 1023.
Echo cancellor/audio synthesizing circuitry 1023 is being taken as target with the audio data supplied from audio codec 1028
In the case where execute echo cancellor, also, via audio-frequency amplifier circuit 1024 from the output of loudspeaker 1025 by synthesizing the sound
The data of the audio of the acquisitions such as frequency evidence and other audio datas.
SDRAM 1030 stores various data needed for CPU 1032 executes processing.
Flash memory 1031 stores the program to be executed by CPU 1032.By such as activating television receiver 1000
Deng predetermined timing the program that stores in flash memory 1031 is read by CPU 1032.The EPG obtained via digital broadcasting
Data are also stored in flash memory 1031 via network from data that book server obtains etc..
For example, the MPEG- of the content-data obtained via network from book server comprising the control by CPU 1032
TS is stored in flash memory 1031.For example, by the control of CPU1032, via internal bus 1029, flash memory
Its MPEG-TS is supplied to mpeg decoder 1017 by 1031.
It is handled in a manner of mpeg decoder 1017 is identical by with the MPEG-TS supplied from digital tuner 1016 the case where
Its MPEG-TS.In this way, television receiver 1000 receives the content-data being made of video, audio etc. via network,
It is decoded using mpeg decoder 1017, so as to show its video, and it is possible to export its audio.
In addition, television receiver 1000 is also comprising the light-receiving list for receiving the infrared signal emitted from remote controler 1051
Member 1037.
Light receiving unit 1037 indicates user's from 1051 receiving infrared-ray of remote controler, also, by what is obtained by demodulation
The control routine of the content of operation is exported to CPU 1032.
CPU 1032 is executed according to control routine supplied from light receiving unit 1037 etc. and is deposited in flash memory 1031
The program of storage, to control the whole operation of television receiver 1000.Each unit of CPU1032 and television receiver 1000 via
Unshowned path connection.
USB I/F 1033 is to the television receiver 1000 via the USB cable connection being mounted on USB terminal 1036
Transmission/reception of external device (ED) execution data.Network I/F 1034 is via the cable and network being mounted in network terminal 1035
Connection also executes transmission/reception of the data in addition to audio data to various devices connected to the network.
Television receiver 1000 can be suitable for by using picture decoding apparatus as mpeg decoder 1017 to execute
The noise remove of local property in image.As a result, television receiver 1000 can from through broadcast singal received by antenna or
Person obtains more high image quality decoding image via the content-data that network obtains.
<7. the 7th embodiment>
[cellular phone]
Figure 24 is master of the diagram using the cellular phone for applying picture coding device and picture decoding apparatus of the invention
Want the block diagram of configuration example.
Cellular phone 1100 shown in Figure 24 includes the main control unit for being configured as integrally controlling each unit
1150, power circuit unit 1151, operation input control unit 1152, image encoder 1153, Camera IO/F cell 1154,
LCD control unit 1155, image decoder 1156, multiplexing/separative unit 1157, record/broadcast unit 1162, modulation/
Demodulator circuit unit 1158 and audio codec 1159.These units are connected with each other via bus 1160.
In addition, cellular phone 1100 includes operation key 1119, CCD (charge-coupled device) camera 1116, liquid crystal display
Device 1118, storage unit 1123, transmission/reception circuit unit 1163, antenna 1114, microphone (MIC) 1121 and loudspeaker
1117。
In end of calling and when powering on key by the operation of user, power circuit unit 1151 by from battery pack to
Each unit is powered to activate the cellular phone 1100 in mode of operation.
Based on the control for the main control unit 1150 being made of CPU, ROM, RAM etc., in such as voice call mode, data
In the various modes of communication pattern etc., cellular phone 1100 executes various operations, for example, transmission/reception of audio signal, electronics
Transmission/reception of mail and image data, image taking, data record etc..
For example, cellular phone 1100 will be by microphone (words by audio codec 1159 in voice call mode
Cylinder) 1121 collect audio signals be converted to digital audio-frequency data, spectrum expansion is carried out to it at modulation/demodulation circuit unit 1158
Exhibition processing, also, digital-to-analog conversion process and frequency conversion process are carried out to it at transmission/reception circuit unit 1163.
Cellular phone 1100 sends unshowned base via antenna 1114 for the signal for being used to send obtained by its conversion process
It stands.The signal (audio signal) for being used to send for being sent to base station is supplied to the honeycomb electricity of another party via public phone network
Words.
In addition, for example, in voice call mode, cellular phone 1100 at transmission/reception circuit unit 1163 to
Received reception signal amplifies at antenna 1114, further carries out at frequency conversion process and analog/digital conversion to it
Reason, carries out composing to it at modulation/demodulation circuit unit 1158 inverse extension process, and by audio codec 1159 by its
Be converted to analog audio signal.Cellular phone 1100 exports the analog audio signal that the sum that it is converted obtains from loudspeaker 1117.
In addition, for example, cellular phone 1100 is defeated in operation in the case where sending Email in data communication mode
Enter the text data for the Email that receiving is inputted by the operation of operation key 1119 at control unit 1152.Cellular phone
1100 handle its text data at main control unit 1150, and show via LCD control unit 1155 as image
On liquid crystal display 1118.
In addition, cellular phone 1100 is based on the text data received by operation input control unit 1152, the instruction of user
Deng the generation e-mail data at main control unit 1150.Cellular phone 1100 is at modulation/demodulation circuit unit 1158 pair
Its e-mail data carries out spectrum extension process, and carries out digital-to-analog to it at transmission/reception circuit unit 1163 and turn
Change processing and frequency conversion process.Cellular phone 1100 is by the signal for being used to send obtained by its conversion process via antenna
1114 are sent to unshowned base station.The signal (Email) for being used to send for being sent to base station is taken via network, mail
Business device etc. is supplied to scheduled destination.
In addition, for example, when in data communication mode receive Email in the case where, cellular phone 1100 with send/
Receiving circuit unit 1163 receives the signal that sends via antenna 1114 from base station, amplifies to the signal, also, to its into
One stepping line frequency conversion process and analog/digital conversion processing.Cellular phone 1100 is at modulation/demodulation circuit unit 1158
It receives signal to it to carry out composing inverse extension process, to restore original electronic mail data.Cellular phone 1100 controls single via LCD
Member 1155 shows the e-mail data of recovery on liquid crystal display 1118.
It note that cellular phone 1100 can record in storage unit 1123 via record/broadcast unit 1162 (to deposit
Storage) e-mail data that receives.
The storage unit 1123 is optional rewritable recording medium.Storage unit 1123 can be such as RAM, interior
The semiconductor memory for setting flash memory etc. can be hard disk, or can be such as disk, magneto-optic disk, CD, USB and deposit
The removable medium of reservoir, memory card etc..Much less, storage unit 1123 can be storage device in addition to these.
In addition, for example, when in data communication mode transmit image data in the case where, cellular phone 1100 by
Imaging is at CCD camera 1116 to generate image data.CCD camera 1116 includes the optics as camera lens, aperture etc.
The intensity-conversion of the light received is electric signal by device and the CCD that subject is imaged for being used as photoelectric conversion device,
And generate the image data of the image of subject.CCD camera 1116 is via Camera IO/F cell 1154 in image encoder
Compressed encoding is executed to image data at 1153, and is converted to the image data of coding.
Cellular phone 1100 is using above-mentioned picture coding device 100 as the image encoder for executing this processing
1153.Therefore, in a manner of identical with picture coding device 100, image encoder 1153, which can execute, to be suitable in image
The noise remove of local property.
It note that at this point, simultaneously, while being shot with CCD camera 1116, cellular phone 1100 is in audio coding decoding
Analog to digital conversion is carried out to the audio collected at microphone (microphone) 1121 at device 1159, and further it is carried out
Coding.
Cellular phone 1100 is using scheduled method to from image encoder 1153 at multiplexing/separative unit 1157
The coded image data of supply and from audio codec 1159 supply digital audio-frequency data multiplexed.Cellular phone
1100 carry out spectrum extension process to the multiplexed data obtained as its result at modulation/demodulation circuit unit 1158, and
And digital-to-analog conversion process and frequency conversion process are carried out to it at transmission/reception circuit unit 1163.Cellular phone
1100 send unshowned base station via antenna 1114 for the signal for being used to send obtained by its conversion process.It will send
The signal (picture signal) for transmission to base station is supplied to other sides via network etc..
It note that in the case where not transmitting image data, cellular phone 1100 can also be via LCD control unit 1155
Rather than image encoder 1153 is shown in the image data generated at CCD camera 1116 on liquid crystal display 1118.
In addition, for example, working as the data for the motion pictures files that reception and simple website etc. link in data communication mode
In the case where, cellular phone 1100 receives the letter sent from base station via antenna 1114 at transmission/reception circuit unit 1163
Number, which is amplified, also, its further progress frequency conversion process and analog/digital conversion are handled.Honeycomb electricity
Words 1100 compose inverse extension process to the signal received at modulation/demodulation circuit unit 1158, to restore original more
Road multiplex data.Its multiplexed data is separated into coding at multiplexing/separative unit 1157 by cellular phone 1100
Image data and audio data.
Cellular phone 1100 is decoded the image data of coding at image decoder 1156, to generate broadcasting fortune
Video data, and the playing moving images data are shown on liquid crystal display 1188 via LCD control unit 1155.Cause
This, for example, showing the moving image number for including in the motion pictures files with simple web site url on liquid crystal display 1118
According to.
Cellular phone 1100 is using above-mentioned picture decoding apparatus 200 as the image decoder for executing this processing
1156.Therefore, in a manner of identical with picture decoding apparatus 200, image decoder 1156, which can execute, to be suitable in image
The noise remove of local property.
At this point, simultaneously, digital audio-frequency data is converted to analog audio at audio codec 1159 by cellular phone 1100
Frequency signal, and it is exported from loudspeaker 1117.Thus, for example, playing in the motion pictures files with simple web site url
The audio data for including.
Note that it is identical by with Email the case where in a manner of, cellular phone 1100 can be via record/broadcast unit
1162 by the data record (storage) received linked with simple website etc. in storage unit 1123.
In addition, two dimension of the cellular phone 1100 at main control unit 1150 to the imaging obtained by CCD camera 1116
Code is analyzed, it is hereby achieved that the information recorded in 2 d code.
In addition, infrared ray can be used at infrared communication unit 1181 and communication with external apparatus in cellular phone 1100.
Cellular phone 1100 can execute suitable in this way using picture coding device 100 as image encoder 1153
Together in the noise remove of the local property in image.As a result, cellular phone 1100 can obtain the ginseng with more high image quality
Examine image.Thus, for example, picture quality can be made to become the decoding image obtained and being decoded to coded data
Height, the coded data are generated and encoding to the image data generated at CCD camera 1116.
In addition, cellular phone 1100 is using picture decoding apparatus 200 as image decoder 1156, also, in this way can be with
Execute the noise remove for the local property being suitable in image.For example, as a result, cellular phone 1100 can be from being linked to
The data (coded data) of the motion pictures files of simple website etc. obtain higher-quality decoding image.
It note that and such description has been carried out so far: where cellular phone 1100 utilizes CCD camera
1116, still, cellular phone 1100 can use the imaging sensor (CMOS using CMOS (complementary metal oxide semiconductor)
Imaging sensor) replace the CCD camera 1116.In this case, with using CCD camera 1116 the case where, is identical
Mode, cellular phone 1100 can also be imaged to subject and be generated the image data of the image of subject.
It is described in addition, being directed to cellular phone 1100 so far, still, with the feelings with cellular phone 1100
The identical mode of condition, picture coding device 100 and picture decoding apparatus 200 can be adapted for any kind of device, as long as
It is the device with identical with the imaging function of cellular phone 1100 and communication function imaging function and communication function, example
Such as, PDA (personal digital assistant), smart phone, UMPC (super mobile personal computer), network sheet (net book), notebook
Type personal computer etc..
<8. the 8th embodiment>
[hdd recorder]
Figure 25 is that diagram uses the hdd recorder for applying picture coding device and picture decoding apparatus of the invention
The block diagram of main configuration example.
Hdd recorder shown in Figure 25 (HDD logger) 1200 is devices which that the device is in built-in hard disk
The broadcast that middle storage is received by tuner and includes from the broadcast wave signal (TV signal) of the transmissions such as satellite or ground-plane antenna
The audio data and video data of program, also, the data of storage are provided a user in the timing indicated according to user.
For example, hdd recorder 1200 can be from broadcast wave signal extraction audio data and video data, when appropriate
Time is decoded these audio datas and video data, and stores it in built-in hard disk.In addition, for example, hard disk
Logger 1200 can also obtain audio data and video data from another device via network, in due course to these sounds
Frequency evidence and video data are decoded, and are stored it in built-in hard disk.
In addition, for example, hdd recorder 1200 can be to the audio data and video data recorded in built-in hard disk
It is decoded, is supplied into monitor 1260, show its image on the screen of monitor 1260, and from monitor 1260
Loudspeaker export its audio.In addition, for example, hdd recorder 1200 can be to from the broadcast wave signal obtained via tuner
The audio data and video data of extraction or the audio data and video data obtained via network from another device are solved
Code, is supplied into monitor 1260, shows its image on the screen of monitor 1260, and from the loudspeaking of monitor 1260
Device exports its audio.
Of course, it is possible to execute the operation in addition to these operations.
As shown in figure 25, hdd recorder 1200 include receiving unit 1221, demodulating unit 1222, demultiplexer 1223,
Audio decoder 1224, Video Decoder 1225 and logger control unit 1226.Hdd recorder 1200 further includes EPG data
Memory 1227, program storage 1228, working storage 1229, display converter 1230, OSD (showing on screen) control are single
Member 1231, display control unit 1232, record/broadcast unit 1233, D/A converter 1234 and communication unit 1235.
In addition, display converter 1230 includes video encoder 1241.Record/broadcast unit 1233 includes encoder 1251
With decoder 1252.
Receiving unit 1221 receives infrared signal from remote controler (not shown), is converted into electric signal, and export and give
Logger control unit 1226.Logger control unit 1226 is made of such as microprocessor etc., also, according to being stored in program
Program in memory 1228 executes various processing.At this point, logger control unit 1226 uses working storage as needed
1229。
Communication unit 1235 connected to the network executes communication process via network and another device.For example, communication unit
1235 are controlled by logger control unit 1226, to communicate with tuner (not shown) also, mainly export channel to tuner
Selection control signal.
Demodulating unit 1222 demodulates the signal supplied from tuner, and exports to demultiplexer 1223.It demultiplexes
It by the data separating supplied from demodulating unit 1222 is audio data, video data and EPG data with device 1223, and defeated respectively
Out to audio decoder 1224, Video Decoder 1225 and logger control unit 1226.
The audio data of 1224 pairs of audio decoder inputs is decoded, and is exported to record/broadcast unit 1233.Depending on
The video data of 1225 pairs of frequency decoder inputs is decoded, and is exported to display converter 1230.Logger control unit
The EPG data of input is supplied to EPG data storage 1227 to store by 1226.
Display converter 1230 will be from Video Decoder 1225 or logger control unit using video encoder 1241
The video data encoding of 1226 supplies is the video data for for example meeting NTSC (National Television Standards Committee) format, and defeated
Record/broadcast unit 1233 is given out.In addition, display converter 1230 will be from Video Decoder 1225 or logger control unit
The size conversion of the picture of the video data of 1226 supplies is the size of the size corresponding to monitor 1260, also, uses view
The video data that its screen size has been converted is converted to the video data for meeting NTSC format by frequency encoder 1241, conversion
For analog signal, and it is output to display control unit 1232.
Under the control of logger control unit 1226, display control unit 1232 will be controlled from OSD (showing on screen)
The osd signal that unit 1231 exports is overlapped from the vision signal that display converter 1230 inputs, and is exported to monitor
1260 display is to show.
In addition, the audio data exported from audio decoder 1224 is converted into analog signal using D/A converter 1234,
And it is supplied into monitor 1260.Monitor 1260 exports the audio signal from built-in loudspeaker.
Record/broadcast unit 1233 includes hard disk, there is the recording medium of video data, audio data etc. as record.
Record/broadcast unit 1233 compiles the audio data supplied from audio decoder 1224 by encoder 1251
Code.In addition, record/broadcast unit 1233 is supplied by encoder 1251 from the video encoder 1241 of display converter 1230
Video data encoded.Record/broadcast unit 1233 using multiplexer synthesize its audio data coded data and
The coded data of its video data.The data that record/broadcast unit 1233 is synthesized by channel coding amplification, and via record
Its data is written in a hard disk head.
Record/broadcast unit 1233 plays the data recorded in a hard disk via playback head, amplifies the data, also, make
Audio data and video data are separated into demultiplexer.Record/broadcast unit 1233 passes through decoding using mpeg format
Device 1252 is decoded audio data and video data.Record/broadcast unit 1233 carries out number to decoded audio data
To the conversion of simulation, and export to the loudspeaker of monitor 1260.In addition, record/broadcast unit 1233 is to decoded video
Data carry out the conversion of digital to analogy, and export to the display of monitor 1260.
Logger control unit 1226 via the received infrared signal from remote controler of receiving unit 1221 based on by referring to
The instruction of the user shown reads newest EPG data from EPG data storage 1227, and is supplied to OSD control unit 1231.
OSD control unit 1231 generates the image data for corresponding to the EPG data of input, and exports to display control unit 1232.
Display control unit 1232 by the video data inputted from OSD control unit 1231 export the display to monitor 1260 so as to
Display.Therefore, EPG (electronic program guides) is shown on the display of monitor 1260.
In addition, hdd recorder 1200 can be obtained via the network of internet etc. from the various of another device provisioning
Data, for example, video data, audio data, EPG data etc..
Communication unit 1235 is controlled by logger control unit 1226, with obtain transmit via network from another device it is all
Such as coded data of video data, audio data, EPG data, and it is supplied into logger control unit 1226.Example
Such as, the coded data of the video data of acquisition and audio data is supplied to record/broadcast unit by logger control unit 1226
1233, and store it in hard disk.At this point, logger control unit 1226 and record/broadcast unit 1233 can bases
Need to be implemented the processing recompiled etc..
In addition, the coded data of 1226 pairs of the logger control unit video datas obtained and audio data is decoded,
And the video data of acquisition is supplied to display converter 1230.With with the video data phase supplied from Video Decoder 1225
Same mode, display converter 1230 handles the video data supplied from logger control unit 1226, via display
Control unit 1232 is supplied to monitor 1260, to show its image.
Alternatively, such arrangement can be carried out: where shown according to the image, logger control unit 1226 will decode
Audio data be supplied to monitor 1260 via D/A converter 1234, and export its audio from loudspeaker.
In addition, the coded data of the EPG data of 1226 pairs of logger control unit acquisitions is decoded, also, will decoding
EPG data be supplied to EPG data storage 1227.
The hdd recorder 1200 being configured so that is using picture decoding apparatus 200 as Video Decoder 1225, decoder
1252 and the decoder that is contained in logger control unit 1226.Therefore, in a manner of identical with picture decoding apparatus 200,
Video Decoder 1225, decoder 1252 and the decoder being contained in logger control unit 1226 can execute and be suitable for figure
The noise remove of local property as in.
Therefore, hdd recorder 1200 can execute the noise remove suitable for the local property in image.As a result, example
Such as, hdd recorder 1200 can be from the video data (coded data) and note received via tuner or communication unit 1235
It records the video data (coded data) recorded in the hard disk of record/broadcast unit 1233 and obtains higher-quality decoding image.
In addition, hdd recorder 1200 is using picture coding device 100 as encoder 1251.Therefore, to be compiled with image
The code identical mode of device 100, encoder 1251 can execute the noise remove for the local property being suitable in image.
Therefore, hdd recorder 1200 can execute the noise remove suitable for the local property in image.As a result, example
Such as, hdd recorder 1200 can make the picture quality of the decoding image of the coded data recorded in a hard disk higher.
It note that so far to the hdd recorder for recording video data and audio data in a hard disk
1200 are described, and still, much less, can use any kind of recording medium.For example, even for applying such as
The logger of the recording medium in addition to hard disk of flash memory, CD, video tape etc., with above-mentioned hdd recorder
1200 the case where identical mode, picture coding device 100 and picture decoding apparatus 200 also can be applied to this.
<9. the 9th embodiment>
[camera]
Figure 26 is that diagram uses the main of the camera for applying picture coding device and picture decoding apparatus of the invention
The block diagram of configuration example.
Subject is imaged in camera 1300 shown in Figure 26, and the image of subject is shown on LCD 1316,
And as Imagery Data Recording in recording medium 1333.
Light (that is, picture of subject) is input to CCD/CMOS 1312 by block of lense 1311.CCD/CMOS 1312 is benefit
It is electric signal by the intensity-conversion of the light received with the imaging sensor of CCD or CMOS, and is supplied to camera signal
Processing unit 1313.
The electric signal supplied from CCD/CMOS 1312 is converted to the color of Y, Cr and Cb by camera signal processing unit 1313
Difference signal, and it is supplied to image signal processing unit 1314.Under the control of controller 1321, image signal processing unit
1314 pairs of picture signals supplied from camera signal processing unit 1313 carry out scheduled image procossing, alternatively, using for example
Mpeg format encodes its picture signal by encoder 1341.Image signal processing unit 1314 will be by believing image
Number coded data for being encoded and being generated is supplied to decoder 1315.In addition, the acquisition of image signal processing unit 1314 is being shielded
The data for display generated at (OSD) 1320 are shown on curtain, and are supplied into decoder 1315.
For above-mentioned processing, camera signal processing unit 1313 utilizes as suitably desired to be connected via bus 1317
The DRAM (dynamic random access memory) 1318 connect is kept by image data, from coded data of its coded image data etc.
In its DRAM 1318.
Decoder 1315 is decoded the coded data supplied from image signal processing unit 1314, also, will obtain
Image data (decoding image data) be supplied to LCD 1316.In addition, decoder 1315 will be from image signal processing unit
The data for display of 1314 supplies are supplied to LCD 1316.LCD 1316 is synthesized in due course to be supplied from decoder 1315
The image for the data for display answered and the image of decoding image data, and show its composograph.
Show that 1320 will be by such as menu of symbol, character or figure constitution under the control of controller 1321, on screen
The data for display of picture or icon etc. are output to image signal processing unit 1314 via bus 1317.
Signal based on the content that instruction is ordered by user using operating unit 1322, control unit 1321 execute various places
Reason, also, also control via bus 1314 image signal processing unit 1314, DRAM 1318, external interface 1319, on screen
Display 1320, media drive 1323 etc..Procedure, data needed for executing various processing for controller 1321 etc. is stored in sudden strain of a muscle
In fast ROM 1324.
For example, controller 1321 can replace image signal processing unit 1314 and decoder 1315 to being stored in DRAM
Image data in 1318 is encoded, or is decoded to the coded data being stored in DRAM 1318.At this point, control
Device 1321 can be used format identical with the coding and decoding format of image signal processing unit 1314 and decoder 1315 and hold
Row coding and decoding processing, alternatively, the lattice that image signal processing unit 1314 and decoder 1315 cannot all be handled can be used
Formula is handled to execute coding/decoding.
In addition, for example, in the case where image prints since indicating operating unit 1322, controller 1321 is from DRAM
1318 read image datas, and be supplied into via bus 1317 printer 1334 that is connect with external interface 1319 so as to
Printing.
In addition, for example, in the case where indicating image recording from operating unit 1322, controller 1321 is from DRAM
1318 read coded data, and the recording medium being mounted on media drive 1323 is supplied into via bus 1317
1333 to store.
Recording medium 1333 is optional readable/writeable removable medium, for example, disk, magneto-optic disk, CD, partly leading
Body memory etc..Much less, about the type of removable medium, recording medium 1333 be also it is optional, as such, it can be that band
Device perhaps can be disk or can be memory card.Much less, recording medium 1333 can be non-contact IC card etc..
Alternatively, media drive 1323 and recording medium 1333, which can be configured as, is integrated in non-portabillity recording medium
In, the non-portabillity recording medium is, for example, built-in hard disk drive, SSD (solid state drive) etc..
External interface 1319 is made of such as USB input/output terminal etc., and execute image printing in the case where with
Printer 1334 connects.In addition, driver 1331 is connect with external interface 1319 as needed, such as disk, CD or magneto-optic
The removable medium 1332 of disk is mounted in due course, also, the computer program being read out from is as needed
It is installed in flash ROM 1324.
In addition, external interface 1319 includes the network interface to connect with the predetermined network of LAN, internet etc..Example
Such as, according to the instruction from operating unit 1322, controller 1321 can read coded data from DRAM 1318, and by its
Another device connected via a network is supplied to from external interface 1319.In addition, controller 1321 can be via external interface
1319 obtain via network from the coded data or image data of another device provisioning, and hold it in DRAM 1318,
Alternatively, being supplied into image signal processing unit 1314.
The camera 1300 being configured so that is using picture decoding apparatus 200 as decoder 1315.Therefore, with image solution
The code identical mode of device 200, decoder 1315 can execute the noise remove for the local property being suitable in image.
Therefore, camera 1300 can execute the noise remove suitable for the local property in image.As a result, camera
1300 can read from the image data generated for example at CCD/CMOS 1312, from DRAM 1318 or recording medium 1333
The coded data of video data and the coded data of the video data obtained via network obtain the solution with more high image quality
Code image.
In addition, camera 1300 is using picture coding device 100 as encoder 1341.Therefore, it is filled with being encoded with image
100 identical modes are set, encoder 1341 can execute the noise remove for the local property being suitable in image.
Therefore, camera 1300 can execute the noise remove suitable for the local property in image.As a result, camera
1300 coded datas that can make the coded data recorded in DRAM 1318 or recording medium 1333 and be supplied to other devices
Decoding image picture quality it is higher.
It note that the coding/decoding method of picture decoding apparatus 200 can be applied to the decoding process of the execution of controller 1321.
In an identical manner, the coding method of picture coding device 100 can be applied to the coded treatment of the execution of controller 1321.
In addition, the image data that camera 1300 is shot can be moving image, or it can be static image.
Certainly, picture coding device 100 and picture decoding apparatus 200 can be applied to the device in addition to above-mentioned apparatus
Or system.
In addition, the size of macro block is not limited to 16 × 16 pixels.For example, can be applied to the macro block of various sizes, for example,
The macro block of 32 × 32 pixels shown in Figure 10.
Although being described in the case where being multiplexed (description) to filter factor etc. with bit stream above,
It is, for example, filter factor and image data (or bit stream) can also be transmitted (record) other than being multiplexed.Filter
The form that wave system number and image data (or bit stream) are linked (being added) can also carry out.
State (the associated shape that link (addition) instruction image data (or bit stream) and filter factor interlink
State), also, physical relationship is optional.For example, image data (or bit stream) and filter factor can be by dividing
From transmitting path transmitted.In addition, image data (or bit stream) and filter factor can be recorded in the record of separation
In medium (or in the isolated record area in identical recording medium).It note that (or the bit for example, image data
Stream) and filter factor link increment be optional, and it is possible to according to increment (frame, multiframe etc.) quilt of coded treatment
Setting.
Reference signs list
100 picture coding devices
112 filter factor computing units
113 loop filters
151 orthogonal transformation size buffers
152 decoding image classification units
153 input picture taxons
154 4 × 4 pieces of coefficient calculation units
155 8 × 8 pieces of coefficient calculation units
161 pixel classifications units
162 filter units (4 × 4)
163 filter units (8 × 8)
200 picture decoding apparatus
202 lossless decoding units
204 inverse orthogonal transformation units
207 loop filters
212 intraprediction units
213 motion predictions/compensating unit
251 pixel classifications units
252 filter units (4 × 4)
253 filter units (8 × 8)
Claims (12)
1. a kind of image processing method, comprising:
Image is encoded to generate coded image；
The coded image is decoded to generate decoding image；And
Using the tap number of filter factor filtering processing is executed to the decoding image, wherein based on executing to described image
At least one planarization of the orthogonal transformation size and the decoding image that use in orthogonal transformation processing comes while filter is arranged
The tap number of wave system number and filter factor.
2. image processing method according to claim 1, wherein the orthogonal transformation size is bigger, the filter factor
Tap number be just arranged more and the orthogonal transformation size is smaller, the tap number of the filter factor is just arranged more
It is few.
3. image processing method according to claim 1, further includes:
Based on orthogonal transformation size, the filter factor is calculated using described image and the decoding image；
Wherein, the filtering processing is executed using the filter factor.
4. image processing method according to claim 1, further includes:
Orthogonal transformation, quantization, inverse quantization and inverse orthogonal transformation are executed to described image.
5. image processing method according to claim 1, wherein described in a part of image execution to the decoding image
Filtering processing.
6. image processing method according to claim 1, wherein execute the filtering processing using Wiener filter.
7. a kind of image processing apparatus, comprising:
Coding unit is configured as encoding to generate coded image image；
Decoding unit is configured as being decoded the coded image to generate decoding image；And
Filter processing unit, the tap number for being configured with filter factor execute filtering processing to the decoding image, wherein
At least one based on the orthogonal transformation size and the decoding image that are used in the orthogonal transformation processing executed to described image
A planarization comes while the tap number of the filter factor and the filter factor is arranged.
8. image processing apparatus according to claim 7, wherein the orthogonal transformation size is bigger, the filter factor
Computing unit be just arranged more filter factors tap number and the orthogonal transformation size it is smaller, filtering system
The tap number of fewer filter factor is just arranged in number computing unit.
9. image processing apparatus according to claim 7, wherein
The filter factor computing unit is additionally configured to use described image and the decoding image based on orthogonal transformation size
Calculate the filter factor；
Wherein, the filter processing unit executes the filtering processing using the filter factor.
10. image processing apparatus according to claim 7, further includes:
Orthogonal transform unit is configured as executing orthogonal transformation to described image；
Quantifying unit is configured as executing quantization to the image Jing Guo orthogonal transformation；
Inverse quantization unit is configured as executing inverse quantization to the image by quantization；With
Inverse orthogonal transformation unit is configured as executing inverse orthogonal transformation to by inverse-quantized image.
11. image processing apparatus according to claim 9, wherein the filter processing unit is to the decoding image
A part of image executes the filtering processing.
12. image processing apparatus according to claim 7, wherein the filter processing unit is held using Wiener filter
The row filtering processing.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009195317A JP2011049740A (en) | 2009-08-26 | 2009-08-26 | Image processing apparatus and method |
| JP2009-195317 | 2009-08-26 | ||
| CN201080036453.XA CN102484714B (en) | 2009-08-26 | 2010-08-18 | Image processing device and method |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201080036453.XA Division CN102484714B (en) | 2009-08-26 | 2010-08-18 | Image processing device and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104602002A CN104602002A (en) | 2015-05-06 |
| CN104602002B true CN104602002B (en) | 2019-04-16 |
Family
ID=43627789
Family Applications (5)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510023087.9A Expired - Fee Related CN104601995B (en) | 2009-08-26 | 2010-08-18 | Image processing apparatus and method |
| CN201080036453.XA Expired - Fee Related CN102484714B (en) | 2009-08-26 | 2010-08-18 | Image processing device and method |
| CN201510021614.2A Active CN104601994B (en) | 2009-08-26 | 2010-08-18 | Image processing apparatus and method |
| CN201510023106.8A Active CN104618716B (en) | 2009-08-26 | 2010-08-18 | Image processing apparatus and method |
| CN201510025568.3A Active CN104602002B (en) | 2009-08-26 | 2010-08-18 | Image processing apparatus and method |
Family Applications Before (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510023087.9A Expired - Fee Related CN104601995B (en) | 2009-08-26 | 2010-08-18 | Image processing apparatus and method |
| CN201080036453.XA Expired - Fee Related CN102484714B (en) | 2009-08-26 | 2010-08-18 | Image processing device and method |
| CN201510021614.2A Active CN104601994B (en) | 2009-08-26 | 2010-08-18 | Image processing apparatus and method |
| CN201510023106.8A Active CN104618716B (en) | 2009-08-26 | 2010-08-18 | Image processing apparatus and method |
Country Status (12)
| Country | Link |
|---|---|
| US (3) | US9992516B2 (en) |
| EP (1) | EP2472870A4 (en) |
| JP (1) | JP2011049740A (en) |
| KR (2) | KR101901087B1 (en) |
| CN (5) | CN104601995B (en) |
| AU (1) | AU2010287688B2 (en) |
| BR (1) | BR112012003855B1 (en) |
| CA (2) | CA2970080C (en) |
| MX (1) | MX2012002070A (en) |
| RU (1) | RU2533444C2 (en) |
| TW (1) | TWI435610B (en) |
| WO (1) | WO2011024684A1 (en) |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011151431A (en) | 2009-12-25 | 2011-08-04 | Sony Corp | Image processing apparatus and method |
| JPWO2012131895A1 (en) * | 2011-03-29 | 2014-07-24 | 株式会社東芝 | Image coding apparatus, method and program, image decoding apparatus, method and program |
| TWI455062B (en) * | 2011-04-26 | 2014-10-01 | Univ Nat Cheng Kung | Method for 3d video content generation |
| WO2012153538A1 (en) * | 2011-05-11 | 2012-11-15 | Panasonic Corporation | Methods for encoding and decoding video using an adaptive filtering process |
| WO2012169054A1 (en) * | 2011-06-09 | 2012-12-13 | 株式会社東芝 | Video coding method and device, and video decoding method and device |
| CN102831132B (en) * | 2011-06-13 | 2016-05-25 | 英华达（南京）科技有限公司 | Can on electronic installation, show fast storage method and the electronic installation thereof of digitized map file |
| KR102166220B1 (en) * | 2011-06-28 | 2020-10-15 | 소니 주식회사 | Image processing device and image processing method |
| CN106713914B (en) | 2011-06-30 | 2021-06-01 | 三菱电机株式会社 | Image encoding device and method, image decoding device and method |
| PL231161B1 (en) * | 2011-10-17 | 2019-01-31 | Kt Corp | Method for adaptive transformation based on the on-screen forecasting and the device using this method |
| KR101462052B1 (en) * | 2011-11-09 | 2014-11-20 | 에스케이 텔레콤주식회사 | Video Coding Method and Apparatus using Transform Based Fraquency Domain Adaptive Loop Filter |
| WO2013090120A1 (en) * | 2011-12-15 | 2013-06-20 | Dolby Laboratories Licensing Corporation | Backwards-compatible delivery of digital cinema content with extended dynamic range |
| SG11201402920TA (en) * | 2011-12-19 | 2014-11-27 | Sony Corp | Image processing device and method |
| US9426498B2 (en) | 2012-07-10 | 2016-08-23 | Broadcom Corporation | Real-time encoding system of multiple spatially scaled video based on shared video coding information |
| US9438911B2 (en) | 2012-08-03 | 2016-09-06 | Mediatek Inc. | Video processing system with shared/configurable in-loop filter data buffer architecture and related video processing method thereof |
| AU2013200051B2 (en) * | 2013-01-04 | 2016-02-11 | Canon Kabushiki Kaisha | Method, apparatus and system for de-blocking video data |
| US10417766B2 (en) * | 2014-11-13 | 2019-09-17 | Samsung Electronics Co., Ltd. | Method and device for generating metadata including frequency characteristic information of image |
| CN106303540B (en) * | 2015-05-20 | 2019-02-12 | 浙江大华技术股份有限公司 | A kind of method for compressing image and its device |
| CN105138963A (en) * | 2015-07-31 | 2015-12-09 | 小米科技有限责任公司 | Picture scene judging method, picture scene judging device and server |
| RU2682838C1 (en) * | 2015-12-23 | 2019-03-21 | Хуавей Текнолоджиз Ко., Лтд. | Method and device for coding with transformation with choice of transformation of the block level and implicit alarm system within the framework of the hierarchical division |
| WO2020175145A1 (en) * | 2019-02-27 | 2020-09-03 | ソニー株式会社 | Image processing device and image processing method |
| CN113711600B (en) * | 2019-04-26 | 2024-06-21 | 松下电器（美国）知识产权公司 | Encoding device, decoding device, encoding method, and decoding method |
| CN118235392A (en) * | 2021-12-31 | 2024-06-21 | Oppo广东移动通信有限公司 | Filtering coefficient generation and filtering method, video encoding and decoding method, device and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07143483A (en) * | 1993-11-15 | 1995-06-02 | Nec Eng Ltd | Adaptive post-processing filter |
| CN1846444A (en) * | 2003-09-17 | 2006-10-11 | 汤姆森许可贸易公司 | Adaptive reference picture generation |
| CN101926177A (en) * | 2008-03-07 | 2010-12-22 | 株式会社东芝 | Dynamic image encoding/decoding device |
Family Cites Families (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4152772A (en) * | 1974-08-29 | 1979-05-01 | The United States Of America As Represented By The Secretary Of The Navy | Apparatus for performing a discrete cosine transform of an input signal |
| FI117533B (en) * | 2000-01-20 | 2006-11-15 | Nokia Corp | Procedure for filtering digital video images |
| JP3861698B2 (en) * | 2002-01-23 | 2006-12-20 | ソニー株式会社 | Image information encoding apparatus and method, image information decoding apparatus and method, and program |
| JP4120301B2 (en) * | 2002-04-25 | 2008-07-16 | ソニー株式会社 | Image processing apparatus and method |
| CA2513537C (en) * | 2003-02-21 | 2013-03-26 | Matsushita Electric Industrial Co. Ltd. | Picture coding method and picture decoding method |
| EP1578137A2 (en) * | 2004-03-17 | 2005-09-21 | Matsushita Electric Industrial Co., Ltd. | Moving picture coding apparatus with multistep interpolation process |
| JP4457346B2 (en) * | 2004-11-12 | 2010-04-28 | ノーリツ鋼機株式会社 | Image noise removal method |
| US7792385B2 (en) * | 2005-01-25 | 2010-09-07 | Globalfoundries Inc. | Scratch pad for storing intermediate loop filter data |
| JP2006211152A (en) * | 2005-01-26 | 2006-08-10 | Hokkaido Univ | Device and method for coding image and decoding image, and programs for coding and decoding image |
| JP4784188B2 (en) * | 2005-07-25 | 2011-10-05 | ソニー株式会社 | Image processing apparatus, image processing method, and program |
| JP2007110568A (en) * | 2005-10-14 | 2007-04-26 | Matsushita Electric Ind Co Ltd | Image coding device |
| US7657113B2 (en) * | 2005-12-21 | 2010-02-02 | Hong Kong Applied Science And Technology Research Institute Co., Ltd. | Auto-regressive method and filter for denoising images and videos |
| JP4449915B2 (en) * | 2006-02-08 | 2010-04-14 | ソニー株式会社 | Encoding apparatus, encoding method and program, and recording medium |
| EP1841230A1 (en) | 2006-03-27 | 2007-10-03 | Matsushita Electric Industrial Co., Ltd. | Adaptive wiener filter for video coding |
| EP2001239B1 (en) * | 2006-03-27 | 2017-09-13 | Sun Patent Trust | Picture coding apparatus and picture decoding apparatus |
| WO2008010929A2 (en) * | 2006-07-18 | 2008-01-24 | Thomson Licensing | Methods and apparatus for adaptive reference filtering |
| BRPI0714859A2 (en) * | 2006-08-02 | 2013-05-21 | Thomson Licensing | Method and apparatus for adaptive geometric partitioning for video encoding and video signal structure for video encoding |
| CN101563926B (en) * | 2006-12-18 | 2011-11-16 | 皇家飞利浦电子股份有限公司 | Image compression and decompression |
| EP1944974A1 (en) * | 2007-01-09 | 2008-07-16 | Matsushita Electric Industrial Co., Ltd. | Position dependent post-filter hints |
| JP4847890B2 (en) * | 2007-02-16 | 2011-12-28 | パナソニック株式会社 | Encoding method converter |
| JP2009110559A (en) * | 2007-10-26 | 2009-05-21 | Pioneer Electronic Corp | Optical disk device |
| CN101170701B (en) * | 2007-11-16 | 2010-10-27 | 四川虹微技术有限公司 | Block elimination filtering method and device for video encoding and decoding system |
| US7924941B2 (en) * | 2007-11-27 | 2011-04-12 | Motorola Mobility, Inc. | Digital pre-distortion for orthogonal frequency division multiplexing (OFDM) signals |
| CN101970946A (en) | 2008-02-20 | 2011-02-09 | Aos控股公司 | Organic polymer coatings for water containers |
| JP2010081368A (en) * | 2008-09-26 | 2010-04-08 | Toshiba Corp | Image processor, moving image decoding device, moving image encoding device, image processing method, moving image decoding method, and, moving image encoding method |
| KR101457418B1 (en) * | 2009-10-23 | 2014-11-04 | 삼성전자주식회사 | Method and apparatus for video encoding and decoding dependent on hierarchical structure of coding unit |
-
2009
- 2009-08-26 JP JP2009195317A patent/JP2011049740A/en active Pending
-
2010
- 2010-07-29 TW TW99125172A patent/TWI435610B/en active
- 2010-08-18 CN CN201510023087.9A patent/CN104601995B/en not_active Expired - Fee Related
- 2010-08-18 CN CN201080036453.XA patent/CN102484714B/en not_active Expired - Fee Related
- 2010-08-18 CN CN201510021614.2A patent/CN104601994B/en active Active
- 2010-08-18 EP EP10811734.2A patent/EP2472870A4/en not_active Withdrawn
- 2010-08-18 AU AU2010287688A patent/AU2010287688B2/en not_active Ceased
- 2010-08-18 CN CN201510023106.8A patent/CN104618716B/en active Active
- 2010-08-18 CA CA2970080A patent/CA2970080C/en not_active Expired - Fee Related
- 2010-08-18 US US13/390,595 patent/US9992516B2/en active Active
- 2010-08-18 RU RU2012106134/08A patent/RU2533444C2/en active
- 2010-08-18 MX MX2012002070A patent/MX2012002070A/en active IP Right Grant
- 2010-08-18 BR BR112012003855-9A patent/BR112012003855B1/en active IP Right Grant
- 2010-08-18 CN CN201510025568.3A patent/CN104602002B/en active Active
- 2010-08-18 CA CA2769733A patent/CA2769733C/en not_active Expired - Fee Related
- 2010-08-18 KR KR1020177027840A patent/KR101901087B1/en active IP Right Grant
- 2010-08-18 KR KR1020127004293A patent/KR101786130B1/en active IP Right Grant
- 2010-08-18 WO PCT/JP2010/063918 patent/WO2011024684A1/en active Application Filing
-
2018
- 2018-04-27 US US15/929,011 patent/US10250911B2/en active Active
-
2019
- 2019-02-11 US US16/272,325 patent/US11051044B2/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07143483A (en) * | 1993-11-15 | 1995-06-02 | Nec Eng Ltd | Adaptive post-processing filter |
| CN1846444A (en) * | 2003-09-17 | 2006-10-11 | 汤姆森许可贸易公司 | Adaptive reference picture generation |
| CN101926177A (en) * | 2008-03-07 | 2010-12-22 | 株式会社东芝 | Dynamic image encoding/decoding device |
Also Published As
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104602002B (en) | Image processing apparatus and method | |
| CN101990099B (en) | Image processing apparatus and method | |
| CN102511165B (en) | Image processing apparatus and method | |
| CN106254876B (en) | Image processing apparatus and method | |
| CN101990098B (en) | Image processing apparatus and method | |
| CN105379266A (en) | Disabling intra prediction filtering | |
| CN106851289A (en) | Image processing apparatus and image processing method | |
| CN102823254A (en) | Image processing device and method | |
| CN102884791A (en) | Apparatus and method for image processing | |
| CN102792693A (en) | Device and method for processing image | |
| CN102668570B (en) | Image processing device and method thereof | |
| CN106331710B (en) | Image processing apparatus and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |