CN106612432A - Coding method and decoding processing method - Google Patents
Coding method and decoding processing method Download PDFInfo
- Publication number
- CN106612432A CN106612432A CN201610921231.5A CN201610921231A CN106612432A CN 106612432 A CN106612432 A CN 106612432A CN 201610921231 A CN201610921231 A CN 201610921231A CN 106612432 A CN106612432 A CN 106612432A
- Authority
- CN
- China
- Prior art keywords
- data
- subband
- coded
- priority
- compositions
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/63—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/127—Prioritisation of hardware or computational resources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/15—Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/1883—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit relating to sub-band structure, e.g. hierarchical level, directional tree, e.g. low-high [LH], high-low [HL], high-high [HH]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a coding method and a decoding processing method. A frequency transformation unit executes discrete wavelet transformation processing on image data, quantizes the output of sub-bands of each component using a quantization unit, and performs entropy coding using a coding unit. If a total code amount of the image data that has been coded exceeds a maximum value that has been set, an overflow control unit replaces the coded data with copy data obtained by coding 0 in order from sub-bands having the lowest priority, until the total code amount is less than or equal to the maximum value.
Description
Technical field
The present invention relates to coded method and decoding processing method, more particularly to one kind is for processing moving or static figure
The technology of the record of the original image (RAW image) of picture.
Background technology
In traditional camera head, the original image information (RAW image) shot by imaging sensor is Bayer
(debayered) ((demosaiced) of demosaicing), the original image information for removing Baeyer is converted into by luminance signal
With the signal of colour difference signal composition, and each signal is performed so-called development treatment (such as denoising, Optical distortion correction and
Image optimization).Generally, the luminance signal and colour difference signal of executed development treatment is subsequently compressed and is encoded, and is recorded
In the recording medium.On the other hand, there is the camera head for being able to record that original image.Although with original image, needs
Greatly, but advantage is that the correction and deterioration of artwork (original image) is suppressed to minimum to already recorded data amount, and
Can like using original image in the postedit original image of image taking, therefore the experienced users with quality of editors.Separately
Outward, in recent years, the record of original image has not been only applied to rest image and has been also applied to moving image.When by moving image
When being recorded as original image, needing to perform is used for the control of the desired encoding amount of data volume boil down to, with predetermined record
Record has the moving image of given duration in medium.
If however, encoding amount control and quantified controlling such a data volume occur not by appropriate execution, be somebody's turn to do
Data volume has exceeded the transfer rate to predetermined recording medium, causes the data in recording medium to be destroyed.Even if in addition, original number
In being written into recording medium according to (RAW data), if it exceeds reproduce ensured bit rate in real time, then the data can not be by
Reproduction equipment correctly reproduces.In preparation in this case, it is desirable to provide the machine of the data volume after coding can be reduced
System.As the method for compression original image, it is believed that the method for such as JPEG 2000 is suitable, and it is related to using such as little
Data are decomposed into subband (frequency band) by the frequency transformation of wave conversion, and by each subband compression, so as not to occur due to coding
The block distortion (block distortion) for causing, rather than by performing the DCT in units of block come compressed data.For example exist
In Japanese Unexamined Patent Publication 2004-297195 publications, describe in JPEG 2000, data volume after coding can be reduced
The configuration of camera head.In JPEG 2000, embedded encoded EBCOT (Embedded Block are employed in compressed encoding
Coding with Optimized Truncation, optimization intercepts embedding space matrix), each rectangular block in picture is with position
Plane performs coding for unit, is thus provided that a kind of mechanism for abandoning the low bit plane of importance in encoded.Additionally, there are
It is a kind of with Rotating fields and to abandon the mechanism of the layer with small significance, and by using these technologies, volume can be reduced
Data volume after code.
However, because EBCOT has heavy process load and with great operand, being difficult to EBCOT
All codings are applied to, therefore, especially, EBCOT is not suitable for the embedded device for needing to perform real-time processing.If additionally,
Using Rotating fields, meeting generation system expense (overhead), therefore always do not use Rotating fields.
Technology described in No. 2004-297195 bulletin of Japanese Unexamined Patent Publication is to give priority to subband, is matched somebody with somebody in order
Put encoding stream (coded stream), and if data exceed predefined size, then follow-up data is by inserting end code and quilt
Block, also, when reproducing, by the way that the data after end code are set to into 0 data come perform decoding process.The problem of presence
It is：This decoding process needs special decoder, especially, if multiple subbands are truncated, then do not retrieve from data
To end code, the subband being truncated cannot be just understood.
The content of the invention
The present invention proposes a kind of coded method and coding/decoding method, and it can adjust the data volume after coding, and need not make
With with it is heavy process load embedded encoded EBCOT, and can utilize decoder normal process or by decoding
Device addition is simply processed and generates reproducible encoding stream.
The present invention has following configuration.
According to the first aspect of the invention, there is provided a kind of coded method, including：Each composition execution to view data is little
Wave conversion；The data after conversion are encoded for each subband；It is determined that being obtained by the coding of described image data
Whether editor-in-chief's code amount exceedes threshold value, and if it is determined that editor-in-chief's code amount then replaces coded number more than the threshold value with tentation data
According to or in units of the subband abandon coded data so that editor-in-chief's code amount is less than or equal to the threshold value.
According to a further aspect in the invention, there is provided a kind of decoding processing method, including：For each subband to by figure
Coded data perform decoding is processed as obtained from multiple subbands of data are encoded, and obtains coefficient data；And it is right
The coefficient data of acquisition performs inverse wavelet transform, and obtains view data, wherein, if to carrying through the wavelet of decoding process
For tentation data, then by the way that all coefficient datas are set to into 0, the inverse wavelet transform of wavelet is performed.
In accordance with the invention it is possible to using simple mechanism, adjust to the data volume after original image coding.
By referring to the drawings, to the description of exemplary embodiment, further characteristic of the invention will be clear from.
Description of the drawings
Fig. 1 is the block diagram of the topology example of the camera head for illustrating according to embodiments of the present invention；
Fig. 2A, Fig. 2 B and Fig. 2 C are the figures of the pel array for illustrating first embodiment；
Fig. 3 is the concept map of the subband for illustrating first embodiment；
Fig. 4 is the structure of encoding stream in a frame for illustrate first embodiment；
Fig. 5 is the process chart of the overflow control unit for illustrating first embodiment；
Fig. 6 is the figure of the priority of the subband for illustrating first embodiment；
Fig. 7 is the concept map for illustrating the value in first embodiment by obtaining to encoding amount integrating；
Fig. 8 is the concept map of the data structure for illustrating encoding stream in the first embodiment including replicate data；
Fig. 9 is the block diagram of the topology example for illustrating the camera head according to second embodiment；
Figure 10 A are the concept maps for illustrating the structure of encoding stream and the parameter related to replacement instruction in second embodiment；
Figure 10 B are the concept maps for illustrating the structure of encoding stream in second embodiment；
Figure 11 is the block diagram of the topology example for illustrating the reproduction equipment that encoding stream can be reproduced in second embodiment；
Figure 12 A are the concept maps of the process of composition conversion in sensor processing unit in the third embodiment；
Figure 12 B are the figures for illustrating the priority of subband in the third embodiment；
Figure 13 is the figure for illustrating the priority of subband in fourth embodiment；
Figure 14 is the flow process of overflow control unit in fourth embodiment；
Figure 15 is by the concept map of value obtained from the encoding amount integrating to encoding stream in fourth embodiment；
Figure 16 is by the concept map of value obtained from the encoding amount of integrating encoding stream in fourth embodiment；
Figure 17 is the concept map for illustrating subband in the 5th embodiment；
Figure 18 is the figure for illustrating the priority of subband in the 5th embodiment；
Figure 19 is the concept map for illustrating the structure of encoding stream in the 5th embodiment.
Specific embodiment
First embodiment
Embodiments of the invention are described in detail next, with reference to accompanying drawing.Fig. 1 is to illustrate according to embodiments of the present invention taking the photograph
As the block diagram of the topology example of device.Encoding device perform volume with the block of variable-size by the way that the video of input is divided into
Code is generating and record encoding stream.
<Coded treatment>
In FIG, control unit 109 includes CPU and the memorizer for storing the control program performed by CPU, and
Whole process of control camera head 100.When the instruction for starting camera operation is given, it is input into by camera optical unit 101
The optical imagery of the subject to be taken, and form optical imagery on imaging sensor unit 102.Imaging sensor list
Unit 102 will be converted to the signal of telecommunication by the light of red, green and blue (RGB) color filter configured in each pixel.Fig. 2A is
The example of the color filter being arranged in imaging sensor unit 102, and the picture of the image processed by camera head 100 is shown
Pixel array.As shown in Figure 2 A, red (R), green (G), blue (B) is configured in each pixel with mosaic formation, and pixel battle array
Row one with regularly arranged 4 pixels (2*2) including 1 red pixel, 1 blue pixel and 2 green pixels
The structure of set.Above-mentioned pel array is commonly known as Bayer array (Bayer array).
The signal of telecommunication that sensor processing unit 103 is changed to imaging sensor unit 102 performs pixel repair process.
The process that the repair process is included in imaging sensor unit 102 to defect pixel and the pixel with low reliability is performed,
Such as using neighboring pixel value to picture element interpolation to be rehabilitated, and deduct predetermined offset (offset value).
In the present embodiment, from the image information of the output of sensor processing unit 103 original image (RAW image) or original are referred to as
Beginning data (RAW data), mean original (undeveloped) image.
Hereafter, each picture that the original image for being input in the Bayer array in such as Fig. 2 B and having processed is separated in Fig. 2 C
Element, and input picture buffer 104 is output to, to form the plane of the pixel with each composition.However, because Bayer
Array includes 2 pixels with G component, and the pixel of this 2 G components is processed to be different compositions, and is referred to as G1
And G2.Input picture buffer 104 can be input into the original image of multiple pixel columns.When original image is input into, picture coding
Unit 116 is input into the original image kept by input picture buffer 104, and starts coded treatment.Here, it is imported into figure
As the data of coding unit 116 are referred to as view data.
Frequency conversion unit 105 is input into the original image kept by input picture buffer 104, performs discrete wavelet transformer
Change, image is transformed to into subband (frequency band), and by the subband output after conversion to quantifying unit 106.Frequency conversion unit 105
Output is the discrete wavelet transform coefficients (here, also referred to as conversion coefficient) for each subband.Quantify setting unit 110 vectorial
Change unit 106 to notify to provide quantization step of the instruction to perform by control unit 109.Quantifying unit 106 is arranged using quantization
Conversion coefficient of the quantization step that unit 110 is notified to quantify to be input into by frequency conversion unit 105, and the conversion coefficient is defeated
Go out to coding unit 107.Coding unit 107 is compressed using such as entropy code (entropy coding) etc. and is encoded and quantified
The conversion coefficient quantified in unit 106, and by coded data output to coded data holding unit 108.In the present embodiment,
Assume that coding unit 107 performs compressed encoding using the entropy code of such as Columbus coding (Golomb coding).Then, compile
The encoding amount output of the encoding stream for being compressed and being encoded for generating to encoding stream is formed unit 112 and is overflowed true by code unit 107
Order unit 113.
Maximum encoding amount setting unit 111 indicates each of maximum encoding amount setting unit 111 according to based on control unit 109
Plant and compressed determined by logging mode (the preferential logging mode of picture quality, logging mode of record time priority etc.)
Rate, calculating is assigned to the maximum encoding amount of a pictures and provides instruction to overflow control unit 113.Optionally, it is maximum
Encoding amount setting unit 111 can store the maximum encoding amount that arranged from control unit 109 and be given to overflow control unit 113
Indicate.After coding unit 107 encodes whole subbands, the encoding amount of whole subbands of 113 pairs of generations of overflow control unit enters
Row integrating, and determine whether the encoding amount of integrating exceedes maximum encoding amount setting unit 111 and notify to overflow control unit 113
Maximum encoding amount.If it is determined that the encoding amount of integrating exceedes maximum encoding amount, then the determination of overflow control unit 113 will be by with little
The subband that the replicate data (copy data) of encoding amount is replaced.Then, control unit 113 notifies replicate data signal generating unit 114
The subband that unit 112 data to be copied are replaced is formed with encoding stream, and is received from replicate data signal generating unit 114 and is replicated
The encoding amount of the subband that data are replaced.So, the encoding amount that overflow control unit 113 is performed for controlling encoding amount is controlled.
Replicate data signal generating unit 114, using whole coefficients as 0 data, is generated and utilized and coding for the subband for notifying
Data (hereinafter referred to as replicate data) coded by the similar coded method of the coded method of unit 107, and the data that will be generated
Export replicate data holding unit 115.Encoding stream forms unit 112 according to the instruction from overflow control unit 113, passes through
Replicate data holding unit 115 is input into the data of the target sub-band that data to be copied are replaced and keeps single by coded data
The data of the subband that unit 108 is input into outside target sub-band, form encoding stream.
<The structure of encoding stream>
Fig. 3 is the concept map for illustrating the subband when wavelet transform (DWT) is performed, and upper left is with low-limit frequency
(that is, frequency band is low) subband, sub-bands of frequencies to bottom right increases (that is, frequency band becomes higher).Here, situations below is shown：To tool
The subband LL for having horizontal and vertical low-frequency component performs two examples of horizontal and vertical DWT, with until decomposition levels
(resolving level) (Lv) be 2 subband.In Fig. 3, input picture 301 is broken down into subband 302 by wavelet transformation.
2LL, 2HL, 2LH and 2HH of subband 302 is with the subband that sub-band division grade is 2.Similar, 1HL, 1LH and 1HH are tools
There is the subband that sub-band division grade is 1.It is noted that for convenience, artwork (original image) is considered as into decomposition levels for 0
The 0LL with low-frequency component.Although it is noted that can have higher decomposition levels in JPEG 2000, no matter dividing
Solution number of degrees is how many, can perform the invention according to the present embodiment, therefore decomposition levels are restricted to grade 2 by this example.
If encoded to a pictures, 7 subbands are generated for 4 pixel planes, it is, the R1 of Bayer pixels
Pixel planes, B1 pixel planes, G1 pixel planes and G2 pixel planes, therefore 28 subbands are generated altogether.Note, although at this
A pictures (fully entering image) will be encoded in example, but the input picture can be divided into multiple tiles
(tile), then encoded in units of each tile.Certainly, it is also applied for the invention according to the present embodiment.
Fig. 4 is the concept map of the structure for illustrating the encoding stream that the frame that unit 112 is formed is formed by encoding stream.Here, with
Fig. 3 is similar to, and shows situations below：Perform two examples of horizontal and vertical DWT, and with until son that decomposition levels are 2
Band.Encoding stream 401 includes the pixel planes with color component.Coded data 402 is the subband included in R pixel planes
Coded data, and including the gradational subband of institute.The data head of the information needed for including decoding is added to the head of encoding stream
After portion, encoding stream forms the exports coding stream of unit 112, so as to be ordered in order for the pixel planes of each color component
One group.7 subbands in pixel planes are arranged in order from low frequency.
<Overflow control process>
Fig. 5 is the flow chart of the process for illustrating overflow control unit 113.The process content of overflow control is shown using Fig. 5.
Note, overflow control unit 113 also can be realized by computer (processor) configuration processor.
The generation encoding amount in units of subband is obtained from coding unit 107 in step S501.
Determine whether to get the generation encoding amount of all subbands that picture includes in step S502, and process base
In it is determined that result and branch.If having obtained the generation encoding amount of all subbands, process is advanced into step S503, otherwise, place
Reason is advanced into step S501 to obtain the generation encoding amount of other subbands.
In step S503, obtain from maximum encoding amount setting unit 111 and generate encoding amount as the maximum of threshold value.
The value that encoding amount integrating is obtained that generates of all subbands by including to picture is determined in step S504
(i.e. editor-in-chief's code amount) whether more than obtain in step S503 it is maximum generate encoding amount, and process based on a determination that result and divide
.If it is determined that generating encoding amount more than maximum by the value obtained to generating encoding amount integrating, then process and be advanced into step
Rapid S505, however, if it is determined that the value is not more than maximum generation encoding amount, then process terminates.That is, circulate execution step S504 to arrive
S509, until editor-in-chief's code amount is less than or equal to threshold value.
In step S505, the subband with low priority is considered as to replace target in the subband being not replaced
Band.Determination process is will be described in after a while.
In step S506, to the replacement target sub-band that replicate data signal generating unit 114 notifies to determine in step S505
Replicate data generation.
In step s 507, notify to replace target sub-band to encoding stream signal generating unit 112.
In step S508, from replicate data signal generating unit 114 size of replicate data is obtained.In step S509, profit
The encoding amount for replacing target sub-band is updated with the size of replicate data.
<Replace target sub-band determination to process>
Here, will be described in step S505 is used to determine the process for replacing target sub-band.Overflow control unit 113 gives
Each subband priority, and think that the subband with low priority is that replicate data replaces target.Fig. 6 is to illustrate overflowing for the present embodiment
The figure of each subband priority gone out in control unit.The priority of subband is individually sorted, and the decomposition levels based on subband
And pixel planes Sort Priority (Lv).With regard to sub-band division grade, there is higher prior with compared with the subband of high de-agglomeration grade
Level.Priority in identical decomposition levels is different according to pixel planes, and G1/G2 compositions are higher, and R/B compositions are relatively low.Preferentially
Level is different always according to the composition of subband in pixel planes, with LL as limit priority (Lv is only 2), followed by HL, LH and HH
Order give priority.In the example of fig. 6, the subband 1HH of B component has lowest priority, the subband 2LL tools of G1 compositions
There is limit priority.Note, although in the example of fig. 6 subband LH has than in same pixel plane and identical decomposition levels
Subband HL lower priority, but order can be with opposite to that.In addition, priority can determine in advance and in a fixed manner
Definition, or can programmably define.Overflow control unit 113 performs the process of Fig. 5 according to the priority of definition.
Fig. 7 is to illustrate that maximum generation for exceeding setting in the value obtained by the generation encoding amount integrating to subband is encoded
In the case of amount, by generating the value that obtained of encoding amount integrating and by after to replacing it before processing replacement
Generate the figure of the value that encoding amount integrating is obtained.Reference 701 represents the generation encoding amount of the encoding stream before replacement is processed.
Reference 702 represents the generation encoding amount of the encoding stream after replacement is processed.Reference 703 represents maximum encoding amount control
The maximum encoding amount that unit 111 is notified.Here, according to Fig. 6 subband priority, by replacing difference with replicate data
R pixel planes and B pixel planes include, 4 subbands of the LH compositions that decomposition levels are 1 and HH compositions so that coding
The integrating value of amount is suppressed to maximum generation encoding amount or less.According to the process of Fig. 5, from shown in Fig. 6 with minimum preferential
Level subband start to perform in order using the replacement of replicate data, until meeting step S504 till.Fig. 7 shows have
The 1HH subbands of the B component of lowest priority are replicated first data replacement, the 1HH subbands of R component, the 1LH subbands of B component and R
The 1LH subbands of composition are sequentially replicated data replacement, and encoding amount integrating value reaches maximum encoding amount or less in the point.
Fig. 8 shows the concept map of the data structure of the encoding stream including replicate data.Fig. 8 shows and is providing duplication
Data replace the process that encoding stream when indicating forms unit 112.It is similar with Fig. 7, here, suppose that flat in R pixel planes and B pixels
Face includes, decomposition levels are that 4 subbands in 1 whole LH compositions and HH compositions are replicated data replacement.Encoding stream 801
Including the pixel planes with color component.In the coded data 802 of the subband that R pixel planes include, decomposition levels are 1
LH compositions and HH compositions subband be replicated data replacement.In the coded data 803 of the subband that B pixel planes include,
Decomposition levels are that 1 LH compositions and the subband of HH compositions are also replicated data replacement.
Encoding stream forms unit 112 according to the replacement mesh for representing the informed code stream formation unit 112 of overflow control unit 113
The information of mark subband, included using the input R pixel planes of replicate data holding unit 115 and B pixel planes, decomposition levels
The subband of LH compositions and HH compositions for 1, and it is input into other subbands using coded data holding unit 108.Then, subband
Coded data is replaced according to the information for replacing target sub-band is represented by corresponding replicate data.In this example, replicate data
It is that the coded data that 0 coded data is obtained all is arranged to by the wavelet conversion coefficient of subband to be replaced, and
And subband is replaced by the data.Above-mentioned encoding stream is the coded data generated using normal wavelet transform, therefore is not required to
Single decoder, and above-mentioned encoding stream is wanted to reproduce using common decoder.In addition, because there is low priority
Subband (subband with upper frequency in this example) is replaced first, therefore the deterioration of picture quality can be suppressed to most
It is little.
Do so can provide a kind of camera head, and it by the degradation inhibiting of picture quality to minimum, and can incited somebody to action
Encoding amount is adjusted after whole sub-band codings that picture includes.
Second embodiment
The present embodiment is with the structure difference of first embodiment, replicate data signal generating unit 114 and replicate data
Holding unit 115 is omitted, and overflow control unit 113 forms unit 112 and provides instruction to abandon data to encoding stream, and compiles
Code stream forms unit 112 and abandons instruction generation encoding stream according to data.Other blocks have the structure similar with first embodiment.
Fig. 9 is the block diagram of the topology example for representing the camera head according to the present embodiment.Overflow control unit 113 is in coding
Unit 107 is encoded after whole subbands, and the generation encoding amount of all subbands to obtaining from coding unit 107 carries out integrating, really
What constant volume was calculated generates whether encoding amount exceedes the maximum coding that maximum encoding amount setting unit 111 notifies overflow control unit 113
Amount, and if it is determined that exceeding maximum encoding amount, it is determined that it is dropped the subband of data.Then, overflow control unit 113 is notified
Encoding stream forms the data of unit 112 and abandons target sub-band.When data discard notification is received, encoding stream formed unit 112 to
Data head add list registration is according to the labelling being dropped.
<Data header structure and replacement are indicated>
Figure 10 A are the concept maps for representing the structure of encoding stream in the present embodiment and the parameter related to instruction is replaced.
Encoding stream 1000 includes data head 1001 and coded data 1002.Replace_flag (replacement labelling) 1003 illustrates data
The labelling being dropped, and there is labelling for all subbands.Replace_flag 1003 is included in data head 1001.Compile
Code stream forms unit 112 and first the Replace_flag of whole subbands is set to into 0.Then, when connecing from overflow control unit 113
When receiving data discarding instruction and specified subband, encoding stream forms unit 112 will be corresponding with the subband for sending data discarding instruction
Replace_flag be set to 1.By all Replace_flags corresponding with the subband that data are dropped be set to 1 it
Afterwards, the subband data that encoding stream formation unit 112 is not dropped using the input of coded data holding unit 108, and merely with
The subband being not dropped forms encoding stream.In addition, data head 1000 includes the Replace_flag 1003 of above-mentioned setting.
Figure 10 B show the data structure of encoding stream.Here, situation about will describe as an example is to receive such finger
Show, the decomposition levels that it indicates that B pixel planes includes are 1 LH compositions and the subband of HH compositions is data discarding mesh
Mark.Replace_flag only corresponding with the subband of LH compositions and HH compositions that the decomposition levels that B pixel planes include are 1
1003 are changed into 1, and remaining is 0.The decomposition levels that B pixel planes include are the coding of the subband of 1 LH compositions and HH compositions
Data include abandoning the subband of target as data, therefore are not included in coded data 1002.Use is described more fully below
In the method for reproducing above-mentioned encoding stream.Although Replace_flag 1003 can be associated with the identification information for showing subband setting
Put, but the order of subband can be determined in advance, and flag values can only be arranged according to the order.
<The method for reproducing encoding stream>
Figure 11 is the configuration example for representing the reproduction equipment that can reproduce the encoding stream generated by the encoding device in Fig. 9.
The coded data 1101 of subband is imported into the codec processing unit 1102 that input encoded data and perform decoding are processed.Re-quantization
The coefficient that the input of processing unit (dequantization processing unit) 1103 is decoded by codec processing unit 1102,
And perform re-quantization to process (or inverse quantization processes (inverse quantization processing)).Discrete wavelet is closed
Into processing unit 1104 using inverse quantization processing unit 1103 for each subband input re-quantization coefficient, to the coefficient being input into
Data perform inverse wavelet transform, and form pixel planes.In addition, being obtained by using 0 quantization parameter for replacing all of subband
0 data 1105 for obtaining are imported into discrete wavelet synthesis processing unit 1104.Can be single by the input of such as reproduction equipment control
First (not shown) performs the control of the reference of replacement flag (Replace_flag) and decoding corresponding with the value.Input control
The Replace_flag 1003 of unit reference data head 1001, and for the subband that Replace_flag is 0, at decoding
Reason unit 1102 is input into the coded data 1101 of the subband with decoding data, and using inverse quantization processing unit 1103 to discrete
Small echo synthesis processing unit 1104 is input into through the coefficient of re-quantization process.On the other hand, it is 1 for Replace_flag
Subband, the coded data of the subband is dropped in record, therefore does not exist.Therefore, control unit is input into discrete wavelet
Synthesis processing unit 1104 is input into 0 data 1105, rather than the coded data of subband is carried out into decoding process and re-quantization process.
The function of the input control unit can be synthesized processing unit 1104 to perform by discrete wavelet.
Even for the non-existent encoding stream of coded data of subband, discrete wavelet synthesis processing unit 1104 also can lead to
Cross and utilize Replace_flag to be used as input to perform the process for reproducing image by 0 data.Even if in addition, multiple subbands
Data are dropped, it is also possible to easily judge whether coded data using Replace_flag.
Do so can provide a kind of camera head, set although may require that and the reproduction for reproducing is performed using Replace_flag
It is standby, but the camera head can adjust encoding amount after all subbands that picture includes are encoded, and without the need for replicate data
Generation is processed.
Although in addition, have been described in the present embodiment using Replace_flag perform reproduce situation, it is as follows
Configuration also in the range of the embodiment of the present invention, the configuration is：Data head 1001 includes representing the code length of subband
Grammer (Syntax) (subband_size), and indicates to refer to subband data discarding is received from overflow control unit 113
Regularly, encoding stream formed unit 112 by by subband_size be set to 0 come encoding stream is set and without using Replace_
The configuration of flag, and for the subband that subband_size is 0, similar to the feelings that reproduction is performed using Replace_flag
0 data are used as input to perform the configuration for reproducing the process of image by condition, reproduction equipment.
3rd embodiment
Compared with the configuration of first embodiment, the present embodiment has following configuration：Sensor processing unit 103 pairs is visitd
Your array performs composition conversion, to obtain the radio-frequency component GH of 4 planes, i.e. luminance components Y, color component U and V and G,
And input picture buffer is output them into, other blocks have the configuration similar with first embodiment.
Figure 12 A are the figures of the process of the composition conversion for representing sensor processing unit 103 in the present embodiment.Pixel groups
1201 are included in pixel G1, G2, R the and B pixels included in Bayer array.Pixel groups 1202 are included by the way that G1 and G2 pixels are become
GH, GL, the R and B pixel being changed to obtained by GH and GL compositions.Pixel groups 1203 are included by the way that GL, R and B image is performed into YUV
GH, Y, U and V pixel obtained by conversion.Here, for example, Y compositions are luminance components, U compositions be aberration between Y and R into
Point, V compositions are the aberration compositions between Y and B.Sensor processing unit 103 is using in the Bayer array shown in Fig. 2 B
Association in G1, G2, R and B pixel 1201 of input and processed original image between G1 and G2, G1 and G2 is converted
For the GL of the low-frequency component of the GH and G of the radio-frequency component of G, GH, GL, R and B pixel 1202 is generated.Note, in this example, GH
GH=(G1-G2)/2 and GL=(G1+G2)/2 is given respectively with GL.
Next, being turned by the way that the low-frequency component GL and R of G in GH, GL, R and B pixel 1202 and B is performed into color space
Change to obtain Y, U and V composition to generate GH, Y, U and V pixel 1203.Sensor processing unit 103 to input picture is slow
Device 104 output GH, Y, U and V pixel 1203 is rushed, to form plane using these pixels.
Figure 12 B are the figures for representing the priority of subband in the present embodiment.It is similar with first embodiment, the priority quilt of subband
Individually sequence, and the order according to sub-band division grade and pixel planes gives priority.With regard to sub-band division grade, have
There is higher priority compared with the subband of high de-agglomeration grade.Priority in same decomposition levels is different according to pixel planes,
And according to using Y compositions as limit priority followed by GH compositions and R/B compositions order giving priority.In addition, with
First embodiment is similar, and priority is different always according to the composition of subband in pixel planes, and according to excellent using LL as highest
The order of first level (only highest ranking, only has grade 2 in Figure 12 B) followed by HL, LH and HH is giving priority.Even if
In the case that Bayer array is performed into composition conversion to obtain YUV- system colors space, it is also possible to be first carried out with relatively low excellent
The replacement of the subband of first level.In addition to the point that color system changes according to Figure 12 A, can be compiled with the configuration similar with Fig. 1
Code image.Therefore, it is possible to reproduce image from encoding stream using common decoding device.
Do so can provide a kind of camera head, even if Bayer array is being performed into composition conversion to obtain YUV systems
In the case of system color space, it is also possible to encoding amount is adjusted after all subbands that picture includes are encoded, while will figure
As the degradation inhibiting of quality is to minimum.
Although in addition, describe configuration of the sensor processing unit 103 to first embodiment in the present embodiment holding
The situation of row composition conversion, but following configuration, also in the invention scope of the present embodiment, the configuration is：Sensor signal
Configuration of the processing unit 103 to second embodiment performs composition conversion.
Note, the coded data for abandoning each subband for describing in a second embodiment is also applied for the present embodiment.
Fourth embodiment
It is that the group of subband arranges priority rather than individually that the present embodiment and the difference of the configuration of first embodiment are
For subband, priority is set.Although the configuration of the camera head of the present embodiment is identical with first embodiment, overflow control list
The operation of unit 113 is different from first embodiment.In addition, similar with first embodiment, operation and the normal reproduction of reproduction equipment set
It is standby identical.Overflow control unit 113 is configured to select replicate data to replace mesh from the group of the subband with equal priority
Mark subband, and encoding stream formation unit 112 is configurable to generate encoding stream so that replicate data is configured in after it by collective
Face.Other blocks have the configuration similar with first embodiment.
<The priority of subband>
Overflow control unit 103 gives subband priority, and the subband with lower priority is replaced with order
Replicate data, the data volume after coding reach predetermined value or it is lower till.Figure 13 is to represent that subband is excellent in the present embodiment
The concept map of first level.Decomposition levels are that LL, LH and HL composition of the subband of 2 G1 and G2 is considered to have equal priority and is
1 group (limit priority), decomposition levels are that the HH compositions of the subband of 2 G1 and G2 are considered to have equal priority for 2
Group (secondary high priority), decomposition levels are that LL, LH and HL composition of 2 R and B subbands is considered to have equal priority and is
3 group (next one limit priority), decomposition levels are that the HH compositions of 2 R and B subbands are considered to have equal priority
For 4 group (next one limit priority).Decomposition levels are that LH the and HL compositions of the subband of 1 G1 and G2 are considered to have
Equal priority is 5 group (next one limit priority), and decomposition levels are that the HH compositions of the subband of 1 G1 and G2 are considered as
Be with the group (next one limit priority) that equal priority is 6, decomposition levels be the subband of 1 R and B LH and HL into
Divide and be considered to have the group (next one limit priority) that equal priority is 7, decomposition levels are the subband of 1 R and B
HH compositions are considered to have the group (next one limit priority) that equal priority is 8.In this example, subband has quilt altogether
It is divided into 8 priority.
In fig. 13, decomposition levels are that a group of subband LL, LH and HL of 2 G1 and G2 has limit priority, and are had
The group for having the priority of one group of subband HH for R that decomposition levels are 1 and B has lowest priority.The subband it is preferential suitable
Sequence for example can determine in advance, or be arranged to modifiable.No matter which kind of mode, overflow control unit 113 can root
Each subband is replaced according to priority using replicate data.
<Overflow control>
Overflow control unit 113 is in order considered the subband with lower priority based on above-mentioned priority to replicate number
According to replacement target.Figure 14 is to represent that the subband for determining overflow control unit replaces the flow process of mesh calibration method in the present embodiment
Figure.That is, the process of Figure 14 in the present embodiment is performed in S505 the step of Fig. 5.In step S505 to S509, perform using figure
The process for one or more subbands that process in 14 determines.In step S1401, even if not being that replicate data is replaced
The all subbands included in the group with lowest priority in the subband of target are arranged to replace target, and the process is according to it
Encoding amount whether exceed the maximum encoding amount and branch that encoding amount control unit notifies.First, select with minimum preferential
The group of level.If encoding amount exceedes maximum encoding amount, process is advanced into step S1402, and otherwise, process is branched off into step
S1403。
In step S1402, the group for having lowest priority in not being the subband of replicate data replacement target includes
All subbands be considered as replace target.
In step S1403, the group for having lowest priority in the subband for being never replicate data replacement target (that is, exists
It is considered as group that replicate data replaces target in step S1401) in the subband that includes, select to replace target sub-band, so as to
The closest maximum encoding amount notified by maximum encoding amount setting unit 114 of encoding amount.By in all possible combination
The method of combination of the closest maximum encoding amount of encoding amount is selected realizing system of selection.For example, obtain with replicate data
The difference between encoding amount and maximum encoding amount before replacing it.Then, with regard to belonging to the subband of target group, obtain using replicating
Data replace the amount of data reduction in the case of subband.Reached more than coded data before replacing by combining these amount of data reduction
Amount determines the combination of subband with the minima of the value of the difference of maximum encoding amount.The subband is used as replacement target sub-band.
Figure 15 is the encoding stream for representing the replicate data generated by the overflow control unit to including by first embodiment
Encoding amount integrating and the present embodiment is included replicate data encoding stream the concept of value that obtained of encoding amount integrating
Figure.Before replicate data is replaced it, the encoding amount of encoding stream 1501 exceedes the maximum notified by maximum encoding amount setting unit 111
Encoding amount 1504.Because the replicate data in the present embodiment is replaced, the encoding amount that replicate data replaces it rear encoding stream 1502 is big
The encoding amount of the encoding stream 1503 after the replicate data that the overflow control unit 113 of first embodiment is generated is replaced it, and
Less than or equal to maximum encoding amount 1504.
Under the control of first embodiment overflow control unit 113, in encoding stream the duplication number that unit 112 is generated is formed
According in the encoding stream 1503 before replacing it, decomposition levels be the LH compositions of 1 R with the LH of the B that HH compositions, decomposition levels are 1 into
Divide the subband with HH compositions, i.e., altogether 4 subbands are that replicate data replaces target.That is, the son with lower priority
Band is replicated in order data replacement, and is less than or equal to the time point of maximum encoding amount 1504, above-mentioned 4 sons in encoding amount
Band is changed into replacing target.
On the other hand, under the control of the overflow control unit 1503 of the present embodiment, form unit 112 in encoding stream and give birth to
Into replicate data replace it before encoding stream 1502 in, decomposition levels are the HH compositions of 1 R and B pixels that decomposition levels are 1
HL compositions and HH compositions subband, i.e., altogether 3 subbands are that replicate data replaces target.That is, having and replacement
Suitable subband is selected in the subband of target equal priority, the subband that can make selection is more suitable subband.
Encoding stream forms the encoding stream that unit 112 is generated based on the control of the overflow control unit 113 of the present embodiment
1502 have less subband for being replicated data replacement, therefore, compared to the overflow control unit 113 based on first embodiment
Control and the encoding stream 1503 that generates, picture quality increases.
Figure 16 is the concept map for illustrating the structure of encoding stream in the present embodiment.Similar with Figure 15, here, decomposition levels are 1
The HH compositions of R and the HL compositions of B pixels that decomposition levels are 1 and HH compositions, i.e., altogether 3 subbands are considered as replicate data
Replace target.Encoding stream 1601 includes the coded data 1602 of the subband included in R pixel planes, and in B pixel planes
Comprising subband coded data 1603.Encoding stream forms the arrangement that unit 112 changes subband on encoding stream, and in decomposition etc.
Level for 1 B LH compositions after configure decomposition levels be 1 B HL compositions, replicate data collective is added to into coded data
End.
In the configuration of first embodiment, high-frequency sub-band be replicated in order data replacement, therefore generate encoding stream so as to
Replicate data is configured after coded data.However, in the present embodiment, encoding stream is generated so as to also match somebody with somebody after coded data
Put replicate data.
In above-mentioned mode by the priority packet of subband and make replicate data replace target sub-band be chosen, this can
There is provided such a camera head, its can after all sub-band codings for including in picture adjust encoding amount while,
By the degradation inhibiting of picture quality to minimum.
Note, the discarding coded data in units of subband for describing in a second embodiment also can be suitable for and this enforcement
Example.In addition, as in 3rd embodiment, the present embodiment can also be applied to the color system in addition to RGB, such as YUV.
5th embodiment
In the present embodiment, it is defeated after input picture buffer 104 keeps image for the configuration of first embodiment
Enter image and be divided into multiple rectangular tiles, wavelet transform is performed to each tile, is quantified and is encoded, overflow control unit
Perform control to and be easy to give priority to the subband of each tile, to determine that replicate data replaces target sub-band.Other block tools
There is the configuration similar to first embodiment.In the present embodiment, description input picture is divided into two tiles of left and right
Configuration is as an example.
Figure 17 is the concept map for representing the subband in the present embodiment after wavelet transform.Input picture 1701 is drawn
It is divided into the first tile 1701 and the second tile 1702.Wavelet transform process in from tile 1702 generate subband 1704,
And generate subband 1705 from tile 1703 in wavelet transform.Multiple watts are divided into by this way in input picture
In the case of piece, the subband of each tile is generated.
Figure 18 is the concept map for representing the priority of subband in the present embodiment.The priority of subband is implemented with first in tile
Example is similar.Priority in the same sub-band of each tile is identical.For example, include in B pixels in tile 1, grade
Subband for 1 HH compositions and include in B pixels in tile 2, the subband of the HH compositions that grade is 1 have it is identical
Priority.In addition, it is similar to first embodiment, with regard to the subband in each tile, give to subband in this example independent
Priority.
When it is determined that replicate data replaces target sub-band, overflow control unit 113 performs control according to the priority of subband,
So that the same sub-band in all tiles is considered to replace target by collective.When it is determined that replicate data replaces target sub-band, overflow
Go out control unit 113 and perform control so that include in B pixels in tile 1, the subband of the HH compositions that grade is 1 and
Include in B pixels in tile 2, grade is that the subband of 1 HH compositions is considered to replace target by collective first.Using multiple
It can be the process in Fig. 5 similar to first embodiment that data processed replace the process of subband, or with fourth embodiment phase
As process in Fig. 5 and Figure 14.By the way that the present embodiment is applied to into second and third embodiments, can be compiled in units of tile
Code.However, as it appears from the above, between tile subband corresponding with tile simultaneously by Collective choice to replace target, or collective not by
Select.
Figure 19 is the concept map of the structure for representing the present embodiment encoding stream.Here, coding in a case where is shown
The structure of stream：The grade included in R pixel planes and B pixel planes in tile 1 is the son of 1 LH compositions and HH compositions
Band and the grade included in R pixel planes and B pixel planes in tile 1 are 1 LH compositions and the subband quilt of HH compositions
It is considered that replicate data replaces target.If picture quality changes between tile, in tile boundaries distortion is seen.However,
By the overflow control unit 113 of the present embodiment, identical subband is replicated data collective and replaces in each tile, therefore
Picture quality is caused to suppress encoding amount while equably deterioration between tile, as a result the distortion in tile boundaries part can
It is eliminated.
Even if in the case where picture to be divided into multiple tiles, do so can also provide a kind of camera head, its energy
It is enough to adjust encoding amount after all sub-band codings for including in picture, the distortion without causing tile boundaries part.Separately
Outward, the present embodiment can also be applied in second to fourth embodiment combination.
Other embodiment
Can pass through to read and perform to record (also can more completely be referred to as " non-transitory computer-readable in storage medium
Storage medium ") on computer executable instructions (for example, one or more programs) to perform above-described embodiment in one or
More functions and/or the one or more electricity including the one or more function in for performing above-described embodiment
The system on road (for example, special IC (ASIC)) or the computer of device, also, can realizing embodiment of the disclosure
By using by for example being read by the computer of the system or device and perform from the storage medium it is described in terms of
Calculation machine executable instruction to perform above-described embodiment in one or more functions and/or control one or more
Many circuits perform the method for the one or more function in above-described embodiment to realize embodiments of the invention.The calculating
Machine can include one or more processors and one or more memorizer (for example, CPU (CPU), microprocessors
Unit (MPU)), and the network of separate computer or separate processor can be included, to read and perform the calculating
Machine executable instruction.The computer executable instructions for example can be provided to computer from network or the storage medium.
The storage medium can include such as hard disk, random access memory (RAM), read only memory (ROM), Distributed Calculation system
The memorizer of system, CD (such as compact disk (CD), digital versatile disc (DVD) or Blu-ray Disc (BD)TM), flash memory device with
And one of storage card etc. or more.
Other embodiments
Embodiments of the invention can also be realized by following method, i.e. by network or various storage mediums
The software (program) of function for performing above-described embodiment is supplied to into system or device, the computer of the system or device or in
The method that Central Processing Unit (CPU), microprocessing unit (MPU) read simultaneously configuration processor.
Although describing the present invention already in connection with exemplary embodiment, it should be appreciated that the invention is not limited in disclosure
Exemplary embodiment.The scope of following claims should be adapted to broadest interpretation, to include all modifications, equivalent knot
Structure and function.
Claims (19)
1. a kind of coded method, the coded method includes：
Wavelet transformation is performed to each composition of view data；
The data after conversion are encoded for each subband；And
It is determined that whether the editor-in-chief's code amount obtained by the coding of described image data exceedes threshold value, and if it is determined that total coding
Amount exceedes the threshold value, then replace coded data with tentation data or abandon coded data in units of the subband, so that
Editor-in-chief's code amount is less than or equal to the threshold value.
2. coded method according to claim 1, wherein,
In the determination, based on the priority for giving each subband, start in order from the subband with lowest priority,
Replaced with the tentation data or abandon the coded data, until editor-in-chief's code amount is less than or equal to the threshold value
Only.
3. coded method according to claim 1, wherein,
In the determination, based on the priority for giving every group of subband, even if in using the tentation data replacement group
In the case that editor-in-chief's code amount exceedes the threshold value during all subbands, start to use in order from the group with lowest priority
The tentation data replaces the coded data of all subbands in this set, and, it is less than or equal to institute in editor-in-chief's code amount
In the case of stating threshold value, in the subband of the group, start to utilize the predetermined number in order from the group with lowest priority
According to the coded data for replacing or abandoning subband, if the coded data of the subband is replaced by the tentation data, result will
It is editor-in-chief's code amount less than or equal to the threshold value and is maximum.
4. coded method according to claim 3, wherein,
The tentation data be added to by being encoded to described image data obtained by coded data end.
5. the coded method according to any one of claim 2-4, wherein,
The priority is determined according to the composition and frequency band of the subband.
6. coded method according to claim 5, wherein,
The frequency of the subband is lower, and the priority is higher.
7. the coded method according to any one of claim 1-4, wherein,
The composition of described image data includes RGB compositions.
8. the coded method according to any one of claim 2-4 or claim 6, wherein,
The composition includes luminance components and aberration composition, and,
Priority of the priority of the luminance components higher than the aberration composition.
9. the coded method according to any one of claim 2-4 or claim 6, wherein,
Described image data include the Bayer pixel being made up of 4 compositions G1, G2, R and B, and
G1 and G2 compositions have identical priority, and the priority of R component higher than the priority of B component.
10. the coded method according to any one of claim 2-4 or claim 6, wherein,
Described image data include the Bayer pixel being made up of G1, G2, R and B of 4 compositions, and
In the determination, the subband of the G1 and G2 compositions is not abandoned.
11. coded methods according to any one of claim 2-4 or claim 6, wherein,
The GH compositions of the radio-frequency component of described image data including G component, the Y compositions of the luminance components generated from R component, B into
Divide the GL compositions and U the and V compositions of aberration composition with the low-frequency component of G component, and
The priority is reduced according to the order of Y compositions, GH compositions, U compositions and V compositions.
12. coded methods according to claim 11, wherein,
The subband of the luminance components is not abandoned.
13. coded methods according to any one of claim 1-4 or claim 6, wherein,
The tentation data is by using the output in wavelet transformation, is configured to 0 wavelet conversion coefficient to the figure
Coded data obtained by being encoded as data.
14. coded methods according to any one of claim 1-4 or claim 6, wherein,
In the conversion, discrete wavelet transformer is carried out to described image data in units of constituting the tile of described image data
Change, and,
In the determination, if there is multiple tiles, then subband corresponding with the plurality of tile is by the tentation data collection
Body is replaced or collective abandons.
15. coded methods according to any one of claim 1-4 or claim 6, also include：
Encoding stream is generated, according to the subband that is arranged in order from low to high in the encoding stream.
16. coded methods according to claim 1, wherein,
In the determination, if the coded data is dropped, in the data head of the subband of the coded data being dropped
Predetermined information is set.
17. coded methods according to claim 1, wherein,
In the determination, if the coded data is dropped, would indicate that the coding of the subband of the coded data being dropped
The information of length is set to 0.
A kind of 18. decoding processing methods, the decoding process includes：
For each subband to being encoded by the multiple subbands to view data obtained from coded data perform decoding
Reason, and obtain coefficient data；And
Coefficient data to obtaining performs inverse wavelet transform, and obtains view data,
Wherein, if to will through decoding process wavelet provide tentation data, by the way that all coefficient datas are set to into 0,
Perform the inverse wavelet transform of wavelet.
19. decoding processing methods according to claim 18, wherein,
If to include the tentation data through the header of the wavelet of decoding process, by the way that all coefficient datas are set to
0, perform the inverse wavelet transform of wavelet.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2015209179A JP6722995B2 (en) | 2015-10-23 | 2015-10-23 | Encoding method, encoding device, imaging device, and program |
| JPJP2015-209179 | 2015-10-23 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106612432A true CN106612432A (en) | 2017-05-03 |
| CN106612432B CN106612432B (en) | 2019-11-15 |
Family
ID=58559380
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610921231.5A Active CN106612432B (en) | 2015-10-23 | 2016-10-20 | Coding method and decoding processing method |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US10638162B2 (en) |
| JP (1) | JP6722995B2 (en) |
| CN (1) | CN106612432B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108235038A (en) * | 2018-02-09 | 2018-06-29 | 西安万像电子科技有限公司 | The method and apparatus of image coding and decoding compression |
| CN112335244A (en) * | 2018-06-28 | 2021-02-05 | 苹果公司 | Priority-based video encoding and transmission |
| WO2022141515A1 (en) * | 2020-12-31 | 2022-07-07 | 深圳市大疆创新科技有限公司 | Video encoding method and device and video decoding method and device |
| US11451788B2 (en) | 2018-06-28 | 2022-09-20 | Apple Inc. | Rate control for low latency video encoding and transmission |
| US11653026B2 (en) | 2018-06-28 | 2023-05-16 | Apple Inc. | Video encoding system |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6986868B2 (en) * | 2017-06-19 | 2021-12-22 | キヤノン株式会社 | Image coding device, image decoding device, image coding method, image decoding method, program |
| JP7321237B2 (en) * | 2017-06-19 | 2023-08-04 | キヤノン株式会社 | Image encoding device, image encoding method, program |
| JP6978675B2 (en) * | 2018-01-25 | 2021-12-08 | 富士通株式会社 | Data compression device, data compression method and data compression program |
| CN108956767B (en) * | 2018-06-13 | 2020-11-24 | 天津大学 | Reinforced concrete corrosion fatigue damage evaluation method based on frequency-information entropy |
| JP7033013B2 (en) | 2018-06-15 | 2022-03-09 | キヤノン株式会社 | Image coding device, image decoding device, their control method, and program |
| JP7242246B2 (en) * | 2018-10-31 | 2023-03-20 | キヤノン株式会社 | Image encoding device, control method thereof, and program |
| US10939138B1 (en) | 2019-01-30 | 2021-03-02 | Vulcan Inc. | Quality control engine for video decompression |
| US11470355B1 (en) | 2019-01-30 | 2022-10-11 | Vulcan Inc. | Quality control engine for video compression |
| US11134276B1 (en) * | 2019-01-30 | 2021-09-28 | Vulcan Inc. | Key and difference block video decompression |
| US10979737B1 (en) | 2019-01-30 | 2021-04-13 | Vulcan Inc. | Key and difference block video compression |
| KR20210052095A (en) * | 2019-10-31 | 2021-05-10 | 삼성전자주식회사 | Image encoder, image decoder, and method for image encoding and image decoding |
| JP2022034409A (en) * | 2020-08-18 | 2022-03-03 | キヤノン株式会社 | Image encoding device, control method of the same, and program |
| JP2022122682A (en) * | 2021-02-10 | 2022-08-23 | キヤノン株式会社 | Image encoding device and control method thereof, and program |
| CN116896645B (en) * | 2023-09-11 | 2024-01-12 | 东莞市京品精密模具有限公司 | Lithium battery tab mold production online monitoring system based on cloud computing |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6154493A (en) * | 1998-05-21 | 2000-11-28 | Intel Corporation | Compression of color images based on a 2-dimensional discrete wavelet transform yielding a perceptually lossless image |
| US20010028748A1 (en) * | 2000-03-30 | 2001-10-11 | Makoto Sato | Image processing apparatus and method |
| US20040136596A1 (en) * | 2002-09-09 | 2004-07-15 | Shogo Oneda | Image coder and image decoder capable of power-saving control in image compression and decompression |
| JP2004297195A (en) * | 2003-03-25 | 2004-10-21 | Minolta Co Ltd | Image data transmission apparatus |
| US20040264785A1 (en) * | 2003-06-27 | 2004-12-30 | Tooru Suino | Image coding apparatus, program, storage medium and image coding method |
| US20050111740A1 (en) * | 2003-09-05 | 2005-05-26 | Hiroyuki Sakuyama | Coding apparatus, coding method, program and information recording medium that can suppress unnatural degradation of image quality |
Family Cites Families (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2263373B (en) * | 1992-01-09 | 1995-05-24 | Sony Broadcast & Communication | Data error concealment |
| JPH06178287A (en) * | 1992-12-02 | 1994-06-24 | Matsushita Electric Ind Co Ltd | Picture coder |
| US5748245A (en) * | 1993-03-29 | 1998-05-05 | Canon Kabushiki Kaisha | Encoding apparatus for encoding input information data while controlling a code quantity of encoded information data |
| JPH09139944A (en) * | 1995-09-12 | 1997-05-27 | Matsushita Electric Ind Co Ltd | Coding method, coder, wavelet converter and wavelet inverse converter |
| GB2366467B (en) * | 2000-08-23 | 2003-11-26 | Motorola Inc | Mobile terminal battery power conservation |
| TW567728B (en) * | 2001-02-20 | 2003-12-21 | Sanyo Electric Co | Method and apparatus for decoding graphic image |
| US20050078873A1 (en) * | 2003-01-31 | 2005-04-14 | Cetin Ahmet Enis | Movement detection and estimation in wavelet compressed video |
| US7200277B2 (en) * | 2003-07-01 | 2007-04-03 | Eastman Kodak Company | Method for transcoding a JPEG2000 compressed image |
| US7574063B2 (en) * | 2003-07-23 | 2009-08-11 | Canon Kabushiki Kaisha | Image coding method and apparatus |
| US20050141774A1 (en) * | 2003-12-30 | 2005-06-30 | Eastman Kodak Company | Image compression utilizing discarding of bitplanes |
| US8363717B2 (en) | 2005-05-17 | 2013-01-29 | Canon Kabushiki Kaisha | Image processing apparatus |
| US8059712B2 (en) * | 2006-01-13 | 2011-11-15 | Adobe Systems Incorporated | Independently adjusting the quality levels for luminance and chrominance channels in a digital image |
| JPWO2008093698A1 (en) * | 2007-01-31 | 2010-05-20 | ソニー株式会社 | Information processing apparatus and method |
| JP2008228208A (en) | 2007-03-15 | 2008-09-25 | Ricoh Co Ltd | Image encoding method, image encoding device, image encoding circuit, information recording medium, and computer program |
| US8294811B2 (en) * | 2009-08-04 | 2012-10-23 | Aptina Imaging Corporation | Auto-focusing techniques based on statistical blur estimation and associated systems and methods |
| JP5114462B2 (en) * | 2009-08-28 | 2013-01-09 | 京セラドキュメントソリューションズ株式会社 | Image compression apparatus and image compression program |
| US20120057800A1 (en) * | 2010-09-08 | 2012-03-08 | Guleryuz Onur G | Geometrical image representation and compression |
| JP5947641B2 (en) | 2012-07-06 | 2016-07-06 | キヤノン株式会社 | Moving picture coding apparatus, control method therefor, and computer program |
| US8879858B1 (en) * | 2013-10-01 | 2014-11-04 | Gopro, Inc. | Multi-channel bit packing engine |
| US9674554B2 (en) * | 2014-10-28 | 2017-06-06 | Sony Corporation | Image processing system with coding mode and method of operation thereof |
-
2015
- 2015-10-23 JP JP2015209179A patent/JP6722995B2/en active Active
-
2016
- 2016-10-17 US US15/295,249 patent/US10638162B2/en active Active
- 2016-10-20 CN CN201610921231.5A patent/CN106612432B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6154493A (en) * | 1998-05-21 | 2000-11-28 | Intel Corporation | Compression of color images based on a 2-dimensional discrete wavelet transform yielding a perceptually lossless image |
| US20010028748A1 (en) * | 2000-03-30 | 2001-10-11 | Makoto Sato | Image processing apparatus and method |
| US20040136596A1 (en) * | 2002-09-09 | 2004-07-15 | Shogo Oneda | Image coder and image decoder capable of power-saving control in image compression and decompression |
| JP2004297195A (en) * | 2003-03-25 | 2004-10-21 | Minolta Co Ltd | Image data transmission apparatus |
| US20040264785A1 (en) * | 2003-06-27 | 2004-12-30 | Tooru Suino | Image coding apparatus, program, storage medium and image coding method |
| US20050111740A1 (en) * | 2003-09-05 | 2005-05-26 | Hiroyuki Sakuyama | Coding apparatus, coding method, program and information recording medium that can suppress unnatural degradation of image quality |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108235038A (en) * | 2018-02-09 | 2018-06-29 | 西安万像电子科技有限公司 | The method and apparatus of image coding and decoding compression |
| CN108235038B (en) * | 2018-02-09 | 2020-09-11 | 西安万像电子科技有限公司 | Method and device for image coding, decoding and compressing |
| CN112335244A (en) * | 2018-06-28 | 2021-02-05 | 苹果公司 | Priority-based video encoding and transmission |
| US11451788B2 (en) | 2018-06-28 | 2022-09-20 | Apple Inc. | Rate control for low latency video encoding and transmission |
| US11496758B2 (en) | 2018-06-28 | 2022-11-08 | Apple Inc. | Priority-based video encoding and transmission |
| CN112335244B (en) * | 2018-06-28 | 2022-12-23 | 苹果公司 | Priority-based video encoding and transmission |
| US11653026B2 (en) | 2018-06-28 | 2023-05-16 | Apple Inc. | Video encoding system |
| WO2022141515A1 (en) * | 2020-12-31 | 2022-07-07 | 深圳市大疆创新科技有限公司 | Video encoding method and device and video decoding method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106612432B (en) | 2019-11-15 |
| US20170118491A1 (en) | 2017-04-27 |
| JP6722995B2 (en) | 2020-07-15 |
| JP2017085247A (en) | 2017-05-18 |
| US10638162B2 (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106612432B (en) | Coding method and decoding processing method | |
| US9838715B2 (en) | Image processing apparatus and method | |
| JP5152598B2 (en) | Encoding apparatus, encoding method, decoding apparatus, and decoding method | |
| CA2615299C (en) | Image encoding device, image decoding device, image encoding method, and image decoding method | |
| CN103535037B (en) | Image processing apparatus and image processing method | |
| CN108271024B (en) | Image coding and decoding method and device | |
| CN109076226A (en) | Image processing apparatus and method | |
| CN101044510A (en) | Film grain simulation method | |
| US20080285874A1 (en) | Method and apparatus for processing image data | |
| TW201836353A (en) | Method, apparatus and system for encoding and decoding video data | |
| WO2018001208A1 (en) | Encoding and decoding method and device | |
| US20220116617A1 (en) | Transform coefficient coding method and device therefor | |
| US7120306B2 (en) | Image processing method and image coding apparatus utilizing the image processing method | |
| JP6986868B2 (en) | Image coding device, image decoding device, image coding method, image decoding method, program | |
| JP6857970B2 (en) | Image coding device and its control method | |
| CN110476427A (en) | Code device and coding method and decoding apparatus and coding/decoding method | |
| CN113994685A (en) | Exchanging information in scalable video coding | |
| TW202002654A (en) | Coefficient coding with grouped bypass bins | |
| US20180176579A1 (en) | Methods and devices for encoding and decoding frames with a high dynamic range, and corresponding signal and computer program | |
| JP7033013B2 (en) | Image coding device, image decoding device, their control method, and program | |
| JP6849359B2 (en) | Coding device, coding device control method, and program | |
| JP6465570B2 (en) | IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD | |
| US9049432B1 (en) | Motion differential set partition coding for color image sequence compression | |
| JP6465571B2 (en) | IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD | |
| JP7242246B2 (en) | Image encoding device, control method thereof, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |