CN102300090B - Encoding device, imaging device, coding send system and coded method - Google Patents
Encoding device, imaging device, coding send system and coded method Download PDFInfo
- Publication number
- CN102300090B CN102300090B CN201110176610.3A CN201110176610A CN102300090B CN 102300090 B CN102300090 B CN 102300090B CN 201110176610 A CN201110176610 A CN 201110176610A CN 102300090 B CN102300090 B CN 102300090B
- Authority
- CN
- China
- Prior art keywords
- coding
- data
- image data
- view data
- moving image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
A kind of encoding device includes: obtain part, is configured to obtain the motion image data of a plurality of view data including to reproduce with set rate;Determine part, it is configured to determine whether the coding of each of described view data of the described motion image data separately won by described obtaining portion is necessary, and exports instruction and be set to the view data of coded object or be not set to the indication signal of view data of coded object;And coding executable portion, it is configured to provide for described indication signal, and has encoded, while reducing view data discretely according to the described determination determining part, a plurality of view data separately won by described obtaining portion.
Description
Technical field
It relates to be used for including encoding device and the coded method of the motion image data of a plurality of view data.
Background technology
Motion image data (Japanese Patent Publication No.2008-of a plurality of view data is included by encoding device coding
236789 and 2000-050254 (hereinafter referred to as patent documentations 1 and 2)).
Encoding device comes by meeting the coding system such as MPEG (Motion Picture Experts Group) 1,2 or 4, the standard such as H.264
Encoded moving image data.
Such as, encoding device adjusts such as the quantization parameter of Qp value etc. according to coding situation, inserts and skip in units of macro block
Data (skip data), or in units of frame, insert skipped frame data.
Thus encoding device performs coded treatment while adjusting the data volume of encoded moving image data.
Summary of the invention
But, such encoding device may abandon frame data according to coding situation so that encoded moving image data is
Predetermined amount of data.
Such as, when encoding device predictive coding motion image data while multiple frames of encoding moving pictures in order
When will exceed predetermined transmission data volume, encoding device skips the frame data processed or next frame data.
Additionally, in patent documentation 1, determine frame to be skipped based on the relation with frame before and frame afterwards.
Additionally, in patent documentation 2, determine frame to be skipped by judgement based on object video etc..
When thereby determining that, according to coding situation etc., the frame data not encoded, lose encoded motion figure with irregular interval
Frame data as data.
When reproducing the motion image data with the frame data so lost with irregular interval, frame period is unstable
Fixed, therefore such situation occurs, wherein during reproducing, image changes suddenly or image stops a little while.
When there is such situation, spectators have incongruity for the moving image reproduced.
Therefore, it is desirable to encoding device reduces inharmonious (unnatural) sense of spectators, this inharmonious (unnatural) sense is with compiling
The discontinuity of code motion image data.
According to disclosure first embodiment, it is provided that a kind of encoding device, including: obtain part, be configured to acquisition and include
The motion image data of a plurality of view data that can reproduce with set rate;Determine part, be configured to determine by described acquisition
Whether the coding of each of the described view data of the described motion image data that part obtains is necessary, and exports instruction
The view data being set to coded object or the indication signal of the view data not being set to coded object;And coding enforcement division
Point, it is configured to provide for described indication signal, and reduces view data discretely according to the described determination determining part
Encode a plurality of view data separately won by described obtaining portion simultaneously.Described determine that part determines each 's of view data
Whether coding is necessary so that by a plurality of view data in the encoded moving image data of described coding executable portion coding
Reproduction interval stable.
According to first embodiment, described determine that part determines whether the coding of each of view data is necessary so that
Stable by the reproduction interval of a plurality of view data in the encoded moving image data of described coding executable portion coding.
Additionally, described coding executable portion is reducing the same of view data discretely according to the described determination determining part
Time, a plurality of view data that coding is separately won by described obtaining portion.
Therefore, the reproduction interval of a plurality of view data in encoded moving image data is stabilized.
According to the disclosure the second embodiment, it is provided that a kind of imaging device, including: imaging moiety, it is configured as output to include
The motion image data of a plurality of view data by obtaining with set rate imaging;And coded portion, it is configured to encode institute
State motion image data.Described coded portion includes: obtain part, is configured to obtain the described fortune exported from described imaging moiety
Video data;Determine part, be configured to determine the described figure of the described motion image data separately won by described obtaining portion
As whether the coding of each of data is necessary, and export instruction and be set to the view data of coded object or be not set to compile
The indication signal of the view data of code object;And coding executable portion, it is configured to provide for described indication signal, and at root
Encode, while reducing view data discretely according to the described determination determining part, the multiple bar chart separately won by described obtaining portion
As data.Described determine that part determines whether the coding of each of view data is necessary so that performed by described coding
The reproduction interval of a plurality of view data in the encoded moving image data of code segment is stable.
According to the disclosure the 3rd embodiment, it is provided that a kind of coding transmission system, including: coded portion, it is configured to coding
Motion image data including a plurality of view data by obtaining with set rate imaging;Transmitting portion, is configured to send and leads to
Cross the encoded moving image data of described coded portion coding;Receiving portion, is configured to reception and is sent by described transmitting portion
Encoded moving image data;And decoded portion, it is configured to the encoding moving pictures that decoding is received by described receiving portion
Data.Described coded portion includes: obtain part, is configured to obtain the described motion image data from imaging moiety output;Really
Determine part, be configured to determine each of described view data of the described motion image data separately won by described obtaining portion
Coding whether be necessary, and export instruction be set to the view data of coded object or be not set to the picture number of coded object
According to indication signal;And coding executable portion, it is configured to provide for described indication signal, and determines part according to described
Determination reduce view data discretely while encode a plurality of view data separately won by described obtaining portion.Described determine
Part determines whether the coding of each of view data is necessary so that transported by the coding of described coding executable portion coding
The reproduction interval of a plurality of view data in video data is stable.
According to the disclosure the 4th embodiment, it is provided that a kind of coded method, including: include acquisition part, determine part and
The described obtaining portion of the encoding device of coding executable portion separately wins to obtain motion image data, and described encoding device is configured to coding bag
Include the motion image data of a plurality of view data that can reproduce with set rate;Described determine that part determines the described motion of acquisition
Whether the coding of each of the described view data of view data is necessary;And described coding executable portion is according to described
The figure of the described motion image data of acquisition is encoded while determining the view data reducing described motion image data discretely
As data.Described determine that part determines whether the coding of each of view data is necessary so that encoded moving image data
In the reproduction interval of a plurality of view data stable.
According to the disclosure, in encoded moving image data, it is not easy to occur discontinuity, and can reduce spectators'
Inharmonious (unnatural) is felt.
Accompanying drawing explanation
Fig. 1 is the schematic block diagram of the encoding device according to disclosure first embodiment;
Fig. 2 is the block diagram of the computer equipment for realizing the encoding device in Fig. 1;
Fig. 3 is to aid in illustrating the figure of the example of the motion image data of the encoding device coding in Fig. 1 to be passed through;
Fig. 4 is the flow chart of the operation of the importation in Fig. 1;
Fig. 5 is the block diagram of the Video coding executable portion in Fig. 1;
Fig. 6 is by the flow chart to the encoding operation that every frame data are carried out of the Video coding executable portion in Fig. 1;
Fig. 7 is the flow chart of the coding-control operation of the coding-control part in Fig. 1;
The figure of the coding-control operation of the coding-control part that Fig. 8 is to aid in Fig. 1;
Fig. 9 represents that the initialization of the encoding device in Fig. 1 processes sequence;
The coding-control part that Figure 10 A and 10B is to aid in explanatory diagram 1 exports the coding of Video coding executable portion and deposits
Or there is not the figure of information;
Figure 11 represents the typical coded treatment sequence of the importation in Fig. 1 and Video coding executable portion;
Figure 12 represents when the coding-control part in Fig. 1 starts coded treatment sequence when controlling;
Figure 13 represents that the coding-control part in Fig. 1 starts the coded treatment sequence after controlling;
Figure 14 A, 14B and 14C are changing of the data volume of the motion image data of the encoding device coding being shown through in Fig. 1
The figure of the example become;
Under Figure 15 A and 15B is to aid in illustrating to be carried out by coding-control part when encoded moving image data underflow
Suppression of overflowing controls the figure of operation;
Figure 16 A and 16B is to aid in explanation when encoded moving image data overflows by overflowing that coding-control part is carried out
Go out suppression and control the figure of operation;
Figure 17 A and 17B is to aid in the first example of the motion image data that explanation is encoded by the encoding device in Fig. 1
Figure;
Figure 18 A and 18B is to aid in the second example of the motion image data that explanation is encoded by the encoding device in Fig. 1
Figure;
Figure 19 A and 19B is to aid in the 3rd example of the motion image data that explanation is encoded by the encoding device in Fig. 1
Figure;
Figure 20 A and 20B is to aid in the 4th example of the motion image data that explanation is encoded by the encoding device in Fig. 1
Figure;
Figure 21 A and 21B is to aid in the 5th example of the motion image data that explanation is encoded by the encoding device in Fig. 1
Figure;
Figure 22 A and 22B is to aid in illustrating the figure (the first example) of the post-processing operation by the output part in Fig. 1;
Figure 23 A and 23B is to aid in illustrating the figure (the second example) of the post-processing operation by the output part in Fig. 1;
Figure 24 is the schematic block diagram illustrating the coding transmission system according to the disclosure the second embodiment;And
Figure 25 is to aid in illustrating when by H.264 system or MPEG-2 system coding by the coding of coding-control part
Control the figure of operation.
Detailed description of the invention
Hereinafter, preferred embodiment of the present disclosure will be described with reference to the drawings.
To be described in the following order.
1. first embodiment (example of encoding device)
2. the second embodiment (there is the example of the coding transmission system of imaging device)
1. first embodiment
[configuration of encoding device 1]
Fig. 1 is the schematic block diagram of the encoding device 1 according to disclosure first embodiment.
Encoding device 1 coding input motion image data in Fig. 1.
Encoding device 1 in Fig. 1 includes that input motion image data storing part 10, importation 11, coding situation are deposited
Storage part 13, coding-control part 14, Video coding executable portion 15, output part 16 and output motion image data storage part
Divide 17.
Fig. 2 is the block diagram of the computer equipment 100 for realizing the encoding device 1 in Fig. 1.
Computer equipment 100 in Fig. 2 has CPU (CPU) 101, memorizer (MEM) 102 and input and output
Partly (I/O) 103.
Memorizer 102 stores encoding procedure.
In memorizer 102, the encoding procedure of storage can be stored in memorizer 102 before the shipment of computer equipment 100
In, or can store in the memory 102 after the shipment of computer equipment 100.
Storing encoding procedure in the memory 102 after the shipment of computer equipment 100 such as can be by reading record
Encoding procedure on a computer readable recording medium or download via transmission medium (such as the Internet etc.) and obtain.
CPU 101 reads and performs the encoding procedure of storage in memorizer 102.
Therefore, in CPU 101, realize the importation 11 in Fig. 1, Video coding executable portion 15 and output part 16.
Additionally, realize input motion image data storing part 10, output motion image data storage in the memory 102
Part 17 and coding situation storage part 13.
Conveniently mention, in fig. 2, the motion image data of input coding equipment 1 such as inputs from input/output section 103
And store in the memory 102.
Additionally, the encoded moving image data generated by encoding device 1 is stored in the memory 102, and hereafter from
Input/output section 103 output is to outside.
Input motion image data storing part 10 in Fig. 1 stores input motion view data 21 and input data information
22。
The example of the input motion view data 21 of encoding device 1 coding that Fig. 3 is to aid in explanation Fig. 1 to be passed through
Figure.
Input motion view data 21 in Fig. 3 has a plurality of frame data 23.
Frame data 23 in Fig. 3 are can the view data of still image that reproduces of a frame rate.A plurality of frame in Fig. 3
Data 23 start to reproduce from the frame in left side the most in order.
Motion image data in Fig. 3 such as encodes in units of three frames.The unit of this coded treatment is referred to as GOP (picture
Group).
In the example of fig. 3, the first frame that the left side from each GOP starts is encoded to I (internal) picture.Second frame is compiled
Code is B (bi-directional predicted) picture.3rd frame is encoded to P (prediction) picture.
Input data information 22 is the information about input motion view data 21.
Such information such as includes the information of the frame rate about input motion view data 21 and about obtaining input
The information of the shooting environmental of motion image data 21.
In FIG, importation 11 is connected to input motion image data storing part 10 and Video coding executable portion
15。
Importation 11 obtains input motion view data 21 and input number from input motion image data storing part 10
It is believed that breath 22.
Every frame data 23 of the input motion view data 21 of acquisition are exported Video coding and perform by importation 11
Part 15.
Now, importation 11 frame rate based on input motion view data 21 determines the outlet chamber of every frame data 23
Every, this frame rate is based on input data information 22, and performs to Video coding with this output gap a plurality of frame data of output 23
Part 15.
Fig. 4 is the flow chart of the operation of the importation 11 in Fig. 1.
Fig. 4 is that such as in importation 11, the input/output section 103 from Fig. 2 obtains input motion view data 21 He
Flow chart in the case of input data information 22.
Obtaining input motion view data 21 and input data information 22, importation 11 is by input motion view data 21
It is stored in input motion image data storing part 10 with input data information 22.Additionally, importation 11 is at input motion
Storage coding presence or absence information (step ST1) in image data storing part 10.
The initial code information 24 that coding situation storage part 13 storage in Fig. 1 pre-sets is as input motion
The coding situation of view data 21.
Conveniently mention, initial code information 24 can be arranged in advance in encoding device 1, or such as can be via Fig. 2
In input/output section 103 from outside input.
Initial code information 24 includes such as encoding required information, such as overview, level (level), encoding moving pictures
The bit rate of data, GOP length, the frame period etc. of encoded moving image data.
Such as, the number of frames (amount of images) that one GOP of GOP Length Indication includes.
Such as, frame period is the record frame rate when recording motion image data.
Coding-control part 14 is connected to input motion image data storing part 10, coding situation storage part 13 and regards
Frequency coding executable portion 15.
Coding-control part 14 is based on the input data information 22 in input motion image data storing part 10 and coding
Initial code information 24 in situation storage part 13, output indication signal is to Video coding executable portion 15.
Such as, coding-control part 14 frame rate based on input motion view data 21 and the frame of initial code information 24
Speed, the initial frame rate of instruction coding in Video coding executable portion 15.
Additionally, such as in each cycle of GOP length, coding-control part 14 is based on from Video coding executable portion 15
The notification signal of input, determines the situation of coding by Video coding executable portion 15.
Additionally, coding-control part 14 is according to determining that result updates the content of indication signal.
Such as, coding-control part 14 compares the data of the motion image data by Video coding executable portion 15 coding
Measure and be defined as to store the data volume of the buffer 37 of the buffer of encoded moving image data, and indication signal is updated to
Content corresponding to the relation between these data volumes.
Coding-control part 14 indicates every frame data 23 of input image data to be set to the view data of coded object
Again without the view data being set to coded object.
Video coding executable portion 15 is connected to importation 11, output part 16, coding situation storage part 13 and compiles
Code controls part 14.
Video coding executable portion 15 encodes the frame data 23 from importation 11 input, and exports the frame data of coding
23 to output part 16.
Now, Video coding executable portion 15 based on coding situation storage part 13 in storage initial code information 24,
From indication signal and coding situation (data volume etc. of encoded moving image data) of coding-control part 14 input, the most really
Whether the coding of framing data 23 is necessary.
Additionally, Video coding executable portion 15 determines frame coding system, parameter (encoding variable) etc. independently.
Then, Video coding executable portion 15 is according to the determination of Video coding executable portion 15 self, and coding is from input unit
Divide the frame data 23 of 11 inputs, and the frame data 23 of coding are exported part 16.
Additionally, Video coding executable portion 15 is corresponding in each cycle of GOP length, output is transported for informed code
The notification signal of the data volume of video data is to coding-control part 14.
Fig. 5 is the block diagram of the Video coding executable portion 15 in Fig. 1.
Video coding executable portion 15 in Fig. 5 is by MPEG-4 visual system encoded moving image data.
Video coding executable portion 15 in Fig. 5 has the first frame memory 31, motion vector detection 32, subtractor
33, DCT (discrete cosine transform) unit 34 and quantizer 35.
Video coding executable portion 15 in Fig. 5 also has VLC (variable length code) unit 36 and buffer 37.
Video coding executable portion 15 in Fig. 5 also has inverse quantizer 38, IDCT (inverse DCT) unit the 39, second frame is deposited
Reservoir 40 and motion compensator 41.
First frame memory 31 stores image based on the frame data 23 inputted from importation 11.
Motion vector detection 32 is connected to the first frame memory 31.
Motion vector detection 32 detects for another for the newly encoded object images of storage in the first frame memory 31
The motion vector of the object that the image of frame data 23 is common.
Subtractor 33 is connected to the first frame memory 31 and motion compensator 41.Subtractor 33 is from the first frame memory 31
Storage figure image subtraction the second frame memory 40 in storage and from the figure obtained by the compensation deals of motion compensator 41
Picture.
DCT unit 34 is connected to subtractor 33.DCT unit 34 is made from the figure obtained by the difference operation of subtractor 33
Each predetermined block experience discrete cosine transform of picture.
Quantizer 35 is connected to DCT unit 34.Quantizer 35 quantifies the DCT coefficient of each frequency band, and this coefficient is mono-by DCT
The unit 34 discrete cosine transform in each piece obtains.
VLC unit 36 is connected to quantizer 35.VLC unit 36 makes the DCT coefficient data warp quantified by quantizer 35
Go through variable length code.Coded data is exported buffer 37 by VLC unit 36.
Thus buffer 37 stores the frame data 23 of coding.The frame data 23 of coding export Fig. 1's from this buffer 37
Output part 16.
VLC unit 36 is also connected to motion vector detection 32.VLC unit 36 will be examined about by motion vector detection 32
The data of the motion vector surveyed export buffer 37.
Additionally, in a series of coded treatment, DCT unit 34, quantizer 35 and VLC unit 36 read coding-control part
Initial code information 24 in the indication signal of 14 and coding situation storage part 13.
DCT unit 34, quantizer 35 and VLC unit 36 indication signal based on coding-control part 14 and coding situation are deposited
Initial code information 24 in storage part 13, such as adjustment block size, degree of quantization and coded method.
The data volume of the frame data 23 of the coding of storage in read buffers 37 gone back by quantizer 35.
Quantizer 35 judges based on the independence according to data volume, such as, determine whether the coding of frame data 23 is necessary.
Inverse quantizer 38 is connected to quantizer 35.The inverse quantizer 38 DCT coefficient after being quantified by quantizer 35 generates to be used
DCT coefficient in the frame data 23 quantified.
IDCT unit 39 is connected to inverse quantizer 38.IDCT unit 39 generates from the DCT coefficient generated by inverse quantizer 38
The image of the frame data 23 quantified.
Second frame memory 40 stores the image of the frame data 23 quantified.
Motion compensator 41 is connected to motion vector detection 32 and the second frame memory 40.
Motion compensator 41, based on the motion vector detected by motion vector detection 32, generates by mobile second frame
The image that in memorizer 40, the image of storage obtains.
Output part 16 in Fig. 1 is connected to Video coding executable portion 15 and output motion image data storage part
17。
The frame data 23 of the coding inputted from Video coding executable portion 15 are stored in output moving image by output part 16
Data storage section 17.
Thus export motion image data storage part 17 and store the frame data by Video coding executable portion 15 coding
23。
Output motion image data storage part 17 storage obtains as by the identical input motion view data 21 of coding
The first output data 25 of motion image data and the second output data 26, as shown in Figure 3.
[encoding operation of the coding executable portion in Fig. 1]
Fig. 6 is by the flow process to the encoding operation that every frame data 23 are carried out of the Video coding executable portion 15 in Fig. 1
Figure.
Each time when the incoming frame data 23 of importation 11, Video coding executable portion 15 is according to incoming frame data 23
Frame rate performs the coded treatment of Fig. 6.
In the coded treatment for every frame data 23, Video coding executable portion 15 first determines whether to encode and is compiling
The frame data 23 (step ST11) that code relates in processing.
Such as, when not encoding the indication signal of described frame data 23 from coding-control part 14 input instruction, video is compiled
Not coded frame data 23 are determined in code executable portion 15 principle.
But, when Video coding executable portion 15 reads the data volume and really of the frame data 23 of coding from buffer 37
Settled buffer 37 is by time emptying when not encoding described frame data 23, and Video coding executable portion 15 determines wants coded frame data
23。
Additionally, such as when to encode the indication signal of described frame data 23 from coding-control part 14 input instruction, depending on
Determine in frequency coding executable portion 15 principle and want coded frame data 23.
But, when Video coding executable portion 15 reads the data volume and really of the frame data 23 of coding from buffer 37
When during settled coding described frame data 23, buffer 37 will become full, Video coding executable portion 15 determines not coded frame data 23.
When determine want coded frame data 23 time, Video coding executable portion 15 performs the process (step of coded frame data 23
ST12)。
Video coding executable portion 15 exports the frame data 23 (step ST13) of coding from the buffer 37 of Fig. 5.
Additionally, Video coding executable portion 15 calculates and stores the data volume (step ST14) of the frame data 23 of coding.
After coded frame data 23, Video coding executable portion 15 determines that the most whether the process timing of described frame data 23 is
Output notice signal is to the timing (step ST15) of encoding controller.
Equally, when the frame data 23 as coded treatment object do not encode, Video coding executable portion 15 determines institute
Whether processing of the frame data 23 stated is regularly the timing (step ST15) to encoding controller of the output notice signal.
Such as, when the GOP according to the unit as three frames as shown in Figure 2 performs coding, such as Video coding performs
Part 15 determines that the timing of output notice signal arrives when encoding the last P picture of each GOP.Video coding executable portion 15
Determine that the timing of output notice signal does not arrive when encoding other pictures.
When the timing of output notice signal arrives, Video coding executable portion 15 is by the data volume of the frame data 23 of coding
Notice is to encoding controller (step ST16).In the case of figure 2, Video coding executable portion 15 is constituted at coding three frame
During the last P picture of each GOP, notify to set to coding-control by the total amount of data of three frame data 23 of coding in each GOP
Standby.
Video coding executable portion 15 thus terminate coded treatment.Additionally, when the timing of output notice signal does not arrive
Time, Video coding executable portion 15 terminates coded treatment.
[the coding-control operation of the coding-control part 14 in Fig. 1]
Fig. 7 is the flow chart of the coding-control operation of the coding-control part 14 in Fig. 1.
Such as, coding-control part 14 performs Fig. 7's when inputting notification signal from Video coding executable portion 15 every time
Coding-control operates.In the example of fig. 6, Video coding executable portion 15 is the most encoded each in Video coding executable portion 15
During the final picture of GOP, output notice signal is to coding-control part 14.
In coding-control operates, first coding-control part 14 compares encoding amount and the predetermined buffer model 51 of acquisition
In threshold value (step ST21).
Then, coding-control part 14 comparative result based on encoding amount determines frame data to be encoded in scheduled time slot
The ratio of 23, and the frame data 23 of coded object to be set to are selected according to this ratio a plurality of frame data 23 in scheduled time slot
(step ST22).
Then, coding-control part 14 exports the finger of scheduled time slot and the frame data 23 indicating the selection being set to coded object
Show that signal is to Video coding executable portion 15 (step ST23).Coding-control part 14 such as indicates input motion view data 21
GOP length and described GOP in be set to the frame data 23 of coded object or be not set to the frame data 23 of coded object.
The figure of the coding-control operation of the coding-control part 14 that Fig. 8 is to aid in Fig. 1.
Fig. 8 illustrates the Buffer Model 51 meeting MPEG-4 video standard.Coordinate axes instruction is surplus in Buffer Model 51
Remaining data volume.Conveniently mention, the buffer 37 in Fig. 5 is corresponding to Buffer Model 51.
Conveniently mention, remaining data are referred to be encoded by Video coding executable portion 15 but are not output portion in rear class
Divide the data of 16 process.
VBV (video buffer checker) in Fig. 8 is the buffer occupancy amount defined in MPEG-4 video standard.According to
MPEG-4 video standard, it is desirable to control the amount of coded data so that in Buffer Model 51, remaining data volume falls in VBV value
In the range of 0% to 100%.
When buffer occupancy amount is 0%, Buffer Model 51 is full, and is in underflow condition.
When buffer occupancy amount is 100%, Buffer Model 51 is empty, and is in overflow status.
When in the Video coding executable portion 15 prediction buffer model 51 in Fig. 1, remaining data volume will become to be less than
VBV value 0% time, such as, according to Video coding executable portion 15, Video coding executable portion 15 self judges that execution is used for
Reduce the control of data volume.Such as, Video coding executable portion 15 stops according to self judgement of Video coding executable portion 15
And the coding of skipped frame data 23.
Additionally, work as remaining data volume in Video coding executable portion 15 prediction buffer model 51 will become more than VBV
Value 100% time, according to Video coding executable portion 15, Video coding executable portion 15 self judges that execution is used for increasing number
Control according to amount.Such as, according to Video coding executable portion 15, Video coding executable portion 15 self judges that coding to be skipped
Frame data 23.
On the other hand, coding-control part 14 based on spillover alleviation threshold value 52, VBV value 80% threshold value 53, VBV value
The threshold value 54 of 40% and underflow suppression threshold value 55, control the encoding operation of Video coding executable portion 15.
Spillover alleviation threshold value 52 is arranged between the threshold value 53 of the 80% of VBV value and VBV value.
Underflow suppression threshold value 55 is arranged between the threshold value 54 of 40% of zero-sum VBV value.
Conveniently mention, these values are such as stored in coding situation storage part 13 as initial code information 24.Additionally,
Each value suitably can be arranged by changing initial code information 24.
When remaining data amount is in the range of 80% to the 40% of VBV value, the uncomfortable whole encoding amount of coding-control part 14.
Coding-control part 14 exports indication signal to Video coding executable portion 15, and this indication signal has and exported video
Encode the content that the indication signal of executable portion 15 is identical.
On the other hand, when remaining data amount is not in the range of 80% to the 40% of VBV value, coding-control part 14 is adjusted
Whole encoding amount.Coding-control part 14 exports indication signal to Video coding executable portion 15, and this indication signal has with
Export the content that the indication signal of Video coding executable portion 15 is different.
Specifically, in the case of fig. 8, the scope of spillover alleviation threshold value 52 is arrived when remaining data amount in the 80% of VBV value
Time interior, coding-control part 14 adjusts encoding amount so that encoding amount is reduced one-level.Such as, coding-control part 14 will timing in advance
Section (GOP length) extends one-level, or bar number or the ratio of frame data 23 to be encoded in GOP are reduced one-level.
Additionally, when remaining data amount is in the range of the 100% of spillover alleviation threshold value 52 to VBV value, coding-control portion
Divide 14 adjustment encoding amounts so that encoding amount is reduced two-stage.Such as, scheduled time slot is extended two-stage or incites somebody to action by coding-control part 14
The bar number of frame data 23 to be encoded in GOP or ratio reduce two-stage.
Additionally, when remaining data amount suppresses in the range of threshold value 55 to underflow the 40% of VBV value, coding-control part
14 adjust encoding amount so that encoding amount is increased one-level.Such as, scheduled time slot is shortened one-level by coding-control part 14, or will
The bar number of frame data 23 to be encoded in GOP or ratio increase one-level.
Additionally, when remaining data amount is in the range of underflow suppression threshold value 55 to the 0% of VBV value, coding-control part
14 adjust encoding amount so that encoding amount is increased two-stage.Such as, scheduled time slot is shortened two-stage by coding-control part 14, or will
The bar number of frame data 23 to be encoded in GOP or ratio increase two-stage.
After frame data 23 to be encoded in determining GOP length and GOP, coding-control part 14 exports indication signal.
Coding-control part 14 selects frame data 23 as coded object, and these frame data 23 are included in input motion picture number
In 21 so that the interval of the frame data 23 that encode in predefined conditions is equal intervals, and based on selecting output instruction
Signal.
Coding-control part 14 is such as from the frame rate of input motion view data 21 and input motion view data 21
The approximate number (or multiple) of frame rate selects the frame rate of motion image data to be encoded, and based on the frame rate choosing selected
Select frame data 23 as coded object.
Thus, the frame rate of the motion image data of instruction encoding based on coding-control part 14 such as 1/60 second,
Switch between 1/30 second, 1/20 second, 1/15 second, 1/12 second, 1/5 second, 1/4 second, 1/3 second, 1/2 second and 1 second.
Additionally, based on such control instruction, Video coding executable portion 15 selects frame data 23 to be encoded, and compiles
Code frame data 23.
For example, it is assumed that the frame rate of the motion image data of coding is 1/15 second when not adjusting encoding amount.In these feelings
Under condition, one-level reduces instruction and the frame rate of the motion image data of coding is changed into 1/30 second.Two-stage reduces instruction will coding
The frame rate of motion image data change into 1/60 second.Additionally, one-level increases the instruction frame by the motion image data of coding
Speed changes into 1/12 second.Two-stage increases instruction and the frame rate of the motion image data of coding is changed into 1/5 second.
[integrated operation of the encoding device 1 in Fig. 1]
Then by the integrated operation of the encoding device 1 in description Fig. 1.
First normal operating will be described.
Fig. 9 represents that the initialization of the encoding device 1 in Fig. 1 processes sequence.
In fig .9, when input data information 22 is stored in input motion image data storing part 10, importation
11 read input data information 22.
Importation 11 determines the frame period of input motion view data 21, at this frame period by input motion view data
Frame data 23 output of 21 is to Video coding executable portion 15, and remains this frame period (step ST31) in inside.
Coding-control part 14 reads input data information 22 from input motion image data storing part 10, and including
The frame period (step ST32) of portion's storage input motion view data 21.
Video coding executable portion 15 reads initial code information 24 from coding situation storage part 13, determines that coding is required
Code/decode type, overview (profile), rank (level), bit rate, frame rate, GOP length etc., and prepare coding
(step ST33).
Coding-control part 14 reads initial number information 24 from coding situation storage part 13.
Coding-control part 14 is from the frame period calculated by encoding frame rate and the input motion view data stored before
The frame period calculation code presence or absence information of 21, adjusts and controls timing, and exports coding presence or absence information
With control timing (step ST34).
The coding presence or absence letter that Video coding executable portion 15 is determined by coding-control part 14 in storage inside
Breath and control timing (step ST35).
Coding-control part 14 output that Figure 10 A and 10B is to aid in explanatory diagram 1 is to the volume of Video coding executable portion 15
The figure of code presence or absence information.
The a plurality of frame data 23 of the input motion view data 21 in Figure 10 A have anchor-frame interval.
In the example of Figure 10 B, according to a plurality of frame data 23 of the motion image data of coding presence or absence information
Be there is the anchor-frame obtained by the most discrete minimizing input motion view data 21 be spaced.
Additionally, in the case of GOP a length of " 3 ", the period of six frame data 23 of input motion view data 21 is
Period corresponding to GOP length.Additionally, coding is from three frame data 23 of six frame data 23 alternate selection.
Figure 11 represents the typical coded treatment sequence of the importation 11 in Fig. 1 and Video coding executable portion 15.
When input motion view data 21 is stored in input motion image data storing part 10, importation 11 is read
Take input motion view data 21, and input motion view data 21 is exported Video coding executable portion 15.Input unit
Points 11 with the frame period pre-set, and the most a plurality of unpressed frame data 23 is exported Video coding enforcement division
Divide 15 (step ST41-1 to ST41-4).
When incoming frame data 23, Video coding executable portion 15 determines coding based on coding presence or absence information etc.
Whether it is necessary.When to perform coding, Video coding executable portion 15 encodes frame number based on the coding information being provided previously by
According to 23, and the frame data 23 of coding are exported part 16 (step ST42-1 to ST42-4).
When the frame data 23 of input coding, frame data 23 are stored in output motion image data storage by output part 16
In part 17 (step ST43-1 to ST43-4).
Every time when the output frame data 23 of importation 11, Video coding executable portion 15 and output part 16 repeat above-mentioned
Process.Output motion image data stores part 17 thus stores the first output data formed by the frame data 23 of a plurality of coding
25。
Video coding executable portion 15 determines every frame data independently when every frame data 23 are performed coded treatment
Whether the coding of 23 is necessary, as shown in Figure 6.
Video coding executable portion 15 compares the data of the data (frame data 23 etc.) of the coding of output to output part 16
Amount and the data volume of Buffer Model 51.Then Video coding executable portion 15 adjusts coding according to data volume result of the comparison
Amount, in order to meet the conversion of the control of buffer 37 as defined by moving image standard.Video coding executable portion 15 is such as
Adjust such as the quantization parameter of Qp value etc., insert in units of macro block and skip data, or insert skipped frame data 23.
As a result, Video coding executable portion 15 self judging according to Video coding executable portion 15, frame number can be encoded
According to 23 or can not coded frame data 23, regardless of the instruction of coding-control part 14, the coding of this instruction instruction frame data 23
Whether it is necessary.
In Video coding executable portion 15 is thus according to buffer 37, remaining data volume is carried out about frame data 23
Coding whether be necessary when finally judging, the frame period of the view data of a plurality of coding in the motion image data of coding is not
Fixing.
As a result, when reproducing the motion image data of coding, during reproducing, image changes immediately or image seems
Stop a little while.Image becomes unstable image.
By the view data of a plurality of coding of the motion image data of the coding of Video coding executable portion 15 control
Frame period may become unstable, and this Video coding executable portion 15 repeats whether the coding about frame data 23 is necessary.
Spectators feel incongruity for such moving image.
Figure 12 represents when the coding-control part 14 in Fig. 1 starts coded treatment sequence when controlling.
Basic handling flow process is similar to the flow process of Figure 11, and performs the step same reference numerals table of similar process
Show.
Every time during incoming frame data 23, Video coding executable portion 15 calculates in standard compliant Buffer Model 51 and encodes
Encoding amount after described frame data 23, and this encoding amount (step ST42-1 to ST42-4) is kept in inside.
When encoding the timing of end of each GOP and arriving, Video coding executable portion 15 output notice signal is to coding
Control part 14, the encoding amount (step ST44) that this notification signal keeps after including coding in inside.
When inputting notification signal, coding-control part 14 compares the buffering in the encoding amount obtained of notice and Fig. 8
Each threshold value (step ST45) in device model 51.Additionally, coding-control part 14 is every frame data 23 according to comparative result
Generate coding presence or absence information, and coding presence or absence information is exported Video coding as indication signal
Executable portion 15 (step ST46).
Video coding executable portion 15 keeps new coding presence or absence information (step ST47) received in inside.
Figure 13 represents that the coding-control part 14 in Fig. 1 starts the coded treatment sequence after controlling.
Basic handling flow process is similar to the flow process of Figure 11, and performs the step same reference numerals table of similar process
Show.
But, Video coding executable portion 15 determines every based on the new coding presence or absence information shown in Figure 12
Whether the coding of frame data 23 is necessary, and performs coded treatment.
Therefore, when providing the instruction of the frame data encoded in every two frame data, such as, Video coding enforcement division
Points 15 do not export the frame data of coding to exporting part 16, as shown in step ST42-2 to the ST42-4 in Figure 13.
[example of the view data of coding]
Figure 14 A, 14B and 14C are the data volumes of the motion image data of encoding device 1 coding being shown through in Fig. 1
The figure of the example changed.
Figure 14 A is the figure illustrating input motion view data 21.Figure 14 B is the figure of the motion image data illustrating coding.
Figure 14 C is the figure illustrating MPEG-4 video buffer occupancy.In Figure 14 A to 14C, the time proceeds to the right from the left side.
In Figure 14 A to 14C, first, all each bar frame data 23 of coding input motion image data 21.
But, as shown in Figure 14 C, buffer occupancy amount changes towards underflow.
In this case, coding-control part 14 updates indication signal at timing T1.Video coding executable portion 15 thus
Switching is so that each Article 2 frame data 23 of coding input motion image data 21.Video coding executable portion 15 is at each 2V
Period encodes frame data.
In the case of Figure 14 A to 14C, after the first instruction changes, buffer occupancy amount changes towards underflow equally.
In this case, coding-control part 14 updates indication signal further at timing T2.Video coding executable portion
15 thus switch, in order to each Article 3 frame data 23 of coding input motion image data 21.Video coding executable portion 15
Frame data are encoded in each 3V period.
Figure 15 A and 15B is to aid in what explanation was carried out by coding-control part 14 when encoded moving image data underflow
Underflow suppression controls the figure of operation.
Figure 15 A illustrates buffer occupancy amount.Figure 15 B illustrates the enlarged drawing of T3 to the T4 period in Figure 15 A.
In Figure 15 A, become suppressing threshold value 55 less than underflow at timing T3, VBV occupancy.In this case, such as Figure 15 B
Shown in, the frame period of each Article 3 frame data 23 is become as the frame period of the frame data 23 of coded object.
As a result, prevent VBV occupancy from reducing further after timing T3.That is, prevented by Video coding executable portion 15
VBV occupancy is reduced to estimate be the level of underflow level.
Figure 16 A and 16B is to aid in what explanation was carried out by coding-control part 14 when encoded moving image data overflows
Spillover alleviation controls the figure of operation.
Figure 16 A is the figure illustrating buffer occupancy amount.Figure 16 B is the enlarged drawing of T5 to the T6 period in Figure 16 A.
In Figure 16 A, exceed spillover alleviation threshold value 52 at timing T7, VBV occupancy.In this case, such as Figure 16 B institute
Show, become the frame of every frame data 23 as the frame period of frame data 23 of coded object from the frame period of every two frame data 23
Interval.
As a result, prevent VBV occupancy from increasing further after timing T7.That is, prevented by Video coding executable portion 15
VBV occupancy increases to the level that estimation is spilling level.
Figure 17 A to 21B is to aid in illustrating the first example of the motion image data by encoding device 1 coding in Fig. 1
Figure.
Figure 17 A to Figure 21 A is the figure illustrating input motion view data 21.Figure 17 B to Figure 21 B is the motion illustrating coding
The figure of view data.In the drawings, V represents the frame period of input motion view data 21.
Figure 17 A and 17B represents such example, and wherein the GOP length at the motion image data of coding remains fixed in 3
While change the frame rate of motion image data of coding.
When encoding operation frame rate is equal to or less than initial setting up frame rate, coding-control part 14 provides instruction to hold
The operation of row Figure 17 A and 17B.Figure 17 A and 17B represents execution in the case of the frame number that the GOP length arranged is changed in GOP
Control example.
Specifically, indication signal based on timing T11, by the behaviour of the coded frame data 23 of Video coding executable portion 15
Making the process from every frame data 23 of coding and become encoding the process of each Article 2 frame data 23, GOP length remains simultaneously
3。
Additionally, indication signal based on timing T12, by the operation of the coded frame data 23 of Video coding executable portion 15
Becoming encoding the process of each Article 3 frame data 23 from the process encoding each Article 2 frame data 23, GOP length is protected simultaneously
Hold is 3.The reproduction interval of the view data of a plurality of coding thus broaden.
Figure 18 A and 18B represents another example, and wherein the GOP length at the motion image data of coding remains fixed in 3
Change the frame rate of the motion image data of coding simultaneously.When operating frame rate and exceeding initial setting up frame rate, coding-control
Part 14 is given and instructs to perform the operation of Figure 18 A and 18B.Figure 18 A and 18B represents that the GOP length arranging is changed in GOP
Frame number in the case of perform control example.
Specifically, indication signal based on timing T21, by the behaviour of the coded frame data 23 of Video coding executable portion 15
Making the process from encoding each Article 2 frame data 23 and become encoding the process of every frame data 23, GOP length remains simultaneously
3.The reproduction interval of the view data of a plurality of coding thus narrow.
Figure 19 A and 19B represents that passing through coding-control part 14 when operating frame rate and exceeding initial setting up frame rate indicates
Frame rate change another example.Figure 19 A and 19B represents that the control performed when the GOP length arranged is changed into the time is shown
Example.
Specifically, indication signal based on timing T22, in the period of each GOP keeping input motion view data 21
While, by the operation of the coded frame data 23 of Video coding executable portion 15 from encoding at each Article 2 frame data 23
Reason becomes encoding the process of every frame data 23.
Figure 20 A and 20B represents another example, and wherein the GOP length at the motion image data of coding remains fixed in 3
Change the frame rate of the motion image data of coding simultaneously.When operating frame rate and exceeding initial setting up frame rate, coding-control
Part 14 is given and instructs to perform the operation of Figure 20 A and 20B.Figure 20 A and 20B represents that the GOP length arranging is changed in GOP
Frame number in the case of perform control example.
Specifically, indication signal based on timing T31, by the behaviour of the coded frame data 23 of Video coding executable portion 15
Making the process from encoding each Article 2 frame data 23 and become encoding the process of every frame data 23, GOP length remains simultaneously
3。
Additionally, Video coding executable portion 15 is from being I picture, P picture and P picture by three picture codings in GOP
Control to become the control that three picture codings are I picture, B picture and P picture in GOP.
Figure 21 A and 21B represents that passing through coding-control part 14 when operating frame rate and exceeding initial setting up frame rate indicates
Frame rate change another example.Figure 21 A and 21B represents that the control performed when the GOP length arranged is changed into the time is shown
Example.
Specifically, indication signal based on timing T32, in the period of each GOP keeping input motion view data 21
While, by the operation of the coded frame data 23 of Video coding executable portion 15 from encoding at each Article 2 frame data 23
Reason becomes encoding the process of every frame data 23.
Additionally, Video coding executable portion 15 is from being I picture, P picture and P picture by three picture codings in GOP
Control to become the control that six picture codings are I picture, B picture, P picture, B picture, P picture and B picture in GOP.
[post-processing operation]
Then will carry out from the Video coding executable portion 15 behaviour to the output part 16 of the video data of its input coding
The description made.
The frame data 23 of the coding inputted from Video coding executable portion 15 are stored in output motion diagram by output part 16
As in data storage section 17.
When equaling to or higher than initial setting up by the practical operation frame rate for coding of Video coding executable portion 15
During frame rate, specifically, the first output data 25 and the second output data 26 are stored in output moving image by output part 16
In data storage section 17.
Figure 22 A and 22B is to aid in illustrating the figure of the example of the post-processing operation by the output part 16 in Fig. 1.
Figure 22 A is the figure illustrating the first output data 25.Figure 22 B is the figure illustrating the second output data 26.
In the case of Figure 22 A and 22B, the GOP length of setting is construed to frame number by output part 16, and defeated by first
Go out data 25 and the second output data 26 are stored in output motion image data storage part 17.
Specifically, the frame number of each GOP that the GOP length of setting is construed in Figure 20 B by output part 16, and
First output data 25 are stored in output motion image data storage part 17.
Additionally, output part 16 stores in Figure 20 B all pictures of each GOP as output motion image data storage part
Divide the second output data 26 in 17.
Output part 16 therefore based on the frame data 23 encode by Video coding executable portion 15, generation corresponding to
The output data of initial setting up frame rate and the output data of the operation frame rate corresponding to Video coding executable portion 15.
Figure 23 A and 23B is to aid in illustrating the figure of another example of the post-processing operation by the output part 16 in Fig. 1.
Figure 23 A is the figure illustrating the first output data 25.Figure 23 B is the figure illustrating the second output data 26.
In the case of Figure 23 A and 23B, the GOP length of setting is construed to frame number by output part 16, and defeated by first
Go out data 25 and the second output data 26 are stored in output motion image data storage part 17.
Specifically, the frame number of each GOP that the GOP length of setting is construed in Figure 21 B by output part 16, and
First output data 25 are stored in output motion image data storage part 17.
Additionally, whole pictures of each GOP in Figure 21 B are stored in defeated as the second output data 26 by output part 16
Go out in motion image data storage part 17.
As it has been described above, in the first embodiment, frame number is determined in Video coding executable portion 15 based on Buffer Model 51
Before whether the coding according to 23 is necessary, coding-control part 14 changes the frame rate for coding, in order to the figure of stable coding
Data volume as data.
Therefore, in the first embodiment, Video coding executable portion 15 is less determines according to coding situation during encoding
Whether coding is necessary, and the frame rate of a plurality of view data in the motion image data of stable coding.
As a result, when reproducing by the motion image data of encoding device 1 coding according to first embodiment, moving image
Seem smooth, because the frame rate of motion image data is stable.
Decreasing such trend, the most such as during reproducing, image changes immediately or shows a little while, as video is compiled
Code executable portion 15 determines, according to coding situation, the situation whether coding is necessary during encoding.It is possible to prevent not assist to spectators
The sensation adjusted.
In the first embodiment, because the frame period of the frame data 23 of coding stabilizes to substantially fixed interval, so
The equipment 63 that reproduces for rendering frame data 23 can be by simple supplementary functions interpolation and the frame rebuilding discrete minimizing.
Specifically, coding-control part 14 is from the frame rate of input motion view data 21 and input motion view data 21
Frame rate approximate number (or multiple) in select to Video coding executable portion 15 instruction encoding frame rate.
As a result, in the first embodiment, the view data of a plurality of coding is corresponding to the input motion in each fixed interval
The view data of view data 21.Accordingly it is possible to prevent give the inharmonic sensation of user.
Coding-control part 14 determines the encoding frame rate to Video coding executable portion 15 instruction, shares and compiles for video
Whether the Buffer Model 51 of code executable portion 15 is necessary with the coding determining frame data 23.Therefore, coding-control part 14
Control can prevent independently Video coding executable portion 15 determine interpolation or delete frame.
In the first embodiment, for spillover alleviation, frame period shortens as far as possible, and increases the coding of time per unit
Number of times.As a result, first embodiment can suppress encoding amount fault etc., and allows to keep fixing frame period.
In the first embodiment, coding-control part 14 uses special being used for for identical buffer 51 (encoding amount)
Spillover alleviation and the threshold value of underflow suppression, as in Video coding executable portion 15.As a result, in the first embodiment, even if
When there is the symbol of spilling or underflow, it is also possible to from the normal condition of the last stage of this state return.Additionally, first embodiment
Therefore can suppress skipping due to encoding amount fault etc., and keep fixing frame period.
In the first embodiment, when shortening frame period as far as possible and increasing the coding number of times of time per unit, as
The frame increased from original state is encoded as non-reference intra frame, as shown in Figure 20 A and 20B and Figure 21 A and 21B.Additionally,
Output part 16 generates for the first output data 25 of initial setting up frame rate with for the frame higher than initial setting up frame rate
Second output data 26 of speed.As a result, reproducing equipment 63 etc. can be according to the performance etc. of reproduction equipment 63, from initial setting up frame
Selection output data in the motion image data of the picture quality of speed and the motion image data of more high image quality, and again
Now export data.
When practical operation frame rate exceedes initial setting up frame rate, the time that GOP represents can be by by GOP length
Degree is construed to the quantity of coded frame and shortens, as shown in Figure 18 A and 18B and Figure 20 A and 20B.As a result, time per unit generates
The quantity of inter-frame can increase, therefore the quantity of recovery point can increase.
When practical operation frame rate exceedes initial setting up frame rate, the time that GOP represents can be by by GOP length
Degree is construed to the scramble time and extends, as shown in Figure 19 A and 19B and Figure 21 A and 21B.As a result, it is possible to reduce the number of inter-frame
Amount, increases the encoding amount that can distribute to each frame, therefore improves the picture quality of each image.
When practical operation frame rate is less than initial setting up frame rate, the time that GOP represents can be by by GOP length
Degree is construed to the scramble time and extends, as illustrated in figures 17a and 17b.As a result, it is possible to reduce the quantity of inter-frame, increase can distribute
To the encoding amount of each frame, therefore improve the picture quality of each image.Additionally, due to this effect can suppress coding further
Amount (Buffer Model 51) fault.Additionally, because the frame number that the length of a GOP is carried is fixed, so the encoding amount of a GOP
Can easily predict.
<2. the second embodiment>
Figure 24 is the schematic block diagram illustrating the coding transmission system 61 according to the disclosure the second embodiment.
The coding of Figure 24 sends system 61 and has imaging device 62 and reproduction equipment 63.
Imaging device 62 has imaging moiety 71, input buffer storage 72, coded portion 73, output buffer storage 74
With the first communications portion 75.
Reproduction equipment 63 has the second communications portion 81, receives buffer storage 82, decoded portion 83, decoding buffer storage
Device 84, reproduction part 85 and monitor 86.
Imaging moiety 71 e.g. cmos sensor in imaging device 62 or ccd sensor.Imaging moiety 71 is connected to
Input buffer storage 72.The signal of the image of pickup is exported input buffer storage 72 by imaging moiety 71.Input buffering
Memorizer 72 stores the view data of a pickup.
Coded portion 73 is the encoding device 1 shown in Fig. 1.Coded portion 73 is connected to input buffer storage 72 and output
Buffer storage 74.Coded portion 73 obtains the view data of the motion image data constituting pickup from input buffer storage 72
(frame data 23), coded image data, and the view data of coding is exported output buffer storage 74.Output buffering is deposited
Reservoir 74 stores the view data of coding.
First communications portion 75 e.g. radio communication part.First communications portion 75 is connected to output buffer storage
74.First communications portion 75 sends the data of storage in output buffer storage 74 by the radio in predetermined communication band.
The second communications portion 81 in reproduction equipment 63 is the Radiocommunications that can communicate with the first communications portion 75
Point.Second communications portion 81 is connected to receive buffer storage 82.Second communications portion 81 will receive from the first communications portion 75
Data be stored in reception buffer storage 82 in.Receive buffer storage 82 thus store the view data of coding.
Decoded portion 83 is connected to receive buffer storage 82 and decoding buffer storage 84.Decoded portion 83 decoding receives
The view data of the coding of storage in buffer storage 82, and the view data of decoding is stored in decoding buffer device memorizer
In 84.Decoding buffer memorizer 84 stores the view data of decoding.
Reproduce part 85 and be connected to decoding buffer memorizer 84 and monitor 86.Reproduce part 85 will solve with pre-determined frame rate
In code buffer storage 84, the view data of storage exports monitor 86.Monitor 86 thus display by multiple decoding image shapes
The moving image become.
Above-described embodiment each is the example of disclosure preferred embodiment.But, the disclosure is not limited to this.Can carry out
Various modifications and changes are without departing from the spirit of the disclosure.
Such as, the encoding device 1 according to aforementioned first embodiment and the coded portion 73 according to the second embodiment pass through
Every frame data 23 of MEPG-4 video system encoded moving image data.
In addition, such as encoding device 1 or coded portion 73 can be transported by H.264 system or MPEG-2 system coding
Every frame data 23 of video data.
Figure 25 is to aid in illustrating when by H.264 system coding by the coding-control operation of coding-control part 14
Figure.
Figure 25 illustrates the Buffer Model 51 meeting the H.264 standard of system.Longitudinal axis instruction Buffer Model 51 keeps
Data volume.The transverse axis instruction time.Conveniently mention, MPEG-2 system also uses the Buffer Model 51 of the H.264 system that is similar to,
And the data volume according to keeping in Buffer Model 51 suitably controls data volume to be encoded.
In MPEG-4 video system, as shown in Figure 14 C, the initial value when starting coded treatment is set to the pre-of VBV value
Determine percentage ratio (%).
On the other hand, in H.264 system, as shown in figure 25, it is set to the 0% of VBV value starting initial value when encoding.
Therefore, start to there is little buffer occupancy afterwards immediately preceding coded treatment.
Additionally, in H.264 system, after Video coding executable portion 15 is such as according to scheduled time slot after beginning coded treatment
The data volume of coded data, start coding-control operation.
Therefore, in the case of the disclosure is applied to the Video coding executable portion 15 of H.264 system, coding-control is met
Part 14 starts coding-control according to the data volume of coded data after scheduled time slot and processes.
Conveniently mention, equally in MPEG-2, can be started according to volume by the control of coding-control part 14 similarly
The coding-control operation of the data volume of code data.
Aforementioned second embodiment is the example that the encoding device 1 according to first embodiment is applied to imaging device 62.
Imaging device 62 includes DSC (digital camera), video camera, monitoring camera etc..
Encoding device 1 applies also for such as portable phone, PDA (personal digital assistant), electronic book equipment, notebook
Computer equipment, navigator and portable reproduction apparatus.
Additionally, encoding device 1 can be applicable to reproduction equipment, AV (audio frequency and video) equipment, DLNA (DLNA)
Server apparatus etc..
The application comprises and is involved in Japanese Priority Patent Application JP submitted to Japan Office on June 28th, 2010
Theme disclosed in 2010-146434, is incorporated herein by reference in its entirety.
It should be appreciated by those skilled in the art, depend on that design requires and other factors, various amendment, group can occur
Conjunction, sub-portfolio and replacement, as long as they are in the range of claim or its equivalent.
Claims (17)
1. an encoding device, including:
Obtain part, be configured to obtain the motion image data of a plurality of view data including to reproduce with set rate;
Determine part, be configured to determine the described view data of the described motion image data separately won by described obtaining portion
Whether the coding of each is necessary, and export instruction be set to the view data of coded object or be not set to coded object
The indication signal of view data;And
Coding executable portion, is configured to be provided described indication signal, and according to the described determination result determining part from
While reducing view data scatteredly, a plurality of view data that coding is separately won by described obtaining portion, wherein
Described determine that part determines whether the coding of each of view data is necessary so that by described coding executable portion
The reproduction interval of a plurality of view data in the encoded moving image data of coding is stable,
Described coding executable portion output notice signal determines part to described, and described notification signal is for the execution phase at coding
Between repeat to notify the data volume of described encoded moving image data, and
Export described indication signal described determine part described coding the term of execution update described indication signal so that
Under the data volume of described encoded moving image data, the reproduction interval of a plurality of view data in encoded moving image data tends to
Equal intervals, the data volume of described encoded moving image data is repeated notice by described notification signal.
2. encoding device as claimed in claim 1, wherein
The described data volume determining the more described encoded moving image data of part be defined as storing described encoding moving pictures
The data volume of the buffer of the buffer of data, the data volume of described encoded moving image data is notified by described notification signal,
Difference hour between the maximum amount of data and the data volume of described encoded moving image data of described buffer, described really
Fixed part updates described indication signal, in order to widen the reproduction interval of coded image data based on described indication signal, and
Difference hour between the minimum data amount and the data volume of described encoded moving image data of described buffer, described really
Fixed part updates described indication signal, in order to reproduction interval based on described indication signal constriction coded image data.
3. encoding device as claimed in claim 1, wherein
Described coding executable portion data volume based on described encoded moving image data, according to described coding executable portion from
Body judges, reduces discretely and encodes the described view data separately won by described obtaining portion so that described encoded motion figure
As the data volume of data is in preset range.
4. encoding device as claimed in claim 3, wherein
When being defined as storing the maximum amount of data of the buffer of the buffer of described encoded moving image data and described coding fortune
When not existing poor between the data volume of video data, described coding executable portion self is sentenced according to described coding executable portion
Disconnected, reduce view data to be encoded discretely, and
When not existing poor between the minimum data amount and the data volume of described encoded moving image data of described buffer, described
Coding executable portion self judging according to described coding executable portion, increases view data to be encoded.
5. encoding device as claimed in claim 4, wherein
Described coding executable portion is overflowed or underflow based on described buffer, determines and increases or delete view data to be encoded,
And
Described determine be based partially on the reference value that the data volume into described buffer is arranged, determine in described indication signal instruction
Whether the coding of each of view data is necessary.
6. encoding device as claimed in claim 1, wherein
When the code rate of a plurality of view data encoded by described coding executable portion based on described indication signal is less than pre-
During the code rate first arranged, described determine part update described indication signal so that a plurality of view data be wider than corresponding to
The interval at the interval of the described code rate pre-set encodes.
7. encoding device as claimed in claim 1, wherein
When the code rate of a plurality of view data encoded by described coding executable portion based on described indication signal is higher than pre-
During the code rate first arranged, described determine part update described indication signal so that a plurality of view data be narrower than corresponding to
The interval at the interval of the described code rate pre-set encodes.
8. encoding device as claimed in claim 7, wherein
Described determine that part updates described indication signal, until encoded by described coding executable portion based on described indication signal
A plurality of view data and a plurality of view data one_to_one corresponding maximally obtained by described acquisition part, and
Described determine that the maximum code rate of a plurality of view data encoded by described coding executable portion is set to by part
Speed in a plurality of view data separately won by described obtaining portion.
9. encoding device as claimed in claim 1, wherein
Described determine that part is for separately won by described obtaining portion each group of a plurality of view data of motion image data
Export described indication signal, and
Described determine part indicate in described indication signal described group corresponding to described indication signal include described many
Whether the coding of bar view data is necessary.
10. encoding device as claimed in claim 9, wherein
Described determine part change described indication signal, in order to according to encode by described coding executable portion described coding transport
The data volume of video data, is increased or decreased a plurality of picture number in the motion image data separately won by described obtaining portion
According to quantity, the quantity of described a plurality of view data corresponds to described group, and the image of coding is not increased or decreased in described group
The bar number of data.
11. encoding devices as claimed in claim 10, wherein
When each described coding executable portion encodes a plurality of view data in described group based on described indication signal, described coding
Executable portion output determines part for the notification signal notifying the data volume of described encoded moving image data to described, and
Under the data volume of described encoded moving image data, export the described of described indication signal and determine that part refers to for the next one
The group shown updates described indication signal so that the reproduction interval of a plurality of view data in encoded moving image data tends to equal
Interval, the data volume of described encoded moving image data is notified by notification signal.
12. encoding devices as claimed in claim 9, wherein
Described determine part change described indication signal, in order to according to encode by described coding executable portion described coding transport
The data volume of video data, the bar number of the view data of coding in being increased or decreased described group, and be not increased or decreased and pass through
The quantity of a plurality of view data in the motion image data that described obtaining portion is separately won, the quantity pair of described a plurality of view data
Group described in Ying Yu.
13. encoding devices as claimed in claim 12, wherein
When each described coding executable portion encodes a plurality of view data in described group based on described indication signal, described coding
Executable portion output determines part for the notification signal notifying the data volume of described encoded moving image data to described, and
Under the data volume of described encoded moving image data, export the described of described indication signal and determine that part refers to for the next one
The group shown updates described indication signal so that the reproduction interval of a plurality of view data in encoded moving image data tends to equal
Interval, the data volume of described encoded moving image data is notified by notification signal.
14. encoding devices as claimed in claim 1, also include
Post processing part, is provided to the described encoded moving image data from described coding executable portion, wherein
When the speed of a plurality of view data in described encoded moving image data is higher than the code rate pre-set, described
Post processing part generates for the motion image data of higher rate and the motion diagram of code rate that pre-sets described in being used for
As data.
15. 1 kinds of imaging devices, including:
Imaging moiety, is configured as output to include the moving image number by a plurality of view data obtained with set rate imaging
According to;And
Coded portion, is configured to encode described motion image data, wherein
Described coded portion includes
Obtain part, be configured to obtain the described motion image data exported from described imaging moiety;
Determine part, be configured to determine the described view data of the described motion image data separately won by described obtaining portion
Whether the coding of each is necessary, and export instruction be set to the view data of coded object or be not set to coded object
The indication signal of view data;And
Coding executable portion, is configured to be provided described indication signal, and according to the described determination result determining part from
Encode a plurality of view data separately won by described obtaining portion while reducing view data scatteredly, and
Described determine that part determines whether the coding of each of view data is necessary so that by described coding executable portion
The reproduction interval of a plurality of view data in the encoded moving image data of coding is stable,
Described coding executable portion output notice signal determines part to described, and described notification signal is for the execution phase at coding
Between repeat to notify the data volume of described encoded moving image data, and
Export described indication signal described determine part described coding the term of execution update described indication signal so that
Under the data volume of described encoded moving image data, the reproduction interval of a plurality of view data in encoded moving image data tends to
Equal intervals, the data volume of described encoded moving image data is repeated notice by described notification signal.
16. 1 kinds of coding transmission systems, including:
Coded portion, is configured to encode the moving image number included by a plurality of view data obtained with set rate imaging
According to;
Transmitting portion, is configured to send the encoded moving image data encoded by described coded portion;
Receiving portion, is configured to receive the encoded moving image data sent by described transmitting portion;And
Decoded portion, is configured to the encoded moving image data that decoding is received by described receiving portion, wherein
Described coded portion includes
Obtain part, be configured to obtain the described motion image data from imaging moiety output;
Determine part, be configured to determine the described view data of the described motion image data separately won by described obtaining portion
Whether the coding of each is necessary, and export instruction be set to the view data of coded object or be not set to coded object
The indication signal of view data;And
Coding executable portion, is configured to be provided described indication signal, and according to the described determination result determining part from
While reducing view data scatteredly, a plurality of view data that coding is separately won by described obtaining portion, and
Described determine that part determines whether the coding of each of view data is necessary so that by described coding executable portion
The reproduction interval of a plurality of view data in the encoded moving image data of coding is stable,
Described coding executable portion output notice signal determines part to described, and described notification signal is for the execution phase at coding
Between repeat to notify the data volume of described encoded moving image data, and
Export described indication signal described determine part described coding the term of execution update described indication signal so that
Under the data volume of described encoded moving image data, the reproduction interval of a plurality of view data in encoded moving image data tends to
Equal intervals, the data volume of described encoded moving image data is repeated notice by described notification signal.
17. 1 kinds of coded methods, including:
Described obtaining portion including acquisition part, the encoding device determining part and coding executable portion separately wins to obtain moving image number
It is configured to encode the motion image data of a plurality of view data including to reproduce with set rate according to, described encoding device;
Described determine that part determines whether the coding of each of the described view data of the described motion image data of acquisition has
Necessity, and export instruction be set to coded object view data or be not set to coded object view data instruction letter
Number;And
Described coding executable portion is reducing described motion image data discretely according to the described determination result determining part
While view data, the view data of the described motion image data that coding obtains, wherein
Described determine that part determines whether the coding of each of view data is necessary so that in encoded moving image data
The reproduction interval of a plurality of view data is stable,
Described coding executable portion output notice signal determines part to described, and described notification signal is for the execution phase at coding
Between repeat informed code motion image data data volume, and
Export described indication signal described determine part described coding the term of execution update described indication signal so that
Under the data volume of described encoded moving image data, the reproduction interval of a plurality of view data in encoded moving image data tends to
Equal intervals, the data volume of described encoded moving image data is repeated notice by described notification signal.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010-146434 | 2010-06-28 | ||
JP2010146434A JP2012010263A (en) | 2010-06-28 | 2010-06-28 | Encoding device, imaging device, encoding/transmitting system and encoding method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN102300090A CN102300090A (en) | 2011-12-28 |
CN102300090B true CN102300090B (en) | 2016-12-14 |
Family
ID=
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1536891A (en) * | 2003-02-05 | 2004-10-13 | ���µ�����ҵ��ʽ���� | Image signal reproducing device and method |
CN1668110A (en) * | 2004-03-11 | 2005-09-14 | 宝利通公司 | Method and apparatus for improving the average image refresh rate in a compressed video bitstream |
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1536891A (en) * | 2003-02-05 | 2004-10-13 | ���µ�����ҵ��ʽ���� | Image signal reproducing device and method |
CN1668110A (en) * | 2004-03-11 | 2005-09-14 | 宝利通公司 | Method and apparatus for improving the average image refresh rate in a compressed video bitstream |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6115420A (en) | Digital video signal encoder and encoding method | |
KR101418950B1 (en) | An improved video rate control for video coding standards | |
US4958226A (en) | Conditional motion compensated interpolation of digital motion video | |
EP0771120B1 (en) | Video encoding apparatus | |
US6526097B1 (en) | Frame-level rate control for plug-in video codecs | |
US20050074061A1 (en) | Signaling buffer fullness | |
US5974185A (en) | Methods and apparatus for encoding video data using motion vectors for decoding by regular or downconverting decoders | |
EP1921863A2 (en) | An encoder | |
JP4273207B2 (en) | Method and apparatus for encoding or decoding digital video data | |
WO1994024822A1 (en) | Method and apparatus for coding image, and image recording medium | |
KR20020064925A (en) | Video bitrate control method and device for digital video recording | |
JP4632049B2 (en) | Video coding method and apparatus | |
US9615095B2 (en) | Coding device, imaging device, coding transmission system, and coding method | |
US20050243917A1 (en) | H.263/MPEG video encoder using average histogram difference and method for controlling the same | |
JP2001054110A (en) | Signal processing unit, signal processing method and computer program product | |
KR0152013B1 (en) | Moving estimation device considering variable length coding | |
CN102300090B (en) | Encoding device, imaging device, coding send system and coded method | |
JP2008263443A (en) | Information processing apparatus and method, and program | |
JPH08307860A (en) | Scene re-encoder | |
JP4718736B2 (en) | Video encoding device | |
KR100203637B1 (en) | Apparatus for coding motion picture | |
WO2012069318A1 (en) | Bit rate regulation module and method for regulating bit rate | |
KR100397133B1 (en) | Method and System for compressing/transmiting of a picture data | |
Pan et al. | Adaptive frame skipping based on spatio-temporal complexity for low bit-rate video coding | |
JP4379046B2 (en) | Video encoding apparatus and code amount control method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20160930 Address after: Kanagawa Applicant after: SONY SEMICONDUCTOR SOLUTIONS Corp. Address before: Tokyo, Japan Applicant before: Sony Corp. |
|
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20161214 |