CN102300090B - Encoding device, imaging device, coding send system and coded method - Google Patents

Encoding device, imaging device, coding send system and coded method Download PDF

Info

Publication number
CN102300090B
CN102300090B CN201110176610.3A CN201110176610A CN102300090B CN 102300090 B CN102300090 B CN 102300090B CN 201110176610 A CN201110176610 A CN 201110176610A CN 102300090 B CN102300090 B CN 102300090B
Authority
CN
China
Prior art keywords
coding
data
image data
view data
moving image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201110176610.3A
Other languages
Chinese (zh)
Other versions
CN102300090A (en
Inventor
深田章敬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Semiconductor Solutions Corp
Original Assignee
Sony Semiconductor Solutions Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2010146434A external-priority patent/JP2012010263A/en
Application filed by Sony Semiconductor Solutions Corp filed Critical Sony Semiconductor Solutions Corp
Publication of CN102300090A publication Critical patent/CN102300090A/en
Application granted granted Critical
Publication of CN102300090B publication Critical patent/CN102300090B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

A kind of encoding device includes: obtain part, is configured to obtain the motion image data of a plurality of view data including to reproduce with set rate;Determine part, it is configured to determine whether the coding of each of described view data of the described motion image data separately won by described obtaining portion is necessary, and exports instruction and be set to the view data of coded object or be not set to the indication signal of view data of coded object;And coding executable portion, it is configured to provide for described indication signal, and has encoded, while reducing view data discretely according to the described determination determining part, a plurality of view data separately won by described obtaining portion.

Description

Encoding device, imaging device, coding send system and coded method
Technical field
It relates to be used for including encoding device and the coded method of the motion image data of a plurality of view data.
Background technology
Motion image data (Japanese Patent Publication No.2008-of a plurality of view data is included by encoding device coding 236789 and 2000-050254 (hereinafter referred to as patent documentations 1 and 2)).
Encoding device comes by meeting the coding system such as MPEG (Motion Picture Experts Group) 1,2 or 4, the standard such as H.264 Encoded moving image data.
Such as, encoding device adjusts such as the quantization parameter of Qp value etc. according to coding situation, inserts and skip in units of macro block Data (skip data), or in units of frame, insert skipped frame data.
Thus encoding device performs coded treatment while adjusting the data volume of encoded moving image data.
Summary of the invention
But, such encoding device may abandon frame data according to coding situation so that encoded moving image data is Predetermined amount of data.
Such as, when encoding device predictive coding motion image data while multiple frames of encoding moving pictures in order When will exceed predetermined transmission data volume, encoding device skips the frame data processed or next frame data.
Additionally, in patent documentation 1, determine frame to be skipped based on the relation with frame before and frame afterwards.
Additionally, in patent documentation 2, determine frame to be skipped by judgement based on object video etc..
When thereby determining that, according to coding situation etc., the frame data not encoded, lose encoded motion figure with irregular interval Frame data as data.
When reproducing the motion image data with the frame data so lost with irregular interval, frame period is unstable Fixed, therefore such situation occurs, wherein during reproducing, image changes suddenly or image stops a little while.
When there is such situation, spectators have incongruity for the moving image reproduced.
Therefore, it is desirable to encoding device reduces inharmonious (unnatural) sense of spectators, this inharmonious (unnatural) sense is with compiling The discontinuity of code motion image data.
According to disclosure first embodiment, it is provided that a kind of encoding device, including: obtain part, be configured to acquisition and include The motion image data of a plurality of view data that can reproduce with set rate;Determine part, be configured to determine by described acquisition Whether the coding of each of the described view data of the described motion image data that part obtains is necessary, and exports instruction The view data being set to coded object or the indication signal of the view data not being set to coded object;And coding enforcement division Point, it is configured to provide for described indication signal, and reduces view data discretely according to the described determination determining part Encode a plurality of view data separately won by described obtaining portion simultaneously.Described determine that part determines each 's of view data Whether coding is necessary so that by a plurality of view data in the encoded moving image data of described coding executable portion coding Reproduction interval stable.
According to first embodiment, described determine that part determines whether the coding of each of view data is necessary so that Stable by the reproduction interval of a plurality of view data in the encoded moving image data of described coding executable portion coding.
Additionally, described coding executable portion is reducing the same of view data discretely according to the described determination determining part Time, a plurality of view data that coding is separately won by described obtaining portion.
Therefore, the reproduction interval of a plurality of view data in encoded moving image data is stabilized.
According to the disclosure the second embodiment, it is provided that a kind of imaging device, including: imaging moiety, it is configured as output to include The motion image data of a plurality of view data by obtaining with set rate imaging;And coded portion, it is configured to encode institute State motion image data.Described coded portion includes: obtain part, is configured to obtain the described fortune exported from described imaging moiety Video data;Determine part, be configured to determine the described figure of the described motion image data separately won by described obtaining portion As whether the coding of each of data is necessary, and export instruction and be set to the view data of coded object or be not set to compile The indication signal of the view data of code object;And coding executable portion, it is configured to provide for described indication signal, and at root Encode, while reducing view data discretely according to the described determination determining part, the multiple bar chart separately won by described obtaining portion As data.Described determine that part determines whether the coding of each of view data is necessary so that performed by described coding The reproduction interval of a plurality of view data in the encoded moving image data of code segment is stable.
According to the disclosure the 3rd embodiment, it is provided that a kind of coding transmission system, including: coded portion, it is configured to coding Motion image data including a plurality of view data by obtaining with set rate imaging;Transmitting portion, is configured to send and leads to Cross the encoded moving image data of described coded portion coding;Receiving portion, is configured to reception and is sent by described transmitting portion Encoded moving image data;And decoded portion, it is configured to the encoding moving pictures that decoding is received by described receiving portion Data.Described coded portion includes: obtain part, is configured to obtain the described motion image data from imaging moiety output;Really Determine part, be configured to determine each of described view data of the described motion image data separately won by described obtaining portion Coding whether be necessary, and export instruction be set to the view data of coded object or be not set to the picture number of coded object According to indication signal;And coding executable portion, it is configured to provide for described indication signal, and determines part according to described Determination reduce view data discretely while encode a plurality of view data separately won by described obtaining portion.Described determine Part determines whether the coding of each of view data is necessary so that transported by the coding of described coding executable portion coding The reproduction interval of a plurality of view data in video data is stable.
According to the disclosure the 4th embodiment, it is provided that a kind of coded method, including: include acquisition part, determine part and The described obtaining portion of the encoding device of coding executable portion separately wins to obtain motion image data, and described encoding device is configured to coding bag Include the motion image data of a plurality of view data that can reproduce with set rate;Described determine that part determines the described motion of acquisition Whether the coding of each of the described view data of view data is necessary;And described coding executable portion is according to described The figure of the described motion image data of acquisition is encoded while determining the view data reducing described motion image data discretely As data.Described determine that part determines whether the coding of each of view data is necessary so that encoded moving image data In the reproduction interval of a plurality of view data stable.
According to the disclosure, in encoded moving image data, it is not easy to occur discontinuity, and can reduce spectators' Inharmonious (unnatural) is felt.
Accompanying drawing explanation
Fig. 1 is the schematic block diagram of the encoding device according to disclosure first embodiment;
Fig. 2 is the block diagram of the computer equipment for realizing the encoding device in Fig. 1;
Fig. 3 is to aid in illustrating the figure of the example of the motion image data of the encoding device coding in Fig. 1 to be passed through;
Fig. 4 is the flow chart of the operation of the importation in Fig. 1;
Fig. 5 is the block diagram of the Video coding executable portion in Fig. 1;
Fig. 6 is by the flow chart to the encoding operation that every frame data are carried out of the Video coding executable portion in Fig. 1;
Fig. 7 is the flow chart of the coding-control operation of the coding-control part in Fig. 1;
The figure of the coding-control operation of the coding-control part that Fig. 8 is to aid in Fig. 1;
Fig. 9 represents that the initialization of the encoding device in Fig. 1 processes sequence;
The coding-control part that Figure 10 A and 10B is to aid in explanatory diagram 1 exports the coding of Video coding executable portion and deposits Or there is not the figure of information;
Figure 11 represents the typical coded treatment sequence of the importation in Fig. 1 and Video coding executable portion;
Figure 12 represents when the coding-control part in Fig. 1 starts coded treatment sequence when controlling;
Figure 13 represents that the coding-control part in Fig. 1 starts the coded treatment sequence after controlling;
Figure 14 A, 14B and 14C are changing of the data volume of the motion image data of the encoding device coding being shown through in Fig. 1 The figure of the example become;
Under Figure 15 A and 15B is to aid in illustrating to be carried out by coding-control part when encoded moving image data underflow Suppression of overflowing controls the figure of operation;
Figure 16 A and 16B is to aid in explanation when encoded moving image data overflows by overflowing that coding-control part is carried out Go out suppression and control the figure of operation;
Figure 17 A and 17B is to aid in the first example of the motion image data that explanation is encoded by the encoding device in Fig. 1 Figure;
Figure 18 A and 18B is to aid in the second example of the motion image data that explanation is encoded by the encoding device in Fig. 1 Figure;
Figure 19 A and 19B is to aid in the 3rd example of the motion image data that explanation is encoded by the encoding device in Fig. 1 Figure;
Figure 20 A and 20B is to aid in the 4th example of the motion image data that explanation is encoded by the encoding device in Fig. 1 Figure;
Figure 21 A and 21B is to aid in the 5th example of the motion image data that explanation is encoded by the encoding device in Fig. 1 Figure;
Figure 22 A and 22B is to aid in illustrating the figure (the first example) of the post-processing operation by the output part in Fig. 1;
Figure 23 A and 23B is to aid in illustrating the figure (the second example) of the post-processing operation by the output part in Fig. 1;
Figure 24 is the schematic block diagram illustrating the coding transmission system according to the disclosure the second embodiment;And
Figure 25 is to aid in illustrating when by H.264 system or MPEG-2 system coding by the coding of coding-control part Control the figure of operation.
Detailed description of the invention
Hereinafter, preferred embodiment of the present disclosure will be described with reference to the drawings.
To be described in the following order.
1. first embodiment (example of encoding device)
2. the second embodiment (there is the example of the coding transmission system of imaging device)
1. first embodiment
[configuration of encoding device 1]
Fig. 1 is the schematic block diagram of the encoding device 1 according to disclosure first embodiment.
Encoding device 1 coding input motion image data in Fig. 1.
Encoding device 1 in Fig. 1 includes that input motion image data storing part 10, importation 11, coding situation are deposited Storage part 13, coding-control part 14, Video coding executable portion 15, output part 16 and output motion image data storage part Divide 17.
Fig. 2 is the block diagram of the computer equipment 100 for realizing the encoding device 1 in Fig. 1.
Computer equipment 100 in Fig. 2 has CPU (CPU) 101, memorizer (MEM) 102 and input and output Partly (I/O) 103.
Memorizer 102 stores encoding procedure.
In memorizer 102, the encoding procedure of storage can be stored in memorizer 102 before the shipment of computer equipment 100 In, or can store in the memory 102 after the shipment of computer equipment 100.
Storing encoding procedure in the memory 102 after the shipment of computer equipment 100 such as can be by reading record Encoding procedure on a computer readable recording medium or download via transmission medium (such as the Internet etc.) and obtain.
CPU 101 reads and performs the encoding procedure of storage in memorizer 102.
Therefore, in CPU 101, realize the importation 11 in Fig. 1, Video coding executable portion 15 and output part 16.
Additionally, realize input motion image data storing part 10, output motion image data storage in the memory 102 Part 17 and coding situation storage part 13.
Conveniently mention, in fig. 2, the motion image data of input coding equipment 1 such as inputs from input/output section 103 And store in the memory 102.
Additionally, the encoded moving image data generated by encoding device 1 is stored in the memory 102, and hereafter from Input/output section 103 output is to outside.
Input motion image data storing part 10 in Fig. 1 stores input motion view data 21 and input data information 22。
The example of the input motion view data 21 of encoding device 1 coding that Fig. 3 is to aid in explanation Fig. 1 to be passed through Figure.
Input motion view data 21 in Fig. 3 has a plurality of frame data 23.
Frame data 23 in Fig. 3 are can the view data of still image that reproduces of a frame rate.A plurality of frame in Fig. 3 Data 23 start to reproduce from the frame in left side the most in order.
Motion image data in Fig. 3 such as encodes in units of three frames.The unit of this coded treatment is referred to as GOP (picture Group).
In the example of fig. 3, the first frame that the left side from each GOP starts is encoded to I (internal) picture.Second frame is compiled Code is B (bi-directional predicted) picture.3rd frame is encoded to P (prediction) picture.
Input data information 22 is the information about input motion view data 21.
Such information such as includes the information of the frame rate about input motion view data 21 and about obtaining input The information of the shooting environmental of motion image data 21.
In FIG, importation 11 is connected to input motion image data storing part 10 and Video coding executable portion 15。
Importation 11 obtains input motion view data 21 and input number from input motion image data storing part 10 It is believed that breath 22.
Every frame data 23 of the input motion view data 21 of acquisition are exported Video coding and perform by importation 11 Part 15.
Now, importation 11 frame rate based on input motion view data 21 determines the outlet chamber of every frame data 23 Every, this frame rate is based on input data information 22, and performs to Video coding with this output gap a plurality of frame data of output 23 Part 15.
Fig. 4 is the flow chart of the operation of the importation 11 in Fig. 1.
Fig. 4 is that such as in importation 11, the input/output section 103 from Fig. 2 obtains input motion view data 21 He Flow chart in the case of input data information 22.
Obtaining input motion view data 21 and input data information 22, importation 11 is by input motion view data 21 It is stored in input motion image data storing part 10 with input data information 22.Additionally, importation 11 is at input motion Storage coding presence or absence information (step ST1) in image data storing part 10.
The initial code information 24 that coding situation storage part 13 storage in Fig. 1 pre-sets is as input motion The coding situation of view data 21.
Conveniently mention, initial code information 24 can be arranged in advance in encoding device 1, or such as can be via Fig. 2 In input/output section 103 from outside input.
Initial code information 24 includes such as encoding required information, such as overview, level (level), encoding moving pictures The bit rate of data, GOP length, the frame period etc. of encoded moving image data.
Such as, the number of frames (amount of images) that one GOP of GOP Length Indication includes.
Such as, frame period is the record frame rate when recording motion image data.
Coding-control part 14 is connected to input motion image data storing part 10, coding situation storage part 13 and regards Frequency coding executable portion 15.
Coding-control part 14 is based on the input data information 22 in input motion image data storing part 10 and coding Initial code information 24 in situation storage part 13, output indication signal is to Video coding executable portion 15.
Such as, coding-control part 14 frame rate based on input motion view data 21 and the frame of initial code information 24 Speed, the initial frame rate of instruction coding in Video coding executable portion 15.
Additionally, such as in each cycle of GOP length, coding-control part 14 is based on from Video coding executable portion 15 The notification signal of input, determines the situation of coding by Video coding executable portion 15.
Additionally, coding-control part 14 is according to determining that result updates the content of indication signal.
Such as, coding-control part 14 compares the data of the motion image data by Video coding executable portion 15 coding Measure and be defined as to store the data volume of the buffer 37 of the buffer of encoded moving image data, and indication signal is updated to Content corresponding to the relation between these data volumes.
Coding-control part 14 indicates every frame data 23 of input image data to be set to the view data of coded object Again without the view data being set to coded object.
Video coding executable portion 15 is connected to importation 11, output part 16, coding situation storage part 13 and compiles Code controls part 14.
Video coding executable portion 15 encodes the frame data 23 from importation 11 input, and exports the frame data of coding 23 to output part 16.
Now, Video coding executable portion 15 based on coding situation storage part 13 in storage initial code information 24, From indication signal and coding situation (data volume etc. of encoded moving image data) of coding-control part 14 input, the most really Whether the coding of framing data 23 is necessary.
Additionally, Video coding executable portion 15 determines frame coding system, parameter (encoding variable) etc. independently.
Then, Video coding executable portion 15 is according to the determination of Video coding executable portion 15 self, and coding is from input unit Divide the frame data 23 of 11 inputs, and the frame data 23 of coding are exported part 16.
Additionally, Video coding executable portion 15 is corresponding in each cycle of GOP length, output is transported for informed code The notification signal of the data volume of video data is to coding-control part 14.
Fig. 5 is the block diagram of the Video coding executable portion 15 in Fig. 1.
Video coding executable portion 15 in Fig. 5 is by MPEG-4 visual system encoded moving image data.
Video coding executable portion 15 in Fig. 5 has the first frame memory 31, motion vector detection 32, subtractor 33, DCT (discrete cosine transform) unit 34 and quantizer 35.
Video coding executable portion 15 in Fig. 5 also has VLC (variable length code) unit 36 and buffer 37.
Video coding executable portion 15 in Fig. 5 also has inverse quantizer 38, IDCT (inverse DCT) unit the 39, second frame is deposited Reservoir 40 and motion compensator 41.
First frame memory 31 stores image based on the frame data 23 inputted from importation 11.
Motion vector detection 32 is connected to the first frame memory 31.
Motion vector detection 32 detects for another for the newly encoded object images of storage in the first frame memory 31 The motion vector of the object that the image of frame data 23 is common.
Subtractor 33 is connected to the first frame memory 31 and motion compensator 41.Subtractor 33 is from the first frame memory 31 Storage figure image subtraction the second frame memory 40 in storage and from the figure obtained by the compensation deals of motion compensator 41 Picture.
DCT unit 34 is connected to subtractor 33.DCT unit 34 is made from the figure obtained by the difference operation of subtractor 33 Each predetermined block experience discrete cosine transform of picture.
Quantizer 35 is connected to DCT unit 34.Quantizer 35 quantifies the DCT coefficient of each frequency band, and this coefficient is mono-by DCT The unit 34 discrete cosine transform in each piece obtains.
VLC unit 36 is connected to quantizer 35.VLC unit 36 makes the DCT coefficient data warp quantified by quantizer 35 Go through variable length code.Coded data is exported buffer 37 by VLC unit 36.
Thus buffer 37 stores the frame data 23 of coding.The frame data 23 of coding export Fig. 1's from this buffer 37 Output part 16.
VLC unit 36 is also connected to motion vector detection 32.VLC unit 36 will be examined about by motion vector detection 32 The data of the motion vector surveyed export buffer 37.
Additionally, in a series of coded treatment, DCT unit 34, quantizer 35 and VLC unit 36 read coding-control part Initial code information 24 in the indication signal of 14 and coding situation storage part 13.
DCT unit 34, quantizer 35 and VLC unit 36 indication signal based on coding-control part 14 and coding situation are deposited Initial code information 24 in storage part 13, such as adjustment block size, degree of quantization and coded method.
The data volume of the frame data 23 of the coding of storage in read buffers 37 gone back by quantizer 35.
Quantizer 35 judges based on the independence according to data volume, such as, determine whether the coding of frame data 23 is necessary.
Inverse quantizer 38 is connected to quantizer 35.The inverse quantizer 38 DCT coefficient after being quantified by quantizer 35 generates to be used DCT coefficient in the frame data 23 quantified.
IDCT unit 39 is connected to inverse quantizer 38.IDCT unit 39 generates from the DCT coefficient generated by inverse quantizer 38 The image of the frame data 23 quantified.
Second frame memory 40 stores the image of the frame data 23 quantified.
Motion compensator 41 is connected to motion vector detection 32 and the second frame memory 40.
Motion compensator 41, based on the motion vector detected by motion vector detection 32, generates by mobile second frame The image that in memorizer 40, the image of storage obtains.
Output part 16 in Fig. 1 is connected to Video coding executable portion 15 and output motion image data storage part 17。
The frame data 23 of the coding inputted from Video coding executable portion 15 are stored in output moving image by output part 16 Data storage section 17.
Thus export motion image data storage part 17 and store the frame data by Video coding executable portion 15 coding 23。
Output motion image data storage part 17 storage obtains as by the identical input motion view data 21 of coding The first output data 25 of motion image data and the second output data 26, as shown in Figure 3.
[encoding operation of the coding executable portion in Fig. 1]
Fig. 6 is by the flow process to the encoding operation that every frame data 23 are carried out of the Video coding executable portion 15 in Fig. 1 Figure.
Each time when the incoming frame data 23 of importation 11, Video coding executable portion 15 is according to incoming frame data 23 Frame rate performs the coded treatment of Fig. 6.
In the coded treatment for every frame data 23, Video coding executable portion 15 first determines whether to encode and is compiling The frame data 23 (step ST11) that code relates in processing.
Such as, when not encoding the indication signal of described frame data 23 from coding-control part 14 input instruction, video is compiled Not coded frame data 23 are determined in code executable portion 15 principle.
But, when Video coding executable portion 15 reads the data volume and really of the frame data 23 of coding from buffer 37 Settled buffer 37 is by time emptying when not encoding described frame data 23, and Video coding executable portion 15 determines wants coded frame data 23。
Additionally, such as when to encode the indication signal of described frame data 23 from coding-control part 14 input instruction, depending on Determine in frequency coding executable portion 15 principle and want coded frame data 23.
But, when Video coding executable portion 15 reads the data volume and really of the frame data 23 of coding from buffer 37 When during settled coding described frame data 23, buffer 37 will become full, Video coding executable portion 15 determines not coded frame data 23.
When determine want coded frame data 23 time, Video coding executable portion 15 performs the process (step of coded frame data 23 ST12)。
Video coding executable portion 15 exports the frame data 23 (step ST13) of coding from the buffer 37 of Fig. 5.
Additionally, Video coding executable portion 15 calculates and stores the data volume (step ST14) of the frame data 23 of coding.
After coded frame data 23, Video coding executable portion 15 determines that the most whether the process timing of described frame data 23 is Output notice signal is to the timing (step ST15) of encoding controller.
Equally, when the frame data 23 as coded treatment object do not encode, Video coding executable portion 15 determines institute Whether processing of the frame data 23 stated is regularly the timing (step ST15) to encoding controller of the output notice signal.
Such as, when the GOP according to the unit as three frames as shown in Figure 2 performs coding, such as Video coding performs Part 15 determines that the timing of output notice signal arrives when encoding the last P picture of each GOP.Video coding executable portion 15 Determine that the timing of output notice signal does not arrive when encoding other pictures.
When the timing of output notice signal arrives, Video coding executable portion 15 is by the data volume of the frame data 23 of coding Notice is to encoding controller (step ST16).In the case of figure 2, Video coding executable portion 15 is constituted at coding three frame During the last P picture of each GOP, notify to set to coding-control by the total amount of data of three frame data 23 of coding in each GOP Standby.
Video coding executable portion 15 thus terminate coded treatment.Additionally, when the timing of output notice signal does not arrive Time, Video coding executable portion 15 terminates coded treatment.
[the coding-control operation of the coding-control part 14 in Fig. 1]
Fig. 7 is the flow chart of the coding-control operation of the coding-control part 14 in Fig. 1.
Such as, coding-control part 14 performs Fig. 7's when inputting notification signal from Video coding executable portion 15 every time Coding-control operates.In the example of fig. 6, Video coding executable portion 15 is the most encoded each in Video coding executable portion 15 During the final picture of GOP, output notice signal is to coding-control part 14.
In coding-control operates, first coding-control part 14 compares encoding amount and the predetermined buffer model 51 of acquisition In threshold value (step ST21).
Then, coding-control part 14 comparative result based on encoding amount determines frame data to be encoded in scheduled time slot The ratio of 23, and the frame data 23 of coded object to be set to are selected according to this ratio a plurality of frame data 23 in scheduled time slot (step ST22).
Then, coding-control part 14 exports the finger of scheduled time slot and the frame data 23 indicating the selection being set to coded object Show that signal is to Video coding executable portion 15 (step ST23).Coding-control part 14 such as indicates input motion view data 21 GOP length and described GOP in be set to the frame data 23 of coded object or be not set to the frame data 23 of coded object.
The figure of the coding-control operation of the coding-control part 14 that Fig. 8 is to aid in Fig. 1.
Fig. 8 illustrates the Buffer Model 51 meeting MPEG-4 video standard.Coordinate axes instruction is surplus in Buffer Model 51 Remaining data volume.Conveniently mention, the buffer 37 in Fig. 5 is corresponding to Buffer Model 51.
Conveniently mention, remaining data are referred to be encoded by Video coding executable portion 15 but are not output portion in rear class Divide the data of 16 process.
VBV (video buffer checker) in Fig. 8 is the buffer occupancy amount defined in MPEG-4 video standard.According to MPEG-4 video standard, it is desirable to control the amount of coded data so that in Buffer Model 51, remaining data volume falls in VBV value In the range of 0% to 100%.
When buffer occupancy amount is 0%, Buffer Model 51 is full, and is in underflow condition.
When buffer occupancy amount is 100%, Buffer Model 51 is empty, and is in overflow status.
When in the Video coding executable portion 15 prediction buffer model 51 in Fig. 1, remaining data volume will become to be less than VBV value 0% time, such as, according to Video coding executable portion 15, Video coding executable portion 15 self judges that execution is used for Reduce the control of data volume.Such as, Video coding executable portion 15 stops according to self judgement of Video coding executable portion 15 And the coding of skipped frame data 23.
Additionally, work as remaining data volume in Video coding executable portion 15 prediction buffer model 51 will become more than VBV Value 100% time, according to Video coding executable portion 15, Video coding executable portion 15 self judges that execution is used for increasing number Control according to amount.Such as, according to Video coding executable portion 15, Video coding executable portion 15 self judges that coding to be skipped Frame data 23.
On the other hand, coding-control part 14 based on spillover alleviation threshold value 52, VBV value 80% threshold value 53, VBV value The threshold value 54 of 40% and underflow suppression threshold value 55, control the encoding operation of Video coding executable portion 15.
Spillover alleviation threshold value 52 is arranged between the threshold value 53 of the 80% of VBV value and VBV value.
Underflow suppression threshold value 55 is arranged between the threshold value 54 of 40% of zero-sum VBV value.
Conveniently mention, these values are such as stored in coding situation storage part 13 as initial code information 24.Additionally, Each value suitably can be arranged by changing initial code information 24.
When remaining data amount is in the range of 80% to the 40% of VBV value, the uncomfortable whole encoding amount of coding-control part 14. Coding-control part 14 exports indication signal to Video coding executable portion 15, and this indication signal has and exported video Encode the content that the indication signal of executable portion 15 is identical.
On the other hand, when remaining data amount is not in the range of 80% to the 40% of VBV value, coding-control part 14 is adjusted Whole encoding amount.Coding-control part 14 exports indication signal to Video coding executable portion 15, and this indication signal has with Export the content that the indication signal of Video coding executable portion 15 is different.
Specifically, in the case of fig. 8, the scope of spillover alleviation threshold value 52 is arrived when remaining data amount in the 80% of VBV value Time interior, coding-control part 14 adjusts encoding amount so that encoding amount is reduced one-level.Such as, coding-control part 14 will timing in advance Section (GOP length) extends one-level, or bar number or the ratio of frame data 23 to be encoded in GOP are reduced one-level.
Additionally, when remaining data amount is in the range of the 100% of spillover alleviation threshold value 52 to VBV value, coding-control portion Divide 14 adjustment encoding amounts so that encoding amount is reduced two-stage.Such as, scheduled time slot is extended two-stage or incites somebody to action by coding-control part 14 The bar number of frame data 23 to be encoded in GOP or ratio reduce two-stage.
Additionally, when remaining data amount suppresses in the range of threshold value 55 to underflow the 40% of VBV value, coding-control part 14 adjust encoding amount so that encoding amount is increased one-level.Such as, scheduled time slot is shortened one-level by coding-control part 14, or will The bar number of frame data 23 to be encoded in GOP or ratio increase one-level.
Additionally, when remaining data amount is in the range of underflow suppression threshold value 55 to the 0% of VBV value, coding-control part 14 adjust encoding amount so that encoding amount is increased two-stage.Such as, scheduled time slot is shortened two-stage by coding-control part 14, or will The bar number of frame data 23 to be encoded in GOP or ratio increase two-stage.
After frame data 23 to be encoded in determining GOP length and GOP, coding-control part 14 exports indication signal.
Coding-control part 14 selects frame data 23 as coded object, and these frame data 23 are included in input motion picture number In 21 so that the interval of the frame data 23 that encode in predefined conditions is equal intervals, and based on selecting output instruction Signal.
Coding-control part 14 is such as from the frame rate of input motion view data 21 and input motion view data 21 The approximate number (or multiple) of frame rate selects the frame rate of motion image data to be encoded, and based on the frame rate choosing selected Select frame data 23 as coded object.
Thus, the frame rate of the motion image data of instruction encoding based on coding-control part 14 such as 1/60 second, Switch between 1/30 second, 1/20 second, 1/15 second, 1/12 second, 1/5 second, 1/4 second, 1/3 second, 1/2 second and 1 second.
Additionally, based on such control instruction, Video coding executable portion 15 selects frame data 23 to be encoded, and compiles Code frame data 23.
For example, it is assumed that the frame rate of the motion image data of coding is 1/15 second when not adjusting encoding amount.In these feelings Under condition, one-level reduces instruction and the frame rate of the motion image data of coding is changed into 1/30 second.Two-stage reduces instruction will coding The frame rate of motion image data change into 1/60 second.Additionally, one-level increases the instruction frame by the motion image data of coding Speed changes into 1/12 second.Two-stage increases instruction and the frame rate of the motion image data of coding is changed into 1/5 second.
[integrated operation of the encoding device 1 in Fig. 1]
Then by the integrated operation of the encoding device 1 in description Fig. 1.
First normal operating will be described.
Fig. 9 represents that the initialization of the encoding device 1 in Fig. 1 processes sequence.
In fig .9, when input data information 22 is stored in input motion image data storing part 10, importation 11 read input data information 22.
Importation 11 determines the frame period of input motion view data 21, at this frame period by input motion view data Frame data 23 output of 21 is to Video coding executable portion 15, and remains this frame period (step ST31) in inside.
Coding-control part 14 reads input data information 22 from input motion image data storing part 10, and including The frame period (step ST32) of portion's storage input motion view data 21.
Video coding executable portion 15 reads initial code information 24 from coding situation storage part 13, determines that coding is required Code/decode type, overview (profile), rank (level), bit rate, frame rate, GOP length etc., and prepare coding (step ST33).
Coding-control part 14 reads initial number information 24 from coding situation storage part 13.
Coding-control part 14 is from the frame period calculated by encoding frame rate and the input motion view data stored before The frame period calculation code presence or absence information of 21, adjusts and controls timing, and exports coding presence or absence information With control timing (step ST34).
The coding presence or absence letter that Video coding executable portion 15 is determined by coding-control part 14 in storage inside Breath and control timing (step ST35).
Coding-control part 14 output that Figure 10 A and 10B is to aid in explanatory diagram 1 is to the volume of Video coding executable portion 15 The figure of code presence or absence information.
The a plurality of frame data 23 of the input motion view data 21 in Figure 10 A have anchor-frame interval.
In the example of Figure 10 B, according to a plurality of frame data 23 of the motion image data of coding presence or absence information Be there is the anchor-frame obtained by the most discrete minimizing input motion view data 21 be spaced.
Additionally, in the case of GOP a length of " 3 ", the period of six frame data 23 of input motion view data 21 is Period corresponding to GOP length.Additionally, coding is from three frame data 23 of six frame data 23 alternate selection.
Figure 11 represents the typical coded treatment sequence of the importation 11 in Fig. 1 and Video coding executable portion 15.
When input motion view data 21 is stored in input motion image data storing part 10, importation 11 is read Take input motion view data 21, and input motion view data 21 is exported Video coding executable portion 15.Input unit Points 11 with the frame period pre-set, and the most a plurality of unpressed frame data 23 is exported Video coding enforcement division Divide 15 (step ST41-1 to ST41-4).
When incoming frame data 23, Video coding executable portion 15 determines coding based on coding presence or absence information etc. Whether it is necessary.When to perform coding, Video coding executable portion 15 encodes frame number based on the coding information being provided previously by According to 23, and the frame data 23 of coding are exported part 16 (step ST42-1 to ST42-4).
When the frame data 23 of input coding, frame data 23 are stored in output motion image data storage by output part 16 In part 17 (step ST43-1 to ST43-4).
Every time when the output frame data 23 of importation 11, Video coding executable portion 15 and output part 16 repeat above-mentioned Process.Output motion image data stores part 17 thus stores the first output data formed by the frame data 23 of a plurality of coding 25。
Video coding executable portion 15 determines every frame data independently when every frame data 23 are performed coded treatment Whether the coding of 23 is necessary, as shown in Figure 6.
Video coding executable portion 15 compares the data of the data (frame data 23 etc.) of the coding of output to output part 16 Amount and the data volume of Buffer Model 51.Then Video coding executable portion 15 adjusts coding according to data volume result of the comparison Amount, in order to meet the conversion of the control of buffer 37 as defined by moving image standard.Video coding executable portion 15 is such as Adjust such as the quantization parameter of Qp value etc., insert in units of macro block and skip data, or insert skipped frame data 23.
As a result, Video coding executable portion 15 self judging according to Video coding executable portion 15, frame number can be encoded According to 23 or can not coded frame data 23, regardless of the instruction of coding-control part 14, the coding of this instruction instruction frame data 23 Whether it is necessary.
In Video coding executable portion 15 is thus according to buffer 37, remaining data volume is carried out about frame data 23 Coding whether be necessary when finally judging, the frame period of the view data of a plurality of coding in the motion image data of coding is not Fixing.
As a result, when reproducing the motion image data of coding, during reproducing, image changes immediately or image seems Stop a little while.Image becomes unstable image.
By the view data of a plurality of coding of the motion image data of the coding of Video coding executable portion 15 control Frame period may become unstable, and this Video coding executable portion 15 repeats whether the coding about frame data 23 is necessary.
Spectators feel incongruity for such moving image.
Figure 12 represents when the coding-control part 14 in Fig. 1 starts coded treatment sequence when controlling.
Basic handling flow process is similar to the flow process of Figure 11, and performs the step same reference numerals table of similar process Show.
Every time during incoming frame data 23, Video coding executable portion 15 calculates in standard compliant Buffer Model 51 and encodes Encoding amount after described frame data 23, and this encoding amount (step ST42-1 to ST42-4) is kept in inside.
When encoding the timing of end of each GOP and arriving, Video coding executable portion 15 output notice signal is to coding Control part 14, the encoding amount (step ST44) that this notification signal keeps after including coding in inside.
When inputting notification signal, coding-control part 14 compares the buffering in the encoding amount obtained of notice and Fig. 8 Each threshold value (step ST45) in device model 51.Additionally, coding-control part 14 is every frame data 23 according to comparative result Generate coding presence or absence information, and coding presence or absence information is exported Video coding as indication signal Executable portion 15 (step ST46).
Video coding executable portion 15 keeps new coding presence or absence information (step ST47) received in inside.
Figure 13 represents that the coding-control part 14 in Fig. 1 starts the coded treatment sequence after controlling.
Basic handling flow process is similar to the flow process of Figure 11, and performs the step same reference numerals table of similar process Show.
But, Video coding executable portion 15 determines every based on the new coding presence or absence information shown in Figure 12 Whether the coding of frame data 23 is necessary, and performs coded treatment.
Therefore, when providing the instruction of the frame data encoded in every two frame data, such as, Video coding enforcement division Points 15 do not export the frame data of coding to exporting part 16, as shown in step ST42-2 to the ST42-4 in Figure 13.
[example of the view data of coding]
Figure 14 A, 14B and 14C are the data volumes of the motion image data of encoding device 1 coding being shown through in Fig. 1 The figure of the example changed.
Figure 14 A is the figure illustrating input motion view data 21.Figure 14 B is the figure of the motion image data illustrating coding. Figure 14 C is the figure illustrating MPEG-4 video buffer occupancy.In Figure 14 A to 14C, the time proceeds to the right from the left side.
In Figure 14 A to 14C, first, all each bar frame data 23 of coding input motion image data 21.
But, as shown in Figure 14 C, buffer occupancy amount changes towards underflow.
In this case, coding-control part 14 updates indication signal at timing T1.Video coding executable portion 15 thus Switching is so that each Article 2 frame data 23 of coding input motion image data 21.Video coding executable portion 15 is at each 2V Period encodes frame data.
In the case of Figure 14 A to 14C, after the first instruction changes, buffer occupancy amount changes towards underflow equally.
In this case, coding-control part 14 updates indication signal further at timing T2.Video coding executable portion 15 thus switch, in order to each Article 3 frame data 23 of coding input motion image data 21.Video coding executable portion 15 Frame data are encoded in each 3V period.
Figure 15 A and 15B is to aid in what explanation was carried out by coding-control part 14 when encoded moving image data underflow Underflow suppression controls the figure of operation.
Figure 15 A illustrates buffer occupancy amount.Figure 15 B illustrates the enlarged drawing of T3 to the T4 period in Figure 15 A.
In Figure 15 A, become suppressing threshold value 55 less than underflow at timing T3, VBV occupancy.In this case, such as Figure 15 B Shown in, the frame period of each Article 3 frame data 23 is become as the frame period of the frame data 23 of coded object.
As a result, prevent VBV occupancy from reducing further after timing T3.That is, prevented by Video coding executable portion 15 VBV occupancy is reduced to estimate be the level of underflow level.
Figure 16 A and 16B is to aid in what explanation was carried out by coding-control part 14 when encoded moving image data overflows Spillover alleviation controls the figure of operation.
Figure 16 A is the figure illustrating buffer occupancy amount.Figure 16 B is the enlarged drawing of T5 to the T6 period in Figure 16 A.
In Figure 16 A, exceed spillover alleviation threshold value 52 at timing T7, VBV occupancy.In this case, such as Figure 16 B institute Show, become the frame of every frame data 23 as the frame period of frame data 23 of coded object from the frame period of every two frame data 23 Interval.
As a result, prevent VBV occupancy from increasing further after timing T7.That is, prevented by Video coding executable portion 15 VBV occupancy increases to the level that estimation is spilling level.
Figure 17 A to 21B is to aid in illustrating the first example of the motion image data by encoding device 1 coding in Fig. 1 Figure.
Figure 17 A to Figure 21 A is the figure illustrating input motion view data 21.Figure 17 B to Figure 21 B is the motion illustrating coding The figure of view data.In the drawings, V represents the frame period of input motion view data 21.
Figure 17 A and 17B represents such example, and wherein the GOP length at the motion image data of coding remains fixed in 3 While change the frame rate of motion image data of coding.
When encoding operation frame rate is equal to or less than initial setting up frame rate, coding-control part 14 provides instruction to hold The operation of row Figure 17 A and 17B.Figure 17 A and 17B represents execution in the case of the frame number that the GOP length arranged is changed in GOP Control example.
Specifically, indication signal based on timing T11, by the behaviour of the coded frame data 23 of Video coding executable portion 15 Making the process from every frame data 23 of coding and become encoding the process of each Article 2 frame data 23, GOP length remains simultaneously 3。
Additionally, indication signal based on timing T12, by the operation of the coded frame data 23 of Video coding executable portion 15 Becoming encoding the process of each Article 3 frame data 23 from the process encoding each Article 2 frame data 23, GOP length is protected simultaneously Hold is 3.The reproduction interval of the view data of a plurality of coding thus broaden.
Figure 18 A and 18B represents another example, and wherein the GOP length at the motion image data of coding remains fixed in 3 Change the frame rate of the motion image data of coding simultaneously.When operating frame rate and exceeding initial setting up frame rate, coding-control Part 14 is given and instructs to perform the operation of Figure 18 A and 18B.Figure 18 A and 18B represents that the GOP length arranging is changed in GOP Frame number in the case of perform control example.
Specifically, indication signal based on timing T21, by the behaviour of the coded frame data 23 of Video coding executable portion 15 Making the process from encoding each Article 2 frame data 23 and become encoding the process of every frame data 23, GOP length remains simultaneously 3.The reproduction interval of the view data of a plurality of coding thus narrow.
Figure 19 A and 19B represents that passing through coding-control part 14 when operating frame rate and exceeding initial setting up frame rate indicates Frame rate change another example.Figure 19 A and 19B represents that the control performed when the GOP length arranged is changed into the time is shown Example.
Specifically, indication signal based on timing T22, in the period of each GOP keeping input motion view data 21 While, by the operation of the coded frame data 23 of Video coding executable portion 15 from encoding at each Article 2 frame data 23 Reason becomes encoding the process of every frame data 23.
Figure 20 A and 20B represents another example, and wherein the GOP length at the motion image data of coding remains fixed in 3 Change the frame rate of the motion image data of coding simultaneously.When operating frame rate and exceeding initial setting up frame rate, coding-control Part 14 is given and instructs to perform the operation of Figure 20 A and 20B.Figure 20 A and 20B represents that the GOP length arranging is changed in GOP Frame number in the case of perform control example.
Specifically, indication signal based on timing T31, by the behaviour of the coded frame data 23 of Video coding executable portion 15 Making the process from encoding each Article 2 frame data 23 and become encoding the process of every frame data 23, GOP length remains simultaneously 3。
Additionally, Video coding executable portion 15 is from being I picture, P picture and P picture by three picture codings in GOP Control to become the control that three picture codings are I picture, B picture and P picture in GOP.
Figure 21 A and 21B represents that passing through coding-control part 14 when operating frame rate and exceeding initial setting up frame rate indicates Frame rate change another example.Figure 21 A and 21B represents that the control performed when the GOP length arranged is changed into the time is shown Example.
Specifically, indication signal based on timing T32, in the period of each GOP keeping input motion view data 21 While, by the operation of the coded frame data 23 of Video coding executable portion 15 from encoding at each Article 2 frame data 23 Reason becomes encoding the process of every frame data 23.
Additionally, Video coding executable portion 15 is from being I picture, P picture and P picture by three picture codings in GOP Control to become the control that six picture codings are I picture, B picture, P picture, B picture, P picture and B picture in GOP.
[post-processing operation]
Then will carry out from the Video coding executable portion 15 behaviour to the output part 16 of the video data of its input coding The description made.
The frame data 23 of the coding inputted from Video coding executable portion 15 are stored in output motion diagram by output part 16 As in data storage section 17.
When equaling to or higher than initial setting up by the practical operation frame rate for coding of Video coding executable portion 15 During frame rate, specifically, the first output data 25 and the second output data 26 are stored in output moving image by output part 16 In data storage section 17.
Figure 22 A and 22B is to aid in illustrating the figure of the example of the post-processing operation by the output part 16 in Fig. 1.
Figure 22 A is the figure illustrating the first output data 25.Figure 22 B is the figure illustrating the second output data 26.
In the case of Figure 22 A and 22B, the GOP length of setting is construed to frame number by output part 16, and defeated by first Go out data 25 and the second output data 26 are stored in output motion image data storage part 17.
Specifically, the frame number of each GOP that the GOP length of setting is construed in Figure 20 B by output part 16, and First output data 25 are stored in output motion image data storage part 17.
Additionally, output part 16 stores in Figure 20 B all pictures of each GOP as output motion image data storage part Divide the second output data 26 in 17.
Output part 16 therefore based on the frame data 23 encode by Video coding executable portion 15, generation corresponding to The output data of initial setting up frame rate and the output data of the operation frame rate corresponding to Video coding executable portion 15.
Figure 23 A and 23B is to aid in illustrating the figure of another example of the post-processing operation by the output part 16 in Fig. 1.
Figure 23 A is the figure illustrating the first output data 25.Figure 23 B is the figure illustrating the second output data 26.
In the case of Figure 23 A and 23B, the GOP length of setting is construed to frame number by output part 16, and defeated by first Go out data 25 and the second output data 26 are stored in output motion image data storage part 17.
Specifically, the frame number of each GOP that the GOP length of setting is construed in Figure 21 B by output part 16, and First output data 25 are stored in output motion image data storage part 17.
Additionally, whole pictures of each GOP in Figure 21 B are stored in defeated as the second output data 26 by output part 16 Go out in motion image data storage part 17.
As it has been described above, in the first embodiment, frame number is determined in Video coding executable portion 15 based on Buffer Model 51 Before whether the coding according to 23 is necessary, coding-control part 14 changes the frame rate for coding, in order to the figure of stable coding Data volume as data.
Therefore, in the first embodiment, Video coding executable portion 15 is less determines according to coding situation during encoding Whether coding is necessary, and the frame rate of a plurality of view data in the motion image data of stable coding.
As a result, when reproducing by the motion image data of encoding device 1 coding according to first embodiment, moving image Seem smooth, because the frame rate of motion image data is stable.
Decreasing such trend, the most such as during reproducing, image changes immediately or shows a little while, as video is compiled Code executable portion 15 determines, according to coding situation, the situation whether coding is necessary during encoding.It is possible to prevent not assist to spectators The sensation adjusted.
In the first embodiment, because the frame period of the frame data 23 of coding stabilizes to substantially fixed interval, so The equipment 63 that reproduces for rendering frame data 23 can be by simple supplementary functions interpolation and the frame rebuilding discrete minimizing.
Specifically, coding-control part 14 is from the frame rate of input motion view data 21 and input motion view data 21 Frame rate approximate number (or multiple) in select to Video coding executable portion 15 instruction encoding frame rate.
As a result, in the first embodiment, the view data of a plurality of coding is corresponding to the input motion in each fixed interval The view data of view data 21.Accordingly it is possible to prevent give the inharmonic sensation of user.
Coding-control part 14 determines the encoding frame rate to Video coding executable portion 15 instruction, shares and compiles for video Whether the Buffer Model 51 of code executable portion 15 is necessary with the coding determining frame data 23.Therefore, coding-control part 14 Control can prevent independently Video coding executable portion 15 determine interpolation or delete frame.
In the first embodiment, for spillover alleviation, frame period shortens as far as possible, and increases the coding of time per unit Number of times.As a result, first embodiment can suppress encoding amount fault etc., and allows to keep fixing frame period.
In the first embodiment, coding-control part 14 uses special being used for for identical buffer 51 (encoding amount) Spillover alleviation and the threshold value of underflow suppression, as in Video coding executable portion 15.As a result, in the first embodiment, even if When there is the symbol of spilling or underflow, it is also possible to from the normal condition of the last stage of this state return.Additionally, first embodiment Therefore can suppress skipping due to encoding amount fault etc., and keep fixing frame period.
In the first embodiment, when shortening frame period as far as possible and increasing the coding number of times of time per unit, as The frame increased from original state is encoded as non-reference intra frame, as shown in Figure 20 A and 20B and Figure 21 A and 21B.Additionally, Output part 16 generates for the first output data 25 of initial setting up frame rate with for the frame higher than initial setting up frame rate Second output data 26 of speed.As a result, reproducing equipment 63 etc. can be according to the performance etc. of reproduction equipment 63, from initial setting up frame Selection output data in the motion image data of the picture quality of speed and the motion image data of more high image quality, and again Now export data.
When practical operation frame rate exceedes initial setting up frame rate, the time that GOP represents can be by by GOP length Degree is construed to the quantity of coded frame and shortens, as shown in Figure 18 A and 18B and Figure 20 A and 20B.As a result, time per unit generates The quantity of inter-frame can increase, therefore the quantity of recovery point can increase.
When practical operation frame rate exceedes initial setting up frame rate, the time that GOP represents can be by by GOP length Degree is construed to the scramble time and extends, as shown in Figure 19 A and 19B and Figure 21 A and 21B.As a result, it is possible to reduce the number of inter-frame Amount, increases the encoding amount that can distribute to each frame, therefore improves the picture quality of each image.
When practical operation frame rate is less than initial setting up frame rate, the time that GOP represents can be by by GOP length Degree is construed to the scramble time and extends, as illustrated in figures 17a and 17b.As a result, it is possible to reduce the quantity of inter-frame, increase can distribute To the encoding amount of each frame, therefore improve the picture quality of each image.Additionally, due to this effect can suppress coding further Amount (Buffer Model 51) fault.Additionally, because the frame number that the length of a GOP is carried is fixed, so the encoding amount of a GOP Can easily predict.
<2. the second embodiment>
Figure 24 is the schematic block diagram illustrating the coding transmission system 61 according to the disclosure the second embodiment.
The coding of Figure 24 sends system 61 and has imaging device 62 and reproduction equipment 63.
Imaging device 62 has imaging moiety 71, input buffer storage 72, coded portion 73, output buffer storage 74 With the first communications portion 75.
Reproduction equipment 63 has the second communications portion 81, receives buffer storage 82, decoded portion 83, decoding buffer storage Device 84, reproduction part 85 and monitor 86.
Imaging moiety 71 e.g. cmos sensor in imaging device 62 or ccd sensor.Imaging moiety 71 is connected to Input buffer storage 72.The signal of the image of pickup is exported input buffer storage 72 by imaging moiety 71.Input buffering Memorizer 72 stores the view data of a pickup.
Coded portion 73 is the encoding device 1 shown in Fig. 1.Coded portion 73 is connected to input buffer storage 72 and output Buffer storage 74.Coded portion 73 obtains the view data of the motion image data constituting pickup from input buffer storage 72 (frame data 23), coded image data, and the view data of coding is exported output buffer storage 74.Output buffering is deposited Reservoir 74 stores the view data of coding.
First communications portion 75 e.g. radio communication part.First communications portion 75 is connected to output buffer storage 74.First communications portion 75 sends the data of storage in output buffer storage 74 by the radio in predetermined communication band.
The second communications portion 81 in reproduction equipment 63 is the Radiocommunications that can communicate with the first communications portion 75 Point.Second communications portion 81 is connected to receive buffer storage 82.Second communications portion 81 will receive from the first communications portion 75 Data be stored in reception buffer storage 82 in.Receive buffer storage 82 thus store the view data of coding.
Decoded portion 83 is connected to receive buffer storage 82 and decoding buffer storage 84.Decoded portion 83 decoding receives The view data of the coding of storage in buffer storage 82, and the view data of decoding is stored in decoding buffer device memorizer In 84.Decoding buffer memorizer 84 stores the view data of decoding.
Reproduce part 85 and be connected to decoding buffer memorizer 84 and monitor 86.Reproduce part 85 will solve with pre-determined frame rate In code buffer storage 84, the view data of storage exports monitor 86.Monitor 86 thus display by multiple decoding image shapes The moving image become.
Above-described embodiment each is the example of disclosure preferred embodiment.But, the disclosure is not limited to this.Can carry out Various modifications and changes are without departing from the spirit of the disclosure.
Such as, the encoding device 1 according to aforementioned first embodiment and the coded portion 73 according to the second embodiment pass through Every frame data 23 of MEPG-4 video system encoded moving image data.
In addition, such as encoding device 1 or coded portion 73 can be transported by H.264 system or MPEG-2 system coding Every frame data 23 of video data.
Figure 25 is to aid in illustrating when by H.264 system coding by the coding-control operation of coding-control part 14 Figure.
Figure 25 illustrates the Buffer Model 51 meeting the H.264 standard of system.Longitudinal axis instruction Buffer Model 51 keeps Data volume.The transverse axis instruction time.Conveniently mention, MPEG-2 system also uses the Buffer Model 51 of the H.264 system that is similar to, And the data volume according to keeping in Buffer Model 51 suitably controls data volume to be encoded.
In MPEG-4 video system, as shown in Figure 14 C, the initial value when starting coded treatment is set to the pre-of VBV value Determine percentage ratio (%).
On the other hand, in H.264 system, as shown in figure 25, it is set to the 0% of VBV value starting initial value when encoding.
Therefore, start to there is little buffer occupancy afterwards immediately preceding coded treatment.
Additionally, in H.264 system, after Video coding executable portion 15 is such as according to scheduled time slot after beginning coded treatment The data volume of coded data, start coding-control operation.
Therefore, in the case of the disclosure is applied to the Video coding executable portion 15 of H.264 system, coding-control is met Part 14 starts coding-control according to the data volume of coded data after scheduled time slot and processes.
Conveniently mention, equally in MPEG-2, can be started according to volume by the control of coding-control part 14 similarly The coding-control operation of the data volume of code data.
Aforementioned second embodiment is the example that the encoding device 1 according to first embodiment is applied to imaging device 62.
Imaging device 62 includes DSC (digital camera), video camera, monitoring camera etc..
Encoding device 1 applies also for such as portable phone, PDA (personal digital assistant), electronic book equipment, notebook Computer equipment, navigator and portable reproduction apparatus.
Additionally, encoding device 1 can be applicable to reproduction equipment, AV (audio frequency and video) equipment, DLNA (DLNA) Server apparatus etc..
The application comprises and is involved in Japanese Priority Patent Application JP submitted to Japan Office on June 28th, 2010 Theme disclosed in 2010-146434, is incorporated herein by reference in its entirety.
It should be appreciated by those skilled in the art, depend on that design requires and other factors, various amendment, group can occur Conjunction, sub-portfolio and replacement, as long as they are in the range of claim or its equivalent.

Claims (17)

1. an encoding device, including:
Obtain part, be configured to obtain the motion image data of a plurality of view data including to reproduce with set rate;
Determine part, be configured to determine the described view data of the described motion image data separately won by described obtaining portion Whether the coding of each is necessary, and export instruction be set to the view data of coded object or be not set to coded object The indication signal of view data;And
Coding executable portion, is configured to be provided described indication signal, and according to the described determination result determining part from While reducing view data scatteredly, a plurality of view data that coding is separately won by described obtaining portion, wherein
Described determine that part determines whether the coding of each of view data is necessary so that by described coding executable portion The reproduction interval of a plurality of view data in the encoded moving image data of coding is stable,
Described coding executable portion output notice signal determines part to described, and described notification signal is for the execution phase at coding Between repeat to notify the data volume of described encoded moving image data, and
Export described indication signal described determine part described coding the term of execution update described indication signal so that Under the data volume of described encoded moving image data, the reproduction interval of a plurality of view data in encoded moving image data tends to Equal intervals, the data volume of described encoded moving image data is repeated notice by described notification signal.
2. encoding device as claimed in claim 1, wherein
The described data volume determining the more described encoded moving image data of part be defined as storing described encoding moving pictures The data volume of the buffer of the buffer of data, the data volume of described encoded moving image data is notified by described notification signal,
Difference hour between the maximum amount of data and the data volume of described encoded moving image data of described buffer, described really Fixed part updates described indication signal, in order to widen the reproduction interval of coded image data based on described indication signal, and
Difference hour between the minimum data amount and the data volume of described encoded moving image data of described buffer, described really Fixed part updates described indication signal, in order to reproduction interval based on described indication signal constriction coded image data.
3. encoding device as claimed in claim 1, wherein
Described coding executable portion data volume based on described encoded moving image data, according to described coding executable portion from Body judges, reduces discretely and encodes the described view data separately won by described obtaining portion so that described encoded motion figure As the data volume of data is in preset range.
4. encoding device as claimed in claim 3, wherein
When being defined as storing the maximum amount of data of the buffer of the buffer of described encoded moving image data and described coding fortune When not existing poor between the data volume of video data, described coding executable portion self is sentenced according to described coding executable portion Disconnected, reduce view data to be encoded discretely, and
When not existing poor between the minimum data amount and the data volume of described encoded moving image data of described buffer, described Coding executable portion self judging according to described coding executable portion, increases view data to be encoded.
5. encoding device as claimed in claim 4, wherein
Described coding executable portion is overflowed or underflow based on described buffer, determines and increases or delete view data to be encoded, And
Described determine be based partially on the reference value that the data volume into described buffer is arranged, determine in described indication signal instruction Whether the coding of each of view data is necessary.
6. encoding device as claimed in claim 1, wherein
When the code rate of a plurality of view data encoded by described coding executable portion based on described indication signal is less than pre- During the code rate first arranged, described determine part update described indication signal so that a plurality of view data be wider than corresponding to The interval at the interval of the described code rate pre-set encodes.
7. encoding device as claimed in claim 1, wherein
When the code rate of a plurality of view data encoded by described coding executable portion based on described indication signal is higher than pre- During the code rate first arranged, described determine part update described indication signal so that a plurality of view data be narrower than corresponding to The interval at the interval of the described code rate pre-set encodes.
8. encoding device as claimed in claim 7, wherein
Described determine that part updates described indication signal, until encoded by described coding executable portion based on described indication signal A plurality of view data and a plurality of view data one_to_one corresponding maximally obtained by described acquisition part, and
Described determine that the maximum code rate of a plurality of view data encoded by described coding executable portion is set to by part Speed in a plurality of view data separately won by described obtaining portion.
9. encoding device as claimed in claim 1, wherein
Described determine that part is for separately won by described obtaining portion each group of a plurality of view data of motion image data Export described indication signal, and
Described determine part indicate in described indication signal described group corresponding to described indication signal include described many Whether the coding of bar view data is necessary.
10. encoding device as claimed in claim 9, wherein
Described determine part change described indication signal, in order to according to encode by described coding executable portion described coding transport The data volume of video data, is increased or decreased a plurality of picture number in the motion image data separately won by described obtaining portion According to quantity, the quantity of described a plurality of view data corresponds to described group, and the image of coding is not increased or decreased in described group The bar number of data.
11. encoding devices as claimed in claim 10, wherein
When each described coding executable portion encodes a plurality of view data in described group based on described indication signal, described coding Executable portion output determines part for the notification signal notifying the data volume of described encoded moving image data to described, and
Under the data volume of described encoded moving image data, export the described of described indication signal and determine that part refers to for the next one The group shown updates described indication signal so that the reproduction interval of a plurality of view data in encoded moving image data tends to equal Interval, the data volume of described encoded moving image data is notified by notification signal.
12. encoding devices as claimed in claim 9, wherein
Described determine part change described indication signal, in order to according to encode by described coding executable portion described coding transport The data volume of video data, the bar number of the view data of coding in being increased or decreased described group, and be not increased or decreased and pass through The quantity of a plurality of view data in the motion image data that described obtaining portion is separately won, the quantity pair of described a plurality of view data Group described in Ying Yu.
13. encoding devices as claimed in claim 12, wherein
When each described coding executable portion encodes a plurality of view data in described group based on described indication signal, described coding Executable portion output determines part for the notification signal notifying the data volume of described encoded moving image data to described, and
Under the data volume of described encoded moving image data, export the described of described indication signal and determine that part refers to for the next one The group shown updates described indication signal so that the reproduction interval of a plurality of view data in encoded moving image data tends to equal Interval, the data volume of described encoded moving image data is notified by notification signal.
14. encoding devices as claimed in claim 1, also include
Post processing part, is provided to the described encoded moving image data from described coding executable portion, wherein
When the speed of a plurality of view data in described encoded moving image data is higher than the code rate pre-set, described Post processing part generates for the motion image data of higher rate and the motion diagram of code rate that pre-sets described in being used for As data.
15. 1 kinds of imaging devices, including:
Imaging moiety, is configured as output to include the moving image number by a plurality of view data obtained with set rate imaging According to;And
Coded portion, is configured to encode described motion image data, wherein
Described coded portion includes
Obtain part, be configured to obtain the described motion image data exported from described imaging moiety;
Determine part, be configured to determine the described view data of the described motion image data separately won by described obtaining portion Whether the coding of each is necessary, and export instruction be set to the view data of coded object or be not set to coded object The indication signal of view data;And
Coding executable portion, is configured to be provided described indication signal, and according to the described determination result determining part from Encode a plurality of view data separately won by described obtaining portion while reducing view data scatteredly, and
Described determine that part determines whether the coding of each of view data is necessary so that by described coding executable portion The reproduction interval of a plurality of view data in the encoded moving image data of coding is stable,
Described coding executable portion output notice signal determines part to described, and described notification signal is for the execution phase at coding Between repeat to notify the data volume of described encoded moving image data, and
Export described indication signal described determine part described coding the term of execution update described indication signal so that Under the data volume of described encoded moving image data, the reproduction interval of a plurality of view data in encoded moving image data tends to Equal intervals, the data volume of described encoded moving image data is repeated notice by described notification signal.
16. 1 kinds of coding transmission systems, including:
Coded portion, is configured to encode the moving image number included by a plurality of view data obtained with set rate imaging According to;
Transmitting portion, is configured to send the encoded moving image data encoded by described coded portion;
Receiving portion, is configured to receive the encoded moving image data sent by described transmitting portion;And
Decoded portion, is configured to the encoded moving image data that decoding is received by described receiving portion, wherein
Described coded portion includes
Obtain part, be configured to obtain the described motion image data from imaging moiety output;
Determine part, be configured to determine the described view data of the described motion image data separately won by described obtaining portion Whether the coding of each is necessary, and export instruction be set to the view data of coded object or be not set to coded object The indication signal of view data;And
Coding executable portion, is configured to be provided described indication signal, and according to the described determination result determining part from While reducing view data scatteredly, a plurality of view data that coding is separately won by described obtaining portion, and
Described determine that part determines whether the coding of each of view data is necessary so that by described coding executable portion The reproduction interval of a plurality of view data in the encoded moving image data of coding is stable,
Described coding executable portion output notice signal determines part to described, and described notification signal is for the execution phase at coding Between repeat to notify the data volume of described encoded moving image data, and
Export described indication signal described determine part described coding the term of execution update described indication signal so that Under the data volume of described encoded moving image data, the reproduction interval of a plurality of view data in encoded moving image data tends to Equal intervals, the data volume of described encoded moving image data is repeated notice by described notification signal.
17. 1 kinds of coded methods, including:
Described obtaining portion including acquisition part, the encoding device determining part and coding executable portion separately wins to obtain moving image number It is configured to encode the motion image data of a plurality of view data including to reproduce with set rate according to, described encoding device;
Described determine that part determines whether the coding of each of the described view data of the described motion image data of acquisition has Necessity, and export instruction be set to coded object view data or be not set to coded object view data instruction letter Number;And
Described coding executable portion is reducing described motion image data discretely according to the described determination result determining part While view data, the view data of the described motion image data that coding obtains, wherein
Described determine that part determines whether the coding of each of view data is necessary so that in encoded moving image data The reproduction interval of a plurality of view data is stable,
Described coding executable portion output notice signal determines part to described, and described notification signal is for the execution phase at coding Between repeat informed code motion image data data volume, and
Export described indication signal described determine part described coding the term of execution update described indication signal so that Under the data volume of described encoded moving image data, the reproduction interval of a plurality of view data in encoded moving image data tends to Equal intervals, the data volume of described encoded moving image data is repeated notice by described notification signal.
CN201110176610.3A 2010-06-28 2011-06-28 Encoding device, imaging device, coding send system and coded method Expired - Fee Related CN102300090B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010-146434 2010-06-28
JP2010146434A JP2012010263A (en) 2010-06-28 2010-06-28 Encoding device, imaging device, encoding/transmitting system and encoding method

Publications (2)

Publication Number Publication Date
CN102300090A CN102300090A (en) 2011-12-28
CN102300090B true CN102300090B (en) 2016-12-14

Family

ID=

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1536891A (en) * 2003-02-05 2004-10-13 ���µ�����ҵ��ʽ���� Image signal reproducing device and method
CN1668110A (en) * 2004-03-11 2005-09-14 宝利通公司 Method and apparatus for improving the average image refresh rate in a compressed video bitstream

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1536891A (en) * 2003-02-05 2004-10-13 ���µ�����ҵ��ʽ���� Image signal reproducing device and method
CN1668110A (en) * 2004-03-11 2005-09-14 宝利通公司 Method and apparatus for improving the average image refresh rate in a compressed video bitstream

Similar Documents

Publication Publication Date Title
US6115420A (en) Digital video signal encoder and encoding method
KR101418950B1 (en) An improved video rate control for video coding standards
US4958226A (en) Conditional motion compensated interpolation of digital motion video
EP0771120B1 (en) Video encoding apparatus
US6526097B1 (en) Frame-level rate control for plug-in video codecs
US20050074061A1 (en) Signaling buffer fullness
US5974185A (en) Methods and apparatus for encoding video data using motion vectors for decoding by regular or downconverting decoders
EP1921863A2 (en) An encoder
JP4273207B2 (en) Method and apparatus for encoding or decoding digital video data
WO1994024822A1 (en) Method and apparatus for coding image, and image recording medium
KR20020064925A (en) Video bitrate control method and device for digital video recording
JP4632049B2 (en) Video coding method and apparatus
US9615095B2 (en) Coding device, imaging device, coding transmission system, and coding method
US20050243917A1 (en) H.263/MPEG video encoder using average histogram difference and method for controlling the same
JP2001054110A (en) Signal processing unit, signal processing method and computer program product
KR0152013B1 (en) Moving estimation device considering variable length coding
CN102300090B (en) Encoding device, imaging device, coding send system and coded method
JP2008263443A (en) Information processing apparatus and method, and program
JPH08307860A (en) Scene re-encoder
JP4718736B2 (en) Video encoding device
KR100203637B1 (en) Apparatus for coding motion picture
WO2012069318A1 (en) Bit rate regulation module and method for regulating bit rate
KR100397133B1 (en) Method and System for compressing/transmiting of a picture data
Pan et al. Adaptive frame skipping based on spatio-temporal complexity for low bit-rate video coding
JP4379046B2 (en) Video encoding apparatus and code amount control method

Legal Events

Date Code Title Description
PB01 Publication
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20160930

Address after: Kanagawa

Applicant after: SONY SEMICONDUCTOR SOLUTIONS Corp.

Address before: Tokyo, Japan

Applicant before: Sony Corp.

GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20161214