CN1691769A - Video recording apparatus for variable frame-rate recording, multiplexing method, picture encoding method - Google Patents
Video recording apparatus for variable frame-rate recording, multiplexing method, picture encoding method Download PDFInfo
- Publication number
- CN1691769A CN1691769A CNA2005100629461A CN200510062946A CN1691769A CN 1691769 A CN1691769 A CN 1691769A CN A2005100629461 A CNA2005100629461 A CN A2005100629461A CN 200510062946 A CN200510062946 A CN 200510062946A CN 1691769 A CN1691769 A CN 1691769A
- Authority
- CN
- China
- Prior art keywords
- frame rate
- data
- rate
- frame
- picture signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
A video recording apparatus provides a slow motion effect or a quick motion effect by digitally converting the frame-rate instead of by changing the playback speed of the film, and using few recording media without requiring any special device at playing. A picture encoding part encodes only valid frames by changing a rate-controlling method so that a predetermined playing frame-rate is obtained at a standard data-rate at playing. And a TS multiplexing part multiplexes by converting a frequency of a standard STC clock by only a ratio of valid frame-rate and playing frame-rate, and generating values for PCR, PTS, and DTS.
Description
Technical field
The present invention relates to a kind of video recording apparatus, as video camera etc., more specifically, relate to a kind of being adapted to pass through and replace using film, digitally converting frame rate provides the slow motion in the film or the video recording apparatus of fast motion effect, and a kind of multiplexing method, picture coding method, program and recording medium that is used to dispose video recording apparatus.
Background technology
Traditionally, utilize film to take and edit film.Traditional video recording apparatus based on film is by with the F.F. of film or put slowly and change the record frame rate slow motion or fast motion effect in the film are provided.
Semiconductor technology, computer technology and high density recording development of technology have improved the image quality and the performance of broadcasting equipment system.Now, produce increasing film with the Digital Theater System that utilizes VTR and computer based non-linear editing instrument.These new methods comprise a kind of method that slow motion and fast motion effect digitally are provided with the multiframe speed imaging device that can be set to any number by the frame rate of CCD (charge coupled device) driving method in the control imaging moiety, imaging.
For example, being published in " video α " the 19th No./the 4, volume, the sequence number published by Shashin-Kogyou Publishing Inc. by Katsuyuki Taguchi and Minoru Namikawa in April, 2003 is that " TECHNIQUE CALLED ' VARIABLE FRAME RATEFUNCTION ' " on 180 described a kind of VTR that slow motion and fast motion effect can digitally be provided with multiframe speed imaging device.This equipment can be 1 frame/second step-length from 4 frame/seconds to 60 frames/second ground changes frame rate, with driven CCD gradually.For simplicity, in the description afterwards, imaging speed is X frame/second, and will be called the Xp picture signal from the picture signal of CCD output.Although can change frame rate with the step-length of 1 frame/second in the example of " TECHNIQUE CALLED ' VARIABLE FRAME RATEFUNCTION ' ", X needs not to be integer, and can it be set to any number in the real number scope.
CCD output is the Xp picture signal.In the VTR part in being included in multiframe speed imaging device, will be changed to the signal record of 60 frame/seconds by so-called drop-down processing (its expression repeats each frame once or more times) is the 60p picture signal.Finish the VTR that compresses in the so-called frame of compression as the VTR here with using wherein, thereby in the compressed video data, obtain arbitrary frame at each frame.
That is to say that multiframe speed imaging device has the view finder that comprises the liquid crystal board that is called as EVF (electronic viewfinder).EVF can typically only show the 60p picture signal, and can not come the display frame signal with the frame rate of taking, as 12 frame/seconds.Must carry out drop-down processing to the Xp picture signal, becoming the 60p picture signal that can on EVF, show, thereby make EVF can show the Xp picture signal that CCD output shows.To be recorded on the VTR by the 60p picture signal that drop-down processing obtains.
When playing, play the 60p picture signal that obtains by drop-down processing by tape.Traditional video recording apparatus is by obtaining Xp picture signal (signal before the drop-down processing) from the 60p picture signal, and be called as " frame rate converter " thus particular device change its time shaft to make frame rate be 24 frame/seconds, and in VTR, with this signal record 24p picture signal, so that edit, provide slow motion and fast motion effect.
Summary of the invention
But under the situation that only needs record Xp picture signal, when writing down the 60p picture signal that obtains by drop-down processing among the VTR that it compresses in application of frame, traditional video recording apparatus has consumed considerable recording medium.
In addition, the particular device that need be called as " frame rate converter " is changed to generate the 24p picture signal in the acquisition of carrying out the Xp picture signal after VTR plays and time shaft.
Consider the problems referred to above, the object of the present invention is to provide a kind of video recording apparatus, a kind of multiplexing method, a kind of picture coding method, a kind of program and a kind of recording medium, consume a spot of recording medium, and when playing without any need for specific equipment.
In order to address the above problem, a first aspect of the present invention is a kind of video recording apparatus, comprising:
Multiplexer, operation are used for the time management information that defined decode time and are undertaken multiplexingly by the squeezed data that the compressed encoding of carrying out the input picture signal produces, and operation is used for output system stream; And
Tape deck, operation is used for system flow is recorded in recording medium;
Wherein when the record frame rate of input picture signal is different from the default broadcast frame rate that is used to play the picture signal that obtains after record, broadcast and decode system stream, described multiplexer pair carries out multiplexing with default broadcast corresponding time management information of frame rate and squeezed data.
A second aspect of the present invention is the video recording apparatus according to first aspect present invention, comprises picture coding apparatus, and operation is used to carry out the compressed encoding to the input picture signal, and output squeezed signal.
A third aspect of the present invention is the video recording apparatus according to first aspect present invention, and wherein the squeezed data are to produce by some frames of input picture signal are carried out the interframe compression.
A fourth aspect of the present invention is the video recording apparatus according to first aspect present invention, and wherein the squeezed data are to produce according to the input picture signal that obtains from the imaging device that can change frame rate during imaging.
A fifth aspect of the present invention is the video recording apparatus according to first aspect present invention, the operation of wherein said multiplexer is used to carry out and meets the multiplexing of mpeg standard, and time management information comprises PCR or SCR as the timing base of decoding and output (demonstration), wherein PTS represents to export the timing of each decoded frame, and DTS represents that decoding regularly.
A sixth aspect of the present invention is the video recording apparatus according to first aspect present invention, wherein said multiplexer has clock, operation is used for the generation time management system, and described clock has the frequency that can change according to employed fiducial value when the record frame rate is identical with the broadcast frame rate; And
Wherein when the record frame rate was different from the broadcast frame rate, described multiplexer changed the frequency of described clock according to fiducial value, and used the frequency after changing to come generation time management information.
A seventh aspect of the present invention is the video recording apparatus according to sixth aspect present invention, be X frame/second (X is a real number) wherein when writing down frame rate, and when to play frame rate be Y frame/second, the X/Y that described multiplexer becomes the fiducial value of X when identical with Y with the frequency of described clock doubly and uses the frequency after changing to come generation time management information.
A eighth aspect of the present invention is the video recording apparatus according to first aspect present invention, be X frame/second (X is a real number) wherein when writing down frame rate, and when to play frame rate be Y frame/second, described multiplexer management information computing time, thereby make difference between the time management information be the difference between corresponding fiducial time of the management information X/Y doubly, wherein the time management information that is produced when X is identical with Y is management information fiducial time.
A ninth aspect of the present invention is the video recording apparatus according to first aspect present invention, wherein when the record frame rate is different from the broadcast frame rate, described multiplexer produces timing base information with the multiplexing interval that is different from the multiplexing interval of benchmark, wherein the multiplexing interval of benchmark be the record frame rate with the identical situation of broadcast frame rate under, at the multiplexing interval of the timing base information (RCR) in the time management information.
A tenth aspect of the present invention is the video recording apparatus according to ninth aspect present invention, be X frame/second (X is a real number) wherein when writing down frame rate, and when to play frame rate be Y frame/second, described multiplexer produces timing base information, thereby make timing base information (PCR) in the time management information be the multiplexing interval of benchmark X/Y doubly, wherein the multiplexing interval of benchmark is the multiplexing interval under the X situation identical with Y.
A eleventh aspect of the present invention is a kind of video recording apparatus, comprising:
Picture coding apparatus, operation are used to carry out the compressed encoding to the input picture signal, and output squeezed data;
Multiplexer, operation are used for other information and squeezed data are carried out multiplexing, and output system stream; And
Tape deck, operation is used for system flow is recorded in recording medium;
Wherein said picture coding apparatus operation is used for when the record frame rate is different from the broadcast frame rate, change the data rate of squeezed data according to reference data speed, and carry out compressed encoding to the input picture signal, wherein reference data speed is the played data speed of the broadcast frame rate preset during the picture signal of acquisition with playing after record, broadcast and decode system stream when the record frame rate of the input picture signal squeezed data when identical.
A twelveth aspect of the present invention is the video recording apparatus of the tenth one side according to the present invention, wherein when the record frame rate is different from the broadcast frame rate, described picture coding apparatus is carried out the compressed encoding to the input picture signal, thereby makes the data rate approximate match of playing during the squeezed data in reference data speed.
A thirteenth aspect of the present invention is the video recording apparatus of the 12 aspect according to the present invention, be X frame/second (X is a real number) wherein when writing down frame rate, when playing frame rate and be Y frame/second and reference data speed and being R bps (R is a real number), described picture coding apparatus is carried out rate controlled, thereby with R * (X/Y) bps data rate the input picture signal is carried out compressed encoding.
A fourteenth aspect of the present invention is the video recording apparatus of the 13 aspect according to the present invention, and wherein system flow is the stream that meets the MPEG2 standard; And
The operation of wherein said picture coding apparatus is used for that the picture_rate that expression respectively is used for the input image frame speed of rate controlled is set to X, the bit_rate that represents the targeted rate of squeezed data is set to R * (X/Y).
A fifteenth aspect of the present invention is the video recording apparatus of the 12 aspect according to the present invention, be X frame/second (X is a real number) wherein when writing down frame rate, when playing frame rate and be Y frame/second and reference data speed and being R bps (R is a real number), described picture coding apparatus is carried out rate controlled, thereby carrying out its frame rate with R bps data rate is the compressed encoding of the input picture signal of Y, and irrelevant with the frame rate as the input picture signal of X.
A sixteenth aspect of the present invention is the video recording apparatus of the 15 aspect according to the present invention, and wherein system flow is the stream that meets the MPEG2 standard; And
The operation of wherein said picture coding apparatus is used for the picture_rate that expression respectively is used for the input image frame speed of rate controlled and is set to Y, represents that the bit_rate of the targeted rate of squeezed data is set to R.
A seventeenth aspect of the present invention is the video recording apparatus of the tenth one side according to the present invention, wherein be different from when playing frame rate when the record frame rate, described picture coding apparatus changes according to the record frame rate and plays that frame rate is corresponding, the data rate of squeezed data during playing.
A eighteenth aspect of the present invention is a kind of video recording apparatus, comprising:
Multiplexer, operation be used for to other information and by picture signal is carried out squeezed data that compressed encoding produces carry out multiplexing, and output system stream; And
Tape deck, operation is used for system flow is recorded in recording medium;
Wherein said multiplexer operation is used for when the record frame rate is different from the broadcast frame rate, change the register system data rate of system flow according to reference data speed, and carry out multiplexingly, wherein the baseline system data rate is when the record frame rate of the input picture signal system flow played data speed when the default broadcast frame rate of the picture signal of acquisition is identical with playing after record, broadcast and decode system stream.
A nineteenth aspect of the present invention is the video recording apparatus of the tenth eight aspect according to the present invention, wherein when the record frame rate is different from the broadcast frame rate, described multiplexer is carried out multiplexing to the compressed encoding picture signal, thus make and play that frame rate is corresponding, the data rate approximate match of the system flow during playing is in the baseline system data rate.
A twentieth aspect of the present invention is the video recording apparatus of the 19 aspect according to the present invention, even it is Rts bps (Rts is the real number of Rts＞R) that the operation of wherein said multiplexer is used for the data rate that X is different from Y and system flow, carry out multiplexing, thereby when the squeezed data having been carried out compressed encoding so that can decode to the squeezed data with R bps the time, at described multiplexer during to described tape deck output system stream, the output data rate of system flow is Rts * (X/Y) bps, wherein writing down frame rate is X frame/second (X is a real number), playing frame rate is Y frame/second, and the played data speed of the squeezed data of X when identical with Y is R bps of reference data speed (R is a real number).
The of the present invention the 20 is the video recording apparatus of the tenth eight aspect according to the present invention on the one hand, and wherein when the record frame rate was different from the broadcast frame rate, described multiplexer changed the data rate of system flow during playing according to the frame rate of input picture signal.
The 22 aspect of the present invention is the video recording apparatus according to second aspect present invention, comprise the valid frame checkout gear, operation is used for by utilizing input valid frame mark to obtain the valid frame mark from the input picture signal, and be by the time with each frame repeats once or more times produces picture signal at the input picture signal, and when having imported expression as the valid frame mark of the valid frame of the primitive frame that is used to produce described input picture signal, the valid frame that is obtained to described picture coding apparatus output.
The 23 aspect of the present invention is the video recording apparatus according to first aspect present invention, wherein said multiplexer operation is used for except that the squeezed data, input audio data also, and (1) is when the record frame rate is identical with the broadcast frame rate, described multiplexer carries out multiplexing to input audio data and system flow, and (2) when the record frame rate is different from when playing frame rate, and described multiplexer does not carry out multiplexing to input audio data and system flow.
The 24 aspect of the present invention is the video recording apparatus according to first aspect present invention, comprise sound conversion device, wherein when except that the squeezed data, going back input audio data, and (1) is when the record frame rate is identical with the broadcast frame rate, described sound conversion device output sound data, as the recording voice data, and do not change the sample frequency of input audio data; And (2) when the record frame rate is different from when playing frame rate, and described sound conversion device is converted to different frequencies with the sample frequency of input audio data, and the output sound data, as the recording voice data; And
Wherein said multiplexer operation is used for output recording voice data multiplex in system flow.
The 25 aspect of the present invention is the video recording apparatus of the 24 aspect according to the present invention, the operation of wherein said sound conversion device is used for X/Y that sample frequency with input audio data is converted to X and the asynchronous frequency of Y doubly, wherein writing down frame rate is X frame/second (X is a real number), is Y frame/second (Y is a real number) and play frame rate.
The 26 aspect of the present invention is the video recording apparatus according to first aspect present invention, and wherein system flow comprises a plurality of groupings; And
Wherein said tape deck operation is used for the grouping reproduction time management information that has defined reproduction time multiplexing in the grouping that is included in system flow, and it is recorded on the recording medium;
Wherein said tape deck operation is used for when the record frame rate is different from the broadcast frame rate, changes grouping reproduction time information according to benchmark grouping reproduction time information, and multiplexing this information;
Wherein benchmark grouping reproduction time information is the grouping reproduction time information of record frame rate when identical with the broadcast frame rate.
The 27 aspect of the present invention is the video recording apparatus of the 26 aspect according to the present invention, wherein said tape deck has clock, operation is used for producing grouping reproduction time information, and employed fiducial value changed when its frequency was can be according to the record frame rate identical with the broadcast frame rate; And
Wherein when the record frame rate was different from the broadcast frame rate, described tape deck changed the frequency of described clock according to fiducial value, and used the frequency after changing to produce grouping reproduction time management information.
The 20 eight aspect of the present invention is the video recording apparatus of the 27 aspect according to the present invention, be X frame/second (X is a real number) wherein when writing down frame rate, and when to play frame rate be Y frame/second, the X/Y that described tape deck becomes the fiducial value of X when identical with Y with the frequency of described clock doubly and uses described clock to produce grouping reproduction time management information.
The 29 aspect of the present invention is the video recording apparatus of the 26 aspect according to the present invention, be X frame/second (X is a real number) wherein when writing down frame rate, and when to play frame rate be Y frame/second, described tape deck calculates grouping reproduction time information, thereby makes X/Y that difference between the numerical value of continuous grouping reproduction time information is approximately the difference between the numerical value of corresponding benchmark grouping reproduction time information doubly.
The 30 aspect of the present invention is the video recording apparatus of the 29 aspect according to the present invention, the operation of wherein said tape deck is used for calculating poor between the numerical value of respective packets reproduction time information when described tape deck, thereby when making grouping reproduction time information be approximately X/Y times of difference of continuous benchmark grouping reproduction time information, from a plurality of numerical value, select the difference of respective packets reproduction time information to determine, and calculate grouping reproduction time information, thereby selected result's mean value be benchmark grouping reproduction time information difference X/Y doubly.
The of the present invention the 30 is a kind of video recording apparatus on the one hand, comprising:
Picture coding apparatus, operation are used for the input picture signal that obtains from the imaging device that can change over the frame rate during looking like is carried out compressed encoding, and output squeezed data; And
Tape deck, operation is used for output squeezed data are recorded in recording medium;
Wherein the frame rate of squeezed data during with imaging is recorded on the recording medium; And
The squeezed data that wherein will be recorded on the recording medium are converted to predetermined predetermined broadcast frame rate.
The 32 aspect of the present invention is a kind of multiplexing method, comprising:
To the time management information that defined decode time and undertaken by the squeezed data that the compressed encoding of carrying out picture signal produces multiplexing, and output system stream; And
System flow is recorded on the recording medium;
Wherein, the record frame rate of input picture signal is used to play after record, broadcast and decode system stream and during the default broadcast frame rate of the picture signal that obtains when being different from, and described multiplexing to carrying out multiplexing with default broadcast corresponding time management information of frame rate and squeezed data.
The 33 aspect of the present invention is a kind of multiplexing method, be used for carrying out multiplexing to the time management information and the squeezed data that have defined decode time, described squeezed data to its frame rate be X frame/second the X picture signal of (X is a real number) carried out compressed encoding, thereby can the X picture signal be decoded as the Y picture signal that its frame rate is Y frame/second (Y is a real number) with the broadcast bit rate of R bps (R is a real number);
Wherein said method comprise standard time management information is carried out multiplexing, thereby make difference between the numerical value of management information be X/Y doubly; And
Wherein when X=Y, thus fiducial time management information be want multiplexing carried out compressed encoding can be with the time management information on the squeezed data of R bps broadcast bit rate decoding X picture signal.
The 34 aspect of the present invention is a kind of multiplexing method, be used for carrying out multiplexing to the time management information and the squeezed data that have defined decode time, described squeezed data have been carried out compressed encoding, thereby can be that the X picture signal of X frame/second (X is a real number) is decoded as the Y picture signal that its frame rate is Y frame/second (Y is a real number) with its frame rate;
Wherein said method comprises the timing base information (PCR) in the control time management information, is spaced apart Y/X doubly thereby make to multiply each other.
The 35 aspect of the present invention is a kind of picture coding method, comprising:
The input picture signal is carried out compressed encoding, and output squeezed data;
Out of Memory and squeezed data are carried out multiplexing, and output system stream; And
System flow is recorded on the recording medium;
Wherein when the record frame rate is different from the broadcast frame rate, described execution compressed encoding changes the record data speed of squeezed data according to reference data speed, and the input picture signal carried out compressed encoding, wherein reference data speed is when the record frame rate of the input picture signal squeezed data playback data rate when the default broadcast frame rate of the picture signal of acquisition is identical with playing after record, broadcast and decode system flow.
The 36 aspect of the present invention is a kind of picture coding method, be used for to its frame rate be X frame/second the X picture signal of (X is a real number) carry out compressed encoding, thereby can the X picture signal be decoded as the Y picture signal that its frame rate is Y frame/second (Y is a real number) with the broadcast bit rate of R bps (R is a real number), described method comprises:
Obtain to play frame rate Y and play bit rate R;
Input is used for the frame rate value X of imaging;
The input image frame speed picture_rate that is used for rate controlled is set to X, and the targeted rate bit_rate of squeezed data is set to R (X/Y); And
Utilize the value of picture_rate and bit_rate to carry out the rate controlled of compressed encoding.
The 37 aspect of the present invention is a kind of picture coding method, be used for to its frame rate be X frame/second the X picture signal of (X is a real number) carry out compressed encoding, thereby can the X picture signal be decoded as the Y picture signal that its frame rate is Y frame/second (Y is a real number) with the broadcast bit rate of R bps (R is a real number), described method comprises:
Obtain to play frame rate Y and play bit rate R;
Input is used for the frame rate value X of imaging;
The input image frame speed picture_rate that is used for rate controlled is set to Y, and the targeted rate bit_rate of squeezed data is set to R; And
Utilize the value of picture_rate and bit_rate to carry out the rate controlled of compressed encoding.
The 30 eight aspect of the present invention is a kind of program of using with computer, and described program comprises:
Operation be used to make computer to the time management information that defined decode time and undertaken by the squeezed data that the compressed encoding of carrying out the input picture signal produces multiplexing, and the executable code that makes computer output system stream; And
Operation is used to make computer that system flow is recorded in executable code on the recording medium;
Wherein be used to play after record, broadcast and decode system stream and during the default broadcast frame rate of the picture signal that obtains when the record frame rate of input picture signal is different from, described operation is used to make computer to carry out multiplexing executable code pair to carry out multiplexing with default broadcast corresponding time management information of frame rate and squeezed data.
The 39 aspect of the present invention is a kind of program of using with computer, and described program comprises:
Operation is used to make the compressed encoding of computer execution to the input picture signal, and the executable code of output squeezed data;
It is multiplexing that operation is used to make computer that other information and squeezed data are carried out, and the executable code of output system stream; And
Operation is used to make computer that system flow is recorded in executable code on the recording medium; And
The executable code operation that wherein said operation is used to make computer carry out compressed encoding is used for when the record frame rate is different from the broadcast frame rate, change the data rate of squeezed data according to reference data speed, and carry out compressed encoding to the input picture signal, wherein reference data speed is the broadcast frame rate preset during the picture signal of acquisition with playing after record, broadcast and decode system stream when the record frame rate of the input picture signal squeezed data playback data rate when identical.
The 40 aspect of the present invention is a kind of program of using with computer, and described program comprises:
Operation is used to make computer to other information with undertaken multiplexingly by picture signal being carried out squeezed data that compressed encoding produces, and makes the executable code of computer output system stream; And
Operation is used to make computer that system flow is recorded in executable code on the recording medium;
Wherein said operation is used to make computer to carry out multiplexing executable code operation and is used for when the record frame rate is different from the broadcast frame rate, change the register system data rate of system flow according to reference data speed, and carry out multiplexingly, wherein the baseline system data rate is when the record frame rate of the input picture signal system flow played data speed when the default broadcast frame rate of the picture signal of acquisition is identical with playing after record, broadcast and decode system stream.
The of the present invention the 40 is a kind of computer-readable medium that comprises the described program of the 30 eight aspect according to the present invention on the one hand.
The 42 aspect of the present invention is a kind of computer-readable medium that comprises the described program in the 39 aspect according to the present invention.
The 43 aspect of the present invention is a kind of computer-readable medium that comprises the described program in the 40 aspect according to the present invention.
The 44 aspect of the present invention is the video recording apparatus of the tenth one side according to the present invention, wherein said multiplexer operation is used for except that the squeezed data, input audio data also, and (1) is when the record frame rate is identical with the broadcast frame rate, described multiplexer carries out multiplexing to input audio data and system flow, and (2) when the record frame rate is different from when playing frame rate, and described multiplexer does not carry out multiplexing to input audio data and system flow.
The 45 aspect of the present invention is the video recording apparatus of the tenth eight aspect according to the present invention, wherein said multiplexer operation is used for except that the squeezed data, input audio data also, and (1) is when the record frame rate is identical with the broadcast frame rate, described multiplexer carries out multiplexing to input audio data and system flow, and (2) when the record frame rate is different from when playing frame rate, and described multiplexer does not carry out multiplexing to input audio data and system flow.
The 46 aspect of the present invention is the video recording apparatus of the tenth one side according to the present invention, comprise sound conversion device, wherein when except that the squeezed data, going back input audio data, and (1) is when the record frame rate is identical with the broadcast frame rate, described sound conversion device output sound data, as the recording voice data, and do not change the sample frequency of input audio data; And (2) when the record frame rate is different from when playing frame rate, and described sound conversion device is converted to different frequencies with the sample frequency of input audio data, and the output sound data, as the recording voice data; And
Wherein said multiplexer operation is used for output recording voice data multiplex in system flow.
The 47 aspect of the present invention is the video recording apparatus of the tenth eight aspect according to the present invention, comprise sound conversion device, wherein when except that the squeezed data, going back input audio data, and (1) is when the record frame rate is identical with the broadcast frame rate, described sound conversion device output sound data, as the recording voice data, and do not change the sample frequency of input audio data; And (2) when the record frame rate is different from when playing frame rate, and described sound conversion device is converted to different frequencies with the sample frequency of input audio data, and the output sound data, as the recording voice data; And
Wherein said multiplexer operation is used for output recording voice data multiplex in system flow.
Description of drawings
Fig. 1 shows the block diagram that has according to the imaging/tape deck of the video recording apparatus of the embodiment of the invention 1;
Fig. 2 is the schematic diagram of the signal waveform of each parts among Fig. 1;
Fig. 3 shows the more detailed block diagram according to the video recording apparatus 2 of the embodiment of the invention 1;
Fig. 4 is the schematic diagram of the signal waveform of each parts among Fig. 1 and Fig. 3;
Fig. 5 shows the data capacity of the bit buffer unit 36 that permission decodes and the schematic diagram of VBV buffer capacity when playing;
Fig. 6 shows the flow chart of the process in the rate control device 32;
Fig. 7 shows the block diagram that will add the structure on the STC clock-generating device 53 to;
Fig. 8 is the schematic diagram of the signal waveform of each parts under the slow motion situation, among Fig. 1 and Fig. 3;
Fig. 9 shows at the data capacity of the bit buffer unit 36 of decoding under the slow-motion situation, when allowing in broadcast and the schematic diagram of VBV buffer capacity;
Figure 10 shows the block diagram according to the video recording apparatus 2 of the embodiment of the invention 2;
Figure 11 be when MPEG2-TS being recorded on the tape deck 23, stores packets concept map regularly;
Figure 12 is the example that is added with the TS grouping of ATS;
Figure 13 is the example that is used to reproduce the broadcast circuit regularly of the TS grouping that is added with ATS;
Figure 14 shows when imaging frame rate value X=(8/1.001) fps, the time diagram of the operation of each parts;
Figure 15 shows when imaging frame rate value X=14.985fps, the time diagram of the operation of each parts;
When Figure 16 shows and carries out addressing at imaging frame rate value X=14.985fps and to the mark time interval between the TS grouping, the schematic diagram of the operation of each parts; And
Figure 17 shows the block diagram of the typical structure of ATS numerical value generation device 90.
Embodiment
Can provide a kind of according to video recording apparatus of the present invention, picture coding method, multiplexing method, program and recording medium and only write down the video recording apparatus that valid frame (X picture signal) consumes a small amount of recording medium by said structure.Can also provide a kind of its based on default play that frame rate carries out that compressed encoding is handled and multiplexing process in when playing, without any need for the video recording apparatus of specific device.
Now, with reference to the accompanying drawings video recording apparatus according to the present invention, picture coding method and multiplexing method are described.
[embodiment 1]
Fig. 1 shows the block diagram that has according to the imaging/tape deck of the video recording apparatus of the embodiment of the invention 1.
In Fig. 1, reference number 1 expression imaging device, 2 expression video recording apparatus, 3 expression electronic viewfinders (after this being abbreviated as EVF), 4 expression microphones, 5 represent control sections, 6 expression 60p picture signals, and 7 expressions are used for from the valid frame mark of 60p picture signal acquisition with the corresponding valid frame of exporting from CCD 10 of Xp picture signal.
The CCD that reference number 10 expressions can scan progressively, 11 expression frame memories, the shooting processing section that 12 expressions are used to make a video recording and handle, 13 expression CCD drive circuits, and 14 expressions are used to switch and the driving pulse commutation circuit of output and the corresponding driving pulse of multiframe speed.
Next, will the operation of present embodiment be described.
Driving pulse commutation circuit 14 receives control signal from control section 5, produces the required driving pulse of imaging Xp picture signal, and these pulses are outputed to CCD drive circuit 13.CCD drive circuit 13 is converted to predetermined voltage by the driving pulse of self-driven pulse commutation circuit 14 in the future and comes driven CCD 10.CCD 10 is to the Xp picture signal of frame memory 11 output imagings.
Fig. 2 is the schematic diagram of the signal waveform of each parts among Fig. 1.Reference number 502 expressions are from the output signal of CCD 10.Although in Fig. 2, show as actual Xp picture signal from the output signal of CCD 10, output signal only need comprise and the corresponding image information of Xp picture signal, and the form of synchronizing signal needn't be identical with the form of Xp picture signal.
Image information changes according to the Xp picture signal in the 60p picture signal that obtains by drop-down processing.Shown in 502c, the transition position between image information obtains part 20 outputs to valid frame and is used for from the valid frame mark 7 of 60p picture signal acquisition with the corresponding valid frame of Xp picture signal.Although valid frame mark 7 is suitable for exporting separately with picture signal 6, can carry out multiplexingly to it, and in the vertical blanking cycle of picture signal 6, export.
Valid frame obtains part 20 and uses valid frame mark 7 to obtain the Xp picture signal from the 60p picture signal, and to TS multiplexing part 21 output Xp picture signals.21 pairs of inputs of TS multiplexing part Xp picture signal carries out the MPEG video compression coding, and output squeezed data.Here, the Xp picture signal is carried out compressed encoding, carry out the control of compressed encoding speed and the interpolation of header the 24 frames/second during according to broadcast.If ought be under the normal recordings pattern (promptly, imaging frame rate and broadcast frame rate identical (X=24)) when writing down picture, reference data speed is R bps, and TS multiplexing part 21 is carried out rate controlled, is R (X/24) bps with Xp picture signal compressed encoding.To describe this processing in detail after a while.
On the other hand, will be input to acoustic coding part 24, carry out the audio compression coding with the voice signal of microphone 4 records, and the output compression sound data.Can come processing audio signal according to the frame-rate conversion of picture signal.In other words, in the sample frequency of voice signal is Fa and reference data speed after the compressed encoding is under the situation of Ra, frame rate according to the input picture signal, the sample frequency of voice signal is converted to (X/24), and voice signal is compressed by carrying out rate controlled, thereby when carrying out the audio compression coding, the data rate of compression sound data will be Ra (X/24).Perhaps, can sample frequency is multiplexing on input audio signal according to the voice data that the frame rate of importing picture signal is converted into (X/24), and do not carry out compressed encoding.
That is to say that when the frame rate of frame rate system flow when equaling to play of input picture signal, acoustic coding part 24 output sound data as the recording voice data, and need not to change the sample frequency of input audio data.When the frame rate of input picture signal was different from the frame rate of system flow when playing, acoustic coding part 24 can be converted to the sample frequency of input audio data another frequency, and the output sound data, as the recording voice data.
At only producing and the multiplexed compressed voice data when the X=24, otherwise do not produce the not situation of multiplexed compressed voice data yet, described present embodiment, as the realization example of more simplifying.
In other words, TS multiplexing part 22 input audio datas and squeezed data.When the frame rate of frame rate system flow when equaling to play of input picture signal, TS multiplexing part 22 is multiplexed into input audio data in the system flow.When the frame rate of input picture signal was different from the frame rate of system flow when playing, TS multiplexing part 22 was not multiplexed into input audio data in the system flow.
22 pairs of information that define decode time of TS multiplexing part, with must information from relevant other of the squeezed data of TS multiplexing part 21 input and carry out from the compression sound data of acoustic coding part 24 inputs multiplexing, and output system flow that represent by 502d, the MPEG-TS form.
In 502d etc., for example, " I " expression I picture in " I2 ", be intra-coded picture (interior coded picture), for example, " B " expression B picture in " B0 ", it is the bi-directional predictive coding picture, for example, " P " expression P picture in " P5 ", i.e. forward predictive coded picture (prediction encoded picture) between two frames.Therefore, different with the conventional video recording equipment described in " background technology ", the video recording apparatus utilization of present embodiment is at compressing in compression of the interframe of B picture or P picture and the frame.
Record is from the system flow of TS multiplexing part 22 outputs in recording section 22.Time management information comprises PTS (show time scale) and the instruction decoding DTS (decoding markers) regularly as the timing of the PCR (program clock benchmark) of the timing base of coding and output (demonstration), each coded frame of indication output.
During when the system flow in the recording section 23 of the video recording apparatus that is recorded in present embodiment to outside decoding device output and by this decoding device decoding output system stream, utilize PCR to produce the STC (system clock) of the operation benchmark that is used as this decoding device.Then, decoding device is controlled, thereby carried out decoding according to STC, moment of being defined as PTS/DTS and showing.Therefore, when the Xp picture signal being carried out compressed encoding and when multiplexing, need to change the numerical value of PCR, PTS and DTS, thus according to play wherein the identical mode of situation of the 24p picture signal having been carried out compressed encoding and multiplexing system flow, when playing, control.Therefore, when the frame rate of Xp picture signal be different to be recorded in the recording section 23, when playing during the default frame rate of system flow, TS multiplexing part 22 will be when playing the corresponding time management information multiplexing of default frame rate of system flow in the squeezed data.The frame rate of the Xp picture signal of present embodiment is the example of record frame rate of the present invention, and the default frame rate of system flow is the example of broadcast frame rate of the present invention during the broadcast of present embodiment.To be described this after a while.
When playing, according to shown in 502e, play the identical form of 24p picture signal with reference data speed and come Play System stream.Also according to shown in 502f, come decoding compressed picture data at the identical mode of common 24p picture signal.At last, it is drop-down that the 24p picture signal of decoding is carried out so-called 2-3, becomes the progressive or interlaced pictures of 60 frame/seconds, so as compatible mutually with the interface between video recording apparatus that is used in present embodiment usually and the picture monitor, output then.Therefore, when carrying out compressed encoding, TS multiplexing part 21 must be provided with " repeat_first_field, top_fiele_first " according to this 2-3 is drop-down.
Fig. 3 is the block diagram that shows in more detail according to the video recording apparatus 2 of the embodiment of the invention 1.
With identical numeral give with Fig. 1 in identical assembly, and omit detailed description.Reference number 30 and 31 expressions are used to store the frame memory with the corresponding frame of B picture of the MPEG2 that is used to change the order of handling incoming frame, 32 expressions be used to control so that the data rate of squeezed data near the rate control device of desired value, 33 expression subtracters, 34 expression DCT devices, 35 expression quantization devices, 36 expressions are used for temporary transient store compressed picture data so that export the bit buffer unit of squeezed data with constant speed, 37 expression inverse quantization devices, 38 expression IDCT devices, 39 expression adders, and 40 and 41 expressions are used for the frame memory of Memory Reference picture.The TS multiplexing part 21 that comprises above-mentioned part is carried out the MPEG2 video compression coding.Because the MPEG2 video is the known standards of those of ordinary skills, with the detailed description of omitting based on each term of this standard, as DCT or quantification etc., and the operation of relating module.Because in the MPEG2 standard, the single width picture that will encode usually is called " picture ", in the following description, use interchangeably in " picture " and " frame ".Therefore, term " frame " is represented the identical meaning here with " picture ".
Reference number 50 and 55 expressions are used to produce respectively the PES generating apparatus with picture and the corresponding PES grouping of sound, 51 and 56 expressions are used for producing the TS generating apparatus of TS grouping by cutting apart input PES grouping and multiplexing information needed, 52 expressions are used for the TS grouping and carry out multiplexing multiplexer at another required grouping of picture and sound respectively, and 53 expressions are used to produce the STC clock-generating device of the STC clock of the time shaft benchmark that is used as creation-time management information.STC clock-generating device 53 is the examples according to clock of the present invention.Reference number 54 expression is used in the multiplexing timing of management the STC control circuit according to STC clock generating time management information.The TS multiplexing part 22 execution MPEG2-TS that comprise above-mentioned part are multiplexing.Because MPEG2-TS is the known standards of those of ordinary skills, with the detailed description of omitting based on each term of this standard, as PES (packetizing element flow) or TS (transmitting stream) etc., and the operation of relating module.
Fig. 4 is the schematic diagram of the signal waveform of each parts among Fig. 1 and Fig. 3.504d shows the chart of the content of frame memory 30, and 504e shows the chart of the content of frame memory 31, and 504f shows the chart of the content of frame memory 40, and 504g shows the chart of the content of frame memory 41.Be restricted to 30 and 31 these two in order to be used to store frame memory with the corresponding frame of B picture, must with shown in 504h, at the identical speed of the speed of 60p picture signal each frame of Xp picture signal is encoded.
Now, will describe in detail according to the rate controlled in the picture compressing and coding of the present invention.As mentioned above, in the present invention, TS multiplexing part 21 must be carried out rate controlled, thereby is R (X/24) bps with Xp picture signal compressed encoding.
Fig. 5 shows permission and carry out the data capacity of the bit buffer unit 36 in the decoded pictures coded portion and the schematic diagram of VBV buffer capacity when playing.Rate control device 32 must control squeezed data data rates, thereby the VBV buffer when playing can not produce overflow or underflow, shown in 505e.505c how to show during writing down according to the time interocclusal record each frame chart.505d shows when playing the chart of how playing each frame according to the time.When comparing 505c and 505d, although the content of data is identical, time shaft changes according to the ratio between imaging frame rate X and the broadcast frame rate 24.Therefore, the data rate among the 505c is that data rate among the 505d multiply by X/24.
The result is, the descend speed of (being output) of the data capacity of bit buffer unit is that the standard speed R of squeezed data multiply by X/24 among the 505b.On the other hand, the distance between the picture is the inverse of imaging frame rate X.Therefore, suppose that the ratio of vertical axis of 505b and 505e is identical, equate that by respectively each frame being carried out the data volume that compressed encoding produces promptly the length of each vertical line (vertical line 100 and 200,101 and 201) equates.That is to say the target data amount of each condensed frame and identical when rate control device 32 compresses the 24p picture signals (although the input picture signal is the Xp picture signal).
Fig. 6 shows the flow chart of the process in the rate control device 32.At step S1, be provided with and play frame rate Y (being fixed as 24 in the present embodiment) and play bit rate R (standard speeds of squeezed data).For example, can perhaps can from the nonvolatile memory of when realizing video recording apparatus, having stored preset value, read according to utilizing input on switch or GUI (graphical user interface) screen to determine the numerical value of Y and R.Then, at step S2, according to utilizing the input on switch or the GUI screen to be arranged to picture frame rate value X.
At step S3, calculating will be used to control the parameter of actual speed rate.One of them is picture_rate, for being input to the frame rate of the picture in the TS multiplexing part 21.Can be with imaging frame rate value X as picture_rate.Another is bit_rate, is the targeted rate of squeezed data.Can multiply each other and obtain bit_rate by playing bit rate R and imaging frame rate and playing ratio (X/Y) between the frame rate.
At last,, utilize, compressed encoding is carried out rate controlled at the picture_rate of step S3 acquisition and the numerical value of bit_rate at step S4.Any method can be used for rate controlled.For example, can use known and be used for MPEG2 is carried out the method for rate control of standardized MPEG2 TM5 (test model 5).Below, will the situation of the control method of using MPEG2 TM5 be described.
At rate control device 32 places, for example, to distribute to the target data amount of specific GOP (picture group) next picture afterwards according to the expression formula setting shown in the formula 1.In formula 1, Ti is the target data amount that will distribute to next I picture.Tp is the target data amount that will distribute to next P picture.Tb is the target data amount that will distribute to next B picture.Kp and Kb are the constants that depends on quantization device 35.Rgop is the remaining bits amount of distributing to as the GOP of pre-treatment.Np and Nb are included in the P picture in the GOP of pre-treatment and the volume residual of B picture.How complicated Xi, Xp and Xb are the respectively designators of the previous I picture of encoding of indication, P picture and B picture.Owing in MPEG TM5, disclose the details of parameter, with the description of omitting to it.
[formula 1]
Provide formula 2, as the initial value of the Rgop at the sequence top that is used to encode in the formula 1.Afterwards, when picture being encoded, upgrade this initial value at every turn.N is the quantity of the picture among the GOP who is included in the sequence.
[formula 2]
Therefore, Ti, Tp that obtains by formula 1 and Tb are according to changing as the bit_rate of the targeted rate of squeezed data with as the picture_rate of frame rate.When realizing rate control device 32 according to MPEG2 TM5 (utilizing formula 1 and formula 2), be R (X/24) and to make picture_rate be X by making bit_rate, the control of the buffer shown in 505b can easily be provided.
When the frame rate of input picture signal when being X frame/second, default frame rate when system flow is play is Y frame/second, and the reference data speed when being included in the squeezed data playback in the system flow is R bps, TS multiplexing part 21 is carried out rate controlled, thereby with R * (X/Y) bps data rate the input picture signal is carried out compressed encoding.
The target data amount that should be pointed out that each condensed frame in Fig. 5 is during with compression 24p picture signal identical (although the input picture signal is the Xp picture signal).Therefore, the processing of step S3 can become another processing that picture_rate=Y and bit_rate=R are set.In above-mentioned rate controlled at MPEG2 TM5, each expression formula that is associated with rate controlled changes according to the ratio of bit_rate/picture_rate, and use picture_rate and bit_rate, when bit_rate is that R and picture_rate are when being Y, can obtain identical result, as shown in Equation 3.
[formula 3]
That is to say, when the frame rate of importing picture signal is X frame/second, default frame rate when system flow is play is Y frame/second, and the reference data speed when being included in squeezed data playback in the system flow is when being R bps, TS multiplexing part 21 can obtain result same as described above, thereby is that the picture signal of Y carry out compressed encoding with R bps data rate to its frame rate even it carries out rate controlled, has nothing to do with the frame rate that be the input picture signal of X.
In other words, when the frame rate of input picture signal is different from frame rate when playing, 21 pairs of TS multiplexing part input picture signal carries out compressed encoding, thereby the reference data speed when making signal in fact with the squeezed data playback is complementary, its frame rate when playing.Therefore, TS multiplexing part 21 can be controlled the data rate of squeezed data, thereby when playing, the VBV buffer can not produce overflow or underflow.
Next, with the generation of describing in detail according to the time management information of the embodiment of the invention.As mentioned above, present embodiment need be when changing RCR, PTS and DTS, change is carried out the multiplexing time interval to PCR, PTS and DTS, thereby can carry out to the 24p picture signal that the situation of compressed encoding and multiplexing system flow is the same carries out identical control with playing wherein when playing.
When shown in 505d, playing and the coding of decoding shown in 505c, multiplexing and when having write down MPEG2-TS, the time interval between the multiplexing PCR of 505c, PTS and DTS be its time interval in 505d 24/X doubly.Therefore, when the frame rate of importing picture signal is X frame/second, and when the default frame rate of system flow is a Y frame/second when playing, the time interval that is used for multiplexing PCR, PTS and DTS be when its with X frame/when write down second fiducial time Y/X at interval doubly, wherein at time interval of the X of identical numerical value and Y be fiducial time at interval.On the other hand, utilize counting to produce these numerical value, described counting is used as the benchmark of time shaft at TS multiplexing part 22 places, and is used for multiplexing in required timing place of counting STC clock.Therefore, when multiplexing when being spaced apart 24/X times, the interval between the numerical value also be 24/X doubly, and this has caused some problems.
Therefore, in the present invention, adjust the numerical value of PCR, PTS and DTS.A kind of mode is to produce the STC clock is retained in PCR, the PTS of common frequency and DTS (being spaced apart 24/X doubly between its numerical value), utilizes calculator or software then, these numerical value and X/24 is multiplied each other, and carry out multiplexing to the result.That is to say, when the frame rate of importing picture signal is X frame/second, and the default frame rate of system flow when playing is when being Y frame/second, TS multiplexing part management information 22 computing time, and carry out multiplexing, thereby the difference between the association in time information be the difference between management information fiducial time X/Y doubly, wherein the time management information that is produced when X is identical with Y is management information fiducial time.Add calculator or CPU by output stage, can easily obtain being used to carry out the STC control circuit 54 of this processing at PCR, PTS and DTS.
Because in the MPEG2 standard, the interval of multiplexing PCR is defined as maximum 100ms, need the multiplexing interval of control, so that meet this constraint to play bit_rate R.Thereby this can realize the unified time of multiply by 24/X that is spaced apart in the real time of multiplexing PCR by control STC control circuit 54.That is to say, when the frame rate of importing picture signal is X frame/second, and the default frame rate of system flow when playing is when being Y frame/second, TS multiplexing part 22 is added PCR, thereby the Y/X that is spaced apart the multiplexing interval of benchmark that makes multiplexing PCR doubly, wherein the multiplexing multiplexing interval of benchmark that is spaced apart when X is identical with Y.
The another kind of mode that meets above-mentioned constraint is that the STC clock that will be used to produce the numerical value of PCR, PTS and DTS multiply by X/24.In order to produce this STC clock, need on STC clock-generating device 53, add circuit.
Fig. 7 shows the block diagram that will add the structure on the STC clock-generating device 53 to.Reference number 60 expressions are used to control frequency dividing ratio P, the Q of frequency divider 61,65 and 66 and the control device of R, the frequency that 61 expressions are used for the standard STC clock that will import is divided into the frequency divider of 1/Q, 62 expression phase difference detectors, 63 representative ring path filters, 64 expression VCO, and 65 expressions are used for the frequency from the output of VCO 64 is divided into the frequency divider of 1/P.Control device 60, frequency divider 61, phase difference detector 62, loop filter 63, VCO 64 and distributor 65 have constituted PLL.Reference number 66 expression is used for the frequency from the output of VCO 64 is divided into the frequency divider of 1/R.
Utilize structure shown in Figure 7, the frequency (27MHz) of STC clock can be become { 27MHz (P/Q) }/R.Therefore, can be by utilizing this structure with the frequency of STC clock and X/24 multiply each other required PCR, PTS of the MPEG2-TS that produces multiplexing 505c and the numerical value of DTS.
That is to say, when the frame rate of importing picture signal is X frame/second, and when the default frame rate of system flow is a Y frame/second when playing, the X/Y that TS multiplexing part 22 becomes the fiducial value (27MHz) of X when identical with Y with the frequency of STC clock doubly, and the STC clock after the utilization change, the respective value of generation PCR, PTS and DTS.Therefore, when the frame rate of input picture signal is different from the default frame rate of system flow when playing, TS multiplexing part 22 can change the frequency of STC clock according to fiducial value (27MHz), and STC clock generating PCR, PTS after the utilization change and the respective value of DTS.
Although three times of quick acting situations when Figure 4 and 5 show the broadcast of wherein imaging frame rate X=8 also can make it be higher than the 24 frame/seconds of playing frame rate by increasing imaging frame rate X, when broadcast, provide slow motion, shown in Fig. 8 and 9.Imaging frame rate X and to play frame rate 24 just numerically different in this case, can see, owing to by application said structure and operation, can provide slow motion when broadcast by comparison diagram 4 and Fig. 8, Fig. 5 and Fig. 9.
Therefore, embodiment 1 provides a kind of video recording apparatus, and it consumes a spot of recording medium by only writing down valid frame (Xp picture signal).Embodiment 1 can save recording medium, because at picture compressing and coding, it can realize high compression ratio by utilizing MPEG2, and this is the technology that has a kind ofly replaced encoding in frame, encoded in interframe.Embodiment 1 can also provide a kind of video recording apparatus that does not need specific device, because this equipment is carried out compressed encoding processing and multiplexing process according to the default frame rate (24 frame/second) of playing, and can play record with identical data rate R with identical frame rate (24 frame/second), as it being write down according to common mode.
Need not explanation, although by supposing with the drop-down 60p picture signal that is treated to of the Xp picture signal of imaging, and input video recording equipment, and the broadcast frame rate was 24 frame/seconds, embodiment 1 is described, also can and be converted in the picture signal input video recording equipment of N frame/second drop-down processing, and can be with M frame/handle second broadcast frame rate.
[embodiment 2]
Figure 10 shows the block diagram according to the video recording apparatus 2 of the embodiment of the invention 2.With identical numeral give with Fig. 1 and 3 in identical assembly, and omit detailed description.Reference number 90 expression ATS numerical value generation devices, 91 expression ATS multiplexers, and 92 expression recording medium control sections.
If when from TS multiplexer 22 when tape deck 23 transmits MPEG2-TS, actual available transfer rate is higher, then will transmit the TS grouping off and on.For MPEG2-TS is recorded on the recording medium effectively, can remove unnecessary information in the actual transmission stream, as the sky grouping etc.In this case, TS grouping is input to tape deck 23 and will need being recorded on the recording medium in some way from the timing of tape deck 23 output TS groupings.For this purpose, Blu-ray disc etc. is used and is arrived markers (ATS).
Below, will the effect of ATS to general record and broadcast be described.Figure 11 be when MPEG2-TS being recorded on the tape deck 23, stores packets concept map regularly.511a is 23 input TS from TS multiplexer 22 to tape deck.511b wants the TS of physical record on recording medium.511c is the TS that plays and export from recording medium.300～302nd, empty grouping.303～305 expressions do not have the timing of TS grouping.
When the input TS of 511a comprises sky when grouping shown in 300～302, should remove these empty groupings from the record TS of the 511b that is used for writing down, because empty grouping does not comprise the information that record and broadcasting pictures and sound are required.But, have at the timing information among the PCR of MPEG2-TS owing to arrive regularly, if shown in 511b, play, then can not play correct STC.Therefore, need vacate the part of empty grouping, and not have any grouping, shown in 511c, perhaps need to insert once more empty grouping, and input.In order to realize this purpose, the top that 511b adds the ATS that has indicated the incoming timing of grouping to will write down each grouping, and it is carried out record.
Figure 12 is the example that is added with the TS grouping of ATS.Before 188 bytes of the TS of MPEG2-TS grouping, added the ATS of 4 bytes.For example, by counting from operating with 27MHz so that be input to the ATS multiplexer 91 as the counter of 32 bits of ATS numerical value generation device 90 free-running operations, and before the counting with in each TS grouping input ATM tape deck 23 time is added on the TS grouping, realize the interpolation of this ATS.
Be used to reproduce the TS grouping that is added with ATS broadcast circuit regularly example as shown in figure 13.Reference number 70 expression smoothing buffer devices, 71 expressions are recorded in the ATS on the smoothing buffer device, 72 expression comparators, 73 expression read-out control part branches, and 74 expression counters.
With the input of the record TS shown in 511b smoothing buffer device 70.In the TS grouping in being recorded in smoothing buffer device 70, read out the ATS 71 that is added in the TS grouping of writing down at first, and input comparator 72.On the other hand, counter 74 is operated with 27MHz clock (with being used for producing the identical frequency of ATS when writing down), and counting is outputed to comparator 72.
When the record TS that plays shown in 511b, the ATS that adds in the TS grouping that will play at first is loaded in the counter 74, divide into groups and export a TS.Then, comparator 72 compares the numerical value that adds the ATS 71 in the TS grouping subsequently to and numerical value from counter 74.When values match, comparator 72 is notified to read-out control part with match information and divides 73.When from comparator 72 input match information, read-out control part divides 73 to carry out control, thereby at this constantly, reads the TS grouping that is added with ATS 71 from smoothing buffer device 70.Utilize these operations, in identical timing, the TS grouping that output is read from smoothing buffer device 70 is as the input TS (511a) shown in 511c.As a part, 303～305 shown in the 511c do not have the TS grouping that is added with corresponding ATS, and it will be blank, and not have any data.
ATS has been described at record usually with the effect when playing, picture frame rate value X when identical with broadcast frame rate value Y.For example, when recording medium was memory, necessary assigned address was to carry out access to it.Therefore, if former state is used input transfer stream, the timing between then can not stores packets is so that record and playing.Therefore, in system, the timing when need reproducing input between grouping is as ATS etc.
Now, with describe when imaging frame rate value X is set to different numerical value with broadcast frame rate value Y, structure of the present invention and operation.Here, suppose to play frame rate Y=(24/1.001) fps.The reference data speed Rts=24Mbps of MPEG2-TS when also hypothesis is play.
Figure 14 shows when imaging frame rate value X=(8/1.001) fps, the time diagram of the operation of each parts.514a is the record side-looking frequency PES from 50 outputs of PES generating apparatus.With the frame rate (valid frame speed) of 8fps,, PTS/DTS is added on the record side-looking frequency PES according to the data that comprise a frame picture signal.Therefore, the interval of interpolation PTS/DTS reflects the imaging frame rate.
514b is the MPEG2-TS that is added with ATS from 91 outputs of ATS multiplexer.Think on eight bit parallel data wires, with the 27MHz clock, to 92 transmission of recording medium control section and the relevant data of exporting from ATS multiplexer 91 of the MPEG2-TS that is added with ATS.Video PES shown in the 514e is divided into many, and each bar is stored in the payload of TS grouping (TSP).
Reference data speed Rts when the data rate of the MPEG2-TS shown in 514b is broadcast multiply by the ratio between imaging frame rate X and the broadcast frame rate Y, i.e. Rts (X/Y)=24Mbps (8fps/24fps)=8Mbps.
Therefore, owing to compare with the transmission capacity of eight bit parallel holding wires of 27MHz clock, the data volume of MPEG2-TS is less, and each between the TS grouping is blank at interval, do not have any data.Be spaced apart 18827MHz/ (8Mbps/8)=5076, wherein Rts (X/Y)=8Mbps during record between the TS grouping.
That is to say, when the frame rate of importing picture signal is X frame/second, and when the default frame rate of system flow is a Y frame/second when playing, the squeezed data are carried out compressed encoding, thereby can decode with the R bps reference data speed during to the squeezed data playback, and the data rate of system flow when playing is Rts bps (wherein Rts is the real number of Rts＞R), TS multiplexing part 22 is carried out multiplexing, thereby the output data rate that makes system flow is Rts * (X/Y) bps, with system flow is recorded in the recording section 23 identical.Even the frame rate of input picture signal is different from the frame rate when playing, 22 pairs of squeezed data of TS multiplexing part are carried out multiplexing, thereby the squeezed data are complementary with reference data speed frame rate, when system flow is play when playing in fact.
ATS is added on before each TS grouping.Because the numerical value of the time of advent of TS grouping when ATS uses with the record of 27MHz counting at above-mentioned common record with in playing, the difference between the ATS is 5076 continuously, and the TS class interval during with record is identical.But, when imaging frame rate value X when playing frame rate value Y and be set to different numerical value, the numerical value that is added to ATS need be provided with in the timing when playing.To be described this after a while.
514c is the MPEG2-TS that plays and reproduced the timing of original TS grouping from recording medium.But, accurately identical during regularly not with record.Data rate differs the ratio between imaging frame rate and the broadcast frame rate.In this stage, at first remove ATS, but, utilize the accompanying drawing that still has ATS to describe present embodiment for simply.
514d be with 514c in the video PES that is separated of MPEG2-TS.Still in this figure, data rate also differs at the ratio between the imaging frame rate of record side-looking frequency PES (514a) and the broadcast frame rate.
In Figure 14, according to playing side, promptly 514c and 514d provide multiplexing time reference in stream, i.e. the numerical value of ATS, PCR, PTS and DTS.When Rts=2Mbps, the difference between the determined adjacent ATS in the TS class interval during by above-mentioned broadcast is 18827MHz/ (24Mbps/8)=1692.
That is to say, when the frame rate of importing picture signal is X frame/second, and when the default frame rate of system flow is a Y frame/second when playing, ATS numerical value generation device 90 calculates ATS, thereby make X/Y that ATS is essentially the difference between the continuous benchmark ATS numerical value doubly, the ATS numerical value that is produced when wherein X is identical with Y is benchmark ATS numerical value.
Can dispose this ATS numerical value generation device 90, to utilize the software on the microcomputer, the numerical value of reference data speed during according to imaging frame rate value X, broadcast frame rate value Y and broadcast, calculated difference 1692, in register, and order provides the numerical value that adds in each input TS grouping with this value storage.After a while, with reference to Figure 17 this is described in detail.
Can dispose ATS numerical value generation device 90 according to another kind of mode, as in the common record (being 27MHz when writing down usually), the Counter Value input ATS benchmark multiplexer 90 of the counter that will operate with the ATS reference clock.This can utilize wherein, and the frequency of ATS reference clock can realize by the structure that 27MHz (X/Y) changes.For example, when Y=(24/1.001) fps and X=(8/1.001) fps, the frequency of ATS reference clock is 27MHz (8/24)=9MHz.As the structure that is used to change the ATS reference clock, can use structure 1 described according to the embodiment of the invention, as shown in Figure 7.The ATS reference clock of embodiment 2 is the example according to clock of the present invention.
That is to say, when the frame rate of importing picture signal is X frame/second, and when the default frame rate of system flow is a Y frame/second when playing, the X/Y that ATS numerical value generation device 90 frequencies with the ATS reference clock become the fiducial value of X when identical with Y doubly and uses the ATS reference clock after changing to produce ATS numerical value.When the default frame rate of the frame rate of input picture signal system flow when playing not simultaneously, ATS numerical value generation device 90 produces ATS numerical value by the frequency that changes the ATS reference clock according to fiducial value.
For example, when inserting the PCR grouping at every L grouping, the difference between the adjacent PCR that the PCR grouping during by broadcast is determined is 1692L.When Y=24fps, adjacent PTS and the difference between the DTS that the frame period during by broadcast is determined are (1/24fps) 90kHz=3750.Deviant between PCR value and the PTS/DTS value is set, thereby satisfies the buffering that meets the MPEG2 standard in timing place of 514c and 514d.
As described in reference Figure 14, as picture frame speed X=8fps, broadcasts frame rate is Y=24fps, and during the reference data speed Rts=24Mbps when playing, if count with the clock of 27MHz, record and the interval between TS divides into groups when playing all are integers.Therefore, can provide the numerical value of ATS, and without any problem.But some imaging frame rate X make when counting with the clock of 27MHz, the interval when writing down between the TS grouping is not an integer.With reference to Figure 15 this type of example is described.
Figure 15 shows when imaging frame rate value X=14.985fps, the time diagram of the operation of each parts.515e is carried out broadcast from recording medium after and has reproduced the MPEG2-TS of the timing of original TS grouping, and is identical with 514c.When according to the ratio between imaging frame rate and the broadcast frame rate, by the timing of 515e calculating record side, be similar to 515d from the MPEG2-TS that is added with ATS of ATS multiplexer 91 outputs, and be similar to 515c from the record side-looking frequency PES of PES generating apparatus 50 outputs.Interval between 515d calculating TS grouping: 18827MHz/ (24Mbps (14.985fps/24/1.001) fps)/8=2707.2 has produced mark.
Although in fact the interval between the TS grouping is necessary for integer, for example, is 2708 clocks if it is rounded up, at the 515d that is similar to 515b, a plurality of intervals broadening of PCR.On the other hand, with by the accurately identical timing output of the determined timing of imaging frame rate from the record side-looking of PES generating apparatus 50 outputs PES frequently, be similar to 515a, promptly identical with 515c.As a result, the synchronized relation between PCR and the PTS/DTS becomes irregular, and it can not correctly be play as common 24fps picture signal when playing.
When Figure 16 shows and carries out addressing at imaging frame rate value X=14.985fps and to the mark time interval between the TS grouping, the schematic diagram of the operation of each parts.516a is the record side-looking frequency PES from 50 outputs of PES generating apparatus, and is identical with 515a.516b is that the video PES with 516a carries out multiplexing and is added with the MPEG2-TS of ATS.Here, think 2707 clocks that are spaced apart between the TS grouping.When the interval according to the imaging frame rate and when playing ratio calculation between the frame rate and playing, between the TS grouping, it is 1691.875 clocks, shown in 516d.But the numerical value with this mark can not be as the difference of ATS.
Therefore, shown in 516c, when being the ATS assignment, the difference of supposing continuous ATS is 1692, and then at eight the poor of accumulation and 1691.875 that divide into groups, it accurately is a clock.Can be by when being the ATS assignment, a difference 1691 is composed in per eight groupings, comes the mark at the interval between the addressing TS grouping.
Figure 17 shows the structure that is used to as the ATS numerical value generation device 90 of assignment such as ATS.Reference number 80 is represented the difference registers, and 81 represent adders, 82 presentation selectors, and 83 expression ATS value counters, 84 expression ATS numerical value registers, 85 expression adders, 86 represent comparators, and 87 represent that counting down to J returns 0 J counter then.Configuration ATS numerical value generation device 90, thereby the numerical value K that can each ATS difference of being arranged in the difference register 80 be set by the microcomputer (not shown), be arranged on the numerical value J in the J counter 87 and compare with output from J counter 87 at comparator 86 places.When carrying out with the corresponding operation of Figure 16, be set to the ATS difference with 1691, be set to each numerical value J and K with 7.
Utilize the synchronous pulse of input of dividing into groups to drive ATS value counter 83 and J counter 87 with the TS that is input in the ATS multiplexer 91.During each input TS grouping, J counter 87 sequential counting of starting from scratch, and count down at 7 o'clock at it, when the next TS grouping of input, it returns zero.Comparator 86 will compare from the output and the K=7 of J timer.When exporting less than K, promptly when output was between zero-sum six, selector 82 selections were from the output (1691+1=1692) of adder 81.When being output as 7 from J counter 87, identical with K, the output (1691) that selector 82 is selected from difference register 80.Therefore, ATS counter 83 with 1692 be added in 8 TS grouping input, at the difference of seven TS grouping inputs, will add on the numerical value that is stored in the ATS numerical value register 84 at 1691 of a TS grouping.By being used to from the output valve of ATS counter 83 can to provide ATS at time shown in 516c and numerical value as the ATS numerical value that will add in the TS grouping.
Although in the present embodiment, from numerical value 1691 and 1692, select the ATS difference, described numerical value is not limited thereto, and can select from three or more numerical value.
Here, the frame rate during hypothetical record is X, and the frame rate when playing is Y.In order to calculate the ATS difference, thereby make X/Y times that to add the difference that to add the ATS numerical value in the continuous T S grouping in the time of with the difference of the ATS in the corresponding TS grouping of frame rate Y record to be record to, only need to calculate ATS, from a plurality of numerical value, select as the mean value of the selected numerical value that will add the ATS numerical value on the respective packets to X/Y times for the difference of when it writes down with frame rate Y, adding the ATS numerical value in the corresponding TS grouping to thereby make.In this manner, can addressing TS fractional spaced between the grouping.
When the default frame rate of the frame rate of input picture signal and the stream of register system not simultaneously, ATS numerical value generation device 90 will be multiplexed in the TS grouping by the corresponding ATS of default frame rate of system flow when playing.
Therefore, embodiment 2 provides a kind of video recording apparatus that can play with frame rate identical with the equipment that writes down according to common mode (24 frame/second) and identical TS data rate Rts, and without any need for specific device.Even this is that this device still can be realized the variable frame-rate record, and carries out compressed encoding and multiplexing because be used for playing TS grouping record and the Play System regularly with ATS (arrival markers), to meet the default frame rate (24 frame/second) of playing.
Standard speed (the playing bit_rate) R that has utilized TS data data Rts when playing and squeezed signal constant and with the irrelevant situation of imaging frame rate value (valid frame speed) X, embodiment 1 and 2 is described.But the value of Rts and R needs not to be constant, also can change according to the numerical value of X.
That is to say that when the frame rate of input picture signal was different from frame rate when playing, TS multiplexing part 21 was according to the frame rate of input picture signal, change the frame rate data rate corresponding, squeezed data when playing when playing.
For example, for 2.5 times of slow motions at as shown in Figure 8 60fps imaging are provided, wherein the standard speed of record is 9Mbps usually, and described device need be carried out coding with 2.5 times 22.5Mbps as 9Mbps.MPEG2 main profile at main level encoder can be used for common record, although the coding rate of record during 60fps exceeded the scope of MPEG2 main profile at main level, it needs more expensive complicated encoder.
As picture frame speed X=60fps and when playing frame rate Y=24fps, the standard speed by will write down usually the time becomes 6Mbps, the coding during with the 15Mbps executive logging.Thereby in the scope of MPEG2 main profile at main level, coding is available.
Utilizing aforesaid operations, the record of variable frame-rate can be provided with encoder in fact cheaply, is cost to have worsened image quality by the speed R that debases the standard.In this case, for typical MPEG2-TS, be available with the decoding of standard speed R=6Mbps.
Under the situation of as shown in figure 16 record that utilizes ATS and broadcast, identical processing is available equally.That is to say, when the frame rate of input picture signal is different from frame rate when playing, the frame rate that frame rate is corresponding, data rate system flow when playing becomes the input picture signal that TS multiplexing part 22 will be when playing.
For example, as picture frame speed X=60fps and broadcast frame rate Y=24fps, wherein the MPEG2-TS reference data speed Rts at common record is 24Mbps, and the data rate of MPEG2-TS is 24Mbps (60fps/24fps)=60Mbps during broadcast.Even in compressed encoding part and TS multiplexing part, it is difficult that this two-forty is handled, and can become Rts=16Mbps by when X=60fps, the data rate of MPEG2-TS is 16Mbps (60fps/24fps)=40Mbps when making record, easily realizes this processing.
As mentioned above, by according to imaging frame rate value X, change the TS data rate Rts when playing and the standard speed R of squeezed data, can obtain the record of variable frame-rate with the structure of lower cost.
Although MPEG2-TS is used for multiplexing by supposition, embodiments of the invention are described, multiplexing method is not limited thereto, and for example, also can use MPEG2-PS (program flow).Although the MPEG2 picture coding is used for the compressed encoding of picture by supposition, embodiment is described, compaction coding method is not limited thereto, and for example, also can use MPEG4 video coding, the compressed encoding among video coding, the DVC (digital recording band) H.264.
Have valid frame by supposition video recording apparatus 2 and obtain part 20 and TS multiplexing part 21, embodiment is described, video recording apparatus 2 is not limited thereto, and video recording apparatus 2 can not comprise that valid frame obtains part 20, TS multiplexing part 21 and sound coded portion 24.In this case, the device of video recording apparatus 2 outsides has valid frame acquisition part 20, TS multiplexing part 21 and sound coded portion 24.In this external device (ED), handle from the Xp picture signal 6 and the valid frame sign 7 of imaging device 1 output, and these device output squeezed data.Then, video recording apparatus 2 will be input to the TS multiplexing part 22 from the squeezed data of external device (ED) output, produces system flow by it.Video recording apparatus 2 can not carried out the compressed encoding to the input picture signal in person, can import the squeezed data of having carried out compressed encoding, and only carry out multiplexing.
Although the present invention is not limited thereto, when recording it in recording medium, the time management information of time of having defined the PCR that is used to decode etc. is carried out multiplexing by supposition, embodiment is described.When embodiment is recorded on the recording medium, it can carry out record according to the form of the frame rate X in when record, and these time management information are not carried out multiplexing, and by when playing, utilize frame converter etc., become the picture signal of Y frame/second being recorded in picture signal on the recording medium.
That is to say following execution operation in this case.At first, 1 pair of picture signal of imaging device of the frame rate in the time of can changing record carries out imaging.Picture signal in TS multiplexing part 21 imagings is carried out compressed encoding, and output squeezed data.Output squeezed data are not handled in TS multiplexing part 22.Instead, recording section 23 will directly be recorded on the recording medium from the squeezed data of TS multiplexing part 21 outputs.When recording section 23 is recorded in the squeezed data on the recording medium, its frame rate recording compressed picture data during with imaging.When broadcast is recorded in squeezed data on the recording medium, the squeezed data are converted to predetermined frame rate, described predetermined frame rate is pre-determined by frame converter etc.
For example, when X is 12 and Y when being 24, operate following carrying out.Imaging device 1 is taken the photograph picture signal with 12 frames/second beats.Captured picture signal is carried out compressed encoding, and produce the squeezed data.With the squeezed data to be recorded on the recording medium for 12 frame/seconds.Different with embodiment, will the squeezed data do not carry out multiplexing with the time management information of the decode time that has defined PCR etc.When broadcast is recorded in squeezed data on the recording medium, utilize frame converter, packed data is converted to the picture signals of 24 frame/seconds and output.
Therefore,, compare, can save more recording medium effectively with traditional video recording apparatus owing to the frame rate of shooting picture signal the squeezed data are recorded on the recording medium in this case.This is when being converted to the frame rate of the 60 frame/seconds that can show because of the picture signal when it at first will be taken on EVF, traditional video recording apparatus is recorded in the squeezed data of redundancy on the recording medium, then, signal in the condensed frame, and produce the squeezed data, and data are recorded on the recording medium as the picture in the frame rate of 60 frame/seconds.
Program according to the present invention is a kind of program of cooperating with computer, is used to make computer to carry out the function of whole or some devices of above-mentioned video recording apparatus of the present invention.
Recording medium according to the present invention is that a kind of carrying is used to make computer to carry out the recording medium of the functional programs of the whole of above-mentioned video recording apparatus of the present invention or some devices (or device, element etc.), wherein computer-readable and carry out various functions with computer by the program that computer is read.
One or more devices in the term of the invention described above " some devices " the expression multiple arrangement.
Whole or some functions of the term of the invention described above " function of device " indication device.
The purposes of program of the present invention can be wherein to be recorded on the computer-readable recording medium described program and the scheme of cooperating with computer.
The purposes of program of the present invention can be the scheme that wherein said program is transmitted on transmission medium, read and cooperated with computer by computer.
Data structure of the present invention comprises database, data format, tables of data, data list, data type.
Recording medium comprises ROM, and transmission medium comprises as transmission mediums such as internet, light wave, radio wave and sound waves.
The computer of the invention described above is not limited to the hardware completely as CPU etc., even also can comprise firmware, OS ancillary equipment.
As mentioned above, can realize structure of the present invention by software or hardware.
Picture recording medium of the present invention is useful for video camera, is particularly useful for not the playback speed by changing film but provides the slow motion in the film and the video camera of fast motion effect by the digital frame rate transition.
Claims (47)
1. video recording apparatus comprises:
Multiplexer, operation are used for the time management information that defined decode time and are undertaken multiplexingly by the squeezed data that the compressed encoding of carrying out the input picture signal produces, and operation is used for output system stream; And
Tape deck, operation is used for system flow is recorded in recording medium;
Wherein be used to play after record, broadcast and decode system stream and during the default broadcast frame rate of the picture signal that obtains when the record frame rate of input picture signal is different from, described multiplexer pair carries out multiplexing with default broadcast corresponding time management information of frame rate and squeezed data.
2. video recording apparatus according to claim 1 is characterized in that comprising picture coding apparatus, and operation is used to carry out the compressed encoding to the input picture signal, and output squeezed signal.
3. video recording apparatus according to claim 1 is characterized in that the squeezed data are to produce by some frames of input picture signal are carried out the interframe compression.
4. video recording apparatus according to claim 1 is characterized in that the squeezed data are to produce according to the input picture signal that obtains from the imaging device that can change frame rate during imaging.
5. video recording apparatus according to claim 1, it is characterized in that the operation of described multiplexer is used to carry out meets the multiplexing of mpeg standard, and time management information comprises PCR or SCR as the timing base of decoding and output (demonstration), wherein PTS represents to export the timing of each decoded frame, and DTS represents that decoding regularly.
6. video recording apparatus according to claim 1, it is characterized in that described multiplexer has clock, operation is used for generation time management information, and described clock has the frequency that can change according to employed fiducial value when the record frame rate is identical with the broadcast frame rate; And
Wherein when the record frame rate was different from the broadcast frame rate, described multiplexer changed the frequency of described clock according to fiducial value, and used the frequency after changing to come generation time management information.
7. video recording apparatus according to claim 6, it is characterized in that when writing down frame rate be X frame/second, X is a real number, and when to play frame rate be Y frame/second, the X/Y that described multiplexer becomes the fiducial value of X when identical with Y with the frequency of described clock doubly and uses the frequency after changing to come generation time management information.
8. video recording apparatus according to claim 1, it is characterized in that when writing down frame rate be X frame/second, X is a real number, and when to play frame rate be Y frame/second, described multiplexer management information computing time, thereby make difference between the time management information be the difference between corresponding fiducial time of the management information X/Y doubly, wherein the time management information that is produced when X is identical with Y is management information fiducial time.
9. video recording apparatus according to claim 1, it is characterized in that when the record frame rate is different from the broadcast frame rate, described multiplexer produces timing base information with the multiplexing interval that is different from the multiplexing interval of benchmark, wherein the multiplexing interval of benchmark be the record frame rate with the identical situation of broadcast frame rate under, at the multiplexing interval of the timing base information (RCR) in the time management information.
10. video recording apparatus according to claim 9, it is characterized in that when writing down frame rate be X frame/second, X is a real number, and when to play frame rate be Y frame/second, described multiplexer produces timing base information, thereby make timing base information (PCR) in the time management information be the multiplexing interval of benchmark X/Y doubly, wherein the multiplexing interval of benchmark is the multiplexing interval under the X situation identical with Y.
11. a video recording apparatus comprises:
Picture coding apparatus, operation are used to carry out the compressed encoding to the input picture signal, and output squeezed data;
Multiplexer, operation are used for other information and squeezed data are carried out multiplexing, and output system stream; And
Tape deck, operation is used for system flow is recorded in recording medium;
Wherein said picture coding apparatus operation is used for when the record frame rate is different from the broadcast frame rate, change the data rate of squeezed data according to reference data speed, and carry out compressed encoding to the input picture signal, wherein reference data speed is the played data speed of the broadcast frame rate preset during the picture signal of acquisition with playing after record, broadcast and decode system stream when the record frame rate of the input picture signal compressing image data when identical.
12. video recording apparatus according to claim 11, it is characterized in that when the record frame rate is different from the broadcast frame rate, described picture coding apparatus is carried out the compressed encoding to the input picture signal, thereby makes the data rate approximate match of playing during the squeezed data in reference data speed.
13. video recording apparatus according to claim 12, it is characterized in that when writing down frame rate be X frame/second, X is a real number, when playing frame rate and be Y frame/second and reference data speed and being R bps, R is a real number, described picture coding apparatus is carried out rate controlled, thereby with R * (X/Y) bps data rate the input picture signal is carried out compressed encoding.
14. video recording apparatus according to claim 13 is characterized in that system flow is the stream that meets the MPEG2 standard; And
The operation of wherein said picture coding apparatus is used for that the picture_rate that expression respectively is used for the input image frame speed of rate controlled is set to X, the bit_rate that represents the targeted rate of squeezed data is set to R * (X/Y).
15. video recording apparatus according to claim 12, it is characterized in that when writing down frame rate be X frame/second, X is a real number, when playing frame rate and be Y frame/second and reference data speed and being R bps, R is a real number, described picture coding apparatus is carried out rate controlled, is the compressed encoding of the picture signal of Y thereby carry out its frame rate with R bps data rate, and irrelevant with the frame rate X of input picture signal.
16. video recording apparatus according to claim 15 is characterized in that system flow is the stream that meets the MPEG2 standard; And
The operation of wherein said picture coding apparatus is used for the picture_rate that expression respectively is used for the input image frame speed of rate controlled and is set to Y, represents that the bit_rate of the targeted rate of squeezed data is set to R.
17. video recording apparatus according to claim 11, it is characterized in that being different from when playing frame rate when the record frame rate, described picture coding apparatus changes according to the record frame rate and plays that frame rate is corresponding, the data rate of squeezed data during playing.
18. a video recording apparatus comprises:
Multiplexer, operation be used for to other information and by picture signal is carried out squeezed data that compressed encoding produces carry out multiplexing, and output system stream; And
Tape deck, operation is used for system flow is recorded in recording medium;
Wherein said multiplexer operation is used for when the record frame rate is different from the broadcast frame rate, change the register system data rate of system flow according to reference data speed, and carry out multiplexingly, wherein the baseline system data rate is the played data speed when the record frame rate of the input picture data system flow when the default broadcast frame rate of the broadcasting pictures signal of acquisition is identical with playing after record, broadcast and decode system stream.
19. video recording apparatus according to claim 18, it is characterized in that when the record frame rate is different from the broadcast frame rate, described multiplexer is carried out multiplexing to the compressed encoding picture signal, thus make and play that frame rate is corresponding, the data rate approximate match of the system flow during playing is in the baseline system data rate.
20. video recording apparatus according to claim 19, even it is characterized in that it is Rts bps that the operation of described multiplexer is used for the data rate that X is different from Y and system flow, carry out multiplexing, thereby when thereby the squeezed data having been carried out compressed encoding can decode to the squeezed data with R bps the time, at described multiplexer during to described tape deck output system stream, the output data rate of system flow is Rts * (X/Y) bps, wherein writing down frame rate is X frame/second, playing frame rate is Y frame/second, and the played data speed of the squeezed data of X when identical with Y is R bps of reference data speed, wherein Rts is the real number of Rts＞R, X is a real number, and R is a real number.
21. video recording apparatus according to claim 18 is characterized in that when the record frame rate is different from the broadcast frame rate described multiplexer changes the data rate of system flow during playing according to the frame rate of input picture signal.
22. video recording apparatus according to claim 2, it is characterized in that comprising the valid frame checkout gear, operation is used for by utilizing input valid frame mark to obtain the valid frame mark from the input picture signal, and be by the time with each frame repeats once or more times produces picture signal at the input picture signal, and when having imported expression as the valid frame mark of the valid frame of the primitive frame that is used to produce described input picture signal, the valid frame that is obtained to described picture coding apparatus output.
23. video recording apparatus according to claim 1, it is characterized in that described multiplexer operation is used for except that the squeezed data, input audio data also, and (1) is when the record frame rate is identical with the broadcast frame rate, described multiplexer carries out multiplexing to input audio data and system flow, and (2) when the record frame rate is different from when playing frame rate, and described multiplexer does not carry out multiplexing to input audio data and system flow.
24. video recording apparatus according to claim 1, it is characterized in that comprising sound conversion device, wherein when except that the squeezed data, going back input audio data, and (1) is when the record frame rate is identical with the broadcast frame rate, described sound conversion device output sound data, as the recording voice data, and do not change the sample frequency of input audio data; And (2) when the record frame rate is different from when playing frame rate, and described sound conversion device is converted to different frequencies with the sample frequency of input audio data, and the output sound data, as the voice data of record; And
The recording voice data multiplex that wherein said multiplexer operation is used for exporting is in system flow.
25. video recording apparatus according to claim 24, it is characterized in that the operation of described sound conversion device is used for X/Y that sample frequency with input audio data is converted to X and the asynchronous frequency of Y doubly, wherein writing down frame rate is X frame/second, and play frame rate is Y frame/second, wherein X is a real number, and Y is a real number.
26. video recording apparatus according to claim 1 is characterized in that system flow comprises a plurality of groupings; And
Wherein said tape deck operation is used for the grouping reproduction time management information that has defined reproduction time multiplexing in the grouping that is included in system flow, and it is recorded on the recording medium;
Wherein said tape deck operation is used for when the record frame rate is different from the broadcast frame rate, changes grouping reproduction time information according to benchmark grouping reproduction time information, and multiplexing this information;
Wherein benchmark grouping reproduction time information is the grouping reproduction time information of record frame rate when identical with the broadcast frame rate.
27. video recording apparatus according to claim 26, it is characterized in that described tape deck has clock, operation is used for producing grouping reproduction time information, and employed fiducial value changed when the frequency of described grouping reproduction time information was can be according to the record frame rate identical with the broadcast frame rate; And
Wherein when the record frame rate was different from the broadcast frame rate, described tape deck changed the frequency of described clock according to fiducial value, and used the frequency after changing to produce grouping reproduction time management information.
28. video recording apparatus according to claim 27, it is characterized in that when writing down frame rate be X frame/second, and when to play frame rate be Y frame/second, the X/Y that described tape deck becomes the fiducial value of X when identical with Y with the frequency of described clock doubly, and use described clock to produce grouping reproduction time management information, wherein X is a real number.
29. video recording apparatus according to claim 26, it is characterized in that when writing down frame rate be X frame/second, and when to play frame rate be Y frame/second, described tape deck calculates grouping reproduction time information, thereby make X/Y that difference between the numerical value of continuous grouping reproduction time information is approximately the difference between the numerical value of corresponding benchmark grouping reproduction time information doubly, wherein X is a real number.
30. video recording apparatus according to claim 29, it is characterized in that the operation of described tape deck is used for calculating poor between the numerical value of respective packets reproduction time information when described tape deck, thereby when making grouping reproduction time information be approximately X/Y times of difference of continuous benchmark grouping reproduction time information, from a plurality of numerical value, select the difference of respective packets reproduction time information to determine, and calculate grouping reproduction time information, thereby selected result's mean value be benchmark grouping reproduction time information difference X/Y doubly.
31. a video recording apparatus comprises:
Picture coding apparatus, operation are used for the input picture signal that obtains from the imaging device that can change over the frame rate during looking like is carried out compressed encoding, and output squeezed data; And
Tape deck, operation are used for the squeezed data of output are recorded in recording medium;
Wherein the frame rate of squeezed data during with imaging is recorded on the recording medium; And
The squeezed data that wherein will be recorded on the recording medium are converted to predetermined predetermined broadcast frame rate.
32. a multiplexing method comprises:
To the time management information that defined decode time and undertaken by the squeezed data that the compressed encoding of carrying out picture signal produces multiplexing, and output system stream; And
System flow is recorded on the recording medium;
Wherein, the record frame rate of input picture signal is used to play after record, broadcast and decode system stream and during the default broadcast frame rate of the picture signal that obtains when being different from, and described multiplexing to carrying out multiplexing with default broadcast corresponding time management information of frame rate and squeezed data.
33. multiplexing method, be used for carrying out multiplexing to the time management information and the squeezed data that have defined decode time, described squeezed data have been that the X picture signal of X frame/second has carried out compressed encoding to its frame rate, thereby can the X picture signal be decoded as the Y picture signal that its frame rate is Y frame/second with R bps broadcast bit rate, wherein X is a real number, R is a real number, and Y is a real number;
Wherein said method comprise standard time management information is carried out multiplexing, thereby make difference between the numerical value of management information be X/Y doubly; And
Wherein when X=Y, thus fiducial time management information be want multiplexing carried out compressed encoding can be with the time management information on the squeezed data of R bps broadcast bit rate decoding X picture signal.
34. multiplexing method, be used for carrying out multiplexing to the time management information and the squeezed data that have defined decode time, described squeezed data have been carried out compressed encoding, thereby the X picture signal that can be X frame/second with its frame rate is decoded as the Y picture signal that its frame rate is Y frame/second, wherein X is a real number, and Y is a real number;
Wherein said method comprises the timing base information (PCR) in the control time management information, is spaced apart Y/X doubly thereby make to multiply each other.
35. a picture coding method comprises:
The input picture signal is carried out compressed encoding, and output squeezed data;
Other information and squeezed data are carried out multiplexing, and output system stream; And
System flow is recorded on the recording medium;
Wherein when the record frame rate is different from the broadcast frame rate, described execution compressed encoding changes the record data speed of squeezed data according to reference data speed, and the input picture signal carried out compressed encoding, wherein reference data speed is when the record frame rate of the broadcasting pictures signal squeezed data playback data rate when the default broadcast frame rate of the picture signal of acquisition is identical with playing after record, broadcast and decode system flow.
36. picture coding method, being used for its frame rate is that the X picture signal of X frame/second carries out compressed encoding, thereby can the X picture signal be decoded as the Y picture signal that its frame rate is Y frame/second with R bps broadcast bit rate, wherein X is a real number, R is a real number, Y is a real number, and described method comprises:
Obtain to play frame rate Y and play bit rate R;
Input is used for the frame rate value X of imaging;
The input image frame speed picture_rate that is used for rate controlled is set to X, and the targeted rate bit_rate of squeezed data is set to R (X/Y); And
Utilize the value of picture_rate and bit_rate to carry out the rate controlled of compressed encoding.
37. picture coding method, being used for its frame rate is that the X picture signal of X frame/second carries out compressed encoding, thereby can the X picture signal be decoded as the Y picture signal that its frame rate is Y frame/second with R bps broadcast bit rate, wherein X is a real number, R is a real number, Y is a real number, and described method comprises:
From the outside or memory to play frame rate Y and play bit rate R;
Input is used for the frame rate value X of imaging;
The input image frame speed picture_rate that is used for rate controlled is set to Y, and the targeted rate bit_rate of squeezed data is set to R; And
Utilize the value of picture_rate and bit_rate to carry out the rate controlled of compressed encoding.
38. a program of using with computer, described program comprises:
Operation be used to make computer to the time management information that defined decode time and undertaken by the squeezed data that the compressed encoding of carrying out the input picture signal produces multiplexing, and the executable code that makes computer output system stream; And
Operation is used to make computer that system flow is recorded in executable code on the recording medium;
Wherein be used to play after record, broadcast and decode system stream and during the default broadcast frame rate of the picture signal that obtains when the record frame rate of input picture signal is different from, described operation is used to make computer to carry out multiplexing executable code pair to carry out multiplexing with default broadcast corresponding time management information of frame rate and squeezed data.
39. a program of using with computer, described program comprises:
Operation is used to make the compressed encoding of computer execution to the input picture signal, and the executable code of output squeezed data;
It is multiplexing that operation is used to make computer that other information and squeezed data are carried out, and the executable code of output system stream; And
Operation is used to make computer that system flow is recorded in executable code on the recording medium; And
The executable code operation that wherein said operation is used to make computer carry out compressed encoding is used for when the record frame rate is different from the broadcast frame rate, change the data rate of squeezed data according to reference data speed, and carry out compressed encoding to the input picture signal, wherein reference data speed is the broadcast frame rate preset during the picture signal of acquisition with playing after record, broadcast and decode system stream when the record frame rate of the input picture signal squeezed data playback data rate when identical.
40. a program of using with computer, described program comprises:
Operation is used to make computer to other information with undertaken multiplexingly by picture signal being carried out squeezed data that compressed encoding produces, and makes the executable code of computer output system stream; And
Operation is used to make computer that system flow is recorded in executable code on the recording medium;
Wherein said operation is used to make computer to carry out multiplexing executable code operation and is used for when the record frame rate is different from the broadcast frame rate, change the register system data rate of system flow according to reference data speed, and carry out multiplexingly, wherein the baseline system data rate is when the record frame rate of the input picture signal system flow played data speed when the default broadcast frame rate of the picture signal of acquisition is identical with playing after record, broadcast and decode system stream.
41. computer-readable medium that comprises according to the described program of claim 38.
42. computer-readable medium that comprises according to the described program of claim 39.
43. computer-readable medium that comprises according to the described program of claim 40.
44. video recording apparatus according to claim 11, it is characterized in that described multiplexer operation is used for except that the squeezed data, input audio data also, and (1) is when the record frame rate is identical with the broadcast frame rate, described multiplexer carries out multiplexing to input audio data and system flow, and (2) when the record frame rate is different from when playing frame rate, and described multiplexer does not carry out multiplexing to input audio data and system flow.
45. video recording apparatus according to claim 18, it is characterized in that described multiplexer operation is used for except that the squeezed data, input audio data also, and (1) is when the record frame rate is identical with the broadcast frame rate, described multiplexer carries out multiplexing to input audio data and system flow, and (2) when the record frame rate is different from when playing frame rate, and described multiplexer does not carry out multiplexing to input audio data and system flow.
46. video recording apparatus according to claim 11, it is characterized in that comprising sound conversion device, wherein when except that the squeezed data, going back input audio data, and (1) is when the record frame rate is identical with the broadcast frame rate, described sound conversion device output sound data, as the recording voice data, and do not change the sample frequency of input audio data; And (2) when the record frame rate is different from when playing frame rate, and described sound conversion device is converted to different frequencies with the sample frequency of input audio data, and the output sound data, as the recording voice data; And
Wherein said multiplexer operation is used for output recording voice data multiplex in system flow.
47. video recording apparatus according to claim 18, it is characterized in that comprising sound conversion device, wherein when except that the squeezed data, going back input audio data, and (1) is when the record frame rate is identical with the broadcast frame rate, described sound conversion device output sound data, as the recording voice data, and do not change the sample frequency of input audio data; And (2) when the record frame rate is different from when playing frame rate, and described sound conversion device is converted to different frequencies with the sample frequency of input audio data, and the output sound data, as the recording voice data; And
Wherein said multiplexer operation is used for output recording voice data multiplex in system flow.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2004103760 | 2004-03-31 | ||
| JP2004103760 | 2004-03-31 | ||
| JP2004312899 | 2004-10-27 |
Related Child Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009101380331A Division CN101534406B (en) | 2004-03-31 | 2005-03-31 | Video recording device for recording variable frame rate |
| CN2009101380327A Division CN101534405B (en) | 2004-03-31 | 2005-03-31 | Video recording device for recording variable frame rate |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1691769A true CN1691769A (en) | 2005-11-02 |
| CN100499781C CN100499781C (en) | 2009-06-10 |
Family
ID=35346848
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009101380327A Active CN101534405B (en) | 2004-03-31 | 2005-03-31 | Video recording device for recording variable frame rate |
| CNB2005100629461A Active CN100499781C (en) | 2004-03-31 | 2005-03-31 | Video recording apparatus for variable frame-rate recording, multiplexing method, picture encoding method |
| CN2009101380331A Active CN101534406B (en) | 2004-03-31 | 2005-03-31 | Video recording device for recording variable frame rate |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009101380327A Active CN101534405B (en) | 2004-03-31 | 2005-03-31 | Video recording device for recording variable frame rate |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009101380331A Active CN101534406B (en) | 2004-03-31 | 2005-03-31 | Video recording device for recording variable frame rate |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP4669902B2 (en) |
| CN (3) | CN101534405B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101076121B (en) * | 2006-05-17 | 2010-08-04 | 索尼株式会社 | Stream generating apparatus, imaging apparatus, data processing apparatus and stream generating method |
| CN101404734B (en) * | 2007-10-01 | 2011-08-24 | 索尼株式会社 | Picture signal processing apparatus and picture signal processing method |
| CN108259934A (en) * | 2016-12-29 | 2018-07-06 | 安讯士有限公司 | For playing back the method and apparatus of recorded video |
| CN108449566A (en) * | 2014-03-12 | 2018-08-24 | 索尼互动娱乐有限责任公司 | Video frame rate compensation is carried out by adjusting vertical blanking |
| CN108781301A (en) * | 2016-03-24 | 2018-11-09 | 索尼公司 | Sending device, sending method, reception device and method of reseptance |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4358081B2 (en) | 2004-03-31 | 2009-11-04 | パナソニック株式会社 | Video recording device |
| KR20140039920A (en) * | 2012-09-25 | 2014-04-02 | 삼성전자주식회사 | Image data processing method and apparatus, and electronic device including the same |
| CN104539837A (en) * | 2014-11-28 | 2015-04-22 | 广东欧珀移动通信有限公司 | Method and device for recording variable speed playback video |
| CN106341725A (en) * | 2016-09-27 | 2017-01-18 | 北京小米移动软件有限公司 | Video message processing method and device for electronic apparatus |
| CN107155068A (en) * | 2017-07-11 | 2017-09-12 | 上海青橙实业有限公司 | Mobile terminal and the method and apparatus for video capture |
| WO2020101362A1 (en) | 2018-11-14 | 2020-05-22 | Samsung Electronics Co., Ltd. | Method for recording multimedia file and electronic device thereof |
| GB2584831B (en) * | 2019-06-05 | 2023-02-08 | Reeltime Apps Ltd | Video image recording and playback |
| CN112154670A (en) * | 2019-08-13 | 2020-12-29 | 深圳市大疆创新科技有限公司 | Video processing method and device and storage medium |
| CN113825019B (en) | 2020-06-19 | 2022-11-11 | 北京字节跳动网络技术有限公司 | Video variable-speed playing method and device, electronic equipment and computer readable medium |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5793927A (en) * | 1995-06-07 | 1998-08-11 | Hitachi America, Ltd. | Methods for monitoring and modifying a trick play data stream to insure MPEG compliance |
| US6058141A (en) * | 1995-09-28 | 2000-05-02 | Digital Bitcasting Corporation | Varied frame rate video |
| JP3436505B2 (en) * | 1999-04-28 | 2003-08-11 | 日本ビクター株式会社 | Digital information signal recording method, digital information signal recording device, and digital information signal recording medium |
| JP2002094939A (en) * | 2000-09-12 | 2002-03-29 | Hitachi Ltd | Recording apparatus and reproducing apparatus |
| JP2002109831A (en) * | 2000-09-29 | 2002-04-12 | Toshiba Corp | Recording and reproducing device |
| WO2002037937A2 (en) * | 2000-11-07 | 2002-05-16 | Bristol-Myers Squibb Company | Acid derivatives useful as serine protease inhibitors |
| JP3661588B2 (en) * | 2000-11-07 | 2005-06-15 | 松下電器産業株式会社 | Cinema signal creation system |
| JP2002320203A (en) * | 2001-04-19 | 2002-10-31 | Matsushita Electric Ind Co Ltd | Video signal recorder and video signal reproducer |
| JP2002369139A (en) * | 2001-06-05 | 2002-12-20 | Sanyo Electric Co Ltd | Digital broadcast recording method, digital broadcast reproducing method, digital broadcast recorder and digital broadcast reproducer |
| JP2003018547A (en) * | 2001-07-05 | 2003-01-17 | Matsushita Electric Ind Co Ltd | Video stream transmitting method, scene change point detecting method and decode instruction displaying apparatus |
-
2005
- 2005-03-31 CN CN2009101380327A patent/CN101534405B/en active Active
- 2005-03-31 CN CNB2005100629461A patent/CN100499781C/en active Active
- 2005-03-31 CN CN2009101380331A patent/CN101534406B/en active Active
-
2009
- 2009-06-26 JP JP2009152853A patent/JP4669902B2/en active Active
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101076121B (en) * | 2006-05-17 | 2010-08-04 | 索尼株式会社 | Stream generating apparatus, imaging apparatus, data processing apparatus and stream generating method |
| CN101404734B (en) * | 2007-10-01 | 2011-08-24 | 索尼株式会社 | Picture signal processing apparatus and picture signal processing method |
| CN108449566A (en) * | 2014-03-12 | 2018-08-24 | 索尼互动娱乐有限责任公司 | Video frame rate compensation is carried out by adjusting vertical blanking |
| CN108449566B (en) * | 2014-03-12 | 2020-06-23 | 索尼互动娱乐有限责任公司 | Video frame rate compensation by adjusting vertical blanking |
| CN108781301A (en) * | 2016-03-24 | 2018-11-09 | 索尼公司 | Sending device, sending method, reception device and method of reseptance |
| CN108259934A (en) * | 2016-12-29 | 2018-07-06 | 安讯士有限公司 | For playing back the method and apparatus of recorded video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101534406B (en) | 2011-08-10 |
| CN101534405A (en) | 2009-09-16 |
| JP4669902B2 (en) | 2011-04-13 |
| CN101534405B (en) | 2011-06-01 |
| JP2009268129A (en) | 2009-11-12 |
| CN100499781C (en) | 2009-06-10 |
| CN101534406A (en) | 2009-09-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1691769A (en) | Video recording apparatus for variable frame-rate recording, multiplexing method, picture encoding method | |
| CN1223196C (en) | Decoder and decoding method, recorded medium and program | |
| CN1299501C (en) | Video signal producing system and video signal recording/ reproducing device in that system | |
| CN1245022C (en) | Data processing method/equipment and data regenerateion method/equipment and recording medium | |
| CN1135845C (en) | Image transmitting method, image processing method, image processor, data storage medium | |
| CN1055815C (en) | High speed video editing system | |
| CN1299502C (en) | Decoding device and decoding method | |
| CN1152569C (en) | Multiplexed data producing, encoded data reproducing, and clock conversion apparatus and method | |
| CN1108462A (en) | Method and apparatus for coding video signal, and method and apparatus for decoding video signal | |
| CN1992869A (en) | Playback apparatus playback method and playback program | |
| CN1943246A (en) | Image decoding method | |
| CN101075462A (en) | Recording/reproducing/editing apparatus, method and program | |
| CN1968391A (en) | Photographing apparatus, display control method, and program | |
| CN1950907A (en) | Moving picture stream generation apparatus, moving picture coding apparatus, moving picture multiplexing apparatus and moving picture decoding apparatus | |
| CN101036389A (en) | Content receiving apparatus, video/audio output timing control method, and content providing system | |
| CN1474604A (en) | Image mignal transmission, coding and decoding method nad device, and optical disc recording and reproducing method | |
| CN1501703A (en) | Data stream replaying equipment and method, digital broadcast receiver and correlative computer program | |
| CN1249629A (en) | Information record system and method | |
| CN1768529A (en) | Audio/video recording apparatus, recording method, playback apparatus, playback method, playback program, and recording program | |
| CN1747544A (en) | Recording apparatus, recording method, reproducing apparatus, reproducing method, and program | |
| CN1163068C (en) | Digital signal processing device and method, digital signal recording and replaying apparatus | |
| CN1848941A (en) | Image reproducing method and image processing method, and image reproducing device, image processing device, and television receiver capable of using the methods | |
| CN1237066A (en) | Moving picture encoding method and apparatus and recording medium | |
| CN1269352C (en) | Decoding apparatus and decoding method | |
| CN1698374A (en) | Information processing device and method, program, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |