CN1136721C - Method and device for flow editing - Google Patents
Method and device for flow editing Download PDFInfo
- Publication number
- CN1136721C CN1136721C CNB001036904A CN00103690A CN1136721C CN 1136721 C CN1136721 C CN 1136721C CN B001036904 A CNB001036904 A CN B001036904A CN 00103690 A CN00103690 A CN 00103690A CN 1136721 C CN1136721 C CN 1136721C
- Authority
- CN
- China
- Prior art keywords
- stream
- edit
- streams
- recompile
- segmentation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Television Signal Processing For Recording (AREA)
Abstract
The present invention relates to a flow editing system which is designed at an editing point arranged in each flow and is switched from one input flow to another input flow used during editing operation. The system comprises two decoders and at least one encoder. In the editing operation for merging two flows to generate one flow, the system only recodes the tail part of one flow and the front part of another flow which cross the editing point and uses the rest parts of the flows without change. Thus, the deterioration of signal quality caused by recoding the flows is lowered to minimum.
Description
Present invention relates in general to a kind of stream editing equipment, this equipment is used to edit the stream that is formed by video data code and voice data code combination; Especially the present invention relates to a kind of stream editing equipment, this equipment is used for connecting in real time two streams, produces single stream, and picture quality can deterioration.
Mpeg format is a kind of typical video and Audiocode compression coding technology, in this form, reduces data volume with discrete cosine transform (DTC) and predictive coding method, thereby realizes the compressed encoding to mobile image.
Figure 11 shows a kind of encoder, and it is used to carry out this encoding operation.
Encoder comprises subtracter 41, DCT circuit 42, quantizer 43, variable length code circuit 49, buffer 50, inverse quantizer 44, inverse DCT circuit 45, adder 46, video memory 47 and motion vector detection 48.
When carrying out inter prediction encoding, motion vector detection 48 compares input image data and the view data that is stored in the video memory 47, calculating kinematical vector (MV), and output it to video memory 47 and variable length code circuit 49.
Subtracter 41 is read through the view data to motion compensation from video memory 47, and the difference between input image data and the view data that reads from video memory 47 is exported to DCT circuit 42.The difference data of 42 pairs of subtracters of DCT circuit, 41 inputs carries out discrete cosine transform, and its DCT coefficient is exported to quantizer 43, with the type notification variable length code circuit 49 of DCT.
In the quantization step of quantizer 43 with quantizer matrix (Quant) defined of buffer 50 the DCT coefficient is quantized, and quantized result and quantizer matrix (Quant) are exported to variable length code circuit 49.Also quantized result is exported to inverse quantization circuit 44.
The output of the motion vector (MV) that 49 pairs of motion vector detections 48 of variable length code circuit calculate, the type of DCT, quantizer matrix (Quant) and quantizer 43 is encoded.The data that these are encoded temporarily are stored in the buffer 50, export with the form of stream then.
Also carry out re-quantization, in inverse DCT circuit 45, it is carried out inverse DCT then with the output of 44 pairs of quantizers 43 of inverse quantizer.Adder 46 is reproduced input image data with the output of inverse DCT circuit 45 and the view data addition of reading from video memory 47, and then with this image data storage in video memory 47, be used for next input image data is carried out subtraction.
When not using inter prediction to carry out interframe encode, only carry out DCT, from video memory 47, do not read view data.
When using inter prediction, can also carry out the forward inter prediction encoding with the preceding piece image that is stored in the video memory 47, and carry out reverse inter prediction encoding with the future image that is stored in the video memory 47.
In mpeg format, each incoming frame is encoded into a image in following three images: the I image that only comprises inner macroblock (intra-macroblock); Comprise P image inner and the micromodule forward inter prediction encoding; And the B image that comprises the macroblock of inner, the forward inter prediction encoding and reverse inter prediction encoding.
Figure 10 (a)-10 (d) shows a process sequence, and this sequence is with voice data and the video data addition of encoding with said method, so that produce data flow by the form that is suitable for medium.
By being different from input and the frame order when being encoded into I image, P image and B image is placed moving image, so that produce video-frequency basic flow (ES).For example with 24 milliseconds interval audio compressed data, to produce audio ES.These ES are divided into suitable unit, and will be grouped in head.For each head, increase PTS (express time mark), PTS represents to reproduce the time of grouped data.
The video that so forms and audio packet are carried out multiplexed with head as a compression (pack), form and flow.Fig. 9 shows typical compressive flow.Stream is recorded in such as in the mediums such as DVD.From medium, read stream, and moment of PTS regulation to each packet decoding and reproduction, thereby realize playback.
Usually, by from medium, reading stream and rearrange them, the stream that has required content by a plurality of miscarriage lifes that are recorded in the medium.For example, when needs with stream A separated into two parts and will flow B and be placed between them when producing stream C, first's decoding of convection current A, and will form the front portion of stream C again to its coding.The second portion of convection current A decoding then is again to its coding, to produce the afterbody of stream C.But there is a shortcoming in this stream editor, i.e. repeated encoding operation can reduce the quality of edited image.
Also editing technique of each stream that directly is coupled is used in proposal, but they are subjected to each restriction of flowing that must be coupled at the I of video data image place.
In mpeg format, to video data packets, wherein GOP is made up of an I image and a plurality of P and B image by the unit of image sets (GOP).Each GOP generally includes 15 width of cloth images (0.5 second).If when stream is cut in an image punishment of P image or B image, be difficult to press image as unit rendering frame image, therefore can cause image to continue the problem that distortion occurs until a back I image.
Usually when off-line operation, carry out above-mentioned editor, therefore very time-consuming.
Therefore, a main purpose of the present invention is to avoid the shortcoming of prior art.
Another object of the present invention provides a kind of stream editing system, and this system can connect two streams in real time, produces single stream, but does not make such as signal quality deteriorates such as picture qualities.
According to one aspect of the present invention, a kind of stream editing equipment is provided, this equipment is designed to the in-edit place that can be provided with in each stream, switch to another with one in two inlet flows that use in the edit operation.System comprises (a) first decoder, is used for first-class decoding; (b) second decoder is used for the second stream decoding; (c) encoder is used at least one the stream recompile to flowing through first and second of first and second decoder decodes; And (d) controller, be used to control editor to first and second streams, so that produce the 3rd stream, the 3rd stream is made up of two parts, a part is first preceding segmentation, it is arranged in before the in-edit of first-class setting, another part is the aft section of second stream, it is arranged in after the in-edit of the second stream setting, controller is when producing the 3rd stream, another part charge merging with segmentation before at least one part charge of segmentation before in first and second streams and back segmentation and first and second streams and back segmentation, wherein at least one part charge is through a respective decoder decoding in first and second decoders, encoder recompile and being defined leaves the one section given length of in-edit that is provided with in one of first and second streams, and another part charge is meant the part charge before first and second decoder decodes and encoder recompile.
In better model of the present invention, first and second streams all are made up of a plurality of image sets (GOP).Controller has been determined the length of such part, the decoded and recompile of this part, and will in the 3rd stream, merge, scope is to begin to the front portion of the GOP that in-edit is set from in-edit.
Can also have the head generator, be used to the 3rd miscarriage to give birth to a series of heads.
At least one stream recompile during encoder can flow first and second with the coded message that first and second decoders are obtained at least one the stream decoding in first and second streams.
Coded message comprises image type, quantizer matrix (Quant) and discrete cosine transform (DCT) type.
When require encoder at least one stream in first and second streams is being carried out recompile when operation change with first and second streams in stream when encoding during used bit rate, encoder uses the Quant that changes according to following relational expression:
Change back Quant=and change preceding Quant * (bit rate before change back bit rate/change)
By the holding wire of two separation, will through the video of decoding and/voice data and first and second decoders of coded message from be arranged on separate unit pass to encoder.
This equipment can also comprise multiplex machine, is used for first and second streams are divided into video packets and audio packet; And multiplex machine, be used for carrying out multiplexed to the video packets of a stream of first and second streams and the audio packet in another stream.
When the part in will merging to the 3rd stream was defined within the first aft section, encoder was edited this part after the second stream editor is finished.
In the process that produces the 3rd stream, controller is selected following four parts, before first decoding and the recompile first-class in the first of preceding segmentation, it two is after first, before the in-edit, by the second portion of segmentation before in the stream of encoder output, it three is after the in-edit, by the first of aft section in second stream of encoder output, it four is after the second stream first, the second portion of aft section in second stream before decoding and the recompile.Controller has been determined the scope of the front portion of first-class second portion from in-edit to the GOP that in-edit is set, and the scope of second end of stream first from in-edit to the GOP that in-edit is set.
According to a second aspect of the present invention, a kind of stream edit methods is provided, the in-edit place that this method can be provided with in each inlet flow switches to another with one in two inlet flows that use in the edit operation.Method may further comprise the steps: (a) with two decoders first and second streams are decoded; (b) at least one that is used in first and second streams that decoding step is decoded flows recompile; And (c) control to first and second stream editors, so that produce the 3rd stream, the 3rd stream is made up of two parts, a part is first preceding segmentation, it is arranged in before the in-edit of first-class setting, another part is the aft section of second stream, it is arranged in after the in-edit of the second stream setting, controlled step is when producing the 3rd stream, another part charge merging with segmentation before at least one part charge of segmentation before in first and second streams and back segmentation and first and second streams and back segmentation, wherein at least one part charge is through decoding, recompile and being defined leaves the one section given length of in-edit that is provided with in one of first and second streams, and another part charge is meant the part charge before decoding and recompile.
In better model of the present invention, first and second streams all are made up of a plurality of image sets (GOP).Decoded and recompile and will in the 3rd stream, the length of assembling section be defined as beginning to the front portion of the GOP that in-edit is set from in-edit.
Method can also be included as the step that a series of heads are given birth in the 3rd miscarriage.
At least one stream recompile during the coded message that coding step is obtained at least one the stream decoding in first and second streams with decoding step flows first and second.
Coded message comprises image type, quantizer matrix (Quant) and discrete cosine transform (DCT) type.
During used bit rate, coding step uses the Quant that changes according to following relational expression when requiring coding step to change that a stream is encoded in to first and second streams:
Change back Quant=and change preceding Quant * (bit rate before change back bit rate/change)
Method can also may further comprise the steps: be about to first and second streams and be divided into video packets and audio packet; And carry out multiplexed to the video packets of a stream in first and second streams and the audio packet in another stream.
When the part in will merging to the 3rd stream was defined within the first aft section, coding step was edited this part after the second stream editor is finished.
In the process that produces the 3rd stream, controlled step is selected following four parts, before first decoding and the recompile first-class in the first of preceding segmentation, its two be after first, before the in-edit, in decoding and recompile first-class before the second portion of segmentation, it three is firsts of aft section after the in-edit, in second stream of decoding and recompile, and it four is after the second stream first, the second portion of aft section in second stream before decoding and the recompile.Determined the scope of the front portion of first-class second portion from in-edit to the GOP that in-edit is set.Determined the scope of second end of stream first from in-edit to the GOP that in-edit is set.
With reference to the accompanying drawing and the following detailed description of reading of preferred embodiment of the present invention, will more fully understand the present invention, still, should not be considered as described accompanying drawing and describing is that invention is limited in the scope of specific embodiment, they are for convenience of explanation and understand.
Accompanying drawing has:
Fig. 1 is a block diagram, shows the editing system according to first embodiment of the invention;
Fig. 2 is with editing system editor's stream 0 and stream 1, and by stream 0 and stream 1 stream of forming 3 through editor;
Fig. 3 is a block diagram, shows the editing system according to second embodiment of the invention;
Fig. 4 is a block diagram, shows the circuit structure of multiplexer in Fig. 3 editing system;
Fig. 5 is a block diagram, shows the editing system according to third embodiment of the invention;
Fig. 6 is a curve chart, show three kinds of signal to noise ratio curves under the situation, first kind of situation is parameter identical when all using with a preceding encoding operation, second kind of situation is the parameter of presentation video type, quantizer matrix (Quant) and DCT type identical when only using with a preceding encoding operation, and the third situation is not use identical parameter fully;
Fig. 7 is a block diagram, according to the editing system of fourth embodiment of the invention;
Fig. 8 is with the editing system editor's of the 4th embodiment among Fig. 7 stream 0 and stream 1, and by stream 0 and stream 1 stream of forming 3;
Fig. 9 shows a compressive flow;
Figure 10 (a)-10 (d) shows a process sequence, and this sequence is with voice data and video data addition, so that produce data flow by the form that is suitable for medium;
Figure 11 is a block diagram, shows traditional editing system.
Referring now to accompanying drawing, in a few width of cloth figure, identical label is represented identical part.Fig. 1 shows according to editing system of the present invention, the flow to edlin of this system to from DVD-RAM11, reading, and they are stored among the DVD-RAM11 again.
Editing system generally comprises stream controller 12, is used for control and DVD-RAM11 read and write becomes a mandarin; Two AV decoders 20 and 21 are used for the convection current decoding, to produce vision signal and audio signal; Video encoder 18 is used for the vision signal recompile, to produce video-frequency basic flow (ET); Audio coder 19 is used for the audio signal recompile, flows substantially to produce audio frequency; Multiplexer 17, be used for video-frequency basic flow and audio frequency are flowed substantially multiplexed, to produce compressive flow; Delay circuit 15; AV encoder 22 is used for to audio signal and vision signal decoding, so that they are carried out visual monitoring; Switch 24, the vision signal that is used for importing is chosen video encoder 18; Switch 23, the audio signal that is used for importing is chosen audio coder 19; Switch 16 is used for selecting a stream from the stream of multiplexer 17 and delay circuit 15 outputs; Timing controller 13 is used for the operation of control switch 16,23 and 24; And system controller 14, be used to control the whole system operation.
Fig. 2 shows the stream of being handled by the present embodiment editing system.
Editing system will flow 0 segmentation A and segmentation B part and the segmentation C and the segmentation D combination of flowing 1, produce stream 3.In each stream 0 and stream 1, an in-edit is set between segmentation B and segmentation C.In the following discussion, supposed before the beginning edit operation, by editorial staff or other external equipment information input system controller 14 in-edit.With stream 0,1 and 3 fixed less part, each less part formation image sets (GOP) of being divided at interval.The front portion of each GOP comprises the I image.In the illustrated case, the in-edit in each stream all is set among the GOP, leaves one section given interval, front portion of this GOP.Segmentation B is defined as, the front portion from in-edit to the GOP that has set this in-edit.Segmentation A is made up of the GOP of segmentation B front.Segmentation C is defined as, and has set the end of the GOP of in-edit 1 to stream from in-edit.Segmentation D is made up of the GOP of segmentation C back.
To produce stream at 3 o'clock, use the segmentation A of the stream of from DVD-RAM 11, reading 0 in executive editor's operation same as before, and segmentation B is to its decoding and by re-using behind video encoder 18 and audio coder 19 recompiles through AV decoder 20.To its decoding and by re-using behind video encoder 18 and audio coder 19 recompiles, and segmentation D uses the segmentation C of the stream of reading from DVD-RAM11 1 same as before through AV decoder 21.Specifically, in producing stream 3 processes, in four segmentation A, B, C and D, have only segmentation B and C behind recompile, just to use.This can alleviate the deterioration of image quality of stream 3.
The control signal that 13 pairs of system controllers of timing controller are exported successively responds console switch 16.
At first, timing controller 13 console switchs 16 are so that pass to stream controller 12 with the segmentation A of the stream 0 of delay circuit 15 output.Specifically, the segmentation A of the stream of reading from DVD-RAM11 by stream controller 12 0 experiences a period of time in delay circuit 15 postpones, and returns DVD-RAM11 then same as before.
Then, timing controller 13 console switchs 16, between stream controller 12 and multiplexer 17, set up communication, go back console switch 23 and switch 24, setting up communication between audio coder 19 and the AV decoder 20 and between video encoder 18 and the AV decoder 20.Specifically, video data among stream 0 the segmentation B and voice data after 20 decodings of AV decoder respectively by video encoder 18 and audio coder 19 to its recompile.
As mentioned above, video encoder 18 and audio coder 19 produces video-frequency basic flow respectively and audio frequency flows substantially.In multiplexer 17 to these substantially stream carry out multiplexedly, produce a compressive flow, and then compressive flow passed to stream controller 12 by switch 16, and it is recorded among the DVD-RAM11, follow back at the segmentation A of stream 0.Delay circuit 15 makes the data delay a period of time among the segmentation A, equal during this period of time to data among the segmentation B decode, coding and multiplexed required time.
Then, timing controller 13 is selected between audio coders 19 and the AV decoder 21 and the communication between Video Decoder 18 and the AV decoder 21 by switch 23 and switch 24, to video data and the voice data recompile among the segmentation C of the stream 1 of AV decoder 21 outputs.Video-frequency basic flow and audio frequency to video encoder 18 and audio coder 19 outputs in multiplexer 17 flow multiplexed substantially, produce a compressive flow, and then compressive flow passed to stream controller 12 by switch 16, and it is recorded among the DVD-RAM11, follow back at the segmentation B of stream 0.
At last, timing controller 13 console switchs 16 are so that be directly passed to stream controller 12 with the segmentation D of the stream 1 of delay circuit 15 output.Specifically, the segmentation D of the stream of reading from DVD-RAM11 by stream controller 12 1 experiences a period of time delay circuit 15 postpones, and then records among the DVD-RAM11, follows the back at the segmentation C of stream 1.Delay circuit 15 makes the data delay a period of time among the segmentation D, equal during this period of time to data among the segmentation C decode, coding and multiplexed required time.
Use two decoders 20 and 21 convection current in real time to edit.In producing stream 3 processes, only use segmentation B and C can make two streams 0 and 1 coupled to each other by encoder 18 and 19 recompiles, very big deterioration can not take place in picture quality.
The segmentation A of stream 0 cannot be write among the DVD-RAM11 again.In this case, the segmentation B of recompile and the sequence of C are recorded on the zone of DVD-RAM11, for example, follow in the regional back of original record segmentation A, and segmentation D are replicated in the appropriate area of DVD-RAM11.
In above-mentioned discussion, suppose that the in-edit of stream 0 and 1 all is arranged in the GOP, but might just in time be arranged between adjacent two GOP by one of them in-edit.For example, as shown in Figure 2,, producing stream at 3 o'clock so, using the part of following in the stream 1 in segmentation B back if flow the end that 0 in-edit is arranged on the nearest GOP of segmentation A.Specifically, in the process that produces stream 3, use the preceding stream 0 of recompile same as before, have only the part of the end from its in-edit to certain GOP that in-edit is set in the stream 1 just to re-use through recompile.
Below will describe the editing system of second embodiment, this system is used to update header signal, and simply decoder is correctly decoded mix flow.
In first embodiment, will flow 0 and stream 1 be coupled, produce stream 3, this can cause stream 1 and flow packet header comprised between 0 PTS and frame number discontinuous.Therefore, when convection current 3 decodings, decoder need be analyzed discontinuous PTS and frame number, so that press the proper order reproduced image, and makes reproduction sound and image synchronization.
As shown in Figure 3, the editing system of present embodiment comprises multiplexer 25, multiplexer 26 and switch 27 and 28.Go multiplexer 25 that the stream 1 of stream controller 12 outputs is separated into video packets and audio packet.Multiplexer 26 links to each other with the video packets of output head again with audio packet.Delay circuit 15 is connected switch 16 and extends to from stream controller 12 between the holding wire of AV decoder 20.Therefore identical among other structure and first embodiment shown in Figure 1 omit its detailed description here.
As shown in Figure 4, multiplexer 26 comprises video packets head generator 32, is used to produce the video packets head; Video packets generator 31, it produces video packets with the head that video packets head generator 32 produces; Audio packet head generator 34 is used to produce the audio packet head; Audio packet generator 33, it produces audio packet with the head that audio packet head generator 34 produces; Compressing of herder generator 35 is used to produce compressing of herder; Outlet selector 36 is used for definite type that will be multiplexed into the grouping of a compression; And switch 37, it selects one according to the packet type that outlet selector 36 is determined from the output of video packets generator 31, audio packet generator 33 and compressing of herder generator 35.
The same with first embodiment will be flowed 0 the direct inlet flow controller 12 of segmentation A by delay circuit 15 and switch 16.
Then, the segmentation C of stream 0 segmentation B and stream 1 is incorporated in the back of segmentation A.Specifically, timing controller 13 console switchs 27 and 28 are being set up communication between multiplexer 26 and the video encoder 18 and between multiplexer 26 and the audio coder 19.Thus, the audio frequency that produces of video-frequency basic flow that video encoder 18 is produced and audio coder 19 substantially stream offer multiplexer 26.
The video packets head generator 32 of multiplexer 26 produces packet header for the video-frequency basic flow of input.Video packets generator 31 is separated into video packets with video-frequency basic flow, and packet header and their additions that video packets head generator 32 is produced, thereby video packets is exported to switch 37 with head.
Equally, audio packet head generator 34 is the audio frequency of the input estranged group of head of miscarrying substantially.Audio packet generator 33 with the basic flow point of audio frequency from becoming audio packet, and packet header and their additions that audio packet head generator 34 is produced, thus audio packet is exported to switch 37 with head.
Compressing of herder generator 35 produces the head of compression.
Go multiplexer 25 will flow 1 segmentation D and be separated into video packets and audio packet, and by switch 27 and 28 they are exported to multiplexer 26 respectively.
Video packets head generator 32 produces head for the video packets of going multiplexer 25 inputs.A head that replaces each input video grouping in the head of video packets generator 31 usefulness video packets head generators 32 outputs is so that the video packets that output header is replaced.
Equally, audio packet head generator 34 produces head for the audio packet of going multiplexer 25 inputs.A head that replaces each input audio packet in the head of audio packet generator 33 usefulness audio packet head generators 34 outputs is so that the audio packet that output header is replaced.
Same as described above, outlet selector 36 is determined to be included in a packet type in the compression, and console switch 37, produces a compressive flow.
By above-mentioned discussion as seen, the editing system of present embodiment links to each other head and segmentation D and segmentation B again with grouping among the C.Therefore, increase from the head that flows 0 segmentation A, can form a complete stream continuously to the frame number and the PTS of the head of segmentation B, C and D.
Below describe the editing system of the 3rd embodiment, this system can reduce to minimum to the deterioration that picture quality causes the recompile operation.
Fig. 5 shows the editing system of present embodiment, and the difference of second embodiment only is among this system and Fig. 3, and the parameter of using when system controller 14 takes out decoding from decoder 20,21 and 22 is with the operation of controlled encoder 18 and 19.Other structure is all identical with operation, therefore omits its detailed description here.
As discussing among Figure 11, can use usually such as image type, quantizer matrix (Quant), DCT type, motion vector (MV) and macroblock types parameters such as (MB) moving image encoding.Encoder side sends to decoder side with the information of these parameters.Decoder side uses the information that receives to the input data decode.
Image type is represented in I image, P image and the B image, and presses the formal representation of two bits of every frame.
Quantizer matrix (Quant) is made up of parameter, and each parameter has been stipulated quantization step, and presses the formal representation of five bits of each macroblock (MB).
The type of DCT represents that DCT is frame DCT, or field DCT, and presses the formal representation of a bit of every MB.
Motion vector (MV) is by the formal representation of six of every MB or above bit.
The type of MB is represented the coding mode of MB, and by the formal representation of every MB one to 8 bits.
Can be by between the decode operation of decoder 20 and 21, reusing used parameter in the encoding operation, reduce when with 18 pairs of video encoders during through video data recompile that decoder 20 and 21 is decoded and the deterioration of image quality that produces.This is because the identical parameters that reuses in the video encoder 18 can be carried out the same-code operation that previous video data experienced.
Specifically, system controller 14 is fetched the information of the above-mentioned parameter of decoding in decoder 20,21 and 22, and sends it to video encoder 18.Video encoder 18 is according to the information that receives, and produces the identical parameter of using in the encoding operation with the previous experience of inputting video data of parameter, and with them to the video data recompile, thereby the alleviation deterioration of image quality.
Fig. 6 is a curve chart, show three kinds of signal to noise ratio curves under the situation, first kind of situation is parameter identical when all using with a preceding encoding operation, second kind of situation is the parameter of presentation video type, quantizer matrix (Quant) and DCT type identical when only using with a preceding encoding operation, and the third situation is not use identical parameter fully.
These curve shows, the parameter of identical presentation video type, quantizer matrix (Quant) and DCT type when only using, the signal to noise ratio (snr) in the time of can realizing basically all using identical parameters with a preceding encoding operation.In addition, aspect used data volume, therefore these three parameters can send to video encoder 18 with information from system's control 14 effectively less than all the other parameters of expression MV and MB type.
Usually, need when operating, recompile change the bit rate (hereinafter referred to as original bit rate) in the encoding operation before the decode operation.For example, connecting two different streams of bit rate need flow recompile to one of them, makes its bit rate consistent with the bit rate of another stream.When running into this situation, the editing system of present embodiment can be revised each value of quantizer matrix (original Quant) according to following relation, to produce new quantizer matrix (new Quant):
Original bit rate: new bit rate=original Quant: new Quant
Therefore, the new original Quant of Quant=* (new bit rate/original bit rate)
The amended quantizer matrix of video encoder 18 usefulness (new Quant) is to the video data recompile, thereby bit rate is changed, and do not sacrifice the improvement to deterioration in image quality simultaneously.Usually, in the encoding operation before decode operation, increase quantization step,, reduce the obviously quantization step of part simultaneously, to improve picture quality to view data to improve compression ratio to the not obvious part of view data.Revise the quantizer matrix according to above-mentioned equation bit rate is changed, keep same as before simultaneously above-mentioned to compression ratio raising and to the improvement of picture quality.
Specifically, the not obvious part of image encoded data also comprises many sightless noises in the quantization step that increases, and the obvious part of encoding in the quantization step that reduces comprises many muting signal compositions.Do not need fully noise in the not obvious part is carried out recompile, therefore allow to increase quantization step, to improve compression ratio.On the contrary, obviously part need make the growth minimum of noise, so need to reduce quantization step.Therefore, with above-mentioned equation change quantizer matrix (Quant) make can be in encoder 18 recompile, and do not sacrifice picture quality.
Avoid the method for deterioration in image quality to use in the legacy system with two separate units with the parameter identical with a preceding used parameter of encoding operation, wherein two separate units are the mpeg stream reconstructors and the editing machine that is used for the reproduced image recompile with monitor.Such system passes to editing machine with vision signal and the audio signal that reconstructor reproduces.In reconstructor, change the vision signal that passes to editing machine by handover operation.
When stating method in the use, the parameter transmission cable is connected between reconstructor and the editing machine, be used to transmit five parameters of presentation video type, quantizer matrix (Quant), DCT type, motion vector (MV) and macroblock (MB) type, or three parameters of the information of presentation video type, quantizer matrix (Quant) and DCT type.Smudgy in order to prevent the relation between parameter and the frame of video, will be in the blanking interval that vision signal flows, send to editing machine with reproducing the ID and the PTS that comprise in the stream by the data cable that is connected between reconstructor and the editing machine, and will and pass through the parameter addition that the parameter transmission cable sends ID and PTS.
Fig. 7 shows the editing system according to the 4th embodiment, and this system is recording audio data again.
The editing system of this embodiment comprises multiplexer 25, is used for stream 1 is divided into video packets and audio packet; Remove multiplexer 29, be used for stream 0 is divided into video packets and audio packet; And switch 27 and 28, be used for from video encoder 18, remove multiplexer 25 and go the output of multiplexer 29 to select one, from audio coder 19, remove multiplexer 25 and go to select one the output of multiplexer 29.Therefore identical among other structure and second embodiment omit its detailed description here.
Output with 26 pairs of switches 27 of multiplexer and 28 is compressed, and exports to stream controller 12 with the form of stream.Specifically, as shown in Figure 8, mode with similar first embodiment forms segmentation A, the B of stream 3 and the segmentation D that C also forms stream 3 with the following methods, promptly by the video packets among the segmentation D of switch 27 selection streams 1, by the audio packet among the segmentation D of switch 28 selection streams 0, thereby produce the stream of forming by video packets in the stream 1 and the audio packet that flows in 0.The same with first embodiment, the segmentation A of stream 0 cannot be rewritten among the DVD-RAM11.
Edit operation according to the 5th embodiment below will be described, this operation be when the editorial staff when observing monitor to from DVD-RAM, read flow to edlin the time performed.
When known in-edit in advance, carry out the edit operation of first embodiment.Therefore, can be according to the segmentation B recompile of the anterior convection current 0 of segmentation.But when the editorial staff was provided with in-edit when observing monitor, the data of in-edit were not input editing systems in advance.Edit operation under this situation of description that below sees figures.1.and.2.
Be used for editing edit operation and first embodiment identical of the segmentation A of stream 0.When editor flowed 0 segmentation B, editing system was not known in-edit, caused editing system can not discern the segmentation B of stream 0.Therefore, continue identical edit operation, thereby will flow in 0 sequential recording about segmentation A and B in DVD-RAM11 with processing segmentation A.
When the editorial staff determined in-edit, timing controller 13 console switchs 23 and 24 linked to each other with video encoder 18 audio coder 19 with AV decoder 21, and console switch 16, and multiplexer 16 is linked to each other with stream controller 12.Therefore, in video encoder 18 and audio coder 19, to the data recompile of the segmentation C in the stream 1 of AV decoder 21 decoding, then by multiplexer 17, switch 16 and stream controller 12, with its transmission be recorded among the DVD-RAM11.Identical among the edit operation that is used for editing stream 1 segmentation D and first embodiment.
After the decoding of the segmentation C that finishes convection current 1, the method console switch 16 that timing controller 13 usefulness are identical with first embodiment, the segmentation D of the stream 1 of delay circuit 15 output is directly passed to stream controller 12, thereby segmentation D is recorded among the DVD-RAM11, follow back at segmentation C.
In case determined in-edit, just can determine the scope of the segmentation B of stream 0 as mentioned above.Therefore, behind the editor who finishes convection current 0 and stream 1 with said method, editing system is read the data among the segmentation B of stream 0 once more, with its decoding, encode and be rewritten in the respective regions of DVD-RAM11.
As mentioned above, when not pre-determining in-edit, at first will flow 0 and stream 1 re-write among the DVD-RAM11, the segmentation B recompile of not convection current 0, the segmentation B recompile of convection current 0 then is so that interpolation is carried out in convection current.Usually, the length of segmentation B is 0.5 second.Therefore, the editorial staff feels that edit operation carries out in real time.
If the segmentation B recompile of not convection current 0 can make the reproduced image distortion so.This be because, described in Figure 10 (a) and Figure 10 (b), discuss, the sequence of coded image is different with the frame sequence of original image, therefore when GOP of cut-out, required several frames disappearances when causing reproduction.The distortion in images when recompile of the segmentation B of convection current 0 has been avoided reproduction.
Although, disclosed the present invention with preferred embodiment for the ease of understanding, should be appreciated that, do not break away from principle of the present invention and can in all sorts of ways and implement the present invention.Therefore, present invention is to be construed as and comprise all possible embodiment and to the modification of illustrated embodiment, it implements not break away from the principle of the invention that is limited by appended claims.
Claims (17)
1. a stream editing equipment is characterized in that, this equipment is designed to the in-edit place that can be provided with in each stream, switches to another with one in two inlet flows that use in the edit operation, and described equipment comprises:
First decoder is used for first-class decoding;
Second decoder is used for the second stream decoding;
Encoder is used at least one the stream recompile to flowing through first and second of described first and second decoder decodes;
Controller, be used to control editor to first and second streams, so that produce the 3rd stream, described the 3rd stream is formed by being arranged in the aft section that the preceding segmentation before the in-edit and second stream is positioned at after the in-edit in first-class, described controller is when producing the 3rd stream, the other parts of preceding segmentation described in the part at least one segmentation of preceding segmentation described in first and second streams and described aft section and first and second streams and described aft section are merged, described part in wherein said at least one segmentation is through respective decoder decoding in described first and second decoders and by described encoder recompile, described part is defined as leaving the in-edit that is provided with in one of first and second streams and has one section given length, and described other parts are meant the part charge before decoding and recompile;
The head generator is used to the 3rd miscarriage to give birth to a series of heads;
Remove multiplex machine, be used for first and second streams are divided into video packets and audio packet; And
Multiplex machine is used for carrying out multiplexed to the video packets of a stream of first and second streams and the audio packet in another stream.
2. stream editing equipment as claimed in claim 1, it is characterized in that, first and second streams all are made up of a plurality of image sets, and described controller determined decoded and recompile and will merge to the length of part described in the 3rd stream, and described part begins till the front portion of the image sets at this in-edit place from in-edit.
3. stream editing equipment as claimed in claim 1 is characterized in that, at least one the stream recompile during the coded message that described encoder is obtained at least one stream decoding in first and second streams with described first and second decoders flows first and second.
4. stream editing equipment as claimed in claim 3 is characterized in that, coded message comprises image type, quantizer matrix and discrete cosine transform type.
5. stream editing equipment as claimed in claim 4, it is characterized in that, when require described encoder at least one stream in first and second streams is being carried out recompile when operation change with first and second streams in stream when encoding during used bit rate, described encoder uses the quantizer matrix that changes according to following relational expression:
Change the preceding quantizer matrix of back quantizer matrix=change * (bit rate before bit rate after changing/change).
6. stream editing equipment as claimed in claim 3 is characterized in that, by the holding wire of two separation, will pass to described encoder through the video and/or audio data and described first and second decoders of coded message from be arranged on separate unit of decoding.
7. stream editing equipment as claimed in claim 1 is characterized in that, when the described part in will merging to the 3rd stream was defined within the described first aft section, described encoder carried out recompile to described part after the second stream editor is finished.
8. stream editing equipment as claimed in claim 1, it is characterized in that, in the process that produces the 3rd stream, described controller is selected following four parts, before first decoding and the recompile first-class in the first of preceding segmentation, it two is after first, before the in-edit, second portion by segmentation before in described encoder output first-class, it three is after the in-edit, by the first of aft section in second stream of described encoder output, it four is after the second stream first, the second portion of aft section in second stream before decoding and the recompile.
9. stream editing equipment as claimed in claim 8, it is characterized in that, first and second streams all are made up of a plurality of image sets, and described controller has been determined the scope of first-class second portion and the scope of second first of flowing, wherein first second portion begins to the front portion of the image sets at this in-edit place from in-edit, and the first of second stream begins to the end of the image sets at this in-edit place from in-edit.
10. stream edit methods, the in-edit place that this method can be provided with in each inlet flow switches to another with one in two inlet flows that use in the edit operation, it is characterized in that, said method comprising the steps of:
With two decoders first and second streams are decoded;
Be used at least one the stream recompile in first and second streams that described decoding step is decoded; And
Control is to the editor of first and second streams, so that produce the 3rd stream, described the 3rd stream is formed by being arranged in the aft section that the preceding segmentation before the in-edit and second stream is positioned at after the in-edit in first-class, described controlled step is when producing the 3rd stream, the other parts of preceding segmentation described in the part at least one segmentation of preceding segmentation described in first and second streams and described aft section and first and second streams and described aft section are merged, described part in wherein said at least one segmentation is through decoding and recompile, and be defined as leaving the in-edit that is provided with in one of first and second streams and have one section given length, described other parts are meant the part charge before decoding and recompile;
Be that a series of heads are given birth in the 3rd miscarriage;
First and second streams are divided into video packets and audio packet; And
Carry out multiplexed to the video packets of a stream in first and second streams and the audio packet in another stream.
11. stream edit methods as claimed in claim 10, it is characterized in that, first and second streams all are made up of a plurality of image sets, and decoded and recompile and will merge to the 3rd the length of described part in flowing and be defined as beginning to the front portion of the image sets at this in-edit place from in-edit.
12. stream edit methods as claimed in claim 10 is characterized in that, at least one the stream recompile during the coded message that described coding step is obtained at least one the stream decoding in first and second streams with described decoding step flows first and second.
13. stream edit methods as claimed in claim 12 is characterized in that, coded message comprises image type, quantizer matrix and discrete cosine transform type.
14. stream edit methods as claimed in claim 13, it is characterized in that, during used bit rate, described coding step uses the quantizer matrix that changes according to following relational expression when requiring described coding step to change that a stream is encoded in to first and second streams:
Change the preceding quantizer matrix of back quantizer matrix=change * (bit rate before bit rate after changing/change).
15. stream edit methods as claimed in claim 10 is characterized in that, when the described part in will merging to the 3rd stream was defined within the described first aft section, described coding step carried out recompile to described part after the second stream editor is finished.
16. stream edit methods as claimed in claim 10, it is characterized in that, in the process that produces the 3rd stream, described controlled step is selected following four parts, before first decoding and the recompile first-class in the first of preceding segmentation, it two is after first, before the in-edit, the second portion of preceding segmentation in decoding and recompile first-class, it three is after the in-edit, the first of aft section in second stream of decoding and recompile, it four is second to flow after the first, the second portion of aft section in second stream before decoding and the recompile.
17. stream edit methods as claimed in claim 16, it is characterized in that, first and second streams all are made up of a plurality of image sets, and the scope of first-class second portion and the scope of the second stream first have been determined, wherein first-class second portion is to begin to the front portion of the image sets at this in-edit place from in-edit, and the second stream first is the end of the image sets from in-edit to this in-edit place.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB001036904A CN1136721C (en) | 2000-02-28 | 2000-02-28 | Method and device for flow editing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB001036904A CN1136721C (en) | 2000-02-28 | 2000-02-28 | Method and device for flow editing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1311605A CN1311605A (en) | 2001-09-05 |
| CN1136721C true CN1136721C (en) | 2004-01-28 |
Family
ID=4577103
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB001036904A Expired - Fee Related CN1136721C (en) | 2000-02-28 | 2000-02-28 | Method and device for flow editing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1136721C (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100377589C (en) * | 2005-04-07 | 2008-03-26 | 北京北大方正电子有限公司 | A method for quick generation of video file |
| CN101026725B (en) * | 2005-07-15 | 2010-09-29 | 索尼株式会社 | Reproducing apparatus, reproducing method |
| JP4251298B2 (en) * | 2005-07-15 | 2009-04-08 | ソニー株式会社 | REPRODUCTION DEVICE AND REPRODUCTION METHOD, PROGRAM, PROGRAM STORAGE MEDIUM, DATA, RECORDING MEDIUM, RECORDING DEVICE, AND RECORDING MEDIUM MANUFACTURING METHOD |
-
2000
- 2000-02-28 CN CNB001036904A patent/CN1136721C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN1311605A (en) | 2001-09-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1151684C (en) | Moving-picture coding-decoding apparatus and method, and moving-picture code recording medium | |
| CN1135708C (en) | Picture signal processing system, decoder, picture signal processing method, and decoding method | |
| CN1151681C (en) | Digital recording and playback apparatus having MPEG code decoder and method therefor | |
| CN1242620C (en) | Transcoder-based adaptive quantization for digital video recording | |
| CN1086070A (en) | The method and system of Code And Decode picture intelligence and relevant picture-signal recording media | |
| CN1134992C (en) | Picture predictive decoding/coding method and device, and data memory medium | |
| CN1255800C (en) | Method and equipment for producing recording information signal | |
| EP1258993B1 (en) | Lossless encoding and decoding system | |
| CN1318950A (en) | Picture coding device and method, camera, video recorder and graphic transmission device | |
| CN1723710A (en) | Be used for system and the system that is used for video data decoding to video data encoding | |
| CN1076934C (en) | Animation encoding method, animation decoding method, animation recording medium and animation encoder | |
| CN1184809C (en) | Data processing device and method, and recording device and method | |
| CN1788496A (en) | Image processing device, image processing method, information processing device, information processing method, information recording device, information recording method, information reproduction dev | |
| CN1251967A (en) | Method and apparatus for processing information and stream, recording and reproducing | |
| CN1155241C (en) | Receiver and transmitter-receiver | |
| KR20090099455A (en) | Video contents editing apparatus, controller and method | |
| CN1136721C (en) | Method and device for flow editing | |
| US20080152313A1 (en) | Image processing apparatus | |
| CN1263290C (en) | Image processor and method thereof | |
| CN1173557C (en) | Editing device and data transmission method | |
| CN1220392C (en) | Image compression equipment and method for processing frame jump | |
| EP0948212A2 (en) | Method and apparatus for encoding orthogonal transform coefficients | |
| CN1533171A (en) | Image processing device and method and image processing system and program | |
| JP3427505B2 (en) | Image coding method and editing device | |
| CN1275468C (en) | MPEG video decoding method and mpeg video decoder |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C06 | Publication | ||
| PB01 | Publication | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C19 | Lapse of patent right due to non-payment of the annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |