CN102118598B - Device and method for processing videos - Google Patents
Device and method for processing videos Download PDFInfo
- Publication number
- CN102118598B CN102118598B CN2009102588943A CN200910258894A CN102118598B CN 102118598 B CN102118598 B CN 102118598B CN 2009102588943 A CN2009102588943 A CN 2009102588943A CN 200910258894 A CN200910258894 A CN 200910258894A CN 102118598 B CN102118598 B CN 102118598B
- Authority
- CN
- China
- Prior art keywords
- frame
- video
- image
- pipeline
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Image Processing (AREA)
Abstract
The invention discloses a device and method for processing videos, which are used for capturing a viewing zone as a video result. The device for processing videos comprises a video sensor, a temporary storage and a video pipeline, wherein the video sensor adopts a sensing frame to capture the viewing zone and generates a video comprising multiple frames; the video pipeline directly adopts the video sensor to receive one of the multiple frames to serve as a first frame, processes the first frame to generate a temporary result frame, and generates a video result based on the temporary result frame and a second frame received directly by the video sensor through the frequency of a video frame; and the frequency of the video frame is less than the frequency of the sensing frame. The method for processing videos adopts the above device to capture the viewing zone as a video result.
Description
Technical field
The present invention relates to a kind of processing unit and processing method thereof of video, particularly a kind of processing unit and processing method thereof of saving the video of required holder size and frequency range.
Background technology
The user can use image/video (video) capture devices such as digital camera or video camera to come pick-up image or video, and obtains play-overing image/video output file of viewing and admiring.Yet the data that obtain via transducer (sensor) at first of devices such as digital camera are initial data (raw data), and initial data need be passed through many processing and just can be offered the user and view and admire.
Present digitized video processing (Digital Image Processing, DIP) the technology initial data of using pipeline (pipeline) system handles image/videos more, and pipeline system is to carry out a series of processing to single image.Pipeline system has (stage) a plurality of the processing stage usually, can handle the image that is transfused to continuously to apply filter methods such as (filter) length by length.For example, image/video that pipeline system can use filter to be transfused to converts the rgb color space pattern into, also can convert source file into general image format.
Yet; Because the video frame frequency (video frame rate) when the used sensing frame frequency (sensor frame rate) of the image sensor on existing is exported with video is similar; Therefore so Video processing must be accomplished, limited the hardware speed of pipeline system virtually and to the demand of memory body in a frame time.Especially now very general multiple dimensioned (multi-scale) or the image application technology of multiframe (multi-frame) increases the required hardware cost of pipeline system especially.
Because the multiple dimensioned or treatment technology of multiframe need be handled a plurality of incoming frames and could produce an output frame; For example handling the source image that image sensor provided, is that a kind of successive frame is handled, and last frame is to be temporarily stored in earlier in the input buffer; Afterwards when handling next frame; Read out last frame again to the input buffer handling together, so pipeline system just need have at least one extra input buffer (buffer), could keep frame that image sensor gives in order to follow-up processing; This all is very large challenge for the size and frequency range of memory body.
In addition, along with the progress of science and technology, the resolution of image or video also and then improves.On behalf of input buffer, this also to possess has bigger capacity, and in other words, input buffer needs more cost, and the source image read or write the required frequency range of memory body can along with the processing stage increase and become big.Moreover, need carry out the access computing in large quantities when carrying out the image processing of multiframe, also current video processing method has been caused the problem of frame delay (frame delay).
Summary of the invention
In order to solve the problem of the higher and frame delay of aforementioned tube wire system cost, the present invention provides a kind of processing unit and processing method thereof of video, and it is in order to being a results for video with the district's acquisition of finding a view.The processing unit of video provided by the present invention and processing method thereof can be exempted the demand to input buffer, therefore can reduce required hardware cost, and can solve the problem of frame delay and reduce the required reading and writing bandwidth of memory body.
The processing unit of video provided by the present invention is to comprise: video sensor (video sensor), storage temporary (temporary memory) and video pipeline (video pipeline).Wherein video sensor is with find a view district and produce the video comprise continuous a plurality of frames (frame) of a sensing frame frequency (sensor frame rate), and the video pipeline directly receives one of these frames as one first frame by video sensor.The video pipeline is handled to produce a temporary transient result frame first frame; Produce results for video according to temporary transient result frame and direct one second frame that receives by video sensor with a video frame frequency (video frame rate) again; Wherein second frame is to be the next frame of first frame, and wherein the video frame frequency less than the sensing frame frequency.
According to an enforcement example of the present invention, the video pipeline is to can be one or its combination that is selected from the group that is made up of an image process unit, an image-zooming (image scaling) unit, image mixing (image blending) unit, a frame-rate conversion (frame rate conversion) unit and an image compression unit.
Implement example according to of the present invention another, the image mixed cell of video pipeline produces results for video according to the temporary transient result frame and second frame.Preferably, the processing unit of video can comprise in addition a holder as a result, and the video pipeline is stored in holder as a result with results for video.
And the processing method of video provided by the present invention is to comprise: find a view district and generation video, and wherein video comprises continuous a plurality of frames; Directly receive one of these frames as first frame, and first frame is handled, to produce temporary transient result frame; Directly receive second frame, wherein second frame is the next frame of first frame; And according to second frame and temporary transient result frame generation results for video.
Preferably, the processing method of video is to receive one of these frames as first frame with the video pipeline, and first frame is handled to produce temporary transient result frame.And the step that above-mentioned foundation second frame and temporary transient result frame produce results for video can comprise: handle second frame and temporary transient result frame with the image mixed cell of video pipeline, to produce results for video.
In addition, the processing method of video also can comprise: temporary transient result frame is stored in storage temporary.The processing method of video also can comprise: results for video is stored in holder as a result.And the video pipeline can be with rest parts in these frames that directly receive alternately as first frame and second frame and handle it, all be processed up to these frames and finish.
In sum; Effect of the present invention is; Processing unit and processing method thereof according to video of the present invention can utilize the video sensor with higher sensing frame frequency to obtain image, make video sensor directly send image (a plurality of frames) to the video pipeline again.Therefore the video pipeline frame that needing can directly obtain is handled, and does not need to the input buffer requirement.So according to above-mentioned processing method, the processing unit of video need not dispose any input buffer can carry out the many sizes or the image processing technique of multiframe, can effectively reduce whole memory body size, and the required reading and writing bandwidth of memory body.
Describe the present invention below in conjunction with accompanying drawing and specific embodiment, but not as to qualification of the present invention.
Description of drawings
Figure 1A is the block diagram of the processing unit of the video of one enforcement example according to the present invention;
Figure 1B is the block diagram of the processing unit of another video of implementing example according to the present invention;
Fig. 2 is the flow diagram of the processing unit of the video of one enforcement example according to the present invention;
Fig. 3 is the schematic flow sheet of the processing method of another video of implementing example according to the present invention;
Fig. 4 is the flow diagram according to multiple dimensioned exemplary applications of the present invention; And
Fig. 5 is the flow diagram according to multiframe exemplary applications of the present invention.
Wherein, Reference numeral
The processing unit of 20 videos
22 video sensors
221 sensor controllers
24 storage temporaries
26 video pipelines
261,261 ' image-zooming unit
262 image process units
263 image mixed cells
28 holders as a result
30 videos
32,32 ' first frame
34,34 ' second frame
36,36 ' temporary transient result frame
38,38 ' results for video
40 microprocessors
42 coders
44 display engine unit
46 I/O units
48 display unit
Embodiment
Below in execution mode, be described in detail detailed features of the present invention and advantage; Its content is enough to make any those skilled in the art to understand technology contents of the present invention and implements according to this; And according to content, the claim scope and graphic that this specification disclosed, those skilled in the art can understand purpose and the advantage that the present invention is correlated with easily.
The present invention provides a kind of processing unit and processing method thereof of video, and it is in order to being a results for video with find a view a district acquisition.Please refer to Figure 1A, it is the block diagram for the processing unit of the video of one enforcement example according to the present invention.Illustrate like Figure 1A, the processing unit 20 of video comprises a video sensor (videosensor) 22, a storage temporary (temporary memory) 24, one video pipeline (video pipeline) 26 and a holder 28 as a result.The processing unit 20 of video is distinguished the initial data (raw data) that obtains a video (video) by video sensor 22 according to finding a view, and is results for video by video pipeline 26 with Video processing again.
In addition, mainly be to handle according to the processing unit 20 of video provided by the present invention and processing method thereof, for the processing method of audio frequency and unrestricted to the frame in the video.
According to an enforcement example of the present invention, results for video is meant the frame of being handled by video pipeline 26, and the frame that these were handled can synthesize an output video (output video).And implement example according to of the present invention another, the processing unit 20 of video can receive a plurality of frames and only produce results for video as output, then is output as a static images (still image) this moment.Though many situation with output video are example in this specification, the processing unit of video provided by the present invention and processing method thereof also can be used for handling static images.
Below roughly introduce these processing units.
The image-zooming unit is in order to frame dwindled (downsizing, or be called down-scaling) or to amplify (upsizing, or be called up-scaling).When the user was not high to the resolution requirement of results for video, the processing unit 20 of video can use the image-zooming unit to reduce the resolution of video, to save the requisite space that stores results for video.And when carrying out for example super-resolution digitized videos such as (Super Resolution) processing, also need use the image-zooming unit.For example the image-zooming unit can be processed into different resolution with an image (or frame) again, to obtain the image characteristics of image under different resolution.
The image mixed cell is then in order to be mixed into a new frame with a plurality of (major part is two) frame.The image mixed cell can calculate the rgb color or the brightness of new frame, and obtain various mixed effect according to the rgb color or the brightness of each pixel (pixel) in the mixed frame.
The frame-rate conversion unit is in order to improve or to reduce the video frame frequency of output video within the specific limits.The frame-rate conversion unit reduces the results for video quantity that comprises in the output video to reduce the video frame frequency, frame and adding in the output video to improve the video frame frequency between also available interpolation method produces and mends.And the frame-rate conversion unit also can be by software control, and do not need the additional hardware unit.
The image compression unit can use destructive compression, and the quality that promptly reduces frame is to reduce the shared storage area of results for video.The image compression unit is also in order to the video format that the output video boil down to is different; Video format can for example be by (the Moving Picture Experts Group of dynamic image expert body; MPEG) the MPEG-2 form of being formulated, or blue light (Blu-ray) form of attention image quality.
Image process unit can carry out multiple processing to image, for example sharp keenization (sharping), color revisal or removal blood-shot eye illness, AWB, tone processing etc.Different according to required function, employed filter of image process unit and operation method can have variation miscellaneous, do not limit it in the present invention.Image process unit also can use filter (filter) to remove salt green pepper noise (Salt andpepper noise) or ISO noise noises such as (high ISO noise) in the frame, to obtain image quality preferably.For example, the simple filtering device can for example be median filter (median filter) or linear filter.
Figure 1B is for another implements the block diagram of the processing unit of the video of example according to the present invention.Illustrate like Figure 1B; The processing unit 20 of video is except comprising video sensor 22, storage temporary 24, video pipeline 26 and as a result the holder 28, still comprises a sensor controller 221, a microprocessor 40, a coder (codec) 42, a display engine unit (display engine unit) 44, one I/O unit 46.
Microprocessor 40 is overall operations of the processing unit 20 of control of video, for example sends various command and handles 22 picked image of video sensor to make video pipeline 26 grades cooperate.
42 of coders are in order to encode image and to compress; Can be Audio Video Interleaved form (Audio Video Interleave format for example with video conversion; AVI format) or Motion Picture Expert Group form video formats such as (Moving Picture Experts Group, MPEG format).
The processing unit 20 of video also can comprise an I/O unit 46; Can be like the memory external card control units; Be used for handling video data later and be stored to memory card, wherein memory card can be safe digital card (Secured Digital Card, SD card), memory body storehouse memory card (Memory Stick MemoryCard; The MS card), compact flash memory card (Compact Flash Memory Card, CF card) etc.
By video pipeline 26 with above-mentioned processing unit, be converted into results for video by the frame of the video of video sensor 22 acquisitions, a plurality of results for video also become output video.And in the process of video pipeline 26 processed frames, the frame that also can section processes be crossed is as a temporary transient result frame, and temporary transient result frame is stored in storage temporary 24.And according to an enforcement example of the present invention, storage temporary 24 is can be configured in the video pipeline 26.That is to say that storage temporary 24 can be that an interior magazine (internal storage) or the second level of video pipeline 26 is got (L2cache) soon.
Say that in more detail video pipeline 26 directly receives one of frame of being captured by video sensor 22 as one first frame, and first frame is handled and produced temporary transient result frame, and can deposit temporary transient result frame in storage temporary 24.Then video pipeline 26 directly receives first frame by video sensor 22 next frame as one second frame, video pipeline 26 is again according to the results for video of the result frame and second frame generation temporarily.
According to an enforcement example of the present invention, video pipeline 26 can be stored in holder 28 as a result with the results for video of finishing dealing with (and output video), and holder 28 is the external storages (external storage) that can be video pipeline 26 as a result.Implement example according to of the present invention another, storage temporary 24 can be same holder with holder 28 as a result also, and distinguishes separated with memory body address (address).In other words, storage temporary 24 and holder 28 as a result can be the storage area of the different memory bodys address of same holder.
Please be simultaneously with reference to Figure 1A, Figure 1B and Fig. 2, wherein Fig. 2 is the flow diagram for the processing unit of the video of one enforcement example according to the present invention.Implement in the example in this, the sensing frame frequency of video sensor 22 is the twices for the video frame frequency of output video.Illustrate like Fig. 2, video sensor 22 is found a view to distinguish according to sensing frame acquisition one and is produced video 30, and video 30 comprises a plurality of frames.Video pipeline 26 comprises image-zooming unit 261, image process unit 262 and image mixed cell 263.
Along with the process of time, video pipeline 26 receives first frame 32 ' again and produces temporary transient result frame 36 ', the second frame 34 ' and temporary transient result frame 36 ' again after image mixed cell 263 mixes, generation results for video 38 '.Video pipeline 26 so repeats received frames and processed steps till handling the frame that all video sensors 22 are transmitted, to obtain corresponding to the results for video 38 of video 30.
In addition; Results for video 38 can be via after coder 42 decodings; Be shown on the display unit 48 via display engine unit 44; And display unit 48 is being lower than the video frame frequency output video result 38 of sensing frame frequency, and for example when video sensor 22 used sensing frame frequencies were per second 60 frames, then display unit 48 was with the video frame frequency output video result 38 of per second 30 frames.
Please with reference to Fig. 3, it is for another implements the schematic flow sheet of the processing method of the video of example according to the present invention.Can know that by Fig. 3 the processing method of video can comprise step S100: find a view district and generation video, wherein video comprises continuous a plurality of frames; Step S110: receive one of these frames as first frame, and first frame is handled, to produce temporary transient result frame; Step S120: receive second frame, wherein second frame is the next frame of first frame; Step S130: produce results for video according to second frame and temporary transient result frame; And step S140: repeated execution of steps S110, S120 and S130, till all frames are handled.
Wherein step S110 can be carried out by video pipeline 26, and step S130 can be carried out by image mixed cell 263.Better is that after step S110 obtained temporary transient result frame 36, the processing method of video also can comprise step: temporary transient result frame 36 is stored in storage temporary 24.In addition, after step S130 obtained results for video 38, the processing method of video also can comprise step: results for video 38 is stored in holder 28 as a result.
Be noted that first frame 32 and second frame 34 are directly to receive from video sensor 22 for video pipeline 26.
Above-mentioned steps S100 is the step that produces single results for video 38 for the processing method of video to step S130.At step S140, the processing method of video can repeat these steps up to all frames of handling video 30, and obtains comprising till the output video of all results for video 38.Meaning be video pipeline 26 can be with rest parts in these frames that directly receive alternately as first frame 32 and second frame 34 and handle it, all be processed up to the frame of video 30 and finish.
In more detail, video pipeline 26 be with remaining frame in the video 30 in regular turn alternately as first frame 32 and second frame 34, and 26 pairs first frames of video pipeline 32 are handled to produce temporary transient result frame 36.Video pipeline 26 produces video spare results 38 according to temporary transient result frame 36 and direct second frame 34 that is received by video sensor 22 again.Video pipeline 26 and with video frame frequency output video result 38, till these frames of handling video 30 less than the sensing frame frequency.
Next please with reference to Fig. 4 and Fig. 5, it is respectively the flow diagram according to multiple dimensioned application of the present invention (multi-scale application) example and multiframe application (multi-frame application) example.The enforcement example of Fig. 4 and Fig. 5 is the processing unit 20 real multiple dimensioned and multiframe exemplary applications of doing for utilizing video provided by the present invention.
In the enforcement example of Fig. 4, video sensor 22 provides first frame 32 and second frame 34 to give video pipeline 26, video pipeline 26 and with two stage processing to produce results for video 38.In this enforcement example; The sensing frame frequency of video sensor 22 is the twice of the required video frame frequency of output; And video pipeline 26 contains image-zooming unit 261, image-zooming unit 261 ', image process unit 262 and an image mixed cell 263, and wherein image-zooming unit 261 is as one first image-zooming unit, and image-zooming unit 261 ' is as one second image-zooming unit; The two is a pair of; All tool supports image to amplify or reduction capability, and when one of them carried out magnified image, another then dwindled image.
In the processing of phase I, video pipeline 26 can use image-zooming unit 261 earlier first frame 32 to be dwindled, and extracts an image feature of first frame 32 that is dwindled out with image process unit 262.Image feature can for example be to detect the edge in first frame 32 that (edge-detection) method obtains with one edge; Can also be the low frequency part of first frame 32 that obtains after handling with a low pass filter (low pass filter), temporary transient result frame 36 and existing in the storage temporary 24 of these first frame, 32 conducts of handling then.In second stage was handled, temporary transient result frame 36 (first frame 32 that is dwindled) was sent to before image mixed cell 263 mixes, the resolution that first frame 32 that video pipeline 26 can will dwindle with image-zooming unit 261 ' earlier amplifies back script.
And in the processing of second stage, video pipeline 26 receives second frame 34 and handles second frame 34 with image process unit 262.At last; Read temporary transient result frame 36 from storage temporary 24; And because temporary transient result frame 36 is first frames 32 that dwindled; So utilize image-zooming unit 261 ' to make it to amplify back resolution originally earlier, deliver to image mixed cell 263 again and be mixed into results for video 38 with second frame of handling 34.
In like manner, remaining frame can repeatability be handled like aforementioned manner, repeats no more then.
Implement example according to of the present invention another, video pipeline 26 also can be chosen the part of image feature, and only image feature is amplified back original resolution, for being mixed into results for video 38 via image mixed cell 263 and second frame of handling 34 afterwards.
In more detail, image feature can have an original size (being the resolution of the script of first frame 32 and image feature).In the phase I, image-zooming unit 261 as the first image-zooming unit in order to change the size of first frame 32.Then image process unit 262 selects image feature as temporary transient result frame 36 from the first varying sized frame 32.Then, in the processing of second stage, video pipeline 26 receives second frame 34 and handles second frame 34 with image process unit 262.At last, read temporary transient result frame 36 from storage temporary 24.And because temporary transient result frame 36 is the image features of varying sized (change resolution); So utilize image-zooming unit 261 ' size of image feature to be returned back to original size (resolution originally) earlier, deliver to image mixed cell 263 again and be mixed into results for video 38 with second frame of handling 34 as the second image-zooming unit.
In like manner, remaining frame can repeatability be handled like aforementioned manner, repeats no more then.
Wherein, when image-zooming unit 261 is when dwindling image, then image-zooming unit 261 ' is exactly a magnified image; Otherwise when image-zooming unit 261 was magnified image, then image-zooming unit 261 ' was exactly to dwindle image.
Aforesaid embodiment utilizes image-zooming unit 261 and 261 ' collocation mutually, but owing to an image-zooming unit 261 itself just has amplification and dwindles two kinds of functions of image, so can also only realize through an image-zooming unit 261 according to demand.For example; If present video pipeline 26 has only image-zooming unit 261; Then image-zooming unit 261 receives first frames 32 and changes the size of first frame 32, and image process unit 262 selects image feature as temporary transient result frame 36 from the first varying sized frame 32 afterwards.Then also the size of image feature is returned back to original size, deliver to image mixed cell 263 again by image-zooming unit 261.
In comparison, the way that existing many sizes are used needs to preserve the frame that image sensor was captured with an extra input buffer, carries out the processing of phase I and second stage with the frame in the input buffer for pipeline.Because the video sensor 22 of the processing unit 20 of video provided by the present invention has higher sensing frame frequency, so video sensor 22 can real-time continuous provide first frame 32 and second frame 34.So compare with existing way, the processing unit 20 of video provided by the present invention does not need the support of input buffer.
In the enforcement example that the multiframe of Fig. 5 is used, the sensing frame frequency of video sensor 22 is the twice of the required video frame frequency of output.For example, first frame 32 is for the time for exposure acquisition with 1/45 second of the camera lens of digital camera obtains, and second frame 34 is to obtain with 1/90 second time for exposure acquisition.The results for video of then handling 38 can be an image with time for exposure of 1/30 second, and the quality of results for video 38 is better than directly capturing the frame that obtains with time for exposure of 1/30.For example the 38 comparable time for exposure with 1/30 of results for video capture the frame that obtains and have noise still less, or contrast more clearly.
The same with the enforcement example of Fig. 4, because video sensor 22 has higher sensing frame frequency, so the processing unit 20 of video does not need existing input buffer and the frequency range of reading and writing input buffer.And behind the removal input buffer, because of the also disappearance thereupon of problem of the frame delay (frame delay) that input buffer caused.
In addition, because first frame 32 is to be different images with second frame 34, that is to say in first frame 32 and second frame 34 to have different image informations.Therefore video pipeline 26 can obtain more image information, to produce preferable results for video.
And according to the processing unit of video of the present invention and processing method thereof applicable to various digitized video Treatment Technology; For example video text detects (video text detection), motion event detection (sport eventdetection), the square frame illusion alleviates (blocking-artifact reduction), detection of dynamic/compensation (motiondetection/compensation), super-resolution, fuzzy (blur deconvolution), human face recognition (face recognition) or the video firm (video stabilization also is called anti-hand and shakes) removed.
In sum, can utilize video sensor to obtain image, make video sensor directly send image (a plurality of frames) to the video pipeline again with higher sensing frame frequency according to the processing unit and the processing method thereof of video of the present invention.The frame that the video pipeline directly obtains a plurality of needs is as input and handle, and does not need to the identical frame of input buffer requirement effectively to reduce whole memory body size as input, and reduces image is read or required frequency range when writing memory body.So according to above-mentioned processing method, the processing unit of video need not dispose any input buffer can carry out the many sizes or the image processing technique of multiframe.That is to say, can solve problems such as the higher and frame delay of hardware cost that existing pipeline system needs input buffer caused according to the processing unit of video of the present invention and processing method thereof.
Certainly; The present invention also can have other various embodiments; Under the situation that does not deviate from spirit of the present invention and essence thereof; Those of ordinary skill in the art work as can make various corresponding changes and distortion according to the present invention, but these corresponding changes and distortion all should belong to the protection range of the appended claim of the present invention.
Claims (11)
1. the processing unit of a video: it is characterized in that, comprising:
One video sensor, with find a view district and produce a video of sensing frame frequency acquisition one, wherein this video comprises a plurality of frames; And
One video pipeline; Directly receive one of those frames as one first frame by this video sensor; This first frame is handled to produce a temporary transient result frame; This video pipeline produces a results for video according to this temporary transient result frame and direct one second frame that is received by this video sensor again, and with this results for video of video frame frequency output less than this sensing frame frequency, wherein this second frame is the next frame of this first frame.
2. the processing unit of video according to claim 1; It is characterized in that; In regular turn alternately as this first frame and this second frame, and handle producing this temporary transient result frame this first frame by this video pipeline with remaining those frames for this video pipeline, and this video pipeline is again according to this temporary transient result frame and directly by this this results for video of second frame generation of this video sensor reception; And with this this results for video of video frame frequency output, till handling those frames less than this sensing frame frequency.
3. the processing unit of video according to claim 1 is characterized in that, wherein this video pipeline comprises:
One image mixed cell, this image mixed cell this temporary transient result frame of mixing and this second frame are to produce this results for video.
4. the processing unit of video according to claim 3 is characterized in that, this first frame has at least one image feature, and this image feature has an original size, and this video pipeline comprises:
One first image-zooming unit receives this first frame and changes the size of this first frame; And
One image process unit; From this varying sized first frame, select this image feature with as this temporary transient result frame; This first image-zooming unit again will this temporary transient result frame size return back to this original size after, transmit return back to this original size this image feature to this image mixed cell to mix to produce this results for video with this second frame.
5. the processing unit of video according to claim 3 is characterized in that, this first frame has at least one image feature, and this image feature has an original size, and this video pipeline comprises:
One first image-zooming unit receives this first frame and changes the size of this first frame;
One image process unit selects this image feature with as this temporary transient result frame from this varying sized first frame; And
One second image-zooming unit, the size of this temporary transient result frame returned back to this original size after, transmit return back to this original size this image feature to this image mixed cell to mix to produce this results for video with this second frame.
6. the processing unit of video according to claim 1; It is characterized in that this video pipeline is one of to be selected from the group that is made up of an image process unit, an image-zooming unit, an image mixed cell, a frame-rate conversion unit and an image compression unit or its combination.
7. the processing method of a video in order to be a results for video with the district's acquisition of finding a view, is characterized in that, comprising:
One video sensor is this district and produce a video of finding a view with sensing frame frequency acquisition, and wherein this video comprises a plurality of frames;
(a) directly receive one of those frames as one first frame, and this first frame is handled, to produce a temporary transient result frame by this video sensor;
(b) directly receive one second frame by this video sensor, wherein this second frame is the next frame of this first frame; And
(c) produce this results for video according to this second frame and this temporary transient result frame that directly receive, and with this results for video of video frame frequency output less than this sensing frame frequency, wherein this video frame frequency is less than this sensing frame frequency by this video sensor.
8. the processing method of video according to claim 7 is characterized in that, also comprises:
With remaining those frames alternately as this first frame and this second frame; And
Repeated execution of steps (a) and (b) and (c) are till handling remaining those frames.
9. the processing method of video according to claim 7; It is characterized in that; This step (a) is carried out with a video pipeline, and this video pipeline is one of to be selected from the group that is made up of an image process unit, an image-zooming unit, an image mixed cell, a frame-rate conversion unit and an image compression unit or its combination.
10. the processing method of video according to claim 9 is characterized in that, this step (a) is carried out with a video pipeline, and this step (a) comprising:
With one first image-zooming unit of this video pipeline, change the size of this first frame; And
With an image process unit of this video pipeline, an image feature of from this varying sized first frame, selecting this first frame is with as this temporary transient result frame;
And this step (c) comprising:
Size that will this temporary transient result frame with this first image-zooming unit returns back to an original size of this image feature, and transmit return back to this original size this image feature to this image mixed cell; And
Mix this image feature and this second frame that returns back to this original size with this image mixed cell, to produce this results for video.
11. the processing method of video according to claim 9 is characterized in that, this step (a) is carried out with a video pipeline, and this step (a) comprising:
With one first image-zooming unit of this video pipeline, change the size of this first frame; And
With an image process unit of this video pipeline, an image feature of from this varying sized first frame, selecting this first frame is with as this temporary transient result frame;
And this step (c) comprising:
Size that will this temporary transient result frame with one second image-zooming unit of this video pipeline returns back to an original size of this image feature, and transmit return back to this original size this image feature to this image mixed cell; And
Mix this image feature and this second frame that returns back to this original size with this image mixed cell, to produce this results for video.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009102588943A CN102118598B (en) | 2009-12-30 | 2009-12-30 | Device and method for processing videos |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009102588943A CN102118598B (en) | 2009-12-30 | 2009-12-30 | Device and method for processing videos |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102118598A CN102118598A (en) | 2011-07-06 |
| CN102118598B true CN102118598B (en) | 2012-11-21 |
Family
ID=44217169
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009102588943A Expired - Fee Related CN102118598B (en) | 2009-12-30 | 2009-12-30 | Device and method for processing videos |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102118598B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1337648A (en) * | 2001-06-28 | 2002-02-27 | 北京山鑫海达科技发展有限公司 | High-speed real-time image record system |
| CN1496121A (en) * | 2002-08-16 | 2004-05-12 | 索尼公司 | Image processing device, image processing method, recording medium and program |
| CN101102501A (en) * | 2007-08-02 | 2008-01-09 | 北京中星微电子有限公司 | A real time frame rate control method and its device |
-
2009
- 2009-12-30 CN CN2009102588943A patent/CN102118598B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1337648A (en) * | 2001-06-28 | 2002-02-27 | 北京山鑫海达科技发展有限公司 | High-speed real-time image record system |
| CN1496121A (en) * | 2002-08-16 | 2004-05-12 | 索尼公司 | Image processing device, image processing method, recording medium and program |
| CN101102501A (en) * | 2007-08-02 | 2008-01-09 | 北京中星微电子有限公司 | A real time frame rate control method and its device |
Non-Patent Citations (1)
| Title |
|---|
| JP特开2007-228099A 2007.09.06 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102118598A (en) | 2011-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20130021504A1 (en) | Multiple image processing | |
| JP4421897B2 (en) | Simultaneous dual pipeline for acquisition, processing and transmission of digital video and high-resolution digital still photos | |
| US6594399B1 (en) | Method and apparatus for integrating multiple 1-D filters into a digital image stream interface | |
| CN104869381B (en) | A kind of image processing system, method and device | |
| US8941744B2 (en) | Image sensors for establishing an image sharpness value | |
| US8072511B2 (en) | Noise reduction processing apparatus, noise reduction processing method, and image sensing apparatus | |
| CN100356405C (en) | Method and apparatus for changing digital image size | |
| US8564724B2 (en) | Ghosting artifact reduction in temporal noise filtering | |
| JP6038234B2 (en) | Architecture for video processing, high-speed still image processing, and high-quality still image processing | |
| CN105993177A (en) | Image capture accelerator | |
| JP5460736B2 (en) | Method and apparatus for the correction of images from fisheye lenses in cameras | |
| CN100474890C (en) | Image display device | |
| US20110157426A1 (en) | Video processing apparatus and video processing method thereof | |
| JP4245139B2 (en) | Image processing device | |
| US8081228B2 (en) | Apparatus and method for processing image data | |
| US8548272B2 (en) | Image signal processing apparatus, image signal processing method, camera apparatus, image display apparatus, and image signal output apparatus | |
| US20100253806A1 (en) | Imaging system and imaging method thereof | |
| CN114298889A (en) | Image processing circuit and image processing method | |
| US7944510B2 (en) | Broadcast receiving apparatus for capturing broadcast signal and method thereof | |
| US20100135644A1 (en) | Photographing apparatus and method of controlling the same | |
| CN102118598B (en) | Device and method for processing videos | |
| US10277811B2 (en) | Display control device and imaging device | |
| US20130169758A1 (en) | Three-dimensional image generating device | |
| CN100379249C (en) | A method and apparatus for changing digital image size during process of shooting | |
| US20040196380A1 (en) | Image processing device, camera and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20121121 Termination date: 20181230 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |