TWI424371B - Video processing device and processing method thereof - Google Patents

Description

Video processing device and processing method thereof

The present invention relates to a video processing device and a processing method thereof, and more particularly to a video processing device and a processing method thereof that can save a required memory size and bandwidth.

The user can use a video/video capture device such as a digital camera or a video camera to capture images or video, and obtain an image/video output file that can be directly played. However, the data originally obtained by the sensor such as a digital camera is raw data, and the original data has to undergo a lot of processing to be provided for viewing by the user.

Today's Digital Image Processing (DIP) technology uses a pipeline system to process raw images of video/video, while a pipeline system can perform a series of processing on a single image. The pipeline system usually has a plurality of processing stages, and the input image can be continuously processed step by step by applying a filter or the like. For example, the pipeline system can use a filter to convert the input image/video into RGB color space mode, and can also convert the original file into a common image format.

However, since the sensor frame rate used in the conventional image sensor is similar to the video frame rate at the time of video output, the video processing is completed in one frame time. Therefore, the hardware speed of the pipeline system and the demand for the memory are invisibly limited. In particular, today's popular multi-scale or multi-frame imaging applications increase the hardware cost of pipeline systems.

Since multi-scale or multi-frame processing techniques need to process multiple input frames to produce an output frame, such as processing the source image provided by the image sensor, a continuous frame processing, the previous frame It is temporarily stored in the input buffer, and then when the next frame is processed, the previous frame is read in the input buffer to be processed together, so the pipeline system needs to have at least one additional input buffer. (buffer), in order to preserve the frame given by the image sensor for subsequent processing, which is a very big challenge for the size and bandwidth of the memory.

In addition, with the advancement of technology, the resolution of video or video has also increased. This also means that the input buffer needs to have a larger capacity. In other words, the input buffer requires more cost, and the bandwidth required for the source image to read or write to the memory increases as the processing stage increases. . Furthermore, when performing image processing of multiple frames, a large amount of access operations are required, and a problem of frame delay is caused to the conventional video processing method.

In order to solve the problem of high cost and frame delay of the above pipeline system, the present invention provides a video processing device and a processing method thereof for extracting a framing area as a video result. The video processing device and the processing method thereof provided by the invention can eliminate the requirement of the input buffer, thereby reducing the required hardware cost, solving the problem of frame delay and reducing the read/write frequency required for the memory. width.

The video processing device provided by the present invention comprises: a video sensor, a temporary memory, and a video pipeline. The video sensor captures the framing area at a sensor frame rate and generates one of a plurality of consecutive frames, and the video pipeline directly receives the frames by the video sensor. One as a first frame. The video pipeline processes the first frame to generate a temporary result frame, and then generates a video frame at a video frame rate according to the temporary result frame and a second frame directly received by the video sensor. As a result, the second frame is the next frame of the first frame, and wherein the video frame rate is less than the sensing frame rate.

According to an embodiment of the present invention, the video pipeline may be selected from an image processing unit, an image scaling unit, an image blending unit, a frame rate conversion unit, and One of a group of image compression units or a combination thereof.

According to another embodiment of the present invention, the image mixing unit of the video pipeline generates a video result according to the temporary result frame and the second frame. Preferably, the video processing device further includes a result storage, and the video pipeline stores the video result in the result storage.

The video processing method provided by the present invention includes: capturing a framing area and generating video, wherein the video comprises a plurality of consecutive frames; directly receiving one of the frames as the first frame, and the first frame Processing is performed to generate a temporary result frame; the second frame is directly received, wherein the second frame is the next frame of the first frame; and the video result is generated according to the second frame and the temporary result frame.

Preferably, the video processing method receives one of the frames as a first frame by the video pipeline, and processes the first frame to generate a temporary result frame. The step of generating the video result according to the second frame and the temporary result frame may include: processing the second frame and the temporary result frame by the image mixing unit of the video pipeline to generate the video result.

In addition, the processing method of the video may further include: storing the temporary result frame in the temporary storage. The processing method of the video may also include: storing the video result in the result storage. And the video pipeline can alternately receive the remaining portions of the frames directly received as the first frame and the second frame until the frames are processed.

In summary, the video processing device and the processing method thereof according to the present invention can obtain an image by using a video sensor having a higher sensing frame rate, and then cause the video sensor to directly display the image (multiple images) The box is transferred to the video line. Therefore, the video pipeline can be directly processed by the required frame without being required to the input buffer. Therefore, according to the above processing method, the video processing device can perform multi-size or multi-frame image processing technology without any input buffer, which can effectively reduce the overall memory size and the read/write frequency required by the memory. width.

The detailed features and advantages of the present invention are set forth in the Detailed Description of the Detailed Description of the <RTIgt; </ RTI> <RTIgt; </ RTI> </ RTI> </ RTI> <RTIgt; The objects and advantages associated with the present invention can be readily understood by those skilled in the art.

The invention provides a video processing device and a processing method thereof, which are used for extracting a framing area as a video result. Please refer to FIG. 1A, which is a block diagram of a video processing apparatus according to an embodiment of the present invention. As shown in FIG. 1A, the video processing device 20 includes a video sensor 22, a temporary memory 24, a video pipeline 26, and a result storage. 28. The video processing device 20 obtains a video raw data according to the framing area by the video sensor 22, and then the video line 26 processes the video as a video result.

The video sensor 22 can also be referred to as an image sensor, such as an image capturing unit or an image sensing element of a digital camera, a cell phone, or a camera. For example, the video sensor 22 can be a Charge Coupled Device (CCD) of a digital camera or a Complementary Metal-Oxide-Semiconductor (CMOS) photosensitive element. In more detail, when the user uses a digital camera to capture video of the surrounding scenery, the video sensor 22 captures the reflected light of the scene entering the digital camera through the lens as video; and the framing area is a digital camera. CCD or CMOS captures the view.

The video captured by the video sensor 22 may include a plurality of consecutive frames, and may also include audio. Moreover, the video sensor 22 captures an image of the framing area with a higher sensor frame rate, and the sensing frame rate can be, for example, 60 frames per second or 90 frames per second. Frame. With the advancement of technology, the sensing frame rate of the video sensor 22 may even reach above 120 frames per second. It should be noted that the sensing frame rate of the video sensor 22 needs to be greater than the video frame rate of the video result. More preferably, the sensing frame rate can be at least twice the video frame rate.

In addition, the video processing device 20 and the processing method thereof according to the present invention are mainly for processing a frame in video, and there is no limitation on the method for processing the audio.

The video pipeline 26 sequentially receives the frame captured by the video sensor 22 on the time axis, and performs various digital image processing (DIP) on the received frame to obtain a video result.

According to an embodiment of the invention, the video result refers to a frame processed by the video pipeline 26, and the processed frames can be synthesized into an output video. According to another embodiment of the present invention, the video processing device 20 can receive a plurality of frames and generate only the video result as an output, and the output at this time is a still image. Although the case of outputting video is often taken as an example in the present specification, the video processing device and the processing method thereof provided by the present invention can also be used to process still images.

Video line 26 can include a number of different processing units depending on the function, and substantially video line 26 can include at least one image processing unit. In addition to the image processing unit, the video pipeline 26 may also include an image scaling unit, an image blending unit, a frame rate conversion unit, and an image compression unit. unit.

These processing units are briefly described below.

The image scaling unit is used to downsizing (or down-scaling) or upsizing (or up-scaling). When the user's resolution of the video result is not high, the video processing device 20 can use the image scaling unit to reduce the resolution of the video to save the space required for storing the video result. When performing digital image processing such as Super Resolution, an image scaling unit is also required. For example, the image scaling unit can process an image (or frame) into different resolutions to obtain image characteristics of the image at different resolutions.

The image blending unit is used to blend multiple (mostly two) frames into a new frame. The image mixing unit can calculate the RGB color or brightness of the new frame according to the RGB color or brightness of each pixel (pixel) in the mixed frame, and obtain various mixed effects.

The frame rate conversion unit is configured to increase or decrease the video frame rate of the output video within a certain range. The frame rate conversion unit reduces the number of video images included in the output video to reduce the video frame rate, and can also generate a tween frame by interpolation and add the output video to increase the video frame rate. The frame rate conversion unit can also be controlled by software without additional hardware units.

The image compression unit can use destructive compression, which reduces the quality of the frame to reduce the storage space occupied by the video result. The image compression unit is also used to compress the output video into different video formats. The video format may be, for example, an MPEG-2 format developed by Moving Picture Experts Group (MPEG), or a Blu-ray that emphasizes image quality ( Blu-ray format.

The image processing unit can perform various processing on the image, such as sharping, color correction or red-eye removal, automatic white balance, tone processing, and the like. Depending on the desired function, the filters and algorithms used by the image processing unit can be varied in various ways, and are not limited in the present invention. The image processing unit can also use a filter to remove noise such as salt and pepper noise or high ISO noise in the frame to obtain better picture quality. For example, a simple filter can be, for example, a median filter or a linear filter.

The "1B" diagram is a block diagram of a processing apparatus for video according to another embodiment of the present invention. As shown in FIG. 1B, the video processing device 20 includes a video sensor 22, a temporary memory 24, a video pipeline 26, and a result memory 28, and includes a sensor controller 221 and a micro The processor 40, a codec 42, a display engine unit 44, and an input/output unit 46.

The sensor controller 221 is for generating a high speed control signal to control the video sensor 22.

The microprocessor 40 controls the overall operation of the video processing device 20, such as transmitting various commands to cause the video line 26 and the like to cooperate with the image captured by the video sensor 22.

The codec 42 is used for encoding and compressing images, for example, converting the video into an audio video interleave format (AVI format) or a motion picture compression standard format (Moving Picture Experts Group, MPEG format). Video format.

The display engine unit 44 is configured to display the image captured by the video sensor 22 or the image read by the external storage device on a display device 48 connected to the video processing device 20. The display device 48 outputs the video according to the video frame rate, and the video frame rate is lower than the sensing frame rate. More preferably, the sensing frame rate is at least twice the video frame rate. Furthermore, the display device 48 can be installed on the video processing device 20, such as a liquid crystal display (LCD) or the like, or externally connected to the video processing device 20, such as a television screen.

The video processing device 20 can include an input/output unit 46, such as an external memory card control unit, for storing the processed video data into a memory card, wherein the memory card can be a secure digital card (Secured Digital Card). , SD card), memory stick memory card (Memory Stick Memory Card, MS card), compressed flash memory card (Compact Flash Memory Card, CF card).

The video frame captured by the video sensor 22 is converted into a video result by the video line 26 having the processing unit, and the plurality of video results become output video. In the process of processing the frame by the video pipeline 26, the partially processed frame may also be used as a temporary result frame, and the temporary result frame may be stored in the temporary storage 24. In accordance with an embodiment of the present invention, the temporary storage 24 can be configured within the video line 26. That is, the temporary storage 24 can be an internal storage of the video pipeline 26 or a second level cache (L2 cache).

In more detail, the video pipeline 26 directly receives one of the frames captured by the video sensor 22 as a first frame, and processes the first frame to generate a temporary result frame, and may temporarily The resulting frame is stored in temporary storage 24. Then, the video pipeline 26 directly receives the next frame of the first frame as a second frame by the video sensor 22, and the video pipeline 26 generates the video result according to the temporary result frame and the second frame.

In accordance with an embodiment of the present invention, the video pipeline 26 can store the processed video results (and output video) in the result store 28, and the result store 28 can be an external storage of the video line 26. According to another embodiment of the present invention, the temporary storage 24 may also be the same storage as the result storage 28, separated by a memory address. In other words, the temporary storage 24 and the result storage 28 can be storage spaces for different memory addresses of the same storage.

Please refer to "1A", "1B" and "2", where "2" is a block diagram of a video processing apparatus according to an embodiment of the present invention. In this embodiment, the sensing frame rate of the video sensor 22 is twice the video frame rate of the output video. As shown in FIG. 2, the video sensor 22 generates a video 30 by capturing a framing area according to the sensing frame, and the video 30 includes a plurality of frames. The video pipeline 26 includes an image scaling unit 261, an image processing unit 262, and an image mixing unit 263.

The video pipeline 26 receives one of the frames directly from the video sensor 22 as a first frame 32, and processes the first frame 32 to generate a temporary result frame 36, and the temporary result frame 36 is saved. The temporary storage 24 is entered. The video frame 26 then receives and processes the second frame 34, and the image mixing unit 263 mixes the processed second frame 34 and the temporary result frame 36 read from the temporary storage 24 into the video result 38. Thereafter, the video result 38 can be stored in the result store 28.

As time passes, the video pipeline 26 receives the first frame 32 ′ and generates a temporary result frame 36 ′. The second frame 34 ′ and the temporary result frame 36 ′ are mixed by the image mixing unit 263 to generate a video. The result is 38'. The video pipeline 26 repeats the steps of receiving the frame and processing until the frames transmitted by all of the video sensors 22 have been processed to obtain a video result 38 corresponding to the video 30.

In addition, the video result 38 can be decoded by the codec 42 and displayed on the display device 48 via the display engine unit 44, and the display device 48 outputs the video result 38 at a video frame rate lower than the sensing frame rate, for example, When the sensing frame rate used by the video sensor 22 is 60 frames per second, the display device 48 outputs the video result 38 at a video frame rate of 30 frames per second.

Please refer to FIG. 3, which is a schematic flowchart of a video processing method according to another embodiment of the present invention. As shown in FIG. 3, the processing method of the video may include the step S100: capturing the framing area and generating the video, wherein the video includes a plurality of consecutive frames; and step S110: receiving one of the frames as the first frame And processing the first frame to generate a temporary result frame; step S120: receiving the second frame, wherein the second frame is the next frame of the first frame; step S130: according to the second frame And the temporary result frame generates a video result; and step S140: repeating steps S110, S120, and S130 until all the frames are processed.

Step S110 can be performed by the video pipeline 26, and step S130 can be performed by the image mixing unit 263. More preferably, after the temporary result frame 36 is obtained in step S110, the video processing method may further include the step of storing the temporary result frame 36 in the temporary storage 24. In addition, after the video result 38 is obtained in step S130, the video processing method may further include the step of storing the video result 38 in the result storage 28.

It should be noted that the first frame 32 and the second frame 34 are received by the video line 26 directly from the video sensor 22.

The above steps S100 to S130 are steps of generating a single video result 38 for the video processing method. In step S140, the video processing method may repeat these steps until all the frames of the video 30 are processed, and the output video including all the video results 38 is obtained. That is, the video pipeline 26 can alternately treat the remaining portions of the frames directly received as the first frame 32 and the second frame 34 until the frames of the video 30 are processed.

In more detail, the video pipeline 26 sequentially replaces the remaining frames in the video 30 as the first frame 32 and the second frame 34, and the video pipeline 26 processes the first frame 32 to generate a temporary result map. Box 36. The video pipeline 26 then generates a video result 38 based on the temporary result frame 36 and the second frame 34 received directly by the video sensor 22. The video pipeline 26 outputs the video results 38 at a video frame rate that is less than the sensing frame rate until the frames of the video 30 are processed.

Next, please refer to "4th figure" and "5th figure", which are respectively a block diagram of a multi-scale application example and a multi-frame application example according to the present invention. The implementation examples of "Fig. 4" and "Fig. 5" are examples of multi-scale and multi-frame applications implemented by the processing device 20 of the video provided by the present invention.

In the embodiment of FIG. 4, the video sensor 22 provides a first frame 32 and a second frame 34 to the video pipeline 26, and the video pipeline 26 is processed in two stages to generate a video result 38. In this embodiment, the sensing frame rate of the video sensor 22 is twice the video frame rate required for output, and the video pipeline 26 includes an image scaling unit 261, an image scaling unit 261', and an image processing unit 262. And an image mixing unit 263, wherein the image scaling unit 261 is a first image scaling unit, and the image scaling unit 261' is a second image scaling unit, which are a pair of images, and both support image zooming or zooming. When one of them zooms in on the image, the other zooms out.

In the first stage of processing, the video pipeline 26 may first reduce the first frame 32 using the image scaling unit 261, and extract an image feature of the reduced first frame 32 by the image processing unit 262. The image feature may be, for example, an edge in the first frame 32 obtained by an edge-detection method, or may be a first frame 32 obtained by a low pass filter. The low frequency portion, then the processed first frame 32 is used as a temporary result frame 36 and is present in the temporary storage 24. In the second stage processing, before the temporary result frame 36 (the reduced first frame 32) is sent to the image mixing unit 263 for mixing, the video line 26 will first reduce the first by the image scaling unit 261'. Frame 32 is enlarged back to the original resolution.

And in the second stage of processing, the video pipeline 26 receives the second frame 34 and processes the second frame 34 with the image processing unit 262. Finally, the temporary result frame 36 is read from the temporary storage 24, and since the temporary result frame 36 is a reduced first frame 32, the image scaling unit 261' is first used to enlarge it to the original resolution. The image feed unit 263 and the processed second frame 34 are mixed into the video result 38.

Similarly, the remaining frames will be reproducible as described above, and will not be described again.

According to another embodiment of the present invention, the video pipeline 26 may also select portions of the image features and only magnify the image features back to the original resolution for later mixing with the processed second frame 34 via the image mixing unit 263. For the video result 38.

In more detail, the image features may have an original size (ie, the original frame 32 and the original resolution of the image features). In the first stage, the image scaling unit 261 serves as a first image scaling unit for changing the size of the first frame 32. The image processing unit 262 then selects the image feature from the first frame 32 of the resized size as the temporary result frame 36. Next, in the second stage of processing, the video pipeline 26 receives the second frame 34 and processes the second frame 34 with the image processing unit 262. Finally, the temporary result frame 36 is read from the temporary storage 24. And because the temporary result frame 36 is an image feature that has been changed in size (changing the resolution), the image scaling unit 261 ′ is first used as the second image scaling unit to restore the size of the image feature to the original size (original resolution). The image feed unit 263 and the processed second frame 34 are mixed into the video result 38.

Similarly, the remaining frames will be reproducible as described above, and will not be described again.

Wherein, when the image scaling unit 261 is a reduced image, the image scaling unit 261' is an enlarged image; otherwise, when the image scaling unit 261 is an enlarged image, the image scaling unit 261' is a reduced image.

The foregoing embodiment uses the image scaling units 261 and 261' to match each other. However, since one image scaling unit 261 itself has two functions of zooming in and out, it can also be achieved by only one image scaling unit 261 as needed. For example, if the current video pipeline 26 has only the image scaling unit 261, the image scaling unit 261 receives the first frame 32 and changes the size of the first frame 32, after which the image processing unit 262 moves from the first frame 32 of the resized size. The image feature is selected as the temporary result frame 36. The image feature is then restored to the original size by the image scaling unit 261 and sent to the image mixing unit 263.

In contrast, traditional multi-size applications require an additional input buffer to hold the frame captured by the image sensor for the pipeline to perform the first and second stages in the input buffer frame. Stage processing. Since the video sensor 22 of the video processing device 20 provided by the present invention has a high sensing frame rate, the video sensor 22 can continuously provide the first frame 32 and the second frame 34 in real time. Therefore, the video processing device 20 provided by the present invention does not require the input buffer support as compared with the conventional method.

In the embodiment of the multi-frame application of "Fig. 5", the sensing frame rate of the video sensor 22 is twice the video frame rate required for output. For example, the first frame 32 is obtained by taking the lens of the digital camera with an exposure time of 1/45 second, and the second frame 34 is obtained with an exposure time of 1/90 second. The processed video result 38 can be an image with an exposure time of 1/30 second, and the quality of the video result 38 is better than the frame obtained directly by the exposure time of 1/30. For example, the video result 38 may have less noise or a sharper contrast than the frame obtained by the exposure time of 1/30.

As with the embodiment of "Fig. 4", since the video sensor 22 has a higher sensing frame rate, the video processing device 20 does not require the bandwidth of the conventional input buffer and the read/write input buffer. . After the input buffer is removed, the problem of frame delay caused by the input buffer also disappears.

In addition, since the first frame 32 and the second frame 34 are different images, that is, the first frame 32 and the second frame 34 may have different image information. Therefore, the video pipeline 26 can obtain more image information to produce better video results.

Moreover, the video processing device and the processing method thereof according to the present invention are applicable to various digital image processing technologies, such as video text detection, sport event detection, and block artifact reduction (blocking- Artifact reduction), motion detection/compensation, super-resolution, blur deconvolution, face recognition, or video stabilization (also known as anti-shake).

In summary, the video processing device and the processing method thereof according to the present invention can obtain an image by using a video sensor having a higher sensing frame rate, and then cause the video sensor to directly display the image (multiple images) The box is transferred to the video line. The video pipeline directly receives multiple required frames as input and processes it, without requiring the same frame as an input to the input buffer, effectively reducing the overall memory size and reducing the reading or writing of the image into the memory. The bandwidth required. Therefore, according to the above processing method, the video processing device can perform multi-size or multi-frame image processing technology without configuring any input buffer. That is to say, the video processing device and the processing method thereof according to the present invention can solve the problems of high hardware cost and frame delay caused by the conventional pipeline system requiring an input buffer.

While the present invention has been described above in terms of the preferred embodiments thereof, it is not intended to limit the invention, and the invention may be modified and modified without departing from the spirit and scope of the invention. The patent protection scope of the invention is subject to the definition of the scope of the patent application attached to the specification.

20. . . Video processing device

twenty two. . . Video sensor

221. . . Sensor controller

twenty four. . . Temporary storage

26. . . Video pipeline

261,261’. . . Image scaling unit

262. . . Image processing unit

263. . . Image mixing unit

28. . . Result storage

30. . . Video

32,32’. . . First frame

34,34’. . . Second frame

36,36’. . . Temporary result frame

38,38’. . . Video result

40. . . microprocessor

42. . . Codec

44. . . Display engine unit

1A is a block diagram of a processing device for video according to an embodiment of the present invention;

1B is a block diagram showing a processing device for video according to another embodiment of the present invention;

2 is a block diagram showing a flow of a video processing apparatus according to an embodiment of the present invention;

3 is a schematic flow chart of a method for processing video according to another embodiment of the present invention;

Figure 4 is a flow block diagram of a multi-scale application example in accordance with the present invention;

Figure 5 is a block diagram of a multi-frame application example in accordance with the present invention.

Claims (18)

A video processing device includes: a video sensor that captures a framing area at a sensing frame rate and generates a video, wherein the video includes a plurality of frames; and a video pipeline directly from the video The sensor receives one of the frames as a first frame, and processes the first frame to generate a temporary result frame, and the video pipeline is further based on the temporary result frame and directly by the video sensor Receiving a second frame to generate a video result, and outputting the video result at a video frame rate less than the sensing frame rate, wherein the second frame is the next picture of the first frame frame. The processing device of the video device of claim 1, wherein the video pipeline alternately uses the remaining frames as the first frame and the second frame, and the video pipeline is A frame processing is performed to generate the temporary result frame, and the video pipeline generates the video result according to the temporary result frame and the second frame directly received by the video sensor, and is smaller than the sensing frame The video frame rate of the rate outputs the video result until the frames are processed. The processing device for video according to claim 1, further comprising: a temporary storage, wherein the video pipeline stores the temporary result frame in the temporary storage. The processing device for video according to claim 1, further comprising: a result storage, wherein the video pipeline stores the video result in the result storage. The processing device of the video device of claim 1, wherein the video pipeline comprises: an image mixing unit, the image mixing unit mixing the temporary result frame and the second frame to generate the video result. The processing device of the video device of claim 5, wherein the first frame has at least one image feature, the image feature has an original size, and the video pipeline further comprises: a first image scaling unit, receiving the a first frame and changing a size of the first frame; and an image processing unit that selects the image feature from the first frame that has been resized as the temporary result frame, the first image scaling unit Retrieving the size of the temporary result frame to the original size and transmitting the image feature returned to the original size to the image mixing unit for mixing with the second frame to generate the video result. The processing device of the video device of claim 5, wherein the first frame has at least one image feature, the image feature has an original size, and the video pipeline further comprises: a first image scaling unit, receiving the a first frame and changing a size of the first frame; an image processing unit, selecting the image feature from the first frame that has been resized as the temporary result frame; and a second image scaling unit, Retrieving the size of the temporary result frame to the original size and transmitting the image feature returned to the original size to the image mixing unit for mixing with the second frame to generate the video result. The processing device for video according to claim 1, wherein the first frame is different from the exposure time of the second frame. The processing device of the video device of claim 1, wherein the video pipeline is selected from the group consisting of an image processing unit, an image scaling unit, an image mixing unit, a frame rate conversion unit, and an image compression unit. One of the group or a combination thereof. A video processing method for capturing a framing area as a video result includes: capturing the framing area at a sensing frame rate and generating a video, wherein the video includes a plurality of frames; (a) Directly receiving one of the frames as a first frame, and processing the first frame to generate a temporary result frame; (b) directly receiving a second frame, wherein the second frame The next frame of the first frame; and (c) generating the video result according to the second frame and the temporary result frame, and outputting at a video frame rate smaller than the sensing frame rate The video result, wherein the video frame rate is less than the sensing frame rate. The method for processing video according to claim 10, further comprising: alternately using the remaining frames as the first frame and the second frame; and repeating steps (a) and (b) And (c) until the remaining frames are processed. The method for processing video according to claim 10, wherein the step (a) is performed by a video pipeline. The method for processing video according to claim 12, wherein the video pipeline is selected from the group consisting of an image processing unit, an image scaling unit, an image mixing unit, a frame rate conversion unit, and an image compression unit. One of the group or a combination thereof. The method for processing video according to claim 12, wherein the step (c) comprises: processing the second frame and the temporary result frame by an image mixing unit of the video pipeline to generate the video result. . The method for processing video according to claim 14, wherein the step (a) comprises: changing a size of the first frame by a first image scaling unit of the video pipeline; and using the video pipeline An image processing unit selects an image feature of the first frame from the first frame that has been resized as the temporary result frame; and the step (c) includes: using the first image scaling unit The size of the temporary result frame is restored to an original size of the image feature, and the image feature returned to the original size is transmitted to the image mixing unit; and the image feature is restored to the original size by the image mixing unit And the second frame to generate the video result. The method for processing video according to claim 14, wherein the step (a) comprises: changing a size of the first frame by a first image scaling unit of the video pipeline; and using the video pipeline An image processing unit selects an image feature of the first frame from the first frame that has been resized as the temporary result frame; and the step (c) includes: capturing a second image of the video pipeline The zoom unit restores the size of the temporary result frame to an original size of the image feature, and transmits the image feature returned to the original size to the image mixing unit; and the image image mixing unit is mixed back to the original size The image feature and the second frame are used to generate the video result. The method for processing video according to claim 10, further comprising: storing the temporary result frame in a temporary storage. The method for processing video according to claim 10, further comprising: storing the video result in a result storage.