KR20080113648A - Apparatus and method for image processing in capable of displaying captured image without time delay, and computer readable medium stored thereon computer executable instruction for performing the method - Google Patents

Abstract

An image processing apparatus and a method thereof, capable of displaying an captured image without time delay, and a computer readable medium thereof are provided to solve instability of fast data interfacing due to high pixelization and display a captured image fast. An original image processing unit processes a captured image in an image sensor correspondingly to an image data format for storage. A display image processing unit processes the captured image correspondingly to a format of a display unit. An image output unit alternatively outputs image data processed by the original image processing unit and image data process by the display image processing unit. An image signal processing module(200) includes an image output unit. A multimedia application processing module(300) displays the image data stored in the display image processing unit on a display unit.

Description

Apparatus and method for image processing in capable of displaying captured image without time delay, and computer readable medium stored thereon computer executable instruction for performing the method}

The following drawings attached to this specification are illustrative of preferred embodiments of the present invention, and together with the detailed description of the invention to serve to further understand the technical spirit of the present invention, the present invention is a matter described in such drawings It should not be construed as limited to.

1 is a block diagram of an image processing apparatus according to a preferred embodiment of the present invention.

FIG. 2 is a detailed block diagram of the image signal processing module shown in FIG. 1.

3 is a flowchart illustrating an image processing process according to an exemplary embodiment of the present invention.

4 is a timing diagram illustrating a process of transmitting image data according to a preferred embodiment of the present invention.

5 is a flowchart illustrating an image processing process according to an exemplary embodiment of the present invention in the continuous capture mode.

The present invention relates to image processing, and more particularly, to an image processing apparatus and method capable of displaying a captured image without time delay.

Recently, digital cameras using an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) have been widely used. Digital cameras are commercially available as camera-only products, but also in combination with hand-held terminals such as mobile phones and PDAs.

In the handheld terminal, however, the clock speed and the memory capacity of the central processing unit are not superior to those developed for the personal computer. In addition, since the development direction of the terminal is oriented to a thin thickness and a small size, there are a lot of space constraints in mounting an additional device such as a camera. On the other hand, despite these spatial constraints, the number of pixels of a digital camera mounted in a handheld terminal is gradually increasing to 3 million pixels or more, for example. Therefore, the image processing apparatus faces a demand to process a large amount of data in a short time under spatial constraints.

A general image processing apparatus includes an image sensor for capturing an image and an image signal processing module for converting raw image data in analog form received from the image sensor into digital data and converting the image data into image data suitable for a general image format. ), A multimedia application processing module for storing video data received from the video signal processing module in a storage medium, and displaying a video, and for displaying a preview video or a captured video. It has a display unit such as a view finder. The image sensor, the image signal processing module, and the multimedia application processing module are typically implemented in separate chip forms, and are mounted in an image processing device (a digital camera or a handheld terminal) together with, for example, a liquid crystal display module constituting a display unit.

In the operation of the image processing apparatus configured as described above, the analog image raw image data captured by the image sensor is converted into digital data by the image signal processing module, and the general image is processed through color correction, gamma correction, and color coordinate system conversion. It is converted into video data suitable for the format. The digital image data converted by the image signal processing module is transmitted to the multimedia application processing module, and the multimedia application processing module compresses and encodes the received image data according to a predetermined standard such as JPEG encoding and stores it in a memory such as an SDRAM. The image data stored in the memory is decoded and displayed on the display unit.

However, as the number of pixels of the digital camera mounted in the handheld terminal increases, the amount of data to be processed by the multimedia application processing module also increases, and thus the processing speed of the multimedia application processing module does not keep up. For example, when a multimedia application module needs to compress-code, store, and display image data input at a high speed of 10 frames per second or more in a high pixel imaging apparatus of 3 million pixels or more, image data of one frame may be displayed. During encoding, data of the next frame may be input, in which case high-speed data interfacing becomes unstable, such as data collision. To solve this problem, the clock frequency of the multimedia application module must be increased considerably, which is technically impossible to implement. Therefore, in the related art, the clock frequency of the image signal processing module is reduced in accordance with the limit of the clock frequency of the multimedia application processing module. However, this leads to the deterioration of the image quality.

On the other hand, in order to solve such a problem, a method of performing compression encoding in the video signal processing module used in the conventional multimedia application processing module may be used. That is, an encoding unit for compression encoding is added to the image signal processing module in addition to the pre-processing blocks for the conversion or correction performed by the conventional video signal processing module to encode the image captured by the image sensor. At this time, when the image data of the next frame is input during encoding for one frame, it is skipped or the vertical synchronization signal V_sync indicating the start of input of the next frame is delayed to prevent data collision during encoding. Meanwhile, the image data encoded by the image signal processing module is transmitted to the multimedia application processing module, stored in a memory or decoded, and displayed on the display unit.

According to this method, however, when the captured image is displayed on the display unit by the multimedia application processing module, the captured image must be decoded first and generally down-scaled to match the resolution of the display unit lower than the resolution of the stored image. Therefore, considerable time is required until the display of the captured image. Therefore, this method can solve the instability of data interfacing due to high pixelation, but it cannot meet the user's demand for quick confirmation of the captured image and rapid capture of the next image. In particular, the slow display of the captured image is unnaturally apparent as the capture and display of the image are delayed at a time interval in the continuous shooting mode that continuously captures the image within a short time. Commercialization becomes substantially difficult.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problems of the prior art, and an object thereof is to provide an image processing apparatus capable of quickly displaying a captured image while resolving instability of high-speed data interfacing due to high pixels.

Another object of the present invention is to provide an image processing method capable of quickly displaying a captured image while resolving instability of high-speed data interfacing due to high pixels.

Still another object of the present invention is to provide a computer-readable recording medium in which an image processing method capable of quickly displaying the captured image is programmed.

In order to achieve the above technical problem, in the present invention, the image signal processing module alternately outputs not only the image data for storing the captured image, but also the display image data to the multimedia application processing module by a predetermined unit, and the multimedia application processing module is stored. The image data for display is stored in the memory and the display image data is displayed on the display unit. Since the image data for display is already processed by the video signal processing module according to the format of the display unit, the multimedia application processing module does not need to perform a separate operation for displaying the captured image on the display unit. The display of the captured image is immediately performed without time delay.

Specifically, the image processing apparatus according to an aspect of the present invention, the original image processing unit for processing the captured image captured by the image sensor in accordance with a preset storage image data format; A display image processor configured to process the captured image according to a format of the display unit; And an image output unit configured to alternately output image data processed by the original image processing unit and image data processed by the display image processing unit by a predetermined unit. And store the image data processed by the original image processing unit and the image data processed by the display image processing unit in the storage image storage area and the display image storage area, respectively. And a multimedia application processing module configured to display image data stored in the display image storage area on a display unit when a signal indicating start is input.

In addition, an image processing method according to another aspect of the present invention is an image processing method in a capture mode in an image processing apparatus including an image sensor, an image signal processing module, a multimedia application processing module, and a display unit. Processing at the processing module a captured image captured by the image sensor according to a preset storage image data format; (b) processing the captured image according to a format of a display unit in an image signal processing module; (c) in the video signal processing module, alternately outputting the video data processed in the step (a) and the video data processed in the step (b) by a predetermined unit to the multimedia application processing module; (d) The multimedia application processing module stores the image data processed in the step (a), received from the image signal processing module, in the storage image storage area, and displays the image data processed in the step (b), the display image storage area. Storing in; And (e) displaying, by the multimedia application processing module, the image data stored in the display image storage area on the display unit when a signal indicating the start of the next frame is input.

Still another technical problem of the present invention can be achieved by a computer-readable recording medium in which the image processing method according to the present invention is programmed and recorded.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the specification and claims should not be construed as having a conventional or dictionary meaning, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention. Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

The image processing apparatus according to the present invention is used in combination with various digital image photographing apparatuses. Here, the digital image photographing apparatus includes a digital camera, a digital camcorder, a mobile phone equipped with a digital camera, a PDA, a personal multimedia player, and the like, and acquires an image of a subject according to a user's shutter operation, converts the image into a digital image, and stores the image. Refers to a device that performs a function of storing in a medium.

1 is a block diagram of an image processing apparatus according to a preferred embodiment of the present invention.

Referring to FIG. 1, the image processing apparatus according to the present embodiment includes an image sensor 100, an image signal processing module 200, a multimedia application processing module 300, a storage medium 400, and a display unit 500. do.

The image sensor 100 captures an image of an object and outputs an analog raw image signal to the image signal processing module 200. Preferably, the image sensor 100 is an imaging device configured of a Charge Coupled Device (CCD) or a Complementary Metal-Oxide Semiconductor (CMOS). However, the present invention is not limited by the type of the image sensor 100.

The image signal processing module 200 receives an analog raw image signal output from the image sensor 100, converts the analog raw image signal into a digital image signal, and processes the image signal according to the present invention to output to the multimedia application processing module 300. Specifically, the image signal processing module 200 of the present embodiment, as shown in FIG. 2, includes a preprocessor 210, an original image processor 220, a display image processor 230, and an image outputter 240. do.

The preprocessor 210 converts the analog raw video signal into a digital video signal, converts color coordinate systems such as YUV and RGB as necessary, and performs normal video signal processing such as color correction, gamma correction, and noise removal. Here, the preprocessing refers to a process performed before the stored image processing and the display image processing according to the present invention to be described later, and the processing performed by the preprocessing unit 210 is not directly related to the features of the present invention. Since the preprocessing is known to those skilled in the art as a process by a conventional video signal processing module well known as an ISP (Image Signal Processor) in the technical field to which the present invention belongs, the detailed description thereof will be omitted.

The original image processing unit 220 is a general image to be stored in the storage medium 400 by the multimedia application processing module 300, which will be described later by the image sensor 100 and the captured image preprocessed by the preprocessor 210. Function block that processes data according to its format.

In detail, the original image processor 220 includes a stored image scaler 221. The stored image scaler 221 scales the captured image preprocessed by the preprocessor 210 according to a resolution standard (eg, 640 * 480, etc.) preset by the user or defaulted by the image capturing apparatus.

In addition, the original image processing unit 220 may include a JPEG encoder 223 as an encoding unit that compresses and encodes the captured image scaled by the storage image scaler 221. That is, the JPEG encoder 223 is provided inside the video signal processing module 200 without providing the inside of the multimedia application processing module 300, thereby storing image data for storage to be stored in the storage medium 400. By compressing at 200, the data is sent to the multimedia application processing module 300 to reduce the data rate to stabilize data interfacing between the image signal processing module 200 and the multimedia application processing module 300. On the other hand, in the present embodiment, although the encoding unit is shown and described as compression encoding according to the JPEG standard, the present invention is not limited to the JPEG encoding scheme.

In addition, the original image processor 220 includes a storage image buffer 225 that temporarily stores the encoded image data.

The display image processing unit 230 is a format of the image data to be displayed on the display unit 500 by the multimedia application processing module 300 which will be described later captured image captured by the image sensor 100 and preprocessed by the preprocessor 210. This is a function block for processing.

In detail, the display image processor 230 includes a display image scaler 231 and a display image buffer 233. The display image scaler 231 scales the captured image preprocessed by the preprocessor 210 according to the size of the display unit (eg, 320 * 240) implemented by the viewfinder of the image capturing apparatus. The display image buffer 233 temporarily stores the image data scaled by the display image scaler 231.

The storage image buffer 225 and the display image buffer 233 are each smaller than the total size of the storage image data and the display image data, and are large enough to store the amount of data to be output at one time. The storage image buffer 225 and the display image buffer 233 have a first in first out (FIFO) structure.

Although not shown, the display image processor 230 may further include an encoder (eg, a JPEG encoder) that compressively encodes the image scaled by the display image scaler 231. In this case, in addition to the above-described storage image data, the display image data is also compressed and sent to the multimedia application processing module 300, thereby further interfacing data between the image signal processing module 200 and the multimedia application processing module 300. It can be stabilized.

The image output unit 240 stores the storage image data compression-coded by the JPEG encoder 223 of the original image processing unit 220 and the scaled (or compressed-coded) display by the display image scaler 231. Image data for output to the multimedia application processing module 300. In this case, the method of outputting the storage image data and the display image data can be various. In the present embodiment, the interleaving method, that is, outputted alternately by a predetermined unit, will be described in detail later.

The multimedia application processing module 300 receives the storage image data and the display image data of a predetermined unit from the image signal processing module 200 (actually, the image output unit 240), and the storage image data is stored image. The display image data is stored in the storage area and the display image data is stored in the display image storage area. The storage image storage area and the display image storage area may be provided in the multimedia application processing module 300 or in the storage medium 400 such as SDRAM.

In addition, the multimedia application processing module 300 displays the display image data accumulated in the display image storage area on the display unit 500 including, for example, an LCD module when the captured image data corresponds to one captured image.

3 is a flowchart illustrating an image processing process according to a preferred embodiment of the present invention, and FIG. 4 is a timing diagram illustrating a process of transmitting image data according to a preferred embodiment of the present invention. Referring to these drawings, the image processing method of the present invention will be described in detail as follows.

Commercially available digital video recording devices, unlike traditional cameras, support a preview function that previews objects to be included in the captured video through the viewfinder. In other words, when the user turns on the digital image capturing apparatus (or operates in the camera mode) for capturing, the user enters the preview mode and the image of the subject is displayed through the viewfinder as a moving image that changes at short frame intervals. Then, when the user operates the shutter when the desired image is captured, the user enters a capture mode to capture a digital still image of the subject. The present invention relates to the operation in the capture mode, in which only the preview image is processed as the display image and displayed on the display unit. In FIG. 4, VSYNC is a vertical synchronization signal indicating the start of each frame, and in the preview mode, the image signal processing module 200 and the multimedia application processing module 300 process the preview image implemented in each frame image in synchronization with the VSYNC. Will be displayed.

In the preview mode, the image captured by the image sensor 100 or the image data processed by the image signal processing module 200 may be an image having the maximum size (resolution) supported by the image sensor 100 or the photographing apparatus. As the photographing apparatus becomes high pixel, a lot of time is required for processing the preview image. In order to solve this problem, there is a method of widening the frame interval, but since it does not become a natural video, it is common to operate at a low resolution even if the image quality is somewhat deteriorated. On the other hand, the image captured in the capture mode is the image of the maximum size supported by the image sensor 100 or the image capturing device or the size of the image preset by the user. In addition, in the capture mode, the flash may operate or the exposure time may be different. As a result, the image displayed in the preview mode and the image captured in the capture mode may be different.

When the user enters the capture mode by operating the shutter, the image sensor 100 captures an image of a subject at a predetermined resolution and outputs an analog raw image signal to the image signal processing module 200 (S10). The image signal processing module 200 then processes the analog raw image, in particular a slight time delay in preprocessing and buffering until encoding is started by the JPEG encoder 223 and until the encoded storage image data is output. This inevitably occurs. Accordingly, the multimedia application processing module 300 may not receive the storage image data and the display image data before the next vertical synchronization signal that operates in synchronization with the multimedia application processing module 300, and may discard one frame. Accordingly, when the image is captured, the VSYNC signal is delayed by the delay time d to synchronize the image signal processing module 200 and the multimedia application processing module 300 with the changed VSYNC.

Subsequently, the preprocessing unit 210 of the image signal processing module 200 receives an analog raw image signal output from the image sensor 100 and performs tactics such as analog-to-digital conversion, color coordinate system conversion, color correction, gamma correction, and noise removal. A series of preprocessing is performed (S20).

The image data preprocessed by the preprocessor 210 is input to the stored image scaler 221 of the original image processor 220 and the display image scaler 231 of the display image processor 230. Then, the display image scaler 231 scales the captured image preprocessed by the preprocessor 210 according to the size (eg, 320 * 240) of the display unit of the image capturing apparatus (S30) and the display image buffer 233. The scaled image data is temporarily stored.

Meanwhile, the stored image scaler 221 scales the captured image preprocessed by the preprocessor 210 according to a resolution standard (for example, 640 * 480, etc.) preset by the user or defaulted by the image capturing apparatus (eg, 640 * 480). S40). Subsequently, the captured image scaled by the stored image scaler 221 is encoded by the JPEG encoder 223 (S50), and the encoded storage image is temporarily stored in the stored image buffer 225.

Subsequently, the image output unit 240 is compressed and encoded by the JPEG encoder 223 and stored in the storage image buffer 225, and is stored in the storage image buffer 225, and scaled by the display image scaler 231 to the display image buffer 233. The stored display image data is output to the multimedia application processing module 300. In this case, the storage image data and the display image data can be output in various ways. In the present embodiment, the interleaving methods are alternately outputted in predetermined units.

The output of the interleaving method may be implemented by alternately occupying the output bus of the image output unit 240 by the storage image buffer 225 and the display image buffer 233. Specifically, if any one of the storage image buffer 225 and the display image buffer 233 is filled with a predetermined threshold amount of image data, the buffer occupies the output bus. The buffer then releases the output bus after sending some data. Such an operation is alternately performed between the storage image buffer 225 and the display image buffer 233, and the image data for storage and the image data for display are alternately output to the multimedia application processing module 300 (S60). ).

Here, the 'shift' transmission in the strict sense may not be followed. For example, depending on the size of the buffer or the size of the image data, the speed at which one buffer is filled may be much slower than the speed at which the other buffer is filled. The buffer can then skip one transfer.

On the other hand, it is preferable that each buffer first sends a header including information indicating the type of the image data, whether the image data is storage image data or display image data, before the image data is loaded on the output bus.

The multimedia application processing module 300 which receives the image data for storage and the image data for display by the predetermined unit from the image output unit 240 alternately stores the image data for storage in the storage image storage area and displays the image for display. The image data is stored in the display image storage area. Whether the image data from the image output unit 240 is storage image data or display image data can be known by referring to the above-described header.

This series of operations continues until the vertical synchronizing signal VSYNC indicating the start of the next frame is input (S80), and when the next vertical synchronizing signal VSYNC _{k +1} is input, the display image data accumulated in the display image storage area so far. Is displayed on the display unit 500 (S90).

In addition, the video signal processing module 200, when the storage video data and the display video data output by the video output unit 240 exceeds one frame period, the vertical synchronization signal VSYNC _{k +} indicating the start of the next frame. You can also skip ₁ or have a delay such as VSYNC ^' _{k +1} . In this case, dummy data may be added to the next vertical sync signal VSYNC _{k +2} or the delayed vertical sync signal VSYNC ^' _{k +1} from the end of the output image data.

Meanwhile, as described above, the display image processor 230 may further include an encoder (eg, a JPEG encoder) that compressively encodes the image scaled by the display image scaler 231 to compressively encode the display image data. . In this case, data interfacing between the image signal processing module 200 and the multimedia application processing module 300 may be further stabilized. However, since the multimedia application processing module 300 needs to decode and display the compressed and encoded display image data on the display unit 500, it takes more time than the display of the uncompressed display image data. Since the size is much smaller than the normal storage image, the decoding time is short, so the time delay felt by the user is not so much a problem.

The above description is about a process of capturing and displaying one still image, but the present invention can be very usefully applied to a continuous capture mode, that is, a mode of capturing a plurality of images continuously at short time intervals. Referring to Figure 5 described in detail as follows.

First, the capture from one capture image to the display on the display unit is the same as described with reference to steps S10 to S90 of FIG. 3. In the continuous capture mode, in addition to this, it further includes the following steps S100 to S130.

When the processing of one captured image is finished, it is determined whether the continuous capturing is completed, that is, whether the predetermined number of image capturings have been performed (S100). As a result, if the continuous capture has not been completed yet, the display step S90 of the display image data is repeated in the image capture step S10. That is, by immediately displaying the captured image on the display unit 500 for each captured image, the user can immediately check the captured image.

On the other hand, when all the continuous capture is finished, all display image data of the continuously captured image stored in the display image storage area is read (S110).

The display image data thus read is first down scaled to an appropriate size to display a plurality of images on one screen, and then displayed on one screen of the display unit 500 for user selection (S120).

Then, the user selects the capture image that he / she likes most, and the storage image data corresponding thereto is finally stored in the storage medium (S130).

<Simulation example>

Hereinafter, in order to confirm the effect of the present invention, in the case where only the image data obtained by compressing and encoding the captured image in the image signal processing module according to the conventional method is sent to the multimedia application processing module, an example of simulating the time taken until the display of the captured image will be described. Do it.

In this example, the image sensor uses a 3 million pixel scale and simulates the time until the captured image is decoded and encoded according to the JPEG standard under the following conditions and then the captured image is output to the display unit.

Advanced RISC Machine (ARM) speed: 200 MHz

Cache size: 16KB each of data and code cache RAM size

Bus speed: 100 MHz

Raw file size before 3 million pixels compression: 3M pixels x 2 = 6MBytes (YCbCr 4: 2: 2 requires 2 bytes per pixel)

File size after 3 million pixels compression: Compression rate varies from image to image but typically between 1/4 and 1/8 compression rate, approximately 0.75 Mbytes to 1.5 MBytes.

In these systems, the JPEG file decoding time was found to be at least 600ms. That is, in the conventional method, it takes more than 600 ms to restore a 3 million pixel compressed image to the display unit, and thus, the total capture time felt by the user is very unsatisfactory. On the other hand, in the present invention, since the display image data processed according to the format of the display unit by the display image processing unit is displayed on the display unit as it is, no additional time is required for displaying the captured image, thereby enabling rapid display.

The image processing method according to the present invention described above may be embodied as computer readable codes on a computer readable recording medium. Computer-readable recording media include all types of recording devices that store data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may also be implemented in the form of a carrier wave (for example, transmission over the Internet). Include. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. In addition, functional programs, codes, and code segments for implementing the image processing method may be easily inferred by programmers in the art.

As described above, although the present invention has been described by way of limited embodiments and drawings, the present invention is not limited thereto and is intended by those skilled in the art to which the present invention pertains. Of course, various modifications and variations are possible within the scope of equivalents of the claims to be described.

According to the present invention, the image signal processing module alternately outputs not only the image data for storing the captured image but also the display image data to the multimedia application processing module by a predetermined unit, so that the multimedia application processing module outputs the image data for storage to the memory. In addition to storing, the display image data is displayed on the display unit. Since the image data for display is already processed by the video signal processing module in accordance with the format of the display unit, and especially its size is very small even if no separate compression encoding is performed, the multimedia application processing module is adapted to display the captured image on the display unit. If no separate decoding is required or necessary, it can be decoded in a short time. Therefore, the display of the captured image is performed immediately without time delay. In addition, according to the present invention, in particular, since the captured images are displayed immediately in the continuous capture mode, it is possible to quickly check and select the image by the user.

Claims (13)

An original image processor configured to process the captured image captured by the image sensor according to a preset image data format for storage; A display image processor configured to process the captured image according to a format of the display unit; And an image output unit configured to alternately output image data processed by the original image processing unit and image data processed by the display image processing unit by a predetermined unit. And The image data processed by the original image processor and the image data processed by the display image processor are respectively output from the image output unit in a stored image storage area and a display image storage area, and the next frame starts. And a multimedia application processing module configured to display, on a display unit, image data stored in the display image storage area when a signal indicating is input. The method of claim 1, The original image processing unit may further include: a storage image scaler for scaling the captured image to a size of a preset storage image data, an encoding unit compressing and encoding a captured image scaled by the storage image scaler, and encoding by the encoding unit. And a storage image buffer for temporarily storing the captured image data. The method of claim 1, And the display image processing unit comprises a display image scaler for scaling the captured image according to the size of the display unit, and a display image buffer for temporarily storing image data scaled by the display image scaler. The method of claim 1, In the continuous capture mode in which the capturing operation by the image sensor is continuously performed, the multimedia application processing module reads out all the images continuously stored in the display image storage area when the continuous capturing by the continuous capture mode is completed. And down-scaling to display all the images on one screen of the display unit. The method of claim 1, And the video signal processing module skips or delays the vertical synchronization signal indicating the start of the next frame when the video data output by the video output unit exceeds one frame period. An image processing method in a capture mode in an image processing apparatus including an image sensor, an image signal processing module, a multimedia application processing module, and a display unit, (a) processing the captured image captured by the image sensor in accordance with a preset storage image data format in the image signal processing module; (b) processing the captured image according to a format of the display unit in the image signal processing module; (c) in the video signal processing module, alternately outputting the video data processed in the step (a) and the video data processed in the step (b) to the multimedia application processing module by a predetermined unit; (d) the multimedia application processing module stores the image data processed in step (a), received from the image signal processing module, in a storage image storage area, and displays the image data processed in step (b). Storing in a storage area; And and (e) displaying, by the multimedia application processing module, image data stored in the display image storage area on the display unit when a signal indicating the start of a next frame is input. According to claim 6, wherein step (a), (a1) scaling the captured image to a size of preset image data for storage; (a2) an encoding step of compression encoding the captured image scaled in the step (a1); And (a3) temporarily storing the captured image encoded in the step (a2) in a storage image buffer. The method of claim 7, wherein step (b), (b1) scaling the captured image to a size of the display unit; and (b2) temporarily storing the captured image scaled in the step (b1) in a display image buffer. The method of claim 8, The step (c) is performed by occupying an output bus for a time to send the image data of the predetermined unit to a buffer in which the predetermined image data of the stored image buffer and the display image buffer are filled first. Image processing method characterized in that. The method of claim 9, The buffer occupying the output bus first sends a header including information indicating the type of video data to be sent through the output bus, And the multimedia application processing module detects information indicating the type of the image data included in the header, and stores the image data in an image storage area corresponding to the type of the image data. The method of claim 6, When the capture mode is the continuous capture mode, the multimedia application processing module reads and scales down all images continuously stored in the display image storage area when the continuous capture by the continuous capture mode is completed, and then displays the scaled portion. All of the image processing method characterized in that displayed on one screen. The method of claim 6, And (c) skipping or delaying the vertical synchronization signal indicating the start of the next frame when the image data output in step (c) exceeds one frame period. A computer-readable recording medium having recorded thereon a program according to any one of claims 6 to 12.

Images