JP2005333349A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus which reduces a cost and can display a reduced image of a photographing image at early timing immediately after photographing. <P>SOLUTION: A first control means (sub-CPU 214) controls the switching timing of a switching means (switching unit 209) based on the status transition of the storage operation of a compressed image data memory (JPEG image memory 207) and the state transition of a storage operation to a reduced image data memory (reduced image memory 208). Thus, the compressed image data (JPEG image data) and the contracted image data (contracted image data) are switched and outputted to a body unit. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging apparatus that images a subject and outputs image data.

  In recent years, imaging devices such as digital cameras have rapidly become widespread with higher functionality and lower prices. Since the digital camera can obtain a captured image as digital image data, the captured image can be displayed on a display monitor of the digital camera or recorded on a recording medium such as a memory card. In such a digital camera, after shooting, image data is recorded on a recording medium and a reduced image of the image data is displayed on a display monitor, and the user confirms the shooting result by viewing the reduced image. Can do. 2. Description of the Related Art Conventionally, there has been proposed an apparatus capable of improving the display time lag of a quick view image by outputting a quick view image displayed after imaging before the recording image data is completed (for example, Patent Document 1). reference).

  The imaging apparatus as described above is roughly divided into a camera module that images a subject and outputs image data, and an imaging apparatus main body (hereinafter referred to as a main body unit) that records and displays the output image data. A configuration in which image compression for compressing image data into a JPEG (Joint Photographic Expert Group) image and the like and generation of a reduced image of the image data is performed on the camera module side is considered. In such a configuration that performs image compression and generation of reduced image data on the camera module side and outputs to the main body side, when displaying a reduced image of the captured image on the display monitor on the main body side immediately after shooting, The following three methods are conceivable.

(1) After outputting a JPEG image of a captured image from the camera module to the main body, the camera module outputs a reduced image of the captured image to the main unit, and the main unit displays the output reduced image on the display monitor. .
(2) Output a reduced image of the captured image from the camera module to the main unit. The main unit displays the output reduced image on the display monitor, and then outputs a JPEG image of the captured image from the camera module to the main unit. To do. Note that the output method of the reduced image corresponds to the display method of Patent Document 1 described above.
(3) Only the JPEG image of the photographed image is output from the camera module to the main unit, and the main unit expands the output JPEG image, generates a reduced image from the expanded image data, and displays it on the display monitor. .
JP 2003-198914 A

  However, in the above method (1), since the reduced image cannot be confirmed on the display monitor until the reduced image is output to the main unit after the JPEG image is output from the camera module, the reduced image is displayed. In the meantime, there is a possibility that a time lag may occur, and there is a problem that confirmation of the photographing result cannot be performed quickly. Also, until the JPEG image output is completed in the camera module, a memory that can store the reduced image is necessary, which may increase the cost.

  In the method (2), since the reduced image is output from the camera module to the main unit first, it is possible to display the reduced image immediately after shooting. However, until the output of the reduced image is completed, the JPEG image is not displayed. Since the camera module requires a relatively large capacity of memory that can be stored, the cost may increase.

  In the method (3), after the JPEG image is output from the camera module to the main unit after shooting, the reduced image is confirmed on the display monitor until the JPEG image is expanded and the reduced image is generated on the main unit. Therefore, there is a possibility that a time lag may occur, and there is a problem that it is not possible to smoothly check the photographing result. Further, since the main unit needs a function for generating JPEG decompression and reduced images, the cost may increase.

  An object of the present invention is to provide an imaging apparatus capable of reducing cost and displaying a reduced image of a captured image at an early timing immediately after imaging.

In order to solve the above problem, the invention according to claim 1 is:
A camera module including a first control unit that processes captured image data acquired by the built-in imaging unit, and a second control unit that processes the image data output from the camera module and displays the image data on the display unit. In an imaging device comprising a main unit,
The camera module includes a compression unit that compresses the captured image data, a compressed image data memory that stores the compressed image data compressed by the compression unit, and a reduced image generation unit that generates a reduced image of the captured image data. Selecting a reduced image data memory for storing reduced image data generated by the reduced image generation means, a compressed image data output from the compressed image data memory, and a reduced image data output from the reduced image data memory Switching means for automatically switching and outputting,
The first control means controls the switching timing of the switching means based on the state transition of the storage operation of the compressed image data memory and the state transition of the storage operation of the reduced image data memory, whereby the compressed image data And the reduced image data are switched and output to the main unit.

  Here, “compressed image data” means image processing such as JPEG image compression and JPEG2000 image compression, and “reduced image data” means data obtained by reducing the image size, such as thumbnail images and screen nail images. Means. Further, “the state transition of the storage operation” means, for example, a state in which the storage capacity of the compressed image data memory or the reduced image data memory is almost full.

The invention according to claim 2 is the invention according to claim 1,
Whenever the remaining storage capacity of the compressed image data memory or the reduced image data memory reaches a predetermined value, the first control means stores the image data stored in the image data memory that has reached the predetermined value. The switching timing of the switching means is controlled and output to the main unit.

The invention according to claim 3 is the invention according to claim 1 or 2,
Prior to controlling the switching timing of the switching means, the first control means determines whether the image data memory storing the image data output by the switching timing control is the compressed image data memory or the reduced image data memory. Identification information for identification is output to the main unit.

The invention according to claim 4 is the invention according to claim 3,
The second control means displays the compressed image data and the reduced image data on the display means based on the output identification information.

  According to the first aspect of the present invention, the first control means sets the switching timing of the switching means based on the state transition of the storage operation in the compressed image data memory and the state transition of the storage operation in the reduced image data memory. By controlling, compressed image data and reduced image data are switched and output to the main unit. With such a configuration, the processed image data and the reduced image data can be output efficiently, so that the time lag until the reduced image is displayed can be improved. Therefore, the reduced image data can be displayed at an early timing immediately after shooting. In addition, since the storage capacities of the processed image storage unit and the reduced image storage unit can be reduced, the cost can be reduced.

  According to the second aspect of the present invention, the first control means, when the remaining storage capacity of the compressed image data memory or the reduced image data memory reaches a predetermined value, the image data that has reached the predetermined value. The image data stored in the memory is output to the main unit by controlling the switching timing of the switching means. With such a configuration, the processed image data and the reduced image data can be output efficiently, so that the time lag until the reduced image is displayed can be improved. Therefore, the reduced image data can be displayed at an early timing immediately after shooting. In addition, since the storage capacities of the processed image storage unit and the reduced image storage unit can be reduced, the cost can be reduced.

  According to the third aspect of the present invention, prior to the control of the switching unit, the image storage unit storing the data output by the switching control is used to identify whether the image storage unit is the processed image storage unit or the reduced image storage unit. The identification information is output to the storage control means. With this configuration, it is possible to determine whether the data output in accordance with the control of the switching unit is processed image data or reduced image data based on the identification information.

  According to the invention described in claim 4, the second control means causes the display means to display the compressed image data and the reduced image data based on the identification information output from the camera module. By adopting such a configuration, it is possible to display the processed image data and the reduced image data that are output efficiently, so that the time lag until the reduced image is displayed can be improved.

  Hereinafter, an example in which the imaging apparatus of the present invention is applied to a mobile phone 10 with an imaging apparatus will be described in detail with reference to FIGS.

  FIG. 1 shows a functional configuration of the mobile phone 10. As shown in FIG. 1, a mobile phone 10 includes a main CPU (Central Processing Unit) 11, a display unit 12, an input unit 13, a RAM (Random Access Memory) 14, a communication control unit 15, a storage unit 16, a voice input / output unit. 17, a power supply unit 18, a camera module 20, and the like. Each unit is connected by a bus 19. Here, the camera module 20 is the camera module described in the claims, and the mobile phone 10 excluding the camera module 20 is the main unit described in the claims.

  The main CPU 11 reads a system program stored in the storage unit 16 and develops it in a work memory formed in the RAM 14, and controls each unit according to the system program. Further, the main CPU 11 reads out various processing programs and application programs such as mail software stored in the storage unit 16, develops them in the work memory, executes various processes, and stores the processing results in the work memory in the RAM 14. The information is stored and displayed on the display unit 12. Then, the processing result stored in the work memory is stored in a specified storage destination in the storage unit 16.

  When the main CPU 11 receives the JPEG image data and reduced image data output from the camera module 20 via the image output I / F 210, the main CPU 11 stores the JPEG image data and reduced image data in the storage unit 16. Here, the storage of the JPEG image data and the reduced image data is performed based on the identification information output from the camera module 20 prior to the output of the JPEG image data and the reduced image data.

  Further, the main CPU 11 performs control to display the JPEG image data and the reduced image data stored in the storage unit 16 on the display unit 12.

  The display unit 12 is configured by an LCD (Liquid Crystal Display) panel or the like, and performs screen display based on display data input from the main CPU 11.

  The input unit 13 includes a cursor key, character / number keys, various function keys, and the like, and outputs a press signal by the key operation to the main CPU 11.

  The RAM 14 forms a work area that temporarily stores various programs, data being processed, processing results, and the like as a buffer.

  The communication control unit 15 includes a wireless communication unit including an antenna (not shown), and transmits / receives various information to / from each device on the communication network N via the wireless base station in accordance with an instruction input from the main CPU 11.

  The storage unit 16 includes a nonvolatile memory such as a flash memory, and the like, a system program corresponding to the mobile phone 10, various processing programs that can be executed on the system program, application programs, data processed by these programs, and the like Record.

  The voice input / output unit 17 includes a microphone, a speaker, an amplifier, an A / D conversion unit, a D / A conversion unit, and the like, converts a user's voice signal input from the microphone into digital voice information, and the voice information. To the main CPU 11, and voice information input from the main CPU 11 during reception, voice information such as a ring tone and operation confirmation sound is converted into an analog voice signal, amplified, and output from a speaker.

  The power supply unit 18 includes a power supply circuit, a rechargeable battery, and the like, and supplies power to each functional unit of the mobile phone 10 based on an instruction input from the main CPU 11.

  As shown in FIG. 2, the camera module 20 includes an optical lens 201, a CCD (Charge Coupled Diode) 202, an A / D circuit 203, a signal processing circuit 204, a JPEG image generation unit 205, a reduced image generation unit 206, and a JPEG image memory. 207, reduced image memory 208, switching unit 209, image output I / F 210, actuator 211, storage unit 212, power supply circuit 213, sub CPU 214, serial communication I / F 215, and the like.

  The optical lens 201 is made of glass or plastic and forms an optical image of a subject. The CCD 202 converts the optical image signal imaged on the light receiving surface by the optical lens 201 into analog image data. In this embodiment, the CCD is used. However, the present invention is not limited to this, and a CMOS (Complementary Metal Oxide Semiconductor) sensor or the like may be used.

  The A / D circuit 203 converts the analog image data output from the CCD 202 into digital image data and outputs it to the signal processing circuit 204. The signal processing circuit 204 performs, for example, conversion to YUV data, gamma correction, white balance correction, and the like on the image data output from the A / D circuit 203 to obtain JPEG image generation unit 205 and captured image data. The image is output to the reduced image generation unit 206.

  The JPEG image generation unit 205 performs compression processing on the captured image data output from the signal processing circuit 204 using a compression method compliant with the JPEG method, and sequentially outputs the generated JPEG image data to the JPEG image memory 207.

  The reduced image generation unit 206 generates reduced image data such as thumbnail images from the captured image data output from the signal processing circuit 204, and sequentially outputs the generated reduced image data to the reduced image memory 208.

  The JPEG image memory 207 is a FIFO (First In, First Out) memory, and functions as a buffer that temporarily stores JPEG image data output from the JPEG image generation unit 205.

  The reduced image memory 208 is a FIFO memory, and functions as a buffer that temporarily stores reduced image data output from the reduced image generation unit 206.

  The switching unit 209 selectively switches between output of JPEG image data stored in the JPEG image memory 207 and output of reduced image data stored in the reduced image memory 208 based on the control of the sub CPU 214. Switching is performed so that only one data is output to the image output I / F 210.

  The image output I / F 210 is an interface for outputting JPEG image data and reduced image data to the main CPU 11, and is connected to the main CPU 11 by a high-speed bus in one direction.

  The actuator 211 has an actuator drive circuit (not shown), and drives, for example, zooming by movement of the optical lens 201 and opening / closing of a lens barrier (not shown) of the optical lens 201 in accordance with control of the sub CPU 214. Do.

  The storage unit 212 includes a nonvolatile memory such as a flash memory, and stores program codes and control parameters necessary for controlling each unit of the camera module 20.

  The power supply circuit 213 adjusts the voltage of the power supplied from the power supply unit 18 shown in FIG. 1 and supplies power to each part of the camera module 20 according to the control of the sub CPU 214.

  The sub CPU 214 comprehensively controls each unit of the camera module 20 in accordance with the program code stored in the storage unit 212, and based on a control signal output from the main CPU 11 via the serial communication I / F 215, the sub CPU 214 Control each part.

  Further, the sub CPU 214 outputs the data stored in the image memory of either the JPEG image memory 207 or the reduced image memory 208 based on the state transition of the storage operation of the JPEG image memory 207 and the reduced image memory 208. The switching timing of the switching unit 209 is controlled.

  Specifically, every time the remaining storage capacity of the JPEG image memory 207 or the reduced image memory 208 reaches a predetermined value, the switching unit 209 outputs the data stored in the image memory that has reached the predetermined value. Control to switch.

  Here, the “remaining storage capacity is a predetermined value” is, for example, a value such that the remaining storage capacity reaches 10% of the total storage capacity, and the threshold is set based on the storage capacity of each image memory. It is preferable to set, and it is more preferable to set an optimum threshold based on the processing capability of the JPEG image generation unit 205 and the reduced image generation unit 206.

  The sub CPU 214 determines whether the image memory that has reached the predetermined value when the remaining storage capacity of the JPEG image memory 207 or the reduced image memory 208 reaches a predetermined value is the JPEG image memory 207 or the reduced image memory 208. The identification information for identifying is output to the main CPU 11 via the image output I / F 210 prior to the switching timing control of the switching unit 209.

  The serial communication I / F 215 is a serial communication interface for connecting the sub CPU 214 and the main CPU 11, and outputs a control signal input from the main CPU 11 to the sub CPU 214 and various signals input from the sub CPU 214. Is output to the main CPU 11.

Next, the operation of the present embodiment will be described with reference to the flowchart of FIG.
FIG. 3 is a flowchart showing a flow of processing when JPEG image data and reduced image data are output from the camera module 20 in the mobile phone 10. Note that each process described in the following flowchart is performed under the control of the sub CPU 214.

  As a premise of this processing, a release operation for photographing a subject is performed from the user via the input unit 13, and based on this operation, control is performed to perform imaging from the main CPU 11 to the sub CPU 214 via the serial communication I / F 215. Assume that a signal is output.

  First, upon receiving a control signal for imaging from the main CPU 11, analog image data captured by the CCD 202 through the optical lens 201 is converted into digital image data by the A / D circuit 203, and gamma correction is performed on this image data. Processing such as white balance correction is performed by the signal processing circuit 204, and the processed captured image data is output to the JPEG image generation unit 205 and the reduced image generation unit 206 (step S11).

  Next, the photographed image data output to the JPEG image generation unit 205 is compressed by a compression method compliant with the JPEG method to generate JPEG image data, which is sequentially stored in the JPEG image memory 207 and at the same time the reduced image generation unit 206. The reduced image data of the photographed image data output to is generated and sequentially stored in the reduced image memory 208 (step S12).

  JPEG image data and reduced image data are sequentially stored until the remaining storage capacity of the JPEG image memory 207 or the reduced image memory 208 reaches a predetermined value. When one of the remaining storage capacity reaches a predetermined value ( In step S13; Yes, identification information for identifying the image memory on the side that has reached the predetermined value is output from the sub CPU 214 to the main CPU 11 via the image output I / F 210 (step S14). For example, when the remaining storage capacity of the reduced image memory 208 reaches a predetermined value, identification information that can be identified from the reduced image memory 208 is output to the main CPU 11.

  In step S13, when the remaining storage capacity does not change, that is, the generation of JPEG image data by the JPEG image generation unit 205 is completed or the generation of reduced image data by the reduced image generation unit 206 is completed. In such a case, control for switching the switching unit 209 is performed so that the output is output to the image output I / F 210 even if the remaining storage capacity does not reach a predetermined value.

  After the identification information is output in step S14, the switching unit 209 outputs the JPEG image data or the reduced image data (hereinafter simply referred to as data) stored in the image memory that has reached the predetermined value. And the corresponding data is output to the image output I / F 210 (step S15) and output to the main CPU 11. For example, when the remaining storage capacity of the reduced image memory 208 reaches a predetermined value, the switching timing of the switching unit 209 is controlled so that reduced image data stored in the reduced image memory 208 is output, and the reduced image data Will be output.

  Next, it is determined whether or not the output of JPEG image data and reduced image data has been completed. If the output of both image data has not been completed (step S16; No), the process returns to step S13 again. Note that the data output in step S15 is continuously output until it is determined in step S13 that the remaining storage capacity of one of the image memory and the reduced image memory has reached a predetermined value.

  On the other hand, if it is determined in step S16 that the output of both image data has been completed (step S16; Yes), this process ends.

  FIG. 4 is a diagram schematically showing a time chart of JPEG image data and reduced image data output by the above processing. Here, the passage of time is shown from the upper left end to the right end and then from the lower left end to the right end.

  As shown in FIG. 4, before the reduced image data and the JPEG image data are output, identification information for identifying the image memory storing the respective data is transmitted, and the reduced image data and the JPEG image data are alternately displayed. It is in the form that is output. In general, since the data capacity of the reduced image data is smaller than that of the JPEG image data, the output of the reduced image data ends first, and thereafter, the JPEG image data is output.

  Next, referring to the flowchart of FIG. 5, the JPEG image data and the reduced image data output from the camera module in the process of FIG. 3 are stored in the storage unit 16, and the reduced image data is displayed on the display unit 12. The flow of the process up to is shown. Each process described in the following flowchart is performed by the main CPU 11.

  First, it waits until the identification information and data output from the camera module 20 via the image output I / F 210 are input (step S21; No), and when the identification information and data are input (step S21; Yes). It is determined whether the input identification information indicates the JPEG image memory 207 or the reduced image memory 208 (step S22). It is assumed that the identification information is output from the camera module 20 prior to the data.

  In step S22, if the reduced image memory 208 is indicated (step S22; reduction), it is determined that the data input following this identification information is reduced image data, and the storage unit 16 stores the reduced image data as reduced image data. (Step S23).

  Next, it is determined whether or not reduced image data for one image has been stored (step S24). Here, the reduced image data for one image means reduced image data for one image generated by the reduced image generation unit 206 of the camera module 20, and the reduced image memory 208 has a storage capacity for one image. In such a case, the reduced image data is divided and input, so this determination is necessary.

  If it is determined in step S24 that reduced image data for one image has not been stored (step S24; No), the process returns to step S21 again. On the other hand, if it is determined in step S24 that reduced image data for one image has been stored (step S24; Yes), the reduced image data is displayed on the display unit 12 (step S25), and the process proceeds to step S27.

  On the other hand, when the JPEG image memory 207 is indicated in step S22 (step S22; JPEG), it is determined that the data input subsequent to the identification information is JPEG image data, and the storage unit 16 stores the data as JPEG image data. (Step S26), the process proceeds to step S27.

  In step S27, it is determined whether or not storage of JPEG image data for one image has been completed. Here, JPEG image data for one image means JPEG image data for one image generated by the JPEG image generation unit 205 of the camera module 20, and the JPEG image memory 207 has a storage capacity for one image. In such a case, the JPEG image data is divided and input, so this determination is necessary.

  If it is determined in step S27 that JPEG image data for one image is not stored (step S27; No), the process returns to step S21 again. On the other hand, if it is determined in step S27 that JPEG image data for one image has been stored (step S27; Yes), the process ends.

  In general, since the data capacity of reduced image data is small compared to JPEG image data, storage of reduced image data for one image ends first, and thereafter storage of JPEG image data for one image ends. . After storing the reduced image data for one screen, the main CPU 11 displays the reduced image data on the display unit 12.

  Thus, since JPEG image data and reduced image data for one screen can be efficiently stored based on the identification information, the time lag until the reduced image data is displayed can be improved.

  As described above, each time the remaining storage capacity of the JPEG image data stored in the JPEG image memory 207 and the reduced image data stored in the reduced image memory 208 reaches a predetermined value, the switching unit 209. Since it is possible to output JPEG image data and reduced image data efficiently by controlling the output, it is possible to improve the time lag until the reduced image data is displayed. . Therefore, the reduced image data can be displayed at an early timing immediately after shooting. In addition, since the storage capacity of the storage means for storing JPEG image data and reduced image data can be reduced, the cost can be reduced.

  In the present embodiment, the switching unit 209 is selectively switched to output JPEG image data and reduced image data under the control of the sub CPU 214 that comprehensively controls each unit of the camera module 20. However, the present invention is not limited to this, and a switching control unit that executes the switching control of the switching unit 209 and the processing of steps S13 to S16 illustrated in FIG. 3 may be provided separately, and switching that performs hardware processing from the viewpoint of processing speed. More preferably, it is a control means.

  The description in the present embodiment shows an example of the imaging apparatus according to the present invention, and the present invention is not limited to this. The detailed configuration and detailed operation of the mobile phone 10 in the present embodiment can be changed as appropriate without departing from the spirit of the present invention.

  For example, the image pickup system including the image pickup apparatus of the present invention has been described using the mobile phone 10 with an image pickup apparatus.

It is a block diagram which shows the structure of a mobile telephone. It is a block diagram which shows the structure of a camera module. It is a flowchart which shows the flow of a process when JPEG image data and reduced image data are output from a camera module. It is the figure which showed typically the time chart of JPEG image data and reduced image data output from a camera module. 6 is a flowchart showing a flow of storing JPEG image data and reduced image data input to a mobile phone and displaying reduced image data.

Explanation of symbols

10 Mobile phone (imaging device)
11 Main CPU (second control means)
12 Display section (display means)
13 Input unit 14 RAM
15 Communication Control Unit 16 Storage Unit 17 Audio Input / Output Unit 18 Power Supply Unit 19 Bus 20 Camera Module (Camera Module)
201 Optical lens (photographing means)
202 CCD (photographing means)
203 A / D circuit (photographing means)
204 Signal processing circuit (imaging means)
205 JPEG image generation unit (compression means)
206 Reduced image generator (reduced image generator)
207 JPEG image memory (compressed image data memory)
208 Reduced image memory (Reduced image data memory)
209 switching unit (switching means)
210 Image output I / F
211 Actuator 212 Storage Unit 213 Power Supply Circuit 214 Sub CPU (First Control Unit)
215 Serial communication I / F

Claims (4)

A camera module including a first control unit that processes captured image data acquired by the built-in imaging unit, and a second control unit that processes the image data output from the camera module and displays the image data on the display unit. In an imaging device comprising a main unit,
The camera module includes a compression unit that compresses the captured image data, a compressed image data memory that stores the compressed image data compressed by the compression unit, and a reduced image generation unit that generates a reduced image of the captured image data. Selecting a reduced image data memory for storing reduced image data generated by the reduced image generation means, a compressed image data output from the compressed image data memory, and a reduced image data output from the reduced image data memory Switching means for automatically switching and outputting,
The first control means controls the switching timing of the switching means based on the state transition of the storage operation of the compressed image data memory and the state transition of the storage operation of the reduced image data memory, whereby the compressed image data And the reduced image data are switched and output to the main unit.   Whenever the remaining storage capacity of the compressed image data memory or the reduced image data memory reaches a predetermined value, the first control means stores the image data stored in the image data memory that has reached the predetermined value. The imaging apparatus according to claim 1, wherein a switching timing of a switching unit is controlled and output to the main unit.   Prior to controlling the switching timing of the switching means, the first control means determines whether the image data memory storing the image data output by the switching timing control is the compressed image data memory or the reduced image data memory. The imaging apparatus according to claim 1, wherein identification information for identification is output to the main unit.   The imaging apparatus according to claim 3, wherein the second control unit causes the display unit to display the compressed image data and the reduced image data based on the output identification information.

Images