JP2005150835A - Image processing apparatus, digital camera system, and digital camera - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To attain a smooth and speedy photographing operation of a camera by controlling a monitor display screen, according to a resolution of a selected monitor display destination and an operation mode of the camera. <P>SOLUTION: The display destination is either TV monitor display externally connected by video output or TFT (back panel of TV) display. At the time of TFT display, horizontal interpolation is applied by intermediate processing to reduce the amount of read data from a VRAM. At present, the reduction rate is 1/4 compared to a video output. Also, even in the case of video output, if priority is given to camera operation speed such as consecutive shot, the resolution of an image is reduced. In that case, the same processing operation as that of the TFT display mode is performed. Since the VRAM is formed in the inside of a large-capacity RAM connected to the system, a bus usage amount is reduced because of the reduction of a data amount from read data from the VRAM, and system performance increases that much. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image processing apparatus that displays on a display device image data obtained by performing image processing on an output from an imaging device or image data stored in a storage device.

  In a conventional imaging apparatus such as a digital video camera or a digital still camera, an LCD monitor provided in the digital camera body or a captured image display means for displaying a video signal output from the digital camera by connecting to a separate TV monitor It has become.

  Patent Document 1 proposes a still image reproduction apparatus that displays an image on a TV monitor or an LCD display based on digitally recorded image data.

  Specifically, for example, image data recorded as a digital signal on an IC card or the like is read, restored, and recorded in a frame memory for at least one image composed of a plurality of memories. Based on the image data read from the memory, the image is reproduced on the LCD display means or output to the outside for monitor reproduction.

  When the image is reproduced on the LCD display means, the amount of image data necessary to satisfy the resolution is smaller than that on the TV monitor, so that a plurality of frames constituting the built-in frame memory are used. To inactivate a part of the memory.

  At this time, when the image is reproduced on the LCD display means without externally outputting the image data, the frame memory is operated, for example, ¼, the power consumption is reduced to, for example, 0.6 W, and the LCD display Even including the power consumed by the means, it is about 6.5 W. Further, when the image data is output to the outside, the LCD display means is not operated, so that the power consumption is about 5.5 W. Thus, the reduction in power consumption and the miniaturization can be effectively promoted in this reproducing apparatus. become.

  Further, for example, in Patent Document 2, an LCD monitor for displaying an image is used not only for displaying an image recorded on a recording medium but also for use as a finder by displaying a captured image in real time. However, the angle of view of the live video displayed on the LCD monitor is completely the angle of view of the recorded image recorded on the recording medium. In other words, since it does not match the shooting angle of view, the problem that the shooting angle of view cannot be determined accurately can be improved, and the photographer can determine the shooting angle of view from the through video displayed on the LCD monitor. It is possible to record an image of the shooting angle of view on a recording medium when a release button is pressed.

  Specifically, in digital cameras, the aspect ratio of the LCD monitor is often different from the aspect ratio of the recorded image. In this case, the live image of the LCD monitor is recorded in the recording range (the image of the recorded image). The image in the peripheral area is cut and displayed. The problems as described above are caused by the fact that the shooting angle of view cannot be accurately confirmed in the live video.

  Therefore, in this proposal, in the display of the through moving image, the angle of view of the through moving image displayed on the LCD monitor is displayed by displaying the image of the peripheral portion of the recording range of the image stored in the recording medium on the monitor, Even when the angle of view (shooting angle of view) of the image recorded on the recording medium is different, the electronic camera can accurately determine the angle of view of shooting based on the through moving image displayed on the LCD monitor.

  The display operation on the TV monitor or the rear LCD panel 171 of the conventional digital camera will be described with reference to FIG.

  First, in the imaging (101), output from photoelectric conversion elements in the incident light portion composed of horizontal K pieces and L vertical portions and output from a plurality of photoelectric conversion elements in a light shielding portion (not shown) are made.

  In the image processing (110), the first image data subjected to jpeg processing, which is photographed image data after known image processing such as AD conversion, dark current correction, and white balance, and the second image data. -Monitor display image data with a reduced display size is generated.

  The storage device (103), which is a detachable nonvolatile memory, stores both the first image data and the second image data described above, or the first image data. .

  The monitor display image data that is the second image data read from the storage device (103) or the monitor display image data generated by the image processing (110) is then video-out. It is determined whether or not the output is selected (120). When the output is not selected, the monitor display image amount is set for the LCD monitor (122), but the value is compared with the display image amount setting for ntsc described later. The display image amount for LCDs that are the same or smaller than this is a value that exceeds the required amount.

Further, whether or not there is monitor display image data as second image data is performed for the image read out from the storage device (103). (125)
Then, when there is monitor display image data which is the second image data, it is subsequently determined whether or not the display is enlarged. (126) There is second image data, and further enlargement display is performed. If not, the second image data is stored in the VRAM area 131 inside the memory 130. (130)
When video out output is selected, (120) it is determined whether the format is NTSC format or PAL format (121), and if NTSC format is selected, the NTSC format is displayed with the optimum resolution The display image amount is set so that it can be displayed (123), and if the PAL format is selected, the display image amount is set so that it can be displayed with the optimum resolution in the PAL format (124).

  The monitor display image generation is performed when the video out is selected and when the enlarged display is selected in the LCD monitor display, but the captured image and the monitor display image which are the first image data are selected. A monitor display image having a set display image amount is generated using the temporary storage area.

  Since the amount of monitor display image data required for video-out output is larger than that for LCD monitor display, the first image, which is the main image data described with reference to FIG. After being stored in 132, it is generated by performing known image reduction processing such as thinning and interpolation in the horizontal and vertical directions so that the set display image amount is obtained.

  That is, the image data output from the JPEG image data generation unit 113 in FIG. 1 has the maximum purpose of being handled as a captured image, but the display contents on the TV monitor and the rear LCD panel 171 It is also used when you want to enlarge partially.

  Monitor display image data, which is the generated second image data, is stored in the VRAM area 131.

  Video signal preprocessing such as conversion from RGB components to YUV components as video signal preprocessing, γ conversion according to the output destination, setting of luminance range and hue range necessary for video encoding, signal synchronization, etc. I do.

Here, when video-out is selected, conversion to a field image is also performed. (142)
When the video out output is not selected, that is, when the LCD monitor display and the NTSC format video out are selected, the video is encoded into the NTSC format and the PAL format video out is selected. Video encoding to PAL format. (161)
At this time, the LCD monitor display output and the NTSC video out output have the same form of encoder output, which will be described later, and even if the display image amount for ntsc is set when the LCD monitor display is selected, the LCD monitor display is defective. It does not affect.

After the display image is video-encoded, it is determined again whether the video-out output is selected (162). When the video-out is not selected, that is, when the LCD monitor is displayed, the NTSC format interface is selected. After being output to the LCD controller by the face (170), it is displayed on the rear LCD panel. (171)
When video out is selected, the signal is amplified and driven in accordance with either NTSC or PAL format (163) and output to the connected TV monitor.

As described above, the LCD display image data amount is the same as or smaller than the ntsc display image amount setting, but the LCD display image data amount exceeds the necessary amount. Therefore, useless time is generated in a series of shooting operations.
Japanese Patent Registration No. 2865360 Japanese Patent Laid-Open No. 2001-157097

  In recent years, digital camera systems that use image sensors consisting of millions of pixels have also been developed, especially for single-lens reflex cameras, so that they can be used without any difference from cameras using silver halide films. It aims to shorten the time required for one shooting operation and increase the continuous shooting speed.

  The increase in the number of pixels, the shortening of the time required for one photographing operation, and the increase in the continuous photographing speed are largely contradictory, and various measures are required. When a plurality of SRAMs used as a memory are controlled and an image is displayed on the LCD display, the contents that inactivate unused SRAMs are intended to reduce current consumption, and as a result, a series of processes Although the time taken from the start of execution to the display is proportional to the external display such as LCD display and TV monitor and the different data amount, there is no description about shortening this. No solution to the problem is disclosed.

  Similarly, Patent Document 2 also switches the display image so that the peripheral part can be displayed on the monitor screen and the shooting angle of view can be accurately determined with a live video, but a solution to this problem is not disclosed.

  In view of the above circumstances, the present invention controls the monitor display image according to the resolution of the selected monitor display destination and the operation mode of the camera, thereby enabling a smooth and speedy shooting operation of the camera. The purpose is realization.

  The image processing apparatus according to claim 1 includes an image sensor in which a plurality of photoelectric conversion elements are two-dimensionally arranged, receives a light beam from a subject area by the image sensor, converts the light into an electric signal, and outputs an image signal. The imaging means and the second image data smaller than the data amount of the first image data and the first image data associated with each other in response to the image signal from the imaging means. There are image processing means for outputting data, monitor display means for displaying an image for monitor display, and first and second monitor display destinations, and monitor with a data amount corresponding to the selected monitor display destination. In accordance with the display control means for creating a display image and outputting it to the monitor display image display destination, and the display control means, the data amount of the second image data is further increased from the first image data. And a third image less than the amount of data of the first image data. And a monitor display image generating means for generating and outputting data, and performing control to output the second image data by performing horizontal interpolation processing. When the data is displayed on the second monitor, the third display data is output. The control for outputting the image data is performed.

  The digital camera system according to claim 2 includes an image sensor in which a plurality of photoelectric conversion elements are two-dimensionally arranged, receives a light beam from a subject area by the image sensor, converts the light into an electric signal, and outputs an image signal. The imaging means and the second image data smaller than the data amount of the first image data and the first image data associated with each other in response to the image signal from the imaging means. There are image processing means for outputting data, monitor display means for displaying an image for monitor display, and first and second monitor display destinations, and monitor with a data amount corresponding to the selected monitor display destination. In accordance with the display control means for creating a display image and outputting it to the monitor display image display destination, and the display control means, the data amount of the second image data is further increased from the first image data. Less than the amount of data in the first image data. A digital camera system comprising a monitor display image generating means for generating and outputting third image data, wherein when displaying on a first monitor which is a monitor provided in the camera, the second display Control is performed to perform horizontal interpolation processing on image data and output, and control is performed to output third image data when displayed on a second monitor separate from the camera.

  The digital camera system according to claim 3 includes an image sensor in which a plurality of photoelectric conversion elements are two-dimensionally arranged, receives a light beam from a subject region by the image sensor, converts the light into an electric signal, and outputs an image signal. The imaging means and the second image data smaller than the data amount of the first image data and the first image data associated with each other in response to the image signal from the imaging means. Image processing means for outputting data, monitor display means for displaying an image for monitor display, and storage means having an image data storage area for monitor display therein. Nonvolatile storage means for storing one image data and second image data smaller than the amount of the first image data, and a first display monitor provided in the camera And there is a second display monitor separate from the camera. A monitor display image is created with a data amount corresponding to one of the selected display monitors, stored in the image data storage area by the storage means, and then read out and repeatedly displayed on the monitor display image display destination. In accordance with the display control means for performing the output control and the display control means, the first image data is larger than the data amount of the second image data and the data of the first image data. A digital camera system comprising monitor display image generation means for generating and outputting third image data smaller than the amount of data, wherein the second image is displayed when displayed on the first display monitor; Data is subjected to horizontal interpolation processing and output, and control is performed to output third image data during display on a second display monitor separate from the camera.

  The digital camera according to claim 4 includes an imaging device in which a plurality of photoelectric conversion elements are arranged two-dimensionally, and receives a light beam from a subject area by the imaging device and converts it into an electrical signal to output an image signal. And second image data smaller than the amount of data of the first image data and the first image data associated with each other in response to the image signal from the imaging means. A first display monitor that is a display monitor provided in the camera, a monitor display means for displaying an image for monitor display, a storage means having an image data storage area for monitor display, and a camera There is a second display monitor separate from the camera, and a monitor display image is created on one of the selected display monitors with the data amount selected in accordance with the camera operation mode, and stored. Recorded in the image data storage area. After that, according to the display control means for performing the control to read out and repeatedly output to the monitor display image display destination, the data of the second image data from the first image data according to the display control means. And a monitor display image generating means for generating and outputting third image data which is larger than the first image data and smaller than the first image data amount, to the first display monitor. When the image is displayed, the second image data is subjected to horizontal interpolation processing and output, and when it is displayed on the second display monitor separate from the camera, it is controlled according to the operation mode of the camera. A digital camera which performs control to selectively switch one of the output of the third image data or the output of the second image data subjected to the horizontal interpolation process.

  The image processing apparatus according to claim 6, processing means for processing the same image into a plurality of image data having different data amounts, and directly outputting image data having a large data amount among the plurality of image data, Image data having a small data amount among the image data is output means for performing interpolation processing and outputting the image data.

  According to the present invention, there are three display destinations: a rear LCD panel, a TV monitor with NTSC video output, and a TV monitor with PAL video output, and the resolution of one output destination selected from these is displayed. When the data amount of the monitor display image is switched so as to correspond and the display on the rear LCD panel is selected, the data amount of the VRAM area is interpolated. It becomes a digital camera system in which the operation time is shortened by a corresponding amount.

  Also, when selecting the optimum image data amount according to the monitor display destination, the camera operation mode is also taken into consideration, and the video out output to the TV monitor is selected and the continuous shooting operation mode is selected. In some cases, the image data for LCD monitor display that has already been generated is used for video out output, thereby reducing the frequency of bus use and providing a digital camera system that can perform continuous shooting at higher speed.

  Embodiments of the present invention will be described below.

  Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram of an image processing apparatus for a digital camera according to the first embodiment of the present invention.

  As shown in the figure, the present image processing apparatus outputs a microcomputer PRS 105 that controls the entire main image processing, an image pickup unit 101 including an area image sensor composed of a CCD or the like, and the image pickup unit 101. There is an image processing unit 110 that processes image signals.

  The output of the image processing unit 110 is stored in the memory 130 via the data bus 102. A data bus 102 includes a microcomputer PRS 105, a storage unit 103 formed of a nonvolatile storage member for storing a plurality of image data, and an external IF device 104 for exchanging data with an external device such as a personal computer. Is connected.

  The microcomputer PRS105 is, for example, a one-chip computer in which a CPU (central processing unit), RAM, ROM, EEPROM (electrically erasable programmable ROM), video controller, input / output port, and the like are arranged. -(Hereinafter abbreviated as "microcomputer").

  The microcomputer PRS105 performs a series of operations based on a sequence program stored in the ROM. Since the main point of this case is the area surrounded by the wavy line, an arrow is added to clarify that this range is under the control of the microcomputer PRS 105 in FIG. 1, but the other parts in FIG. Under the control of the PRS 105.

  The imaging unit 101 includes an imaging element of a CCD area image sensor or a CMOS area image sensor, a sensor driving unit that drives the imaging element, an analog signal processing unit such as AGC, and an A / D conversion unit, and the read photoelectric conversion output After performing analog processing suitable for the digital signal, it is converted to a digital signal.

  The light flux from the imaging region is imaged on the image sensor through an optical system (not shown), and the image sensor photoelectrically converts this to an electrical signal and converts it into a digital value and outputs it to the image processing unit 110.

  The image processing unit 110 includes a basic image processing unit 111, a raw image data generation unit 112 that reversibly compresses the output of the basic image processing unit 111, a JPEG image data generation unit 113 that performs irreversible compression, a back surface, and the like. The monitor display image data generation unit 114 generates an image to be displayed on a monitor attached to the monitor. The basic image processing unit 111 receives an imaging signal output from the imaging unit 101, performs dark correction, performs original image processing such as extraction of pixel data of the light shielding unit (optical black) and pixel flaw correction, and white balance. A series of image processing relating to so-called picture creation, such as image correction, gamma correction, color interpolation, and color correction, is performed, and signals are output separately for each color component of RGB.

  The amount of output data from the image processing unit 110 is increased to an integral multiple of the amount of data output from the imaging unit 101 by performing color interpolation processing.

  Here, the image pickup unit 101 sequentially outputs in units of one line in the horizontal direction in a Bayer array according to the driving method of the image pickup element. In the image processing unit 110, the input contents according to the Bayer array are independent of RGB by an internal color interpolation process at the time of output, that is, the image data capacity is three times as large as the input.

  The raw image data generation unit 112 reversibly compresses the image data input in RGB from the basic image processing unit 111 in line units, and the compressed data is sequentially stored in the memory 130. .

  The JPEG image data generation unit 113 includes a YUV conversion unit and a JPEG encoding processing unit. The YUV conversion unit converts the image data input in RGB from the basic image processing unit 111 into a luminance component and a color difference component, and the JPEG encoding processing unit performs image compression processing.

  The JPEG encoding processing unit compresses the input image data by JPEG encoding processing. Here, DCT (Discrete Cosine Transform) and Huffman Transform are performed. For signals consisting of luminance and chrominance, for DCT processing, the luminance signal is 8x8 pixels horizontally and the chrominance signal is 8x8 pixels as the minimum unit. The function for converting to a scan is also included in this part.

  The compressed data is sequentially stored in the memory 130.

  These encoding processes are repeatedly performed for one screen of image data from the image capturing unit 101. Before and after the JPEG encoding process, the microcomputer PRS 105 generates headers and footers such as shooting date and time information in an arbitrary format and stores them in the memory 130 together with image data compressed by encoding.

  In addition, the setting values such as the compression rate necessary for JPEG encoding and the conversion reference data necessary for that are set by the microcomputer PRS 105 when the shutter is pressed.

  The monitor display image data generation unit 114 performs image processing for display on a rear LCD monitor display panel 171 provided in the camera or a TV monitor connected to the camera. The contents are signal processing for image size reduction including filter processing, and are stored in the memory 130 after signal processing. At this time, two different image data generated from the same imaging data are stored in the memory 130 as captured image data.

  The two image data having different image sizes are the first image data that is not subjected to image reduction processing by the image processing unit 110 and the second image that is subjected to image reduction processing by the image processing unit 110. It is divided into data.

  Image data not subjected to the reduction process is handled as photographed image data, and the second image data subjected to the reduction process is used for editing and checking the photographed image data such as thumbnails and monitor displays. It is the main purpose of generation to handle as management information of the second image. Naturally, the data amount of the second image data is smaller than the data amount of the first image data.

  Here, the first image data that is not subjected to the reduction process and the second image data that has been subjected to the reduction process are managed as independent image files, but are associated with each other. Yes.

  Thereafter, the image data stored in the memory 130 is sequentially stored in the storage device 103 (to be described later) in a time interval between camera operations.

  The memory 130 includes a VRAM area 131 and a monitor display image temporary storage area 132 therein.

  The image data written in the VRAM area 131 is read at a predetermined timing by the video controller 106 built in the microcomputer PRS 105 and displayed on the TV monitor or the rear LCD panel 171.

  The size of the VRAM area 131 is changed so as to obtain an optimum resolution in accordance with a display destination device.

  The relationship between the size of the VRAM area and the display destination device will be described in detail with reference to FIG.

  The monitor display image temporary storage area 132 is an area for storing image data larger than the original VRAM area 131 when the monitor display image generation unit 127 generates image data to be written in the VRAM area 131. It is.

  When the image data output from the monitor display image data generation unit 114 is not used for the monitor display output, the monitor display image generation unit 127 uses the VRAM from the image data stored in the monitor display image temporary storage area 132. Monitor display image data is generated in the area 131.

  The generated image data is, for example, data read by the storage device 103, image data output from the JPEG image data generation unit 113, or image data output from the raw image data generation unit 112. , And one of these is stored in the monitor display image temporary storage area 132 at this time.

  The image data output from the JPEG image data generation unit 113 has the greatest purpose of being handled as a photographed image. However, when the display content is to be partially enlarged on the TV monitor or the rear LCD panel 171, the image data is output. using.

  The storage member of the storage device 103 is detachable from the system, and after the data writing from the volatile storage member is performed for one or more screens in the state of being attached to the system, the storage member is removed from the system. The data stored in another system that can be read in the data format of this system can be played back, edited, and saved.

  The memory device 103 is composed of a volatile storage member having a relatively high writing speed for storing a plurality of image data, whereas the storage device 103 is detachable with a relatively low writing speed. It is different in that it is composed of possible non-volatile memory members.

  Both the first image data and the second image data are managed in the storage device 103 in a format for satisfying the above-mentioned purpose.

  The video controller 106 incorporated in the microcomputer PRS 105 reads the contents of the VRAM area 131 via the data bus 102 and outputs it to the data conversion unit 140.

  The data conversion unit 140 receives the RGB component when the image signal form is stored in the VRAM area 131 and converts it into a YUV component, and is optimal for the display output destination of either the TV monitor or the rear LCD panel 171. Γ conversion and interpolation reduction processing are performed, and video signal preprocessing such as setting of a luminance range and a hue range necessary for video encoding, and signal synchronization is performed. Further, when video out is selected, conversion to a field image is also performed.

  The output of the data converter 140 is converted into a signal in the NTSC format or PAL format by the video encoder 161.

  The output of the video encoder unit 161 is sent to the LCD controller 170 or the video amplifier & driver unit 163 by the switching SW unit 162. The video amplifier & driver unit 163 is a known function for providing a drive capability required for output to a TV monitor.

  The LCD controller 170 is used in combination with the rear LCD panel 171, and the input signal form is NTSC. Therefore, when the output destination by the switching SW 162 is the rear LCD panel 171, the signal form is NTSC.

  Control of the monitor display image output system such as the output signal form of the switching SW unit 162 and the video encoder-161 is performed by the microcomputer PRS 105 and its internal video controller 106.

  The RGB interface is also stored in each RGB color component, and the interface with the drive unit of the LCD controller 170 which is the controller of the rear LCD display panel 171 provided in the camera is also performed in RGB. The output contents are performed in units of lines as in the case of input.

  With reference to FIG.

  2 shows an observation state at the time of camera shooting, an output image from the image sensor included in the imaging unit 101 of FIG. 1, and the content of the output image after a series of signal processing is performed by the image processing unit 110. FIG.

  FIG. 4A shows a state where the finder is viewed from the camera eyepiece, and AFP1 to AFP3 indicate three distance measuring points, and the focus is adjusted at the distance measuring point AFP2. .

  At this time, the imaging device included in the imaging unit 101 in FIG. 1 is a K × L pixel as shown in FIG. 1B, and in FIG. 1C, this is the basic image of the image processing unit 110. A series of signal processing such as dark correction, flaw correction, white balance and color correction, and color interpolation is performed from the OB clamp in the processing unit 111 for each color of RGB, and from the KxL pixel for each color of R, G, and B Indicates that the output image is

  In other words, the image output of the imaging element composed of KxL pixels is subjected to signal processing in the basic image processing unit 111 of the image processing unit 110, so that the image output becomes three times the capacity.

  In FIG. 6A, each display shown at the lower end indicates a camera setting state such as a shutter speed or a focus adjustment for focus adjustment, and shows a state in which all the display portions are turned on for explanation. Therefore, during the operation of the camera, lighting or extinguishing is performed independently according to the operating state, and not all displays are lit as shown in FIG.

  Further, when the focus detection points AFP1 to AFP3 are selected for focus adjustment, they are surrounded by an outer quadrilateral and an inner quadrilateral in a short time that can be sufficiently confirmed by the photographer by an optical system and an illumination device (not shown). The red area lights up red.

  With reference to FIG.

  FIG. 3 is a diagram showing the form and data amount according to the output destination of the monitor display image. The operation contents in the VRAM area 131 and the data converter 140 shown in FIG. 1 and the output of the video encoder-161 are shown. The relationship and function are also shown briefly.

  FIG. 3A shows the output to the rear LCD panel 171.

  FIG. 3B shows output to the TV monitor.

  The data amount of the monitor display image stored in the VRAM area 131 is 376 pixels × 240 lines when output to the rear LCD panel 171, 752 pixels × 480 lines when outputting to the TV monitor in the NTSC format, and PAL. When output to the TV monitor in the format, it is 752 pixels X576 lines.

  Then, when outputting to the TV monitor, reading from the VRAM area 131 is performed in two fields, field 1 and field 2, in units of lines. In NTSC, 480 lines are alternately read out 240 by 240.

  At the time of output to the rear LCD panel 171, data of 376 pixels per line read from the VRAM area 131 is horizontally interpolated by the data conversion unit 140 and increased to 752 pixels. Further, the same display image data is output to both field 1 and field 2.

  Accordingly, when outputting to the TV monitor, the video encoder-161 outputs an image signal having an optimum resolution for either the NTSC format or the PAL format, and outputs it to the rear LCD panel 171. In this case, an image signal with an optimal resolution is output.

  The above description is mainly about the amount of display image data. The data conversion unit 140 converts the signal form from RGB to YUV, γ conversion, video encoder-161, and so on. The interface is also available.

  Now, the display operation on the TV monitor or the rear LCD panel 171 in the operation of the system shown in FIG. 1 will be described in detail with reference to FIG. 4 including the operation of the monitor display image generation unit 127.

  FIG. 4 is a diagram showing the flow of the display operation on the TV monitor or the rear LCD panel 171.

  In order to make the explanation easy to understand, the same blocks are given the same numbers as in FIG.

  First, in the imaging (101), as shown in FIG. 2B, from the output from the photoelectric conversion elements in the incident light portion composed of K horizontal and L vertical, and from the plurality of photoelectric conversion elements in the light shielding portion (not shown). Is output.

  In the image processing (110), the jpeg processing is performed as the first image data after the well-known image processing such as AD conversion, dark current correction, white balance and the like shown in the image processing unit 110 of FIG. Monitor display image data in which the display size of the image and the second image data is reduced is generated.

  The storage device (103), which is a detachable nonvolatile memory, stores both the first image data and the second image data described above, or the first image data.

The monitor display image data that is the second image data read from the storage device (103) or the monitor display image data generated by the image processing (110) is then video-out. It is determined whether or not the output is selected (120). When the output is not selected, the monitor display image amount is set for the LCD monitor. (122)
Further, whether or not there is monitor display image data as second image data is performed for the image read out from the storage device (103). (125)
Then, when there is monitor display image data which is the second image data, it is subsequently determined whether or not the display is enlarged. (126) There is second image data, and further enlargement display is performed. If not, the second image data is stored in the VRAM area 131 inside the memory 130. (130)
When there is no second image data or there is second image data but enlarged display is performed, a monitor display image needs to be generated separately, so that a monitor display image is generated. (127)
Such processing is for image data from the storage device 103 and is not performed during a series of shooting operations.

  When video out output is selected, (120) it is determined whether the format is NTSC format or PAL format (121), and if NTSC format is selected, the NTSC format is displayed with the optimum resolution. The display image amount is set so that it can be displayed (123), and if the PAL format is selected, the display image amount is set so that it can be displayed with the optimum resolution in the PAL format (124).

  The monitor display image generation is performed when the video out is selected and when the enlarged display is selected in the LCD monitor display, but the captured image and the monitor display image which are the first image data are selected. A monitor display image having a set display image amount is generated using the temporary storage area.

  Since the amount of monitor display image data required for video-out output is larger than that for LCD monitor display, the first image, which is the main image data described with reference to FIG. After being stored in 132, it is generated by performing known image reduction processing such as thinning and interpolation in the horizontal and vertical directions so that the set display image amount is obtained.

  That is, the image data output from the JPEG image data generation unit 113 in FIG. 1 has the maximum purpose of being handled as a captured image, but the display contents on the TV monitor and the rear LCD panel 171 It is also used when you want to enlarge partially.

  Although not shown here, an enlarged display with video out is also provided in the function.

  When video out is selected, there is no enlarged display discrimination processing, and the function changes to a display area designation function that is performed when the second image data is generated from the captured image that is the first image data. No, it is simply the difference between whether the specified area is the whole area or a partial area.

  Monitor display image data, which is the generated second image data, is stored in the VRAM area 131.

Thereafter, it is determined again whether or not the video-out output is selected (135). When the video-out output is not selected, that is, when displaying on the LCD monitor, the display image data is horizontally interpolated. . (141)
By this horizontal interpolation, even when the amount of data from the memory 130 is small, the encoder interface can be used in the same manner as when the NTSC video signal is selected.

The display image data for LCD and the display image data for video out output, which are horizontally interpolated and have the same horizontal line data, are converted from RGB components to YUV components and output as video signal preprocessing. Video signal pre-processing such as γ conversion according to the preceding, setting of luminance range and hue range necessary for video encoding, and signal synchronization are performed. Here, when video-out is selected, conversion to a field image is also performed. (142)
When the video out is not selected, that is, when the LCD monitor display or the NTSC format video out is selected, the video is encoded in the NTSC format, and when the PAL format video out is selected, the PAL Video encode to format. (161)
The difference between the LCD monitor display selection and the NTSC video out selection is in the amount of display image. Less when LCD monitor display is selected, but it is based on the optimal resolution for display.

After the display image is video-encoded, it is determined again whether the video-out output is selected. (162)
When the video out is not selected, that is, when the LCD monitor is displayed, the video is output to the LCD controller via the NTSC format interface (170) and then displayed on the rear LCD panel. (171)
When video out is selected, the signal is amplified and driven in accordance with either NTSC or PAL format (163) and output to the connected TV monitor.

  As described above, in the first embodiment, there are three monitor display destination choices: the rear LCD panel, the TV monitor with NTSC video output, and the TV monitor with PAL video output, which are selected from these. The data amount of the monitor display image is switched so as to correspond to the resolution of one output destination.

  When the display on the rear LCD panel is selected, the amount of data in the VRAM area is interpolated, so that the amount of use of the data bus 102 through which monitor display image data is read from the VRAM area is extremely small. .

  Since the time when horizontal interpolation is not performed is considered to be close to ½, a series of camera operation times can be shortened by a corresponding amount.

  In comparison with the ntsc format TV monitor output, the usage amount of the data bus 102 is reduced to ¼.

  Hereinafter, a second embodiment of the present invention will be described with reference to the drawings.

  FIG. 5 is a block diagram of an image processing apparatus for a digital camera according to the second embodiment of the present invention.

  In the first embodiment, the process from shooting to display is performed by a series of processes regardless of the operation mode at the time of shooting by the camera.

  Although the configuration shown in FIG. 5 is the second embodiment, the processing content of the display image data is selectively performed according to the operation mode at the time of photographing by the operation camera.

  The operation will be described with reference to FIG.

  In FIG. 5, the correspondence at the time of continuous shooting is added as compared with FIG.

  FIG. 5 is a diagram showing a flow of display operation on the TV monitor or the rear LCD panel 171.

  In order to make the explanation easy to understand, the same blocks are given the same numbers as in FIG.

  Since each block has already been described in the first embodiment, it is omitted here.

  Now, the display operation on the TV monitor or the rear LCD panel 171 will be described in detail with reference to FIG. 5 including the operation of the monitor display image generation unit 127.

  First, in the imaging (101), as shown in FIG. 2B, from the output from the photoelectric conversion elements in the incident light portion composed of K horizontal and L vertical, and from the plurality of photoelectric conversion elements in the light shielding portion (not shown). Is output.

  In the image processing (110), the jpeg processing is performed as the first image data after the well-known image processing such as AD conversion, dark current correction, white balance and the like shown in the image processing unit 110 of FIG. Monitor display image data in which the display size of the image and the second image data is reduced is generated.

  The storage device (103), which is a detachable nonvolatile memory, stores both the first image data and the second image data described above, or the first image data.

Next, it is determined whether or not the shooting operation mode of the camera is a high-speed continuous shooting mode. (119)
When it is in the high-speed continuous shooting mode or not in the high-speed continuous shooting mode, it is determined whether or not the video out output is selected (120). Set for. (122)
Further, whether or not there is monitor display image data which is second image data is determined for the image data read from the storage device 103. (125)
When there is monitor display image data as the second image data, it is subsequently determined whether or not the display is enlarged (126). When the second image data is present and is not enlarged, The second image data is stored in the VRAM area 131 inside the memory 130. (130)
Further, when there is no second image data or there is second image data but an enlarged display is performed, a monitor display image needs to be generated separately, so that a monitor display image is generated. (127)
Such processing is for image data from the storage device 103, and is not performed during a series of shooting operations.

  Returning to the process 120, when the video out output is selected (120), it is determined whether the format is the NTSC format or the PAL format (121), and if the NTSC format is selected, The display image amount is set so that it can be displayed with the optimum resolution in the NTSC format (123). If the PAL format is selected, the display image amount is set so that it can be displayed with the optimum resolution in the PAL format (124). .

The monitor display image generation is performed when the video out is selected and when the enlarged display is selected in the LCD monitor display, but the captured image and the monitor display image which are the first image data are selected. A monitor display image having a set amount of image data is generated using the temporary storage area. (127)
Since the amount of monitor display image data required for video-out output is larger than that for LCD monitor display, the first image, which is the main image data described with reference to FIG. After being stored in 132, it is generated by performing known image reduction processing such as thinning and interpolation in the horizontal and vertical directions so that the set display image amount is obtained.

  That is, the image data output from the JPEG image data generation unit 113 in FIG. 1 has the maximum purpose of being handled as a captured image, but the display contents on the TV monitor and the rear LCD panel 171 It is also used when you want to enlarge partially.

  Although not shown here, an enlarged display with video out is also provided in the function.

  When video out is selected, there is no enlarged display discrimination processing, and the function changes to a display area designation function that is performed when the second image data is generated from the captured image that is the first image data. No, it is simply the difference between whether the specified area is the whole area or a partial area.

  Monitor display image data, which is the generated second image data, is stored in the VRAM area 131.

Thereafter, it is determined again whether the high-speed continuous shooting mode is selected (134),
It is determined whether the video out output is selected when it is in the high-speed continuous shooting mode and not in the high-speed continuous shooting mode (120). When it is a display, the display image data is horizontally interpolated. (141)
By this horizontal interpolation, even when the amount of data from the memory 130 is small, the encoder interface can be used in the same manner as when the NTSC video signal is selected.

Display image data for LCD and data for video out output that have been horizontally interpolated to have the same horizontal line data are converted from RGB components to YUV components as video signal preprocessing. Video signal preprocessing such as γ conversion corresponding to the output destination, luminance range and hue range necessary for video encoding, and signal synchronization are performed. Here, when video-out is selected, conversion to a field image is also performed. (142)
When the video out output is not selected, that is, when the LCD monitor is displayed and when the NTSC format video out is selected, the video is encoded into the NTSC format and the PAL format video out is selected. Encodes video in PAL format. (161)
The difference between the LCD monitor display selection and the NTSC video out selection is in the amount of display image. Less when LCD monitor display is selected, but it is based on the optimal resolution for display.

After the monitor display image is video-encoded, it is determined again whether the video out output is selected (162). When the video out is not selected, that is, when the LCD monitor is displayed, the NTSC format interface is selected. -After being output (170) to the LCD controller on the face, it is displayed on the rear LCD panel. (171)
When the video out output is selected, the signal is amplified and driven in accordance with either NTSC or PAL format (163) and output to the connected TV monitor.

  As described above, in the second embodiment, the optimum image data amount is selected in accordance with the monitor display destination, but in this case, the operation mode of the camera is also taken into consideration, and the video out output to the TV monitor is performed. When is selected and the continuous shooting operation mode is selected, the image data for LCD monitor display that has already been generated is used for video out output, reducing the frequency of data bus usage and high-speed continuous shooting. It can be performed.

(Correspondence between Invention and Example)
In each of the above embodiments, the imaging unit 101 corresponds to the imaging unit of the present invention, the image processing unit 110 corresponds to the signal processing unit, the memory 130 corresponds to the internal storage unit, and the TV monitor or the rear LCD display panel 171. Corresponds to the monitor display means, the microcomputer PRS105 corresponds to the display control means, and the monitor display image generation unit 127 corresponds to the monitor display image generation means.

  The above is the correspondence between each configuration of the embodiment and each configuration of the present invention. However, the present invention is not limited to the configuration of the embodiment, and for example, the input signal is an RGB color component or luminance. Even when the image is not a component or color difference component, the image sensor is not a CCD image sensor, or the monitor display destination is not an LCD or TV monitor, even if it differs from the contents shown in the embodiment, Needless to say, any configuration that can achieve the function described in the section is acceptable.

It is a block diagram which shows the electric system of this 1st Embodiment. It is a figure which shows the relationship of the state which looked at the finder of the camera of the 1st Embodiment, the image imaged at that time, and the image after image processing. The figure shown about the form according to the output destination of the image for monitor displays of this 1st Embodiment, and data amount It is a figure which shows the flow of a process of the image for monitor displays of this 1st Embodiment. It is a figure which shows the flow of a process of the image for monitor displays of the 2nd Embodiment. It is a block diagram which shows the conventional electric system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Image pick-up part 102 Data bus 103 Memory | storage device 104 External interface 105 Microcomputer PRS
106 video controller 110 image processing unit 111 basic image processing unit 112 raw image data generation unit 113 jpeg image data generation unit 114 monitor display image data generation unit 127 monitor display image generation unit 130 memory 140 data Data converter 161 Video encoder
162 Changeover switch 163 Video amplifier & driver 170 LCD controller 171 Rear LCD panel

Claims (6)

  An image pickup unit including an image pickup device in which a plurality of photoelectric conversion elements are arranged two-dimensionally, receiving a light beam from a subject area by the image pickup device, converting the light into an electric signal, and outputting an image signal; and an image signal from the image pickup unit In response, the image processing means for outputting the first image data associated with each other independently and the second image data smaller than the data amount of the first image data, and the monitor display There are monitor display means for displaying a directed image, and first and second monitor display destinations, and a monitor display image is created with a data amount corresponding to the selected monitor display destination, and the monitor display image display destination According to the display control means for controlling the output to the first image data, and a third amount less than the amount of data of the first image data and less than the amount of data of the first image data according to the display control means. The image data is generated and output from the first image data. Display image generating means for controlling to output the second image data by interpolating the second image data when displayed on the first monitor, and outputting the third image when displayed on the second monitor. An image processing apparatus that performs control to output data.   An image pickup unit including an image pickup device in which a plurality of photoelectric conversion elements are arranged two-dimensionally, receiving a light beam from a subject area by the image pickup device, converting the light into an electric signal, and outputting an image signal; and an image signal from the image pickup unit In response, the image processing means for outputting the first image data associated with each other independently and the second image data smaller than the data amount of the first image data, and the monitor display Monitor display means for displaying a directed image, having a first monitor display destination and a second monitor display destination, creating a monitor display image with a data amount corresponding to the selected monitor display destination, and displaying the monitor display According to the display control means for performing control to output to the image display destination, and the display control means, the data amount is larger than the data amount of the second image data and is larger than the data amount of the first image data. A small amount of third image data is generated from the first image data and output. And a monitor display image generating means for performing a horizontal interpolation process on the second image data when outputting to a first monitor, which is a monitor provided in the camera. A digital camera system which performs control and outputs third image data when displayed on a second monitor separate from the camera.   An image pickup unit including an image pickup device in which a plurality of photoelectric conversion elements are arranged two-dimensionally, receiving a light beam from a subject area by the image pickup device, converting the light into an electric signal, and outputting an image signal; and an image signal from the image pickup unit In response, the image processing means for outputting the first image data associated with each other independently and the second image data smaller than the data amount of the first image data, and the monitor display A monitor display means for displaying a directed image, a storage means having an image data storage area for monitor display therein, a first image data which is detachable and is an output of the image processing means, and a first Non-volatile storage means for storing second image data smaller than the amount of image data, a first display monitor provided in the camera, and a separate camera. There is a second display monitor that responds to one of the selected display monitors. Display control means for creating a monitor display image with the amount of data that has been stored, storing it in the image data storage area by the storage means, and then reading it out and repeatedly outputting it to the monitor display image display destination; According to the control means, third image data that is larger than the amount of data of the second image data and smaller than the amount of data of the first image data is used as the first image data. And a monitor display image generating means for generating and outputting from the data, and when the data is displayed on the first display monitor, the second image data is subjected to horizontal interpolation processing and output. A digital camera system which performs control and outputs third image data at the time of display on a second display monitor separate from the camera. An image pickup means including an image pickup element in which a plurality of photoelectric conversion elements are arranged two-dimensionally, receiving a light beam from a subject area on the image pickup element, converting the light into an electric signal, and outputting an image signal;
In response to the image signal from the imaging means, the first image data and the second image data which are smaller than the data amount of the first image data are output independently of each other. Image processing means, monitor display means for displaying an image for monitor display, storage means having an image data storage area for monitor display therein, a first display monitor and a camera which are display monitors provided in the camera A second display monitor that is separate from the first display monitor, and creates a monitor display image on one of the selected display monitors with the data amount selected in accordance with the operation mode of the camera. After the image data is stored in the image data storage area, the display control means for performing the control to read out and repeatedly output to the monitor display image display destination, and the data amount of the second image data according to the display control means More than the first image data Monitor image generating means for generating and outputting third image data smaller than the first data amount from the first image data, and when displaying on the first display monitor, The second image data is subjected to horizontal interpolation processing and output, and when displayed on a second display monitor separate from the camera, the third image data is displayed in accordance with the operation mode of the camera. A digital camera which performs control to selectively switch one of the output of the data and the output obtained by subjecting the second image data to horizontal interpolation.   5. A digital camera according to claim 4, wherein the operation mode of the camera is one frame shooting and continuous shooting.   Processing means for processing the same image into a plurality of image data having different data amounts, and image data having a large amount of data among the plurality of image data are directly output, and image data having a small amount of data among the plurality of image data And an output means for performing an interpolation process and outputting the image processing apparatus.

Images