JP2009152894A - Image processing device and its control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve a technology for contriving the improvement of convenience by quickly permitting live view display of processing result requested by user. <P>SOLUTION: The control method of an image processing device, provided with an image device for photographing the optical image of an object, a first display mode which displays the whole of angle of field of the image device of an image output real-time from the image device and a second display mode which displays a part of angle of field of the image device of the image output real-time from the image device while permitting display by switching the image of the first display mode and the live preview display by the second display mode, includes an input step of receiving a user operation with respect to the image displayed through live view by the first display mode or the second display mode and a display mode switching step of switching forcibly the display mode for effecting the live view display in accordance with the input user operation. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image processing technique for displaying an entire image and an enlarged image at the same time and displaying any one of images in a live view.

  In recent years, in digital cameras that are rapidly spreading, it is a great advantage for users that a captured image can be reproduced and displayed immediately after shooting. In addition, the function of performing enlarged display when reproducing and displaying a photographed image is very useful for quickly recognizing the focus of the photographed subject. There has been proposed a digital camera that can automatically switch between full image display and enlarged image display according to the shooting mode of the camera during playback display (see, for example, Patent Document 1).

In addition, an imaging device such as a digital still camera that captures a moving image is connected to a PC using a connection unit such as a USB, and an input moving image from the camera is reproduced on the PC side in real time. Since playback in real time is possible, the user can smoothly check composition, exposure, and focus.
JP 2005-303408 A

  In an image processing apparatus that reproduces a moving image input from a camera in real time on the PC side, it is important to quickly reflect the operation performed by the user on the display. When it is possible to switch between the two modes of the whole image display mode and the enlarged image display mode at an arbitrary magnification, it is preferable for the user to reflect the user operation in which display mode. Depends on the operation performed. For example, when the user adjusts the focus using the autofocus function of the camera, it may be desirable to switch the display mode to the enlarged image display mode to enlarge and display the area near the distance measuring point.

  The present invention realizes a technique that enables prompt display of live processing results desired by a user and improves convenience.

  In order to solve the above-described problems, an image processing apparatus according to the present invention is an image processing apparatus that displays an image output in real time from an imaging device that captures an optical image of a subject on a display device. Has a live view display in a first display mode for displaying the entire angle of view of the imaging device, and a second display mode for displaying a part of the angle of view of the imaging device. An input unit that is capable of switching between an image in a mode and a live view display in the second display mode, and that accepts a user operation on an image displayed in a live view in the first display mode or the second display mode; Display mode switching means for forcibly switching the display mode for performing the live view display in response to a user operation by the input means. And butterflies.

  The image processing apparatus control method of the present invention includes a first display mode for displaying an entire angle of view of an imaging apparatus that captures an optical image of a subject and an image output in real time from the imaging apparatus. And a display device having a second display mode for displaying a part of the angle of view of the image pickup device of an image output in real time from the image pickup device, and the image in the first display mode and the A method for controlling an image processing apparatus capable of switching between live view display in the second display mode and displaying the live view display in the first display mode or the second display mode. An input step for accepting an operation, and a display mode switching step for forcibly switching a display mode for performing the live view display according to the input user operation , Characterized by having a.

  According to the present invention, the display mode that reflects the operation performed by the user can be appropriately switched to either the first display mode for displaying the entire image or the second display mode for displaying the enlarged image. For this reason, the desired processing result can be quickly visually recognized without the user being aware of it.

  Hereinafter, an embodiment according to the present invention will be described in detail with reference to the drawings.

  The embodiment described below is an example as means for realizing the present invention, and should be appropriately modified or changed according to the configuration of the apparatus to which the present invention is applied and various conditions. It is not limited to the embodiment.

  FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus according to an embodiment of the present invention.

  In FIG. 1, 10 is a digital camera, and 100 is a photographing lens. The light beam incident on the photographing lens 100 passes through the diaphragm 101 and the shutter 103, and is converted from an optical image into an electrical signal by the image sensor 104. The image sensor 104 is configured as an area sensor in which primary color transmission filters of R (red), G (green), and B (blue) are arranged on a checkerboard in a pixel unit (Bayer arrangement), and 3600 (H) × 2400 ( V).

  The image sensor 104 can read out pixel data in three kinds of readout modes shown in FIG. Read mode 1 is a mode for reading all pixel data. Read mode 1 is used as a read mode at the time of still image shooting. The readout mode 2 is a mode for reading out pixel data of an arbitrary area of the image sensor 104, and is used in an enlarged image display mode during live view. The read mode 3 is used in the whole image display mode during live view. As shown in FIG. 3, three pixels of the same color are added in the horizontal direction, three lines are read out in the vertical direction, and image data of 1200 (H) × 800 (V) is read out. The live view is a function for displaying an image of a subject acquired by the image sensor 104 in real time on a liquid crystal monitor provided on the back of the camera or the like prior to shooting.

  Reference numeral 105 denotes an A / D converter that converts an analog image signal output from the image sensor 104 into a digital signal. A timing control circuit 107 supplies a clock signal and a control signal to the image sensor 104 and the A / D converter 105, and is controlled by the memory control circuit 108 and the system control circuit 106.

  An image processing circuit 109 performs predetermined signal processing, such as white balance adjustment, pixel interpolation processing, gradation processing, and color conversion processing, on the data from the A / D converter 105 or the data from the memory control circuit 108. Etc. Further, the image processing circuit 109 performs a predetermined calculation process using the captured image data. The system control circuit 106 performs TTL AF (autofocus) processing and AE (automatic exposure) processing for controlling the exposure control circuit 102 and the focus control circuit 113 based on the obtained calculation result. ing.

  A memory control circuit 108 controls the A / D converter 105, the timing control circuit 107, the image processing circuit 109, the memory 110, and the compression / decompression circuit 111.

  The data of the A / D converter 105 is written into the memory 110 via the image processing circuit 109 and the memory control circuit 108, or the data of the A / D converter 105 is directly written via the memory control circuit 108.

  Reference numeral 110 denotes a memory for storing captured still images and moving images for live view display, and has a sufficient storage capacity for storing a predetermined number of still images and moving images. The memory 110 can also be used as a work area for the system control circuit 106. A compression / decompression circuit 111 compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like, reads an image stored in the memory 110, performs compression processing or decompression processing, and stores the processed data in the memory 110 is written.

  An exposure control circuit 102 controls the aperture 101 and the shutter 103. Reference numeral 113 denotes a focus control circuit that controls focusing of the photographing lens 100 as an optical system, and reference numeral 112 denotes a zoom control circuit that controls zooming of the photographing lens 100. The exposure control circuit 102 and the focus control circuit 113 are controlled using the TTL method. Based on the calculation result obtained by calculating the captured image data by the image processing circuit 109, the system control circuit 106 performs the exposure control circuit 102 and the focus control circuit. 113 is controlled.

  A system control circuit 106 controls the entire digital camera 10.

  Reference numeral 114 denotes an electrically erasable / recordable nonvolatile memory such as an EEPROM.

  Reference numeral 115 denotes a shutter switch SW1, which is turned ON during the operation of a shutter button (not shown), and instructs to start operations such as AF (autofocus) processing, AE (automatic exposure) processing, and AWB (auto white balance) processing. Reference numeral 116 denotes a shutter switch SW2, which is turned on when an operation of a shutter button (not shown) is completed. First, an exposure process for writing a signal read from the image sensor 104 to the memory 110 via the A / D converter 105 and the memory control circuit 108, and development using computations in the image processing circuit 109 and the memory control circuit 108 Process. Further, the image data is read from the memory 110, compressed by the compression / decompression circuit 111, and an instruction to start a series of processes of recording processing for writing the image data to the recording medium 117 is given.

  The compression / decompression circuit 111 performs JPEG conversion processing on the developed image data so that the PC (personal computer) 120 can perform live view display using MJPEG (Motion-JPEG).

  The digital camera 10 includes an external interface 119 as communication means for connecting to a PC or other external device. The digital camera 10 can transfer a still image or a moving image generated by the compression / decompression circuit 111 from the digital camera 10 to the external PC 120 via the external interface 119 and display it on the display monitor 121. . Further, the digital camera 10 such as the exposure control circuit 102, the focus control circuit 113, and the zoom control circuit 112 can be controlled from the external PC 120 via the external interface 119.

  FIG. 2 is a diagram illustrating a UI (User Interface) screen 20 of application software for controlling the digital camera 10 from the PC 120.

  In FIG. 2, reference numeral 200 denotes an entire image display area (first display area) for live view display of the entire angle of view of the photographing lens 100, and 201 denotes a live view display of a part of the angle of view of the photographing lens 100. This is an enlarged image display area (second display area). A range of the enlarged image display area 201 can be set by a drag operation with a pointing device such as a mouse connected to the PC 120 in the entire image display area 200. The set range is displayed as a magnified display setting range 207 in the entire image display area 200 with a dotted line. When the enlarged display setting range 207 has already been set, the enlarged display setting range 207 can be moved by specifying a region within the range and performing a drag operation.

  The PC 120 can display an image output from the digital camera 10 in an entire image display mode (first display mode) in which the entire angle of view of the camera is displayed in the entire image display area 200. Furthermore, the PC 120 can display in an enlarged image display mode (second display mode) in which a part of the angle of view of the camera is displayed in the enlarged image display area 201.

  Further, the PC 120 can switch either the display of the entire image display area 200 or the display of the enlarged image display area 201 to a live view display that displays a live view image output in real time from the camera (display mode switching means). ). When the PC 120 displays a live view image in the entire image display mode, the digital camera 10 reads out pixel data from the image sensor 104 in the reading mode 3 and outputs it to the PC 120.

  When the PC 120 displays a live view image in the enlarged image display mode, the digital camera 10 reads out pixel data from the image sensor 104 in the read mode 2 and outputs the pixel data to the PC 120. Therefore, the digital camera 10 switches the reading mode of the image sensor 104 depending on whether the PC 120 displays a live view image in the entire image display mode or a live view image in the enlarged image display mode.

  That is, in the present embodiment, live view display is performed in only one of the entire image display area 200 and the enlarged image display area 201. Then, the last displayed image is displayed as a still image in the other display area that is not displayed in live view.

  On the UI screen of this embodiment, operation units 202 to 206 are displayed as input means for receiving user operations.

  Reference numeral 202 denotes an image processing parameter changing unit. The image characteristic parameter changing unit 202a can change a rough image characteristic, for example, an image characteristic for a portrait photograph or an image characteristic for a landscape photograph. The detailed image parameter changing unit 202b can change more detailed image characteristics, such as contrast, sharpness, color density, and hue, than the image characteristic parameter changing unit 202a (setting changing operation).

  Reference numeral 203 denotes a white balance changing unit. The white balance mode selection unit 203a can select a white balance mode set in the digital camera 10 such as an AWB (auto white balance) mode, a sunlight mode, an incandescent light bulb mode, or the like (setting change operation). Further, after the click white balance (WB) button 203b is pressed with a pointing device such as a mouse, the whole image display area 200 or the enlarged image display area 201 is clicked to make the color of the peripheral area of the clicked point white. WB gain can be set.

  An exposure correction operation unit 204 can change the exposure (setting change operation) by controlling the exposure control circuit 102 by moving the slider bar left and right.

  A zoom operation unit 205 can change the angle of view of the photographing lens 100 by the zoom control circuit 112 according to the zoom amount.

  Reference numeral 206 denotes a focus operation unit. The autofocus button 206a and the manual focus button 206b allow the autofocus operation and the manual focus operation of the photographing lens 100, respectively.

  Next, the operation of the image processing apparatus of this embodiment will be described with reference to the flowchart of FIG.

In FIG. 5, when the digital camera 10 is activated with the USB cable connected to the PC 120, the digital camera 10 is recognized on the PC 120 and application software is activated. The digital camera 10 receives the entire image on the PC 120 via the external interface 119. Transfer of the live view image is started in the display mode (S101).

  When the enlarged display setting range 207 is set or changed by the drag operation of the mouse connected to the PC 120 (S102), the screen shifts to the enlarged image display mode (S110). In S <b> 110, all pixel data in an area corresponding to the enlarged display setting range 207 is read from the image sensor 104, image processing is performed, and a live view image is displayed in the enlarged image display area 201. When the user sets or changes the enlarged display setting range 207, the subject that the user wants to see after the setting is reflected by forcibly switching to the enlarged image display mode even in the entire image display mode. It is possible to quickly check the focus check.

  When the enlarged display setting range 207 is not set or changed (S102), when the focus operation unit 206 is operated by the user (S103), it is determined whether the enlarged display setting range 207 is set in S108. When the enlarged display setting range 207 is set, the process proceeds to S110. If the enlarged display setting range 207 is not set, the process proceeds to S109. In the case of a focus operation using the autofocus button 206a, the area around the focused distance measuring point is set in the enlarged display setting range 207. In the case of a focus operation with the manual focus button 206b, the center area of the angle of view is set in the enlarged display setting range 207.

  Next, when the image processing parameter changing unit 202 is operated by the user and the image processing parameter is changed (S104), the process proceeds to S101 to switch to the entire image display mode. When the user changes the image processing parameter, the image that the user wants to see with the highest priority is reflected after the parameter change is reflected by forcibly switching to the whole image display mode even in the enlarged image display mode. The color tone of the entire corner can be confirmed quickly. Similarly, when the user operates the white balance changing unit to change the white balance (S105) or the exposure correction operating unit 204 is operated to correct the exposure (S106), the entire image display mode is set. Transition.

  The live view ends when the shutter switch SW1 or the shutter switch SW2 is pressed (S107).

  In the above embodiment, after the display mode is switched by the operation from the user, the display mode is not changed unless the operation from the user is performed. However, according to the display mode before the operation by the user, the display mode may be switched back to the original display mode after a predetermined time. For example, during live view display in the enlarged image display mode, if the user temporarily switches to the entire image display mode by an operation from the user, control may be performed so that the enlarged image display mode is switched again after a predetermined time.

[Other Embodiments]
The object of the present invention can also be achieved by the following method. That is, a storage medium (or recording medium) in which a program code of software that realizes the functions of the above-described embodiments is recorded is supplied to the system or apparatus. Then, the computer (or CPU or MPU) of the system or apparatus reads and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but the present invention includes the following cases. That is, an operating system (OS) running on a computer performs part or all of actual processing based on an instruction of a program code, and the functions of the above-described embodiments are realized by the processing.

  Furthermore, the following cases are also included in the present invention. That is, the program code read from the storage medium is written in a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion card or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing. When the present invention is applied to the above-mentioned storage medium, the storage medium stores program codes corresponding to the procedure described above.

1 is a block diagram illustrating a configuration of an image processing apparatus according to an embodiment of the present invention. It is a figure which illustrates UI screen by the application software which concerns on this embodiment. It is a figure explaining the read-out method of the pixel data from the image sensor of this embodiment. It is a figure explaining the read-out mode of the pixel data from the image sensor of this embodiment. It is a flowchart which shows operation | movement of the image processing apparatus of this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Digital camera 100 Shooting lens 101 Diaphragm 102 Exposure control circuit 103 Shutter 104 Image sensor 105 A / D converter 106 System control circuit 107 Timing control circuit 108 Memory control circuit 109 Image processing circuit 110 Memory 111 Compression / decompression circuit 112 Zoom control circuit 113 Focus control circuit 114 Non-volatile memory 115 Shutter switch SW1
116 Shutter switch SW2
117 Recording medium 119 External interface 120 PC
121 Display monitor 20 UI screen 200 Whole image display area 201 Enlarged image display area 202 Image processing parameter change unit 202a Image characteristic parameter change unit 202b Detailed image parameter change unit 203 White balance change unit 203a White balance mode selection unit 203b Click white balance button 204 Exposure compensation operation unit 205 Zoom operation unit 205a Telephoto zoom button 206b Wide-angle zoom button 206 Focus operation unit 206a Autofocus button 206b Manual focus button 207 Enlarged display setting range

Claims (8)

An image processing device that displays an image output in real time from an imaging device that captures an optical image of a subject on a display device,
The display device includes a live view display in a first display mode for displaying the entire angle of view of the imaging device, and a second display mode for displaying a part of the angle of view of the imaging device. It is possible to switch between an image in one display mode and a live view display in the second display mode,
Input means for receiving a user operation on an image displayed in live view in the first display mode or the second display mode;
An image processing apparatus, comprising: a display mode switching unit that forcibly switches a display mode for performing the live view display according to a user operation by the input unit.   The display device includes a first display area that performs live view display in the first display mode, and a second display area that performs live view display in the second display mode. When live view display in the first display mode is performed on the display area, the second display area is displayed on the first display area from the imaging device before the image displayed on the live view. When the output image is displayed and live view display in the second display mode is performed in the second display area, the live view is displayed in the second display area in the first display area. The image processing apparatus according to claim 1, wherein an image output from the imaging apparatus is displayed before the displayed image.   The display mode switching means switches to a display mode before the switching by the display mode switching means after a predetermined time from switching any of the display modes to the live view display according to a user operation by the input means. The image processing apparatus according to claim 1 or 2.   When the user operation is a focus operation of the photographing lens of the imaging apparatus, the display mode switching unit forcibly switches the display mode so as to perform live view display in the second display mode. The image processing apparatus according to claim 1, wherein:   When the user operation is a setting change operation of any one of exposure, white balance, and image processing parameters of the imaging device, the display mode switching unit performs live view display in the first display mode. The image processing apparatus according to claim 1, wherein the display mode is forcibly switched. An imaging device that captures an optical image of a subject, a first display mode that displays an entire angle of view of the imaging device that is output in real time from the imaging device, and an image that is output in real time from the imaging device A display device having a second display mode for displaying a part of the angle of view of the imaging device, and switching between an image in the first display mode and a live view display in the second display mode. A control method of an image processing apparatus capable of displaying,
An input step of accepting a user operation on an image displayed in live view in the first display mode or the second display mode;
And a display mode switching step of forcibly switching a display mode for performing the live view display according to the input user operation.   When the user operation is a focus operation of the photographing lens of the imaging apparatus, the display mode switching step forcibly switches the display mode so as to perform a live view display in the second display mode. The control method according to claim 6.   When the user operation is a setting change operation of any one of exposure, white balance, and image processing parameters of the imaging apparatus, the display mode switching step performs live view display in the first display mode. The control method according to claim 6 or 7, wherein the display mode is forcibly switched.

Images