JP2012044558A - Imaging device and photographed image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device and a photographed image display method capable of displaying a rec view and confirming a progress situation of image processing by the same display mode, in a single shot mode or a continuous shot mode.SOLUTION: An imaging device has: a basic image processor 107 that performs a basic image process to a RAW image data, and a special image processor 118 that performs a special image process including a plurality of stages of image processing; a rec-view generator 120 that generates a rec-view from an image obtained by performing the basic image process to the RAW image data; and an image resize processor 119 that sequentially performs a size reduction process to image data obtained by the plurality of stages of image processing to generate an icon image. The icon image is sequentially displayed on a display 114 while shifting a display position depending on the progress of the image process in the special image processor 118.

Description

  The present invention relates to an imaging device and a captured image display method.

  In recent years, there are examples of digital cameras having a special image processing function (for example, an art filter) that can take a photograph with a unique effect by performing various image processing. By applying special image processing to the shot image, for example, by blurring the image, it can be finished to a photo that looks like a miniature photograph, or noise is superimposed on the photo to create a photo with noise between film shots. Can be finished.

  On the other hand, with a digital camera, an outline of a photograph taken by the REC view display function can be confirmed immediately after photographing. The REC view is a confirmation image displayed for a short time (for example, 3 seconds) immediately after shooting. By confirming the REC view display, it is possible to confirm whether or not a photograph as expected can be taken without changing the digital camera to the reproduction mode and reproducing the photograph. However, if special image processing is used, processing time is longer than conventional image processing, so it takes time until the REC view is displayed.

  For this reason, a method of displaying an image generated by performing simple image processing on captured image data on a liquid crystal panel is known (see, for example, Patent Document 1). By using this method, the REC view can be displayed in a short time even when performing special image processing that takes time.

Japanese Patent No. 3389540

  Although the method of displaying an image by simple image processing on the liquid crystal panel disclosed in Patent Document 1 enables a REC view to be displayed in a short time, the impression of the finally recorded image is confirmed. I can't. There is also a problem that the progress of special image processing cannot be known.

  In the single-shot mode, after displaying the image by simple image processing in rec view, a slide bar that displays the progress of special image processing is displayed, and after the special image processing is completed, the recorded image is displayed by the method described above. The problem can be solved.

  However, when shooting in the continuous shooting mode, the display method using only one slide bar as described above cannot display the progress of image processing of a plurality of images. When a plurality of images are prepared, there is a problem that the display mode is different from that in single shooting and it is difficult to understand.

  Accordingly, an object of the present invention made by paying attention to these points is to confirm the rec view display and the progress of image processing in the same display mode in both the single shooting mode and the continuous shooting mode. It is an object of the present invention to provide an imaging apparatus and a captured image display method that can perform the above-described processing.

The invention of an imaging apparatus according to claim 1 that achieves the above object
An imaging unit for imaging a subject and generating RAW image data;
An image processing unit that performs at least two-stage image processing on the RAW image data and generates a target image;
A REC view generation unit for generating a REC view based on the RAW image data;
An image resizing processing unit that sequentially reduces image data obtained by image processing of a plurality of stages of the at least two stages of image processing and generates an icon image;
A display unit for displaying the REC view, the icon image, and the target image;
A recording unit for recording the target image generated by the image processing unit,
The icon images are sequentially displayed on the display unit while shifting the display position according to the progress of the image processing in the image processing unit.

The invention according to claim 2 is the imaging apparatus according to claim 1,
The REC view generation unit displays a REC view based on image data obtained by image processing of one intermediate stage other than the final stage among the image processing of the at least two stages of the image processing unit. It is a feature.

The invention according to claim 3 is the imaging apparatus according to claim 2,
The REC view generation unit displays another REC view based on the target image obtained by the final stage image processing among the at least two stages of image processing of the image processing unit. It is.

The invention according to claim 4 is the imaging apparatus according to claim 2 or 3,
The image processing unit includes a basic image processing unit that performs basic image processing for reproducing a captured image on the RAW image data, and a special image processing unit that performs special image processing for adding a special effect to the reproduced captured image. The one intermediate stage image processing is the basic image processing.

The invention according to claim 5 is the imaging apparatus according to any one of claims 1 to 4,
When performing sequential imaging of a subject, the imaging unit sequentially generates RAW image data by the sequential imaging, and the image processing unit performs the image processing in parallel on the sequentially generated RAW image data. The REC view generation unit sequentially generates a REC view based on the sequentially generated RAW image data, and the image resizing processing unit generates an icon image corresponding to each of the sequential imaging, The display unit sequentially displays the sequentially generated REC views, and displays icon images corresponding to each of the sequential imaging in a direction in which the display position is shifted. .

The invention of the photographed image display method according to claim 6 for achieving the above object
Imaging a subject to generate RAW image data;
Displaying a REC view based on the RAW image data;
Subjecting the RAW image data to at least two stages of image processing to generate a target image;
Recording the generated target image,
In the step of generating the target image, an icon image is generated by sequentially reducing image data obtained by a plurality of stages of image processing among the at least two stages of image processing, and the icon image is converted into the image processing unit. In accordance with the progress of the image processing, the display position is sequentially displayed on the display unit while shifting the display position.

The invention according to claim 7 is the captured image display method according to claim 6,
The step of displaying the REC view is characterized in that the REC view is generated based on image data obtained by image processing at one intermediate stage other than the final stage among the at least two stages of image processing. It is.

The invention according to claim 8 is the captured image display method according to claim 7,
Of the at least two stages of image processing of the image processing section, there is a step of displaying another REC view based on the target image obtained by final stage image processing.

The invention according to claim 9 is the captured image display method according to claim 7 or 8,
The one intermediate stage image processing is basic image processing for reproducing a photographed image from the RAW image data, and the other image processing after the one intermediate stage image processing is specially performed on the reproduced photographed image. Special image processing for adding effects is included.

The invention according to claim 10 is the imaging display method according to any one of claims 6 to 9,
When performing sequential imaging of a subject, the step of generating the RAW image data sequentially generates RAW image data by the sequential imaging, and the step of displaying the REC view is performed on the sequentially generated RAW image data. The step of sequentially displaying REC views and generating the target image includes performing the image processing in parallel on the sequentially generated RAW image data and corresponding to each of the sequential imaging. And the icon images are displayed side by side in a direction in which the display position is shifted.

  According to the present invention, based on the RAW image data, the REC view generation unit that generates the REC view, and the image data obtained by the image processing in a plurality of stages of at least two stages of image processing are sequentially reduced, and the icon is displayed. An image resizing processing unit for generating an image, and the icon images are sequentially displayed on the display unit while shifting the display position according to the progress of the image processing in the image processing unit. It is an object of the present invention to provide an imaging apparatus and a captured image display method capable of confirming the rec view display and the progress of image processing in the same display mode in any of the shooting modes.

It is a block diagram which shows the structure of the imaging device to which the image display apparatus in embodiment of this invention is applied. 3 is a flowchart showing main processing performed by the imaging apparatus shown in FIG. 1. 3 is a flowchart showing details of still image shooting / image processing in FIG. 2. 3 is a flowchart showing details of moving image shooting / image processing in FIG. 2. 3 is a flowchart showing details of the reproduction process of FIG. 2. 4 is a flowchart showing details of still image processing / LCD display of FIG. 3. 6 is a flowchart showing details of still image processing / LCD display in FIG. 3, and a flowchart showing a method different from FIG. 6A. 5 is a flowchart showing details of the moving image processing / LCD display of FIG. 4. It is a figure explaining the display area of the display panel at the time of still image photography. It is a figure which shows an example of the display image when a to-be-photographed object image is single-shot using the imaging device of FIG. It is a figure which shows another example of the display image when a to-be-photographed object image is single-shot using the imaging device of FIG. It is a figure which shows an example of the display image when a to-be-photographed object image is continuously taken using the imaging device of FIG.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram illustrating a configuration of a digital still camera (imaging device) to which the image display device according to the present embodiment is applied. The digital still camera shown in FIG. 1 includes a camera body 1 and an interchangeable lens 2. The digital still camera according to the present embodiment can perform a processing process called “diorama” to blur the periphery of the subject as a special image processing function. In the present application, an image that has been subjected to special image processing such as “diorama” by user setting is referred to as a target image.

  The interchangeable lens 2 includes a lens 1010, a flash memory 1011, a microcomputer 1012, a driver 1013, and a diaphragm 1014. The interchangeable lens 2 is communicably connected to the camera body 1 via the I / F 999.

  The camera body 1 includes a mechanical shutter 101, an image sensor 102, an analog processing unit 103, an analog / digital conversion unit 104 (hereinafter, A / D conversion unit 104), a bus 105, an SDRAM 106, and a basic image processing unit. 107, AE processing unit 108, AF processing unit 109, image compression / decompression unit 110, memory interface 111 (hereinafter referred to as memory I / F 111), storage medium 112, LCD driver 113, LCD 114, and microcomputer 115, an operation unit 116, a flash memory 117, a special image processing unit 118, an image resizing processing unit 119, and a REC view generation unit 120.

  Here, the imaging unit includes an imaging element 102, an analog processing unit 103, and an A / D conversion unit 104. The image processing unit includes a basic image processing unit 107 and a special image processing unit 118. Further, the LCD 114 constitutes a display unit.

  The lens 1010 focuses the optical image of the subject on the image sensor 102. The lens 1010 may be a short focus lens or a zoom lens.

  The microcomputer 1012 is connected to the I / F 999, the flash memory 1011 and the driver 1013. The microcomputer 1012 reads and writes information stored in the flash memory 1011 and controls the driver 1013. Information stored in the flash memory 1011 includes data on the focal length of the interchangeable lens 2 and the like.

  The microcomputer 1012 can further communicate with the microcomputer 115 via the I / F 999, transmits various information to the microcomputer 115, and receives information such as an aperture value from the microcomputer 115.

  In response to an instruction from the microcomputer 1012, the driver 1013 drives the lens 1010 to change the focal length and focus position, and drives the aperture 1014. The aperture 1014 is provided in the vicinity of the lens 1010 and adjusts the amount of light of the subject.

  The mechanical shutter 101 is driven in response to an instruction from the microcomputer 115 to control the time for exposing the subject to the image sensor 102.

  The image sensor 102 is an image sensor in which a Bayer array color filter is arranged in front of a photodiode constituting each pixel. The Bayer array has a line in which R pixels and G (Gr) pixels are alternately arranged in a horizontal direction, and a line in which G (Gb) pixels and B pixels are alternately arranged, and the two lines are further divided. It is configured by alternately arranging in the vertical direction. The imaging element 102 receives the light collected by the lens 1010 by a photodiode that constitutes a pixel and performs photoelectric conversion, and outputs the amount of light to the analog processing unit 103 as a charge amount. The image sensor 102 may be a CMOS type or a CCD type.

  The analog processing unit 103 performs waveform shaping on the electrical signal (analog image signal) read from the image sensor 102 while reducing reset noise and the like, and further increases the gain so that the target brightness is obtained. . The A / D conversion unit 104 converts the analog image signal output from the analog processing unit 103 into a digital image signal (hereinafter referred to as image data). Hereinafter, the image data before being subjected to image processing after being converted by the A / D conversion unit 104 is referred to as RAW image data.

  A bus 105 is a transfer path for transferring various data generated in the digital camera to each unit in the digital camera. The bus 105 includes an A / D conversion unit 104, an SDRAM 106, a basic image processing unit 107, an AE processing unit 108, an AF processing unit 109, an image compression / decompression unit 110, a memory I / F 111, and an LCD driver 113. And a microcomputer 115, a special image processing unit 118, an image resizing unit 119, and a REC view generating unit 120.

  The RAW image data output from the A / D conversion unit 104 is temporarily stored in the SDRAM 106 via the bus 105. The SDRAM 106 temporarily stores various data such as RAW image data obtained by the A / D conversion unit 104 and image data processed by the basic image processing unit 107, the image compression / decompression unit 110, and the special image processing unit 118. Is a storage unit.

  The basic image processing unit 107 includes an optical black subtraction unit 1071 (hereinafter referred to as OB subtraction unit 1071), a white balance correction unit 1072 (hereinafter referred to as WB correction unit 1072), a synchronization processing unit 1073, a color matrix calculation unit 1074, gamma / color. A reproduction processing unit 1075, an edge enhancement processing unit 1076, and a noise reduction processing unit 1077 (hereinafter referred to as NR processing unit 1077) are included, and various image processing is performed on the image data read from the SDRAM 106.

  The OB subtraction unit 1071 performs optical black subtraction processing (hereinafter referred to as OB subtraction processing) on the image data. The OB subtraction process is a process of subtracting an optical black value (hereinafter referred to as an OB value) caused by a dark current of the image sensor 102 from a pixel value of each pixel constituting image data.

  The WB correction unit 1072 performs a process of correcting the white balance by multiplying the image data by a white balance gain corresponding to the white balance mode. The white balance mode can be set by the user in accordance with a light source such as sunny weather, cloudy weather, a light bulb, and a fluorescent light.

  The synchronization processing unit 1073 performs processing for converting image data based on the Bayer array into image data composed of R, G, and B information per pixel. Here, a color component that does not exist in the pixel is compensated by a complementing process from surrounding pixels. The color matrix calculation unit 1074 corrects the color of the image data by performing linear conversion on the image data by reading out and multiplying the color matrix coefficients corresponding to the set white balance mode from the flash memory 117. The gamma / color reproduction processing unit 1075 performs gamma correction processing and color reproduction processing for changing the color of an image.

  The edge enhancement processing unit 1076 uses a bandpass filter to extract edge components from the image data, multiply the extracted edge component data by a coefficient corresponding to the degree of edge enhancement, and then add it to the image data. Then, processing for enhancing the edge of the image data is performed.

  The NR processing unit 1077 performs processing for reducing noise by processing using a filter that reduces high frequency, coring processing, and the like.

  The image data after each processing is performed by the basic image processing unit 107 is stored in the SDRAM 106.

  The AE processing unit 108 calculates subject luminance from the image data. The data for calculating the subject brightness may be an output of a dedicated photometric sensor. The AF processing unit 109 extracts a high-frequency component signal from the image data, and acquires a focus evaluation value by AF (Auto Focus) integration processing.

  When still image data is recorded, the image compression / decompression unit 110 reads the image data from the SDRAM 106, compresses the read image data according to the JPEG compression method, and temporarily stores the compressed JPEG image data in the SDRAM 106. The microcomputer 115 creates a JPEG file by adding a JPEG header necessary for constructing a JPEG file to the JPEG image data stored in the SDRAM 106, and sends the created JPEG file via the memory I / F 111. To the recording medium 112.

  The image compressing / decompressing unit 110 also reads out the moving image data from the SDRAM 106 when recording the moving image data. The compressed moving image data is temporarily stored in the SDRAM 106 after being compressed according to the H.264 system. The image compression / decompression unit 110 further performs a process of decompressing (decompressing) the compressed data based on a command from the microcomputer 115.

  The recording medium 112 is, for example, a recording medium including a memory card that can be attached to and detached from the camera body 1, but is not limited thereto.

  The LCD driver 113 includes a display image processing unit (not shown), and causes the LCD 114 to display an image based on the image data temporarily stored in the SDRAM.

  Here, the display of the image includes a REC view display that displays the image data immediately after shooting for a short time, a playback display of the JPEG file stored in the recording medium 112, and a display of moving images such as a live view display. . When reproducing the compressed data recorded on the recording medium 112, the image compression / decompression unit 110 reads out the compressed data recorded on the recording medium 112, performs decompression (decompression) processing, and then temporarily decompresses the decompressed data. It is stored in the SDRAM 106. The LCD driver 113 reads the decompressed data from the SDRAM 106, converts the read data into a video signal, and then outputs it to the LCD 114 for display.

  The microcomputer 115 having a function as a control unit comprehensively controls various sequences of the digital camera body 1. An operation unit 116 and a flash memory 117 are connected to the microcomputer 115.

The operation unit 116 is an operation member such as a power button, a release button, a moving image button, a playback button, a special image processing mode selection button, and various input keys. When one of the operation members of the operation unit 116 is operated by the user, the microcomputer 115 executes various sequences according to the user's operation. The power button is an operation member for instructing power on / off of the digital camera. When the power button is pressed, the power of the digital camera is turned on. When the power button is pressed again, the digital camera is turned off. The release button has a two-stage switch of a first release switch and a second release switch. When the release button is pressed halfway and the first release switch is turned on, the microcomputer 115 performs a shooting preparation sequence such as AE processing and AF processing. Further, when the release button is fully pressed and the second release switch is turned on, the microcomputer 115 performs shooting by executing a shooting sequence.

  The playback button is a button for causing the LCD 114 to display a still image or a moving image obtained by shooting.

  The movie button is a button for starting and ending movie shooting. Since the moving image is not yet shot in the initial state, when the moving image button is pressed in this state, moving image shooting starts. When the moving image button is pressed during moving image shooting, moving image shooting ends. Therefore, every time the moving image button is pressed, the start and end of moving image shooting are alternately repeated.

  The special image processing mode selection button is a button for selecting whether or not to perform special image processing on a captured image and what kind of special visual image processing is performed. In the present embodiment, an image processing mode called “diorama” that blurs the periphery of the subject can be selected.

  Note that instead of the above-described playback button, moving image button, and special image processing mode selection button, the LCD 114 may be a touch panel type to instruct shooting, playback, mode selection, and the like from the LCD.

  The flash memory 117 includes various parameters necessary for operation of the digital camera such as a white balance gain, a color matrix coefficient, and a low-pass filter coefficient according to the white balance mode, noise data of a granular pattern resembling a granular feeling due to silver salt particles, and A serial number for specifying a digital still camera is stored. The flash memory 117 also stores various programs executed by the microcomputer 115. The microcomputer 115 reads parameters necessary for various sequences from the flash memory 117 according to a program stored in the flash memory 117, and executes each process.

  The special image processing unit 118 includes a low-pass processing unit 1181 and an image composition unit 1182, and reads out image data processed by the basic image processing unit 107 from the SDRAM 106 when the special image processing mode is selected by the user. Then, processing according to the selected image processing mode is performed to generate a desired target image.

  The low-pass processing unit 1181 performs low-pass processing on the image data read from the SDRAM 106 according to an instruction from the microcomputer 115, blurs the image, and stores the image in the SDRAM 106. The image synthesis unit 1182 synthesizes two image data stored in the SDRAM 106 according to the coordinates in accordance with an instruction from the microcomputer 115. The synthesized image data is stored in the SDRAM 106.

  The image resizing processing unit 119 performs a reduction process for reducing the number of pixels on the image data read from the SDRAM 106 to generate an icon image. The image reduction process can be performed by a known method such as pixel thinning. The icon image generated by the image resizing processing unit 119 is stored in the SDRAM 106.

  The REC view generation unit 120 reads out the image data after each image processing is performed by the basic image processing unit 107 from the SDRAM 106, performs processing such as reducing the number of pixels, and generates an image for REC view display on the LCD 114. To do. The REC view generation unit 120 can also read out the image data after the special image processing is performed by the special image processing unit 118 from the SDRAM 106 and generate an image for REC view display on the LCD 114.

  FIG. 2 is a flowchart showing main processing performed by the digital still camera shown in FIG. When the user presses the power button to turn on the digital still camera, the microcomputer 115 starts the process of step S101.

  In step S101, the recording flag is initialized to off. The recording flag is a flag that is turned on during moving image shooting and turned off when no moving image is shot.

  In step S102, it is determined whether or not the playback button has been operated by the user. If it is determined that the play button has been operated, the process proceeds to step S103. If it is determined that the play button has not been operated, the process proceeds to step S104.

  In step S103, processing for reproducing a still image or a moving image obtained by shooting is performed. Details of the reproduction process will be described later with reference to FIG.

  In step S104, it is determined whether or not the moving image button has been operated by the user. If it is determined that the movie button has been operated, the process proceeds to step S105. If it is determined that the movie button has not been operated, the process proceeds to step S106.

  In step S105, the recording flag is reversed, and the process proceeds to step S106. As described above, every time the video button is pressed, the video recording start and end are alternately repeated. Therefore, in this step, if the recording flag is off, it is on, and if it is on, Turn off and invert the recording flag.

  In step S106, it is determined whether the recording flag is on. If it is determined that the recording flag is on, the process proceeds to step S112. If it is determined in step S112 that moving image recording is in progress, image processing and image compression are performed on the moving image data based on the image signal from the image sensor 102, and then recorded on the recording medium 112. If it is determined that the moving image recording is not in progress, a live view display for determining a subject composition and shutter timing in still image shooting is performed. Details of the moving image shooting / image processing in step S112 will be described later with reference to FIG.

  On the other hand, if it is determined in step S106 that the recording flag is OFF, the process proceeds to step S107. In step S107, it is determined whether or not the user has pressed the release button halfway to turn on the first release switch. If it is determined that the first release switch is turned on, the process proceeds to step S108.

  In step S108, AE processing is performed. Specifically, the AE processing unit 108 calculates subject brightness, and refers to the exposure condition determination table stored in the flash memory 117 based on the calculated subject brightness, so that the ISO sensitivity at the time of shooting, the aperture , And determine the shutter speed.

  In step S109, AF processing is performed. Specifically, first, the AF processing unit 109 calculates a focus evaluation value. The microcomputer 115 issues a command for driving the lens 1010 to the driver 1013 based on the focus evaluation value. Based on this command, the driver 1013 drives the lens 1010 to change the focal length and the focus position.

  If the first release switch is not turned on in step S107, or if the first release switch remains on, the process proceeds to step S110. In step S110, it is determined whether or not the user has fully pressed the release button to turn on the second release switch. If it is determined that the second release switch is turned on, the process proceeds to step S111. If it is determined that the second release switch is not turned on, the process proceeds to step S112.

  In step S111, still image shooting and image processing are performed. Details of the still image shooting / image processing will be described later with reference to FIG.

In step S113, it is determined whether the power of the digital still camera is turned off. If it is determined that the power is not turned off, the process returns to step S102 and the above-described processing is performed.
On the other hand, when the power button is pressed by the user and the power is turned off, the process of the flowchart is ended.

  As described above, in the main flow in the present embodiment, the still image shooting mode is set in the initial setting. In this state, steps S102 → S104 → S106 → S107 → S110 → S112 → S113 → S102 are sequentially executed. Perform live view display. If the release button is pressed halfway during live view display, an AE operation is performed in step S108, and an AF operation is performed in step S109. If the release button is fully pressed, a still image is taken in step S111. When the moving image button is pressed, the recording flag is turned on in step S105, and moving image shooting is continued by repeatedly executing steps S106 → S112 → S113 → S102 → S104 → S106. If the moving image button is pressed again in this state, the recording flag is turned off in step S105, and the flow returns to the still image flow described above.

  FIG. 3 is a flowchart showing details of the processing in step S111 of the flowchart shown in FIG. 2, that is, details of still image shooting / image processing. Still image shooting is executed in a single shooting mode or a continuous shooting mode set in advance by the user.

  In step S201, it is checked whether or not the SDRAM 106 has an area for temporarily storing image data to be shot. If there is a vacancy, this process ends immediately. If there is no space, the process waits until an area for storing image data that is no longer needed after image processing is completed, and the area is set as a space area. This prevents a buffer shortage during continuous shooting.

  In step S202, shooting is performed. The shooting (still image shooting) is the same as a conventionally used method. The driver 1013 drives the aperture 1014 so as to achieve a set aperture value based on an instruction from the microcomputer 1012. Based on the determined shutter speed, shooting is performed by controlling the mechanical shutter 101 to obtain an image corresponding to the determined ISO sensitivity.

  In step S203, various still image processes are performed on the RAW image data (Bayer data) obtained in step S202 and displayed on the LCD 114. Details of the still image processing / LCD display will be described later with reference to FIGS. 6A and 6B.

  In step S204, the image compression / decompression unit 110 performs JPEG compression on the image data subjected to the image processing in step S203, adds header information such as the image size and shooting conditions, and generates a JPEG file.

  In step S205, the JPEG file generated in step S204 is recorded on the recording medium 112 via the memory I / F 111.

  In step S206, when the special image processing mode is selected, the display of the icon image displayed on the LCD in step S203 is terminated based on the flowchart of FIG. 6A as described later. When the icon display ends, the user can know that all the steps from shooting (step S202) to JPEG file recording (step S205) have ended.

  When a plurality of still images are continuously shot in the continuous shooting mode, the shooting in step S202 is continuously performed, still image processing / LCD display (step S203) of each shooting, generation and recording of a JPEG file (step S203). Steps S204 and S205) and the end of icon display (step S206) are sequentially executed in parallel for each image data obtained by continuous shooting.

  FIG. 4 is a flowchart showing details of the process in step S112 of the flowchart shown in FIG. 2 and moving image shooting / image processing. This flowchart also includes processing for displaying a live view. Note that moving image processing is performed on an image with a reduced number of pixels compared to still image processing.

  In step S301, AE processing is performed. This process is the same as the process of step S108 in the flowchart shown in FIG.

  In step S302, shooting is performed. The shooting (moving image shooting) is the same as a conventionally used method. That is, shooting is performed by controlling a so-called electronic shutter based on the determined aperture, shutter speed, and ISO sensitivity.

  In step S303, various image processes are performed on the RAW image data (Bayer data) obtained in step S302 and displayed on the LCD 114. Details of the moving image processing / LCD display will be described later with reference to FIG.

  On the other hand, in step S304, it is determined whether a moving image is being recorded. If the recording flag is off, it is determined that the moving image is not being recorded, and the processing of this flowchart is terminated. If the recording flag is on, it is determined that the moving image is being recorded, and step S305 is performed. Proceed to

  In step S305, a moving image file is generated and recorded on the recording medium 112. That is, the image compression / decompression unit 110 compresses the image data according to the format of the moving image file, adds predetermined header information, and generates a moving image file. The compression format of the moving image file includes “H.264”, “Motion JPEG”, “MPEG”, and the like. Then, the generated moving image file is recorded on the recording medium 112 via the memory I / F 111.

  FIG. 5 is a flowchart showing details of the process in step S103 of the flowchart shown in FIG. 2, that is, the reproduction process.

  In step S401, an image file to be displayed on the LCD 114 is determined based on the operation of the operation unit 116 by the user. When the user presses the play button, the moving image file and still image file recorded on the recording medium 112 are displayed as a list (thumbnail display) on the LCD 114. For video files, the first frame image is displayed as a thumbnail. The user selects a file to be displayed on the LCD 114 by operating a cross key included in the operation unit 116. The selected file is determined as an image file to be displayed on the LCD 114.

  In step S402, it is determined whether or not the image file determined in step S401 is a moving image file. If it is determined that the file is not a moving image file but a still image file, the process proceeds to step S409.

  In step S409, the image compression / development unit 110 acquires image data to be displayed on the LCD 114 by selecting and expanding the still image file determined in step S401 from the files recorded on the recording medium 112. .

  In step S410, the LCD driver 113 causes the LCD 114 to display the image data acquired in step S409.

  On the other hand, if it is determined in step S402 that the image file determined in step S401 is a moving image file, the process proceeds to step S403. In step S403, information on the number of frames included in the header information of the moving image file is acquired.

  In step S404, the parameter N for counting the number of frames is set to an initial value of 1.

  In step S405, the image compression / decompression unit 110 selects the moving image file determined in step S401 from the files recorded in the recording medium 112, and performs a process of expanding the Nth frame image data.

  In step S406, the LCD driver 113 causes the LCD 114 to display the Nth frame of image data acquired in step S405.

  In step S407, 1 is added to the parameter N, and the process proceeds to step S408.

  In step S408, it is determined whether the parameter N is larger than the number of frames of the moving image file. If it is determined that the parameter N is equal to or less than the number of frames of the moving image file, the process returns to step S405 to develop the image data of the next frame (step S405) and display it on the LCD 114 (step S406). On the other hand, when it is determined that the parameter N is larger than the number of frames of the moving image file, the reproduction process is terminated.

  FIG. 6A is a flowchart showing details of the processing in step S203 of the flowchart shown in FIG. 3, that is, the details of the development processing of the RAW image data captured during still image capturing and the display on the LCD.

  In step S501, the OB subtraction unit 1071 performs OB subtraction processing for subtracting the OB value obtained at the time of imaging from the RAW image data obtained by imaging.

  In step S502, the WB correction unit 1072 performs a process of correcting the white balance by multiplying the image data subjected to the OB subtraction process by a white balance gain corresponding to the white balance mode. Note that the white balance mode can be set for each shooting by the user operating an input key included in the operation unit 116. The microcomputer 115 sets the white balance mode based on the operation of the operation unit 116 by the user. When the digital still camera has an auto white balance function that automatically adjusts the white balance, the microcomputer 115 automatically sets a white balance mode in accordance with the light source at the time of shooting.

  In step S503, the synchronization processing unit 1073 performs synchronization processing on the image data that has been subjected to the white balance correction processing.

  In step S504, the color matrix calculation unit 1075 reads the color matrix coefficient corresponding to the white balance mode from the flash memory 117 and multiplies the image data on which the synchronization processing has been performed.

  In step S505, the gamma / color reproduction processing unit 1074 performs gamma correction processing and color reproduction processing for changing the color of the image on the image data on which the color matrix calculation has been performed.

  In step S506, the edge enhancement processing unit 1076 performs edge enhancement processing on the image data that has been subjected to gamma correction processing and color reproduction processing.

  In step S507, the REC view generation unit 120 performs gradation processing and color reproduction processing that are basic for reproducing the subject image by the above-described image processing, and stores the image data stored in the SDRAM 106, that is, an intermediate-stage image. The image data obtained by the processing is read from the SDRAM 106 to generate a REC view, and the REC view is displayed on the LCD for a predetermined time under the control of the microcomputer 115.

  In step S508, the NR processing unit 1077 performs noise reduction processing (hereinafter also referred to as NR processing) on the image data on which the edge enhancement processing has been performed. In the NR process, a coring process based on a coring parameter or a process using a filter that reduces high frequencies is performed based on a noise reduction parameter.

  In step S509, based on the state of the special image processing mode selection button on the digital still camera body, it is determined whether or not the special image processing mode is selected. When the special image processing mode (for example, “diorama”) is selected, the process proceeds to step S510 to execute special image processing. If special image processing is not selected, the processing ends and the process returns to the flowchart of FIG.

  In step S510, the image resizing processing unit 119 reduces the image data after the NR processing, creates an icon image, and displays it on a part of the display panel of the LCD 114, for example, in the lower left area.

  In step S511, the image data after NR processing obtained in step S508 is subjected to low-pass processing to generate a blurred image.

  In step S512, the image data immediately after the NR process obtained in step S508 and the image data subjected to the low pass process obtained in step S511 are combined. At that time, the image is synthesized so that the weight of the image immediately after the NR processing is high in the central portion of the image and the weight of the low-pass processed image is high in the peripheral portion.

  In step S513, the image data synthesized in step S512 is reduced to create an icon image. Further, this icon image is displayed at a position shifted to the right from the position of the icon image displayed at step S510, instead of the icon image displayed at step S510.

  In step 514, the image data after NR processing obtained in step S508 is subjected to low-pass processing to generate a blurred image. At this time, the image is more blurred than the image obtained by the low-pass processing in step S511.

  In step S515, the image data of the synthesized image obtained in step S512 and the image data subjected to the low-pass process obtained in step S514 are synthesized. At that time, the image is synthesized so that the weight of the synthesized image is high in the central part of the image and the low-pass processed image is high in the peripheral part. The image is synthesized so that the range in which the weight of the low-pass processed image is higher than the image synthesis in step S512 is only the peripheral portion of the image.

  In step S516, the image data combined in step S515 is reduced to create an icon image. Further, this icon image is displayed at a position shifted to the right from the position of the icon image displayed at step S513, instead of the icon image displayed at step S513. After step S516 is completed, the process returns to the flowchart of FIG.

  FIG. 6B is a flowchart showing the process of step S203 of the flowchart shown in FIG. 3, and is a flowchart showing a method different from FIG. 6A. This flowchart is obtained by replacing steps S507, S510, S513, and S516 with steps S507 ', S510', S513 ', and S516' in the flowchart of FIG. 6A, respectively. The other steps are the same as those in the flowchart shown in FIG.

  In step S507 ′, the image resizing processing unit 119 reduces the image data after the edge enhancement processing (step S506) to create an icon image, and this icon image is displayed on a part of the display panel of the LCD 114, for example, lower left. Display in the sub-area. In step S510 ′, the image resize processing unit 119 reduces the image data after the NR processing (step S508) to create an icon image, and replaces the icon image displayed in step S507 ′ with the icon image. The icon image displayed in step S507 ′ is displayed at a position shifted to the right side. In step S513 ′, the image resizing processing unit 119 reduces the image data after the first image composition processing (step S512) of the special image processing to create an icon image. The icon image is generated in step S510 ′. Instead of the displayed icon image, the icon image is displayed at a position shifted to the right from the position of the icon image displayed in step S510 ′.

  In step S516 ′, the REC view generation unit 120 generates a REC view from the image data that has been subjected to the second image composition processing (step S515) of the special image processing, and ends the display of the icon image displayed in step S513 ′. The REC view is displayed on the LCD for a predetermined time under the control of the microcomputer 115.

  As described above, in the flowcharts of FIGS. 6A and 6B, the captured RAW image data is subjected to steps S501 to S506 and S508 (hereinafter, a series of processing is referred to as basic image processing) to reproduce the subject image. Generate image data. Further, when the special image processing mode is selected, special image processing including low-pass processing and image synthesis is performed on the image data in two stages, and the purpose of the “diorama” in which the peripheral image is blurred Generate an image. That is, there are at least basic image processing and special image processing stages until the target image is obtained from the RAW image data, and the special image processing stage is composed of two stages of image processing. Further, according to the flowchart of FIG. 6A or 6B, the icons of the image data are sequentially displayed on the LCD 114 while being shifted to the right as the basic image processing and the special image processing progress (steps S510, S513, and S13). S516; Steps S507 ′, S510 ′, S513 ′). The icon display in step S516 in the flowchart in FIG. 6A is deleted in step S206 in FIG. 3 when the recording of the image on the recording medium 112 is completed.

  In the method of FIG. 6A, since the REC view display is performed in the middle of the basic image processing, the angle of view in continuous shooting or the like can be confirmed on the entire screen. In the method of FIG. 6B, since the REC view display is performed when the image processing is completed, the final image can be confirmed on the entire screen. In any of the methods, the user can grasp the progress of processing from the position of the icon, and can confirm the angle of view of the photographing result and the processing result from the icon image.

  When a plurality of still images are shot in the continuous shooting mode, the processes in the flowcharts of FIGS. 6A and 6B are processed in parallel for each shot image data.

  FIG. 7 is a flowchart showing details of the processing in step S303 of the flowchart shown in FIG. 4, that is, the details of the development processing of moving image data shot during moving image shooting and display on the LCD.

  Each processing in steps S601 to S607 is basic image processing for generating image data obtained by reproducing a subject image from RAW image data, and is the same as steps S501 to S506 and S508 in the flowchart of FIG. . In the flowchart of FIG. 7, unlike the flowchart shown in FIG. 6A, the REC view display after image data generation by basic image processing is not performed.

  In step S608, based on the state of the special image processing mode selection button on the digital still camera body, it is determined whether or not the special image processing mode is selected. When the special image processing mode (for example, “diorama”) is selected, the process proceeds to step S609 to execute special image processing. If special image processing is not selected, the process proceeds to step S613.

  Steps S609 to S612 are steps for performing special image processing on the image data reproduced by the basic image processing, and are the same as steps S511, S512, S514, and S515 in the flowchart of FIG. As a result, a target image of “diorama” in which the peripheral image is blurred is generated. Unlike the flowchart in the case of the still image of FIG. 6A, no icon is generated / displayed after the image compositing process (steps S610 and S612). Note that the moving image is processed in a shorter time than the processing of the still image because the processing is performed on a smaller number of pixels than the still image.

  In step S613, image data not subjected to special image processing when the special image processing mode is not selected or image data immediately after special processing when the special image processing mode is selected is stored on the LCD 114. Display and return to the process of FIG.

  Therefore, at the time of live view display or moving image shooting, a moving image reproduced by basic image processing or a moving image subjected to special image processing is displayed on the LCD 114 in accordance with the selection of the special image processing mode.

  Next, a method for displaying an image on the liquid crystal panel of the LCD 114 when the special image capturing mode is selected will be described with reference to the examples shown in FIGS.

  FIG. 8 is a diagram illustrating a display area of the liquid crystal panel. The lower side of the display area of the liquid crystal panel 1141 is an icon display area 1142. As the special image processing progresses, the displayed sequential icons are displayed at positions shifted sequentially from left to right in this area.

  FIG. 9A is a diagram showing an example of a display image when a subject image is single-shot using the digital still camera of FIG. 1, and shows a case where still image processing / LCD display is performed according to the flowchart of FIG. 6A. For example, when a still image of a subject such as a person is captured, the processing of S501 to S506 in FIG. 6A is performed on the captured RAW image data, and then, based on the generated image data, as illustrated in FIG. 9A (a). The REC view for a predetermined time is displayed on the liquid crystal panel 1141 (step S507). Since the REC view display is displayed without waiting for completion of the special image processing after the basic image processing (except for the NR processing), the REC view display is displayed promptly after photographing regardless of the contents of the special image processing.

  Thereafter, as shown in FIG. 9A (b), the generated icon is displayed at the left end of the icon display area 1142 of the liquid crystal panel 1141 for the image data on which the NR process has been performed (step S510 in FIG. 6). The REC view display is switched to the live view display when a predetermined time has elapsed. At this time, the icon is displayed over the live view display displayed on the LCD in step S613 in FIG.

  Further, as shown in FIGS. 9A (b) and 9 (c), as each stage of special image processing progresses, an icon of the special processing image at each stage is generated, and sequentially replaced with the icons already displayed. It is displayed at a position shifted in the direction (steps S510, S513, S516 in FIG. 6).

  When all the special image processing is completed and the image data of the target image is recorded on the recording medium 112 (step S205 in FIG. 3), the last remaining icon is deleted (step S206 in FIG. 3). Thereby, the user can confirm the impression of the image after the special image processing without changing the mode of the digital still camera to the mode for image reproduction.

  FIG. 9B is a diagram showing another example of a display image when a subject image is single-shot using the digital still camera of FIG. 1, and shows a case where still image processing / LCD display is performed according to the flowchart of FIG. 6B. For example, when a still image of a subject such as a person is photographed, the photographed RAW image data is subjected to the processing of S501 to S506 in FIG. 6B and then based on the generated image data as shown in FIG. 9B (a). An icon image is displayed at the left end of the icon display area 1142 of the liquid crystal panel 1141 (step S507 ′).

  Thereafter, along with the progress of each stage of image processing, the image data subjected to the NR process (step S508) and the image data after the first image synthesis (step S512) are sequentially performed in each stage. An icon is generated and displayed at a position shifted to the right in order to replace the already displayed icon (S510 ′, S513 ′). The icon display corresponding to step S513 'in FIG. 6B is as shown in FIG. 9B (b).

  Further, when the second image synthesis of the special image processing (step S515) is completed, as shown in FIG. 9B (c), the rec view is displayed together with the icon displayed in FIG. 9 (b) based on the generated special image. Is displayed on the liquid crystal panel 1141 (step S516 ′). Further, as shown in FIG. 9B (d), the icon display is ended, and after a predetermined time has elapsed from the start of the REC view display, the liquid crystal panel 1141 becomes a live view display as shown in FIG. 9B (e).

  On the other hand, FIG. 10 is a diagram showing an example of a display image when subject images are continuously shot using the digital still camera of FIG. 1, and shows a case where still image processing / LCD display is performed according to the flowchart of FIG. 6A. In this example, it is assumed that the continuous shooting time interval is shorter than the REC view display time, and the subject person moves to the right as viewed from the front of the digital still camera along with the continuous shooting.

  FIG. 10A shows the REC view display after the first continuous shooting is performed (step S507). Next, when the second image is taken, as shown in FIG. 10B, the first REC view display is interrupted and the REC view of the second image is displayed on the liquid crystal panel 1141. . At this time, an icon obtained by reducing the image data of the first photographed image is displayed in the icon display area 1142 (step S510). Further, when the third image is taken, a rec view of the third image is displayed on the liquid crystal panel 1141, as shown in FIG. Also, icons obtained by reducing the first and second captured images according to the image processing stage are displayed in the icon display area 1142 (step S510 in FIG. 6A). Each of these icons corresponds to a photographed image that has not been recorded with special image processing after photographing, and the icon corresponding to each photographed image is image-processed as in the case of single shot. As it progresses, it will be shifted to the right. That is, in the case of continuous shooting, basic image processing and special image processing are processed in parallel for each captured image data, and a progress display of image processing using a plurality of icons is performed.

  Thereafter, when the continuous shooting is finished, after the REC view of the last shooting is displayed for a predetermined time, as shown in FIG. 10D, the display on the liquid crystal panel 1141 becomes a live view display (S613 in FIG. 7). Further, the icon of the photographed image being processed is continuously displayed in the icon display area 1142. As shown in FIGS. 10 (e) to 10 (g), these icons are sequentially shifted to the right as the special image processing of the corresponding captured image data proceeds, and the JPEG file is recorded on the recording medium 112 ( In FIG. 3, step S205) is completed, and then erased sequentially.

  Thereby, even in the case of continuous shooting, the progress of special image processing for a plurality of shootings can be confirmed together with the image being processed by the icon image displayed on the LCD 112.

  According to the present embodiment, when the basic image processing unit after shooting generates image data subjected to basic image processing, a subject image based on the image data is displayed on the LCD 112 as a rec view display, so that the special image processing mode is selected. Even in this case, the composition of the subject image can be quickly confirmed. Further, since the icon image based on the icon image data sequentially generated by the image resizing processing unit is sequentially displayed at the bottom of the display unit while shifting the display position according to the progress of the image processing in the image processing unit, In both the continuous shooting mode and the continuous shooting mode, it is possible to check the rec view display and the progress of the image processing by the same display mode.

  In addition, this invention is not limited only to the said embodiment, Many deformation | transformation or a change is possible. For example, the special image processing is not limited to “diorama”. Various special image processing such as images that mimic miniature photos and film photos, “pop art” that emphasizes colors, and “toy photos” that darken the surrounding area, as described in the background art, can be adopted. Is possible. In that case, the configuration of the special image processing unit differs depending on the special image processing mode employed.

  In the embodiment, the REC view is displayed after the edge enhancement processing of the basic image processing and after the special image processing. However, the present invention is not limited to this, and the REC view display is performed after image processing at any of a plurality of stages of the image processing. You may make it do. In this case, the REC views in a plurality of image processing stages may be sequentially switched without changing from the REC view display to the live view display.

  The display position of the icon image is not limited to the lower part of the liquid crystal panel of the LCD, but may be the upper part. The direction in which the icon image is shifted is not limited to the horizontal direction, and may be the vertical direction. Or you may shift so that it may draw an arc instead of linear.

  Each component of the digital still camera, for example, the basic image processing unit, the special image processing unit, the REC view generation unit, and the image resizing unit does not need to be formed by independent dedicated hardware. You may comprise so that one part or all part of a process may be performed.

  In addition, the first REC view display after imaging displays an image obtained by performing basic image processing for reproducing a subject image on RAW image data, but is not limited thereto. In addition to image reproduction for recording by the imaging device, an image for REC view display may be directly generated from RAW image data. The RAW image data is not limited to the Bayer array, but may be RGB data such as fobion.

DESCRIPTION OF SYMBOLS 1 Camera body 2 Interchangeable lens 101 Mechanical shutter 102 Image pick-up element 103 Analog processing part 104 Analog / digital conversion part 106 SDRAM
107 basic image processing unit 108 AE processing unit 109 AF processing unit 110 image compression / decompression unit 111 memory I / F
112 Recording medium 113 LCD driver 114 LCD
115 Microcomputer 116 Operation Unit 117 Flash Memory 118 Special Image Processing Unit 119 Image Resizing Processing Unit 120 Rec View Generation Unit 999 I / F
1010 Lens 1011 Flash Memory 1012 Microcomputer 1013 Driver 1014 Aperture 1071 OB Calculation Unit 1072 WB Correction Unit 1073 Synchronization Processing Unit 1074 Color Matrix Calculation Unit 1075 Gamma / Color Reproduction Processing Unit 1076 Edge Enhancement Processing Unit 1181 Low Pass Processing Unit 1182 Image Synthesis Unit

Claims (10)

An imaging unit for imaging a subject and generating RAW image data;
An image processing unit that performs at least two-stage image processing on the RAW image data and generates a target image;
A REC view generation unit that generates a REC view based on the RAW image data;
An image resizing processing unit that sequentially reduces image data obtained by image processing of a plurality of stages of the at least two stages of image processing and generates an icon image;
A display unit for displaying the REC view, the icon image, and the target image;
A recording unit for recording the target image generated by the image processing unit,
The imaging apparatus is characterized in that the icon images are sequentially displayed on the display unit while shifting the display position according to the progress of the image processing in the image processing unit.
  The REC view generation unit displays a REC view based on image data obtained by image processing of one intermediate stage other than the final stage among the at least two stages of image processing of the image processing unit. The imaging apparatus according to claim 1.   The REC view generation unit displays another REC view based on the target image obtained by final image processing among the at least two image processing steps of the image processing unit. Item 3. The imaging device according to Item 2.   The image processing unit includes a basic image processing unit that performs basic image processing for reproducing a captured image on the RAW image data, and a special image processing unit that performs special image processing for adding a special effect to the reproduced captured image. The image pickup apparatus according to claim 2, wherein the intermediate image processing is the basic image processing.   When performing sequential imaging of a subject, the imaging unit sequentially generates RAW image data by the sequential imaging, and the image processing unit performs the image processing in parallel on the sequentially generated RAW image data. The REC view generation unit sequentially generates a REC view based on the sequentially generated RAW image data, and the image resizing processing unit generates an icon image corresponding to each of the sequential imaging, The display unit sequentially displays the sequentially generated REC views, and displays icon images corresponding to the sequential imaging in a direction in which the display position is shifted. 5. The imaging device according to any one of items 1 to 4. Imaging a subject to generate RAW image data;
Displaying a REC view based on the RAW image data;
Subjecting the RAW image data to at least two stages of image processing to generate a target image;
Recording the generated target image,
In the step of generating the target image, an icon image is generated by sequentially reducing image data obtained by a plurality of stages of image processing among the at least two stages of image processing, and the icon image is converted into the image processing unit. A method of displaying a captured image, comprising: sequentially displaying on a display unit while shifting a display position in accordance with the progress of the image processing.   The step of displaying the REC view generates the REC view based on image data obtained by image processing at one intermediate stage other than the final stage among the at least two stages of image processing. Item 7. The captured image display method according to Item 6.   8. The method according to claim 7, further comprising a step of displaying another REC view based on the target image obtained by final image processing among the at least two image processing steps of the image processing unit. Method for displaying captured images.   The one intermediate stage image processing is basic image processing for reproducing a photographed image from the RAW image data, and the other image processing after the one intermediate stage image processing is specially performed on the reproduced photographed image. 9. The captured image display method according to claim 7, further comprising special image processing for adding an effect.   When performing sequential imaging of a subject, the step of generating the RAW image data sequentially generates RAW image data by the sequential imaging, and the step of displaying the REC view is performed on the sequentially generated RAW image data. The step of sequentially displaying REC views and generating the target image includes performing the image processing in parallel on the sequentially generated RAW image data and corresponding to each of the sequential imaging. The image display method according to any one of claims 6 to 9, wherein the icon images are displayed side by side in a direction in which the display position is shifted.

Images