JP4337758B2 - Imaging apparatus, still image display method during movie shooting, and program - Google Patents

Description

  The present invention relates to a still image display technique at the time of moving image shooting in which a moving image and a still image are distinguished and displayed on one screen when shooting a still image during moving image shooting.

  In recent years, digital cameras having a moving image shooting function are commercially available. In such a digital camera, a camera that can shoot a still image without stopping moving image shooting during moving image shooting has been proposed.

Patent Documents 1 to 3 listed below disclose a method of capturing a still image during moving image shooting with a digital camera. According to the method of Patent Document 1, a moving image is captured at a moving image frame period and stored in a buffer memory in accordance with a still image shooting operation during moving image shooting, while still recording the next moving image frame. Take a picture and record it.
That is, the moving image shooting process and the still image shooting process are performed in parallel. Patent Document 4 below discloses a method of changing the image quality without interrupting shooting while shooting a moving image in a digital camera.

In the method of Patent Document 2, when there is a still image shooting operation during moving image shooting, the shooting and storage operation of the moving image frame is temporarily interrupted, and during that time, the still image is shot and recorded. Resume memory.
That is, still image shooting is performed by interrupt processing. Then, when the movie shooting is finished, an interpolation frame corresponding to the movie frame of the interruption period that could not be recorded during the still image shooting is separately generated and stored, and when the movie is played back, the interpolation frame is used for the interruption period. As a result, still image shooting during moving image shooting can be performed.

  The method of Patent Literature 3 is a camera capable of shooting a moving image and a still image, and displays the moving image and the still image on the viewfinder so that they are distinguished from each other.

  The method of Patent Document 4 has a function of capturing a moving image, and inputs a command for changing the compression ratio of the image during moving image shooting in a digital camera that compresses and records the captured image. The image compression ratio is changed based on a command from the input unit during the input unit and moving image shooting. The bit rate is provided as an initial value from a bit rate register in which the bit rate is registered in advance or is input as a fluctuation value by pressing the recording button or the like. The longer the pressing time, the higher the image quality of the moving image. That's it.

Japanese Patent Laid-Open No. 11-55617 (see paragraphs “0010” and “0011”, FIG. 2) JP 2001-111934 A (see paragraphs “0029” to “0032”, FIG. 1 and FIG. 4) JP 2003-259161 A (refer to paragraphs “0010” to “0017”, FIGS. 2 and 4) JP 2000-270251 A (see paragraphs “0020” to “0039”, FIG. 3)

  However, in the technique described in Patent Document 1 or 2, a still image can be taken while a moving image is being taken, but no particular mention is made of a device for confirming the composition at the time of taking a picture.

Also, with the technology described in Patent Document 3, the photographer can shoot while constantly monitoring the difference in the area (composition) that can be captured for each still image and movie, so switch to standard movie shooting after taking a high-definition still image. This reduces the uncomfortable feeling of reducing the area (composition). -On the other hand, it is possible to reduce the uncomfortable feeling of area (composition) enlargement that occurs when you switch to high-definition still image shooting after shooting a movie, but you can change the angle of view between the movie and still image, and zoom in There was a problem that this was not expected.
For example, when shooting a child's concert, you may want to shoot the entire performance of the child's performance while you want to zoom in on your child and shoot a beautiful image, or you can shoot a sports competition relay video. In some cases, a child may want to shoot a still image with a different composition at a certain shooting opportunity. As described above, there is a problem that it is desired to shoot a still image with a composition different from that for moving image shooting.

  In the technique described in Patent Document 4, the image quality of a moving image can be changed during moving image shooting, but the image quality of a still image shot during moving image shooting is not assumed, and the bit rate is initially set. Manual setting other than the value is not assumed, and there is a problem that the image quality is not automatically switched when a still image is shot and displayed during moving image shooting.

  The present invention has been made to solve the above-described problems. When still image shooting is performed while changing the angle of view or zooming up during moving image shooting, the moving image and the still image are displayed separately on one screen. An object of the present invention is to provide an image pickup apparatus, a still image display method and a program for shooting a moving image.

In order to solve the above-described problem, in the invention described in claim 1, in an imaging apparatus that shoots a subject and generates and records the image data, subject images sequentially taken in accordance with a moving image shooting start instruction are used as moving image data. Moving image processing means for converting and sequentially storing in the work memory, still image processing means for converting a subject image captured by a still image shooting instruction into still image data and storing it in the work memory, and moving image zoom for instructing moving image zoom If there is an instruction means, a moving image zoom processing means for performing telephoto zoom processing or wide-side zoom processing according to the instruction contents of the moving image zoom instruction means, and a still image shooting instruction during moving image shooting, the moving image processing means A moving image acquisition unit that converts a subject image captured during shooting into moving image data having an image quality different from that of the still image, and the still image processing unit. A still image acquisition unit that converts a subject image captured by a still image shooting instruction into still image data having an image quality different from that of a moving image and stores the still image data in a work memory; the moving image data acquired by the moving image acquisition unit; Depending on the indication content of the display control means for distinguishing and displaying the still image data acquired by the still image acquisition means, the still image zoom instruction means for instructing the still image zoom, and the instruction content of the still image zoom instruction means, A still image zoom processing means for performing a wide side zoom process, and the display control means is acquired by the moving image acquisition means when the zoom instruction to the telephoto side is given by the still image zoom instruction means. The still image zoom is performed by overwriting the still image data acquired by the still image acquisition means on the moving image data to be displayed. If there is a zoom instruction to the wide side according indicate means, said stationary the still image data acquired by the image acquiring unit is overwriting the video image data obtained by the video image acquisition means to display images, it An imaging device is provided.
This makes it possible to shoot a still image having a composition different from that of the moving image during moving image shooting. Further, since the image quality of the still image is displayed as an image having an image quality different from that of the moving image at the time of shooting, it becomes easy to distinguish the moving image from the still image, and the composition of the still image to be displayed is easy to understand.
Also, when zoomed to the telephoto side, the display size of the still image is smaller than that of the moving image, so for example, a still image with a different image quality that is zoomed up to the center of the screen is displayed on the moving image displayed on the full screen. Since it can be displayed, a still image having a composition different from that of a moving image can be distinguished from the moving image, and is easy to understand.
Also, when zooming to the wide side, that is, zooming so that the still image is larger than the moving image, for example, the display size of the moving image is smaller than the still image, so that the still image displayed on the full screen is different. Since a high-quality moving image can be displayed at the center of the screen, a still image having a composition different from that of a moving image can be distinguished from the moving image, and is easy to understand.

Further, in the invention according to claim 2, the moving image acquisition unit converts the subject image captured during moving image shooting into the semi-transparent moving image data by the moving image processing unit, thereby having an image quality different from that of the still image. The imaging apparatus according to claim 1, further comprising means for obtaining moving image data .
Accordingly, since the moving image displayed when the still image is captured during moving image shooting is displayed in a semi-transparent manner, the moving image and the still image can be easily distinguished, and the composition of the still image displayed together with the moving image is easily understood.

According to a third aspect of the present invention, there is provided a still image display method at the time of moving image shooting in an image pickup apparatus that shoots a subject, generates image data thereof, and records the subject image, and is sequentially captured by a moving image shooting start instruction. Is converted into moving image data and sequentially stored in the work memory, and if there is a still image shooting instruction during moving image shooting, the subject image captured during moving image shooting is converted into moving image data having a quality different from that of the still image. The subject image captured by the still image shooting instruction is converted into still image data having an image quality different from that of the moving image, stored in the work memory, the still image data is overwritten and displayed on the moving image data, and there is a moving image zoom instruction. Depending on the content of the instruction, telephoto zoom processing or wide zoom processing is performed, and still image data and moving image data obtained as a result of zooming are displayed separately. Providing a still image display method for movie recording, wherein the door.
This makes it possible to shoot a still image having a composition different from that of the moving image during moving image shooting.
Further, since the image quality of the still image is displayed as an image having an image quality different from that of the moving image at the time of shooting, it becomes easy to distinguish the moving image from the still image, and the composition of the still image to be displayed is easy to understand.

According to the fourth aspect of the present invention, when there is an instruction to change the shooting range of the still image displayed on the moving image, still image data and moving image obtained by changing the shooting range of the still image are displayed. 4. The method of displaying still images during moving image shooting according to claim 3, wherein the data is displayed separately .
Thereby, since the shooting range of the still image can be moved, a still image different from the composition of the moving image can be displayed and shot during moving image shooting.

According to the fifth aspect of the present invention, moving image data having an image quality different from that of a still image is relatively low image quality moving image data, and still image data having an image quality different from that of a moving image is relatively high. The still image display method for moving image shooting according to claim 3, wherein the still image data is a still image data .
As a result, when shooting a movie, the still image displayed when the still image is shot is displayed as a higher quality image than the movie. The composition is easy to understand.

According to a sixth aspect of the present invention, there is provided the still image display method at the time of moving image shooting according to the third aspect, wherein the moving image data having an image quality different from that of the still image is translucent moving image data. To do.
Accordingly, when a moving image is shot, the moving image is displayed as a semi-transparent image when the still image is shot, so that it is easy to distinguish between the moving image and the still image, and the composition of the still image displayed together with the moving image is easy to understand.

According to a seventh aspect of the present invention, there is provided a program that causes an imaging apparatus to execute the still image display method during moving image photographing according to any one of the third to sixth aspects .
As a result, when taking a still image while changing the angle of view or zooming in during movie shooting , the imaging device simultaneously takes a still image with a composition different from the movie composition during movie shooting, and displays it on the same screen. It can be displayed separately.

  According to the present invention, when taking a still image during moving image shooting by changing the angle of view or zooming in, a still image having a composition different from the moving image composition is simultaneously shot during moving image shooting and displayed separately on the same screen. be able to.

FIG. 1 is a perspective view showing an appearance of a digital movie camera according to the present invention, FIG. 1 (a) is a perspective view, and FIG. 1 (b) is a view showing an example of arrangement of operation buttons (keys).
In FIG. 1A, reference numeral 10 denotes a main body of the digital movie camera 100, reference numeral 1 denotes a lens barrel, reference numeral 5 denotes a holder, reference numeral 15 denotes a voice input microphone, and reference numeral 111 denotes a photographing lens. The lens barrel 1 contains an optical system such as a photographing lens group with an optical zoom function, and an image of a subject is formed on the light receiving surface of an image sensor disposed at the rear end of the lens barrel 1. It is something to be imaged.

On the upper surface of the camera body 10, there are operation buttons such as a moving image zoom key 31, a still image zoom key 32, a moving image / recording start / stop button 33, a still image shooting shutter button 34, a still image, as shown in FIG. An image capturing end button 35, a cursor 36, and other various function buttons (not shown) are provided. In the illustrated example, the zoom keys 31 and 32 include a W button for instructing a wide side zoom and a T button for instructing a telephoto side zoom.
Also, instead of providing the still image shooting end button 35, the still image shooting shutter button 34 is configured to be pressed in two steps so that exposure is set in the first step and an image is captured (recorded) in the second step. Also good.

Although not shown on the right side of the camera body 10 (the back side in FIG. 1A), it is connected to the front side of the body 10 and a hinge member so as to be openable and closable, and electrically. Is connected to the main body 10 when the liquid crystal display screen is in the closed state, and is in close contact with the back with the liquid crystal display screen facing inward, and is integrated with the main body 10 in the open state. Can open up to 90 ° angle. Therefore, the photographer can view a moving image displayed at the time of shooting, a still image preview image shot during moving image shooting, a still image having a composition different from that of the moving image, or a playback image displayed at the time of playback. .
Also, on the back or bottom of the main unit, a battery storage unit for storing the power battery, a terminal unit for data exchange with an external device (for example, a USB terminal unit), a battery charging terminal, a screw hole for fixing a tripod, etc. (Not shown) is provided.

FIG. 2 is an explanatory diagram of a display example of a still image to be shot during shooting operation and moving image shooting of the digital movie camera 100. FIG. 2 (a) is an example of a moving image displayed during moving image shooting. ) Is an example of a still image preview image displayed when still image shooting is performed during moving image shooting. FIG. 2C is an example of a still image displayed during still image zoom operation (telephoto zoom). (C ′) is an example of a still image displayed during a still image zoom operation (wide-side zoom), FIG. 2 (d) is an example of a still image moved by a moving operation, and FIG. 2 (e) is a still image zoom-up operation. FIG. 2F shows an example of a still image that has been zoomed up, and FIG. 2F shows an example of a still image that has been moved by a moving operation.
In addition, the ◯ mark attached to the W button or T button of the still image zoom key 32 shown in the upper right of FIGS. 2C, 2D, and 2E indicates that the marked button has been pressed. This means that a circle attached to the cursor 36 shown in the upper right of FIGS. 2D and 2F indicates that the direction in which the circle is attached has been selected. Reference numeral 60 denotes an icon indicating that a moving image is being shot, and reference numeral 70 denotes an icon that indicates a still image shooting mode. Hereinafter, a display example when a still image shooting operation is performed during moving image shooting will be described with reference to FIGS. 1 and 2.

  When a photographer presses the video / recording start / stop button 33 of the digital movie camera 100 in a scene (in this example, a birthday party for a child that is performed indoors), video recording is started, and the subject within the angle of view starts. An image is captured and a moving image 61 is displayed. At this time, an icon 60 signifying moving image display is displayed (FIG. 2A).

  Next, when the photographer presses the still image shooting shutter button 34, a still image preview image (high-quality (= high-resolution) still image having the same composition as the movie being shot) 71 is the same size on the full-screen movie. Is displayed. At this time, an icon 70 indicating the still image shooting mode is displayed (FIG. 2B).

  Here, when the photographer presses the T button of the still image zoom key 32, the zoom lens moves to the telephoto side, and the moving image being shot is displayed as a moving image 62 with a low image quality (= low resolution) on the entire screen. Then, the zoomed-up high-quality still image 72 is displayed on the moving image 62 (FIG. 2C). When the photographer presses the W button of the still image zoom key 32, the zoom lens moves to the wide side, the high-quality still image 73 zoomed to the wide side is displayed on the full screen, and the moving image being shot is displayed. It is displayed on the still image 73 displayed as a low-quality image 63 on the full screen (FIG. 2 (c ′)).

  In addition, when the photographer operates the cursor 36 in FIG. 2C, the still image shooting range can be moved (in the illustrated example, the cursor 36 is moved to match the two lower left children. This is an example of moving down.) Thereby, the composition of the moving image 64 being photographed remains unchanged, and the photographing range of the still image 74 can be changed to a desired composition (FIG. 2D).

  Further, the photographer presses the T button of the still image zoom key 32 to perform the zoom-up operation of the moving image 64 to obtain a zoomed-up still image 75 (FIG. 2E), or operates the cursor 36 to operate the still image. A still image 76 can be obtained by moving the shooting range and finely adjusting the composition (FIG. 2 (f)).

  After displaying the still image of the desired composition as described above, the photographer presses the still image shooting end button 35 to end the still image shooting. Also, the moving image / recording start / stop button 33 is pressed to end moving image shooting, and the shot moving image and still image are recorded in a storage memory (image storage unit 45) such as a flash memory. Note that when the still image shooting end button 35 is pressed, the still image may be recorded in a storage memory (image storage unit 45) such as a flash memory.

  As a scene to shoot still images during movie shooting, not to go to athletics and sightseeing spots where zooming is frequently changed during movie shooting, but to announce kindergarten play groups and volleyball and piano that want to shoot movies for a long time with a tripod A meeting, a birthday party as shown in FIG. 2, or a children's soccer game is suitable. Therefore, this is a photographing method suitable for a case where a moving image is basically taken as it is, and only a composition of interest is zoomed up to shoot a still image. Furthermore, the digital movie camera 100 can be used by being fixed to a tripod to obtain a stable composition image.

  FIG. 3 is a conceptual functional block diagram of the digital movie camera 100. In this block diagram, as shown in FIG. 3A, for convenience, the imaging unit 11, the still image processing unit 12, the moving image processing unit 13, the image quality setting unit 14, the microphone (audio input device) 15, the audio processing It is divided into functional blocks such as a unit 16, a streaming unit 17, a control unit 20, an operation unit 30, a display unit 40, a display control unit 41, an audio output unit 43, and an image storage unit 45.

  As shown in FIG. 3B, the imaging unit 11 includes an optical system drive motor 11-1, an imaging lens group 11-2 with an optical zoom function, an imaging element 11-3 such as a CCD or a CMOS, a timing generator ( TG) 11-4, vertical driver 11-5, sample hold circuit (S / H) 11-6, A / D converter 11-7, mechanical shutter mechanism and the like. Note that the image sensor 11-3 receives a control signal from the control unit 20 by an auxiliary circuit such as a timing generator 11-4, a vertical driver 11-5, a sample hold circuit 11-6, and an A / D converter 11-7. The shutter speed, the exposure value, etc. are variably set based on the above, and the image formed through the preceding lens group 11-2 is converted into an electrical signal corresponding to the set value, and the electrical signal is converted into A / D. The signal is converted into a digital signal by the converter 11-7 and is output to the still image processing unit 12 and / or the moving image processing unit 13 at a constant cycle.

  As shown in FIG. 3C, the still image processing unit 12 includes circuits such as a color process circuit 12-1, an image encoding unit 12-2, and a DMA controller 12-3. The color process circuit 12-1 The digital signal input from the imaging unit 11 is received and temporarily held in a Bayer-based form corresponding to the pixel of the CCD 11-3, and stored to create RGB data, and the luminance component (Y) and the color component ( Cr, Cb) signal components, and after white balance correction is performed on the signal components based on the control signal from the control unit 20, the image coding unit 12-2 (see FIG. 6) performs image coding processing. To the still image data having the image quality of the bit rate (the bit rate for high image quality (= high resolution) or the bit rate for low image quality (= low resolution)) set by the image quality setting unit 14 and then DMA. It transfers the image data in the work memory 20-4 by Direct Memory Access) controller 12-3, and temporarily stored. When the shutter operation is performed, the image data at that time is sent to the display unit 40 to display a still image as a preview image.

  Although not shown, the still image processing unit 12 reads the image data written in the work memory 20-4 at the time of save recording, performs JPEG compression processing, and saves and records in the image storage unit (save memory) 45. In addition, a compression / expansion unit is provided that performs decompression processing on the compressed image data stored and recorded in the image storage unit 45 during reproduction and reproduces the image data.

  The compression / decompression unit supports a plurality of compression ratios, and a mode for storing in correspondence with the compression ratio corresponds to a high resolution (generally called high precision, fine, normal, etc.) with a low compression ratio. There are modes that support low resolution (commonly called economy etc.) with a high compression ratio. It also supports high to low pixel counts. For example, there are image sizes called SXGA, XGA, SVGA, VGA and the like.

  As shown in FIG. 3D, the moving image processing unit 13 includes circuits such as a color process circuit 13-1, an image encoding unit 13-2, and a DMA controller 13-3, and the color process circuit 13-1 The digital signal input from the image pickup unit 11 is separated into luminance component (Y) and color component (Cr, Cb) signal components, and after performing white balance correction based on the control signal from the control unit 20, the image The bit rate (high image quality (= high resolution) bit rate or low image quality (= low resolution) set by the image quality setting unit 14 by performing image encoding processing in the encoding unit 13-2 (see FIG. 6) (Bit rate) of the image quality, the DMA controller 13-3 outputs the moving image data to the streaming unit 17. Although not shown, the moving image processing unit 13 reads the image data written in the work memory 20-4 at the time of saving recording, performs the moving image compression processing, saves and records it in the image storage unit 45, and at the time of reproduction. A compression / decompression unit is provided that performs decompression processing on the compressed image data stored and recorded in the image storage unit 45 to reproduce the image data.

  The compression / decompression unit supports a plurality of compression ratios, and modes corresponding to the compression ratios include a mode corresponding to a high resolution with a low compression ratio and a mode corresponding to a low resolution with a high compression ratio. . The compression / expansion unit can also be used as the image encoding unit 12-2 of the still image processing unit 12 and the image encoding unit 13-2 of the moving image processing unit 13.

  When there is a bit rate setting change instruction from the control unit 20, the image quality setting unit 14 instructs the image encoding unit 12-2 of the still image processing unit 12 to use a bit rate for high image quality (= high resolution) or low image quality (= Set the bit rate for (low resolution). Similarly, a low image quality bit rate or a high image quality bit rate is set in the image encoding unit 13-2 of the moving image processing unit 13 in accordance with a bit rate setting change instruction from the control unit 20.

  A microphone (acoustic input device) 15 receives sound, converts it into an electric signal, and outputs it to the sound processing unit 16. Although not shown, the audio processing unit 16 includes an audio IC and an audio encoding unit, converts an electrical signal (analog audio signal) from the microphone 15 into a digital signal (digital data), and sequentially outputs the digital signal (digital data) to the streaming unit 17.

  The streaming unit 17 receives the moving image data sent from the moving image video processing unit 13 and the audio data sent from the audio processing unit 16, and simultaneously sends the moving image data to the display control unit 41 so that the display unit 40 reproduces and displays the moving image data. At the same time, the audio data is sent to the audio output unit 43 for reproduction. Further, the moving image data is temporarily stored in the work memory 20-4 under the control of the CPU 20-1.

The still image processing unit 12 corresponds to the still image processing unit of the present invention, and the moving image processing unit 13 and the streaming unit 17 correspond to the moving image processing unit of the present invention. The still image processing unit 12 and the image quality setting unit 14 correspond to the still image acquisition unit of the present invention, and the moving image processing unit 13, the image quality setting unit 14 and the streaming unit 17 correspond to the moving image acquisition unit of the present invention.
000

  As shown in the block diagram of FIG. 4, the control unit 20 includes a CPU (Central Processing Unit) 20-1, and a program memory (for example, ROM) is connected to the CPU 20-1 via a bus 20-2. 20-3, work memory (for example, DRAM) 20-4, data memory (for example, RAM) 20-5, input unit 20-7, output unit 20-8, timer 20-6, etc. are connected. Yes.

The CPU 20-1 executes a predetermined control program stored in the program memory 20-3, thereby fetching data from the input unit 20-7, for example, still image data from the still image processing unit 12, streaming unit 17 Video data and audio data from the camera, status signals of various keys from the operation unit 30, compressed image data from the image storage unit 45, writing of data to the output unit 20-8, and writing to the imaging unit 11 Control signal of shutter speed and exposure setting value, white balance correction control signal to still image processing unit 12 and / or moving image processing unit 13, display signal to display control unit 41, bit rate setting to image quality setting unit 14 A change instruction, image data for recording (compressed image data), etc. are written to the image storage unit 45.
When the menu process is executed, various setting values selected in the menu process are written in the work memory 20-4 in a nonvolatile manner (information is not lost even when the power is turned off). 100 overall operations are controlled.

  The operation unit 30 includes various operation unit buttons provided on the camera body unit 10, that is, a moving image zoom key 31, a still image zoom key 32, a moving image / recording start / stop button 33, as shown in FIG. Status signals corresponding to operations of the still image shooting shutter button 34, the still image shooting end button 35, the cursor 36, and various other function buttons are sent to the control unit 20.

  The display control unit 41 converts a display signal such as a through image (photographing standby image), a preview image, a still image, a moving image, or various setting screens output from the control unit 20 into the display format of the display unit 40 and displays the display signal. The information is output to the unit 40 and displayed on the liquid crystal display screen of the display unit 40. The display control unit 41 and the display unit 40 constitute a display unit as a unit. The audio output unit 43 includes an audio reproduction device such as a speaker, and reproduces the received audio signal and outputs it to the outside.

  The image storage unit 45 corresponds to a storage memory, and includes a recording medium for recording a captured image (also referred to as a captured image) in a nonvolatile manner. For example, a semiconductor storage device such as a flash memory or a magnetic memory device is used. It can be used for the recording medium. The image storage unit 45 is a removable memory such as a memory card, for example, and may be configured to be mounted on an electronic camera.

FIG. 5 is a flowchart showing an operation example of the digital movie camera 100. This flowchart is for explaining a program for causing the digital movie camera 100 to realize the still image display function at the time of moving image shooting of the present invention.
The processing shown below will be basically described by an example in which the control unit 22 executes according to a program stored in the program memory 20-3 in advance, but it is not necessary to store all functions in the program memory. A part or all of them may be received via a network. Hereinafter, description will be given based on FIGS.

  In FIG. 5, when shooting a movie after the photographer turns on the main power supply (not shown) of the digital movie camera 100, the photographer starts moving image / recording provided on the upper surface of the digital movie camera 100. Since the / stop button 33 is pressed, the CPU 20-1 checks the status signal sent from the operation unit 30, and proceeds to step S2 if the moving image / recording start / stop button 33 is pressed, otherwise the key. Wait for operation (step S1).

  When the moving image / recording start / stop button 33 is pressed or there is a transition from step S11, the subject image within the angle of view of the digital movie camera 100 is converted into an electrical signal by the imaging unit 11 and is captured. The moving image data is output to the streaming unit 17 at a predetermined cycle by the signal processing as described above in the unit 13. If there is an audio input, audio data from the microphone 15 and the audio processing unit 16 is output to the streaming unit 17 (step S2).

  The streaming unit 17 receives the moving image data sent from the moving image video processing unit 13 and the audio data sent from the audio processing unit 16 while sending the moving image data to the display control unit 41 via the control unit 20 and the audio data. This is sent to the audio output unit 43. Further, the moving image data is temporarily stored in the work memory 20-4 (step S3).

  The display control unit 41 converts the received moving image data into the display format of the display unit 40 and displays it on the liquid crystal monitor screen of the display unit 40 as shown in the example of FIG. In the example of FIG. 2, an icon (in the illustrated example, the icon 60) indicating that a moving image is being captured is displayed at a predetermined position on the screen. The audio output unit 43 reproduces the received audio signal and outputs it to the outside (step S4).

  When zooming a moving image, the photographer operates the W button or the T button of the moving image zoom key 31 provided on the upper surface of the digital movie camera 100, so that the CPU 20-1 is sent from the operation unit 30. The signal is examined. If the W button or T button of the moving image zoom key 31 is pressed, the process proceeds to step S6, and if not, the process proceeds to step S7 (step S5).

  When the zoom key 31 is operated, the CPU 20-1 moves the zoom lens to the wide side or the telephoto side by a drive control unit (not shown) of the optical system drive motor 11-1 according to the operated zoom button. For this purpose, a drive signal is sent to move the zoom lens (step S6).

  When taking a still image during moving image shooting, the photographer presses a still image shooting shutter button 34 (hereinafter simply referred to as “shutter button 34”) provided on the upper surface of the digital movie camera 100, so the CPU 20 -1 examines the status signal sent from the operation unit 30. If the shutter button 34 is pressed, the process proceeds to step S8, and if not, the process proceeds to step S16 (step S7).

  When the shutter button 34 is pressed, the CPU 20-1 sends a bit rate setting change instruction signal for the still image processing unit 12 and a bit rate setting change instruction signal for the moving image processing unit 13 to the image quality setting unit 14. The image quality setting unit 14 sets a bit rate for high image quality (= high resolution) to the image encoding unit 12-2 of the still image processing unit 12, and the image encoding unit 13-2 of the moving image processing unit 13 A bit rate for low image quality (= low resolution) is set. Thereafter, the moving image displayed in step S4 is subjected to image coding processing by the image coding unit 13-2 based on the low image quality bit rate set by the image quality setting unit 14 until the image quality setting is initialized in step S19. The low-quality moving image that has been subjected to is displayed (step S8).

  Next, the still image processing unit 12 receives the digital signal input from the imaging unit 11 and temporarily holds it in a Bayer-based form corresponding to the pixel of the CCD 11-3, stores it, creates RGB data, After separating the component (Y) and color components (Cr, Cb) into signal components and applying white balance correction to the signal components based on the control signal from the control unit 20, the image quality setting unit 14 performs the above step S8. The image encoding unit 12-2 performs image encoding processing based on the set high-quality bit rate to obtain high-quality image data, and then the DMA controller 12-3 stores the image data in the work memory 20-4. And temporarily stored (step S9).

  The CPU 20-1 further sends the image data to the display control unit 41, and displays a still image 71 (high quality) on the full screen as a preview image 71 as shown in FIG. In the example of FIG. 2, an icon (the icon 70 in the illustrated example) indicating the still image shooting mode is displayed at a predetermined position on the screen (step S10).

  The photographer operates the T button or W button of the still image zoom key 32 provided on the upper surface of the digital movie camera 100 when zooming the still image, and moves the cursor when changing the still image shooting range. When the camera 36 is operated to record a still image, the still image shooting end button 35 is pressed. Therefore, the CPU 20-1 checks the status signal sent from the operation unit 30, and the T button of the still image zoom key 32 is pressed. If YES, the process proceeds to step S12. If the W button is pressed, the process proceeds to step S13. If the cursor 36 is operated, the process proceeds to step S14. If the still image shooting end button 35 is pressed, the process proceeds to step S15. If no key is pressed, the process returns to step S2 (step S2). S11).

  When the zoom button T is pressed, the CPU 20-1 sends a drive signal for moving the zoom lens to the telephoto side to a drive control unit (not shown) of the optical system drive motor 11-1 to turn the zoom lens on. Move to step S11. Since the display size of the still image 72 becomes smaller than the moving image 62 due to the movement of the zoom lens to the telephoto side, the moving image data for the full screen from the streaming unit 17 written in the display buffer (not shown) is added to the moving image data. The output from the still image processing unit 12 in step S9 is overwritten. As a result, as shown in the example of FIG. 2C, the high-quality still image 72 is zoomed up and displayed at the center of the screen on the low-quality moving image 62 displayed on the full screen (step S12). ).

  Further, when the zoom button W is pressed, that is, when the zoom is performed so that the still image is larger than the moving image, the CPU 20-1 widens the drive control unit (not shown) of the optical system drive motor 11-1. A drive signal for moving the zoom lens to the side is sent to move the zoom lens, and the process returns to step S11. Since the display size of the still image 73 becomes larger than the moving image 62 due to the movement of the zoom lens to the wide side, the output from the still image processing unit 12 is written in the display buffer (not shown) as a full screen in step S9. The moving image data from the streaming unit 17 is overwritten. As a result, the low-quality moving image 63 is displayed in the center of the screen on the high-quality still image 73 displayed on the full screen as shown in the example of FIG. 2C '(step S13).

  When the cursor 36 is pressed, the CPU 20-1 changes the coordinate of the center point as if the center point of the display range of the still image is moved in the direction indicated by the operation of the cursor 36. To change the apparent angle of view of the still image, and after the angle of view is changed, the still image processing unit 12 creates RGB data based on the digital signal input from the imaging unit 11, and the luminance component (Y) and color After separating into signal components of components (Cr, Cb) and performing white balance correction, image coding processing is performed by the image coding unit 12-2 and high-quality image data set by the image quality setting unit 14 After that, the DMA controller 12-3 transfers the image data to the work memory 20-4 and temporarily stores it (overwrites the still image data obtained in step S12) and displays the still image data. Sent to the control unit 41, to overwrite the still image data into moving image data of the screen single serving from the streaming unit 17 being written to the display buffer (not shown) returns to step S11. As a result, the moved still image 74 is displayed on the moving image 64 as shown in the example of FIG. That is, the shooting range of the still image can be moved so as to be different from the composition of the moving image (step S14).

  When the still image shooting end button 35 is pressed, the CPU 20-1 sends a bit rate setting change instruction signal for the still image processing unit 12 and a bit rate setting change instruction signal for the moving image processing unit 13 to the image quality setting unit 14. , The image quality setting unit 14 returns the viewlets of the still image processing unit 12 and the moving image processing unit 13 to the original image quality, and in step S14, the still image shooting range is restored. When the apparent angle of view of the still image is changed so as to be different from the composition of the moving image, the coordinates of the center point are returned to the initial values, and the still image shooting mode is terminated (for example, the icon 70 in FIG. Delete) and return to step S2. In this step, the still image data stored in the work memory 20-4 is not erased (step S15).

  If the shutter button 34 is not pressed in step S7, the CPU 20-1 checks the status signal from the operation unit 30, and if the moving image / recording start / stop button 33 is pressed, the process proceeds to step S17. If not, the process returns to step S2 (step S16).

  When the moving image / recording start / stop button 33 is pressed, moving image data is taken out from the work memory 20-4, sent to the moving image signal processing unit 13, subjected to compression processing, and recorded in the image storage unit 45 ( Step S17) Further, still image data (may be for a plurality of sheets) is taken out from the work memory 20-4, and sent to the still image signal processing unit 12 (respectively) and subjected to JPEG compression processing. The image is recorded in the image storage unit 45 in association with the recorded moving image frame (step S18), and the image quality setting unit 14 further instructs the bit rate setting change instruction signal for the still image processing unit 12 and the moving image video processing unit 13 to be used. A bit rate setting change instruction signal is sent to cause the image quality setting unit 14 to restore the bit rates of the still image processing unit 12 and the moving image processing unit 13 to the original values. Restore the settings that had been quality, further, if you change the angle of view of the apparent still image in step S14, returns the coordinates of the center point to the initial value, and terminates the moving image photographing operation (step S19).

  With the operation of the flowchart of FIG. 5, still image shooting with a composition different from that of a moving image can be performed during moving image shooting. Further, since the image quality of the still image is displayed as a higher quality image than the moving image at the time of shooting, the composition of the still image displayed together with the moving image is easy to understand.

  In the description of FIGS. 1 to 5 described above, the optical zoom is described. However, both the moving image and the still image may be digitally zoomed, that is, electronically zoomed. In this case, the moving image is digitally zoomed in step S5 in the flowchart of FIG. 5, the still image telephoto zoom processing is performed in step S12, and the wide zoom processing is performed in step S13. What is necessary is just to comprise. In this way, since it is not necessary to consider the movement time of the zoom lens during zooming, it is possible to shoot a moving image and a still image while maintaining the continuity of the moving image.

  The moving image may be zoomed by optical zoom, and the still image may be zoomed by digital zoom. In this case, the optical zoom is performed in step S6 in the flowchart of FIG. 5, the telephoto zoom process of the still image is performed by digital zoom in step S12, and the wide zoom process is performed by digital zoom in step S13. do it. In this way, a clear image can be obtained with the optical zoom in the moving image shooting, and the moving time of the zoom lens does not have to be taken into consideration in the still image zooming, so that the continuity of the moving image is maintained. You can shoot movies and still images. In addition, since still images have higher image quality than moving images, deterioration in image quality can be prevented.

  FIG. 6 is a block diagram illustrating a configuration example of the image encoding unit illustrated in FIGS. 3C and 3D. 3 except for the compression rate change command input unit (recording button, press sensor bit rate conversion unit, bit rate value conversion unit) and input filter unit, that is, the code amount control unit 1213. -1, DCT unit 1213-2, quantization unit 1214-3, variable length coding unit 1213-4, and motion compensation unit 1213-5.

  The code amount control unit 1213-1 determines a parameter related to the quantization width according to the bit rate value set by the image quality setting unit 14. The DCT unit 1213-3 performs a two-dimensional discrete cosine transform process on the image data from the color process circuit 12-1 (or the color process circuit 13-1), thereby converting the image into discrete spatial frequency components (DCT coefficients). ). The DCT coefficient obtained by the DCT unit 1213-3 is given to the quantization unit 1213-3. The quantization unit 1213-4 quantizes the DCT coefficient. Data after two-dimensional discrete cosine transform (DCT) is known to be biased toward low-frequency components, and significant data (data other than 0) of high-frequency components decreases due to quantization, and data compression is performed. . The quantized DCT coefficient value obtained by the quantization unit 1213-4 is provided to the variable length coding unit 1213-6. The variable length coding unit 1213-6 performs entropy coding based on the appearance frequency of data. The encoded data obtained by the variable length encoding unit 1213-6 is output to the DMA controller 12-3 (or the DMA controller 3-3). The motion compensation unit 1213-5 performs inverse quantization for returning the quantized DCT coefficient obtained by the quantization unit 4 to the DCT coefficient before quantization, and restores the original image data.

  In the description of each of the above embodiments, when shooting a still image during moving image shooting, the moving image is displayed as a low-quality image and the still image is displayed as a high-quality image. However, the present invention is not limited to this. When the processing unit 13 is configured to be able to generate a semi-transparent image, and the image quality change instruction is issued from the CPU 20-1, the image quality setting unit 14 is sent to the image encoding unit 13-2 (FIG. 2C) of the moving image processing unit 13. A moving image may be made a semi-transparent image by transmitting a semi-transparent image generation instruction and outputting semi-transparent moving image data. In this way, the composition of the still image displayed together with the moving image can be easily understood. In this case, it is desirable for the photographer to determine the composition of the still image so that the still image is easy to see as a high-quality image.

  In the flowchart of FIG. 5, when the moving image / recording start / stop button 33 is pressed again to finish moving image shooting, the moving image and still image are recorded in the image storage unit 45 (steps S16 to S18). When the still image shooting end button 35 is pressed (step S14), the still image may be recorded in the image storage unit 45.

  In the above-described embodiment, an example has been described in which a single image sensor captures both moving images and still images. However, a moving image sensor and a still image sensor may be provided separately. Further, although a method for processing a moving image and a still image in parallel with one image sensor has not been described in detail, the technique described in Patent Documents 1 to 3 described above, or Japanese Patent Application No. 2003 filed by the present applicant. Techniques for parallel processing of moving images and still images described in No. 357132 can be appropriately employed.

  In the above embodiment, the still image has a high image quality and the moving image has a low image quality. However, in order to determine the composition of the still image during video-through (while recording a movie), the movie is displayed with a high image quality at the center. The still image may be displayed with a low image quality (semi-transparent) as a whole, and the composition of the still image may be determined before pressing the shutter.

  As mentioned above, although one Example of this invention was described, this invention is not limited to the said Example, It cannot be overemphasized that various deformation | transformation implementation is possible. For example, the term imaging device can be applied to an electronic still camera, a mobile phone with a camera, an information device having an imaging unit, and the like in addition to a digital movie camera.

It is a perspective view which shows the external appearance of the digital movie camera of this invention. It is explanatory drawing of the example of a display of the still image image | photographed during imaging | photography operation of a digital movie camera, and video recording. It is a conceptual functional block diagram of a digital movie camera. It is a block diagram which shows the structural example of the control part of a digital movie camera. It is a flowchart which shows the operation example of a digital movie camera. It is a block diagram which shows the structural example of the image coding part shown to FIG.3 (c), (d).

Explanation of symbols

11 Imaging unit (optical zoom means)
12 Still image processing unit (still image processing means, still image acquisition means, electronic zoom means)
13 Video image processing unit (moving image processing means, moving image acquisition means, electronic zoom means)
14 Image quality setting unit (still image acquisition means, moving image acquisition hand, means for obtaining still image data of different image quality)
15 Microphone 16 Audio processing unit 17 Streaming unit (moving image acquisition means, moving image processing means)
20 Control unit (display control means)
30 Operation unit 31 Zoom key for moving image (moving image zoom instruction means)
32 Still image zoom key (still image zoom instruction means)
33 Video / Recording Start / Stop Button 34 Still Image Shooting Shutter Button (Still Image Shooting Instruction Unit)
35 Still image shooting end button (still image shooting end instruction means)
36 Cursor (shooting range change instruction means)
40 Display section (display means)
41 Display control unit (display means)
43 Audio output unit 45 Image storage unit (storage memory)
100 digital movie camera

Claims (7)

In an imaging device that shoots a subject, generates image data thereof, and records it,
Moving image processing means for converting subject images sequentially captured in accordance with a moving image shooting start instruction into moving image data and sequentially storing them in a work memory;
Still image processing means for converting a subject image captured by a still image shooting instruction into still image data and storing it in a work memory;
Movie zoom instruction means for instructing movie zoom,
Movie zoom processing means for performing telephoto zoom processing or wide zoom processing according to the instruction content of the movie zoom instruction means;
When there is a still image shooting instruction during moving image shooting, the moving image acquisition unit and the still image processing unit cause the moving image processing unit to convert a subject image captured during moving image shooting into moving image data having a quality different from that of the still image. A still image acquisition means for converting the subject image captured by the still image shooting instruction into still image data having an image quality different from that of the moving image and storing it in a work memory;
Display control means for distinguishing and displaying the moving image data acquired by the moving image acquisition means and the still image data acquired by the still image acquisition means;
Still image zoom instruction means for instructing still image zoom;
Still image zoom processing means for performing telephoto side zoom processing or wide side zoom processing according to the instruction content of the still image zoom instruction means;
Equipped with a,
When the zoom instruction to the telephoto side is given by the still image zoom instruction means, the display control means adds the still image acquired by the still image acquisition means to the moving image data acquired by the moving image acquisition means. When the image is displayed by overwriting the data and the zoom instruction to the wide side is instructed by the still image zoom instruction unit, the still image data acquired by the still image acquisition unit is acquired by the moving image acquisition unit. An image pickup apparatus, wherein the moving image data is overwritten to display an image. The moving image acquisition means includes means for obtaining moving image data having an image quality different from that of a still image by causing the moving image processing means to convert a subject image captured during moving image shooting into translucent moving image data. The imaging apparatus according to claim 1 . A still image display method at the time of moving image shooting in an imaging device that shoots a subject to generate and record the image data,
The subject image that is sequentially captured in response to the movie shooting start instruction is converted into moving image data and stored in the work memory sequentially.If there is a still image shooting command during movie shooting, the subject image captured during movie shooting is a still image. The moving image data having different image quality is converted, and the subject image captured by the still image shooting instruction is converted to still image data having an image quality different from that of the moving image and stored in a work memory, and the still image is stored in the moving image data. Overwrite and display the data,
When taking a movie zoom, the camera performs a telephoto zoom process or a wide zoom process according to the instruction, and displays still image data obtained as a result of zooming and the moving image data separately. Still image display method. Furthermore, when there is an instruction to change the shooting range of the still image displayed on the moving image, the still image data obtained by changing the shooting range of the still image and the moving image data are displayed separately. The method for displaying a still image during moving image shooting according to claim 3 . The moving image data having an image quality different from that of the still image is relatively low-quality moving image data, and the still image data having an image quality different from that of the moving image is relatively high-quality still image data. The method for displaying a still image during moving image shooting according to claim 3 . 4. The method of displaying still images during moving image shooting according to claim 3 , wherein the moving image data having an image quality different from that of the still image is translucent moving image data. A program that causes an imaging apparatus to execute the still image display method during moving image shooting according to any one of claims 3 to 6 .

Images