JP2007306496A - Camera, photographing control method, program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera, a photographing control method thereof, a program, and a recording medium attaining photographing in combination of a moving picture and a still picture, which is principally used. <P>SOLUTION: An AFE section 4 being a read section reads a moving picture as an output 2 from an imaging element 3 before and after the still picture is released. The AFE section 4 reads an image in a range narrower than the still picture as the moving picture. In the case of portrait photographing particularly, the AFE section 4 reads two kinds of moving pictures different in size comprising an A moving picture in a narrow range and a B moving picture in a rather wider range. Moreover, the AFE section 4 selects a range adaptable to a 16:9 wide screen as a read range of the moving picture. Moreover, the camera records the moving pictures adjacent the still picture in combination with the still picture. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a camera that is also used as a moving image still image, and more particularly to a camera that can simultaneously record a moving image during still image shooting.

  Recently, many digital cameras capable of shooting both still images and moving images have been proposed. The development of such a camera has been promoted by an increase in memory capacity, progress in moving image compression technology, and an increase in speed of an image sensor. Furthermore, development of a high-pixel image sensor capable of high-speed readout is also great. For example, an image sensor with a high pixel of 5 million pixels or more has conventionally required a reading speed of several tens of milliseconds, but recently, a device capable of reading full pixels at a high frame rate of 60 fps has been proposed.

  For example, there has been proposed a digital camera that can not only shoot a still image and a moving image separately, but also can simultaneously shoot (Patent Document 1).

On the other hand, a photographed image obtained by a digital camera that records both moving images and still images is not only printed in the same manner as a conventional silver salt camera, but also has an increased chance of being displayed on a TV or personal computer monitor. An image taken vertically by the camera has no problem in printing, but it becomes very unnatural when displayed on the screen. In view of this, there has been proposed a camera that detects whether it is a vertical composition or a horizontally long composition depending on how it is held, and reflects the situation of shooting and reproduction together during reproduction (Patent Document 2).
JP 2005-57378 A JP 2003-60940 A

  Various cameras that can shoot both still images and movies have been commercialized. However, current video / still image cameras are not easy to use, and the captured images are not very useful. One of the causes is that the decisive factors at the time of shooting differ between moving images and still images. In other words, since many conditions such as exposure and focus are automated in still image shooting, the user must determine the timing and composition for cutting out a moment of the subject. On the other hand, the story of the whole movie is important, not the moment. Therefore, it is necessary not only to shoot a moving image and a still image at the same time, but also to devise a combination of both.

  Further, a large practical problem is screen display. As pointed out above, there is a problem that when a vertically shot image is displayed with its orientation changed, blanks are generated on the left and right sides of the screen. And if the digital content playback environment in the home is improved, the chances of enjoying images in front of a large-screen TV will increase. In the case of a large screen TV, high definition (HD) image quality is increasing, and the aspect ratio is a horizontally long screen of 16: 9. In contrast, a still image has a 4: 3 aspect ratio for printing. Although portrait orientation is often used when shooting a person, when such a portrait still image is played back on a large-screen TV, a larger non-display portion than the conventional one is generated on the left and right, and the willingness to see is reduced. Since it is a camera that supports still images of moving images, it is necessary to devise a way to carefully view still images on a TV, especially on a wide screen.

  In view of the above problems, an object of the present invention is to provide a camera capable of performing combined shooting of moving image still images mainly including still images, a shooting control method thereof, a program, and a recording medium.

In order to achieve the above object, a camera according to a first invention is a camera that records a moving image and a still image.
An image data extraction unit that extracts first image data and second image data from the image sensor, a recording unit that records the first image data as a moving image and a second image data as a still image, and a vertical and horizontal direction of the camera A composition determination unit that determines the composition of the first image data from the image sensor according to an output of the composition determination unit.

  According to a second aspect of the present invention, there is provided a camera for recording a moving image and a still image, a reading unit for reading out a still image and a moving image having a part of the still image as a shooting region from the image sensor, and reading from the image sensor. A control unit that controls recording of the output image, and the reading unit uses a still image and a moving image in which a part of the still image is captured at a timing before and after the still image shooting. The control unit controls to record the read moving image in association with the still image.

  According to a third aspect of the present invention, there is provided a camera for recording a moving image and a still image, a reading unit for reading the still image and the moving image from the image sensor, and changing the read moving image to a size of a part of the image. A size changing unit that controls recording of an image read from the image sensor, and the reading unit captures a moving image together with a still image at a timing before and after the still image shooting. The reading and control unit controls to record the moving image whose size is changed by the size changing unit together with the still image at the time of still image shooting.

  According to a fourth aspect of the present invention, there is provided a shooting control method for a camera that records a moving image and a still image. When a still image is shot, a part of the still image is taken together with the still image at a timing before and after the still image shooting. Is read out in the shooting area, and the read out moving image is recorded in association with the still image.

  According to the present invention, it is possible to provide a camera capable of performing combined shooting of moving image still images mainly composed of still images, a shooting control method thereof, a program, and a recording medium.

The best mode for carrying out the present invention will be described below with reference to the drawings.
(First embodiment)
FIG. 1 is an overall block diagram of a camera 1 to which the present invention is applied. The camera 1 includes a lens unit 2, an image sensor 3, an analog front end (hereinafter abbreviated as AFE) unit 4, an image processing unit 5, a compression unit 6, a recording / reproducing unit 7, and a medium 8. The lens unit 2 forms an image of the incident subject 20 on the image sensor 3. The image sensor 3 is composed of a CCD or a CMOS, and converts the formed subject image into an electrical signal. The AFE unit 4 converts an analog signal output from the image sensor 3 into a digital image signal and inputs the digital image signal to the image processing unit 5. The AFE unit 4 also has a function of selecting signals output from the image sensor 3 and can extract only limited pixel data from all light receiving surfaces.

  The image processing unit 5 performs various processes on the image data. The image processing unit 5 performs various processing such as color correction, smoothing processing, and contrast enhancement processing on the image data. The image processing unit 5 is provided with a size changing unit 5a. The size changing unit 5a changes the size of the image from the original image to a size according to the instruction by appropriately changing the aspect ratio at the time of image recording or reproduction. Also called partial image or cropping. Details will be described later.

  The compression / decompression unit 6 includes a still image compression / decompression unit 6a that performs compression / decompression for still images and a moving image compression / decompression unit 6b that performs moving image compression. The still image compression / decompression unit 6a includes a still image compression / decompression circuit such as JPEG (Joint Photographic Coding Experts Group). The video compression / decompression unit 6b is an MPEG (Motion Picture Experts Group) or H.264 standard. H.264 video compression / decompression circuit. The recording / reproducing unit 7 records the compressed image data on the recording medium 8 at the time of shooting, and reads the image data from the medium 8 at the time of reproduction. The medium 8 is a recording medium for storing and recording images.

  In addition, the camera 1 is provided with a display control unit 12, a display unit 13, and an output unit 14. The display control unit 12 controls the display unit 13 to display an image recorded on the medium 8 at the time of reproduction and a monitor image at the time of shooting. The display unit 13 is composed of, for example, an LCD, and displays a monitor image at the time of shooting, and displays an expanded recorded image at the time of reproduction. At the time of shooting, the user determines the composition and timing while performing the shooting operation while viewing the image displayed on the display unit 13.

  The output unit 14 converts the captured image or the size-changed image output from the image processing unit 5 into an NTSC signal or a high-definition signal suitable for the connected external display device 21 and outputs the converted signal. The external display device (hereinafter abbreviated as TV) 21 is an NTSC type TV or a high-vision type TV.

  The camera 1 is provided with an MPU 10, a ROM 11, and an operation unit 16. An MPU (microcontroller) 10 is a control unit that controls the entire camera 1 such as shooting and reproduction according to a program. The ROM 11 is a non-volatile and recordable memory such as a flash ROM, and stores a control program for performing control processing of the camera 1. The operation unit 16 notifies the MPU 10 of the photographer's instruction. As a representative example of the operation unit 16, switches 16a, 16b, and 16c are provided. The switch 16a is a release switch. In addition, there are switches such as shooting / playback mode switching and shooting mode switching. The MPU 10 detects user instructions such as shooting and display with the switches 16a, 16b, and 16c.

  The camera 1 is provided with a vertical / horizontal determination unit 17 and a face detection unit 15. The vertical / horizontal determination unit 17 determines whether the composition is vertical or horizontal during shooting. The MPU 10 writes this result in the captured image data. This result is reflected in the control of the AFE unit 4 and the image processing unit 5 by the MPU 10. The face detection unit 15 analyzes an image signal picked up from the image signal according to the image processing result, detects whether or not a face-specific eye-nose or contour is included therein, and determines the size of the face in the screen. The sheath position is output to the MPU 10.

  FIG. 2 is a diagram illustrating an example of a user's image appreciation scene. As in the past, the user often enjoys the captured image on the print 22. In addition, it is considered that the user has more opportunities to enjoy image content shot in front of the large-screen TV 21. Since the number of high-definition (HD) image quality is increasing as the TV 21 used, the aspect ratio of the TV 21 is also increased in a horizontally long screen of 16: 9. On the other hand, since the aspect ratio of the image pickup element of the camera is generally 4: 3 (print 22), the deviation becomes a problem.

  FIG. 3 is a diagram showing a scene of vertical composition shooting. The subject 20 is photographed by the camera 1 held vertically. FIG. 4 is a diagram showing various images displayed on the wide screen TV 21. When shooting a person, the camera is often used in a vertical composition as shown in FIG. FIG. 4A shows an example in which an image shot with such a vertical composition is displayed. As shown in FIG. 4A, when a vertically long still image shot on the premise of printing is reproduced on the screen of the TV 21, large non-display portions 23a are generated on the left and right sides of the screen.

  The non-display portion 23a is very large because a 4: 3 screen is vertically displayed with respect to a 16: 9 image. When 3: 4 corresponds to 9 in the vertical direction, there are only 3 × 9/4 = 6.8 for 16 in the horizontal direction. Even if two images are arranged, 6.8 × 2 = 13.6 <16. The inefficiency at this time cannot be ignored so much that the side cannot be satisfied.

  Therefore, if it is assumed to be viewed on a special large-screen TV, it is desirable to make a powerful display by fully utilizing the screen as shown in FIG. Therefore, the same image is displayed with the face centered as shown in FIGS. 4 (A) → (B) → (C). This enables powerful display.

  FIG. 5 is a diagram showing the relationship between the size of an image displayed on the screen of the TV 21 and the corresponding pixels used for display. Here, the images in FIGS. 5A-1, A-2, and A-3 correspond to the images in FIGS. 4A, 4 </ b> B, and 4 </ b> C, respectively. In FIG. 5A-2 and subsequent figures, a broken-line frame indicates the range of the original captured image, and a solid-line frame indicates the range of the image displayed on the TV 21.

  5B-1 to 5B-4 are diagrams conceptually showing a pixel arrangement of a part of the entire still image data and a ratio of pixels read out during reproduction. 5 (B-1) to (B-4) correspond to (A-1) to (A-4), respectively. However, the ratio of readout pixels described below is merely an example.

  Still image data is usually composed of full pixels of an image sensor. This is because still images need to withstand printing. On the other hand, the TV 21 not only has an aspect but also the number of reproducible pixels is considerably different from the image pickup device itself (much less). Therefore, when reproducing an image as shown in FIG. 5A, for example, it is sufficient to extract and reproduce only the hatched portion in FIG. 5B-1. In other words, it is assumed that only the two hatched portions of the image sensor screen 3a in 28 pixels can be displayed, for example, as shown in FIG. It is shown as a thinning method).

  Next, in FIG. 5A-2, the image is enlarged and displayed. When an image as shown in FIG. 5A-2 is displayed, the thinning method is changed in consideration of TV reproduction. That is, as shown in FIG. 4B, since the display area increases and the non-display portion 23a decreases, the ratio of pixels used for display in all pixels is increased. Here, for example, four pixels out of 16 pixels of the still image are used. This is because if the thinning result as shown in FIG. 5A is enlarged as it is, only a rough screen can be reproduced while having a high-definition display capability and an original image having abundant information. Thereby, the high definition feeling on the screen is not impaired.

  FIG. 5A-3 shows a case where an image is displayed on the entire screen. When displaying as shown in FIG. 5A-3, the pixels in the face partial area of the image as shown in FIG. 5A-3 are output. The aspect ratio is adjusted to the TV aspect ratio. The number of pixels to be used is also increased compared to the above (A-1) and (A-2). That is, there is a case where it is not necessary to perform pixel thinning as shown in FIGS.

  The above shows an example of a vertical composition in which the display area is extremely different for a 16: 9 wide screen TV. Note that FIG. 5A-4 is an example in which a still image captured in a normal horizontal composition is displayed on the TV 21. At this time, it is only possible to display only a region such as a solid line in FIG. 5D, and it is needless to say that a limited region such as a solid line needs to be displayed. As described above, it is possible to enjoy beautiful high-definition images by fully utilizing the reproduction capability of the TV 21.

  FIG. 6 is a flowchart for explaining the procedure of the image output process described above. This image output process is mainly executed by the MPU 10, the image processing unit 5, the size changing unit 5a, and the output unit 14 according to the program.

  First, it is determined whether the image to be reproduced is a moving image or a still image (step S11). In the case of a moving image (step S11 YES), output for moving image display is performed (step S21). If it is determined that the image is a still image (NO in step S11), still image data is read from the medium 8 via the recording / playback unit 7 (step S12). Next, it is determined whether the shooting composition of this image is vertical or horizontal (step S13). The vertical / horizontal determination is performed by the vertical / horizontal determination unit 17 based on the composition data attached to the image data at the time of shooting. Alternatively, the image processing unit 5 may determine the image characteristics.

  The size changing unit 5a performs the following size changing process based on the vertical / horizontal determination result, and the output unit 14 outputs the image. This is the process described in FIG. 4 and FIG. First, if it is not a vertical composition (NO in step S13), that is, it is a normal horizontal screen, the size changing unit 5a cuts out the area indicated by the solid line in FIG. 5 (A-4) and the output unit 14 changes the size. Is output (step S22). The output image is displayed on the TV 21.

  In the case of a photograph with a vertical composition (YES in step S13), display is performed such that FIG. 4 (A) → (B) → (C) is sequentially repeated for a fixed time. This is to prevent the screen from changing suddenly. The size changing unit 5a first outputs the read image data as an image having a size as shown in FIG. 4A (step S14). The aspect ratio (horizontal: vertical) here remains at 3: 4. When displayed for a predetermined time (YES in step S15), the read image data is resized to an image having a size as shown in FIG. 4B and output (step S16). The aspect ratio here is changed to, for example, 5: 4. Further, when the display is performed for a predetermined time (step S17 YES), the read image data is resized to an image as shown in FIG. 4C and output (step S18). The aspect ratio here is changed to 16: 9.

  If there is an end instruction operation during the image display as shown in FIG. 4C (YES in step S19), the end process is performed. If there is an instruction to switch to another image display (YES in step S20), the process returns to step S11. Note that the display order during reproduction may be the order of (C) → (B) → (A) instead of the order of FIG. 4 (A) → (B) → (C). Here, since the image file is recorded on the camera media together with the moving image and still image, according to the switching operation of the image file by the user, the operation determines whether the operation is moving image or still image and switches the display method. I made it.

  In the above description, output to an external display device while changing the area of a captured image during reproduction has been described. However, the present invention is not limited to this, and a resized image may be simultaneously generated and recorded at the time of shooting. This will be described below.

  FIG. 7 is a flowchart for explaining a procedure of image recording processing for recording a size-changed image together with shooting. This process is mainly executed by the MPU 10, the image processing unit 5, and the size changing unit 5a according to the program.

  The photographed original image is compressed as an image composed of full pixels that can withstand printing (step S31). Next, the processing is changed depending on whether the captured image is a vertical composition. Based on the determination by the vertical / horizontal determination unit 17, it is determined whether the vertical composition is set (step S32). If the composition is not the vertical composition (NO in step S32) and the composition is horizontal, the size changing unit 5a generates a horizontally long image as shown by the solid line in FIG. It records with a picked-up image (step S36).

  On the other hand, when the composition is vertical (YES in step S32), the recording / reproducing unit 7 records the compressed photographed image that is an image displaying the entire subject as shown in FIG. 4A (step S33). Subsequently, the size changing unit 5a generates an intermediate image with the aspect ratio changed as shown in FIG. 4B from the original photographed image, and the recording / reproducing unit 7 records this (step S34). Further, the size changing unit 5a generates an image with an aspect ratio of 16: 9 from the recorded image so as to effectively use the entire screen as shown in FIG. 4C, and the recording / reproducing unit 7 records this ( Step S35).

  Here, the display can be switched to three levels, but it is possible to display in two stages, step S33 and step S35, and since the transition is halfway, the image quality does not matter. You can do that.

  As described above, since the resized image is recorded at the time of shooting, there is no need for a process of changing the size of the full pixel image every time it is played back, and no special circuit is required on the playback side. become. In the above example, the size is shown in three stages. However, the size may be changed in three stages or more.

  Next, a modification of the first embodiment will be described with reference to FIGS. As shown in FIG. 4A, when both sides of the screen are completely black without an image, it is felt that the appearance is not good. Therefore, this modified example is an example in which a margin part is effectively used when an image is displayed during reproduction display. FIG. 8 is a flowchart for explaining the procedure of the synthesis process. FIG. 9 is a diagram showing an image displayed on the TV 21.

  As shown in FIG. 9, an image with different images attached to both sides of the screen is created and displayed. However, if it is too complicated or difficult to understand, it will interfere with the viewing of the original image. Use the illustrated image.

  The procedure of the synthesis process will be described along the flowchart of FIG. Assume that the original still image has been shot. The original image size changing process is performed (step S41). Another image used in the margin area is read (step S42). The attached image is synthesized with the original image whose size has been changed, and this synthesized image is compressed and recorded (step S43). The image processing unit 5 performs composition processing. By the above device, it is possible to effectively display the wide screen more effectively.

(Second embodiment)
Next, a second embodiment will be described with reference to FIGS. The second embodiment is an example in which, when shooting an enlarged portion during TV playback, shooting is performed such that a face image is determined and that portion is emphasized.
This is because, in a portrait image, particularly a portrait photograph, a person's face is generally important, and therefore it is effective to magnify and display a face part as shown in FIG. 4C. A block diagram of a camera to which the present invention is applied is the same as FIG.

  FIG. 10 shows two examples of monitor images displayed on the display unit during shooting. It is during vertical composition shooting. The screen in FIG. 10A is a screen that shows the entire image and the area that is enlarged and recorded therein. A broken line frame at the top of the screen is a frame 23b indicating an area to be enlarged and recorded. The area portion of the frame 23b is enlarged as shown in FIG.

  On the other hand, the screen of FIG. 10B is an example of multi-display. A captured image 23c for a still image and a resized image 23d for TV display are displayed in multiple on the display unit 13. Since both the entire image and the image to be resized are displayed at the same time, it is convenient for shooting. At this time, a portion to be enlarged during TV display may be displayed as a frame 23b. Here, the position of the frame 23b may be shifted by the user by operating a switch or the like. It is more desirable that the position of the frame 23b can be changed in the form of image tracking once set.

  FIG. 12 is a flowchart for explaining the procedure of the photographing process. Here, in order to make it easy to understand, the description will focus on the scene at the time of vertical composition shooting. This process is mainly executed by the MPU 10, the size changing unit 5a, and the display control unit 12 according to the program.

  First, the entire image is displayed on the display unit 13 (step S51). This is to make the shutter chance and composition be judged. A wide-screen frame 23b for display on the TV screen is also displayed (step S52). That is, an image as shown in FIG. 10A is displayed. Of course, a multi-display as shown in FIG.

  The user waits for a shooting instruction (step S53). The switch 16a is operated by a user operation that is determined to have an appropriate timing and composition. If there is an operation instruction (YES in step S53), still image shooting corresponding to the entire screen (entire image) is performed (step S54). Then, photographing within the frame 23b in step S52 is performed (step S55). Shooting in step S55 is recording an image whose size has been changed by the size changing unit 5a in accordance with the playback capability of the TV 21. As a result, when the TV 21 is used, it is possible to switch between the screen as shown in FIG. 4A and the screen as shown in FIG.

  If the position of the frame 23b does not like before shooting, it can be changed. A change operation by the user's XY operation key is determined (step S51). If there is a frame position switching operation for changing the position of the frame 23b (YES in step S56), the position of the frame 23b is moved in accordance with the user's cross key operation (step S57). The cross key is an operation key belonging to the operation unit 16. If there is no switching operation (step S56 NO), the process jumps to step S58. When the user performs the locking operation of the frame 23b at that position (YES in step S58), the image in the frame is stored (step S59). Then, even if the image is changed by changing the direction of the camera (YES in step S60), the position of the frame is made to follow where the image is (step S61). The tracking of the position of the frame 23b is performed based on detection by the face detection unit 15, for example. If there is no lock operation (NO in step S58) or no image change (NO in step S60), the process returns to step 51.

  Thus, if the frame 23b moves according to the image, the frame 23b is moved to a position where a similar image exists even if the composition as shown in FIG. 11A changes to the composition as shown in FIG. 11B. Therefore, even if the user does not bother to change the frame position, the camera 1 determines the image and switches the image position of the TV reproduction display character, so that the user can concentrate on shooting.

  As described above, according to the second embodiment, a still image on the premise of printing and a still image on the premise of TV playback capable of displaying with movement are simultaneously shot, and the shot image is taken regardless of the playback mode. Can enjoy.

(Third embodiment)
A third embodiment will be described with reference to FIGS. 13 to 16. In the third embodiment, moving image shooting is performed at the same time before and after still image shooting. In the third embodiment, still image shooting is mainly used, and moving image shooting is a shooting method that supplements still image shooting. That is, a still image that is itself completed as a work is shot, and a corresponding moving image is reproduced by a predetermined operation for the subject. A block diagram of a camera to which the present invention is applied is the same as FIG.

  FIG. 13 is a flowchart for explaining the procedure of the imaging control process of the camera 1. This photographing control process is mainly executed by the MPU 10, the AFE unit 4, the vertical / horizontal determination unit 17 and the like according to the program.

  It is determined whether or not a release operation for still image shooting has been performed (step S71). Wait for the user to take a still image. Before the release operation (NO in step S71), the process proceeds to step S76, and a moving image is recorded prior to still image shooting. Here, the moving image is recorded in a buffer memory (not shown). First, since it is pre-shooting, the moving picture shooting for a certain time or longer is deleted. This is because the buffer memory overflows. Therefore, it is determined whether there is a moving image older than a predetermined time (step S76), and the corresponding moving image is deleted (step S77).

  Thereafter, the method of shooting a movie is changed depending on the shooting composition. First, the horizontal composition shooting will be described. The vertical / horizontal determination of the composition in step S78 is performed by the vertical / horizontal determination unit 17. Since horizontal shooting is not vertical shooting (NO in step S78), the process proceeds to step S79. Then, the moving image whose size has been changed is recorded (step S79). Here, the size is changed in accordance with the aspect ratio of the TV 21. In addition, the number of pixels is also recorded with the number of pixels adjusted to the resolution of the TV 21. There are two ways to change the size. One is that the AFE unit 4 reads out the entire range of pixels from the image sensor 3 and changes the size in the size changing unit 5a. The other is a method in which the AFE unit 4 reads out pixels in a region having a set size from the image sensor 3. Either is possible.

  If a release operation is performed (YES in step S71), a still image is captured over the entire image sensor (step S72). This is so that beautiful images can be enjoyed even after printing. Effective use of the entire surface of the image sensor makes it possible to shoot using more pixels than moving images. And it compresses and records (step S73). Since it is horizontal shooting (NO in step S74), the process proceeds to step S82. Then, the resized moving image is recorded again (step S82). Recording is performed until a predetermined total time of TA and TB is reached (step S83). When the moving image recording time reaches a predetermined time of TA and TB (YES in step S83), the moving image shot before the still image and the moving image shot after the still image and recorded in the buffer memory are stored in the still image. It is recorded on the medium 8 so as to relate to the image (step S84).

  Next, the case of vertical shooting will be described. In the vertical shooting before the release operation (NO in step S71) (YES in step S78), the A moving image and the B moving image are simultaneously recorded (steps S80 and 81). The A movie is a movie having a size as shown in FIG. The B moving image is a moving image having a smaller size as shown in FIG. This also continues for a predetermined period until a release operation is performed. If a release operation is performed (YES in step S71), a still image is captured over the entire image sensor (step S72), and is compressed and recorded (step S73), as in the horizontal shooting.

  Next, since it is vertical shooting (step S74 YES), it is determined whether there is a face on the screen (step S75). The face detection unit 15 determines whether or not there is a face. When there is no face (NO in step S75), the same processing as in the above-described horizontal shooting is performed (steps S82 to S84). If it is determined that there is a face (step S75), the screen portion including the face is recorded as A movie (step S85). The A movie is a movie having a size as shown in FIG. And A moving image recording is continued only for the predetermined time TA (step S86 NO). When the predetermined time TA has elapsed (YES in step S86), the screen portion including the face is recorded as a B moving image (step S87). The B moving image is a moving image having a smaller size as shown in FIG. Similarly, the B moving image recording is continued for a predetermined time TB (step S88 NO). When the predetermined time TB has passed (step S88 YES), the B moving image recording is ended.

  And about the A moving image recorded at step 80, the predetermined time TA before still image photography is recorded on the medium 8 as an A moving image (step S89). Similarly, for the B moving image recorded in step 81, a moving image before a predetermined time TB is recorded on the medium 8 as a B moving image (step S90). Thus, in vertical shooting with a face, images are recorded in the order of TB time B moving image, TA time A moving image, still image, TA time A moving image, and TB time B moving image. In vertical shooting without a face, images are recorded in the order of TB time B moving image, TA time A moving image, still image, and TA + TB time moving image.

  FIG. 14 is a timing chart showing still image and moving image signal output from the image sensor 2 and a diagram showing pixels to be read. The AFE unit 4 performs thinning readout of the image sensor 3, and the MPU 10 performs overall control. That is, here, the AFE unit 4 functions as an image data extracting unit or a reading unit that extracts image data. The diagrams are all active L. Although two examples of the moving image size changing method have been described above, the following control is performed when the AFE unit 4 changes the read area of the image pickup device 3 to change the moving image size. .

  The top shows the release operation timing. The second from the top is the output 1 of the image sensor. The output 1 indicates the output (reading) timing of the image signal of the still image (first image). The right side is a part of the pixel array, and pixels read out from the image sensor are indicated by diagonal lines. In the still image, all pixels are read from the entire area of the image sensor.

  The third from the top is the output 2 of the image sensor. The output 2 of the image sensor indicates the output (reading) timing of the image signal of the moving image (second image). Since the number of pixels of the still image is larger, the output time of the image signal of the still image takes longer than that of the moving image. The fourth from the top shows an image signal sequence for A moving image. The pixels to be read out are thinned out to about a half of the image sensor, for example. The bottom shows an image signal sequence for the B moving image. The pixels to be read out are thinned out to about a half of the area of the image sensor, for example. As the image signals for the A moving image and the B moving image, the signal indicated by the output 2 of the image sensor is used alternately.

  Until the release operation is performed, the output 2 which is the image signal of the moving image output from the image sensor is alternately used for the A moving image and the B moving image. That is, A moving image and B moving image are recorded simultaneously. As soon as the release operation is performed, the image signal of the still image is read (output 1). During this time, the image signal for moving image is not output from the output 2.

  When the output of the still image signal is completed, the moving image signal is output again from the output 2. The moving image signal is used as the A moving image during the first TA period. The next TB period is used as a B moving image.

  FIG. 15 is a flowchart for explaining the procedure of image output processing during reproduction. This is a case where an image shot by the shooting process described with reference to the flowchart of FIG. 13 is reproduced. This image output process is mainly executed by the MPU 10, the AFE unit 4 and the like according to the program. FIG. 16 is a diagram showing images reproduced and displayed on the TV 21 in order of time when the captured image is a vertical image. FIG. 16 is described according to the flowchart.

  A photographed image file is selected in accordance with a user instruction (step S101). It is determined whether the selected file is a moving image or a still image (step S102). If it is a moving image (YES in step S102), moving image reproduction is performed (step S103). During the reproduction of the moving image, an end operation by the user is determined (step S104). If there is an end operation (step S104YES), end processing is performed. Further, during the moving image reproduction, the user also determines a slide show operation instruction (step S105). If there is a slide show operation instruction (step S105 YES), the next file is selected from the media (step S106), and the process proceeds to step S102 described above.

  On the other hand, when a still image is selected in step S102 (NO in step S102), a moving image before still image shooting is reproduced. If the image is a vertical image, the B image is reproduced in the TB period and the A image is reproduced in the TA period (step S107). 16A and 16B show the B image and the A image reproduced on the TV 21. FIG. If the image is a horizontal image, the resized moving image is played back for a period of TA + TB. Then, the still image is reproduced for a predetermined period (step S108). It is an image like (C) of FIG. Subsequently, when the image is a vertically shot image, the A image is reproduced for the TA period and the B image is reproduced for the TB period (step S109). 16D and 16E show the A image and the B image reproduced on the TV 21. FIG. If the image is a horizontal image, the resized moving image is played back for a period of TA + TB (step S109). Then, the process proceeds to step S104 described above, and processing corresponding to the end operation (step S104) and the slide show operation (step S105) is performed.

  In this way, in the third embodiment, since moving images are recorded in association with before and after still images, it is possible to view images with more information by supplementing the movement of the subject at that time in addition to still images. And In addition, when a still image is displayed on a TV, it is possible to effectively reproduce the image in accordance with the display form. When the still image obtained in this way is played back on a TV, the effect of using the full screen of a large TV effectively can be obtained by using the fullness of the still image and the fun of the motion and process of the moving image.

  In each of the above embodiments, part or all of the MPU 10 processing described in each of the above embodiments may be configured by hardware. On the contrary, the AFE unit 4 or the vertical / horizontal determination unit 17 may be configured by software. The specific configuration is a design matter. Each control process by the MPU 10 is realized by a software program stored in the ROM 11 being supplied to the MPU and operating according to the supplied program. Therefore, the software program itself realizes the functions of the MPU 10, and the program itself constitutes the present invention. A recording medium for storing the program also constitutes the present invention. As a recording medium, besides a flash memory, an optical recording medium such as a CD-ROM or DVD, a magnetic recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Moreover, although each embodiment demonstrated the example which applied this invention to the digital camera, you may apply not only to this but the camera part of a mobile telephone, for example.

  Furthermore, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

1 is an overall block diagram of a camera 1 to which the present invention is applied in a first embodiment. The figure which showed an example of the user's image appreciation scene in 1st Embodiment. The figure which shows the scene of vertical composition imaging | photography in 1st Embodiment. The figure which shows the various images displayed on TV21 of a wide screen in 1st Embodiment. The figure which shows the size of the image displayed on the screen of TV21 in 1st Embodiment, and the relationship of the pixel used for a display correspondingly. 5 is a flowchart for explaining a procedure of image output processing in the first embodiment. 6 is a flowchart for explaining a procedure of image recording processing for recording a size-changed image at the time of shooting in the first embodiment. 5 is a flowchart for explaining a procedure of a synthesis process in the first embodiment. The figure which shows the image displayed on TV21 in 1st Embodiment. In 2nd Embodiment, two examples of the monitor image displayed on a display part at the time of imaging | photography. The figure which shows the tracking of the frame 23b at the time of composition change in 2nd Embodiment. 9 is a flowchart for describing a procedure of imaging control processing in the second embodiment. 9 is a flowchart for describing a procedure of imaging control processing in the third embodiment. In 3rd Embodiment, the timing chart which shows the image signal of the still image output from the image pick-up element 2, and a moving image. 9 is a flowchart for explaining a procedure of image output processing during reproduction in the third embodiment. In the third embodiment, a state in which vertically shot images are reproduced in time order on the TV 21 is shown.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Camera, 2 ... Lens part, 3 ... Image pick-up element, 4 ... Analog front end part, 5 ... Image processing part,
5a ... Size changing unit, 6 ... Compression / decompression unit, 6a ... Still image compression / decompression unit, 6b ... Video compression / decompression unit,
7 ... Recording / playback unit, 8 ... Media, 10 ... MPU, 11 ... ROM, 12 ... Display control unit, 13 ... Display unit,
DESCRIPTION OF SYMBOLS 14 ... Output part, 15 ... Face detection part, 16 ... Operation part, 16a ... Release switch, 16b, 16c ... Change switch, 17 ... Portrait / horizontal determination part, 20 ... Subject, 21 ... External display device,
22 ... print, 23a ... non-display portion, 23b ... frame, 23c ... photographed image for still image,
23d ... Resize image

Claims (12)

For cameras that record video and still images,
An image data extraction unit for extracting first image data and second image data from the image sensor;
A recording unit for recording the first image data as a moving image and the second image data as a still image;
A composition determination unit for determining the vertical and horizontal composition of the camera;
The camera according to claim 1, wherein the image data extraction unit changes the acquisition range of the first image data from the imaging device in accordance with an output of the composition determination unit. In cameras that record moving and still images,
A readout unit that reads out a still image and a moving image having a part of the still image as a shooting region from the imaging element;
A control unit that controls recording of an image read from the image sensor, wherein the reading unit captures a part of the still image together with the still image at a timing before and after the still image shooting. Is read out,
The camera according to claim 1, wherein the control unit controls to record the read moving image in association with the still image. Provided with an output unit that outputs the captured moving image and still image to an external display device,
The camera according to claim 2, wherein the readout unit reads out a range corresponding to an aspect ratio of the external display device as an imaging region of the moving image. It has a vertical / horizontal determination unit that determines the composition during shooting,
The camera according to claim 2, wherein the readout unit reads out a range corresponding to the determination of the vertical / horizontal determination unit as the imaging region of the moving image. The readout unit reads out a plurality of moving images with different shooting areas when the vertical / horizontal determination unit determines vertical shooting, and the control unit reads a plurality of moving images having different shooting areas before and after still image shooting. The camera according to claim 4, wherein the camera is controlled to record an image. In cameras that record moving and still images,
A readout unit for reading out still images and moving images from the image sensor;
A size changing unit for changing the read moving image to a size of a part of the image;
A control unit that controls recording of an image read from the image sensor, and the reading unit reads a moving image at a timing before and after the still image shooting together with the still image at the time of still image shooting.
The camera according to claim 1, wherein the control unit controls to record a moving image resized by the size changing unit together with a still image at the time of still image shooting. Provided with an output unit that outputs the captured moving image and still image to an external display device,
The camera according to claim 6, wherein the size changing unit changes the size of the moving image according to an aspect ratio of the external display device. It has a vertical / horizontal determination unit that determines the composition at the time of shooting,
When the vertical / horizontal determination unit determines vertical shooting, the reading unit reads a plurality of moving images with different shooting areas, and the control unit reads a plurality of moving images having different shooting areas before and after still image shooting. The camera according to claim 6, wherein the camera is controlled so as to record. In the camera control method for recording moving images and still images,
At the time of still image shooting, a moving image having a part of the still image as a shooting area is read out together with the still image at a timing before and after the still image shooting, and the read moving image is recorded in association with the still image. An imaging control method characterized by the above. In the camera control method for recording moving images and still images,
When shooting a still image, the moving image is read out together with the still image at the timing before and after this still image shooting.
A shooting control method, wherein the read moving image is changed to a size of a part of the image, and the moving image having the changed size is recorded together with the still image. In a program for causing a computer to execute a shooting control method of a camera that records moving images and still images,
In the shooting control method, during still image shooting, a moving image in which a part of the still image is captured as a shooting area is read at the timing before and after the still image shooting together with the still image, and the read moving image is converted into the still image. A program characterized by recording in association. In a computer-readable recording medium for recording a program for causing a computer to execute a shooting control method of a camera that records a moving image and a still image,
In the shooting control method, during still image shooting, a moving image in which a part of the still image is captured as a shooting area is read at the timing before and after the still image shooting together with the still image, and the read moving image is converted into the still image. A recording medium for recording in association with the recording medium.

Images