JP5628992B2 - CAMERA, CAMERA CONTROL METHOD, DISPLAY CONTROL DEVICE, AND DISPLAY CONTROL METHOD - Google Patents

Description

  The present invention relates to a camera, a camera control method, and a display control device, and more specifically, a digital camera, a video camera, a camera-equipped mobile phone, and the like, a camera having a still image shooting function and a moving image shooting function, a camera control method, and a display. The present invention relates to a control device and a display control method.

  As in conventional film photography, still image shooting that cuts out a moment is relatively easy for a general user. On the other hand, in video shooting, it was difficult to determine the start timing and end timing, and movie cameras were used only for events that were formalized, such as athletic meet and wedding ceremony. In addition, except for the case where a detailed performance is determined in advance, the change in the captured moving image is scarce and it is difficult to obtain an image that can withstand viewing. This is because a monotonous image is difficult to endure for a user who is used to a moving image whose composition changes frequently such as a television program. Furthermore, although various expressions can be made by changing the shooting parameters, there are things that are difficult for an amateur user.

  Therefore, it is conceivable to change the image by combining a still image and a moving image. For example, Patent Documents 1 and 2 disclose a camera that can capture a still image while capturing a moving image. In addition, there has been proposed a camera that does not become monotonous by editing a moving image after shooting the moving image. For example, Patent Document 3 discloses a camera that can record a moving image before and after still image shooting. Furthermore, for example, in Patent Document 4, when editing a video, when connecting the video, a transition effect is given when the rules at the time of connection (end with pan and start with pan) are not followed. There has been disclosed a camera that can easily edit a moving image even for a user who has no technical knowledge about editing.

Japanese Patent Laid-Open No. 4-331583 Japanese Patent No. 3673528 Japanese Patent Application Laid-Open No. 2001-078137 JP 2003-110995 A

  The cameras disclosed in Patent Documents 1, 2, and 3 can only shoot moving images and still images with the same device, and do not shoot images that are not monotonous. The camera disclosed in Patent Document 4 is a proposal for editing a moving image, and does not capture an image that is not monotonous at the time of shooting.

  The present invention has been made in view of such circumstances, and a camera, a camera control method, a display control device, and a camera that enable anyone to easily shoot or display a variety of varied images. It is another object of the present invention to provide a display control method.

In order to achieve the above object, a camera according to a first aspect of the present invention is an imaging unit that converts a subject image into image data, acquires image data from the imaging unit in response to a release operation, and before or after the release operation. A shooting unit that acquires a plurality of image data from the imaging unit; a trimming unit that sequentially generates trimmed image data in different regions from the plurality of image data; and trimmed image data generated by the trimming unit; A controller that records the image data acquired during the release operation, and the controller detects a portion having a characteristic related to a person, and the trimmed image data generated in the different area includes before the portion is characterized, the image moves the trimming position from the portion next of the feature, finally the entire screen, sequentially raw To.

In the camera according to the second invention, in the first invention, the trimmed image data is sequentially generated so as to be reduced from the enlarged image.

In the camera according to the third invention, in the first invention, the trimmed image data is sequentially generated so as to be enlarged from the reduced image.

In the camera according to a fourth aspect of the present invention, in the first aspect, the trimmed image data is subjected to exposure correction, and the image data acquired during the release operation is sequentially generated so as to achieve proper exposure.

According to a fifth aspect of the present invention, there is provided a camera control method for converting a subject image into image data, obtaining the converted image data in accordance with a photographing instruction, recording the converted image data in a recording unit, and recording the recorded image data. A portion having a characteristic related to the person is detected, the first portion at the position of the characteristic is trimmed, and this is recorded in the recording unit, and the first portion at a position different from the first portion is recorded. The portion 2 is trimmed and finally recorded in the recording unit so that the entire screen can be reproduced sequentially.

According to a sixth aspect of the present invention, there is provided a display control apparatus for recording the image data at the time of release acquired during the release operation and the trimmed image data acquired before or after the release operation and trimmed in different areas in a plurality of frames. A portion having a characteristic related to a person from the image data recorded in the recording unit, and reproducing trimmed image data of a first portion having a characteristic first in the image data, Subsequently, a trimming image of the second part at a position different from the first part is reproduced, and finally, a reproduction control unit that sequentially reproduces the image data acquired during the release operation.

According to a seventh aspect of the present invention, there is provided a display control method comprising: recording image data acquired during a release operation and trimmed image data acquired before or after the release operation and trimmed in different areas in a plurality of frames; A display control method in a recorded display device, wherein a portion having a characteristic related to a person is detected from the image data recorded in the recording unit, and the first of the image data having a characteristic is detected . The trimmed image data of the first part is reproduced, then the trimmed image of the second part at a position different from the first part is reproduced, and finally the image data acquired during the release operation is sequentially reproduced. To do.

  According to the present invention, a camera that allows a viewer to imagine what (who) is captured until the entire subject is displayed, and allows the viewer to increase expectation on the displayed subject, A camera control method, a display control device, and a display control method can be provided.

It is a block diagram which shows the electric constitution of the camera concerning 1st Embodiment of this invention. It is a block diagram which shows the detail of the image processing part of the camera concerning 1st Embodiment of this invention. FIG. 5 is a diagram illustrating a procedure of shooting a still image and moving image shooting performed before shooting the still image in the camera according to the first embodiment of the present invention. In the camera according to the first embodiment of the present invention, it is a diagram showing the relationship between still image shooting and displayed and recorded images in moving image shooting performed prior to the still image shooting. 6 is a flowchart illustrating an operation for deleting unnecessary images in the camera according to the first embodiment of the present invention. FIG. 3 is a diagram illustrating still image shooting and a display state of a moving image shot prior to shooting of the still image in the camera according to the first embodiment of the present invention. FIG. 6 is a diagram illustrating a relationship between a still image shooting and a displayed and recorded image in moving image shooting performed prior to the still image shooting in the camera according to the modification of the first embodiment of the present invention. In the camera concerning 2nd Embodiment of this invention, it is a figure which shows the relationship of the image displayed and recorded in the video recording performed before imaging | photography of a still image and this still image. It is a flowchart which shows the operation | movement which changes the trimming range in the camera concerning 2nd Embodiment of this invention. It is a figure explaining a mode that the trimming range is moved according to the time of expression change in the camera concerning the modification of 2nd Embodiment of this invention. It is a figure which shows the procedure of the video recording performed in the camera concerning 3rd Embodiment of this invention continuously after image | photographing of a still image and this still image. It is a figure which shows the relationship between the image displayed and recorded in the video recording performed in the camera concerning 3rd Embodiment of this invention after a still image imaging | photography and this still image imaging | photography. In the camera concerning 3rd Embodiment of this invention, it is a figure which shows a mode that the direction of a camera changes after still image photography. In the camera concerning 3rd Embodiment of this invention, it is a figure which shows a mode that the center part of a screen is recorded and displayed as a moving image, even when the direction of a camera changes after a still image photography.

  Hereinafter, a preferred embodiment will be described using a camera to which the present invention is applied according to the drawings. FIG. 1 is a block diagram showing an electric circuit of a camera 10 according to the first embodiment of the present invention. The camera 10 is a digital camera, and includes a control unit 1, an imaging unit 2, a face detection unit 2a, a parameter setting unit 3, a motion determination unit 4, a recording unit 6, a parameter control unit 7, a display unit 8, an operation unit 9, and a clock. It consists of part 11 grade.

  The imaging unit 2 includes a photographing lens (zoom lens) having a zoom function and a focusing function, an exposure control unit such as a shutter / aperture, an imaging element, a driving and reading circuit for the imaging element, and the like. The subject image is converted into image data by the image sensor and output. The face detection unit 2a is based on the image data output from the imaging unit 2 and processed by the control unit 1, whether or not a human face is included in the subject image, and if a face is included Detects the number of human faces, their positions and sizes, and outputs the detection results to the control unit 1. It also detects facial expressions such as smile levels. In detecting a face, shadows of parts such as eyes, nose, and mouth in the face are extracted and performed by a pattern matching method or the like.

  The control unit 1 controls the entire sequence of the camera 10 according to a program stored in a storage unit (not shown) in the control unit 1. The control unit 1 includes a composition change determination unit 1a, a trimming unit 1b, and an image processing unit 5. The composition change determination unit 1a determines whether the composition of the screen and the way the camera 10 is held have changed. In determining the composition change of the screen, a motion vector or the like is used based on the image data output from the imaging unit 2. Further, how to hold the camera 10 is determined based on a determination output of a motion determination unit 4 described later.

  The trimming unit 1b performs a trimming process for cutting out part of the image data output from the imaging unit 2. When cutting out the image data, among the image data of the moving image shot before or after the still image shooting, a plurality of positions far from or near the face position detected by the face detection unit 2a Then, trimming processing is performed.

  The image processing unit 5 captures image data output from the imaging unit 2, performs various image processing such as thinning processing, clipping processing, resizing processing, edge enhancement, color correction, white balance, and image compression, and Image processing for view display, for recording a still image and a moving image in the recording unit 6, and for reproducing and displaying a still image and a moving image is performed. In image compression / expansion, a still image compression / expansion circuit, a moving image compression / expansion circuit, and the like are provided for still images and moving images in accordance with respective processes.

  In addition, the image processing unit 5 stores the full-size image data or the image-processed image data of a captured moving image for a predetermined time (for example, about 0.5 second to 2 seconds) before and after still image shooting. Temporary storage is possible for each frame. In particular, in the first embodiment, the trimming unit 1b performs a trimming process on the image data of a moving image acquired before shooting a still image, and temporarily stores the processed image data. This trimming process will be described later with reference to FIGS.

  The parameter setting unit 3 manually sets shooting parameters using a zoom button for changing the focal length in the imaging unit 2, an aperture value setting operation unit for setting an aperture value, and the like, and outputs the shooting parameters to the control unit 1. In the case of an aperture value or the like, it may be automatically set according to the result of photometry. The parameter control unit 7 controls the imaging unit 2 based on the imaging parameters that are set manually or automatically by the parameter setting unit 3. By controlling the shooting parameters, it is possible to adjust exposure, angle of view, background blur (depth of field), and the like.

  The motion determination unit 4 includes a six-axis sensor or the like that detects a total of six axes of physical quantities including acceleration in a three-dimensional space, that is, three-axis acceleration, and rotation speed in the three-dimensional space, that is, a three-axis angular velocity. The motion determination unit 4 can determine whether or not the way the camera 10 is held.

  The operation unit 9 includes various operation members such as a release button, a power switch, a reproduction button, a menu button, and the like, determines the operation state of these operation members, and sends a determination result to the control unit 1. The above-described control unit 1 controls photographing and reproduction in a predetermined sequence according to the operation state of the operation member. The recording unit 6 records image data of still images and moving images acquired by the imaging unit 2 and compressed by the image processing unit 5 when a shooting instruction is given by the release button.

  The display unit 8 includes a display monitor such as a liquid crystal panel or an organic EL panel disposed on the back surface of the camera 10 and the like. A live view display before shooting, a playback display of recorded images, a camera information display, and the like. I do. The photographer can observe the live view display and determine the composition and timing. The clock unit 11 performs a timekeeping operation and outputs shooting date information. This shooting date / time information is recorded when image data of a still image or a moving image is recorded in the recording unit 6.

  Next, details of the configuration of the image processing unit 5 will be described with reference to FIG. As described above, the image processing unit 5 captures the image data output from the imaging unit 2 and performs various image processing such as thinning processing and resizing processing. Here, the moving image captured before and after the still image shooting is performed. A configuration related to image processing of image data will be mainly described.

  The temporary recording unit 5a is a memory for temporarily storing image data from the imaging unit 2, a memory 0 for temporarily storing image data of a still image, a predetermined time prior to the still image, and a still image Memory (−n) to memory (−1), memory 0, memory 1 to memory n for temporarily storing image data corresponding to each frame of a moving image (continuous shooting) to be captured for a predetermined time that follows. Have Here, the memory (−n) to the memory (−1) are memories for temporarily recording moving images for a predetermined time prior to still image shooting, and the memory 0 is for temporarily recording image data of still images. The memories 1 to n are memories for temporarily recording a moving image for a predetermined time after still image shooting. Note that it is not necessary to record image data in all of the memories (-n) to the memory n, and only a limited memory among them may be used for recording image data of moving images and still images.

  The time control unit 5h inputs timekeeping information from the clock unit 11 and performs timekeeping control for sequentially recording moving image data at each frame update time interval in each memory of the temporary recording unit 5a. In this embodiment, the time interval for temporarily recording the image data is set to one frame interval of the image data output from the imaging unit 2, but may be set to several frame intervals.

  A memory 0 for temporarily storing still image data is connected to the still image compression unit 5b. The still image compression unit 5b performs image compression such as JPEG. Memory (-n) to memory (-1) and memory 1 to memory n for storing image data of each frame of the moving image (continuous shooting) are connected to the effect processing unit 5e.

  The effect processing unit 5e performs image processing that produces an image effect on the input moving image data. The moving image compression unit 5f performs moving image compression on the image data processed by the effect processing unit 5e by MPEG4, motion JPEG, or the like.

  The connection data unit 5g combines the moving image data generated by the moving image compression unit 5f and the still image data generated by the still image compression unit 5b, and continuously connects both image data. Generate information. The connection information by the connection data unit 5f, the image data from the still image compression unit 5b, and the image data from the moving image compression unit 5g are sent to the recording unit 6 and recorded as one image file. Of course, it is also possible to record in a separate file and record information associated therewith in a still image or moving image file. It is also possible to substitute this with time information. When the image data recorded in the recording unit 6 is reproduced, the reproduction speed is increased, or conversely, the image data is reproduced by fast-forwarding or slow motion. Also, the number of seconds corresponding to the memory capacity of the temporary recording unit 5a varies depending on how many frames are taken per second. Thus, the memory is used with a degree of freedom.

  Next, shooting and reproduction of an image in this embodiment will be described with reference to FIG. Images are taken in the order of images 21a to 21d at the time of shooting. Among them, the image 21d is a still image, and the images 21a to 21c are moving images shot prior to shooting of a still image. The photographer intends to shoot the subject 22 and acquires the image 21d as a still image. However, since the image 21d is displayed from the beginning at the time of reproduction, there is no time to enjoy what image is displayed when viewing. Can't raise expectations.

  Therefore, in the present embodiment, the entire portion including the face of the subject 22 is not reproduced and displayed from the beginning, but the portion other than the face is displayed first so that the whole image can be seen gradually. Specifically, from the image data recorded at the time of shooting, the image 21a in which the hand portion is enlarged is first read and displayed, and then the image 21b in a wider range including the hand portion is read and displayed. Next, the image 21c in which the face portion is enlarged is read and displayed, and finally the image 21d in which the entire subject 22 is reflected is read and displayed. Since the viewer has a sense of expectation to quickly know what (who) is reflected, it is possible to perform effective reproduction display using the psychology. In other words, it is difficult for the viewer to easily understand the part that the viewer is concerned about, such as who is in the picture and what kind of facial expression they are doing. At this time, by using a facial expression change peculiar to a moving image, for example, by showing the movement at the moment when the mouth smiles, it is possible to enhance the desire to know who is in the picture.

  The camera 10 in the present embodiment records image data suitable for performing such playback display. Of course, the images 21a to 21c may be cut out from the entire image data such as the image 21d. However, in this embodiment, the image does not change in expression and is not interesting. The video is played back as a video.

  Next, the photographing operation of the camera 10 in the present embodiment will be described using the flowchart shown in FIG. When the moving image shooting flow is entered, it is first determined whether or not shooting is to be performed (S1). When the photographer observes the live view display on the display unit 8 and determines the composition, the release button in the operation unit 9 is operated, and it is determined here whether or not the release button has been operated.

  If the result of determination in step S <b> 1 is that shooting has not been performed, images corresponding to the aforementioned images 21 a to 21 c are acquired in steps S <b> 2 to S <b> 4. First, trimming photography is performed on the lower part 1 of the face (S2). Here, from the full size image data (for example, 12M (12 million pixels)) for the portion below the face portion of the subject 22, in this example, the hand portion, 2M (2 million pixels) is obtained by the trimming unit 1b. The image data corresponding to the image 21a is temporarily recorded in the memory of the temporary recording unit 5a. Here, the number of pixels is 2M, which is the number of pixels assumed to be reproduced and displayed as a high-definition image, but may be a different value depending on the assumed reproduction display device. When trimming is performed, the size of the display unit is limited so that the screen can be displayed without waste during display. The data can be half of this. Smaller sizes are easier to handle, and the degree of freedom in moving the trimming position can be increased. If the size is large, it cannot be displayed and is wasted.

  Subsequently, trimming photography is performed on the lower part 2 of the face (S3). Here, the range above the lower part 1 of the face and wider than the range of the lower part 1, in this example, the part including the hand part and extending from the lower part 1 is trimmed at 2M from the full-size image data, and the image 21b Is temporarily recorded in the memory of the temporary recording unit 5a. Once the lower part 2 is photographed, next, trimming photographing is performed for the lower part 3 of the face (S4). Here, the range above the lower part 2 of the face and approximately the same as the range of the lower part 2, in this example, the enlarged part including the face part is trimmed at 2M from the full image data, and the image 21c is trimmed. Corresponding image data is temporarily recorded in the memory of the temporary recording unit 5a. When provisional recording ends, the process returns to step S1.

  As described above, in steps S2 to S4, a trimming process for cutting out a part (lower parts 1 to 3) of full-size image data is performed. What is important here is the continuity of each image. In this embodiment, since the face portion is gradually made visible, when the face size in the image 21c and the face size in the image 21d are compared, the face size changes in a direction of decreasing (enlargement → reduction). ing. Therefore, it is better not to disturb the enlargement → reduction relationship also in the images 21a to 21c. However, when moving from the image 21b to the image 21c, only the trimming position is shifted in a state where there is no change in the enlargement ratio. As described above, the enlargement ratio is changed in a fixed direction, but it is preferable that the change in the trimming position is also moved in a fixed direction and is not reversed.

  If the result of determination in step S1 is shooting, a still image is next shot (S11). Here, the full-size image data (12M (12 million pixels)) of the still image output from the imaging unit 2 is recorded in the recording unit 6.

  Once a still image is shot, unnecessary images are deleted (S12). Here, in step S2 to S4, image data other than the image data finally recorded in the recording unit 6 is deleted from the image data temporarily recorded in the temporary recording unit 5a. The trimming shooting in steps S2 to S4 is repeated until the still image shooting in step S11 is performed, and the trimming image recorded in the recording unit 6 is only the latest image on which the still image shooting has been performed. Therefore, in step S12, trimming images and the like not recorded in the recording unit 6 are deleted. Note that a trimmed image that exceeds the maximum recording capacity of the temporary recording unit 5a to be temporarily recorded is deleted during the processing of steps S2 to S4. When unnecessary images are deleted, the flow of moving image shooting ends.

  Since the trimmed images and still image data of the lower face 1, 2, and 3 are recorded in this way, during playback, the image data is read in the order of lower face 1 → lower face 2 → lower face 3 → still image, Display playback. That is, it is possible to display the entire image at the time of release at the end while moving the portion from the beginning. In the present embodiment, the lower part of the face is first trimmed, and the trimming position is moved upward toward the face position. This starts from the top of the face and starts from the sky unrelated to the person, and it is often difficult to raise expectations. In general, assuming that a person is standing or sitting, the lower part of the face is trimmed first from the viewpoint of giving priority to the part related to the person. By using the contour information of the person and the information of the skin color, the trimming position may be moved along the part such as the hand or the foot to enhance the expectation. Since it is desirable to display the entire face after displaying the change in facial expression as much as possible, before displaying the entire face, it is preferable to display a large portion that is easily changed depending on the expression, such as eyes and mouth. In addition, in the case of a photo book in which the same person is shown, it is known who is shown, and the change in facial expression tends to be monotonous. Therefore, when the same person continues, control that shifts the trimming position to the face from a bright color other than the face may be performed. Note that the image cut out by trimming is resized so that it fits in the display unit.

  The relationship between temporary recording and final recording of images in moving image shooting and still image shooting described with reference to FIG. 3 will be described with reference to FIG. The line corresponding to “imaging (full)” in FIG. 4 indicates the full-size image data captured at time T1 to time T8. Based on this image data, the control unit 1 and the image processing unit 5 generate a live view image and display it on the display unit 8. The live view image is generated by resizing or thinning out the number of pixels corresponding to the number of pixels of the display unit 8.

  Further, trimming image data for temporary recording is generated by performing trimming processing based on the full image data. As shown in FIG. 4, three trimmed images in the screen are generated from the full-size image data for one frame, and the trimmed images are temporarily recorded in the temporary recording unit 5a. In the present embodiment, the number of pixels of the image data of the trimmed image is 2M as described above.

  In the example of FIG. 4, a still image is taken at time T8 (corresponding to the timing of S11 in FIG. 3). The still image full image data 24d acquired at this timing is finally recorded in the recording unit 6. In addition, the trimmed image temporarily recorded at times T5 to T7, which is closest to time T8, is finally recorded on the recording unit 6. In the final recording of the image data of the trimmed image, the trimmed image data 23a temporarily recorded at time T5, the trimmed image data 23b temporarily recorded at time T6, and the trimmed image data 23c temporarily recorded at time T7, respectively. Finally recorded as final trimmed image data 24a, 24b, 24c. Other trimmed image data temporarily recorded at time T1 to time T4 and trimmed image data other than the trimmed image data 23a to 23c temporarily recorded at time T5 to time T7 are deleted as unnecessary images.

  As described above, according to the camera 10 of the present embodiment, when a still image is captured at time T8, the trimmed image data temporarily recorded immediately before the still image is recorded as the final image. Therefore, by reproducing the last recorded image data, the reproduction is started from the portion of the subject 22 as described with reference to FIG. 3, and finally the display ends with the entire image of the subject 22. For this reason, anyone can easily shoot and display a variety of varied images by combining moving images and still images.

  Note that the image data of the trimmed image is generated from the full-size image data. When trimming, a part of the image data is cut out. Therefore, it is desirable that the base image data has a larger number of pixels. However, if there is no problem in consideration of the number of pixels of the assumed display device, the full-size image data is not necessarily used. Instead, resized or thinned image data may be used. Needless to say, even when full-size image data is finally recorded, resizing is necessary according to the screen to be displayed. The still image is recorded in full size for printing or partial enlargement, and with the effect of moving images as in this embodiment, it is reproduced and displayed on the display unit of a camera LCD monitor, TV, mobile phone, etc. In this case, resizing is performed according to the size of the display unit. Moreover, although the example which raises the expectation with respect to a still image is shown in this embodiment, even when a person appears in a moving image, this embodiment can be applied as a technique which raises an expectation. In this case, it is only necessary to continuously shoot a moving image instead of a still image.

  In the present embodiment, since the trimmed image is generated from the moving image before still image shooting, it is possible to reproduce the facial expression change. For this reason, it is a more enjoyable image when the facial expression change is clearly seen. Therefore, it is desirable to acquire image data that can capture facial expression changes at time T7, which is immediately before still image shooting. Also, the timings of times T5 and T6 may be determined according to the facial expression change time (facial expression change time Tf in FIG. 4).

  A flow of unnecessary image deletion for reproducing an image utilizing the fun of the facial expression change in the lower part 3 will be described with reference to FIG. This flow is a subroutine of step S12 (see FIG. 3), and when executing this flow, the facial expression change time Tf is measured in advance at the time of trimming photographing of the lower part 3 of the face in step S4 (see FIG. 3). This time Tf is stored. The facial expression change time Tf is, for example, the time from a true face to a smile, and the face detection unit 2a can detect the facial part as well as the facial expression, and obtain the facial expression change at this time. In this way, the facial expression can be monitored before shooting, and if the maximum information of the facial expression smile data is stored in the recording unit, the user can automatically perform the release operation without performing the release operation. Release can be done. In this case, the best smile can be recorded as the final image, and anyone can take a picture that captures the change in facial expression until the smile is reached. Since it is only necessary to hold it, it can be used for beginners. Note that the facial expression change time Tf may be measured after shooting, as will be described later. In this case, the user can select a facial expression according to the user's preference, but the facial expression does not necessarily change immediately before that. Is Tf.

  If the flow for unnecessary image deletion is entered, first, the expression change of the lower part 3 of the face immediately before photographing is detected (S21). For example, the trimmed image of the face of the subject 22 at time T7 corresponding to the lower part 3 is compared with the trimmed image of the face of the subject 22 at time T6 immediately before it, and it is determined whether there is a change in expression. . In addition, when more image data is memorize | stored in the time between time T6-T7, you may make it compare these images.

  Subsequently, it is determined whether or not there is a change in facial expression (S22). Since the expression change is detected in step S21, the determination is made based on the detection result. If the result of this determination is that there is a change in facial expression, the facial expression change time is measured and set as Tf (S23). Using this facial expression change time Tf, if there is a facial expression change in step S24 and subsequent steps, the display time of the lower 1, 2, and 3 images is controlled.

  Once the facial expression change time Tf is obtained, it is next determined whether or not the facial expression change time Tf is longer than 1 second (S24). If the facial expression change time Tf is longer than 1 second as a result of this determination, the image of the lower part 3 of the face can be displayed for the facial expression change time Tf (S25). Subsequently, it is determined whether the facial expression change time Tf is shorter than 3 seconds (S26). If the result of this determination is that the facial expression change time is shorter than 3 seconds, the image of the lower part 1 of the face can be displayed for the duration of the facial expression change time Tf (S27), and the lower part of the face 2 for the duration of the facial expression change time Tf. Can be displayed (S28). As a result, the display time of each of the lower 1, 2, and 3 images, that is, the images displayed based on the final trimmed image data 24a to 24c becomes the facial expression change time Tf, and this facial expression change time Tf is trimmed as the display time. It is finally recorded together with the image data of the image. The trimmed image changes at the same time interval as the time when the facial expression of the subject 22 changes, and an attractive facial expression change process can be enjoyed.

  On the other hand, if the result of determination in step S22 is that there is no change in facial expression in the lower part 3 of the face immediately before photographing, the images of the lower part 1, 2, and 3 of the face can be displayed for 1 second each (S31). Even when there is no change in facial expression, each trimmed image is reproduced and displayed for one second in order to increase the expectation at the time of reproduction and display.

  If the result of determination in step S26 is that the facial expression change time Tf is longer than 3 seconds, the images of the lower parts 1, 2, and 3 of the face can be displayed for 1 second each (S32). When it takes a long time to change the facial expression, if the trimmed image is changed at the interval of the facial expression change time Tf, the image display time becomes too long. In this case, the interval is set to 1 second.

  When the above-described steps S28, S31, and S32 are executed, the other images are then deleted (S29). Here, the image temporarily recorded in the temporary recording unit 5a other than the image left in the final recording is deleted. When the image deletion is completed, the original flow is restored.

  Thus, in this flow, since the time for reproducing and displaying the trimmed image is recorded together with the image data, the trimmed image is displayed during the recorded reproduction time during the reproduction display. In particular, when the image is reproduced with the expression change time Tf, changing the expression in the same time as the time required to change from a true face to a smile increases the expectation and the image reproduction full of realism. In this flow, 1 second and 3 seconds are used as the time to be compared with the expression change time Tf. However, this is only an example, and it is a time to increase the sense of expectation and perform image reproduction full of realism. Not limited to this.

  Next, an example of displaying the finally recorded trimmed image (see FIG. 4) on the sub-screen provided in the display unit 8 will be described with reference to FIG. A sub screen 8b is provided beside the main screen 8a of the display unit 8 as shown in FIG. 6A, and a trimmed image and a still image that are finally recorded on the sub screen 8b are displayed. That is, on the sub screen 8b, the trimmed images 26a to 26c are displayed and the still image 26d is displayed. Thus, the effect can be confirmed by displaying the photographing result on the sub-screen 8b. Note that the trimmed images recorded in the temporary recording unit 5a may be sequentially read and displayed before still image shooting. In this case, a still image cannot be displayed, but a trimmed image can be predicted in advance.

  Further, as shown in FIG. 6B, only one image may be displayed on the sub screen 8c, and trimmed images and still images may be sequentially reproduced and displayed on the sub screen 8c. In this case, since the images are reproduced and displayed in time series as in the actual reproduction display, it is possible to satisfy the expectation until the still image is displayed.

  Next, a modification of the first embodiment of the present invention will be described with reference to FIG. In the first embodiment, at time T1 to T8, both the image data for display on the display unit 8 and the image data of the trimmed image temporarily recorded in the temporary recording unit 5a are generated from the full image data. However, in this modification, imaging is performed by thinning out at times T11, T13, and T15, and image data for display is generated using the image data at this time. At times T12, T14, and T16, image data is acquired in full size, and image data of a trimmed image is generated using this image data.

  When the full size is imaged according to the frame rate of the display unit 8 and both the image data for display and the trimmed image for temporary recording cannot be generated at high speed from this full image, In this way, full-size image data may be obtained discretely to increase speed. Also in this case, the image data of the trimmed image generated from the full-size image data is temporarily recorded in the temporary recording unit 5a. Then, the image data of the still image is finally recorded at time T18, and the image data of the trimmed image temporarily recorded at the latest (time T12, T14, T16) is finally recorded.

  As described above, in the first embodiment of the present invention and the modified example thereof, prior to the shooting of a still image, image data is acquired by a moving image (continuous shooting), and trimming is performed on a plurality of portions of the image data. A plurality of trimmed image data are temporarily recorded. When a still image is captured, the image data selected from the image data of the latest temporarily recorded trimmed image is finally recorded in the recording unit 6 together with the full-size image data of the still image.

  When the image data recorded in this way is reproduced, the entire subject is not reproduced and displayed suddenly, but is reproduced and displayed after a part of the subject is reproduced and displayed. At this time, changes in facial expressions and the like can be recorded to express the facial expressions at that time. Therefore, until the entire subject is displayed, you can zoom in on a part of the screen, enjoy the facial expression, and expect (and who) you are in, Can be increased. This technique can be applied during screen transitions, and can be used not only for still image shooting but also for transitions for cut cuts of moving images. Further, this moving image portion may be used when the image display is ended in order to represent not only the expectation but also the regret. At this time, exposure correction may be used in combination with image processing. Further, in the present embodiment, when temporarily recording a moving image (continuous shooting), the image data of the trimmed image is temporarily recorded. Therefore, the capacity of the temporary recording unit 5a is increased as compared with the case of temporarily recording full image data. Can be reduced.

  Next, a second embodiment of the present invention will be described with reference to FIGS. In the first embodiment, a trimmed image is generated from full-size image data at each time, and the trimmed image is temporarily recorded. In contrast, in the second embodiment, full-size image data is temporarily recorded every time or every frame, and a predetermined portion is trimmed from the temporarily recorded full-size image data when a still image is captured. And make a final record.

  Since the configuration of the second embodiment is the same as that of the first embodiment shown in FIGS. 1 and 2, detailed description thereof is omitted. However, the moving image recording memory of the temporary recording unit 5a temporarily records the image data of the trimmed image in the first embodiment. However, the present embodiment is different in that the full-size image data is temporarily recorded. .

  In the present embodiment, as shown in FIG. 8, at each time T21 to T27, the imaging unit 2 acquires image data at full size, and resizes this full size image data to generate image data for display. doing. In addition, full-size image data is temporarily recorded every time or every frame. When a still image is shot at time T28, a predetermined portion is trimmed from the full-size image data temporarily recorded at times T25 to T27, which is the nearest time. The final trimmed image data 28 a to 28 c of the trimmed image generated at this time and the still image full image data 28 d at the time of shooting are finally recorded in the recording unit 6.

  In trimming, the trimming frames 29a to 29c are moved from a portion far from the face of the subject (the hand portion in this example) toward the face portion, and the trimming frame 29b is larger than the trimming frame 29a and is trimmed. The frame 29b and the trimming frame 29c have the same size.

  Note that fade-in may be performed when the trimmed image is generated. That is, the trimming image data 28a is subjected to exposure correction so that the still image is overexposed so that the still image full image data 28d is properly exposed. Exposure correction is performed by the parameter control unit 7 or the image processing unit 5.

  As described above, in the second embodiment, the final trimmed image data 28a, 28b, 28c and the still image full image data 28d are recorded in the recording unit 6. Therefore, at the time of reproduction, first the final trimmed image data 28a → the final trimmed image data. The data is read out in the order of 28b → final trimmed image data 28c, and this is sequentially reproduced. Finally, the still image full image data 28d is read out and reproduced and displayed. For this reason, the subject portion is reproduced first, and finally the entire subject is reproduced and displayed while the subject portion moves.

  In the description of FIG. 8, there are three trimmed images. However, more trimmed images may be generated and reproduced so as to move smoothly. The flowchart of the trimming range shown in FIG. 9 is not limited to three, and is a flow for generating a large number of trimmed images. The flow of moving image shooting in the second embodiment temporarily records full-size image data in steps corresponding to steps S2 to S4 in the flow in the first embodiment shown in FIG. The number of image data to be temporarily recorded is the number that can be temporarily recorded in the memory of the temporary recording unit 5a. When a shooting instruction is given in step S1, a still image is shot in step S11. The unnecessary image deletion subroutine of step S12 in FIG. 3 is replaced with a trimming range subroutine shown in FIG.

  When the flow of the trimming range is entered, face detection is first performed (S41). In this step, whether or not a face is included in the image data of the still image temporarily recorded in the memory 0 of the temporary recording unit 5a is detected by the face detection unit 2a. Subsequently, the face size (D) is detected (S42). In this step, when the face detection unit 2a detects that a face is included, the size of the face is detected, and this detected size is set as D. Next, the face position is detected (S43). In this step, the face detection unit 2a detects the position of the detected face, and the detected face position is set to (Xf, Yf).

  Subsequently, it is determined whether or not there is a position designation (S44). Here, it is determined whether or not the user has manually designated the initial position of the trimmed image. For example, as shown in FIG. 6B, the position may be specified by touching the initial position of the trimmed image when a still image is displayed on the main screen 8a. In this case, the user's touch operation is detected by a touch panel (not shown) or the like. Alternatively, the cursor may be moved by operating a cross button or the like, and the position may be determined by an OK button or the like.

  If the position is designated as a result of the determination in step S44, then the designated position center is obtained (S45). In this step, the coordinates of the position on the screen designated by the touch panel, the cross button or the like are obtained, and these are set as (X1, Y1). Subsequently, at the designated position coordinates (X1, Y1), the size of the image is determined with the same size (d) as the display unit (S46). In this step, for example, the size d is set to about 2M on the assumption that a high-definition image is displayed. However, the size d may be different depending on the assumed display unit.

  If the position is not specified as a result of the determination in step S44, then an image having the same size (d) as the display unit is determined at a position far from the face (S51). The central coordinates of a position far from the face, in other words, a position away from the face are determined in the next step S52. The far position is a person part, a part other than the face, for example, a characteristic part such as a hand. Therefore, the farthest part can be determined by image analysis. The method of determining a position far from the face is not limited to this method, and any method may be used as long as the position is moved from a position different from the face so as to increase the expectation. Another example will be described later with reference to FIG. Further, as described in step S46, the size of the linmig image is determined with the same size d as that of the display unit. If the size of the trimmed image is the same as that of the high-definition image, 2M is set. Subsequently, center coordinates (X1, Y1) of the image are determined (S52). Here, since a position far from the face is obtained in step S51, the center coordinates of the position are obtained.

  If the central coordinates are obtained in step S52 or the size d is determined in step S46, then an image of size d is trimmed with the coordinates (X1, Y1) (S53). Here, the trimming unit 1b performs trimming from the full-size image data with the size d around the coordinates (X1, Y1).

  Once the trimming process is performed in step S53, it is next determined whether or not the current position is the face position (S54). The trimming process is initially performed with the coordinates (X1, Y1) as the center position, but the coordinates are moved in step S64 as described later. In step S54, it is determined whether or not the current position has reached the face position (Xf, Yf).

  If the face position is not the result of the determination in step S54, it is next determined whether or not the face size D is larger than the trimmed image size d (S61). As a result of this determination, if the face size D is smaller than the image size d, then the size d is set to (d + Δd) (S63). That is, the size d is increased by Δd. This is because when the trimming is performed first, the size of the trimmed image is d, but finally the size of the trimmed image is gradually increased by Δd so as to coincide with the size D of the face. is there.

  If the result of determination in step S61 is that the face size D is larger than the image size d, the image size d is fixed to the face size D (S62). This is to prevent the trimming portion from becoming larger than the face size. When the size d of the image becomes larger than the size D of the face, it is possible to prevent the face from shrinking and being concerned about the size change rather than the expression change. This makes it possible to enjoy facial expressions without changing the size of the face on the screen. In the present embodiment, the moving image is shown before the entire image is shown. In other words, the device is designed such that the face other than the face is shown first, and when the face is shown, the change in facial expression is greatly shown. Therefore, the emphasis is on the composition change from the face up to the whole (from the telephoto to the wide direction), so even when the face is shown from something other than the face, the direction is aligned to aim for a natural zooming effect. However, such a restriction is not necessarily required when further screen changes are required.

  If the image size d is fixed to D in step S62 or the image size is set to d + Δd in step S63, then the trimming image is moved closer to the face position (Xf, Yf) from the initial position (X1, Y1). (S64). That is, the center position of the trimmed image is moved little by little. In this case, the moving speed is set to such a speed that it can move from the initial trimming position to the face position in a time of about 0.5 second to 2 seconds, but may be slower or faster depending on the user's preference. .

  Subsequently, trimming is performed with the image size at the movement position (S65). Here, the trimming unit 1b performs trimming at the position determined in step S64 from the full-size image data and the image size determined in step S62 or S63, and finally the image data of the trimmed image is recorded in the recording unit 6. . When trimming is performed, the process returns to step S54, and the trimming process is repeated while changing the image size d and the trimming position until the face position is reached. If the face position is reached as a result of the determination in step S54, the processing of the trimming range is terminated and the process returns to the original flow.

  As described above, in the flow of the trimming range, the trimming is performed while changing the image size from the full-size image data to the face position (Xf, Yf) from the center position (X1, Y1) determined in step S45 or S52. The image is cut out, and the trimmed image thus cut out is finally recorded. In this flow, the trimmed image is not limited to three frames, and a large number of trimmed images can be easily generated. Therefore, the user can smoothly slide from the initial position (X1, Y1) to the face position (Xf, Yf). A trimmed image can be generated.

  In this flow, after the size of the trimmed image is changed in step S63, the face is brought closer to the face in step S64. This is a way to enjoy the change of facial expression with the frame size corresponding to the face up. Also, if the size of the trimming image is changed after first moving to the face position, the person's identity is known from the beginning, and no expectation can be given. Therefore, the trimming image was moved to the face position last. However, since there are scenes and users that require the opposite effect, the relationship between steps S61 and S54 may be reversed.

  Although the flow of the trimming range has been described as being executed during shooting, it can also be executed during playback. That is, full-size image data of a moving image (continuous shooting) within a predetermined time before still image shooting is recorded in the recording unit 6, and the trimming range flow shown in FIG. The image may be cut out, and the cut out trimmed image may be sequentially reproduced and displayed. Further, although the image data recorded in the temporary recording unit 5a before shooting is set to the full size, the image data smaller than the full size may be used in consideration of the image size of the display unit of the assumed playback device.

  Next, another example of how to determine a position far from the face in step S51 will be described with reference to FIG. In addition to determining a specific position such as a hand part by performing image analysis as a distant position, there is a method of simply selecting a part of a person farthest from the face. In this case, if it is sufficiently far from the face position, it takes time to move from the initial position to the face position, and there is a risk of getting bored when viewing. Therefore, in this example, the trimming start position and the frame moving speed are determined so as to produce an effect that gives a sense of expectation when viewing.

  FIG. 10A shows an entire image 29a when shooting a moving image and trimmed images 29b to 29d at that time. In this case as well, the trimmed image is moved from the portion far from the face toward the face as in the above-described embodiment. In the trimmed image 29c, the lower side of the face portion of the subject is visible, and in this state, no laughing is made. However, the entire face of the subject can be seen in the trimmed image 29b, and in this state, he is laughing. In this way, the time Tf from the state of not laughing to the state of laughing is measured. The movement speed v can be calculated by dividing the difference in distance from the edge of the face to the center of the face (about D / 2) (where D is the size of the face) by the time Tf. If the position moved at the moving speed v for a predetermined time (for example, about 2 seconds) is set as the trimming start position, the trimmed image and the still image can be reproduced and displayed in time with the expression change of the subject.

  FIGS. 10B and 10C show such trimming positions and changes in facial expressions. FIG. 10B shows a state in which the trimming position is moved with time, with the trimming position on the vertical axis and the passage of time on the horizontal axis. Further, FIG. 10C shows a state in which the expression of a person's face changes with time, with the expression expressed as a numerical value on the vertical axis and the passage of time on the horizontal axis. Here, the expression expresses changes in the size of the eyes, the degree of rising of the mouth edge, and the like. The higher this value is, the higher the smile level is. Therefore, the portion where the change in this value is large is the process of becoming a smile. The time Tf when this change is large is obtained, and during this time Tf, The trimming line 29e may be determined so that the trimming frame moves from the lower end of the face to the center of the face.

  Thus, by determining the trimming start position and the moving speed of the trimming frame, it is possible to enjoy the facial expression change of the subject. In addition, since the trimming is performed, the expression change can be enlarged and displayed. Depending on the subject, there may be no change in facial expression. In this case, the expectation may be enhanced by changing the screen by changing the shooting position in a place other than the face. This example can be used not only in the second embodiment but also in the first embodiment. In other words, the expression change is monitored in this example, but in the first embodiment, when there is a change in the expression, shooting is automatically performed, or it is displayed that it is a shooting opportunity. Also good.

  As described above, in the second embodiment of the present invention and its modifications, image data is acquired in full size or the like as a moving image (continuous shooting) and temporarily recorded as it is before shooting a still image. . Then, when a still image is shot, image data of a trimmed image is generated from the latest full-size moving image data, and the generated image data and still image data are finally recorded in the recording unit 6. doing.

  When the image data recorded in this way is reproduced, as in the first embodiment, the entire subject is not suddenly reproduced and displayed, but is reproduced and displayed after a part of the subject is reproduced and displayed. Therefore, it is possible to imagine what (who) is captured until the entire subject is displayed, and the expectation can be enhanced.

  Further, in the present embodiment, image data of a full size or the like is temporarily recorded, so that a large-capacity temporary recording unit 5a is required as compared with the case of temporarily recording a trimmed image. However, the degree of freedom in generating a trimmed image after still image shooting is high, and an image with a higher expectation can be obtained.

  Furthermore, in this embodiment, a trimmed image may be generated when an image is reproduced without generating a trimmed image after still image shooting. In this case, the reproduction trimmed image may be generated by a camera, for example, by an image reproduction device such as a personal computer.

  Next, a third embodiment of the present invention will be described with reference to FIGS. In the first and second embodiments, a moving image (continuous shooting) is always temporarily recorded in the temporary recording unit 5a prior to shooting a still image. In the third embodiment, after shooting a still image, a moving image (continuous shooting) is shot, a trimming image is generated from the image data of the moving image obtained at this time, and this is recorded.

  Since the configuration of the third embodiment is the same as that of the first embodiment shown in FIGS. 1 and 2, detailed description thereof is omitted. However, the moving image recording memory of the temporary recording unit 5a records image data before taking a still image in the first embodiment. However, in this embodiment, the temporary recording unit 5a is not used because temporary recording is not performed. Can be omitted.

  With reference to FIG. 11, shooting and reproduction of an image in the present embodiment will be described. Images are taken in the order of images 31a to 31d at the time of shooting. Among them, the image 31a is a still image, and the images 31b to 31d are moving images (continuous shooting) shot after shooting a still image.

  Also in this embodiment, the still image 31a showing the entire face including the face of the subject 22 is not reproduced and displayed from the beginning, but the portion other than the face is displayed first so that the whole image can be seen gradually. . That is, a trimmed image 31b in which the hand portion is enlarged is displayed first, then a wide range trimmed image 31c including the hand portion is displayed, and then a trimmed image 31d in which the face portion is enlarged is displayed. Finally, a still image 31a showing the entire subject 22 is displayed. Also in the present embodiment, it is possible to perform effective reproduction display by utilizing the expectation of the viewer who wants to know what (who) is captured as soon as possible.

  Next, the photographing operation of the camera 10 in the present embodiment will be described using the flowchart shown in FIG. When the moving image shooting flow is entered, first, as in step S1, it is determined whether or not shooting is to be performed (S71). When the moving image shooting flow is entered, a live view image is displayed based on the output of the imaging unit 2, and when the photographer decides the composition and shoots a still image, the release button is operated. It is determined whether or not the release button has been operated.

  If the result of determination in step S <b> 1 is that there was no shooting, the camera enters a standby state, and waits for the release button to be operated while a live view image is displayed. On the other hand, if the result of determination in step S71 is shooting, a still image is shot (S72). Here, the image data of the still image output from the imaging unit 2 is recorded in the recording unit 6 as full image data (12M (12 million pixels)). This image corresponds to the still image 31a described above.

  Once the still image has been shot, trimming shooting is then performed on the lower part 1 of the face (S73). Here, the portion below the face portion of the subject 22, that is, the hand portion in this example, is trimmed from the full image data with 2M (2 million pixels) by the trimming unit 1b, and the image data corresponding to the image 31b. Is finally recorded in the recording unit 6. Note that the number of pixels is 2M, as in the case of the first embodiment, is the number of pixels that is assumed to be reproduced and displayed as a high-definition image, and may be a different value depending on the assumed reproduction display device.

  Subsequently, trimming photography is performed for the lower part 2 of the face (S74). Here, the range above the lower part 1 of the face and wider than the range of the lower part 1, in this example, the part including the hand part and extending from the lower part 1 is trimmed at 2M from the full-size image data, and the image 31c Is finally recorded in the recording unit 6. Once the lower part 2 is photographed, next, trimming photographing is performed for the lower part 3 of the face (S75). Here, the range above the lower part 2 of the face and approximately the same as the range of the lower part 2, in this example, the enlarged part including the face part is trimmed at 2M from the full-size image data. The image data corresponding to 31d is finally recorded in the recording unit 6. When this recording is finished, this flow is finished.

  As described above, also in the third embodiment, in steps S73 to S75, a trimming process for cutting out a part (lower parts 1 to 3) from full-size image data is performed. However, continuity of each image is also important here. is there. For this reason, it is desirable to change the size of the face in the trimmed image so that the size of the face decreases, and to change the direction of the trimming position in a certain direction. In the above description, the trimmed image is finally recorded in steps S73 to S75. However, the trimmed image may be temporarily recorded in the temporary recording unit 5a and then collectively recorded in the recording unit 6.

  FIG. 12 shows how to display and record image data obtained by moving image shooting and still image shooting. Time T55 is the timing of still image shooting, previous times T51 to T54 are before still image shooting, and times T56 to T58 are trimming processing timing after still image shooting. At times T <b> 51 to T <b> 54, the image data output from the imaging unit 2 is only displayed as a live view on the display unit 8. During this time, the image data from the imaging unit 2 is thinned out and then sent to the display unit 6, and the temporary recording of the image data is not performed as in the first and second embodiments.

  At time T55, the full-size image data of the still image is finally recorded in the recording unit 6. Next, at times T56 to T58, a trimming range is cut out from the image data of the full-size moving image, and the image data of the trimmed image is finally recorded in the recording unit 6. In addition, the image is displayed on the display unit 8 based on the image data of the trimmed image generated at this time.

  As described above, in the third embodiment, after capturing the still image 31a, the image data of the trimmed images 31b, 31c, and 31d is sequentially generated from the moving image, and the final recording is performed on the recording unit 6. Then, when reproducing and displaying, reproduction is performed in the order of the trimmed image 31b → 31c → 31d → still image 31a. For this reason, it is not always necessary to temporarily record a moving image before shooting a still image, and the configuration can be simplified. Note that the generation order of the trimmed images is generated from a position far from the face, and since this order is a time-series direction, there is little discomfort during reproduction. However, it may of course be generated from a position close to the face first.

  In the present embodiment, a moving image is continuously captured after a still image is captured. For this reason, if the camera 10 is not pointed at the subject for a predetermined time (in the embodiment, about 0.5 second to 2 seconds) even after the still image is captured, the image becomes unsightly. Therefore, in the present embodiment, in order to prevent the photographer from applying unnecessary stress, the person 25 located at the center of the screen is automatically extracted, and the face portion of the person 21 is trimmed and recorded. I am doing so.

  This trimming method will be described with reference to FIGS. FIG. 13 shows a state in which the subject 22 is being photographed. A still image is photographed in the photographing region 15a, and a subsequent moving image is photographed in the photographing regions 15b and 15c. At this time, among images captured by the camera 10, FIG. 14A is an image corresponding to the imaging region 15a, FIG. 14B is an image corresponding to the imaging region 15b, and FIG. ) Is an image corresponding to the imaging region 15c.

  The image of FIG. 14A corresponding to the still image shooting area 15a is recorded as shown in FIG. 14D, but the image corresponding to the moving image shooting area 15b is the center of the screen of the shooting area 15a. 14b (the face of the subject 22 exists in the center) is recorded as shown in FIG. 14E, and the image corresponding to the moving image shooting area 15c is a trimming area including the center of the shooting area 15a. 17c is recorded as shown in FIG. Here, the aspect ratios of the trimming regions 17b and 17c may be changed from the aspect ratio of the still image. However, by setting the same aspect ratio, the uncomfortable feeling can be eliminated. It is said.

  The trimming process described with reference to FIGS. 13 and 14 is executed by the composition change determination unit 1a and the trimming unit 1b in the control unit 1. In other words, when the composition change determination unit 1a determines that the photographing regions 15a to 15c have been changed, the trimming unit 1b performs a trimming process based on the determination result. Further, although the trimming process has been described as being performed after shooting, it can also be performed before shooting. That is, when a moving image is shot before shooting and a still image is shot, the portions corresponding to the shooting areas 17b and 17c may be trimmed from the image data of the latest moving image.

  As described above, in the third embodiment of the present invention, after capturing a still image, the image data is acquired by a moving image (continuous shooting), trimmed from the image data, and together with the image data of the still image, The image data of the trimmed image is also recorded. For this reason, it is not necessary to temporarily record moving image data before shooting a still image, and the configuration can be simplified.

  As described above, in each embodiment of the present invention, the image data is acquired from the imaging unit 2 in response to the release operation, and the continuous shooting image data is acquired from the imaging unit 2 before or after the release operation. Based on the continuous shooting image data, trimmed images are sequentially generated in different regions in each frame, and the generated trimmed image and the image data at the time of release are recorded. For this reason, anyone can easily shoot a variety of images that are rich in change compared to the case of simply shooting.

  Further, in each embodiment of the present invention, before displaying an image of the entire screen, a part of the image captured before or after capturing the image is trimmed, and the trimmed image is displayed first. Yes. For this reason, it is possible to appreciate a wide variety of images. In particular, if you first display the part of a person's hand, then move the part of the person little by little, and finally display the entire face from the enlarged display of the face, what is (who) is shown? Imagine the effect of increasing expectations. In addition, in conventional photo appreciation, when a person was reflected, it was satisfactory just to see that person. In other words, if you are interested in photos that you are interested in, please carefully watch them, and if you are not interested in the photos, or if your facial expressions are not good, you may skip the photos. It was. It is unfortunate that even if there is something interesting in the surroundings other than the person's face, the photograph is overlooked without being interested. In each embodiment of the present invention, the part other than the face is enlarged and displayed, which is helpful when such an image is interestingly appreciated.

  In each embodiment of the present invention, when a release button is operated and shooting is performed, a still image is shot. However, the present invention is not limited to this, and moving image shooting may be started in accordance with the operation of the release button. In the third embodiment, shooting of a moving image (continuous shooting) is performed after shooting of a still image. However, after shooting of a moving image is terminated in accordance with the operation of the release button, shooting of a moving image for trimming (continuous shooting) is performed. May be performed.

  Further, in each embodiment of the present invention, the relevant portion of the subject person is trimmed, and the trimming position is linearly moved toward the face position. You may perform the process which turns to a face according to an outline. In addition, although the initial position is a part related to the person, it may be a characteristic part other than the part related to the person, and the trimming range may be changed toward the person from this characteristic part. good. As a characteristic, it is only necessary to have a shape in the periphery of the image compared to the previous and subsequent images, for example, a color like a bouquet or a glossy like accessory. is there. Also, if the face appears first, the viewer's interests such as what facial expression and who is in the photo are lost. Therefore, gradually focus attention on people from things that are hard to reach even though they are on the screen. If the same expression continues and becomes monotonous, the trimming start position is changed from the relevant part of the person to such a characteristic one. Guided and imaginated.

  In each embodiment of the present invention, a digital camera has been described as an apparatus for photographing. However, the camera may be a digital single lens reflex camera or a compact digital camera, such as a video camera or a movie camera. It may be a camera for moving images, or may be a camera built in a mobile phone, a personal digital assistant (PDA), a game device, or the like.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 ... Control part, 1a ... Image processing part, 1b ... Trimming part, 2 ... Imaging part, 2a ... Face detection part, 3 ... Parameter setting part, 4 ... Motion Determination unit, 5 ... image processing unit, 5a ... temporary recording unit, 5b ... still image compression unit, 5e ... effect processing unit, 5f ... image compression unit, 5g ... connection data Part, 5h ... time control part, 6 ... recording part, 7 ... parameter control part, 8 ... display part, 8a ... main screen, 8b ... sub-screen, 8c ... Sub-screen, 9 ... operation unit, 10 ... camera, 11 ... clock unit, 15a ... shooting area, 15b ... shooting area, 15c ... shooting area, 17b ... trimming area 17c: Trimming area, 21a: Image, 21b: Image, 21c: Image, 21d: Image 22 ... Subject, 23a ... Trimmed image data, 23b ... Trimmed image data, 23c ... Trimmed image data, 24a ... Final trimmed image data, 24b ... Final trimmed image data, 24c .. Final trimmed image data, 24d: still image full image data, 26a: trimmed image, 26b ... trimmed image, 26c ... trimmed image, 26d ... still image, 27 ... trimmed Instruction frame, 28a... Final trimmed image data, 28b... Final trimmed image data, 28c... Final trimmed image data, 28d .. still image full image data, 29a. Trimmed image 29c Trimmed image 29d Trimmed image 31a And still image, 31b ··· trimming image, 31c ··· trimming image, 31d ··· trimming image

Claims (7)

An imaging unit for converting a subject image into image data;
In response to the release operation, the image capturing unit acquires image data from the image capturing unit, and acquires a plurality of image data from the image capturing unit before or after the release operation;
A trimming unit that sequentially generates trimmed image data in different areas from the plurality of image data;
A control unit for recording the trimmed image data generated by the trimming unit and the image data acquired during the release operation;
Have
The control unit detects a part having a characteristic related to a person, and sets trimming positions from the characteristic part as the trimming image data generated in the different areas, and then the trimming position from the characteristic part. A camera that sequentially generates a moved image and finally the entire screen.   The camera according to claim 1, wherein the trimmed image data is sequentially generated so as to be reduced from the enlarged image.   The camera according to claim 1, wherein the trimmed image data is sequentially generated so as to be enlarged from the reduced image.   2. The camera according to claim 1, wherein the trimmed image data is subjected to exposure correction, and the image data acquired during the release operation is sequentially generated so as to achieve proper exposure. Convert the subject image into image data,
Acquire the converted image data in accordance with the shooting instruction, record this in the recording unit,
A portion having a characteristic related to a person is detected from the recorded image data, a first portion at a position of the characteristic portion is trimmed, and this is recorded in a recording unit.
Trimming the second part at a position different from the first part, and finally recording in the recording unit so that the entire screen can be reproduced sequentially,
A camera control method. A recording unit that records the image data at the time of release acquired during the release operation and the trimmed image data that is acquired before or after the release operation and is trimmed in different areas in a plurality of frames;
A portion having a characteristic related to a person is detected from the image data recorded in the recording unit, and the trimmed image data of the first portion having the characteristic is reproduced first in the image data, A reproduction control unit that reproduces the trimmed image of the second part at a position different from the first part, and finally reproduces the image data acquired during the release operation;
A display control device comprising: A display control method in a display device in which image data at the time of release acquired during the release operation and trimmed image data acquired before or after the release operation and trimmed in different areas in a plurality of frames are recorded in the recording unit. There,
A portion having a characteristic related to a person is detected from the image data recorded in the recording unit, and the trimmed image data of the first portion having the characteristic is reproduced first in the image data, Replaying the trimmed image of the second portion at a position different from the first portion, and finally replaying the image data acquired during the release operation sequentially,
A display control method characterized by the above.