JP5876991B2 - Shooting equipment, shooting method and playback method - Google Patents

Description

The present invention relates to a photographing device capable of capturing a moving image , a photographing method, and a reproducing method .

  In recent years, many portable devices (photographing devices) with a photographing function such as a digital camera have not only a still image but also a moving image photographing function. Some photographing apparatuses have a function of detecting a subject by image processing and controlling the subject to perform optimal imaging.

  For example, Patent Document 1 discloses an apparatus configured so that a subject can be automatically tracked so that the subject is within a shooting range. In the technique of Patent Document 1, when tracking according to the movement of the subject becomes difficult as in the case where the moving speed of the subject is relatively high, the subject is zoomed out to zoom in on the subject. Is within the shooting range.

  JP 2009-33450 A

  However, in the apparatus of Patent Document 1, even if the user wants to image the subject on the telephoto side in order to keep the subject within the shooting range, the subject may be imaged on the wide-angle side by zooming out. There was a problem that a desired imaging result could not be obtained.

An object of the present invention is to provide a photographing apparatus , a photographing method, and a reproducing method capable of continuously displaying an image of a subject at a desired angle of view during reproduction .

An imaging apparatus according to the present invention includes an imaging unit, a subject detection unit that detects a moving subject in a moving image captured by the imaging unit, and the subject in the moving image is out of frame by movement. A zoom control unit that detects the angle of view and changes the angle of view to the wide angle side, a control unit that records information on the timing of changing the angle of view by the zoom control unit in association with the moving image, and at the time of reproducing the moving image, A playback display control unit that displays the angle of view on the moving image at a constant angle regardless of the change of the angle of view at the time of imaging using the information on the timing of change of the angle of view .
In addition, an imaging device according to the present invention includes an imaging unit, a subject detection unit that detects a moving subject in a moving image captured by the imaging unit, and the subject in the moving image is out of frame by movement. And a control unit that records information on change timing of the angle of view by the zoom control unit corresponding to the moving image, and controls the control. The unit records information on the angle of view before and after the change of the angle of view and position information on the field of view of the subject, together with information on the change timing of the angle of view.
In addition, an imaging device according to the present invention includes an imaging unit, a subject detection unit that detects a moving subject in a moving image captured by the imaging unit, and the subject in the moving image is out of frame by movement. A zoom control unit that detects that the angle of view is changed to the wide angle side, a control unit that records information on the timing of changing the angle of view by the zoom control unit in association with the moving image, and pixels of the moving image A pixel number switching unit that changes the number of pixels, and the pixel number switching unit increases the number of pixels of the moving image at a timing of changing the angle of view.
In addition, an imaging device according to the present invention includes an imaging unit, a subject detection unit that detects a moving subject in a moving image captured by the imaging unit, and the subject in the moving image is out of frame by movement. And a control unit that records information on change timing of the angle of view by the zoom control unit corresponding to the moving image, and controls the control. After recording the moving image and the angle-of-view change information, the unit records timing information for adjusting the angle of view on the display when the moving image is reproduced.
In addition, the imaging method according to the present invention detects a moving subject in the captured moving image, detects that the subject in the moving image is out of the frame due to movement, and sets the angle of view to the wide angle side. The angle of view change timing information is recorded in association with the moving image, and the angle of view change at the time of imaging is performed by using the angle of view change timing information during playback of the moving image. Regardless, the angle of view on the moving image display is kept constant.
In addition, in the playback method according to the present invention, the information on the timing of changing the angle of view is recorded corresponding to the moving image captured by changing the angle of view to the wide-angle side according to the out-of-frame accompanying the movement of the subject. Information on the timing of changing the angle of view is read from the image file, and the angle of view on the moving image display is kept constant.

  According to the present invention, it is possible to continuously display an image of a subject at a desired angle of view during reproduction.

1 is a block diagram showing a circuit configuration of a photographing apparatus according to a first embodiment of the present invention. Explanatory drawing for demonstrating the imaging in tracking imaging mode. The graph which shows the change of the number of pixels at the time of an angle-of-view change, with elapsed time on the horizontal axis and the number of pixels on the vertical axis. The graph which shows the change of a focal distance at the time of a view angle change by making elapsed time into a horizontal axis and taking a focal distance into a vertical axis | shaft. 7 is a flowchart showing an operation during recording in the tracking imaging mode. The flowchart which shows the operation | movement at the time of reproduction | regeneration. Explanatory drawing for demonstrating the operation | movement at the time of reproduction | regeneration. The flowchart employ | adopted in 2nd Embodiment. The flowchart employ | adopted in 2nd Embodiment. Explanatory drawing for demonstrating 2nd Embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a circuit configuration of the photographing apparatus according to the first embodiment of the present invention.

  The imaging device 10 has an imaging unit 12 configured by an imaging element such as a CCD or a CMOS sensor. An optical image of a subject from an optical system including an imaging lens (not shown) provided on the front surface of the imaging device 10 is formed on an imaging surface of an imaging element (not shown) constituting the imaging unit 12. The imaging unit 12 is driven and controlled by the control unit 11. The control unit 11 outputs a drive signal for the imaging device to the imaging unit 12 and takes in an image signal obtained by photoelectric conversion of the optical image by the imaging device. The imaging unit 12 is also controlled by the control unit 11 and can capture moving images.

  The control unit 11 performs predetermined signal processing, for example, color signal generation processing, matrix conversion processing, and other various digital processing on the image signal obtained by photoelectric conversion of the image sensor. The control unit 11 can output image information, audio information, and the like compressed by performing an encoding process when recording an image signal, an audio signal, and the like.

  The photographing device 10 is also provided with an operation unit 13 and a touch panel 14. The operation unit 13 generates an operation signal based on a user operation on various switches (not shown) such as a shooting start / end button and a shooting mode setting provided in the shooting device 10 and outputs the operation signal to the control unit 11. The touch panel 14 generates an operation signal based on a user's touch operation and outputs the operation signal to the control unit 11. The control unit 11 controls each unit based on the operation signal.

  The photographing apparatus 10 is provided with a reproduction display control unit 15 and a recording / reproduction unit 16. The recording / reproducing unit 16 can record image information and audio information from the control unit 11. As the recording / reproducing unit 16, for example, a card interface can be adopted. The recording / reproducing unit 16 can record image information, audio information, and the like on a recording medium such as a memory card. Further, the recording / reproducing unit 16 can read out image information and audio information recorded on the recording medium and supply them to the control unit 11. The control unit 11 can decode the image information and the audio information reproduced by the recording / reproducing unit 16 to obtain an image signal and an audio signal.

  The reproduction display control unit 15 gives a captured image from the imaging unit 12 and a reproduction image from the recording / reproducing unit 16 to the display unit 17 to display these images. Note that the reproduction display control unit 15 can give the moving image from the control unit 11 to the display unit 17 for display. The recording / playback unit 16 can also record a moving image, and the playback display control unit 15 can also give the playback image from the recording / playback unit 16 to the display unit 17 for playback display.

  The reproduction display control unit 15 can also display a menu display for operating the photographing apparatus 10 on the display unit 17. The display unit 17 is provided, for example, on the back surface of the main body of the photographing apparatus 10 so that the photographer can visually recognize the display screen of the display unit 17 at the time of photographing. As the display unit 17, an LCD panel or the like can be employed.

  A touch panel 14 may be disposed on the display screen of the display unit 17. The touch panel 14 generates an operation signal corresponding to the position pointed by the user with a finger. When the touch panel 14 is provided on the display screen of the display unit 17, the user can instruct various command buttons displayed on the display screen of the display unit 17 using the touch panel 14. Accordingly, the touch panel 14 can output operation signals corresponding to various command buttons displayed on the display screen of the display unit 17 to the control unit 11.

  In the present embodiment, a target subject detection unit 21 is provided. The target subject detection unit 21 receives the captured image from the control unit 11 and detects the target subject in the captured image. For example, the subject-of-interest detection unit 21 detects an object having a central movement in the captured image as the subject of interest. The subject-of-interest detection unit 21 outputs the detection result to the control unit 11. Note that the subject-of-interest detection unit 21 detects a position of the detected subject of interest within the visual field range, and outputs position information of the subject of interest to the control unit 11.

  In the present embodiment, the out-of-frame detection unit 22 detects that the target subject detected by the target subject detection unit 21 is out of the visual field range, that is, detects the out-of-frame and controls the detection result. It outputs to the part 11. The out-of-frame detection unit 22 is used when the subject of interest disappears from the field of view, when a predetermined range of the subject of interest, for example, more than half of the image portion of the subject of interest does not fit within the field of view, or when the subject is a person. When most of the face is out of the visual field range, it is determined that the frame has been lost.

  The zoom control unit 23 can control zoom-in and zoom-out by controlling a zoom lens (not shown) constituting the imaging unit 12.

  In the present embodiment, imaging in the tracking imaging mode is possible. In the tracking imaging mode, the control unit 11 detects whether or not the subject of interest has gone out of frame. When the subject of interest is out of the frame, the control unit 11 controls the zoom control unit 23 to zoom out so that the subject falls within the field of view, and causes the imaging unit 12 to image the subject on the wide angle side. It has become.

  FIG. 2 is an explanatory diagram for explaining imaging in the tracking imaging mode.

  Now, it is assumed that a person running on a track is taken as a subject of interest and imaging is performed on the telephoto side. A square frame in the center of FIG. 2 indicates the visual field range FS in this case. In this visual field range FS, as shown in FIG. 2, an image 33 (broken line) of a person running on the track image 32 is captured. The subject-of-interest detection unit 21 detects the person image 33 as the subject of interest. In this state, most of the human image 33 is within the visual field range FS, and the out-of-frame detection unit 22 determines that no out-of-frame has occurred.

  Here, it is assumed that the image 33 of the main subject is out of the visual field range FS due to reasons such as fast movement of the person. The person image 31 in FIG. 2 shows this state. Then, the control unit 11 controls the zoom control unit 23 to change the angle of view to the wide-angle side so that the human image 33 falls within the visual field range. As a result, the visual field range FS changes to the wide-angle-side visual field range FL, and the person image 31 falls within the visual field range FL.

  Here, off-frame records the characteristics such as the color and pattern of the image obtained at the center of the screen during imaging in the field-of-view range FS, and the subject having this characteristic (here, a person) moves from the center of the screen. In addition to determining whether the image has disappeared at the end, it may be determined to predict at what timing the image disappears from the end based on the speed of movement in the screen.

  From the prediction of the movement of the subject, the angle of view may be changed to the wide angle side at such a timing that it does not deviate before deviating from the frame. The subject may be specified on the touch panel.

  In the present embodiment, in the tracking imaging mode, the control unit 11 pays attention to the angle-of-view change time information indicating the angle-of-view change timing when the angle of view is changed to the wide-angle side based on the detection result of out-of-frame. The subject information recording unit 25 records the information. The angle-of-view change time information is information corresponding to the time information of the captured image. By reading the angle-of-view change time information at the time of reproduction, the timing of change of the angle at which the angle of view was changed is grasped. Be able to. This does not need to be strictly the time, but can be substituted by the elapsed time from the start of the moving image.

  The angle-of-view change timing information due to the frame deviation is the timing at which the angle of view is changed to the wide-angle side, but it may be the timing at which the subject is removed or can be substituted at the timing at which the angle of view starts to change.

  In addition, the control unit 11 is provided with position information regarding the position within the visual field range of the subject of interest from the subject of interest detection unit 21, and the position information is provided to the subject of interest information recording unit 25 for recording.

  Further, in the tracking imaging mode, when the angle of view is changed to the wide angle side according to the detection result of out-of-frame, the control unit 11 obtains the ratio of the angle of view (zoom ratio) before and after the change of the angle of view, and zoom ratio Information is recorded in the subject-of-interest information recording unit 25.

  In the present embodiment, a pixel number switching unit 24 is provided. The pixel number switching unit 24 can change the number of pixels of the captured image. For example, it is assumed that the image pickup element in the image pickup unit 12 can pick up an image with four times the number of pixels of HD image quality. The pixel number switching unit 24 changes the number of pixels of the captured image at the telephoto end to, for example, the number of pixels of HD image quality by resizing processing. Note that the pixel number switching unit 24 may reduce the number of pixels by thinning-out processing or pixel addition processing at the time of reading from the image sensor, and reduce the number of pixels by thinning-out processing or resizing processing on the acquired captured image. May be. In the specification, the resizing process includes all the processes for reducing the number of pixels.

  In the present embodiment, in the tracking imaging mode, the pixel number switching unit 24 increases the number of pixels of the captured image after changing the angle of view when the angle of view is changed to the wide angle side according to the detection result of out of frame. It is like that. For example, the pixel number switching unit 24 obtains a captured image having the number of pixels four times the number of pixels of HD image quality by stopping the resizing process.

  For example, in FIG. 2, the number of pixels in the captured image in the field of view range FL at the wide angle end is quadrupled with respect to the number of pixels in the captured image in the field of view range FS at the telephoto end. Therefore, for example, even when only the portion of the visual field range having the same size as the visual field range FS in the captured image of the visual field range FL at the wide-angle end is reproduced, the entire captured image of the visual field range FS is reproduced. Playback at the same resolution is possible. In this case, the main subject is continuously reproduced with the same angle of view and image quality as the image display of the visual field range FS by displaying the captured image area based on the position information within the visual field range FL of the main subject. Is possible.

  In the present embodiment, the reproduction display control unit 15 reads the angle-of-view change time information, the position information, and the zoom ratio information recorded in the target subject information recording unit 25 during reproduction, and displays a reproduction image display area. Is to control. For example, the reproduction display control unit 15 uses the information recorded in the subject-of-interest information recording unit 25 to change the angle of view at the time of imaging when the angle of view changes due to a frame out of tracking imaging mode. Regardless, it is possible to reproduce in the equal angle reproduction mode in which reproduction is performed with the same angle of view.

  Next, the operation of the embodiment configured as described above will be described with reference to FIGS. FIG. 3 is a graph showing the change in the number of pixels when the angle of view is changed, with the elapsed time on the horizontal axis and the number of pixels on the vertical axis. FIG. 4 shows the focal length on the vertical axis with the elapsed time on the horizontal axis. It is a graph which shows the change of the focal distance at the time of changing an angle of view. FIG. 5 is a flowchart showing an operation during recording in the tracking imaging mode, and FIG. 6 is a flowchart showing an operation during reproduction.

(When recording)
When the imaging apparatus 10 is turned on and enters the tracking imaging mode, the control unit 11 displays a captured image (through image) on the display unit 17 based on the image signal from the imaging unit 12 in step S1 of FIG. Display. Next, the control unit 11 determines whether or not moving image shooting has been started (step S2).

  For example, when moving image shooting is instructed by a switch operation or the like for starting moving image shooting, the control unit 11 starts shooting. When the tracking shooting mode is set, at this point, the control unit 11 controls the zoom control unit 23 to perform imaging at the telephoto end. For ease of explanation, the term “telephoto end” is used, but it is assumed that the subject is magnified and photographed at a position other than the wide-angle end. For example, if you select the tracking shooting mode from the menu and then specify the subject on the touch panel, the angle of view will be set so that the size of the person's upper body or full body image will be shot on the screen. To do. Alternatively, first, the subject may be actually enlarged near the telephoto end, and an effect may be given to determine which subject is to be selected, and it may be easy for the user to specify a touch. A “tracking shooting mode” may be displayed on the FS of FIG. In this way, if the angle of view is set in addition to the wide angle, the camera user (photographer) can track the subject to some extent while the user's framing tracking is not in time. It is possible to control to assist, and it is possible to shoot with a sense of security. In particular, if “tracking shooting mode” is displayed, the user knows that the angle of view is sufficient and can concentrate on shooting with peace of mind. At the time of imaging at the telephoto end, the imaging unit 12 performs imaging with a low number of pixels by the pixel number switching unit 24 (step S3). For example, when the imaging unit 12 can capture an image with a resolution four times as high as the HD image quality, the pixel number switching unit 24 sets the imaging with the HD image quality resolution.

  The control unit 11 performs predetermined signal processing on the captured image from the imaging unit 12 to generate a moving image. In step S <b> 4, the control unit 11 controls the target subject detection unit 21 to detect the target subject from the visual field range of the moving image, and outputs the detection result to the control unit 11. The control unit 11 controls the out-of-frame detection unit 22 and continues moving image shooting while determining whether or not the subject of interest is within the field-of-view range FS at the telephoto end.

  The controller 11 determines whether or not a zoom operation has been performed in step S5. When the zoom operation is performed by the user, the control unit 11 controls the zoom control unit 23 based on the user operation to perform zoom-in or zoom-out processing (step S6). Note that this operation may be performed before the start of the moving image.

  In the next step S <b> 7, the control unit 11 determines whether or not an out of frame is detected by the out of frame detection unit 22. If no out-of-frame is detected in step S7, the control unit 11 determines whether or not a shooting end operation has been performed in step S8. If no shooting end operation has been performed, moving image recording is performed in step S9. Do. The control unit 11 compresses the moving image and gives it to the recording / reproducing unit 16. Thereby, the recording / reproducing unit 16 sequentially records the moving images being captured.

  Here, as shown in FIG. 2, it is assumed that the position of the image 33 of the subject of interest in the visual field range FS moves to the position of the image 31 during the imaging of the visual field range FS, resulting in out of frame. This out-of-frame is detected by the out-of-frame detection unit 22, and the control unit 11 shifts the processing from step S7 to step S11 based on the detection result of the out-of-frame detection unit 22. In step S11, the control unit 11 determines whether or not the angle of view is the telephoto end. In the example of FIG. 2, the angle of view is set to the telephoto end at the point of out of frame, and the control unit 11 proceeds to the next step S <b> 12.

  In step S12, the control unit 11 sets the number of pixels picked up by the image pickup unit 12 to a high number of pixels. FIG. 3 shows this state, and shows that the number of imaging pixels of the imaging unit 12 has changed from a low pixel count to a high pixel count due to the occurrence of an out-of-frame condition. For example, when imaging at the resolution of HD image quality is performed at the time of imaging at the telephoto end, the resolution is increased to four times the HD image quality.

  Next, the control unit 11 controls the zoom control unit 23 to zoom out to the wide angle end (step S13). FIG. 4 shows this state. When an out-of-frame occurs, zoom-out processing is performed, and the field angle changes from the telephoto end to the wide-angle end. As a result, as shown in FIG. 2, the visual field range extends to the visual field range FL at the wide-angle end, and the image 31 of the subject of interest is included in the visual field range FL.

  If this zoom-out is suddenly performed, the user may be confused. Before this, the “tracking shooting mode” flashes or the “user assistance start” mark lights up, etc. You may make it inform. If such automatic switching is not desired, it may be stopped by, for example, reframing or touch panel operation.

  When the angle of view is actually changed, in the present embodiment, the control unit 11 displays angle-of-view change time information indicating the angle-of-view change timing, position information regarding the position within the field of view of the subject of interest, and the image. The zoom ratio information before and after the change of the corner is recorded in the target subject information recording unit 25 (step S14). Note that the control unit may record only the view angle change time information (or timing from the start of the moving image).

  The control unit 11 compresses the captured moving image and records it by the recording / reproducing unit 16 until it is determined in step S8 that the shooting has been completed.

  Thus, in this embodiment, when the out-of-frame of the subject of interest is detected by the out-of-frame detection unit 22, the control unit 11 controls the zoom control unit 23 to widen the angle of view and image at the wide-angle end. To capture the subject of interest within the field of view, and record the angle-of-view change time information, the location information of the subject of interest, and the zoom ratio information when the angle of view is changed.

(During playback)
FIG. 7 is an explanatory diagram for explaining the operation during reproduction. FIG. 7A shows a captured image, and each frame shows an image of one frame in the moving image along the flow of time. FIG. 7B shows a reproduction display image of a recorded image corresponding to each frame in FIG.

  A description will be given assuming that the moving image shown in FIG. 7A is recorded at the time of recording. FIG. 7A shows that wide-angle imaging has been performed between the third image and the fourth image from the left by changing the angle of view accompanying the out of frame. It is assumed that the angle of view for obtaining the visual field range of the third to third images in FIG. 7A is the same as the angle of view for obtaining the visual field range FS of the fourth and fifth images.

  When the reproduction mode is instructed, the control unit 11 controls the reproduction display control unit 15 and the recording / reproduction unit 16 to reproduce the recorded moving image. In the playback mode, the user can specify the equal angle of view playback mode using the operation unit 13. The equal angle playback mode is the same as the angle of view before changing the angle of view even after changing the angle of view when playing back recorded images with the tracking imaging mode specified at the time of shooting and the angle of view widened by the off-frame of the subject of interest. It is a mode that enables.

  When the equal angle of view reproduction mode is not instructed, the control unit 11 determines whether resizing is necessary (step S22). If the size of the area displayed on the display unit 17 is smaller than the size of the recorded image, the control unit 11 resizes the recorded image (step S24). When determining that resizing is not necessary, the control unit 11 reproduces the recorded image as it is (step S23). The resized recorded image or the original recorded image from the control unit 11 is given to the reproduction display control unit 15 to be reproduced and displayed on the display screen of the display unit 17. In step S <b> 25, the control unit 11 determines whether or not a user has issued an instruction to stop the reproduction mode, and continues the reproduction until an instruction to stop the reproduction is given.

  Here, it is assumed that the equal field angle reproduction mode is instructed. In step S31, the control unit 11 controls the reproduction display control unit 15 and the recording / reproduction unit 16 to start reproduction by equal-angle reproduction. The reproduction display control unit 15 reads the angle-of-view change time information, the position information of the subject of interest, and the zoom ratio information recorded in the subject-of-interest information recording unit 25 in the equal field-of-view reproduction mode. The reproduction display control unit 15 detects the timing at which the angle of view is switched to the wide-angle side due to out-of-frame during imaging based on the angle-of-view change time information. The angle-of-view change time information is set corresponding to the recording elapsed time of the captured moving image, and the reproduction display control unit 15 recognizes at which timing of the moving image being reproduced the angle of view is changed. To do. The reproduction display control unit 15 sets the image period in which the angle of view is changed due to the out-of-frame as a candidate period for changing the display area in the image, and determines whether the reproduction position of the recorded image has reached the candidate period. Determination is made (step S32).

  Until the reproduction position of the recorded image reaches the candidate period, the reproduction display control unit 15 displays the recorded moving image on the display unit 17 as it is. Corresponding to the third image from the left in FIG. 7A, the third image from the left in FIG. 7B is displayed.

  As shown in the fourth and fifth sheets in FIG. 7A, the recorded image in the candidate period has an angle of view that is widened at the time of shooting, and the field of view of the recorded image is wider than before the angle of view is changed. ing.

  When the reproduction position of the recorded image reaches the candidate period, the reproduction display control unit 15 proceeds to step S34, and based on the zoom ratio information, the visual field range having the same size as the visual field range of the reproduced image before changing the angle of view. From the playback image. In this case, the reproduction display control unit 15 determines the cutout position so that the subject of interest is positioned within the cutout image range based on the subject position information. The reproduction display control unit 15 gives the cut-out image range to the display unit 17 so that it is enlarged and displayed on the entire display unit 17. The fourth and fifth images in FIG. 7 (b) are enlarged and displayed by cutting out the portion of the visual field range FS from the fourth and fifth images in FIG. 7 (a). In this way, as shown in FIG. 7B, the angle of view on the display unit 17 does not change before and after the angle of view change at the time of imaging. If the time for changing from telephoto to wide-angle in FIG. 4 is not taken into consideration, the screen may be discontinuous at the timing of this enlarged display, so the transition information during the change from telephoto to wide-angle is also included. Record it. In addition, with an electronic zoom, the transition can be changed to various patterns, and can be switched instantaneously.

  In this specification, the field angle on display refers to the area of the display image corresponding to the field angle at the time of imaging, and when the entire area of the captured image is always displayed, the field angle at the time of imaging. And the angle of view on the display correspond one-to-one. Even when the angle of view changes to the wide-angle side, only the partial field of the captured image after this change can be displayed, so that only the same field of view range before the change of the angle of view can be displayed. The upper angle of view can be made constant.

  The reproduction display control unit 15 continues the uniform angle reproduction until it is determined in step S35 that the equal angle angle reproduction end operation has been performed.

  As described above, in the present embodiment, by using the view angle change time information, the position information of the subject of interest, and the zoom ratio information recorded at the time of recording in the tracking imaging mode, a moving image before and after the view angle change is reproduced. The image can be displayed without changing the angle of view on the display. Further, by using the position information of the subject of interest, it is possible to perform clipping so that the subject of interest falls within the display area, and display with the same zoom ratio before and after switching the angle of view. Moreover, the number of pixels after changing to the wide-angle side during imaging is larger than before changing the angle of view, and even when the image in the candidate period is enlarged by reproduction with the same angle of view during reproduction, It is possible to prevent the resolution from deteriorating from the previous period. In this way, it is possible to continuously display an image of a subject at a desired angle of view even though the angle of view has been changed due to a frame shift at the time of imaging. At the time of reproduction, the view angle on the display may be adjusted at the view angle change time timing by using only the view angle change time information.

  That is, the present invention is also effective for a playback device that corrects the angle of view by using the angle-of-view change timing and angle-of-view change pattern (time change) information at the time of shooting (for example, reading from an image file). .

  Further, at the time of reproduction, such a discontinuous frame may be skipped for reproduction.

(Second Embodiment)
FIGS. 8 to 10 relate to a second embodiment of the present invention, FIGS. 8 and 9 show flowcharts employed in the second embodiment, and FIG. 10 explains the second embodiment. It is explanatory drawing for. The hardware configuration of the present embodiment is the same as the hardware configuration of the first embodiment, and illustration thereof is omitted.

  In the first embodiment, the position information of the subject of interest is recorded at the time of imaging in order to cut out the image portion including the subject of interest from the image captured at the wide angle side. However, it is conceivable that the detection accuracy of the position information of the subject of interest is reduced due to the imaging on the wide-angle side, such as when a plurality of people are captured in the captured image. Therefore, in the present embodiment, position information of a subject of interest can be set after recording a moving image.

  The recording operation is the same as in the first embodiment. During recording, detection and recording of position information of the subject of interest may be omitted.

  When the editing mode is entered, the control unit 11 controls the playback display control unit 15 and the recording / playback unit 16 to start playback of a moving image (step S41 in FIG. 8). FIG. 10A shows a display screen 17 a and a seek bar display unit 17 b of the display unit 17 provided on the back surface of the photographing apparatus 10. In the example of FIG. 10, a captured image of two people running on a track is included in one frame in a recorded moving image. FIG. 10A shows an image 41 showing a track and two people's images. It shows that a reproduced image including images 42 and 43 is displayed on the display screen 17a.

  The reproduction display control unit 15 displays the seek bar display on the seek bar display unit 17b (step S42). The seek bar display indicates the angle of view when an image being reproduced is captured. Depending on whether the bar display 44 is located at the position of white display (outlined portion) to black display (shaded portion) in FIG. 10, the image is taken on the telephoto end side shown on the white display side or shown on the black display side. It shows whether the image is captured at the wide-angle end. That is, it can be seen that the reproduced image in FIG. 10A is captured at the telephoto end during shooting.

  Here, it is assumed that the image after the change of the angle of view from the narrow side to the wide angle side due to the out of frame in the tracking imaging mode during image recording is reproduced. In this case, the subject appears smaller as the angle of view widens. When the reproduction display control unit 15 detects that the image after the change to the wide angle side has been reproduced based on the angle-of-view change time information, the reproduction display control unit 15 determines that the enlargement processing period has been reached, and performs the process in step S43. To step S44.

  In step S44, the playback display control unit 15 starts slow playback. For example, the playback display control unit 15 displays the playback image at 1/2 times speed or 1/4 times speed. Thereby, a time margin is generated for the operation for selecting the range (cutout range) to be enlarged by the user, and the selection operation is facilitated. As a result, it is possible to prevent the subject from becoming too small and difficult to be specified if the subject moves fast. During slow playback, an indication that the subject should be selected may be displayed. Alternatively, the subject may be designated in the same manner by performing slow playback before the angle of view becomes wide. This makes it possible to specify the subject before and after changing the angle of view and make tracking more reliable so that the same subject is continuously reproduced.

  In step S45, the control unit 11 accepts an attention point selection operation by the user. The reproduction display control unit 15 sets a predetermined clipping range around the attention point.

  FIG. 10B shows an attention point selection operation by the user. FIG. 10B shows that small images 42 ′ and 43 ′ are displayed on the display screen 17a because the images 42 and 43 of the person in FIG. 10A are captured on the wide angle side. Yes. The user can confirm that the image captured on the wide-angle side is displayed by the position of the bar display 44 on the seek bar display.

  Now, it is assumed that the user performs an attention point selection operation with the image 43 ′ as an attention subject. The user touches the position of the image 43 'with, for example, the finger 46 (step S45). This operation is detected by the touch panel 14 provided on the display unit 17. When the operation signal based on the user's attention point selection operation is supplied from the touch panel 14 to the control unit 11, the reproduction display control unit 15 is an image of a predetermined clipping range including the attention point designated by the user in the next step S46. Is enlarged and displayed on the entire display unit 17.

  In this case, the reproduction display control unit 15 prevents the view angle on the display of the image before and after the change of the view angle from changing based on the zoom ratio information, that is, the view range based on the view angle before the change of the view angle. The cut-out range is set so that the field-of-view range is the same size as. FIG. 10C shows an enlarged display 47 in this case. FIG. 10C shows that the images 42 ′ and 43 ′ of the person in FIG. 10B are enlarged and displayed on the display screen 17a as images 42 ″ and 43 ″. .

  Note that the coloring area (filled area) 48 on the seek bar display in FIG. 10C indicates the imaging time of the enlarged display 47 when the left end to the right end of the seek bar display are associated with the start time to the end time of the captured image. Show. The reproduction display control unit 15 records the attention point information and the imaging time information corresponding to the enlarged display period in the attention subject information recording unit 25.

  The control unit 11 determines whether or not the user's attention point selection operation has been completed (step S48). For example, the control unit 11 can determine that the point-of-interest selection operation has ended when the user releases the finger 46 from the display screen 17a.

  Note that the control unit 11 can more reliably identify the subject of interest by performing the attention point selection operation while moving the finger 46 touching the image of the subject of interest in accordance with the movement of the image. Is possible.

  When the attention point selection operation by the user ends, the reproduction display control unit 15 ends the display of the cut out enlarged display 47, for example, after a predetermined time. In step S50, the control unit 11 determines whether or not the reproduction of the moving image has ended. If not, the control unit 11 returns to step S41 and repeats the processing in steps S41 to S49.

  Further, in step S51, the control unit 11 may edit and record the recorded image using the image enlarged by the user performing the attention point selection operation. That is, in this case, among the image periods after the change of the angle of view in the recorded image, the image period for which the user has selected the attention point is replaced with an enlarged image of the field of view corresponding to the angle of view before the change of the angle of view. And recorded.

  Further, in this case, the control unit 11 performs a process such as a thinning process or an interpolation process for all the frames of the edited image to match the number of pixels in accordance with a predetermined format, and then records a moving image. I do.

  When the image editing in step S51 is performed, an image with the angle of view on the display adjusted can be displayed by a normal playback device.

  In the case where the image editing in step S51 is not performed, an image whose angle of view on the display is adjusted can be reproduced and displayed by the viewing reproduction shown in FIG. In the viewing / playback mode, the control unit 11 controls the playback display control unit 15 and the recording / playback unit 16 to start moving image playback (step S61).

  In step S62, the reproduction display control unit 15 determines whether or not the target subject information recording unit 25 has information on the target point regarding the moving image to be reproduced. When there is information on the point of interest, the playback display control unit 15 displays a seek bar display shown in FIG. As described above, in the seek bar display shown in FIG. 10C, the angle of view on the display is indicated by the bar display 44, and the time (reproduction position) from the start of imaging of the captured image is indicated by the coloring area 48.

  When the moving image being reproduced is reproduced to the reproduction position corresponding to the imaging time corresponding to the attention point selection operation, the reproduction display control unit 15 shifts the processing from step S64 to step S65 and performs enlarged display. That is, the reproduction display control unit 15 displays an enlarged image of the cutout range including the attention point on the entire display screen 17a of the display unit 17 as in step S46 of FIG. As described above, the cutout range is determined from the zoom ratio.

  When the moving image being reproduced is reproduced to the reproduction position corresponding to the imaging time corresponding to the end timing of the attention point selection operation, the reproduction display control unit 15 shifts the processing from step S66 to step S67, and performs normal processing. Return to video playback.

  As described above, in this embodiment, the same effect as in the first embodiment can be obtained, and the area of the subject to be enlarged in the recorded moving image can be set in the editing mode after recording. Can do. Thus, for example, when the angle of view is changed to the wide-angle side due to out-of-frame in the tracking imaging mode, the subject desired by the user can be detected even when the subject of interest cannot be reliably detected from the captured image on the wide-angle side. Can be reproduced within the field of view corresponding to the angle of view before changing the angle of view only during the period desired by the user.

It is obvious that the present invention can be applied to an apparatus for automatically tracking a subject by providing a mechanism for changing the optical axis direction of the imaging unit.
[Appendix 1]
An imaging unit having a zoom function;
A display unit;
A designation part that allows the subject to be designated when the zoom is not at the wide-angle end,
A zoom control unit that detects that the designated subject is out of frame and changes the angle of view to a wide angle side;
An imaging apparatus comprising: a display control unit that performs display for informing the display unit of a change in the angle of view in accordance with information on a change in angle of view by the zoom control unit.
[Appendix 2]
A subject detection unit that detects a subject in a moving image that has been shot with a change in the angle of view;
Using information on the change in the angle of view and information on the change timing at the time of shooting,
A playback device comprising: a playback display control unit that adjusts and displays a view angle on a moving image display regardless of the change of the view angle at the time of imaging.
[Appendix 3]
In a moving image shot with a change in the angle of view from a narrow angle of view to a wide angle of view,
Using information on the change in the angle of view and information on the change timing at the time of shooting,
Slow playback starts and the subject selected during slow playback
A playback device comprising: a playback display control unit that displays an image as if it was shot at substantially the same angle of view regardless of the change in the angle of view at the time of imaging.

    DESCRIPTION OF SYMBOLS 10 ... Imaging device, 11 ... Control part, 12 ... Imaging part, 13 ... Operation part, 14 ... Touch panel, 15 ... Reproduction display control part, 16 ... Recording / reproduction part, 17 ... Display part, 21 ... Interesting subject detection part, 22 ... out-of-frame detection unit, 23 ... zoom control unit, 24 ... pixel number switching unit, 25 ... target subject information recording unit.

Claims (10)

An imaging unit;
A subject detection unit that detects a moving subject in the moving image captured by the imaging unit;
A zoom control unit that detects that the subject in the moving image is out of frame due to movement and changes the angle of view to the wide angle side;
A control unit that records information on the angle of view change timing by the zoom control unit in association with the moving image;
A reproduction display control unit for displaying the moving image with a constant angle of view on the display of the moving image, regardless of the change of the angle of view at the time of imaging, using the information on the timing of changing the angle of view when reproducing the moving image ; An imaging device comprising: An imaging unit;
A subject detection unit that detects a moving subject in the moving image captured by the imaging unit;
A zoom control unit that detects that the subject in the moving image is out of frame due to movement and changes the angle of view to the wide angle side;
A control unit for recording information on the angle of view change timing by the zoom control unit in association with the moving image;
Comprising
The control unit, together with the information of the change timing of the field angle, imaging equipment, characterized in that to record the location information in the information and field of view of the subject of the ratio of the angle before and after the angle of view changes. In order to specify the tracking subject on the touch panel on the display during playback,
The photographing apparatus according to claim 1 , wherein the reproduction display control unit performs slow display of the moving image to be reproduced. The reproduction display control unit uses the information on the timing of changing the angle of view and the information on the ratio of the angle of view before and after changing the angle of view to display the moving image regardless of the change in the angle of view at the time of imaging. The imaging device according to claim 1 , wherein the image is displayed with a constant angle of view. The control unit records information on the angle of view before and after the change of the angle of view and position information in the visual field range of the subject, together with information on the change timing of the angle of view.
The photographing apparatus according to claim 4 , wherein the reproduction display control unit always displays the subject by using the position information. An imaging unit;
A subject detection unit that detects a moving subject in the moving image captured by the imaging unit;
A zoom control unit that detects that the subject in the moving image is out of frame due to movement and changes the angle of view to the wide angle side;
A control unit that records information on the angle of view change timing by the zoom control unit in association with the moving image;
Comprising a number of pixels switching unit for changing the number of pixels of the moving picture,
The pixel number switching unit at a timing of changing the angle of view, imaging equipment, characterized in that increasing the number of pixels of the moving picture. An imaging unit;
A subject detection unit that detects a moving subject in the moving image captured by the imaging unit;
A zoom control unit that detects that the subject in the moving image is out of frame due to movement and changes the angle of view to the wide angle side;
A control unit for recording information on the angle of view change timing by the zoom control unit in association with the moving image;
Comprising
The control unit includes a photographing device, characterized in that after recording the information of change timing of the moving picture and the field angle, and records the timing information to adjust the angle of the display when reproduction of the moving picture. 8. The photographing apparatus according to claim 7 , wherein the control unit records information indicating a position where the moving image is displayed in an enlarged manner after recording the moving image and the information about the change timing of the angle of view. Detect moving subjects in the captured video,
Detect that the subject in the moving image is out of frame due to movement, change the angle of view to the wide angle side,
The information change timing of the angle and recorded corresponding to the moving picture,
When reproducing the moving image, the information on the timing of changing the angle of view is used to display a fixed angle of view on the moving image display regardless of the change of the angle of view at the time of imaging. A shooting method characterized by the above. The angle-of-view change timing from an image file in which information of the angle-of-view angle change is recorded in correspondence with a moving image captured with the angle of view changed to the wide-angle side in accordance with a frame shift accompanying the movement of the subject. The information is read out and displayed at a constant angle of view on the moving image.

Images