JP2018201095A - Imaging apparatus having motion prediction function - Google Patents

Abstract

To make it possible to photograph a desired scene even in a case of an imaging apparatus with low continuous shooting performance by simulating a motion of a subject and generating a photographing timing of a scene to be photographed from the result, when shooting a scene that you want to shoot while the subject is moving.SOLUTION: The imaging apparatus includes: an operation simulation unit 109 for simulating a movement of a dynamic model of a moving body in a recording apparatus; and a pattern matching unit and an imaging timing generation unit 104 that performs an imaging instruction 125 to an imaging control unit 102 by controlling a shutter timing for photographing a shape and position of a moving object to be recorded from the result and a delay time due to processing time inside the apparatus.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a recording apparatus, and more particularly to an imaging apparatus for analyzing and analyzing an input video and automating imaging timing.

2. Description of the Related Art Conventionally, there is known a method of performing continuous shooting with an imaging device and selecting a result when shooting is performed aiming at a specific opportunity from among the movement of a moving object that is a shooting target.
In recent years, the amount of memory incorporated in an image pickup apparatus has increased, and means are provided for automatically performing shooting for several seconds before and after shutter timing and selecting an image to be recorded. Also, as in Japanese Patent Application Laid-Open No. 2012-151704, a moving locus of a moving object is specified and the progress is displayed on the display unit from the start to the end of continuous shooting, and a means for composing and recording these progresses as a single photograph is also provided Has been.

JP 2012-151704 A JP 2010-119097

However, continuous shooting does not always include the scene you want to target, and the continuous shooting performance varies depending on the camera model. It was difficult to shoot at the targeted opportunity.
In view of the above problems, an object of the present invention is to provide an imaging apparatus capable of recording at a predetermined timing from the movement of a moving object without performing continuous shooting.

  The movement of the dynamic model of the moving object is simulated in the recording device, and the shutter timing for capturing the shape and position of the moving object to be recorded is controlled from the result and the delay time due to the processing time inside the device. And

  According to the present invention, a dynamic model can be used not only for humans but also for animals such as cars, motorcycles, pets, etc. Can be taken. Furthermore, since it is photographed by a program by matching with the result of the dynamic model simulation, it is possible to photograph even if there is no photographer in the vicinity of the imaging device.

Configuration of imaging apparatus to which the present invention is applied Composite photo obtained by continuous shooting Missing scenes in continuous shooting Dynamic model Dynamic modeling of continuous shooting Correlation between dynamic model behavior and shooting Correlation between dynamic model simulation and photography

[Example 1]
A block diagram of an imaging apparatus to which the present invention is applied is shown in FIG. In the figure, 101 is a lens and an image sensor of an imaging device, 102 is a function for generating and outputting a video captured by a video input (112) from the image sensor as a live video signal (113), and storage. A shooting control unit having a function of generating and outputting (114) a photograph for use and a function of reading and storing a stored photograph (114), 103 an image storage unit for storing a photograph, and 104 to a shooting control unit (102) An imaging timing generation unit 105 that generates an imaging instruction (125), and an input video analysis unit 105 that analyzes the input video (115) output from the imaging control unit (102).

  106 is a dynamic model specifying unit that acquires the type of the dynamic model and the corresponding dynamic model from the moving body model data (107) based on the result (116) of the input video analysis unit (105), and 108 is a pattern for performing matching determination of the video pattern. Matching unit 109 is a motion simulation unit that performs motion simulation of a dynamic model, 123 is a simulation result display unit that generates a result of the motion simulation unit as display data (124), 111 is a display unit having a touch input function, 110 is It is a display data generation unit that generates display data to be displayed on the display unit (111).

  The live video signal (113), the input video (115) input to the input analysis unit (105), and the signal (118) input to the pattern matching unit (108) are converted into a live video signal by the shooting control unit (102). The same data as (113) is distributed.

  The imaging device displays the input video from the lens and the image sensor (101) as a live view as video data suitable for the display unit (111) by the shooting control unit (102), and is suitable for the input video by the operation of the operator. The image is processed and stored in the image storage unit (103) as a photograph. In the shooting control unit, when generating a photo to be saved by operation, the basic function is to capture a single photo from the lens and image sensor (101), and to capture multiple times per operation. Continuous shooting can be performed. In addition, it is possible to create and save a composite photo that combines the photos taken continuously into a single photo.

  As an example of continuous shooting, throwing continuous shooting is raised. FIG. 2 is a composite photograph obtained by continuous shooting. A composite photo is a series of temporally-consecutive scenes made up of photos obtained by continuous shooting. FIG. 3 shows a missing scene in continuous shooting. The photograph obtained by continuous photographing is a photograph that is missing from the movement part of 301 that is the swinging part of the arm depending on the photographing timing. Even in the case of a continuous photo of pitching as in this example, it is generally difficult to simply take a picture at the moment of releasing the ball by an operator's instruction.

  Means for identifying a scene that is missing even in such continuous shooting, which is the object of the present invention, and shooting the scene will be described below.

  After obtaining continuous shots and composite photos, the shooting timing generation unit (104) reads the stored continuous photos and composite photos, operates the read photos, and sets them in the muon unit (127).

  On the other hand, the input video analysis unit (105) outputs the information specifying and specifying the operation target, which is the subject of continuous shooting, from the video to the dynamic model specifying unit (106) (116).

  The dynamic model specifying unit (106) specifies the person from the video specified by the input video analysis unit (105), reads out the dynamic model data of the person shown in FIG. 4 from the dynamic model data (107), and reads it out. The model data obtained is set in the operation simulation unit (109).

  The motion simulation unit (109) analyzes the motion from the set dynamic model and the continuous photograph or the composite photograph, and replaces the operation target of the photograph with the dynamic model. FIG. 5 shows a dynamic model of continuous shooting.

  Organize the dynamic motion of pitching motion on the time axis in the imaging device. Fig. 6 shows the correlation between the organized dynamic model operation and imaging. In FIG. 6, 601 is a time axis, 602 is a time taken as a continuous photograph, and 602 is a time displayed as a live video.

  Next, the shape of the dynamic data model photographed as a continuous photograph and the movements not photographed in the time interval are obtained by simulation.

  FIG. 7 shows the correlation between dynamic model simulation and imaging. Here, the part of the result of having obtained the operation part of the missing 301 by simulation is shown. In the figure, reference numeral 701 denotes a time and a clock for internal processing. Reference numeral 703 denotes the time of a photograph obtained as a continuous photograph. Reference numeral 704 denotes the time displayed as a live view.

  The motion simulation unit (109) passes the result of the simulation to the simulation result display unit (123), and the simulation result display unit (123) presents and selects the scene that was not captured during the continuous shooting. Display data to be received is generated and displayed on the display unit (111) through the display data generation unit (110).

  When the operator selects a desired scene from the scenes displayed on the display unit (111), the selected scene is notified to the shooting timing generation unit (104). The shooting timing generation unit identifies that the scene is 702.

  It takes a processing time to discriminate the video input by the pattern matching unit (108) as a specific scene. Therefore, the shooting timing generation unit (104) matches the designated scene to the pattern matching unit (108) by using the 707 scene, which is a scene retroactive to the discrimination processing time (706) of the pattern matching unit (108). Set as (119).

  The pattern matching unit (108) performs scene determination on the video (118) output from the shooting control unit (115), and when it matches the set scene, it matches the shooting timing generation unit (104). This is notified (121).

  The shooting timing generation unit (104) generates a shooting instruction (125) to the shooting control unit (102) when a notification (121) is received from the pattern matching unit (108). Take a photo of (702).

  As described above, a motion simulation is performed by comparing the motion model of the target person with the motion to be photographed to generate a scene that could not be taken as a photograph, and discrimination of the input video to the scene in consideration of the delay time of internal processing Thus, even an inexperienced operator of an imaging device can obtain a desired photograph.

[Example 2]
In the first embodiment, the same video as the live video signal (113) may be used as the video (118) input to the pattern matching unit (108). At this time, the desired scene may be between the frame rates of the live video signal. Even in this case, the determination scene for the input video is subdivided, and a scene obtained by adding the amount of time difference between the scene and the frame rate is set as the determination scene. Shooting at the same timing even for scenes between frame rates by issuing a shooting instruction to the shooting control with a delay of a delay time after the shooting notification is issued in the shooting timing generator (104) Is possible.

[Example 3]
In the first and second embodiments, the motion simulation unit (109) extends the motion simulation to 3D by using a 3D model as the dynamic model data. The input video analysis unit (105) determines the direction of the target to be identified, and notifies the direction to the imaging timing generation unit (104). The photographing timing generation unit (104) notifies the direction to the operation simulation unit (109). The motion simulation unit (109) generates a scene suitable for the direction, and the shooting timing generation unit (104) acquires the suitable scene and sets it in the pattern matching unit (108). This makes it possible to perform desired shooting at a free angle with respect to the designated scene even if the object changes its orientation or the operator changes its position.

101 range and image sensor
102 Shooting control unit
103 Image storage
104 Shooting timing generator
105 Input video analysis unit
106 Dynamic model identification part
107 Dynamic model data
108 Pattern matching section
109 Operation simulation section
110 Display data generator
111 Display
123 Simulation result display

Claims (5)

An imaging apparatus that performs digital recording, and the imaging apparatus analyzes an input video, a shooting control unit that performs shooting by a program, a display unit that displays an input video for an imaging device operator to make a shooting determination Input video analysis means for identifying a moving object, identification means for a dynamic model of the identified moving object, operation simulation means for the dynamic model, means for displaying a simulation result, and matching means for pattern matching of the input video And a shooting timing generation unit that issues a shooting instruction to the shooting control unit, and the shooting timing generation unit applies the matching to a desired pattern designated by the operator from the display of the simulation result. Set a pattern that goes back in time as a matching pattern. Imaging device and issues the imaging instruction when receiving the result of the matching. 2. The imaging apparatus according to claim 1, wherein a plurality of patterns within the frame rate interval of the input video are set in addition to the matching pattern set by the shooting timing generation unit, and the delay time is adapted according to the matched pattern. An imaging apparatus characterized by instructing an up-sampling for adding the two. The imaging apparatus according to claim 1, wherein the capturing timing of the input video is changed by the capturing timing generation unit. 4. The imaging apparatus according to claim 1, wherein a 3D simulation is performed for a dynamic model and an operation simulation to be used, and when the direction of the moving body changes, the input image analysis unit performs the direction of the moving body. And imaging direction is notified to the imaging timing generation unit, and the imaging timing generation unit resets a pattern corresponding to the direction in the matching unit. 5. The imaging apparatus according to claim 1, wherein the simulation can be performed by using two or more photographs of the moving body that have been photographed in advance for the operation designation of the operation simulation. 6. .