JP6521133B2 - Imaging control apparatus, imaging control method, and program - Google Patents

Description

  The present invention relates to an imaging control apparatus, an imaging control method, and a program.

  2. Description of the Related Art Conventionally, a system has been devised in which a camera is mounted on the head of a photographer and the photographing and recording are performed automatically. Then, as described in Patent Document 1, a technique is considered in which the periodicity of blurring of the head at the time of walking is determined, and photographing is performed at a timing when this blurring is small.

Unexamined-Japanese-Patent No. 2010-93451

  However, in the case of Patent Document 1 described above, since the recording is performed with shutter timing that depends on the walking mode of the photographer, the imaging interval originally desired by the photographer may be ignored.

  The present invention has been made in view of such problems, and it is an object of the present invention to be able to store a desired image.

  In order to achieve the above object, an imaging control apparatus according to an aspect of the present invention is configured to acquire the movement state information acquired by the movement state information acquisition means for acquiring movement state information indicating the movement state of the device. Setting means for setting the number of imagings, Control means for controlling the imaging means to take images of the number of sheets set by the setting means, Exposure timing at the time of imaging by the control means, Acquisition of the movement state information And selecting means for selecting an image to be stored from a plurality of images taken by control by the control means based on movement state information sequentially acquired by the means.

  According to the present invention, a desired image can be stored.

It is a block diagram showing the composition of the hardware of the imaging device concerning one embodiment of the present invention. FIG. 5 is a functional block diagram showing a functional configuration for executing a preferred image selection process among the functional configurations of the imaging device of FIG. 1. It is a figure for demonstrating a sensor sampling table. It is a schematic diagram showing a program diagram in the present embodiment. It is a flowchart explaining the flow of the suitable image selection process which the imaging device of FIG. 1 which has the functional structure of FIG. 2 performs.

  Hereinafter, embodiments of the present invention will be described using the drawings.

FIG. 1 is a block diagram showing a hardware configuration of an imaging apparatus according to an embodiment of the present invention.
The imaging device 1 is configured as a wearable camera including, for example, a digital camera.
The wearable camera is attached, for example, in the vicinity of the head of a photographer, and captures an image with an angle of view (horizontal direction) at the time of exercise such as walking or running.

  The imaging device 1 includes a central processing unit (CPU) 11, a read only memory (ROM) 12, a random access memory (RAM) 13, a bus 14, an input / output interface 15, a sensor unit 16, and an imaging unit 17. , An input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22.

  The CPU 11 executes various processes in accordance with a program stored in the ROM 12 or a program loaded from the storage unit 20 to the RAM 13.

  Data and the like necessary for the CPU 11 to execute various processes are also stored in the RAM 13 as appropriate.

  The CPU 11, the ROM 12 and the RAM 13 are connected to one another via a bus 14. An input / output interface 15 is also connected to the bus 14. A sensor unit 16, an imaging unit 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22 are connected to the input / output interface 15.

  The sensor unit 16 is configured by a three-axis acceleration sensor or the like that measures an acceleration including a gravitational acceleration component of the device and outputs a sensor value capable of detecting the movement or direction of the device. The sensor value output from the sensor unit 16 is used to estimate the shake or the posture of the device with respect to the movement cycle of the device.

  Although not shown, the imaging unit 17 includes an optical lens unit and an image sensor.

The optical lens unit is configured of a lens that collects light, such as a focus lens or a zoom lens, in order to capture an object.
The focus lens is a lens that forms an object image on the light receiving surface of the image sensor.
The zoom lens is a lens that freely changes the focal length in a certain range.
The optical lens unit is also provided with peripheral circuits for adjusting setting parameters such as focus, exposure, white balance, etc., as necessary.

The image sensor includes a photoelectric conversion element, an AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a complementary metal oxide semiconductor (CMOS) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) an object image, accumulates an image signal for a certain period of time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on this analog image signal. A digital signal is generated by various signal processing, and is output as an output signal of the imaging unit 17.
Hereinafter, such an output signal of the imaging unit 17 is referred to as “captured image data”. Data of the captured image is appropriately supplied to the CPU 11 and an image processing unit (not shown).

The input unit 18 includes various buttons and the like, and inputs various information in accordance with a user's instruction operation.
The output unit 19 includes a display, a speaker, and the like, and outputs an image and a sound.
The storage unit 20 is configured by a hard disk, a dynamic random access memory (DRAM), or the like, and stores data of various images.
The communication unit 21 controls communication performed with another device (not shown) via a network including the Internet.

  A removable medium 31 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like is appropriately attached to the drive 22. The program read from the removable media 31 by the drive 22 is installed in the storage unit 20 as needed. The removable medium 31 can also store various data such as image data stored in the storage unit 20 in the same manner as the storage unit 20.

In the image pickup apparatus 1 configured as described above, when a plurality of images are photographed, the apparatus at the time of environmental photographing is estimated from information (hereinafter referred to as "environmental information") related to the photographing environment such as sensor values. And an inclination of the device, and select a suitable image free from blurring and inclination from among the plurality of photographed images.
The imaging apparatus 1 also has a function of interval shooting that shoots a predetermined number of images at a predetermined interval, and has a function of performing continuous shooting during one cycle of the interval shooting. In such an imaging apparatus 1, when performing imaging, an action of a photographer wearing the imaging apparatus 1 is estimated from a movement cycle of the apparatus at the time of imaging, and imaging parameters corresponding to the estimated action (for example, It has a function to shoot with the number of shots, exposure, shutter speed etc.). Here, the action of the photographer estimated is, for example, a state of exercise such as a state of rest, a state of walking, a state of traveling, and the like.
By having the above-described function, the imaging device 1 can select and store a suitable image at a desired imaging timing.

FIG. 2 is a functional block diagram showing a functional configuration for executing a suitable image selection process among the functional configurations of such an imaging device 1.
In the preferred image selection process, in shooting in one cycle at the time of interval shooting, an action at the time of shooting is estimated, shooting parameters suitable for the estimated action are set, and a plurality of images are shot by continuous shooting And a series of processes for selecting and storing a suitable image free from blurring and inclination at the time of shooting from among the plurality of photographed images.

  As shown in FIG. 2, in the preferred image selection processing, in the CPU 11, an imaging control unit 51, an environment information acquisition unit 52, an action estimation processing unit 53, an imaging parameter setting unit 54, an image acquisition unit 55, and an environment The information analysis unit 56 and the image selection unit 57 function.

  Further, in one area of the storage unit 20, an environment information storage unit 71 and an image storage unit 72 are set.

  The environment information storage unit 71 stores a sensor sampling table in which sensor values indicating the movement state (degree) of the device acquired from the sensor unit 16 are arranged in the order of acquisition. In this sensor sampling table, along with the sensor values, the order of the captured images is also stored in time series.

FIG. 3 is a diagram for explaining a sensor sampling table.
As shown in the example of FIG. 3A, the sensor sampling table has a data format in which the sensor value [ACC] sampled at the sensor type in the header part [Header] and the exposure timing [EXP] are described in time series. It has become. Further, the sensor sampling table has a data format in which the sensor value and the image number attached in the order of photographing are described in the data section [data] corresponding to the header part.
In this sensor sampling table, the sensor value and the image can be synchronized because the image number is described for each shooting together with the sensor value for each acquisition in time series. That is, the sensor value corresponding to the image number becomes the sensor value between the sensor values before and after the image number.
For this reason, when comparing sensor values among a plurality of captured images, comparison may be made with sensor values located before and after an image number.
By using such a sensor sampling table, acquisition and management of sensor values can be performed, and synchronization between sensor values and an image can be achieved. In addition, since the attitude of the device at the time of shooting can be analyzed based on the sensor value, the design can be simplified and the processing load can be reduced as compared with the case where image analysis or the like is performed to determine shake or tilt.
As shown in the example of FIG. 3B, when the sensor values [ACC] (sensor values 0 to 8) and the exposure timing [EXP] (image number 1 and image number 2) are plotted in the order of acquisition, they are plotted. By comparing the sensor values of the exposure timing, it is possible to easily compare the magnitude of blurring at the time of shooting.

  Returning to FIG. 2, the image storage unit 72 stores data of the image selected by the image selection unit 57.

  The imaging control unit 51 controls the sensor unit 16 and the imaging unit 17 to perform imaging and controls the sensor unit 16 according to the start of interval imaging, or the imaging unit based on settings of imaging parameters and the like. Control 17 and so on.

  The environment information acquisition unit 52 acquires environment information which is a shooting environment at the shooting timing of interval shooting. The shooting information includes, for example, the state of movement of the device and the brightness of the surroundings (shooting direction). Further, in the present embodiment, the movement state of the device is acquired from the sensor value from the sensor unit 16, and the brightness is acquired by analyzing the photographed image.

The action estimation processing unit 53 executes an action estimation process.
In the action estimation process, a process of estimating the action at the current time of the photographer wearing the imaging device 1 is performed from the acquired sensor value (the state of movement). As the behavior estimation, for example, a known behavior estimation method such as machine learning is used. As a result of the action estimation process, the action of the photographer's stillness, walking, running, and other movements (stationary / walking / running / others) is estimated.

In the present embodiment, shooting parameters (in the present embodiment, [the number of continuously shot images], [continuously shot fps], and [program diagram]) corresponding to the estimated action are provided.
The shooting parameters corresponding to the estimated action are generally selected to select a high shutter speed and high-speed continuous shooting as the estimated exercise intensity of the action is higher (rest <travel). Other shooting parameters are set such that high shutter speeds and settings that can withstand high-speed continuous shooting are selected.

Specifically, when the estimated action is [still], the program diagram: Normal is selected with the number of continuous shots: one.
If the estimated action is [walking], the program diagram Action1 is selected with the number of continuous shots: 3 and the continuous shooting fps: 30 fps.
When the estimated action is [travel], the program diagram: Action 2 is selected with continuous shooting number: 10, continuous shooting fps: 60 fps.
When the estimated action is [Others], the program diagram: Action 1 is selected with the number of continuous shots: 3, continuous shooting fps: 30 fps.

Here, the program diagram refers to the relationship between each shooting parameter (sensitivity, aperture, shutter speed, EV (Exposure Value) in this embodiment) set at the time of exposure control for a plurality of parameters related to shooting. It is a defined characteristic diagram.
FIG. 4 is a schematic view showing a program diagram in the present embodiment.
As shown in FIG. 4, in the program diagram of the present embodiment, the sensitivity increases and the shutter speed decreases as the motion intensity changes from Normal corresponding to a standstill with low exercise intensity to Action 2 corresponding to traveling with a high exercise intensity. Is configured.
In such a program chart, the type of the program chart is selected by the estimated action, and the shooting exposure value (optimum program line is selected based on the brightness which is the environmental information acquired from the image etc. at the time of shooting). Figure is determined.

Returning to FIG. 2, the shooting parameter setting unit 54 selects the shooting parameters of the number of continuous shots, the continuous shooting fps, and the program diagram according to the action estimated by the action estimation processing unit 53.
Further, the imaging parameter setting unit 54 sets AF (Auto Focus), AWB (Auto White Balance) and AE (Auto Exposure) from the 3A measurement and program chart. As for AE, a shooting exposure value is determined and set from environmental information of brightness acquired from an image or the like at the time of shooting with respect to a program diagram selected by an estimated action.

  The image acquisition unit 55 acquires an image captured by the imaging unit 17.

The environmental information analysis unit 56 executes environmental information analysis processing.
In the environmental information analysis process, the sensor value acquired from the sensor unit 16 is analyzed.
Specifically, the environmental information analysis unit 56 analyzes a sensor value at each photographing (exposure) time to determine shake presence / absence determination, and posture estimation to determine an inclination from the estimated device posture. ,I do. The shake determination is performed by determining a shift from the movement period of the specified photographer from the periodic change of the sensor value. Further, posture estimation is performed by extracting a gravity acceleration component from a sensor value, and determining the difference between the estimated device posture and a reference posture (for example, the horizontal direction). As a result of the analysis, it is possible to determine the degree of the image blurring or the device inclination at each photographing (exposure) time from the condition of the device without judging the actual image.

  The image selection unit 57 selects an image with less blurring of the image and inclination of the apparatus based on the analysis result by the environment information analysis unit 56 from the images acquired by the image acquisition unit 55.

FIG. 5 is a flow chart for explaining the flow of preferred image selection processing executed by the imaging device 1 of FIG. 1 having the functional configuration of FIG. 2.
The preferred image selection process is started by the user starting the preferred image selection process on the input unit 18.

  In step S1, the imaging control unit 51 starts interval imaging.

In step S <b> 2, the environmental information acquisition unit 52 starts sampling of the sensor value output from the sensor unit 16. In addition, the environmental information acquisition unit 52 outputs the sensor value to the environmental information storage unit 71 and stores the sensor value according to the acquisition.
The acquired sensor values are sequentially added to the sensor sampling table as shown in FIG. 3 in the environment information storage unit 71.

In step S3, the imaging control unit 51 determines whether it is an interval imaging timing. That is, the imaging control unit 51 determines whether or not it is the imaging timing based on the elapsed time of the designated interval.
If it is not the interval photographing timing, it is determined as NO in step S3 and the standby state is established until the interval photographing timing comes.
If it is the interval photographing timing, it is determined as YES in Step S3, and the process proceeds to Step S4.

  In step S4, the action estimation processing unit 53 executes an action estimation process. In the action estimation process, the sensor values acquired one after another are analyzed, and a process of estimating the action at the current time of the photographer wearing the imaging device 1 is executed. As a result of the action estimation process, the action of the photographer's stillness, walking, running, and other movements (stationary / walking / running / others) is estimated. For example, the behavior of walking is estimated from the acquired sensor values.

  In step S5, the photographing parameter setting unit 54 selects the photographing parameter of the number of continuously shot images / shutter speed (fps) / program diagram corresponding to the action estimated by the action estimation processing unit 53. For example, when the estimated action is [walking], the program diagram (FIG. 4): Action 1 is selected at the number of continuous shots: 3, continuous shooting fps: 30 fps.

  In step S6, the environment information acquisition unit 52 acquires environment information of brightness from the image or the like at that time, and performs 3A measurement (AE / AWB / AF). At this time, the imaging unit 17 prepares for exposure.

  In step S7, the imaging parameter setting unit 54 sets the imaging based on the imaging parameters. Specifically, the shooting parameter setting unit 54 sets the continuous shooting number and the continuous shooting fps selected based on the estimated action. Further, the photographing parameter setting unit 54 performs 3A (AE / AWB / AF) based on the photographing exposure value determined from the environmental information of the brightness acquired for the selected program chart and the measurement result. Make settings for

  In step S8, the imaging control unit 51 controls the imaging unit 17 to start imaging.

  In step S9, the imaging control unit 51 controls the imaging unit 17 to perform exposure with the content set by the imaging parameter setting unit 54. Then, the image acquisition unit 55 acquires an image from the imaging unit 17. The exposure timing is stored in the sensor sampling table of the environment information storage unit 71 in order to synchronize the exposure timing with the sensor value.

In step S10, the imaging control unit 51 determines whether or not the set continuous shooting has been completed. That is, the imaging control unit 51 determines whether or not the set continuous shooting number has been shot.
If continuous shooting has not been completed, it is determined as NO in step S10, and the process returns to step S9.
If continuous shooting has been completed, YES is determined in step S10, and the process proceeds to step S11.

In step S11, the environment information analysis unit 56 executes an environment information analysis process. In the environmental information analysis process, the sensor value acquired from the sensor unit 16 is analyzed.
Specifically, the environment information analysis unit 56 analyzes the sensor value at each photographing (exposure) time, and determines the degree of inclination of the apparatus from the attitude of the apparatus estimated as the degree of blurring of the corresponding image. As a result, the blur of the image in each image and the degree of inclination are analyzed.

  In step S12, the image selection unit 57 selects an image from among the images acquired by the image acquisition unit 55. Specifically, based on the analysis result by the environment information analysis unit 56, the image selection unit 57 selects an image with less blurring of the image and inclination of the device from among the plurality of images.

  In step S <b> 13, the image selection unit 57 stores an image with little blurring of the selected image or inclination of the device in the image storage unit 72.

In step S14, the imaging control unit 51 determines whether interval imaging has been completed.
If the interval imaging has not been completed, it is determined as NO in Step S14, and the process returns to Step S3.
If the interval shooting has been completed, it is determined as YES in Step S14, and the preferred image selection process is ended.

  Therefore, the imaging apparatus 1 estimates the action (operating state) of the photographer and appropriately selects and sets the continuous shooting according to the estimated action, thereby reducing blurring of the image and tilting the apparatus. It is possible to take pictures of less Further, in the imaging apparatus 1, by synchronizing the exposure timing and the acquisition timing of the sensor value with the sensor sampling table, it becomes possible to analyze the sensor value at the time of shooting. It becomes possible to automatically select and store an optimal image with less blurring of the image and less inclination of the apparatus from the images.

The imaging device 1 configured as described above includes an environment information acquisition unit 52, a photographing parameter setting unit 54, an image acquisition unit 55, and an image selection unit 57.
The environment information acquisition unit 52 acquires the imaging environment including the movement state of the apparatus at the imaging timing of interval imaging via the sensor value.
The imaging parameter setting unit 54 sets the number of images to be acquired based on the imaging environment acquired by the environment information acquisition unit 52.
The image acquisition unit 55 captures an image each time the imaging timing is detected, and acquires the number of images set by the imaging parameter setting unit 54.
Thereby, in the imaging device 1, a desired image can be stored.

The imaging device 1 further includes an image selection unit 57 that selects an image to be stored from the number of images acquired by the image acquisition unit 55.
Thereby, in the imaging device 1, a suitable image to be stored can be selected.

The image selection unit 57 selects an image to be stored from the plurality of acquired images based on the movement state of the apparatus at the time of acquisition of the set number of images.
Thereby, in the imaging device 1, imaging can be performed at a desired imaging timing, and a suitable image to be stored can be selected.

The imaging device 1 further includes an environment information storage unit 71 that stores the movement state of the device acquired by the environment information acquisition unit 52 and the set number of images in association with each other.
The image selection unit 57 selects an image to be stored from the plurality of images stored in the environment information storage unit 71 during the period excluding the imaging timing.
Thereby, in the imaging device 1, for example, processing can be reduced with a simple configuration as compared with the case of selecting an image to analyze and store an image.

The imaging parameter setting unit 54 sets imaging conditions when the image acquisition unit 55 acquires an image based on the imaging environment acquired by the environment information acquisition unit 52.
Thus, the imaging device 1 can acquire a suitable image according to the imaging environment at the time of imaging.

The environment information acquisition unit 52 acquires a shooting environment each time a shooting timing arrives.
Thus, the imaging device 1 can acquire a suitable image according to the imaging environment at the imaging timing.

The environmental information acquisition unit 52 acquires the movement state of the device by the acceleration sensor mounted on the device.
Thereby, in the imaging device 1, the sensor value detected by the acceleration sensor can be used, and the movement state of the device with high accuracy can be acquired.

  The present invention is not limited to the above-described embodiment, and modifications, improvements, and the like in the range in which the object of the present invention can be achieved are included in the present invention.

In the above-mentioned embodiment, although the movement state of imaging device 1 was acquired by the sensor value of an acceleration sensor, it is not restricted to this. For example, it may be configured to acquire an image each time, and analyze the acquired image to acquire the movement state of the imaging device 1.
Specifically, the photographing environment acquisition unit can be configured to acquire the movement state of the imaging device 1 by analyzing the image.
Thereby, in the imaging device 1, the imaging unit 17 can acquire the movement state of the imaging device 1 without separately providing a sensor of the acceleration sensor.

Further, the estimation process of the behavior estimation processing unit 53 may directly acquire the moving speed, and estimate the movement state of the imaging device 1 from the moving speed.
Specifically, in the imaging device 1, the movement state of the device includes the speed of movement of the device.

Further, when acquiring the moving speed, the moving type (walking, traveling, etc.) of the photographer may be associated with the moving speed, and the moving speed may be acquired by acquiring the moving type.
Specifically, the imaging device 1 further includes a first estimation unit that estimates the movement type from the state of movement of the device, and the speed of movement is based on the movement type estimated by the first estimation unit. It can be configured to be determined.

Furthermore, contrary to the above case, the estimation process of the behavior estimation processing unit 53 may directly acquire the movement type and estimate the movement state of the imaging device 1 from the movement type. Further, when acquiring the movement type, the movement speed of the photographer may be associated with the movement type, and the movement type may be acquired by acquiring the movement speed.
Specifically, the apparatus further comprises second estimation means for estimating the speed of movement from the state of movement of the device, and the movement type is determined based on the speed estimated by the second estimation means. can do.

  In the above-mentioned embodiment, although sensor part 16 was constituted by an acceleration sensor, it is not restricted to this, and if it is a sensor effective in estimation and judgment, such as a geomagnetic sensor, a gyro sensor, and GPS, you may use variously and combine.

  Moreover, in the above-mentioned embodiment, although the action regarding exercise | movement, such as a walk and driving | running | working, was estimated, it is not restricted to this, You may estimate various actions.

  Further, in the above-described embodiment, the continuous shooting number / continuous shooting fps / program diagram is not limited to an example, and may be set variously in accordance with the operation state.

  Further, in the above-described embodiment, although the preferable image condition is "less image blurring" "less tilt of the device", various suitable image conditions may be set and determined depending on applications.

  Further, in the above-described embodiment, although the shooting timing of the continuous shooting is after the shooting setting notification, an appropriate timing may be determined by utilizing a state estimation result or a sensor value.

Further, in the above-described embodiment, although the timing of interval imaging start is set to a fixed time interval, the imaging timing may be adaptively determined based on the state estimation result and the sensor data analysis result. For example, the interval shooting interval can be adaptively changed according to the timing at which the operating state has changed (such as a change from an exercise state to a stationary state) or the operating state (for example, stationary: every 5 minutes, walking: every 3 minutes, running: Every minute, etc.).

  In the above embodiment, the exposure timing synchronized with the sensor data is the exposure start timing. However, the present invention is not limited to this. The exposure end timing or the exposure start / end timing may be used.

  In the above-described embodiment, the acceleration sensor is mounted on the camera. However, if the sensing unit and the camera unit can communicate, a separate system may be used using an external device.

Moreover, in the above-mentioned embodiment, although the imaging device 1 to which this invention is applied was demonstrated as an example the wearable camera which is a digital camera, it is not specifically limited to this.
For example, the present invention can be generally applied to electronic devices having a suitable image selection function.
Specifically, for example, the present invention is applicable to a laptop personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be performed by hardware or software.
In other words, the functional configuration of FIG. 2 is merely illustrative and not particularly limited. That is, it is sufficient if the imaging apparatus 1 is provided with a function capable of executing the above-described series of processes as a whole, and what functional block is used to realize this function is not particularly limited to the example of FIG.
Further, one functional block may be configured by hardware alone, may be configured by software alone, or may be configured by a combination of them.

When the series of processes are executed by software, a program that configures the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only configured by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body to provide the program to the user, but also the user in a state incorporated in advance in the apparatus main body The recording medium etc. provided to The removable medium 31 is made of, for example, a magnetic disk (including a floppy disk), an optical disk, or a magneto-optical disk. The optical disc is constituted of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disk), a Blu-ray Disc (Blu-ray Disc) (registered trademark) or the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. The recording medium provided to the user in a state of being incorporated in the apparatus main body is, for example, the ROM 12 of FIG. 1 in which the program is recorded, the hard disk included in the storage unit 20 of FIG.

  In the present specification, in the step of describing the program to be recorded on the recording medium, the processing performed chronologically along the order is, of course, parallel or individually not necessarily necessarily chronologically processing. It also includes the processing to be performed.

  While some embodiments of the present invention have been described above, these embodiments are merely illustrative and do not limit the technical scope of the present invention. The present invention can take other various embodiments, and furthermore, various changes such as omissions and substitutions can be made without departing from the scope of the present invention. These embodiments and modifications thereof are included in the scope and the gist of the invention described in the present specification, etc., and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the claims at the beginning of the application of the present application is appended below.
[Supplementary Note 1]
Shooting environment acquisition means for acquiring a shooting environment including the movement state of the apparatus at the shooting timing of interval shooting;
A first setting unit configured to set the number of images to be acquired based on the imaging environment acquired by the imaging environment acquisition unit;
An acquisition unit that captures an image each time the imaging timing is detected, and acquires the number of images set by the first setting unit;
An imaging apparatus comprising:
[Supplementary Note 2]
The image pickup apparatus according to claim 1, further comprising: selection means for selecting an image to be stored from the number of images acquired by the acquisition means.
[Supplementary Note 3]
The selection unit selects an image to be stored from the plurality of acquired images based on a state of movement of the device at the time of acquisition of the set number of images. Imaging device.
[Supplementary Note 4]
The apparatus further comprises holding means for holding the state of movement of the device acquired by the photographing environment acquiring means in association with the set number of images.
The imaging apparatus according to claim 3, wherein the selection unit selects an image to be stored from the plurality of images held by the holding unit during a period excluding the photographing timing.
[Supplementary Note 5]
A second setting unit configured to set a shooting condition when the acquisition unit acquires an image based on the imaging environment acquired by the imaging environment acquisition unit;
The imaging device according to any one of appendices 1 or 4, further comprising:
[Supplementary Note 6]
The photographing environment acquisition unit acquires a photographing environment each time a photographing timing arrives.
The imaging device according to appendix 5, characterized in that
[Supplementary Note 7]
The photographing environment acquisition unit acquires the movement state of the apparatus by an acceleration sensor mounted on the apparatus.
The imaging device according to any one of appendices 1 to 6, characterized in that
[Supplementary Note 8]
The photographing environment acquisition unit acquires the movement state of the device by analyzing an image.
The imaging device according to any one of appendices 1 to 6, characterized in that
[Supplementary Note 9]
The imaging device according to any one of appendices 1 to 8, characterized in that the state of movement of the device includes the speed of movement of the device.
[Supplementary Note 10]
The apparatus further comprises a first inference means for inferring the movement type from the state of movement of the device;
The imaging device according to appendix 9, wherein the speed of the movement is determined based on the movement type estimated by the first estimation means.
[Supplementary Note 11]
The imaging device according to any one of appendices 1 to 8, wherein a movement type is included in the state of movement of the device.
[Supplementary Note 12]
The apparatus further comprises second inference means for inferring the speed of movement from the state of movement of the device;
The imaging device according to appendix 11, wherein the movement type is determined based on the speed estimated by the second estimation means.
[Supplementary Note 13]
An image acquisition method performed by an imaging device, comprising:
An imaging environment acquisition step of acquiring an imaging environment including a state of movement of the apparatus at an imaging timing of interval imaging;
A first setting step of setting the number of images to be acquired based on the imaging environment acquired in the imaging environment acquisition step;
An acquisition step of imaging each time the imaging timing is detected, and acquiring the number of images set in the first setting step;
An image acquisition method characterized by comprising:
[Supplementary Note 14]
A computer for controlling the imaging device,
Imaging environment acquisition means for acquiring the imaging environment including the state of movement of the apparatus at the timing of imaging of interval imaging,
A first setting unit configured to set the number of images to be acquired based on the imaging environment acquired by the imaging environment acquisition unit;
An acquisition unit configured to capture an image each time the imaging timing is detected, and acquire the number of images set by the first setting unit;
A program characterized by acting as

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Bus, 15 ... Input-output interface, 16 ... Sensor part, 17 ... Imaging unit, 18: Input unit, 19: Output unit, 20: Storage unit, 21: Communication unit, 22: Drive, 31: Removable media, 51: Imaging control Unit 52: Environmental information acquisition unit 53: Behavior estimation processing unit 54: Shooting parameter setting unit 55: Image acquisition unit 56: Environmental information analysis unit 57: 57 Image selection unit, 71: Environmental information storage unit, 72: Image storage unit

Claims (6)

Setting means for setting the number of imaging sheets of the imaging means based on the movement state information acquired by the movement state information acquisition means for acquiring movement state information indicating the movement state of the device;
A control unit that controls the imaging unit to capture the number of images set by the setting unit;
An image to be stored from a plurality of images captured by the control unit based on the exposure timing at the time of imaging by the control unit and the movement status information sequentially acquired by the movement status information acquisition unit Selection means for selecting
An imaging control apparatus comprising:   The selection means should store the number of images acquired by the acquisition means by comparing the movement state information acquired before and after the exposure timing among the movement state information acquired sequentially. The imaging control apparatus according to claim 1, wherein an image is selected.   The image pickup control apparatus according to claim 1, wherein the setting unit sets the number of photographed images at the photographing timing of the interval photographing mode. The movement state information acquisition unit is provided in an external device of the device.
The device and the external device both have communication means,
The selecting means is a plurality of images captured by the control by the control based on the exposure timing at the time of imaging by the control and the movement state information sequentially acquired via the communication. The image pickup control apparatus according to any one of claims 1 to 3, wherein an image to be stored is selected from the above. Setting the number of imaging sheets of the imaging means based on the movement state information acquired by the movement state information acquisition means for acquiring movement state information indicating the movement state of the device;
A control step of controlling the imaging unit to capture the number of images set in the setting step;
An image to be stored from a plurality of images captured by the control in the control step based on the exposure timing at the time of imaging in the control step and the movement status information sequentially acquired by the movement status information acquisition unit A selection step to select
An imaging control method characterized by including: A computer provided in the imaging control device,
Setting means for setting the number of imaging sheets of the imaging means based on the movement state information acquired by the movement state information acquisition means for acquiring movement state information indicating the movement state of the device;
Control means for controlling the imaging means to pick up the number of images set by the setting means;
An image to be stored from a plurality of images captured by the control unit based on the exposure timing at the time of imaging by the control unit and the movement status information sequentially acquired by the movement status information acquisition unit Selection means to select
A program characterized by acting as

Images