JP2009049691A - Imaging apparatus and imaging control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To acquire captured image data having no blurs by preventing the captured image data having blurs from being acquired in an imaging apparatus and by detecting the motion of the imaging apparatus itself to acquire the captured image data when there is no movement in the imaging apparatus itself. <P>SOLUTION: The imaging apparatus detects movement in automatic imaging processing and stores the captured image data captured when the movement of the imaging apparatus itself has stopped. By the automatic imaging processing, the captured image data which are imaged at timing when the movement of the imaging apparatus itself has stopped can be stored. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image pickup apparatus and an image pickup control method, and more particularly to a technique for eliminating the influence of blurring on a picked-up image due to movement of the image pickup apparatus itself.

JP 2007-109049 A

For example, as a life log camera or the like, a camera that records a scene that the user sees in daily life as image data by periodically taking a still image by a camera worn by the user has been proposed. By using this life log camera, it becomes possible to leave a user's action history, memories, etc. as image data.
In Patent Document 1, an image of the periphery of the host vehicle is captured by a camera installed in the host vehicle, and an edge extraction process is performed on the camera image when the host vehicle is stopped and the camera image when the host vehicle is started. A device has been proposed in which detection is performed and a camera image at the start is displayed on the display device when an object is detected, and a camera image at the start is not displayed on the display device when an object is not detected.

By the way, as a life log camera, for example, a device that attaches a small image capturing device to a spectacle-type or head-mounted mounting unit, captures images at regular time intervals, and stores the captured image data is assumed. it can.
However, when a user wears such a device and performs daily actions, the image capturing device itself moves at the timing of capturing the captured image data to be stored, and the influence of the movement of the image capturing device on the captured image data. May occur.

FIG. 12 illustrates the movement of the image pickup apparatus that is considered when it is assumed that, for example, the image pickup apparatus picks up images at regular time intervals while the user is moving and stores the picked-up image data.
In FIG. 12, the horizontal axis indicates time and the vertical axis indicates speed. For example, the movement of the image capturing device itself changes in the plus (+) direction and the minus (−) direction in accordance with the shaking of the body when the user walks. Note that the timing when the movement becomes zero is the timing when the image capturing apparatus itself becomes stationary for a moment when the direction of shaking of the image capturing apparatus itself changes, for example.
The image capturing apparatus automatically captures images at regular intervals tn and stores captured image data. In this figure, the time when the captured image data to be stored is captured is shown as time t1, time t2,... Time t6, time t7. The fixed period tn may be, for example, about 4 seconds to 10 seconds.

  As shown in FIG. 12, when the image capturing apparatus captures images at a predetermined time interval tn from the timing when captured image data stored last time is captured, time t1 when the image capturing is performed. Then, the timing of the movement speed of the image pickup apparatus is large. At time t2, time t4, time t5, time t6, and time t7, imaging is performed at the timing when the image capturing apparatus itself is moving.

  In other words, when imaging is performed during a certain period tn, it is considered that imaging is often performed at the timing when the imaging apparatus itself moves, for example, when the user moves (for example, while walking or running), There is a concern that a large number of blurred captured images affected by the movement of the image capturing apparatus may be obtained.

  In view of the above, an object of the present invention is to prevent captured image data having a blur in an image capturing apparatus. Furthermore, the movement of the image pickup device itself is detected, and the picked-up image data is acquired when the image pickup device itself does not move so that the acquisition control of the picked-up image data without blur is performed.

An image capturing apparatus according to the present invention includes an image capturing unit that captures an image of a subject to obtain captured image data, a storage processing unit that performs a storage process on the captured image data obtained by the image capturing unit, and an image capturing apparatus itself. As the motion detection means for detecting the motion and the automatic imaging processing not based on the shutter operation of the user, the captured image data captured by the imaging means at the control timing based on the detection result in the motion detection means is stored in the storage processing means. And a control means for performing control for saving processing.
The control means determines the timing at which the movement of the image capturing apparatus itself is determined to be stopped as the control timing.
Further, the control unit sets the predetermined period after the storage process unit performs the storage process as a standby period in which the captured image data captured by the imaging unit is not a target of the storage process. Control.

In addition, the image processing apparatus further includes a temporary holding unit, and the control unit associates the detection information in the motion detection unit with the captured image data captured by the imaging unit during the execution period of the automatic imaging process. If the control timing is not obtained even after a predetermined period of time, the image data stored in the temporary holding means is stored on the basis of the detection information. The captured image data to be selected is selected, and control is performed to cause the storage processing means to store the selected captured image data.
The image capturing apparatus further includes a temporary storage unit that temporarily stores captured image data obtained by the imaging unit, and the control unit performs the automatic imaging process based on the detection result of the motion detection unit. The captured image data picked up by the image pickup means is temporarily held in the temporary holding means at the timing when it is determined that the movement of itself is close to the stop state, and the control timing cannot be obtained even after a predetermined period. In this case, control is performed to cause the saving processing means to save the captured image data temporarily held in the temporary holding means.
In addition, the control means sets the timing at which the detection result that the image capturing apparatus itself is predicted to stop moving is obtained by the motion detection means as the control timing.

  The imaging control method of the present invention is an imaging control method of an image imaging device that performs automatic imaging processing that is not based on a user's shutter operation, an imaging step that captures a subject image and obtains captured image data, and an image imaging device itself. A motion detection step for detecting a motion, and a storage processing step for storing the captured image data captured in the imaging step at a control timing based on a detection result in the motion detection step.

According to the present invention described above, the captured image apparatus can store captured image data captured when the movement of the image capturing apparatus itself is stopped by performing the automatic image capturing process.
This automatic imaging process is a process of storing captured image data of a subject image captured at a control timing when it is determined that the motion of the image capturing apparatus itself is in a stopped state based on the motion detection result. The stopped state is a state in which the control means determines that the captured image device is in a stopped state or a minute movement that can be regarded as stopped. By determining the state, the control timing for acquiring the captured image data to be stored is determined.

According to the present invention, since it is possible to perform imaging at a timing when the movement of the image capturing device itself is stopped, it is possible to avoid the influence of blurring due to the movement of the image capturing device itself appearing in the captured image data. I can do it.
For example, when an image capturing device is installed by a user or installed in a car, even if the user or the car moves, the captured image data captured at the timing when the motion of the image capturing device itself is stopped is stored. Can do. In other words, captured image data that is not affected by blur can be stored. When a large number of captured image data stored by the image capturing apparatus of the present invention are sequentially reproduced and displayed, smooth continuous images that are not affected by blur are displayed. It can be viewed as captured image data and is suitable as a life log image.

Embodiments of the present invention will be described below. The description will be made in the following order.
[1. Appearance of imaging device]
[2. Configuration example of imaging apparatus]
[3. Image processing operation example I]
[4. Image processing operation example II]
[5. Image processing operation example III]
[6. Image processing operation example IV]
[7. Image processing operation example V]
[8. Modified example]

[1. Appearance of imaging device]

Various forms are assumed as the imaging apparatus 1 of the embodiment, and examples of their appearance are illustrated in FIGS.
FIG. 1A shows a neck-mounted type imaging apparatus 1. The imaging apparatus 1 has a part for fixing a strap, for example, and is attached by fixing the strap to the part and hanging it on the user's neck as shown in the figure. The user only needs to wear the imaging lens 3L included in the imaging device 1 so that the imaging can be performed with the front direction of the user as the subject direction.
Although not shown, for example, a display unit used for an imaging monitor or reproduction of a captured image may be provided on the back surface of the imaging device 1 or the like.

FIG. 1B shows an imaging apparatus 1 that is a glasses-type display camera. The imaging device 1 has a mounting unit having a frame structure that makes a half turn, for example, from both sides of the head to the back of the head, and is mounted on the user by being placed on both ear shells as illustrated.
In the imaging device 1, the imaging lens 3 </ b> L is arranged forward so that imaging is performed with the user's visual field direction as the subject direction when the user is wearing the imaging device 1.
Further, in the wearing state as shown in the figure, a pair of display units 5 and 5 for the left eye and the right eye are arranged immediately before both eyes of the user, that is, at a position where a lens in normal glasses is located. Has been. For example, a liquid crystal panel is used for the display unit 5. By controlling the transmittance, a through state as shown in the figure, that is, a transparent or translucent state can be obtained. Since the display unit 5 is in the through state, there is no problem in normal life even if the user always wears it like glasses.
In addition to a pair of display units 2 corresponding to both eyes, a configuration in which one display unit 2 is provided corresponding to one eye is also conceivable. A configuration in which the display unit 2 is not provided is also conceivable.

In FIGS. 1A and 1B, the neck-mounted type or the eyeglass-type imaging device 1 is exemplified, but various structures for the user to wear the imaging device 1 can be considered. For example, a headphone type, a neckband type, an ear hook type, or any other mounting unit may be worn by the user. Furthermore, for example, a configuration may be adopted in which the user attaches to normal glasses, a visor, headphones, or the like with an attachment such as a clip. Moreover, it does not necessarily have to be worn on the user's head.
In addition, in the case of FIG. 1A, the imaging direction is the front direction of the user, but the imaging device 1 may be worn on the neck so as to capture the back of the user when worn.
In the case of FIG. 1B, the imaging direction is the user's field of view, but the imaging lens 3 </ b> L is attached so as to capture the user's rear, side, upper, foot direction, and the like when worn. Alternatively, a configuration in which a plurality of imaging systems having the same or different imaging directions is provided is also conceivable.
Further, in FIGS. 1A and 1B, an imaging direction variable mechanism that can change the subject direction manually or automatically may be provided for one or a plurality of imaging lenses 3L.

Needless to say, forms other than those shown in FIGS. 1A and 1B are also conceivable as an image pickup apparatus for picking up a still image. For example, an imaging apparatus 1 that can be installed in a vehicle and that can image inside or outside the vehicle can be assumed as the present embodiment. For example, it is an imaging device attached to take an image of the interior of a vehicle or an imaging device attached to take an image of a front landscape, a rear landscape, or the like of a car.
Further, an apparatus such as a mobile phone, a PDA (Personal Digital Assistant), and a portable personal computer that has a function as an imaging apparatus can be assumed as the imaging apparatus 1 of the present embodiment.
In these various forms, for example, a microphone that collects external sound may be provided, and an audio signal to be recorded together with image data may be obtained during imaging. Further, a speaker unit and an earphone unit that perform audio output may be formed.
It is also conceivable that a light emitting unit that performs illumination in the direction of the subject is provided in the vicinity of the imaging lens 3L using, for example, an LED (Light Emitting Diode) or a flash light emitting unit for taking a still image.

[2. Configuration example of imaging apparatus]

Here, a configuration example of the imaging apparatus 1 according to the embodiment will be described.
FIG. 2 is a block diagram illustrating an internal configuration of the imaging apparatus 1.
As illustrated, the imaging apparatus 1 includes a system controller 2, an imaging unit 3, an imaging control unit 4, a display unit 5, a display control unit 6, an operation input unit 7, an acceleration sensor 8, a storage unit 9, a temporary memory unit 10, A bus 11 and a communication unit 12 are included.

  The system controller 2 includes, for example, a microcomputer including a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), a nonvolatile memory unit, and an interface unit, and controls the entire imaging apparatus 1. The control unit The system controller 2 performs various arithmetic processes and exchanges control signals with each unit via the bus 11 based on a program held in an internal ROM or the like, and causes each unit to execute a required operation.

The imaging unit 3 includes an imaging optical system 3a, an imaging element unit 3b, and an imaging signal processing unit 3c.
The imaging optical system 3a in the imaging unit 3 performs a focusing operation and a zooming operation on a lens system including the imaging lens 3L illustrated in FIG. 1, a diaphragm, a zoom lens, a focus lens, and the like, and the lens system. A drive system or the like is provided.
In the image pickup device section 3b in the image pickup section 3, a solid-state image pickup device array that detects image pickup light obtained by the image pickup optical system 3a and generates an image pickup signal by performing photoelectric conversion is provided. The solid-state imaging device array is, for example, a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array.
The imaging signal processing unit 3c in the imaging unit 3 includes a sample hold / AGC (Automatic Gain Control) circuit that performs gain adjustment and waveform shaping on a signal obtained by the solid-state imaging device, and a video A / D converter. Obtained image data. Also, white balance processing, luminance processing, color signal processing, and the like are performed on the captured image data.

Imaging is performed by the imaging unit 3 including the imaging optical system 3a, the imaging element unit 3b, and the imaging signal processing unit 3c, and captured image data is obtained.
Image data obtained by the imaging operation of the imaging unit 3 is processed by the imaging control unit 4.
The imaging control unit 4 performs processing for converting the captured image data into a predetermined image data format under the control of the system controller 2, and displays the converted captured image data in the temporary memory unit 10, the storage unit 9, and the display according to the operation status. Processing to be supplied to the control unit 6 is performed.
Further, the imaging control unit 4 controls on / off of imaging operation in the imaging unit 3, driving control of the zoom lens and focus lens of the imaging optical system 3a, sensitivity and frame rate of the imaging element unit 3b based on an instruction from the system controller 2. Control, parameter control of each process of the imaging signal processing unit 3c, execution process setting, and the like.

A display unit 5 and a display control unit 6 are provided as a configuration for displaying to the user in the imaging apparatus 1.
The display unit 5 is provided with a display panel unit such as a liquid crystal display and a display driving unit for driving the display panel unit. This display driving unit is configured by a pixel driving circuit for displaying the image data supplied from the imaging control unit 4 on the display panel unit. The pixel drive circuit applies a drive signal based on the video signal to each pixel arranged in a matrix in the display panel unit at a predetermined horizontal / vertical drive timing, and causes display to be performed.

The display control unit 6 drives the pixel driving circuit in the display unit 5 based on the control of the system controller 2 to execute a predetermined display. For example, display of a captured image as a monitor in the imaging unit 3 or display of an image reproduced in the storage unit 9 is executed.
For these displays, for example, brightness level adjustment, color correction, contrast adjustment, sharpness (outline emphasis) adjustment, and the like can be performed. Also, generation of an enlarged image obtained by enlarging a part of the image data, generation of a reduced image, soft focus, mosaic, luminance inversion, highlight display (highlight display) of a part of the image, change in atmosphere of the whole color, etc. Image effect processing can also be performed.

The operation input unit 7 has operation elements such as keys, buttons, and dials, for example, and forms operation elements such as a power on / off operation and an on / off operation of a shake avoidance function described later. Further, as an operation of the imaging system, for example, an operator used for a shutter operation, a zoom operation, an exposure setting operation, a self-timer operation, or the like may be formed.
The operation input unit 7 supplies information obtained from such an operator to the system controller 2, and the system controller 2 performs necessary arithmetic processing and control corresponding to the information.

The acceleration sensor 8 detects the acceleration of the movement of the imaging apparatus 1 itself, and supplies a signal corresponding to the detected acceleration to the system controller 2.
For example, the acceleration sensor 8 can detect the movement of the imaging device 1 itself when the user wears the imaging device 1 and moves.
Then, the system controller 2 performs processing for taking in the detected value of the acceleration of the movement of the imaging device 1 itself as a signal supplied from the acceleration sensor 8.
In the present embodiment, it is only necessary to be able to detect the movement of the imaging apparatus 1 itself. Instead of the acceleration sensor 8, an angular velocity sensor, a vibration sensor, an impact sensor, or the like may be used.

The storage unit 9 is used for storing various data. For example, it is used for storing captured image data.
The storage unit 9 may be configured by a solid-state memory such as a flash memory, or may be configured by an HDD (Hard Disk Drive), for example.
Further, instead of a built-in recording medium, a portable recording medium, for example, a recording / reproducing drive corresponding to a recording medium such as a memory card incorporating a solid-state memory, an optical disk, a magneto-optical disk, or a hologram memory may be used.
Of course, both a built-in type memory such as a solid-state memory and an HDD, and a recording / reproducing drive for a portable recording medium may be mounted.
The storage unit 9 records and stores captured image data based on the control of the system controller 2.
Further, based on the control of the system controller 2, the recorded data is read and supplied to the system controller 2, the display control unit 6, and the like.

The temporary memory unit 10 is a volatile memory used for temporarily storing captured image data.
The temporary memory unit 10 can temporarily hold the captured image data supplied from the imaging control unit 4 and supply the captured image data to the storage unit 9 in accordance with an instruction from the system controller 2.
The temporary memory unit 10 is used in image capturing processing operation examples III and IV described later, and may not be provided when other processing operation examples are employed.

The communication unit 12 is provided as a part that performs data communication with various external devices.
For example, data transmission / reception with a server device (not shown) may be performed. In that case, for example, a configuration in which network communication is performed via short-range wireless communication with a network access point by a method such as wireless LAN or Bluetooth, or direct wireless communication with a server device having a corresponding communication function is possible. Communication may be performed.
Further, the communication unit 12 may be connected to a device such as a personal computer using an interface such as a USB (Universal Serial Bus) system, and may transmit and receive data.
The communication unit 12 can transfer, for example, captured image data captured and stored in the storage unit 9 to a personal computer or other external device.

The configuration of the imaging device 1 has been described above, but this is only an example. Addition and deletion of various components are naturally conceivable depending on the actual operation example and function.

[3. Image processing operation example I]

The imaging device 1 of this example having such a configuration is, for example, a neck-hanging type as shown in FIG. 1A and avoids shaking while the user is wearing and moving the imaging device 1. Suppose you use a function. In this case, an image capturing processing operation is performed to realize that the captured image data blurred due to the movement of the image capturing apparatus 1 itself is avoided.
Hereinafter, the imaging processing operation as the present embodiment will be described.
Note that the image pickup apparatus 1 in later-described image pickup processing operation examples II, III, IV, and V will also be described as the necking type shown in FIG.

FIG. 3 shows a change in the detected value indicating the speed of movement of the imaging apparatus 1 based on the detection result from the acceleration sensor 8 included in the imaging apparatus 1. The horizontal axis represents time, and the vertical axis represents speed. The detected value is shown.
When the change in the detected value of the speed is indicated in the plus (+) direction, for example, this indicates that the imaging device 1 has moved in the upward direction, and when the change is indicated in the minus (−) direction. This shows that the imaging apparatus 1 has moved downward. Further, the change in the detected value of the speed is zero when the imaging device 1 is stopped. For example, when the detection value of the speed when the imaging device 1 moves in the right direction is indicated as a change in the plus (+) direction, the change in the minus (−) direction indicates that the imaging device 1 moves in the left direction. It is shown as a detected value of speed at the time.
Such a change in speed is detected by the acceleration sensor 8 as the movement of the imaging device 1 in accordance with the movement of the user's body, for example, when the user is walking and moving.

  In FIG. 3, in response to the detection value of the movement speed of the imaging apparatus 1 becoming zero, the timings at which the captured image data stored by the imaging apparatus 1 are captured are the time t001, the time t002, and the time t003. ,... Are shown as time t012 and time t013. At each time point, since the movement of the imaging apparatus 1 itself is stopped, it is possible to acquire captured image data that is not affected by blurring.

The processing of the system controller 2 for realizing such an operation will be described with reference to FIG.
The process shown in FIG. 4 is executed based on a program stored in the ROM built in the system controller 2 (the same applies to the processes shown in FIGS. 6, 8, 9, and 11 described later). is there).

  In step F <b> 101, the system controller 2 starts confirming the detected acceleration value from the acceleration sensor 8. In step F <b> 102, the system controller 2 performs a process of calculating the speed of the imaging apparatus 1 based on the detected acceleration value from the acceleration sensor 8. By calculating the speed of the imaging apparatus 1, the state of the imaging apparatus 1 can be determined. That is, when the speed is generated in the imaging device 1, the imaging device 1 is moving.

In step F103, the system controller 2 determines whether or not the speed of the imaging device 1 has become zero, according to the calculation result of the speed of the imaging device 1 in step F102. That is, the fact that the speed of the imaging device 1 becomes zero indicates that the imaging device 1 itself is in a stopped state.
Here, when the system controller 2 obtains a determination result that the speed of the imaging apparatus 1 has not become zero, the process returns to step F102. Step F102 → Step F103 → Step F102 until a determination result is obtained that the speed of the imaging device 1 has become zero at a certain point in time (that is, until a result is obtained that the imaging device 1 itself is stopped). → Repeat step F103 →...

In step F103, if the system controller 2 obtains a determination result that the speed of the imaging device 1 has become zero, the process proceeds to step F104.
In step F104, the system controller 2 gives an instruction for still image capturing to the image capturing control unit 4 at this timing when the speed of the image capturing apparatus 1 becomes zero and the image capturing apparatus 1 itself is stopped. That is, control is performed so that one frame of captured image data captured by the imaging unit 3 at this time is an image to be stored as a still image. With this control, the imaging control unit 4 performs a predetermined process such as an encoding process on the extracted captured image data of one frame, and transfers it to the storage unit 9. The storage unit 9 performs processing for recording the transferred one-frame captured image data on a recording medium.
The system controller 2 returns the process to step F102 when the process in step F104 is completed. The system controller 2 repeats the process (F102, F103, F104) that proceeds to step F104 every time it obtains a determination result that the speed of the imaging device 1 has become zero in step F103.
That is, the system controller 2 repeats the process of causing the imaging unit 3 to perform imaging at each timing when the imaging device 1 itself is stopped and saving the captured image data as a still image in the storage unit 9. Is.

  Note that the captured image data captured by the imaging unit 3 is stored at the timing when the speed of movement of the imaging device 1 itself becomes zero, but the timing for imaging is not limited to when the speed is zero. That is, the captured image data captured when the motion of the imaging device 1 itself is captured at a minute timing hardly affects the captured image data, and the captured image data captured when the motion of the imaging device 1 itself is stopped. Captured image data that is not inferior to the above can be acquired. Therefore, the process may proceed to step F104 at the timing when the detection value of the speed corresponding to the movement of the imaging apparatus 1 itself is fine, and the captured image data at that time may be stored. That is, the determination in step F103 may be a determination as to whether the speed is zero or a value within a predetermined range near zero.

As described above, in the process of FIG. 4, the system controller 2 performs a process of acquiring and storing captured image data using the timing at which it is determined that the movement of the imaging apparatus 1 itself is in a stopped state as a control timing. Note that the stopped state is a state in which the movement of the imaging apparatus 1 itself is stopped or can be determined as a stopped state.
Since imaging can be performed when the imaging device 1 itself is in a stopped state, captured image data in which the influence of shaking due to movement of the imaging device 1 itself does not appear can be stored. Further, when the stored captured image data is viewed in order, the captured image data is not affected by blurring, so that it can be viewed as smooth continuous captured image data.

[4. Image processing operation example II]

In the image capturing processing operation of FIG. 4 for realizing the shake avoidance function described above, processing for acquiring and storing captured image data captured at the timing when the motion speed of the imaging device 1 itself becomes zero. It is carried out. The fact that the speed of movement of the imaging apparatus 1 itself is zero means that the movement of the imaging apparatus 1 itself is in a stopped state. Therefore, the captured image data captured at this timing is influenced by the movement of the imaging apparatus 1 itself. There is no captured image data, that is, there is no blurring.
However, since the movement of the imaging device 1 itself may change irregularly, imaging may be performed at short time intervals. For example, there may be a case where the imaging device 1 itself moves to a stopped state and immediately thereafter the imaging device 1 itself starts moving again. In such a case, the imaging device 1 performs imaging at a short time interval. Thus, captured image data with almost no change in the subject image is acquired and stored.

Normally, when a user wears the imaging device 1 and takes an image while moving and saves the captured image data, the user captures captured image data obtained by capturing a subject image that has a slight change compared to a subject image that hardly changes. It seems desirable.
Therefore, a processing operation for storing captured image data captured after a certain time interval is also conceivable.
Hereinafter, such a captured image acquisition processing operation will be described.

FIG. 5 shows the change in the detected value of the movement speed of the imaging apparatus 1 itself, as in FIG. 3 described above, and the horizontal axis shows the time and the vertical axis shows the detected value of the speed.
Also in FIG. 5, the detected value of the speed of the imaging device 1 changes in the positive direction and the negative direction, indicating that the imaging device 1 is moving.

In FIG. 5, counting of the standby period te is started after the speed of the imaging apparatus 1 becomes zero, and captured image data obtained by capturing at the timing when the speed becomes zero after the count of the standby period te is acquired. And save it.
The time t101 shown in FIG. 5 is the time when the count of the standby period te has elapsed since the previous speed became zero. The time at which the speed becomes zero after the elapse of the count at time t101 is indicated as time t102, and the imaging apparatus 1 performs processing for acquiring and storing captured image data captured at the timing of time t102. Do.
Furthermore, the time when the count of the waiting period te has elapsed from time t102 is shown as time t103, and the time when the speed becomes zero after the time t103 has elapsed is shown as time t104. Also, the time when the count of the waiting period te has elapsed from the time t104 is indicated as a time t105, the time when the speed has become zero after the counting of the time t105 is indicated as the time t106, and the time when the counting of the waiting period te has elapsed from the time t106 Is the time t107, and the time when the speed is zero after the elapse of the count at the time t107 is shown as the time t108.
The standby period te is an arbitrarily determined period, and is, for example, about 4 to 5 seconds. All the waiting periods te are counted from the time when the speed becomes zero (timing when the captured image data to be stored is acquired). The imaging device 1 does not store captured image data obtained during the standby period te.

  In the captured image acquisition processing operation in FIG. 5, the counting of the standby period te in which the imaging is not performed is started from the time when the captured image data to be stored is captured at the speed of zero, and after the standby period te has elapsed. In this case, the captured image data at the timing when the speed becomes zero can be stored, so that a subject image having a certain degree of change can be stored.

Processing of the system controller 2 for realizing such an operation will be described with reference to FIG.
First, the system controller 2 performs a process of starting counting after resetting the count of the waiting period te as an internal timer process in step F200. Next, the system controller 2 determines whether or not the count of the standby period te has elapsed in step F201. If the determination result that the standby period te has elapsed is obtained, the system controller 2 advances the process to step F202. The processing from step F202 to step F205 is the same as the processing from step F101 to step F104 in FIG.
That is, the system controller 2 starts confirming the detected acceleration value from the acceleration sensor 8 and calculates the speed of the imaging device 1 based on the detected acceleration value. Further, a process for determining whether or not the speed of the imaging apparatus 1 has become zero is performed according to the calculation result of the speed of the imaging apparatus 1. If the determination result that the speed has not become zero is obtained, Step F204 is performed. The process returns from step F203 to step F203. And the process of step F203-> step F204-> step F203-> step F204-> ... is repeated until the judgment result that the speed of the imaging device 1 became zero at a certain time is obtained.
If the determination result that the speed of the imaging apparatus 1 has become zero is obtained, the system controller 2 proceeds to step F205 and instructs to capture a still image at that timing. That is, control is performed so that one frame of captured image data captured by the imaging unit 3 at that time is an image to be stored as a still image. Thereby, the imaging control unit 4 performs a predetermined process such as an encoding process on the extracted captured image data of one frame and transfers it to the storage unit 9. The storage unit 9 performs processing for recording the transferred one-frame captured image data on a recording medium.
Then, when the system controller 2 causes the storage unit 9 to record the captured image data, the system controller 2 returns the process to step F201, and repeats the processes after step F201.

As an example of the processing operation described so far, as in the case of the image capturing processing operation example I, since the image capturing apparatus 1 itself can perform image capturing, the captured image data that is not affected by blurring is used. Can be saved.
Further, by setting the predetermined period after the captured image data storage process is performed as a standby period te in which the captured image data captured by the imaging unit 3 is not a target of the storage process, almost the same subject image is stored. The subject image with changes can be stored as a still image, and the captured image data captured can be stored.
Further, when the stored captured image data is viewed in order, the captured image data is not affected by blurring, so that it can be viewed as smooth continuous captured image data.

In the case of the image pickup processing operation example II, as in the case of the image pickup processing operation example I, the control timing for picking up the picked-up image data to be stored is limited to when the movement speed of the image pickup apparatus 1 itself is zero. If the movement of the image capturing apparatus 1 itself is not so small that it can be regarded as a stop, the process proceeds to step F205, and the captured image data captured at that timing may be stored.

[5. Image processing operation example III]

In the image pickup processing operation examples I and II in FIGS. 4 and 6 described above, the subject image is picked up at the timing when the speed of movement of the image pickup apparatus 1 itself becomes zero, and the picked-up image data is stored. Was.
However, for example, when the user wearing the imaging device 1 is constantly moving and the imaging device 1 itself continues to move in accordance with the user's movement, the speed of the movement of the imaging device 1 itself does not readily become zero. There is a possibility.
Therefore, in such a case, a processing operation for storing captured image data captured when the motion of the imaging device 1 itself is close to a stop state from among captured image data captured within a predetermined period may be considered. .
Hereinafter, such a captured image acquisition processing operation will be described.

FIG. 7 shows the change in the detected value indicating the speed of movement of the imaging apparatus 1 as in FIG. 3 described above, with the horizontal axis indicating time and the vertical axis indicating the detected value of speed.
Further, the detected value of the speed of the imaging device 1 changes in the positive direction and the negative direction, indicating that the imaging device 1 is moving.

The waiting period te shown in FIG. 7 is an arbitrarily defined period, for example, about 4 to 5 seconds, like the waiting period te described in FIG. 5, and during the counting of the waiting period te. The imaging apparatus 1 does not capture a subject image. The imaging device 1 does not perform imaging during the count of the waiting period te, as in the case of FIG. 5, from the timing when the captured image data to be stored last time is captured without a time interval. This is to prevent the captured image data that does not change much in the subject image from being stored even if the captured image data to be stored is captured.
In FIG. 5, the timing at which the speed of movement of the imaging apparatus 1 becomes zero after the elapse of the count of the standby period te is set as the control timing. However, in the case of FIG. In consideration of the possibility that the speed of movement of 1 does not become zero, the maximum extension period ta is counted.
In the maximum extension period ta, counting of the standby period te is started simultaneously with the start of counting, and the captured image data captured by the imaging unit 3 after the count of the standby period te has elapsed is temporarily held in the temporary memory unit 10. To. In the maximum extension period ta, counting of a new maximum extension period ta is started after the count of the previous maximum extension period ta has elapsed, and the period is, for example, about 10 seconds.

A time point t201 and a time point 210 illustrated in FIG. 7 are times when the counting of the standby period te is completed. Time t202 to time t209, and time t210 to time t218 indicate the timings of capturing and temporarily storing each frame as still image capturing, and time t209 and time t218 are the maximum extension period ta. It shows the point in time when the count ends.
For example, how many frames of captured image data can be captured within the count of the maximum extension period ta, which is about 10 seconds, depends on the setting of the frame rate in the image sensor section 3b. Alternatively, in addition to temporarily holding all the frames, intermittent frame image data such as every other frame or every other frame may be stored in the temporary memory unit 10.

  When the imaging device 1 basically has a speed of movement of the imaging device 1 itself that is zero (or within a range that can be regarded as zero) after the standby period te, as in the above-described image imaging processing operation example II. Causes the storage unit 9 to record the captured image data obtained by the imaging unit 3 at that timing as still image data.

However, the maximum extension period ta may elapse without the speed becoming zero. In that case, the picked-up image data picked up at the timing at which the speed is closest to zero is selected from a plurality of picked-up image data held in the temporary memory unit 10 as one frame of picked-up image data to be stored. For example, at the time point 209 when the count of the maximum extension period ta ends, the captured image captured at the timing of the time point t205 where the speed is closest to zero among the captured image data held in the temporary memory unit 10. Data is selected and recorded in the storage unit 9.
Similarly, even when the counting of the maximum extension period ta ends at time t218 without the speed of movement of the imaging device 1 itself becoming zero, the captured image is captured at the timing of time t217 where the speed is closest to zero. Data is selected and recorded in the storage unit 9.

Processing of the system controller 2 for realizing such an operation will be described with reference to FIG.
First, the system controller 2 performs a process of starting counting after resetting the internal timer that counts the standby period te and the maximum extension period ta in step F300. Then, the system controller 2 performs substantially the same processing as the processing from step F201 to step F205 described in FIG. 6 in the processing from step F301 to step F305.
That is, the system controller 2 determines whether or not the standby period te has elapsed, and if a determination result indicating that the standby period te has elapsed is obtained, confirmation of the acceleration detection value from the acceleration sensor 8 is confirmed. And the speed of the imaging device 1 is calculated based on the detected acceleration value. Then, the system controller 2 determines whether or not the speed of the imaging device 1 has become zero, according to the calculation result of the speed of the imaging device 1. When it is determined that the speed of the imaging device 1 has become zero, at that timing, one frame of captured image data captured by the imaging unit 3 is controlled as an image to be stored as a still image. . Thereby, the imaging control unit 4 performs a predetermined process such as an encoding process on the extracted captured image data of one frame and transfers it to the storage unit 9. The storage unit 9 performs processing for recording the transferred one-frame captured image data on a recording medium.
In this case, the system controller 2 returns the process to step F300 and performs the same process as described above.

On the other hand, when the system controller 2 determines in step F304 that the speed of the imaging device 1 is not zero, the system controller 2 proceeds to step F306.
In step F <b> 306, the system controller 2 performs a process of extracting the captured image data captured based on the frame rate setting in the imaging element unit 3 b from the imaging control unit 4 and holding it in the temporary memory unit 10. In this case, the system controller 2 adds a time code to the captured image data of one frame extracted by the imaging control unit 4 and stores it in the temporary memory unit 10.

  Next, in step F307, the system controller 2 records the detected value of the speed of the imaging device 1 together with the time code. That is, the system controller 2 associates the detected value of the speed of the imaging device 1 with the time code assigned to the captured image data of one frame and stores it in the internal memory, for example.

In step F308, the system controller 2 determines whether or not the count of the maximum extension period ta has elapsed. If it is determined that the count of the maximum extension period ta has not elapsed, the process returns to step F303. Further, when the speed of the imaging apparatus 1 does not become zero, the system controller 2 repeats the process of Step F303 → Step F304 → Step F306 → Step F307 → Step F308 → Step F303 →.
If the system controller 2 obtains a determination result that the maximum extension period ta has elapsed at a certain time, the system controller 2 advances the process to step F309.
In step F309, the system controller 2 confirms the time code recorded together with the information of the detected value of the speed at each time point stored in the internal memory in the process of step F307, and the information of the speed closest to zero is obtained. The captured image data provided with the same time code as the time code is transferred from the temporary memory unit 10 to the storage unit 9 and recorded in the storage unit 9.

  After performing the process of recording the captured image data in the storage unit 9 in step F309, the system controller 2 ends the confirmation of the detected value of the acceleration of the imaging device 1 from the acceleration sensor 8 in step F310, and performs the process. Return to Step F301.

8 is imaged at the timing when the movement speed of the imaging apparatus 1 itself is zero, similar to the image imaging processing operation examples I and II of FIGS. 4 and 6 described above. Therefore, it is possible to prevent the captured image data from being blurred due to the movement of the imaging device 1.
Further, when the control timing cannot be obtained even after the count of the maximum extension period ta has elapsed (when the process does not proceed to step F305), the speed is detected from the captured image data held in the temporary memory unit 10. The captured image data to be stored can be selected based on the information, and the selected captured image data can be stored in the storage unit 9. For this reason, a still image with relatively little blur can be stored even in a situation where it is difficult to stop.

[6. Image processing operation example IV]

With respect to the image capturing processing operation example III described with reference to FIG. 8, the image capturing apparatus 1 causes the temporary memory unit 10 to retain all captured image data captured within the count of the maximum extension period ta, and the captured image. A processing operation has been performed in which picked-up image data picked up at the timing when the speed of the image pickup apparatus 1 is closest to zero is selected from the data and stored in the storage unit 9.
Here, the imaging device 1 does not hold all the captured image data captured within the count of the maximum extension period ta in the temporary memory unit 10, but the imaging device 1 is the most captured imaged image data. Only the picked-up image data picked up at a timing at which the speed is close to zero may be held in the temporary memory unit 10.

For example, the picked-up image data picked up at time t202 shown in FIG. 7 is picked up at the timing when the speed of the image pickup apparatus 1 is closest to zero among the picked-up image data picked up within the count of the maximum extension period ta at the present time. It is assumed that the captured image data is obtained. The imaging device 1 holds the captured image data captured at the timing of the time t202 in the temporary memory unit 10 until the captured image data captured at the timing of the imaging device 1 near zero is obtained from the timing t202. .
In FIG. 7, after that, since the captured image data is captured at a timing t205 at a timing when the speed of the imaging device 1 is closer to zero than the timing t202, in this case, the imaging device 1 is captured at the timing of the time t202. Instead of the captured image data, a processing operation for holding the captured image data captured at timing t205 in the temporary memory unit 10 is performed.

When the imaging apparatus 1 performs such a processing operation, the captured image data held in the temporary memory unit 10 when the count of the maximum extension period ta has elapsed is captured within the count of the maximum extension period ta. The captured image data is captured at the timing at which the speed of the imaging device 1 is closest to zero among the image data.
The image capturing apparatus 1 stores the captured image data in the storage unit 9, so that the image capturing apparatus 1 is the most captured image data captured within the count of the maximum extension period ta, as in the image capturing processing operation example III. It is possible to acquire captured image data captured at a timing when the speed of the image is close to zero. Then, by performing such processing operation by the imaging apparatus 1, work efficiency can be improved and the memory capacity for temporary storage can be saved.

Hereinafter, processing of the system controller 2 for realizing such processing operation will be described with reference to FIG.
First, the system controller 2 performs a process of starting counting after resetting the internal timer for counting the standby period te and the maximum extension period ta in step F400. Next, in step F401, the system controller 2 performs a process of determining whether or not the count of the standby period te has elapsed. If a determination result is obtained that the count of the standby period te has elapsed, the process proceeds to step F402. To proceed.
In subsequent step F402, the system controller 2 first resets the variable VR to an initial value, and sets the variable VR to 0 when the initial value is set to 0, for example. The variable VR is a variable used for processing determination in step F406 described later. Then, when the system controller 2 resets the variable VR to the initial value and starts detecting information from the acceleration sensor 8, the process proceeds to step F403.
In step F403, the system controller 2 calculates the speed of the imaging device 1 based on the detected acceleration value from the acceleration sensor 8, and holds the calculated detected speed value as a variable VN. By calculating the speed of the imaging apparatus 1 in this manner, it is possible to determine whether the imaging apparatus 1 is in a moving state as described in Step F102 of FIG. 4 described above.

In the processing of Step F404 and Step F405, the system controller 2 performs the same processing as Step F204 and Step F205 described in FIG.
That is, the system controller 2 determines whether or not the speed of the imaging device 1 has become zero (a range that can be regarded as zero) according to the calculation result of the speed of the imaging device 1 in step F403. Here, when the determination result that the speed of the imaging apparatus 1 has become zero is obtained, an instruction to capture a still image is issued at that timing. That is, the imaging control unit 4 extracts one frame of captured image data obtained by the imaging unit 3 at that time, performs a predetermined process, and transfers it to the storage unit 9. The storage unit 9 performs processing for recording the transferred one-frame captured image data on a recording medium.

On the other hand, if the system controller 2 determines in step F404 that the speed of the imaging apparatus 1 is not zero, the process proceeds to step F406.
In step F406, the system controller 2 determines whether the variable VR = 0 (initial value) or the variable VR> the variable VN.
The case where the variable VR is an initial value is a case where the process has not yet proceeded to steps F407 and F408 within the period of the maximum extension period ta of this time. This indicates that the captured image data is not temporarily stored within the maximum extension period ta. For this reason, since the captured image data of the current frame is captured image data captured at the timing when the speed of the imaging apparatus 1 is currently closest to zero, the system controller 2 advances the process to step F407.
In this case, the system controller 2 performs control to store the captured image data of the current frame in the temporary memory unit 10 in step F407. In step F408, the value of the variable VN is substituted for the variable VR.
If the maximum extension period ta has not ended yet, the process returns from step F409 to step F403.

After the value of the variable VN is substituted for the variable VR in step F408, when the process proceeds from step F404 to F406 again, the system controller 2 compares the variable VR with the variable VN, and the variable VR> the variable VN. Determine whether or not.
The case where the variable VR> the variable VN means that the imaged image data of the frame that can be currently acquired by the imaging unit 3 has zero speed of the imaging device 1 than the captured image data currently held in the temporary memory unit 10. It can be determined that the captured image data is captured at a close timing.
Therefore, the system controller 2 advances the processing to step F407, and performs control to overwrite and store the captured image data of the current frame in the temporary memory unit 10. In this case, the captured image data stored so far is discarded. In step F408, the value of the variable VN is substituted for the variable VR. If the maximum extension period ta has not ended yet, the process returns from step F409 to step F403.
If the variable VR is not the initial value and the variable VN is greater than the variable VR in step F406, the system controller 2 returns the process from step F409 to F403.

  As a result of calculating the speed of the imaging apparatus 1, during the period in which the determination of zero speed is not obtained in step F404, the processes of steps F407 and F408 are performed according to the determination result of step F406. The unit 10 is always in a state in which one frame of captured image data captured in a state close to zero is stored.

If it is determined in step F404 that the maximum extension period ta has elapsed without being determined as zero speed, the system controller 2 advances the process to step F410.
At the time when the count of the maximum extension period ta has elapsed, the captured image data currently held in the temporary memory unit 10 has the highest speed among the captured image data captured within the count period of the maximum extension period ta. This means captured image data captured at a close timing. Therefore, in step F410, the system controller 2 performs processing of transferring the captured image data currently stored in the temporary memory unit 10 to the storage unit 9 and recording it in the storage unit 9.
In step F411, the system controller 2 ends the confirmation of the detected value of the acceleration of the imaging device 1 from the acceleration sensor 8, and returns the process to step F401.

The image capturing processing operation example IV described with reference to FIG. 9 is similar to the image capturing processing operation examples I, II, and III described with reference to FIGS. It is possible to take an image while the image pickup apparatus 1 is moving, and to prevent the imaged image data from being blurred by the movement of the image pickup apparatus 1.
Further, when the control timing cannot be obtained even after the count of the maximum extension period ta has elapsed, the captured image data captured at the timing at which the speed is closest to zero and stored in the temporary memory unit 10 is stored in the storage unit 9. Therefore, it is possible to acquire captured image data with as little influence as possible at a predetermined time interval.
Since only the captured image data captured at the timing at which the speed of the imaging apparatus 1 is closest to zero among the captured image data captured within the count of the maximum extension period ta is held in the temporary memory unit 10, Compared to the case of 8, the temporary memory unit 10 does not need a large capacity, and simplification of the apparatus configuration can be realized.
Further, the captured image data held in the temporary memory unit 10 after the elapse of the count of the maximum extension period ta is the timing at which the speed is closest to zero among the captured image data captured within the count of the maximum extension period ta. Since it can be automatically determined that the captured image data is captured, the processing operation can be efficiently performed when the captured image data is stored in the storage unit 9.

Although not shown in FIG. 9, in step F406, the variable VR may be the variable VN. In that case, the captured image data temporarily stored in step F407 may be updated, or the captured image data to be temporarily stored may not be updated without proceeding to step F407.
However, if the captured image data to be temporarily stored is updated in step F407, the updated captured image data is data that has a longer time interval than the captured image data stored as the previous still image. This is preferable from the standpoint that similar images are not continuously stored.

[7. Image processing operation example V]

In the image pickup processing operation examples I, II, III, and IV of FIGS. 4, 6, 8, and 9 described above, the subject image is picked up by the image pickup unit 3 when the speed of the image pickup apparatus 1 becomes zero. Thus, the captured image data captured is stored in the storage unit 9.
However, in actual operation, there is a slight time lag until the system controller 2 causes the imaging unit 3 to capture the subject image in response to the detected value of the speed of the imaging device 1 becoming zero. This time lag is the time difference from when the movement of the imaging apparatus 1 actually stops until the system controller 2 recognizes the detected speed value of the imaging apparatus 1 as zero, and the system controller 2 instructs the imaging control unit 4 to perform imaging. This occurs as a timing at which it is performed and a time lag until one frame extraction processing in the imaging control unit 4.
The captured image data as a still image that is actually stored in the storage unit 9 by the imaging device 1 is captured at a timing slightly deviated from the time point when the speed detection value becomes zero due to this time lag. It becomes data. In particular, when the movement of the imaging apparatus 1 itself stops for a moment and then moves again, the captured image data may be captured at the timing when the movement starts.
The influence of the blurring on the captured image data due to the movement of the imaging device 1 itself is obtained when there is some movement due to the balance between the shutter speed in the imaging element unit 3b and the speed of the movement of the imaging device 1 itself. Although it can be considered that the captured image data is practically free from blurring, it is preferable to be able to save the frame image captured at the timing of zero speed as much as possible.

Therefore, the imaging device 1 obtains the processing at which the speed is zero by performing the processing in which the system controller 2 issues an imaging instruction at a timing before the timing at which the detected value of the speed of the imaging device 1 becomes zero. It is also conceivable to perform extraction / storage processing on captured image data of a subject image to be obtained. In other words, the imaging instruction is issued at the timing when the detection result that the movement of the imaging apparatus 1 itself is predicted to stop is obtained.
Hereinafter, such a captured image acquisition processing operation will be described.

FIG. 10 shows the change in the detected value indicating the speed of movement of the imaging apparatus 1 as in FIGS. 3 and 7 described above, the horizontal axis indicates the time, and the vertical axis indicates the detected value of the speed. ing.
Further, the detected value of the speed of the imaging device 1 changes in the positive direction and the negative direction, indicating that the imaging device 1 is moving.

In FIG. 10, the time points at which the speed is zero are indicated as time point t302, time point t304, time point t306, and time point t308. In addition, the time points when the system controller 2 issues an image pickup instruction so that the subject image is picked up at each time point are indicated as a time point t301, a time point t303, a time point t305, and a time point t307. These time points also indicate the timing at which the detected value of the speed becomes the threshold value Lth1 or the threshold value Lth2.
The threshold values Lth1 and Lth2 are threshold values set in advance by calculating a time lag from when the system controller 2 issues an imaging instruction until the imaging unit 3 actually captures one frame of captured image data.
For example, when the subject image is captured at time t302, the system controller 2 issues an imaging instruction at time t301 when the detected speed value approaches zero and reaches the threshold value Lth1. Further, when the subject image is captured at time t304, the system controller 2 issues an imaging instruction at time t303 of the threshold value Lth2 at which the speed detection value approaches zero.

  In addition, as a method for setting the threshold value Lth1 and the threshold value Lth2, for example, when the user moves while wearing the imaging device 1, it is conceivable that the user moves on foot or on a vehicle. It is assumed that the user moves according to the movement. At that time, it is assumed that the imaging device 1 attached to the user also moves in a certain manner in synchronization with the movement of the user. Therefore, if this assumption is correct, the imaging apparatus 1 can detect the change pattern of the speed of the same imaging apparatus 1, and therefore the speed threshold value Lth1 and the threshold value Lth2 that the speed is estimated to be zero are set. It can be calculated. Therefore, the time point at which the detected value of the velocity becomes the threshold value Lth1 and the threshold value Lth2 while approaching zero (time point t301, time point t303, time point t305, time point t307 in FIG. 10) may be determined as the timing of the imaging instruction.

  Alternatively, if the predetermined value near zero is fixed and the detected value of the detected speed reaches the predetermined value X near zero, the system controller 2 issues an imaging instruction, and the speed is zero. It is estimated that the subject image can be captured at the timing. In that case, the time point at which the detected value of the speed reaches the predetermined value X while approaching zero may correspond to the time point t301, the time point t303, the time point t305, and the time point t307 in FIG.

  In this way, the system controller 2 performs the time t301, the time t303, the time t305 when the speed detection value threshold Lth1 and the threshold Lth2 are detected from the time t302, the time t304, the time t306, and the time t308 when the speed becomes zero. When an imaging instruction is given at time t307, an image of one frame at the timing when the speed of the imaging device 1 is almost zero can be acquired as captured image data.

Hereinafter, processing of the system controller 2 for realizing such an operation will be described with reference to FIG.
First, in the processing of Step F501 and Step F502, the system controller 2 performs the same processing as Step F101 and Step F102 of FIG. That is, the system controller 2 starts confirming the detected acceleration value from the acceleration sensor 8 and calculates the speed of the imaging device 1 based on the detected acceleration value.
In step F503, the system controller 2 determines whether or not the speed of the imaging device 1 is a timing for instructing to save the captured image data according to the calculation result of the speed of the imaging device 1. That is, the system controller 2 determines whether or not the threshold value Lth1 or the threshold value Lth2 has been detected in the process in which the calculated detection value of the speed has changed to zero.
For example, a time point t301 in FIG. 10 indicates a time point when the threshold value Lth1 is detected. By instructing the imaging at the timing of this time t301, the subject image is captured at the time t302 when the illustrated speed is zero.

In step F503, when the system controller 2 obtains a determination result that the speed of the imaging device 1 is not the timing for instructing to save the captured image data, the process returns to step F502. Then, at a certain point in time, until the system controller 2 obtains a determination result that the speed of the imaging device 1 is a timing for instructing to save the captured image data, Step F502 → Step F503 → Step F502 → Step F503 → Repeat the process.
Further, when the system controller 2 obtains a determination result that the speed of the imaging device 1 is the timing for instructing to save the captured image data, the system controller 2 advances the process to step F504.

In step F504, the system controller 2 issues an instruction to cause the imaging unit 3 to perform imaging, and the captured image data of one frame that has been captured is extracted from the imaging control unit 4, and is determined to be a captured still image. Is transferred to the storage unit 9. The storage unit 9 performs processing for recording the transferred one-frame captured image data on a recording medium.
Further, the system controller 2 returns the process to step F502 when the process in step F504 is completed, and in step F503, a determination result is obtained that the speed of the imaging apparatus 1 is the timing for instructing to save the captured image data. In this case, the process of Step F502 → Step F503 → Step F504 → Step F502 → Step F503 → Step F504 →... Is repeated.
That is, the system controller 2 issues an instruction to perform imaging at the timing when the threshold value Lth1 or the threshold value Lth2 is detected in the process in which the detected value of the speed is changed to zero, and at the timing when the imaging device 1 stops by the movement. The process of storing the captured image data as a still image in the storage unit 9 is repeated.

The image capturing processing operation example V described above with reference to FIG. 11 is similar to the image capturing processing operation examples I, II, III, and IV described with reference to FIGS. 4, 6, 8, and 9. Imaging is performed when the movement of itself stops, and it is possible to prevent the captured image data from being blurred by the movement of the imaging apparatus 1.
The timing at which the detection result of the speed at which the movement of the imaging apparatus 1 itself is predicted to stop is obtained is set as a control timing in consideration of the time lag until the system controller 2 causes the imaging unit 3 to capture the subject image. Thus, it is possible to increase the possibility of storing a still image at the timing when the movement of the imaging device 1 itself stops.
Further, when the stored captured image data is viewed in the order of acquisition, the captured image data is not influenced by blurring, so that it can be viewed as smooth continuous captured image data.

[8. Modified example]

Although the embodiments of the present invention have been described above, the present invention should not be limited to the embodiments described so far.
For example, the shake avoidance function described so far may be arbitrarily turned on / off by the user through a mode operation. By turning off this shake avoidance function, for example, when the user wants to acquire a captured image captured when the imaging device 1 is intentionally moving, the operation input unit 7 performs a mode operation. Thus, it is preferable that the shake avoidance function as in the above processing example can be turned off.

Further, in the image capturing processing operation example I described with reference to FIG. 3, it is considered that the speed of the image capturing apparatus 1 does not easily become zero. In this case, the subject is imaged at the timing when the fixed period tn described with reference to FIG. And the captured image data may be stored. This is because if the captured image data to be stored for a too long period cannot be acquired, it does not make sense to perform imaging using the shake avoidance function.
Also in the image pickup processing operation example II described with reference to FIG. 6, when the speed of the imaging apparatus 1 does not become zero within the fixed period tn after the set standby period te, the timing at which the fixed period tn has elapsed. In this case, the subject may be imaged and the captured image data may be stored.
Also, in the image capturing processing operation example V described with reference to FIG. 11, when the speed threshold value Lth1 or the threshold value Lth2 is not detected within the predetermined period tn, the subject is imaged at the timing when the predetermined period tn has passed, You may make it preserve | save the captured image data imaged.
In the case of the above-described image pickup processing operation examples II and V, as in the case of the image pickup processing operation example I, if the picked-up image data that should be stored for a very long time cannot be acquired, the meaning of performing the image pickup with the shake avoidance function It is because it does not make.

It is an external view of the imaging device of the present invention. It is a block diagram of the imaging device of an embodiment of the invention. It is explanatory drawing of the image imaging process operation example I in the imaging device of embodiment. 6 is a flowchart of an example I of image capturing processing according to the embodiment. It is explanatory drawing of the image imaging process operation example II in the imaging device of embodiment. It is a flowchart of image pick-up processing operation example II of an embodiment. It is explanatory drawing of the image imaging process operation examples III and IV in the imaging device of embodiment. It is a flowchart of image pick-up processing operation example III of an embodiment. It is a flowchart of image pick-up processing operation example IV of an embodiment. It is explanatory drawing of the image imaging process operation example V in the imaging device of embodiment. 6 is a flowchart of an image capturing process operation example V according to the embodiment. It is explanatory drawing of the image pick-up process operation of a prior art example.

Explanation of symbols

    DESCRIPTION OF SYMBOLS 1 Imaging device, 2 System controller, 3 Imaging part, 3a Imaging optical system, 3b Imaging element part, 3c Imaging signal processing part, 4 Imaging control part, 5 Display part, 6 Display control part, 7 Operation input part, 8 Acceleration sensor , 9 Storage unit, 10 Temporary memory unit, 11 Bus, 12 Communication unit

Claims (7)

Imaging means for capturing a captured image data by capturing a subject image;
Storage processing means for performing storage processing on the captured image data obtained by the imaging means;
Motion detection means for detecting the motion of the image capturing device itself;
Control means for controlling the storage processing means to store the captured image data captured by the imaging means at the control timing based on the detection result of the motion detection means as automatic imaging processing not based on the shutter operation of the user When,
An image pickup apparatus comprising:   The image capturing apparatus according to claim 1, wherein the control unit sets the timing at which the movement of the image capturing apparatus itself is in a stopped state as the control timing.   The control means controls the automatic imaging process by setting a predetermined period after the saving process means to execute the saving process as a standby period in which the captured image data captured by the imaging means is not a target of the saving process. The image capturing apparatus according to claim 1, wherein: A temporary holding means;
The control means includes
In the execution period of the automatic imaging process, the detection information in the motion detection unit and the captured image data captured by the imaging unit are stored in the temporary holding unit in association with each other, and even if a predetermined period elapses When the control timing is not obtained, the captured image data to be stored is selected based on the detection information from the captured image data stored in the temporary holding unit, and the selected captured image data is selected. The image capturing apparatus according to claim 1, wherein the storage processing unit performs control to perform storage processing. A temporary holding means for temporarily holding captured image data obtained by the imaging means;
The control means includes
As the automatic imaging process, based on the detection result of the motion detection unit, the captured image data captured by the imaging unit at a timing when it is determined that the motion of the image imaging device itself is close to the stop state is temporarily stored in the temporary holding unit. If the control timing is not obtained even after a predetermined period of time, control is performed to cause the storage processing unit to store the captured image data temporarily stored in the temporary storage unit. The image capturing apparatus according to claim 1, wherein:   2. The control unit according to claim 1, wherein the control unit sets, as the control timing, a timing at which the motion detection unit obtains a detection result predicted to stop the movement of the image capturing apparatus itself. 3. Imaging device. As an imaging control method of an imaging apparatus that performs automatic imaging processing that is not based on a user's shutter operation,
An imaging step of capturing a subject image and obtaining captured image data;
A motion detection step for detecting the motion of the image capturing device itself;
A storage processing step for storing the captured image data captured in the imaging step at a control timing based on the detection result in the motion detection step;
An imaging control method comprising:

Images