JP2008288821A - Imaging apparatus and imaging method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To execute appropriate imaging respectively in an automatic imaging mode and a manual imaging mode. <P>SOLUTION: The setup with respect to the operation of an imaging means is switched according to manual imaging and automatic imaging. The setup with respect to the operation of the imaging means is, for instance, the setup of the operation (operation relating to a focus or a diaphragm, for instance) of an imaging optical system in the imaging means, the setup of the operation (shutter speed, for instance) of an imaging element part, and the setup of a signal processing operation (gain (sensitivity) processing and correction processing such as blur correction, for instance) for imaging signals obtained in the imaging element part, etc. By switching the setup, appropriate picked-up image data are obtained corresponding to the respective cases of the automatic imaging and manual imaging of different imaging conditions. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and an imaging method for imaging a subject scene.

JP 2004-356970 A

  In the above-mentioned Patent Document 1, an image captured in response to a manual operation (for example, shutter operation) with a normal digital still camera or video camera and an image automatically captured with a wearable camera worn by the user on the body are described. A technique for making the recording method different is disclosed.

However, in the imaging apparatus, manual imaging that performs processing for storing a captured image at a timing corresponding to a shutter operation and automatic imaging that automatically performs processing for storing a captured image without using a shutter operation can be selectively executed. In this case, it is considered that a more suitable captured image can be obtained by appropriately controlling the operation and processing of the imaging system, for example, signal processing and imaging optical system processing, according to the manual imaging and automatic imaging. It is done.
Therefore, an object of the present invention is to enable more suitable image capturing in each of manual imaging and automatic imaging.

  An imaging apparatus according to the present invention includes an imaging unit that performs imaging to acquire captured image data of a subject, a storage processing unit that performs storage processing of captured image data obtained by the imaging unit, and a timing according to a shutter operation. A manual imaging operation for storing captured images and an automatic imaging operation for automatically storing captured images without shutter operation are selectively executed by the imaging unit and the storage unit. And a control unit that performs control to switch settings relating to the operation of the imaging unit when the manual imaging operation is performed and when the automatic imaging operation is performed.

The imaging means is configured using a CCD sensor or a CMOS sensor as an imaging element.
In addition, as the automatic imaging operation, the control unit performs a periodic captured image data storage process, a captured image data storage process in response to generation of a trigger other than a shutter operation, or a captured image data storage process as a moving image. Control to execute.
The imaging device is used by being mounted on a user's body or a moving body. Alternatively, the imaging device is owned and used by the user.
The control means switches between the manual imaging operation and the automatic imaging operation in accordance with a mode switching operation.
The control means causes the manual imaging operation to be executed in response to detecting a shutter operation while the automatic imaging operation is being executed.

Further, the control means switches the setting of the body shake correction, the setting of the body movement correction, or the setting of the camera shake correction as the setting relating to the operation of the imaging means.
The control means switches focus settings as settings relating to the operation of the imaging means.
Further, the control means performs switching of shutter speed setting, sensitivity setting, or aperture setting as the setting relating to the operation of the imaging means.

  The imaging method of the present invention acquires the captured image data of the subject by performing imaging, and performs the setting for the manual imaging operation as the setting related to the imaging operation as the imaging method of the imaging device that performs the storage process of the captured image data. Manual imaging step for saving captured image at timing according to shutter operation and setting for automatic imaging operation as setting related to imaging operation, and automatically saving captured image without shutter operation An automatic imaging step.

In the present invention, a manual imaging operation for storing a captured image at a timing corresponding to a shutter operation and an automatic imaging operation for automatically storing a captured image without using a shutter operation are selectively performed. When it is possible to execute the setting, the setting relating to the operation of the imaging unit is switched according to the manual imaging and the automatic imaging. The setting relating to the operation of the imaging means (setting relating to the imaging operation) is, for example, the setting of the operation of the imaging optical system in the imaging means (for example, the operation relating to the focus and the diaphragm), the setting of the operation of the imaging element unit (for example, the shutter speed), For example, setting of a signal processing operation (for example, gain (sensitivity) processing or correction processing such as blur correction) for an image pickup signal obtained by the image pickup device section.
Although the imaging situation differs between automatic imaging and manual imaging, appropriate captured image data can be obtained in accordance with the imaging situation by switching the setting relating to the operation of the imaging means according to automatic imaging and manual imaging.

  According to the present invention, since the setting relating to the operation of the imaging unit is switched between the automatic imaging operation and the manual imaging operation, appropriate captured image data is obtained according to different imaging conditions between automatic imaging and manual imaging. This makes it possible to capture and store appropriate image data in each case.

Embodiments of the present invention will be described below. The description will be given in the following order.
[1. Appearance example of imaging device]
[2. Configuration example of imaging apparatus]
[3. Example of settings related to imaging operation]
[4. Processing Example I]
[5. Treatment example II]
[6. Treatment Example III]
[7. Effects and modifications of the embodiment]

[1. Appearance example of imaging device]

Although various forms are assumed as the imaging device 1 of the embodiment, examples of their appearance are illustrated in FIGS. 1 (a), (b), (c), and (d).
FIG. 1A shows an imaging apparatus 1 that is a glasses-type display camera. For example, the imaging apparatus 1 has a mounting unit having a frame structure that makes a half turn from both sides of the head to the back of the head, and is mounted on the user by being placed on both ear shells as illustrated.
In the imaging apparatus 1, the imaging lens 3 a is arranged facing forward so that imaging is performed with the user's visual field direction as the subject direction when the user is wearing the imaging apparatus 1.
Further, in the wearing state as shown in the figure, a pair of display panels 2a and 2a for the left eye and the right eye are arranged immediately in front of both eyes of the user, that is, at a position where a lens in normal glasses is located. Has been. For example, a liquid crystal panel is used for the display panel unit 2a. By controlling the transmittance, a through state as shown in the figure, that is, a transparent or translucent state can be obtained. Since the display panel unit 2a is in the through state, even if the user always wears it like glasses, there is no problem in normal life.
In addition to a pair of display panel units 2a corresponding to both eyes, a configuration in which one display panel unit 2a is provided corresponding to one eye is also conceivable.

  FIG. 1B shows the image pickup apparatus 1 that the user similarly wears on the head, but does not include the display panel unit 2a as shown in FIG. For example, it is mounted on the user's head by a mounting unit that is hung on the ear shell. In this state, the imaging lens 3a is arranged facing forward so that the user's field of view is taken as the subject direction.

In FIGS. 1 (a) and 1 (b), the imaging device 1 mounted on the user's head by the spectacle-type or head-mounted mounting unit has been described. However, the structure for the user to mount the imaging device 1 is as follows. Think variously. For example, a headphone type, a neckband type, an ear hook type, or any other mounting unit may be worn by the user. Further, for example, a configuration may be adopted in which the user wears the device by attaching the clip to a normal pair of glasses, a visor, headphones, or the like.
Furthermore, the imaging device 1 which is located on the user's head by being mounted on a helmet, a hat, or the like is also conceivable.
Moreover, it does not necessarily have to be worn on the user's head. For example, the imaging device 1 that is worn on clothes or put in a breast pocket, the imaging device 1 that is worn on the user's arm by an arm band, the imaging device 1 that is worn on the user's shoulder, or a wrist-type wrist of the user The imaging device 1 attached to the user may be a ring type imaging device 1 attached to a user's finger.

In the example of FIGS. 1A and 1B, the imaging direction is the user's field of view, but the imaging lens 3a is attached so as to capture the user's rear, side, upper, and foot directions when worn. A configuration in which a plurality of imaging systems having the same or different imaging directions are provided are also conceivable.
Furthermore, an imaging direction variable mechanism that can change the subject direction manually or automatically may be provided for one or a plurality of imaging lenses 3a.

FIG. 1C shows an imaging apparatus 1 having a form generally known as a digital still camera.
FIG. 1D shows an imaging apparatus 1 having a form generally known as a video camera.
As shown in FIGS. 1C and 1D, the imaging apparatus 1 that the user has and uses is also an aspect of the embodiment of the present invention. Although only the imaging lens 3a is shown in the figure, a display device such as a panel display unit for an imaging monitor and a viewfinder is also provided.

  In the following description, the imaging device 1 worn by the user (not held by hand) in the form shown in FIGS. 1A and 1B or as described above is referred to as a “wearable type”, and FIG. As shown in (d), the imaging apparatus 1 that the user uses in his / her hand is referred to as a “hand-held type”.

Further, it goes without saying that forms other than those shown in FIGS. 1A, 1B, 1C, and 1D can be considered as the imaging apparatus 1 that performs still image capturing and moving image capturing. For example, a device such as a mobile phone, a PDA (Personal Digital Assistant), or a portable personal computer that has a function as an image pickup device can be assumed as the image pickup device 1 of the present embodiment.
In these various forms, for example, a microphone that collects external sound may be provided, and an audio signal to be recorded together with image data may be obtained at the time of imaging. Further, a speaker unit and an earphone unit that perform audio output may be formed.
It is also conceivable that a light emitting unit that performs illumination in the direction of the subject is provided in the vicinity of the imaging lens 3a using, for example, an LED (Light Emitting Diode) or a flash light emitting unit for capturing a still image.

By the way, as the imaging device 1 of this Embodiment, both manual imaging and automatic imaging can be performed as imaging operation.
Here, “manual imaging” refers to an operation in which imaging (recording of captured image data) is performed by a user's shutter operation.
On the other hand, “automatic imaging” refers to an operation in which imaging (recording of captured image data) is performed without being based on a user's shutter operation. For example, when the user wears the imaging device 1 shown in FIGS. 1A and 1B, a still image is taken at an operation of capturing a moving image at all times, for example, at intervals of 1 second, several seconds, or several tens of seconds. The operation of performing is assumed as automatic imaging. For example, it is an operation of capturing a trajectory of a user's daily life as a life camera. In addition, an operation in which imaging is performed by some kind of trigger other than a user operation is assumed as automatic imaging, instead of periodic imaging. For example, automatic imaging is performed by detecting an emotion such as a user's tension or startle, and automatically capturing an image, or performing an image by a trigger (trigger other than user shutter operation information) supplied from an external device. .

[2. Configuration example of imaging apparatus]

A configuration example of the imaging apparatus 1 will be described with reference to FIG.
The system controller 10 includes, for example, a microcomputer including a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), a nonvolatile memory unit, and an interface unit, and controls the entire imaging device 1. The control unit The system controller 10 performs various arithmetic processes and exchanges control signals with each unit via the bus 13 based on a program held in an internal ROM or the like, and causes each unit to execute a required operation.

The imaging unit 3 includes an imaging optical system, an imaging element unit, and an imaging signal processing unit.
In the imaging optical system in the imaging unit 3, the imaging system 3a shown in FIG. 1, a lens system including an aperture, a zoom lens, a focus lens, and the like, and a focusing operation and a zooming operation are performed on the lens system. Drive system and the like.
In addition, the imaging device section in the imaging section 3 is provided with a solid-state imaging device array that detects imaging light obtained by the imaging optical system and generates an imaging signal by performing photoelectric conversion. The solid-state imaging device array is, for example, a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array.
The imaging signal processing unit in the imaging unit 3 includes a sample hold / AGC (Automatic Gain Control) circuit that performs gain adjustment and waveform shaping on a signal obtained by the solid-state imaging device, a gain amplifier for sensitivity adjustment, and a video A / D. A converter is provided to obtain captured image data as digital data. Also, white balance processing, luminance processing, color signal processing, blur correction processing / vibration correction processing, and the like are performed on the captured image data.

Imaging is performed by the imaging unit 3 having the imaging optical system, the imaging element unit, and the imaging signal processing unit, and captured image data is obtained.
Image data obtained by the imaging operation of the imaging unit 3 is processed by the imaging control unit 6.
The imaging control unit 6 converts the captured image data into a predetermined image data format under the control of the system controller 10, and converts the converted captured image data into a storage unit 14, a communication unit 15, and display control according to the operation status. Processing to be supplied to the unit 7 is performed.
The imaging control unit 6 also controls on / off of the imaging operation in the imaging unit 3 based on an instruction from the system controller 10, zoom lens of the imaging optical system, drive control of the focus lens, control of the aperture amount of the aperture mechanism, imaging device Shutter speed (exposure time) and frame rate control, gain control (sensitivity control) in the imaging signal processing unit, blur correction and vibration correction on / off or correction amount control, parameter control and execution of each process Set processing.

The imaging device 1 can perform automatic imaging and manual imaging. In the case of automatic imaging, in accordance with an instruction from the system controller 10, the imaging control unit 6 performs processing for periodically storing captured image data obtained by the imaging unit 3 in the storage unit 14. For example, the imaging control unit 6 transfers the captured image data to the storage unit 14 in response to a periodic shutter processing instruction from the system controller 10.
On the other hand, in the case of manual imaging, the system controller 10 instructs the imaging control unit 6 to perform shutter processing in response to a user's shutter operation by an operation input unit 11 described later. In response to this, the imaging control unit 6 performs processing for storing the captured image data obtained by the imaging unit 3 in the storage unit 14.

A display unit 2 and a display control unit 7 are provided as a configuration for displaying to the user in the imaging apparatus 1.
The display unit 2 is provided with a display panel unit 2a using the above-described liquid crystal panel and the like, and a display driving unit that drives the display panel unit 2a.
The display drive unit includes a pixel drive circuit for displaying the image data supplied from the imaging control unit 6 on the display panel unit 2a that is a liquid crystal display, for example. The pixel driving circuit applies a driving signal based on the video signal to each pixel arranged in a matrix in the display panel unit 2a at a predetermined horizontal / vertical driving timing, thereby causing display to be performed.

The display control unit 7 drives the pixel driving circuit in the display unit 2 based on the control of the system controller 10, and causes the display panel unit 2a to execute a predetermined display.
That is, the display panel unit displays a display as an imaging monitor in the imaging unit 3, a reproduction display of captured image data captured in the storage unit 14, a display of data received by the communication unit 15, a display of various characters, and the like. Run in 2a.
For these displays, for example, brightness level adjustment, color correction, contrast adjustment, sharpness (outline emphasis) adjustment, and the like can be performed. Also, generation of an enlarged image obtained by enlarging a part of the image data, generation of a reduced image, soft focus, mosaic, luminance inversion, highlight display (highlight display) of a part of the image, change in atmosphere of the whole color, etc. Image effect processing, separation and synthesis of images for divided display of captured images, generation of character images and image images, processing of combining the generated images with captured images, and the like can also be performed.
Further, the display control unit 7 controls the display driving unit based on an instruction from the system controller 10 and controls the transmittance of each pixel of the display panel unit 2a so as to be in a through state (transparent or translucent state). You can also.

The storage unit 14 is used for storing various data. For example, it is used for storing captured image data.
The storage unit 14 may be configured by a solid-state memory such as a RAM or a flash memory, or may be configured by an HDD (Hard Disk Drive), for example.
Further, instead of a built-in recording medium, a portable recording medium, for example, a recording / reproducing drive corresponding to a recording medium such as a memory card incorporating a solid-state memory, an optical disk, a magneto-optical disk, or a hologram memory may be used.
Of course, both a built-in type memory such as a solid-state memory and an HDD, and a recording / reproducing drive for a portable recording medium may be mounted.
The storage unit 14 records and stores captured image data based on the control of the system controller 10.
Further, based on the control of the system controller 10, the recorded data is read and supplied to the system controller 10, the display control unit 7, and the like.

The communication unit 15 transmits / receives data to / from an external device. The communication unit 15 may be configured to perform network communication via a short-range wireless communication with a network access point using a method such as a wireless LAN or Bluetooth, or between external devices having a corresponding communication function. It may be one that performs direct wireless communication.
The network communication may be communication of various networks such as the Internet, a mobile phone communication network, a PHS communication network, an ad hoc network, and a LAN.
Further, it is not necessarily wireless communication, and communication with an external device may be performed through a wired connection with the external device.
Note that the captured image data is stored in the storage unit 14 inside the imaging apparatus 1 as well as the captured image data is transmitted from the communication unit 15 to the external device and stored in the storage unit of the external device. Is also possible. In that sense, transmission processing of captured image data by the communication unit 15 is also considered as one form of storage processing. The external device that receives and stores the captured image data transmitted by the transmission unit 15 includes a data server having a communication function, a personal computer, a video player, a video camera, a digital still camera, a mobile phone having an imaging function, and a PDA. Various devices can be assumed.

In the imaging apparatus 1, an operation input unit 11 is provided for user operation.
For example, the operation input unit 11 may include a controller such as a key and a dial to detect a user operation as a key operation or the like, or may detect a user's conscious behavior. .
When providing an operation element, for example, power on / off operation, imaging system operation (for example, shutter operation, zoom, focus, aperture adjustment operation, signal processing instruction operation), display related operation (for example, selection of display contents) Or a display adjustment operation) or the like.

Further, a touch pad or a touch panel may be provided as an operator. For example, a touch panel is provided in the display unit 2, and an operation input is performed when the user touches the display screen.
Further, the touch panel, the cross key, the jog dial, or the like may be provided as an operator for moving a pointer such as a cursor on the screen. Alternatively, a remote controller incorporating an acceleration sensor, an angular velocity sensor, or the like may be operable such that the user moves the cursor on the screen by moving the remote controller in his / her hand.
For example, when an imaging apparatus as shown in FIGS. 1C and 1D is considered, it is preferable to perform various operations using operation keys, a dial, a touch panel, and the like.

  On the other hand, in the case of an imaging device worn on the head as shown in FIGS. 1A and 1B, an operation key, a dial, a touch panel, or the like may be provided. Considering that it is difficult to arrange the control elements, it is also preferable to adopt a configuration in which the behavior of the user is detected and regarded as an operation input.

In the case of a configuration for detecting user behavior, it is conceivable to provide an acceleration sensor, an angular velocity sensor, a vibration sensor, a pressure sensor, and the like.
For example, when the user taps the imaging device 1 from the side, the acceleration is detected by an acceleration sensor, a vibration sensor, or the like. For example, when the lateral acceleration exceeds a certain value, the system controller 10 recognizes the user operation. To be able to. Also, if it is possible to detect whether the user has struck the side part (the part corresponding to the eyeglass vine) from the right side or the side part from the left side by using an acceleration sensor or an angular velocity sensor, these can be used as predetermined operations. It can also be determined.
Further, it is possible to detect that the user turns his head or shakes his / her head with an acceleration sensor or an angular velocity sensor, and the system controller 10 can recognize this as a user operation.
Further, pressure sensors are arranged on the left and right side portions (portion corresponding to the eyeglasses) of the imaging apparatus 1, and when the user presses the right side with a finger, the zoom operation in the telephoto direction is performed. When pressed with, zoom operation in the wide-angle direction can be performed.

Furthermore, a configuration as a biosensor may be provided so that user biometric information is detected and recognized as an operation input. Biometric information includes pulse rate, pulse wave, heart rate, electrocardiogram information, myoelectricity, respiratory information (for example, respiratory rate, depth, ventilation volume, etc.), sweating, GSR (skin electrical response), blood pressure, blood Examples are oxygen saturation concentration, skin surface temperature, brain waves (for example, information on α wave, β wave, θ wave, and δ wave), blood flow change, and eye condition.
The system controller 10 recognizes the detection information of the biosensor as a user operation input. For example, the user's conscious behavior may be an eye movement (change in line-of-sight direction or blinking), but if it is detected that the user has blinked three times, it is determined as a specific operation input. Furthermore, it is possible to detect that the user has attached or removed the imaging device 1 or that a specific user has attached by detecting the biological information, and the system controller 10 can turn on / off the power in response to the detection. You may make it perform off.
The biological sensor may be arranged inside the wearing frame of the eyeglass-type imaging device 1, for example, so as to be able to detect the various information by contacting the user's temporal region or the back of the head. It may be attached to a predetermined part of the body as a separate body from the one mounting frame portion.
In order to detect the state of the eye, the state of movement, the pupil, and the like, it is conceivable to use a camera that images the user's eyes.

The operation input unit 11 supplies information obtained as an operation element, an acceleration sensor, an angular velocity sensor, a vibration sensor, a pressure sensor, a biological sensor, and the like to the system controller 10, and the system controller 10 uses the information to operate the user. Is detected.
In addition, as a structure for detecting a user's behavior, other sensors, such as a sensor which detects a user's voice and a sensor which detects the motion of a lip, may be provided.
In the imaging apparatus 1 of the present example, as operations such as a shutter operation and setting operation in manual imaging, and a mode switching operation between manual imaging and automatic imaging, operations using the above-described operators, operations using a touch panel, operations based on user behavior, and the like are assigned. be able to.

The configuration of the imaging device 1 has been described above, but this is only an example. Addition and deletion of various components are naturally conceivable depending on the actual operation example and function.

[3. Example of settings related to imaging operation]

As described above, the imaging apparatus 1 of the present example can execute by switching between automatic imaging and manual imaging. In this example, in consideration of the difference in imaging state between manual imaging and automatic imaging, various settings related to the imaging operation are changed between when manual imaging is performed and when automatic imaging is performed. 3A and 3B illustrate setting items whose settings are changed.

FIG. 3A shows a setting example related to the imaging operation for the wearable type imaging apparatus 1 as shown in FIGS. 1A and 1B, for example.
In the case of a wearable type that the user wears on the body, the correction processing for the body shake at the time of imaging and the shake correction such as compensation according to the movement of the body, for example, the movement of the walking state or the running state are switched. One.
In automatic imaging, still image imaging is performed when the user is not aware of the shutter timing. Alternatively, moving image capturing is continuously performed. In this case, since the user performs normal living behavior without being aware of imaging, the body shakes greatly, and the image captured by the imaging device 1 is a large image. Considering this, it is appropriate to perform blur correction and motion compensation due to body shaking in the signal processing system of the imaging unit 3. On the other hand, in manual imaging, the user performs a shutter operation with the shutter timing in mind. For this reason, in most cases, the user is stationary. Therefore, there is not much blurring in the captured image.
Therefore, the blur correction process is turned on in the automatic imaging mode, and the blur correction process is turned off in the manual imaging mode. Note that the correction amount may be reduced without turning the blur correction off in the manual imaging mode.

The focus control is pan focus in the automatic imaging mode and auto focus or manual focus in the manual imaging mode.
In the automatic imaging mode, since the user does not specify a subject, focus-free pan-focusing that focuses from a short distance to a long distance using the subject depth of the lens is appropriate. On the other hand, since the image quality is better when the distance to the subject is correctly adjusted, it is appropriate to use autofocus in the manual imaging mode in which the user is aware of the subject. Of course, in the manual imaging mode, the user may perform the focus adjustment manually, so that the focus adjustment can be executed according to the user's operation as the manual focus.

The shutter speed is high in the automatic imaging mode and standard in the manual imaging mode.
As in the case of body shaking described above, considering that the user is normally acting in the automatic imaging mode, it is preferable to set the shutter speed to be high so as to capture an image without blur as much as possible. is there. On the other hand, in the manual imaging mode, it is appropriate to set the standard speed and perform normal imaging. Of course, as a manual change, it is preferable that the shutter speed can be variably set according to the user's operation.

The sensitivity (gain given to the imaging signal) is set to high sensitivity in the automatic imaging mode and is set to standard sensitivity in the manual imaging mode.
As described above, in the automatic imaging mode, it is possible to capture an image with an appropriate luminance level by increasing the sensitivity in accordance with increasing the shutter speed. On the other hand, in the manual imaging mode, the standard sensitivity may be set in accordance with the standard shutter speed. Of course, as a manual change, it is preferable that the sensitivity can be variably set according to the user's operation.

FIG. 3B shows a setting example in the hand-held type imaging apparatus 1.
Automatic imaging in the handheld imaging device 1 is executed with the imaging device 1 placed, for example. For example, when the user places the imaging apparatus 1 in his / her room and executes periodic still image imaging or continuous moving image imaging as automatic imaging, the user can use the camera as a monitoring camera in his / her room.
On the other hand, in manual imaging, the user holds the imaging device 1 in his hand and performs a shutter operation toward the subject.
Assuming such automatic imaging and manual imaging, the following setting changes are assumed.

First, camera shake correction is turned off in the automatic imaging mode and turned on in the manual imaging mode.
In the automatic image capturing mode, if image capturing is performed in a state where the image capturing apparatus 1 is placed at a certain place as described above, blurring does not occur, and camera shake correction may be off. On the other hand, in the manual imaging mode in which imaging is performed with a hand, it is preferable that the camera shake correction function normally.

The focus control is fixed focus in the automatic imaging mode, and autofocus or manual focus in the manual imaging mode.
When imaging is performed in a certain place, the focal length can be considered to be almost fixed. For example, when a desired focus state is first obtained by autofocus control (or user manual focus adjustment), The focus state should be fixed. On the other hand, in manual imaging mode, it is normally used as autofocus or manual focus.

Regarding the exposure control, the automatic imaging mode is fixed, and the manual imaging mode is auto (automatic exposure) or manual (manual exposure).
The exposure control is executed by adjusting the aperture opening amount, shutter speed, and sensitivity (gain).
When automatic imaging is performed with a fixed arrangement at a certain location, there is no significant change in the amount of external light in a short period of time, so fixed exposure control may be performed. In other words, it is not necessary to constantly monitor the brightness level of the captured image and perform exposure correction. However, since there may be a change in the time zone between morning and night and a situation in which the light is turned on and off in the room, periodic exposure correction may be performed after a certain amount of time.
On the other hand, in manual imaging, it is preferable to perform automatic exposure correction or perform exposure adjustment according to a user's manual operation.

3A and 3B exemplify setting items for switching settings between the automatic imaging mode and the manual imaging mode in the wearable type and the handheld type imaging apparatus 1, but of course other setting items are also available. Is conceivable.
In addition, for each setting item, the user may be able to select in advance or set numerical values the setting values (on / off and setting parameters) of the automatic imaging mode and the manual imaging mode.

[4. Processing Example I]

As a setting item as described above, a processing example (processing example I) of the system controller 10 for performing automatic imaging and manual imaging while changing settings related to imaging and signing will be described with reference to FIG.
FIG. 4 shows processing related to switching between automatic imaging and manual imaging from when the imaging apparatus 1 is turned on until the power is turned off.

When a power-on trigger occurs as a user operation or other trigger, the system controller 10 performs power-on control as step F101 and executes various initial operations. Also, it is confirmed whether the automatic imaging mode or the manual imaging mode is set as the initial mode.
The initial mode may be fixedly determined as either the automatic imaging mode or the manual imaging mode, or the mode when the power is turned off last time may be selected. Further, the initial mode may be determined to any one by the user's selection setting.

When the automatic imaging mode is selected as the initial mode, the system controller 10 advances the process from step F102 to F103. When the manual imaging mode is selected as the initial mode, the system controller 10 advances the process from step F102 to F108.
First, a case where the automatic imaging mode is set will be described.
In step F103, the system controller 10 performs settings related to the imaging operation as a setting process for automatic imaging. That is, in the case of the wearable type imaging apparatus 1, the imaging control unit 6 is instructed to set the setting items described in FIG. 3A according to the automatic imaging mode, and in the case of the handheld type imaging apparatus 1, FIG. The setting control unit 6 is instructed to set the setting items described in (b) according to the automatic imaging mode.

In step F104, the system controller 10 starts automatic imaging. In other words, for example, the system controller 10 periodically issues a shutter instruction to the imaging control unit 6 to periodically supply the captured image data to the storage unit 14, and the storage unit 14 stores the captured image data. Execute the process.
Alternatively, the system controller 10 may instruct the imaging control unit 6 to start moving image capturing and the storage unit 14 to start recording captured image data as a moving image at the time of step F104.

  In this automatic imaging, for example, in the case of the wearable type imaging apparatus 1, the settings in step F <b> 103 are settings such as shake correction on, pan focus, high-speed shutter speed, and high-sensitivity imaging in consideration of body shake in the imaging unit 3. Imaging is performed. In the case of the hand-held type imaging apparatus 1, the imaging unit 3 performs imaging with settings of camera shake correction off, fixed focus, and fixed exposure control.

After step F104, automatic imaging continues as regular still image recording or moving image recording. During execution of the automatic imaging, the system controller 10 monitors the mode switching operation by the user in step F105 and operates in step F106. Monitor termination trigger occurrence.
If a power-off trigger occurs as a user operation or other trigger during this automatic imaging operation, the system controller 10 recognizes that the operation has ended in step F106, ends the automatic imaging operation in step F115, and ends the operation in step F116. Various processes and power-off control are performed.
If a user mode switching operation is detected during the automatic imaging operation, the system controller 10 ends the automatic imaging operation in step F107 and proceeds to step F108.

As described above, when the initial mode is set to the manual imaging mode in step F102, and when the mode is switched to the manual imaging mode by the mode switching operation in step F105 during the automatic imaging operation, the system controller 10 performs step Proceed to F108.
In step F108, the system controller 10 performs settings related to the imaging operation as a setting process for manual imaging. That is, in the case of the wearable type imaging apparatus 1, the imaging control unit 6 is instructed to set the setting items described in FIG. 3A according to the manual imaging mode, and in the case of the handheld type imaging apparatus 1, FIG. The setting control unit 6 is instructed to set the setting items described in (b) according to the manual imaging mode.

The system controller 10 monitors user operations and other triggers in steps F109, F110, F111, and F112.
When the user performs a shutter operation, the system controller 10 advances the process from step F109 to F113, issues a shutter instruction to the imaging control unit 6, supplies the captured image data to the storage unit 14, and the storage unit 14 Storage processing of captured image data is executed. That is, still image capturing is executed in accordance with the user's shutter operation.
In this case, for example, in the case of the wearable type imaging apparatus 1, the imaging unit 3 performs imaging with settings of blur correction off, autofocus, standard shutter speed, and standard sensitivity imaging by the setting in step F108. In the case of the hand-held type imaging apparatus 1, the imaging unit 3 performs imaging with settings of camera shake correction on, auto focus, and automatic exposure control.

In the manual imaging mode, the user may perform various setting operations in addition to the shutter operation. For example, a manual focus operation, an exposure amount setting operation, a shutter speed setting operation, a sensitivity changing operation, and the like. When detecting these setting operations, the system controller 10 advances the processing from step F110 to F114, and instructs the imaging control unit 6 to perform settings corresponding to the operations.
In this way, when the shutter operation is performed after the user performs the setting operation, the processing of the system controller 10 proceeds from step F109 to F113. At that time, imaging according to the user's manual setting is performed.

In the manual imaging mode, when a power-off trigger is generated as a user operation or other trigger, the system controller 10 recognizes that the operation has ended in step F112, proceeds to step F116, and performs various processes and power-off control when the operation ends. I do.
Further, when the system controller 10 detects the user's mode switching operation in step F111 in the manual imaging mode, the process proceeds to step F103, performs setting processing for automatic imaging operation, and starts the automatic imaging operation in step F104. .

With the processing of FIG. 4 described above, the user can select automatic imaging and manual imaging by the mode switching operation, and settings relating to the imaging operation are automatically switched depending on whether automatic imaging or manual imaging.

[5. Treatment example II]

In the processing example I in FIG. 4 described above, the automatic imaging mode and the manual imaging mode are switched by the user's mode switching operation. However, as the processing example II, the automatic imaging is usually performed and the manual operation is performed only when the user performs the shutter operation. An example in which the imaging operation is performed is shown in FIG.

When the power-on trigger occurs, the system controller 10 performs power-on and initial processing as step F201 in FIG.
In step F202, the system controller 10 instructs the imaging control unit 6 to perform automatic imaging settings as settings related to the imaging operation (similar to step F103 in FIG. 4).
In step F203, the automatic imaging operation by the imaging control unit 6 and the storage unit 14 is started.

After step F203, automatic imaging continues as regular still image recording or moving image recording. During execution of the automatic imaging, the system controller 10 monitors the shutter operation by the user in step F204, and the operation ends in step F205. Monitor the occurrence of a trigger.
If a power-off trigger occurs as a user operation or other trigger during this automatic imaging operation, the system controller 10 recognizes that the operation has ended in step F205, ends the automatic imaging operation in step F207, and ends the operation in step F208. Various processes and power-off control are performed.

On the other hand, when it is detected that the user has performed the shutter operation during the automatic image capturing operation, the system controller 10 proceeds from step F204 to F206, and instructs switching to the manual image capturing setting and the image capturing operation.
For example, at the moment of the shutter operation, the setting items such as the shutter speed and sensitivity (gain) are changed to the setting for manual imaging to the imaging control unit 6, and still image imaging is instructed with the setting changed. In addition, the storage unit 14 is caused to save captured image data captured at the shutter operation timing.
When this manual imaging operation is finished, automatic imaging is started (resumed) in step F203 after instructing the setting for automatic imaging in step F202.

That is, in the processing example II of FIG. 5, manual imaging is performed only when the user performs a shutter operation during operation in the automatic imaging mode, and settings relating to the imaging operation are switched. The captured image data at the shutter operation timing is stored as still image data by manual imaging. The setting items to be changed may be items that can be handled instantaneously, such as sensitivity (gain) and shutter speed.
However, it is also possible to switch setting items that are difficult to respond instantaneously, such as focus control. For example, by adopting an operation method in which the auto focus functions when the shutter button is lightly pressed and the shutter operation is performed when the shutter button is strongly pressed, the auto focus function is enabled at the shutter operation point. It is also possible.

[6. Treatment Example III]

Treatment example III is shown in FIG. 6, which is a synthesis of treatment examples I and II.
Steps F101 to F116 in FIG. 6 are the same as steps F101 to F116 in FIG. In FIG. 6, during the automatic imaging operation, the system controller 10 monitors the mode switching operation in step F105 and the end trigger in step F106, and in addition, the shutter operation is monitored in step F204. ing.
When the shutter operation is detected in the automatic image capturing mode, the process proceeds from step F204 to F206, the setting relating to the image capturing operation is switched as manual image capturing, and the captured image data at the shutter operation timing is stored as still image data by manual image capturing. For example, setting of sensitivity (gain), shutter speed, etc. is changed, and manual imaging is executed. In steps F103 and F104, the automatic imaging operation is resumed.

In other words, in this example, automatic imaging and manual imaging are selectively executed by the user's mode switching operation, and when the shutter operation is performed during the automatic imaging operation, imaging is performed in the manual imaging mode at that moment. It is a thing.

[7. Effects and modifications of the embodiment]

According to the above embodiment, since the setting relating to the operation of the image capturing unit 6 is switched between the automatic image capturing operation and the manual image capturing operation, appropriate image capturing is performed according to the image capturing state different between automatic image capturing and manual image capturing. Image data can be obtained, which makes it possible to capture and store appropriate image data in each case.
For example, in the case of the wearable imaging device 1, the shake correction, focus control, shutter speed, and sensitivity are switched as shown in FIG. 3A, and in the case of the handheld imaging device 1, camera shake correction, focus control, By switching the exposure control as shown in FIG. 3B, it is possible to perform imaging in accordance with each situation of automatic imaging and manual imaging.

In addition, since the user does not need to consciously operate these setting switches, usability is also good.
According to the above processing example I, the user can selectively use the automatic imaging mode and the manual imaging mode by the mode switching operation, and particularly, it is possible to capture a suitable image without requiring a setting change operation for each mode.
According to the above processing examples II and III, manual imaging can also be performed by performing a shutter operation during the automatic imaging mode. For example, it is possible to realize processing that can handle instantaneous photo opportunities while periodically storing captured image data by automatic imaging. Of course, in this case as well, an appropriate setting change is automatically made according to the shutter operation, and thus a suitable captured image can be obtained in response to a sudden photo opportunity.

The present invention is not limited to the above-described embodiment, and various modifications can be considered as configuration examples and processing examples of the imaging apparatus 1.
Various items other than the items listed in FIG. 3 are conceivable as setting items related to the imaging operation to be switched between the automatic imaging mode and the manual imaging mode. For example, it may be set as an item for changing the setting of presence / absence of an optical filter of an optical system, parameters for luminance processing or color processing for a captured image signal, and the like.

As an operation in the automatic imaging mode, various kinds of operations can be considered as performing imaging by a predetermined trigger (trigger other than shutter operation) in addition to periodic still image imaging and continuous moving image imaging.
For example, when a biological sensor is provided, it is conceivable to issue a shutter instruction using a change in pulse, brain wave, blood pressure, heart rate, or the like as a trigger. Changes in the user's physical condition are affected by some ambient changes. For example, because there are changes in the physical condition due to meeting a favorite person, witnessing an accident, etc., these are often valuable timings as shutter timings for automatic imaging.
Similarly, the user's psychological state may be estimated to give a shutter instruction. For example, the user's emotion (fun, funny, glad, sad, terrifying, calm, nostalgic, emotion, startle, excitement, tension, etc.) Can be estimated. Furthermore, the user's psychological state can also be determined by the state of the pupil and the movement of the line of sight by the visual sensor. It is also suitable to generate an automatic imaging trigger according to these determination results.

It is also conceivable to provide an image analysis unit for analyzing the captured image data, and to store an automatically captured image based on the image analysis result.
That is, the image (monitor image) captured by the imaging unit 3 is always supplied to the image analysis unit. For example, when a person is recognized in the captured image by image analysis, a specific object is recognized, or a specific person is recognized, the image data is transferred to the storage unit 14 and stored. is there.
In addition, automatic imaging may be conceived in which a microphone is provided to collect external sound and the occurrence of a large volume is detected as the shutter timing.

In the embodiment, the wearable type imaging device 1 and the handheld type imaging device 1 that the user wears on the body are shown. However, the imaging device 1 that is worn on the moving body is also considered as the imaging device of the present invention. It is done. For example, an imaging device mounted on a vehicle such as an automobile, a motorcycle, a bicycle, and a railway, a ship, an aircraft, and the like.
In the case of the imaging apparatus 1 mounted on these moving bodies, it is naturally conceivable to change the setting according to the situation between the automatic imaging mode and the manual imaging mode.

It is explanatory drawing of the example of an external appearance of the imaging device of embodiment of this invention. It is a block diagram of the imaging device of an embodiment. It is explanatory drawing of the item of the setting change of embodiment. It is a flowchart of process example I of an embodiment. It is a flowchart of process example II of an embodiment. It is a flowchart of process example III of an embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Imaging device, 2 Display part, 2a Display panel part, 3 Imaging part, 6 Imaging control part, 7 Display control part, 10 System controller, 11 Operation input part, 14 Storage part, 15 Communication part

Claims (11)

Imaging means for performing imaging and acquiring captured image data of a subject;
Storage processing means for performing storage processing of captured image data obtained by the imaging means;
A manual imaging operation for storing a captured image at a timing according to a shutter operation and an automatic imaging operation for automatically storing a captured image without using a shutter operation are selectively performed with the imaging unit and the storage. Control means for performing control for switching settings relating to the operation of the imaging means when the manual imaging operation is executed and when the automatic imaging operation is executed.
An imaging apparatus comprising:   The imaging apparatus according to claim 1, wherein the imaging unit is configured using a CCD sensor or a CMOS sensor as an imaging element.   The control means executes, as the automatic image capturing operation, periodic captured image data storage processing, captured image data storage processing in response to generation of a trigger other than a shutter operation, or captured image data storage processing as a moving image. The imaging apparatus according to claim 1, wherein the imaging apparatus is controlled so as to perform the control.   The imaging apparatus according to claim 1, wherein the imaging apparatus is used by being mounted on a user's body or a moving body.   The imaging apparatus according to claim 1, wherein the imaging apparatus is used by a user.   The imaging apparatus according to claim 1, wherein the control unit switches between the manual imaging operation and the automatic imaging operation in accordance with a mode switching operation.   The imaging apparatus according to claim 1, wherein the control unit causes the manual imaging operation to be executed in response to detecting a shutter operation when the automatic imaging operation is being executed.   The imaging apparatus according to claim 1, wherein the control unit performs switching of a setting for body shake correction, a setting for body motion correction, or a setting for camera shake correction as a setting relating to the operation of the imaging unit.   The imaging apparatus according to claim 1, wherein the control unit performs switching of a focus setting as a setting relating to the operation of the imaging unit.   2. The imaging apparatus according to claim 1, wherein the control unit performs switching of shutter speed setting, sensitivity setting, or aperture setting as the setting relating to the operation of the imaging unit. As an imaging method of an imaging apparatus that performs imaging to acquire captured image data of a subject and performs storage processing of the captured image data,
A manual imaging step for setting a manual imaging operation as a setting related to the imaging operation and performing a storage process of the captured image at a timing according to the shutter operation;
An automatic imaging step for performing a setting for automatic imaging operation as a setting relating to the imaging operation, and automatically saving a captured image without depending on a shutter operation;
An imaging method comprising:

Images