JP2018033056A - Imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device that obtains information from a wearable apparatus at necessary timing, makes use of the information, and thereby can implement high-speed and accurate AE and AF control according to the intention of a user.SOLUTION: An imaging device executes: a timing determination process operable to determine whether it is prescribed timing in camera operation; an information acquisition process operable to communicate with a wearable terminal; a subject information selection process operable to select information on a main subject on the basis of information obtained from the wearable terminal by the information acquisition process; an AF control information setting process operable to reflect information in AF control on the basis of information obtained by the subject information select process; and an AE control information setting process operable to reflect information in AE control on the basis of the information obtained by the subject information select process.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an imaging apparatus, and more particularly, to an imaging apparatus capable of performing AE / AF control in accordance with a user's intention at high speed and accurately in cooperation with a wearable device.

  Conventionally, the camera is linked not only to the camera itself, but also to other devices including other cameras, and by effectively utilizing the information obtained from them, it is possible to control shooting more quickly or accurately. Has been devised.

  For example, in Patent Literature 1, at least one of a plurality of imaging devices that can communicate with each other captures distance information up to a focal point or a captured image that includes a focal point. An invention is disclosed in which each imaging device determines each depth of field using distance information to the in-focus point or a captured image including the in-focus point. Has been.

JP 2014-44540 A

  However, in the prior art disclosed in the above-mentioned patent document, since a plurality of imaging devices that can communicate with each other are based on the premise that they are imaging systems that capture the same subject, the timing may be a little. The information from other imaging devices can only be determined by determining only the depth of field for shooting the same subject when it is easily imagined that the result may be unintended by the user if it goes crazy. Since it is not used effectively, considering the cooperation with wearable devices that are expected to become more popular in the future, the benefits of preparing multiple imaging devices are very thin. It can be felt.

In order to achieve the above object, the present invention provides:
Timing determination means capable of determining whether or not a predetermined timing in camera operation),
A communication means capable of communicating with the wearable terminal;
Based on the information obtained from the wearable terminal by the communication means,
Subject information selection means capable of selecting information on the main subject,
Based on the information obtained by the subject information selection means,
AF control information setting means that can be reflected in AF control Based on the information obtained by the subject information selection means,
An imaging apparatus including an AE control information setting unit that can be reflected in AE control is provided.

In the above, the predetermined timing is:
When the camera is held, an AE start button On, a LiveView start button On, and a moving image recording start button On are provided.

In the above, the information on the main subject is
There is provided an imaging apparatus as described above, characterized by distance information, subject position (range), subject recognition result, Bv value, subject position (range), scene recognition result, and flicker information.

  According to the present invention, it is possible to reflect the user's viewpoint and intention, in particular, by acquiring information from a glasses-type wearable device at a necessary timing, and effectively using them, so that it can be performed at high speed and accurately in accordance with the user's intention. AE / AF control can be realized.

1 is a block diagram of an imaging apparatus and a configuration diagram of a wearable device according to an embodiment of the present invention. Flow chart of overall control according to the above embodiment Flow chart of timing determination processing according to the above embodiment Flowchart of subject information selection processing according to the above embodiment Flowchart of AF information setting process according to the above embodiment Flowchart of AE information setting process according to the above embodiment Flow chart of wearable device processing according to the above embodiment

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a configuration diagram of an imaging device and a wearable device according to an embodiment of the present invention.

  Reference numeral 100 denotes a photographing lens. As types of photographing lenses, there are single focus lenses and zoom lenses. Reference numeral 101 denotes an image sensor. A CCD, CMOS sensor, or the like is used as the image sensor 101, and the subject image formed by the photographing lens 100 is converted into an electrical signal. Reference numeral 102 denotes an A / D converter. The A / D converter 102 converts the analog output signal of the image sensor 101 into a digital signal. Reference numeral 103 denotes a microcomputer. The microcomputer 103 controls the entire imaging apparatus such as control of each component and data processing.

  The microcomputer 103 performs all processing such as display control timing of the wearable device and communication with the eyepiece detection sensor described in the present embodiment. Reference numeral 104 denotes a volatile memory. The volatile memory 104 temporarily holds image data converted into a digital signal by the A / D converter. Reference numeral 105 denotes a nonvolatile memory. The nonvolatile memory 105 has an execution program for the imaging apparatus that is processed by the microcomputer 103. Reference numeral 106 denotes an optical viewfinder. It is assumed that the user takes a picture while looking through the optical viewfinder. Reference numeral 107 denotes an image processing unit.

  The image processing unit 107 performs image processing on the captured image. In addition, for example, a RAW development function from a playback menu and a filter effect function are provided for the captured image. Reference numeral 108 denotes a communication member. Control communication with wearable devices. For example, wireless LAN technologies such as Bluetooth (registered trademark), ZigBee, and WiFi are assumed. However, the communication technology is not particularly limited in the present embodiment. Reference numeral 109 denotes an eyepiece detection sensor. The eye detection sensor 109 is used to detect whether or not the optical viewfinder has been looked into.

  It is assumed that the detected result is processed by the microcomputer 103. Reference numeral 110 denotes a display member. A liquid crystal monitor is assumed. Reproduction of an image obtained by shooting, menu display, RAW development UI display of the reproduced image, and UI display of filter processing are performed. Further, in this embodiment, a display device having a touch panel function is assumed for the main display member 110. It is assumed that control equivalent to the operation member 113 can be performed by the microcomputer 103 in accordance with the operation of the touch panel. The operation member 113 includes switches, buttons, and the like, and performs operations on those displayed on the display member 110.

  In this embodiment, a display panel is assumed for the sub display member 111. Displays settings related to shooting. The sound detection member 112 performs an operation of detecting or recording the sound of the external environment.

  The configuration of the wearable device will be described. Reference numeral 120 denotes a display member. The display member 120 can display an image captured by the imaging device, a reproduced image, a menu, and the like through the communication member. Reference numeral 114 denotes a lens used for imaging with a wearable device. Reference numeral 115 denotes a communication member. A process of communicating with the communication member 108 of the imaging apparatus is controlled. As with the communication member 108 of the imaging apparatus, for example, wireless LAN technologies such as Bluetooth (registered trademark), ZigBee, and WiFi are assumed. The communication technology is not particularly limited in this embodiment. Reference numeral 116 denotes a capture member.

  Reference numeral 117 denotes a member that detects sound. Reference numeral 118 denotes a spectacle lens. Reference numeral 119 denotes a line-of-sight detection sensor attached to the eyeglass lens. From this line-of-sight detection sensor, it is possible to detect where the human eye is looking through the wearable device.

[Example 1]
The first embodiment of the present invention will be described below with reference to FIGS. First, FIG. 2 showing the overall flow will be described.

  First, the imaging apparatus determines whether or not a desired timing has come using a timing determination process (S201). If it is determined by the timing determination process that the desired timing has come, then communication with the wearable device is performed, and all accumulated information accumulated on the wearable side is acquired (S202). When the acquisition of the stored information is completed, a subject information selection process is performed in which only the stored information relating to the main subject is selected from all the acquired stored information (S203).

  Next, an AF control information setting process for applying the obtained accumulated information relating to the main subject to AF control is performed (S204). Further, an AE control information setting process for applying the acquired accumulated information on the main subject to AE control is performed (S205), and the entire flow is completed.

Next, FIG. 3 in which the timing determination process is performed will be described.
The timing determination process is a process for determining whether or not a shooting preparation start operation has been performed. In the timing determination process, first, a captured image from the wearable device is acquired (S301). In the present embodiment, the wearable device is assumed to be a glasses type, that is, the photographed image from there means that it is almost equivalent to the viewpoint of the user. It is first determined whether or not the camera is held from the acquired photographed image (S302). If it is determined by the determination means that the camera is held, the process ends when a desired timing has come.

  If it is determined by the determination means that the camera is not held, it is then determined whether or not the AE start button is turned on (S303). If it is determined by the determination means that the AE start button has been turned on, the process ends when a desired timing has come. If the determination means determines that the AE start button is not turned on, it is next determined whether or not the LiveView start button is turned on (S304). If it is determined by the determination means that the LiveView start button has been turned on, the process ends when a desired timing has come.

  If it is determined by the determination means that the LiveView start button is not turned on, it is then determined whether or not the moving image recording start button is turned on (S305). If it is determined by the determining means that the moving image recording start button has been turned on, the process ends when a desired timing has come. If the determining means determines that the moving image recording start button has not been turned on, wearables are made. A photographed image is acquired from the device (S301), and the process returns to the first flow.

Next, FIG. 4 in which subject information selection processing is performed will be described. Subject information selection processing means processing to extract only the information corresponding to the main subject from the information necessary for use in the subsequent camera operation accumulated on the wearable side until the desired timing arrives doing.
First, the acquired storage information is sorted with reference to the time axis (S401). Next, counting from the newest time, it is determined whether or not the same subject continues for a predetermined time or more (S402). If the same subject continues by the determination means, it is considered that the subject is staring, and the same subject is set as the main subject (S403). Otherwise, a subject that matches the subject currently viewed on the camera side is searched (S404), and is set as the main subject. The accumulated information corresponding to the main subject thus obtained is acquired (S405), and the process ends.

  Next, the AF information setting process will be described with reference to FIG. First, distance information, a subject position (range), a subject recognition result, and a Bv value are acquired from the accumulated information selected by the subject information selection process (S501). Next, the distance information is set to the AF start position of the lens (S502). Next, the subject position (range) is set as a search start range (S503). Next, the subject recognition result is set as the main subject (S504). Next, the Bv value is set to determine whether AF auxiliary light is necessary (S505). Finally, AF control is started (S506) and is ended.

  In other words, by setting these pieces of information from the beginning of AF control, information that was originally known only after operating AE or AF to some extent has already been obtained, so it is faster and more accurate than normal AF operations. It can be operated.

  Next, the AE information setting process will be described with reference to FIG. First, subject position (range), scene recognition result, and flicker information are acquired from the accumulated information selected by the subject information selection process (S601). Next, the subject position (range) is set to the center position of the AE calculation (S602). Next, the scene recognition result is set in the program diagram information (S603). Next, flicker information is set (S604).

  Finally, AE control is started (S605) and is ended. In other words, as with AF control, since these pieces of information are set from the beginning of AE control, information that was originally only known after AE or AF was operated to some extent has already been obtained. Compared with normal AE operation. Thus, it can be operated at high speed and accurately.

  Next, wearable device processing capable of acquiring necessary information by communicating with the camera will be described with reference to FIG. First, imaging is performed (S701), and then development is performed (S702), thereby generating captured image data. Next, it is transmitted to the camera side (S703).

  Next, distance information, subject position (range), subject recognition result, Bv value, scene recognition result, and flicker information are calculated from the image data (S704). It is set as time information and stored as accumulated information (S705). Next, it is determined whether the camera has issued a transmission request for the stored information (S706). If the camera has issued a transmission request, all accumulated information that has been accumulated until then is transmitted (S707), and all accumulated data is cleared when transmission is completed (S708). If not, return to the first flow.

  In this embodiment, an image photographed through a wearable terminal and information obtained therefrom are considered to be one of important data reflecting the user's viewpoint and intention. On top of that, by controlling according to the embodiment described so far, the user's viewpoint and intention can be deciphered and the camera can be used effectively, and it is fast and accurate according to the user's intention. AE and AF control can be performed.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

DESCRIPTION OF SYMBOLS 100: Lens 101: Image pick-up element 102: A / D converter 103: Microcomputer 104: Volatile memory 105: Non-volatile memory 106: Optical finder 107: Image processing part 108: Communication member 109 of an imaging device: Eyepiece detection sensor 110 : Main display member 111: Sub display member 112: Sound detection member 113 of the imaging apparatus: Operation member 114: Lens 115 of the wearable device: Communication member 116 of the wearable device 117: Capture member of the wearable device 117: Sound detection member 118 of the wearable device : Eyeglass lens 119: Line-of-sight detection sensor 120 of wearable device: Display unit of wearable device

Claims (3)

Timing determination means capable of determining whether or not a predetermined timing in camera operation;
A communication means (108) capable of communicating with the wearable terminal;
Based on the information obtained from the wearable terminal by the communication means,
Subject information selection means capable of selecting information on the main subject,
Based on the information obtained by the subject information selection means,
AF control information setting means that can be reflected in AF control Based on the information obtained by the subject information selection means,
An imaging apparatus provided with AE control information setting means that can be reflected in AE control. In the above, the predetermined timing is
2. The image pickup apparatus according to claim 1, wherein when the camera is held, an AE start button On, a LiveView start button On, and a moving image recording start button On. In the above, the information about the main subject is
The imaging apparatus according to claim 1, wherein the imaging apparatus includes distance information, subject position (range), subject recognition result, Bv value, subject position (range), scene recognition result, and flicker information.