JP2012015661A - Imaging device and imaging method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce restriction of a presence position of an operator when imaging is controlled in accordance with an operator's gesture.SOLUTION: An imaging device has plural imaging units for achieving image data, an imaging range changing unit for individually changing at least one of an imaging direction and an imaging field angle of each of the plural imaging units to change an imaging range, a gesture detector for detecting an operator's gesture from the image data achieved by any one imaging unit, and an imaging controller for performing control of changing an imaging range to be recorded and imaging control containing an imaging instruction to the plural imaging units in accordance with the detected gesture. When the change of the imaging range to be recorded is controlled, the imaging controller controls the imaging range changing means to change the imaging range of an imaging unit concerned as some imaging unit out of the plural imaging units in accordance with the gesture detected by the gesture detector. When an operator is not contained in the imaging range of the imaging unit concerned, change of the imaging ranges of other imaging units than the imaging unit concerned is restricted to the range within which the operator is contained.

Description

  The present invention relates to an imaging apparatus and an imaging method including a plurality of imaging units.

  2. Description of the Related Art Conventionally, imaging apparatuses that detect a gesture operation of a subject existing in an imaging range of an imaging apparatus and automatically perform a predetermined imaging operation are known (see Patent Documents 1 and 2).

  In Patent Document 1, a facial expression or gesture of a subject existing in the imaging range of an imaging device is detected, and when a predetermined facial expression or gesture is detected, a photographing process is automatically performed and acquired. An imaging device that records a captured image is described.

  In Patent Document 2, in a tracking area set in advance, a position of a subject and a gesture in which the subject points to an arbitrary position are detected, and based on the detected position of the subject and the position indicated by the gesture, An imaging apparatus that automatically cuts out an image from a captured image is described.

  However, the imaging devices described in Patent Documents 1 and 2 automatically perform a predetermined imaging operation according to a gesture of a subject that is a subject to be photographed (a subject included in a final output image such as a recorded image or a display image). It is assumed that a person or the like whose gesture is to be detected is always present within the imaging range of the imaging device.

  Patent Document 3 describes a compound eye imaging apparatus including a plurality of imaging units capable of capturing a three-dimensional image. The compound-eye imaging device captures the same subject with two imaging units, and generates a three-dimensional image with a stereoscopic effect by synthesizing two image data having parallax.

JP 2010-34685 A JP 2007-158680 A JP 2008-129439 A

  By the way, when it is assumed that the imaging apparatus is controlled in accordance with an operator's intentional gesture, an imaging instruction at an angle of view such that the operator is not included in the imaging range is also assumed. In the imaging apparatus described in 2, it is impossible to capture an image at an angle of view where the operator is not included in the imaging range.

  In the compound-eye imaging device described in Patent Literature 3, when it is assumed that the imaging device is controlled in accordance with a gesture, the imaging ranges of the plurality of imaging units are linked to each other. If there is no operator, control according to the gesture cannot be performed.

  The present invention provides an imaging apparatus and an imaging method in which restrictions on an operator's location are reduced when performing control according to an operator's gesture.

An imaging device that performs imaging according to an operator's gesture,
A plurality of imaging units for acquiring image data of a predetermined imaging range;
An imaging range changing unit for changing the imaging range by individually changing at least one of the imaging direction and the imaging angle of view of each of the plurality of imaging units;
A gesture detection unit that detects the gesture of the operator from the image data acquired by any one of the plurality of imaging units;
An imaging control unit that performs imaging control including change control of an imaging range to be recorded and imaging instructions for the plurality of imaging units according to the detected gesture;
The imaging control unit controls the imaging range changing unit when changing the imaging range to be recorded, and sets the imaging range of the main imaging unit, which is a part of the plurality of imaging units, When the operator is not included from the imaging range of the main imaging unit, the imaging range of the imaging unit other than the main imaging unit is changed when the operator is changed according to the gesture detected by the gesture detection unit. Imaging device limited to a range including.

An imaging method of an imaging device that performs imaging according to an operator's gesture,
Acquiring image data of a predetermined imaging range from a plurality of imaging units;
Changing at least one of the imaging direction and the imaging angle of view of each of the plurality of imaging units individually and changing the imaging range by the imaging range changing unit;
Detecting a gesture of the operator by a gesture detection unit from the image data acquired by any one of the plurality of imaging units;
A step of performing an imaging control including an imaging range change control to be recorded and an imaging instruction for the plurality of imaging units by the imaging control unit according to the detected gesture,
When changing the imaging range to be recorded by the imaging control unit, the imaging range changing means is controlled, and the imaging range of the main imaging unit, which is at least one imaging unit among the plurality of imaging units, When the operator is not included from the imaging range of the main imaging unit, the imaging range of the imaging unit other than the main imaging unit is changed when the operator is changed according to the gesture detected by the gesture detection unit. To a range that includes
An imaging method for causing the display unit to display an image corresponding to the imaging range to be recorded, based on image data acquired by one of the main imaging units.

  ADVANTAGE OF THE INVENTION According to this invention, when performing control according to an operator's gesture, the imaging device and imaging method which reduced the restrictions of an operator's presence position can be provided.

It is a block diagram which shows the structure of an imaging device. It is a figure which shows the state which is image | photographing a to-be-photographed object. It is a figure which shows the example of the image displayed based on the acquired image data. It is a flowchart which shows an example of the procedure of an imaging. It is a flowchart which shows an example of the procedure of an imaging. It is a flowchart which shows an example of the procedure of an imaging. It is a flowchart which shows an example of the procedure of an imaging. It is a flowchart which shows an example of the procedure of an imaging. It is a flowchart which shows an example of the procedure of an imaging. It is a flowchart which shows an example of the procedure of an imaging.

  FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus including a plurality of imaging systems. A digital camera having two imaging units will be described as an example of the imaging device.

  In this imaging apparatus, the two imaging units are provided in the horizontal direction with a distance greater than or equal to the distance between the human eyes. The two imaging units include a right eye imaging system and a left eye imaging system. The right-eye imaging system includes a lens group 1R, a CCD type or MOS type solid-state imaging device 5R, a diaphragm 2R provided therebetween, an infrared cut filter 3R, and an optical low-pass filter 4R. The left-eye imaging system includes a lens group 1L, a CCD type or MOS type solid-state imaging device 5L, an aperture 2L provided therebetween, an infrared cut filter 3L, and an optical low-pass filter 4L. The imaging device can image the same subject from the respective viewpoints of the right eye imaging system and the left eye imaging system.

  Each of the lens groups 1R and 1L includes a zoom lens for adjusting the zoom position, a focus lens for adjusting the focus position, and the like. The zoom lens and the focus lens are moved synchronously between the right eye imaging system and the left eye imaging system. In this imaging apparatus, the zoom lens and the focus lens can be moved by controlling only one of the lens groups 1R and 1L. Alternatively, the zoom lenses and focus lenses of the lens groups 1R and 1L can be controlled to be in different positions.

  The system control unit 11 that performs overall control of the entire electrical control system of the imaging apparatus is mainly configured by a processor that operates according to a predetermined program. The system control unit 11 controls the lens driving unit 8 to adjust the focus lens position and zoom lens position of the lens groups 1R and 1L, and controls the aperture amounts of the apertures 2R and 2L via the aperture driving unit 9. Adjust the exposure amount.

  Further, the system control unit 11 drives the solid-state imaging devices 5R and 5L via the imaging device driving unit 10, and outputs subject images captured through the lens groups 1R and 1L as imaging signals. An instruction signal from the user is input to the system control unit 11 through the operation unit 14.

  The electrical control system of the imaging apparatus further includes an analog signal processing unit 6R that performs analog signal processing such as correlated double sampling processing connected to the output of the solid-state imaging device 5R, and the imaging output from the analog signal processing unit 6R. An A / D conversion circuit 7R that converts a signal into a digital signal, an analog signal processing unit 6L that performs analog signal processing such as correlated double sampling processing connected to the output of the solid-state imaging device 5L, and the analog signal processing unit 6L And an A / D conversion circuit 7L that converts the imaging signal output from the digital signal into a digital signal, and these are controlled by the system control unit 11.

  Further, the electric control system of the digital camera includes a main memory 16, a memory control unit 15 connected to the main memory 16, and imaging signals output from the A / D conversion circuits 7R and 7L. Digital signal processing unit 17 that generates image data by performing (interpolation calculation, gamma correction calculation, RGB / YC conversion processing, etc.), and the image data generated by digital signal processing unit 17 is compressed into a JPEG format or a compressed image A display to which a compression / expansion processing unit 18 that expands data, an external memory control unit 20 to which a detachable recording medium 21 is connected, and a display unit 23 that displays an image based on image data in a stereoscopic manner are connected. And a control unit 22, which are connected to each other by a control bus 24 and a data bus 25 and controlled by a command from the system control unit 11. It is.

  The display unit 23 is used as an image display unit for displaying a captured image, and is used as a GUI at various settings. Further, at the time of photographing, the image data acquired from the solid-state imaging devices 5R and 5L is continuously displayed as a through image on the display unit 23 and used as an electronic viewfinder or the like.

  As a stereoscopic display mechanism, the stereoscopic image data displayed on the display unit 23 is composed of right image data and left image data. The right image data and the left image data have an elongated strip shape and are alternately arranged in parallel.

  The display unit 23 uses, for example, a time division parallax image method as a display method. In the time division parallax image method, right image data and left image data are alternately displayed on one liquid crystal display unit, and when the right image data is displayed, light from the backlight of the liquid crystal display unit is displayed on the right eye of the observer. When the left image data is displayed by irradiating in the direction of, the viewer recognizes the stereoscopic image by irradiating light from the backlight built in the display unit toward the left eye of the observer It is a method.

  In the following example, the configuration of an imaging apparatus including the two imaging units in FIG. 1 will be described as an example.

  Furthermore, the imaging apparatus includes an image recognition unit 31, an operation detection unit 32, and an imaging control unit 33. The image recognition unit 31, the operation detection unit 32, and the imaging control unit 33 are connected to each other by the control bus 24 and the data bus 25, and are controlled by a command from the system control unit 11. The image recognition unit 31 and the motion detection unit 32 function as a gesture detection unit.

  The image recognition unit 31 detects a face image based on the acquired image data, and recognizes the operator by performing face recognition based on the detected face image.

  The motion detection unit 32 detects the operator's gesture recognized by the image recognition unit 31. The imaging apparatus detects the operator's gesture and automatically performs change control. Here, the gesture refers to an operation performed by an operator (for example, an operation such as raising a hand). The gesture is set with predetermined control content related to imaging range change control and imaging instructions. For example, control for changing the imaging range of each of the plurality of imaging units by driving the optical zoom is set for the gesture of raising the hand of the operator. The imaging device detects an operator's gesture included in the imaging range, and is controlled according to the gesture. Thus, the operator can cause the imaging apparatus to execute desired control from a remote position without directly inputting a finger or the like from the operation unit 14 of the imaging apparatus.

  The imaging control unit 33 performs control including change control of the imaging range to be recorded and imaging instruction to the imaging unit in accordance with the detected gesture.

Next, an example in which imaging is performed using an imaging device will be described.
FIG. 2 shows a state in which a plurality of persons including the operator are imaged using the imaging apparatus of FIG. In FIG. 2, there are four persons, and the person indicated by the arrow in the figure is the operator. The operator stands at a position away from the imaging device. In this example, a gesture in which the operator raises his / her hand is detected in the imaging apparatus, and optical zoom is executed in accordance with the detected gesture. The operator can confirm an image corresponding to the imaging range to be recorded on the display unit of the imaging apparatus.

  FIG. 3 shows an image displayed on the display unit of the imaging apparatus in the state of FIG. FIG. 3A shows an image based on the image data acquired by one of the two imaging units (gesture detection imaging unit). FIG. 3B shows an image based on the image data acquired by the other (main imaging unit) of the two imaging units.

  As shown in FIG. 3A, the gesture detection imaging unit is controlled to include an operator in the imaging range. An operator's gesture can be detected from the image data acquired by the gesture detection imaging unit. As shown in FIG. 3B, the imaging range of the main imaging unit is controlled to be changed by an optical zoom corresponding to the gesture. The main imaging unit can acquire image data at an imaging angle of view corresponding to a gesture, and can acquire an image corresponding to an imaging range to be recorded based on the image data. On the other hand, since the imaging unit does not include the operator in the changed imaging range, it cannot detect the operator's gesture. If the imaging range of the two imaging units is changed and controlled by the optical zoom according to the gesture of the operator, the operator is not included in the imaging range, and thereafter the imaging device cannot be controlled. Therefore, in the imaging apparatus, when the imaging control unit 33 controls the change of the imaging range to be recorded with the optical zoom, as shown in FIG. 3B, the imaging range of the main imaging unit is controlled according to the gesture by controlling the optical zoom. Change it. Further, as illustrated in FIG. 3A, when the operator is not included from the imaging range of the main imaging unit, the imaging device limits the change of the imaging range of the gesture detection imaging unit to a range including the operator.

  When different imaging ranges are captured by the main imaging unit and the gesture detection imaging unit, it corresponds to the imaging range to be recorded based on the image data acquired by either the main imaging unit or the gesture detection imaging unit. Display the image to be displayed.

  Hereinafter, a case where the change control according to the gesture is control for changing the angle of view by optical zoom will be described as an example.

  In this example, a means for changing the imaging field angle of the imaging unit by changing the imaging field angle of the imaging unit by optical zoom is an imaging range changing unit. The imaging range changing unit may change the imaging direction of the imaging unit. The imaging range changing unit changes the imaging range by individually changing at least one of the imaging direction and the imaging angle of view of each of the two imaging units. The imaging range changing unit changes the imaging direction of the imaging unit, for example, means for controlling the movement of the camera platform holding the imaging device, means for controlling the pan / tilt mechanism, and trimming processing of image data Means may be used.

  Next, a procedure for executing predetermined control and imaging according to an operator's gesture will be described. In the following description, the configuration of the imaging apparatus shown in FIG. 1 will be described as an example.

FIG. 4 is a flowchart illustrating an example of an imaging procedure. In the drawings referred to below, the gesture detection imaging unit is also referred to as a gesture camera.
In this example, first, in step S1, the image recognition unit 31 detects a face image from image data acquired from one of the two imaging units, and performs face recognition based on the detected face image. The recognized subject person is set as the operator. In face recognition, a face image detected from image data is compared with registered image data registered in advance to determine how much they match. If they match, the person in the face image is recognized as an operator. . After this procedure, the process proceeds to step S2. Note that face detection may be performed on image data acquired from each of the two imaging units.

  In step S2, the motion detection unit 32 detects the recognized gesture of the operator. The gesture is determined based on whether or not the feature point is calculated by acquiring the operator's region in the image data and the change pattern of the feature point matches a predetermined pattern. Then, the process proceeds to step S3.

  In step S3, the motion detection unit 32 determines the presence or absence of a gesture. If a gesture is detected, the change control set in advance associated with the gesture is set, and the process proceeds to step S4. Here, an optical zoom associated in advance with the gesture of raising the hand of the operator is performed. On the other hand, if no gesture is detected, the process proceeds to step S10.

  In step S4, the imaging control unit 33 determines whether or not the operator cannot detect when the imaging range of the two imaging units is changed and controlled by executing the optical zoom. If the operator cannot be detected, the process proceeds to step S5. If the operator can be detected, the process proceeds to step S7.

  In step S5, it is determined whether or not the operator is imaged by the gesture detection imaging unit. If the gesture detection imaging unit determines that the operator can be detected, the process proceeds to step S6. If the gesture detection imaging unit determines that the operator cannot be detected, the process proceeds to step S8.

  In step S6, one of the two image pickup units is set as the gesture detection image pickup unit, and the image pickup is actually started by the gesture detection image pickup unit. The gesture detection imaging unit is controlled by the imaging control unit 33 such that the imaging range is a range including the operator. On the other hand, the imaging range of the main imaging unit is changed and controlled by the optical zoom instructed by the gesture. At this time, an image corresponding to the imaging range to be recorded is displayed on the display unit based on the image data captured by the main imaging unit. Alternatively, the display unit may display an image based on the image data captured by the gesture detection imaging unit. Then, it progresses to step S10.

  In step S7, when the optical zoom is executed, it is determined that the respective imaging ranges of the two imaging units include the operator. Therefore, the imaging control unit 33 changes the imaging ranges of the two imaging units by the optical zoom. To do. Then, it progresses to step S10.

  In step S8, a warning operation is executed in response to the result of the operator's determination that detection is not possible in any imaging range of the two imaging units in step S5. The warning operation includes a method of blinking a tally and a method of displaying on the display unit 23.

  In step S10, it is determined whether or not an imaging instruction has been issued. The imaging instruction may be given by an operator using a gesture, or may be input directly by another person to the operation unit 14 of the imaging apparatus. If there is an imaging instruction, the process proceeds to S11. If there is no imaging instruction, the process returns to step S1 and the above procedure is repeated.

  In step S11, it is determined whether or not the gesture detection imaging unit captures an image in an imaging range different from that of the main imaging unit and an operation for detecting an operator is set. When the gesture detection imaging unit performs an operation of detecting the operator, the process proceeds to step S12. If the gesture detection imaging unit is not performing an operation of detecting the operator, the process proceeds to step S15.

  In step S12, the imaging control unit 33 temporarily interrupts the operation of detecting the operator by the gesture detection imaging unit, and sets the imaging range of the gesture detection imaging unit according to the gesture in the same manner as the main imaging unit. To switch to the imaging range under change control. At this time, the gesture detection imaging unit is in the same operation state as the main imaging unit, that is, the imaging range is changed by the optical zoom. In addition, data indicating the operation state of the interrupted gesture detection imaging unit is recorded in the main memory 16. Then, the process proceeds to step S13.

  In step S13, imaging control for acquiring image data for recording is executed. At this time, image data is acquired from each of the two imaging units in the imaging range subjected to change control according to the gesture. The image based on the acquired image data includes parallax based on the arrangement of the two imaging units. In this operation, the acquired image data is recorded in the main memory 16. After this procedure, the process proceeds to step S14.

  In step S14, after performing the imaging control, the imaging range of the gesture detection imaging unit is changed to a range including the operator. At this time, the imaging control unit 33 reads data indicating the operation state of the previous gesture detection imaging unit from the main memory 16, and the imaging range immediately before switching the imaging range of the gesture detection imaging unit to imaging control (that is, The control is performed to return to the imaging range limited to include the operator. Based on the image data acquired by one of the main imaging unit and the gesture detection imaging unit, an image corresponding to the imaging range to be recorded is displayed on the display unit 23. Thereafter, the flow ends.

  In step S <b> 15, the two imaging units determine that neither is set as a gesture detection imaging unit, and performs imaging without changing the imaging range of the two imaging units. Image data is acquired from each of the two imaging units and recorded in the main memory 16. Thereafter, the flow ends.

  The imaging apparatus combines the acquired image data to create three-dimensional image data. Further, the imaging apparatus may create two-dimensional image data based on only one acquired image data. The two-dimensional image data and the three-dimensional image data are stored in the main memory 16.

  In this way, the operator can check the imaging range to be recorded on the display unit even when the operator cannot detect the change control according to the gesture. Therefore, the operator can control the image capturing apparatus with a gesture without being restricted by the position of the image capturing range.

  In addition, when an imaging instruction is given, the imaging device switches the two imaging units to change control corresponding to the gesture and performs imaging. In this way, it is possible to obtain a three-dimensional image by acquiring two pieces of image data having parallax and synthesizing these image data.

  After performing the imaging control, the control is performed again so that the imaging range of the gesture detection imaging unit includes the operator. This can prevent the imaging apparatus from recognizing the operator. Further, the operator can control the imaging device with a gesture immediately after imaging.

  Next, an example in which a part of the above procedure is modified will be described. In this example, a case will be described in which it is determined whether or not a plurality of recognized subjects include a plurality of persons registered as registered image data. FIG. 5 is a flowchart showing the procedure of this example. In FIG. 5, the flow after the procedure for detecting a gesture is the same as that described in FIG.

  First, in step S21, the image recognition unit 31 detects face detection based on image data. Then, face recognition is performed for recognizing a person based on a face image detected by face detection. Thereafter, the process proceeds to step S22. Note that the image data may be acquired from either of the two imaging units.

  In step S22, face recognition is performed to determine whether there is a match between the detected face image of the subject and registered image data registered in advance. If there is even one face image that matches the registered image data, the process proceeds to step S23. If no face image matches the registered image data, the process proceeds to the procedure for detecting a gesture (see step S3 in FIG. 4).

  In step S23, it is determined whether or not there are a plurality of face images that match the registered image data. If there are a plurality of face images that match the registered image data, the process proceeds to step S24. If there are not a plurality of face images that match the registered image data, the process proceeds to step S25.

  In step S24, a priority order to be set as an operator is assigned to a plurality of subjects, and a person having the highest priority order to be set as an operator among the plurality of subjects is set as the operator. As a method of assigning priorities, for example, priorities are set in advance for registered image data. Thereafter, the process proceeds to a procedure for detecting a gesture (see step S3 in FIG. 4).

  In step S25, the person determined as the face image matching the registered image data in step S23 is set as the operator. Thereafter, the process proceeds to a procedure for detecting a gesture (see step S3 in FIG. 4).

  In this way, only the gesture of a specific person can be detected and the imaging device can be controlled.

  Further, the imaging device detects the gesture of the person with the highest priority to be the operator by setting the order in the registered image data in advance, and if this person cannot be detected, the operator next A gesture of a person with a high priority to be detected may be detected, and change control corresponding to the detected gesture may be executed.

  Next, an example in which a part of the above procedure is modified will be described. FIG. 6 is a flowchart showing the procedure of this example. In FIG. 6, since the same procedure as step S1 to step S10 shown in FIG. 4 is performed first, these procedures will not be described and will be omitted.

  In step S31, as in step S11 of FIG. 4, after the imaging instruction, it is determined whether or not the gesture detection imaging unit is performing an operation of detecting the operator. If the gesture detection imaging unit is performing an operation of detecting an operator, the process proceeds to step S32. If the gesture detection imaging unit is not performing an operation of detecting the operator, the process proceeds to step S34.

  In step S32, at least one of AE (automatic exposure control), AF (automatic focus adjustment), and AWB (auto white balance) is executed based on the image data acquired in the imaging range of the main imaging unit. Then, it progresses to the step which performs imaging.

  In step S34, at least one of AE (automatic exposure control), AF (automatic focus adjustment), and AWB (auto white balance) is executed based on the image data acquired in the imaging ranges of the two imaging units. . Thereafter, the process proceeds to the step of executing the main imaging.

  In this way, the acquired image data can be optimized. Further, the values of AE, AF, and AWB may be applied to any of the through image and the image data at the time of imaging control.

  Next, an example in which a part of the above procedure is modified will be described. FIG. 7 is a flowchart showing the procedure of this example. In FIG. 7, the flow after the procedure for detecting a gesture is the same as that described in FIG.

  First, in step S41, detection of an operator is started by the gesture detection unit as in the above example. Then, the process proceeds to step S42.

  In step S42, the face image detected by the face detection is compared with registered image data registered in advance, and it is determined whether or not the operator can be recognized. If it can be recognized as an operator, the process proceeds to step S43. If the operator cannot be recognized, it is determined that the operator is not included in the imaging range, and the process proceeds to step S44. The image data used for operator recognition may be acquired by either of the two imaging units.

  In step S43, a person whose face image matches the registered image data is set as the operator. And it progresses to the step (step S2 of FIG. 4) which detects a gesture.

  In step S44, based on the result determined that the operator detected in step S42 does not include the operator, was the operator detected in image data before the image data acquired in the current imaging range? Is determined. In this example, when the image data is one frame, it is determined whether or not an operator is detected from the past 100 frames. Information recorded in the main memory 16 is read as information regarding past image data and whether or not the operator has detected. If an operator is detected from the past 100 frames, it is determined that the operator has gone out of the imaging range, and the process proceeds to step S45. If the operator cannot be detected from the past 100 frames, the process returns to step S42. Note that it may be determined whether or not the operator is included in the imaging range based on the presence or absence of the operator's detection in the image data captured from a predetermined time before the current time, instead of the number of frames.

  In step S45, a warning operation is executed. The warning operation includes a method of blinking a tally and a method of displaying on the display unit 23. The warning operation is desirably performed after a predetermined time has elapsed since the operator determined that the detection was impossible.

  FIG. 8 is a flowchart showing an example in which a part of the procedure of FIG. 7 is modified. FIG. 8 is a flowchart showing the procedure of this example. In this example, steps S51 to S54 are the same as steps S41 to S44 in the procedure of FIG.

  In step S55, a camera operation for searching for an operator is executed based on the determination result that the operator has been detected in the image data before the image data acquired in the current imaging range in step S54. In the camera operation for searching for an operator, for example, at least one of the two imaging units is changed by the imaging range changing unit.

  In this way, when the imaging apparatus determines that the operator is no longer included in the imaging range, control is performed so that the operator is included in the imaging range.

  FIG. 9 is a flowchart showing an example in which a part of the above procedure is modified.

  First, in step S61, an operator is detected in the same manner as in the above-described example. Then, the process proceeds to step S62.

  In step S62, it is determined from the acquired image data whether the detected operator is at a predetermined position according to the positional relationship with the operator recognized as the imaging range. The image data may be acquired from either the main imaging unit or the gesture detection imaging unit. When the imaging region is set so as to surround the central region and the central region, the end region is set as a predetermined position. When the detected operator is included in the end region of the imaging range, the process proceeds to step S63. When the detected operator is included in the central region of the imaging range, the process proceeds to a procedure for detecting a gesture (see step S3 in FIG. 4).

  In step S63, the imaging range changing unit changes the imaging range of the imaging unit so that the operator is included in the central region of the imaging range. Thus, the operator is included in the central area in the changed imaging range.

  In this way, it is possible to prevent the operator from being included in the imaging range.

  FIG. 10 is a flowchart showing an example in which a part of the above procedure is modified. In FIG. 10, since the same procedure as step S1 to step S10 shown in FIG. 4 is performed first, these procedures will not be described and will be omitted. In this procedure, it is assumed that an imaging instruction has been given first.

  In step 71, it is determined whether or not an operation for detecting the operator is performed by the gesture detection imaging unit. When the operation for detecting the operator is performed by the gesture detection imaging unit, the process proceeds to step S72. When the operation for detecting the operator is not performed by the gesture detection imaging unit, the process proceeds to step S76.

  In step S72, an image is captured by the gesture detection imaging unit, and image data is acquired and recorded. Thereafter, the process proceeds to step S73.

  In step S <b> 73, the imaging control unit 33 performs control to change the imaging range of the gesture detection imaging unit in accordance with the gesture, similarly to the main imaging unit. Thereafter, the process proceeds to step S74.

  In step S74, each of the two imaging units captures an image within an imaging range that is change-controlled according to the gesture. The acquired image data is recorded. Thereafter, the process proceeds to step S75.

  In step S75, after performing imaging control, the imaging range of the gesture detection imaging unit is changed to a range in which the operator is included. Then, the flow ends.

  In step S76, it is determined that the respective imaging ranges of the two imaging units have been changed by the change control according to the gesture, and imaging is performed by the two imaging units by the imaging control of the imaging control unit 33. The two acquired image data are recorded respectively. Then, the flow ends.

  In this way, the image is captured in the state in which the operation for detecting the operator is performed in the gesture detection imaging unit, and in the state in which the two imaging units are both changed and controlled according to the gesture, and the image data is acquired. Can be acquired and recorded, making it easier to understand the situation at the time of imaging.

Next, a modified example of the present invention will be described.
In the above example, the imaging device is configured to include a display unit that displays an image based on image data acquired by one of the two imaging units. However, the imaging device is configured not to include a display unit. You can also. If the imaging device is provided with an LED that functions as a notification means, when the optical zoom is performed, the LED blinks when the operator is not included in one of the imaging ranges of the two imaging units. The operator can be notified that the operator is no longer included in the imaging range of the imaging unit.

An example of the operation of the imaging apparatus provided with the LED will be described.
First, the operator's gesture is detected as in the above example. When an optical zoom based on a gesture is performed, when the operator is not included in the imaging range of the imaging unit, at least one of the plurality of imaging units performs electronic zoom and continues to detect the operator. . At this time, the operator is notified that the electronic zoom is being executed by means such as blinking the LED.

  The imaging device may include an interface that can be connected to an external display device (for example, a television), and may be able to display an image based on image data acquired by the imaging unit on the external display device. In an imaging apparatus including a plurality of imaging units and connected to an external display device, an operator is usually imaged by each of the plurality of imaging units, and an image acquired from one of the two imaging units is displayed on the external display device Can be displayed. When the optical zoom is performed and the operator is not included in the imaging range of the imaging unit, one of the two imaging units is switched to the electronic zoom to maintain a state where the operator can be imaged. At this time, the recorded image can be displayed or the operator can be displayed on the external display device. For example, when there are a plurality of persons in an imaging range and an unspecified person is an operator, an electronic zoom that detects an operator's gesture in one imaging unit of two imaging units in different imaging ranges The image captured by the image capturing unit switched to the electronic zoom can be displayed on the external display device.

This specification discloses the following matters.
(1) An imaging device that performs imaging according to an operator's gesture,
A plurality of imaging units for acquiring image data of a predetermined imaging range;
An imaging range changing unit for changing the imaging range by individually changing at least one of the imaging direction and the imaging angle of view of each of the plurality of imaging units;
A gesture detection unit that detects the gesture of the operator from the image data acquired by any one of the plurality of imaging units;
An imaging control unit that performs imaging control including change control of an imaging range to be recorded and imaging instructions for the plurality of imaging units according to the detected gesture;
The imaging control unit controls the imaging range changing unit when changing the imaging range to be recorded, and sets the imaging range of the main imaging unit, which is a part of the plurality of imaging units, When the operator is not included from the imaging range of the main imaging unit, the imaging range of the imaging unit other than the main imaging unit is changed when the operator is changed according to the gesture detected by the gesture detection unit. Imaging device limited to a range including.
(2) The imaging apparatus according to (1),
A display unit for displaying an image corresponding to the imaging range to be recorded based on the image data acquired by any one of the plurality of imaging units;
An imaging apparatus that causes the display unit to display an image corresponding to the imaging range to be recorded based on the image data acquired by one imaging unit of the plurality of imaging units.
(3) The imaging apparatus according to (1) or (2),
The imaging apparatus that performs the imaging control by changing an imaging range of the imaging unit other than the main imaging unit according to the gesture.
(4) The imaging apparatus according to any one of (1) to (3),
The imaging device that changes the imaging range of the imaging unit other than the main imaging unit to a range including the operator after performing the imaging control.
(5) The imaging apparatus according to any one of (1) to (4),
The said gesture detection part is an imaging device which determines the said operator by performing face detection and face recognition to the acquired said image data.
(6) The imaging apparatus according to any one of (1) to (5),
The gesture detection unit detects a plurality of subjects from the acquired image data, compares the plurality of subjects with registered image data registered in advance, determines a priority order for the operator, and determines the priority. An imaging device that sets the operator based on the order.
(7) The imaging apparatus according to any one of (1) to (6),
An imaging apparatus that performs at least one of automatic exposure control, automatic focus adjustment, and auto white balance based on the image data acquired by the main imaging unit.
(8) The imaging apparatus according to any one of (1) to (7),
An imaging device that issues a warning when the operator is not detected from the image data in the gesture detection unit.
(9) The imaging apparatus according to any one of (1) to (8),
An imaging apparatus that changes the imaging range of an imaging unit other than the main imaging unit when the operator is not detected from the image data in the gesture detection unit.
(10) The imaging apparatus according to any one of (1) to (9),
An imaging apparatus that changes the imaging range from the acquired image data in accordance with a positional relationship with the operator recognized as the imaging range.
(11) The imaging apparatus according to any one of (1) to (10),
The imaging control unit changes an imaging range of only the imaging unit other than the main imaging unit and the main imaging unit and an imaging range of the imaging unit other than the main imaging unit according to the gesture according to an imaging instruction. An imaging device that controls imaging performed by the plurality of imaging units.
(12) An imaging method of an imaging apparatus that performs imaging according to an operator's gesture,
Acquiring image data of a predetermined imaging range from a plurality of imaging units;
Changing at least one of the imaging direction and the imaging angle of view of each of the plurality of imaging units individually and changing the imaging range by the imaging range changing unit;
Detecting a gesture of the operator by a gesture detection unit from the image data acquired by any one of the plurality of imaging units;
A step of performing an imaging control including an imaging range change control to be recorded and an imaging instruction for the plurality of imaging units by the imaging control unit according to the detected gesture,
When changing the imaging range to be recorded by the imaging control unit, the imaging range changing means is controlled, and the imaging range of the main imaging unit, which is at least one imaging unit among the plurality of imaging units, When the operator is not included from the imaging range of the main imaging unit, the imaging range of the imaging unit other than the main imaging unit is changed when the operator is changed according to the gesture detected by the gesture detection unit. To a range that includes
An imaging method for causing the display unit to display an image corresponding to the imaging range to be recorded, based on image data acquired by one of the main imaging units.
(13) The imaging method according to (12),
A step of displaying an image corresponding to an imaging range to be recorded on a display unit based on image data acquired by some imaging units of the plurality of imaging units, wherein the step includes: An imaging method for causing the display unit to display an image corresponding to the imaging range to be recorded based on image data acquired by one of the imaging units.
(14) The imaging method according to (12) or (13),
The imaging method in which the imaging control unit performs the imaging control by changing an imaging range of the imaging unit other than the main imaging unit according to the gesture.
(15) The imaging method according to any one of (12) to (14),
The imaging method, wherein the imaging control unit changes the imaging range of the imaging unit other than the main imaging unit to a range including the operator after performing the imaging control.
(16) The imaging method according to any one of (12) to (15),
The gesture detection unit is an imaging method in which the operator is determined by performing face detection and face recognition on the acquired image data.
(17) The imaging method according to any one of (12) to (16),
The gesture detection unit detects a plurality of subjects from the acquired image data, compares the plurality of subjects with registered image data registered in advance, determines a priority order for the operator, and determines the priority. An imaging method for setting the operator based on ranking.
(18) The imaging method according to any one of (12) to (17),
An imaging method for performing at least one of automatic exposure control, automatic focus adjustment, and auto white balance based on the image data acquired by the main imaging unit.
(19) The imaging method according to any one of (12) to (18),
An imaging method for giving a warning when the operator is not detected from the image data in the gesture detection unit.
(20) The imaging method according to any one of (12) to (19),
An imaging method for changing the imaging range of an imaging unit other than the main imaging unit when the operator is not detected from the image data in the gesture detection unit.
(21) The imaging method according to any one of (12) to (20),
An imaging method for changing the imaging range in accordance with a positional relationship with the operator recognized as an imaging range from the acquired image data.
(22) The imaging method according to any one of (12) to (21),
The imaging control unit changes an imaging range of only the imaging unit other than the main imaging unit and the main imaging unit and an imaging range of the imaging unit other than the main imaging unit according to the gesture according to an imaging instruction. An imaging method for controlling imaging performed by the plurality of imaging units.

11 System Control Unit 31 Image Recognition Unit 32 Motion Detection Unit 33 Imaging Control Unit

Claims (22)

An imaging device that performs imaging according to an operator's gesture,
A plurality of imaging units for acquiring image data of a predetermined imaging range;
An imaging range changing unit for changing the imaging range by individually changing at least one of the imaging direction and the imaging angle of view of each of the plurality of imaging units;
A gesture detection unit that detects the gesture of the operator from the image data acquired by any one of the plurality of imaging units;
An imaging control unit that performs imaging control including change control of an imaging range to be recorded and imaging instructions for the plurality of imaging units according to the detected gesture;
The imaging control unit controls the imaging range changing unit when changing the imaging range to be recorded, and sets the imaging range of the main imaging unit, which is a part of the plurality of imaging units, When the operator is not included from the imaging range of the main imaging unit, the imaging range of the imaging unit other than the main imaging unit is changed when the operator is changed according to the gesture detected by the gesture detection unit. Imaging device limited to a range including. The imaging apparatus according to claim 1,
A display unit for displaying an image corresponding to the imaging range to be recorded based on the image data acquired by any one of the plurality of imaging units;
An imaging apparatus that causes the display unit to display an image corresponding to the imaging range to be recorded based on the image data acquired by one imaging unit of the plurality of imaging units. The imaging apparatus according to claim 1 or 2,
The imaging apparatus that performs the imaging control by changing an imaging range of the imaging unit other than the main imaging unit according to the gesture. The imaging apparatus according to any one of claims 1 to 3,
The imaging device that changes the imaging range of the imaging unit other than the main imaging unit to a range including the operator after performing the imaging control. The imaging apparatus according to any one of claims 1 to 4, wherein:
The said gesture detection part is an imaging device which determines the said operator by performing face detection and face recognition to the acquired said image data. The imaging apparatus according to any one of claims 1 to 5,
The gesture detection unit detects a plurality of subjects from the acquired image data, compares the plurality of subjects with registered image data registered in advance, determines a priority order for the operator, and determines the priority. An imaging device that sets the operator based on the order. The imaging device according to any one of claims 1 to 6,
An imaging apparatus that performs at least one of automatic exposure control, automatic focus adjustment, and auto white balance based on the image data acquired by the main imaging unit. The imaging apparatus according to any one of claims 1 to 7,
An imaging device that issues a warning when the operator is not detected from the image data in the gesture detection unit. The imaging apparatus according to any one of claims 1 to 8,
An imaging apparatus that changes the imaging range of an imaging unit other than the main imaging unit when the operator is not detected from the image data in the gesture detection unit. The imaging apparatus according to any one of claims 1 to 9,
An imaging apparatus that changes the imaging range from the acquired image data in accordance with a positional relationship with the operator recognized as the imaging range. It is an imaging device given in any 1 paragraph of Claims 1-10,
The imaging control unit changes an imaging range of only the imaging unit other than the main imaging unit and the main imaging unit and an imaging range of the imaging unit other than the main imaging unit according to the gesture according to an imaging instruction. An imaging device that controls imaging performed by the plurality of imaging units. An imaging method of an imaging device that performs imaging according to an operator's gesture,
Acquiring image data of a predetermined imaging range from a plurality of imaging units;
Changing at least one of the imaging direction and the imaging angle of view of each of the plurality of imaging units individually and changing the imaging range by the imaging range changing unit;
Detecting a gesture of the operator by a gesture detection unit from the image data acquired by any one of the plurality of imaging units;
A step of performing an imaging control including an imaging range change control to be recorded and an imaging instruction for the plurality of imaging units by the imaging control unit according to the detected gesture,
When changing the imaging range to be recorded by the imaging control unit, the imaging range changing means is controlled, and the imaging range of the main imaging unit, which is at least one imaging unit among the plurality of imaging units, When the operator is not included from the imaging range of the main imaging unit, the imaging range of the imaging unit other than the main imaging unit is changed when the operator is changed according to the gesture detected by the gesture detection unit. To a range that includes
An imaging method for causing the display unit to display an image corresponding to the imaging range to be recorded, based on image data acquired by one of the main imaging units. The imaging method according to claim 12, comprising:
A step of displaying an image corresponding to an imaging range to be recorded on a display unit based on image data acquired by some imaging units of the plurality of imaging units, wherein the step includes: An imaging method for causing the display unit to display an image corresponding to the imaging range to be recorded based on image data acquired by one of the imaging units. The imaging method according to claim 12 or 13,
The imaging method in which the imaging control unit performs the imaging control by changing an imaging range of the imaging unit other than the main imaging unit according to the gesture. The imaging method according to any one of claims 12 to 14,
The imaging method, wherein the imaging control unit changes the imaging range of the imaging unit other than the main imaging unit to a range including the operator after performing the imaging control. The imaging method according to any one of claims 12 to 15,
The gesture detection unit is an imaging method in which the operator is determined by performing face detection and face recognition on the acquired image data. The imaging method according to any one of claims 12 to 16, comprising:
The gesture detection unit detects a plurality of subjects from the acquired image data, compares the plurality of subjects with registered image data registered in advance, determines a priority order for the operator, and determines the priority. An imaging method for setting the operator based on ranking. The imaging method according to any one of claims 12 to 17,
An imaging method for performing at least one of automatic exposure control, automatic focus adjustment, and auto white balance based on the image data acquired by the main imaging unit. The imaging method according to any one of claims 12 to 18, comprising:
An imaging method for giving a warning when the operator is not detected from the image data in the gesture detection unit. The imaging method according to any one of claims 12 to 19,
An imaging method for changing the imaging range of an imaging unit other than the main imaging unit when the operator is not detected from the image data in the gesture detection unit. The imaging method according to any one of claims 12 to 20,
An imaging method for changing the imaging range in accordance with a positional relationship with the operator recognized as an imaging range from the acquired image data. The imaging method according to any one of claims 12 to 21,
The imaging control unit changes an imaging range of only the imaging unit other than the main imaging unit and the main imaging unit and an imaging range of the imaging unit other than the main imaging unit according to the gesture according to an imaging instruction. An imaging method for controlling imaging performed by the plurality of imaging units.

Images