JP5504887B2 - Imaging control apparatus, imaging control method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus that automatically changes an imaging field of view and performs imaging, an imaging control apparatus for an imaging system, and an imaging control method. The present invention also relates to a program for realizing the imaging control apparatus and the imaging control method.

JP 2009-100300 A

In the above-mentioned patent document 1, an automatic composition adjustment and an image obtained by the composition adjustment are provided by an imaging system including a digital still camera and a pan / tilt head that electrically changes the pan / tilt direction of the digital still camera. A technique for automatically recording an image is disclosed.
In the technique described in Patent Document 1, a subject as a person is searched using, for example, a face detection technique. Specifically, the subject (person's face) displayed in the image frame is detected while rotating the digital still camera in the pan direction by the pan head.
If a subject is detected in the image frame as a result of such a subject search, the subject detection mode (for example, the number, position, size, etc.) of the subject in the image frame at that time is determined. The optimum composition is determined (optimum composition determination). That is, the optimum pan, tilt, and zoom angles are obtained.
Further, when the pan / tilt / zoom angles optimized by the optimum composition determination are obtained in this way, the pan / tilt / zoom angles are adjusted using these angles as target angles (composition adjustment).
After completion of the composition adjustment, the captured image is automatically recorded.
According to such an automatic image capturing operation (automatic image recording) by automatic composition adjustment, it is possible to record a captured image with an automatically optimized composition without any user's imaging operation.

By the way, according to automatic imaging that does not require a cameraman, there is an advantage that a natural facial expression and appearance can be imaged without the user being aware of the cameraman at a party, for example. On the other hand, some users may want to have their conscious facial expressions and appearances copied. For example, it may be a commemorative photo, a figure posing for the camera, or a facial expression conscious of imaging.
Usually, when a photographer is taking a still image with a camera, a user who wants to take a picture calls the photographer and requests that the photographer take a picture, and gathers or determines a pose.
However, only by performing the above-described automatic imaging, it is impossible to perform photography (still image imaging) according to the user's request.
SUMMARY An advantage of some aspects of the invention is that an image pickup system that performs automatic image pickup can easily realize still image pickup according to a user's request.

The imaging control device of the present invention, when a predetermined trigger input is accepted, instead of the automatic imaging mode, a request corresponding imaging control unit that causes the imaging device to execute an imaging operation according to the imaging request as a request corresponding imaging mode, An imaging field variable control unit that drives and controls an imaging field variable mechanism, and an imaging preparation processing unit that performs processing for determining an imaging field for still image capturing. If accepted, the imaging preparation processing unit executes processing for determining an imaging field of view according to an imaging request as the request-capable imaging mode, and is variable by the imaging field-of-view variable control unit during the request-capable imaging mode. Drive control of the mechanism, adjust the arrangement of subject images in the imaging field of view, and when one or more subjects are detected in the imaging field of view, further move the imaging field of view and request imaging The composition process of confirming the presence of another object in accordance performed.

In addition, an imaging advance notice operation control unit that performs execution control of the advance notice operation for performing still image shooting is further provided, and the request corresponding imaging control unit performs the request corresponding imaging operation on the imaging preparation processing unit as the request corresponding imaging mode. The process for determining the imaging field of view is executed, and after the imaging field of view is determined, the above notice operation is executed under the control of the imaging advance notice operation control unit, and then the still image imaging operation is executed under the control of the imaging record control unit.
The trigger receiving unit detects a specific operation input by the user, for example, a touch operation by the user to the touch sensor unit or a specific audio input as the trigger input, or when a specific subject state is determined from a captured image. Detects that there is a trigger input.

Further, in the request-capable imaging mode, the imaging preparation processing unit performs subject detection processing for placing a subject according to the imaging request in the imaging field of view while driving and controlling the variable mechanism by the imaging field of view variable control unit. I do.
Further, in the request-corresponding imaging mode, the imaging preparation processing unit performs composition processing for adjusting the arrangement of the subject image in the imaging field of view while driving and controlling the variable mechanism by the imaging field of view variable control unit. The composition processing includes processing for confirming the presence of another subject in response to an imaging request by further moving the imaging field when one or more subjects are detected within the imaging field.
Further, the imaging preparation processing unit performs the composition processing also in the automatic imaging mode, and the composition with the processing procedure or processing parameter different from that in the automatic imaging mode in the request imaging mode. Process.

An imaging control method of the present invention is an imaging control method for an imaging apparatus or an imaging system having an imaging unit for imaging a subject and recording captured image data on a recording medium, and receiving a predetermined trigger input; , when the trigger input of which is accepted, instead of automatic imaging mode, as a request corresponding imaging mode, in the imaging apparatus or the imaging system, the steps of executing an imaging operation in response to the imaging request, depending on the imaging requirements A step of executing a process for determining an imaging field of view, a step of adjusting an arrangement of subject images in the imaging field of view in the request-capable imaging mode, and a case where one or more subjects are detected in the imaging field of view. And a step of confirming the presence of another subject in response to the imaging request by moving the imaging field of view.
The program according to the present invention is a program that causes the arithmetic processing unit to execute the above steps as a control processing program for the imaging apparatus or imaging system.

In the present invention, in the automatic imaging mode, the imaging apparatus (imaging system) executes the still image imaging operation while automatically driving the variable mechanism to change the imaging field of view. The operation in the automatic imaging mode is executed regardless of the user's intention and request. During the operation in the automatic imaging mode, the user can request imaging by performing a predetermined trigger input. The imaging operation corresponding to the trigger input is the operation in the request-compliant imaging mode.
In the request corresponding imaging mode, an imaging field of view corresponding to an imaging request is determined. For example, an operation is performed with the user who has input the trigger as the subject. After such an imaging field of view is determined, a still image imaging operation is automatically executed. At this time, if a notice operation for taking a still image is also performed, the user can easily determine an expression or a pose.
In other words, the imaging operation according to the present invention can execute “imaging at the will of the cameraman” and “imaging at the request of the user” in each of the automatic imaging mode and the imaging mode corresponding to the request when a normal cameraman takes an image. It becomes.

  According to the present invention, it is possible to capture natural facial expressions, appearances, sights, and the like by imaging in the automatic imaging mode, and it is also possible to perform imaging according to the user's request by imaging in the request-response imaging mode. As a result, as the automatic imaging that does not require the cameraman, various types of imaging that are equivalent to the case where the cameraman images can be performed.

It is the front view and back view of a digital still camera which are the components of the imaging system of the embodiment of the present invention. It is a perspective view of a pan head which is a component of the imaging system of an embodiment. It is a front view of the state which attached the digital still camera to the pan head of embodiment. It is explanatory drawing of the motion of the pan direction in the state which attached the digital still camera to the pan head of embodiment. It is explanatory drawing of the motion of the tilt direction in the state which attached the digital still camera to the pan head of embodiment. It is a rear view of the pan head of an embodiment. It is explanatory drawing of the touch sensor part of the pan head of embodiment. It is a block diagram which shows the example of an internal structure of the digital still camera of embodiment. It is a block diagram which shows the example of an internal structure of the pan head of embodiment. It is explanatory drawing of the control function structure of embodiment. It is a flowchart of the automatic imaging process of an embodiment. It is a flowchart of the imaging control process of 1st Embodiment. 10 is a flowchart of an imaging control process for performing pan / tilt in a requested direction as a modification of the embodiment. 10 is a flowchart of an imaging control process in which subject detection is not performed as a modification of the embodiment. It is a flowchart of the imaging control process which does not perform a composition process as a modification of embodiment. It is a flowchart of the other imaging control process which does not perform a composition process as a modification of embodiment. It is a flowchart of the imaging control process which performs a captured image presentation process as a modification of embodiment. It is explanatory drawing of the basic composition process of embodiment. It is explanatory drawing of the basic composition process of embodiment. It is explanatory drawing of the target range in the composition process of embodiment. It is explanatory drawing of the gravity center arrangement | positioning to the target range in the composition process of embodiment. It is explanatory drawing of the local solution in composition processing, and the best solution. It is explanatory drawing of the local solution in composition processing, and the best solution. It is explanatory drawing of temporary composition adjustment of embodiment. It is explanatory drawing of this composition adjustment after provisional composition adjustment of embodiment. It is explanatory drawing of the target range of the temporary composition of embodiment. 6 is a flowchart of composition processing in an automatic imaging mode and a request-compliant imaging mode according to the embodiment. It is a flowchart of the process of temporary composition adjustment and main composition adjustment of an embodiment. It is a flowchart of the imaging control process of 2nd Embodiment. It is a flowchart of the imaging control process of 3rd Embodiment. It is explanatory drawing of the other control function structure of embodiment. It is explanatory drawing of the other control function structure of embodiment. It is explanatory drawing of the other control function structure of embodiment. It is explanatory drawing of the other control function structure of embodiment. It is explanatory drawing of the basic control function structure of embodiment.

Hereinafter, embodiments of the present invention will be described in the following order. In the embodiment, an imaging apparatus (imaging system) including a digital still camera and a camera platform is taken as an example.

<1. Configuration of imaging system>
[1-1: Overall configuration]
[1-2: Digital still camera]
[1-3: pan head]
<2. Functional configuration example>
<3. Automatic imaging process>
<4. Imaging Operation of First Embodiment>
<5. Modification of First Embodiment>
[5-1: Trigger to request imaging mode]
[5-2: Pan / tilt in required direction]
[5-3: Example in which subject detection is not performed in request-capable imaging mode]
[5-4: Example in which composition processing is not executed in request-capable imaging mode]
[5-5: Presented image in request-capable imaging mode]
[5-6: Temporary composition processing]
[5-7: Control method in other demanding imaging mode]
<6. Imaging Operation of Second Embodiment>
<7. Imaging Operation of Third Embodiment>
<8. Imaging Operation of Fourth Embodiment>
<9. Modification of functional configuration>
<10. Program>

In this specification, the terms “image frame”, “angle of view”, “imaging field of view”, and “composition” are used, but the definitions of the words are as follows.
The “image frame” refers to an area range corresponding to one screen in which an image can be seen, for example, and generally has an outer frame shape as a vertically or horizontally long rectangle.
The “view angle” is also called a zoom angle or the like, and represents a range within an image frame determined by the position of the zoom lens in the optical system of the image pickup apparatus. Generally, it is determined by the focal length of the imaging optical system and the size of the image plane (image sensor, film), but here, the element that can change according to the focal length is called the angle of view. The
The “imaging field of view” represents a field of view by the imaging optical system. That is, it is a range that fits in the image frame as an imaging target in the ambient scene of the imaging device. In addition to the above-mentioned angle of view, this is determined by the swing angle in the pan (horizontal) direction and the angle (elevation angle, depression angle) in the tilt (vertical) direction.
Here, “composition” is also referred to as framing, and refers to an arrangement state including the size setting of the subject in the image frame determined by the imaging field of view.

<1. Configuration of imaging system>
[1-1: Overall configuration]

The imaging system according to the embodiment includes a digital still camera 1 and a pan head 10 to which the digital still camera 1 is detachably attached.
FIG. 1 shows an example of the appearance of the digital still camera 1. 1A and 1B are a front view and a rear view of the digital still camera 1, respectively.
As shown in FIG. 1A, the digital still camera 1 includes a lens unit 21 a on the front side of the main body unit 2. The lens portion 21a is a portion that is exposed to the outside of the main body 2 as an optical system for imaging.

A release button 31 a is provided on the upper surface of the main body 2. In the imaging mode, an image (captured image) captured by the lens unit 21a is generated as an image signal. In the imaging mode, captured image data for each frame is obtained at a predetermined frame rate by an image sensor described later.
When an operation (release operation / shutter operation) is performed on the release button 31a, a captured image (frame image) at that timing is recorded on the recording medium as still image data. That is, still image capturing, generally called photography, is performed.

The digital still camera 1 has a display screen section 33a on the back side as shown in FIG.
This display screen portion 33a is referred to as a through image in the imaging mode, and an image captured by the lens portion 21a at that time is displayed. The through image is a moving image based on each frame image obtained by the image sensor, and is an image that directly represents the subject at that time.
In the reproduction mode, the image data recorded on the recording medium is reproduced and displayed.
Further, an operation image as a GUI (Graphical User Interface) is displayed according to an operation performed by the user on the digital still camera 1.
In addition, the touch panel is combined with the display screen unit 33a, so that the user can perform necessary operations by placing a finger on the display screen unit 33a.

Although illustration is omitted, the digital still camera 1 may be provided with various keys other than the release button 31a, operators such as a dial.
Further, the digital still camera 1 may be provided with a sound collection part as an audio input part 35 to be described later, an LED issuing part or a speaker part as a release notice execution part 36, and the like.

FIG. 2 is a perspective view showing the external appearance of the camera platform 10. 3 to 5 show a state in which the digital still camera 1 is placed in an appropriate state with respect to the camera platform 10 as the appearance of the imaging system of the present embodiment. 3 is a front view, FIG. 4 is a plan view, and FIG. 5 is a side view (particularly, FIG. 5B shows the movable range of the tilt mechanism in the side view).
As shown in FIGS. 2, 3, 4, and 5, the camera platform 10 is largely configured by combining a main body 11 on a grounding base 15 and further a camera base with respect to the main body 11. It has the structure where the part 12 was attached.

When the digital still camera 1 is attached to the camera platform 10, the bottom surface side of the digital still camera 1 is placed on the top surface side of the camera base 12.
As shown in FIG. 2, a projection 13 and a connector 14 are provided on the upper surface of the camera base 12. Although not shown, a hole that engages with the protrusion 13 is formed in the lower surface of the main body 2 of the digital still camera 1. When the digital still camera 1 is properly placed with respect to the camera pedestal 12, the hole and the protrusion 13 are engaged. In this state, if the panning / tilting operation of the general pan head 10 is performed, the digital still camera 1 is prevented from being displaced from or detached from the pan head 10.

  In the digital still camera 1, a connector is also provided at a predetermined position on the lower surface portion. When the digital still camera 1 is properly attached to the camera base 12 as described above, the connector of the digital still camera 1 and the connector 14 of the camera platform 10 are connected, and at least communication between them is possible. It becomes.

  For example, the position of the connector 14 and the protrusion 13 can be changed (moved) within a certain range in the camera base 12 in practice. In addition, for example, by using an adapter that matches the shape of the bottom surface of the digital still camera 1, a digital still camera of a different model can be attached to the camera pedestal 12 while being able to communicate with the camera platform 10. It has become.

Next, basic movement of the digital still camera 1 in the pan / tilt direction by the camera platform 10 will be described.
First, the basic movement in the pan direction is as follows.
In a state where the camera platform 10 is placed on a table or a floor surface, for example, the bottom surface of the grounding platform 15 is grounded. In this state, as shown in FIG. 4, the main body 11 side can rotate in the clockwise direction and the counterclockwise direction around the rotation shaft 11a. In other words, this makes it possible to change the imaging field of view in the horizontal direction (left-right direction) of the digital still camera 1 attached to the camera platform 10 (so-called panning).
In this case, the pan mechanism of the camera platform 10 has a structure in which the rotation of 360 ° or more can be freely performed in any of the clockwise direction and the counterclockwise direction.

In the pan mechanism of the pan head 10, the reference position in the pan direction is determined.
Here, as shown in FIG. 4, the pan reference position is set to 0 ° (360 °), and the rotation position of the main body 11 along the pan direction, that is, the pan position (pan angle) is set to 0 ° to 360 °. It shall be represented by

The basic movement of the camera platform 10 in the tilt direction is as follows.
As shown in FIGS. 5A and 5B, the movement in the tilt direction is obtained when the camera pedestal 12 swings the angle in both the elevation angle and the depression angle with the rotation axis 12a as the rotation center.
Here, FIG. 5A shows a state in which the camera base 12 is at the tilt reference position Y0 (0 °). In this state, the imaging direction F1 that coincides with the imaging optical axis of the lens unit 21a (optical system unit) and the grounding surface part GR that is grounded by the grounding base part 15 are parallel to each other.
In addition, as shown in FIG. 5B, first, in the elevation direction, the camera pedestal 12 has a predetermined maximum rotation angle + f ° from the tilt reference position Y0 (0 °) with the rotation axis 12a as the rotation center. Can move on. Also in the depression angle direction, it can move within the range of a predetermined maximum rotation angle −g ° from the tilt reference position Y0 (0 °) with the rotation axis 12a as the rotation center.
In this way, the camera base 12 moves within the range of the maximum rotation angle + f ° to the maximum rotation angle −g ° with the tilt reference position Y0 (0 °) as the base point, whereby the camera platform 10 (camera base 12). The imaging field of view in the tilt direction (vertical direction) of the digital still camera 1 attached to can be changed. That is, a tilting operation can be obtained.

FIG. 6 shows a rear view of the camera platform 10.
As shown in the figure, the camera platform 10 includes a power terminal t-Vin for removably connecting a power cable and a video terminal t-Video for removably connecting a video cable on the back surface of the main body 11. Is formed.

The camera platform 10 charges the digital still camera 1 by supplying power input via the power terminal t-Vin to the digital still camera 1 mounted on the camera pedestal 12 described above. Is configured to do.
That is, the pan head 10 of this example also functions as a cradle (dock) for charging the digital still camera 1.
In the case of this example, when a video signal based on, for example, a captured image is transmitted from the digital still camera 1 side, the camera platform 10 outputs the video signal to the outside via the video terminal unit t-Video. It is configured as follows.
As shown in FIG. 6 and FIG. 4, the menu button 60a is provided on the back surface of the main body 11 of the camera platform 10. By operating the menu button, menu display is performed on the display screen section 33a on the digital still camera 1 side, for example, by communication between the camera platform 10 and the digital still camera 1. This menu display allows the user to perform a required operation.

By the way, in an example as the present embodiment, a user's touch operation is adopted as one of triggers for executing an operation in a request-capable imaging mode described later.
Specifically, the user performs an operation of touching the camera platform 10. For this reason, for example, as shown in FIG. 7A, the touch region 60 b is formed on the upper surface of the main body 11. When the user touches the touch area 60b, the touch sensor mounted on the camera platform 10 detects the touch operation.
In FIG. 7, a partial area on the front side indicated by a broken line is the touch area 60 b. However, for example, the entire upper surface of the main body 11 may be the touch area 60 b.

7B shows an example in which touch areas 60b, 60c, and 60d are formed on the front surface side, the right side, and the left side, respectively, on the upper surface of the main body 11 of the pan head 10. Show. For example, three touch sensors are provided in the camera platform 10, and touch operations on the touch areas 60b, 60c, and 60d are detected by the respective touch sensors.
In this case, depending on which touch sensor has detected the touch operation, which direction the user has performed the touch operation on the imaging system side using the digital still camera 1 and the camera platform 10 from the front side, the right side, or the left side. Can be determined.
Here, the case where the three touch areas 60b to 60d are formed is illustrated, but of course, more touch sensors are provided so that the direction in which the touch operation is performed more finely can be determined in the many touch areas. It may be.

Although not shown, the camera platform 10 may be provided with a sound input unit (a sound input unit 62 described later) having a microphone and a sound input circuit system.
The camera platform 10 may be provided with an imaging unit (an imaging unit 63 described later) including an imaging lens, an image sensor, an imaging signal processing system, and the like.
Further, the pan head 10 may be provided with a light emitting display unit such as an LED, a display unit such as a liquid crystal panel, an audio output unit such as a speaker and an audio output circuit, etc. as a release notice execution unit 64 described later.
These will be sequentially described later.

[1-2: Digital still camera]

FIG. 8 is a block diagram illustrating an internal configuration example of the digital still camera 1.
The optical system unit 21 includes a predetermined number of imaging lens groups including a zoom lens, a focus lens, and the like, a diaphragm, and the like, and forms incident light on the light receiving surface of the image sensor 22 as imaging light.
The optical system unit 21 is also provided with a drive mechanism unit for driving the zoom lens, the focus lens, the diaphragm, and the like. The operation of these drive mechanisms is controlled by so-called camera control such as zoom (view angle) control, automatic focus adjustment control, and automatic exposure control executed by the control unit 27, for example.

The image sensor 22 performs so-called photoelectric conversion in which imaging light obtained by the optical system unit 21 is converted into an electric signal. For this purpose, the image sensor 22 receives the imaging light from the optical system unit 21 on the light receiving surface of the photoelectric conversion element, and sequentially accumulates signal charges accumulated according to the intensity of the received light at a predetermined timing. Output. Thereby, an electrical signal (imaging signal) corresponding to the imaging light is output.
The photoelectric conversion element (imaging element) employed as the image sensor 22 is not particularly limited. However, in the present situation, for example, a CMOS (Complementary Metal Oxide Semiconductor) sensor, a CCD (Charge Coupled Device), or the like. Can be mentioned. When a CMOS sensor is used, a device (component) corresponding to the image sensor 22 may include an analog-digital converter corresponding to an A / D converter 23 described below.

  The imaging signal output from the image sensor 22 is input to the A / D converter 23, thereby being converted into a digital signal and input to the signal processing unit 24.

The signal processing unit 24 is configured by, for example, a DSP (Digital Signal Processor), and performs predetermined signal processing according to a program on the digital imaging signal output from the A / D converter 23.
The signal processing unit 24 captures the digital imaging signal output from the A / D converter 23 in units corresponding to one still image (frame image). Then, predetermined image processing is performed on the captured image signal in units of still images, thereby generating captured image data (captured still image data) that is image signal data corresponding to one still image.
In addition, the signal processing unit 24 may perform image analysis processing for subject detection processing and composition processing described later using the captured image data acquired in this way.

Here, when the captured image data generated by the signal processing unit 24 as described above is recorded in the memory card 40 that is a recording medium as image information, for example, the captured image data corresponding to one still image is stored in the signal processing unit. 24 to the encode / decode unit 25.
The encoding / decoding unit 25 performs compression encoding on the captured image data in units of still images output from the signal processing unit 24 by a predetermined still image compression encoding method, and performs control of the control unit 27, for example. Accordingly, a header or the like is added to convert the image data into a format compressed into a predetermined format. Then, the image data generated in this way is transferred to the media controller 26.
The media controller 26 writes and records the transferred image data on the memory card 40 under the control of the control unit 27. The memory card 40 in this case is a recording medium having a configuration including a card-type outer shape conforming to a predetermined standard, for example, and having a nonvolatile semiconductor memory element such as a flash memory inside.
Note that the recording medium for recording image data may be of a type or format other than the memory card. For example, various recording media such as an optical disk, a hard disk, a semiconductor memory chip such as a flash memory chip that is detachably attached, and a hologram memory may be employed.

Further, the digital still camera 1 displays a so-called through image, which is an image currently being captured, by causing the display unit 33 to perform image display using the captured image data obtained by the signal processing unit 24. be able to.
For example, the signal processing unit 24 captures the imaging signal output from the A / D converter 23 as described above and generates captured image data corresponding to one still image. By continuing this operation, the frame in the moving image is generated. Captured image data corresponding to an image is sequentially generated. The captured image data sequentially generated in this way is transferred to the display driver 32 under the control of the control unit 27.

The display driver 32 generates a drive signal for driving the display unit 33 based on the captured image data input from the signal processing unit 24 as described above, and outputs the drive signal to the display unit 33. As a result, on the display unit 33, images based on the captured image data in units of still images are sequentially displayed.
If the user sees this, the image captured at that time is displayed as a moving image on the display unit 33. That is, a through image is displayed.

The digital still camera 1 can also reproduce the image data recorded on the memory card 40 and display the image on the display unit 33.
For this purpose, the control unit 27 designates image data and instructs the media controller 26 to read data from the memory card 40. In response to this command, the media controller 26 accesses the address on the memory card 40 where the designated image data is recorded, executes data reading, and sends the read data to the encoding / decoding unit 25. Forward.

  The encode / decode unit 25 extracts, for example, actual data as compressed still image data from the captured image data transferred from the media controller 26 under the control of the control unit 27, and decodes the compressed still image data with respect to compression encoding. Processing is executed to obtain captured image data corresponding to one still image. Then, the captured image data is transferred to the display driver 32. As a result, the image of the captured image data recorded on the memory card 40 is reproduced and displayed on the display unit 33.

Further, on the display unit 33, a user interface image (operation image) can be displayed along with the through image and the reproduced image data.
In this case, for example, the control unit 27 generates display image data as a necessary user interface image according to the operation state at that time, and outputs the display image data to the display driver 32. Thereby, the user interface image is displayed on the display unit 33.
The user interface image can be displayed on the display screen of the display unit 33 separately from the monitor image and the reproduced image of the captured image data, such as a specific menu screen. It is also possible to display the image data so as to be superimposed and synthesized on a part of the reproduced image.

The control unit 27 includes a CPU (Central Processing Unit), and constitutes a microcomputer together with the ROM 28, the RAM 29, and the like.
In the ROM 28, for example, various setting information related to the operation of the digital still camera 1 is stored in addition to a program to be executed by the CPU as the control unit 27.
The RAM 29 is a main storage device for the CPU.
Further, the flash memory 30 in this case is provided as a nonvolatile storage area used for storing various setting information that needs to be changed (rewritten) in accordance with, for example, a user operation or an operation history. It is
For example, if a non-volatile memory such as a flash memory is adopted as the ROM 28, a partial storage area in the ROM 28 may be used instead of the flash memory 30.

In the case of the present embodiment, the control unit 27 performs various imaging preparation processes for automatic imaging.
First, as subject detection processing, subject detection is performed from each frame image obtained by the signal processing unit 24 while changing the imaging field of view (or is performed by the signal processing unit 24), and a subject around the digital still camera 1 is searched. Process.
In addition, as composition processing, the optimal composition determination according to a predetermined algorithm for determining the optimal composition according to the form of the subject detected upon subject detection, and the optimal composition obtained by the optimal composition determination as the target composition Perform composition adjustment.
After these imaging preparation processes, the control unit 27 performs control and processing for executing automatic recording of captured images.
Further, prior to the execution of the image capture (release), control is also performed for a notice operation that presents the user with the image capture.
These control processes will be described later.

The operation unit 31 generates various operation elements provided in the digital still camera 1, and operation information signal output parts that generate operation information signals according to operations performed on these operation elements and output the operation information signals to the control unit 27. Are shown together.
Examples of the various controls include a release button 31a, a power button, a mode button, a zoom operation button, an operation dial, and the like omitted in FIG.
When the display unit 33 is formed as a touch panel, the touch sensor unit is also a specific example of the operation unit 31.
Further, a command signal receiving unit from the remote controller is one example of the operation unit 31.
The control unit 27 executes predetermined processing according to the operation information signal input from the operation unit 31. Thereby, the operation of the digital still camera 1 according to the user operation is executed.
Although it has been described that the touch sensor is provided on the pan head 10 earlier, as an example, a case where the touch sensor is provided on the housing of the digital still camera 1 may be considered. The touch sensor in that case is also one of the specific examples of the operation unit 31 shown in the figure.

The pan head compatible communication unit 34 is a part that executes communication according to a predetermined communication method between the pan head 10 side and the digital still camera 1 side.
For example, in a state in which the digital still camera 1 is attached to the camera platform 10, a physical layer configuration for enabling transmission / reception of communication signals to / from the communication unit on the camera platform 10 side, and a predetermined layer higher than the physical layer configuration And a configuration for realizing the corresponding communication processing. The physical layer configuration includes a connector portion connected to the connector 14 in correspondence with FIG.

  Further, in order to enable charging from the camera platform 10 side, each connector is provided with a terminal for transmitting charging power as well as a terminal for exchanging communication signals. Although not shown, the digital still camera 1 is provided with a battery mounting portion for detachably mounting a battery, and transmitted to the battery mounted on the mounting portion from the pan head 10 side. Charging based on the generated power is performed.

The digital still camera 1 may be provided with an audio input unit 35. For example, it is used when detecting input of a voice of a specific word or a specific sound (for example, a sound of clapping a hand) as a trigger input to a request-response imaging mode described later.
The sound input unit 35 includes a sound signal processing circuit including a microphone and a microphone amplifier, a sound analysis unit for determining a specific sound, and the like. The voice analysis may be executed by the control unit 27.
Further, as a determination of the release timing, the voice input unit 35 is also provided when determining the input of a voice of a specific word or a specific sound.

The digital still camera 1 may be provided with a release notice execution unit 36. This is a part for executing a release notice operation described later.
The release notice execution unit 36 may be any device unit that can present to the user that a still image is to be captured by display or voice.
For example, there may be a case where a light emitting element such as an LED and a light emission operation unit using the light emission driving circuit are used to give a notice with a predetermined light emission pattern.
Alternatively, a liquid crystal display unit or the like provided on the front side of the casing of the digital still camera 1 may be a display unit that gives a notice by specific character display, color display, pattern display, or the like.
In addition, a sound output unit including an audio signal generation unit, an amplifier, a speaker, and the like may be used as a notification with an electronic sound, a beep sound, a message sound, and the like.
Furthermore, these may be used in combination.

[1-3: pan head]

FIG. 9 shows an internal configuration example of the camera platform 10.
As shown in FIG. 6, the pan head 10 is provided with a power terminal portion t-Vin and a video terminal portion t-Video.
The electric power input through the power supply terminal unit t-Vin is supplied as operating power for each necessary unit in the pan / tilt head 10 through the power supply circuit 61. In the power supply circuit 61, charging power for the digital still camera 1 is generated, and the charging power is supplied to the digital still camera 1 via the communication unit 52 (connector).
Further, the video signal transmitted from the digital still camera 1 side is supplied to the video terminal unit t-Video via the communication unit 52 → the control unit 51.

  Here, the operating power of each part of the pan head 10 is shown as if it is supplied only via the power input terminal t-Vin. However, the pan head 10 actually has a battery mounting portion. Are provided so that the operating power of each part can be supplied from the battery attached to the attachment part.

Further, the pan head 10 of the present embodiment is provided with a connection detection unit 59 for detecting whether or not a cable is connected to the power supply terminal unit t-Vin and the video terminal unit t-Video. As a specific configuration of the cable connection presence / absence detection mechanism, for example, a configuration in which a switch is turned ON / OFF according to connection / extraction of a cable can be cited. However, in the present embodiment, the connection detection unit 59 may be configured to output a detection signal for identifying cable connection / extraction, and the specific configuration is particularly limited. Not.
Detection signals from the connection detection unit 59 (a detection signal for the power supply terminal unit t-Vin and a detection signal for the video terminal unit t-Video) are supplied to the control unit 51.

The pan head 10 is provided with the pan / tilt mechanism as described above, and as shown in FIG. 9, the pan mechanism portion 53, the pan motor 54, the tilt mechanism portion 56, and the tilt motor are shown in FIG. 57 is shown.
The pan mechanism unit 53 is configured to have a mechanism for giving movement in the pan (lateral / horizontal) direction shown in FIG. 4 with respect to the digital still camera 1 attached to the pan / tilt head 10. It is obtained by rotating the pan motor 54 in the forward and reverse directions.
Similarly, the tilt mechanism unit 56 is configured to have a mechanism for giving a motion in the tilt (vertical / vertical) direction shown in FIG. 5 with respect to the digital still camera 1 attached to the camera platform 10. The movement of the mechanism is obtained by rotating the tilt motor 57 in the forward and reverse directions.

The control unit 51 includes a microcomputer formed by combining a CPU, a ROM, a RAM, and the like, for example, and controls the movements of the pan mechanism unit 53 and the tilt mechanism unit 56.
For example, when the control unit 51 controls the movement of the pan mechanism unit 53, a signal instructing the direction to be moved and the moving speed is output to the pan driving unit 55. The pan driving unit 55 generates a motor driving signal corresponding to the input signal and outputs the motor driving signal to the pan motor 54. For example, if the motor is a stepping motor, the motor drive signal is a pulse signal corresponding to PWM control.
By this motor drive signal, the pan motor 54 rotates, for example, with a required rotation direction and rotation speed, and as a result, the pan mechanism unit 53 is also driven to move with the corresponding movement direction and movement speed.
Similarly, when controlling the movement of the tilt mechanism unit 56, the control unit 51 outputs to the tilt drive unit 58 a signal instructing the moving direction and moving speed necessary for the tilt mechanism unit 56. The tilt drive unit 58 generates a motor drive signal corresponding to the input signal and outputs the motor drive signal to the tilt motor 57. By this motor drive signal, the tilt motor 57 rotates, for example, at a required rotation direction and rotation speed, and as a result, the tilt mechanism unit 56 is also driven to move according to the corresponding movement direction and speed.

Here, the pan mechanism unit 53 includes a rotary encoder (rotation detector) 53a. The rotary encoder 53 a outputs a detection signal indicating the rotation angle amount to the control unit 51 in accordance with the rotational movement of the pan mechanism unit 53. Similarly, the tilt mechanism unit 56 includes a rotary encoder 56a. The rotary encoder 56 a also outputs a signal indicating the rotation angle amount to the control unit 51 in accordance with the rotational movement of the tilt mechanism unit 56.
As a result, the control unit 51 can acquire (monitor) information on the rotation angle amounts of the driving pan mechanism unit 53 and tilt mechanism unit 56 in real time.

The communication unit 52 is a part that performs communication in accordance with a predetermined communication method with the pan head compatible communication unit 34 in the digital still camera 1 attached to the pan head 10.
The communication unit 52 corresponds to a physical layer configuration for enabling transmission / reception of wired or wireless communication signals to / from a counterpart communication unit and a predetermined layer higher than this, like the pan / tilt head compatible communication unit 34. And a configuration for realizing communication processing. As the physical layer configuration, the connector 14 of the camera base 12 is included in correspondence with FIG.

Specifically, the operation unit 60 generates and controls an operation element as the menu button 60a shown in FIGS. 4 and 6 and an operation information signal corresponding to the operation performed on the operation element. The operation information signal output part output to the part 51 is shown collectively. The control unit 51 executes predetermined processing in accordance with the operation information signal input from the operation unit 60.
Although it has been described in FIG. 7 that the pan head 10 may be provided with a touch sensor, the touch sensor is also an example of the operation unit 60. In that case, the detection signal of the touch operation by the touch sensor is supplied to the control unit 51.
Further, when a remote controller is prepared for the camera platform 10, a command signal receiving unit from the remote controller is also an example of the operation unit 60.

The pan head 10 may be provided with a voice input unit 62. The voice input unit 62 is provided, for example, for detecting input of a voice of a specific word or a specific sound (for example, a sound of clapping a hand) as a trigger input to a request responsive imaging mode described later.
The audio input unit 62 includes an audio signal processing circuit including a microphone and a microphone amplifier, an audio analysis unit that determines a specific sound, and the like. The voice analysis may be executed by the control unit 51.
Further, as a determination of the release timing in the digital still camera 1, a voice input unit 62 may be provided on the pan head 10 side in order to cope with the case where the input of a voice of a specific word or a specific sound is determined.

The pan head 10 may be provided with an imaging unit 63. The imaging unit 63 is provided to detect a specific subject state, for example, a specific pose or line of sight of the user on the subject side, as a trigger input to the request-response imaging mode.
The imaging unit 63 includes an optical system unit, an image sensor, an A / D converter, a signal processing unit, an image analysis unit, and the like. The image analysis may be executed by the control unit 51.
Further, when determining a specific subject state as the determination of the release timing in the digital still camera 1, the imaging unit 63 may be provided on the pan head 10 side.

The pan head 10 may be provided with a release notice execution unit 64. This is a part for executing a release notice operation described later.
The release notice execution unit 64 may be any device unit that can present to the user that a still image is to be captured by display or voice.
For example, there may be a case where a light emitting unit (for example, an LED) and a light emitting operation unit by its light emitting driving circuit are used to give a notice according to a predetermined light emitting pattern or light emitting period.
Alternatively, a liquid crystal display unit or the like provided on the front side of the casing of the digital still camera 1 may be a display unit that gives a notice by specific character display, color display, pattern display, or the like.
In addition, a sound output unit including an audio signal generation unit, an amplifier, a speaker, and the like may be used as a notification with an electronic sound, a beep sound, a message sound, and the like.
Furthermore, these may be used in combination.
Note that it is also possible to perform a predetermined operation combining pan and tilt as the release notification operation. In that case, the pan mechanism unit 53 and the tilt mechanism unit 56 perform actual operations as the release notice execution unit 64.

<2. Functional configuration example>

Next, the block diagram of FIG. 10 shows an example of a functional configuration realized by hardware and software (program) for the digital still camera 1 and the camera platform 10 constituting the imaging system of the present embodiment.
This functional configuration example is a configuration that realizes an imaging control device that performs imaging operation control of the imaging system of the present example. Mainly, the hardware configuration of the control unit 27 in the digital still camera 1, the control unit 51 in the camera platform 10, and the like. And a control processing function formed by linking software modules activated by them. In FIG. 10, control functions necessary for processing in an automatic imaging mode and a request-response imaging mode, which will be described later, are shown in blocks for each function.
Although various examples of functional configurations are conceivable, FIG. 10 shows an example, and other various examples will be described later in FIG.

As shown in FIG. 10, on the digital still camera 1 (control unit 27) side, an imaging recording control unit 81, an imaging preparation processing unit 82, an imaging visual field variable control unit 83, a release notice operation control unit 84, a communication processing unit 85, A mode sequence control unit 86 and a trigger reception unit 89 are provided.
The pan head 10 (control unit 51) side includes, for example, a communication processing unit 71, a pan / tilt control unit 72, and a trigger detection unit 73.

First, on the digital still camera 1 side, the imaging / recording control unit 81 obtains an image obtained by imaging as image signal data (captured image data), and performs control processing for storing the captured image data in a recording medium. This is the part to be executed. The imaging / recording control unit 81 also performs control for reproduction, display operation of recorded still image data, display operation of a through image during imaging, and the like.
That is, the imaging / recording control unit 81 controls the optical system unit 21, the image sensor 22, the A / D converter 23, the signal processing unit 24, the encoding / decoding unit 25, the media controller 26, the display driver 32, and the like in FIG. That is, a functional part that controls basic operations of the digital still camera 1 such as instructing lens driving control of the optical system unit 21, imaging operation of the image sensor 22, imaging signal processing, recording / reproducing processing, and executing still image imaging. It is.

The imaging preparation processing unit 82 is a functional part that performs an imaging preparation process when executing an automatic imaging mode and a request-compliant imaging mode, that is, still image imaging that does not depend on a user's release operation.
One of the imaging preparation processing is subject detection processing. This is a process of confirming each frame image obtained by the signal processing unit 24 while performing pan and tilt operations by the camera platform 10 so that a subject (for example, a human face) enters the imaging field of view. For this purpose, the imaging preparation processing unit 82 performs processing such as determination of a necessary pan / tilt operation of the camera platform 10 and person detection and face detection by image analysis of frame image data.
There is a composition process as one of the imaging preparation processes. The composition processing is processing for determining whether or not the arrangement of the subject image in the imaging field of view is in an optimal state (composition determination) and adjusting the composition (composition adjustment). In order to adjust the composition, the imaging preparation processing unit 82 determines a necessary pan / tilt operation of the camera platform 10, determines whether the optical system unit 21 drives the zoom lens, and the like.

  Note that the processing function for performing image analysis for subject detection processing and composition processing described above can be executed not by the control unit 27 but by a DSP (Digital Signal Processor) as the signal processing unit 24. Therefore, the functional unit as the imaging preparation processing unit 82 can be realized by a program or instruction given to one or both of the control unit 27 and the DSP as the signal processing unit 24.

The imaging field variable control unit 83 is a functional part that controls the operation of actually changing the imaging field. The imaging field of view is changed by pan / tilt of the camera platform 10 or zoom operation of the optical system unit 21. Therefore, the imaging visual field variable control unit 83 is a functional part that performs pan / tilt control and zoom control.
When the cameraman manually captures an image using the digital still camera 1, the imaging field variable control unit 83 controls the zoom lens drive in accordance with, for example, the zoom operation of the cameraman.
Further, in the case of an automatic imaging mode and a requirement-compliant imaging mode, which will be described later, the imaging visual field variable control unit 83 performs zoom driving control, pan driving control, and tilt driving control in accordance with the determination / instruction in the imaging preparation processing unit 82. For pan drive control and tilt drive control, a pan / tilt control signal is transmitted to the camera platform 10 via the communication processing unit 85.
In particular, when performing composition adjustment or the like, a pan / tilt control signal for instructing the pan / tilt movement amount is output to the pan / tilt head 10 in accordance with the pan / tilt movement amount determined by the imaging preparation processing unit 82.
Further, the zoom operation of the optical system unit 21 is driven and controlled according to the zoom magnification determined by the imaging preparation processing unit 82.

The release notification operation control unit 84 controls a release notification execution operation to be described later.
For example, as described with reference to FIGS. 8 and 9, release notice execution units 36 and 64 may be provided in one or both of the digital still camera 1 and the camera platform 10. The release notification operation control unit 84 performs control to execute sound output, light emission output, and display output in the release notification execution units 36 and 64.
When the release notification operation is executed by the behavior of the digital still camera 1, a pan / tilt control signal is supplied to the pan head 10 side in order to realize the behavior.

The communication processing unit 85 is a part for executing communication with the communication processing unit 71 provided on the pan head 10 side according to a predetermined communication protocol.
The pan / tilt control signal generated by the imaging field variable control unit 83 is transmitted to the communication processing unit 71 of the camera platform 10 through communication of the communication processing unit 64.

The mode sequence control unit 86 controls the sequence of each mode operation when performing automatic still image imaging that does not depend on the user's release operation as the automatic imaging mode and the request corresponding imaging mode.
That is, in each of the automatic imaging mode and the request-compliant imaging mode, control processing by the imaging record control unit 81, the imaging preparation processing unit 82, the imaging visual field variable control unit 83, and the release notice operation control unit 84 is appropriately executed in a predetermined procedure. The still image capturing operation in each mode is realized.
The mode sequence control unit 86 includes a function as a “request-capable imaging control unit” in the claims of the present invention.
For example, the trigger receiving unit 89 recognizes the trigger input detected by the trigger detection unit 73 on the camera platform 10 side through communication by the communication processing units 71 and 85, and switches this from the automatic imaging mode to the request-compliant imaging mode. It is a functional part that is accepted as an input. The trigger reception unit 89 notifies the mode sequence control unit 86 of the trigger reception. The function of the trigger receiving unit 89 may be regarded as one function of the mode sequence control unit 86.

Next, on the camera platform 10 side, the communication processing unit 71 is a part for executing communication with the communication processing unit 85 on the digital still camera 1 side.
When the pan / tilt control signal is received, the pan / tilt control signal is output to the pan / tilt control unit 72.

The pan / tilt control unit 72 is an execution function of a process related to pan / tilt control among the control processes executed by the control unit 51 on the camera platform 10 side illustrated in FIG. 9, for example.
The pan / tilt control unit 72 controls the pan driving unit 55 and the tilt driving unit 58 shown in FIG. 9 according to the input pan / tilt control signal. Thereby, for example, panning and tilting for subject detection processing, panning and tilting for obtaining an optimal horizontal viewing angle and vertical viewing angle by composition processing are performed.

The trigger detection unit 73 is a functional part that detects a trigger input for shifting from the automatic imaging mode to the request-compliant imaging mode.
As an example, when the trigger input is a touch operation on the touch area 60b provided on the camera platform 10 as shown in FIG. 7, the trigger detection unit 73 has a function of detecting an input to the touch sensor. .
Further, as described above, when the trigger input is detected from the voice input unit 62 and the imaging unit 63 in FIG. 9 in addition to the touch input, processing for monitoring and detecting these trigger inputs is performed.
When the trigger detection unit 73 detects a trigger input, the trigger detection unit 73 transmits a trigger detection signal from the communication processing unit 71 to the mode sequence control unit 86 of the digital still camera 1.

<3. Automatic imaging process>

Before describing the operation sequence as the embodiment, the imaging process in the automatic imaging mode will be described with reference to FIG.
In the automatic imaging mode, the imaging system of the present example is determined to be optimum determined according to the form of the subject detected by subject detection by subject detection (search), optimum composition determination, and composition adjustment as preparation for imaging. The automatic composition adjustment operation with the target composition as the target composition is performed. Then, release processing is automatically performed under predetermined conditions. As a result, appropriate still image capturing is performed without requiring the operation of the cameraman.
FIG. 11A shows a procedure in which each functional part performs a predetermined process in accordance with an instruction from the mode sequence control unit 86 in FIG. 10 as the automatic imaging mode operation.

When the imaging operation in the automatic imaging mode is started, capturing of captured image data is started as Step F1 in FIG.
That is, the imaging record control unit 81 starts capturing captured image data for each frame by the image sensor 22 and the signal processing unit 24.

Subject detection processing is performed in step F2, and composition processing is performed in step F3.
Subject detection processing and composition processing (optimum composition determination, composition adjustment) are executed by the function of the imaging preparation processing unit 82 (specifically, the processing of the control unit 27 and / or the signal processing unit 24).

After the capturing of the captured image data is started in step F1, the signal processing unit 24 sequentially acquires frame image data corresponding to one still image as captured image data by the image sensor 22.
The imaging preparation processing unit 82 performs processing for detecting an image portion corresponding to a human face from each frame image data as subject detection processing.
The subject detection process may be executed for every frame, or may be executed for every predetermined number of frames.

In the subject detection process in this example, a face frame is set for each subject detected from within the image, for example, using a so-called face detection technique, corresponding to the area of the image portion of the face. Then, information on the number of subjects in the image frame, the size of each subject, and the position in each image frame is obtained from information such as the number, size, and position of the face frame.
Note that some face detection methods are known, but in the present embodiment, what kind of detection method is adopted is not particularly limited, and detection accuracy, design difficulty, etc. A method that is appropriately appropriate in consideration may be adopted.

As the subject detection process in step F2, first, a search for subjects existing around the digital still camera 1 is performed.
Specifically, as the search for the subject, the control unit 27 (the imaging preparation processing unit 82 and the imaging visual field variable control unit 83) in the digital still camera 1 performs pan / tilt control on the camera platform 10 and zoom on the optical system unit 21. By performing the control, for example, subject detection is performed by image analysis in the signal processing unit 24 (or the control unit 27) while changing the imaging field of view.
Such subject search is executed until a subject is detected in a frame image as captured image data. Then, the process ends when a subject (person's face) is present in the frame image, that is, in the imaging field of view at that time.

After the subject detection processing is completed, the control unit 27 (imaging preparation processing unit 82) performs composition processing in step F3.
Specifically, as composition processing, first, it is determined whether or not the composition at that time is in an optimal state. In this case, after determining the image structure based on the subject detection result (in this case, determination of the number of subjects, the subject size, the subject position, etc. in the image frame), the information on the image structure determined by the image structure determination is added. Based on this, an optimum composition is determined according to a predetermined algorithm.
Here, the composition in this case is determined by each of the pan, tilt, and zoom imaging fields of view. Therefore, depending on the determination process of whether or not the composition is the optimal composition, the subject detection result (image Information on the amount of control of pan / tilt / zoom for obtaining an optimal imaging field of view according to the aspect of the subject within the frame can be obtained.

If the composition is not in an optimal state, pan / tilt control and zoom control are performed to achieve the optimal composition state as composition adjustment.
Specifically, the control unit 27 (the imaging preparation processing unit 82 and the imaging visual field variable control unit 83) uses the pan / tilt control amount change information obtained by the optimal composition determination processing as the composition adjustment control. The control unit 51 is instructed.
In response to this, the control unit 51 of the camera platform 10 obtains a movement amount for the pan mechanism unit 53 and the tilt mechanism unit 56 according to the instructed control amount, and performs pan driving and tilt driving of the obtained movement amount. As described above, the control signal is supplied to the pan driving unit 55 and the tilt driving unit 58.
In addition, the control unit 27 (the imaging preparation processing unit 82 and the imaging visual field variable control unit 83) instructs the optical system unit 21 by instructing the optical system unit 21 of information on the angle of view for the zoom obtained by the optimum composition determination process. The zoom operation by the optical system unit 21 is executed so that the angle of view can be obtained.

  If it is determined that the composition is not in the optimum composition state and pan / tilt and zoom control is performed as composition adjustment, the process is repeated from the subject detection process in steps F3 to F2. This is because the subject may deviate from the imaging field of view due to pan / tilt and zoom operations or due to the movement of a person.

When the optimal composition is obtained, the control unit 27 (mode sequence control unit 86) performs a release timing determination process in step F4.
For example, the release may be performed on the condition that the subject is in a predetermined state such as a smile.
Note that the release timing may not be OK in the release timing determination process in step S4, but in this case, the process starts again from the subject detection in step S1. This is because the subject may be out of the imaging field of view or the composition may be lost due to the movement of the subject person.

  If it is determined that the release condition is satisfied by the release timing determination process, the captured image data is automatically recorded as the release process in step F5. Specifically, the control unit 27 (imaging / recording control unit 81) controls the encoding / decoding unit 25 and the media controller 26, and the captured image data (frame image) obtained at that time is stored in the memory card 40. Let the recording run.

As shown in FIG. 11A, in the imaging system of the present embodiment, still image imaging in the automatic imaging mode is realized based on the control / processing by the control unit 27.
Note that the processing in FIG. 11B will be described later as a fourth embodiment.

<4. Imaging Operation of First Embodiment>

In the configuration of the digital still camera 1 and the camera platform 10 in FIGS. 8 and 9, the operation as the first embodiment realized based on the functional configuration in FIG. 10 will be described with reference to FIG.
When the functional configuration of FIG. 10 is assumed, the process of FIG. 12 can be considered as the process of the control unit 27 of the digital still camera 1.

When an automatic imaging is instructed by an operation by a user, for example, a power-on operation, an operation on an operation menu screen on the display unit 33, etc., the operation of the automatic imaging mode by the system of this example is started.
In response to the start operation of the automatic imaging mode by the user, the control unit 27 (mode sequence control unit 86) advances the process from step F101 to F102 in FIG. 12, and starts the automatic imaging mode process.
That is, the control unit 27 (mode sequence control unit 86) causes the automatic still image capturing to be executed by the process of FIG.

As a behavior of the imaging system that can be actually seen by the user, the digital still camera 1 automatically performs pan / tilt operations by the pan / tilt head 10 and searches for a subject while performing a zoom operation, and captures a still image at an arbitrary time point. Will do. In other words, it seems that the camera system does not exist and the imaging system decides the subject without permission and takes a still image.
In this case, the absence of a cameraman makes it easy to capture a still image in a natural atmosphere that the user is not aware of.

Here, the control unit 27 (mode sequence control unit 86) monitors the trigger input to the request corresponding imaging mode in step F103 during the period in which the processing of the automatic imaging mode in step F102 is being executed.
Although not shown in FIG. 11A, the presence / absence of a trigger input is confirmed within the period from step F2 to step F4 in FIG.
In the first embodiment, as shown in FIG. 7A, the touch area 60b is formed on the pan head 10, and the user's touch operation on the touch area 60b is a trigger input to the request-capable imaging mode. explain.

If no trigger input is detected, still image capturing in the automatic imaging mode in step F102 is continued until it is determined in step F104 in FIG. In the period from step F2 to step F4 in FIG. 11A, in addition to confirming the presence or absence of a trigger input, the user's end operation is also monitored.
When the user performs a predetermined operation to instruct the end of automatic imaging, the control unit 27 (mode sequence control unit 86) advances the process of FIG. 12 from step F104 to F105, performs a predetermined end process, and performs a series of steps. End the operation.

When the user performs a touch operation on the touch area 60b of the camera platform 10 in the automatic imaging mode, the control unit 51 (trigger detection unit 73) in the camera platform 10 detects this, and the trigger detection signal is transmitted to the control unit 27 (trigger). To the reception unit 89 and the mode sequence control unit 86).
Upon recognizing and receiving the trigger input, the control unit 27 (mode sequence control unit 86) advances the process of FIG. 12 from step F103 to F106, and performs operation control in the request-response imaging mode.
Steps F106 to F109 are processing in the request corresponding imaging mode.

In step F106, the control unit 27 (imaging preparation processing unit 82, imaging field variable control unit 83) performs subject detection processing.
In Step F107, the control unit 27 (the imaging preparation processing unit 82 and the imaging visual field variable control unit 83) performs composition processing.
The subject detection process and the composition process are processes for determining an imaging view according to an imaging request.

As an example, the subject detection processing in step F106 and the composition processing in step F107 may be performed by the same algorithm as the subject detection processing in step F2 in FIG. 11A and the composition processing in step F3 in the automatic imaging mode. Conceivable.
Here, the request-corresponding imaging mode is a mode for capturing a still image in response to a user request. Therefore, in order to do so, it is necessary to capture the user who has performed the imaging request (touch operation) as a subject. This can be said to be processing for determining an imaging field of view according to an imaging request.
When the touch area 60b is set on the front side of the main body 11 of the pan head 10 as shown in FIG. 7A, it is assumed that the user who has made the imaging request (touch operation) is on the front side of the imaging system. Is done.
Therefore, if the subject detection algorithm is an algorithm in which the initial position is the pan state in the front direction (the pan reference position in FIG. 4) and the tilt reference position is in FIG. 5, subject detection / composition processing is performed from that state. In most cases, it is considered that the user can be captured in the imaging field of view. For this reason, the subject detection process in step F106 and the composition process in step F107 may be started from the initial state by the same algorithm as in the automatic imaging mode.

  However, in some cases, it is appropriate to perform subject detection / composition processing with an algorithm different from that in the automatic imaging mode in order to perform effective still image imaging as the requirement-compliant imaging mode. Such various examples will be described later as modified examples.

If an optimal composition is obtained in the processes in steps F106 and F107, the control unit 27 (release notification operation control unit 84) performs a release notification process in step F108.
As described in FIG. 8, when the release notice execution unit 36 is provided on the digital still camera 1 side, the control unit 27 (release notice operation control unit 84) executes a predetermined operation on the release notice execution unit 36. Let
For example, the release notice execution unit 36 executes LED blinking display, causes the LED to emit light with a specific blinking cycle and blinking pattern, generates an electronic sound, or generates a message sound such as “yes cheese”. Control.
In addition, when the release notice is expressed by a pan / tilt action, for example, when the digital still camera 1 shakes or nods, the release notice action control unit 84 instructs the imaging visual field variable control unit 83. Thus, a pan / tilt control signal for realizing such behavior is transmitted to the pan head 10 side.
Of course, you may give the release notice which used these together.
With the release notice, the user can pose or make a facial expression before the predicted release timing.

After the release notice, the control unit 27 (imaging recording control unit 81) performs release processing in step F109, and records still image data in the memory card 40.
Here, the control unit 27 (imaging / recording control unit 81) performs a release process and executes a still image imaging operation when a predetermined still image imaging condition is satisfied after the release notice operation is performed or after the start of the execution. Can be considered.
For example, when there is a specific voice input, when a specific subject state is determined from a captured image, or when a predetermined time has elapsed after the release notice operation is performed or after the start of the execution, the above-described still image capturing is performed. It is assumed that the condition is satisfied.
When there is a specific voice input, for example, a specific word uttered by the user, a clapping sound, a whistling sound, or the like is detected.
The specific subject state means that the subject captured in the composition process has become a smile, such as a specific facial expression, a specific gesture, such as waving at the imaging system, raising the hand, or clapping the hand Detecting a state of performing a behavior such as peace signing, winking or gazing toward the imaging system.
The passage of the predetermined time is, for example, the passage of a predetermined time (for example, several seconds) after the release notice operation is performed or from the start of the execution.
The control unit 27 (mode sequence control unit 86) performs necessary detection processing using these as still image capturing conditions, and when the still image capturing conditions are satisfied, the release processing (that is, the still image) is controlled by the imaging / recording control unit 81. Recording) may be performed.
After capturing the still image, the control unit 27 (mode sequence control unit 86) returns the process to step F102, ends the request-corresponding imaging mode, and performs the process as the automatic imaging mode again.

By performing the processing of FIG. 12, when a still image is being captured in the automatic imaging mode, the user may perform a touch operation when he / she wants to take a picture. Then, the still image capturing is performed according to the request of the user by the operation in the request corresponding imaging mode. At this time, the release notice is also performed, so that the user can take a picture with a facial expression, line of sight, figure, etc. that he / she wants to take.
That is, according to the present embodiment, in addition to being able to capture natural facial expressions, appearances, sights, etc. by imaging in the automatic imaging mode, imaging according to the user's request can be performed by imaging in the demanding imaging mode. You can also. That is, it is still image shooting or commemorative shooting intended by the user.
As a result, it is possible to perform various still image imaging equivalent to the case where the cameraman captures images as automatic imaging that does not require the cameraman.

<5. Modification of First Embodiment>
[5-1: Trigger to request imaging mode]

Hereinafter, various modifications of the first embodiment will be described. First, the trigger input to the request-capable imaging mode will be described here.
In the above description, an example has been described in which a user's touch operation on the camera platform 10 is recognized as a trigger operation. As the touch operation, a touch area may be provided on the housing of the digital still camera 1 and the imaging system may recognize the trigger operation when the user touches the touch area of the digital still camera 1. The functional configuration in that case will be described later with reference to FIG.

Further, as an operation for trigger input by the user, an operation button may be provided on the pan head 10 or the digital still camera 1 and the operation of the operation button may be used as the trigger input.
Furthermore, the user may be able to perform a trigger operation by an operation using a wireless or wired remote controller using infrared rays or radio waves.

Further, the trigger detection unit 73 may detect a specific voice input as a trigger input. For example, as described with reference to FIG. 9, the pan head 10 is provided with the voice input unit 62, and the control unit 51 (trigger detection unit 73) recognizes a specific voice input.
The specific voice input is a certain word, for example, a word “take a picture!” Uttered by the user, or a sound of clapping a hand.
The voice input unit 35 or the trigger detection unit 73 performs an input voice signal analysis process to determine whether or not there is a specific voice input. If there is a specific voice input, it is recognized that a trigger input has been made.
For example, in response to various trigger detections as described above, the trigger receiving unit 89 can receive a trigger to the request-capable imaging mode in the control unit 27 on the digital still camera 1 side.
Even when the control unit 27 on the digital still camera 1 side is provided with a function as a trigger detection unit in addition to the trigger reception unit 89, the audio input unit 35 described in FIG. Detection of a trigger input by such a specific voice input and reception as a trigger to the request-capable imaging mode can be performed.

Further, the trigger detection unit 73 may detect that a trigger input has been made when a specific subject state is determined from the captured image.
For example, as described with reference to FIG. 9, the camera platform 10 includes the imaging unit 63, and the control unit 51 (trigger detection unit 73) recognizes a specific subject state detected from the captured image as a trigger input.
The specific subject state may be a specific gesture, for example, a behavior such as waving a hand toward an imaging system, raising a hand, clapping a hand, performing a peace sign, or winking toward an imaging system. Alternatively, the user may be gazing at the imaging system.
The imaging unit 63 or the trigger detection unit 73 determines a user's specific gesture or determines the user's line of sight through image analysis processing of the captured image. When a specific subject state is detected, it is recognized that a trigger input has been made.
When the control unit 27 on the digital still camera 1 side is provided with a function as a trigger detection unit in addition to the trigger reception unit 89, in the course of image analysis in the signal processing unit 24, that is, subject detection processing, Since the behavior, line of sight, and the like as the specific subject state can be recognized, it is possible to detect the trigger input based on the specific subject state and accept it as a trigger to the request-capable imaging mode.

[5-2: Pan / tilt in required direction]

Next, an example of the imaging preparation process when the request-capable imaging mode is set will be described.
FIG. 13 shows a flowchart of a processing example. The same processing steps as those in FIG. 12 are denoted by the same step numbers, and description thereof is omitted.
In the process of FIG. 13, when a trigger to the request-response imaging mode is detected in step F103, the processes of steps F120 and F121 are performed prior to the start of the subject detection process of step F106.

In step F120, the control unit 27 determines the requested direction. The required direction is the direction in which the user who performed the trigger input is present, that is, the direction of the trigger input with reference to the position of the imaging system.
In step F121, the control unit 27 performs pan / tilt control in the requested direction so that the imaging direction of the digital still camera 1 is directed to the requested direction.

A specific example will be described.
For example, when a touch operation is set as a trigger input, the touch areas 60b to 60d are formed in a plurality of directions as shown in FIG.
When the control unit 51 (trigger detection unit 73) of the camera platform 10 detects a touch operation, information on which of the touch areas 60b to 60d is touched by the user (or the trigger input direction) together with the trigger detection signal. Information) is also transmitted to the control unit 27 (trigger reception unit 89, mode sequence control unit 86) of the digital still camera 1. Accordingly, the control unit 27 performs the requested direction determination in step F120.
After determining the trigger input direction, the control unit 27 (the imaging preparation processing unit 82 and the imaging visual field variable control unit 83) determines that the imaging direction of the digital still camera 1 is directed to the trigger input direction (required direction) in step F121. Output pan / tilt control signals. As a result, pan / tilt operation is performed on the camera platform 10 side, and the digital still camera 1 faces in the direction in which the user is present.

That is, as the imaging preparation process, first, the digital still camera 1 is directed in the required direction as if the user's request was answered.
From this state, the control unit 27 (the imaging preparation processing unit 82 and the imaging visual field variable control unit 83) performs subject detection / composition processing in steps F106 and F107.
This makes it easy to capture the user who requested the imaging and easily capture a still image desired by the user.

Such processing is also possible when the trigger input is an audio input.
For example, a plurality of microphones are prepared in the voice input unit 35 (or 62), and the direction in which the above-described specific voice input is generated is determined from the time difference between the voice signals obtained by the microphones.
In step F120, the control unit 27 discriminates the direction in which the user who made the request from the voice input exists in this way, thereby enabling pan / tilt control in the requested direction in step F121.
The actual behavior is such that the imaging system reacts to the user's call and turns to the user, and thereafter, still image imaging including the user is performed in the processing of steps F106 to F109.

[5-3: Example in which subject detection is not performed in request-capable imaging mode]

Examples of processing in which subject detection is not performed in the request-capable imaging mode are shown in FIGS. The same processing steps as those in FIG. 12 are given the same step numbers.
First, the processing example in FIG. 14 is an example in which when the trigger input is received in step F103, the control unit 27 performs the composition processing in step F107 in the state of the imaging field of view without performing subject detection.
For example, only zoom control is performed as the composition processing in step F107. Then, still image capturing is performed by the processing of steps F108 and F109.

This is a processing example that assumes a case where the user performs a trigger input in order to have the digital still camera 1 take a certain direction when the digital still camera 1 faces in a certain direction.
For example, during the automatic imaging mode, when a user who is viewing a through image on the display screen unit 33a on the back of the digital still camera 1 enters an imaging field of view that is not regarded as a subject, particularly by subject detection processing, This is useful when you want to take a picture of it. In view of such an application, it is also preferable not to perform the release notice process in step F108.

Next, the processing example of FIG. 15 is an example in which the pan / tilt control in the required direction described in FIG. 13 is combined.
When the trigger input is accepted in step F103, the control unit 27 determines the requested direction in step F120. In step F121, pan / tilt control in the required direction is performed so that the imaging direction of the digital still camera 1 is directed to the required direction.
Thereafter, the control unit 27 performs composition processing in step F107, and performs still image capturing in steps F108 and F109.
In the case of this processing example, since the digital still camera 1 is directed in the required direction, an operation is performed in which only the composition (for example, only the zoom angle) is adjusted and imaged.

[5-4: Example in which composition processing is not executed in request-capable imaging mode]

A processing example in which the composition processing is not executed in the request-capable imaging mode is shown in FIG. The same processing steps as those in FIG. 12 are given the same step numbers.
First, in the processing example of FIG. 16, when a trigger input is received in step F103, the control unit 27 performs subject detection. For example, if the user's face enters the imaging field and the subject detection is OK, composition processing is not performed. In step F108, a release notice process is performed. In step F109, a still image capturing process is performed.

This is processing that assumes a case where the user wishes to perform still image imaging regardless of composition during the automatic imaging mode.
In particular, when the subject detection is OK (for example, when a person is captured in the imaging field of view), it can be applied as an operation when the user desires to capture an image immediately.
In view of such an application, it is also preferable not to perform the release notice process in step F108.

[5-5: Presented image in request-capable imaging mode]

FIG. 17 shows a processing example in which a captured image is presented to the user when a still image is captured in the request-compatible imaging mode. 17, steps F101 to F109 are the same as those in FIG.
In the processing example of FIG. 17, the release process is performed in step F109 and the still image data is recorded in the memory card 40, and then the control unit 27 performs the captured image presentation process in step F130.

In step F130, the control unit 27 (mode sequence control unit 86, imaging / recording control unit 81) causes the display unit 33 to display still image data recorded by the release process.
Then, the control unit 27 (imaging visual field variable control unit 83) transmits a pan / tilt control signal to the camera platform 10 side. In this case, an instruction to drive 180 degrees in the pan direction is output to at least the pan head 10. At the same time, an instruction for tilt driving by a predetermined angle in the elevation direction may be provided.
On the pan head 10 side, the control unit 51 (pan / tilt control unit 72) performs pan / tilt drive control in accordance with the pan / tilt control signal.
As a result, the digital still camera 1 on the pan head 10 rotates 180 degrees.

According to this process example, the display unit 33 (display screen unit 33a) is directed to the user immediately after the user who has requested the request-capable imaging mode is imaged. That is, immediately after the release, the image content copied to the user is presented.
As a result, the user can easily confirm on the spot what kind of still image was taken.
Note that step F130 in FIG. 17 may be added to the processes in FIGS. 13, 14, 15, and 16.

[5-6: Temporary composition processing]

Next, an example in which the temporary composition process is performed in the composition process in step F107 in the request-capable imaging mode in each example of FIGS. 12 to 15 or 17 will be described.

First, basic composition processing that is executed in the automatic imaging mode and the requirement-compliant imaging mode will be described.
Assume that captured image data of the image content shown in the image frame 300 of FIG. As the image content of the captured image data, there is one subject as a person.

The image frame 300 in this case corresponds to an image area corresponding to one frame of the captured image data. Here, it is assumed that the frame image as the image frame 300 is formed by Cx = 320 and Cy = 240, where the horizontal pixel number (horizontal image size) is Cx and the vertical pixel number (vertical image size) is Cy. Yes.
Further, the position in the image frame 300 in this case is represented by coordinates (X, Y), and here, the upper left corner of the image frame 300 is defined as coordinates (0, 0).
In addition, a vertical reference line Ld1 and a horizontal reference line Ld2 are virtually set for the image frame 300.
The vertical reference line Ld1 is a straight line that passes through the midpoint of the image frame 300 in the horizontal direction, and the horizontal reference line Ld2 is a straight line that passes through the midpoint of the image frame 300 in the vertical direction. The vertical reference line Ld1 and the horizontal reference line Ld2 are reference lines when moving the position of the subject in the image frame 300 in the horizontal / vertical direction, respectively, as composition control.
Further, the intersection coordinates (160, −120) of the vertical reference line Ld1 and the horizontal reference line Ld2 are handled as the reference point P in the composition control.

By performing subject detection (face detection) on the captured image data having the image content shown in FIG. 18, the face of one subject SBJ shown in the figure is detected as the detected subject. That is, one face is detected here by detecting one face by the face detection process. As a result of detecting the subject in this manner, for example, information on the number, orientation, position, and size of the subject is obtained.
For the number of subjects, for example, the number of faces detected by face detection may be obtained. In the case of FIG. 18, since one face is detected, a result that the number of subjects is 1 is obtained.

When subject detection is performed using a face detection method, a frame (face frame FR) is set as the detection result for the face portion of the detected subject.
In FIG. 18, the face frame FR is arranged so as to correspond to the face portion of the image of the subject SBJ. The face frame FR in this case is arranged in a square shape corresponding to the face image portion in the detected subject. Here, the face frame FR is assumed to be a square.
The face frame FR is set for the image portion as a face in the image frame 300. Accordingly, the position and size of the face frame FR in the image frame 300 are also changed and set according to the position and size of the face of the subject in the image frame 300 detected by the face detection process at that time.

Regarding the position information for each subject, at least the subject gravity center G (X, Y) that is the center of gravity of the subject SBJ in the image as the captured image data is obtained.
As for how to set the subject gravity center G, for example, a known subject gravity center detection method can be adopted. As one example, the intersection of square diagonal lines as the face frame FR detected corresponding to the subject SBJ can be considered as the subject center of gravity.

The size of the subject is represented here by the size (number of pixels) of one side of the face frame FR in the vertical or horizontal direction.
FIG. 18 shows a state where the vertical size size = 32 of the face frame FR is detected as an example.

In addition, regarding the face direction for each subject here, it is detected, for example, which of the three directions of left, front, and right.
It is assumed that the subject SBJ in FIG. 18 is detected as being front in the face direction.

Here, based on the subject detection information for the subject SBJ detected as shown in FIG. 18, it is assumed that a determination result that the composition shown in FIG.
That is, first, the composition is such that the subject size is set to size = 64, and the subject gravity center G is located at G (160, −120 + Δy).

  For example, although it varies depending on the number detected, in order to obtain a good composition, the size of the subject in the image frame 300 is not too small or too large, and is required to be appropriate. The subject size when size = 64 shown in FIG. 19 is determined as a value at which the subject SBJ has the optimum size in the image frame 300.

Further, the arrangement position of the subject gravity center G is obtained on the following basis, for example.
When there is one subject SBJ, the simplest and basic position of the subject SBJ is arranged at the center of the image frame 300. That is, the subject gravity center G is positioned at the reference point P.
However, a composition in which such a subject is positioned at the center of the screen is generally a typical bad composition. For example, a good composition can be obtained by shifting the position of the subject according to a rule existing from the center of the screen as represented by the three-division method or the golden rate method.

Therefore, in this case, first, the position of the subject SBJ (subject gravity center G) in the vertical direction of the image frame 300 is moved by a certain amount with respect to the horizontal reference line Ld2.
As described above, the movement amount about the subject gravity center G in the vertical direction with respect to the horizontal reference line Ld2 is defined as the vertical offset amount Δy. The vertical offset amount Δy and a horizontal offset amount Δx described later can be expressed by, for example, the number of pixels. In this case, the Y coordinate of the subject gravity center G in FIG. 19 is expressed as (−120 + Δy).
Here, a positive value is given as the vertical offset amount Δy, so that the subject gravity center G is positioned in a region above the horizontal reference line Ld2 in the image frame 300 as shown in the figure. ing.

The position of the subject in the horizontal direction is based on the face direction detected for the subject.
As described with reference to FIG. 18, the face direction of the subject SBJ in this case is detected as being the front among the three stages of right, front, and left.
Here, when the face direction of one subject SBJ is detected to be the front, the horizontal direction is positioned at the center. That is, the X coordinate of the subject gravity center G is set to the same X coordinate (160) as the middle point in the horizontal direction, that is, the vertical reference line Ld1 (reference point P).
In this case, the horizontal offset amount Δx, which is defined as the amount of movement of the subject gravity center G in the horizontal direction with respect to the vertical reference line Ld1, is set to zero.
FIG. 19 shows the subject gravity center G (160, −120 + Δy) set in accordance with such composition determination rules and algorithms.

Eventually, the process of adjusting the composition from the state of FIG. 18 to the state of FIG. 19 in this way places the center of gravity of the subject's face within a predetermined target range by pan / tilt operation, and makes it It is a process to make the size. The target range is set according to the size, number, face orientation, etc. of the subject SBJ.
For example, in the case of FIG. 19, since the face is the front, the target range TA is set as shown in FIG. 20A, and the subject gravity center G is included in the target range TA.
The horizontal offset amount Δx and the vertical offset amount Δy are determined according to the setting of the target range TA, and the composition is adjusted so that the subject gravity center G is finally within the target range TA.

FIG. 20A shows an example when the face direction of the subject SBJ is the front, but the target range TA is set differently depending on the face direction.
For example, assume that the face direction of the detected subject is left. Here, the left face direction means that the face of the individual subject SBJ is facing the left side in the image frame 300 from the person who sees the image content of the image frame 300 when actually viewing the image content. The state that can be seen. Incidentally, the actual person himself / herself as the individual subject SBJ is actually facing the right side from the front facing the direction opposite to the imaging device that has performed the imaging.
In this case, with respect to the position of the subject gravity center G in the horizontal direction, among the left and right image areas (divided areas) divided into two by the vertical reference line Ld1, It is made to be in the image area on the “right” side. Thereby, in the image frame 300, a space is obtained on the left side, which is the direction in which the face of the subject SBJ is facing.

That is, as shown in FIG. 20B, the target range TA is set in the right image area by the vertical reference line Ld1. Then, the subject gravity center G is set within the target range TA.
By adopting such a composition, for example, the center of gravity G of the subject SBJ whose face direction is left is set as the subject position corresponding (matched) to the center of the screen in the left-right direction, or the vertical reference A better composition can be obtained as compared with the case where the image area is in the left direction with respect to the line Ld1.
When the detected face direction of the subject is right, contrary to the case of the left, the left side of the left and right image regions (divided regions) in which the subject gravity center G is divided into two by the vertical reference line Ld1. To be in the image area.

In addition, when a plurality of subjects are detected, an image area composed of the detected plurality of subjects is regarded as a group of comprehensive subjects (total subjects), and one target is set for the total subjects. A subject gravity center (total subject gravity center) GG is obtained.
For example, FIG. 21A shows an example in which two subjects SBJ1 and SBJ2 are detected. The centroids of the centroids G1 and G2 of the subjects SBJ1 and SBJ2 are the total subject centroid GG12.
It is assumed that the target range TA is set to the position shown in the figure based on the number of subjects, the orientation of the face, and the size.
In this case, composition adjustment is performed so that the total subject center of gravity GG12 falls within the target range TA, as indicated by a broken-line arrow.
As a result, the composition is as shown in FIG.

There are several ways to set the total subject gravity center G. FIG. 21 shows, as the simplest example, an intermediate point on a line segment connecting the centroids (G1, G2) of the leftmost and rightmost subjects in the image frame 300 among a plurality of detected individual subjects. The points are set as the total subject gravity center GG12.
When there are a plurality of subjects, the detected face direction may differ for each individual subject. In this case, one face direction as an overall subject may be determined based on the relationship between the face directions detected for each of a plurality of individual subjects. As a relationship of face directions detected for each of a plurality of individual subjects, when the number of the same face directions occupies a predetermined ratio or more in the total number of individual subjects, The face direction of the subject is determined and used for composition determination and setting of the target range TA.

As can be understood from the above description, the target range TA in which the subject gravity center (or the total subject gravity center) is arranged is determined by the subject size, number, and orientation. Whether or not the composition is optimal is determined by whether or not the subject center of gravity (or the total subject center of gravity) is in the target range TA. It is also determined whether or not the subject size in the image frame 300 is appropriate.
If it is determined that the composition is not optimal, as the composition adjustment process, the position of the subject gravity center G is changed so that the subject gravity center (or the total subject gravity center) falls within the target range TA, or the subject size is appropriate. Will be resized to be.
The position of the subject gravity center G (or the total subject gravity center GG) is changed by pan control with respect to the pan mechanism of the camera platform 10 in the horizontal direction. Further, the vertical direction is performed by tilt control with respect to the tilt mechanism of the camera platform 10.
The subject size is changed by control (zoom control) of moving the zoom lens in the optical system unit 21 of the digital still camera 1. Alternatively, it can be performed by image signal processing such as image cut-out for captured image data.

  The above is the basic composition process. For example, in the case of the process of FIG. 12, the above process is performed in the composition process (step F3 of FIG. 11A) in the automatic imaging mode of step F102.

However, in the case of performing control to move the subject gravity center G to the target range TA described above, even if an optimal composition is obtained within the imaging field of view at that time, there is actually a more appropriate composition. There is.
For example, even if there are a plurality of people in the vicinity, there is a possibility that the composition is adjusted with a small number of people and the composition with the maximum number of people is not achieved.

An example is shown in FIG.
The imaging field of view indicated by the image frame 300A in FIG. 22 is the optimum composition as a local solution. That is, when two subjects SBJ1 and SBJ2 are detected in the subject detection process even though there are three close positions, the total subject gravity center GG12 of the two subjects SBJ1 and SBJ2 is set to the target range TA (300A ).
However, in this case, the imaging field of view as the best solution is the state shown as the image frame 300B. That is, in this state, the subject SBJ1, SBJ2, and SBJ3 are included, and the total subject gravity center GG123 is within the target range TA (300B) in the image frame 300B.

  If, in the course of subject detection processing, a search that tilts up from below is performed and two subjects SBJ1 and SBJ2 are detected first, the composition processing is performed with only the two subjects SBJ1 and SBJ2. The still image is captured with the composition as the local solution.

Similarly, FIG. 23A shows an image frame 300A having a local composition and an image frame 300B having the best solution.
Assuming that in the process of subject detection, a search that pans from the left to the right is performed, and if two subjects SBJ1 and SBJ3 are detected first, only the two subjects SBJ1 and SBJ3 are detected. Composition processing is performed, and still image capturing is performed with composition as a local solution.

For example, in the case of imaging in the automatic imaging mode, even if still image imaging is performed with a composition as a local solution, there is no problem. This is because the image is originally taken without the user being aware of it.
However, in the request-corresponding imaging mode, the composition as the local solution tends to fail to meet the user's request.
For example, as shown in FIG. 22 and FIG. 23 (a), three users gather together in order to take a picture and perform trigger input. In that case, a commemorative photo was taken with three people, but in the state of the local solution, one person was not photographed. If you try to put as many people as possible, you need to look around them once.

Therefore, as an example of the embodiment, in the composition processing in the request-response imaging mode, when one or more subjects corresponding to the imaging request are detected in the imaging field, the imaging field is further moved to meet the imaging request. In addition, a process for confirming the presence of another subject is included.
As a specific example, as a composition adjustment process, a two-stage process of a temporary composition adjustment and a main composition adjustment described below is performed.

The temporary composition adjustment is a process of searching for another subject before panning and tilting to a target composition as the main composition in composition adjustment. For example, the pan / tilt amount is intentionally performed exceeding the target range TA of the main composition to search for other subjects.
The actual processing is performed by changing the target range TA between the temporary composition adjustment and the main composition adjustment.

The temporary composition adjustment will be described with reference to FIG.
FIG. 24A shows an example in which three subjects SBJ1, SBJ2, and SBJ3 exist. Here, it is assumed that in the subject detection process, two subjects SBJ1 and SBJ2 are detected in the process of tilting from below to above.
Here, although composition processing is started, first, temporary composition adjustment is performed.
In this case, as shown in the figure, the target range TA is set to be lower in the image frame 300 than in the normal composition adjustment described above.
First, since the subjects SBJ1 and SBJ2 are detected, the composition adjustment is performed by performing pan / tilt control so that the total subject gravity center GG12 of the subjects SBJ1 and SBJ2 falls within the target range TA. In the case of this example, the tilt is increased so that the total subject gravity center GG12 falls within the target range TA.
However, in this case, since the target range TA is set lower than usual, the amount of tilt-up is larger than that in the case of normal composition adjustment, and tilted up further upward.
Then, a new subject SBJ3 is detected in the process.

In this case, composition processing is performed again in response to detection of the subjects SBJ1, SBJ2, and SBJ3. Also in this case, first, temporary composition adjustment is performed. This time, the total subject gravity center GG123 of the subjects SBJ1, SBJ2, and SJB3 is tilted up so as to be within the target range TA.
If no other subject exists above the subject SBJ3, the temporary composition adjustment is completed as shown in FIG.

When the temporary composition adjustment is completed, the main composition adjustment is performed next. The main composition adjustment here is the normal composition adjustment described above.
FIG. 25A shows the image frame 300 in a state where the temporary composition adjustment has been completed. At the time of this composition adjustment, the target range TA is set to the normal position shown in the figure. That is, in this case, the target range TA used in the temporary composition adjustment is reset upward in the image frame 300.
Then, pan / tilt control is performed so that the total subject gravity center GG123 falls within the target range TA. In this case, tilt down control is performed.
Then, the state shown in FIG. 25B is reached, and the overall subject center of gravity GG123 is within the target range TA, so that the main composition adjustment is completed.
Eventually, when this main composition adjustment is completed, an optimal composition including three subjects SBJ1, SBJ2, and SJB3 is obtained.

For example, as described above, in the provisional composition adjustment, the target range TA is positioned in front of the image frame 300 with respect to the position different from the normal, specifically, the change direction of the imaging field of view, according to the search direction in the composition adjustment. Set to the position where As a result, it is slightly over the composition to be finally adjusted. Thus, it is confirmed whether or not another subject exists in the search direction range.
In the examples of FIGS. 24 and 25 described above, the tilt range is increased at the time of temporary composition adjustment. Therefore, the target range TA at the time of temporary composition adjustment is set lower than usual.
Assuming a case where panning is performed from right to left at the time of temporary composition adjustment and the target range TA in the main composition is on the vertical reference line Ld1, temporary composition adjustment is performed as shown in FIG. In this case, the target range TA is on the right side of the vertical reference line Ld1. As a result, it can be confirmed whether or not there is a subject on the left side.
Also, assuming that the target range TA in the main composition is on the vertical reference line Ld1 when panning from left to right at the time of temporary composition adjustment, the temporary composition is as shown in FIG. The target range TA at the time of alignment is set to the left side of the vertical reference line Ld1. Thereby, it can be confirmed whether or not a subject exists on the right side.

As described above, by setting the target range TA different from the main composition adjustment and performing the temporary composition adjustment, and then performing the main composition adjustment, it is possible to capture a still image with no subject leakage. That is, it is possible to take a still image for the maximum number of subjects.
In the process of panning / tilting in the provisional composition adjustment, when the face of a certain subject that has been detected falls on the edge area of the image frame, it is possible to perform no further pan / tilt control. .
In addition, even if the center of gravity changes depending on the orientation of the face during the main composition adjustment, the orientation of the face may be ignored in the provisional composition adjustment.
A representative example of a subject is a person's face. When a region of interest other than a person's face can be extracted as in the subject SJB4 in FIG. 23B, the composition is adjusted by combining them. It is also possible to do.

27 and 28, a process when the temporary composition adjustment is applied to the process of FIG. 12 will be described.
FIG. 27A shows subject detection processing and composition processing performed as steps F2 and F3 of FIG. 11A when the operation in the automatic imaging mode is performed as step F102 of FIG.
Here, in the composition process in the automatic imaging mode, the provisional composition adjustment is not performed. However, in the request-capable imaging mode, as an example in which an algorithm different from the composition process in the automatic imaging mode is adopted, the process in which the provisional composition adjustment is performed An example is given.

First, as the subject detection processing in step F2 in the automatic imaging mode described in FIG. 11A, in step F201 in FIG. 27A, the control unit 27 (imaging preparation processing unit 82) has detected the subject. Confirm whether or not.
If no subject is detected, the control unit 27 (imaging preparation processing unit 82) executes a search process in step F202. In step F201, it is confirmed whether or not a subject is detected.
Specifically, as described above, the processes in steps F201 and F202 are performed by the control unit 27 (the imaging preparation processing unit 82 and the imaging visual field variable control unit 83) with respect to the pan / tilt control for the camera platform 10 and the optical system unit 21. By performing zoom control, it is a process of confirming whether or not subject detection has been performed by image analysis in the signal processing unit 24 (or control unit 27) while changing the imaging field of view.

When the subject is detected, the control unit 27 (imaging preparation processing unit 82) confirms whether or not the composition is the optimum composition in step F203 in FIG. 27A as the composition process in step F3 in FIG. The composition adjustment process in F204 is performed.
This is the normal composition process described above, for example, the process described with reference to FIGS.
That is, after determining the image structure based on the subject detection result (determination of the number of subjects in the image frame, the subject size, the face orientation, etc.), the image structure is determined based on the image structure information determined by the image structure determination. It is determined whether the composition is optimal according to the algorithm. If the composition is not optimal, the imaging field of view is varied by pan / tilt / zoom control as composition adjustment.
As described above with reference to FIG. 11, when pan / tilt and zoom control is performed as composition adjustment, the processing is repeated from the subject detection process in steps F3 to F2. In FIG. 27A, when the composition is adjusted in step F204, the process starts again from step F201.

The composition adjustment in step F204 is a normal composition adjustment process.
FIG. 28 (a) shows an example of a normal composition adjustment procedure.
In step F300, the control unit 27 sets a target range TA for obtaining an optimal composition. For example, the target range TA is set as shown in FIG.
Next, in step F301, the control unit 27 determines the horizontal offset amount Δx according to the set target range TA.
Next, in step F302, the control unit 27 executes pan control so that the subject gravity center G (or the total subject gravity center GG) is positioned on the X coordinate corresponding to the determined horizontal offset amount Δx.

  Subsequently, in step F303, the control unit 27 determines the vertical offset amount Δy with respect to the target range TA. In step F304, tilt control is executed so that the subject gravity center G (or the total subject gravity center GG) is positioned on the Y coordinate corresponding to the determined vertical offset amount Δy.

Next, in step F305, the control unit 27 determines the zoom magnification Z.
As described above, the size of the subject SBJ in the image frame 300 is changed by changing the angle of view by zoom control. The zoom magnification here refers to a magnification of an angle of view necessary for obtaining a subject size determined in accordance with an optimal composition from a subject size when the subject is detected by subject detection processing.
For this purpose, the control unit 27 first determines a target subject size (zoom control target value) required as an optimum composition according to a predetermined rule according to the detected subject condition.
Then, the ratio between the target subject size size_trg obtained as described above and the subject size size_org (the size (number of pixels) of one side in the vertical direction (or horizontal direction) of the face frame FR) obtained during the subject detection processing is calculated. This is determined as the zoom magnification Z. That means
Z = size_trg / size_org
Thus, the zoom magnification Z is calculated.
In step F306, the control unit 27 executes zoom control with the zoom magnification Z.

  The composition adjustment procedure in FIG. 28A is merely an example. For example, the pan / tilt control may be performed after the zoom control is performed first. Also, the horizontal offset amount Δx and the vertical offset amount Δy can be calculated in consideration of the change in the size of the subject due to the zoom magnification.

In the automatic imaging mode, composition processing is performed as described above with reference to FIGS. 27 (a) and 28 (a).
On the other hand, the composition process executed in step F107 of FIG. 12 in the request-capable imaging mode is as follows.

FIG. 27B shows subject detection processing and composition processing performed as steps F106 and F107 in FIG.
First, as subject detection processing in step F106, in step F201, the control unit 27 (imaging preparation processing unit 82) confirms whether or not a subject has been detected.
If no subject is detected, the control unit 27 (imaging preparation processing unit 82) executes a search process in step F202. In step F201, it is confirmed whether or not a subject is detected.
The processes of steps F201 and F202 are the same as steps F201 and F202 of FIG.

When the subject is detected, the control unit 27 (imaging preparation processing unit 82) first performs a temporary composition process as the composition process in step F107 of FIG. That is, in step F210, confirmation is made as to whether or not the composition is optimal as a temporary composition, and provisional composition adjustment processing is performed in step F211. This is, for example, the processing described with reference to FIGS.
That is, after determining the image structure based on the subject detection result (determination of the number of subjects in the image frame, subject size, face orientation, etc.), the target range TA as a temporary composition is determined. Then, it is determined whether or not the optimal composition is optimum. If the optimum composition is not optimum, the imaging field of view is varied by pan / tilt / zoom control as provisional composition adjustment.

Even when pan / tilt and zoom control is performed as the temporary composition adjustment, the process returns to step F201 and starts again from the subject detection. This is because the subject may not exist due to the change in the imaging field of view or the movement of the user.
Further, as described above, the provisional composition adjustment swings the imaging field of view more than the normal composition adjustment, and therefore, a new subject may be detected. In that case, temporary composition adjustment is performed based on the subject gravity center G (or the total subject gravity center GG) including the new subject again.

FIG. 28B shows an example of the procedure for provisional composition adjustment in step F211.
In step F310, the control unit 27 sets a target range TA for obtaining a temporary composition. For example, as described in FIGS. 24 and 26, a target range TA different from the original target range TA is set according to the search direction.
The subsequent steps F311 to F316 are the same as steps F301 to F306 in FIG. 28A as the normal composition adjustment.

That is, in step F311, the horizontal offset amount Δx is determined according to the set temporary composition target range TA.
Next, in step F312, the control unit 27 performs pan control so that the subject gravity center G (or the total subject gravity center GG) is positioned on the X coordinate corresponding to the horizontal offset amount Δx.
Subsequently, in step F313, the control unit 27 determines the vertical offset amount Δy with respect to the temporary composition target range TA. In step F314, tilt control is executed so that the subject gravity center G (or the total subject gravity center GG) is positioned on the Y coordinate corresponding to the vertical offset amount Δy.
Next, the control unit 27 determines the zoom magnification Z in step F315.
Then, in step F316, the control unit 27 executes zoom control with the zoom magnification Z.

  The temporary composition adjustment procedure in FIG. 28B is also an example. For example, the pan / tilt control may be performed after the zoom control is performed first. Also, the horizontal offset amount Δx and the vertical offset amount Δy can be calculated in consideration of the change in the size of the subject due to the zoom magnification.

When such a temporary composition adjustment is performed and the temporary composition becomes OK in step F210 of FIG. 27B, that is, when the subject gravity center G (or the total subject gravity center GG) is positioned within the target range TA for the temporary composition. Subsequently, processing of the main composition in steps F212 and F213 is performed. That is, it is a normal composition process.
The processing of the main composition in steps F212 and F213 is the same as steps F203 and F204 in FIG. Further, the main composition adjustment procedure in step F213 is as shown in FIG.

As described above, in the request-capable imaging mode, composition processing is performed in two stages: provisional composition adjustment and main composition adjustment.
Thereby, as a still image capturing according to the user's request, an image desired by the user with the maximum number of subjects within the angle of view can be automatically captured.
As an example of the provisional composition matching method, the example in which the target range TA is set on the near side in the search direction has been described. However, other specific methods are conceivable.
For example, when a subject is detected, it is conceivable that a composition is temporarily set with the subject, and then the presence or absence of another subject is confirmed by searching around the subject. Alternatively, an example of simply searching around the subject when a subject is detected can be considered.

[5-7: Control method in other demanding imaging mode]

Up to this point, each example has been described as a modification of the first embodiment. In particular, these are imaging preparation processes or imaging preparations that are performed in a control method different from that in the automatic imaging mode in the requirement-compliant imaging mode. Examples of subject detection processing and composition processing in the processing are given.
In addition to the above examples, various control methods can be considered in the request-capable imaging mode, such as processing procedures, algorithms, or control parameter settings that are different from those in the automatic imaging mode.

  In the request-capable imaging mode, for example, a situation where a plurality of users gather to request still image imaging is also assumed. In this case, it is conceivable to limit the zoom control range in the composition processing process in the sense of capturing as many users as possible. Specifically, the zoom control upper limit parameter is changed.

It is also conceivable that the judgment condition for the optimum composition is made sweet. For example, in the request corresponding imaging mode, the range of the frame as the target range TA is widened.
Alternatively, the time during which the subject gravity center G exists within the target range TA may be shortened. For example, in steps F203, F210, and F212 in FIG. 27, it is determined that the composition is OK because the subject center of gravity G exists within the target range TA for a predetermined time or longer. When performing F212, the predetermined time is a short time.
These are due to the fact that there is little movement on the user's side because they are imaged according to the user's request.

In the subject detection process in step F106 of FIG. 12 in the request-capable imaging mode, it is conceivable to limit the panning range and the tilting range in order to make it easier to find the requested user. This is a technique for avoiding catching a user other than the user who made the request as a subject when the position of the requested user is known to some extent (for example, when the above-mentioned request direction can be recognized).

<6. Imaging Operation of Second Embodiment>

FIG. 29 shows the imaging operation control of the second embodiment.
Steps F101 to F107 are the same as those in FIG.
In the second embodiment, the control unit 27 performs the subject detection process in step F106 and the composition process in step F107 in the request-capable imaging mode, and then does not perform the release notice. This is an example of performing a release.

For example, as indicated by a solid line in the flowchart, when the composition process in step F107 is OK, the control unit 27 (mode sequence control unit 86) performs a release timing determination process as step F108A.
If it is determined that the release timing is reached, the process proceeds to step F109 to perform a release process. After the release process, the process returns to the automatic imaging mode in step F102.

The release timing determination process is a process for determining whether or not a predetermined still image capturing condition is satisfied, and various examples are conceivable.
For example, release timing determination by time can be considered. For example, the elapse of a predetermined time (for example, a few seconds) from the time when the composition process becomes OK is set as a still image capturing condition. In that case, the control unit 27 (mode sequence control unit 86) counts a predetermined time in step F108A, and executes release processing under the control of the imaging / recording control unit 81 in step F109 when the predetermined time elapses.

Further, it may be determined that the still image capturing condition is satisfied when there is a specific voice input.
For example, a specific word generated by the user, a clapping sound, a whistling sound, or the like is set as a specific sound as a still image capturing condition.
In step F108A, the control unit 27 (mode sequence control unit 86) detects the input of these specific sounds.
Then, when these specific sounds are confirmed from the analysis result of the input audio signal from the audio input unit 35, it is determined that the release timing has come, and in step F109, the release process under the control of the imaging / recording control unit 81 is executed.

Further, when a specific subject state is determined from the captured image, it may be determined that the still image capturing condition is satisfied.
In step F108A, the control unit 27 (mode sequence control unit 86) monitors the presence or absence of a specific subject state detected by analyzing the captured image.
The specific subject state means that the subject captured in the composition process has become a smile, such as a specific facial expression, a specific gesture, such as waving at the imaging system, raising the hand, or clapping the hand A state in which a behavior such as peace signing or winking toward the imaging system is performed can be considered. Alternatively, the user who is the subject may be gazing at the imaging system.
The control unit 27 determines a specific state of these users by image analysis processing of the captured image. When a specific subject state is detected, it is determined that the release timing has come, and in step F109, a release process is executed under the control of the imaging / recording control unit 81.

  In the second embodiment, the release notification process is not performed. However, when the release timing determination is performed in step F108A, the release notification operation is executed to perform an action corresponding to the still image capturing condition by the user. It is also preferable to prompt (for example, smile, utterance, etc.).

  As an example of processing, as indicated by a broken line in FIG. 29, it is conceivable to proceed to step F109 immediately after composition processing and perform release processing.

Note that, also in the second embodiment, various examples described as modifications of the first embodiment can be applied as modifications.

<7. Imaging Operation of Third Embodiment>

FIG. 30 shows a processing example of the third embodiment.
Steps F101 to F105 are the same as those in FIG.
In the third embodiment, when a request-capable imaging mode is entered by a trigger input, a release notification is immediately performed in step F108 without performing subject detection processing and composition processing as imaging preparation processing, and then in step F109. This is an example of performing a release.
The processing in steps F108 and F109 is the same as that in FIG.

For example, as a case where the request-compliant imaging mode is set, there may be a case where it is desired to perform still image imaging in the state of the imaging field of view of the digital still camera 1 at that time.
Depending on such a case, subject detection processing and composition processing may be unnecessary.
For example, when the imaging field of view of the digital still camera 1 is automatically changing in the automatic imaging mode, the user performs trigger input in anticipation of the digital still camera 1 facing toward him. Then, a release notice operation is performed in that state, and a still image is captured.
Even with such processing, still image capturing according to the user's request is realized.

Also in the third embodiment, various examples (examples such as trigger input other than the subject detection process and composition process) described as modifications of the first embodiment are applied as modifications. be able to.
Particularly in the case of the third embodiment, the operation described in FIG. 13 as a modification of the first embodiment, that is, the requested direction determination in step F120 in FIG. 13 and the pan / tilt control in the requested direction in step F121. It is also suitable to combine.
In that case, when the user performs a trigger input, first, the digital still camera 1 turns around in the direction of the user, and in that state, the release notice and release processing are performed.

<8. Imaging Operation of Fourth Embodiment>

The fourth embodiment will be described as an example of processing in the automatic imaging mode.
FIG. 11B shows a processing example of the fourth embodiment.

Steps F1 to F3 in FIG. 11B are the same as those in FIG. In this case, when the composition process is OK in step F3, the control unit 27 performs a release notice process as step F4A. The release notice process is the same as the process described in step F108 in FIG.
That is, the fourth embodiment is a processing example in which a release notice process is performed even when still images are captured in the automatic imaging mode to notify the user that still images are captured.
This process can be applied to an imaging system that does not provide a request-capable imaging mode, and the process of FIG. 11B can be applied as the automatic imaging mode process of step F102 of FIG.

Even in the automatic image capturing mode, by performing the release notice process, a user who has noticed it can take a pose in consideration of still image capturing.

<9. Modification of functional configuration>

The processing examples of the various embodiments have been described above, but the description so far has basically been described as the control processing based on the functional configuration of FIG.
For example, in the imaging system including the digital still camera 1 and the camera platform 10, other functional configuration examples than those shown in FIG. Examples are given below.

FIG. 31 shows an example in which a function as a trigger detection / acceptance unit 87 is provided on the control unit 27 side of the digital still camera 1 as can be seen from comparison with FIG. That is, in this example, trigger input is also detected on the control unit 27 side, and if a trigger is detected, it is accepted as a trigger to the request-capable imaging mode.
Various examples of trigger input have been described as modifications of the first embodiment. For example, when a touch sensor is provided in the casing of the digital still camera 1 or when a trigger input is performed as an operation to the digital still camera 1, the trigger detection / acceptance unit 87 of the control unit 27 functions as shown in FIG. Thus, the trigger input is recognized.
Also, when the voice input unit 35 shown in FIG. 8 is provided and a specific voice input is recognized as a trigger input, the trigger detection / acceptance unit 87 in FIG. 31 performs the recognition process.
Further, when the control unit 27 on the digital still camera 1 side is provided with a function as the trigger detection / reception unit 87, the specific processing described above is performed in the course of image analysis in the signal processing unit 24, that is, subject detection processing. Recognize behavior and line of sight as subject state and detect trigger input.

For these reasons, the functional configuration as shown in FIG. 31 may be adopted.
Of course, both the trigger detection unit 73 on the camera platform 10 side in FIG. 10 and the trigger detection / acceptance unit 87 on the digital still camera 1 side in FIG. 31 are provided as functional configurations so that various trigger inputs can be supported. Also good.

Further, as another example of the functional configuration, although not shown, the release notice operation control unit 84 in FIG. 10 or 31 may be provided on the pan head 10 side.
That is, as shown in FIG. 9, a release notice execution unit 64 is provided on the pan head 10 side, or an operation as a release notice is executed by pan / tilt operation of the pan head.
In this case, the mode sequence control unit 86 gives an instruction for the release notification operation to the release notification operation control unit on the camera platform 10 side by communication. In response to this, the release notification operation control unit performs execution control of the operation of the release notification execution unit 64 or executes and controls a predetermined behavior by the pan / tilt operation.

  FIG. 32 is an example in which the digital still camera 1 side has only the imaging / recording control unit 81 and the communication processing unit 85. On the camera platform 10 side (control unit 51), a communication processing unit 71, a trigger detection / acceptance unit 79, an imaging preparation processing unit 74, an imaging visual field variable control unit 75, a release notification operation control unit 76, and a mode sequence control unit 77 are provided. Provide.

The control process executed by each functional unit is basically the same as that described with reference to FIG. 10 except for the following points.
The imaging preparation processing unit 74 receives captured image data as each frame image from the signal processing unit 24 of the digital still camera 1 in order to perform subject detection processing and composition processing. Then, image analysis is performed, and subject detection processing and composition processing similar to those described above are performed.
In response to an instruction from the imaging preparation processing unit 74, the imaging field variable control unit 75 controls the pan driving unit 55 and the tilt driving unit 58 to execute pan / tilt operations for subject detection and composition adjustment. Let
Further, for zoom control, the imaging preparation processing unit 74 outputs a zoom control signal to the control unit 27 (imaging recording control unit 81) on the digital still camera 1 side via the communication processing unit 71. The imaging / recording control unit 81 controls execution of zoom processing for composition adjustment based on the zoom control signal.

Further, the mode sequence control unit 77 gives an instruction to each functional part in order to realize the operation in the automatic imaging mode and the request-corresponding imaging mode as shown in FIG.
The mode sequence control unit 77 outputs a release control signal to the control unit 27 (imaging recording control unit 81) on the digital still camera 1 side via the communication processing unit 71 when performing the release process such as Step F109 in FIG. To do. The imaging / recording control unit 81 controls execution of the still image recording operation in accordance with the release control signal.
The trigger detection / reception unit 79 detects a trigger input. And when it detects, it receives as a trigger to a request | requirement imaging mode.

  When performing the release notice process, the mode sequence control unit 86 gives an instruction for the release notice operation to the release notice operation control unit 76. In response to this, the release notification operation control unit 76 performs execution control of the operation of the release notification execution unit 64 on the camera platform 10 side, or executes and controls a predetermined behavior by the pan / tilt operation.

As a modification of FIG. 32, although not shown, a case where a trigger detection unit and a release notification operation control unit are provided in the digital still camera 1 or both may be considered.
That is, the trigger input and the release notification operation are performed on the digital still camera 1 side, the pan head 10 side, or both.

FIG. 33 is a further modification of FIG. This is an example corresponding to the case where the imaging unit 63 is provided on the pan head 10 side as mentioned in FIG.
The imaging preparation processing unit 74 inputs frame image data from the imaging unit 63 instead of from the digital still camera 1 side. Then, image analysis is performed, and subject detection processing and composition processing similar to those described above are performed.
In this case as well, as in the case of FIG. 32, the imaging visual field variable control unit 75 controls the pan driving unit 55 and the tilt driving unit 58 in response to an instruction from the imaging preparation processing unit 74 to detect the subject. The pan / tilt operation for composition adjustment is executed. Further, for zoom control, the imaging preparation processing unit 74 outputs a zoom control signal to the control unit 27 (imaging recording control unit 81) on the digital still camera 1 side via the communication processing unit 71. The imaging / recording control unit 81 controls execution of zoom processing for composition adjustment based on the zoom control signal.

Further, since the imaging unit 63 is provided on the camera platform 10 side, a trigger input based on a specific subject state, that is, a user's specific behavior or line of sight can be handled on the camera platform 10 side.
Therefore, the trigger detection / reception unit 79 analyzes the captured image data from the imaging unit 63 and detects the trigger input. And when it detects, it receives as a trigger to a request | requirement imaging mode.
As a modification of FIG. 33, a case where the trigger detection unit and the release notification operation control unit are provided in the digital still camera 1 or in both cases can be considered.

In some cases, the trigger detection unit is provided only on the digital still camera 1 side, and the trigger reception unit is provided on the pan head 10 side.
An example is shown in FIG. FIG. 34 shows an example in which the digital still camera 1 (control unit 27) side includes an imaging / recording control unit 81, a communication processing unit 85, and a trigger detection unit 88. A communication processing unit 71, a trigger receiving unit 78, an imaging preparation processing unit 74, an imaging visual field variable control unit 75, a release notification operation control unit 76, and a mode sequence control unit 77 are provided on the pan head 10 side (control unit 51).
For example, when a touch sensor is provided on the casing of the digital still camera 1 or when the audio input unit 35 is provided, the trigger detection unit 88 detects a user operation or specific audio input on the digital still camera 1 side. The trigger detection unit 78 is notified of the trigger detection via the communication processing units 85 and 71. The trigger accepting unit 78 accepts a trigger input through the communication, and notifies the mode sequence control unit 77 that a trigger input has been made. For example, the mode sequence control unit 77 gives an instruction to each functional part in order to realize the operations of the automatic imaging mode and the request-compliant imaging mode shown in FIG.

As mentioned above, although the example of a structure of the control function was illustrated, naturally various control function structures can be considered.
The most basic functional configuration as an embodiment of the present invention is as shown in FIG. 35 (a) or FIG. 35 (b).
FIG. 35A shows a case where a mode sequence control unit 86 and a trigger reception unit 89 (or trigger detection / reception unit 87) are provided at least on the digital still camera 1 side. Various examples are assumed in which each other functional part is provided on either the digital still camera 1 side or the pan head 10 side. For example, the configuration shown in FIGS. 10 and 31 corresponds to this.
FIG. 35B shows a case where a mode sequence control unit 86 and a trigger receiving unit 78 (or trigger detecting / receiving unit 79) are provided at least on the pan head 10 side. Various examples are assumed in which the other functional parts are provided on either the digital still camera 1 side or the pan head 10 side. For example, the configuration shown in FIGS. 32, 33, and 34 corresponds to this.
As can be understood from these, the imaging control apparatus of the present invention can be realized as a control function configuration as the digital still camera 1 or as a control function configuration of the camera platform 10. Further, it can be realized as a control function configuration of the imaging system by the digital still camera 1 and the camera platform 10. In other words, each of the digital still camera 1, the camera platform 10, or the imaging system of those sets can be an implementation product of the imaging control apparatus or the imaging control method of the present invention.
10, FIG. 31 to FIG. 34, and FIG. 35 show the respective control function parts in blocks, but they do not have to be configured as independent program modules or hardware. In fact, as long as the overall processing of these control function units, the processing operation of FIG.

<10. Program>

The program according to the present embodiment is a program that causes an arithmetic processing unit such as a CPU to execute processing in the automatic imaging mode and the request-compliant imaging mode as the processing operation of each of the above-described embodiments or modifications. In particular, the processing described above with reference to FIG.

The program according to the present embodiment is recorded in advance in a personal computer, an HDD as a recording medium built in a device such as the digital still camera 1 or the pan head 10, or a ROM in a microcomputer having a CPU. be able to.
Alternatively, it may be temporarily stored on a removable recording medium such as a flexible disk, CD-ROM (Compact Disc Read Only Memory), MO (Magnet optical) disk, DVD (Digital Versatile Disc), Blu-ray disk, magnetic disk, semiconductor memory, memory card, etc. Can be stored (recorded) or permanently. Such a removable recording medium can be provided as so-called package software.

  The program of the present invention can be downloaded from a removable recording medium to a personal computer or the like, or can be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

  The program of the present invention is suitable for the realization and wide provision of an imaging apparatus and an imaging system that realize the processing of each of the above embodiments.

  DESCRIPTION OF SYMBOLS 1 Digital still camera, 2 Main body part, 21a Lens part, 31a Release button, 10 Head, 11 Main body part, 12 Camera base part, 13 Projection part, 21 Optical system, 22 Image sensor, 23 A / D converter, 24 Signal Processing unit, 25 encoding / decoding unit, 26 media controller, 27 control unit, 28 ROM, 29 RAM, 30 flash memory, 31 operation unit, 32 display driver, 33 display unit, 34 pan head compatible communication unit, 35 audio input unit , 36 Release notice execution unit, 40 memory card, 51 control unit, 52 communication unit, 53 pan mechanism unit, 54 pan motor, 55 pan drive unit, 56 tilt mechanism unit, 57 tilt motor, 58 tilt drive unit 59, connection detection unit, 60 operation unit, 60b-60d touch area, 62 Voice input unit, 63 imaging unit, 64 release notice execution unit, 81 imaging record control unit, 82, 74 imaging preparation processing unit, 83, 75 imaging visual field variable control unit, 84, 76 release notice operation control unit, 86, 77 mode Sequence control unit, 72 Pan / tilt control unit, 73, 87 Trigger detection unit, 78, 89 Trigger reception unit, 79, 87 Trigger detection / reception unit

Claims (17)

When a predetermined trigger input is accepted, instead of the automatic imaging mode, a request corresponding imaging control unit that causes the imaging device to execute an imaging operation according to an imaging request as a request corresponding imaging mode;
An imaging field variable control unit that drives and controls an imaging field variable mechanism;
An imaging preparation processing unit that performs a process of determining an imaging field of view for still image imaging ,
The request-capable imaging control unit
When the trigger input is accepted, as the request corresponding imaging mode, the imaging preparation processing unit is caused to execute a process of determining an imaging field of view according to the imaging request,
In the request-compliant imaging mode, the imaging visual field variable control unit drives and controls the variable mechanism, adjusts the arrangement of subject images in the imaging visual field, and when one or more subjects are detected in the imaging visual field, An imaging control apparatus that performs composition processing for moving the imaging field of view and confirming the presence of another subject according to the imaging request . It further includes an imaging advance notice operation control unit that executes and controls the advance notice operation for taking a still image,
The request-capable imaging control unit causes the imaging preparation processing unit to execute a process of determining an imaging field of view for a request-capable imaging operation as the request-capable imaging mode. imaging control apparatus according to claim 1 to execute the still image imaging operation were allowed to perform the above announcement operation by control. Imaging control apparatus according to claim 1 for accepting a specific input operation by the User chromatography THE as the trigger input. Imaging control apparatus according to claim 1 for accepting a particular speech input as the trigger input. Imaging control apparatus according to claim 1 from an imaging image receiving that specific subject state is determined as the trigger input. In the request-capable imaging mode, the imaging preparation processing unit performs subject detection processing for placing a subject according to the imaging request in the imaging field of view while driving and controlling the variable mechanism by the imaging field of view variable control unit. The imaging control apparatus according to claim 1 to be performed. The imaging preparation processing unit performs the composition processing even in the automatic imaging mode, and the composition processing with a processing procedure or processing parameter different from that in the automatic imaging mode in the request-compliant imaging mode. imaging control apparatus according to claim 1 for. The input direction of the upper Symbol trigger input is a detectable,
The imaging control apparatus according to claim 1 , wherein the imaging preparation processing unit drives and controls the variable mechanism in the input direction by the imaging visual field variable control unit.   The request-corresponding imaging control unit causes the imaging apparatus to execute a process for determining an imaging field of view for a request-capable imaging operation as the request-capable imaging mode, and when a predetermined still image imaging condition is satisfied after the imaging field of view is determined The imaging control apparatus according to claim 1, wherein a still image imaging operation is executed. The imaging control apparatus according to claim 9 , wherein the request-capable imaging control unit determines that the still image imaging condition is satisfied when a specific audio input is received. The imaging control apparatus according to claim 9 , wherein the request corresponding imaging control unit determines that the still image imaging condition is satisfied when a specific subject state is determined from the captured image.   The request-capable imaging control unit causes the imaging device to execute a still image imaging operation, displays a still image captured image on the display unit of the imaging device, and directs the display unit in an imaging direction. The imaging control apparatus according to claim 1, wherein the imaging mechanism is driven.   The imaging control apparatus according to claim 1, wherein the request-capable imaging control unit returns to the operation of the automatic imaging mode after performing a still image imaging operation in the request-capable imaging mode. The imaging control apparatus according to claim 2 , wherein the imaging notice operation control unit performs control to execute audio output or display output as a notice operation for performing still image imaging. The imaging control apparatus according to claim 2 , wherein the imaging notice operation control unit performs control to drive the variable mechanism and to cause the imaging apparatus to execute a predetermined action as a notice operation for performing still image imaging. An imaging control method for an imaging apparatus or imaging system having an imaging unit that performs imaging of a subject and recording of captured image data to a recording medium,
Receiving a predetermined trigger input;
When the trigger input is accepted, the imaging device or the imaging system performs an imaging operation in response to an imaging request as a request-compliant imaging mode instead of the automatic imaging mode; and
Executing a process of determining an imaging field of view according to the imaging request;
Adjusting the placement of the subject image within the imaging field during the request-compliant imaging mode;
When one or more subjects are detected within the imaging field of view, the step of further moving the imaging field of view to confirm the presence of another subject in response to the imaging request;
An imaging control method comprising: A control processing program for an imaging apparatus or an imaging system having an imaging unit that performs imaging of a subject and recording of captured image data to a recording medium,
Receiving a predetermined trigger input;
When the trigger input is accepted, the imaging device or the imaging system performs an imaging operation in response to an imaging request as a request-compliant imaging mode instead of the automatic imaging mode; and
Executing a process of determining an imaging field of view according to the imaging request;
Adjusting the placement of the subject image within the imaging field during the request-compliant imaging mode;
When one or more subjects are detected within the imaging field of view, the step of further moving the imaging field of view to confirm the presence of another subject in response to the imaging request;
A program that causes an arithmetic processing unit to execute.

Images