JP2024064186A - Imaging system, device and control method - Google Patents

Abstract

[Problem] To provide an imaging system that controls shooting parameters by linking analysis results from multiple cameras with sensing results from a portable device. [Solution] An imaging system comprising multiple imaging devices each including an imaging means for imaging a subject, a main subject detection means for detecting a main subject using an image captured by the imaging means, and a receiving means for receiving sensing results transmitted from an external device, and a sensor device attached to a subject to be photographed that is different from the imaging means and includes a sensor means for acquiring information about the subject and a transmitting means for transmitting the sensing results of the sensor means to the imaging device, wherein the imaging device receives the sensing results of the sensor means and controls at least one of the focus position, angle of view, and composition of the imaging device using the sensing results of the sensor means and the results of the main subject detection means. [Selected Figure] Figure 1

Description

The present invention relates to a technology for controlling camera photography, and in particular to an imaging system, device, and control method using a wearable device, etc.

Technology is known that controls the shooting operation of a camera based on the results of sensing from an acceleration sensor, a human presence sensor, etc.

For example, Patent Document 1 discloses controlling automatic photography of a remote camera according to the status of a portable device (wearable device).

JP 2016-072673 A

However, the conventional technology disclosed in the above-mentioned patent document mainly controls the timing of automatic photography based on the sensing results. In other words, it does not take into consideration the control of photography parameters such as the focus position, angle of view, and composition of multiple cameras based on the sensing results. For example, consider a case where part of the face of the subject being photographed is hidden by another subject, making it impossible for the camera to detect the subject's face. In this case, if the timing of photography is controlled only from the sensing results attached to the arm or leg, there is a possibility that the face of the subject being photographed will not be in focus, or that the face will remain partially hidden.

The present invention provides an imaging system that combines the analysis results from multiple cameras with the sensing results from a portable device, making it possible to control shooting parameters such as the camera's focus position, angle of view, and composition to capture the best shot of the subject.

In order to achieve the above object, the present invention provides an imaging system comprising a plurality of imaging devices each including an imaging means for imaging a subject, a main subject detection means for detecting a main subject using an image captured by the imaging means, and a receiving means for receiving a sensing result transmitted from an external device, and a sensor device attached to a subject to be photographed that is different from the imaging means and includes a sensor means for acquiring information about the subject and a transmitting means for transmitting the sensing result of the sensor means to the imaging device, wherein the imaging device receives the sensing result of the sensor means and uses the sensing result of the sensor means and the result of the main subject detection means to control at least one of the focus position, angle of view, and composition of the imaging device.

The present invention provides a camera system in which multiple cameras work together to capture the best shot of a subject.

FIG. 1 shows a configuration example of the present invention. FIG. 1 is a diagram showing an example of the external appearance of an imaging system 100. FIG. 1 is a diagram showing an example of a positional relationship of an imaging system 100. A flowchart for explaining the operation of the camera 101 and the camera 102 according to the first embodiment. 1 is a flowchart for explaining the operation of the wearable device 103. FIG. 1 shows an example of a display of the camera 102 according to the first embodiment. FIG. 11 is a diagram for explaining a composition request according to a second embodiment. A flowchart for explaining the operation of the camera 101 and the camera 102 according to the second embodiment.

Below, preferred embodiments of the present invention will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the claimed invention. In addition, although multiple features are described in the embodiments, not all of them are necessarily essential to the invention, and multiple features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicate explanations will be omitted.

In this embodiment, the sensing results of a wearable device such as a smartphone or a wristband-type terminal are linked to the analysis results of multiple cameras to control shooting parameters such as the camera's focus position, angle of view, and composition. Specifically, even if a particular camera has difficulty detecting the main subject because part of the subject to be photographed is hidden by other subjects, a system is realized that can take the best shot of the subject by using information from the main subject detection results of another camera.

Figure 1 shows an example of an imaging system 100 described in this embodiment. The imaging system 100 in Figure 1 is realized by three devices: a camera 101, a camera 102, and a wearable device 103. Examples of the wearable device 103 include a smartphone and a wristband-type terminal, and the form is not important. Figure 2 shows the external appearance of one embodiment of the present invention. Figure 2(a) shows the imaging system 100 to which three devices are connected: two digital cameras 201 as the camera 101 and camera 102, and a smartphone 202 as the wearable device 103.

The control unit 112 is, for example, a CPU, and reads out a control program for each block of the camera 101 from a ROM 113 (described later), and deploys it in a RAM 114 (described later) for execution. In this way, the control unit 112 controls the operation of each block of the camera 101.

The ROM 113 is a non-volatile memory that can be electrically erased and recorded, and stores the operating programs of each block of the camera 101 as well as parameters required for the operation of each block.

RAM 114 is a rewritable volatile memory, and is used for expanding programs executed by the control unit 112, etc., and for temporarily storing data generated by the operation of each block of the camera 101, etc.

The communication unit 115 communicates according to a predetermined wireless communication standard. Examples of wireless communication standards include the so-called Wi-Fi of the IEEE 802.11 standard, Bluetooth (registered trademark), and NFC. Linkage with the wearable device 103 (described below) requires a standard that allows communication over the distance between the camera 101, camera 102, and wearable device 103. For example, Bluetooth (registered trademark) has a communication distance of approximately 400 meters, and is capable of detecting position and direction (relative angle).

The optical system 121 is composed of a group of lenses including a zoom lens and a focus lens, and forms an image of the subject on the imaging surface of the image sensor 122, which will be described later.

The image sensor 122 is composed of, for example, a CCD or CMOS sensor. Each pixel of the image sensor 122 photoelectrically converts the optical image formed on the imaging surface of the image sensor 122 by the optical system 121, and outputs the resulting analog image signal to the A/D converter 123 described below.

The A/D conversion unit 123 converts the analog image signal input from the image sensor 122 into digital image data, and the digital image data output from the A/D conversion unit 123 is temporarily stored in the RAM 114.

The image processing unit 124 applies various image processing such as white balance adjustment, color interpolation, and gamma processing to the image data stored in the RAM 114. The image processing unit 124 also performs main subject detection of the recorded image. These will be described in detail later.

The recording unit 125 is a removable memory card or the like, and records the image data processed by the image processing unit 124 as a recorded image via the RAM 114.

When transitioning from a non-imaging state to an imaging state, the pulse generating unit 126 supplies a scanning clock (horizontal drive pulse) and a predetermined control pulse to the image sensor 122. Of the scanning clocks generated by the pulse generating unit 126, the clock for vertical scanning is input to the vertical drive modulation unit 111, which will be described later.

The vertical drive modulation unit 111 modulates the vertical scanning clock, which is one of the scanning clock signals generated by the pulse generation unit 126, to a predetermined clock frequency and inputs it to the image sensor 122. The vertical drive modulation unit 111 determines the scanning pattern of the reset scanning performed for each line of the image sensor 122, which is made up of multiple pixels. This reset scanning for each line of the image sensor 122 realizes the function of an electronic front curtain shutter.

The gyro sensor 119 is a motion detection sensor that detects angular velocity and determines the magnitude of camera shake.

The mechanical shutter 118 is composed of an open/close shutter mechanism that provides a light blocking mechanism that physically blocks light (hereinafter, mechanical shutter). The mechanical shutter 118 also functions as a rear curtain (hereinafter, mechanical rear curtain) that is composed of multiple light blocking blades. The control unit 112 controls the exposure time (shutter speed) by adjusting the timing at which the mechanical rear curtain starts to run. On the other hand, the function of the electronic front curtain is realized by resetting and scanning the pixels of the image sensor 122 line by line in sequence at a predetermined timing.

The display unit 127 is a display device such as an LCD, and displays images stored in the RAM 114 and images recorded in the recording unit 125, and displays an operation user interface for receiving user instructions. The display unit 127 also displays images captured by the image sensor 122 for adjusting the composition during preparatory shooting.

The configuration of camera 101 has been explained above. As the configuration of camera 102 is the same as that of camera 101, a description of it will be omitted.

Next, the configuration of the wearable device 103 will be described with reference to FIG. 1. The wearable device 103 has a touch screen display 141, and characters, images, icons, etc. are displayed on the liquid crystal display 142. The touch screen 143 can detect gesture operations.

The in-camera 134 is equipped with a lens and an imaging element such as a CCD or CMOS that converts an optical image into an electrical signal. The in-camera 134 is a small camera module equipped with AF (autofocus), aperture, and shutter speed adjustment functions. The in-camera 134 captures an image of an object facing the touch screen display 141.

The illuminance sensor 145 acquires illuminance information of the subject focused by the in-camera 134 and the out-camera 135, and uses this information to adjust the exposure time and ISO sensitivity during shooting.

The control unit 138 is, for example, a CPU, and reads out a control program for each block of the wearable device 103 from the ROM 151 described below, and deploys it in the RAM 152 described below for execution. In this way, the control unit 138 controls the operation of each block of the wearable device 103. The control unit 138 provides a camera function by controlling the touch screen 143, the switch 144, the in-camera 134, the illuminance sensor 145, the out-camera 135, and the light 136, etc.

ROM 151 is a non-volatile memory that can be electrically erased and recorded, and stores the operating programs of each block of wearable device 103 as well as parameters required for the operation of each block.

RAM 152 is a rewritable volatile memory, and is used for expanding programs executed by the control unit 112, etc., and for temporarily storing data generated by the operation of each block of the wearable device 103, etc.

When the switch 144 is set to ON for sound output, the speaker 139 outputs the shutter sound and warning sound when capturing an image.

The connector 133 is used to connect the wearable device 103 to an external device. For example, an AC adapter for charging a battery provided in the power supply module 132 described below is connected to the connector 133. The connector 133 is also used to input and output image data, audio data, and the like to a non-volatile memory connected from the outside. The connector 133 may be a specially designed terminal such as a dock connector, or a general-purpose terminal such as a USB (Universal Serial Bus).

The outer camera 135 is a small camera module similar to the inner camera 134. The outer camera 135 captures an image of a subject on the opposite side of the inner camera 134. The light 136 is a light emitting module that functions as a flash when the outer camera 135 captures an image.

The communication module 131 communicates according to a specific wireless communication standard. Examples of wireless communication standards include the so-called Wi-Fi of the IEEE 802.11 standard, Bluetooth (registered trademark), and NFC. Specific examples of communication include input and output of image data obtained by capturing images and downloading of program modules for adding functions to the wearable device 103. The communication module 131 is also used to transmit information from a group of sensors (illuminance sensor 145, acceleration sensor 146, gyro sensor 147, and depth sensor 148) to the cameras 101 and 102, which will be described later.

The power supply module 132 is equipped with a rechargeable battery and supplies power to the entire wearable device 103. The battery equipped in the power supply module 132 may be, for example, a lithium ion battery or a nickel-metal hydride battery.

The acceleration sensor 146 detects the direction and magnitude of acceleration acting on the wearable device 103. The acceleration sensor 146 is capable of detection in three axes: X, Y, and Z.

The gyro sensor 147 detects the angle and angular velocity of the wearable device 103. The depth sensor 148 measures the distance from the camera to the subject being photographed. The following methods can be used to measure distance. For example, a method can be used in which the time it takes for infrared rays, light, ultrasonic waves, etc. to be reflected from an object and bounce back can be measured. In addition, a method can be used in which multiple cameras and pixels are arranged in parallel to obtain depth information of the subject from a parallax image. There is also a method that uses the wireless communication standard Bluetooth (registered trademark) to detect the position of the wearable device 103, the distance from the wearable device 103 (transmitter) to the camera (receiver), and the relative angle between the wearable device 103 (transmitter) and the camera (receiver). Note that the method of measuring distance in implementing the present invention is not limited to the above, and any existing suitable method can be used as appropriate.

Figure 2 shows an example of the appearance of the imaging system 100. (a) to (c) of Figure 2 respectively show a combination of the camera 101, the camera 102 and the wearable device 103 that cooperate as the imaging system 100. The connection between the camera 101, the camera 102 and the wearable device 103 is wirelessly connected, for example, by Bluetooth (registered trademark) or the like, and they communicate with the imaging system 100. 201 shows a digital camera as an example of the camera 101, the camera 102. 202 shows a smartphone as an example of the wearable device 103, and this smartphone is often equipped with a camera function. Therefore, by using the camera function, it is possible to use it as the camera 101, the camera 102 side instead of the wearable device 103 side, like the in-camera 134 and the out-camera 135 mounted on the smartphone 202 in Figure 2 (c). In addition, the wearable device 103 can also be in the form of a wristband-type terminal 203 or the like other than a smartphone. Above, we have explained the external appearance and system configuration of the imaging system 100.

First Embodiment
3 to 6, the processing of the imaging system 100 according to the first embodiment (Example 1) of the present invention will be described below. In Example 1, a subject to be photographed wears the wearable device 103, and a user photographs the subject to be photographed using the cameras 101 and 102. For example, a use case is assumed in which a father and a mother use their respective cameras to photograph a child's soccer or dance match, with the child at the center.

Figure 3 (a) shows an example of the positional relationship between camera 101, camera 102, wearable device 103, and a subject. There are multiple subjects A to D as subjects, and cameras 101 and 102 capture subject A, who is wearing wearable device 103, as the subject. Cameras 101 and 102 control the shooting parameters by taking into account the positional relationship between each camera and the subject through wearable device 103.

First, the operation of the wearable device 103 will be described with reference to FIG. 5. The following process is realized by the control unit 138 controlling each part of the device according to the program stored in the ROM 151.

In step S501, the user first turns on the power of the wearable device 103. Then, the wearable device 103 performs a standby operation to receive sensing signals of the wearable device 103 from the sensors (acceleration sensor 146, gyro sensor 147, depth sensor 148, etc.).

In step S502, the communication units 115 of the cameras 101 and 102 acquire the sensing signals acquired in step S501 at regular time intervals. For example, as sensing signals, information on the position of the wearable device 103, the distance from the wearable device 103 to the cameras 101 and 102, and the relative angles between the wearable device 103 and the cameras 101 and 102 is received. In order to acquire this position, distance, and relative angle information, the output from the depth sensor 148 is acquired periodically at predetermined times.

In step S503, the user first wears the wearable device 103 at a specific position, for example, on the wrist. The wearable device 103 detects that it has been worn by the subject using a tactile sensor (not shown). The wearable device 103 can also be attached anywhere so long as the subject's movements can be monitored. In this case, the method of identifying the part of the subject where the wearable device 103 is worn may involve detecting the device being worn from image data acquired by the camera 101. The part of the subject where the wearable device 103 is to be worn may be set in advance. There is also a known technology for recording the acceleration, speed, etc. of a specific part within a specified period of time in advance, and identifying the part of the subject that is moving based on the actual movement (Patent No. 6325581).

In step S504, communication module A131 of wearable device 103 transmits to camera 101 and camera 102 information on the position of wearable device 103, the distance from wearable device 103 to camera 101 and camera 102, the relative angle between wearable device 103 and camera 101 and camera 102, and information on the part of the body where wearable device 103 is attached, all of which were determined in step S502.

This completes the processing of the wearable device 103.

Next, the operation of cameras 101 and 102 will be described using the flowchart in FIG. 4. In the flowchart in FIG. 4, the positional relationship between cameras 101, 102, wearable device 103, and the subject is as shown in FIG. 3(a). Here, the operation of cameras 101 and 102 will be described in a situation where camera 101 can detect the face of main subject A, the subject of the image capture, and camera 102 detects that part of the face of main subject A is hidden by another subject B. Note that the processing of the flowchart in FIG. 4 is realized by control unit 112 controlling each unit of cameras 101 and 102 according to a program stored in ROM 113 in cameras 101 and 102 of imaging system 100.

The processing flow of the camera 101 when the main subject of the image capture is detected will be explained using FIG. 4(a).

In step S401, the communication unit 115 of the camera 101 receives information transmitted from the wearable device 103, including the position of the wearable device 103, the distance from the wearable device 103 to the camera 101, and the relative angle between the wearable device 103 and the camera 101.

In step S402, the user starts preparatory shooting, such as adjusting the composition, using the camera 101. Based on the information on the position of the wearable device 103, the distance from the wearable device 103 to the camera 101, and the relative angle between the wearable device 103 and the camera 101 acquired in step S401, assistance is displayed regarding the direction of the wearable device 103. For example, if the position of the wearable device 103 is not included in the angle of view of the camera 101, a message such as "Please take the picture a little further to the left" is displayed on the display unit 127 so that the position of the wearable device 103 is included in the angle of view. During this preparatory shooting period, the camera 101 continuously captures images and displays the recorded images on the display unit 127. The user adjusts the composition while looking at the displayed preparatory shooting image. Note that the processing of steps S403, S404, and S405 described below is performed during the preparatory shooting period.

In step S403, the control unit 112 of the camera 101 determines whether or not the main subject has been detected from the preparatory captured image in the image processing unit 124. If it is determined that the main subject has been detected, the process proceeds to step S404, and if it is determined that the main subject has not been detected, the process returns to step S401 and repeats the processes from step S401 onwards. The camera 101 proceeds to step S404, assuming that it has detected the main subject of subject A, which is the subject of the image capture.

Methods for detecting subjects include general subject detection techniques. Examples include face/facial organ detection and head detection. Face/facial organ detection and head detection are methods for detecting the area where a person's face, organs, and head are present from a captured image using techniques based on pattern recognition and machine learning. Methods for determining whether a detected subject is the main subject include, for example, a method for determining whether the features match those of a registered face registered in advance by a user, and a method for determining that a subject is the main subject when the ratio of the subject's face area to the area of the entire image is large.

In step S404, it is determined whether there is any other camera (camera 102) in the imaging system 100 that has not been able to detect the main subject. If there is a camera that has not been able to detect the main subject, the process proceeds to step S405, and if there is no camera that has not been able to detect the main subject, the process proceeds to step S406.

In step S405, the camera that successfully detected the main subject (camera 101) transmits main subject detection information to the camera that failed to detect the main subject (camera 102). Specifically, the main subject detection information is center coordinate information of the detected main subject's face and distance difference information between the wearable device 103 and the face of main subject A. The distance difference information will be explained in detail in the flow of FIG. 4(b) described later.

In step S406, the control unit 112 of the camera 101 captures an image using the shooting settings made in the processing of the above steps, and records the captured image in the ROM 113. In this way, during the preparatory shooting, the user repeatedly sets the shooting parameters so that the main subject of the shooting target is in focus while checking the preparatory shooting image displayed on the display unit 127, and presses the shutter button when the photo opportunity arises.

Next, the processing flow of the camera 102 when the main subject of the image capture cannot be detected will be explained using FIG. 4(b).

In step S401, the communication unit 115 of the camera 102 receives information transmitted from the wearable device 103, including the position of the wearable device 103, the distance from the wearable device 103 to the camera 102, and the relative angle between the wearable device 103 and the camera 102.

In step S402, the user starts preparatory shooting, such as adjusting the composition, using the camera 102. Based on the information on the position of the wearable device 103, the distance from the wearable device 103 to the camera 102, and the relative angle between the wearable device 103 and the camera 102 acquired in step S401, assistance is displayed regarding the direction of the wearable device 103. During this preparatory shooting period, the camera 102 continuously captures images and displays the recorded images on the display unit 127. The user adjusts the composition and the like while looking at the displayed preparatory shooting images. Note that the processes of steps S403, S407, and S408 described below are performed during the preparatory shooting period.

In step S403, the control unit 112 of the camera 102 determines whether or not the main subject has been detected from the preparatory shooting image in the image processing unit 124. If it is determined that the main subject has been detected, the process proceeds to step S406, and if it is determined that the main subject has not been detected, the process proceeds to step S407. Since part of the face of subject A is hidden by subject B, the camera 102 cannot detect the main subject, so the process proceeds to step S407. Figure 6 shows an example of a preparatory shooting image displayed on the display unit 127 of the camera 102 during preparatory shooting when attempting to capture main subject A, which is the subject to be shot by the camera 102.

In step S407, the camera (camera 102) that was unable to detect the main subject in step S403 determines whether or not there is main subject detection information in the other camera (camera 101) in the imaging system 100. If there is main subject detection information in the other camera (camera 101), the process proceeds to step S408, and if there is no main subject detection information in the other camera (camera 101), the process returns to step S401 and repeats the processes from step S401 onwards.

In step S408, the camera (camera 101) that was able to detect the main subject acquires distance difference information between the wearable device 103 and the face of the main subject A. Here, the camera (camera 102) that was unable to detect the main subject adjusts the focus position to the position of the face of the main subject A, not the position of the wearable device 103, based on the distance information acquired by camera 101. The distance difference refers to the distance difference indicated by the dotted line in Fig. 6B from the center coordinates (Xs, Ys, Zs) of the wearable device 103 worn by the subject A to the face center coordinates ( _XA , _YA , _ZA ) of the subject A. The camera (camera 102) that was unable to detect the main subject based on this distance difference information moves the focus position from the center coordinates (Xs, Ys, Zs) of the wearable device 103 that was being focused on to the face center coordinates ( _XA , _YA , _ZA ) of the main subject A. 3B, camera 101 acquires information on the center coordinates (Xs, Ys, Zs) of wearable device 103, distance P from camera 101 to wearable device 103, and relative angle P between wearable device 103 and camera 101, as well as center coordinates ( _XA , _YA , _ZA ) of the face of main subject A detected by image processing unit 124, based on the sensing result received from wearable device 103. Similarly, camera 102 acquires information on the center coordinates (Xs, Ys, Zs) of wearable device 103, distance Q from camera 102 to wearable device 103, and relative angle Q between wearable device 103 and camera 102, based on the sensing result received from wearable device 103. By transmitting and receiving the information acquired by cameras 101 and 102, information can be shared and cooperation can be achieved. For example, a camera that was able to detect a main subject (camera 101) can assist in controlling the shooting parameters of camera 102 to determine, for a camera that was not able to detect the main subject, where to focus (the facial center coordinates ( _XA , _YA , _ZA ) of main subject A) or how to control the focus position based on the currently set focus position (the center coordinates (Xs, Ys, Zs) of wearable device 103).

In step S406, the control unit 112 of the camera 102 captures an image using the shooting settings made in the processing of the above steps, and records the captured image in the ROM 113. In this way, during the preparatory shooting, the user repeatedly sets the shooting parameters so that the main subject of the shooting target is in focus while checking the preparatory shooting image displayed on the display unit 127, and presses the shutter button when the photo opportunity arises.

In the first embodiment, the coordinates for focusing are the center coordinates of the face of the main subject being photographed, but they may also be the center coordinates of the main subject's eyes.

In the first embodiment, the shutter button is pressed when a photo opportunity arises in step S406, but the camera may be configured to automatically capture the image when the main subject is detected in step S403.

In the first embodiment, a configuration was described in which a shooting parameter related to the focus position of the camera is controlled. Note that the configuration may be such that shooting parameters related to the angle of view and composition of the camera are controlled in addition to the focus. For example, the size and center coordinates of the main subject are detected by the camera, and the focal length is adjusted (zoom magnification is set) based on the size and center coordinates so that the area of the main subject in the camera is a predetermined ratio. Alternatively, the configuration may be such that the photographer is instructed in the direction of movement so that the main subject is in the center of the screen.

Second Embodiment
Next, a second embodiment (Example 2) of the present invention will be described in detail with reference to the drawings. In Example 2, a process of controlling the shooting parameters of each camera will be described when the requirements for the composition to be shot by each camera (hereinafter, referred to as a composition request) are set via the control unit 112 prior to the image capture operation. The process on the wearable device 103 side of the image capture system 100 in Example 2 is the same as that in Example 1, and therefore will not be described. The operation performed by the control unit 112 of the camera 101 and the camera 102, which is a feature of Example 2, will be described with reference to the flowcharts of FIG. 7 and FIG. 8. The following process is realized by the camera 101 and the camera 102 as the image capture system 100, in that the control unit 112 controls each unit of the device according to a program stored in the ROM 113. In addition, the wearable device 103 is realized by the control unit 138 controlling each unit of the device according to a program recorded in the ROM 151. The same reference numerals are given to the processes of the same steps as those in Example 1, and detailed descriptions will be omitted.

The operation of cameras 101 and 102 will be explained using the flowchart in Figure 8.

In step S401, the communication units 115 of the cameras 101 and 102 receive information transmitted from the wearable device 103 regarding the position of the wearable device 103, the distance from the wearable device 103 to the cameras 101 and 102, and the relative angles between the wearable device 103 and the cameras 101 and 102.

In step S402, the user begins preparatory shooting, such as adjusting the composition, using cameras 101 and 102.

In step S403, the control units 112 of the cameras 101 and 102 determine in the image processing unit 124 whether or not a main subject has been detected from the preparatory captured image. The main subject detection method is as described above in the first embodiment.

If it is determined that the main subject has been detected, the process proceeds to step S801; if it is determined that the main subject has not been detected, the process proceeds to step S407.

In step S801, the control units of the cameras 101 and 102 have determined in step S403 that the main subject was detected. The control units then evaluate the composition based on the composition request information set by the user via an operation unit (not shown) and the image analysis results from the image processing unit 124.

A composition request by a user will be described with reference to FIG. 7. FIG. 7 is an example of a setting screen on which a user sets a composition request (composition request setting). In this example, face size, subject area, and face position are set. Face size is a request for the face size of the main subject in the area of the entire screen. Subject area is a request for how the main subject is to be photographed, and items such as a close-up of the face, a bust-up, or the whole body can be selected. Face position is an item for setting a request for the position of the main subject's face in the entire image. In this example, it is possible to set whether the position of the main subject is to the left of the image, the center of the image, or the right of the image. Note that the composition requirements set in the composition request may be determined by the control unit 112 based on the focal length of the lenses of the cameras 101 and 102 and the results of image analysis during shooting.

The composition evaluation method involves calculating a composition evaluation value (first composition evaluation value) based on the position of the wearable device 103, the distances from the wearable device 103 to the cameras 101 and 102, and the relative angles between the wearable device 103 and the cameras 101 and 102, which are acquired in steps S401 to S403, as well as the user's composition request information, main subject detection information, and lens information (focal length) of the cameras 101 and 102.

For example, as shown in the composition request in FIG. 7, if "bust-up" and "full body" are requested as the subject area, the evaluation value is calculated from the focal length of the lens of each of cameras 101 and 102 and the distance to wearable device 103. Specifically, if a "bust-up" shot is possible based on the distance between camera 101 and wearable device 103 and the focal length of the lens of camera 101, the composition evaluation value is set high, and if a "bust-up" shot is not possible, the composition evaluation value is set low. The composition evaluation value is calculated for all the requested items set by the user for each camera. In the example of FIG. 7, the composition evaluation value is calculated for each of the items set by face size, subject area, and face position.

In step S407, the camera that was unable to detect the main subject in step S403 determines whether or not there is main subject detection information in other cameras in the imaging system 100. If there is main subject detection information in other cameras, the process proceeds to step S408, and if there is no main subject detection information in other cameras, the process proceeds to step S802.

In step S408, distance difference information between the wearable device 103 and the face of the main subject A is obtained from the other camera that was able to detect the main subject. On the other hand, the camera that was unable to detect the main subject adjusts the focus position to the position of the face of the main subject A, rather than the position of the wearable device 103, based on the calculated distance, and returns to step S403, repeating the processes from step S403 onwards. In step S802, since it was determined in step S407 that the other camera also did not have main subject detection information, image analysis based on main subject detection cannot be used. Therefore, a composition evaluation value is calculated (second composition evaluation value) based on the composition request information set by the user via an operation unit (not shown), the distance between the wearable device 103 and cameras 101 and 102, and the lens information (focal length) of cameras 101 and 102.

Specifically, the composition evaluation value calculation method is the same as that of step S801, but in step S802, there is no information on main subject detection, and the face size of the main subject is unknown. Therefore, the standard sizes of the human body, for example, the standard sizes of adults and children are stored in ROM 113 in advance, and the user sets whether the subject is an adult or a child when wearing wearable device 103. In step S803, based on the composition evaluation values of steps S801 and S802, it is determined whether camera 101 or camera 102 is more suitable for capturing "bust-up" or "full-body" images. For example, if the composition evaluation value of camera 101 for "bust-up" is higher than that of camera 102, it is determined that camera 101 should capture "bust-up" images and camera 102 should capture "full-body" images.

In step S406, the shooting conditions for each camera are determined based on the results of the determination made in step S803.

The above describes the method in which the imaging system 100 of the second embodiment controls each camera shooting parameter based on a composition request set by the user, using the flowchart in FIG. 8. Through these processes, it becomes possible to take the best shot of the main subject according to the user's request.

Other Embodiments
The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

The above describes preferred embodiments of the present invention, but the present invention is not limited to these embodiments, and various modifications and variations are possible within the scope of the gist of the invention.

REFERENCE SIGNS LIST 100 Imaging system 101 Camera 102 Camera 121 Optical system 122 Imaging element 123 A/D conversion section 124 Image processing section 125 Recording section 126 Pulse generating section 127 Display section 118 Mechanical shutter 119 Gyro sensor 111 Vertical drive modulation section 112 Control section 113 ROM
114 RAM
115 Communication unit 103 Wearable device 132 Power supply module 131 Communication module 133 Connector 134 In-camera 135 Out-camera 136 Light 137 System memory 138 Control unit 139 Speaker 141 Touch screen display 142 Liquid crystal display 143 Touch screen 144 Switch 145 Illuminance sensor 147 Gyro sensor 148 Depth sensor 151 ROM
152 RAM
146 Acceleration Sensor

Claims (5)

An imaging means for imaging a subject;
a main subject detection means for detecting a main subject using the image captured by the imaging means;
A receiving means for receiving a sensing result transmitted from an external device;
A plurality of imaging devices each having
A sensor means for acquiring information of a subject;
a transmitting means for transmitting a sensing result of the sensor means to the imaging device;
A sensor device attached to a subject to be photographed, which is different from the imaging means;
An imaging system comprising:
an imaging system characterized in that the imaging device receives a sensing result of the sensor means, and controls at least one of a focus position, an angle of view, and a composition of the imaging device using the sensing result of the sensor means and a result of the main subject detection means. The imaging system according to claim 1, characterized in that the sensor means senses at least one piece of information related to the position of the sensor device, the distance between the sensor device and the imaging device, and the relative angle between the sensor device and the imaging device. The imaging system according to claim 1, characterized in that the multiple imaging devices and the sensor device share the sensing results of the sensor means and the detection results of the main subject detection means, and control at least one of the focus position, angle of view, and composition of a second imaging device different from the first imaging device that did not detect the main subject based on information about the main subject of a first imaging device that detected the main subject. the plurality of image capture devices further include a composition request setting unit for setting request information regarding a composition at the time of photographing,
2. The imaging system according to claim 1, wherein the composition of each of the imaging devices is controlled based on the request information set by said composition request setting means, the sensing result of said sensor means, and lens information of said plurality of imaging devices. The imaging system according to claim 4, characterized in that the request information includes at least one of the area, size, and position of the main subject.

Images