JP7484277B2 - Photographing system, photographing device, and photographing method - Google Patents

Description

The present invention relates to a photography system, a photography device, and a photography method.

Conventionally, when taking photographs, a method is known in which the photographing conditions are set to match the photographer's intentions, thereby preventing photographing errors.

For example, first, the photographing device sets the photographing conditions. Then, the photographing device detects the facial area of the subject based on image data output by converting the image signal output from the image sensor. Next, the photographing device plays a predetermined warning on the display unit depending on whether or not the facial area is detected. In this way, when attempting to photograph a person in a photographing mode not designed for photographing people, if an inappropriate photographing mode is set, a method is known that alerts the user and prevents photographing failure (see, for example, Patent Document 1, etc.).

However, conventional methods do not make judgments based on multiple conditions. As a result, shooting may be performed even when the photographer does not intend to, or shooting may not be performed even when the photographer intends to.

One aspect of the present invention aims to perform photography in accordance with the photographer's intentions.

According to an embodiment of the present invention, a photography system is provided for performing photography of a photography device, comprising:
an acquisition unit that acquires data including first data from an RGB camera and second data from a sensor that measures distance;
a determination unit that detects a predetermined subject based on the first data and the second data and determines whether a condition regarding the presence or absence of the predetermined subject is satisfied;
an execution unit that executes photography by the photography device when it is determined that the condition is satisfied;
Equipped with.

Embodiments of the present invention allow photography to be performed in accordance with the photographer's intentions.

FIG. 1 is a diagram illustrating an example of the configuration of an imaging system. FIG. 1 illustrates an example of an imaging device. FIG. 2 is a diagram illustrating an example of a hardware configuration of the imaging device. FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device. FIG. 2 is a diagram illustrating an example of a functional configuration. FIG. 13 is a diagram illustrating an example of the entire process. FIG. 1 is a diagram showing a first example. FIG. 13 is a diagram showing a second example. FIG. 13 is a diagram showing a third example. FIG. 13 is a diagram showing an example in which an image is captured at a timing different from the original intention.

The optimal and minimal form for implementing the invention will be described below with reference to the drawings. Note that when the same reference numerals are used in the drawings, they indicate similar configurations, and duplicated explanations will be omitted. Also, the specific examples shown in the drawings are merely examples, and the configuration may further include configurations other than those shown in the drawings.

<Example of imaging system configuration>
For example, the imaging system 10 has the following configuration.

Figure 1 is a diagram showing an example of the configuration of a photography system. For example, photography system 10 has a photography device 1 and a smartphone 2.

The image capturing device 1 has multiple optical systems and generates images capturing a wide range, such as in all directions, of the image capturing device 1, and outputs the images to the smartphone 2. In this example, the image processed by the image capturing system 10 is, for example, a spherical image.

In such an image capture system 10, the image capture device 1 can be operated by an information processing device such as a smartphone 2. The smartphone 2 also outputs spherical images and the like to the user.

In the photography system 10, the photography device 1 and the smartphone 2 are connected by wire or wirelessly. For example, the smartphone 2 inputs data output by an external device such as the photography device 1. Note that the data may be input via a network or another device.

The configuration of the photography system 10 is not limited to the configuration shown in the figure. For example, the photography device 1 and the smartphone 2 may be an integrated device. On the other hand, the photography system 10 may include devices other than the photography device 1 and the smartphone 2, and may be composed of three or more devices.

<Examples of imaging devices>
FIG. 2 is a diagram showing an example of an imaging device.

Fig. 2(a) is a front view showing an example of the imaging device 1. Fig. 2(b) is a left side view showing an example of the imaging device 1. Fig. 2(c) is a plan view showing an example of the imaging device 1.

Specifically, the imaging device 1 has, for example, a front imaging element 1H1, a rear imaging element 1H2, and a switch 1H3.

The imaging device 1 then generates an image such as a spherical image using images captured by the front imaging element 1H1 and the rear imaging element 1H2.

Switch 1H3 is a so-called shutter button. In other words, switch 1H3 is an example of an input device with which the user instructs image capture device 1 to perform image capture.

Figure 3 is a diagram showing an example of the hardware configuration of a photographing device. For example, the photographing device 1 has a photographing unit 1H4, an image processing unit 1H7, a photographing control unit 1H8, a CPU (Central Processing Unit, hereinafter referred to as "CPU1H9"), and a ROM (Read-Only Memory, hereinafter referred to as "ROM1H10"). The photographing device 1 also has an SRAM (Static Random Access Memory, hereinafter referred to as "SRAM1H11"), a DRAM (Dynamic Random Access Memory, hereinafter referred to as "DRAM1H12"), and an operation I/F (Interface, hereinafter referred to as "Operation I/F1H13"). Furthermore, the imaging device 1 has a network I/F 1H14, a wireless I/F 1H15, and an antenna 1H16. The hardware resources are connected by a bus 1H17, and perform input and output of data or signals.

The photographing unit 1H4 has a front photographing element 1H1 and a rear photographing element 1H2. A lens 1H5 is provided corresponding to the front photographing element 1H1, and a lens 1H6 is provided corresponding to the rear photographing element 1H2.

The front imaging element 1H1 and the rear imaging element 1H2 are so-called camera units. The front imaging element 1H1 and the rear imaging element 1H2 each have an optical sensor such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD).

The front imaging element 1H1 converts the light incident through the lens 1H5 to generate image data. Similarly, the rear imaging element 1H2 converts the light incident through the lens 1H6 to generate image data. The imaging unit 1H4 then outputs the image data generated by the front imaging element 1H1 and the rear imaging element 1H2 to the image processing unit 1H7.

In addition, the front imaging element 1H1 and the rear imaging element 1H2 may further include optical elements such as an aperture or a low-pass filter in addition to a lens. The front imaging element 1H1 and the rear imaging element 1H2 may also perform processing such as defective pixel correction or camera shake correction.

CPU1H9 is an example of a calculation device and a control device. For example, CPU1H9 executes processing based on a program.

ROM1H10, SRAM1H11, and DRAM1H12 are examples of storage devices. For example, ROM1H10, SRAM1H11, and DRAM1H12 store programs, data, or parameters executed by CPU1H9. Note that the photographing device 1 may further include an auxiliary storage device such as a hard disk.

The operation I/F 1H13 is an interface for inputting user operations.

Network I/F 1H14, wireless I/F 1H15, and antenna 1H16 are interfaces that input and output data to and from external devices wirelessly or via wired connections.

Bus 1H17 is used for sending and receiving data, etc. For example, bus 1H17 is PCI Express (Peripheral Component Interconnect Bus Express), etc.

Figure 4 is a diagram showing an example of the hardware configuration of an information processing device. For example, the smartphone 2 has an auxiliary memory device 2H1, a main memory device 2H2, an input/output device 2H3, a status sensor 2H4, a CPU 2H5, and a network I/F 2H6. Each hardware resource is connected by a bus 2H7, and performs input and output of data or signals.

The auxiliary storage device 2H1 and the main storage device 2H2 are examples of storage devices. For example, the auxiliary storage device 2H1 and the main storage device 2H2 store programs, data, or parameters executed by the CPU 2H5.

The input/output device 2H3 is, for example, a touch panel.

The status sensor 2H4 is, for example, a gyro sensor or an angle sensor.

The network I/F 2H6 is an interface that inputs and outputs data to and from external devices wirelessly or via a wired connection.

CPU2H5 is an example of a calculation device and a control device. For example, CPU2H5 executes processing based on a program.

The image capture device and the information processing device are not limited to the above examples. For example, the image capture device may be a hardware configuration with a single optical system. Furthermore, the information processing device and the image capture device may be integrated in part or in whole.

<Functional configuration example>
5 is a diagram showing an example of a functional configuration. For example, the photographing system 10 has a functional configuration including an input unit 101, an acquisition unit 102, a plurality of first determination units 103, a second determination unit 104, and an execution unit 105. The following describes the functional configuration shown in the figure as an example.

The input unit 101 performs an input procedure for inputting multiple conditions for performing photography.

The acquisition unit 102 performs an acquisition procedure to acquire data related to multiple conditions.

The first determination unit 103 performs a first determination procedure to determine whether or not each of the multiple conditions input to the input unit 101 is satisfied based on the data acquired by the acquisition unit 102.

The second judgment unit 104 performs a second judgment procedure to determine whether two or more of the conditions judged by the multiple first judgment units 103 are satisfied.

When the second determination unit 104 determines that two or more conditions are satisfied, the execution unit 105 performs an execution procedure to perform shooting.

For example, the input unit 101 is realized by an input/output device 2H3 or the like. The acquisition unit 102 is realized by a photographing unit 1H4 or the like. Furthermore, the first determination unit 103, the second determination unit 104, and the execution unit 105 are realized by a CPU 2H5 or the like.

The number of first judgment units 103 will be set to match the number of conditions.

<Overall processing example>
FIG. 6 is a diagram showing an example of the overall process. In the following, an example will be described in which two pieces of data and two conditions are used. However, there may be two or more pieces of data and conditions. In the following description, two types of data, "first data" and "second data", are used. Similarly, in the following example, there are two types of conditions, "first condition" and "second condition".

In addition, the number of types of data and the number of conditions do not have to match. For example, multiple conditions may be input for one piece of data. Conversely, a configuration in which multiple pieces of data are used to determine one condition may also be used.

In step S1, the input unit 101 inputs a number of conditions. For example, step S1 is a process that is carried out before shooting, that is, as preparation. Specific examples of the conditions will be described later.

Steps S11, S12, S21, and S22 are performed in parallel, for example, as shown in the figure. Note that steps S11, S12, S21, and S22 do not have to be performed in parallel. For example, steps S11, S12, S21, and S22 may be performed in sequence.

Furthermore, depending on the type of data, the period for acquiring data and the time that elapses for executing the process for determining the conditions may differ. Therefore, steps S11, S12, S21, and S22 may differ in the number of cycles and timing at which they are executed.

In step S11, the acquisition unit 102 acquires the first data.

In step S12, the first judgment unit 103 judges whether or not the first condition is satisfied. Next, if it is judged that the first condition is satisfied (YES in step S12), the first judgment unit 103 proceeds to step S2. On the other hand, if it is judged that the first condition is not satisfied (NO in step S12), the first judgment unit 103 proceeds to step S11, etc. In other words, the acquisition of the first data and the judgment of whether or not the first condition is satisfied are repeated until the first condition is satisfied.

Steps S21 and S22 are executed in the same manner as steps S11 and S12.

In step S21, the acquisition unit 102 acquires the second data.

In step S22, the first judgment unit 103 judges whether or not the second condition is satisfied. Next, if it is judged that the second condition is satisfied (YES in step S22), the first judgment unit 103 proceeds to step S2. On the other hand, if it is judged that the second condition is not satisfied (NO in step S22), the first judgment unit 103 proceeds to step S21. That is, the acquisition of the second data and the judgment of whether or not the second condition is satisfied are repeated until the second condition is satisfied.

In step S2, the second judgment unit 104 judges whether or not both the first condition and the second condition are satisfied. Next, if it is judged that both the first condition and the second condition are satisfied (YES in step S2), the second judgment unit 104 proceeds to step S3. On the other hand, if it is judged that either the first condition or the second condition is not satisfied (NO in step S2), the second judgment unit 104 proceeds to step S11. That is, the process of acquiring the first data, judging whether or not the first condition is satisfied, acquiring the second data, and judging whether or not the second condition is satisfied is repeated until both the first condition and the second condition are satisfied.

In step S3, the execution unit 105 executes the image capture.

The first and second conditions are set in advance, for example, by the photographer. The first and second conditions indicate conditions that will trigger the execution of shooting. When all the input conditions are met in step S2 (YES in step S2), shooting is executed.

The first data and the second data are acquired according to a condition. That is, each condition is associated in advance with a type of data suitable for determining the respective condition and a sensor that acquires the data.

As described above, the photography system 10 determines the timing for photographing based on two or more conditions. In this way, photography can be performed in accordance with the photographer's intentions, compared to when the timing for photographing is determined based on only a single condition.

Examples of combinations of data and conditions are as follows:

<First Example>
7 is a diagram showing a first example. In this example, the imaging system is a camera system 203 having an RGB camera 204 and a ToF camera 205.

Hereinafter, the direction that indicates the distance from the subject to the camera system 203 will be referred to as the "Z axis." On the other hand, the direction that is perpendicular to the Z axis and is the horizontal direction in the image will be referred to as the "X axis."

The RGB camera 204 is a camera that generates RGB image data. In this example, it is assumed that the RGB camera 204 generates image data showing the first subject 201 and the second subject 202.

The ToF camera 205 is a sensor that measures the distance to a subject using a method such as the Time Of Flight method and displays the measurement result. Note that the ToF camera 205 may be configured to include a sensor that measures using another method as long as it is a sensor that can measure the distance to a subject (which is the position on the Z axis).

As shown in the figure, the first subject 201 is a building, an object on which a person's face is depicted, such as a poster.

The second subject 202 is a person.

When a sensor capable of generating an image is used, such as the RGB camera 204, image data showing the first subject 201 and the second subject 202 (hereinafter referred to as "image data 206") can be generated.

When a sensor capable of measuring distance, such as the ToF camera 205, is used, data indicating the distance to the first subject 201 and the second subject 202 (hereinafter referred to as "distance data 209") can be generated. Furthermore, when distance data 209 and the like are available, three-dimensional data can be generated.

In addition, the first and second conditions are input as follows:

First condition: Two or more faces can be detected in the image data 206.
Second condition: Two or more subjects having a face shape can be detected from the distance data 209.

As described above, when it is determined that all of the input first and second conditions are satisfied, photography is performed.

In this example, the camera system 203 acquires image data 206 and distance data 209 as examples of the first data and the second data. In this example, of the first subject 201 and the second subject 202, the second subject 202 is a person, and there is only one person, so the condition is not met and shooting is not performed.

The first judgment unit 103 performs face detection processing on the image data 206. In this example, the image data 206 is data of an image showing two faces, a first face image 207 and a second face image 208. Therefore, since the faces shown in the first face image 207 and the second face image 208 are detected, the first judgment unit 103 judges that the above first condition is satisfied.

The first determination unit 103 performs a process of detecting the shape of a face based on the distance data 209. First, in the distance data 209, the first subject 201 is a person drawn on a poster, as indicated by the first subject distance information 210, and therefore does not have any irregularities indicating the shape of a face. Therefore, the shape of a face is not detected by the first subject distance information 210.

On the other hand, the first judgment unit 103 determines, based on the distance data 209, that the second subject distance information 211 includes projections and recesses that indicate the shape of the face. Therefore, the shape of the face is detected from the second subject distance information 211.

Therefore, in this example, one subject having a face shape is detected. Therefore, in this example, the first judgment unit 103 judges that the above second condition is not satisfied.

The second determination unit 104 determines that two or more of the first and second conditions are not satisfied because the second condition is not satisfied. Therefore, the execution unit 105 does not execute the image capture. In this way, even if a subject such as the first subject 201 is captured, the image capture is prevented from being executed, and the image capture can be executed according to the photographer's intention.

In this example, if another person other than the second subject 202 appears within the angle of view, the second condition is also met. Therefore, the execution unit 105 executes the image capture.

For example, a condition for the RGB camera 204 may be that a specific object is not captured within the angle of view. This condition is input when, for example, the intention is to capture a landscape or the like. The specific object is recognized by inputting image data of the same type of object in advance, etc.

In addition, the conditions for the ToF camera 205 may be such that no object having a specified shape is captured within the angle of view.

By entering such conditions, you can prevent capturing images that include objects you do not want to capture.

On the other hand, the conditions may be entered so that the object to be photographed is within the angle of view.

The condition may also be that the subject is within a specified distance based on the distance data 209. For example, the condition may be input as "There is an object having a specified shape within 0.5 m of the camera system 203." In this way, a condition using the distance to the subject may be input. When such a condition is input, shooting can be performed with the composition or sense of distance intended by the photographer.

The ToF camera 205 is an example of a device that uses infrared rays. In this way, an optical sensor that measures light other than visible light, such as infrared rays (IR), may be used. For example, a sensor that detects infrared rays can distinguish people, etc., by their temperature. Furthermore, by using infrared rays, people or animals, etc. can be detected even in dark environments.

Furthermore, the condition may be that a specific heat source is within the angle of view. In this manner, when data is acquired from a sensor that uses temperature, the judgment can be made with high accuracy because it is made based on factors other than appearance.

Furthermore, when the RGB camera 204 and the ToF camera 205 are used, the following conditions may be used.

First condition: Two or more faces can be detected in the image data 206.
Second condition: Two or more subjects having a face shape can be detected from the distance data 209.
Third condition: The subject detected in the second condition is in focus.

There may also be a mode in which the faces of all captured subjects are brought into focus when shooting is performed. If all of the first, second, and third conditions are met, the second judgment unit 104 judges that two or more conditions are met. In this way, in a mode in which shooting is performed by bringing the faces of all captured subjects into focus, the combination of conditions as described above can prevent the camera from trying to bring the face of a poster, such as the first subject 201, into focus.

<Second Example>
8 is a diagram showing the second example. Hereinafter, as shown in the figure, the height direction (the direction perpendicular to the XZ plane) is referred to as the "Y axis."

The imaging device 1 is an omnidirectional camera that generates data showing a omnidirectional image. For example, a omnidirectional image is an image that shows all directions in the horizontal direction (the X-Z plane direction). Furthermore, a omnidirectional image is an image that shows a wide range of 180° or more in the vertical direction (the X-Y plane direction). Note that it is desirable for the angle of view to be as wide as 100° or more in the horizontal or vertical direction.

Figure 8 (A) shows an example in which the photographer 301 holds the imaging device 1 in his/her hand and performs imaging operations at his/her fingertips.

Figure 8 (B) shows an example in which the imaging device 1 is placed at a high position using a support rod 304, and imaging is performed at a high position.

Therefore, when comparing Figure 8 (A) and Figure 8 (B), the position at which the imaging device 1 performs imaging is different.

In this example, for example, the first condition and the second condition are input as follows:

First condition: The shutter button is pressed.
Second condition: The photographer 301 is not photographed within the shooting range.

In a spherical camera or the like with a wide shooting range of an image capturing device of 100° or more, unintended subject capture is likely to occur. In addition, when the shooting range is wide, it may be difficult to determine the timing when the subject to be captured falls within the shooting range. A condition is input so that shooting is performed to prevent such capture, or so that shooting is performed when the subject to be captured falls within the shooting range.

In this example, the specified subject is the photographer 301, and the second condition is that the specified subject is not captured within the shooting range of the shooting device. Such a condition can prevent the specified subject from being captured.

In this example, the first condition is when the shutter button is pressed. With this condition, the photographer can take the picture at the timing they intend.

It is also preferable that the imaging system is configured to have an altimeter that measures the height of the imaging device 1. The imaging system then obtains data indicating the results of measuring the height of the imaging device 1 from the altimeter. With such a configuration that uses an altimeter, the height of the imaging device 1 can be ascertained.

When using an image capture device 1 with a wide shooting range, the shooting range of the image capture device 1 is often wide, for example, as in the shooting range 302. On the other hand, there is, for example, a blind spot 303 with respect to the shooting range 302.

In the case of FIG. 8(A), the photographer 301 is in the shooting range 302, i.e., the photographer 301 is captured in the image, and the second condition is not met. Therefore, as shown in FIG. 8(B), the imaging device 1 is placed with a support rod 304 at a height that puts the photographer 301 in a blind spot 303. In this way, it is possible to prevent the photographer 301 from being captured in the image.

For example, in FIG. 8(A), the first condition is met by pressing the shutter button.

On the other hand, the second condition is met by detecting that a certain height has been reached by determining that the photographer 301 is not in the image if the height is as shown in FIG. 8(B).

The second determination unit 104 determines that two or more conditions are not satisfied if either the first condition or the second condition is not satisfied.

When the condition that such a camera is at or above a certain height is input, it is possible to prevent a certain subject from appearing within the shooting range of the camera, and to perform shooting at the timing intended by the photographer.

<Third Example>
9 is a diagram showing a third example. In this example, a camera 34, which is an example of an imaging device, is photographed by creating a certain distance from a third subject 31 using a support rod 32 for photography. As shown in the figure, the third subject 31 is, for example, two people. It is assumed that one of the third subjects 31 presses the shutter button of the camera 34 using the support rod 32 for photography. This is a case where photography is performed as a so-called "selfie."

Also, assume that one of the third subjects 31 has a smartphone 2, which is an example of a communication device. The smartphone 2 and the camera 34 can communicate with each other by short-range wireless communication or the like, and the distance between the devices can be measured by radio wave intensity or the like. The communication device may be a type of smartphone 2.

In this way, the photography system uses the communication device to measure the distance between the photography device and the subject. That is, the photography system regards the inter-device distance as the distance between the photography device and the subject, and acquires data indicating the inter-device distance from the communication device. In this way, the photography system measures the distance between the photography device and the subject. In this example, point A PA and point B PB are the distance between the photography device and the subject.

The distance between the imaging device and the subject is different in Fig. 9(A) and Fig. 9(B). In the following, the distance between the devices in Fig. 9(A) is assumed to be "30 cm." On the other hand, the distance between the devices in Fig. 9(B) is assumed to be "80 cm."

The camera 34 also has an acceleration sensor that measures acceleration. The imaging system then obtains data indicating acceleration from the camera 34.

In this example, for example, the first condition and the second condition are input as follows:

First condition: The subject's entire body is within the shooting range.
Second condition: There is no camera shake.

The first condition is that when the subject is a plurality of people, the entire bodies of all of the people are included.

In this way, when photographing the third subject 31 at a certain distance, the camera 34 is far away from the photographer, so even if the photographer intended to have the entire subject's body within the shooting range, it is difficult to perform the photograph while checking whether the composition is as intended. In this way, if the distance between the photographing device and the subject is insufficient, the photograph is often not photographed with the composition as intended by the photographer.

Furthermore, when photography is performed using the support rod 32 for photography, it often becomes unstable. That is, the camera 34 is located near the tip of the support rod 32 for photography and acts as a weight. Furthermore, when the support rod 32 for photography becomes longer, the camera 34 is more likely to become unstable and a state in which a large acceleration occurs, known as "camera shake." In this way, when photography is performed in a state of large acceleration, the photography is often performed in a blurrier state than the photographer intended due to "camera shake."

In the following, it is assumed that the camera angle of view 33 as shown in the figure is constant. In this example, in the state of FIG. 9(A), the entire body of the subject is not within the shooting range. On the other hand, if there is a sufficient distance between the shooting device and the subject, in the state of FIG. 9(B), the entire body of the subject is within the shooting range. In this way, it is preset that when the distance between the shooting device and the subject is "80 cm" or more, the entire body of the subject is within the shooting range, i.e., the first condition is satisfied.

With this setting, when the distance between the photographing device and the subject measured by the smartphone 2 reaches "80 cm" as shown in Figure 9 (B), the photographing system determines that the first condition is met.

In addition, if the acceleration is equal to or less than a predetermined value, the imaging system determines that the camera 34 is stable, i.e., that no "camera shake" is occurring. Note that the predetermined value is set in advance.

When the condition that the distance between the camera and the subject is a certain distance or more is input, the subject can be captured within the shooting range of the camera, and an image with the intended composition can be captured. Also, when the condition that the acceleration of the camera is below a predetermined value is input, the image can be captured with the quality intended by the photographer, with less degradation due to camera shake, etc.

<Examples of Effects>
10 is a diagram showing an example in which a photograph is taken at a timing different from the original intention. An example in which the user intends to photograph scenery and landscapes will be described below. In addition to the scenery and landscapes, a building is also captured in the photographing angle of view 401 shown in the figure. As shown in the figure, a poster 403 is put up on this building. Also, a face image 402 of a person is drawn on the poster 403.

As a further setting, assume that a mode for photographing scenery and landscapes is preset in the photographing device. In this mode for photographing scenery and landscapes, if a facial image 402 is within the photographing angle of view 401, the facial image 402 may be recognized by a face detection function, i.e., the face depicted on the poster 403 may be recognized as the face of an actual person.

With such settings and recognition results, shooting may not be performed or a warning may be output, such as that the mode setting is incorrect, and shooting may occur at a timing different from the original intention. Depending on the device or settings, it may be difficult to shoot scenery and landscapes unless you reset the mode, remove the face image 402 from the shooting angle of view 401, turn off the face recognition function, or take other steps.

On the other hand, with a configuration like this embodiment, even if the face image 402 is captured, the image can be captured according to the photographer's intentions.

<Regarding the photographer's intended timing>
The timing intended by the photographer is determined, for example, by the photography mode selected by the photographer, or the settings individually made to the photography device (in this case, the mode that accepts settings), etc. Therefore, the timing intended by the photographer is determined in various ways based on the settings, modes, etc.

<Conditions>
The conditions are not limited to the above examples. For example, the conditions may be determined by a combination of selected or predetermined conditions depending on the shooting mode.

<Sharing of data acquisition scope>
It is desirable that the photographing range of the photographing device and the data acquisition range such as the detection range of the sensor are set so that at least a part of them is shared.

In other words, it is desirable that the multiple data acquired by the acquisition unit be data generated by sensing a similar range.

In this way, when data is generated for a shared range, data on a similar subject is obtained. For example, when image data is used for both the first and second conditions and images are taken with different imaging devices, it is desirable that the angle of view of both imaging devices is the same. In this way, conditions can be judged for similar subjects and conditions when the range and environment from which data is obtained are the same, thereby increasing the accuracy of judging the conditions.

<Modification>
The data and conditions may be combined in other ways than those shown above.

In the above example, the image capture is performed when the conditions are met, but the opposite condition may be set so that the image capture is not performed.

Each device does not have to be a single device. In other words, each device may be a combination of multiple devices. Note that the configuration may include additional devices other than those shown in the figure.

The above-mentioned photographing method may also be realized by a program. When the photographing method is executed based on the program, the arithmetic unit and control unit of the computer perform calculations and control based on the program to execute each process. Also, the storage unit of the computer stores data used in the processes based on the program to execute each process.

The program may also be distributed by recording it on a computer-readable storage medium. The storage medium may be a magnetic tape, flash memory, optical disk, magneto-optical disk, magnetic disk, or other such medium. Furthermore, the program may be distributed through telecommunications lines.

The embodiment of the present invention may be realized by an imaging system having an information processing device or an imaging device having the functions of an information processing device. The imaging system may also execute each process and data storage in a redundant, distributed, parallel, virtualized, or combination of these in a plurality of information processing devices.

Although one example of an embodiment has been described above, the present invention is not limited to the above embodiment. In other words, various modifications and improvements are possible within the scope of the present invention.

1 Photographing device 2 Smartphone 10 Photographing system 31 Third subject 32 Photographing support rod 33 Camera angle of view 34 Camera 101 Input unit 102 Acquisition unit 103 First judgment unit 104 Second judgment unit 105 Execution unit 201 First subject 202 Second subject 203 Camera system 204 RGB camera 205 ToF camera 206 Image data 207 First face image 208 Second face image 209 Distance data 210 First subject distance information 211 Second subject distance information 301 Photographer 302 Photographing range 303 Blind spot 304 Support rod 401 Photographing angle of view 402 Face image 403 Poster PA Point A PB Point B

JP 2007-295390 A

Claims (16)

An imaging system for performing imaging of an imaging device,
an acquisition unit that acquires data including first data from an RGB camera and second data from a sensor that measures distance;
a determination unit that detects a predetermined subject based on the first data and the second data and determines whether a condition regarding the presence or absence of the predetermined subject is satisfied;
an execution unit that executes photography by the photography device when it is determined that the condition is satisfied;
An imaging system comprising: An imaging system for performing imaging of an imaging device,
an input unit for inputting a plurality of conditions for executing photography;
an acquisition unit that acquires data on the plurality of conditions from an RGB camera and a sensor that measures distance ;
a first determination unit that determines, based on first data from the RGB camera and second data from a sensor that measures the distance, whether or not a state indicated by the first data and the second data satisfies each of the plurality of conditions;
a second determination unit that determines whether or not two or more conditions related to the presence or absence of a predetermined subject are satisfied among the plurality of conditions;
and an execution unit that executes photography by the photographing device when it is determined that a condition regarding the presence or absence of two or more of the predetermined subjects is satisfied. the acquiring unit acquires a plurality of types of data including the first data and the second data ;
The imaging system according to claim 1 , wherein the plurality of types of data are generated for a shared range. The condition regarding the presence or absence of the predetermined subject is
The photographing system according to claim 1 , wherein a condition is included in which the predetermined subject is not photographed within a photographing range of the photographing device. The condition regarding the presence or absence of the predetermined subject is
The photographing system according to claim 1 , wherein a condition is met in which the predetermined subject is captured within a photographing range of the photographing device. The photographing system according to claim 1 , wherein the photographing range of the photographing device is 100° or more . Any one of the above conditions is
7. The photographing system according to claim 2 , further comprising a condition that a shutter button of the photographing device is pressed. The photographing system according to claim 1 , wherein the acquisition unit acquires the data from a device that uses infrared rays. The camera further includes an acceleration sensor that measures the acceleration of the image capturing device,
The photographing system according to claim 1 , wherein the acquisition unit acquires the data from the acceleration sensor. Any one of the above conditions is
The photographing system according to claim 2 , further comprising a condition that a subject is present within a predetermined distance from the photographing device. Any one of the above conditions is
The photographing system according to claim 2 , further comprising a condition that a heat source is present within the angle of view of the photographing device. Any one of the above conditions is
The photographing system according to claim 2 , further comprising a condition that the acceleration of the photographing device is equal to or less than a predetermined value. an acquisition unit that acquires data including first data from an RGB camera and second data from a sensor that measures distance;
a determination unit that detects a predetermined subject based on the first data and the second data and determines whether a condition regarding the presence or absence of the predetermined subject is satisfied;
an execution unit that executes photography when it is determined that the above condition is satisfied;
An imaging device comprising: an input unit for inputting a plurality of conditions for executing photography;
an acquisition unit that acquires data on the plurality of conditions from an RGB camera and a sensor that measures distance ;
a first determination unit that determines, based on first data from the RGB camera and second data from a sensor that measures the distance, whether or not a state indicated by the first data and the second data satisfies each of the plurality of conditions;
a second determination unit that determines whether or not two or more conditions related to the presence or absence of a predetermined subject are satisfied among the plurality of conditions;
and an execution unit that executes photography when it is determined that a condition regarding the presence or absence of two or more of the predetermined subjects is satisfied. A photographing method performed by a photographing system that performs photographing of a photographing device,
An acquisition step in which the photography system acquires data including first data from the RGB camera and second data from a sensor that measures distance;
a determination step in which an image capturing system detects a predetermined subject based on the first data and the second data and determines whether a condition regarding the presence or absence of the predetermined subject is satisfied;
an execution procedure for executing photography by the photography device when the photography system determines that the condition is satisfied;
A method of shooting including. A photographing method performed by a photographing system that performs photographing of a photographing device,
an input procedure for inputting a plurality of conditions for executing photography by the photography system;
an acquisition step in which the photography system acquires data on the plurality of conditions from each of an RGB camera and a sensor that measures distance ;
a first determination step in which the photography system determines, based on first data from the RGB camera and second data from a sensor that measures the distance , whether or not a state indicated by the first data and the second data satisfies each of the plurality of conditions;
a second determination step in which the photographing system determines whether or not two or more conditions related to the presence or absence of a predetermined subject are satisfied among the plurality of conditions;
and an execution step of executing photography by the photographing device when the photographing system determines that a condition regarding the presence or absence of two or more of the predetermined subjects is satisfied.

Images