JP2019208225A - Electronic apparatus and program - Google Patents

Abstract

To provide an electronic apparatus capable of performing automatic photographing at a proper opportunity for a photograph.SOLUTION: A camera 51 comprises: an acquisition unit 18 for acquiring a plurality of sensing signals including at least a sensing signal relating to sound by a sensor possessed by a subject; and a control unit 16 for determining an angle of view of the camera for imaging the subject on the basis of a comparison between a signal pattern of the sensing signals relating to sound and a reference pattern by using the acquired sensing signal relating to sound and setting the angle of view to perform automatic photographing.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an electronic device and a program.

  Shooting to detect the position of the target subject by providing a number of position sensors at predetermined intervals in the stadium, etc., and determining which position sensor received the signal emitted by the transmitter or IC tag possessed by the target subject A support device is known (see Patent Document 1).

Japanese Patent No. 4750158

  In the prior art, since the determination of the shooting timing is left to the cameraman, automatic shooting cannot be performed at an appropriate shutter chance.

According to the first aspect of the present invention, the electronic device uses an acquisition unit that acquires at least a sensing signal related to sound by a sensor included in the subject, and a camera that captures the subject using the acquired sensing signal related to sound. And a control unit for determining the angle of view.
According to the second aspect of the present invention, the program obtains at least a sensing signal related to sound by a sensor included in the subject, and an image of a camera that captures the subject using the acquired sensing signal related to sound. And causing the computer to execute the process of determining the corners.
According to the third aspect of the present invention, the electronic device obtains a signal related to a plurality of sounds from a mobile device, and a control for determining an angle of view taken by the camera using the obtained plurality of signals. A section.
According to a fourth aspect of the present invention, a program acquires a signal related to a plurality of sounds from a mobile device, and determines a field angle captured by a camera using the acquired signals related to the plurality of sounds. , Execute on the computer.
According to the fifth aspect of the present invention, the electronic device includes: an acquisition unit that acquires a plurality of sensing signals including sound by a plurality of sensors included in a subject; and a plurality of sounds included in the plurality of sensing signals. And a control unit that determines shooting timing based on a similar sound signal pattern.

It is a figure explaining the imaging | photography system by 1st embodiment of this invention. It is a block diagram explaining the structural example of a camera. FIG. 3A is a flowchart illustrating processing executed by the camera, and FIG. 3B is a flowchart illustrating processing executed by the sensing device. It is a figure explaining the imaging | photography system by 2nd embodiment of this invention. It is a figure which illustrates the composition of a camera and an auto pan head. FIG. 6A is a flowchart illustrating processing executed by the camera, and FIG. 6B is a flowchart illustrating processing executed by the sensing device. It is a figure explaining an audio | voice matching process. It is a figure explaining determination of an imaging direction. It is a figure explaining the imaging | photography system by 3rd embodiment of this invention. It is a block diagram which illustrates the principal part structure of a highly functional mobile telephone. FIG. 11A is a diagram illustrating a display screen when the direction to be photographed differs from the direction of the camera, and FIG. 11B is a case in which the direction to be photographed matches the direction of the camera. It is a figure which illustrates a display screen. FIG. 12A is a flowchart illustrating processing executed by the sensing device, and FIG. 12B is a flowchart illustrating processing executed by the automatic photographing apparatus. It is a figure which illustrates the notification display screen displayed on the display surface of the display and input part of an information display apparatus. It is a flowchart which illustrates the flow of the process which an information display apparatus performs. It is a figure explaining supply of the program to a mobile device.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.
(First embodiment)
<Explanation of usage>
FIG. 1 is a diagram for explaining a photographing system according to a first embodiment of the present invention. In FIG. 1, the camera 51 and the high-function mobile phone 100 constitute an imaging system. The camera 51 is set on a tripod 52. The camera 51 is equipped with a wireless communication unit.
The wireless communication unit may be mounted in an accessory terminal outside the housing of the camera 51 in addition to being mounted in the housing of the camera 51.

  A person 1 carries a high-function mobile phone 100 called a smartphone. The advanced mobile phone 100 executes a basic application program called an operating system (OS) and then executes a predetermined application program (hereinafter simply referred to as an application) that runs on the OS. Since smartphones are publicly known, detailed description of the high-function mobile phone 100 is omitted in the description of the present embodiment, but is the same as that illustrated in FIG. 10 in the description of the third embodiment to be described later.

  When the high function mobile phone 100 executes an application for a camera, for example, the high function mobile phone 100 operates as a camera, and when the high function mobile phone 100 executes an application for providing information, the high function mobile phone 100 Operates as a sensing device. In the present embodiment, since the high-function mobile phone 100 is used as a sensing device, the high-function mobile phone 100 that executes the information providing application is hereinafter referred to as the sensing device 100.

  For example, the sensing device 100 performs PTP (Picture Transfer Protocol) connection with the camera 51 via a wireless LAN, and transmits sensing information to the camera 51 that is connected to PTP. In the present embodiment, an angular acceleration signal detected by an angular acceleration sensor built in the sensing device 100 and an acceleration signal detected by an acceleration sensor built in the sensing device 100 are used as sensing information.

  In the usage scene of FIG. 1, the person 1 operates the camera 51 to activate the self-portrait mode. The self-portrait mode is a mode in which the camera 51 automatically performs shooting including the person 1 when the person 1 who operates the camera 51 moves within the shooting angle of view of the camera 51 and substantially stops.

  The camera 51 obtains the movement locus of the person 1 based on sensing information transmitted from the sensing device 100 after the self-shooting mode is activated, and the person 1 moves within the shooting angle of view of the camera 51 based on the movement locus. If it is determined that the operation has stopped substantially, a photographing process is performed.

<Explanation of camera>
FIG. 2 is a block diagram illustrating a configuration example of the camera 51. In FIG. 2, a camera 51 includes an imaging optical system 11, an imaging element 12, an image data receiving unit 13, an image processing circuit 14, an LCD monitor 15, a RAM 16, a flash memory 17, a CPU 18, and communication control. A circuit 19 and an operation member 20 are provided.

  The image processing circuit 14, LCD monitor 15, communication control circuit 19, RAM 16, flash memory 17, and CPU 18 are each connected via a bus 21.

  The imaging optical system 11 includes a plurality of lens groups including a zoom lens and a focusing lens, and forms a subject image on the imaging surface of the imaging element 12. In order to simplify FIG. 2, the imaging optical system 11 is illustrated as a single lens. The image sensor 12 is configured by a CMOS image sensor or the like, and captures a subject image on the imaging surface. From the image sensor 12, a photoelectric conversion signal (image data) corresponding to the brightness is read for each pixel.

  The image data receiving unit 13 receives the image data read from the image sensor 12 and sends it to the image processing circuit 14. The image processing circuit 14 performs various types of image processing (color interpolation processing, gradation conversion processing, contour enhancement processing, white balance adjustment processing, etc.) on the image data.

  The LCD monitor 15 is constituted by a liquid crystal panel, and displays an image, an operation menu screen, and the like according to an instruction from the CPU 18. The RAM 16 is used as a work memory for the CPU 18. The RAM 16 temporarily stores image data in the image processing step by the image processing circuit 14. The flash memory 17 stores a program executed by the CPU 18.

  The CPU 18 controls the operation of the camera 51 by executing a program stored in the flash memory 17. The CPU 18 also performs AF (autofocus) operation control and automatic exposure (AE) calculation. The AF operation uses, for example, a contrast detection method for obtaining a focusing position of a focusing lens (not shown) based on image contrast information. In the exposure (AE) calculation, for example, the calculation is performed based on an image signal of an area that is a focus adjustment target.

  The operation member 20 includes a main switch, a release button, a menu switch, and the like. The operation member 20 sends an operation signal corresponding to each operation such as a main switch operation, a release operation, a menu selection operation, and a shutter speed change operation to the CPU 18. The CPU 18 monitors input of operation signals from the operation member 20.

  The CPU 18 calculates the movement trajectory of the person 1 based on sensing information transmitted from the sensing device 100 in the self-portrait mode, that is, the angular acceleration detection signal and the acceleration detection signal, and whether or not the person 1 is in a substantially stopped state. Determine whether. By calculating the movement trajectory, the position of the person 1 with respect to the camera 51 can be obtained. Further, it can be determined from the magnitude of the swing of the sensing device 100 whether the person 1 is moving or is stopped.

  In addition to the case where the release button is pressed (fully pressed) in the normal shooting mode, the CPU 18 determines that the person 1 has substantially stopped within the shooting angle of view of the camera 51 in the self-shooting mode. Then, an instruction is sent to each block in FIG. 2 to start the photographing process. That is, the CPU 18 of the camera 51 determines the shooting timing of the camera 51 in the self-portrait mode based on the sensing information transmitted from the sensing device 100.

The communication control circuit 19 transmits and receives radio waves via the antenna 19a in response to an instruction from the CPU 18 in order to perform wireless communication with the sensing device 100. In the present embodiment, the communication control circuit 19 performs wireless communication with the sensing device 100.
When the wireless communication unit is configured as an accessory outside the housing of the camera 51, the communication control circuit 19 may be mounted on the wireless communication unit.

<Description of flowchart>
A flow of processing executed by the camera 51 (CPU 18) in the self-portrait mode and a flow of processing executed by the sensing device 100 will be described with reference to a flowchart illustrated in FIG. FIG. 3A is a flowchart illustrating the process executed by the camera 51. FIG. 3B is a flowchart illustrating a process executed by the sensing device 100.

<Camera processing>
When the CPU 18 of the camera 51 is set to the self-portrait mode by a user operation, the process shown in FIG. In step S310, the CPU 18 activates the self-shooting mode process and proceeds to step S320. In step S320, the CPU 18 executes a connection sequence process and proceeds to step S330. In the connection sequence process, the PTP connection is performed with the terminal (sensing device 100) that transmitted the connection request.

  In step S330, the CPU 18 determines whether a release operation has been performed. If the release button constituting the operation member 20 is pressed, the CPU 18 makes a positive determination in step S330 and proceeds to step S340. If the release button is not pressed, the CPU 18 makes a negative determination in step S330 and proceeds to step S390.

  In step S340, the CPU 18 sends a transmission request for sensing information (angular acceleration signal and acceleration signal in this example) to the sensing device 100, and starts receiving sensing information detected and transmitted by the sensing device 100 at predetermined intervals.

  In step S350, the CPU 18 calculates the movement locus of the person 1 based on the received sensing information. The CPU 18 considers that the position of the person 1 at the time when the first sensing information is acquired is equivalent to the position of the camera 51, and obtains the movement locus of the person 1 based on the position of the camera 51.

  In step S <b> 360, the CPU 18 determines whether the position of the person 1 is within the shooting angle of view of the camera 51. As for the shooting angle of view, a value (viewing angle information) based on the design data of the imaging optical system 11 is recorded in the flash memory 17 in advance. If the position of the person 1 based on the movement trajectory exists within the angle of view, the CPU 18 makes a positive determination in step S360 and proceeds to step S370. If the position of the person 1 does not exist within the angle of view, the CPU 18 proceeds to step S360. Is negatively determined, and the process returns to step S340.

  In step S370, the CPU 18 determines whether the person 1 is stationary. If the CPU 18 determines that the movement of the person 1 has stopped and is substantially stopped based on the acceleration signal, the CPU 18 makes an affirmative determination in step S370 and proceeds to step S380. If it cannot be determined, a negative determination is made in step S370 and the process returns to step S340. When returning to step S340, the CPU 18 repeats the above-described processing. Even if the acceleration signal is not 0, the CPU 18 determines that it is substantially stopped if it is equal to or less than a predetermined value.

In step S380, the CPU 18 outputs a photographing permission command to perform photographing processing. The CPU 18 calculates the distance from the camera 51 to the person 1 based on the movement trajectory of the person 1 and performs the main photographing after adjusting the focus according to this distance.
It should be noted that the main photographing may be performed by a so-called setting pin in which the focus adjustment position is fixed in advance.

  In step S390, the CPU 18 determines whether or not to end the self-portrait mode. When the end operation is performed from the operation member 20, the CPU 18 makes a positive determination in step S390 and proceeds to step S400. If the end operation is not performed, the CPU 18 makes a negative determination in step S390 and returns to step S330. CPU18 which returns to step S330 repeats the process mentioned above.

In step S400, the CPU 18 ends the process of the self-portrait mode and ends the process of FIG.
In the above description, in step S370, the CPU 18 determines whether or not the person 1 is stationary, but step S370 may be omitted. That is, in step S360, if the CPU 18 determines that the position of the person 1 is within the shooting angle of view of the camera 51, the process proceeds to step S380, where the CPU 18 outputs a shooting permission command to perform shooting processing. It may be configured. In this case, the CPU 18 may be configured to output a photographing permission command after a predetermined time has elapsed after the CPU 18 determines that the position of the person 1 is within the photographing field angle of the camera 51.

<Processing on the sensing device side>
When the sensing device 100 executes the application for providing information by a user operation, the sensing device 100 starts the process illustrated in FIG. In step S710, the sensing device 100 starts the automatic shooting mode process and proceeds to step S720.

  In step S <b> 720, the sensing device 100 executes a connection sequence process and performs PTP connection with the camera 51.

  In step S <b> 730, the sensing device 100 determines whether there is a sensing information transmission request from the camera 51. The sensing device 100 makes an affirmative determination in step S730 when a transmission request is received, and proceeds to step S740. If no transmission request is received, the sensing device 100 determines negative in step S730 and proceeds to step S750.

  In step S740, the sensing device 100 transmits sensing information (in this example, an angular acceleration signal and an acceleration signal) to the camera 51, and proceeds to step S750.

  In step S750, the sensing device 100 determines whether to end the self-portrait mode. When the termination of the information providing application is instructed by a user operation, the sensing device 100 makes an affirmative determination in step S750 and proceeds to step S760. If the termination of the information providing application is not instructed, the sensing device 100 makes a negative determination in step S750 and returns to step S730. The sensing device 100 returning to step S730 repeats the above-described processing. As a result, when there is a transmission request for sensing information from the camera 51, the sensing device 100 transmits sensing information (an angular acceleration signal and an acceleration signal in this example) to the camera 51 at predetermined intervals.

  In step S760, the sensing device 100 ends the process of the self-portrait mode and ends the process of FIG.

According to the first embodiment described above, the following operational effects are obtained.
(1) The camera 51 uses the communication control circuit 19 that acquires sensing information from the sensing device 100 included in the person 1, the CPU 18 that determines the shooting timing of the camera 51 that images the person 1 using the acquired sensing information, I was prepared to. By sensing the information of the person 1 near the person 1, sensing can be performed with higher accuracy than when sensing at a position away from the person 1. For this reason, imaging can be performed at an appropriate imaging timing using a highly accurate sensing result.

(2) Since the CPU 18 outputs a command related to shooting based on the sensing information, for example, a command for permitting a release such as a shooting permission command or a command for informing the release timing in the case of manual shooting at an appropriate timing. Can output.

(3) The sensing information indicates the movement information of the person 1, and the CPU 18 calculates the movement locus of the person 1 based on the sensing information, and the person 1 moves within the angle of view of the camera 51 based on the movement locus. The above command is output when it is determined. By outputting a command based on the movement trajectory, the command can be output at an appropriate timing when the person 1 moves into the angle of view regardless of whether the person 1 moves early or late. .

(4) Since the CPU 18 outputs the command when it is determined that the person 1 has substantially stopped within the angle of view of the camera 51, the CPU 18 performs shooting while suppressing the image blur of the moving person 1. obtain.

(Modification 1)
The camera 51 may not be a digital camera and may be a silver salt camera as long as it communicates with the sensing device 100.
Further, the camera 51 may be configured by another mobile device such as another high-function mobile phone 100 or a tablet terminal that has executed the self-shooting mode application. The sensing device 100 may be configured by a wearable terminal such as a glasses type or a wristwatch type.

(Modification 2)
In the above description, an example in which the CPU 18 of the camera 51 issues a permission command for performing the photographing process (S380) has been described, but the processing corresponding to steps S350 to S370 may be performed on the sensing device 100 side. .

  In the second modification, when the release button that constitutes the operation member 20 is pressed, the CPU 18 makes an affirmative determination in step S330 and performs the following processing. That is, the CPU 18 transmits a request for photographing permission to the sensing device 100 and waits for photographing permission from the sensing device 100. The CPU 18 transmits the angle of view information to the sensing device 100 before requesting permission for photographing.

  The sensing device 100 that has received the request for permission to perform imaging performs processing corresponding to steps S350 to S370. Then, the sensing device 100 that has made an affirmative determination in the process corresponding to step S370 transmits a photographing permission command to the camera 51.

  In addition, the sensing device 100 transmits distance information to the camera 51 together with the photographing permission command. The distance information is a distance from the camera 51 to the person 1 calculated based on the movement locus of the person 1. The CPU 18 of the camera 51 that has received the photographing permission command from the sensing device 100 performs photographing processing in step S380. Also by the modification 2 demonstrated above, the effect similar to said 1st embodiment is acquired.

(Modification 3)
A position where the moving person 1 stops within the angle of view of the camera 51 may be determined in advance. The CPU 18 of the camera 51 or the sensing device 100 moves the person 1 to a predetermined position (for example, right, left, front, back in the shooting angle of view) based on the movement locus of the person 1. In this case, a shooting permission command is output.

(Modification 4)
Further, the shooting distance for outputting the shooting permission command may be determined in advance. The CPU 18 or the sensing device 100 of the camera 51 outputs a shooting permission command when the person 1 moves to a predetermined shooting distance based on the camera 51 based on the movement locus of the person 1.

(Second embodiment)
<Explanation of usage>
FIG. 4 is a diagram for explaining an imaging system according to the second embodiment of the present invention. In FIG. 4, a camera 51 and a plurality of high-function mobile phones (so-called smartphones) 100A to 100E constitute an imaging system. The camera 51 is equipped with a wireless communication unit. The wireless communication unit may be mounted on an accessory terminal outside the housing of the camera 51 in addition to being mounted in the housing of the camera 51. In addition, when the same code | symbol as the code | symbol used by description of 1st embodiment in FIG. 4, FIG. 5 exists, the description in this embodiment is applied preferentially.

In the example of FIG. 4, a camera 51 is arranged in a room where a plurality of persons A to E gather. The camera 51 is set on a tripod 52 having an automatic camera platform 53. The shooting direction of the camera 51 is controlled by the automatic pan head 53 driven by the motor performing pan (rotate left and right) and tilt (rotate up and down) operations. Person A to person E are not seated and can move freely in the room.
The camera 51 and the automatic camera platform 53 may be attached to the wall or ceiling of the room instead of being set on the tripod 52. Further, the camera 51 and the automatic camera platform 53 are not necessarily separate from each other, and the camera 51 may include the automatic camera platform 53.

  Person A to person E carry high-function mobile phones 100A to 100E, respectively. Each of the high-function mobile phones 100A to 100E executes a predetermined application after executing the OS. Since smart phones are known, detailed description of the high-functional mobile phones 100A to 100E is omitted, but is the same as that illustrated in FIG. 10 in the description of the third embodiment to be described later.

In the present embodiment, the high-function mobile phones 100A to 100E are caused to execute applications for providing information, and the high-function mobile phones 100A to 100E are used as sensing devices. Hereinafter, the high-functional mobile phones 100A to 100E that execute the information providing application are referred to as sensing devices 100A to 100E.
Instead of the high-function mobile phone, mobile devices such as tablet terminals, or wearable terminals such as glasses or wristwatches may be used as the sensing devices 100A to 100E.

  The sensing devices 100 </ b> A to 100 </ b> E perform wireless communication with the camera 51 and transmit sensing information to the camera 51. In the present embodiment, an audio signal detected by a microphone incorporated in sensing devices 100A to 100E, position information detected by a position detection unit incorporated in sensing devices 100A to 100E, and further incorporated in sensing devices 100A to 100E. An angular acceleration signal detected by the angular acceleration sensor is used as sensing information.

  In the usage scene of FIG. 4, the camera 51 is activated in advance in the automatic shooting mode. The automatic photographing mode is a mode in which the camera 51 automatically photographs the person A to the person E based on the sensing information sent from the sensing devices 100A to 100E.

  The camera 51 controls the shooting direction based on the sensing information transmitted from the sensing devices 100A to 100E after the automatic shooting mode is activated (for example, the person A, the person D, and the person E who are out of conversation). The camera 51 is directed to the group 61 to be configured), and at the same time (for example, when the conversation of the group 61 is excited), the photographing process is performed.

<Explanation of camera>
FIG. 5 is a diagram illustrating the configuration of the camera 51 and the automatic camera platform 53. The camera 51 is set on an automatic camera platform 53, and the automatic camera platform 53 is attached to a tripod 52 (FIG. 4). The camera 51 and the automatic camera platform 53 are connected by wireless communication. The camera 51 and the sensing devices 100A to 100E are also connected by wireless communication.
The connection between the camera 51 and the automatic camera platform 53 may be a wired communication connection instead of a wireless communication connection.

  The camera 51 includes a lens group 11, an image sensor 12, a power controller 13, a card controller 14, a card slot 15, a CPU 16, a communication driver 17, a transmission / reception circuit 18, and an I / F (interface) driver 19. And the operation member 20, the memory 21, the LCD driver 22, and the display 23, and the battery 31 and the memory card 32 are mounted.

  The lens group 11 includes a zoom lens, and forms a subject image on the image sensor 12. The image sensor 12 captures the subject image formed by the lens group 11. The power controller 13 converts the voltage of the battery 31 into a predetermined voltage and supplies it to each part in the camera 51. The card controller 14 writes data to the memory card 32 mounted in the card slot 15 and reads data recorded on the memory card 32 in accordance with an instruction from the CPU 16.

The CPU 16 performs automatic focus adjustment (AF), automatic exposure adjustment (AE), and photographing while controlling each part in the camera 51 based on a predetermined program recorded in a nonvolatile memory in the CPU 16. The communication driver 17 drives the transmission / reception circuit 18 in response to an instruction from the CPU 16. The transmission / reception circuit 18 transmits and receives radio waves in accordance with instructions from the CPU 16 in order to perform wireless communication with the sensing devices 100A to 100E. In the present embodiment, the transmission / reception circuit 18 performs wireless communication with the automatic camera platform 53 in addition to wireless communication with the sensing devices 100A to 100E.
When the wireless communication unit is configured as an accessory outside the housing of the camera 51, the communication driver 17 and the transmission / reception circuit 18 may be mounted on the wireless communication unit.

  The transmission / reception circuit 18 receives sensing information transmitted from the sensing devices 100A to 100E.

  An I / F (interface) driver 19 converts an operation signal from the operation member 20 into predetermined data and sends it to the CPU 16. The operation member 20 includes a release button, an operation dial, and the like, and issues an operation signal corresponding to an operation on the operation member 20. The memory 21 is used as a work memory for the CPU 16. The LCD driver 22 generates a display control signal for causing the display 23 to display an image or an operation menu screen based on an instruction from the CPU 16. The display 23 is constituted by an LCD (liquid crystal display) panel, for example, and performs display based on a display control signal from the LCD driver 23.

<Explanation of automatic head>
The automatic camera platform 53 includes a drive motor 41, a power supply controller 42, a CPU 43, a communication driver 44, a transmission / reception circuit 45, and a memory 46, and a battery 33 is mounted thereon.

  The drive motor 41 includes a pan motor and a tilt motor. The drive motor 41 rotates the automatic camera platform 53 in the left-right direction or rotates the automatic camera platform 53 in the up-down direction in accordance with the drive pulse signal supplied from the power controller 42. The power supply controller 42 converts the voltage of the battery 33 into a predetermined voltage and supplies it to each part in the automatic camera platform 53, and generates drive pulse signals for the pan motor and the tilt motor in accordance with instructions from the CPU 43. .

  The CPU 43 controls each part in the automatic camera platform 53 based on a predetermined program recorded in the nonvolatile memory in the CPU 43. The communication driver 44 drives the transmission / reception circuit 45 in response to an instruction from the CPU 43. The transmission / reception circuit 45 transmits and receives radio waves according to instructions from the CPU 43 in order to perform wireless communication with the camera 51. In the present embodiment, the transmission / reception circuit 45 performs wireless communication with the camera 51.

  The transmission / reception circuit 45 receives an instruction transmitted from the camera 51 for rotating the automatic camera platform 53 in the left-right direction and an instruction transmitted from the camera 51 for rotating the automatic camera platform 53 in the vertical direction. . That is, the pan operation and tilt operation of the automatic camera platform 53 (that is, the change in the shooting direction of the camera 51) is controlled by the control signal from the camera 51. The transmission / reception circuit 45 transmits information indicating the angles (left-right direction and vertical direction) set in the automatic camera platform 53 to the camera 51. The memory 46 is used as a work memory for the CPU 43.

  The shooting conditions (shutter speed, aperture, focal length, etc.) of the camera 51 are controlled by the CPU 16 of the camera 51. Further, the shooting timing of the camera 51 is determined by the CPU 16 of the camera 51 based on sensing information transmitted from the sensing devices 100A to 100E. The direction in which the camera 51 captures is also determined by the CPU 16 of the camera 51 based on sensing information transmitted from the sensing devices 100A to 100E. An image photographed by the camera 51 is stored in a memory card 32 attached to the camera 51.

<Description of flowchart>
A flow of processing executed by the camera 51 (CPU 16) in the automatic shooting mode and a flow of processing executed by the sensing device 100 will be described with reference to a flowchart illustrated in FIG. FIG. 6A is a flowchart illustrating a process executed by the CPU 16 of the camera 51. FIG. 6B is a flowchart illustrating processing executed by the sensing device 100 (100A to 100E).

<Camera processing>
When the CPU 16 is set to the automatic shooting mode by a user operation, the CPU 16 starts the process shown in FIG. In step S10, the CPU 16 activates the automatic photographing mode process and proceeds to step S20. In step S20, the CPU 16 activates the request handler process and proceeds to step S30. In the request handler process, for example, a connection request reception inquiry (Inquiry) is broadcast. The broadcast transmission is performed for transmission to many terminals (sensing device 100) existing in a wireless communication range.

  In step S30, the CPU 16 detects a terminal in which the automatic shooting mode is activated among terminals (sensing devices 100A to 100E) carried by the persons A to E. When the CPU 16 detects the terminal that transmits the connection request, the CPU 16 makes a positive determination in step S30 and proceeds to step S40. When the terminal that transmits the connection request is not detected, the CPU 16 repeats the detection process. .

  In step S40, the CPU 16 executes a connection sequence process and proceeds to step S50. In the connection sequence process, wireless connection is started with each terminal (sensing device 100) that transmitted the connection request, and an ID for recognizing each terminal (sensing device 100) is sent to each terminal. .

  In step S50, the CPU 16 executes a sound acquisition process and proceeds to step S60. In the voice acquisition process, for example, a voice acquisition start time is designated and a recording request is transmitted to the wirelessly connected terminal (sensing device 100). At this time, the time difference between the CPU 16 and the terminal (sensing device 100) is corrected in the terminal (sensing device 100) by transmitting the current time of the CPU 16 (camera 51 side).

  The CPU 16 receives voice information acquired by each terminal (sensing device 100) from a wirelessly connected terminal (sensing device 100) according to the recording request. The voice information includes an ID of each terminal (sensing device 100) and voice acquisition time information. The audio information is recorded data in units of a predetermined time (for example, 10 seconds).

  In step S60, the CPU 16 executes a voice matching process and proceeds to step S70. FIG. 7 is a diagram for explaining the voice matching process. The voice waveform 71 is a waveform based on voice information received from the sensing device 100A, and the horizontal axis represents time, and the vertical axis represents the frequency. The voice waveform 72 is a waveform based on voice information received from the sensing device 100B, and the horizontal axis represents time, and the vertical axis represents the frequency. The other audio waveforms 73 to 75 are also waveforms based on the audio information received from the sensing devices 100C to 100E, respectively.

  The CPU 16 detects similar speech waveforms from the speech waveforms 71 to 75 based on the speech information received from each terminal (sensing device 100). In the example of FIG. 7, the speech waveform 71, the speech waveform 74, and the speech waveform 75 are similar. For this reason, the CPU 16 determines that the audio waveform 71, the audio waveform 74, and the audio waveform 75 are substantially the same. In the present embodiment, the waveform shape is similar without using as a criterion the exact match as data, such as the magnitude of the sound (amplitude difference) or a partially different frequency component in the speech waveform. If this is the case, an approximate matching determination is made to determine that they are generally coincident.

  The reason for performing the approximate matching determination is that the sound collection conditions cannot be said to be the same in each terminal (sensing device 100) to the extent that voice data (pattern) can be determined to be exact. For example, when the positional relationship between the sound source (speaking person) and each terminal (sensing device 100) is different, the acquired sound level is different. Depending on whether or not the terminal (sensing device 100) is exposed and whether or not the terminal (sensing device 100) is stored in a pocket or bag of clothing, voice and May add another frequency component such as frictional noise. For this reason, in this embodiment, the exact coincidence determination of the speech waveform is not performed.

  As an example of the environment in which the audio waveform 71, the audio waveform 74, and the audio waveform 75 are similar, there is a scene in which the person A, the person D, and the person E gather together in FIG. Regardless of whether the sound source is one or plural, the sound waveforms obtained by recording sounds from the same sound source are similar. As illustrated in FIG. 4, the CPU 16 divides a person carrying a terminal (sensing device 100) corresponding to a similar voice waveform into blocks. The block 61 includes a person A, a person D, and a person E corresponding to the voice waveform 71, the voice waveform 74, and the voice waveform 75. The person B and the person C corresponding to the voice waveform 72 and the voice waveform 73 that are not similar to each other are referred to as individual blocks 62 and 63, respectively.

  In the present embodiment, the example in which the rough matching determination is performed on the speech waveform 71 to the speech waveform 75 has been described. However, the amplitude and frequency component of speech may be arbitrarily limited. For example, various matching determinations can be performed by comparing only sound waveforms whose sound level (sound pressure) is a predetermined value or higher, or comparing only sound waveforms whose frequency components are included in a predetermined frequency band. it can.

  In step S70 of FIG. 6, the CPU 16 determines whether there is a match in the voice matching process. As described above, the CPU 16 makes an affirmative decision in step S70 when it is determined that the speech waveforms are generally matched (similar), and proceeds to step S80. If it is not determined that the speech waveforms are generally matched (similar), it proceeds to step S70. A negative determination is made and the process returns to step S50. CPU16 which returns to step S50 repeats the process mentioned above.

In step S80, the CPU 16 acquires position information of the terminal (sensing device 100). CPU16 acquires each positional information from the terminal (In this example, sensing apparatus 100A, 100D and 100E in the block 61) corresponding to the audio | voice waveform which determined the similarity. The location information is a signal for detecting the location of the terminal (sensing device 100) in the room. For example, the location information may be a signal used in IMES (Indoor Messaging System), and indicates the access point location when using a wireless LAN. It may be a signal.
Instead of acquiring the position information of the terminal (sensing device 100) separately from the sound information, the camera 51 may include the position information in the sound information acquired in step S50. In this case, the ID of each terminal (sensing device 100), the sound acquisition time information of each terminal (sensing device 100), and the position information of each terminal (sensing device 100) are added to the sound information. It will be.

  In step S90, the CPU 16 performs automatic photographing and recording. Automatic shooting and recording are performed according to the following procedure. First, the CPU 16 determines the shooting direction of the camera 51 based on the position information of the sensing devices 100A, 100D, and 100E in the block 61. As illustrated in FIG. 8, the CPU 16 takes an image so as to include a region 90 (indicated by oblique lines) where three circles with the same radius centering on the positions of the sensing devices 100 </ b> A, 100 </ b> D, and 100 </ b> E intersect at the center of the shooting field angle. A direction to be determined is determined, and a command for informing the shooting direction is output to the automatic camera platform 53. Specifically, an instruction to rotate the automatic camera platform 53 is transmitted from the transmission / reception circuit 18. The radius of the circle may be changed as appropriate. That is, if the area 90 is too wide, the radius of the circle is reduced, and if the three circles do not intersect and the area 90 does not exist, the radius of the circle is increased.

  Further, the CPU 16 determines that the sensing devices 100A, 100D, and 100E (that is, the person A, the person D, and the person E) are out of the shooting angle of view based on the position information of the sensing devices 100A, 100D, and 100E in the block 61. In this case, the shooting angle of view is changed by changing the zoom magnification of the zoom lens of the lens group 11.

  Next, the CPU 16 performs face detection processing based on the preview image acquired by the image sensor 12, and performs automatic focus adjustment (AF) on the detected face (for example, the face of the person D). The preview image is a monitor image that is repeatedly acquired at a predetermined frame rate (for example, 60 fps) before the actual photographing.

In addition, the CPU 16 further determines that the sound level of the sound information transmitted from the terminal (in this example, the sensing devices 100A, 100D and 100E in the block 61) corresponding to the sound waveform determined to be similar to a predetermined level. If it exceeds, a shooting permission command is output to start actual shooting. In the main photographing, the image for recording is repeatedly acquired by the image sensor 12 at a predetermined frame rate (for example, 60 fps).
In addition to the determination based on the sound level of the sound information described above, the timing for starting the actual photographing is compared with the sound waveform determined to be similar to the reference waveform previously recorded in the nonvolatile memory in the CPU 16. You may decide based on a result. When the CPU 16 performs a known pattern matching process between the two waveforms and determines that the two waveforms are substantially the same, the CPU 16 starts the main photographing. As the reference waveform, for example, a speech waveform of a predetermined word such as a laughing voice, a melody phrase, or an exclamation can be used.
The reference waveform can be freely added to the nonvolatile memory in the CPU 16 or deleted from the nonvolatile memory by the user. Further, the CPU 16 that has started the main photographing based on the sound level may store the sound waveform acquired at that time in the nonvolatile memory as a reference waveform.

  The CPU 16 uses the memory card together with the audio information transmitted from the terminal (in this example, the sensing devices 100A, 100D, and 100E in the block 61) corresponding to the audio waveform for which the similarity is determined. 32.

In step S100, the CPU 16 determines whether or not to end automatic shooting. When the voice level of the voice information transmitted from the terminal (in this example, the sensing devices 100A, 100D, and 100E in the block 61) corresponding to the voice waveform determined to be similar falls below the predetermined level, the CPU 16 In step S100, an affirmative determination is made, the main photographing is terminated, and the process proceeds to step S110. When the sound level of the sound information transmitted from the sensing devices 100A, 100D, and 100E in the block 61 continues to exceed the predetermined level, the CPU 16 makes a negative determination in step S100 and performs the main photographing. The determination process is repeated while continuing.
Note that, even if the sound level of the sound information does not fall below the predetermined level, the automatic shooting may be terminated when a predetermined time has elapsed since the start of the main shooting.

  In step S110, the CPU 16 determines whether or not to end the automatic shooting mode. When the CPU 16 is set to a mode other than the automatic shooting mode by a user operation, the CPU 16 makes a positive determination in step S110 and proceeds to step S120. If the automatic shooting mode is maintained, the CPU 16 makes a negative determination in step S110 and returns to step S50. CPU16 which returns to step S50 repeats the process mentioned above.

  In step S120, the CPU 16 ends the process of the automatic shooting mode and ends the process of FIG.

  Note that the processes in steps S20 to S40 may be performed not only as the initial process in FIG. 6A but also at a predetermined timing during the automatic photographing process. By performing it at regular intervals, for example, the camera 51 can later add a wireless connection with the sensing device 100 carried by a person who joined late.

<Processing on the sensing device side>
When the sensing device 100 executes the application for providing information by a user operation, the sensing device 100 starts the process illustrated in FIG. In step S510, the sensing device 100 starts the automatic photographing mode process and proceeds to step S520.

  In step S <b> 520, when the sensing device 100 receives a connection request acceptance inquiry (Inquiry) from the camera 51, the sensing device 100 transmits a connection request to the camera 51. The sensing device 100 further executes a connection sequence. Specifically, wireless connection with the camera 51 is started.

  In step S530, the sensing device 100 determines whether an ID is received from the camera 51. The sensing device 100 makes an affirmative determination in step S530 when the ID is received, and proceeds to step S540. If the ID is not received, the sensing device 100 makes a negative determination in step S530 and waits for the reception of the ID.

In step S540, the sensing device 100 performs voice acquisition processing and proceeds to step S550. In the sound acquisition process, in response to a recording request from the camera 51, recording is performed for a predetermined time (in this example, 10 seconds) from the time designated by the camera 51. When recording, the sensing device 100 appends the ID of the sensing device 100 and the sound acquisition time information of the sensing device 100 to the recorded sound information and transmits it to the camera 51.
Note that the position information of the sensing device 100 may be attached to the recorded voice information.

  In step S550, the sensing device 100 determines whether to end the automatic shooting mode. When the termination of the information providing application is instructed by a user operation, the sensing device 100 makes a positive determination in step S550 and proceeds to step S560. If the termination of the information providing application is not instructed, the sensing device 100 makes a negative determination in step S550 and returns to step S540. The sensing device 100 returning to step S540 repeats the above-described processing.

  In step S560, the sensing device 100 ends the process of the automatic shooting mode and ends the process of FIG.

According to the second embodiment described above, the following operational effects can be obtained.
(1) The camera 51 uses the transmission / reception circuit 18 that acquires sensing information by the sensing devices 100A to 100E included in the persons A to E and the shooting timing of the camera 51 that images the persons A to E using the acquired sensing information. And a CPU 16 to be determined. By using the sensing devices 100A to 100E included in the persons A to E, it becomes possible to sense the information of the persons A to E near the persons A to E, and when sensing at a position away from the persons A to E. Compared to high-precision sensing. For this reason, imaging can be performed at an appropriate imaging timing using a highly accurate sensing result.

(2) The sensing information indicates a physical quantity of a type different from the positions of the persons A to E, and the CPU 16 outputs a command related to shooting based on the physical quantity. Commands can be output at the timing.

(3) The sensing devices 100A to 100E sense sound as the physical quantity, and the CPU 16 outputs the command based on a signal indicating sound. Thereby, a command can be output at an appropriate timing based on sounds sensed near the persons A to E.

(4) In the above description, the camera 51 has acquired a plurality of sounds respectively sensed by the plurality of sensing devices 100A to 100E, but may be configured to acquire sound from only one sensing device. . In this case, since the CPU 16 outputs the command based on the comparison between the sound signal pattern and the reference pattern, for example, the command can be output when the voice pattern matches a laughing voice, a song phrase, or a predetermined word. . Further, as compared with the case where the camera 51 directly acquires sound, by acquiring sound sensed by a sensing device included in the subject, sensing with higher accuracy can be performed.

(5) The sensing information indicates a plurality of sounds respectively sensed by the plurality of sensing devices 100A to 100E, and the CPU 16 outputs the command based on a signal pattern of similar sounds among the plurality of sounds. did. For example, the command is output so that the direction in which the sensing device 100A, the sensing device 100D, and the sensing device 100E with similar sensed sound patterns exist is set as the shooting direction. Accordingly, it is possible to perform appropriate shooting with a shooting target narrower than in the case of shooting including all the sensing devices 100A to 100E.

(6) The sensing information indicates the respective positions of the plurality of sensing devices 100A to 100E, and the CPU 16 determines the shooting direction of the camera 51 based on the plurality of positions at which similar sounds are sensed. . By determining the shooting direction based on the position of the sensing device 100A where the similar sound is sensed, the position of the sensing device 100D, and the position of the sensing device 100E, for example, the person A, the person D, and the person E chatting in the group 61 Can be taken as an object to be photographed.

(7) The CPU 16 changes the angle of view of the camera 51 so that a plurality of positions where similar sounds are sensed are included in the angle of view. As a result, when all the sensing devices 100A to 100E are not included in the angle of view, it is possible to cope with widening the angle of view.

(Modification 5)
As long as the camera 51 communicates with the sensing devices 100A to 100E, the camera 51 may be configured by a mobile device such as another high-performance mobile phone 100 that executes an application for the automatic shooting mode. In addition, the sensing devices 100A to 100E may be configured by wearable terminals such as glasses or watches.

(Modification 6)
In the above description, an example in which the shooting direction of the camera 51 is automatically controlled by driving the automatic camera platform 53 in the shooting direction determined by the CPU 16 of the camera 51 has been described. You may comprise so that it can do. In the modified example 6, the direction to be shot determined by the camera 51 is displayed on the display 23 of the camera 51. In the case of the modification 6, the display command for the display 23 corresponds to a command for informing the direction to be photographed. The display content of the display 23 can be performed, for example, in the same manner as in the case of FIG.

  According to the modified example 6, it is possible to notify the person who operates the camera 51 of the direction to be shot determined by the camera 51.

(Modification 7)
Based on the vibrations detected by the sensing devices 100A to 100E, the timing for starting the main photographing may be determined. The CPU 16 permits photographing when the amplitude of vibration information transmitted from a predetermined sensing device (for example, a sensing device corresponding to a speech waveform determined to be similar as described above) exceeds a predetermined level. Output a command to start actual shooting.

In general, a person who excites a field often swings greatly. For this reason, there is a high possibility of a photo opportunity when the vibration of the sensing device carried by the person increases.
In addition, when a person dances, a sensing device carried by the dancing person detects a large vibration. For this reason, there is a high possibility of a photo opportunity when the vibration of the sensing device carried by the dancing person increases.

  According to the modified example 7, it is possible to determine the timing of starting the actual photographing based on the vibration level of the vibration information in addition to the determination based on the sound level of the sound information.

(Third embodiment)
<Explanation of usage>
FIG. 9 is a diagram for explaining an imaging system according to the third embodiment of the present invention. In FIG. 9, a plurality of high-function mobile phones (so-called smartphones) 100A, 100B-1, and 100B-2 constitute an imaging system.

  In the present embodiment, a person O and a person P who carry a high-function mobile phone 100 (hereinafter referred to as sensing devices 100B-1 and 100B-2) that execute an information providing application are respectively connected to the sensing device 100B-1, Photographing is performed using 100B-2. The sensing devices 100B-1 and 100B-2 include an imaging unit (camera module), and the person O and the person P respectively photograph a favorite landscape, another person, an animal, a flower, and the like.

  Each of the sensing devices 100B-1 and 100B-2 that has performed the imaging process broadcasts the imaging time, position information, and information indicating the imaging direction to other high-function mobile phones as sensing information. Another high-function mobile phone is a high-function mobile phone 100 (hereinafter referred to as an automatic photographing device 100A) that executes an application for automatic photographing, and a person Q different from the person O and the person P is carried by the person. The automatic photographing apparatus 100A may be configured as the camera 51 and the automatic camera platform 53 described in the second embodiment.

  When photographing is performed by the sensing devices 100B-1 and 100B-2, sensing information (for example, information that photographing is performed) is collected in the automatic photographing apparatus 100A. 100 A of automatic imaging devices determine the direction which should be image | photographed based on the collected sensing information. For example, a direction in which more shooting is performed is set as a direction to be shot.

  The automatic photographing apparatus 100A further performs automatic photographing at a timing determined based on the collected sensing information. For example, photographing is performed when more sensing information is gathered.

  The sensing devices 100B-1 and 100B-2 and the automatic photographing device 100A as described above will be described in more detail. FIG. 10 is a block diagram illustrating the main configuration of the high-function mobile phone 100. When the same reference numerals as those used in the description of the first embodiment and the second embodiment exist in the drawing, the description in the present embodiment is applied with priority.

  Sensing devices 100B-1 and 100B-2 and automatic photographing apparatus 100A have the same configuration as high-function mobile phone 100. That is, the high-function mobile phone 100 includes a display / input unit 25, a control unit 30, a camera 26, a camera 27, a communication unit 28, and a sensor group 29.

  The display / input unit 25 includes a display surface 22 and a position detection unit 23. The display surface 22 also serves as an operation surface. The position detection unit 23 includes a position detection signal indicating a contact position by a finger and display information (information indicating where and what is displayed on the display surface 22 of the display / input unit 25) of the display control unit 33. Based on this, an object (such as an icon) on the screen of the display / input unit 25 is specified.

  The control unit 30 includes a program execution unit 32, a display control unit 33, a communication control unit 34, and a nonvolatile memory 35, and controls the operation of each unit in the high function mobile phone 100. The program execution unit 32 executes a basic program called an operation system (OS), and then reads and executes an application running on the OS from the nonvolatile memory 35. Note that reading an application from the nonvolatile memory 35 and executing the application may be simply referred to as starting the application.

  The program execution unit 32 normally executes an application associated with an icon (not shown) specified by the position detection unit 23 of the display / input unit 25. When the program execution unit 32 executes the camera application, the program execution unit 32 activates the camera 26 or 27 to exhibit the photographing function. When the program execution unit 32 executes the information providing application, the program execution unit 32 causes the high-function mobile phone 100 to function as a sensing device. When the program execution unit 32 executes an application for automatic shooting, the program execution unit 32 activates the camera 27 to exhibit the automatic shooting function. The user can activate any application corresponding to the icon displayed on the display surface 22 of the display / input unit 25.

  The display control unit 33 displays images, texts, icons, and the like on the display surface 22 of the display / input unit 25. The communication control unit 34 controls communication with an external device performed through the communication unit 28. The nonvolatile memory 35 stores the OS, applications, and necessary data. The user can add or delete any application that operates on the OS to the nonvolatile memory 35.

  The camera 26 is used as a user shooting camera when shooting the user himself / herself or when using the videophone function of the high-function mobile phone 100. The camera 27 is used as a shooting camera when the high function mobile phone 100 exhibits a shooting function / automatic shooting function.

  The communication unit 28 performs wireless communication in response to an instruction from the communication control unit 34. The communication unit 28 directly communicates with other high-function mobile phones 100 in addition to communication via a wireless LAN access point (not shown) or communication via a mobile phone network (not shown). The wireless communication can be performed. Near field communication includes what constitutes a mesh network.

  The sensor group 29 includes a luminance sensor, a sound sensor (microphone), an angular acceleration sensor, an acceleration sensor, a gravity sensor, a temperature sensor, an atmospheric pressure sensor, a humidity sensor, a magnetic sensor, a direction sensor, and a position detection unit. The position detection unit acquires position information based on a transmission wave from a GPS satellite outdoors, and obtains position information based on a transmission wave based on IMES, for example, indoors. The sensor group 29 sends a signal detected in response to a request from the control unit 30 and acquired information to the control unit 30.

<Transmission of sensing information>
The sensing devices 100B-1 and 100B-2 that have executed the information providing application execute shooting processing according to the release operation performed by the person O and the person P, respectively. The shooting process itself is the same as a normal shooting process when a camera application is executed.

  The sensing devices 100B-1 and 100B-2 that have performed the photographing process further use the photographing time of each device, the position information of each device, and information indicating the direction of photographing of each device as automatic sensing device 100A. Broadcast to. The broadcast transmission is performed in order to send sensing information to many automatic photographing devices when there is an automatic photographing device other than the automatic photographing device 100A within a range where wireless communication is possible.

<Determination of shooting direction>
As described above, the automatic photographing apparatus 100A that has executed the automatic photographing application determines the photographing direction based on the sensing information transmitted from the sensing devices 100B-1 and 100B-2. The determined shooting direction is displayed on the display surface 22 of the display / input unit 25. FIG. 11 is a diagram illustrating a display screen of the display surface 22. Details of the method for determining the shooting direction will be described later.

  FIG. 11A shows a display screen when the shooting direction (direction to be shot) is different from the direction of the camera 27 of the automatic shooting device 100A. When the shooting direction (direction to be shot) is the east direction, the control unit 30 displays a message so that the camera 27 faces the east direction.

  FIG. 11B is a display screen when the shooting direction (direction to be shot) matches the direction of the camera 27 of the automatic shooting device 100A. When the direction (east direction) of the camera 27 matches the shooting direction (direction to be shot), the control unit 30 displays that fact.

<Determining shooting timing>
The automatic photographing apparatus 100A further determines a predetermined timing (for example, the number of times the sensing information is received within a predetermined time (for example, within the last 10 seconds) based on the sensing information transmitted from the sensing devices 100B-1 and 100B-2. The photographing process is started at the time when (10 times) is exceeded.

<Description of flowchart>
A flow of processing executed by the automatic photographing apparatus 100A in the automatic photographing mode and a flow of processing executed by the sensing devices 100B-1 and 100B-2 will be described with reference to a flowchart illustrated in FIG. FIG. 12A is a flowchart illustrating processing executed by the sensing devices 100B-1 and 100B-2. FIG. 12B is a flowchart illustrating a process executed by the automatic photographing apparatus 100A.

<Processing on the sensing device side>
When the sensing devices 100B-1 and 100B-2 each execute an information providing application by a user operation, the processing illustrated in FIG. Since the sensing devices 100B-1 and 100B-2 perform the same processing, the following description will be made as the sensing device 100B. In step S210, the sensing device 100B starts the information providing shooting mode process and proceeds to step S220.

  In step S220, the sensing device 100B determines whether a release operation has been performed. For example, when the camera icon displayed on the display surface 22 of the display / input unit 25 is tapped, the sensing device 100B makes a positive determination in step S220 and proceeds to step S230. When the camera icon is not tapped, A negative determination is made in step S230 to wait for a tap operation.

  In step S230, the sensing device 100B executes a photographing process by the camera 27 and proceeds to step S240. In step S240, the sensing device 100B acquires sensing information (in this example, information indicating shooting time, position information, and shooting direction) from the sensor group 29, and proceeds to step S250.

  In step S250, the sensing device 100B sends an instruction to the communication unit 28, transmits sensing information, and proceeds to step S260. In step S260, the sensing device 100B determines whether to end the information providing shooting mode. When the termination of the information providing application is instructed by a user operation, the sensing device 100B makes a positive determination in step S260 and proceeds to step S270. If the information providing shooting mode is maintained, the sensing device 100B makes a negative determination in step S260 and returns to step S220. The sensing device 100B returning to step S220 repeats the above-described processing.

  In step S270, the sensing device 100B ends the information providing shooting mode process and ends the process of FIG.

<Processing on the automatic photographing device>
When the automatic photographing apparatus 100A executes an automatic photographing application by a user operation, the automatic photographing apparatus 100A starts the process illustrated in FIG. In step S610, the automatic photographing apparatus 100A activates the automatic photographing mode process and proceeds to step S620.

  In step S620, the automatic imaging device 100A determines whether sensing information has been received from the sensing device 100B. The automatic photographing apparatus 100A makes an affirmative decision in step S620 when receiving sensing information from the sensing device 100B and proceeds to step S630, and makes a negative decision in step S620 when not receiving sensing information from the sensing device 100B. Proceed to step S670.

  In step S630, the automatic photographing apparatus 100A accumulates the received sensing information (for example, records it in the nonvolatile memory 35), and proceeds to step S640. In step S640, the automatic photographing apparatus 100A determines a photographing direction based on sensing information corresponding to a plurality of photographings by the sensing device 100B. As illustrated in FIG. 9, the automatic image capturing device 100 </ b> A sets a position X where a plurality of straight lines extending from a plurality of image capturing positions by the sensing device 100 </ b> B to the direction imaged by each sensing device 100 </ b> B intersect. Estimated position. A symbol D1 in the figure indicates an orientation imaged by the sensing device 100B-1, and a symbol D2 in the diagram indicates an orientation imaged by the sensing device 100B-2.

  The automatic photographing apparatus 100A further determines a direction D from the own position detected by the position detection unit of the automatic photographing apparatus 100A to the estimated position X as a direction to be photographed by the automatic photographing apparatus 100A. The determined direction is displayed on the display surface 22 of the display / input unit 25 as illustrated in FIG.

  The user of the automatic image capturing device 100A displays the direction to be imaged (the above direction D) displayed on the display surface 22 of the display / input unit 25 and the direction of the camera 27 of the automatic image capturing device 100A (the direction detected by the direction sensor). It is only necessary to hold the automatic photographing apparatus 100A so that the two match.

  In step S650, automatic photographing apparatus 100A determines whether or not a predetermined condition for permitting release is satisfied. For example, the automatic photographing apparatus 100A sets the time when the number of sensing information receptions exceeds a predetermined number of times (10 times in the latest 10 seconds) in a predetermined time as an imaging timing, and at this time, an affirmative determination is made in step S650 and the process proceeds to step S660. . If the predetermined condition is not satisfied, automatic photographing apparatus 100A makes a negative determination in step S650 and returns to step S620. The automatic photographing apparatus 100A that returns to step S620 continues to receive the sensing information.

  In step S660, the automatic photographing apparatus 100A performs photographing processing. The automatic photographing apparatus 100A calculates the distance from the self-position detected by the position detection unit of the automatic photographing apparatus 100A to the estimated position X, and performs the main photographing after performing the focus adjustment according to this distance.

  In step S670, the automatic photographing apparatus 100A determines whether or not to end the automatic photographing mode. When the end operation is performed by the user, automatic photographing apparatus 100A makes an affirmative decision in step S670 and proceeds to step S680. If the ending operation is not performed, automatic photographing apparatus 100A makes a negative determination in step S670 and returns to step S620. The automatic photographing apparatus 100A returning to step S620 repeats the above-described processing.

  In step S680, the automatic photographing apparatus 100A terminates the automatic photographing mode process and terminates the process illustrated in FIG.

  In the present embodiment, the sensing device 100B and the automatic photographing device 100A are described separately for easy understanding. However, the sensing device 100B also serves as the automatic photographing device 100A, and the automatic photographing device 100A also serves as the sensing device 100B. It may be. That is, the high-function mobile phone 100 that executes both the information providing application and the automatic photographing application has a function as the sensing device 100B and a function as the automatic photographing apparatus 100A.

According to 3rd embodiment mentioned above, the following effect is obtained.
(1) The automatic photographing apparatus 100A includes a communication unit 28 that acquires a plurality of signals from the sensing device 100B, and a control unit 30 that outputs a command related to shooting of the camera 27 using the acquired plurality of signals. I made it. By using a plurality of signals from the sensing device 100B, it is possible to perform imaging at an appropriate imaging timing using a plurality of signals that cannot be directly obtained by the automatic imaging apparatus 100A.

(2) The plurality of signals include a position of the sensing device 100B, a signal indicating that the sensing device 100B has been released, and a signal indicating a direction taken by the sensing device 100B. The above command is output based on a signal indicating that the device 100B has been released. Thereby, for example, when the number of receptions of the plurality of signals exceeds 10 times in the latest 10 seconds, the photographing process can be performed. That is, when a large number of images are taken by the sensing device 100B, the images can be automatically taken.

(3) The control unit 30 sets the direction at which the plurality of straight lines indicating the directions photographed by the sensing device 100B from the positions of the plurality of sensing devices 100B intersect as the direction in which the camera 27 should photograph. Accordingly, the shooting direction by the automatic shooting device 100A can be automatically determined using the shooting direction by the sensing device 100B.

(Modification 8)
As long as the sensing devices 100B-1 and 100B-2 and the automatic photographing apparatus 100A can communicate with each other, another high-functional mobile phone 100 that executes an information providing application and an automatic photographing mode application. You may comprise by mobile devices, such as, and a wearable terminal.

(Fourth embodiment)
<Explanation of usage>
In the present embodiment, the high-function mobile phone 100 similar to that illustrated in FIG. 10 in the description of the third embodiment is provided with a function as a sensing device and a function as an information display device. There are a plurality of high-performance mobile phones 100 having a sensing function and an information display function, and a plurality of users carry these high-performance mobile phones 100 respectively.

  Each user who carries the high-performance mobile phone 100 performs shooting using his / her high-function mobile phone 100. Each user shoots a favorite landscape, person, animal, flower, etc. The mobile phone 100 that has performed the photographing operation is hereinafter referred to as a sensing device 100B.

Each sensing device 100B that has performed the imaging process broadcasts the imaging time, position information, and information associated with imaging to other high-function mobile phones 100 as sensing information. Information associated with shooting includes information on the subject and shooting scene obtained by analyzing the shot image, comments input by the user, and the like. User profile information may be included.
The reason for performing the broadcast transmission is to send sensing information to as many high-function mobile phones 100 as possible when there is another high-performance mobile phone 100 other than the sensing device 100B in a wireless communicable range.

  Another high-function mobile phone 100 (hereinafter referred to as information display device 100A) that has received the sensing information transmitted from the sensing device 100B performs a notification display informing the user that the sensing information has been received.

  FIG. 13 is a diagram illustrating a notification display screen displayed on the display surface 22 of the display / input unit 25 of the information display device 100A. The information display device 100A displays the current location (own position) and the shooting position of the sensing device 100B (position of the sensing device 100B) transmitted by the sensing information on the map screen. In FIG. 13, marks 82, 88, 92, 98, and 99 indicate the shooting positions of the sensing device 100.

  When the user of the information display device 100A performs a tap operation on the mark 98, for example, the information display device 100A displays the sensing information corresponding to the shooting position indicated by the mark 98 on the map. In the example of FIG. 13, the sensing information includes the shooting date and time, the nickname of the photographer (user of the sensing device 100B), the category of the photographed image, and the comment input by the photographer. Here, FIG. 13 is shown with a thumbnail image added, but it is shown in order to make the contents of the category and comment easy to understand. In the present embodiment, since the thumbnail image is not included in the sensing information, the thumbnail image is not normally displayed as a notification display.

<Description of flowchart>
The flow of processing executed by the information display device 100A will be described with reference to the flowchart illustrated in FIG. In FIG. 14, when the information display device 100A executes an information display application by a user operation, the information display device 100A starts the process of FIG. In step S810, the information display device 100A activates the information display mode process and proceeds to step S820.

  In step S820, the information display device 100A determines whether sensing information has been received from the sensing device 100B. The information display device 100A makes a positive determination in step S820 when receiving sensing information from the sensing device 100B and proceeds to step S830, and makes a negative determination in step S820 when it does not receive sensing information from the sensing device 100B. Proceed to step S860.

  In step S830, the information display device 100A accumulates the received sensing information (for example, records in the nonvolatile memory 35), and proceeds to step S840. In step S840, the information display device 100A determines whether there is information satisfying a predetermined condition based on sensing information corresponding to a plurality of times of shooting by the sensing device 100B. The predetermined condition is specified by, for example, a category (for example, nature, flower, animal, sports, sea, fireworks, car, aircraft, etc.) specified by the user or a comment (such as “Like”). To do.

  When there is information satisfying the predetermined condition in the received sensing information, the information display device 100A makes an affirmative determination in step S840 and proceeds to step S850, and information that satisfies the predetermined condition is received in the received sensing information. If it does not exist, a negative determination is made in step S840 and the process proceeds to step S860.

  In step S850, the information display apparatus 100A displays the notification display screen (FIG. 13) displayed on the display surface 22 of the display / input unit 25, and proceeds to step S860. The user of the information display device 100A who has seen the notification display screen can know where the shooting has been performed. When the user wants to take a picture, the user can take an action such as visiting the shooting position shown on the map.

  In step S860, the information display device 100A determines whether to end the display. When the end operation is performed by the user, the information display apparatus 100A makes an affirmative determination in step S860 and proceeds to step S870. If the end operation is not performed, the information display device 100A makes a negative determination in step S860 and returns to step S820. The information display apparatus 100A returning to step S820 repeats the above-described processing.

  In step S870, the information display device 100A ends the process of the information display mode and ends the process of FIG.

<Processing on the sensing device side>
The processing of the sensing device 100B can be represented by the flowchart on the left side of FIG. 12 illustrated in the description of the third embodiment. However, the sensing information acquired in step S240 in FIG. 12 includes shooting time, position information, and information associated with shooting. As described above, information associated with shooting is information on a subject or a shooting scene obtained by analyzing an image shot by the sensing device 100B, a comment input by the user, and the like.

  In the description of the flowchart, the sensing device 100B and the information display device 100A are described separately for easy understanding. However, the sensing device 100B also serves as the information display device 100A, and the information display device 100A also serves as the sensing device 100B. The points are as described above. That is, the high-function mobile phone 100 that executes both the information providing application and the information display application has both the function as the sensing device 100B and the function as the information display device 100A.

When the high-function mobile phone 100 having the sensing function and the information display function described in the fourth embodiment is used, an effect can be obtained in the following usage scene.
(1) When a character show starts at an amusement park or the like, a plurality of persons shoot a large number of characters that are appearing using the sensing device 100B. The sensing device 100B that has taken the image notifies the information display device 100A carried by the person who visited the amusement park without knowing that the character show is being held. As a result, a person who did not know the hosting of the character show can move to the location of the character show based on the notification display screen displayed on the display surface 22 of the display / input unit 25 of the information display device 100A. Never miss a show.

(2) When a fireworks display is started in a beach park or the like, a plurality of people shoot many scenes where fireworks are launched using the sensing device 100B. The sensing device 100B that has taken the image notifies sensing information to the information display device 100A carried by a person who has visited the beach park but does not know the fireworks appreciation point. As a result, a person who does not know the viewing point can move to the viewing point according to the notification display screen displayed on the display surface 22 of the display / input unit 25 of the information display device 100A.

(3) At the wedding reception, when a photo session for the bride and groom who went out to the garden of the reception banquet is held, a plurality of persons photograph a large number of the bride and groom using the sensing device 100B. The sensing device 100B that has taken the image notifies the information display device 100A carried by a person who is attending the same reception but carrying a meal or talking at his / her table seat. As a result, a person who has not noticed the photo session at the beginning can know the shooting chance of the bride and groom from the notification display screen displayed on the display surface 22 of the display / input unit 25 of the information display device 100A. Prevent missed opportunities.

(4) When a celebrity such as a celebrity is walking in the city, a person who notices the celebrity photographs the celebrity using the sensing device 100B. Sensing device 100B that has taken the image notifies sensing information to information display device 100A carried by a person who is close to the celebrity but does not notice the celebrity. Thereby, since the person who has not noticed the celebrity can know the existence of the celebrity on the basis of the notification display screen displayed on the display surface 22 of the display / input unit 25 of the information display device 100A, there is a great chance of encounter. Less likely to miss

(5) Assume that a model photo shoot was held at a certain place. A plurality of persons who have known the photo session in advance take a number of models using the sensing device 100B. Sensing device 100B that has taken the image notifies sensing information to information display device 100A carried by the person who visited without knowing the model photo session. Thereby, the person who visited without knowing the photo session knows that it is a model photo session, the name of the model, and the like through the notification display screen displayed on the display surface 22 of the display / input unit 25 of the information display device 100A. So you do n’t know what ’s going on.

(6) When the person A meets the person B who is shooting the camera at the shooting venue, the sensing device 100B used for the shooting by the person B sends sensing information to the information display device 100A carried by the person A. Notice. Thereby, the person A can know what the person B is through the notification display screen displayed on the display surface 22 of the display / input unit 25 of the information display apparatus 100A. That is, using the high-function mobile phone 100 having a sensing function and an information display function, self-introduction can be performed to others.

(7) When the person P is photographed by an unknown person Q, the sensing device 100B used for photographing by the person Q notifies the information display device 100A carried by the person P of sensing information. Thereby, the person P can know the fact that the person P was photographed through the notification display screen displayed on the display surface 22 of the display / input unit 25 of the information display device 100A. That is, it is possible to prevent hidden shooting using the high-function mobile phone 100 having a sensing function and an information display function.

(Modification 9)
The high-function mobile phone 100 may be configured by a mobile device having a sensing function and an information display function, or a wearable terminal as long as they communicate with each other.

(Modification 10)
The program is supplied to the mobile device such as the camera 51, the high-function mobile phone 100, or the tablet terminal in each of the above-described embodiments, for example, as illustrated in FIG. It can be transmitted to the mobile device by distance wireless communication.

  The program may be supplied to the personal computer 205 by setting a storage medium 204 such as a CD-ROM storing the program in the personal computer 205, or to the personal computer 205 by a method via the communication line 201 such as a network. You may load. When passing through the communication line 201, the program is stored in the storage device 203 of the server 202 connected to the communication line.

  The program can also be directly transmitted to the mobile device via a wireless LAN access point (not shown) connected to the communication line 201. Further, a storage medium 204B such as a memory card storing the program may be set in the mobile device. In this way, the program can be supplied as various forms of computer program products such as provision via a storage medium or a communication line.

Although various embodiments and modifications have been described above, the present invention is not limited to these contents. Other embodiments conceivable within the scope of the technical idea of the present invention are also included in the scope of the present invention.
Moreover, it is also possible to combine one or more of each embodiment and its modification with each embodiment.

1, A to E ... person 16 ... CPU
DESCRIPTION OF SYMBOLS 18 ... CPU, transmission / reception circuit 19 ... Communication control circuit 20 ... Operation member 27 ... Camera 28 ... Communication part 30 ... Control part 51 ... Camera 100 ... Sensing device, high-functional mobile phone 100A ... Automatic photographing device 100A-100E ... Sensing device

Claims (10)

An acquisition unit that acquires at least a sensing signal related to sound by a sensor of the subject;
A control unit that determines an angle of view of a camera that images the subject using a sensing signal related to the acquired sound;
Electronic equipment comprising. The electronic device according to claim 1,
The control unit is an electronic device that determines the angle of view based on a comparison between the signal pattern of the sound and a reference pattern. The electronic device according to claim 1,
The acquisition unit acquires a plurality of sensing signals respectively sensed by the plurality of sensors,
The control unit is an electronic device that determines the angle of view based on a signal pattern of a similar sound among a plurality of sounds included in the plurality of sensing signals. The electronic device according to claim 3,
The sensing signal further includes a position of the sensor,
The control unit is an electronic device that determines an angle of view of the camera based on a plurality of positions where the similar sound is sensed. The electronic device according to claim 4,
The control unit is an electronic device that controls the angle of view of the camera so that the angle of view includes a plurality of positions where the similar sound is sensed. The electronic device according to any one of claims 1 to 5,
An electronic device further comprising a camera that images the subject. Processing for obtaining at least a sensing signal related to sound by a sensor of the subject;
Processing for determining an angle of view of a camera that images the subject using a sensing signal related to the acquired sound;
A program that causes a computer to execute. An acquisition unit for acquiring signals relating to a plurality of sounds from a mobile device;
A control unit that determines an angle of view captured by the camera using the plurality of acquired signals;
Electronic equipment comprising. Processing to obtain signals related to multiple sounds from a mobile device;
Processing for determining an angle of view taken by the camera, using the signals related to the plurality of acquired sounds;
A program that causes a computer to execute. An acquisition unit for acquiring a plurality of sensing signals including sound by a plurality of sensors included in the subject;
A control unit that determines shooting timing based on a signal pattern of a similar sound among a plurality of sounds included in the plurality of sensing signals;
Electronic equipment comprising.

Images