JP6819733B2 - Imaging device - Google Patents

Description

The present invention relates to an imaging device.

In recent years, a system in which a user remotely controls an imaging device (digital camera) in a remote location is known.

JP 2006-222816

In Patent Document 1, it has not been studied to change the imaging range of the image pickup device by remote control.

The image pickup apparatus according to the first aspect of the present invention includes an image pickup element that captures an image formed by an optical system and outputs a signal, a detection unit that detects a posture and outputs a first posture information, and the electronic device. A receiving unit that receives the second posture information of the electronic device, a second image generated based on the signal and the first posture information , and a first image generated using the second image and the second posture information. When the image generation unit for generating, have a, a transmission unit for transmitting at least one of the first image and the second image to the electronic device, and the transmission unit, the second image is the signal Information indicating that the image is cut out from the image generated based on the first posture information is transmitted .

Further, the electronic device of the present invention includes a posture sensor that detects the posture information of the electronic device and a transmission unit that transmits the posture information to an image pickup device in an imaging region by an external image pickup element, and sets the electronic device. Transmits the attitude information to the image pickup device in the shooting mode in which the image sensor outputs an instruction regarding the image pickup operation of the image pickup device.

FIG. 1 is a block diagram showing a configuration of an image pickup device (camera body) and an electronic device (smartphone) according to the first embodiment. FIG. 2 is a diagram showing the concept of a system including an image sensor (camera body) and an electronic device (smartphone) according to the first embodiment, and FIG. 2A is a diagram and a diagram showing the back side of the camera body. 2 (b) is a diagram showing the positional relationship between the image sensor and the image circle in the camera body and the imaging range of the image sensor, and FIG. 2 (c) is a diagram and a diagram showing the vertical posture of the smartphone in communication with the camera body. 2 (d) is a diagram showing a horizontal posture of a smartphone in a communication state with the camera body. 3A and 3B are views showing the concept of operation of the first embodiment, FIG. 3A is a view showing the back side of the camera body held in a horizontal position, and FIG. 3B is an image display of the camera body. FIG. 3C is a diagram showing a horizontal posture of a smartphone communicating with the camera body, and FIG. 3D is a diagram showing a state in which the posture of the smartphone is changed. 3 (e) is a diagram showing how the image of the image display unit of the camera body of FIG. 3 (b) is switched due to the change in the posture of the smartphone. FIG. 3F is a diagram showing that the imaging range of the camera body has been switched to the image display unit of the smartphone. FIG. 4 is a flowchart showing the operation of the camera and the smartphone according to the first embodiment. FIG. 5 is a diagram showing the concept of a system including an image pickup device (camera body) and an electronic device (smartphone) in the first modification, and FIG. 5 (a) is a diagram showing the back side of the camera body, FIG. 5 (b). ) Is a diagram showing the positional relationship between the image pickup element and the image circle in the camera body and the imaging range of the image pickup element, FIG. 5 (c) is a diagram showing the vertical posture of the smartphone communicating with the camera body, and FIG. 5 (d). ) Is a diagram showing the horizontal posture of the smartphone in communication with the camera body. FIG. 6 is a diagram showing the concept of a system including an image pickup device (camera body) and an electronic device (smartphone) in the second modification, and FIG. 6 (a) is a diagram showing the back side of the camera body, FIG. 6 (b). ) Is a diagram showing the positional relationship between the image pickup element and the image circle in the camera body and the imaging range of the image pickup element, FIG. 6 (c) is a diagram showing the vertical posture of the smartphone in a communication state with the camera body, FIG. 6 (d). ) Is a diagram showing the horizontal posture of the smartphone communicating with the camera body, and FIG. 6 (e) is a diagram showing the oblique posture of the smartphone communicating with the camera body. FIG. 7 is a block diagram showing a configuration of an imaging device (camera body) and an electronic device (smartphone) according to the second embodiment. 8A and 8B are views showing the concept of operation of the second embodiment, FIG. 8A is a view showing the back side of the camera body held at a position tilted from the horizontal position, and FIG. 8B is a view showing the back side of the camera body. A diagram showing a through image displayed on the image display unit of the camera body, FIG. 8 (c) is a diagram showing an image displayed on the image display unit of a smartphone communicating with the camera body, and FIG. 8 (b) is a camera. FIG. 8 (e) is a diagram showing an image in which the tilt of the image display portion of the body is automatically corrected, and FIG. 8 (e) is a diagram showing a state in which the automatically corrected image is displayed in the image display portion of a smartphone in a communication state with the camera body. 8 (f) is a diagram showing a state in which the posture of the smartphone is changed, and FIG. 8 (g) is a diagram showing a state in which the image of the image display unit of FIG. 8 (b) is switched due to the change in the posture of the smartphone. .. FIG. 8H is a diagram showing that the imaging range of the camera body has been switched to the image display unit of the smartphone. FIG. 10 is a flowchart showing the operation of the camera body and the smartphone of the modified example in the second embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

<First Embodiment>
FIG. 1 shows an image display of an electronic device 105 (tablet-type terminal, mobile phone, smartphone, etc.) capable of wirelessly communicating image information and various information related to images between the camera body (imaging device) 100 and the camera body 100. It is a block diagram which shows the structure of the portable electronic device having a function. In the present embodiment, the following description will be made assuming that the smartphone is used as the electronic device 105.
First, the smartphone 105 will be described. The smartphone 105 includes a wireless communication unit (including a transmission unit and a reception unit) 901 that wirelessly communicates with an external device, a CPU 902 that controls the operation of the smartphone 105, an operation unit 903 that operates the smartphone 105, and attitude information of the smartphone 105. An image display unit 9 such as a calculation unit 904 that obtains numerical information regarding an angle change and performs a calculation, and a liquid crystal monitor that displays an image pickup range from an image sensor of the camera body 100.
06, an attitude sensor 907 such as an acceleration sensor that detects the attitude information of the smartphone 105 is provided. The operation unit 903 described above includes a release operation unit, a mode switching member, and a power button as described later. Further, in the present embodiment, the smartphone 105 is in a normal operation mode (for example, telephone, email, Internet, smartphone camera function, etc.).
In addition, the camera body 1 communicates with the camera body 100 and is displayed on the display of the smartphone 105.
It is provided with a communication shooting mode in which the captured image taken at 00 is displayed and the release operation of the camera body 100 can be performed by remote control.

Next, the camera body 100 will be described. In the present embodiment, the camera body 100 will be described as an interchangeable lens camera body to which the interchangeable lens 120 can be attached and detached. However, the present invention is not limited to this, and the present invention is applied to a camera body with an integrated lens. You may.
The camera body 100 is a wireless communication unit (including a transmission unit and a reception unit) that performs wireless communication with an external device.
913, microphone 914 that outputs sound, operation unit 91 that operates keys of camera body 100
5. Buffer recording unit 916 that temporarily records information to absorb and adjust the time lag between input / output and processing, and attitude control unit 917 that controls the attitude of the imaging range of the camera body 100.
Image processing unit 918 that processes the captured image, image recording medium 920 such as an internal memory or memory card on which the image-processed image is recorded, image display unit 919 such as a liquid crystal monitor that displays the captured image, optical system. An image pickup unit 912 equipped with an image sensor such as CMOS or CCD that captures a subject image via 918, an image pickup range detection unit 924 that detects information that specifies the direction and size of the image pickup range of the camera body 100, and a camera body 100. It is provided with a CPU 911 that electrically connects to each of the above-mentioned parts, sensors, and the like to control image pickup, recording, display, and the like. Further, the camera body 100 includes a contact portion 923A that is electrically connected to the interchangeable lens 120 described later. The interchangeable lens 120 includes an optical system 921 including a photographing lens and the like, a lens control unit 922 that controls the operation of the photographing lens, and a contact portion 923B that connects the camera body 100 and the interchangeable lens 120. By detecting the image pickup range detection unit 924 described above, the CPU 911 can detect the posture information of the image pickup range of the image pickup unit 912.

Next, FIG. 2 is a diagram conceptually showing an embodiment of the imaging device according to the present invention.
In FIG. 2, the camera body 100 and the smartphone 105 are in a state of communication.
The smartphone 105 is in the communication shooting mode. Then, the photographer (user) is in a state of remotely controlling the camera body 100 by using the smartphone 105 at a place away from the camera body 100.




The camera body 100 is provided with an image display unit 919 on the back surface (the surface opposite to the subject side), and displays the image pickup range from the image pickup element. However, the photographer is the camera body 100
Since it is located away from the camera body 100, the image pickup range cannot be confirmed by the image display unit 919 of the camera body 100. However, in the system of the present embodiment, the image captured by the image pickup unit (image sensor) 912 of the camera body 100 is transmitted to the smartphone 105 via the wireless communication unit 913 on the camera body 100 side and the wireless communication unit 901 on the smartphone 105 side. Has been sent to. Therefore, the image display unit 906 of the smartphone 105 at the photographer's hand projects the imaging range displayed on the image display unit 919 of the camera body 100, and the photographer can confirm the captured image.
FIG. 2A is a diagram showing an image display unit 101 on the back surface of the camera body 100, and FIG. 2B is an effective image pickup region 111 shown by a solid line in the image pickup unit (imaging element) 912 inside the camera body 100.
2 (c) and 2 (d) are views showing the image display unit 906 of the smartphone 105, showing that the interchangeable lens 120 (photographing lens) is inscribed in the image circle 110 formed by the interchangeable lens 120 (photographing lens). In the present embodiment, the positional relationship between the effective imaging region 111 of the image pickup unit (image sensor) 912 and the image circle 110 is as shown in FIG. 2 (b).
As shown in FIGS. 2A and 2D, when the camera body 100 is placed in the horizontal position (horizontal position) and the smartphone 105 is placed in the horizontal position, the image of the camera body 100 is displayed on the image display unit 906 of the smartphone 105. The same image as the display unit 919 is displayed. The image 101 displayed on the image display unit 919 of the camera body 100 is reflected in the capture area 112 in the effective image pickup area 111 of the image pickup unit (image sensor) 912 when the camera body 100 is in the horizontal posture (horizontal position). It is an image. That is, the image pickup range of the image 107 displayed on the image display unit 906 of the smartphone 105 is the image pickup unit (image sensor) 912 when the camera body 100 is in the horizontal posture (horizontal position).
It is the same as the area 112 shown by the two-weighted lines in the effective imaging area 111 of. If there is no problem in the imaging range, the photographer gives an instruction to execute the release operation from the smartphone 105, and the camera body 100 receives the information of the release operation and executes the shooting.

Next, as shown in FIGS. 2 (a) and 2 (c), when the smartphone 105 is placed in the vertical position while the camera body 100 is in the horizontal position (horizontal position), the change in the posture information of the smartphone 105 is wirelessly communicated. It is transmitted to the camera body 100 via the unit 901. Then, the area 113 shown by the dotted line in the effective image pickup area 111 of the image pickup unit (imaging element) 912 of the camera body 100.
Is the imaging range, and the range captured by the camera body 100 is trimmed to the vertical posture region 102 shown by the dotted line in FIG. 2A. The corrected image of the vertical posture region 102 is transmitted to the smartphone 105 again, and is displayed as the region 106 shown by the dotted line in FIG. 2C. If there is no problem in the imaging range, the release operation execution instruction information is transmitted and shooting is executed. In the first embodiment, since the shape of the image sensor 912 is rectangular, the image of the vertical posture is partially trimmed from the image of the horizontal posture to obtain a shape-sized image.
In this way, the photographer is at a position away from the camera body 100 while the camera body 1
By simply switching the posture of the smartphone 105 that communicates with 00 to the vertical posture or the horizontal posture, the shooting range from the image sensor can be switched to the desired posture, and an appropriate captured image can be taken. It will be possible.

The rotation correction of the imaging range of the image pickup device described above will be conceptually described with reference to FIG.
FIG. 3A shows a situation in which the camera body 100 is fixed to a tripod and the through image 301 is displayed on the image display unit on the back surface in macro photography. In FIG. 3, the photographer is shooting from a distance, and the camera body 100 is not moved during shooting. In the present embodiment, in that state, the photographer operates the imaging range of the imaging unit (imaging element) 912 of the camera body 100 by remote instruction using the posture information of the smartphone 105, and switches to an appropriate imaging range for shooting. How to do it.
FIG. 3B shows a through image 301 displayed on the image display unit 919 of the camera body 100.
FIG. 3 (e) is a diagram showing a trimmed through image 300 whose details will be described later. Figure 3 (
c) is the captured image 30 displayed on the image display unit 906 of the smartphone 105 in the horizontal posture.
It is a figure which shows 2. The lateral posture of the smartphone 105 shown in FIG. 3C is used as a reference. FIG. 3D is a diagram showing a captured image 303 displayed on the image display unit 906 of the smartphone 105 rotated in the direction of the arrow (the dotted line in the figure is the smartphone 1 in the horizontal posture of FIG. 3C).
05 is shown). FIG. 3E is a diagram showing a trimmed through image 300 of the imaging unit 912 of the camera body 100 corrected by the rotation of the smartphone 105. Figure 3
(F) is a through image 3 trimmed on the image sensor of the camera body 100 of FIG. 3 (b).
It is a figure which shows the state which 00 is transmitted to the smartphone 105, and the image 302 corresponding to the through image 300 is displayed on the image display part 906 of the smartphone 105.

The “done” mark 907 in FIG. 3 (f) will be described later in FIG. 4S350. The "done" mark 907 is not limited to the indication "done", but is "◎" or "☆".
Any shape or text may be used. By displaying the "Done" mark on the display screen of the smartphone 105 in this way, the photographer can easily confirm that the imaging range of the camera body 100 has been switched, and the photographer can take a picture smoothly. it can.
The photographer confirms the image 302 displayed on the image display unit 906 of the smartphone 105, and confirms the image 302.
The amount of rotation correction required to correct the posture of the image pickup range (imaging element) 912 of the camera body 100 is examined. Then, as shown in FIG. 3D, the photographer changes the posture (rotation angle) of the smartphone 105 by the required rotation correction amount. The camera body 100 receives information on the posture change of the smartphone 105 (including information on the rotation angle), and FIG.
As shown by the dotted line in a), the image pickup range (posture of the image pickup range) of the image pickup device 912 is trimmed from the image pickup range 101 to the trimming area 300 by different rotation amounts depending on the angle.
In this way, the photographer does not change the posture of the camera body 100, but changes the posture of the smartphone 105 communicating with each other to change the posture of the image pickup unit (imaging element) 91 of the camera body 100.
The posture of the imaging range of 2 can be switched, and the image desired by the photographer can be captured.

Next, the above operation will be described with reference to the flowchart shown in FIG. FIG. 4 shows the camera body 10
It is a flowchart which shows the basic operation between the CPU 911 of 0 and the CPU 902 of the smartphone 105. The functions of the smartphone 105 of this embodiment include an operation function of the smartphone 105 alone and an operation function of communicating with the camera body 100. Among them, in the flow shown in FIG. 4, the operation function performed by communicating with the camera body 100 will be described.
First, the photographer turns on the power of the smartphone 105 and the camera body 100, and starts the connection operation between the camera body 100 and the smartphone 105.
The CPU 902 of the smartphone 105 is S300, and confirms whether the communication setting mode of the smartphone 105 is the communication shooting mode or the communication reproduction mode. The mode switching is performed by the photographer operating the mode switching member included in the operation unit 903. If the result confirmed by the CPU 902 in S300 is the communication shooting mode, S305
If it is the communication reproduction mode, the process proceeds to S400.

First, the communication procedure and the shooting procedure between the smartphone 105 and the camera body 100 in the communication shooting mode of the smartphone 105 after S305 will be described. In addition, S40
The communication reproduction mode of the smartphone 105 after 0 will be described after the explanation of the communication shooting mode.
The CPU 902 receives a through image from the camera body 100 by wireless communication in S305, and sets the wireless communication unit 901 and the image display unit 906 in a state where the through image is displayed on the image display unit 906.
In S310, the CPU 902 transmits information indicating that the setting of the smartphone 105 is in the communication shooting mode to the camera body 100 by the wireless communication unit 901.
In S100, the CPU 911 receives information indicating that the setting of the smartphone 105 has been set to the communication shooting mode by the wireless communication unit 913.
In S105, the CPU 911 confirms the content of the information received in S100, and the smartphone 1
It is confirmed whether the communication setting mode of 05 is the communication shooting mode or the communication reproduction mode. If the confirmed result is the communication shooting mode, the process proceeds to S110, and if the confirmation result is the communication playback mode, S2
Proceed to 00.

First, the smartphone 1 in the communication shooting mode of the camera body 100 after S110.
The communication procedure and the shooting procedure between 05 and the camera body 100 will be described. In addition, S200
The following communication reproduction mode of the camera body 100 will be described after the explanation of the communication shooting mode.
In S110, the CPU 911 sets the communication shooting mode. The communication shooting mode of the camera body 100 is a mode in which shooting is performed not by operating the operation unit 915 of the camera body 100 but by communicating with the smartphone 105.
In S115, the CPU 911 transmits the through image captured by the imaging unit 912 and displayed on the image display unit 919 to the smartphone 105 via the wireless communication unit 913. In the present embodiment, the image size of the through image to be transmitted is the same size as the image size displayed on the image display unit 919. Not limited to this, if the number of display elements of the image display unit 913 of the camera body 100 and the image display unit 906 of the smartphone 105 are significantly different, the image size to be transmitted is set to the number of display elements of the image display unit 906 of the smartphone 105. You may resize it to a suitable size and send it.
In S315, the CPU 902 displays the through image received via the wireless communication unit 901 on the image display unit 906.
In S120, the CPU 911 confirms the posture information in the initial state of the camera body 100 acquired by the imaging range detection unit 924.
In S125, the CPU 911 transmits the posture information in the initial state to the smartphone 105 via the wireless communication unit 913.
In S320, the CPU 902 receives the attitude information in the initial state of the camera body 100 transmitted from the camera body 100 in S125 via the wireless communication unit 901.

For example, when the camera body is shooting in the horizontal posture as shown in FIG. 2A, in S125, the CPU 911 has the horizontal posture image 101 in FIG. 2A and the image pickup range of the image sensor in the horizontal posture. Posture information indicating that there is is transmitted to the smartphone 105. When the photographer is looking at the smartphone 105 in the horizontal posture as shown in FIG. 2D, the CPU 902 in S320 displays the horizontally long image 107 based on the image received from the camera body 100 and the posture information in the imaging range. indicate. Further, when the CPU 902 receives the posture information indicating that the posture information in the imaging range is the vertical posture, the CPU 902 displays a vertically long image in which the left and right sides of the received image are cut and resized. On the other hand, when the photographer is looking at the smartphone 105 in a vertical position and the CPU 902 receives the horizontally long image, the vertically long image is displayed by cutting the top and bottom of the received image and resizing it.
The photographer confirms the composition of the captured image based on the through image received in S315 and the posture information in the initial state of the camera body 100 received in S320. In this embodiment, the composition of the captured image can be changed in the direction of rotation on a plane perpendicular to the optical axis of the image sensor of the image pickup unit 912 of the camera body 100. The operation method that the photographer performs on the smartphone 105 in order to realize the change is that the photographer performs the operation method on the smartphone 105 on a horizontal surface with the image display unit 906.
It is an operation to rotate. (FIG. 3 (d) above)
The photographer who confirms the composition of the captured image tilts the smartphone 105 by the required amount of tilt if the composition is changed. Or, if the composition is not changed, the posture of the smartphone 105 is not tilted.

In S325, the CPU 902 detects whether the smartphone 105 is tilted by the photographer. If the posture of the smartphone 105 is tilted, the process proceeds to S330, and if the smartphone 105 is not tilted, the process proceeds to S355.
In S330, the posture sensor 907 detects the tilt amount A of the posture of the smartphone 105.
In S335, the CPU 902 transmits the tilt amount A detected in S330 to the camera body 100 via the wireless communication unit 901.
In S130, the CPU 911 receives the tilt amount A of the smartphone 105 transmitted in S335 via the wireless communication unit 913.
In S135, the CPU 911 switches the imaging range of the imaging unit 912 based on the tilt amount A of the smartphone 105 received in S130. Switching the imaging range of the imaging unit 912 means, specifically, determining the trimming range as described with reference to FIGS. 2 and 3 described above.
In S140, the CPU 911 transmits to the smartphone 105 via the wireless communication unit 913, the through image of the imaging range switched in S135 and the information indicating that the image has been corrected.
In S145, the CPU 911 transmits information indicating that the through image transmitted in S140 has been corrected to the smartphone 105 via the frontless communication unit 913.
In S340, the CPU 902 passes through the wireless communication unit 901, and in S140, the camera body 100.
The through image transmitted from is received and displayed on the image display unit 906.
In S345, the CPU 902 passes through the wireless Tsu deep part 901, and in S145, the camera body 100
Receive the information sent from.
In S350, the CPU 902 displays on the image display unit 906 that the through image received in S340 has been corrected. This is the "done" mark 90 in the image display unit of FIG. 3 (f) described above.
Refers to 7.

The photographer confirms the through image displayed on the image display unit 906 of the smartphone 105 via S340 and S350. The through image is the smartphone 105 by the photographer.
It is after the composition is changed by the rotation operation of the posture of. The photographer can determine whether the composition needs to be changed by looking at the through image. If it is not necessary to change the composition, the release operation can be performed by the operation unit 903 of the smartphone 105.
In S355, the CPU 902 detects whether or not the release operation has been performed by the photographer on the operation unit 903. When the CPU 902 detects that the release operation has been performed, the CPU 902 has S360.
If the release operation is not detected, go back to S325 and go from S325 to S355.
Repeat the loop up to. When repeating the second and subsequent loops, the CPU 902 determines S32.
When it is detected in step 5 that the posture of the smartphone 105 is tilted, the "done" mark 907 displayed on the image display unit 906 indicating that the correction has been completed is terminated. Then, when the CPU 902 again receives the information that the through image has been corrected from the camera body 100 in S345 via the wireless communication unit 901, the corrected "finished" mark 907 is displayed again on the image display unit 906.
In S360, the CPU 902 transmits a signal indicating that the release operation of the operation unit 903 has been performed by the photographer via the wireless communication unit 901.
In S150, the CPU 911 receives a signal transmitted in S360 indicating that the release operation of the operation unit 903 of the smartphone 105 has been performed via the wireless communication unit 913.
In S155, the CPU 911 executes shooting and acquires the captured image as an image for recording (preservation).

After shooting, the CPU 911 in S160 transmits the shot recording image to the smartphone 105 via the wireless communication unit 913. The image data transmitted at this time may be image data of an image size taken by the camera body 100, or may be image data resized according to the display size of the image display unit 906 of the smartphone 105. The size at which the image data is transmitted can be manually set by the photographer in advance. If the photographer does not make the setting manually, the setting is automatically made by the camera body 100. In the case of automatic setting of the camera body 100, image data is transmitted according to the display size of the image display unit 906 of the transmission destination, the remaining amount of memory, and the remaining amount of battery. In this case, in S310, the display size and the remaining memory of the image display unit 906 of the smartphone 105 are used as information on the communication shooting mode from the smartphone 105.
Information on the remaining battery level is transmitted, and the camera body 100 uses this transmitted information to determine the size of the image data to be transmitted.
In S365, the CPU 902 receives the captured image for recording transmitted in S160 via the wireless communication unit 901.
In S370, the CPU 902 displays the captured image for recording received in S365 on the image display unit 906.
Here, in a state where the captured image is displayed on the image display unit 906 after this shooting and the photographer confirms the captured image for recording, even if there is a posture change of the smartphone 105, the information on the posture change is available. It is not transmitted to the camera body 100.
The photographer confirms the image for recording taken by the image display unit 906 of the smartphone 105.
The photographer determines whether to continue shooting in the communication shooting mode of the smartphone 105 or to switch to the communication playback mode described above. When switching the mode, the mode switching member of the operation unit 903 described above is operated.

In S375, the CPU 902 detects whether the photographer has performed the communication setting mode switching operation. If the communication setting mode is not switched, the process proceeds to S380, and when it is detected that the communication setting mode has been switched, the process returns to S300 and the loop from S300 to S375 is repeated.
The photographer determines whether to turn off the power of the smartphone 105 or not. To turn off the power, operate the power button of the operation unit 903.
In S380, the CPU 902 detects whether or not the power button of the operation unit 903 has been operated by the photographer to turn off the power of the smartphone 105. When the CPU 902 detects that the power button of the operation unit 903 has been operated, the process proceeds to S385. If the power off operation is not detected, the process returns to S320 and the loop from S320 to S380 is repeated.
In S385, the CPU 902 performs the end operation of the communication setting mode. The end operation of the communication setting mode is to transmit information indicating that the power OFF operation of the smartphone 105 has been operated by the photographer to the camera body 100. Alternatively, the end operation of the communication setting mode is to receive information indicating that the camera body has been turned off by the photographer in S165 described later. The CPU 902 turns off the power after transmitting and receiving the information performed in this step, and ends this flow.
In S165, the CPU 911 detects whether or not the power of the camera body 100 has been turned off by the photographer, and if the power has not been turned off, returns to S100 and repeats the loop from S100 to S165. If the power is turned off, the process proceeds to S170.
In S170, the power supply of the camera body 100 of the CPU 911 is O via the wireless communication unit 913.
Information indicating that the FF has been performed is transmitted to the smartphone 105. Alternatively, the CPU 911 receives information indicating that the power of the smartphone 105 has been turned off. CPU911
Turns off the power after sending and receiving the information performed in this step, and ends this flow.

Next, the communication procedure and the reproduction procedure between the smartphone 105 and the camera body 100 in the communication reproduction mode of the smartphone 105 after S400 and the communication reproduction mode of the camera body 100 after S200 will be described.
The CPU 902 is S400, and the wireless communication unit 90 receives an image recorded in the image recording unit 920 from the camera body 100 by wireless communication and displays the image on the image display unit 906.
1 and the image display unit 906 are set.
In S405, the CPU 902 transmits information indicating that the setting of the smartphone 105 is in the communication reproduction mode to the camera body 100.
In S100, the CPU 911 receives information indicating that the setting of the smartphone 105 has been set to the communication reproduction mode by the wireless communication unit 913.
In S105, the CPU 911 proceeds to S200 when the content of the information received in S100 confirms that the communication setting mode of the smartphone 105 is the communication reproduction mode.
In S200, the CPU 911 sets the communication playback mode. The communication reproduction mode of the camera body 100 is a mode in which the recorded image recorded in the image recording unit 920 of the camera body 100 is transmitted to the smartphone 105 via the wireless communication unit 913.
In S205, the CPU 911 transmits the recorded image recorded in the image recording unit 920 to the smartphone 105 via the wireless communication unit 913. The image size to be transmitted is the above-mentioned S16.
Since it has been described with 0, the description here will be omitted.
In S410, the CPU 902 passes through the wireless communication unit 901, and in S205, the camera body 100
Receives the recorded image transmitted from.
In S415, the CPU 902 displays the recorded image received in S410 on the image display unit 906.
The photographer confirms the recorded image on the image display unit 906 of the smartphone 105.
The photographer performs an image feed operation when viewing the reproduced image further.
In S420, the CPU 902 detects whether the photographer has performed an image feed operation. If the image feed operation is detected, the process proceeds to S425, and if not detected, the process proceeds to S375.
In S425, the CPU 902 transmits a signal requesting an image change to the camera body 100 via the wireless communication unit 901. After transmission, it returns to S410 and repeats the loop from S410 to S420.
In S210, the CPU 911 detects whether or not a signal requesting an image change has been received from the smartphone 105 via the wireless communication unit 913. If a signal is being received, S215
Proceed to. If no signal is received, the process proceeds to S165.
In S215, the CPU 911 selects the image requested by the smartphone 105 and S20.
Return to 5.

Through the above steps, the CPU 902 of the smartphone 105 and the camera body 100
The operation of the communication shooting mode and the communication reproduction mode with the CPU 911 of the above is executed.
As a form of transmitting the recorded image from the camera body 100 to the smartphone 105 in S205, the method of transmitting the recorded image one by one has been described in the present embodiment, but the present invention is not limited to this, and for example, the recorded image is the latest. You may send several images at a time, or you may send the images for each folder recorded in the image recording unit 920 of the camera body 100. Further, the photographer may arbitrarily select the number and method of transmitting the images as described above.

In the present embodiment, the shooting of a still image has been described, but the present invention is applicable not only to a still image but also to a moving image. Specifically, when a moving image is being shot in the communication shooting mode, the operation of S325 to S335 described above (that is, the state before the start of recording) when the through image is displayed on the image display unit 906 of the smartphone 105 (that is, the state before the start of recording). That is, the operation of controlling the posture of the imaging unit 912 from the smartphone 105) is executed, and the change in the posture of the smartphone 105 is reflected in the through image. However, when the photographer operates the record button of the operation unit 903 of the smartphone 105 to start recording, the change in the posture of the smartphone 105 is controlled not to be transmitted to the camera body 100. On the other hand, when the moving image is played back in the communication playback mode, the operation is the same as the communication playback mode of the still image shown in FIG.
The target to be sent and received is a moving image.

Although the power-off operation of the camera body 100 and the power-off operation of the smartphone 105 are linked in the present embodiment, they may be controlled so as not to be linked. For example, when the power is turned off on the camera body 100 side, the power is not turned off on the smartphone 105 side, the communication setting mode may be terminated, and the normal operation mode described above may be switched.

In the above embodiment, as described in FIG. 4, the posture of the smartphone 105 is tilted, and the imaging range of the camera body 100 is corrected by the angle of the amount of tilt. Unlike the above-described embodiment, the control described below may be performed. As shown in FIG. 3A, the photographer tilts the posture of the smartphone 105 as shown in FIG. 3D in a state where the image pickup range of the image sensor of the camera body 100 is the horizontal posture region. At that time, it is assumed that the photographer tilts the smartphone 105 from the horizontal posture. The CPU 911 of the camera body 100 receives the change in the posture information of the smartphone 105, and the magnitude of the change in the posture is a predetermined amount (
For example, if it is determined that the tilt amount is 45 degrees or more), the imaging range of the image sensor of the camera body 100 is corrected from the horizontal posture region to the vertical posture region at once. On the contrary, if the imaging range of the image pickup element of the camera body 100 is in the vertical posture region before the correction, when the posture of the smartphone 105 is significantly changed from the vertical posture to the horizontal posture, the image pickup element of the camera body 100 The imaging range is corrected at once from the vertical posture region to the horizontal posture region. That is, the photographer sets the posture of the imaging range to 9.
If you want to change it by 0 degrees, you do not need to tilt the smartphone posture by 90 degrees, and you can do it roughly, so the operation is easy for the photographer. In addition, the method of correcting this inclination has been described as a method of switching and controlling between two postures, a horizontal posture and a vertical posture, but the method is not limited to this method, and a method of switching and controlling between three or more postures such as an oblique posture is also possible. It is possible. On the other hand, when the magnitude of the posture change is smaller than the above-mentioned predetermined amount, the camera body 100 is imaged according to the amount corresponding to the tilt amount A of the posture information of the smartphone 105 as in the embodiment described with reference to FIG. Change the posture of the range.

<Modification example 1>
FIG. 5 is a diagram showing a modification 1 of FIG. 2 described above. The difference between this modification 1 and the above-described embodiment of FIG. 2 is the shape of the image sensor in the image pickup unit 912 inside the camera body 100. The shape of the imaging surface of the effective imaging region 503 shown by the solid line in FIG. 5B is rectangular in the form of FIG. 2, whereas it is square in the present modification 1, and the effective imaging of the square. This is a point where the image circle 504 formed by the photographing lens is circumscribed with respect to the region 503.
Other configurations and operations (flow charts) are the same as those in the first embodiment of FIG. 2 described above.
FIG. 5 is a diagram showing a state in which the photographer (user) remotely controls the camera body 100 using the smartphone 105, as in FIG. 2.
5 (a) is a diagram showing an image display unit 919 on the back surface of the camera body 100, FIGS. 5 (c), (
d) is a diagram showing the image display unit 906 of the smartphone 105, and FIG. 5 (b) is the camera body 1.
It is shown that the shape of the effective imaging region 503 shown by the solid line in the figure of the imaging unit (imaging element) 912 inside 00 is square, and the image circle 504 formed by the interchangeable lens 120 (photographing lens) is tangent. It is a figure.
5 (a) and 5 (d) show the lateral postures of the camera body 100 and the smartphone 105, as in FIGS. 2 (a) and 2 (d) described above. The image 501 shown by the two-focused lines in FIG. 5 (a) is the image 101 in FIG. 2 (a), and the image 502 shown by the dotted line in FIG. 5 (a) is the image 102 in FIG. 2 (a). Corresponds to. The image 512 shown by the two priority lines in FIG. 5 (d) is shown in FIG.
It corresponds to the image 107 in (d). Description of these images 501, 502, 512 (
The image itself and communication and shooting related to the image) are the same as the description regarding the images 101, 102, and 107 in FIG. 2, and are therefore omitted here.
Next, as shown in FIGS. 5A and 5C, when the smartphone 105 is placed in the vertical position while the camera body 100 is in the horizontal position (horizontal position), the change in the posture information of the smartphone 105 is wirelessly communicated. It is transmitted to the camera body via the unit 901. Then, the camera body 10
The area 506 shown by the dotted line in the effective imaging area 501 of the imaging unit 912 of 0 is the imaging range.
The range imaged by the camera body 100 is the vertical posture region 502 shown by the dotted line in FIG. 5A. The corrected image of the vertical posture region 502 is transmitted to the smartphone 105 again, and is displayed as the region 511 shown by the dotted line in FIG. 5C. If there is no problem in the imaging range, the release operation execution instruction information is transmitted and shooting is executed.

In the first embodiment of FIG. 2 described above, the rectangular effective imaging region 111 is the image circle 110.
The image size of the vertical posture region 113 is smaller than that of the horizontal posture region 112 because of the positional relationship inscribed in. However, in the first modification of FIG. 5, since the square effective imaging region 503 is inscribed in the image circle 504, the vertical posture region 506 has an image size equal to that of the horizontal posture region 505, and the imaging range is effectively used. It is possible to utilize it.
In this way, the photographer is at a position away from the camera body 100 while the camera body 1
By simply operating the posture of the smartphone 105 that communicates with 00 to the vertical posture or the horizontal posture, the shooting range from the image pickup element can be switched to the desired posture (vertical posture region, horizontal posture region) for imaging. It is possible to take an image in which the image size does not change between the vertical posture area and the horizontal posture area.

<Modification 2>
FIG. 6 is a diagram showing a modification 2 of the image pickup apparatus in the present invention. This modification 2 and FIG. 2 described above,
The difference from the embodiment of FIG. 5 is that the shape of the imaging surface of the effective imaging region 603 shown by the solid line in the image of the imaging unit (imaging element) 912 inside the camera body 100 is rectangular in the form of FIG. On the other hand, in the present modification 2, it is a square, and the image circle 604 formed by the photographing lens is inscribed in the effective image pickup region 603 of the square. Other configurations and operations (flow charts) are the same as those of the first embodiment of FIG. 2 and the first modification of FIG.
FIG. 6 is a diagram showing a state in which the photographer (user) remotely controls the camera body 100 using the smartphone 105, as in FIGS. 2 and 5.
6 (a) is a diagram showing an image display unit 919 on the back surface of the camera body 100, FIGS. 6 (c) and 6 (d).
) And (e) are diagrams showing the image display unit 906 of the smartphone 105, and FIG. 6 (b) is a square shape of the effective imaging region 603 shown by the solid line in the image sensor (imaging element) 912 inside the camera body 100. The image circle 6 formed by the interchangeable lens 120 (photographing lens)
It is a figure which shows that it is circumscribed to 04.
6 (a) and 6 (d) show the camera body 1 in the same manner as in FIGS. 2 (a) and 2 (d) described above.
It shows the state of the horizontal posture of 00 and the smartphone 105. The image 601 shown by the two-weighted lines in FIG. 6A is shown in the image 101 in FIG. 2A, and the image 602 shown by the dotted line in FIG. 6A is shown in FIG.
It corresponds to the image 102 in (a). The image 612 shown by the two priority lines in FIG. 6 (d) is shown in FIG.
d) Corresponds to image 107 in. The description of these images 601, 602, and 612 (the image itself, the communication related to the image, and the photographing method) is the same as the description of the images 101, 102, and 107 of FIG. 2, and is therefore omitted here.

Next, FIG. 6 (c) shows the state of the vertical posture of the camera body 100 and the smartphone 105, as in FIG. 5 (c) described above. The image 611 shown by the dotted line in FIG. 6 (c) corresponds to the image 511 in FIG. 5 (c). Explanation about image 611 (image itself and communication about image,
The photographing method) is the same as the description regarding the image 511 of FIG. 5, and is therefore omitted here.
Next, as shown in FIGS. 6A and 6E, when the smartphone 105 is tilted while the camera body 100 is in the horizontal posture (horizontal position), the change in the posture information of the smartphone 105 is wirelessly communicated. It is transmitted to the camera body 100 via the unit 901. Then, the region 607 shown by the alternate long and short dash line in the effective imaging region 603 of the imaging unit 912 of the camera body 100 becomes the imaging range, and the range imaged by the camera body 100 is the oblique posture region shown by the alternate long and short dash line in FIG. 6A. It becomes 600. The corrected image of the oblique posture region 600 is displayed again on the smartphone 1
It is transmitted to 05 and displayed as the region 613 indicated by the alternate long and short dash line in FIG. 6 (e).
If there is no problem in the imaging range, the release operation execution instruction information is transmitted and shooting is executed. In the present embodiment, since the shape of the image sensor 912 is square and the image circle 604 is inscribed in the image circle 912, it is possible to change the image pickup range to the oblique posture region in this way.
It is possible to capture an image in a horizontal posture and an image in a vertical posture and an image in an oblique posture in which the image size does not change.
In this way, while the photographer is at a position away from the camera body 100, the photographer can take an image from the image pickup element simply by operating the posture of the smartphone 105 communicating with each other in the vertical posture or the horizontal posture and in the oblique posture. The range can be switched to any posture, and an image whose image size does not change in any posture including an oblique posture can be taken.

<Second Embodiment>
FIG. 7 is provided with an image display function of an electronic device 705 (tablet type terminal, mobile phone, smartphone, etc.) capable of wirelessly communicating image information and various information related to the image between the camera body 700 and the camera body 700. It is a block diagram which shows the structure of the portable electronic device). In the present embodiment, the following description will be given assuming that the smartphone is used as the electronic device 705.
In the second embodiment, in addition to the first embodiment described above, the camera body 700 is the camera body 70.
The point is that it includes a gyro sensor 925 that detects the inclination and angle of 0.

FIG. 8 is a diagram showing an embodiment of an imaging device according to the present invention. The effect of providing the gyro sensor 925 on the camera body 700 described above with reference to FIG. 8 will be described.
In FIG. 8, the camera body 700 and the smartphone 105 shown in FIG. 7 are in a state of communication. Since the photographer (user) is away from the camera body 700, the camera body 700 cannot be moved during shooting. For example, the photographer placed the camera body 700 on a suitable table 800 to take a commemorative photo with his companions during the trip. However, although the table 800 was tilted instead of horizontal, there is no other horizontal table on which the camera body 700 can be placed. In this embodiment, the photographer is in the state of the smartphone 1
Image pickup unit (image sensor) 91 of the camera body 700 by remote instruction using the attitude information of 05
This is a method of manipulating the imaging range of No. 2 and switching to an appropriate imaging range for shooting.
The camera body 700 is provided with an image display unit 919 on the back surface (the surface opposite to the subject side), and displays an image in the imaging range from the image sensor. However, the photographer is the camera body 70
Since you are away from 0, the through image 80 is displayed on the image display unit 919 of the camera body 700.
1 cannot be confirmed. However, in the system of this embodiment, the camera body 700
And the smartphone 105 can send and receive images via the wireless communication units 913 and 901, respectively.

As shown in FIG. 8A, the camera body 700 is placed on a table 800 tilted to some extent from the horizontal by the photographer. The through image 801 is displayed on the image display unit 919 of the camera body 700. FIG. 8B shows a through image 801 displayed on the image display unit 919 of the camera body 700 of FIG. 8A. 8 (c) shows that the through image 801 of the camera body 700 of FIG. 8 (b) is transmitted to the smartphone 105, and the image display unit 9 of the smartphone 105.
The image 803 displayed in 06 is shown. The camera body 700 includes a gyro sensor 925 and detects the inclination of the posture of the camera body 700. As a result of detection, camera body 7
When the posture of 00 is tilted, the camera body 700 corrects the through image 801. FIG. 8D shows an image 8 in which the through image 801 is automatically corrected by the amount that the camera body 700 is tilted.
04 is shown. Then, the camera body 700 transmits the corrected image 804 and information indicating that the image 804 is an automatically corrected image to the smartphone 105. FIG. 8
As shown in (e), the smartphone 105 has the image 806 received by the image display unit 906 and "
The "auto-corrected" mark 805 is displayed, and the photographer confirms the image 806. As shown in FIG. 8 (f), the photographer confirms the captured image in the image 806 of FIG. 8 (d), but changes the posture (rotation angle) of the smartphone 105 in order to capture a further tilted image. When the smartphone 105 detects that the photographer has changed the posture of the smartphone 105, the smartphone 105 ends the display of the "automatically corrected" mark 805. The camera body 700 receives information on the posture change of the smartphone 105 (including information on the rotation angle), and the imaging range (posture of the imaging range) of the image sensor 912 of the camera body 700 is shown in FIG. 8 (g). The image is corrected to 808. The camera body 700 transmits the corrected image 808 to the smartphone 105, and as shown in FIG. 8 (h), the smartphone 105 receives the received image 809 and the “done” mark 9.
07 is displayed. The photographer confirms the image 809 and executes the release operation.

The operation in FIG. 8 described above will be described with reference to the flowchart of FIG. FIG. 8 is a flowchart showing a basic operation between the CPU 911 of the camera body 700 and the CPU 902 of the smartphone 105. The functions of the smartphone 105 of the present embodiment include an operation function of the smartphone 105 alone and an operation function of communicating with the camera body 700. Among them, in the flow shown in FIG. 9, the operation function performed by communicating with the camera body 700 will be described.

The difference between the first embodiment and the present embodiment is that the camera body 700 includes a gyro sensor 925 for detecting the amount of tilt. Here, the parts different from those in FIG. 4 (operations S120 to S141 on the camera body 700 side and operations S320 on the smartphone 105 side).
S335) will be described from.








In S120, the CPU 911 confirms the posture information of the camera body 700 in the initial state.
In S121, the CPU 911 detects the tilt of the camera body 700 by the gyro sensor 925.
In S122, the CPU 911 automatically corrects the imaging range from the imaging sensor based on the detection result of the gyro sensor 925 in S121.
In S126, the CPU 911 transmits to the smartphone 105 an image of the imaging range automatically corrected in S122 and information indicating that the image has been automatically corrected via the wireless communication unit 913.
In S320, the CPU 902 receives information indicating that the automatically corrected image of the camera body 700 has been automatically corrected, and based on these, displays the received image and the "automatically corrected" mark 805 on the image display unit 906. To do.
The photographer confirms the composition of the automatically corrected image displayed on the image display unit 906 of the smartphone 105. The photographer who confirms the composition of the automatically corrected image tilts the smartphone 105 by the required amount of tilt if the composition is changed. Or, if the composition is not changed, the posture of the smartphone 105 is not tilted.
In S321, the CPU 902 detects whether the smartphone 105 is tilted by the photographer. If the posture of the smartphone 105 is tilted, the process proceeds to S330, and if the smartphone 105 is not tilted, the process proceeds to S355.
In S330, the posture sensor 907 detects the tilt amount B of the posture of the smartphone 105. C
Upon detecting the inclination amount B, the PU 902 ends the display of the "automatically corrected" mark 805.
In S335, the CPU 902 transmits the tilt amount B detected in S330 to the camera body 700 via the wireless communication unit 901.
In S130, the CPU 911 receives the tilt amount B of the smartphone 105 transmitted in S335 via the wireless communication unit 913.
In S131, the CPU 911 has tilt amounts B and S1 of the smartphone 105 received in S130.
The imaging range of the imaging unit 912 is switched based on the amount of tilt of the camera body 700 detected by 21. Specifically, as described with reference to FIG. 8 described above, the imaging range is determined.
In S141, the CPU 911 transmits the through image of the imaging range switched in S131 to the smartphone 105 via the wireless communication unit 913.
Subsequent steps are the same as those described in FIG. 4 above.

In the first embodiment, an embodiment in macro photography is described, and in the second embodiment, an example of a group photograph is described. However, this embodiment is an effective operation when the photographer cannot move the camera body while checking the through image on the image display portion of the camera body, but wants to correct the tilt of the photographed image. It is not limited to the examples of macro photography and group photography.

In addition, in the first embodiment and its modification 1, modification 2, and second embodiment,
The information regarding the angle used for mutual communication between the camera body and the smartphone may be a relative angle depending on the posture of the camera body and the smartphone, or may be an angle using absolute coordinates.

In addition, in the first embodiment and its modification 1, modification 2, and second embodiment,
When the photographer reproduces the captured image transmitted from the camera body on the image display unit of the smartphone and confirms the image, the tilt amount is not transmitted to the camera body even if the smartphone is tilted.

In addition, in the first embodiment and its modification 1, modification 2, and second embodiment,
The amount of change in the posture information of the smartphone was used when instructing the correction amount to correct the rotation of the image, but it is also possible to switch the posture of the image sensor of the image sensor of the camera body by directly inputting the numerical value related to the rotation correction to the smartphone. Is.

901: Wireless communication unit 902: CPU
903: Operation unit 904: Calculation unit 906: Image display unit 907: Posture sensor 908: Reception unit 911: CPU
912: Imaging unit
913: Wireless communication unit 914: Microphone
915: Operation unit 916: Buffer storage unit 917: Attitude control unit 918: Image processing unit 919: Image display unit 920: Image recording unit
921: Optical system 922: Lens control unit 923: Contact unit 924: Imaging range detection unit 925: Gyro sensor

Claims (4)

An image sensor that captures an image formed by an optical system and outputs a signal,
A detection unit that detects the posture and outputs the first posture information,
A receiving unit that receives the second posture information of the electronic device from the electronic device, and
A second image generated based on the signal and the first orientation information, and an image generating unit that generates a first image generated using the second image and the second position information,
At least one of the first image and the second image have a, a transmission unit for transmitting to the electronic equipment,
The transmission unit is an imaging device that transmits information indicating that the second image is an image cut out from an image generated based on the signal based on the first posture information . The first image generated by the image generation unit is an image generated by tilting an amount based on the second posture information with respect to the second image and cutting out from the second image.
The imaging device according to claim 1 . The second posture information is information indicating the tilt angle of the electronic device.
The imaging device according to claim 1 or 2. The second posture information is information indicating whether the electronic device is in the vertical posture or the horizontal posture.
The imaging device according to claim 1 or 2.

Images