JP2015012550A - Imaging apparatus and imaging system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus, an imaging system, an imaging method, etc. enabling operations such as panning and tilting while looking at a display unit of a mobile terminal with a substantially constant sense irrespective of a focal distance of imaging means, in a remote operation such as panning and tilting the imaging means of the imaging apparatus.SOLUTION: An imaging apparatus 1 includes: imaging means 11; drive means 12 for changing the view angle of the imaging means 11; detection means 13 for detecting the focal distance of the imaging means; and transmission/reception means 17 for transmitting a video signal of the imaging means and for receiving from the mobile terminal a control signal based on the movement of the housing of the mobile terminal. The drive means changes the view angle of the imaging means according to the control signal. Based on the focal distance, a ratio of an amount of movement of the mobile terminal housing to an amount of optical axis movement of the imaging means is adjusted.

Description

The present invention relates to an imaging device, an imaging system, an imaging method, and the like used when an imaging device is remotely controlled by a portable terminal. In particular, when the image of the imaging device is viewed on the display means of the mobile terminal, it is possible to perform operation control such as pan / tilt of the imaging means of the imaging device by moving or rotating the mobile terminal. The present invention relates to an imaging device and the like.

2. Description of the Related Art Conventionally, as a method for controlling a remote imaging device such as a camera, a method of sending a control signal such as pan / tilt to the imaging device by a user turning the portable terminal is known. Japanese Patent Application Laid-Open No. 2004-26883 discloses an imaging unit included in a remote camera, in which an angle and a movement amount due to rotation of a casing of a portable terminal having an imaging unit are measured by a change in an image captured by the imaging unit of the portable terminal. There is disclosed a video remote control method for controlling panning and tilting by the same amount of rotation.

Japanese Patent No. 3934521

However, Patent Document 1 described above does not disclose the relationship between the rotation angle of the portable terminal and the panning or tilting angle of the photographing unit when the focal length of the photographing unit is changed. For this reason, when the photographing lens of the photographing means is a variable focus type, for example, if the mobile terminal is rotated while maintaining the same sensation as in wide photographing at the time of tele photographing, the sensitivity of moving the photographed image with respect to the rotation angle at the time of tele photographing. Becomes higher. For this reason, there has been a problem that the captured image of the imaging device displayed on the portable terminal moves too much and the subject to be photographed is out of the composition and is difficult to operate.

In view of such a problem, an object of the present invention is to provide a technique for improving operability of an imaging apparatus, an imaging method, and the like. As a result, for example, even if the mobile terminal is rotated in the same manner as in wide shooting during telephoto shooting, the captured image of the imaging device displayed on the mobile terminal does not move greatly, and the subject to be shot is less likely to be out of composition. , Improve operability.

In order to achieve the above object, an imaging apparatus according to the present invention includes an imaging unit, a driving unit that changes an angle of view by moving an optical axis of the imaging unit, and a detection unit that detects focal length information of the imaging unit. Transmitting and receiving means for transmitting a video signal of the photographing means to the portable terminal and receiving a control signal based on movement of the casing of the portable terminal from the portable terminal. Then, the driving means changes the angle of view of the photographing means according to the control signal, and based on the focal length information, the ratio of the movement amount of the casing of the portable terminal and the movement amount of the optical axis of the photographing means Is adjusted.

In order to achieve the above object, a mobile terminal of the present invention receives a video signal of a photographing unit from a detection unit that detects a movement amount of a casing of the mobile terminal and the imaging device, and a casing of the mobile terminal. Transmission / reception means for transmitting a control signal based on the movement of the image signal to the imaging apparatus, and display means for displaying the video signal. Moreover, the imaging system of this invention has the said imaging device and the said portable terminal.

According to the present invention, for example, even if the mobile terminal is moved or rotated in the same manner as in wide shooting during telephoto shooting, the captured image displayed on the mobile terminal does not move greatly, and the subject to be shot is out of the composition. The operability is improved. Thereby, irrespective of the change in the focal length, it is possible to change the angle of view or the rotation angle of the photographing means while moving or rotating the casing of the portable terminal with almost the same feeling.

The figure for demonstrating the principle of this invention. The figure which shows the state by which the image | video of the image | photographed subject A and B was displayed on the display part of the portable terminal. The figure which shows the relationship of the operating angle of an imaging device with respect to the operating angle of a portable terminal in an imaging device and each focal distance. The block diagram which shows the structure of the imaging device of an Example of this invention, and a portable terminal. The flowchart which shows operation | movement of the portable terminal of an Example. 6 is a flowchart illustrating the operation of the imaging apparatus according to the embodiment.

In the present invention, the angle of view is changed by moving the optical axis of the imaging means of the imaging device according to the control signal based on the movement of the casing of the portable terminal, and the amount of movement of the casing of the portable terminal based on the focal length information of the imaging means And the ratio of the movement amount of the optical axis of the photographing means. Typically, the optical axis of the photographing means is rotated according to a control signal based on the rotation angle of the casing of the portable terminal. The angle of view can be changed not only by rotation of the photographing means but also by relative movement of the optical axis of the photographing optical system with respect to the lens barrel of the photographing means. For example, the angle of view can be changed by parallel movement of the optical axis of the photographing optical system with respect to the lens barrel. However, in the embodiment described later, a configuration will be described in which the angle of view is changed only by the rotation of the photographing means according to the control signal based on the rotation of the casing of the mobile terminal.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following embodiments, a monitoring video is described as a captured video, and a still image is described as a captured image.
(Constitution)
First, the configuration of an imaging apparatus such as a camera and a portable terminal will be described with reference to FIGS. 3A is an explanatory diagram of the imaging apparatus, FIG. 3B is an explanatory diagram of the portable terminal, and FIG. 4 is a block diagram illustrating a configuration of an imaging system including the imaging apparatus and the portable terminal of the present embodiment.

Reference numeral 1 denotes an imaging apparatus, and 2 denotes a portable terminal, which are in a state where they can communicate with each other wirelessly even at a remote location. In the imaging apparatus 1, the photographing unit 11 has a variable focus lens, a sensor, and the like, and photographs a subject. The driving unit 12 performs pan / tilt driving of the photographing unit 11 by a driving mechanism such as a motor. θ is an operating angle that is a rotation angle of the photographing unit 11 and is an angle when the photographing unit 11 rotates in the horizontal direction, that is, panning or rotates in the vertical direction, that is, tilts with respect to the optical axis. Reference numeral 13 denotes an operation angle detection unit which is a rotation angle detection unit of the imaging unit 11 and detects an operation angle θ of the imaging unit 11 rotated by the driving unit 12. Reference numeral 14 denotes detection means for detecting focal length information of the photographing means 11. Reference numeral 15 denotes a video signal generating means for converting the video of the subject photographed by the photographing means 11 into a video signal.

Reference numeral 16 denotes a CPU, which calculates an operating angle θ based on a control signal of the portable terminal 2 described later and detected focal length information. Further, execution control of each application program such as processing of video and images generated by the video signal generation means 15 and data storage are performed. Reference numeral 17 denotes a transmission / reception means that transmits information such as a captured image that the imaging apparatus 1 has and receives a control signal from the portable terminal 1.

In the portable terminal 2, reference numeral 21 denotes a display unit that is a display unit, which displays an image captured by the imaging unit 11 of the imaging device 1. The video displayed on the display unit 21 is a monitoring video in which the video captured by the imaging unit 11 is displayed in real time. φ is an operation angle that is a rotation angle of the casing of the mobile terminal 2 and is an angle when the mobile terminal 2 is rotated left and right or up and down by the photographer. Reference numeral 22 denotes an operation angle detection means which is a rotation angle detection means of the casing of the mobile terminal, and detects the operation angle φ by an angle sensor such as a gyro built in the mobile terminal 2.

Reference numeral 24 denotes a CPU that calculates the amount of rotation necessary for the photographing means 11 corresponding to the operation angle φ of the mobile terminal 1 and converts it into a transmittable format such as a photographing start signal and a zoom operation control signal. Further, the CPU 24 converts, for example, the video signal received from the imaging device 1 into a format that can be displayed on the display unit 21, or converts the control signal generated by the CPU 24 into a format that can be transmitted to the imaging device 1. Controls the execution of each application program. Reference numeral 25 denotes a transmission / reception means for transmitting the control signal converted by the CPU 24 to the imaging apparatus 1 and receiving the captured video of the imaging apparatus 1. As described above, the mobile terminal receives the video signal of the photographing means from the imaging unit and the detection unit that detects the movement amount of the mobile terminal housing, and transmits the control signal based on the movement of the mobile terminal housing to the imaging device. Transmitting and receiving means, and display means for displaying a video signal.

(Description of operation)
Next, operations of the imaging apparatus 1 and the portable terminal 2 according to the present embodiment will be described with reference to FIGS. 1 and 2. The operation here is a monitor operation in the case of still image shooting until a desired subject is searched for and placed within the shooting angle of view before shooting. FIG. 1A is a scene in which the photographer T is holding the mobile terminal 2 and looking at the display unit 21 at a place away from the imaging device 1. On the display unit 21, an image captured by the imaging unit 11 of the imaging device 1 is displayed in real time. Even if the imaging device 1 and the portable terminal 2 are separated, they are in a state where they can communicate with each other wirelessly. When the portable terminal 2 accesses the imaging device 1, an image captured by the imaging device 1 is displayed on the display unit 21 of the portable terminal 2. Is displayed. The photographer T remotely controls the panning and tilting operations of the photographing unit 11 by tilting the mobile terminal 2 left and right and up and down while viewing the video displayed on the display unit 21.

FIG. 1B is a scene viewed from the back side of the imaging apparatus 1, and the imaging apparatus 1 is installed on a tripod 3. The solid line frame shown in FIG. 1 (b) the shows the imaging range when photographing means 11 of the image pickup apparatus 1 to shoot a subject A at a certain focal length f _1, a dotted line frame, subject B at a focal length f ₁ The shooting range when shooting is shown. First, the focal length image of a photographed subject A at f ₁ is photographer T looking at (FIG. 2 (a)), the subject B photographed by the focal length f ₁ followed image (FIG. 2 ( b)) It is assumed that the mobile terminal 2 is pointed in the direction of the arrow P while looking at the screen of the display unit 21. Then, the operation angle detection means 22 incorporated in the mobile terminal 2 detects the tilt angle of the mobile terminal 2, that is, the operation angle φ. The CPU 24 converts the detected operation angle φ into a control signal. The converted control signal is transmitted to the imaging apparatus 1 by the transmission / reception means 25.

In the imaging apparatus 1, the imaging unit 11 is rotated in the direction of arrow S by the operating angle θ calculated by the CPU 24 based on the control signal received by the transmission / reception unit 17 and the focal length information detected by the focal length information detection unit 14. Move. By rotating, the photographer T can see the image of the subject B on the screen of the display unit 21 of the mobile terminal 2. Here, since the imaging device 1 and the portable terminal 2 communicate with each other in real time, the photographer operates the panning or tilting operation of the photographing unit 11 without feeling uncomfortable such as a time lag while looking at the display unit 21 of the portable terminal 2. Can do.

Next, the relationship between the operating angle θ of the photographing unit 11 and the operating angle φ of the mobile terminal 2 will be described with reference to FIG. FIG. 3C is a graph showing the relationship between the operating angle φ of the portable terminal 2 and the operating angle θ of the photographing unit 11 at the focal lengths f ₀ , f ₁ , and f ₂ of the photographing unit 11, and the vertical axis represents the photographing. The operating angle θ of the means 11 and the horizontal axis are the operating angle φ of the portable terminal 2. Here, the relationship between f ₀ , f ₁ and f ₂ is f ₀ <f ₁ <f ₂ , f ₁ is a standard focal length (for example, 50 mm), f ₀ is a focal length on the wide angle side (for example, 18 mm), f ₂ is the focal length of the telephoto side (e.g., 100 mm). The operating angle at the focal length f ₀ is θ ₀ , the operating angle at the focal length f ₁ is θ ₁ , and the operating angle at the focal length f ₂ is θ ₂ . Here, the ratio of the operating angle θ corresponding to the operating angle φ at the focal length f ₁ is set to 1: 1. However, in shooting at the focal length f ₂ on the telephoto side, if the ratio of the operating angle θ corresponding to the operating angle φ remains 1: 1, the captured video that moves on the screen of the display unit 21 of the mobile terminal 2 is maintained. The amount of movement increases by f ₂ / f ₁ . Therefore, for the photographer who operates the portable terminal 2 with the same feeling (turning angle and turning speed) as when shooting at the focal length f ₁ while looking at the display unit 21 of the portable terminal 2, the displayed image is greatly Because it moves, it becomes difficult to operate. Therefore, as shown in the graph, at the focal length f ₂ , the ratio of the operating angle φ of the mobile terminal 2 to the operating angle θ of the photographing unit 11 is such that the operating angle θ ₂ is θ ₂ ≈f ₁ / f ₂ · φ. Control is performed so as to obtain an inverse ratio of the focal length f. Therefore, the video displayed on the mobile terminal 2 does not move significantly, and the operation of the image pickup apparatus 1 can be performed with a substantially constant feeling without a sense of incongruity due to a difference in focal length even when viewing the display unit 21 of the mobile terminal 2. Can be operated remotely.

On the other hand, in shooting at the focal length f ₀ on the wide-angle side, if the ratio of the operating angle θ corresponding to the operating angle φ remains 1: 1, the captured video moving on the screen of the display unit 21 of the mobile terminal 2 is maintained. The amount of movement is reduced by f ₀ / f ₁ . Therefore, for the photographer who operates the portable terminal 2 with the same feeling (turning angle / turning speed) as when shooting at the focal length f ₁ while looking at the display unit 21 of the portable terminal 2, the displayed image moves very easily. Will not. Therefore, as shown in the graph, by controlling the operating angle θ ₀ at the focal length f ₀ to be θ ₀ ≈f ₁ / f ₀ · φ, the feeling is almost constant without a sense of incongruity due to the difference in focal length. The imaging apparatus 1 can be remotely operated. As described above, in this embodiment, the ratio of the operation angle φ of the portable terminal 2 to the operating angle θ of the photographing unit 11 is determined when the focal length of the photographing unit 11 is f ₁ , f ₂ , f ₀ , etc. It has changed. In other words, as the focal length increases, the ratio of the rotation angle of the optical axis of the imaging means to the rotation angle of the mobile terminal housing decreases, and as the focal distance decreases, the imaging with respect to the mobile device housing rotation angle. The ratio of the rotation angle of the optical axis of the means is increased.

Next, the above operation will be described in detail with reference to flowcharts of the mobile terminal 2 and the imaging device 1. FIG. 5 is a flowchart in the case where the panning operation of the photographing unit 11 is performed while watching the monitoring video of the imaging device 1 with the portable terminal 2. First, in response to an instruction from the CPU 24 of the portable terminal 2, an operation start control signal is transmitted to the imaging apparatus 1 (S11). When the video signal of the imaging device 1 is received (S12), the video signal of the imaging device is displayed on the display unit 21 (S13). When the portable terminal 2 is rotated by the photographer, the operation angle detection means 22 detects the rotation angle, that is, the operation angle φ (S14). The CPU 24 converts the detected rotation angle, that is, the operation angle φ into a control signal, and transmits the control signal to the imaging device 1 (S15). After receiving a video signal newly captured by panning of the imaging device 1, if the video of the imaging device 1 displayed on the display unit 21 is to be panned further in the direction that the photographer wants to see, it is carried in the desired direction. The terminal 2 is rotated. The above steps S14 to S15 are repeated until an end instruction is given (S16). The termination instruction here is, for example, the start of still image shooting by pressing a release button (not shown). Subsequently, a control signal for ending the operation is transmitted to the imaging apparatus 1 and the process ends (S18).

FIG. 6 is an operation control flowchart of the imaging apparatus 1. When receiving the operation start control signal from the portable terminal 2 (S1), the imaging apparatus 1 transmits the video signal photographed by the photographing means 11 to the portable terminal 2 and simultaneously starts the pan / tilt mode (S2). Subsequently, based on the focal length information of the photographing unit 11 detected by the detecting unit 14, the ratio of the rotation angle, that is, the operation angle based on the received operation angle information of the portable terminal 2 and the rotation angle, that is, the operation angle of the photographing unit 11. Is adjusted (S3). When the control signal of the operation angle information from the portable terminal 2 is received (S4), the photographing unit 11 is panned by the operation angle calculated by the CPU 16 (S5). The operation angle detection means 13 detects the rotation angle, that is, the operation angle θ panned by the actual photographing means 11 (S6), and coincides with the rotation angle, that is, the operation angle calculated based on the control signal (S7). The panning operation is stopped (S8). The captured video is transmitted to the mobile terminal 2 (S9). The above steps S4 to S9 are repeated until an end instruction is given (S10). When receiving the operation end control signal from the portable terminal 1, the photographing means 11 of the image pickup apparatus 1 ends the panning operation and stops (S11). Subsequently, the imaging device 1 captures a still image.

Although the operation of a still image has been described here, the operation in the case of moving image shooting is as follows. When the image capturing apparatus 1 is accessed by pressing a release button (not shown) of the mobile terminal 2, the image capturing apparatus 1 starts moving image shooting. During moving image shooting, the panning / tilting operation of the photographing means 11 is performed as appropriate, and an instruction to end the operation is transmitted by pressing the release button of the portable terminal 2 again. Upon receiving the operation end control signal, the image pickup apparatus 1 ends the operation of the photographing means 11 and then ends moving image shooting.

As described above, the photographing unit 11 of the imaging device 1 is rotated in the direction that the photographer wants to view by intuitively panning and tilting the portable terminal 2 left and right and up and down while viewing the display unit 21 of the portable terminal 2. In remote control, the following effects are produced. That is, the ratio of the operation angle φ of the portable terminal 2 and the operating angle θ of the photographing unit 11 is changed according to the change in the focal length of the photographing unit 11, so that it is intuitive while viewing the display unit 21 of the portable terminal 2. Even if a simple operation is performed, it is easy to remotely operate the image pickup apparatus without feeling uncomfortable due to a difference in focal length.

In the present embodiment, the operation of moving the mobile terminal 1 in the left-right direction and panning the drive unit 12 has been described. However, the same effect can be obtained in the operation of moving the mobile terminal 1 in the vertical direction and tilting the drive unit 12. . Further, in this embodiment, when the ratio of the operation angle φ of the portable terminal 2 and the operating angle θ of the photographing unit 11 is on the telephoto side, θ ₀ ≈f ₁ / f ₂ · φ, which is approximately the inverse ratio of the focal length f. However, the relationship may be such that the operating angle θ becomes smaller as θ ₀ <f ₁ / f ₂ · φ. Similarly, in the case of the wide angle side, the relationship may be such that the operating angle θ becomes larger as θ ₀ > f ₁ / f ₀ · φ.

Further, the driving unit 12 and the rotatable imaging unit 11 have been described as being built in the imaging apparatus 1, but the entire system including the installation unit such as an electric pan head may be used as the imaging apparatus. In addition, the configuration in which the imaging device 1 is installed by the tripod 3 has been described, but any means capable of installing the imaging device 1 such as a cradle or a suction unit may be used instead of the tripod. Further, the distance between the imaging device 1 and the portable terminal 2 may be indoors or outdoors as long as it is within a range in which wireless communication is possible.

(Other embodiments)
The object of the present invention can also be achieved by the following embodiments. That is, a storage medium storing a program code of software for realizing the functions of the above-described embodiments (functions of a control unit such as a camera and a mobile terminal CPU) is supplied to the apparatus. The computer (or CPU, MPU, etc.) of the controller reads the program code stored in the storage medium and executes the above function. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program for remotely operating the imaging apparatus and the storage medium storing the program constitute the present invention. Become. Of course, the program may be supplied via a communication line. More specifically, an imaging method for causing a computer to execute a program, which transmits a control signal from a portable terminal to an imaging device and moves an optical axis of an imaging unit of the imaging device to change an angle of view and performs imaging, performs the following steps. Have. Displaying the video signal of the imaging means of the imaging device on the display means of the portable terminal; Detecting the amount of movement of the housing of the portable terminal; Transmitting a control signal based on the movement of the casing of the mobile terminal from the mobile terminal to the imaging apparatus; Detecting focal length information of an imaging unit of the imaging apparatus; Adjusting the ratio of the amount of movement of the housing of the portable terminal and the amount of movement of the optical axis of the photographing means based on the focal length information and the control signal received by the imaging device; Changing the angle of view by moving the optical axis of the imaging means of the imaging apparatus by the adjusted amount of movement;

As mentioned above, although preferable embodiment of invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

DESCRIPTION OF SYMBOLS 1 ... Imaging apparatus, 2 ... Portable terminal, 11 ... Imaging means of imaging apparatus, 12 .... Driving means of imaging apparatus, 13 .... Operating angle detection means of imaging apparatus, 14 .... Focal length information of imaging apparatus Detecting means, 17 ..transmission and reception means of imaging device, 21 .display means of portable terminal, 22 ..operation angle detecting means of portable terminal

Claims (10)

An imaging unit; a driving unit that changes an angle of view by moving an optical axis of the imaging unit; a detection unit that detects focal length information of the imaging unit; and a video signal of the imaging unit is transmitted to a portable terminal; And a transmission / reception means for receiving a control signal based on movement of the casing of the mobile terminal from the mobile terminal,
The driving means changes the angle of view of the photographing means according to the control signal,
An image pickup apparatus characterized in that a ratio of a movement amount of the casing of the portable terminal and a movement amount of the optical axis of the photographing unit is adjusted based on the focal length information. The driving means rotates the optical axis of the photographing means,
The transmission / reception means receives a control signal based on a rotation angle of the casing of the mobile terminal,
The imaging apparatus according to claim 1, wherein a ratio between a rotation angle of the casing of the mobile terminal and a rotation angle of the photographing unit is adjusted based on the focal length information. The imaging apparatus according to claim 2, wherein the rotation angle of the photographing unit is a panning or tilting angle of the photographing unit. As the focal length information increases, the ratio of the movement amount or rotation angle of the optical axis of the photographing means to the movement amount or rotation angle of the casing of the mobile terminal is reduced,
The ratio of the movement amount or rotation angle of the optical axis of the photographing means to the movement amount or rotation angle of the housing of the portable terminal is increased as the focal length information is reduced. The imaging device according to any one of the above. Detecting means for detecting the amount of movement of the casing of the mobile terminal;
Transmission / reception means for receiving a video signal of the photographing means from the imaging apparatus according to any one of claims 1 to 4 and transmitting a control signal based on movement of the casing of the portable terminal to the imaging apparatus;
Display means for displaying the video signal;
A portable terminal characterized by comprising: The detection means detects a rotation angle of the casing of the mobile terminal,
The portable terminal according to claim 5, wherein the transmission / reception unit transmits a control signal based on the rotation angle for controlling an operation of the photographing unit. An imaging system comprising: the imaging apparatus according to claim 1; and the portable terminal according to claim 5 or 6. An imaging method for transmitting a control signal from a portable terminal to an imaging device, moving an optical axis of an imaging unit of the imaging device to change an angle of view, and performing imaging.
Displaying the video signal of the imaging means of the imaging device on the display means of the mobile terminal;
Detecting the amount of movement of the housing of the mobile device;
Transmitting a control signal based on movement of the casing of the mobile terminal from the mobile terminal to the imaging device;
Detecting focal length information of the imaging means of the imaging device;
Adjusting the ratio of the movement amount of the housing of the portable terminal and the movement amount of the optical axis of the photographing means based on the focal length information and the control signal received by the imaging device;
Changing the angle of view by moving the optical axis of the imaging means of the imaging device by the changed amount of movement; and
An imaging method characterized by comprising: The movement amount of the casing of the mobile terminal is a rotation angle of the casing of the mobile terminal,
The imaging method according to claim 8, wherein the movement amount of the optical axis of the imaging unit is a rotation angle of the optical axis of the imaging unit. A program for shooting by changing the angle of view by moving the optical axis of the imaging means of the imaging device,
A program for causing a computer to execute the imaging method according to claim 9.