WO2006028247A1

WO2006028247A1 - Video shooting system, video shooting device and video shooting method

Info

Publication number: WO2006028247A1
Application number: PCT/JP2005/016727
Authority: WO
Inventors: Masayuki Hosoi
Original assignee: Pioneer Corporation
Priority date: 2004-09-10
Filing date: 2005-09-12
Publication date: 2006-03-16

Abstract

A video shooting system (10) is provided with a main camera (100) and a subcamera (200). A CPU (111) of the main camera (100) generates a command signal which corresponds to movement of the main camera (100), based on the current position, distance to an object and shooting direction of the main camera (100) and those of the subcamera (200), and transmits the command signal to the subcamera (200) through a communication section (160). The subcamera (200) operates by following the main camera (100) in response to the command signal.

Description

Specification

Video shooting system, video shooting device, and video shooting method

Technical field

The present invention relates to a technical field of a video shooting system, a video shooting device, and a video shooting method.

Background art

[0002] There has been proposed a video imaging system in which a plurality of video imaging devices are linked to each other (for example, see Patent Document 1).

[0003] According to the imaging system described in Patent Document 1 (hereinafter referred to as "conventional technology"), the first camera force is transmitted to the second camera based on the exposure value in the first camera to which the first camera power is also transmitted. The exposure value is controlled. Therefore, it is said that the exposure of two or more cameras at remote locations can be controlled arbitrarily by operating one camera.

[0004] Patent Document 1: Japanese Patent Laid-Open No. 2001-281717

Disclosure of the invention

Problems to be solved by the invention

[0005] However, the conventional technology has the following problems.

[0006] There are many factors that determine the quality of video in addition to the exposure value. For example, even if the exposure value can be unified between two cameras, the quality of the final video obtained is two. It is unlikely that they will be unified between cameras. That is, with the conventional technology, it is practically difficult to capture a high-quality image that can satisfy the user using a plurality of imaging devices.

[0007] The present invention has been made in view of the above-described problems, for example, and provides a video shooting system, a video shooting device, and a video shooting method capable of obtaining a high-quality video. Let it be an issue.

Means for solving the problem

[0008] Ku Video Shooting System>

In order to solve the above problems, a video shooting system of the present invention is accommodated in a network, and at least one main shooting device and at least one sub-shooting for shooting a video. The main photographing device includes a first photographing means for photographing the video, a first control means for controlling the photographing condition of the video in the first photographing means, and among the photographing conditions, Control information generating means for generating control information for causing the sub-photographing device to follow in accordance with conditions defining the composition of the video to be photographed, and the generation for the sub-photographing device via the network. A first communication means for transmitting the transmitted control information, wherein the sub-photographing device is a second photographing means for photographing the video and a second communication for receiving the transmitted control information via the network. And a second control means for controlling the imaging conditions of the video in the second imaging means based on the received control information.

In the present invention, “network” means, for example, a wired communication network such as a WAN (Wide Area Network) or a LAN (Local Area Network) compliant with USB (Universal Serial Bus) or IE EE1394, or the like. A concept that includes a wireless communication network that accesses a wired communication network via a base station or an access point, etc., and includes at least all of the devices that enable communication with the main imaging device capability and secondary imaging device according to the present invention. It is.

[0010] In the present invention, the "main photographing device" and the "sub photographing device" represent one of the photographing devices that constitute the video photographing system according to the present invention. Here, the “photographing device” is a concept including all devices capable of photographing a subject and includes, for example, a DV (Digital Video) camera, a video camera, a camera, a digital camera, and the like. Or it refers to a digital camera or video camera mounted on a mobile terminal such as a mobile phone.

According to the video imaging system of the present invention, during the operation, video is captured by the first imaging means in the main imaging apparatus and by the second imaging means in the sub-imaging apparatus. The image capturing conditions of the first and second imaging means are controlled by the first and second control means, respectively.

Here, the “video shooting conditions” in the present invention is a concept including all conditions having some relationship with the video to be shot. Specifically, for example, conditions relating to exposure such as shutter speed, aperture value, or subject depth, conditions relating to shooting methods such as fade-in or out, or various image processing, and zoom-in or out, left-right direction Rotation of the first and second imaging means (hereinafter referred to as “pan” as appropriate), or rotation of the first and second imaging means in the vertical direction (hereinafter referred to as “tilt” as appropriate), etc. This refers to all or part of the compositional conditions.

[0013] In the present invention, the first and second control means control such shooting conditions, and the mode of such control is, for example, full auto control, semi-auto control, or a user via some input device. Various forms such as simple control based on powerful instructions can be adopted. In the case of full auto control, even if these shooting conditions are controlled without any user operation during shooting according to a control program stored in a ROM (Read Only Memory) or some recording medium, for example. Good. In this case, for example, if the main or sub-photographing device is installed via a fixing means such as a tripod, the attachment portion between the fixing means and the main or sub-photographing device is driven by a motor or the like. The pan or tilt may be controlled by. In the case of semi-automatic control, for example, a part of shooting conditions such as panning or tilting may be controlled through an operation by a user.

[0014] Here, in particular, even if information such as exposure values is shared between the main photographing device and the sub photographing device as in the prior art, the type of subject (human, animal, car, landscape, etc.) or photographing Depending on the purpose (athletic meet, presentation, or various events), it is difficult to obtain sufficient video quality.

[0015] For example, when the main shooting device is shooting while following the movement of one athlete as a subject at an athletic meet or the like, the sub-shooting device installed at another position may It is difficult to follow the shooting action and take a picture of the competitor from another direction. Therefore, the images taken by the main and sub-photographing devices tend to be low-quality images that lack sense.

However, in the present invention, such a problem can be solved as follows. That is, during the operation of the present invention, the control information generating means of the main image capturing device further generates control information for causing the sub image capturing device to follow in accordance with the conditions defining the composition of the image to be captured. It is transmitted to the secondary imaging device via the network by the first communication means.

[0017] Here, the "imaging conditions for defining the composition" are, for example, the position of the main imaging device, the first imaging operator The direction in which the stage is shooting the image (hereinafter referred to as “shooting direction” as appropriate), the distance between the main shooting device and the subject, the zoom magnification, etc., and the composition of the image shot by the first shooting means. This is a concept that broadly represents the shooting conditions that can define the figure to a great extent.

[0018] Such control information generated according to the first imaging condition is, for example, an operation accompanied by a composition change on the main imaging device side, for example, a change in installation position, a state in which the installation position is maintained ( For example, when panning or tilting in a fixed state with a tripod or the like, or when changing the zoom magnification, etc., it is information that causes the sub-photographing device to follow the main photographing device.

Here, “following” refers to, for example, panning (tilting) the secondary imaging device in the same phase or in reverse phase when the main imaging device pans (or tilts). Alternatively, when the zoom magnification of the main photographing device is changed to the telephoto side (zoom-in), the zoom magnification of the sub-photographing device is changed to the telephoto side or the wide-angle side (zoom-out). Therefore, the mode of the control information may be a command signal that positively controls the operation of the sub-photographing device, and the sub-photographing device side transfers to the main photographing device according to some control program or control algorithm. If follow-up control is possible, the information may simply represent the amount of change in shooting conditions.

[0020] In the sub-photographing device, this control information is received by the second communication means via the network. Based on the received control information, the second control means of the sub-photographing device controls the video shooting conditions in the second photographing means described above. Here, the control of the photographing conditions by the second control means can take various forms depending on the form of the control information transmitted from the main photographing apparatus. For example, as described above, when the control information is a type of command signal, the zoom magnification may be changed according to the command signal, or the sub-shooting device may be panned or tilted. In addition, when information representing the shooting conditions on the main photographing apparatus side is simply given as control information, the second control means estimates the current operation of the main photographing apparatus and contacts the main photographing apparatus. Control may be performed so that the video is shot under shooting conditions that best match the video being shot. Note that the basis for such an estimation may be given in advance by experiment, empirical, simulation, or the like.

[0021] Alternatively, if the sub-photographing device is manually operated by the user, The shooting condition may be controlled by providing information prompting the user to change the condition. That is, as compared with the case where no such control is performed, as long as the shooting conditions on the sub-photographing device side can be improved following the shooting conditions on the main-photographing device side.

V. The manner of controlling the photographing conditions performed by the second control means is not limited at all.

[0022] For example, such "information for prompting the change of the second imaging condition" is provided through such a display means when the secondary imaging apparatus is provided with some display means such as a liquid crystal display. May be information. For example, if you want to pan the sub-photographing device by 30 ° to the right, display an arrow mark to the right on the display means, and when the user pans the sub-photographing device by 30 degrees, The second control means may control the photographing conditions by terminating the display. Alternatively, such information may be a kind of audio information when the sub-photographing device is provided with audio output means such as a speaker.

[0023] In the video imaging system of the present invention, a sequence of control occurs between a plurality of video imaging devices during video imaging, but the configuration of the video imaging device itself constitutes all of the video imaging system. It may be equivalent among the video photographing apparatuses. For example, such a control order may be determined each time a video shooting system is constructed and a video is shot.

As described above, according to the video image capturing system of the present invention, by making the secondary imaging device follow the imaging operation of the primary imaging device, for example, when the primary imaging device captures a subject up, On the other hand, the imaging device can shoot wide-angle images that look down on the subject. In addition, when the main photographing device follows the movement of the subject and frequently performs panning or tilting, it is possible to pan or tilt the sub-photographing devices installed at different positions in exactly the same way. . In other words, it is possible to shoot extremely high quality images.

In one aspect of the video imaging system of the present invention, at least one of the first and second control means is based on a preset imaging pattern, and imaging conditions corresponding to the at least one To control.

The “preset shooting pattern” described here refers to a pattern optimized for each of various shooting purposes such as an athletic meet, a music recital, or an outdoor event. [0027] For example, the "Athletic meet" shooting pattern is set as a shooting pattern that frequently pans the shooting apparatus at a predetermined timing, assuming a subject moving over a wide range. In addition, for example, the shooting pattern for “music recital” is set as a shooting pattern that uses a lot of zoom, assuming a fixed subject. When shooting conditions are controlled based on such a shooting pattern, the main or sub-shooting device can easily shoot a video in the full auto mode. However, even in the case of shooting in such a full auto mode, for example, the panning range may be set on the user side in advance. In addition, the timing for panning (or tilting) or zooming may be specified. Or, specify the frequency of occurrence of characteristic actions (such as pan and tilt) in the set shooting pattern, such as “Frequently”, “Standardly”, or “Conservatively”. When the information can be input, the first or second control means may control the photographing condition in accordance with such abstract designation information input by the user.

[0028] It should be noted that such a shooting pattern is used when an optimum pattern for various shooting purposes can be predicted, estimated or specified in advance by an experimental, empirical, or simulation technique. It may be.

[0029] According to this aspect, since the shooting conditions are controlled based on a preset shooting pattern, a plurality of video shooting devices are used while the sub-shooting device follows the main shooting device. It is possible to shoot higher quality video.

[0030] In another aspect of the video imaging system of the present invention, at least one of the first and second control means includes the main imaging device and the secondary imaging device as the preset imaging pattern. The photographing conditions are controlled based on the photographing pattern corresponding to the relative positional relationship between the two.

[0031] The "relative positional relationship" in this aspect may be a positional relationship in a strict sense, but as one of the simplest aspects, for example, an abstraction such as "close" or "far" It may be a similar distance relationship. In addition, if there is a consensus that the subject is common between the main and secondary photographing devices and that the photographing orientation of the first and second photographing means is the direction of the subject. It may be an angle difference with respect to the subject. In such cases The difference in angles may also be defined including abstract concepts such as when facing forces or when they are adjacent.

[0032] According to this aspect, the photographing conditions in each photographing apparatus are controlled based on the photographing pattern corresponding to such a relative positional relationship. For example, when the positional relationship between the two is “facing”, when the main shooting device pans to the right, the sub-shooting device pans to the left so that the same subject is shot. You may go. Alternatively, when “the distance difference of the subject power is large”, the zoom may be compensated within an appropriate range so that the size of the subject in the image is adjusted.

[0033] Therefore, according to this aspect, it is possible to shoot a high-quality video reflecting the positional relationship between the main photographing device and the sub photographing device.

[0034] In another aspect of the video imaging system of the present invention, the main imaging device includes: (i) a distance to a subject; (ii) a current position of the main imaging device; and (iii) the first imaging unit. First acquisition means for acquiring first position information including at least one of the shooting directions is further provided.

[0035] According to this aspect, the first position information acquired by the first acquisition unit can add various supplementary information to the video imaged by the main imaging device, further improving the video quality. It becomes possible to make it.

[0036] Here, the "distance to the subject" in the first position information may not be strictly specified as a distance value. For example, the distance to the subject may be acquired with an ambiguity of “far” or “near” as viewed from a general standard. However, when the distance to the subject is accurately obtained by a known laser ranging technique or a similar ranging technique, the quality of the single layer video can be improved.

[0037] Further, the "current position" in the first position information may be an accurate current position such as latitude information, longitude information, and altitude information power, and a certain area including the current position is It may be a specified degree. Such a current position may be obtained using positioning technology such as GPS (Global Positioning System)! Or may be specified by a base station via a wireless network or the like.

In addition, the “shooting azimuth” in the first position information may be a simple azimuth such as east, west, south, or north, or an accurate absolute azimuth obtained via a geomagnetic sensor or the like. [0038] For example, when all of these three types of elements are obtained accurately (that is, with a certain degree of credibility), the quality of the video shot by the main shooting device is significantly improved.

[0039] In one aspect of the video photographing system of the present invention in which the first position information is acquired in the main photographing device, the sub photographing device includes: (i) a distance to a subject; (ii) a current state of the sub photographing device. And (iii) second acquisition means for acquiring second position information including at least one of the imaging directions of the second imaging means.

[0040] According to this aspect, since the second position information equivalent to the first position information described above is acquired also in the sub-photographing device, the quality of the video can be improved.

[0041] In an aspect of the video imaging system of the present invention in which the first position information and the second position information are acquired, the first communication means sends the sub-photographing apparatus to the sub-photographing apparatus via the network. The acquired first position information is further transmitted, the second communication means further receives the transmitted first position information, and the second control means is configured to receive the acquired second position information and the reception The imaging conditions are controlled based on the first position information.

[0042] According to this aspect, in the sub-shooting device, the shooting conditions are controlled based on the first position information in the main shooting device, so that there is a sense of unity between the main and sub-shooting devices. It becomes possible to shoot extremely high quality images.

[0043] Further, if it is previously known that the main photographing device captures the desired subject, even if the subject is lost on the side of the secondary photographing device, the subject is quickly found and captured. This is preferable because it can be performed.

[0044] When a plurality of shooting patterns corresponding to the shooting purpose, the subject type, or the relative positional relationship between the two are prepared in advance, the transmitted first position information and Based on the acquired second position information, even if the second control means controls the shooting conditions so as to automatically select the shooting pattern most suitable for the current positional relationship between the two and perform shooting. Good.

[0045] In another aspect of the video image capturing system of the present invention in which the first position information and the second position information are acquired, the second communication unit is configured to transmit the main image capturing apparatus to the main image capturing apparatus via the network. The acquired second position information is transmitted, the first communication means receives the transmitted second position information, and the first control means includes the acquired first position information and the reception. The imaging condition is controlled based on the second position information.

[0046] According to this aspect, since it is possible to acquire the position information of the sub-photographing device on the main photographing device side, it is possible to photograph a higher quality video. In this case, it is also possible to easily transmit control information in consideration of the current position of the sub-imaging device on the main imaging device side. For example, if the sub-photographing device is pointing in a direction unrelated to the video to be shot, specify the power to send a command signal to correctly point the subject or the amount of panning or tilting. You can send control information!

[0047] Furthermore, when the position information of the other party is held in both the main and sub-photographing devices, it is possible to accurately grasp the mutual positional relationship between the two, so that the details are further refined. Therefore, it is possible to control the shooting conditions, and the quality of the shot video is greatly improved.

[0048] In another aspect of the video imaging system of the present invention, each of the main and secondary imaging devices further includes authentication means for performing mutual authentication via the first and second communication means.

In the video imaging system of the present invention, control information is transmitted to at least the main imaging device and the auxiliary imaging device. For example, wireless communication between these imaging devices installed at locations separated from each other is performed. When connected via a communication network, interference may occur between the imaging device to which the control information is to be transmitted and another imaging device. However, according to this aspect, since the authentication is performed between the main and secondary imaging devices in advance through the authentication means, the possibility of such interference is remarkably reduced, and highly reliable data transmission and reception are possible. Video can be taken.

[0050] Note that the aspect of the authentication means is not limited as long as mutual authentication is possible between the main and secondary imaging devices, such as an ID that is unique between the imaging devices in advance. Authentication may be done by exchanging identification information.

[0051] In another aspect of the video imaging system of the present invention, at least one of the primary and secondary imaging devices includes audio information acquisition means for acquiring audio information corresponding to an image captured in at least one of the main and auxiliary imaging devices. In addition.

[0052] According to this aspect, in at least one of the main and sub-photographing devices, the at least On the other hand, since it is possible to acquire audio information corresponding to the video imaged, the video quality is further improved.

In order to solve the above problems, the first video imaging device of the present invention is accommodated in a network.

A video shooting device for shooting a video together with another video shooting device accommodated in the network, a shooting unit for shooting the video, and a control unit for controlling a shooting condition of the video in the shooting unit; A control information generating means for generating control information for causing the other video imaging device to follow in accordance with a condition defining a composition of the video to be shot among the shooting conditions, and the other video shooting. Communication means for transmitting the generated control information to the apparatus via the network.

[0053] According to the first video imaging apparatus of the present invention, during the operation, the same effects as those of the main video imaging apparatus in the video imaging system described above can be realized by each means. It is possible to shoot a video.

In order to solve the above-described problem, the second video imaging device of the present invention is a video imaging device that is accommodated in a network and shoots video together with other video imaging devices accommodated in the network, and captures the video. And receiving the control information generated via the network and transmitted via the network in accordance with the conditions defining the composition of the video to be shot in the imaging unit and the other video imaging device. And communication means for controlling the image capturing conditions of the image capturing means based on the received control information.

[0054] According to the second video imaging apparatus of the present invention, during the operation, the same effects as those of the sub-imaging apparatus in the video imaging system described above can be realized by each means. It is possible to shoot a video.

In order to solve the above-described problems, the video shooting method of the present invention is accommodated in a network, and includes a video shooting system including at least one main shooting device and at least one sub-shooting device for shooting images. Video for shooting the video in conjunction with each other (Ii) a first control step of controlling the video shooting conditions in the first shooting step in the main shooting device; (ii) a first control step of controlling the shooting conditions of the video in the first shooting step; ) A control information generating step for generating control information for causing the sub-photographing device to follow in accordance with a condition that defines the composition of the video to be photographed among the photographing conditions; and (iv) in the sub-photographing device. On the other hand, in the transmission step of transmitting the generated control information via the network, (i) a second shooting step of shooting the video in the sub-shooting device, (ii) the transmission of the image via the network. A receiving step for receiving the control information, and (ii) a second control step for controlling the shooting conditions of the video in the second shooting step based on the received control information.

[0055] According to the video imaging method of the present invention, it is possible to capture a high-quality image in the same manner as in the video imaging system, by the operation in each process corresponding to each means in the video imaging system described above. It becomes.

[0056] As described above, the video photographing system includes the first photographing means, the first control means, the control information generating means, the first communication means, the second photographing means, the second communication means, and the second control means. It is possible to shoot high-quality images. Since the first video imaging apparatus includes the imaging means, the control means, the control information generation means, and the communication means, it is possible to take a high-quality image. Since the second video imaging apparatus includes the imaging means, the communication means, and the control means, it is possible to take a high quality video. The video shooting method includes a first shooting process, a first control process, a control information generation process, a transmission process, a second shooting process, a reception process, and a second control process. Is possible.

[0057] These effects and other advantages of the present invention will become apparent from the embodiments described below.

Brief Description of Drawings

FIG. 1 is a conceptual diagram of a video shooting system according to an embodiment of the present invention.

2 is a block diagram of a main camera in the video imaging system of FIG.

3 is a flowchart relating to the overall operation of the video imaging system of FIG.

FIG. 4 is a flowchart of a photographing process in the flowchart of FIG.

[Fig. 5] Model showing the positional relationship between the subject and each camera in the video shooting system of Fig. 1. FIG.

FIG. 6 is a schematic diagram of a recording process in the flowchart of FIG.

FIG. 7 is a flowchart of video data processing in the recording processing of FIG.

FIG. 8 is a flowchart of audio data processing in the recording processing of FIG.

9 is a flowchart of additional information processing in the recording process of FIG.

FIG. 10 is a schematic diagram of a recording format in the recording process of FIG.

FIG. 11 is a schematic diagram of the header and additional information in FIG.

FIG. 12 is a schematic diagram of sub camera follow-up control according to a modification of the present invention.

Explanation of symbols

[0059] 10 ··· Image shooting system, 20… Subject, 30… Network, 40 ··· Tripod, 100 ··· Main camera, 100a · User, 110 ··· Control unit, 111--CPU, 112 ---ROM, 113- --RAM, 120 ... Sound collecting unit, 130 ... Imaging unit, 140 ... Camera rotation unit, 150 ... Lens driving unit, 160 ... Communication unit, 170 ... Position information acquisition 171 ··· Distance measurement unit, 172 ··· Position detection unit, 173 ··· Location detection unit, 180 ... recording unit, 190 ... input unit, 200 ... sub camera.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, the best mode for carrying out the present invention will be described in each embodiment in order with reference to the drawings.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

First, with reference to FIG. 1, the configuration of a video shooting system according to an embodiment of the present invention will be described. FIG. 1 is a conceptual diagram of the video photographing system 10.

In FIG. 1, the video imaging system 10 includes a main camera 100 and a sub camera 200 housed in a network 30, and the main camera 100 and the sub camera 200 shoot the object 20 in conjunction with each other. It is structured as follows.

[0064] Each of the main camera 100 and the sub camera 200 is fixed by a tripod 40 !. Each camera is fixed to a tripod 40 via an attachment 41, and the attachment 41 is configured to be able to freely rotate in the vertical and horizontal directions. Therefore, each camera can also be rotated three-dimensionally while being fixed to the tripod 40. Note that the installation state of the main camera 100 is adjusted in advance by the user 100a so that a desired composition including the subject 20 can be obtained. In this embodiment, this installation state is referred to as “standard state” as appropriate.

[0066] The network 30 is an example of a "network" according to the present invention including a mobile communication network and a wired communication network. For example, the network 30 includes various lines such as an ADSL line, optical fiber line, or telephone line, and It includes base stations and access points corresponding to them.

Next, the detailed configuration of the main camera 100 will be described with reference to FIG. FIG. 2 is a block diagram of the main camera 100. In the present embodiment, the internal configurations of the main camera 100 and the sub camera 200 are the same, and therefore, the configuration of the main camera 100 will be described as a representative in FIG. The reference numerals of the parts corresponding to the sub camera 200 are shown in parentheses in FIG.

In FIG. 2, the main camera 100 includes a control unit 110, a sound collection unit 120, an imaging unit 130, a camera rotation unit 140, a lens driving unit 150, a communication unit 160, a position information acquisition unit 170, a recording unit 180, And an input unit 190.

[0069] The control unit 110 faces a CPU (Central Processing Unit) 111, a ROM 112, and a RAM (Random Access Memory) 13.

CPUl l l is a control unit that controls the operation of the main camera 100.

The ROM 111 is a non-volatile memory, and stores a unique ID number assigned in advance to the main camera 100 and a video shooting program to be described later that is executed by the CPU 11. The CPUll is configured to function as an example of each of the “first control unit”, “control information generation unit”, and “authentication unit” according to the present invention by executing the video shooting program. ing.

Note that the ROM 212 in the sub camera 200 also stores an ID number and a video shooting program in the same manner as the ROM 112, and the CPU 211 executes the “second” according to the present invention by executing the program. Each of the “control means” and the “authentication means” is configured to function as an example.

[0073] The RAMI 13 is a volatile memory, and the CPU ll executes a video shooting program. It is configured to function as a buffer for temporarily storing various data generated in the process.

[0074] The sound collection unit 120 is used to acquire sound around the main camera 100, and a microphone (not shown) and a sound signal acquired by the microphone are converted into sound information of a predetermined format. It is configured to function as an example of the “voice information acquisition unit” according to the present invention, with the help of a voice conversion unit (not shown).

The imaging unit 130 has a CCD (Charge Coupled Diode) (not shown) that photoelectrically converts an image formed by a camera lens (not shown) for each pixel, and is formed by being condensed by the camera lens. An example of the “first photographing means” according to the present invention, which is configured such that a formed field image is formed, and the formed field image is photoelectrically converted and recorded as an imaging signal in the recording unit 180. It is. The imaging unit 230 in the sub camera 200 is an example of the “second imaging unit” according to the present invention.

The camera rotation unit 140 is a drive mechanism including a motor (not shown) for panning and tilting the main camera 100. The camera rotation unit 140 is configured to be able to three-dimensionally rotate the attachment 41 of the tripod 40 according to an instruction from the CPU 111 using the rotation angle and the rotation speed as parameters.

The lens driving unit 150 is a mechanism that drives a lens to control focus and zoom. The lens driving unit 150 is configured to be able to drive the lens according to an instruction from the CPU 111 with the zoom speed and zoom distance as parameters.

[0078] The communication unit 160 is connected to the network 30 via an antenna (not shown), and is configured to be capable of transmitting and receiving data communication with the sub camera 200. It is an example of “communication means”. In addition, the communication unit 260 in the sub camera 200 is configured to function as an example of the “second communication unit” according to the present invention.

[0079] The position information acquisition unit 170 includes a distance measurement unit 171, a position detection unit 172, and an orientation detection unit 173, and is configured to be able to acquire an example of "first position information" according to the present invention. It is an example of the “first acquisition means” according to the invention. The position information acquisition unit 270 in the sub camera functions as an example of the “second acquisition unit” according to the present invention.

[0080] The distance measuring unit 171 includes an infrared sensor (not shown) and the like, The distance from the subject 20 can be measured.

The position detection unit 172 is a known position detection system that uses GPS or a quasi-sky satellite, and is configured to be able to specify the current position of the main camera 100.

The direction detection unit 173 is configured to be able to specify the absolute direction of the main camera 100 by using a force such as a geomagnetic sensor.

The recording unit 180 is a recording medium for recording video and audio data, additional information, and the like. The additional information refers to information indicating, for example, the distance to the subject 20, the current position of the main camera 100, the orientation of the main camera, the zoom size, the pan angle (direction), and the tilt angle (direction). . Also, video data is, for example, data compressed by a data compression format such as MPEG2, MPEG4, or H.264, and audio data is data that conforms to a format such as linear PCM or AC-3, respectively. To be recorded.

[0084] The input unit 190 is configured so that the user 100a can give various instructions to the CPU 111. The input unit 190 is a part of a touch panel device, an operation button, an operation dial, or an operation lever (knob) or It consists of the whole.

Note that the main camera 100 and the sub camera 200 are provided with a display unit configured with, for example, a liquid crystal display so that the user 100a can appropriately check the video being captured, for example. Are omitted for simplicity of explanation.

Next, the operation of the video imaging system 10 having the above configuration will be described. <Overall operation>

First, the overall operation of the video imaging system 10 will be described with reference to FIG. FIG. 3 is a flowchart relating to the overall operation of the video imaging system 10.

In FIG. 3, when the main camera 100 and the sub camera 200 are powered on, mutual authentication is first performed (step A10). At this time, the CPU 111 and the CPU 211 exchange the ID numbers of the main camera 100 and the sub camera 200 stored in the ROMs 112 and 212 via the communication unit 160 and the communication unit 260, respectively. Thereafter, when data is transmitted from the main camera 100 to the sub camera 200, or from the sub camera 200 to the main camera 100, data each having its own ID number is transmitted. Next, CPUll and CPU211 each determine whether or not mutual authentication has been successfully completed (step Al1). If mutual authentication is not successful (step Al 1: YES), CPU 111 and CPU 211 repeat the authentication process, and if authentication is successful (step Al l: YES), CPU 111 and CPU 211 are the main camera. 100 and sub camera 200 are set to idling mode (step A12). Here, the idling mode is a mode that waits for an instruction from the user 100a such as shooting, playback, or various settings. In this embodiment, it is assumed that the sub camera 200 is controlled to perform an operation following the main camera 100 by setting the idling mode.

In this idling mode, the CPU 11 determines whether or not there is an operation input from the user 100a via the input unit 190 (step A13). The determination related to step A13 is constantly executed based on a fixed clock. For example, such an operation input is an instruction for starting a shooting mode for shooting a subject and recording the shot video, an instruction for starting a playback mode for playing back a previously shot video, or the main camera 100. This indicates a setting mode start instruction for changing the electrical or mechanical settings of the machine.

[0089] If no operation input is detected (step A13: NO), CPUll continues the idling mode and if any operation input is detected (step A13: YES), It is determined whether or not the operation input is a shooting mode start instruction (step A14). When activation of the shooting mode is instructed (step A14: YES), the CPU 111 executes shooting processing and recording processing (step A15). This shooting process and recording process will be described later.

[0090] On the other hand, if the operation input from the user 100a is not an instruction to start the shooting mode (step A14: NO), the CPUll then receives the operation input force from the user 100a as an instruction to stop the main camera 100. It is determined whether or not there is a certain force (step A16). If it is a stop instruction (step A16: YES), the CPU 11 turns off the main camera 100 and stops the main camera 100.

[0091] If the operation input from the user 100a is not a stop instruction (step A16: NO), CPUll further determines whether it is another operation input (step A17). The other operation input described here means that the above-described playback mode or setting mode is started. Indicates a movement instruction.

[0092] If these are not other operation inputs (step A17: NO), the CPU 111 returns the processing to step A13 again as a detection error, and if it is another operation input (step A17: YES) ), The CPU 111 performs control corresponding to other operation inputs (step A18).

The CPU 111 determines whether or not the force corresponding to the other operation input has ended (step A19). When the control is not finished (step A19: NO), the CPU 111 continues the control and, when the control is finished, returns the process to step A13 again and controls the main camera 100 to the idling mode. . The control corresponding to the other operation input is the same as the control related to video reproduction or various settings in a normal video camera, and thus detailed description in this embodiment will be omitted.

Next, with reference to FIG. 4, the details of the photographing process according to the present embodiment will be described. FIG. 4 is a flowchart of the photographing process. Note that such shooting processing is realized by the CPUs 111 and 211 executing the video shooting programs stored in the ROMs 112 and 212 (that is, an example of a computer program according to the present invention). Therefore, at the time when this imaging process is started, the CPU 111 has already transmitted a command signal for instructing the CPU 211 to start the imaging process via the communication unit 160, and based on this command signal. The CPU 211 reads the video shooting program stored in the ROM 212 and waits for the next instruction waiting state from the CPU 211.

In FIG. 4, when shooting processing is started, first, position information is acquired in each of the main camera 100 and the sub camera 200 (step B10).

In the operation related to step BIO, first, the CPU 111 instructs the position information acquisition unit 170 to acquire position information regarding the main camera 100. Based on this instruction, the distance measurement unit 171, the position detection unit 172, and the direction detection unit 173 determine the distance between the main camera 100 and the subject 20, the current position of the main camera 100, and the shooting direction of the main camera 100, respectively. Three types of information to be represented are acquired and temporarily stored in the RAM 113. On the other hand, in parallel with giving the position information acquisition unit 170 an instruction to acquire position information regarding the main camera 100, the CPU 111 sends a command signal for requesting acquisition of position information in the sub camera 200 to the communication unit 160. To the sub camera 200.

However, at this time, since it is unknown whether the sub camera 200 is installed in a state where the subject 20 is properly captured, the CPU 111 first obtains temporary position information regarding the sub camera 200. Send the requested command signal.

In the sub camera 200, the CPU 211 instructs the position information acquisition unit 270 to acquire position information related to the sub camera 200 based on the command signal. Based on this instruction, the position detection unit 272 and the direction detection unit 273 acquire two types of information representing the current position of the sub camera 200 and the shooting direction of the sub camera 200, respectively, and are temporarily stored in the RAM 213. The Further, the acquired position information related to the sub camera 200 is transmitted to the main camera 100 via the communication unit 260. The transmitted position information regarding the sub camera 200 is temporarily stored in the RAMI 13 of the main camera 100 as temporary position information regarding the sub camera 200. In this state, the process related to step B10 ends.

Next, the CPU 111 sets the sub camera 200 to a state corresponding to the standard state of the main camera 100, that is, the standard state of the sub camera 200 (step Bl).

[0100] Specifically, when the temporary position information related to the sub camera 200 is acquired, the CPU 111 compares the position information of the main camera 100 stored in the R AMI 13 with the temporary position information. Then, it is determined whether or not the sub-camera 200 is accurately facing the subject 20.

[0101] When the sub camera 200 is not directed toward the subject 20, the CPU 111 newly generates a command signal for panning and tilting the sub camera 200 so as to face the subject 20, and the communication unit 160 To the sub camera 200. In the sub camera 200 that has received this command signal, the CPU 211 controls the camera rotation unit 240 based on the command signal, and pans or tilts the sub camera 200 as instructed.

[0102] When the sub camera 200 is panned or tilted as instructed, the CPU 211 in the sub camera 200 controls the position information acquisition unit 270 to acquire the position information of the sub camera 200 again. At this time, in addition to the two types of information described above, the subject 20 and sub The distance information with respect to the camera 200 is measured and transmitted to the main camera 100 via the communication unit 260 as the true position information of the sub camera 200.

On the other hand, when the sub camera 200 faces the direction of the subject 20, the CPU 111 generates a command signal that requests only acquisition of information indicating the distance between the subject 20 and the sub camera 200, and sets the communication unit 160. To the sub camera 200. In response to this command signal, the sub camera 200 acquires distance information in the same manner as described above, and transmits it to the main camera 100 as information for complementing the temporary position information.

When information indicating the distance between the sub camera 200 and the subject 20 is acquired by any of the above, the CPU 111 further determines the distance between the subject 20 and the main camera 100 and the subject 20 and the sub from the distance information. A difference in distance from the camera 200 (hereinafter referred to as “Δd” as appropriate) is detected. The CPU 111 generates a command signal for zoom compensation on the sub camera 200 side from the detected Ad so as to be equivalent to the main camera 100 in the standard state of the image composition in the sub camera 200. Send to sub camera 200. The value of Ad is temporarily stored in the RAM 113.

In the sub camera 200 that has received this command signal, the subject 20 is captured by varying the zoom distance and further focusing based on the command signal related to the lens driving unit 250 force. In this way, the standard state in the sub camera 200 is set. Note that a part of the processing related to step B11 is necessarily required when the composition on the sub camera 200 side is set in advance so as to capture the subject 20! In this case, in the process according to Step B10, information corresponding to true position information may be transmitted from the sub camera 200, and only zoom compensation in the sub camera 200 may be performed. Furthermore, such zoom compensation does not always have to be done! /.

[0106] When the main camera 100 and the sub camera 200 are set to the standard state, the CPU 111 of the main camera 100, based on the positional information of both stored in the RAMI 13, (Hereinafter referred to as “Δ 0” as appropriate) is acquired (step Β 12). Further, the acquired value of ΔΘ is temporarily stored in the RAMI 13.

Here, with reference to FIG. 5, details of ΔΘ and the above-mentioned Ad will be described. FIG. 5 is a schematic diagram showing the positional relationship between the subject 20, the main camera 100, and the sub camera 200. is there.

In FIG. 5, the distance between the main camera 100 and the subject 20 and the distance between the sub camera 200 and the subject 20 are represented as “(1 &)” and “(1 (31))”, respectively. . Therefore, Ad is defined as the absolute value of “d (main) —d (sub)”. In FIG. 5, the distance between each camera and the subject 20 is expressed with reference to the lens end surface of each camera. As long as the distance is defined based on a common standard between the camera 100 and the sub camera 200, the definition of the distance may be freely determined.

On the other hand, in FIG. 5, ΔΘ is the smaller of the angles formed by the line segment connecting the subject 20 and the main camera 100 and the line segment connecting the subject 20 and the sub camera 200. Refers to an angle.

Returning to FIG. 4, the CPU 113 determines whether the force is within the range of Δ 0 force “120 ° ≤Δ 0≤18≤ °” (hereinafter referred to as “first range” as appropriate) (step Β 13). If it is within the first range (step B13: YES), the CPUll controls the imaging unit 130 to perform imaging in the first imaging mode (step B14). The first shooting mode will be described later.

[0111] CPUlll determines whether or not the power of the video shooting in the first shooting mode is finished (step B15). If shooting has not ended (step B15: NO), CPUlll continues shooting in the first shooting mode, and when shooting ends (step B15: YES), the shooting process ends. Note that the end of shooting refers to, for example, a case where the user 100a gives an instruction to stop via the input unit 190 or a preset shooting time elapses, and the modes may vary! ,.

[0112] On the other hand, if ΔΘ is not within the first range (step B13: NO), CPUlll is

It is determined whether or not Θ is within a range of “45 ° <ΔΘ <120 °” (hereinafter referred to as “second range” as appropriate) (step B16). If it is within the second range (step B16: YES), the CPUll controls the imaging unit 130 to perform imaging in the second imaging mode (step B17). The second shooting mode will be described later.

[0113] CPUlll determines whether or not the power of the video shooting in the second shooting mode has ended (step B18). If shooting is not finished (step B18: NO), CPUlll The shooting in the shadow mode is continued, and when the shooting is finished (step B18: YES), the shooting process is finished.

[0114] If ΔΘ is not within the second range (step B16: NO), CPU 111

It is determined whether it is within the range of 0 force “Δ 0 ≤ 45 °” (hereinafter referred to as “third range” as appropriate) (step Β19). If it is within the third range (step B19: YES), the CPU 111 controls the imaging unit 130 to perform imaging in the third imaging mode (step B20). The third shooting mode will be described later.

[0115] CPU 111 determines whether or not the power of the video shooting in the third shooting mode has ended (step B21). If shooting has not ended (step B21: NO), the CPU 111 continues shooting in the third shooting mode, and when shooting ends (step B21: YES), the shooting process ends.

Here, details of each shooting mode will be described.

[0117] <First shooting mode>

When the angle between the main camera 100 and the sub camera 200 is within the first range, shooting in the first shooting mode is performed. The first range corresponds to the case where the main camera 100 and the sub camera 200 are relatively distant from each other in terms of angle. Examples of situations include shooting of track competitions at sporting events. The first shooting mode is performed, for example, by repeating the shooting routines (1) to (12) below.

[0118] That is, (1) Standard state → (2) Left and right pan (In-phase) → (3) Standard state → (4) Left and right pan (Reverse phase) → (5) Standard state → (6) Vertical tilt (In-phase) → (7) Vertical tilt (reverse phase) → (8) Standard state → (9) Zoom (in phase) → (10) Standard state → (11) Zoom (reverse phase) → (12) Standard state

[0119] In (1), the "standard state" is the above-described standard state. In (2), the main camera 100 also pans this standard state force by the action of the camera rotation unit 140. In parallel with the panning of the main camera, the CPU 111 transmits a command signal to the sub camera 200 via the communication unit 160, and the sub camera 200 pans in phase in response to the command signal.

[0120] Here, "in-phase" means, for example, that the main camera 100 and the sub camera 200 are close in angle. The directions represented by “left” or “right” are equal to each other. However, if the two are separated from each other as in the first shooting mode, the main camera 100 is moved to the left when the two are facing each other (ΔΘ = 180 °). This means that the sub-camera 200 pans to the right, that is, both pan in the opposite direction. In other words, “panning in-phase” is a concept that refers to panning in a direction that captures the same subject, not an absolute panning direction.

[0121] When the sub camera 200 is panned in “in-phase” in this way, the CPU 111 of the main camera 100 moves the sub camera 200 left and right each time based on the relative positional relationship between the main camera 100 and the sub camera 200. It calculates how much to pan in which direction, generates a command signal based on the calculation result, and transmits it to the sub camera 200.

[0122] In (3), the main camera 100 and the sub camera 200 each return to the standard state. At this time, in the main camera 100, the CPU 111 controls the camera rotation unit 140, and in the sub camera 200, the command signal is generated by the CPU 111 of the main camera 100 and transmitted via the communication unit 160. In response to this, the CPU 211 controls the camera rotation unit 240 to return to the standard state described above. Since the return to the standard state is basically the same in the following description, the description is omitted as appropriate.

[0123] In (4)! /, The main camera 100 pans again. In this (4), the CPU / 11 generates and transmits a command signal for panning the sub camera 200 in reverse phase. With this command signal, the sub camera 200 pans in the opposite phase to the main camera 100. Here, “panning in reverse phase” is a concept opposite to the above-mentioned “in-phase” and refers to panning in a direction in which subjects are separated from each other.

[0124] After returning to the standard state again in (5), the main camera 100 is tilted in (6). Also in this case, the tilt is realized by the CPU 111 controlling the camera rotation unit 140. Further, the sub camera 200 is tilted in phase with the main camera 100 by the action of the camera rotation unit 240 in accordance with the transmitted command signal.

[0125] Here, "tilting in phase" is different from panning, and the direction represented by "up" or "down" is independent of the angle between the main camera 100 and the sub-power camera 200. Tilt to be equal to each other. [0126] In (7), the main camera 100 and the sub camera 200 are tilted in opposite phases to each other. Here, “tilt in reverse phase” refers to tilting so that the directions represented by “up” and “down” are different from each other.

[0127] In (8), and after the main camera 100 and the sub camera 200 are restored to the standard state, in (9), the main camera 100 performs zoom photography of the subject 20. At this time, the CPU 111 controls the lens driving unit 150 to adjust the zoom magnification and focus. At the same time, the CPU 111 generates a command signal for causing the sub camera 200 to perform zoom shooting in the same phase and transmits the command signal to the sub camera 200 via the communication unit 160, and the CPU 211 of the sub power camera 200 responds to the command signal. The lens driving unit 250 is controlled to execute in-phase zoom shooting.

Here, “in-phase” zoom photography means that the zoom directions represented by “telephoto (zoom in)” and “wide angle (zoom out)” are mutually different between the main camera 100 and the sub camera 200. It is a concept that points to equality. That is, when the main camera 100 performs telephoto shooting of the subject 20, the same telephoto shooting is used, and when the main camera 100 performs wide-angle shooting, the same wide-angle shooting is performed.

[0129] After returning to the standard state again in (10), in (11), the main camera 100 and the sub camera 200 perform zoom photography of the subject 20 in mutually opposite phases. Here, “photographing in reverse phase” means that, for example, if the main camera 100 captures a subject on the telephoto side, the sub camera 200 captures a subject on the wide-angle side. Then (12) again, the main camera 100 and the sub camera 200 are restored to the standard state. In this way, in the first shooting mode, shooting is performed mainly centering on pan and tilt.

[0130] <Second shooting mode>

When the angle between the main camera 100 and the sub camera 200 is within the second range, shooting in the second shooting mode is performed. The second range corresponds to the case where the main camera 100 and the sub camera 200 are in a standard positional relationship in terms of angle, and does not have a particularly characteristic situation. For example, the following (1) to (1) This is done by repeating the shooting routine up to (14).

[0131] That is, (1) Standard state → (2) Left and right pan (In-phase) → (3) Standard state → (4) Left and right pan (Reverse phase) → (5) Standard state → (6) Zoom (In-phase) → (7) Zoom (reverse phase) → (8) Standard condition → (9) Up and down Tilt (in-phase) → (10) Vertical tilt (reverse phase) → (11) Zoom (in-phase) → (12) Standard state → (13) Zoom (reverse phase) → (14) Standard state.

Note that the individual shooting states (pan, tilt, zoom, and the like) are the same as those in the first shooting pattern described above, and thus the description thereof is omitted. In the second shooting pattern, unlike the first shooting pattern, shooting in which pan and tilt and zoom operations such as zoom in and out are mixed on average is executed.

[0133] <Third shooting mode>

When the angle between the main camera 100 and the sub camera 200 is within the third range, shooting in the third shooting mode is performed. The third range corresponds to the case where the main camera 100 and the sub camera 200 are relatively close to each other in terms of angle. Examples of situations include indoor presentations such as pianos and plays. Is mentioned. The third shooting mode is performed, for example, by repeating the shooting routines (1) to (12) below.

[0134] That is, (1) Standard state → (2) Left and right pan (In-phase) → (3) Standard state → (4) Left and right pan (Reverse phase) → (5) Standard state → (6) Zoom (In-phase) → (7) Zoom (reverse phase) → (8) Standard state → (9) Zoom (in phase) → (10) Standard state → (11) Zoom (reverse phase) → (12) Standard state.

Note that the individual shooting states (pan, tilt, zoom, and the like) are the same as those in the first shooting pattern described above, and thus the description thereof is omitted. In the third shooting pattern, unlike the first and second shooting patterns, shooting is performed mainly focusing on zoom operations such as zooming in and out.

[0136] In this embodiment, at each stage of video shooting in the first to third shooting modes described above, shooting based on the video grammar may be performed. In this case, the CPU 111 and the CPU 211 may control each part of the main camera 100 and the sub camera 200 so that such shooting is performed.

[0137] Here, "video grammar" refers to a universal law that exists between video material, video effects, and concepts to be expressed. For example, if the concept to be expressed as video material has been decided, the video effect that is required to some extent is specified. Alternatively, if the video material and video effects are determined, the intention of the photographer represented by the video can be conveyed to the viewer with a certain degree of accuracy. For general users who are not accustomed to shooting video, Since there are many cases where there is no known image grammar, it is possible to improve the quality of the image easily when shooting based on such image grammar is performed.

[0138] Here, shooting conforming to the video grammar means that, for example, in situations where there is a relatively large amount of movement of the subject such as an athletic meet, the speed in zoom operations such as panning and tilting, zooming in and out, etc. can be increased or cut off. This refers to shooting lively images by switching frequently. Also, in situations where there is relatively little movement of the subject, such as music recitals, the panning, tilting, and zooming speeds are slowed down, and the subject's up-video is shot with various angular forces. For example, taking high-quality images. Such a shooting algorithm that complies with the video grammar may be reflected in the video to be shot by being adopted in a video shooting program stored in the ROM 112 and the ROM 212, for example.

[0139] In each of the first, second, and third shooting modes described above, in addition to the shooting routines described above, in order to take a picture of a situation at a location relatively distant from the subject, An imaging routine that pans at least one camera force, for example, 180 degrees or more, may be provided as appropriate. For example, using such a shooting routine, at a sports day, a competition, a concert, or a presentation! Look at the subject (competitor, performer, etc.) at the bleachers! It is also possible to take pictures of parents' expressions easily. In this case, it is also possible to add a sense of reality, drama, V, and other elements to the video.

Next, with reference to FIG. 6, a recording process for recording the video shot in such a shooting process will be described. FIG. 6 is a flowchart of the recording process. In the present embodiment, the recording process is performed in parallel with the photographing process. 6 is a recording process executed in the main camera 100, and the processing on the sub camera 200 side is the same as that of the main camera 100, and thus the description thereof is omitted.

In FIG. 6, first, the CPU 111 determines whether or not one video frame (hereinafter, “one frame”) has elapsed based on a clock signal or the like (step C10). Here, the “video frame” is a minimum unit of video, and corresponds to “one frame” in a video, for example. [0141] If one frame has not yet passed (step C10: NO), the CPU 111 waits until one frame has passed, and if one frame has passed (step CIO: YES), the video data processing (step C 11), audio data processing (step C 12), and additional information processing (step C 13) are executed in parallel.

[0142] Here, each of these processes will be described with reference to Figs. FIG. 7 is a flowchart of video data processing, FIG. 8 is a flowchart of audio data processing, and FIG. 9 is a flowchart of additional information processing.

[0143] In FIG. 7, video data sampling and digital input are first performed (step Clll). The digitized video data is encoded and temporarily stored in RAMI 13 (step C 112). When the video data is stored in the RAMI 13, the video data processing ends.

[0144] In FIG. 8, audio data sampling and digital input are first performed (step C121). The digitized audio data is encoded and temporarily stored in the RAMI 13 (step C122). When the audio data is stored in the RAMI 13, the audio data processing ends.

In FIG. 9, first, distance information, azimuth information, position information, zoom distance information, pan angle information, tilt angle information, and speed information in pan, tilt, and zoom, etc. Obtained (step C131). The acquired attached calorie information is stored in the RAM 113 (step C132). When the additional information is stored in the RAMI 13, the additional information processing ends.

Returning to FIG. 6, the video data and audio data stored in the RAMI 13 are multiplexed (step C14) and stored in the RAMI 13 together with additional information.

[0147] CPU 111 determines whether or not these data stored in RAM 113 are stored in 1 GOP (step C15). Here, 1GOP is a video unit composed of video data, audio data and additional information of about 1 to 15 frames.

[0148] When data for 1 GOP is not stored (step C15: NO), the CPU 111 returns the process to step C10, and executes the processing of video data, audio data, and additional information of the next video frame. On the other hand, if 1GOP of data is stored in RAMI 13, (C15: YES), the CPU 111 controls the recording unit 180 to record these data (step C16).

Here, the recording format according to the present embodiment will be described with reference to FIG. 10 and FIG. Here, FIG. 10 is a schematic diagram of a recording format, and FIG. 11 is a schematic diagram of a header and additional information in the recording format.

[0150] In FIG. 10, a video stream composed of continuous still images has a configuration in which data is sequentially arranged in GOP units. One GOP is header, video Z audio data

And additional information power.

[0151] FIG. 11 (a) shows the state of the header. The header includes the number of frames included in the GOP, the GOP number, the address on the recording medium of the video Z audio data, the video

It consists of the size of the Z audio data, the address of the additional information on the recording medium, and the size of the additional information.

[0152] Fig. 11 (b) shows the state of the additional information. Additional information includes information such as distance, direction, position, zoom size, pan direction and angle, and tilt direction and angle.

Returning to FIG. 6, when the recording of the video for 1 GOP is completed, the CPU 111 determines whether there is a video to be recorded (step C17). If there is still an image to be recorded (step C17: NO), the CPU 111 returns the process to step C10 again, and processes the video data, audio data, and additional information relating to the next video frame. If there is no more video to record (step C17: YES), the recording process ends.

[0154] As described above, in the video imaging system 10 according to the present embodiment, the main camera 100 and the sub camera 200 are interlocked with each other, and the subject 20 is effectively captured based on the mutual positional relationship. Is possible. Therefore, it is possible to shoot extremely high quality images.

[0155] In the present embodiment, the sub camera 200 is configured to operate by transmitting a command signal for controlling the sub camera 200 in the main camera 100 side force. How the CPU 211 of the camera 200 should move according to the position information transmitted from the main camera 100, or according to the pan / tilt operation amount or zoom operation amount of the main camera 100, etc. You may decide. [0156] In the present embodiment, the current position, the shooting direction, and the force configured to be able to acquire the distance to the subject. For example, in a room or the like, the position search signal such as GPS does not reach the current position. In some cases, the position cannot be specified. Even in such a case, if the consensus of photographing the subject 20 is obtained in advance between the main camera 100 and the sub camera 200, no problem will arise!

[0157] Also, each means for obtaining the position information is not necessarily required! For example, when the above-mentioned consensus is obtained, as long as the sub camera 200 can operate based on a command signal from the main camera 100 or a signal conveying the operation of the main camera 100, etc. The effects of the present invention can be enjoyed unchanged.

[0158] In the present embodiment, both forces of the main camera 100 and the sub camera 200 are described to operate in the full mode. For example, the main camera 100 is actively operated by the user 100a, and the video is displayed. It may be taken. Also in this case, the sub camera 200 can operate following the operation of the main camera 100.

[0159] <Modification>

The manner in which the sub camera 200 follows the main camera 100 is not limited to the above-described embodiment. For example, it is possible to adopt an embodiment as shown in FIG. FIG. 12 is a schematic diagram of the follow-up control according to the modified example of the present invention. In the following description, the same parts as those in the above-described embodiment are denoted by the same reference numerals and the description thereof is omitted.

[0160] In FIG. 12, the sub camera 200 includes a display unit 300, and the composition of the video currently being shot is displayed on the display screen. Here, for example, when the main camera 100 pans 30 ° to the left, the CPU 211 reads “Left” on the display screen based on a command signal from the main camera 100 or based on a control signal that conveys the operation of the main camera 100. The display unit 300 is controlled to display the message, “Pan 30 °! /,”.

[0161] By prompting the main camera 100 to follow such a message, if the user operating the sub-power camera 200 voluntarily pans the sub-camera 200, the tracking operation equivalent to the embodiment is easy. Can be realized. In many cases, the photographing device is used in a hand-held state rather than being fixed to a tripod. In such a situation, it is difficult to pan or tilt the sub camera 200 even if the camera rotation unit 240 is controlled. Therefore, this modification is very effective. In addition, when a portable terminal such as a mobile phone is equipped with a video camera system, it is also very effective because it is difficult to fix it to a tripod.

[0162] The present invention is not limited to the above-described embodiments, and the entire specification can be modified as appropriate without departing from the gist or philosophy of the invention that can be read. The system, the video imaging device, and the video imaging method are also included in the technical scope of the present invention.

Industrial applicability

[0163] The video shooting system, the video shooting device, and the video shooting method according to the present invention can be used for, for example, a video shooting system, a video shooting device, and a video shooting method capable of obtaining a high-quality video. .

Claims

The scope of the claims

[1] including at least one primary imaging device and at least one secondary imaging device, which are accommodated in a network and for capturing images,

The main photographing device is:

A first photographing means for photographing the video;

First control means for controlling shooting conditions of the video in the first shooting means; and for causing the sub-shooting apparatus to follow in accordance with a condition defining a composition of the shot video among the shooting conditions. Control information generating means for generating control information; and first communication means for transmitting the generated control information to the sub-shooting device via the network.

Comprising

The auxiliary photographing device is

A second photographing means for photographing the video;

Second communication means for receiving the transmitted control information via the network; and second control means for controlling the imaging condition of the video in the second imaging means based on the received control information! Control means and

A video shooting system comprising:

[2] At least one of the first and second control means controls a shooting condition corresponding to the at least one based on a preset shooting pattern

The video imaging system according to claim 1, wherein:

[3] At least one of the first and second control means has a photographing pattern corresponding to a relative positional relationship between the main photographing device and the sub photographing device as the preset photographing pattern. To control the shooting conditions based on

The video imaging system according to claim 2, wherein:

[4] The main photographing device includes first position information including at least one of (a distance to a subject, (ii) a current position of the main photographing device, and (iii) a photographing direction of the first photographing unit). A first acquisition means for acquiring

The video imaging system according to claim 1, wherein:

[5] The sub-photographing device includes second position information including at least one of (distance to a subject, (ii) a current position of the sub-photographing device, and (iii) a photographing direction of the second photographing unit). A second acquisition means for acquiring

The video imaging system according to claim 4, wherein:

[6] The first communication means further transmits the acquired first position information to the auxiliary photographing device via the network,

The second communication means further receives the transmitted first position information;

The second control means controls the photographing condition based on the acquired second position information and the received first position information.

The video imaging system according to claim 5, wherein:

[7] The second communication means transmits the acquired second position information to the main photographing device via the network,

The first communication means receives the transmitted second position information;

The first control means controls the imaging condition based on the acquired first position information and the received second position information.

The video imaging system according to claim 5, wherein:

[8] The main and sub-photographing devices further include authentication means for performing mutual authentication via the first and second communication means, respectively.

The video imaging system according to claim 1, wherein:

[9] The at least one of the main and sub imaging devices further includes audio information acquisition means for acquiring audio information corresponding to the video imaged by at least one of the main and sub imaging devices. The video imaging system according to item.

[10] A video imaging device that is accommodated in a network and shoots video together with other video imaging devices accommodated in the network,

Photographing means for photographing the video;

Control means for controlling shooting conditions of the video in the shooting means;

Control information generating means for generating control information for causing the other video imaging apparatus to follow in accordance with a condition defining the composition of the video to be captured among the imaging conditions; Communication means for transmitting the generated control information to the other video imaging device via the network;

A video photographing apparatus comprising:

[11] A video imaging device that is accommodated in a network and shoots video together with other video imaging devices accommodated in the network,

Photographing means for photographing the video;

A communication means for receiving, via the network, control information generated according to a condition defining a composition of the video to be shot and transmitted via the network in the other video photographing device;

Based on the received control information! /, Control means for controlling the imaging conditions of the video in the imaging means;

A video photographing apparatus comprising:

[12] In a video shooting system that is housed in a network and includes at least one main shooting device and at least one sub-shooting device for shooting a video, A video shooting method,

In the main photographing device, (i) a first photographing step for photographing the video, (ii) a first control step for controlling photographing conditions of the video in the first photographing step, and (iii) the photographing conditions A control information generating step for generating control information for following the sub-photographing device in accordance with conditions defining the composition of the captured video; and (iv) the network for the sub-photographing device. A transmission step of transmitting the generated control information via the network, (i) a second imaging step of photographing the video, and (ii) the transmitted control information via the network. And (iii) a second control step of controlling shooting conditions of the video in the second shooting step based on the received control information;

A video shooting method comprising: