KR102213073B1 - Multi channel photographing system based on an imgae and controlling method - Google Patents

Abstract

According to an embodiment of the present invention, provided are an image-based multi-viewpoint imaging system and a control method thereof, capable of easily controlling the multi-view camera when moving a space according to the passage of time. The image-based multi-viewpoint imaging system includes: a main camera with position and point of view through which an entire scene is photographed; and a camera controller which controls the main camera and a plurality of sub-cameras to photograph the subject for a predetermined time, and transmits the images photographed by the respective cameras through a communication network.

Description

Multi channel photographing system based on an imgae and controlling method}

Embodiments relate to an image-based multi-view photographing system and a control method thereof.

Recently, the public prefers to play videos using mobile devices. In line with this preference, companies are offering broadcasting platforms such as V-app, AfreecaTV, and Youtube Live. The public watching these platforms are watching videos taken from one viewpoint, that is, one camera. However, recent viewers want to watch the video shot in the desired space.

Currently, a video service that provides a multi-view image to a user by geometrically correcting and synthesizing a plurality of images acquired by photographing a single subject in various channels with a plurality of cameras has been disclosed. These multi-view images provide realistic images that go beyond the concept of high-definition, and through this, users feel more immersed in the media and can greatly enhance the effect of delivering image information in fields such as advertising, education, medical care, defense, and entertainment. have.

In the conventional multi-view image, channel/time switching is a dimension that is simply reproduced in a predetermined merge method when producing a multi-view image. That is, in the related art, a plurality of frames are acquired from a plurality of cameras, some of the acquired frames are selected, and these frames are merged to produce a single channel switching image. Since such a channel-switched video is a simple merge of the frames of a channel previously determined by the producer during video production, when the video file is played back, the merged frames exert a channel switching effect showing a single channel shift effect. According to such a multi-view video of the prior art, the user was merely watching the pre-made channel switching effect, and the viewer manually manipulated the visual switching or channel switching to watch the video while turning the channel to the desired point of time. It was impossible to do. In addition, a multi-view or camera synchronization technique, and an image correction and transmission method are required to capture an image in various spaces.

An object of the embodiments is to provide an image-based multi-view photographing system and a control method thereof.

An image-based multi-view photographing system according to an embodiment, comprising: a main camera and a plurality of sub cameras capable of driving a 3-axis gimbal; And a camera controller configured to control a subject to be photographed for a predetermined time through the main camera and a plurality of sub cameras, and to transmit images photographed by the respective cameras through a communication network,

When a predetermined subject is selected from the image captured by the main camera, the camera controller calculates location information of an image corresponding to the selected subject, and provides the calculated location information to the plurality of sub cameras. It features.

The plurality of sub-cameras calculate a driving amount of each motor of a 3-axis gimbal motor required to move the viewpoint with the position information at the viewpoints of each sub-camera according to the position information provided from the camera control unit, and the calculation It is characterized in that the motor is driven according to the determined driving amount.

The image-based multi-view photographing system groups and stores images transmitted from the camera control unit according to at least one criterion of time, channel, time, and channel, and stores the grouped images according to a request of a user terminal. It characterized in that it further comprises an image server transmitted through.

The camera control unit calculates the position information of the image corresponding to the selected subject, and at the viewpoints of each of the sub cameras, calculates the driving amount of each motor of the 3-axis gimbal motor required to move the viewpoint to the position information And providing the calculated motor driving amount to each of the sub cameras.

An image-based multi-view photographing system according to another embodiment, comprising: a main camera and a plurality of sub cameras capable of driving a 3-axis gimbal; The main camera and a plurality of sub-cameras control to shoot a subject for a predetermined time, and when a predetermined subject is selected from an image captured by the main camera, location information of an image corresponding to the selected subject is calculated, and the A camera controller that provides the calculated location information to the plurality of sub-cameras and transmits images captured by each of the cameras through a communication network; And an image server for grouping and storing the images transmitted from the camera control unit based on at least one of a mixture of time, channel, time and channel.

In the control method of an image-based multi-view photographing system according to another embodiment, the image-based multi-view photographing system includes: a main camera and a plurality of sub cameras capable of driving a 3-axis gimbal; And a camera controller configured to control a subject to be photographed for a predetermined time through the main camera and a plurality of sub-cameras, and to transmit images photographed by each of the cameras through a communication network. Selecting a subject of the; Calculating location information of an image corresponding to the selected subject; And providing the calculated location information to the plurality of sub cameras.

The plurality of sub-cameras calculate a driving amount of each motor of a 3-axis gimbal motor required to move the viewpoint with the position information at the viewpoints of each sub-camera according to the position information provided from the camera control unit, and the calculation It is characterized in that the motor is driven according to the determined driving amount.

In the control method of the image-based multi-view photographing system, the transmitted images are grouped and stored according to at least one criterion of time, channel, time and channel, and the grouped image is stored in the communication network according to a request of a user terminal. It characterized in that it further comprises the step of transmitting through.

In the control method of the image-based multi-view photographing system, each of the three-axis gimbal motors required to calculate the position information of the image corresponding to the selected subject and move the viewpoint to the position information from the viewpoints of each of the sub cameras The motor driving amount of is calculated, and the calculated motor driving amount is provided to each of the sub cameras.

It includes a recording medium recording a program for executing the method according to another embodiment on a computer.

The image-based multi-view photographing system and the control method thereof according to the embodiment can easily control the synchronization of viewpoints of the multi-view photographing cameras when moving in space over time.

In addition, it is possible to increase the convenience of data transmission of the multiview image and reduce the processing speed.

1 is a schematic diagram of an image-based multi-view photographing system 100 according to an exemplary embodiment.
2 is an exemplary diagram for generating a multiview image.
3 is a schematic diagram of a gimbal device 300 capable of driving a 3-axis gimbal according to an exemplary embodiment.
4 is a schematic diagram of a control module of the gimbal device 300 shown in FIG. 3.
5 and 6 are diagrams for describing a photographing scene of a main camera 510 and a plurality of sub cameras 511 to 513 according to an exemplary embodiment.
7 and 8 are exemplary diagrams for explaining a method of controlling an image-based multi-view photographing system according to an exemplary embodiment.
9 is a flowchart illustrating a method of controlling an image-based multi-view photographing system according to an exemplary embodiment.

The terms used in the embodiments have been selected as currently widely used general terms as possible while considering functions in the embodiments, but this may vary depending on the intention or precedent of a technician working in the art, the emergence of new technologies, etc. . In addition, in certain cases, there are terms that are arbitrarily selected, and in this case, the meaning will be described in detail in the description of the corresponding embodiment. Therefore, the terms used in the present embodiments should be defined based on the meaning of the term and the contents of the present embodiments, not a simple name of the term.

In the description of the embodiments, when a certain part is connected to another part, this includes not only a case in which it is directly connected, but also a case in which it is electrically connected with another component interposed therebetween. In addition, when a certain part includes a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary. In addition, the term "... unit" described in the embodiments means a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software.

Terms such as “consisting of” or “comprising” used in the present embodiments should not be construed as necessarily including all of the various constituent elements or various steps described in the specification, and some constituent elements or some of them It should be construed that the steps may not be included, or may further include additional components or steps.

The description of the following embodiments should not be construed as limiting the scope of the rights, and what those skilled in the art can easily infer should be construed as belonging to the scope of the rights of the embodiments. Hereinafter, embodiments for illustration only will be described in detail with reference to the accompanying drawings.

1 is a schematic diagram of an image-based multi-view photographing system 100 according to an exemplary embodiment.

Referring to FIG. 1, the multi-view photographing system 100 controls a plurality of cameras 111 to 113 and a plurality of cameras 111 to 113, and captures multi-view images captured from the plurality of cameras 111 to 113. It includes a camera controller 110 that processes and transmits, and an image server 200 that processes and stores multiview images transmitted from the camera controller 110. The image server 200 receives a request for a multiview image, a request for a switching image, and a request for a specific event from the user terminal 150, and transmits the stored multiview image to the user terminal 150.

The multi-view photographing system 100 according to the embodiment controls to shoot a subject for a predetermined time through a main camera and a plurality of sub cameras capable of driving a 3-axis gimbal, a main camera and a plurality of sub cameras, and When a predetermined subject is selected from an image, the position information of the image corresponding to the selected subject is calculated, the calculated position information is provided to a plurality of sub cameras, and images captured by each of the cameras are transmitted through a communication network. do. In addition, the transmitted images are grouped and stored according to at least one criterion in which time, channel, time and channel are mixed.

As shown in FIG. 5, the multi-view photographing system 100 includes a plurality of sub cameras 511 to 513 for photographing a sports event, and a main camera 510 for photographing an entire game scene. Here, the plurality of sub-cameras 511 to 513 may be arranged to capture a game scene from all angles, for example, 360 degrees, as shown in FIG. 2. In addition, as shown in FIG. 3, a gimbal device capable of driving a 3-axis gimbal may be coupled to the plurality of sub cameras 511 to 513. The main camera 510 may have a position and a viewpoint for photographing an entire game scene, and each of the sub cameras 511 to 513 may have a specific viewpoint at a feature position.

Referring to FIG. 6, a viewpoint of the main camera 610, a viewpoint of the sub camera 611, and a viewpoint of another sub camera 612 are illustrated. That is, the main camera 610 photographs the entire game scene, and each of the sub cameras 611 and 612 may photograph a specific area or subject at the fixed position. Here, it goes without saying that the main camera or the plurality of sub cameras is not limited to the number and position of each, and may be variously configured. The image server 200 may include an image processing device 130 and an image storage unit 140.

As shown in FIG. 2, a plurality of cameras 1 to N may be disposed to photograph a specific subject. A plurality of cameras arranged in an array around the subject receive a plurality of images photographing the subject from various angles. A method of arranging a plurality of cameras may be, for example, arranging N cameras in a line on substantially the same plane based on an arbitrary camera. In this case, N cameras may be sequentially placed on a circumference spaced a certain distance from the subject, or the distance between the two cameras disposed on both sides and the subject is matched based on the camera disposed in the center, and the remaining cameras It is also possible to make the distance to the subject different. Also, the subject may be a fixed subject or a moving subject.

The plurality of cameras 1 to N and the camera control unit 110 may communicate with each other by wire or wirelessly, and may include a plurality of camera control units for controlling the plurality of cameras 1 to N.

The camera controller 110 may control the plurality of cameras 1 to N through a synchronization signal that synchronizes the plurality of cameras 1 to N. The camera control unit 110 temporarily stores images captured from a plurality of cameras 1 to N, and reduces the size of the captured image through codec change and enables fast transmission.

The camera control unit 110 may include a camera driving control unit, an image conversion unit, and a transmission unit. In an embodiment, the camera controller 110 controls a subject to be photographed for a predetermined time through a main camera and a plurality of sub cameras, and when a predetermined subject is selected from an image captured by the main camera, an image corresponding to the selected subject The location information of is calculated, the calculated location information is provided to the plurality of sub-cameras, and images captured by each of the cameras are transmitted through a communication network.

The camera driving control unit controls camera synchronization and shooting. The image conversion unit reduces the size of the images by changing the codec so that images generated from the plurality of cameras 1 to N can be quickly transmitted through the communication network 120. In addition, it is possible to determine a data transmission method suitable for the shooting site or for wired or wireless transmission. The transmission unit transmits the converted images to the image server 200 through the communication network 120.

The image server 200 groups and stores the multi-view images transmitted from the camera control unit 110 by time, channel, time, and at least one of a combination of channels, and stores the grouping stored at the request of the user terminal 150 The video is transmitted through the communication network.

3 illustrates an example of using a gimbal device according to various embodiments of the present disclosure. Referring to FIG. 3, a gimbal device 300 according to various embodiments of the present disclosure includes a gimbal part 310, a fixed support part 320, and a joint part rotatably connecting the gimbal part 310 and the fixed support part 320. It may include (330).

The gimbal part 310 may include a mounting part 311, a plurality of motors 312a, 312b, 312c, and an angular velocity sensor 313. The mounting part 311 may be configured to mount a camera including an image capturing device (eg, a camera module). The mounting part 311 may have any suitable shape in which the camera can be detachably mounted. For example, the mounting portion 311 may include side arms configured to surround and fix both sides of the camera. An angular velocity sensor 313 may be disposed in one area of the mounting part 311. The angular velocity sensor 313 may include a 6-axis sensor or the like. The angular velocity sensor 313 determines the amount of rotational movement of the camera mounted on the mounting part 311 and the mounting part 311, for example, the amount of rotational movement in the direction of the pitch, roll, and yaw axis. It can be configured to detect.

The plurality of motors 312a, 312b, 312c are connected to the mounting part 311, and the mounting part 311 and other electronic devices 340 mounted on the mounting part 311 are pitched and rolled. ) It can provide a driving force to rotate in the yaw axis. In one embodiment, the mounting part 311 may be rotated on a pitch axis using the first motor 312a, and may be rotated on a roll axis using the second motor 312b. In addition, it can rotate in the yaw axis using the third motor 312c. The plurality of motors 312a, 312b, 312c may be arranged in a range that does not interfere with each other during rotation. For example, the first motor 312a is fixedly coupled to one end of the mounting part 311 and may be connected to the second motor 312b by a connecting member. The second motor 312b may also be connected to the third motor 313b through a connection member. Each of the connecting members physically connects the plurality of motors 312a, 312b, 312c, but can electrically connect the plurality of motors 312a, 312b, 312c by embedding a wire or the like or supply current from the battery. have.

The fixed support part 320 may be fixedly coupled to the gimbal part 310. A user of the gimbal device 300 may hold the fixed support part 320 and take an image using a camera mounted on the mounting part 311. The fixed support part 320 may have any suitable shape so that the user of the gimbal device 300 can hold it with one hand. The gimbal device 300 according to various embodiments of the present disclosure uses the angular velocity sensor 313 to detect the amount of rotational movement of the camera due to the user's movement or hand shake, and a plurality of motors 312a, 312b, 312c By rotating the mounting unit 311 in the reverse direction in response to the detected amount of rotational movement by using and compensating for the detected amount of rotational movement, it is possible to provide an environment in which the camera can capture a clear image without shaking.

The joint part 330 may include a hinge structure such that the gimbal part 310 and the fixed support part 320 have various angles with each other. For example, the joint portion 330 may be configured such that the gimbal portion 310 and the fixed support portion 320 are substantially aligned in a state in which the joint portion 330 is not rotated. For another example, the joint portion 330 may be rotated by 90 degrees so that the gimbal portion 310 and the fixed support portion 320 may be configured to have a 90 degree angle between each other. For another example, the joint portion 330 may be configured to have a skewed angle of -90 degrees (or 270 degrees). That is, the gimbal device 300 according to various embodiments of the present disclosure provides various examples of image capture in which the gimbal part 310 has various angles with respect to the fixed support part 320 by rotation of the joint part 330. Thus, various shooting experiences can be provided to the user.

4 is a block diagram of a functional configuration of a gimbal device according to various embodiments of the present disclosure. The functional configuration disclosed in FIG. 4 may be included in the gimbal device 300 illustrated in FIG. 3.

Referring to FIG. 4, the gimbal device 300 may include a control unit 410, an operation unit 420, a sensor unit 430, a communication unit 440, and an operation unit 450.

The controller 410 may control the overall operation of the gimbal device 300. For example, the controller 410 may control at least one other component of the gimbal device 300. For another example, the control unit 410 may perform an operation related to the movement of the mounting unit 311 or process data of the gimbal device 300.

In addition, the controller 410 can control the rotation of the plurality of motors 422a, 422b, 422c using the position and attitude information of the gimbal device 300 and/or the position and attitude information of the mounting unit 311. have. The operation unit 420 may control the position and angle of the mounting unit 111 based on the control of the control unit 410. The operation unit 420 may include at least one motor and a motor drive. In various embodiments of the present disclosure, the gimbal device 300 may be a 3-axis gimbal device. The operation unit 420 of the 3-axis gimbal device may include three motors and motor drives respectively driving them. For example, a first motor driver 421a and a first motor 422a providing rotational force of a first axis, and a second motor driver 421a and a second motor driver providing rotational force of a second axis perpendicular to the first axis It may include a motor 422b, a third motor driver 421c and a third motor 422c that provide rotational force of a third axis perpendicular to the first and second axes, respectively. In one use example, the first axis may be a pitch, the second axis may be a roll, and the third axis may be a yaw axis. However, the embodiment is not limited thereto, and the gimbal device 300 may be a 2-axis gimbal device. The operation module of the two-axis gimbal device may include two motors and motor drives respectively driving them. In one use example, each motor and motor driver can provide the rotational force of the pitch and roll axis.

The sensor unit 430 may measure a physical quantity or detect an operation state of the gimbal device 300, and may convert the detected information into an electric signal. The sensor unit 430 may include a first angular velocity sensor capable of detecting the amount of rotational movement of the mounting unit 311 and a second angular velocity sensor capable of detecting a gripping state of the fixed support unit 320. In various embodiments, the joint portion 330 may be disposed to detect a rotation state or amount of rotation of the joint portion 330. A sensor having other various functions may be further included.

The control unit 410 according to various embodiments of the present disclosure may control the operation unit 420 to compensate for the amount of rotational movement of the mounting unit 311 detected using the sensor unit 430. The controller 410 may control the motor drivers 421a, 421b, and 421c to drive the plurality of motors 422a, 422b, 422c to rotate in the reverse direction of the detected amount of rotational movement.

The communication unit 440 may be a wireless communication module. The communication unit 440 may include a radio frequency (RF) module, a cellular module, a Wi-Fi module, a Bluetooth (BT) module, and/or a global positioning system (GPS) module. The communication unit 440 may enable the gimbal device 300 to transmit or receive signals with a camera. For example, the gimbal device 300 may transmit or receive a camera and a signal through a wireless local area network (WLAN) by interlocking a Wi-Fi module and an RF module. Alternatively, the gimbal device 300 may control transmission or reception of signals with a camera using a proximity direct communication service by interlocking the BT module with the RF module.

The manipulation unit 450 may receive various signals for operating the gimbal device 300. For example, the operation unit 450 may include various input means including a button method, a touch screen method, a joystick method, a jog key method, and a dial method. The control unit 410 may operate the gimbal device 300 in various operation modes based on various signals received from the operation unit 450. According to various embodiments, the operation mode is a general mode that maintains the balance of the mount part 311, a tracing mode that fixes the focus of the photographing device according to a specific subject, or the angle of the mount part 311 can be manually manipulated. It may include a manual control mode that can be used.

Each of the components described in the present disclosure may be composed of one or more components, and the name of the component may vary according to the type of electronic device. In various embodiments, the gimbal device (eg, the gimbal device 300) includes some components omitted, additional components are further included, or some of the components are combined to form a single entity, but prior to combining The functions of the corresponding components of can be performed in the same way. In addition, each of the components described in the present disclosure may be composed of one or more components, and the name of the corresponding component may vary according to the type of electronic device. In various embodiments, the electronic device may be configured to include at least one of the components described in this document, and some components may be omitted or additional other components may be further included. In addition, some of the components of the electronic device according to various embodiments of the present disclosure are combined to form a single entity, so that functions of the corresponding components before the combination may be performed in the same manner.

7 and 8 are exemplary diagrams for explaining a method of controlling an image-based multi-view photographing system according to an exemplary embodiment.

Referring to FIG. 7A, a specific subject or a subject region 700 of interest is selected from an image captured by the main camera. Here, the selection of a specific subject or the region of interest 700 may be selected by an operator or automatically performed on a user interface. For example, the main camera may be a broadcasting camera, and an operator may select a specific subject or a subject of interest region 700 according to a zoom-in or movement of a viewpoint of the broadcasting camera. In addition, a specific subject or a subject area of interest 700 may be selected by touching the subject area on the screen of the image captured or being captured by the operator.

Referring to FIG. 7B, when a specific subject or subject of interest region 700 is selected from the main camera, viewpoints of a plurality of sub cameras are also moved to the specific subject or subject of interest region 700.

When a specific subject or an area of interest 700 is selected from the main camera, the camera controller calculates location information of an image corresponding to the selected subject 700 and transmits the calculated location information to a plurality of sub cameras. Each of the sub cameras calculates the driving amount of the 3-axis gimbal motor required to move the viewpoint from the current viewpoint with the corresponding position information, and drives the motor to move the viewpoint. Here, it has been described that each sub-camera directly calculates the driving amount of the motor, but is not limited thereto, and the camera control unit calculates the motor driving amount of each sub-camera according to the position information of the selected subject, and substitutes the motor driving information. Of course, it can also be provided to the camera.

Referring to FIG. 8A, from an image captured by the main camera of the entire scene, a specific subject or a region of interest 800 is selected. Referring to FIG. 8B, when a specific subject or a subject of interest area 800 is selected from the main camera, the viewpoints of a plurality of sub cameras are also moved to the specific subject or subject of interest area 800.

9 is a flowchart illustrating a method of controlling an image-based multi-view photographing system according to an exemplary embodiment.

Referring to FIG. 9, in step 900, a subject of interest is selected from an image captured by the main camera.

In step 902, location information of the subject of interest is calculated.

In step 904, the calculated location information is transmitted to a plurality of sub cameras for generating a multiview image.

In step 906, based on the transmitted location information, a motor driving amount required for photographing an object of interest selected by each camera is calculated.

In step 908, the calculated motor drive amount is transmitted to each camera.

In step 910, the gimbal motor is driven according to the amount of motor drive transmitted from each camera.

An embodiment may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery medium.

The above description is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that it can be easily transformed into other specific forms without changing the technical spirit or essential features of the present invention. Therefore, it should be understood that the embodiments described above are illustrative and non-limiting in all respects. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

Claims (10)

In the image-based multi-view photographing system,
Main camera-The main camera has a position and a point of view for shooting the entire scene-and a plurality of sub cameras capable of driving a 3-axis gimbal-Each sub camera has a specific viewpoint at a fixed location -; And
And a camera control unit for controlling a subject to be photographed for a predetermined time through the main camera and a plurality of sub-cameras, and for transmitting images captured by each of the cameras through a communication network,
The camera control unit,
A predetermined subject is selected from the image captured by the main camera-The subject is selected by any one of zoom-in, point movement, and user selection in the main camera-If yes, the position of the image corresponding to the selected subject Calculate information, provide the calculated location information to the plurality of sub-cameras,
The plurality of sub cameras,
From the viewpoints of each of the sub cameras according to the position information provided from the camera control unit, the driving amount of each motor of the 3-axis gimbal motor required to move the viewpoint with the position information is calculated, and the motor is controlled according to the calculated driving amount. Image-based multi-view photographing system, characterized in that to drive. delete The method of claim 1,
An image server for grouping and storing images transmitted from the camera control unit based on at least one of a mixture of time, channel, time and channel, and transmitting the grouped image through the communication network according to a request of a user terminal. Image-based multi-view photographing system comprising a. The method of claim 1,
The camera control unit,
Calculate the position information of the image corresponding to the selected subject, at the viewpoints of each of the sub cameras, calculate the driving amount of each motor of the 3-axis gimbal motor required to move the viewpoint with the position information, and the calculated An image-based multi-view photographing system, characterized in that providing a motor driving amount to each of the sub cameras. In the image-based multi-view photographing system,
A plurality of sub cameras capable of driving a main camera and a 3-axis gimbal;
The main camera and a plurality of sub-cameras control a subject to be photographed for a predetermined time, and a predetermined subject is selected from an image captured by the main camera. The subject is selected among zoom-in, point movement, and user selection in the main camera. Made by any one-If yes, calculates the location information of the image corresponding to the selected subject, provides the calculated location information to the plurality of sub-cameras, and transfers the images taken by each of the cameras to a communication network A camera control unit that transmits through; And
An image server for grouping and storing images transmitted from the camera control unit based on at least one of a mixture of time, channel, time and channel,
The main camera has a position and a point of view in which the entire scene can be photographed, and each sub camera has a specific viewpoint at a fixed position,
The plurality of sub cameras,
From the viewpoints of each of the sub cameras according to the position information provided from the camera control unit, the driving amount of each motor of the 3-axis gimbal motor required to move the viewpoint with the position information is calculated, and the motor is controlled according to the calculated driving amount. Image-based multi-view photographing system, characterized in that to drive. In the control method of the image-based multi-view photographing system,
The image-based multi-view photographing system includes: a main camera and a plurality of sub cameras capable of driving a 3-axis gimbal; And a camera controller configured to control a subject to be photographed for a predetermined time through the main camera and a plurality of sub cameras, and to transmit images photographed by each of the cameras through a communication network,
Selecting a predetermined subject from the image captured by the main camera-selection of the subject is performed by any one of zoom-in, point movement, and user selection in the main camera;
Calculating location information of an image corresponding to the selected subject; And
And providing the calculated location information to the plurality of sub cameras,
The main camera has a position and a point of view in which the entire scene can be photographed, and each sub camera has a specific viewpoint at a fixed position,
The plurality of sub cameras,
From the viewpoints of each of the sub cameras according to the position information provided from the camera control unit, the driving amount of each motor of the 3-axis gimbal motor required to move the viewpoint with the position information is calculated, and the motor is controlled according to the calculated driving amount. A method of controlling an image-based multi-view photographing system, characterized in that driving. delete The method of claim 6,
Grouping and storing the transmitted images according to at least one criterion of a mixture of time, channel, time and channel, and transmitting the grouped image through the communication network according to a request of a user terminal. Control method of an image-based multi-view photographing system. The method of claim 6,
Calculate the position information of the image corresponding to the selected subject, at the viewpoints of each of the sub cameras, calculate the driving amount of each motor of the 3-axis gimbal motor required to move the viewpoint with the position information, and the calculated A method of controlling an image-based multi-view photographing system, comprising providing a motor driving amount to each of the sub cameras. A recording medium on which a program for executing the method according to any one of claims 6, 8 to 9 on a computer is recorded.

Images