KR102488180B1 - Multi-camera device - Google Patents

Abstract

The present invention relates to a multi-camera device comprising: a frame; a central camera placed on the upper surface of the frame; a first side-surface camera placed on the upper surface of the frame with a gap from the central camera; a first rotating device placed between the first side-surface camera and the frame and rotating the first side-surface camera in a lateral direction; a distance measuring device for measuring a distance from an object to be photographed; and a rotation control part for rotating the first rotating device so that the angle of view of the central camera cannot overlap with the angle of view of the first side-surface camera based on the distance measured by the distance measuring device. Therefore, photography can be performed with a maximal angle of view by preventing the angle of view of a plurality of cameras from overlapping with one another.

Description

Multi-camera device {MULTI-CAMERA DEVICE}

The present invention relates to a multi-camera device. More specifically, it relates to a multi-camera device capable of taking pictures with the maximum angle of view by controlling the angles of view of a plurality of cameras so that they do not overlap each other.

Services using metaverse technology, which blurs the boundary between the virtual world and the real world, are being actively introduced. Metaverse technology is based on virtual convergence technology (XR) that encompasses VR (Virtual Reality), AR (Augmented Reality), and MR (mixed Reality), data, network, artificial intelligence (D N A, Data, Network, By converging with AI) technology, it is possible to experience the virtual world beyond the real world.

In order to produce metaverse contents, it is necessary to express a seamless space. To do this, you need a wide-angle lens to shoot the real world. In addition, wide-angle shooting technology has been introduced for 360-degree around-view shooting for creating VR content or Internet maps, and its application is expanding to sports and concert sites that require panoramic shooting.

As a conventional wide-angle photographing technique, there is a method of photographing using a wide-angle lens. However, due to the nature of the lens, the wide-angle lens has a problem in that the central and outer angles are severely distorted, and when image processing is applied to eliminate the distortion, the image quality deteriorates.

In addition, when wide-angle photography is performed using a plurality of cameras, there is a problem in that the angles of view of the plurality of cameras overlap, and image processing must be separately applied to the captured image to compensate for this.

As a result, there has been a demand for a device and method for performing wide-angle photography using a plurality of cameras, which does not require a separate correction process, but there is a problem in that it cannot be provided according to the prior art, and the present invention addresses this problem. it is to solve

Registered Patent Publication No. 10-1283383 (Public date: 2013. 07. 08.)

A technical problem to be solved by the present invention is to capture an image having a maximum angle of view using a plurality of cameras.

In addition, a technical problem to be solved by the present invention is to provide a multi-camera device for adjusting the position of each camera so that the angles of view of a plurality of cameras do not overlap each other.

The objects of the present invention are not limited to the above-mentioned objects, and other objects and advantages of the present invention not mentioned above can be understood by the following description and will be more clearly understood by the examples of the present invention. It will also be readily apparent that the objects and advantages of the present invention may be realized by means of the instrumentalities and combinations indicated in the claims.

A multi-camera device according to an embodiment of the present invention for achieving the above technical problem includes a frame, a central camera located on the upper surface of the frame, a first side camera located on the upper surface of the frame spaced apart from the central camera, the A first rotating device located between the first side camera and the frame and rotating the first side camera in the left and right directions, a distance measuring device for measuring a distance to the shooting target, and a distance measured by the distance measuring device A rotation controller configured to rotate the first rotating device so that the angle of view of the central camera does not overlap with the angle of view of the first side camera.

According to an embodiment of the present invention, a second side camera positioned on an upper surface of the frame spaced apart from the central camera in a direction opposite to the first side camera, and positioned between the second side camera and the frame, Further comprising a second rotation device for rotating the second side camera in the left and right directions, wherein the rotation control unit determines that the angle of view of the central camera is the same as the angle of view of the second side camera based on the distance measured by the distance measuring device. The second rotating device may be rotated so as not to overlap each other.

According to an embodiment of the present invention, the rotation control unit may control the first side camera and the second side camera to rotate in opposite directions around the center camera.

According to an embodiment of the present invention, the rotation controller may control the first rotation device and the second rotation device so that rotation angles of the first side camera and the second side camera are the same.

According to an embodiment of the present invention, the central camera, the first side camera, and the second side camera are arranged on a straight line disposed in the same direction as the extension direction of the frame or on a curved line disposed on a plane of the frame. , may be arranged at predetermined intervals.

According to an embodiment of the present invention, the rotation control unit may determine the rotation angle ω of the camera of the first side camera based on the following <Equation>.

<mathematical expression>

Here, θ denotes the angle of view of the central camera and the first side camera, d denotes an arrangement interval between the central camera and the first side camera, and L denotes the angle of view measured by the distance measuring device. Indicates the distance from the subject to be photographed.

According to an embodiment of the present invention, the rotation control unit may use the distance to the photographing target measured by the distance measuring device and a preset angle of view of the central camera to capture the image of the photographing target by the central camera. A width is calculated, and the first rotation device may be rotated when the calculated width of the photographing target is greater than a disposition distance between the center camera and the first side camera.

According to an embodiment of the present invention, the angles of view of the central camera, the first side camera, and the second side camera may be the same.

According to an embodiment of the present invention, the distance measuring device may include any one of an ultrasonic sensor, an infrared sensor, a light detection and ranging (LIDAR) sensor, and a radio detecting and raging (radar) sensor.

According to the present invention, since the angles of view of a plurality of cameras do not overlap, there is an effect of enabling shooting with the maximum angle of view.

In addition, according to the present invention, since angles of view do not overlap in a plurality of cameras, there is an effect that image processing for removing redundantly photographed parts from captured images can be omitted.

In addition to the above description, specific effects of the present invention will be described together while explaining specific details for carrying out the present invention.

1 is a configuration diagram of a multi-camera device according to an embodiment of the present invention.
2 is a block diagram of a multi-camera device according to an embodiment of the present invention.
3 is a configuration diagram of a multi-camera device according to another embodiment of the present invention.
4 is a photographing state diagram before control of the angle of view according to an embodiment of the present invention.
5 is a photographing state diagram after controlling the angle of view according to an embodiment of the present invention.
6 is an explanatory view for explaining a mathematical formula for deriving a rotation angle ω according to an embodiment of the present invention.

Terms or words used in this specification and claims should not be construed as being limited to a general or dictionary meaning. According to the principle that an inventor may define a term or a concept of a word in order to best describe his/her invention, it should be interpreted as meaning and concept consistent with the technical spirit of the present invention. In addition, the embodiments described in this specification and the configurations shown in the drawings are only one embodiment in which the present invention is realized, and do not represent all of the technical spirit of the present invention, so they can be replaced at the time of the present application. It should be understood that there may be many equivalents and variations and applicable examples.

Terms such as first, second, A, and B used in this specification and claims may be used to describe various components, but the components should not be limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention. The term 'and/or' includes a combination of a plurality of related recited items or any one of a plurality of related recited items.

Terms used in this specification and claims are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. It should be understood that terms such as "include" or "having" in this application do not exclude in advance the possibility of existence or addition of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification. .

In the present specification and claims, when it is described that one component is "connected" to another component, it should be understood that it includes the case of being directly connected as well as the case of being connected through another component in the middle. Only when it is described as "connected" or "directly connected", it should be understood that one component and another component are connected without other components in the middle. Likewise, other expressions describing relationships between components should be understood in the same sense.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs.

Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in this application, it should not be interpreted in an ideal or excessively formal meaning. don't

In addition, each configuration, process, process or method included in each embodiment of the present invention may be shared within a range that does not contradict each other technically.

1 is a block diagram of a multi-camera device according to an embodiment of the present invention, and FIG. 2 is a block diagram of a multi-camera device according to an embodiment of the present invention.

Referring to Figures 1 and 2, the configuration of the multi-camera device 10 according to an embodiment of the present invention will be described.

The multi-camera device 10 includes a frame 100, a central camera 200, a distance measuring device 250, a first side camera 300, a first rotating device 350, a second side camera 400, 2 may include a rotation device 450, a rotation control unit 500, and an image acquisition unit 600.

First, the frame 100 may include a support on which each component of the multi-camera device 10 is disposed. The frame 100 may serve to support a plurality of cameras (eg, the central camera 200, the first side camera 300, and the second side camera 400) to stably capture a subject. there is.

For example, the frame 100 may include a flat plate, a beam support, or a stand cradle. Although the frame 100 is shown as a flat plate in Figure 1, this is only an example and the present invention is not limited thereto.

The central camera 200 and the first side camera 300 may be disposed on the frame 100 to face the same direction. Similarly, the second side camera 400 may be disposed on the frame 100 to face the same direction as the central camera 200 .

The central camera 200 , the first side camera 300 , and the second side camera 400 may be disposed in the frame 100 at regular intervals.

According to an embodiment of the present invention, the central camera 200, the first side camera 300, and the second side camera 400 may be camera devices having the same angle of view.

For example, the central camera 200, the first side camera 300, and the second side camera 400 may be disposed at intervals of 10 to 30 cm, and the angle of view may be 40 to 70 degrees. . Also, as an embodiment, the central camera 200, the first side camera 300, and the second side camera 400 may be cameras having the same performance, but the present invention is not limited thereto.

The first side camera 300 and the second side camera 400 may be disposed at equal intervals on left and right sides of the central camera 200 with the central camera 200 at the center. The central camera 200 , the first side camera 300 , and the second side camera 400 may be arranged at regular intervals on a virtual straight line or a virtual curved line.

However, the present invention is not limited thereto, and in another embodiment of the present invention, any one of the first side camera 300 or the second side camera 400 may be omitted and implemented. Also, in another embodiment of the present invention, the multi-camera device 10 may include three or more side cameras.

Even if the multi-camera device 10 according to an embodiment of the present invention includes a plurality of side cameras, the method for controlling the angle of view of each side camera 300 or 400 is substantially the same. That is, since the operating method of the first side camera 300 and the operating method of the second side camera 400 are substantially the same, the first side camera 300 will be described as an example for convenience of explanation.

The multi-camera device 10 can simultaneously take a wide-angle view using a plurality of cameras, and can be used for VR, panoramic photography, and the like. In the case of wide-angle shooting using a conventional single camera using a wide-angle lens, image distortion occurs in the center part and the outer part due to the limitation of the lens, and there is a problem of image quality deterioration when correcting this with software. The multi-camera device 10 includes a plurality of cameras using normal lenses, and by adjusting the position of each camera so that the angles of view of each camera do not overlap, high-quality wide-angle images without image distortion can be obtained. .

According to one embodiment of the present invention, the first rotating device 350 may be positioned between the frame 100 and the first side camera 300 . The first rotating device 350 may be disposed on the frame 100 and connected to the first side camera 300 . The first rotating device 350 may include a step motor or a brushless DC electric motor (BLDC). However, this is only one example, and the present invention is not limited thereto.

According to an embodiment of the present invention, the first rotating device 350 may rotate the first side camera 300 in the left and right directions. However, this is only one example, and the present invention is not limited thereto.

The first rotation device 350 may receive a rotation signal including a rotation angle ω from the rotation control unit 500. The first rotation device 350 may receive a rotation angle ω included in the received rotation signal. ), the first side camera 300 may be rotated.

According to an embodiment of the present invention, the distance measuring device 250 may measure the distance between the shooting target and the central camera 200 . The distance measuring device 250 may include at least one of an ultrasonic sensor, an infrared sensor, a light detection and ranging (LIDAR) sensor, and a radio detecting and raging (radar) sensor. However, this is only one example, and the present invention is not limited thereto.

According to an embodiment of the present invention, the distance measuring device 250 is disposed on the central camera 200 and can measure the distance in the same direction as the photographing direction of the central camera 200 . Since the distance measuring device 250 should measure the distance to a point closest to the center of the angle of view of the central camera 200 as much as possible, it may be placed in close contact with the central camera 200 .

For example, the distance measuring device 250 may be disposed on top of the central camera 200 or disposed on one side of the central camera 200 . According to another embodiment of the present invention, the distance measuring device 250 may be disposed below or on the side of the central camera 200 .

Based on the distance measured by the distance measuring device 250, the rotation control unit 500 controls the rotation angle of the first side camera 300 required so that the angles of view of the central camera 200 and the first side camera 300 do not overlap ( ω) may be derived, and a rotation signal including the derived rotation angle ω may be transmitted to the first rotating device 350 .

The process of deriving the rotation angle ω by the rotation controller 500 will be described in detail with reference to FIGS. 4 to 6 .

According to an embodiment of the present invention, the image acquisition unit 600 may derive a wide-angle image by receiving image signals output from the central camera 200 and the first side camera 300 and synthesizing them into one image. there is. At this time, the image acquisition unit 600 may generate one panoramic image using a plurality of images output from the central camera 200 and the first side camera 300 .

According to one embodiment of the present invention, the second rotation device 450 is located between the second side camera 400 and the frame 100, and the second rotation device 450 receives a rotation signal from the rotation control unit 500. can be passed and operated. For example, the second rotating device 450 may operate symmetrically with respect to the first rotating device 350 and the central camera 200 . That is, the rotation angle ω of the second rotation device 450 is the same as the rotation angle ω of the first rotation device 350, but the rotation directions may be different. Through this, the first side camera 300 and the second side camera 400 may be rotated so as to be away from each other at the same angle around the central camera 200 .

Since the operating method of the second rotating device 450 is substantially the same as that of the first rotating device 350, duplicate descriptions will be omitted and the operation of the first rotating device 350 will be described as an example.

3 is a configuration diagram of a multi-camera device according to another embodiment of the present invention.

Referring to FIG. 3 , in the multi-camera device 20 according to another embodiment of the present invention, a plurality of cameras may be disposed on an imaginary curve 25.

When the plurality of cameras are disposed on the imaginary curve 25, a slightly wider panoramic image can be obtained than when the plurality of cameras are disposed on the imaginary straight line. At this time, the imaginary curve 25 may be disposed on the plane of the frame 100 and may be formed with the same curvature.

In addition, the imaginary curve 25 may be arranged symmetrically around the central camera 200, and the first side camera 300 and the second side camera 400 are placed at the same distance from one end of the frame 100. may be formed to be placed.

4 is a photographing state diagram before angle of view control according to an embodiment of the present invention, and FIG. 5 is a photographing state diagram after angle of view control according to an embodiment of the present invention.

Referring to FIG. 4 , when the central camera 200 and the first side camera 300 are photographed facing the same direction, the angle of view of the central camera 200 and the angle of view of the first side camera 300 may partially overlap. can

When the angles of view overlap, the image acquisition unit 600 may form a single panoramic image only after a separate process of detecting an area corresponding to the overlapped angles of view. However, the rotation control unit 500 according to an embodiment of the present invention can prevent overlapping by rotating the direction in which the first side camera 300 looks at using the first rotating device 350 .

Referring to FIG. 5 , the rotation control unit 500 adjusts the angle of the first side camera 300 so that the shooting target photographed by the central camera 200 and the photographed target photographed by the first side camera 300 do not overlap. It can be rotated outward of the central camera 200. This is also true for the second side camera 400 . Through this, the multi-camera device according to some embodiments of the present invention allows a plurality of cameras to photograph a photographing subject with angles of view that do not overlap with each other, thereby performing separate image processing to calculate overlapping photographed areas. Panoramic images can be created without any process.

Hereinafter, a method for calculating the rotation angle ω of the first side camera 300 in the rotation controller 500 will be described in detail.

6 is an explanatory view for explaining a mathematical formula for deriving a rotation angle ω according to an embodiment of the present invention.

Referring to FIG. 6 , in a situation where the first angle of view 210, which is the angle of view of the central camera 200, and the second angle of view 320, which is the angle of view of the first side camera 300, overlap each other, the rotation controller 500 By rotating the first side camera 300 in the left direction, overlapping of the first view angle 210 and the second view angle 320 can be avoided.

The rotation controller 500 may derive the rotation angle ω based on the following equation described in FIG. 6 . The rotation controller 500 may determine the rotation angle ω of the first side camera based on Equation (1) below.

(1)

(One)

Here, θ denotes the angle of view of the central camera and the first side camera, d denotes an arrangement interval between the central camera and the first side camera, and L denotes the angle of view measured by the distance measuring device. Indicates the distance from the subject to be photographed.

Referring to FIG. 6 , the disposition distance d between the central camera and the first side camera may be calculated by Equation (2) below.

(2)

(2)

는

이고,

는

이므로, 이를 대입하면 아래 식 (3)으로 정리된다.Referring to Figure 6 here,

Is

ego,

Is

Therefore, substituting this into Equation (3) below.

(3)

(3)

In addition, when converted to the tan function, it is summarized as Equation (4) below.

(4)

(4)

Finally, Equation (5) below is derived by arranging the above Equation (4) with respect to ω.

(5)

(5)

The rotation control unit 500 may derive the value of rotation angle ω by calculating the above equation. The rotation controller 500 may transmit a rotation signal including the derived rotation angle ω to the first rotation device 350 .

In another embodiment, although not shown in the drawing, the rotation control unit 500 uses the distance to the photographing target measured by the distance measuring device 250 and a preset angle of view of the central camera 200 to control the central camera 200. ) calculates the width of the subject to be photographed. Subsequently, the rotation control unit 500 moves the first rotating device 350 to the central camera 200 when the calculated width of the photographing target is greater than the arrangement distance between the central camera 200 and the first side camera 300. can be rotated outward. That is, the width of the target captured by the central camera 200 is derived according to the distance between the central camera 200 and the target, and the width between the derived width and the central camera 200 and the first side camera 300 is calculated. By comparing the distance, the rotation angle ω of the first rotating device 350 can be calculated.

Meanwhile, the rotation control unit 500 may transmit a signal to the distance measuring device 250 to measure a new distance when a photographing target of the multi-camera device is changed. The rotation control unit 500 calculates a new rotation angle ω1 of the side camera 250 using the new distance value output from the distance measurement device 250 and the angles of view of the central camera 200 and the first side camera 300. can be derived

In addition, when the angle of view is changed by a zoom or span operation of the central camera 200 and the first side camera 300, the rotation control unit 500 may derive a new rotation angle ω1. .

When the new rotation angle ω1 is derived, the rotation control unit 500 compares the current rotated state of the first side camera 300 with the new rotation angle ω1 to derive a rotation angle ω for actual operation, , A rotation signal including the derived rotation angle ω may be transmitted to the first rotation device 350 .

Through this, the multi-camera device according to some embodiments of the present invention can take pictures with the widest angle since the angles of view of the plurality of cameras do not overlap. In addition, by controlling the angles of view of a plurality of cameras so as not to overlap, it is possible to take a panoramic photograph with the maximum angle of view.

In addition, since the multi-camera device according to some embodiments of the present invention measures the distance to the subject to be photographed and determines the rotation angle ω of the camera by mathematical calculation based on this result, for detecting the overlap of the angles of view It has an effect that does not require an image processing process.

The above description is merely an example of the technical idea of the present embodiment, and various modifications and variations can be made to those skilled in the art without departing from the essential characteristics of the present embodiment. Therefore, the present embodiments are not intended to limit the technical idea of the present embodiment, but to explain, and the scope of the technical idea of the present embodiment is not limited by these embodiments. The scope of protection of this embodiment should be construed according to the claims below, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of rights of this embodiment.

10: multi-camera device
100: frame
200: central camera
250: distance measuring device
300: first side camera
350: first rotating device
400: second side camera
450: second rotating device
500: rotation control unit
600: image acquisition unit

Claims (9)

frame;
a central camera positioned on an upper surface of the frame;
a first side camera positioned on an upper surface of the frame and spaced apart from the central camera;
a first rotating device disposed between the first side camera and the frame and rotating the first side camera in a left and right direction;
Distance measuring device for measuring the distance to the shooting target; and
A rotation control unit rotating the first rotating device so that the angle of view of the central camera does not overlap with the angle of view of the first side camera based on the distance measured by the distance measuring device;
a second side camera spaced apart from the central camera in a direction opposite to the first side camera and positioned on the upper surface of the frame;
A second rotation device positioned between the second side camera and the frame and rotating the second side camera in the left and right directions;
The rotation control unit rotates the second rotating device so that the angle of view of the central camera does not overlap with the angle of view of the second side camera based on the distance measured by the distance measuring device,
The rotation control unit calculates the width of the photographing target captured by the central camera using the distance to the photographing target measured by the distance measuring device and a preset angle of view of the central camera, and the calculated photographing When the width of the object is larger than the distance between the center camera and the first side camera, the first rotating device is rotated, and the first side camera and the second side camera are rotated around the center camera. to rotate in the opposite direction,
multi-camera device.
delete delete According to claim 1,
The rotation control unit controls the first rotation device and the second rotation device such that rotation angles of the first side camera and the second side camera are the same.
multi-camera device.
According to claim 1,
The central camera, the first side camera and the second side camera,
Arranged at predetermined intervals on a straight line disposed in the same direction as the extending direction of the frame or on a curved line disposed on a plane of the frame
multi-camera device.
According to claim 1,
The rotation control unit,
Determining the rotation angle (ω) of the camera of the first side camera based on the following <Equation>,
multi-camera device.
<mathematical expression>

Here, θ denotes the angle of view of the central camera and the first side camera, d denotes an arrangement interval between the central camera and the first side camera, and L denotes the angle of view measured by the distance measuring device. Indicates the distance from the subject to be photographed.
delete According to claim 1,
The angles of view of the central camera, the first side camera, and the second side camera are the same.
multi-camera device.
According to claim 1,
The distance measuring device,
Including any one of an ultrasonic sensor, an infrared sensor, a light detection and ranging (LIDAR) sensor, and a radio detecting and raging (Radar) sensor,
multi-camera device.

Images