KR20160000224A - Three-dimensional imaging system - Google Patents

Abstract

The present invention relates to a stereoscopic imaging system including: a photographing unit including a frame, a left image camera and a right image camera mounted on the frame such that the cameras reciprocally cross optical axes to respectively photograph left and right images of a subject, a camera driving module driving both of the cameras such that the camera driving module is capable of adjusting X, Y and X axes, rolling, and pitch, and a half mirror slantly installed on an optical axis intersection of the left and right image cameras; a driving meta information obtaining unit obtaining meta information associated with driving of both of the cameras; an environmental meta information obtaining unit obtaining meta information associated with photographing environments of both of the cameras; a meta information storage processing unit storing meta information obtained in the driving meta information obtaining unit and the environmental meta information obtaining unit; and a control unit controlling driving of both of the cameras using meta information associated with driving of both of the cameras stored in the meta information storage processing unit. Accordingly, the present invention provides a stereoscopic imaging system which is based on meta data such that the stereoscopic imaging system enables efficient control of a stereoscopic imaging device and is capable of obtaining various photographing information and post-work efficiency from photographed image data.

Description

[0002] Three-dimensional imaging system [0003]

The present invention relates to a stereoscopic image capturing system, and more particularly, to a stereoscopic image capturing system capable of efficiently controlling a stereoscopic image capturing apparatus based on meta data and obtaining various shooting information and post-operation efficiency from captured image data And more particularly, to a stereoscopic image capturing system.

As a general stereoscopic image photographing apparatus, there is known a stereoscopic camera which simultaneously photographs a left eye image to be viewed by a person as a left eye and a right eye image to be viewed as a right eye by using a left eye image camera and a right eye image camera. It is classified into a parallel stereoscopic camera and an orthogonal stereoscopic camera depending on whether a half mirror is provided or not.

The parallel stereoscopic camera is a stereoscopic camera that takes a left eye image camera and a right eye image camera at a certain distance on a camera frame and directly shoots the image of the subject. It is excellent in structural stability and each camera directly captures an image of a subject. There is a good advantage of resolution. On the other hand, there is a disadvantage that it is bulky in the horizontal direction and it is inconvenient for the person to move and to shoot.

On the other hand, in the orthogonal stereoscopic camera, a left-eye image camera and a right-eye image camera are installed at 90 degrees to each other, and a half mirror is provided at an optical axis intersection of the left eye image camera and the right eye image camera. Since the image of the subject is photographed and the other camera photographs the image of the subject reflected on the half mirror, the erection and resolution can be lower than that of the parallel stereoscopic camera, while the volume is small, .

One example of the orthogonal stereoscopic camera is shown in Fig. As shown in FIG. 1, a conventional orthogonal three-dimensional camera includes a frame 10, a left eye image camera (not shown) mounted on the frame 10 such that optical axes intersect at 90 degrees with each other and image the left eye of the subject 60 A right eye image camera 30 for photographing a right eye image of a subject 60 and a camera 20 connected to the frame 10 by connecting any one of the cameras 20 and the frame 10, A camera alignment module 50 for adjusting the stereoscopic effect of the stereoscopic image by adjusting the binocular disparity between the left eye image and the right eye image by rotating the stereoscopic image around the optical axis, And is provided at 45 degrees on the optical axis intersection of the camera 20 and the right eye image camera 30. The light is partially transmitted through the subject and transmitted to the right eye image camera 30, Not comprise a half mirror 40 for transmitting to the video camera.

In this conventional orthogonal stereoscopic camera, an optical axis alignment process is performed to align the horizontal distance, the height, the pitch and the main time between the left eye image and the right eye image, and then the position and rotation of the camera are adjusted, The stereoscopic effect of the stereoscopic image which is made by the right eye image is controlled.

However, in the stereoscopic image capturing apparatus such as the conventional orthogonal stereoscopic camera, in the process of aligning the optical axis to match the horizontal distance, height, pitch and main time between the left eye image and the right eye image, There is a problem that the control of the apparatus is very inefficient in the process of shooting the stereoscopic image.

Further, since data on the environment and the conditions of the photographing site can not be obtained, various photographing information can not be obtained from the photographed image data. Accordingly, there is a problem in that the utilization of the photographed image is limited and it is difficult to perform the task of rearranging the difference of the white balance, the contrast, and the color of the left and right images according to the photographic information subtitle.

Accordingly, it is an object of the present invention to provide a stereoscopic image capturing system capable of efficiently controlling a stereoscopic image capturing apparatus based on meta information and obtaining various shooting information and post-operation efficiency from captured image data.

According to an aspect of the present invention, there is provided a stereoscopic image capturing system comprising: a frame; a left eye image camera and a right eye image camera which are mounted on the frame so as to cross each other with respect to an optical axis, A camera driving module for driving the X, Y and Z axes and adjusting the rotation and pitch of the X, Y and Z axes, and a half mirror inclined at an optical axis intersection point of the left and right eye image cameras; A driving meta information acquisition unit for acquiring meta information related to the driving of both cameras; An environment meta information acquisition unit for acquiring meta information related to the photographing environment of both cameras; A meta information storage unit for storing meta information obtained by the driving meta information obtaining unit and the environment meta information obtaining unit; And a control unit for controlling driving of both cameras using meta information related to driving the both cameras stored in the meta information storage processing unit.

Here, it is preferable that the camera driving module includes a motor as a driving source, and the driving meta information obtaining unit obtains meta information related to the driving with the encoder sensing value by applying an encoder to the motor.

It is effective that the environmental meta information obtaining unit is provided with at least one of a gyro sensor, a temperature / humidity sensor, a GPS module, a distance sensor, an illuminance sensor, and a white balance sensor.

In this case, the meta information storage processing unit may be connected to the driving meta information obtaining unit, the environment meta information obtaining unit, and the control unit in a wired or wireless manner so as to exchange meta information.

And the control unit controls the main time and convergence control of the left and right eye image cameras and the driving of the optical axis alignment by using the driving-related meta information of the camera driving module among the meta information stored in the meta information storage processing unit to be.

According to the present invention, a stereoscopic image capturing system capable of efficiently controlling a stereoscopic image capturing apparatus based on meta data and capable of obtaining various shooting information and post-operation efficiency from captured image data is provided.

1 is a view showing an example of a conventional stereoscopic image photographing apparatus,
2 is a configuration diagram of a stereoscopic image capturing system according to the present invention,
FIG. 3 is a simplified view of the photographing unit of FIG. 2,
4 to 6 are views showing a state of correcting a video image acquired by the stereoscopic image capturing system according to the present invention.

A stereoscopic image capturing system 101 according to the present invention includes a photographing unit 101 for photographing a stereoscopic image, a driving meta information obtaining unit 103 for obtaining meta information related to driving of the photographing unit 101, An environment meta information acquiring unit 105 for acquiring meta information related to the photographing environment of the photographing apparatus 101 and a meta information acquiring unit 105 for acquiring meta information acquired by the driving meta information acquiring unit 103 and the environment meta information acquiring unit 105, A storage processing unit 107, and a control unit 108 for controlling the driving of the photographing unit 101 using the meta information.

The photographing unit 101 includes a frame 100 and a left eye image camera 200 and a right eye image camera 300 which are mounted on the frame 100 such that mutual optical axes cross each other to photograph the left eye and right eye images of the object 600, A camera driving module 700 for driving both the cameras 200 and 300 so as to be adjustable in X, Y and Z axial directions and in a rolling direction and a pitch with respect to the frame 100, 200 and the right eye image camera 300. The light is partially transmitted through the subject 600 to be transmitted to the right eye image camera 300 and partially reflected to be transmitted to the left eye image camera 200 And a half mirror 400.

The frame 100 is a frame for supporting the left eye image camera 200, the right eye image camera 300, and the half mirror 400. The frame 100 is preferably made of a lightweight alloy structure to facilitate movement.

The left eye image camera 200 may be installed in the frame 100 and may be installed in the frame 100 such that the optical axis is on the z axis. The right eye image camera 300 is installed in the frame 100 such that the optical axis thereof is orthogonal to the optical axis of the left eye image camera 200, and images the right eye image of the object. For example, the right eye image camera 300 may be installed on the frame 100 such that the optical axis thereof faces the x axis, and the left eye image camera 200 and the right eye image camera 300 may be mounted on the frame 100, .

The camera driving module 700 is a camera module that can be mounted on a camera such as an orthopedic stereoscopic camera capable of rotating a half mirror without degrading the stereoscopic effect, Korean Registered Patent No. 1204267 of the present applicant (name: camera photographing position adjusting device), Korean Patent No. 1212452 Korean Registered Patent No. 1162556 (name: a stereoscopic camera alignment module using a wrap jack and a stereoscopic camera rig equipped with the alignment module), Korea Patent No. 1170906 (entitled " stereoscopic camera alignment module and its alignment module (Registered trademark), Korean Registered Patent No. 1243032 (name: orthogonal type stereoscopic camera league), Korea Registered Patent No. 1246025 (name: camera horizontal positioning device), Korean Patent No. 1213962 And a registration module of Korean Patent No. 1162058 (name: a three-dimensional camera rig equipped with a camera alignment device).

Although the camera driving module 700 is applied to the right eye image camera 300 in the present invention, the camera driving module 700 may be applied to the left eye image camera 200, And the right-eye image camera 300, respectively.

It is desirable to use the motor 800 that can be used as the driving source of the camera driving module and the motor 800 as the driving meta information obtaining unit 103. [

The half mirror 400 is mounted on the frame 100 so as to be located at an optical axis intersection point between the left eye image camera 200 and the right eye image camera 300. In addition, the half mirror 400 may be installed at an angle of 45 degrees with respect to the optical axis of the cameras 200 and 300. The half mirror 400 transmits a part of the light of a subject 600 to the right eye image camera 300 and reflects a part of the light of the object to the left eye image camera 200, May acquire the left eye image of the subject 600 and the right eye image camera 300 may acquire the right eye image of the subject 600. [

At this time, the positions of the left eye image camera 200 and the right eye image camera 300 may be reversed.

The driving meta information acquiring unit 103 may be provided as an encoder for acquiring meta information on the driving of the motor 800 of the camera driving module 700. [ Metadata of the movement and pitch of the camera driving module 700 in the X, Y and Z directions and in the rolling direction are obtained by using the encoder so that the left eye image camera 200 and the right eye image camera 300 ) And the convergence control and the optical axis alignment can be precisely controlled.

The driving meta information acquiring unit 103 calculates a relative or absolute position value using a predetermined calculation formula for an input value from the motor 800 to calculate an origin and an actual position of the camera, Speed and the like to the meta information storage unit 107 by wire or wirelessly.

Using the driving-related meta information acquired by the driving meta information acquisition unit 103 and stored in the meta information storage unit 107, the control unit 108 controls the driving of the left and right eye image cameras 200 and 300 It can be precisely controlled by wire or wireless at a short distance and at a long distance.

The environment meta information acquisition unit 105 may include a gyro sensor, a temperature and humidity sensor, a GPS module, a distance sensor, and the like provided at a position adjacent to a frame, a camera, or a camera driving module.

In the case of the gyro sensor, the directional change and the speed of change of the photographing unit 101 such as an azimuthal angle change in the stereoscopic image capturing process can be sensed and transmitted as meta information to the meta information storage unit 107 by wire or wireless. The meta information obtained from the gyro sensor provides accurate environment information for re-shooting using the directional change and the changing speed of the photographing unit 101 such as the azimuthal change of the stereoscopic image photographed in the environment.

The temperature and humidity sensor senses the ambient temperature and humidity in the stereoscopic image capturing process and transmits the sensed temperature and humidity to the meta information storage processing unit 107 as wired or wireless information as meta information. The sensing range of the temperature and humidity sensor is preferably in a range of 0% to 100% of humidity and a temperature of 40 ° C to 120 ° C. The meta information obtained from the temperature / humidity sensor is a color difference And provides accurate environmental information during re-shooting.

The GPS module may transmit information on the stereoscopic image photographing position as meta information to the meta information storage processor 107 by wire or wirelessly. It is possible to accurately reproduce the photographing position using the GPS meta information obtained from the GPS module, so that it is possible to provide environmental information such as the exact position of the image when composing the image taken at the same position or re-photographing.

The distance sensor can use an infrared sensor and can accurately ascertain the distance to the subject 600 to be used for stereoscopic image shooting, thereby improving the quality of the stereoscopic image. The distance meta information obtained from the distance sensor may be transmitted to the meta information storage processing unit 107 by wire or wirelessly. Since the accurate distance between the camera and the subject 600 can be confirmed and reproduced, it is possible to provide the distance information when correcting and re-photographing the photographed image.

Here, the environment meta information acquisition unit 105 preferably includes both the gyro sensor, the temperature / humidity sensor, the GPS module, and the distance sensor. In some cases, only one sensor or two or more sensors may be provided, It is needless to say that it is possible to further include additional sensors such as an illuminance sensor or a white balance sensor for acquiring environment meta information and a configuration capable of recording meta information related to a stereoscopic image shooting environment such as date and time.

Based on the meta information obtained by the environment meta information acquisition unit 105, the application field of the stereoscopic image photographing apparatus can be further expanded including a movie and broadcast photographing apparatus. For example, the stereoscopic imaging system 101 to which a GPS module, a distance sensor, a temperature and humidity sensor is applied is a special field and can be utilized in extreme environments such as medical, military, space, radiation contaminated areas and deep sea areas.

The meta information storage processing unit 107 stores meta information about driving of the motor 800 of the camera driving module 700 obtained by the driving meta information obtaining unit 103 in the process of shooting the stereoscopic image in the photographing unit 101, And meta information about the photographing environment obtained by the meta information acquiring unit 105 is stored.

Related meta information on the X, Y, Z axis direction and the rolling direction movement and pitch of the camera driving module 700 among the meta information stored in the meta information storage processing unit 107, And is used as meta information that can precisely control driving of the left eye image camera 200 and the right eye image camera 300, such as main time, convergence control, and alignment of the optical axis.

The photographic environment related meta information transmitted from the gyro sensor, the temperature and humidity sensor, the GPS module, the distance sensor, and the like among the meta information stored in the meta information storage processing unit 107 is used for correction of the photographed image, It is possible to maximize the efficiency of post-work by providing accurate environmental information during post-work.

The control unit 108 is connected to the meta information storage processing unit 107 and the photographing unit 101 so as to transmit data and control signals wirelessly using a cable or wireless using the Internet or wireless communication, ) Of the camera driving module 700 in the meta information stored in the left eye image camera 200 and the left eye image camera 200 using the driving-related meta information about the X, Y, Z axis direction and the rolling direction movement and pitch of the camera driving module 700, It is possible to precisely and efficiently control driving of the camera 300, such as the main time, convergence control, and optical axis alignment.

The control unit 108 includes a controller such as a computer, a tablet PC, and a dedicated terminal, and a left-eye image camera 200 and a right-eye image camera (not shown) The control program may be pre-programmed to control the operation of the control unit 300.

The stereoscopic image capturing system 101 having such a configuration is capable of capturing a stereoscopic image of the left eye image and the right eye image using the left eye image camera 200 and the right eye image camera 300 of the photographing unit 101, The stereoscopic image is acquired by adjusting the stereoscopic effect of the stereoscopic image formed between the left eye image and the right eye image by adjusting the position and rotation of the camera.

The driving meta information obtaining unit 103 obtains meta information on the driving of the motor 800 of the camera driving module 700 and transmits the meta information to the meta information storing unit 107. The controlling unit 108 stores the stored meta information The main time and convergence control and the alignment of the optical axis of the left and right eye image cameras 200 and 300 are precisely controlled.

In addition, in the stereoscopic image capturing process, the environment meta information acquisition unit 105 acquires meta information about the environment and the environment of the shooting site, thereby obtaining the environment of the stereoscopic image photographed by the left and right eye image cameras 200 and 300 Various shooting environment information can be obtained from the meta information. In this way, it is possible to produce various contents using the photographed images, and to match the differences in the contrast and color of the left and right images using the meta information related to the photographing environment of the left and right eye cameras 200 and 300 It is possible to easily confirm the meta information about the shooting environment for the post-shooting operation or the re-shooting, so that post-operations such as correction and re-shooting of the image can be performed very easily.

For example, when a color difference between a left image and a right image occurs as shown in FIG. 4, a stereoscopic image obtained by accurately correcting the color difference of the left and right images using the meta information obtained by the environment meta information acquisition unit 105 in the stereoscopic image capturing .

5A, the brightness of the left and right images is calculated using the brightness-related meta information obtained by the environment meta information acquisition unit 105 in the stereoscopic image capturing process when the brightness difference between the left image and the right image occurs, b as shown in Fig.

6A, when the color temperature difference between the left image and the right image occurs, the color temperature of the left and right images is calculated using the meta information associated with the color temperature obtained by the environment meta information acquisition unit 105 in the stereoscopic image capturing process, Can be accurately corrected as shown by b in FIG.

As described above, according to the present invention, a stereoscopic image capturing system capable of efficiently controlling the stereoscopic image capturing apparatus based on meta data and obtaining various shooting information and post-operation efficiency from the captured image data / RTI >

101: photographing unit 103: driving meta information obtaining unit
105: environment meta information acquisition unit 107: meta information storage processing unit
108: Control unit 200: Left eye image camera
300: Right eye image camera 400: Half mirror
700: camera driving module

Claims (5)

In a stereoscopic imaging system,
A left eye image camera and a right eye image camera which are mounted on the frame so as to cross each other with respect to the optical axis and respectively photograph left and right eye images of the subject, A photographing unit having a half mirror inclined at an optical axis intersection point of the left eye image camera and the right eye image camera;
A driving meta information acquisition unit for acquiring meta information related to the driving of both cameras;
An environment meta information acquisition unit for acquiring meta information related to the photographing environment of both cameras;
A meta information storage unit for storing meta information obtained by the driving meta information obtaining unit and the environment meta information obtaining unit;
And a control unit for controlling driving of both cameras using meta information related to the driving of both cameras stored in the meta information storage processing unit. The method according to claim 1,
Wherein the camera driving module includes a motor as a driving source, and the driving meta information obtaining unit obtains meta information related to the driving with the encoder sensing value by applying an encoder to the motor. 3. The method of claim 2,
Wherein the environmental meta information obtaining unit is provided with at least one of a gyro sensor, a temperature / humidity sensor, a GPS module, a distance sensor, an illuminance sensor, and a white balance sensor. The method of claim 3,
Wherein the meta information storage processing unit is connected to the driving meta information obtaining unit, the environment meta information obtaining unit, and the control unit in a wired or wireless manner so as to exchange meta information. 5. The method according to any one of claims 1 to 4,
Wherein the control unit controls driving of the primary vision and convergence control and the alignment of the optical axis of the left and right eye image cameras using the meta information related to driving of the camera driving module among the meta information stored in the meta information storage processing unit A stereoscopic imaging system.

Images