KR20110109031A - Stereoscopic image camera apparatus and driving method the same - Google Patents

Abstract

The present invention provides a three-dimensional image camera system and a driving thereof capable of capturing a subject using one image sensor and one lens, and converting the photographed subject image into a stereoscopic image based on the subject depth detected by an impulse signal. A stereoscopic camera apparatus includes a subject depth detection module configured to detect a subject depth corresponding to a distance of a subject through transmission and reception of an impulse signal; An imaging module configured to photograph the subject according to the subject depth by using one image sensor and one lens to generate a subject image; A control module for converting the subject image into a stereoscopic image based on the subject depth; And a display module for displaying the stereoscopic image supplied from the control module.

Description

Stereoscopic camera device and driving method thereof {STEREOSCOPIC IMAGE CAMERA APPARATUS AND DRIVING METHOD THE SAME}

The present invention relates to a stereoscopic image camera system, and more particularly, to capture a subject by using an image sensor and a lens, and to convert the captured subject image into a stereoscopic image based on a subject depth detected by an impulse signal. A stereoscopic camera system and a driving method thereof are provided.

In general, the eyes of humans are located about 6.5 ~ 7cm apart on average. Frequently, a stereoscopic image that a person feels is mainly felt by convergence and binocular parallax caused by the distance between the left and right eyes.

In view of the fact that these two eyes are different from each other, the stereoscopic type is to capture or display an image so that only two images corresponding to each other can be seen in the left eye and the right eye, respectively.

In general, a stereoscopic stereoscopic camera device is classified into a single and binocular.

The single-lens stereoscopic camera apparatus includes an image sensor for capturing an image, a lens, a prism for separating the captured image into two, and a mirror for reflecting the image back to the image sensor. Such a single-eye stereoscopic camera apparatus provides a user with convenience and convenience of operation by taking a picture of the left eye and the right eye at the same time by using the above configuration.

However, since the single-lens stereoscopic camera device photographs one image alternately to the left eye and the right eye, it is necessary to perform separate image processing to compensate for the time difference between the left eye image and the right eye image. And, due to the configuration of the prism or mirror, there is a problem that the volume of the device as a whole increases.

On the other hand, the binocular stereoscopic camera device has the advantage that can realize a high-quality stereoscopic image by simply taking a stereoscopic image using two cameras and two lenses.

However, the binocular stereoscopic camera apparatus has a problem in that the volume of the apparatus increases as a whole using two cameras and two lenses.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problem, and it is possible to capture a subject using one image sensor and one lens, and convert the photographed subject image into a stereoscopic image based on the subject depth detected by the impulse signal. It is an object of the present invention to provide a stereoscopic video camera system and a driving method thereof.

According to an aspect of the present invention, there is provided a stereoscopic camera apparatus, including: a subject depth detection module configured to detect a subject depth corresponding to a distance of a subject through transmission and reception of an impulse signal; An imaging module configured to photograph the subject according to the subject depth by using one image sensor and one lens to generate a subject image; A control module for converting the subject image into a stereoscopic image based on the subject depth; And a display module for displaying the stereoscopic image supplied from the control module.

The object depth detection module may include an impulse signal generator configured to generate the impulse signal; An impulse signal transmitter to transmit the impulse signal to the subject; An impulse signal receiver configured to receive an impulse signal reflected by the subject and returned; An impulse signal analyzer for detecting a propagation delay time by analyzing the received impulse signal; And a subject depth detector configured to detect the subject depth based on the propagation delay time.

The object depth detection module is configured to transmit and receive the impulse signal using ultra wide band wireless communication.

The control module generates an X-axis displacement based on the subject depth, and shifts the subject image in the ± X-axis direction by the generated X-axis displacement to generate a left-eye displacement image and a right-eye displacement image. And an image processor configured to provide the display module with the stereoscopic image corresponding to the image and the right eye displacement image.

The image processor may include an X axis displacement generating unit configured to generate the X axis displacement based on the depth of the subject; A displacement image generator configured to shift the subject image by the X-axis displacement in the ± X-axis direction to generate a left eye displacement image and a right eye displacement image, respectively; And a stereoscopic image output unit configured to sequentially output the left eye displacement image and the right eye displacement image to the display module, or to output a mixed image obtained by mixing the left eye displacement image and the right eye displacement image to the display module. .

The display module may display the stereoscopic image on the display panel by sequentially displaying the left eye displacement image and the right eye displacement image output from the stereoscopic image output unit on the display panel, or by displaying the mixed image.

The X-axis displacement generating unit obtains a constant k (where k is a natural number) by multiplying the set binocular parallax and the focal length of the lens, and calculates a disparity value by dividing a constant k value by the subject depth. After that, half of the calculated disparity value is generated as the X-axis displacement.

The stereoscopic image output unit may include a synchronization signal multiplier configured to multiply the first frame synchronization signal twice to generate a second frame synchronization signal; A synchronization signal selection unit for selectively outputting the first frame synchronization signal or the second frame synchronization signal according to a display control signal according to a user's setting; An image output signal generator configured to generate first and second image output signals corresponding to the first frame synchronization signal or the second frame synchronization signal supplied from the synchronization signal selector; A displacement image mixer configured to generate the mixed image by mixing the left eye displacement image and the right eye displacement image supplied according to the first and second image output signals, and supply the generated mixed image to the display module; A first selector configured to supply the left eye displacement image to the display module or the displacement image mixer according to the first image output signal; And a second selector configured to supply the right eye displacement image to the display module or the displacement image mixer according to the second image output signal.

The image output signal generator generates the first and second image output signals having the same logic state so that the mixed image is displayed on the display panel when the first frame synchronization signal is supplied from the synchronization signal selector. And when the second frame synchronization signal is supplied from the synchronization signal selector, the first and second image outputs having a logic state inverted from each other so that the left eye displacement image and the right eye displacement image are sequentially displayed on the display panel. And generating a signal.

The control module may control the position of the lens such that the focus of the lens is adjusted according to the depth of the subject.

According to an aspect of the present invention, there is provided a method of driving a stereoscopic image camera apparatus, the method including: detecting a subject depth corresponding to a distance of a subject through transmission and reception of an impulse signal; Photographing the subject according to the subject depth by using one image sensor and one lens to generate a subject image; Converting the subject image into a stereoscopic image based on the subject depth; And displaying the stereoscopic image on the display module or storing the stereoscopic image in the storage module.

The detecting of the subject depth may include generating the impulse signal; Transmitting the impulse signal to the subject; Receiving an impulse signal reflected and returned by the subject; Analyzing the received impulse signal to detect a propagation delay time; And detecting the depth of the subject based on the propagation delay time.

The detecting of the subject depth may include transmitting and receiving the impulse signal using ultra wide band wireless communication.

The converting of the subject image into a stereoscopic image may include generating an X-axis displacement based on the depth of the subject; Generating a left eye displacement image and a right eye displacement image by shifting the subject image in the ± X axis direction by the generated X axis displacement; And displaying the stereoscopic image corresponding to the left eye displacement image and the right eye displacement image on the display module or storing the stereoscopic image in the storage module.

The generating of the X-axis displacement may be performed by multiplying the set binocular parallax and the focal length of the lens to obtain a constant k (where k is a natural number) and dividing the constant k by the depth of the subject to disparity. After calculating the value, half of the calculated disparity value is generated as the X-axis displacement.

The displaying of the stereoscopic image on the display module may include sequentially displaying the left eye displacement image and the right eye displacement image on a display panel, or displaying a mixed image of the left eye displacement image and the right eye displacement image on the display panel. It features.

The displaying of the stereoscopic image on the display module may include: generating a second frame synchronization signal by doubling the first frame synchronization signal; Selectively outputting the first frame synchronization signal or the second frame synchronization signal according to a display control signal according to a user setting; Generating first and second image output signals corresponding to the first frame synchronization signal or the second frame synchronization signal, which are selectively output according to the display control signal; And sequentially displaying the left eye displacement image and the right eye displacement image on a display panel according to a logic state of the first and second image output signals, or a mixed image obtained by mixing the left eye displacement image and the right eye displacement image on the display panel. Characterized in that it comprises a step of displaying.

The generating of the first and second image output signals may include the first logic having the same logic state so that the mixed image is displayed on the display panel when the first frame synchronization signal is selectively output according to the display control signal. When the first and second image output signals are generated and the second frame synchronization signal is selectively output according to the display control signal, the left eye displacement image and the right eye displacement image are inverted from each other so as to be sequentially displayed on the display panel. And generating the first and second video output signals having a logic state.

The generating of the subject image may include controlling the position of the lens to adjust the focus of the lens according to the depth of the subject.

As described above, the stereoscopic image camera apparatus and its driving method according to the present invention can reduce the volume of the apparatus and make it slim by realizing a subject image as a stereoscopic image using one image sensor, one lens, and an impulse signal. There is an effect.

In addition, the present invention generates a left-eye displacement image and a right-eye displacement image by shifting the image of the subject image in the ± X-axis direction according to the X-axis displacement corresponding to the subject depth detected through the transmission and reception of the impulse signal, the left eye displacement image and the right eye The display speed of the stereoscopic image can be increased by sequentially displaying the displacement image on the display panel or by displaying the mixed image including the left eye displacement image and the right eye displacement image on the display panel.

1 is a view for schematically explaining a three-dimensional image camera device according to an embodiment of the present invention.
2 is a diagram schematically illustrating a process of generating a stereoscopic image according to an embodiment of the present invention.
3 is a view for explaining a schematic configuration of the object depth detection module shown in FIG.
4 is a diagram for describing transmission and reception of an impulse signal in the object depth detection module illustrated in FIG. 3.
5 is a view for explaining the disparity of a general stereoscopic image camera apparatus.
6 is a view for explaining a schematic configuration of the control module shown in FIG.
FIG. 7 is a diagram for describing a schematic configuration of the image processor illustrated in FIG. 6.
FIG. 8 is a diagram for describing a schematic configuration of the stereoscopic image output unit illustrated in FIG. 7.
9A and 9B are waveform diagrams illustrating first and second image output signals generated by the image output signal generator shown in FIG. 8.
10 is a flowchart for explaining a method of driving a 3D image camera apparatus according to an embodiment of the present invention step by step.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram schematically illustrating a stereoscopic image camera apparatus according to an exemplary embodiment of the present invention, and FIG. 2 is a diagram schematically illustrating a process of generating a stereoscopic image according to an exemplary embodiment of the present invention.

1 and 2, a stereoscopic camera apparatus according to an exemplary embodiment of the present invention includes an imaging module 100, a subject depth detection module 200, a control module 300, a display module 400, and a storage module. And 500.

The imaging module 100 includes an image sensor 110, a lens 120, an image generator 130, and a lens driver 140.

The image sensor 110 is disposed on the rear surface of the lens 120 to photograph the subject 10 transferred from the lens 120 to generate imaging information of the subject. To this end, the image sensor 110 may be formed of a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS).

The lens 120 is disposed in front of the image sensor 110 and enlarges or reduces the subject 10 and transmits the image to the image sensor 110.

The image generator 130 generates the subject image PI based on the sensing information of the subject 10 generated by the image sensor 110 and provides the subject image PI to the control module 300.

The lens driver 140 moves the lens 120 under the control of the control module 300 to enlarge or reduce the subject 10 transferred to the image sensor 110 or to adjust the focus of the subject 10. .

The imaging module 100 having such a configuration photographs the subject 10 using one image sensor 110 and one lens 120, and captures the subject image PI corresponding to the photographed subject 10. It generates and provides to the control module 300.

The subject depth detection module 200 generates an impulse signal IS in response to the distance detection control signal DDCS supplied from the control module 300, and transmits the impulse signal IS to the subject 10, and the subject 10. Receiving an impulse signal RIS reflected and returned by the DELTA signal, and detecting a subject depth PDepth corresponding to the distance between the imaging module 100 and the subject 10 according to the propagation delay time of the impulse signal RIS, The detected subject depth PDepth is provided to the control module 300.

To this end, the object depth detection module 200, as shown in Figure 3, the impulse signal generator 210, impulse signal transmitter 220, impulse signal receiver 230, impulse signal analyzer 240, And a subject depth detector 250.

The impulse signal generator 210 generates an impulse signal IS in response to the distance detection control signal DDCS supplied from the control module 300, and outputs the generated impulse signal IS to the impulse signal transmitter 220. to provide. Here, the distance detection control signal DDCS is a timing signal for timing the impulse signal and may be generated to correspond to a user's shutter operation for capturing a picture or a video.

The impulse signal transmitter 220 transmits the impulse signal IS provided from the impulse signal generator 210 to the subject 10. Here, the impulse signal transmitter 220 may be implemented by various wireless communication technologies commercially available through an antenna (not shown). However, the impulse signal transmitter 220 preferably passes through an obstacle having a characteristic of reflecting signals at a limited bandwidth or at a high power level. The impulse signal (IS) may be transmitted by using an ultra wide band (UWB) wireless communication technology capable of transmitting the UWB. The impulse signal IS transmitted to the subject 10 by the impulse signal transmitter 220 is partially absorbed by the subject 10 and partially reflected by the impulse signal IS according to the characteristics of the subject 10 to return to the imaging module 100. Come.

The impulse signal receiver 230 receives an impulse signal RIS reflected by the subject 10 and returns to the impulse signal analyzer 240 through an antenna. Here, the impulse signal receiver 230 may be implemented in the same wireless communication technology as that of the impulse signal transmitter 220, and preferably, may be implemented in an ultra-wideband wireless communication technology.

The impulse signal analyzer 240 calculates a propagation delay time Tpd through a reception time of the received impulse signal RIS provided from the impulse signal receiver 230, and calculates the propagation delay time Tpd. To the subject depth detector 250. That is, as shown in FIG. 4, the impulse signal analyzer 240 may include a time point t1 at which the impulse signal IS is transmitted and a time point at which the impulse time RIS reflected by the subject 10 is received ( The propagation delay time Tpd between t2) is calculated.

In addition, after the impulse signal analysis unit 240 analyzes the response characteristic (ISRC) of the impulse signal using the impulse signals (RIS) received after the time point t2 when the impulse signal (RIS) is received. After calculating the appropriate light amount of the exposure value and / or flash based on the response characteristic (ISRC) of the analyzed impulse signal, the calculated exposure value and / or light quantity information FLI of the flash may be configured to be provided to the control module 300. have.

Alternatively, the impulse signal analyzer 240 analyzes the characteristic of the subject 10 based on the response characteristic (ISRC) of the impulse signal and then transmits the analyzed characteristic information (PCI) of the analyzed subject 10 to the control module 300. Can provide. For example, the characteristic information (PCI) of the subject 10 may include the type of the subject 10 such as a face, a person, a tree, a glass window, a building, a background, the brightness (color temperature) of the subject 10, and the subject 10. Information on a focus range, etc. may be included, and the characteristic information of the subject 10 may be used for control of exposure compensation, white balance adjustment, and the like.

The subject depth detector 250 calculates a subject depth PDepth corresponding to the physical distance between the imaging module 100 and the subject 10 based on the propagation delay time Tpd provided from the impulse signal analyzer 240. , The calculated subject depth PDepth is provided to the control module 300. Here, the subject depth detector 250 may calculate the subject depth PDepth based on Equation 1 below.

In Equation 1, C represents the speed of light and Tpd represents the propagation delay time.

1 and 2, the control module 300 controls driving of the imaging module 100, the subject depth detection module 200, the display module 400, and the storage module 500, respectively. In addition, the control module 300 may determine the left eye displacement image LDI and the right eye displacement of the subject image PI provided from the imaging module 100 based on the subject depth PDepth detected by the subject depth detection module 200. The left eye displacement image LDI and the right eye displacement image RDI are stored in the storage module 500, sequentially displayed on the display module 500, or the converted left eye displacement image ( 3D image SI is displayed on a display panel (not shown) by displaying the mixed image FI in which the LDI) and the right eye displacement image RDI are mixed on the display module 500.

Meanwhile, in the three-dimensional image camera device, which is well known in order to convert the two-dimensional object image PI captured by the imaging module 100 into a mixed image FI, as shown in FIG. Assuming that any one point (x, y, z) in coordinates is the subject 10, the subject 10 is the left eye on the left and right eye image planes LIP and RIP respectively corresponding to the left and right eye cameras, respectively. It may be represented by image coordinates (x1, y1) and right eye image coordinates (x2, y2).

In FIG. 5, d represents the distance between the left and right lenses, and f represents the distance between the image plane and the center of the lens as the focal length.

Meanwhile, in FIG. 5, the difference (x1-x2) between the X coordinate (x1) of the left eye image and the X coordinate (x2) of the right eye image of the subject 10 appearing on the left and right eye image planes LIP and RIP is determined. Also referred to as a disparity, the stereoscopic camera apparatus may generate a stereoscopic image using the disparity.

In general, the disparity for generating a stereoscopic image may be calculated as follows.

First, the X-axis coordinate (xL) of the left eye lens and the X-axis coordinate (xR) of the right eye lens corresponding to the subject 10 appearing on the left and right eye image planes LIP and RIP, respectively, are represented by Equations 2 and 3 below. It can be defined as

The X-axis coordinate xL of the left eye lens according to Equation 3 may be defined as shown in Equation 4 below according to the distance b between the left and right eye lenses corresponding to binocular parallax.

Substituting Equation 4 into Equation 3, the X-axis coordinate xL of the left eye lens may be defined as Equation 5 below.

Summarizing Equations 2 to 5 may be defined as Equation 6 below.

In Equation 6, (zf) may be a subject depth PDepth detected by the above-described subject depth detection module 200, and bf is a value corresponding to the multiplication of the set binocular parallax and the focal length of the lens. Where k is a natural number.

Accordingly, Equation 6 may be defined by Equation 7 below.

In Equation 7, x1-x2 is a disparity, and it can be seen that the subject depth PDepth and the disparity x1-x2 are inversely proportional.

Accordingly, the control module 300 of the present invention calculates the disperity value by using the subject depth PDepth detected by the subject depth detection module 200, that is, divides the constant k value by the subject depth PDepth value. The subject image PI is converted into a stereoscopic image using the calculated disparity value.

To this end, as shown in FIG. 6, the control module 300 includes a timing controller 310, a sensor control signal generator 320, a distance detection control signal generator 330, and a lens driving signal generator 340. ), And an image processing unit 350.

The timing controller 310 controls the overall driving timing of the stereoscopic image camera apparatus according to the present invention.

The sensor control signal generator 320 generates a sensor control signal SCS under the control of the timing controller 310 to control the driving of the image sensor 110 and the image generator 130. Accordingly, the image sensor 110 of the imaging module 100 generates the imaging information of the subject 10 in response to the sensor control signal SCS, and the image generator 130 is provided from the image sensor 110. The subject image PI is generated based on the captured image information of the subject 10.

The distance detection control signal generator 330 generates the distance detection control signal DDCS under the control of the timing controller 310 to control the driving of the object distance detection module 200. Accordingly, the object distance detection module 200 transmits the impulse signal IS to the subject 10 in response to the distance detection control signal DDCS and receives the impulse signal RIS reflected from the subject 10 and returned. As a result, the above-described object depth PDepth is detected.

The lens driving signal generator 340 controls the driving of the lens driver 140 by generating the lens driving signal LDS under the control of the timing controller 310. In this case, the lens driving signal generator 340 generates the lens driving signal LDS based on the subject depth PDepth provided from the subject distance detecting module 200. Accordingly, the lens driver 140 moves the lens 120 in response to the lens driving signal LDS to enlarge or reduce the subject 10 transmitted to the image sensor 110 or to reduce the focus of the subject 10. Allow it to be adjusted.

Meanwhile, the lens driving signal generator 340 may control the driving of the lens driver 140 to perform the fine focus adjustment function after the coarse focus adjustment function is performed.

Specifically, the lens driving signal generator 340 first generates the lens driving signal LDS according to the subject depth PDepth so that the subject image PI is acquired at the position of the lens 120 whose approximate focus is adjusted. The driving of the driving unit 140 is controlled.

Next, a focus value is calculated on the acquired subject image PI to detect contrast ratio, and the lens driving signal LDS for moving the lens 120 at a predetermined predetermined unit distance again. ) To control driving of the lens driver 140 to obtain the subject image PI again, and detect the contrast ratio of the acquired subject image PI again.

Then, the above process is repeated a predetermined number of times (for example, three times) to determine the position of the lens 140 having the highest contrast ratio as the final focus position, and drive the lens corresponding to the final focus position. The signal LDS is generated to control the driving of the lens driver 140.

The image processor 350 converts the subject image PI provided from the imaging module 100 into a stereoscopic image under the control of the timing controller 310.

To this end, the image processing unit 350, as shown in FIG. 7, the X-axis displacement generating unit 351, the displacement image generating unit 353, the displacement image temporary storage unit 355, and the displacement image output unit 357. And a stereoscopic image output unit 359.

The X-axis displacement generating unit 351 divides the constant "1" by the subject depth PDepth provided from the subject distance detecting module 200 to calculate a disperity (| x1-x2 |) value, and the following equation As shown in FIG. 8, the calculated disparity (| x1-x2 |) value is divided by 2 to generate the X-axis displacement XD.

As illustrated in FIG. 2, the displacement image generator 353 shifts the subject image PI in the ± X-axis direction by the X-axis displacement XD generated by the X-axis displacement generator 351. Image Shift) generates a left eye displacement image (LDI) and a right eye displacement image (RDI), respectively.

The displacement image temporary storage unit 355 temporarily stores the left eye displacement image LDI and the right eye displacement image RDI generated by the displacement image generator 353.

The displacement image output unit 357 temporarily stores the left eye displacement image LDI and the right eye temporarily stored in the displacement image storage unit 355 in response to the stereoscopic image display signal SIDS provided from the timing controller 310 according to a user's setting. The displacement image RDI is output to the stereoscopic image output unit 359 or stored in the storage module 500. That is, the displacement image output unit 357 outputs the left eye displacement image LDI and the right eye displacement image RDI to the stereoscopic image output unit 359 in response to the stereoscopic image display signal SIDS in the first logic state. The left eye displacement image LDI and the right eye displacement image RDI are stored in the storage module 500 in response to the stereoscopic image display signal SIDS of the second logic state.

The stereoscopic image output unit 359 may include the left eye displacement image LDI and the right eye displacement image RDI according to a display control signal DCS corresponding to the simultaneous display of the left eye displacement image LDI and the right eye displacement image RDI. Are sequentially supplied to the display module 400 or a mixed image FI obtained by mixing a left eye displacement image LDI and a right eye displacement image RDI is supplied to the display module 400.

To this end, as shown in FIG. 8, the stereoscopic image output unit 359 includes a synchronization signal multiplier 361, a synchronization signal selector 362, an image output signal generator 363, first and second devices. A selection unit 364, 365, and a displacement mixing unit 366.

The synchronizing signal multiplier 361 multiplies the first frame synchronizing signal FS1 supplied by a timing synchronizing signal generating unit (not shown) twice to generate a second frame synchronizing signal FS2.

The synchronization signal selector 362 is the first frame synchronization signal FS1 supplied from the timing synchronization signal generator or the second frame synchronization signal FS2 supplied from the synchronization signal multiplier 361 according to the display control signal DCS. ) Is supplied to the image output signal generator 363. Here, the display control signal DCS sequentially supplies the left eye displacement image LDI and the right eye displacement image RDI to the display module 400 to display a first logic state for displaying a stereoscopic image on the display module 400. Or a second logic for generating a stereoscopic image by mixing a left eye displacement image (LDI) and a right eye displacement image (RDI), and supplying the generated stereoscopic image to the display module 400 for display on the display module 400. Can have state.

Accordingly, the sync signal selector 362 selects the second frame sync signal FS2 from the first and second frame sync signals FS1 and FS2 when the display control signal DCS is in the first logic state. When the display control signal DCS is in the second logic state, the first frame synchronization signal FS1 is selected from the first and second frame synchronization signals FS1 and FS2 when the display control signal DCS is in the second logic state. The output signal generator 363 is supplied.

The image output signal generator 363 may include the first and second image output signals IOS1, corresponding to the first frame synchronization signal FS1 or the second frame synchronization signal FS2 supplied from the synchronization signal selector 362. IOS2) is generated and supplied to the first and second selectors 364 and 365.

Specifically, when the first frame sync signal FS1 is supplied from the sync signal selector 362, the image output signal generator 363 may be connected to the first frame sync signal FS1 as illustrated in FIG. 9A. Regardless of the condition, the first and second image output signals IOS1 and IOS2 are always generated in a high state.

On the other hand, when the second frame sync signal FS2 is supplied from the sync signal selector 362, the image output signal generator 363 may receive the second frame sync signal FS2 as illustrated in FIG. 9B. The first image output signal IOS1 is generated by repeating the low state and the high state in the frame unit, and the second image output signal IOS2 having an inverted form is first generated in the first image output signal IOS1. Create

In FIG. 7, the first selector 364 is supplied from the displacement image output unit 357 or the storage module 500 in response to the first image output signal IOS1 supplied from the image output signal generator 363. The left eye displacement image LDI is supplied to the display module 400 or the displacement image mixing unit 366. That is, the first selector 364 supplies the left eye displacement image LDI to the displacement image mixing unit 366 according to the first image output signal IOS1 in the high state, and the first image output signal (in the low state). The left eye displacement image LDI is supplied to the display module 400 according to IOS1.

The second selector 365 is a right eye displacement image supplied from the displacement image output unit 357 or the storage module 500 in response to the second image output signal IOS2 supplied from the image output signal generator 363. RDI) is supplied to the display module 400 or to the displacement image mixer 366. That is, the second selector 365 supplies the right eye displacement image RDI to the displacement image mixer 366 in response to the second image output signal IOS2 in the high state, and the second image output signal (in the low state). The right eye displacement image RDI is supplied to the display module 400 according to IOS2).

The displacement image mixing unit 366 mixes the left eye displacement image LDI and the right eye displacement image RDI selectively supplied from the first and second selection units 365, thereby mixing images as shown in FIG. 2. A FI is generated and the generated mixed image FI is supplied to the display module 400.

Meanwhile, in FIG. 6, the control module 300 controls the exposure of the imaging module 100 based on the exposure value provided from the impulse signal analyzer 240 and / or light quantity information FLI of the flash (not shown). And / or a flash controller (not shown) for adjusting the amount of light of the flash.

In addition, in FIG. 6, the control module 300 adjusts the white balance of the subject image PI according to the characteristic information PCI of the subject 10 provided from the impulse signal analyzer 240. It may be configured to further include an image correction unit (not shown).

1 and 7, the display module 400 is a left eye sequentially supplied from the control module 300, that is, the first and second selectors 364 and 365 of the stereoscopic image output unit 359 (see FIG. 8). Displacement image LDI and right eye displacement image RDI are sequentially displayed on a display panel (not shown), or a mixed image supplied from the displacement image mixing unit 366 (see FIG. 8) of the stereoscopic image output unit 359 (see FIG. 8). By displaying FI on the display panel, a stereoscopic image SI is displayed on the display panel. The display panel may be a liquid crystal display, a light emitting diode display, or a field emission display.

10 is a flowchart for explaining a method of driving a 3D image camera apparatus according to an embodiment of the present invention step by step.

Referring to FIG. 10 in conjunction with FIGS. 1 and 2, the driving method of the stereoscopic camera apparatus according to the embodiment of the present invention described above will be described as follows.

First, an impulse signal IS is generated and transmitted to the subject 10 (S0). Here, the impulse signal IS may be transmitted to the subject 10 through an ultra wide band (UWB) wireless communication technology.

Then, it is determined whether the impulse signal (RIS) is received within a predetermined reference time (S1).

If it is determined in step S1 that the impulse signal RIS has been received within the reference time (YES in S1), the response characteristic of the received impulse signal RIS is analyzed to propagate the delay time Tpd of the impulse signal RIS. , And based on the calculated propagation delay time Tpd, the subject depth PDepth is detected as in Equation 1 (S2).

If it is determined in step S1 that the impulse signal RIS is not received within the reference time (No in S1), it means that the subject 10 is at a long distance, so that the focus of the lens 120 is set to infinity. The lens 120 is moved.

Then, the focus of the lens is adjusted to correspond to the detected subject depth PDepth to capture the subject 10 according to the subject depth PDepth to generate a subject image PI (S3).

Then, the X-axis displacement XD is generated based on the subject depth PDepth (S4). Here, the X-axis displacement XD generates the X-axis displacement XD based on the disparity x1-x2 according to the object depth PDepth through Equation 8 described above.

Thereafter, the subject image PI is image shifted in the ± X-axis direction by the X-axis displacement XD to generate a left eye displacement image LDI and a right eye displacement image RDI, respectively (S5).

Then, the left eye displacement image (LDI) and the right eye displacement image (RDI) generated in step S5 are temporarily stored (S6).

Then, it is determined whether to display a stereoscopic image on the display module 400 (S7).

If it is determined in operation S7 that the stereoscopic image is displayed on the display module 400 (YES in S7), each of the temporarily stored left eye displacement image LDI and the right eye displacement image RDI are simultaneously displayed on the display module 400. It is determined whether or not to (S8).

If it is determined in step S7 that the stereoscopic image is not displayed on the display module 500 (No in S7), the storage module 500 stores the temporarily stored left eye displacement image (LDI) and right eye displacement image (RDI), respectively. Store in (S9).

In step S8, when it is determined that the temporarily stored left eye displacement image LDI and the right eye displacement image RDI are simultaneously displayed on the display module 400 (YES in S8), the temporarily stored left eye displacement image LDI and the left eye displacement image LDI and A mixed image FI obtained by mixing a left eye displacement image LDI and a right eye displacement image RDI into a right eye displacement image RDI is generated (S10).

Thereafter, the mixed image FI generated in operation S10 is supplied to the display module 400 to display the subject 10 as a stereoscopic image SI on the display panel (S11).

If it is determined in step S8 that the temporary stored left eye displacement image LDI and the right eye displacement image RDI are not simultaneously displayed on the display module 400 (No in S8), the temporarily stored left eye displacement image LDI is not displayed at the same time. ) And the right eye displacement image RDI are sequentially output to the display module 400 (S12).

Then, the left eye displacement image LDI and the right eye displacement image RDI sequentially output in step S12 are sequentially displayed on the display panel, thereby displaying the subject 10 as a stereoscopic image SI on the display panel (S11). .

As described above, the stereoscopic camera apparatus and the driving method thereof according to the embodiment of the present invention generate the subject image PI by capturing the subject 10 by using one image sensor 110 and one lens 120. In addition, the object depth PDepth corresponding to the physical distance between the imaging module 100 and the subject 10 is detected by using the impulse signal IS, and the X-axis displacement corresponding to the disparity by using the subject depth PDepth. After generating (XD), the subject image (PI) is shifted in the ± X axis direction according to the X-axis displacement (XD) to generate a left eye displacement image (LDI) and a right eye displacement image (RDI), respectively. The object 10 may be displayed by sequentially displaying the LDI and the right eye displacement image RDI on the display panel, or by displaying the mixed image FI mixed with the left eye displacement image LDI and the right eye displacement image RDI on the display panel. May be displayed as a stereoscopic image (SI).

Accordingly, the stereoscopic camera apparatus and its driving method according to an embodiment of the present invention is a stereoscopic image of the subject image (PI) by using one image sensor 110, one lens 120, and the impulse signal (IS). In order to reduce the overall volume of the device can be made slimmer.

Those skilled in the art to which the present invention pertains will understand that the present invention can be implemented in other specific forms without changing the technical spirit or essential features. Therefore, it is to be understood that the embodiments described above are exemplary in all respects and not restrictive. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

10: subject 100: imaging module
110: image sensor 120: lens
130: image generating unit 140: lens driving unit
200: subject depth detection module 300: control module
400: display module 500: storage module

Claims (19)

A subject depth detection module configured to detect a subject depth corresponding to the distance of the subject by transmitting and receiving an impulse signal;
An imaging module configured to photograph the subject according to the subject depth by using one image sensor and one lens to generate a subject image;
A control module for converting the subject image into a stereoscopic image based on the subject depth; And
And a display module for displaying the stereoscopic image supplied from the control module. The method of claim 1,
The subject depth detection module,
An impulse signal generator for generating the impulse signal;
An impulse signal transmitter to transmit the impulse signal to the subject;
An impulse signal receiver configured to receive an impulse signal reflected by the subject and returned;
An impulse signal analyzer for detecting a propagation delay time by analyzing the received impulse signal; And
And a subject depth detector to detect the subject depth based on the propagation delay time. The method of claim 1,
And the subject depth detection module is configured to transmit and receive the impulse signal using ultra wide band wireless communication. The method of claim 1,
The control module generates an X-axis displacement based on the subject depth, and shifts the subject image in the ± X-axis direction by the generated X-axis displacement to generate a left-eye displacement image and a right-eye displacement image. And an image processor which provides the stereoscopic image corresponding to the image and the right eye displacement image to the display module. The method of claim 4, wherein
The image processing unit,
An X-axis displacement generating unit generating the X-axis displacement based on the subject depth;
A displacement image generator configured to shift the subject image by the X-axis displacement in the ± X-axis direction to generate a left eye displacement image and a right eye displacement image, respectively; And
And a stereoscopic image output unit configured to sequentially output the left eye displacement image and the right eye displacement image to the display module, or to output a mixed image of the left eye displacement image and the right eye displacement image to the display module. Video camera device. The method of claim 5, wherein
The display module displays the stereoscopic image on the display panel by sequentially displaying the left eye displacement image and the right eye displacement image output from the stereoscopic image output unit on the display panel, or by displaying the mixed image. Camera device. The method of claim 5, wherein
The X-axis displacement generating unit obtains a constant k (where k is a natural number) by multiplying the set binocular parallax and the focal length of the lens, and calculates a disparity value by dividing a constant k value by the subject depth. And generating half of the calculated disparity value as the X-axis displacement. The method of claim 5, wherein
The stereoscopic image output unit,
A synchronization signal multiplication unit for multiplying the first frame synchronization signal by two times to generate a second frame synchronization signal;
A synchronization signal selection unit for selectively outputting the first frame synchronization signal or the second frame synchronization signal according to a display control signal according to a user's setting;
An image output signal generator configured to generate first and second image output signals corresponding to the first frame synchronization signal or the second frame synchronization signal supplied from the synchronization signal selector;
A displacement image mixer configured to generate the mixed image by mixing the left eye displacement image and the right eye displacement image supplied according to the first and second image output signals, and supply the generated mixed image to the display module;
A first selector configured to supply the left eye displacement image to the display module or the displacement image mixer according to the first image output signal; And
And a second selector configured to supply the right eye displacement image to the display module or the displacement image mixing unit according to the second image output signal. The method of claim 8,
The image output signal generator,
When the first frame synchronization signal is supplied from the synchronization signal selector, the first and second image output signals having the same logic state are generated to display the mixed image on the display panel.
When the second frame synchronization signal is supplied from the synchronization signal selector, the first and second image output signals having a logic state inverted from each other so that the left eye displacement image and the right eye displacement image are sequentially displayed on the display panel. Stereoscopic camera device, characterized in that for generating. The method of claim 1,
And the control module controls the position of the lens to adjust the focus of the lens according to the depth of the subject. Detecting a subject depth corresponding to a distance of the subject by transmitting and receiving an impulse signal;
Photographing the subject according to the subject depth by using one image sensor and one lens to generate a subject image;
Converting the subject image into a stereoscopic image based on the subject depth;
And displaying the stereoscopic image on a display module or storing the stereoscopic image in a storage module. The method of claim 11,
Detecting the subject depth,
Generating the impulse signal;
Transmitting the impulse signal to the subject;
Receiving an impulse signal reflected and returned by the subject;
Analyzing the received impulse signal to detect a propagation delay time; And
And detecting the depth of the subject based on the propagation delay time. The method of claim 11,
The detecting of the depth of the subject may include transmitting and receiving the impulse signal using ultra wide band wireless communication. The method of claim 11,
Converting the subject image to a stereoscopic image,
Generating an X-axis displacement based on the subject depth;
Generating a left eye displacement image and a right eye displacement image by shifting the subject image in the ± X axis direction by the generated X axis displacement; And
And displaying the stereoscopic image corresponding to the left eye displacement image and the right eye displacement image on the display module or storing the stereoscopic image in the storage module. The method of claim 14,
The generating of the X-axis displacement may be performed by multiplying the set binocular parallax and the focal length of the lens to obtain a constant k (where k is a natural number) and dividing the constant k by the depth of the subject to disparity. After calculating the value, half of the calculated disparity value is generated as the X-axis displacement. The method of claim 14,
The displaying of the stereoscopic image on the display module may include sequentially displaying the left eye displacement image and the right eye displacement image on a display panel, or displaying a mixed image of the left eye displacement image and the right eye displacement image on the display panel. A driving method of a stereoscopic video camera device. The method of claim 14,
The displaying of the stereoscopic image on the display module may include:
Multiplying the first frame synchronization signal by two times to generate a second frame synchronization signal;
Selectively outputting the first frame synchronization signal or the second frame synchronization signal according to a display control signal according to a user setting;
Generating first and second image output signals corresponding to the first frame synchronization signal or the second frame synchronization signal, which are selectively output according to the display control signal; And
The left eye displacement image and the right eye displacement image are sequentially displayed on a display panel according to the logic state of the first and second image output signals, or a mixed image of the left eye displacement image and the right eye displacement image is displayed on the display panel. Method of driving a three-dimensional image camera device characterized in that it comprises a step. The method of claim 17,
The generating of the first and second video output signals may include:
When the first frame synchronization signal is selectively output according to the display control signal, generating the first and second image output signals having the same logic state so that the mixed image is displayed on the display panel,
When the second frame synchronization signal is selectively output according to the display control signal, the first and second images having a logic state inverted from each other such that the left eye displacement image and the right eye displacement image are sequentially displayed on the display panel. A driving method of a stereoscopic camera apparatus, characterized in that for generating an output signal. The method of claim 11,
The generating of the subject image may include controlling the position of the lens to adjust the focus of the lens according to the depth of the subject.

Images