KR102233446B1 - Apparatuses for measuring distance with psuedo 4 tap structure - Google Patents

Abstract

The present invention relates to a distance measuring device having a virtual 4-tap pixel structure, and the distance measuring device having a virtual 4-tap pixel structure according to an embodiment of the present invention includes a pixel array for measuring a distance of an object. The delta value of the first angle corresponding to the first row line is calculated through a delta sigma operation, and the delta value of the third angle corresponding to the second row line is calculated by performing the delta sigma operation. A delta sigma circuit to calculate, a memory for storing a delta value of a first angle corresponding to the calculated first row line, and a delta value of a first angle corresponding to the stored first row line And a calculator that calculates distance information corresponding to the first row line by using a delta value of a third angle corresponding to the second row line.

Description

Distance measuring device with virtual 4-tap pixel structure {APPARATUSES FOR MEASURING DISTANCE WITH PSUEDO 4 TAP STRUCTURE}

The present invention relates to a distance measuring apparatus having a virtual 4-tap pixel structure.

In recent years, as the demand for smartphones has increased rapidly, the development of an image sensor included therein has been actively made. The image sensor includes a plurality of pixels that convert photons of a certain spectral band into electrons.

In order to obtain a 3D image, it is necessary to obtain information about not only the color but also the depth between the object and the image sensor. Two methods are exemplarily known as a method of using an emitted light to acquire a depth image.

One is a triangulation method that uses the incident angle and the reflected angle by irradiating the irradiated light onto an object. The other is the Time of Flight (TOF) method, which uses the time to return after irradiation light is irradiated onto an object. The TOF method can generate a depth image in real time because the time required for measurement is shorter than that of the triangulation method. However, in the depth image generation of the TOF method, a depth value distortion due to saturation may occur due to, for example, a photographing distance being too short or an object having a large reflectivity.

Meanwhile, the Time of Flight (TOF) method includes a direct TOF method and an indirect TOF method.

1 to 3 are diagrams for explaining a general TOF method.

As shown in FIG. 1, light emitted from an infrared emitter is reflected by an object, which is a distance measurement object, and is received by a detector. At this time, the TOF method calculates the distance (R) by measuring the round trip time of the emitted light. A depth map for the object may be calculated from the calculated distance.

)가 반영된 수식

을 이용하여 거리(D)를 계산할 수 있다. As shown in FIG. 2, the direct TOF method detects light emitted from an IR Emitter through a sensor array composed of a single-photon avalanche diode. At this time, the controller is the contact time difference (

) Reflected formula

The distance (D) can be calculated using.

)가 반영된 수식

을 이용하여 거리(D)를 계산할 수 있다. As shown in FIG. 3, the indirect TOF method detects light emitted from an IR emitter through a sensor array composed of demodulation pixels or the like. At this time, the controller is not a direct time difference, but an indirect phase difference (

) Reflected formula

The distance (D) can be calculated using.

4 is a diagram for explaining a general pulse TOF.

, 돌아온 적외선(Returned IR)

및 수신된 광(Received Light)(IR+BGL)이 도 4에 도시되어 있다.Emitted IR

, Returned IR

And Received Light (IR+BGL) is shown in FIG. 4.

와 같이 나타낼 수 있다.The emitted IR can be represented by a square wave function. Photocurrent from received light is

It can be expressed as

After the emitted infrared rays reciprocate, light attenuation (A) and delay (θ) occur. In addition, background light (B) is generated by sunlight or indoor lighting. If, assuming that the background light B is 0, a delayed phase difference θ can be found using 2-phase demodulation, which is a simple demodulation method.

5 is a diagram for explaining a general two-phase demodulation method.

에 의해 변조된 전달 스위치 1(TX₁)의 파형,

에 의해 변조된 전달 스위치 2(TX₂)의 파형, 배경 광(BGL, Background light)이 도 5에 도시되어 있다. 스위치 1(TX₁) 및 스위치 2(TX₂)에 대응되는 전하량은 Q(0) 및 Q(π)이다. Emitted IR, Returned IR,

The waveform of the transfer switch 1 (TX _{1) modulated by}

The waveform of the transfer switch 2 (TX ₂ ) modulated by and background light (BGL) is shown in FIG. 5. The amount of charge corresponding to the switch 1 (TX ₁ ) and the switch 2 (TX ₂ ) is Q(0) and Q(π).

The phase shift θ can be easily calculated by the charge ratio as shown in [Equation 1] below.

Here, θ is the phase shift, Q(π) is _{the amount of charge from the transfer switch 2 (TX 2} ), and Q(0)+Q(π) is the total amount of charge.

However, if there is a background light (BGL), a 4-phase demodulation method is required.

6 and 7 are diagrams for explaining a general four-phase demodulation method.

에 의해 변조된 전달 스위치 1(TX₁)의 파형,

에 의해 변조된 전달 스위치 2(TX₂)의 파형이 도 6에 도시되어 있다.Emitted IR, Returned IR, Background light (BGL),

The waveform of the transfer switch 1 (TX _{1) modulated by}

The waveform of the transfer switch 2 (TX ₂ ) modulated by is shown in FIG. 6.

에서의 전하량 차이(

)는 하기의 [수학식 2]와 같이 계산된다.

The difference in the amount of charge at (

) Is calculated as shown in [Equation 2] below.

For example, the difference in the amount of charge at 0 is calculated as shown in [Equation 3] below.

를 가진다. 따라서 2개의 미지수를 풀기 위한 2개의 다른 전하량이 필요하다. If BGL(B, offset) is used, the offset is removed from both charges through the differential charge ΔQ. The differential charge ΔQ is the two unknowns A and

Have. Therefore, two different amounts of charge are needed to solve the two unknowns.

As shown in FIG. 7, θ can be uniquely determined from two differential electric charges ΔQ(0) and ΔQ(π/2). We can know θ up to 2π using 4 phases.

8 to 10 are views for explaining the operation of the conventional delta sigma BGL suppression apparatus.

A conventional delta sigma suppression apparatus suppresses background light (BGL) through a delta sigma operation using data of two frames, frame #1 and frame #2.

Looking at the operation of frame #1, the pixel 110 receives the modulated pulse and transmits the signal integrated to the FD (Floating Diffusion) node by _{TX 1} (0) and TX _{2 (π) as a source follower.} It outputs as V(0) and V(π) through.

The analog delta sigma (Analog ΔΣ) circuit 120 prevents saturation by BGL through a delta sigma operation and outputs ΔV(0).

The ADC (Analog to Digital Converter) 130 converts ΔV(0) into a digital code. The converted code ΔV(0) is stored in the memory 140.

On the other hand, looking at the operation of frame #2, the pixel 110 receives the modulated pulse and transmits a signal integrated to the FD (Floating Diffusion) node by _{TX 1} (π/2) and TX _{2 (3π/2).} It outputs as V(π/2) and V(3π/2) through the source follower.

The analog delta sigma (Analog ΔΣ) circuit 120 prevents saturation by BGL through a delta sigma operation and outputs ΔV (π/2).

The ADC (Analog to Digital Converter) 130 converts ΔV(π/2) into a digital code.

The arithmetic logic unit (ALU) 150 converts the distance information into distance information using the code ΔV(0) stored in the memory 140 of frame #1 and the code ΔV(π/2) output from the ADC 130. .

As shown in FIG. 10, when there is a frame #1 (Frame #1) and a frame #2 (Frame #2), ΔV(0) and ΔV(π/2) required for distance information conversion can be obtained.

The conventional delta sigma BGL suppression method requires ΔV(0) and ΔV(π/2), respectively, so the number of pixel arrays is multiplied by the bit of the ADC. Is required, which requires as much area as the frame memory.

As described above, in the operation for removing background light based on a 2-tap pixel, conventionally, data of two frames are required and a large amount of memory is required. Accordingly, the consumption of the area due to the increase in memory was large. In addition, the frame rate of the system is low, which is not good in terms of speed.

In general, in a circuit system, the higher the frame rate, the better and the smaller the chip in terms of mass production, the lower the cost. These two ideas can reduce the area and improve the system performance by increasing the operating speed.

Accordingly, embodiments of the present invention do not use a frame memory and thus do not use a large area, and calculate the depth information using one frame data, thereby reducing the frame rate. It is an object to provide a distance measuring device with a virtual 4-tap pixel structure that can be improved.

According to an embodiment of the present invention, a delta value of a first angle corresponding to a first row line of a pixel array for measuring an object distance is determined through a delta sigma operation. A delta sigma circuit that calculates and calculates a delta sigma operation on a delta value of a third angle corresponding to the second row line; A memory for storing a delta value of a first angle corresponding to the calculated first row line; And calculating distance information corresponding to the first row line using the stored delta value of a first angle corresponding to the stored first row line and the calculated delta value of a third angle corresponding to the second row line. A distance measuring apparatus having a virtual 4-tap pixel structure may be provided, including an operator.

The apparatus further includes a converter for converting a delta value of a first angle corresponding to the calculated first row line and a delta value of a third angle corresponding to the calculated second row line into a digital code. I can.

The delta sigma circuit may perform a delta sigma operation using voltage values at first and second angles generated by a modulation pulse in a first row line of the pixel array.

The delta sigma circuit may perform a delta sigma operation using voltage values at third and fourth angles generated by modulation pulses in a second row line of the pixel array.

The pixel array may have a structure in which the first row line and the second row line are alternately repeated.

The memory stores a delta value of a first angle corresponding to a first row line of the pixel array, and after the stored delta value of the first angle is calculated by the operator, a second row of the pixel array The delta value of the third angle corresponding to the line may be stored.

The calculator calculates distance information corresponding to the second row line using a delta value of a third angle corresponding to the stored second row line and a delta value of a first angle corresponding to the third row line. can do.

Meanwhile, according to another embodiment of the present invention, a delta sigma operation is performed on a delta value of a first angle corresponding to a first row line of a pixel array for measuring a distance of an object. A delta sigma circuit for calculating a delta sigma operation by calculating a delta value of a third angle corresponding to the second row line; A memory for storing a delta value of a first angle corresponding to the calculated first row line; And a line in which first and second row lines are merged using a delta value of a first angle corresponding to the stored first row line and a delta value of a third angle corresponding to the calculated second row line. A distance measuring apparatus having a virtual 4-tap pixel structure may be provided, including a calculator that calculates distance information corresponding to.

The apparatus further includes a converter for converting a delta value of a first angle corresponding to the calculated first row line and a delta value of a third angle corresponding to the calculated second row line into a digital code. I can.

The delta sigma circuit may perform a delta sigma operation using voltage values at first and second angles generated by a modulation pulse in a first row line of the pixel array.

The delta sigma circuit may perform a delta sigma operation using voltage values at third and fourth angles generated by modulation pulses in a second row line of the pixel array.

The pixel array may have a structure in which the first row line and the second row line are alternately repeated.

The calculator may calculate distance information corresponding to a line in which the first and second row lines are merged, and then calculate distance information corresponding to the merged line by two row lines.

Meanwhile, according to another embodiment of the present invention, a delta value of a first angle corresponding to a first row line of a pixel array for measuring an object distance is calculated, and a third angle corresponding to the second row line is calculated. A delta sigma circuit that calculates a delta value and calculates a delta value of a first angle corresponding to the third row line; To store the calculated delta value of the first angle corresponding to the first row line, the delta value of the third angle corresponding to the second row line, and the delta value of the first angle corresponding to the third row line Memory; And a delta value of a first angle corresponding to a second row line by interpolating a delta value of a first angle corresponding to the stored first row line and a delta value of a first angle corresponding to the third row line. Distance information corresponding to the second row line by using a delta value of a first angle corresponding to the restored second row line and a delta value of a third angle corresponding to the stored second row line A distance measuring apparatus having a virtual 4-tap pixel structure may be provided, including an operator that calculates.

The device corresponds to a delta value of a first angle corresponding to the calculated first row line, a delta value of a third angle corresponding to the calculated second row line, and the calculated third row line It may further include a converter for converting the delta value of the first angle to a digital code.

The delta sigma circuit may perform a delta sigma operation using voltage values at first and second angles generated by a modulation pulse in a first row line of the pixel array.

The delta sigma circuit may perform a delta sigma operation using voltage values at third and fourth angles generated by modulation pulses in a second row line of the pixel array.

The pixel array may have a structure in which the first row line and the second row line are alternately repeated.

The delta sigma circuit calculates a delta value of a third angle corresponding to a fourth row line, and the calculator includes a delta value of a third angle corresponding to the stored second row line and the calculated fourth The delta value of the third angle corresponding to the third row line may be restored by interpolating the delta value of the third angle corresponding to the third row line.

The operator uses a delta value of a third angle corresponding to the restored third row line and a delta value of a first angle corresponding to the stored third row line, and the distance corresponding to the third row line Information can be computed.

The apparatus may further include an alternate phase driver that performs an alternate phase operation for alternately outputting different phases to the same row line for each frame.

The operator detects the occurrence of motion by comparing the pixel data difference with a preset threshold, and uses the distance calculated as one frame for the part where the motion occurs, and calculates as two frames for the part where the motion does not occur. Hybrid depth imaging using one distance can be performed.

The calculator may calculate weight of edges by adding differences between delta values of a specific angle in adjacent row lines, and interpolate a portion where an edge is generated using edge coefficients calculated from the edge degrees. .

Embodiments of the present invention do not use a frame memory and thus do not use a large area, and by calculating depth information using one frame data, the frame rate can be improved. have.

1 to 3 are diagrams for explaining a general TOF method.
4 is a diagram for explaining a general pulse TOF.
5 is a diagram for explaining a general two-phase demodulation method.
6 and 7 are diagrams for explaining a general four-phase demodulation method.
8 to 10 are views for explaining the operation of the conventional delta sigma BGL suppression apparatus.
11 is a diagram for explaining a delta sigma BGL suppression operation used in embodiments of the present invention.
12 is a diagram illustrating a delta sigma BGL suppression circuit used in embodiments of the present invention.
13 and 14 are configuration diagrams for explaining the configuration of a distance measuring apparatus having a virtual 4-tap pixel structure according to an embodiment of the present invention.
15 is a diagram illustrating an operation of a distance measuring apparatus having a virtual 4-tap pixel structure according to another embodiment of the present invention.
16 is a diagram illustrating an operation of a distance measuring apparatus having a virtual 4-tap pixel structure according to another embodiment of the present invention.
17 to 19 are diagrams illustrating an operation of an alternate phase driver in a distance measuring apparatus having a virtual 4-tap pixel structure according to another exemplary embodiment of the present invention.
20 and 21 are diagrams illustrating a hybrid distance imaging operation in a distance measuring apparatus having a virtual 4-tap pixel structure according to another embodiment of the present invention.
22 to 24 are diagrams illustrating an edge-enhanced interpolation operation in a distance measuring apparatus having a virtual 4-tap pixel structure according to another embodiment of the present invention.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail.

However, this is not intended to limit the present invention to a specific embodiment, it should be understood to include all changes, equivalents, or substitutes included in the spirit and scope of the present invention.

Terms such as first and second may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The term and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. It should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, terms such as "comprise" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof does not preclude in advance.

Unless otherwise defined, all terms used herein including technical or scientific terms have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in the present application. Does not.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. In describing the present invention, in order to facilitate an overall understanding, the same reference numerals are used for the same elements in the drawings, and duplicate descriptions for the same elements are omitted.

11 is a diagram for explaining a delta sigma BGL suppression operation used in embodiments of the present invention.

11, the demodulation pixel is connected to a periodic RST (Periodic RST) and transfer switches TX1 and TX2, and V ₁ voltage (V ₁ =V _COM +V _SIG /2) and V ₂ (V ₂ = V _COM -V _SIG /2) Output voltage. The differential integrator _{calculates the V SIG} voltage through the common mode rejection operation for the _{input voltage V 1} and the V ₂ voltage, and calculates the output voltage V _OUT through the frame memory operation. Print it out.

The delta sigma BGL suppression operation divides the _{initial time T int} by a number of sub-integration times T _sub. The delta sigma BGL suppression operation reads the charge quantities Q ₀ and Q _{180 at 0 degrees at each sub integration time T sub} to obtain a differential charge quantity ΔQ. And the delta sigma BGL suppression operation accumulates the differential charge amount ΔQ into an analog memory.

12 is a diagram illustrating a delta sigma BGL suppression circuit used in embodiments of the present invention.

The delta sigma BGL suppression circuit contains four sample & hold circuits, and outputs _{SIG 1} , RST ₁ , SIG ₂ and RST _2.

The output SIG ₁ , RST ₁ , SIG ₂ and RST ₂ are summed by the capacitive feedback amplifier. Looking at double-sampling, V ₁ = RST ₁ -SIG ₁ and V ₂ = RST ₂ -SIG ₂ are the same. Delta operation is the same as V ₁ -V ₂ = (RST ₁ -SIG ₁ )-(RST ₂ -SIG ₂ ). Sigma operation is accumulated in a feedback cap, which is an analog memory.

13 and 14 are configuration diagrams for explaining the configuration of a distance measuring apparatus having a virtual 4-tap pixel structure according to an embodiment of the present invention.

As shown in FIG. 13, a distance measuring apparatus having a virtual 4-tap pixel structure according to an embodiment of the present invention includes a pixel array 210, a delta sigma circuit 220, a converter 230, a memory 240, and It includes a calculator (250). However, not all of the illustrated components are essential components. A distance measuring device having a virtual 4-tap pixel structure may be implemented by more components than the illustrated components, and a distance measuring device having a virtual 4-tap pixel structure may be implemented by fewer components.

Hereinafter, a detailed configuration and operation of each component of the apparatus for measuring a distance having a virtual 4-tap pixel structure of FIG. 13 will be described.

The pixel array 210 includes an even-numbered pixel (Pixel even) corresponding to row X (ROW<x>) and an odd-numbered pixel (Pixel odd) corresponding to row X-1 (ROW<x-1>). . In the pixel array 210, an even-numbered pixel (Pixel even) corresponding to row X (ROW<x>) and an odd-numbered pixel (Pixel odd) corresponding to row X-1 (ROW<x-1>) are alternately It has a repeating structure. That is, the pixel array 210 may have a structure in which a first row line and a second row line are alternately repeated. The pixel array 210 generates voltage values at first and second angles by a modulation pulse at the first pixel. Further, the pixel array 210 generates voltage values at third and fourth angles by a modulation pulse in the second pixel. Here, if the first pixel is an even-numbered pixel, the second pixel is an odd-numbered pixel, and if the first pixel is an odd-numbered pixel, the second pixel is an even-numbered pixel. The first angle may be 0 degrees, the second angle may be 90 degrees (π/2), the third angle may be 180 degrees (π), and the fourth angle may be 270 degrees (3π/2). For example, the pixel array 210 may generate voltage values V(0) and V(π) at 0 degrees and 180 degrees (π) by a modulation pulse in the first pixel. Further, the pixel array 210 has voltage values V(π/2) and V(3π) at 90 degrees (π/2) and 270 degrees (3π/2) by a modulation pulse at the second pixel. /2) can be created.

The delta sigma circuit 220 calculates a delta value of a first angle corresponding to a first row line of a pixel array for measuring an object distance through a delta sigma operation. . In addition, the delta sigma circuit 220 calculates a delta sigma operation using a delta value of a third angle corresponding to the second row line. Here, the delta sigma circuit may perform a delta sigma operation using voltage values at first and second angles generated by a modulation pulse in the first row line of the pixel array 210. The delta sigma circuit may perform a delta sigma operation using voltage values at third and fourth angles generated by modulation pulses in the second row line of the pixel array 210. For example, the delta sigma circuit 220 calculates a delta value ΔV(0) of 0 degrees corresponding to an even-numbered pixel corresponding to row X (ROW<x>) through a delta sigma operation. can do. The delta sigma circuit 220 converts a delta value ΔV(π/2) of 90 degrees (π/2) corresponding to an odd-numbered pixel (Pixel odd) corresponding to row X (ROW<x-1>) to a delta sigma ( Delta sigma) operation.

The converter 230 includes a delta value of a first angle corresponding to the first row line calculated by the delta sigma circuit 220 and a third angle corresponding to the second row line calculated by the delta sigma circuit 220. Convert the delta value to a digital code. For example, the converter 230 may convert a delta value of 0 degrees ΔV(0) into a code ΔV(0) through an analog-to-digital conversion operation. The converter 230 may convert a delta value ΔV (π/2) of 90 degrees (π/2) into a code ΔV (π/2) through an analog-digital conversion operation.

The memory 240 stores a delta value of a first angle corresponding to the first row line converted by the converter 230. Here, the memory 240 may be implemented as a line memory.

The operator 250 uses a delta value of a first angle corresponding to the first row line stored in the memory 240 and a delta value of a third angle corresponding to the second row line converted by the converter 230. Distance information corresponding to the first row line is calculated.

Thereafter, the memory 240 stores a delta value of a first angle corresponding to the first row line of the pixel array 210. After the stored delta value of the first angle is calculated by the operator, the memory 240 may store the delta value of the third angle corresponding to the second row line of the pixel array 210.

In addition, the operator 250 uses a delta value of a third angle corresponding to the second row line stored in the memory 240 and a delta value of a first angle corresponding to the third row line to the second row line. Corresponding distance information can be calculated. Thereafter, the distance measuring apparatus having a virtual 4-tap pixel structure includes a delta value of a first angle corresponding to a first row line calculated through a delta sigma operation for each alternately repeated pixel, and a second row line corresponding to the second row line. Distance information corresponding to the first row line may be calculated using a delta value of 3 angles.

Referring to FIG. 14, an operation of a distance measuring apparatus having a virtual 4-tap pixel structure according to an embodiment of the present invention will be described.

The pixel array 210 has a voltage value V(0) at 0 degrees and 180 degrees (π) by a modulation pulse at an even-numbered pixel (Pixel even) corresponding to row 0 (ROW<0>), and V(π) can be generated from column COL <0> to column COL <X>, respectively. Here, it is not limited to an even-numbered pixel (Pixel even), 0 degrees and 180 degrees (π), but may be an odd-numbered pixel (Pixel odd), 90 degrees (π/2), and 270 degrees (3π/2). .

In addition, the delta sigma circuit 220 corresponds to row 0 (ROW<0>) through a delta sigma operation using voltage values V(0) and V(π) generated by the pixel array 210. A delta value ΔV(0) of 0 degrees corresponding to an even-numbered pixel (Pixel even) may be calculated. Here, it is not limited to an even-numbered pixel (Pixel even), 0 degrees, and may be an odd-numbered pixel (Pixel odd) and 90 degrees (π/2).

Subsequently, the converter 230 may convert the delta value ΔV(0) of 0 degrees into the code ΔV(0) through an analog-to-digital conversion operation. Here, it is not limited to a delta value ΔV(0) of 0 degrees, but may be a delta value ΔV(π/2) of 90 degrees (π/2).

The memory 240 may store the code ΔV(0) converted by the converter 230.

Thereafter, the pixel array 210 is 90 degrees (π/2) and 270 degrees (3π/2) by a modulation pulse at an odd-numbered pixel (Pixel odd) corresponding to row 1 (ROW<1>). The voltage values V(π/2) and V(3π/2) at may be generated from column COL <0> to column COL <X>, respectively. Here, it is not limited to an odd-numbered pixel (Pixel odd), 90 degrees (π/2), and 270 degrees (3π/2), and may be an even-numbered pixel (Pixel even), 0 degrees, and 180 degrees (π). .

In addition, the delta sigma circuit 220 performs a delta sigma operation using voltage values V(π/2) and V(3π/2) generated by the pixel array 210, and the row 1 (ROW<1>). A delta value ΔV(π/2) of 90 degrees (π/2) corresponding to an odd-numbered pixel corresponding to) may be calculated. Here, it is not limited to an odd-numbered pixel (Pixel odd) and 90 degrees (π/2), but may be an even-numbered pixel (Pixel even) and 0 degrees.

Subsequently, the converter 230 may convert the delta value ΔV (π/2) of 90 degrees (π/2) into a code ΔV (π/2) through an analog-digital conversion operation. Here, it is not limited to a delta value ΔV(π/2) of 90 degrees (π/2), but may be a delta value ΔV(0) of 0 degrees.

The operator 250 corresponds to a code ΔV(0) that is a delta value of 0 degrees corresponding to row 0 (ROW<0>) stored in the memory 240 and a row 1 (ROW<1>) converted by the converter 230. Distance information corresponding to row 0 (ROW<0>) can be calculated using a delta value ΔV(π/2) of 90 degrees (π/2).

Thereafter, the memory 240 may store the code ΔV (π/2) converted by the converter 230.

In addition, the distance measuring device with a virtual 4-tap pixel structure uses a delta sigma operation using voltage values V(0) and V(π) corresponding to row 2 (ROW<2>), resulting in a delta value of 0 degrees. ΔV(0) can be calculated and converted into a code ΔV(0) through an analog-to-digital conversion operation. In addition, the distance measuring device with a virtual 4-tap pixel structure uses the code ΔV(π/2) stored in the memory 240 and the code ΔV(0) corresponding to the row 2 (ROW<2>). Distance information corresponding to 1>) can be calculated.

Thereafter, the distance measuring apparatus with a virtual 4-tap pixel structure calculates distance information corresponding to row 0 (ROW<0>) and calculates distance information corresponding to row 1 (ROW<1>), Distance information corresponding to the remaining rows can be calculated up to row X (ROW<X>).

15 is a diagram illustrating an operation of a distance measuring apparatus having a virtual 4-tap pixel structure according to another embodiment of the present invention.

The pixel array 210 generates voltage values at first and second angles by a modulation pulse at the first pixel. Further, the pixel array 210 generates voltage values at third and fourth angles by a modulation pulse in the second pixel. The pixel array 210 may have a structure in which a first row line and a second row line are alternately repeated.

The delta sigma circuit 220 calculates a delta value of a first angle corresponding to a first row line of a pixel array for measuring an object distance through a delta sigma operation. . In addition, the delta sigma circuit 220 calculates a delta sigma operation using a delta value of a third angle corresponding to the second row line. Here, the delta sigma circuit 220 performs a delta sigma operation using voltage values at first and second angles generated by a modulation pulse in the first row line of the pixel array 210. I can. The delta sigma circuit 220 may perform a delta sigma operation using voltage values at third and fourth angles generated by modulation pulses in the second row line of the pixel array 210.

The converter 230 includes a delta value of a first angle corresponding to the first row line calculated by the delta sigma circuit 220 and a third angle corresponding to the second row line calculated by the delta sigma circuit 220. Convert the delta value to a digital code.

The memory 240 stores a delta value of a first angle corresponding to the first row line converted by the converter 230. Here, the memory 240 may be implemented as a line memory.

The operator 250 uses a delta value of a first angle corresponding to the first row line stored in the memory 240 and a delta value of a third angle corresponding to the second row line converted by the converter 230. Distance information corresponding to a line in which the first and second row lines are merged is calculated. The calculator 250 may calculate distance information corresponding to a line in which the first and second row lines are merged, and then calculate distance information corresponding to the merged line by two row lines. The distance measuring apparatus having a virtual 4-tap pixel structure may perform a delta sigma operation in the same manner for the third row line and the fourth row line in which the first row line and the second row line are repeated. Through this, the distance measuring apparatus having a virtual 4-tap pixel structure uses the delta value of the first angle corresponding to the third row line and the delta value of the third angle corresponding to the fourth row line. Distance information corresponding to the line to which the fourth row line is merged may be calculated.

Referring to FIG. 15, an operation of a distance measuring apparatus having a virtual 4-tap pixel structure according to another embodiment of the present invention will be described.

The pixel array 210 has a voltage value V(0) at 0 degrees and 180 degrees (π) by a modulation pulse at an even-numbered pixel (Pixel even) corresponding to row 0 (ROW<0>), and V(π) can be generated from column COL <0> to column COL <X>, respectively.

In addition, the delta sigma circuit 220 corresponds to row 0 (ROW<0>) through a delta sigma operation using voltage values V(0) and V(π) generated by the pixel array 210. A delta value ΔV(0) of 0 degrees corresponding to an even-numbered pixel (Pixel even) may be calculated.

Subsequently, the converter 230 may convert the delta value ΔV(0) of 0 degrees into the code ΔV(0) through an analog-to-digital conversion operation.

The memory 240 may store the code ΔV(0) converted by the converter 230.

Thereafter, the pixel array 210 is 90 degrees (π/2) and 270 degrees (3π/2) by a modulation pulse at an odd-numbered pixel (Pixel odd) corresponding to row 1 (ROW<1>). The voltage values V(π/2) and V(3π/2) at may be generated from column COL <0> to column COL <X>, respectively.

In addition, the delta sigma circuit 220 performs a delta sigma operation using voltage values V(π/2) and V(3π/2) generated by the pixel array 210, and the row 1 (ROW<1>). A delta value ΔV(π/2) of 90 degrees (π/2) corresponding to an odd-numbered pixel corresponding to) may be calculated.

Subsequently, the converter 230 may convert the delta value ΔV (π/2) of 90 degrees (π/2) into a code ΔV (π/2) through an analog-digital conversion operation.

The operator 250 corresponds to a code ΔV(0) that is a delta value of 0 degrees corresponding to row 0 (ROW<0>) stored in the memory 240 and a row 1 (ROW<1>) converted by the converter 230. A delta value of 90 degrees (π/2) ΔV(π/2) can be used to calculate distance information corresponding to the row line where row 0 (ROW<0>) and row 1 (ROW<1>) are merged. have.

Thereafter, the distance measuring device having a virtual 4-tap pixel structure calculates distance information corresponding to the line in which row 0 (ROW<0>) and row 1 (ROW<1>) are merged. <2>) and row 3 (ROW<3>) may calculate distance information corresponding to the merged line. That is, the distance measuring apparatus having a virtual 4-tap pixel structure may calculate distance information corresponding to the merged line by grouping two row lines into a pair.

16 is a diagram illustrating an operation of a distance measuring apparatus having a virtual 4-tap pixel structure according to another embodiment of the present invention.

The pixel array 210 generates voltage values at first and second angles by a modulation pulse at the first pixel. Further, the pixel array 210 generates voltage values at third and fourth angles by a modulation pulse in the second pixel. Also, the pixel array 210 generates voltage values at first and second angles by a modulation pulse in the third pixel. The pixel array 210 may have a structure in which a first row line and a second row line are alternately repeated.

The delta sigma circuit 220 calculates a delta value of a first angle corresponding to the first row line of the pixel array 210 for measuring the distance of an object, and calculates a delta value of a third angle corresponding to the second row line. A value is calculated, and a delta value of a first angle corresponding to the third row line is calculated. The delta sigma circuit 220 may perform a delta sigma operation using voltage values at first and second angles generated by a modulation pulse in the first row line of the pixel array 210. . The delta sigma circuit 220 may perform a delta sigma operation using voltage values at third and fourth angles generated by modulation pulses in the second row line of the pixel array 210.

The converter 230 includes a delta value of a first angle corresponding to the first row line calculated by the delta sigma circuit 220, and a third angle corresponding to the second row line calculated by the delta sigma circuit 220. A delta value, a delta value of a first angle corresponding to the third row line calculated by the delta sigma circuit 220, and a delta value of a third angle corresponding to the second row line calculated by the delta sigma circuit 220 Convert to digital code.

The memory 240 includes a delta value of a first angle corresponding to the first row line converted by the converter 230, a delta value of a third angle corresponding to the second row line, and a third row line. The delta value of the first angle and the delta value of the third angle corresponding to the second row line are stored. Here, the memory 240 may be implemented as a line memory.

The operator 250 interpolates the delta value of the first angle corresponding to the first row line stored in the memory 240 and the delta value of the first angle corresponding to the third row line to correspond to the second row line. The delta value of the first angle is restored. Further, the operator 250 uses the delta value of the first angle corresponding to the restored second row line and the delta value of the third angle corresponding to the second row line stored in the memory 240. Calculate distance information for the row's pixels.

Thereafter, the pixel array 210 may generate voltage values at the third and fourth angles by a modulation pulse in the fourth pixel.

In addition, the delta sigma circuit 220 may calculate a delta value of a third angle corresponding to the fourth row line.

Thereafter, the operator 250 includes a delta value of a third angle corresponding to the second row line stored in the memory 240 and a delta of a third angle corresponding to the fourth row line calculated by the delta sigma circuit 220. The delta value of the third angle corresponding to the third row line may be restored by interpolating the values.

Further, the operator 250 uses the delta value of the third angle corresponding to the restored third row line and the delta value of the first angle corresponding to the third row line stored in the memory 240 to determine the third row. Distance information for the pixels of can be calculated.

Referring to FIG. 16, an operation of a distance measuring apparatus having a virtual 4-tap pixel structure according to another embodiment of the present invention will be described.

The pixel array 210 has a voltage value V(0) at 0 degrees and 180 degrees (π) by a modulation pulse at an even-numbered pixel (Pixel even) corresponding to row 0 (ROW<0>), and V(π) can be generated from column COL <0> to column COL <X>, respectively.

In addition, the delta sigma circuit 220 corresponds to row 0 (ROW<0>) through a delta sigma operation using voltage values V(0) and V(π) generated by the pixel array 210. A delta value ΔV(0) of 0 degrees corresponding to an even-numbered pixel (Pixel even) may be calculated.

Subsequently, the converter 230 may convert the delta value ΔV(0) of 0 degrees into the code ΔV(0) through an analog-to-digital conversion operation.

The memory 240 may store the code ΔV(0) corresponding to the row 0 (ROW<0>) converted by the converter 230.

Thereafter, the pixel array 210 is 90 degrees (π/2) and 270 degrees (3π/2) by a modulation pulse at an odd-numbered pixel (Pixel odd) corresponding to row 1 (ROW<1>). The voltage values V(π/2) and V(3π/2) at may be generated from column COL <0> to column COL <X>, respectively.

In addition, the delta sigma circuit 220 performs a delta sigma operation using voltage values V(π/2) and V(3π/2) generated by the pixel array 210, and the row 1 (ROW<1>). A delta value ΔV(π/2) of 90 degrees (π/2) corresponding to an odd-numbered pixel corresponding to) may be calculated.

Subsequently, the converter 230 may convert the delta value ΔV (π/2) of 90 degrees (π/2) into a code ΔV (π/2) through an analog-digital conversion operation.

The memory 240 may store a code ΔV(π/2) corresponding to row 1 (ROW<1>) converted by the converter 230.

Thereafter, the distance measuring apparatus having a virtual 4-tap pixel structure may calculate a delta value ΔV(0) corresponding to row 2 (ROW<2>).

In step P1, the operator 250 stores a delta value ΔV(0) corresponding to row 0 (ROW<0>) stored in the memory 240 and a delta value ΔV(0) corresponding to the calculated row 2 (ROW<2>). 0) may be interpolated to restore the delta value ΔV(0) corresponding to row 1 (ROW<1>). Further, the operator 250 includes a delta value ΔV(0) corresponding to the restored row 1 (ROW<1>) and a delta value ΔV(π/) corresponding to the row 1 stored in the memory 240 (ROW<1>). 2) can be used to calculate distance information corresponding to row 1 (ROW<1>). Here, the delta value ΔV(0) corresponding to row X (ROW<X>) cannot be restored.

Thereafter, the distance measuring apparatus with a virtual 4-tap pixel structure calculates a delta value ΔV(π/2) corresponding to row 3 (ROW<3>), and converts the calculated delta value ΔV(π/2). It can be stored in the memory 240.

In step P2, the operator 250 stores a delta value ΔV(π/2) corresponding to row 1 (ROW<1>) stored in the memory 240 and a delta value corresponding to the calculated row 3 (ROW<3>). By interpolating ΔV(π/2), a delta value ΔV(π/2) corresponding to row 2 (ROW<2>) may be restored. Further, the operator 250 includes a delta value ΔV(π/2) corresponding to the restored row 2 (ROW<2>) and a delta value ΔV( 0) can be used to calculate distance information corresponding to row 2 (ROW<2>). This operation is repeatedly performed up to row X. Here, the delta value ΔV(π/2) corresponding to row 0 (ROW<0>) cannot be restored.

Meanwhile, the distance measuring apparatus having a virtual 4-tap pixel structure may calculate the delta value ΔV(0) by crossing one row line and store it in the memory 240 for interpolation of the delta value ΔV(0). For example, a distance measuring device with a virtual 4-tap pixel structure is row 2 (ROW<2>), row 4 (ROW<4>), ... The delta value ΔV(0) may be calculated and stored in the memory 240 in the same order as the row X-1 (ROW<X-1>).

Similarly, the distance measuring apparatus of the virtual 4-tap pixel structure calculates the delta value ΔV(π/2) across one row line for interpolation of the delta value ΔV(π/2), and the memory 240 Can be saved on. For example, a distance measuring device with a virtual 4-tap pixel structure is row 3 (ROW<3>), row 5 (ROW<5>), ... The delta value ΔV(π/2) may be calculated in the same order as the row X (ROW<X>) and stored in the memory 240.

Then, the operator 250, as in step P1, row 1 (ROW<1), row 3 (ROW<3), ... , A delta value ΔV(0) corresponding to row X-2 (ROW<X-2>) may be restored. In addition, the operator 250, as in step P2, row 2 (ROW<2), row 4 (ROW<4), ... , A delta value ΔV(π/2) corresponding to row X-1 (ROW<X-1>) may be restored.

In addition, the operator 250 uses a delta value ΔV(0) and a delta value ΔV(π/2) corresponding to each row line, and uses the first row line, row 0 (ROW<0), and the last row line, row X. The remaining row lines excluding (ROW<X): row 1 (ROW<1), row 2 (ROW<2), row 3 (ROW<3),… , Distance information corresponding to row X-2 (ROW<X-2>) and row X-1 (ROW<X-1>) may be calculated.

On the other hand, through the embodiments of the present invention, it is not necessary to use a frame memory and the frame rate of the system can be increased. The frame memory may include the number of pixel arrays (ex.320×240)×ADC bit resolution (ex.10bit)).

17 to 19 are diagrams illustrating an operation of an alternate phase driver in a distance measuring apparatus having a virtual 4-tap pixel structure according to another exemplary embodiment of the present invention.

17 and 18, the apparatus for measuring a distance of a virtual 4-tap pixel structure according to another embodiment of the present invention may further include an alternate phase driver. The alternate phase driver performs an alternate phase operation in which different phases are alternately output to the same row line for each frame.

The alternate phase driver is a driver that alternately outputs even (Even) and odd (Odd) transmission (TX) signals in every frame. The distance measuring device with a virtual 4-tap pixel structure performs an alternating phase operation while maintaining a driving method that performs different phase driving on the even and odd rows, and the distance in two frames. (depth) can be obtained. Here, the alternate phase operation refers to performing a different phase driving operation on the same row for each frame.

Accordingly, as shown in FIG. 19, the distance measuring apparatus having a virtual 4-tap pixel structure can obtain a distance depth (2T) calculated as two frames from the last frame and a distance depth (4T) calculated as one frame. have.

20 and 21 are diagrams illustrating a hybrid distance imaging operation in a distance measuring apparatus having a virtual 4-tap pixel structure according to another embodiment of the present invention.

In the hybrid depth imaging operation, the distance can be output through a virtual Pseudo 4 tap operation in Frame 1, and the distance can also be output in Frame 2 as well.

At this time, if motion does not occur when the distance data of two frames are compared, the distance measuring device of the virtual 4-tap pixel structure uses the alternate phase driver to output two signals respectively to Frame 1 and Frame 2. Can be used to output a more accurate distance.

As shown in FIG. 20, in step S101, in order to perform hybrid depth imaging, a distance measuring apparatus having a virtual 4-tap pixel structure uses a distance depth (P4T) calculated in each frame to perform motion. (motion) is detected. Here, motion is detected for a moving object. At this time, the distance measuring apparatus having a virtual 4-tap pixel structure performs motion detection by comparing a difference between pixel data of two depths and a preset threshold. The distance measuring apparatus having a virtual 4-tap pixel structure outputs frame difference data assuming that motion has occurred when the pixel data difference is greater than a threshold value.

As shown in FIG. 21, in step S102, the distance measuring apparatus of the virtual 4-tap pixel structure uses the previously obtained frame difference data to use the distance depth (P4T) in the part where the motion has occurred, and the motion does not occur. For the part, we use the distance depth(2T). The distance depth (P4T) is to reduce motion artifacts. The distance depth (2T) is to improve the depth accuracy.

In other words, when the distance is calculated using the raw images of frames 1 and 2, motion artifacts occur. However, as described above, the distance measuring apparatus with a virtual 4-tap pixel structure uses a distance depth (P4T) for a portion where motion has occurred and a distance depth (2T) for a portion where motion does not occur, thereby generating a hybrid image. Seek. Then, a distance image with improved motion artifacts and resolution can be obtained.

22 to 24 are diagrams illustrating an edge-enhanced interpolation operation in a distance measuring apparatus having a virtual 4-tap pixel structure according to another embodiment of the present invention.

Since edge information is important for a distance image, the edge-enhanced interpolation operation in a distance measuring device with a virtual 4-tap pixel structure recognizes the edge and interpolates by adding a weight to the non-edge data. to be.

If interpolation is performed using a conventional linear interpolation method, the edge is degraded.

In contrast, the apparatus for measuring a distance of a virtual 4-tap pixel structure according to another embodiment of the present invention prevents edge degradation by applying a weighted coefficient for reinforcing an edge.

When an edge occurs at an intermediate position in the actual data, _{if only ΔQ π/2} is considered, the edge cannot be found. However, if all of the pixel data are used, it is possible to determine whether dpt is using _{ΔQ 0.} The reason is that _{the edge information of ΔQ 0} and ΔQ _π/2 are the same.

As shown in FIG. 22, in step S201, the distance measuring apparatus having a virtual 4-tap pixel structure _{compares data in the upper row and the lower row using ΔQ 0} and detects that an edge has occurred if they are not the same. The distance measuring apparatus with a virtual 4-tap pixel structure compares ΔQ ₀ [0] and ΔQ ₀ [2] to confirm that the edge information is the same. The distance measuring apparatus having a virtual 4-tap pixel structure _{detects an edge by comparing ΔQ 0} [2] and ΔQ ₀ [4] to confirm that the edge information is not the same.

As shown in FIG. 23, in step S202, the distance measuring apparatus of the virtual 4-tap pixel structure obtains the weight of edge. The following method is used to formulate the weight of edge. The distance measuring device with a virtual 4-tap pixel structure is _{the difference between |ΔQ 0} |[0]-[2], _{which is the difference between the upper and lower row values of ΔQ 0} , and the difference between the upper and lower row values of _{ΔQ π/2} . Add |ΔQ _π/2 |[0]-[2] as shown in FIG. 22. Through this, the distance measuring apparatus of the virtual 4-tap pixel structure can obtain the edge degree (W[1], W[2], …).

및

와 같다. 예를 들어, 도 24의 왼쪽 그림과 같이 에지가 아래에서 발생하였기 때문에 W[2]가 W[1]보다 크다. 따라서, α값이 더 크기 때문에, 에지 저하(edge degradation)을 방지할 수 있다. As shown in FIG. 24, in step S203, the distance measuring apparatus of the virtual 4-tap pixel structure calculates the edge coefficients α and β using the calculated edge degree, and applies the calculated edge coefficients. The edge coefficients α and β are

And

Is the same as For example, W[2] is greater than W[1] because the edge is generated from the bottom as shown in the left figure of FIG. 24. Therefore, since the α value is larger, edge degradation can be prevented.

In this way, the distance measuring apparatus of the virtual 4-tap pixel structure calculates the weight of edges by adding differences between the delta values of a specific angle in the adjacent row line, and uses the edge coefficients calculated from the edge degrees. Interpolate the part where the edge is generated.

Although the above has been described with reference to the drawings and examples, it does not mean that the scope of protection of the present invention is limited by the drawings or examples, and those skilled in the art It will be appreciated that various modifications and changes can be made to the present invention without departing from the spirit and scope.

Specifically, the described features may be implemented in digital electronic circuitry, or computer hardware, firmware, or combinations thereof. Features may be executed in a computer program product implemented in storage in a machine-readable storage device, for example, for execution by a programmable processor. And the features can be performed by a programmable processor executing a program of directives to perform the functions of the described embodiments by operating on input data and generating output. The described features include at least one programmable processor, at least one input device, and at least one output coupled to receive data and directives from the data storage system and to transmit data and directives to the data storage system. It can be executed within one or more computer programs that can be executed on a programmable system including the device. A computer program includes a set of directives that can be used directly or indirectly within a computer to perform a specific action on a given result. Computer programs are written in any form of programming language, including compiled or interpreted languages, and included as modules, elements, subroutines, or other units suitable for use in other computer environments, or as independently operable programs. It can be used in any form.

Suitable processors for execution of a program of directives include, for example, both general and special purpose microprocessors, and either a single processor or multiple processors of a different kind of computer. Storage devices suitable for implementing computer program directives and data implementing the described features are, for example, semiconductor memory devices such as EPROM, EEPROM, and flash memory devices, magnetic devices such as internal hard disks and removable disks. Devices, magneto-optical disks and all types of non-volatile memory including CD-ROM and DVD-ROM disks. The processor and memory may be integrated within application-specific integrated circuits (ASICs) or added by ASICs.

The present invention described above is described on the basis of a series of functional blocks, but is not limited by the above-described embodiments and the accompanying drawings, and various substitutions, modifications and changes within the scope not departing from the technical spirit of the present invention It will be apparent to those of ordinary skill in the art to which this invention pertains.

Combinations of the above-described embodiments are not limited to the above-described embodiments, and combinations of various types as well as the above-described embodiments may be provided according to implementation and/or need.

In the above-described embodiments, the methods are described on the basis of a flow chart as a series of steps or blocks, but the present invention is not limited to the order of steps, and certain steps may occur in a different order or concurrently with other steps as described above. I can. In addition, those of ordinary skill in the art understand that the steps shown in the flowchart are not exclusive, other steps are included, or one or more steps in the flowchart may be deleted without affecting the scope of the present invention. You can understand.

The above-described embodiments include examples of various aspects. It is not possible to describe all possible combinations for representing the various aspects, but one of ordinary skill in the art will recognize that other combinations are possible. Accordingly, the present invention will be said to include all other replacements, modifications and changes falling within the scope of the following claims.

210: pixel array
220: delta sigma circuit
230: converter
240: memory
250: operator

Claims (23)

The delta value of the first angle corresponding to the first row line of the pixel array for measuring the distance of the object is calculated through a delta sigma operation, and the second row line is A delta sigma circuit for calculating a delta sigma operation from a delta value of a corresponding third angle;
A memory for storing a delta value of a first angle corresponding to the calculated first row line; And
Calculating distance information corresponding to the first row line using the stored delta value of a first angle corresponding to the stored first row line and the calculated delta value of a third angle corresponding to the second row line Includes an operator,
The delta sigma circuit performs a delta sigma operation using voltage values at first and second angles generated by a modulation pulse in a first row line of the pixel array, A distance measuring apparatus having a virtual 4-tap pixel structure that performs a delta sigma operation using voltage values at third and fourth angles generated by a modulation pulse in a second row line. The method of claim 1,
Virtual 4, further comprising a converter for converting a delta value of a first angle corresponding to the calculated first row line and a delta value of a third angle corresponding to the calculated second row line into a digital code A distance measuring device with a tapped pixel structure. delete delete The method of claim 1,
The pixel array,
A distance measuring apparatus having a virtual 4-tap pixel structure having a structure in which the first row line and the second row line are alternately repeated. The method of claim 1,
The memory,
A delta value of a first angle corresponding to a first row line of the pixel array is stored, and after the stored delta value of the first angle is calculated by the operator, a delta value corresponding to a second row line of the pixel array is stored. A distance measuring device having a virtual 4-tap pixel structure that stores a delta value of a third angle. The method of claim 1,
The operator,
Calculating distance information corresponding to the second row line using a delta value of a third angle corresponding to the stored second row line and a delta value of a first angle corresponding to the third row line A distance measuring device with a 4-tap pixel structure. The delta value of the first angle corresponding to the first row line of the pixel array for measuring the distance of the object is calculated through a delta sigma operation, and the second row line is A delta sigma circuit for calculating a delta sigma operation from a delta value of a corresponding third angle;
A memory for storing a delta value of a first angle corresponding to the calculated first row line; And
The first and second row lines are merged using a delta value of a first angle corresponding to the stored first row line and a delta value of a third angle corresponding to the calculated second row line. Including a calculator that calculates the corresponding distance information,
The delta sigma circuit performs a delta sigma operation using voltage values at first and second angles generated by a modulation pulse in a first row line of the pixel array, A distance measuring apparatus having a virtual 4-tap pixel structure that performs a delta sigma operation using voltage values at third and fourth angles generated by a modulation pulse in a second row line. The method of claim 8,
Virtual 4, further comprising a converter for converting a delta value of a first angle corresponding to the calculated first row line and a delta value of a third angle corresponding to the calculated second row line into a digital code A distance measuring device with a tapped pixel structure. delete delete The method of claim 8,
The pixel array,
A distance measuring apparatus having a virtual 4-tap pixel structure having a structure in which the first row line and the second row line are alternately repeated. The method of claim 8,
The operator,
A distance measuring apparatus having a virtual 4-tap pixel structure that calculates distance information corresponding to a line in which the first and second row lines are merged, and then calculates distance information corresponding to the merged line by two row lines. . A delta value of a first angle corresponding to a first row line of a pixel array for measuring an object distance is calculated, a delta value of a third angle corresponding to a second row line is calculated, and a third row line A delta sigma circuit that calculates a delta value of a first angle corresponding to;
To store the calculated delta value of the first angle corresponding to the first row line, the delta value of the third angle corresponding to the second row line, and the delta value of the first angle corresponding to the third row line Memory;
The delta value of the first angle corresponding to the second row line is restored by interpolating the stored delta value of the first angle corresponding to the first row line and the delta value of the first angle corresponding to the third row line. And, distance information corresponding to the second row line is obtained by using a delta value of a first angle corresponding to the restored second row line and a delta value of a third angle corresponding to the stored second row line. Includes an operator that operates,
The delta sigma circuit performs a delta sigma operation using voltage values at first and second angles generated by a modulation pulse in a first row line of the pixel array, A distance measuring apparatus having a virtual 4-tap pixel structure that performs a delta sigma operation using voltage values at third and fourth angles generated by a modulation pulse in a second row line. The method of claim 14,
A delta value of a first angle corresponding to the calculated first row line, a delta value of a third angle corresponding to the calculated second row line, and a first angle corresponding to the calculated third row line The distance measuring device of a virtual 4-tap pixel structure further comprising a converter for converting the delta value of to a digital code. delete delete The method of claim 14,
The pixel array,
A distance measuring apparatus having a virtual 4-tap pixel structure having a structure in which the first row line and the second row line are alternately repeated. The method of claim 14,
The delta sigma circuit calculates a delta value of a third angle corresponding to a fourth row line,
The operator interpolates a delta value of a third angle corresponding to the stored second row line and a delta value of a third angle corresponding to the calculated fourth row line, A distance measuring device with a virtual 4-tap pixel structure that restores delta values of 3 angles. The method of claim 14,
The operator,
Calculating distance information corresponding to a third row line using a delta value of a third angle corresponding to the restored third row line and a delta value of a first angle corresponding to the stored third row line , A distance measuring device with a virtual 4-tap pixel structure. The method of claim 14,
A distance measuring apparatus having a virtual 4-tap pixel structure, further comprising an alternate phase driver performing an alternate phase operation for alternately outputting different phases to the same row line for each frame. The method of claim 21,
The operator,
The difference in pixel data is compared with a preset threshold to detect the occurrence of motion, and the distance calculated by one frame is used for the part where the motion occurs, and the distance calculated as two frames is used for the part where the motion does not occur. A distance measuring apparatus having a virtual 4-tap pixel structure that performs a hybrid depth imaging operation. The method of claim 21,
The operator,
A virtual 4-tap pixel that calculates the weight of edges by adding the differences between the delta values of a specific angle in the adjacent row line, and interpolates the portion where the edge is generated using the edge coefficients calculated from the edge degrees. The device for measuring the distance of the structure.

Images