KR20130019583A - Image sensor of 3d camera - Google Patents

Abstract

PURPOSE: An image sensor of a 3D camera is provided to change configuration of arrangement of a Bayer pattern in the image sensor, thereby receiving a visible light area and an infrared area in one camera. CONSTITUTION: A 3D camera includes a light source, a plurality of pixels, and a light detection element. The plurality of pixels is arranged in an array of a 2x2 pixel group. The array includes a pixel in which a red light filter is arranged; a pixel in which a green light filter is arranged; a pixel in which a blue light filter is arranged; and a pixel in which an infrared filter is arranged.

Description

Image sensor of 3D camera {IMAGE SENSOR OF 3D CAMERA}

The present invention relates to an image sensor of a 3D camera, and is characterized by an arrangement of an array of a plurality of pixels in constructing an image sensor.

Recently, portable devices (digital cameras, portable terminals, etc.) with image sensors have been developed and sold, and the image sensors are configured as an array of small photodiodes called pixels or photosites. In general, pixels do not extract color directly from light, but instead convert photons of a broad spectral band into electrons. Therefore, the pixel of the image sensor needs to receive only the light of the band required for color acquisition among the light of the broad spectrum band. The pixel of the image sensor may be combined with a color filter to convert only photons corresponding to a specific color into electrons.

In order to acquire a 3D image using these image sensors, not only the color but also information on the distance between the object and the image sensor is required. In general, a reconstructed image of a distance between an object and an image sensor is represented as a depth image in the related field, and the depth image may be obtained by using infrared light.

Conventionally, an image sensor using a Bayer pattern (disclosed in US Pat. No. 3,971,065) has been used to obtain color and distance information in order to obtain a 3D image. The structure of the conventional CMOS and CCD sensor is composed of. An example of such Bayer color filter arrangement is shown in FIG. 1.

Conventional 3D cameras require two CMOS image sensors for RGB (red, green, blue) and two CMOS image sensors for IR (infrared) to implement 3D images. Color information was obtained, depth information was obtained by CMOS image sensor for IR, and 3D image was used.

As shown in FIG. 2, the XBOX 360 includes an infrared laser projector, a CMOS image sensor for RGB, and a CMOS image sensor for IR, thereby implementing 3D images.

As described above, in the case of the 3D camera of the prior art, two cameras, that is, a visible camera and an IR sensing camera, are required. However, in the present invention, the visible light region and All IR areas can be received.

According to an embodiment of the present invention, a light source for generating infrared light; A plurality of pixels; And a light detection element, wherein the plurality of pixels is arranged in an array of 2x2 pixel groups, the array of 2x2 pixel groups comprising pixels arranged with a filter for passing red light, pixels arranged with a filter for passing green light, blue light. Provided is a 3D camera comprising an image sensor comprising a pixel arranged with a filter for passing through, and a pixel arranged with a filter for passing through the infrared ray.

According to a further embodiment of the present invention, a plurality of pixels, the plurality of pixels are arranged in an array of 2x2 pixel groups, the array of 2x2 pixel groups pass through the green light, a pixel arranged a filter for passing red light An image sensor is provided that includes a pixel in which a filter to be arranged is arranged, a pixel in which a filter for passing blue light is arranged, and a pixel in which a filter for passing infrared light is arranged.

1 shows a pixel arrangement of a Bayer pattern according to the prior art.
2 shows a 3D camera using two conventional cameras.
3 is a schematic perspective view of an image sensor according to the present invention.
4 shows a cross-sectional view of an image sensor according to the invention.
5 shows a pixel arrangement pattern of the image sensor according to the present invention.
6 shows a schematic operation of the image sensor according to the present invention.
7A shows a color image of the object through the image sensor of the present invention, and FIG. 7B shows a depth image of the object through the image sensor of the present invention.
Various embodiments are now described with reference to the drawings, wherein like reference numerals are used throughout the drawings to refer to like elements. For purposes of explanation, various descriptions are set forth herein to provide an understanding of the present invention. It is evident, however, that such embodiments may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing the embodiments.

The following description provides a simplified description of one or more embodiments in order to provide a basic understanding of embodiments of the invention. This section is not intended to be a comprehensive overview of all possible embodiments, nor is it intended to identify key elements of all elements or to cover the scope of all embodiments. Its sole purpose is to present the concept of one or more embodiments in a simplified form as a prelude to the more detailed description that is presented later.

3 is a perspective view schematically showing an image sensor 300 according to an embodiment of the present invention. As shown in FIG. 3, a plurality of pixels 310 are disposed in the image sensor 300 to form an array.

4 shows a cross section of the pixel 310 of FIG. 3. As shown in FIG. 4, the pixel 310 includes a filter 410 and a light-detector element 420.

The photodetecting element 420 may generate a charge in response to the light transmitted through the filter 410, and an example of the photodetecting element 420 may be a photodiode or the like.

The filter 410 may selectively transmit the visible light component to the light detection element 420, and the filter 410 may selectively transmit a specific band of the visible light component according to the type thereof.

For example, the filter 410 may transmit a band corresponding to red light, transmit a band corresponding to green light, and correspond to blue light according to its type. The band can be transmitted.

Referring to Figure 5, an arrangement of sixteen pixels is shown as part of the image sensor 300 according to the present invention.

A pixel labeled "G" represents a sensor that obtains a pixel image of green color, a pixel labeled "R" represents a sensor that obtains a pixel image of red color, and a pixel labeled "B" represents a pixel image of blue color. Indicates a sensor.

In the prior art, the Bayer pattern of FIG. 1 shows a Bayer pattern. In this case, pixels are arranged in the order of GRGRGR and pixels in the order of BGBGBG in the second line. As you can see, we replaced one of the two sensors per pixel of 2x2 with an IR sensing sensor to get a pixel image about green.

Thus, as shown in FIG. 5, an arrangement of filters arranged in pixels includes a filter for passing red light ("R filter") per pixel of 2x2, a filter for passing green light ("G filter"), and a filter for passing blue light (" B filter ") and a filter for passing infrared rays (" IR filter "), one each.

This arrangement allows the filter 410 to selectively transmit visible light components according to its characteristics, as well as to transmit infrared components, which are invisible light, to the light detection element 420.

With the pixel array according to the invention it is possible to obtain a color image of the object and also to obtain a depth image through the IR filter. In the conventional case, a color image and a depth image were obtained through two cameras, but in the present invention, since the image sensor of one camera has both a color filter and an IR filter, it is possible to obtain a 3D image with one camera. do.

6A shows a color image of an object through the image sensor of the present invention, and FIG. 6B shows a depth image of an object through the image sensor of the present invention. By combining these images, a three-dimensional image can be obtained. In FIG. 6B, a part far from the camera is shown in black, and a part near the camera is shown in bright colors, thereby obtaining a depth image of an object.

The description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features presented herein.

Claims (2)

A light source generating infrared light; A plurality of pixels; And a light detecting element,
The plurality of pixels is arranged in an array of 2x2 pixel groups,
The array of 2x2 pixel groups includes a pixel arranged with a filter for passing red light, a pixel arranged with a filter for passing green light, a pixel arranged with a filter for passing blue light, and a pixel arranged with a filter for passing infrared light. , 3D camera containing image sensor.
Includes a plurality of pixels,
The plurality of pixels is arranged in an array of 2x2 pixel groups,
The array of 2x2 pixel groups includes a pixel arranged with a filter for passing red light, a pixel arranged with a filter for passing green light, a pixel arranged with a filter for passing blue light, and a pixel arranged with a filter for passing infrared light. , Image sensor.

Images