KR20210138305A - Camera device - Google Patents

Abstract

A camera device according to one embodiment of the present invention includes: a light source emitting a first light including a plurality of light spots; a light receiving unit receiving the first light and generating a first image signal based on the received first light; and a processing unit receiving the first image signal. The processing unit generates first image information including a plurality of pixels based on the first image signal, classifies the plurality of pixels into one of a first pixel group including pixels corresponding to the light spot and a second pixel group including pixels not corresponding to the light spot, compares a pixel value of the second pixel group with a preset reference value, and controls an operation of the light source based on the comparison result.

Description

Camera Device {CAMERA DEVICE}

The embodiment relates to a camera device.

3D contents are being applied in many fields such as education, manufacturing, and autonomous driving as well as games and culture, and depth map is required to acquire 3D contents. Depth information is information representing a distance in space, and represents perspective information of one point in a 2D image at another point.

As a method of acquiring depth information, a method of projecting infrared (IR) structured light onto an object, a method using a stereo camera, a time of flight (TOF) method, and the like are used. According to the TOF method, the distance to the object is calculated by measuring the time of flight, that is, the time the light is emitted and reflected. The biggest advantage of the ToF method is that it provides distance information in a 3D space quickly in real time. In addition, the user can obtain accurate distance information without applying a separate algorithm or performing hardware correction. Also, accurate depth information can be obtained by measuring a very close subject or measuring a moving subject.

However, in the case of a method of acquiring depth information by emitting light, a safety problem is raised. This is because injuries may occur when strong light is directly irradiated to areas vulnerable to light, such as the human eye, due to damage to a member that disperses the power of light from the light source. Therefore, a method capable of solving these problems is required.

The embodiment provides a camera device capable of detecting a failure of a light emitting unit.

The embodiment provides a camera device capable of controlling driving of a light source when a light emitting unit fails.

An embodiment provides a camera device that is resistant to noise caused by ambient light.

The problem to be solved in the embodiment is not limited thereto, and it will be said that the purpose or effect that can be grasped from the solving means or embodiment of the problem described below is also included.

A camera device according to an embodiment of the present invention includes: a light source emitting a first light including a plurality of light spots; a light receiving unit receiving the first light and generating a first image signal based on the received first light; a processing unit receiving the first image signal, wherein the processing unit generates first image information including a plurality of pixels based on the first image signal and includes a pixel corresponding to the light spot classifying the plurality of pixels into any one of a first pixel group and a second pixel group including pixels not corresponding to the light spot, comparing a pixel value of the second pixel group with a preset reference value, and the comparison result Controls the operation of the light source based on

The processor may classify the plurality of pixels into the first pixel group and the second pixel group based on a preset classification criterion.

When the pixel value of the second pixel group is smaller than a preset reference value, the processor may generate a control signal for turning on the light source.

The processor may generate a control signal for turning off the light source when a pixel value of the second pixel group is greater than or equal to a preset reference value.

The light receiving unit may receive the first light in synchronization with the driving time of the light source.

The light receiving unit may receive a second light in synchronization with a non-driving time when the light source is not in operation, and may generate a second image signal based on the second light.

The processing unit generates second image information based on the second image signal, and applies a plurality of pixels included in the second image information to a first pixel group including pixels corresponding to a light emitting source and the light emitting source. classify into a second pixel group including non-corresponding pixels, calculate a noise level due to external light based on a pixel value of a second pixel group of the second image information, and calculate a noise level from the light source and At least one of the light receiving units may be controlled.

The processing unit may change an exposure time of the light receiving unit or a gain of a pixel element of a sensor included in the light receiving unit according to the noise level.

The processing unit may change the power of the light generated by the light source according to the noise level.

The processor may change the preset reference value according to the noise level.

The light source may output the first light before each depth image frame is generated.

According to an embodiment, since abnormality of the light emitting unit can be detected without an additional device, the size of the camera module can be reduced and manufacturing cost can be reduced.

According to an embodiment, it is possible to accurately detect ambient light, and by controlling control parameters of the camera device adaptively to the ambient light, it is possible to improve the accuracy of photographing.

According to an embodiment, since the power of output light can be controlled according to ambient light, there is an advantage in that power consumption can be reduced.

Various and advantageous advantages and effects of the present invention are not limited to the above, and will be more easily understood in the course of describing specific embodiments of the present invention.

1 is a perspective view of a camera module according to an embodiment.
FIG. 2 is a cross-sectional view taken along line AA′ in FIG. 1 .
3 is an exploded perspective view of a camera module according to an embodiment.
4 is a view illustrating a housing of a light emitting unit according to an embodiment.
5 is a view illustrating a first optical unit and a first lens barrel of a light emitting unit according to an embodiment.
6 is a view illustrating a driving magnet unit and a driving coil unit of the light emitting unit according to the embodiment.
7 is a view showing coupling of the elastic part of the light emitting part according to the embodiment.
8 is a view illustrating a first elastic member of a light emitting unit according to an embodiment.
9 is a view showing a second elastic member of the light emitting part according to the embodiment.
10 is a view illustrating one side of a side substrate of a light emitting unit according to an embodiment.
11 is a view showing the other side of the side substrate of the light emitting unit according to the embodiment.
12 is a view illustrating a base of a camera module according to an embodiment.
13 is a view illustrating a second optical unit and a second lens barrel of a light receiving unit according to an embodiment.
14 is a view illustrating a cover of a camera module according to an embodiment.
15 is a diagram illustrating a configuration of a camera device according to an embodiment of the present invention.
16 is a view for explaining a first light according to an embodiment of the present invention.
17 is a diagram for describing a first pixel group and a second pixel group of first image information according to an embodiment of the present invention.
18A and 18B are diagrams for explaining a process of comparing a second pixel group and a reference value according to an exemplary embodiment.
19A and 19B are diagrams for explaining a process of comparing a second pixel group and a reference value according to another exemplary embodiment.
20 is a view for explaining an output timing of the first light according to an embodiment of the present invention.
21 is a view for explaining a light receiving process of a second light according to an embodiment of the present invention.
22 is a diagram for explaining a control process according to a noise level.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

However, the technical spirit of the present invention is not limited to some embodiments described, but may be implemented in various different forms, and within the scope of the technical spirit of the present invention, one or more of the components may be selected among the embodiments. It can be combined and substituted for use.

In addition, terms (including technical and scientific terms) used in the embodiments of the present invention may be generally understood by those of ordinary skill in the art to which the present invention pertains, unless specifically defined and described explicitly. It may be interpreted as a meaning, and generally used terms such as terms defined in advance may be interpreted in consideration of the contextual meaning of the related art.

In addition, the terms used in the embodiments of the present invention are for describing the embodiments and are not intended to limit the present invention.

In the present specification, the singular form may also include the plural form unless otherwise specified in the phrase, and when it is described as "at least one (or one or more) of A and (and) B, C", it is combined with A, B, C It may include one or more of all possible combinations.

In addition, in describing the components of the embodiment of the present invention, terms such as first, second, A, B, (a), (b), etc. may be used.

These terms are only used to distinguish the component from other components, and are not limited to the essence, order, or order of the component by the term.

And, when it is described that a component is 'connected', 'coupled' or 'connected' to another component, the component is not only directly connected, coupled or connected to the other component, but also with the component It may also include a case of 'connected', 'coupled' or 'connected' due to another element between the other elements.

In addition, when it is described as being formed or disposed on "above (above) or under (below)" of each component, the top (above) or bottom (below) is one as well as when two components are in direct contact with each other. Also includes a case in which another component as described above is formed or disposed between two components. In addition, when expressed as "upper (upper) or lower (lower)", the meaning of not only an upper direction but also a lower direction based on one component may be included.

Hereinafter, an optical device according to the present embodiment will be described.

The optical device is any one of a mobile phone, a mobile phone, a smart phone, a portable smart device, a digital camera, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and a navigation device may include. However, the type of optical device is not limited thereto, and any device for taking an image or photo may be included in the optical device.

The optical device may include a body. The body may be in the form of a bar. Alternatively, the main body may have various structures such as a slide type, a folder type, a swing type, a swivel type, in which two or more sub-bodies are coupled to be relatively movable. The body may include a case (casing, housing, cover) forming an exterior. For example, the body may include a front case and a rear case. Various electronic components of an optical device may be embedded in a space formed between the front case and the rear case.

The optics may include a display. The display may be disposed on one surface of the main body of the optical device. The display may output an image. The display may output an image captured by the camera.

The optics may include a camera. The camera may include a Time of Flight (ToF) camera device. The ToF camera device may be disposed on the front side of the main body of the optics. In this case, the ToF camera device may be used for various types of biometric recognition such as user's face recognition and iris recognition for security authentication of optical devices.

Hereinafter, the configuration of the ToF camera device according to the present embodiment will be described with reference to the drawings.

1 is a perspective view of a camera module according to an embodiment, FIG. 2 is a cross-sectional view taken along line AA′ in FIG. 1 , and FIG. 3 is an exploded perspective view of the camera module according to the embodiment.

1 to 3 , the camera module 10 according to the embodiment includes a light emitting unit 1 , a light receiving unit 2 , a connect unit 3 , a main board 4 , an extension board 5 , and a connection board. (6) and a connector (7). And the camera module 10 according to the embodiment may include a control unit CT. The control unit CT may be located on any one of the light emitting unit 1 , the light receiving unit 2 , the connect unit 3 , and the main board 4 .

First, the light emitting unit 1 may be a light emitting module, a light emitting unit, a light emitting assembly, or a light emitting device. The light emitting unit 1 may generate an optical signal and then irradiate the object. In this case, the light emitting unit 1 may generate and output an optical signal in the form of a pulse wave or a continuous wave. The continuous wave may be in the form of a sinusoid wave or a square wave.

And by generating the optical signal in the form of a pulse wave or a continuous wave, for example, the ToF camera device is inputted to the light receiving unit 2 of the ToF camera device after the optical signal output from the light emitting unit 1 and the optical signal are reflected from the object O. It is possible to detect the phase difference between the input lights. In this specification, the output light refers to an optical signal output from the light emitting unit 1 and incident on the object O, and the input light or reflected light is output from the light emitting unit 1 and reaches the object O to reach the object (O). O) may mean an optical signal input to the ToF camera device after being reflected. Also, from the viewpoint of the object O, the output light may be incident light, and the input light may be reflected light.

The light emitting unit 1 irradiates the generated optical signal to the object O for a predetermined exposure period (integration time). Here, the exposure period means one frame period. In the case of generating a plurality of frames, the set exposure cycle is repeated. For example, when the ToF camera device captures an object at 20 FPS, the exposure period is 1/20 [sec]. And when 100 frames are generated, the exposure cycle may be repeated 100 times.

Also, the light emitting unit 1 may generate a plurality of optical signals having different frequencies. The light emitting unit 1 may sequentially and repeatedly generate a plurality of optical signals having different frequencies. Alternatively, the light emitting unit 1 may simultaneously generate a plurality of optical signals having different frequencies.

The light emitting unit 1 may include a light source LS. The light source LS may generate light. The light source LS may output light. The light source LS may irradiate light. The light generated by the light source LS may be infrared rays having a wavelength of 770 nm to 3000 nm. Alternatively, the light generated by the light source LS may be visible light having a wavelength of 380 nm to 770 nm. The light source LS may include all of various elements that generate and output light. For example, the light source LS may include a Light Emitting Diode (LED) and a Vertical Cavity Surface Emitting Laser (VCSEL).

Also, the light source LS may include a plurality of light emitting diodes arranged according to a predetermined pattern. In addition, the light source LS may include an organic light emitting diode (OLED) or a laser diode (LD).

The light emitting unit 1 may include a light modulator for modulating light. The light source LS may generate an optical signal in the form of a pulse wave or a continuous wave by repeatedly flickering (on/off) at regular time intervals. The predetermined time interval may be a frequency of an optical signal. The blinking of the light source LS may be controlled by the light modulator. The light modulator may control the blinking of the light source LS so that the light source LS generates an optical signal in the form of a continuous wave or a pulse wave. The light modulator may control the light source LS to generate an optical signal in the form of a continuous wave or a pulse wave through frequency modulation, pulse modulation, or the like. The light modulator may be located in the control unit. Accordingly, it should be understood that the control unit may block (off) or provide (on) the output of the optical signal by the light source by controlling the light modulator, as will be described later.

The light emitting unit 1 may include a diffuser (not shown). The diffuser (not shown) may be a diffuser lens. A diffuser (not shown) may be disposed in front of the light source LS. Light emitted from the light source LS may pass through a diffuser (not shown) to be incident on the object O. The diffuser (not shown) may change the path of the light emitted from the light source LS. A diffuser (not shown) may diffuse the light emitted from the light source LS. A diffuser (not shown) may be located in a first optical unit to be described later.

Specifically, the light emitting unit 1 includes the above-described light source LS, the housing 110 , the first optical unit 120 , the first lens barrel 130 , the driving magnet unit 140 and the driving coil unit 150 . It may include a driving unit that includes, an elastic unit 160 , a side substrate 170 , and a position sensor 180 .

First, the housing 110 may be located inside the cover 400 to be described later. The housing 110 may be coupled to a first lens barrel 130 , a side substrate 170 , a driving coil unit 150 , and an elastic unit 160 , which will be described later.

The housing 110 may include a barrel accommodating part opened therein. The above-described first lens barrel 130 and the driving coil unit 150 may be irregular in the barrel receiving unit.

The first optical unit 120 may be located in the housing 110 . The first optical unit 120 may be held by a first lens barrel 130 to be described later, and may be coupled to the housing 110 through the first lens barrel 130 .

The first optical unit 120 may include a plurality of optical elements or lenses. For example, the first optical unit 120 may include a plurality of lenses.

Also, the first optical unit 120 may include a collimator lens. In addition, the first optical unit 120 may duplicate the optical signal output from the light source LS according to a preset replication pattern. Accordingly, the first optical unit 120 may include a diffractive optical element (DOE) or a diffuser lens. For example, the first optical unit 120 may include an optical member having a micro-scale or nano-scale structure.

An optical signal (output light) emitted from the light source LS toward the object may pass through the first lens barrel 130 . The optical axis of the first lens barrel 130 and the optical axis of the light source LS may be aligned. Also, the first lens barrel 130 may be coupled to the housing 110 . In addition, the first lens barrel 130 may be fixed to the housing 110 . The first lens barrel 130 may hold the first optical unit 120 formed of a plurality of optical elements.

The first lens barrel 130 may include a lens accommodating part 131 on which the first optical part 120 is seated. The first lens barrel 130 may be moved up and down by a voice coil motor or the like, as will be described later. Accordingly, the first lens barrel 130 may include a magnet seating groove 132 in which the driving magnet unit is seated.

In addition, a screw thread structure may be formed on a side surface of the lens accommodating part 131 for coupling with the first optical part 120 . Accordingly, the first optical unit 120 may move up and down in the housing 110 together with the first lens barrel 130 by a driving unit to be described later.

In addition, the side substrate 170 may be coupled to the housing 110 . The side substrate 170 may be located in the substrate groove 112 located on the side of the housing 110 . Also, the side substrate 170 may be electrically connected to the main substrate 4 .

Also, the driving unit may include a driving magnet unit 140 and a driving coil unit 150 .

The driving magnet unit 140 may include a plurality of magnets. The plurality of magnets may be located in the magnet seating groove 132 located on the side of the first lens barrel 130 .

The driving magnet unit 140 may vertically move the first lens barrel 130 and the first optical unit 120 with respect to the housing 110 by electromagnetic interaction with the driving coil unit 150 to be described later. Accordingly, the separation distance from the lower light source LS to the first optical unit 120 and the first lens barrel 130 may be increased or decreased. And, according to the above-described separation distance, the output light may have the form of a surface light source or a point light source with respect to the object. Here, the point light source may refer to a form in which output light emitted to an object is arranged in a predetermined pattern with a plurality of light spots.

The driving coil unit 150 includes a plurality of coils and may be located on a side surface of the housing 110 . The driving coil unit 150 may be positioned to face the driving magnet unit 140 . Accordingly, when current is injected into the driving coil unit 150 , the first lens barrel 130 may move due to electromagnetic interaction (eg, Lorentz force) between the driving coil unit 150 and the driving magnet unit 140 . .

The driving coil unit 150 may be located in each coil receiving unit 114 formed on the side surface of the housing 110 . The driving coil unit 150 may be electrically connected to the side substrate 170 . For example, the driving coil unit 150 may be electrically connected to the side substrate 170 through a wire or the like. And since the side substrate 170 is coupled to the housing 110 as described above, the driving coil unit 150 may also be seated in the coil receiving unit 114 formed on the side of the housing 110 to be coupled to the housing. A detailed description thereof will be provided later.

The elastic part 160 may be disposed on the housing 110 . The elastic part 160 may be coupled to the first lens barrel 130 and the housing 110 . The housing 110 may be fixedly coupled to the main board 4 or the base 200 to be described later. Alternatively, the first lens barrel 130 may move up and down with respect to the housing 110 by the Lorentz force described above. The elastic unit 160 may provide a preload for vertical movement of the first lens barrel 130 or the first optical unit 120 . Accordingly, when the Lorentz force by the driving unit does not occur, the first lens barrel 130 may maintain a predetermined position with respect to the housing 110 . In addition, even when Lorentz force is generated by the driving unit, since the positional relationship between the first lens barrel 130 and the housing 110 is maintained within a predetermined range, the reliability of the camera module may be improved.

The position sensor 180 may be electrically connected to the side substrate 170 . Also, the position sensor 180 may be located on the side substrate 170 . In addition, the position sensor 180 may be disposed to be spaced apart from the driving magnet unit 140 by a predetermined distance.

The position sensor 180 may include a Hall sensor or a Hall IC. The position sensor 180 may detect a magnetic force of the driving magnet unit 140 .

The position sensor 180 according to the embodiment may sense the magnetic field strength from the driving magnet unit to output position information about the light source LS of the first lens barrel 130 or the first optical unit 120 . Accordingly, the control unit determines the defect of the first optical unit 120 or the first lens barrel 130 based on the position information of the position sensor 180 and controls the output of the light source LS in response to the determination result ( can be turned on/off).

In an embodiment, the position sensor 180 may include a plurality of position sensors. The position sensor 180 may include two sensors. The position sensor 180 may detect movement of the first lens barrel 130 and the first optical unit 120 in the optical axis direction. In this specification, the Z-axis direction is an optical axis direction or a vertical direction as the third direction. And the X-axis direction is a direction perpendicular to the Z-axis direction, and in the embodiment, the direction from the light emitting unit toward the light receiving unit is the first direction. And the Y-axis direction is a direction perpendicular to the X-axis direction and the Z-axis direction, and is a second direction. It will be described below based on this.

The light receiving unit 2 may be a light receiving module, a light receiving unit, a light receiving assembly, or a light receiving device, and may be a component of a camera module. The light receiving unit 2 may receive light (reflected light) emitted from the light emitting unit 1 and reflected from the object, and may convert the received light into an electrical signal.

The light receiving unit 2 may generate input light corresponding to the light signal output from the light emitting unit 1 . The light receiving unit 2 may be disposed side by side with the light emitting unit 1 . The light receiving unit 2 may be disposed next to the light emitting unit 1 . The light receiving unit 2 may be disposed in the same direction as the light emitting unit 1 . With this configuration, the reception efficiency of the input light can be improved in the light receiving unit 2 .

The light receiving unit 2 may include a second lens barrel 320 , a second optical unit 310 , and an image sensor IS.

The second lens barrel 320 may be coupled to a base 200 to be described later. The second lens barrel 320 may be coupled to a base to be described later by screw coupling or the like. Accordingly, the second lens barrel 320 may include a screw thread located on the side. The second lens barrel 320 may be formed integrally with the second optical unit 310 . However, the present invention is not limited thereto.

The second optical unit 310 may be coupled to the second lens barrel 320 . The second optical unit 310 may be coupled to the base 200 through the second lens barrel 320 . The second optical unit 310 may be coupled to the second lens barrel 320 through various coupling methods. The second optical unit 310 may be formed through screw coupling with the second lens barrel 320 as described above.

The second optical unit 310 may include a plurality of lenses. In addition, the second optical unit 310 may be aligned with the lower image sensor IS. Accordingly, the reflected light passing through the second optical unit 310 may be received by the image sensor IS.

The image sensor IS may detect reflected light. In addition, the image sensor IS may detect the reflected light and output it as an electrical signal. In an embodiment, the image sensor IS may detect light having a wavelength corresponding to the wavelength of light output from the light source LS. For example, the image sensor IS may detect infrared rays. Alternatively, the image sensor IS may detect visible light. The image sensor IS may include various image sensors that sense light.

In an embodiment, the image sensor IS is a pixel array that receives light passing through the second lens barrel 320 and the second optical unit 310 and converts it into an electrical signal corresponding to the light, a plurality of pixels included in the pixel array It may include a driving circuit for driving a pixel of the , and a readout circuit for reading an analog pixel signal of each pixel. The readout circuit may generate a digital pixel signal (or an image signal) through analog-to-digital conversion by comparing the analog pixel signal with a reference signal. Here, the digital pixel signal of each pixel included in the pixel array constitutes an image signal, and as the image signal is transmitted in units of frames, it may be defined as an image frame. That is, the image sensor may output a plurality of image frames.

Furthermore, the light receiving unit 2 may further include an image combining unit. The image synthesizing unit may include an image processor that receives an image signal from the image sensor IS and processes the image signal (eg, interpolation, frame synthesis, etc.). In particular, the image synthesizing unit may combine the image signals (low resolution) of a plurality of frames into an image signal (high resolution) of one frame. That is, the image synthesizing unit may synthesize a plurality of image frames included in the image signal received from the image sensor IS, and generate the synthesized result as a composite image. The composite image generated by the image synthesizing unit may have a higher resolution than a plurality of image frames output from the image sensor IS. That is, the image synthesizing unit may generate a high-resolution image through a super resolution (SR) technique. The plurality of image frames may include image frames generated by changing different optical paths by movement of the filters F and F'. Such an image synthesizing unit may be located inside or outside the light receiving unit 2 .

The filters F and F' may be coupled to the base 200 . The filters F and F' may be disposed between the first lens barrel 130 and the light source LS or between the second lens barrel 320 and the image sensor IS. Accordingly, the filters F and F′ may be disposed on a light path between the object and the image sensor IS or on a light path between the object and the light source LS. The filters F and F' may filter light having a predetermined wavelength range.

The filters F and F' can pass light of a specific wavelength. That is, the filters F and F' may block by reflecting or absorbing light other than a specific wavelength. For example, the filters F and F' may pass infrared rays and block light of wavelengths other than infrared rays. Alternatively, the filters F and F' may pass visible light and block light of a wavelength other than visible light. The filters F and F' may be infrared rays band pass filters. Accordingly, the filters F and F' can pass only infrared light. Alternatively, the optical member may be a separate focus fixed lens or a variable focus lens (ex: liquid lens) separated from the lens module.

Also, the filters F and F' are movable. In an embodiment, the filters F and F' may be tilted. When the filters F and F' are tilted, the optical path can be adjusted. When the filters F and F' are tilted, the path of the light incident to the image sensor IS may be changed. For example, in the light receiving unit 2 , the filter F′ may change the FOV (Field of View) angle or the FOV direction of the incident light. In addition, in the embodiment, the filters F and F' may change the path through which light enters as they are tilted to enable high-resolution Time of Flight (ToF).

The cover 400 may be a bracket. The cover 400 may include a 'cover can'. The cover 400 may be disposed to surround the light emitting unit 1 and the light receiving unit 2 . The cover 400 may be coupled to the housing 110 and the base 200 . The cover 400 may accommodate the light emitting unit 1 and the light receiving unit 2 . Accordingly, the cover 400 may be located on the outermost side of the camera module.

In addition, the cover 400 may be a non-magnetic material. In addition, the cover 400 may be formed of a metal. Also, the cover 400 may be formed of a metal plate.

The cover 400 may be connected to the ground portion of the main board 4 . Through this, the cover 400 may be grounded. And the cover 400 may block electromagnetic interference (EMI). In this case, the cover 400 may be referred to as an 'EMI shield can'. The cover 400 is a finally assembled component and may protect the product from external impact. The cover 400 may be formed of a material having a thin thickness and high strength.

In addition, in the camera module 10 according to the embodiment, the light emitting unit 1 and the light receiving unit 2 may be disposed on the main board 4 (PCB, Printed Circuit Board). The main substrate 4 may be electrically connected to the light emitting unit 1 and the light receiving unit 2 .

Also, in the camera module 10 , the connector 3 may be electrically connected to the main board 4 . The connecting unit 3 may be connected to the configuration of the optical device. The connecting unit 3 may include a connector 7 that is connected to the configuration of the optical device. The connector 3 may include an extension board 5 on which the connector 7 is disposed and connected to the connection board 6 . The extension substrate 5 may be a PCB, but is not limited thereto.

In addition, in the camera module, the connection board 6 may connect the main board 4 and the extension board 5 of the connector 3 . The connecting substrate 6 may have flexibility. The connection board 6 may be a flexible printed circuit board (FPCB, Flexible PCB).

In addition, the main substrate 4, the connecting substrate 6, and the extension substrate 5 may be formed integrally or separately.

The camera module may include a reinforcing plate 8 . The reinforcing plate 8 may include a stiffener. The reinforcing plate 8 may be disposed on the lower surface of the main substrate 4 . The reinforcing plate 8 may be formed of a SUS.

Furthermore, the light receiving unit 2 may include a lens driving device. That is, the light receiving unit 2 may include a voice coil motor (VCM). In addition, the light receiving unit 2 may include a lens driving motor. In addition, the light receiving unit 2 may include a lens driving actuator. With this configuration, as described above, the light receiving unit 2 according to the embodiment can tilt the filter F′. And as the filter F' is tilted, the optical path of the input light passing through the filters F and F' may move repeatedly according to a predetermined rule. Accordingly, the light receiving unit 2 outputs high-resolution image information using a plurality of image information converted by the image sensor according to the tilt of the filter F', and the output image information may be provided to an external optical device. .

4 is a view showing a housing of a light emitting unit according to an embodiment, FIG. 5 is a view showing a first optical unit and a first lens barrel of a light emitting unit according to an embodiment, and FIG. 6 is driving of the light emitting unit according to the embodiment It is a view showing a magnet part and a driving coil part, FIG. 7 is a view showing coupling of the elastic part of the light emitting part according to the embodiment, FIG. 8 is a view showing the first elastic member of the light emitting part according to the embodiment, and FIG. 9 is It is a view showing a second elastic member of the light emitting part according to the embodiment, Figure 10 is a view showing one side of the side substrate of the light emitting part according to the embodiment, Figure 11 shows the other side of the side substrate of the light emitting part according to the embodiment One view, Fig. 12 is a view showing the base of the camera module according to the embodiment, Fig. 13 is a view showing the second optical unit and the second lens barrel of the light receiving unit according to the embodiment, and Fig. 14 is the embodiment It is a view showing the cover of the camera module according to the.

Referring to FIG. 4 , the housing 110 of the light emitting part according to the embodiment may include a housing hole 111 , a substrate groove 112 , a sensor hole 113 , and a coil mounting part 114 .

The housing hole 111 may be located in the center of the housing 110 . The first optical unit, the first lens barrel, and the driving unit may be seated in the housing hole 111 .

The substrate groove 112 may be located on the outer surface of the housing 110 . The housing 110 may have a rectangular shape in plan view. However, the present invention is not limited thereto and may be formed in various shapes.

In addition, a coupling protrusion for coupling with the side substrate may be positioned in the substrate groove 112 . The coupling protrusion may extend outward from the side surface of the housing 110 . In addition, the side substrate is provided with a coupling hole, the coupling protrusion is inserted into the coupling hole, so that the side substrate and the housing 110 can be coupled to each other.

The sensor hole 113 may overlap the substrate groove 112 in a first direction (X-axis direction) and a second direction (Y-axis direction). A position sensor may be seated in the sensor hole 113 . Accordingly, the position sensor may be easily electrically connected to the side substrate. In addition, the position sensor has a fixed coupling position with the housing 110 to accurately measure the position of the driving magnet unit.

The coil mounting part 114 may be located on the inner surface of the housing 110 . For example, the coil receiving part 114 may be formed of a chin extending inward from the inner surface of the housing 110 . In this specification, the inner side may be a direction from the housing toward the first optical unit, and the outer side may be a direction from the first optical unit toward the housing in a direction opposite to the inner side.

The driving coil unit may be seated on the coil mounting unit 114 . The driving coil unit may have a closed loop shape as will be described later. Accordingly, the coil seating part 114 may also have a closed loop shape corresponding to the shape of the driving coil part.

Referring to FIG. 5 , the first optical unit 120 of the light emitting unit may be inserted into the lens receiving unit 131 of the first lens barrel 130 . As described above, the first optical unit 120 may include a plurality of lenses. And the first optical unit 120 may include a screw thread located on the outer surface. The first lens barrel 130 may also have a groove corresponding to the screw thread of the first optical unit 120 on the inner surface. Accordingly, the first optical unit 120 and the first lens barrel 130 may be screw-coupled to each other.

In addition, the first lens barrel 130 may include not only the above-described lens accommodating part 131 , but also a magnet seating groove 132 . The magnet seating groove 132 may be plural. In an embodiment, the magnet seating groove 132 is four, and the first outer surface 132a and the second outer surface 132b facing each other of the first lens barrel 130, and the first outer surface facing each other ( It may be positioned on the third outer surface 132c and the fourth outer surface 132d positioned between the 132a and the second outer surface 132b.

That is, the magnet seating groove 132 is located on each of the first outer surface 132a to the fourth outer surface 132d, and first to fourth magnets to be described later are formed on the first outer surface 132a to the fourth outer surface. It can be seated in the magnet seating groove 132 of (132d). A bonding member may be applied to the magnet seating groove 132 . Accordingly, coupling force between the first to fourth magnets and the first lens barrel 130 may be improved.

Referring to FIG. 6 , the driving unit may include a driving magnet unit 140 and a driving coil unit 150 . The driving magnet unit 140 may include a plurality of magnets.

In an embodiment, the driving magnet unit 140 may include a first magnet 141 to a fourth magnet 144 . The first magnet 141 and the second magnet 142 may be positioned to face each other. For example, the first magnet 141 and the second magnet 142 may be symmetrically disposed with respect to the second direction.

The third magnet 143 and the fourth magnet 144 are positioned to face each other, and may be positioned between the first magnet 141 and the second magnet 142 . For example, the third magnet 143 and the fourth magnet 144 may be symmetrically disposed with respect to the first direction.

The first magnet 141 to the fourth magnet 144 may be located in the above-described magnet seating groove.

The driving coil unit 150 may have a closed-loop shape on a plane (XY) as described above. The driving coil unit 150 may be seated on the coil receiving unit. In addition, the driving coil unit 150 may overlap the driving magnet unit 140 at least partially in the first direction or the second direction.

Also, the driving coil unit 150 may be disposed to surround the driving magnet unit 140 . That is, the driving magnet unit 140 may be located on a closed loop of the driving coil unit 150 .

Also, the driving coil unit 150 may be disposed to be spaced apart from the driving magnet unit 140 by a predetermined distance.

In addition, the driving coil unit 150 may include a first wire w1 and a second wire w2 for electrically connecting to the side substrate at one end. The first wire w1 and the second wire w2 may be disposed at positions corresponding to the side substrate to minimize electrical resistance. Accordingly, a decrease in accuracy due to the resistance may be prevented and power efficiency may be improved.

The first wire w1 and the second wire w2 may be respectively connected to one end and the other end of the driving coil unit 150 made of a coil.

7 to 9 , the elastic part 160 may include a first elastic member 161 and a second elastic member 162 . The elastic part 160 may be positioned above or below the first lens barrel 130 to be coupled to the housing 110 and the first lens barrel 130 . Accordingly, even if the first lens barrel 130 is vertically moved by the driving unit, a preload may be applied to the vertical movement of the first lens barrel 130 through the elastic part 160 coupled to the housing 110 . Accordingly, if no current is applied to the driving coil unit, the first lens barrel 130 may exist at the same position in the housing 110 by the restoring force of the elastic unit 160 .

The first elastic member 161 may be positioned above the first lens barrel 130 . The second elastic member 162 may be positioned under the first lens barrel 130 .

The first elastic member 161 may include a first elastic coupling part P1 and a second elastic coupling part P2. The first elastic coupling part P1 may be located outside the second elastic coupling part P2. And the first elastic coupling portion (P1) may be coupled to the protrusion of the housing (110). In addition, the second elastic coupling portion P2 may be coupled to the first lens barrel 130 . At this time, a bonding member may be applied to the first elastic coupling part P1 and the second elastic coupling part P2 for the above-described coupling. For example, the bonding member may include a damper liquid.

Similarly, the second elastic member 162 may include a third elastic coupling portion (P3) and a fourth elastic coupling portion (P4). The third elastic coupling portion P3 may be located outside the fourth elastic coupling portion P4.

And the third elastic coupling portion (P3) may be coupled to the protrusion of the housing (110). Also, the fourth elastic coupling part P4 may be coupled to the first lens barrel 130 . At this time, the bonding member may be applied to the third elastic coupling part P3 and the fourth elastic coupling part P4 to achieve the above-described coupling.

In addition, a first pattern portion PT having various curvatures may be positioned between the first elastic coupling portion P1 and the second elastic coupling portion P2 . That is, the first elastic coupling part P1 and the second elastic coupling part P2 may be coupled to each other with the first pattern part PT interposed therebetween. The first pattern portion PT may be symmetrically positioned in the first direction (X-axis direction) and the second direction (Y-axis direction).

Similarly, a second pattern part PT′ having various curvatures may be positioned between the third elastic coupling part P3 and the fourth elastic coupling part P4. That is, the third elastic coupling part P3 and the fourth elastic coupling part P4 may be coupled to each other with the second pattern part PT′ interposed therebetween. The second pattern part PT' may be symmetrically positioned in the first direction (X-axis direction) and the second direction (Y-axis direction).

10 to 11 , the side substrate 170 may have one side and the other side facing the one side and contacting the housing.

The side substrate 170 may include first and second conductive parts EC1 and EC2 connected to the first and second wires of the driving coil part on one side surface. And the side substrate 170 may include a coupling hole 170a on the other side. The coupling hole 170a may be coupled to the coupling protrusion of the housing as described above. Accordingly, the side substrate 170 may be coupled to the side surface of the housing.

In addition, the position sensor 180 may be positioned on the other side of the side substrate 170 . The position sensor 180 may be seated on the other side of the side substrate 170 and inserted into the sensor hole.

Referring to FIG. 12 , the base 200 is positioned on the main substrate 4 and may be in contact with the main substrate 4 . In addition, the first lens barrel, the first optical unit, the second lens barrel, the second optical unit, and the housing described above may be seated on the base 200 .

The base 200 may include a first base portion 210 and a second base portion 220 that are spaced apart from each other. Components of the light emitting unit, such as the first optical unit, the first lens barrel, and the housing, may be seated on the first base unit 210 . In addition, the second base unit 220 may seat the second optical unit and the second lens barrel.

The first base part 210 and the second base part 220 may include base holes 210a and 220a, respectively. An optical signal from a light source may be output toward an object through the base holes 210a and 220a, and an optical signal (reflected light) reflected from the object may be provided to the image sensor.

In addition, the above-described filters may be seated on the first base part 210 and the second base part 220 , respectively. Furthermore, although the first base part 210 and the second base part 220 are shown as one body, they may be separated. In addition, the second base unit 220 may be tilted as described above, and the filter attached to the second base unit 220 may also be tilted, so that the camera module according to the embodiment may perform the above-described super resolution technique.

Referring to FIG. 13 , the second optical unit 310 may be coupled to the second lens barrel 320 . The second optical unit 310 may be inserted into a hole located in the center of the second lens barrel 320 . In addition, the second lens barrel 320 may have a thread on the outer surface to be screw-coupled to the second base part 220 of the base 200 .

The second optical unit 310 may also include a plurality of lenses.

Referring to FIG. 14 , the cover 400 may include a first cover part 410 and a second cover part 420 in addition to the above description. The first cover part 410 is positioned on the first base part and may include a first cover hole 410a overlapping the first optical part. An optical signal (output light) passing through the first optical unit through the first cover hole 410a may be irradiated to the object.

The second cover part 420 is positioned on the second base part and may include a second cover hole 420a overlapping the second optical part. An optical signal (reflected light) passing through the second optical unit through the second cover hole 420a may be irradiated to the image sensor.

15 is a diagram illustrating a configuration of a camera device according to an embodiment of the present invention.

Referring to FIG. 15 , a camera device according to an embodiment of the present invention may include a camera module and a processing unit. The camera module may include a light emitting unit and a light receiving unit.

As described above, the light emitting unit 1 may include a light source and a first optical unit. The light emitting unit 1 emits light generated from the light source to the first optical unit, and the first optical unit emits the inputted light to the object.

The first optical unit may include a plurality of lenses and a diffuser. At this time, the diffuser scatters the passing light and outputs it. This allows the diffuser to distribute the power of the light output. If the diffuser is removed or a crack occurs in the diffuser, light in which power is not dispersed may be emitted to the object. If the object is an object weak to light, such as a human eye, a safety risk may occur.

The light emitting unit 1 may include a driving unit. The driving unit may move the first optical unit in an optical axis direction. The driving unit may move the first optical unit so that a light spot is formed in the emitted first light.

The light emitting unit 1 may generate light by supplying or blocking power to the light source according to a control signal. The light emitting unit 1 may supply or cut off power to the light source according to a control signal received from the processing unit 20 .

The light receiving unit 2 generates a signal by receiving the light reflected from the object. As described above, the light receiving unit 2 may include a sensor, a filter, and a lens. The light receiving unit 2 may generate an electrical signal by condensing the light reflected from the object through a lens and transmitting it to the sensor. Hereinafter, the electric signal may be described as being mixed with the image signal. The light receiving unit 2 may have a filter disposed on the front or rear side of the lens in order to receive only the light emitted from the light emitting unit. The light receiving unit 2 may transmit the generated image signal to the processing unit 20 .

The light receiving unit 2 may receive the first light in synchronization with the driving time of the light source, and may generate a first image signal based on the received first light.

The light receiving unit 2 may receive the second light during a non-driving time in which the light source does not operate, and may generate a second image signal based on the second light.

The processing unit 20 may be disposed in the camera device. The processing unit 20 may be a processor capable of arithmetic processing. For example, the processing unit 20 may be an application processor disposed in the camera device. The processing unit 20 may include a memory for processing and storing data.

The processing unit 20 may generate an image based on the signal received from the light receiving unit 2 . The processing unit 20 may receive an electrical signal from the sensor of the light receiving unit 2 and generate an image based on the electrical signal. The processing unit 20 may generate a three-dimensional depth image based on the signal received from the light receiving unit 2 . The processing unit 20 may generate a two-dimensional IR image based on the signal received from the light receiving unit 2 .

The processor 20 may generate first image information including a plurality of pixels based on the first image signal. The processing unit 20 may classify the plurality of pixels included in the first image information into one of a first pixel group including pixels corresponding to the light spot and a second pixel group including pixels not corresponding to the light spot. have. The processor 20 may classify the plurality of pixels into a first pixel group and a second pixel group based on a preset classification criterion.

The processor 20 may compare the pixel value of the second pixel group with a preset reference value, and control the operation of the light source based on the comparison result. The processor 20 may generate a control signal for turning on the light source when the pixel value of the second pixel group is smaller than a preset reference value. The processor 20 may generate a control signal for turning off the light source when the pixel value of the second pixel group is greater than or equal to a preset reference value.

The processor 20 may generate second image information based on the second image signal. The processor 20 may classify the plurality of pixels included in the second image information into a first pixel group including pixels corresponding to the light emitting source and a second pixel group including pixels not corresponding to the light emitting source. This may be the same as a process of classifying a plurality of pixels included in the first image information into a first pixel group and a second pixel group.

The processor 20 may calculate a noise level due to external light based on the pixel value of the second pixel group of the second image information. The processing unit 20 may control at least one of the light emitting unit 1 and the light receiving unit 2 based on the noise level.

The processing unit 20 may change an exposure time of the light receiving unit 2 or a gain value of a pixel element of a sensor included in the light receiving unit 2 according to the noise level. The processing unit 20 may change the power of light generated by the light source according to the noise level.

The processing unit 20 may change the preset reference value according to the noise level. The processing unit 20 may change a reference value, which is a comparison reference for pixel values of the second pixel group, according to the noise level.

16 is a view for explaining a first light according to an embodiment of the present invention.

16 shows the first light emitted by the light emitting unit. The light emitting unit may output the first light generated by the light source and the optical unit. The first light may be patterned light in which a light spot is formed according to a predetermined pattern. In a non-spot area other than the light spot, some of the light corresponding to the light spot may be scattered and output, but the amount of light may be very small compared to the light spot.

The light emitting unit may move the optical unit in the optical axis direction to output the first light having a light spot formed according to a predetermined pattern. The light emitting unit may output the first light by moving the optical unit in the optical axis direction through the driving unit.

A light spot may be created by a light source. For example, when the light source is a VCSEL (Vertical Cavity Surface Emitting Lase) array, the VCSEL may include a plurality of emitters. When the light source emits light through the plurality of emitters, first light including a plurality of light spots corresponding to each of the plurality of emitters may be output. An optical member such as a diffuser or a lens disposed on the light source can control the size of light emitted from the emitter. For example, in an optical member such as a diffuser or a lens, the separation distance from the light source may be changed, and the size of the light spot may be changed according to the separation distance from the light source. Accordingly, as the light spot increases, the point light source may be changed to a surface light source and output.

17 is a diagram for describing a first pixel group and a second pixel group of first image information according to an embodiment of the present invention.

In (a) of FIG. 17 , a shade indicates a first pixel group (group1) of the first image information, and in FIG. 17(b) , a shade indicates a second pixel group (group2) of the first image information. 17 and 16 , it can be seen that the first pixel group group1 corresponds to a light spot of the first light, and the second pixel group group2 corresponds to an area other than the light spot. The processor may classify each pixel of the first image information into one of a first pixel group group1 or a second pixel group group2 according to a preset classification criterion.

18A and 18B are diagrams for explaining a process of comparing a second pixel group and a reference value according to an exemplary embodiment.

18A is a graph illustrating first image information according to an exemplary embodiment, and FIG. 18B is a graph illustrating pixel values of the first image information.

In the first image information as shown in FIG. 18A, when pixel values arranged on line a-a' are shown in the form of a graph, it can be shown as shown in FIG. 18B. In FIG. 18B , a shaded portion indicates a first pixel group group1 and a non-shaded portion indicates a second pixel group group2 .

The processing unit compares a pixel value (amplitude) of a first pixel group that is a shaded portion and a reference value (threshold). That is, the pixel value (amplitude) of the second pixel group (group2), which is a non-shaded portion, is not compared with the reference value (threshold).

Referring to FIG. 18B , it can be seen that the pixel value of each pixel included in the second pixel group group2 is smaller than a threshold. Since the pixel value arranged in the second pixel group (group2) and the threshold value are smaller than the threshold, the processing unit may determine that there is no abnormality (eg, dropout or crack) in the optical unit region corresponding to the pixel arranged on line aa'. . As described above, the processor compares the pixel values included in all the second pixel groups group2 with the reference value (threshold) to determine whether the optical unit is normal. According to an exemplary embodiment, when the number of pixels having a pixel value smaller than a threshold among pixels included in the second pixel group is greater than a threshold, the processing unit may determine that the optical unit is normal. Accordingly, the processing unit may generate a control signal for driving the light source and transmit it to the light emitting unit.

19A and 19B are diagrams for explaining a process of comparing a second pixel group and a reference value according to another exemplary embodiment.

19A is a graph illustrating first image information according to an exemplary embodiment, and FIG. 19B is a graph illustrating pixel values of the first image information.

In the first image information as shown in FIG. 19A, when pixel values arranged on line a-a' are shown in the form of a graph, it can be shown as shown in FIG. 19B. In FIG. 19B , a shaded portion indicates a first pixel group group1 and a non-shaded portion indicates a second pixel group group2.

The processing unit compares a pixel value (amplitude) of a first pixel group that is a shaded portion and a reference value (threshold). That is, the pixel value (amplitude) of the second pixel group (group2), which is a non-shaded portion, is not compared with the reference value (threshold).

Referring to FIG. 19B , among pixels included in the second pixel group (group2), it can be confirmed that pixels with spot numbers 0 to 40 and 70 to 230 have pixel values smaller than the threshold. have. Through this, the processing unit may determine that there is no abnormality in the optical unit corresponding to the corresponding section.

However, it can be seen that, among pixels included in the second pixel group group2, a pixel having a spot number of 40 to 70 has a pixel amplitude greater than a threshold. Accordingly, the processing unit may determine that an abnormality (such as a dropout or a crack) has occurred in the optical unit region corresponding to the corresponding section. The processing unit compares the pixel values included in all the second pixel groups group2 with the threshold to determine whether an abnormality has occurred in the optical unit.

18A to 19B , the processing unit according to an embodiment of the present invention determines whether the optical unit is abnormal based on the pixel value included in the second pixel group in the first image information. If it is determined whether the optical unit is abnormal based on the pixel value of the first pixel group corresponding to the light spot of the first light, an error may occur in determining whether the optical unit is abnormal. This is because, in the case of the first pixel group corresponding to the light spot, the pixel value may be greatly changed by the object to which light is irradiated or the surrounding environment. On the other hand, in the case of the second pixel group, since the area does not correspond to the light spot, the pixel value change due to the object or the surrounding environment is small. Accordingly, the present invention improves the accuracy of determination by determining whether the optical unit is abnormal through the second pixel group.

20 is a view for explaining an output timing of the first light according to an embodiment of the present invention.

Referring to FIG. 20 , the light emitting unit may emit first light and third light. The first light may mean light for determining whether an optical unit is abnormal, and the third light may mean light for generating a depth image. One third light illustrated in FIG. 20 may correspond to one depth image frame.

Referring to FIG. 20A , the first light and the third light may be repeatedly emitted with each other. That is, the light emitting unit may emit the first light before emitting the third light for generating each frame of the depth image. If it is determined that an abnormality has occurred in the optical unit based on the first light, the processing unit generates a control signal so that the next third light is not emitted.

Referring to FIG. 20B , after the first light is emitted, a plurality of third lights may be continuously emitted, and the first light may be emitted again. For example, when 4 sheets perform super resolution for generating one high-resolution depth image through the depth image frame, the light emitting unit may continuously emit the fourth light after the first light is emitted. If it is determined that an abnormality has occurred in the optical unit based on the first light emitted after the third light is emitted four times, the processing unit generates a control signal so that the next third light is not emitted.

21 is a view for explaining a light receiving process of a second light according to an embodiment of the present invention.

When the processing unit determines that the optical unit is normal and the light source is driven, the light emitting unit may output the third light as shown in Tx1 of FIG. 21 . The light emitting unit outputs the third light for the first time t1 according to a predetermined period like Tx1.

When the light emitting unit outputs the third light at the first time t1, the first light receiving element (phase-in unit) included in the pixel of the sensor operates at the first time (Rx1-1) at which the light emitting unit outputs the third light ( light is received during t1). In addition, the second light receiving element (phase-out unit) included in the pixel of the sensor receives the third light for the second time t2 like Rx1-2. The camera device may generate a depth image based on the amount of light received through the first light receiving element and the amount of light received through the second light receiving element.

The light receiving unit may receive the second light at a third time t3 between the time when the second light receiving element finishes receiving light and the time when the next third light is output from the light emitting unit. The second light may be ambient light other than the light output to the light emitting unit. The sensor may receive the second light through at least one of the first light receiving element and the second light receiving element.

21 shows that the second light is received at the third time t3, but the light receiving unit receives the second light for a predetermined time between the time when the second light receiving element finishes receiving light and the time when the next light is output from the light emitting unit. It can receive light. The time for receiving the second light can be changed in design by those skilled in the art. In another embodiment, the light receiving unit may receive the second light during a period between the first light and the third light is emitted.

22 is a diagram for explaining a control process according to a noise level.

The processor may calculate the noise level based on the second pixel group of the second image information. According to an embodiment, the processor may calculate the noise level through an average of pixel values of pixels included in the second pixel group. The noise level can be calculated linearly or discretely. A higher noise level may mean that the intensity of ambient light is higher, and a lower noise level may mean lower intensity of ambient light. In the case of the first pixel group, inaccuracies may occur in measuring the intensity of ambient light due to the effect of the light output from the light emitting unit, whereas in the second pixel group, the influence by the light output from the light emitting unit is small. It has the advantage of being able to accurately measure the intensity of ambient light.

The processing unit may generate a first signal Sn1 for changing an exposure time of the light receiving unit according to the noise level. When the noise level is high, the processor may generate the first signal Sn1 for increasing the exposure time of the light receiving unit. On the other hand, when the noise level is low, the processor may generate the first signal Sn1 for reducing the exposure time of the light receiving unit. The first signal Sn1 may be transmitted to the light receiving unit.

The processor may generate a second signal Sn2 for changing a gain of a pixel element of a sensor included in the light receiver according to the noise level. When the noise level is high, the processor may generate the second signal Sn2 for increasing the gain value. On the other hand, when the noise level is low, the processor may generate the second signal Sn2 for reducing the gain value. The second signal Sn2 may be transmitted to the light receiving unit.

The processor may generate the third signal Sn3 capable of changing the power of light generated by the light source according to the noise level. When the noise level is high, the processor may generate a third signal Sn3 for increasing the power of light generated by the light source. On the other hand, when the noise level is low, the processor may generate the third signal Sn3 for reducing the power of light generated by the light source. The third signal Sn3 may be transmitted to the light emitting unit.

The processor may change the preset reference value according to the noise level. The processing unit may include a look-up table in which values corresponding to noise levels are stored. The processor may select a value corresponding to the calculated noise level from the lookup table and set it as a reference value.

According to an embodiment of the present invention, there is an advantage in that it is possible to detect an abnormality in the light emitting unit without adding a separate hardware device to the light emitting unit. When an ITO pattern is placed on the diffuser of the light emitting unit and an electrode is connected to detect whether the diffuser is dropped or cracked, contact between the ITO pattern and the electrode may be difficult due to the movement of the optical unit, but in the present invention, the movement of the optical unit and Regardless of whether the diffuser is dropped or cracked, it can be reliably detected. In addition, when a photodiode is installed inside the light emitting unit to detect cracks/falls in the lens or diffuser of the light emitting unit, an inaccurate diagnosis result may be derived due to an error in the amount of reflected light by a plurality of lenses or diffusers, but in the case of the present invention Since it is based on the light-receiving information of the light-receiving unit, it is possible to detect whether the optical unit is abnormal regardless of the amount of reflected light from the lens or the diffuser of the light-emitting unit.

In the above, the embodiment has been mainly described, but this is only an example and does not limit the present invention, and those of ordinary skill in the art to which the present invention pertains are not exemplified above in the range that does not depart from the essential characteristics of the present embodiment. It will be appreciated that various modifications and applications are possible. For example, each component specifically shown in the embodiment can be implemented by modification. And differences related to such modifications and applications should be construed as being included in the scope of the present invention defined in the appended claims.

1: light emitting part
2: light receiver
10: camera module
20: processing unit

Claims (11)

a light source emitting a first light including a plurality of light spots;
a light receiving unit receiving the first light and generating a first image signal based on the received first light;
Including; a processing unit for receiving the first image signal;
The processing unit,
generating first image information including a plurality of pixels based on the first image signal;
classifying the plurality of pixels into any one of a first pixel group including pixels corresponding to the light spot and a second pixel group including pixels not corresponding to the light spot;
comparing a pixel value of the second pixel group with a preset reference value;
A camera device for controlling an operation of the light source based on the comparison result. According to claim 1,
The processing unit,
A camera device for classifying the plurality of pixels into the first pixel group and the second pixel group based on a preset classification criterion. According to claim 1,
the processing unit
When the pixel value of the second pixel group is smaller than a preset reference value, the camera device generates a control signal for turning on the light source. According to claim 1,
the processing unit
When the pixel value of the second pixel group is greater than or equal to a preset reference value, the camera device generates a control signal for turning off the light source. According to claim 1,
The light receiving unit,
A camera device for receiving the first light in synchronization with the driving time of the light source. According to claim 1,
The light receiving unit,
The camera apparatus is synchronized with a non-driving time when the light source is not in operation, receives a second light, and generates a second image signal based on the second light. 7. The method of claim 6,
The processing unit,
generating second image information based on the second image signal;
classifying the plurality of pixels included in the second image information into a first pixel group including pixels corresponding to the light-emitting source and a second pixel group including pixels not corresponding to the light-emitting source;
A camera apparatus for calculating a noise level caused by external light based on a pixel value of a second pixel group of the second image information, and controlling at least one of the light source and the light receiving unit based on the noise level. 8. The method of claim 7,
The processing unit,
A camera device for changing an exposure time of the light receiving unit or a gain of a pixel element of a sensor included in the light receiving unit according to the noise level. 8. The method of claim 7,
The processing unit,
A camera device for changing the power of the light generated by the light source according to the noise level. 8. The method of claim 7,
The processing unit,
The camera device changes the preset reference value according to the noise level. According to claim 1,
The light source is
A camera device for outputting the first light before each depth image frame is generated.

Images