KR102553487B1 - Camera, and terminal including the same - Google Patents

Abstract

The present invention relates to a camera and a terminal having the same. A camera according to an embodiment of the present invention includes a plurality of light sources, a light source unit outputting a first pattern light, and a second pattern light different from the first pattern light generated by converting the first pattern light from the light source unit. and a light conversion unit that outputs either the first pattern light or the second pattern light, and the first reflected light received from the subject in response to the first pattern light output from the light conversion unit and the second pattern light. a photodetection unit that detects the second reflected light received from the subject, and controls such that a first pattern light is output at a first time point, and controls such that a second pattern light is output at a second time point after the first time point; and a processor that generates depth information of the subject based on the reflected light and the second reflected light. Accordingly, it is possible to reduce heat generation and size by using one light source unit.

Description

Camera, and a terminal having the same {Camera, and terminal including the same}

The present invention relates to a camera and a terminal having the same, and more particularly, to a slim camera capable of reducing heat generation and size by using one light source unit, and to a terminal having the same.

A camera is a device for capturing images. Recently, as cameras are adopted in mobile terminals, research on miniaturization of cameras is being conducted.

Recently, a depth camera is being installed in a mobile terminal, and a method of simultaneously outputting a plurality of pattern lights from a plurality of light source units to calculate depth information of a subject and calculating depth information of the subject based thereon has been implemented.

However, according to this method, since a plurality of pattern lights must be output at the same time, the size of the camera must be increased and heat generation is severe.

An object of the present invention is to provide a camera capable of reducing heat generation and size by using one light source unit, and a terminal having the same.

Another object of the present invention is to provide a camera capable of calculating depth information with high resolution by alternately outputting a plurality of pattern lights, and a terminal having the same.

Another object of the present invention is to provide a camera capable of varying the output cycle of patterned light according to temperature, and a terminal having the same.

A camera and a terminal having the same according to an embodiment of the present invention for achieving the above object include a plurality of light sources, a light source unit outputting a first pattern light, and converting the first pattern light from the light source unit to generate a first light source. A light conversion unit generating a second pattern light different from the first pattern light and outputting either the first pattern light or the second pattern light, and a light received from a subject in response to the first pattern light output from the light conversion unit. A photodetection unit that detects the first reflected light and the second reflected light received from the subject corresponding to the second pattern light, controls the first pattern light to be output at the first time point, and outputs the first pattern light at the second time point after the first time point. and a processor configured to control two pattern lights to be output and generate depth information about a subject based on the first reflected light and the second reflected light.

Meanwhile, the light conversion unit may transmit and output the first pattern light at a first time point, and output second pattern light that is converted and generated at a second time point.

On the other hand, the light patterns of the first pattern light and the second pattern light do not overlap.

Meanwhile, the light conversion unit may include a micro lens or a liquid lens.

Meanwhile, the camera and the terminal including the same may further include a lens for projecting the first pattern light or the second pattern light output from the light conversion unit to the outside.

Meanwhile, the processor may control the first pattern light and the second pattern light to be output alternately at regular intervals.

Meanwhile, the camera and the terminal including the same may further include a temperature detector, and the processor may control output cycles of the first pattern light and the second pattern light to be varied according to the detected temperature.

Meanwhile, the processor may control the output period of the first pattern light and the second pattern light to increase as the detected temperature increases.

Meanwhile, the processor may control the resolution of the first pattern light output from the light source unit to decrease as the detected temperature increases.

Meanwhile, the processor may control the plurality of light sources to vary the resolution of the first pattern light output from the light source unit.

Meanwhile, the processor may control the resolution of the first pattern light to decrease as the moving amount of the camera increases.

Meanwhile, the processor may control the output period of the first pattern light and the second pattern light to increase as the moving amount of the camera increases.

Meanwhile, when the light conversion unit includes a liquid lens, the processor may apply a first electrical signal to the liquid lens at a first time point and apply a second electrical signal to the liquid lens at a second time point.

Meanwhile, the optical conversion unit may include a lens driving unit for applying an electrical signal to the liquid lens and a sensor unit for detecting a curvature of the liquid lens formed based on the electrical signal.

Meanwhile, the sensor unit may detect a change in size or area of a boundary region between an insulator on an electrode in a liquid lens and an electrically conductive aqueous solution.

Meanwhile, the sensor unit may detect capacitance formed between the conductive aqueous solution and the electrode in response to a size or change in area of a boundary region between an insulator and the electrically conductive aqueous solution on the electrode in the liquid lens.

On the other hand, the optical conversion unit may further include a plurality of conductive lines for supplying a plurality of electrical signals output from the lens driving unit to the liquid lens, a switching element disposed between any one of the plurality of conductive lines and the sensor unit. .

Meanwhile, the processor may calculate the curvature of the liquid lens based on the capacitance detected by the sensor unit, and output a variable pulse width signal to the lens driver based on the calculated curvature and the target curvature.

Meanwhile, the processor may control the duty of the variable pulse width signal to increase when the calculated curvature is smaller than the target curvature.

A camera and a terminal including the camera according to an embodiment of the present invention include a plurality of light sources, a light source unit outputting a first pattern light, and a light source unit that converts the first pattern light from the light source unit to generate a light source different from the first pattern light. A light conversion unit that generates two pattern lights and outputs either a first pattern light or a second pattern light; a first reflected light received from a subject in response to the first pattern light output from the light conversion unit; 2 A photodetection unit that detects second reflected light received from a subject in response to pattern light, controls to output first pattern light at a first time point, and outputs second pattern light at a second time point after the first time point. and a processor configured to generate depth information about a subject based on the first reflected light and the second reflected light. Accordingly, it is possible to reduce heat generation and size by using one light source unit.

In particular, since the light conversion unit outputs different pattern lights for each viewpoint, a light interval in the first pattern light can be widened, so heat generation can be reduced and the size of the camera can be made compact.

On the other hand, by alternately outputting a plurality of pattern lights, the resolution of the light pattern by the synthesis of the first reflected light and the second reflected light is increased, and as a result, depth information with high resolution can be calculated.

Meanwhile, the light conversion unit may transmit and output the first pattern light at a first time point, and output second pattern light that is converted and generated at a second time point. Accordingly, since the light interval in the first pattern light can be widened, heat generation can be reduced and the size of the camera can be compactly configured.

On the other hand, the light patterns of the first pattern light and the second pattern light do not overlap. Accordingly, since the light interval in the first pattern light can be widened, heat generation can be reduced and the size of the camera can be compactly configured.

Meanwhile, the light conversion unit may include a micro lens or a liquid lens. Accordingly, it is possible to simply implement the second pattern light in which the first pattern light and the light pattern do not overlap.

Meanwhile, the camera and the terminal including the same may further include a lens for projecting the first pattern light or the second pattern light output from the light conversion unit to the outside. Accordingly, the quality of the patterned light projected to the outside can be improved.

Meanwhile, the processor may control the first pattern light and the second pattern light to be output alternately at regular intervals.

Meanwhile, the camera and the terminal including the same may further include a temperature detector, and the processor may control output cycles of the first pattern light and the second pattern light to be varied according to the detected temperature. Accordingly, heat generation of the camera can be reduced.

Meanwhile, the processor may control the output period of the first pattern light and the second pattern light to increase as the detected temperature increases. Accordingly, heat generation of the camera can be reduced.

Meanwhile, the processor may control the resolution of the first pattern light output from the light source unit to decrease as the detected temperature increases. Accordingly, heat generation of the camera can be reduced.

Meanwhile, the processor may control the plurality of light sources to vary the resolution of the first pattern light output from the light source unit. Accordingly, it is possible to vary the resolution of depth information while reducing heat generation of the camera.

Meanwhile, the processor may control the resolution of the first pattern light to decrease as the moving amount of the camera increases. Accordingly, accuracy of depth information can be improved.

Meanwhile, the processor may control the output period of the first pattern light and the second pattern light to increase as the moving amount of the camera increases. Accordingly, accuracy of depth information can be improved.

Meanwhile, when the light conversion unit includes a liquid lens, the processor may apply a first electrical signal to the liquid lens at a first time point and apply a second electrical signal to the liquid lens at a second time point. Accordingly, it is possible to simply drive the liquid lens.

Meanwhile, the optical conversion unit may include a lens driving unit for applying an electrical signal to the liquid lens and a sensor unit for detecting a curvature of the liquid lens formed based on the electrical signal. Accordingly, it is possible to simply calculate the curvature of the liquid lens.

Meanwhile, the sensor unit may detect a change in size or area of a boundary region between an insulator on an electrode in a liquid lens and an electrically conductive aqueous solution. Accordingly, it is possible to simply calculate the curvature of the liquid lens.

Meanwhile, the sensor unit may detect capacitance formed between the conductive aqueous solution and the electrode in response to a size or change in area of a boundary region between an insulator and the electrically conductive aqueous solution on the electrode in the liquid lens. Accordingly, it is possible to simply calculate the curvature of the liquid lens.

On the other hand, the optical conversion unit may further include a plurality of conductive lines for supplying a plurality of electrical signals output from the lens driving unit to the liquid lens, a switching element disposed between any one of the plurality of conductive lines and the sensor unit. . Accordingly, it is possible to simply calculate the curvature of the liquid lens.

Meanwhile, the processor may calculate the curvature of the liquid lens based on the capacitance detected by the sensor unit, and output a variable pulse width signal to the lens driver based on the calculated curvature and the target curvature. Accordingly, it is possible to implement the liquid lens to have a desired target curvature.

Meanwhile, the processor may control the duty of the variable pulse width signal to increase when the calculated curvature is smaller than the target curvature. Accordingly, it is possible to implement the liquid lens to have a desired target curvature.

1A is a perspective view of a mobile terminal, which is an example of a terminal according to an embodiment of the present invention, viewed from the front.
Figure 1b is a rear perspective view of the mobile terminal shown in Figure 1a.
2 is a block diagram of the mobile terminal of FIG. 1;
Figure 3a is an internal cross-sectional view of the RGB camera of Figure 1b.
Figure 3b is an internal block diagram of the RGB camera of Figure 1b.
Fig. 4 is an internal convex view of the depth camera of Fig. 1b;
FIG. 5A is a diagram referenced for describing an operation of the depth camera of FIG. 1B .
5B illustrates a depth image generated based on calculated distance information.
FIG. 6 is an internal structure diagram of the light output unit of FIG. 4 .
7 is a flowchart illustrating a method of operating a depth camera according to an embodiment of the present invention.
8A to 11 are diagrams referenced for description of the operation method of FIG. 7 .
12A to 12B are diagrams for explaining a liquid lens driving method.
13A to 13C are views showing the structure of a liquid lens.
14A to 14E are diagrams for explaining lens curvature variation of a liquid lens.
15A and 15B are various examples of internal block diagrams of a light conversion unit.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "module" and "unit" for the components used in the following description are simply given in consideration of ease of writing this specification, and do not themselves give a particularly important meaning or role. Accordingly, the “module” and “unit” may be used interchangeably.

1A is a front perspective view of a mobile terminal, which is an example of a terminal according to an embodiment of the present invention, and FIG. 1B is a rear perspective view of the mobile terminal shown in FIG. 1A.

Referring to FIG. 1A , a case constituting the exterior of the mobile terminal 100 is formed by a front case 100-1 and a rear case 100-2. Various electronic components may be embedded in the space formed by the front case 100-1 and the rear case 100-2.

In detail, a display 180, a first audio output module 153a, a first camera 195a, and first to third user input units 130a, 130b, and 130c may be disposed on the front case 100-1. there is. Also, the fourth user input unit 130d, the fifth user input unit 130e, and the first to third microphones 123a, 123b, and 123c may be disposed on the side surface of the rear case 100-2.

The display 180 may operate as a touch screen by overlapping the touch pad in a layer structure.

The first audio output module 153a may be implemented in the form of a receiver or a speaker. The first camera 195a may be implemented in a form suitable for capturing an image or video of a user or the like. In addition, the microphone 123 may be implemented in a form suitable for receiving a user's voice or other sounds.

The first to fifth user input units 130a, 130b, 130c, 130d, and 130e and the sixth and seventh user input units 130f and 130g described below may be collectively referred to as the user input unit 130.

The first to second microphones 123a and 123b are disposed on the upper side of the rear case 100-2, that is, on the upper side of the mobile terminal 100, to collect audio signals, and the third microphone 123c, The lower side of the rear case 100-2, that is, the lower side of the mobile terminal 100, may be disposed for audio signal collection.

Referring to FIG. 1B , a second camera 195b, a third camera 195c, and a fourth microphone (not shown) may be additionally mounted on the back of the rear case 100-2, and the rear case 100 The sixth and seventh user input units 130f and 130g and the interface unit 175 may be disposed on the side surface of -2).

The second camera 195b may have a photographing direction substantially opposite to that of the first camera 195a and may have pixels different from those of the first camera 195a. A flash (not shown) and a mirror (not shown) may be additionally disposed adjacent to the second camera 195b.

Meanwhile, the second camera 195b may be an RGB camera, and the third camera 195c may be a depth camera for calculating a distance to a subject.

A second sound output module (not shown) may be additionally disposed in the rear case 100-2. The second audio output module may implement a stereo function together with the first audio output module 153a, and may be used for a call in a speakerphone mode.

A power supply unit 190 for supplying power to the mobile terminal 100 may be mounted on the side of the rear case 100 - 2 . The power supply unit 190 is, for example, a rechargeable battery and may be detachably coupled to the rear case 100-2 for charging.

The fourth microphone 123d may be disposed on the front side of the rear case 100 - 2 , that is, on the back side of the mobile terminal 100 to collect audio signals.

2 is a block diagram of the mobile terminal of FIG. 1;

Referring to FIG. 2 , the mobile terminal 100 includes a wireless communication unit 110, an audio/video (A/V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, and a memory. 160, an interface unit 175, a control unit 170, and a power supply unit 190 may be included. When these components are implemented in actual applications, two or more components may be combined into one component, or one component may be subdivided into two or more components as needed.

The wireless communication unit 110 may include a broadcast reception module 111, a mobile communication module 113, a wireless Internet module 115, a short-distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 may receive at least one of a broadcast signal and broadcast-related information from an external broadcast management server through a broadcast channel. A broadcast signal received through the broadcast reception module 111 and/or broadcast related information may be stored in the memory 160 .

The mobile communication module 113 may transmit and receive radio signals with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include a voice call signal, a video call signal, or various types of data according to text/multimedia message transmission/reception.

The wireless Internet module 115 refers to a module for wireless Internet access, and the wireless Internet module 115 may be built into or external to the mobile terminal 100 .

The short-distance communication module 117 refers to a module for short-distance communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and the like may be used as short-range communication technologies.

A Global Position System (GPS) module 119 receives location information from a plurality of GPS satellites.

An audio/video (A/V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 195 and a microphone 123.

The camera 195 may process an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a photographing mode. And, the processed image frame may be displayed on the display 180 .

An image frame processed by the camera 195 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110 . Two or more cameras 195 may be provided according to the configuration of the terminal.

The microphone 123 may receive an external audio signal through a microphone in a display off mode, for example, a call mode, a recording mode, or a voice recognition mode, and process it into electrical voice data.

On the other hand, the microphones 123 may be disposed in a plurality in different positions. An audio signal received from each microphone may be processed as an audio signal by the controller 170 or the like.

The user input unit 130 generates key input data input by the user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, and a touch pad (static pressure/capacitance) capable of receiving commands or information through a user's push or touch manipulation. In particular, when the touch pad forms a mutual layer structure with the display 180 to be described later, it may be referred to as a touch screen.

The sensing unit 140 detects the current state of the mobile terminal 100, such as the open/closed state of the mobile terminal 100, the location of the mobile terminal 100, whether or not there is a user contact, and controls the operation of the mobile terminal 100. A sensing signal may be generated.

The sensing unit 140 may include a proximity sensor 141, a pressure sensor 143, a motion sensor 145, a touch sensor 146, and the like.

The proximity sensor 141 can detect the presence or absence of an object approaching the mobile terminal 100 or an object existing near the mobile terminal 100 without mechanical contact. In particular, the proximity sensor 141 may detect a nearby object using a change in an alternating magnetic field or a change in a static magnetic field, or a rate of change in capacitance.

The pressure sensor 143 can detect whether pressure is applied to the mobile terminal 100 and the magnitude of the pressure.

The motion sensor 145 may detect a position or movement of the mobile terminal 100 using an acceleration sensor, a gyro sensor, or the like.

The touch sensor 146 may detect a touch input by a user's finger or a touch input by a specific pen. For example, when a touch screen panel is disposed on the display 180, the touch screen panel may include a touch sensor 146 for detecting location information and intensity information of a touch input. A sensing signal detected by the touch sensor 146 may be transmitted to the controller 170 .

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display 180, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display 180 displays and outputs information processed by the mobile terminal 100 . For example, when the mobile terminal 100 is in a call mode, a UI (User Interface) or GUI (Graphic User Interface) related to a call is displayed. In addition, when the mobile terminal 100 is in a video call mode or a shooting mode, captured or received images can be displayed individually or simultaneously, and a UI and GUI are displayed.

On the other hand, as described above, when the display 180 and the touch pad form a mutual layer structure to form a touch screen, the display 180 can be used as an input device capable of inputting information by a user's touch in addition to an output device. can

The audio output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, or a broadcast reception mode. In addition, the audio output module 153 outputs audio signals related to functions performed by the mobile terminal 100, for example, a call signal reception sound and a message reception sound. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying occurrence of an event in the mobile terminal 100 . The alarm unit 155 outputs a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, a signal may be output in the form of a vibration.

A haptic module 157 generates various tactile effects that a user can feel. A representative example of the tactile effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a tactile effect, the intensity and pattern of the vibration generated by the haptic module 157 can be changed, and different vibrations can be synthesized and output or sequentially output.

The memory 160 may store programs for processing and control of the control unit 170, and provides a function for temporarily storing input or output data (eg, phonebook, message, still image, video, etc.). can also be done

The interface unit 175 serves as an interface with all external devices connected to the mobile terminal 100 . The interface unit 175 can receive data from an external device or receive power and transmit it to each component inside the mobile terminal 100, and can transmit data inside the mobile terminal 100 to an external device.

The control unit 170 typically controls the overall operation of the mobile terminal 100 by controlling the operation of each unit. For example, it may perform related control and processing for voice calls, data communications, video calls, and the like. Also, the controller 170 may include a multimedia playback module 181 for playing multimedia. The multimedia playback module 181 may be configured as hardware within the control unit 170 or may be configured as software separately from the control unit 170. Meanwhile, the controller 170 may include an application processor (not shown) for driving an application. Alternatively, the application processor (not shown) may be provided separately from the control unit 170 .

In addition, the power supply unit 190 may receive external power and internal power under the control of the controller 170 to supply power necessary for the operation of each component.

Figure 3a is an internal cross-sectional view of the RGB camera of Figure 1b.

Referring to the drawings, FIG. 3A is an example of a cross-sectional view of the camera 195b.

The camera 195b may include an aperture 194 , a lens device 193 , and an image sensor 820 .

The diaphragm 194 may open and close light incident to the lens device 193 .

The lens device 193 may include a plurality of lenses adjusted for variable focus.

The image sensor 820 may include an RGB filter 915b and a sensor array 911b that converts light signals into electrical signals in order to sense RGB colors.

Accordingly, the image sensor 820 may sense and output each RGB image.

Figure 3b is an internal block diagram of the RGB camera of Figure 1b.

Referring to the drawings, FIG. 3B is an example of a block diagram of a camera 195b.

The camera 195b may include a lens device 193 , an image sensor 820 , and an image processor 830 .

The lens device 193 may include a plurality of lenses that receive incident light and are adjusted for variable focus.

The image processor 830 may generate an RGB image based on an electrical signal from the image sensor 820 .

In particular, the image processor 830 may generate an image signal based on incident light that has passed through the lens device 193 . Accordingly, an image signal may be generated using the image sensor 820 when photographing the back side.

Meanwhile, an exposure time of the image sensor 820 may be adjusted based on an electrical signal.

Meanwhile, the RGB image from the image processor 830 may be transmitted to the controller 170 of the mobile terminal 100 .

Meanwhile, the controller 170 of the mobile terminal 100 may output a control signal to the lens device 193 to move the lens within the lens device 193 . For example, a control signal for auto focusing may be output to the lens device 193 .

Meanwhile, the controller 170 of the mobile terminal 100 may output an aperture control signal for adjusting light transmittance of the aperture 194 to the aperture 194 .

For example, the control unit 170 of the mobile terminal 100 may control the iris 194 to open during the first period and close the iris 194 during the second period.

Fig. 4 is an internal convex view of the depth camera of Fig. 1b;

Referring to the drawing, the depth camera 195c of FIG. 4 may include a light output unit 210, a light photodetector 280, a temperature detector 260, and a processor 270.

The processor 270 may output a sine wave driving signal Tx of a predetermined frequency to the optical output unit 210 .

The light output unit 210 may output the first pattern light or the second pattern light to the external subject 40 based on the sine wave driving signal, that is, the transmission signal Tx.

In particular, the light output unit 210 may output a first pattern light at a first time point and output a second pattern light at a second time point after the first time point.

That is, the light output unit 210 may alternately output the first pattern light and the second pattern light.

The first pattern light or the second pattern light output to the external subject 40 is scattered or reflected by the external subject 40 . Accordingly, the first reception light or the second reception light scattered or reflected by the external subject 40 may be received by the depth camera 195c.

The photodetector 280 may receive the first reception light or the second reception light and convert it into a reception signal that is an electrical signal.

Meanwhile, the electrical signal Rx converted by the photodetector 280 may be transmitted to the processor 270 .

The processor 270 may calculate distance information about an external subject based on the transmission signal Tx and the transmission signal Tx.

In particular, the processor 270 may synthesize the first received light and the second received light, and calculate distance information with respect to an external subject based on the synthesized light.

Meanwhile, the processor 270 may calculate distance information with respect to an external subject based on a difference between the first pattern light and the second pattern light and light obtained by synthesizing the first received light and the second received light.

Meanwhile, distance information calculated by the depth camera 195c may be transmitted to the controller 170 of the mobile terminal 100 .

Also, the controller 170 of the mobile terminal 100 may generate a depth image based on the distance information calculated by the depth camera 195c.

Alternatively, the processor 270 in the depth camera 195c may generate a depth image based on the calculated distance information.

Meanwhile, the light output unit 210 outputs the first pattern light to the external subject 40 at a first time point, and outputs the second pattern light to the external subject 40 at a second time point after the first time point. can be printed out.

That is, the light output unit 210 may alternately output the first pattern light and the second pattern light.

In particular, the second pattern light is pattern light generated by copying the first pattern light, and it is preferable that the light pattern of the second pattern light does not overlap with the light pattern of the first pattern light.

Accordingly, since the light output unit 210 uses one light source unit, heat generation and size of the depth camera 195c can be reduced.

In particular, since the light conversion unit 320 outputs different pattern lights for each viewpoint, a light interval in the first pattern light can be widened, so heat generation can be reduced, and the size of the depth camera 195c is also compact. can be configured.

On the other hand, by alternately outputting a plurality of pattern lights, the resolution of the light pattern by the synthesis of the first reflected light and the second reflected light is increased, and as a result, depth information with high resolution can be calculated.

Meanwhile, the temperature detection unit 260 may detect the temperature of the light output unit 210 . The detected temperature information T may be input to the processor 270 .

Meanwhile, the processor 270 may control the first pattern light and the second pattern light to be output alternately at regular intervals.

Meanwhile, the processor 270 may control the output period of the first pattern light and the second pattern light to be varied according to the detected temperature. Accordingly, heat generation of the depth camera 195c can be reduced.

Meanwhile, the processor 270 may control the output period of the first pattern light and the second pattern light to increase as the detected temperature increases. Accordingly, heat generation of the depth camera 195c can be reduced.

Meanwhile, the processor 270 may control the resolution of the first pattern light output from the light source unit 310 to decrease as the detected temperature increases. Accordingly, heat generation of the depth camera 195c can be reduced.

Meanwhile, the processor 270 may control the plurality of light sources to vary the resolution of the first pattern light output from the light source unit 310 . Accordingly, it is possible to vary the resolution of depth information while reducing heat generation of the depth camera 195c.

Meanwhile, the processor 270 may control the resolution of the first pattern light to decrease as the movement amount of the depth camera 195c increases. Accordingly, accuracy of depth information can be improved.

Meanwhile, the processor 270 may control the output period of the first pattern light and the second pattern light to increase as the movement amount of the depth camera 195c increases. Accordingly, accuracy of depth information can be improved.

FIG. 5A is a diagram referenced for describing an operation of the depth camera of FIG. 1B .

Referring to the drawings, the depth camera 195c selectively outputs first pattern light or second pattern light to an external subject 40, and first or second reflected light scattered or reflected by the external subject 40. may be received, and distance information may be calculated using a difference between the first pattern light or the second pattern light and the first reflected light or the second reflected light.

5B illustrates a depth image generated based on calculated distance information.

Referring to the drawings, distance information calculated by the depth camera 195c may be expressed as a luminance image 65 as shown in FIG. 5B. Various distance values of an external subject may be displayed as a corresponding luminance level. When the distance information is close, the luminance level may be large (brightness may be bright), and when the depth is long, the luminance level may be small (brightness may be dark).

FIG. 6 is an internal structure diagram of the light output unit of FIG. 4 .

Referring to the drawings, the light output unit 210 includes a light source unit 310 that includes a plurality of light sources and outputs first pattern light, and converts the first pattern light from the light source unit 310 to generate first pattern light. A light conversion unit 320 may be provided to generate a second pattern light different from the first pattern light and output either the first pattern light or the second pattern light.

According to this, the light conversion unit 320 outputs the first pattern light to the external subject 40 at a first time point, and outputs the second pattern light to the external subject 40 at a second time point after the first time point. can be output to

That is, the light output unit 210 may alternately output the first pattern light and the second pattern light.

In particular, the second pattern light is pattern light generated by copying the first pattern light, and it is preferable that the light pattern of the second pattern light does not overlap with the light pattern of the first pattern light.

Accordingly, since the light output unit 210 uses one light source unit, heat generation and size of the depth camera 195c can be reduced.

Meanwhile, the light output unit 210 may further include a lens 330 that projects the first pattern light or the second pattern light output from the light conversion unit 320 to the outside. Accordingly, the quality of the patterned light projected to the outside can be improved.

Meanwhile, the lens 330 may change the traveling direction of light, and a condensing lens or the like may be used for this purpose.

Meanwhile, the light conversion unit 320 may copy the first pattern light from the light source unit 310 to generate a second pattern light different from the first pattern light and output it.

In particular, the light conversion unit 320 may transmit and output the first pattern light at a first time point, and output the converted and generated second pattern light at a second time point. Accordingly, since the light interval in the first pattern light can be widened, heat generation can be reduced, and the size of the depth camera 195c can be compactly configured.

On the other hand, the light patterns of the first pattern light and the second pattern light do not overlap. Accordingly, since the light interval in the first pattern light can be widened, heat generation can be reduced, and the size of the depth camera 195c can be compactly configured.

To this end, the light conversion unit 320 may include a micro lens or a liquid lens. Accordingly, it is possible to simply implement the second pattern light in which the first pattern light and the light pattern do not overlap.

Meanwhile, when the optical conversion unit 320 includes the liquid lens 500, the processor 270 applies a first electrical signal to the liquid lens 500 at a first time point, and at a second time point, A second electrical signal may be applied to the liquid lens 500 . Accordingly, the liquid lens 500 can be easily driven.

FIG. 7 is a flowchart illustrating a method of operating a depth camera according to an embodiment of the present invention, and FIGS. 8A to 11 are diagrams referred to in the description of the operating method of FIG. 7 .

Referring to the drawings, the processor 270 in the depth camera 195c determines whether it is a first viewpoint (S705), and if so, controls the first pattern light to be output (S710).

The light source unit 310 in the light output unit 210 may include a plurality of light sources and output first pattern light based on the plurality of light sources.

For example, the light source unit 310 includes a plurality of vertical resonance surface-emitting laser diodes (VSCELs), and emits a first pattern light PTa as a surface light source at a first time point T1m as shown in FIG. 8A. can be printed out.

Meanwhile, the light conversion unit 320 receiving the first pattern light PTa from the light source unit 310, as shown in FIG. ) can be transmitted and output.

For example, when the light conversion unit 320 includes the liquid lens 500, the liquid lens 500 may not change the traveling direction of light as shown in (b) of FIG. 12A.

Accordingly, the lens 330 may externally output the first pattern light PTa at the first time point T1m as shown in FIG. 8A .

Meanwhile, in step 705 (S705), if it is not the first view, the processor 270 determines whether it is the second view (S707), and if applicable, controls the second pattern light to be output (S715). ).

For example, as shown in FIG. 8B , the light source unit 310 may output the first pattern light PTa as a surface light source at the second time point T2m.

Meanwhile, the light conversion unit 320 receiving the first pattern light PTa from the light source unit 310 performs photo-conversion at the second time point T2m as shown in FIG. ) can be converted into second pattern light (PTb) and output.

It is preferable that the light patterns of the first pattern light PTa and the second pattern light PTb do not overlap in order to increase optical resolution.

To this end, the light conversion unit 320 may shift the first pattern light PTa in a certain direction or the like.

For example, when the light conversion unit 320 includes the liquid lens 500, as shown in (a) or (c) of FIG. 12a or (b) of FIG. 12b, the liquid lens 500 can change the traveling direction of light.

Accordingly, the lens 330 may externally output the second pattern light PTb at the second time point T2m as shown in FIG. 8B (S710).

As a result, when the light conversion unit 320 includes the liquid lens 500, the processor 270 applies a first electrical signal to the liquid lens 500 at a first time point, and at a second time point, A second electrical signal may be applied to the liquid lens 500 . Accordingly, the liquid lens 500 can be easily driven.

Next, after outputting the first pattern light, the photodetector 280 may receive and detect first reception light reflected from an external subject in response to the first pattern light (S720).

Next, after the second pattern light, the photodetector 280 may receive and detect second reception light reflected from an external subject in response to the second pattern light (S725).

The processor 270 may receive an electrical signal corresponding to the first reflected light from the photodetector 280 and an electrical signal corresponding to the second reflected light after the first time point and the second time point, and synthesize them ( S730),

That is, the processor 270 may synthesize the first reflected light and the second reflected light from the photodetector 280 after the first and second viewpoints.

Then, the processor 270 may calculate depth information based on the synthesized signal or the synthesized light (S735).

(a) of FIG. 8c illustrates the first pattern light PTa, (b) of FIG. 8c illustrates the second pattern light PTb, and (c) of FIG. 8c illustrates the first pattern light PTb. The synthesized light PTc obtained by synthesizing (PTa) and the second pattern light PTb is exemplified.

As such, when the first pattern light PTa and the second pattern light PTb do not overlap, the light pattern resolution of the synthesized light PTc is the first pattern light PTa or the second pattern light PTb is approximately twice the optical pattern resolution of .

Accordingly, heat generation can be reduced compared to the conventional method of simultaneously outputting a plurality of pattern lights, and the light pattern resolution can be equal to or higher than that.

Similar to FIG. 8C , the processor 270 may synthesize the first reflection light and the second reflection light and calculate distance information based on the synthesized light.

Accordingly, it is possible to calculate distance information based on a light pattern resolution approximately twice the light pattern resolution of the first reflected light or the second reflected light. Accordingly, an accurate distance calculation for an external subject is possible.

8D illustrates first synthesized light PTam and second synthesized light PTBm projected onto the first surface SFa and the second surface SFb.

The first synthesized light PTam may be a combination of the first pattern light PTa and the second pattern light PTb of FIG. 8C .

Depending on the distance or angle difference between the first surface SFa and the second surface SFb, the distance difference between adjacent first light rays Pa and second light rays Pb in the first composite light PTam is d or , a distance difference between adjacent first and second lights Pb' in the second composite light PTBm may be represented as d1.

The processor 270 may calculate distance information on an external subject according to the difference between d and d1.

On the other hand, in the present invention, the depth camera 195c that outputs the pattern light reproduces and uses the pattern light from one light source unit in order to reduce heat generation and reduce the size.

In another embodiment of the present invention, heat generation of the depth camera 195c may be reduced based on temperature information sensed through the temperature detector 260 .

To this end, on the other hand, the depth camera 195c and the mobile terminal 100 having the same further include a temperature detection unit 260, and the processor 270 generates the first pattern light and the second pattern light according to the detected temperature. The output period of the pattern light can be controlled to be variable. Accordingly, heat generation of the depth camera 195c can be reduced.

Meanwhile, as shown in FIG. 9A , the processor 270 may control the output period of the first pattern light and the second pattern light to increase as the detected temperature increases. Accordingly, heat generation of the depth camera 195c can be reduced.

10(a) illustrates that, when the temperature is Ta, the output cycles of the first pattern light PTa and the second pattern light PTb are 2T1, respectively.

Meanwhile, FIG. 10(a) illustrates that, when the temperature is Ta, the output interval between the first pattern light PTa and the second pattern light PTb that are alternately output is T1.

10(b) illustrates that, when the temperature is Tb higher than Ta, the output cycles of the first pattern light PTa and the second pattern light PTb are 2T2, respectively. At this time, T2 is preferably larger than T1.

Meanwhile, (b) of FIG. 10 illustrates that, when the temperature is Tb higher than Ta, the output interval between the first pattern light PTa and the second pattern light PTb that are alternately output is T2. . Accordingly, heat generation of the depth camera 195c can be reduced.

Meanwhile, the processor 270 may control the resolution of the first pattern light output from the light source unit 310 to decrease as the detected temperature increases, as shown in FIG. 9B. Accordingly, heat generation of the depth camera 195c can be reduced.

To this end, the processor 270 may control the plurality of light sources to vary the resolution of the first pattern light output from the light source unit 310 . Accordingly, it is possible to vary the resolution of depth information while reducing heat generation of the depth camera 195c.

Similarly, when the depth camera 195c and the mobile terminal 100 including the depth camera 195c move, it is possible to change the output period of the pattern light or the resolution of the pattern light in order to improve the accuracy of calculating depth information.

For example, as shown in FIG. 9C , the processor 270 may control the output period of the first pattern light and the second pattern light to increase as the movement amount of the depth camera 195c increases. Accordingly, accuracy of depth information can be improved.

Meanwhile, as shown in FIG. 9D , the processor 270 may control the resolution of the first pattern light to decrease as the movement amount of the depth camera 195c increases. Accordingly, accuracy of depth information can be improved.

11(a) illustrates that, when the temperature is Ta1, the output cycles of the first pattern light PTam and the second pattern light PTbm are 2T1, respectively.

Meanwhile, FIG. 11(a) illustrates that when the temperature is Ta1, the output interval between the first pattern light PTam and the second pattern light PTbm alternately outputted is T1.

11(b) illustrates that, when the temperature is Tb1 higher than Ta1, the output cycles of the first pattern light PTa and the second pattern light PTb are 2T1, respectively.

Meanwhile, (b) of FIG. 11 illustrates that, when the temperature is Tb1 higher than Ta1, the output interval between the first pattern light PTa and the second pattern light PTb that are alternately output is T1. .

On the other hand, compared to FIG. 11(a), the amount of patterns of the first pattern light PTa and the second pattern light PTb in FIG. 11(b) is the first pattern light in FIG. 11(a) It is preferable to be smaller than the pattern amount of (PTam) and the second pattern light (PTbm).

That is, in the case of FIG. 11(b) where the temperature is higher, the pattern light resolution of the output pattern light may be lower. Accordingly, it is possible to calculate depth information on an external subject while reducing heat generated by the depth camera 195c.

12A to 12B are diagrams for explaining a liquid lens driving method.

First, (a) of FIG. 12A illustrates that a first voltage V1 is applied to the liquid lens 500 so that the liquid lens operates like a concave lens.

Next, (b) of FIG. 12A illustrates that the liquid lens 500 does not change the traveling direction of light when a second voltage V2 greater than the first voltage V1 is applied.

Next, (c) of FIG. 12A illustrates that a third voltage V3 greater than the second voltage V2 is applied to the liquid lens 500 so that the liquid lens operates like a convex lens.

Meanwhile, in FIG. 12A, the curvature or diopter of the liquid lens changes according to the level of applied voltage, but is not limited thereto, and the curvature or diopter of the liquid lens may also change according to the pulse width of the applied pulse. do.

Next, (a) of FIG. 12B illustrates that the liquid in the liquid lens 500 operates like a convex lens as it has the same curvature.

That is, according to (a) of FIG. 12B, the incident light Lpaa is concentrated and the corresponding output light Lpab is output.

Next, (b) of FIG. 12B illustrates that, as the liquid in the liquid lens 500 has an asymmetrical curved surface, the traveling direction of light is changed upward.

That is, according to (b) of FIG. 12B, the incident light Lpaa is concentrated upward, and the corresponding output light Lpac is output.

13A to 13C are views showing the structure of a liquid lens. In particular, FIG. 13a shows a top view of the liquid lens, FIG. 13b shows a bottom view of the liquid lens, and FIG. 13c shows a cross-sectional view taken along line II′ of FIGS. 13a and 13c.

In particular, FIG. 13A may be a diagram corresponding to the right side of the liquid lens 500 of FIGS. 12A to 12B, and FIG. 13B may be a diagram corresponding to the left side of the liquid lens 500 of FIGS. 12A to 12B.

Referring to the drawing, the liquid lens 500 may have a common electrode (COM) 520 disposed thereon, as shown in FIG. 13A . In this case, the common electrode (COM) 520 may be disposed in a tube shape, and the liquid 530 may be disposed in a lower region of the common electrode (COM) 520, particularly in a region corresponding to the hollow. there is.

Meanwhile, although not shown in the drawing, an insulator (not shown) may be disposed between the common electrode (COM) 520 and the liquid to insulate the common electrode (COM) 520 .

Also, as shown in FIG. 13B , a plurality of electrodes LA to LD 540a to 540d may be disposed below the common electrode COM 520 , in particular, below the liquid 530 . The plurality of electrodes LA to LD 540a to 540d may be disposed in a form surrounding the liquid 530 .

In addition, a plurality of insulators 550a to 550d for insulation may be disposed between the plurality of electrodes LA to LD 540a to 540d and the liquid 530 , respectively.

That is, the liquid lens 500 includes a common electrode (COM) 520, a plurality of electrodes (LA to LD) 540a to 540d disposed spaced apart from the common electrode (COM) 520, and the common electrode A liquid 530 and an electrically conductive aqueous solution ( 595 in FIG. 13C ) disposed between the (COM) 520 and the plurality of electrodes (LA to LD) 540a to 540d may be provided.

Referring to FIG. 13C , the liquid lens 500 is insulated from a plurality of electrodes (LA to LD) 540a to 540d on a first substrate 510 and a plurality of electrodes (LA to LD) 540a to 540d. A liquid 530 on a plurality of insulators 550a to 550d, a plurality of electrodes LA to LD 540a to 540d, an electroconductive aqueous solution 595 on the liquid 530, and a liquid A common electrode (COM) 520 spaced apart from 530 and a second substrate 515 on the common electrode (COM) 520 may be provided.

The common electrode 520 may be hollow and formed in a tube shape. Also, a liquid 530 and an electrically conductive aqueous solution 595 may be disposed in the hollow region. The liquid 530 may be arranged in a circular shape, as shown in FIGS. 13A to 13B. The liquid 530 at this time may be a non-conductive liquid such as oil.

Meanwhile, the size of the hollow region may increase from the bottom to the top of the hollow region, and accordingly, the size of the plurality of electrodes LA to LD 540a to 540d may decrease from the bottom to the top.

In FIG. 13C , among the plurality of electrodes LA to LD 540a to 540d, the first electrode LA 540a and the second electrode LB 540b are inclined, and from the bottom to the top, Illustrate that the size is getting smaller.

Meanwhile, unlike FIGS. 13A to 13C , a plurality of electrodes (LA to LD) 540a to 540d may be formed on the upper part of the position of the common electrode 520 and the common electrode 520 may be formed on the lower part. do.

Meanwhile, although four electrodes are exemplified as the plurality of electrodes in FIGS. 13A to 13C , it is not limited thereto, and it is possible to form two or more various electrodes.

Meanwhile, in FIG. 13C , after a pulse-shaped electrical signal is applied to the common electrode 520, a pulse-shaped electrical signal is applied to the first electrode (LA) 540a and the second electrode (LB) 540b after a predetermined time. When an electrical signal is applied, a potential difference is generated between the common electrode 520, the first electrode (LA) 540a, and the second electrode (LB) 540b, and thus, an electrically conductive aqueous solution having electrical conductivity. The shape of the liquid 595 changes, and the shape of the liquid 530 inside the liquid 530 changes in response to the shape change of the electrically conductive aqueous solution 595 .

Meanwhile, in the present invention, the curvature of the formed liquid 530 is easily and quickly detected according to the electrical signals applied to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. suggest ways to

To this end, the sensor unit 962 in the present invention is the area of the boundary region Ac0 between the first insulator 550a on the first electrode 540a in the liquid lens 500 and the electrically conductive aqueous solution 595. detect changes in the size or area of

In FIG. 13C , AM0 is exemplified as the area of the boundary area Ac0. In particular, it is exemplified that the area of the boundary region Ac0 contacting the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AM0.

In FIG. 13C , the liquid 530 is not concave or convex, and is parallel to the first substrate 510 or the like. The curvature at this time can be defined as 0, for example.

Meanwhile, as shown in FIG. 13C , with respect to the boundary area Ac0 contacting the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a, by the following Equation 1, the capacitance (C) can be formed.

In this case, ε may represent the permittivity of the dielectric 550a, A may represent the area of the boundary region Ac0, and d may represent the thickness of the first dielectric 550a.

Here, assuming that ε and d are fixed values, the area of the boundary region Ac0 may have a large effect on the capacitance C.

That is, as the area of the boundary region Ac0 increases, the capacitance C formed in the boundary region Ac0 may increase.

Meanwhile, since the area of the border area Ac0 changes as the curvature of the liquid 530 changes, in the present invention, the area of the border area Ac0 is sensed using the sensor unit 962 or the area of the border area Ac0 is detected. It is assumed that the capacitance (C) formed at (Ac0) is sensed.

Meanwhile, the capacitance of FIG. 13c may be defined as CAc0.

14A to 14E are diagrams illustrating various curvatures of the liquid lens 500 .

First, FIG. 14A illustrates that a first curvature Ria is formed in the liquid 530 according to the application of an electric signal to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. do.

In FIG. 14A , as the first curvature Ria is formed in the liquid 530, AMa (>AM0) is exemplified as the area of the boundary area Aaa. In particular, it is exemplified that the area of the boundary region Aaa contacting the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AMa.

According to Equation 1, since the area of the border area Aaa in FIG. 14A is larger than that of FIG. 13C, the capacitance of the border area Aaa becomes larger. Meanwhile, the capacitance of FIG. 14A can be defined as CAaa, and has a larger value than the capacitance CAc0 of FIG. 13C.

The first curvature Ria at this time may be defined as having a value of positive polarity. For example, the first curvature Ria may be defined as having a level of +2.

Next, FIG. 14B illustrates that a second curvature Rib is formed in the liquid 530 according to the application of an electric signal to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. do.

In FIG. 14B, as the second curvature Rib is formed in the liquid 530, AMb (>AMa) is exemplified as the area of the boundary area Aba. In particular, it is exemplified that the area of the boundary region Aba contacting the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AMb.

According to Equation 1, since the area of the border area Aba in FIG. 14B is larger than that of FIG. 14A, the capacitance of the border area Aba becomes larger. Meanwhile, the capacitance of FIG. 14B may be defined as CAba, and has a larger value than the capacitance CAaa of FIG. 14A.

At this time, it may be defined as having a positive polarity value smaller than the second curvature Rib and the first curvature Ria. For example, the second curvature Rib may be defined as having a level of +4.

Meanwhile, according to FIGS. 14A and 14B , the liquid lens 500 operates as a convex lens, and accordingly, the output light LP1a in which the incident light LP1 is concentrated is output.

Next, FIG. 14C illustrates that a third curvature Ric is formed in the liquid 530 according to the application of electric signals to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. do.

In particular, in FIG. 14C , AMa is exemplified as the area of the left border area Acb, and AMb (>AMa) is exemplified as the area of the right border area Acb.

In particular, the area of the boundary area Aca contacting the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AMa, and the second insulator on the second electrode 540b It is exemplified that the area of the boundary region Acb contacting the electrically conductive aqueous solution 595 among the inclined portions of 550b is AMb.

Accordingly, the capacitance of the left boundary region Aca may be CAaa, and the capacitance of the right boundary region Acb may be CAba.

The third curvature Ric at this time may be defined as having a value of positive polarity. For example, it may be defined that the third curvature Ric has a level of +3.

Meanwhile, according to FIG. 14C , the liquid lens 500 operates as a convex lens, and accordingly, the output light LP1b in which the incident light LP1 is more concentrated to one side is output.

Next, FIG. 14D illustrates that a fourth curvature Rid is formed in the liquid 530 according to the application of electric signals to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. do.

In FIG. 14D , as the fourth curvature Rid is formed in the liquid 530, AMd (<AM0) is exemplified as the area of the boundary area Ada. In particular, it is exemplified that the area of the boundary region Ada contacting the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AMd.

According to Equation 1, since the area of the border area Ada in FIG. 14D is smaller than that of FIG. 13C, the capacitance of the border area Ada becomes smaller. Meanwhile, the capacitance of FIG. 14D can be defined as CAda, and has a smaller value than the capacitance of FIG. 13C, CAc0.

The fourth curvature Rid at this time may be defined as having a negative polarity value. For example, the fourth curvature Rid may be defined as having a -2 level.

Next, FIG. 14E illustrates that a fifth curvature Rie is formed in the liquid 530 according to the application of electric signals to the plurality of electrodes LA to LD 540a to 540d and the common electrode 520, respectively. do.

In FIG. 14E , as the fifth curvature Rie is formed in the liquid 530, AMe (<AMd) is exemplified as the area of the boundary area Aea. In particular, it is exemplified that the area of the boundary region Aea contacting the electrically conductive aqueous solution 595 among the inclined portions of the first insulator 550a on the first electrode 540a is AMe.

According to Equation 1, since the area of the border area Aea in FIG. 14E is smaller than that of FIG. 14D, the capacitance of the border area Aea becomes smaller. Meanwhile, the capacitance of FIG. 14E can be defined as CAea, and has a smaller value than the capacitance CAda of FIG. 14D.

The fifth curvature Rie at this time may be defined as having a negative polarity value. For example, the fifth curvature Rie may be defined as having a -4 level.

Meanwhile, according to FIGS. 14D and 14E , the liquid lens 500 operates as a concave lens, and thus output light LP1c obtained by diverging incident light LP1 is output.

15A and 15B are various examples of internal block diagrams of a light conversion unit.

First, FIG. 15A is an example of an internal block diagram of a light conversion unit.

Referring to the drawing, the light conversion unit 320a of FIG. 15A may include a lens driving unit 860, a pulse width variable controller 840, a power supply unit 890, and a liquid lens 500.

Referring to the operation of the light conversion unit 320a of FIG. 15A, the pulse width variable controller 840 outputs a pulse width variable signal V in response to a target curvature, and the lens driver 860 outputs a pulse width variable signal. A corresponding voltage may be output to the plurality of electrodes and the common electrode of the liquid lens 500 by using (V) and the voltage (Vx) of the power supply unit 890 .

That is, the light conversion unit 320a of FIG. 15A may operate as an open loop system to change the curvature of the liquid lens.

15B is another example of an internal block diagram of a light conversion unit.

Referring to the drawings, a light conversion unit 320b according to an embodiment of the present invention includes a liquid lens 500, a lens driving unit 960 for applying an electrical signal to the liquid lens 500, and an electrical signal based on A sensor unit 962 for detecting the curvature of the formed liquid lens 500 and a processor 970 for controlling the lens driving unit 960 to form a target curvature of the liquid lens 500 based on the detected curvature. can include

Meanwhile, unlike the drawing, the light conversion unit 320b may not include the processor 970, and the processor 970 may be included in the processor 270 of FIG. 4 .

Meanwhile, the sensor unit 962 may detect a change in the size or area of the boundary area Ac0 between the insulator on the electrode in the liquid lens 500 and the electrically conductive aqueous solution 595 . Accordingly, it is possible to quickly and accurately detect the curvature of the lens.

On the other hand, the photoconversion unit 320b according to an embodiment of the present invention includes a power supply unit 990 that supplies power and an AD converter 967 that converts a signal related to the capacitance detected by the sensor unit 962 into a digital signal. ) may be further provided.

On the other hand, the light conversion unit (320b), in the lens driving unit 960, a plurality of conductive lines (CA1, CA2) for supplying an electrical signal to each electrode (common electrode, a plurality of electrodes) in the liquid lens 500 and , a switching element SWL disposed between one of the plurality of conductive lines CA2 and the sensor unit 962 may be further included.

In the drawing, it is exemplified that the switching element SWL is disposed between the conductive line CA2 for applying an electrical signal to any one of the plurality of electrodes in the liquid lens 500 and the sensor unit 962 . At this time, a contact point between the conductive line CA2 and one end of the switching element SWL or the liquid lens 500 may be referred to as node A.

Meanwhile, in the present invention, in order to detect the curvature of the liquid lens 500, an electric signal is applied to each electrode (common electrode, a plurality of electrodes) in the liquid lens 500 through a plurality of conductive lines CA1 and CA2. can do.

For example, during the first period, the switching element SWL may be turned on.

At this time, when an electrical signal is applied to an electrode in the liquid lens 500 in a state in which the switching element SWL is turned on and connected to the sensor unit 962, a curvature is formed in the liquid lens 500, and the curvature is formed. An electrical signal corresponding to may be supplied to the sensor unit 962 through the switching element SWL.

Accordingly, the sensor unit 962, based on the electric signal from the liquid lens 500 during the ON period of the switching element SWL, the insulator on the electrode in the liquid lens 500 of the liquid lens 500, A change in the size or area of the boundary region Ac0 between the electrically conductive aqueous solution 595 may be detected, or the capacitance of the boundary region Ac0 may be detected.

Next, during the second period, the switching element SWL is turned off, and an electrical signal may be continuously applied to the electrode within the liquid lens 500 . Accordingly, a curvature may be formed in the liquid 530 .

Next, during the third period, the switching element SWL is turned off, and no electrical signal is applied to the electrode within the liquid lens 500 or a low-level electrical signal may be applied.

Next, during the fourth period, the switching element SWL may be turned on.

At this time, when an electrical signal is applied to an electrode in the liquid lens 500 in a state in which the switching element SWL is turned on and connected to the sensor unit 962, a curvature is formed in the liquid lens 500, and the curvature is formed. An electrical signal corresponding to may be supplied to the sensor unit 962 through the switching element SWL.

On the other hand, when the curvature calculated based on the capacitance detected during the first period is smaller than the target curvature, the processor 970 transmits pulses of the variable pulse width control signal supplied to the driving unit 960 to reach the target curvature. The width can be controlled to increase.

Accordingly, a time difference between pulses respectively applied to the common electrode 530 and the plurality of electrodes may increase, and thus, the curvature formed in the liquid 530 may increase.

During the fourth period, when an electrical signal is applied to an electrode in the liquid lens 500 in a state in which the switching element SWL is turned on and connected to the sensor unit 962, a curvature is formed in the liquid lens 500, , an electrical signal corresponding to the formation of curvature may be supplied to the sensor unit 962 through the switching element SWL.

Accordingly, the sensor unit 962, based on the electric signal from the liquid lens 500 during the ON period of the switching element SWL, the insulator on the electrode in the liquid lens 500 of the liquid lens 500, A change in the size or area of the boundary region Ac0 between the electrically conductive aqueous solution 595 may be detected, or the capacitance of the boundary region Ac0 may be detected.

Accordingly, the processor 970 may calculate the curvature based on the sensed capacitance and determine whether the target curvature is reached. Meanwhile, when the target curvature is reached, the processor 970 may control to supply a corresponding electrical signal to each electrode.

According to this, the curvature of the liquid 530 is formed according to the supply of the electric signal, and the curvature of the liquid can be sensed immediately. Therefore, it is possible to quickly and accurately determine the curvature of the liquid lens 500 .

Meanwhile, in the drawing, the lens driving unit 960 and the sensor unit 962 may be formed as one module 965 .

Meanwhile, in the drawing, the lens driving unit 960, the sensor unit 962, the processor 970, the power supply unit 990, the AD converter 967, and the switching element SWL are system on chip, SOC), it can be implemented in one chip.

Meanwhile, the processor 970 may control the level of the voltage applied to the liquid lens 500 to increase or the pulse width to increase in order to increase the curvature of the liquid lens 500 .

Meanwhile, the processor 970 may calculate the curvature of the liquid lens 500 based on the capacitance detected by the sensor unit 962 .

In this case, the processor 970 may calculate that the curvature of the liquid lens 500 increases as the capacitance detected by the sensor unit 962 increases.

Also, the processor 970 may control the liquid lens 500 to have a target curvature.

Meanwhile, the processor 970 calculates the curvature of the liquid lens 500 based on the capacitance detected by the sensor unit 962, and generates a variable pulse width signal V based on the calculated curvature and the target curvature. It can be output to the lens driving unit 960 .

Accordingly, the lens driving unit 960 uses the variable pulse width signal V and the voltages Lv1 and Lv2 of the power supply unit 990 to form a plurality of electrodes of the plurality of electrodes LA to LD 540a to 540d. Corresponding electrical signals may be output to , , and the common electrode 520 .

In this way, the capacitance of the liquid lens 500 is sensed and fed back, and an electric signal is applied to the liquid lens 500 so that the curvature of the lens is changed, so that the curvature of the lens can be quickly and accurately changed.

Meanwhile, the processor 970 generates a variable pulse width signal V based on the equalizer 972 calculating a curvature error based on the calculated curvature and the target curvature, and the calculated curvature error Φ. A pulse width variable controller 940 for outputting may be included.

Accordingly, the processor 970 may control the duty cycle of the variable pulse width signal V to increase based on the calculated curvature error Φ when the calculated curvature is greater than the target curvature. Accordingly, it is possible to quickly and accurately change the curvature of the liquid lens 500 .

Meanwhile, the processor 970 receives focus information (AF) from the image processing unit 930 and shake information (OIS) from a gyro sensor (not shown), and generates the focus information (AF) and shake information (OIS) Based on , it is possible to determine a target curvature.

At this time, it is preferable that the update cycle of the determined target curvature is longer than the update cycle of the calculated curvature based on the detected capacitance of the liquid lens 500 .

As a result, since the update cycle of the calculated curvature is smaller than the update cycle of the target curvature, the curvature of the liquid lens 500 can be quickly changed to a desired curvature.

Meanwhile, the camera 195c described in FIGS. 4 to 15B can be employed in various electronic devices such as the mobile terminal 100 of FIG. 2 , vehicles, TVs, drones, robots, robot vacuum cleaners, and doors.

In addition, although the preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. Of course, various modifications are possible by those skilled in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

Claims (20)

a light source unit having a plurality of light sources and outputting a first pattern light;
a light conversion unit converting the first pattern light from the light source unit to generate second pattern light different from the first pattern light, and outputting one of the first pattern light and the second pattern light;
a photodetector configured to detect first reflected light received from a subject in response to the first pattern light output from the light conversion unit and second reflected light received from the subject in response to the second pattern light;
The first pattern light is output at a first time point, the second pattern light is output at a second time point after the first time point, and based on the first reflected light and the second reflected light, A processor for generating depth information about a subject; includes,
the processor,
Receiving movement information of the camera from a motion sensor;
Based on the motion information of the camera, the camera characterized in that the control is performed so that the resolution of the first pattern light is lowered as the movement amount of the camera increases. According to claim 1,
The light conversion unit,
At the first point in time, transmitting and outputting the first pattern light;
The camera characterized in that outputting the second pattern light generated by conversion at the second viewpoint. According to claim 1,
Light patterns of the first pattern light and the second pattern light do not overlap. delete According to claim 1,
The camera further comprises a lens for projecting the first pattern light or the second pattern light output from the light conversion unit to the outside. According to claim 1,
the processor,
The camera characterized in that the first pattern light and the second pattern light are controlled to be alternately output at a constant period. According to claim 1,
A temperature detection unit; further comprising,
the processor,
Depending on the temperature detected by the temperature detector, the output period of the first pattern light and the second pattern light is controlled to be varied;
the processor,
The camera characterized in that, as the detected temperature increases, the output period of the first pattern light and the second pattern light increases, or the resolution of the first pattern light output from the light source unit decreases. delete delete According to claim 1,
the processor,
The camera characterized in that the resolution of the first pattern light output from the light source unit is varied by controlling the plurality of light sources. delete According to claim 1,
the processor,
The camera characterized in that the control is performed so that the output cycle of the first pattern light and the second pattern light increases as the moving amount of the camera increases. According to claim 1,
When the light conversion unit includes a liquid lens,
the processor,
At the first time point, a first electrical signal is applied to the liquid lens, and at the second time point, a second electrical signal is applied to the liquid lens;
The light conversion unit,
a lens driver for applying the electric signal to the liquid lens;
A sensor unit for detecting the curvature of the liquid lens formed based on the electrical signal; includes,
The sensor unit,
A camera characterized in that detecting a size of an area or a change in the area of a boundary area between an insulator on an electrode in the liquid lens and an electrically conductive aqueous solution. delete delete delete delete delete delete A terminal having a camera according to any one of claims 1 to 3, 5 to 7, 10, 12, and 13.

Images