KR101674961B1 - Digital device and method for obtaining color image thereof - Google Patents

Abstract

The present invention relates to a digital device capable of acquiring a color image and an IR image together, and a color image acquiring method thereof. More particularly, the present invention relates to a color image corresponding to a visible region of an optical spectrum and a color image corresponding to an infrared region of the optical spectrum An image processing unit for extracting image information from the light receiving unit, and an image processing unit for generating an image of the object based on the extracted image information And a control unit for controlling the illumination unit to emit color light and infrared light at the same time or emit color light and infrared light at different time zones, depending on the image implementing unit and the type of the light receiving unit.

Description

[0001] DESCRIPTION [0002] DIGITAL DEVICE AND METHOD FOR OBTAINING COLOR IMAGE THEREOF [

The present invention relates to a digital device, and more particularly, to a digital device capable of acquiring a color image and an IR image together, and a color image acquiring method thereof.

Generally, a digital device including an infrared camera can generally obtain only a monochrome image.

This is because the configuration of the infrared camera is based on an infrared light, an infrared lens, and an infrared monochrome sensor (IR monocrome sensor).

Unlike ordinary RGB illumination, infrared light projects infrared light outside the human perceptible area.

It is the principle of the infrared camera that the mono infrared light is condensed by an infrared lens designed to apply infrared coating and capable of infrared focusing and captured by an infrared sensor.

As the infrared sensor, a monochrome sensor is mainly used. The infrared sensor is characterized in that unlike a color sensor in which a color filter is different for each pixel, all pixels have the same color filter.

This infrared camera intercepts external light by putting an infrared band-pass filter (IR band pass filter) that transmits the infrared wavelength of the used target and blocks the remaining visible light, and outputs a signal-noise ratio can be increased.

The main purpose of the infrared camera is applied to CCTV for monitoring at night and interior of the vehicle for driver's recognition, drowsiness prevention, visual recognition, and infrared camera for military monitoring and 3D depth sensing camera.

In the case where the user or the subject is mainly a person, by using the infrared wavelength in addition to the wavelength range capable of recognizing the RGB color, it is possible to acquire a natural image by capturing or not recognizing the subject in a covert manner at the same time, There is a purpose.

However, such an infrared camera has a problem that the image itself is displayed in black and white because information about brightness is acquired and attention is focused on the identification of the subject.

Therefore, there is a demand for a digital device including an infrared camera in which color can be added to a monochrome image in the future.

SUMMARY OF THE INVENTION An object of the present invention is to provide a digital device and a color image acquiring method thereof capable of acquiring both a color image and an infrared image.

It is another object of the present invention to provide a digital device and a method of acquiring color images of the digital device, which can obtain various color images by adjusting illumination time according to external environmental conditions.

According to an embodiment of the present invention, there is provided a digital device including: an illumination unit that emits color light corresponding to a visible region of an optical spectrum and infrared light corresponding to an infrared region of a light spectrum; An image processing unit for extracting image information from the light receiving unit, an image implementing unit for implementing an image of a subject based on the extracted image information, and an image processing unit for outputting color light and infrared light simultaneously Or to control the illuminating unit so that the color light and the infrared light are emitted at different time zones.

A color image acquiring method of a digital device according to an embodiment of the present invention includes the steps of emitting color light corresponding to the visible region of the optical spectrum and infrared light corresponding to the infrared region of the optical spectrum, Transmitting and coloring the colored light and the infrared light reflected from the color light source and the infrared light, filtering the transmitted color light and infrared light to transmit only the red light, the green light, and the blue light and the infrared light of the infrared wavelength band, The color light and the infrared light are detected at the same time, and if the color light and the infrared light are not outputted at the same time, the color light and the infrared light are simultaneously detected, A step of extracting image information from the sensed color light and infrared light, and a step of extracting image information based on the extracted image information, It may be made, including the step of implementing a color image of the transfer member.

According to the embodiment of the present invention, various information of the photographed person and wide information of the photographed subject can be obtained by acquiring both the color image and the infrared image, and adding the color information to the infrared image, This has an easy effect.

According to an embodiment of the present invention, various color images and clear images can be obtained by adjusting the illumination time according to external environmental conditions.

1 is a block diagram illustrating a digital device according to an embodiment of the present invention.
2 is a block diagram illustrating a digital device according to another embodiment of the present invention.
3 is a block diagram showing an image processing apparatus of a digital device according to the present invention.
Fig. 4 is a block diagram showing the illumination unit of Fig. 3
5 to 7 are driving waveforms showing the driving method of the illumination unit
8 is a view showing the light receiving portion of Fig. 3
9 and 10 are views showing the sensing unit of the light receiving unit
Fig. 11 is a block diagram showing the image processing unit of Fig. 3
12 is a block diagram showing the first image processing unit of FIG.
13 is a block diagram showing the second image processing unit of FIG.
14 and 15 are flowcharts for explaining a color image acquisition method of a digital device according to the present invention

Hereinafter, various embodiments (s) of a digital device and a three-dimensional image processing method thereof according to the present invention will be described in detail with reference to the drawings.

The suffix "module "," part ", and the like for components used in the present specification are given only for ease of specification, and both may be used as needed. Also, even when described in ordinal numbers such as " 1st ", "2nd ", and the like, it is not limited to such terms or ordinal numbers.

In addition, although the terms used in the present specification have been selected from the general terms that are widely used in the present invention in consideration of the functions according to the technical idea of the present invention, they are not limited to the intentions or customs of the artisan skilled in the art, It can be different. However, in certain cases, some terms are arbitrarily selected by the applicant, which will be described in the related description section. Accordingly, it should be understood that the term is to be interpreted based not only on its name but on its practical meaning as well as on the contents described throughout this specification.

It is to be noted that the contents of the present specification and / or drawings are not intended to limit the scope of the present invention.

Hereinafter, the digital device described in this specification refers to a device that transmits, receives, processes, and outputs data, content, service, application, And includes all devices that perform at least one or more. The digital device can be paired or connected (hereinafter, referred to as 'pairing') with another digital device, an external server, or the like through a wire / wireless network, Can be transmitted / received. At this time, if necessary, the data may be appropriately converted before the transmission / reception. The digital device may be a standing device such as a network TV, a Hybrid Broadcast Broadband TV (HBBTV), a Smart TV, an IPTV (Internet Protocol TV), a PC (Personal Computer) And a mobile device or handheld device such as a PDA (Personal Digital Assistant), a smart phone, a tablet PC, a notebook, and the like. In order to facilitate understanding of the present invention and to facilitate the description of the present invention, FIG. 1, which will be described later, illustrates a digital TV, and FIG. 2 illustrates and describes a mobile device as an embodiment of a digital device. In addition, the digital device described in this specification may be a configuration having only a panel, a configuration such as a set-top box (STB), a device, a system, etc. and a set configuration .

Meanwhile, the wired / wireless network described in this specification refers to a communication network that supports various communication standards or protocols for pairing and / or data transmission / reception between digital devices or a digital device and an external server. Such a wired / wireless network includes all of the communication networks to be supported by the standard now or in the future, and is capable of supporting one or more communication protocols therefor. Such a wired / wireless network includes, for example, a USB (Universal Serial Bus), a Composite Video Banking Sync (CVBS), a Component, an S-Video (Analog), a DVI (Digital Visual Interface) A communication standard or protocol for a wired connection such as an RGB or a D-SUB, a Bluetooth standard, a radio frequency identification (RFID), an infrared data association (IrDA), an ultra wideband (UWB) (ZigBee), DLNA (Digital Living Network Alliance), WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) A long term evolution (LTE-Advanced), and Wi-Fi direct, and a communication standard or protocol for the network.

In addition, when the term is simply referred to as a digital device in this specification, the meaning may mean a fixed device or a mobile device depending on the context, and may be used to mean both, unless specifically stated otherwise.

On the other hand, the digital device is an intelligent device that supports, for example, a broadcast receiving function, a computer function or a support, at least one external input, and the like. The digital device includes e-mail, web browsing, Banking, game, application, and so on. In addition, the digital device may have an interface for supporting at least one input or control means (hereinafter, 'input means') such as a handwriting input device, a touch-screen, .

In addition, the digital device can use a standardized general-purpose OS (Operating System), but in particular, the digital device described in this specification uses the Web OS as an embodiment. Therefore, a digital device can handle adding, deleting, amending, and updating various services or applications on a general-purpose OS kernel or a Linux kernel. And through which a more user-friendly environment can be constructed and provided.

Meanwhile, the above-described digital device can receive and process an external input. The external input is connected to an external input device, that is, the digital device, through the wired / wireless network, Input means or digital device. For example, the external input may be a game device such as a high-definition multimedia interface (HDMI), a playstation or an X-Box, a smart phone, a tablet PC, a pocket photo devices such as digital cameras, printing devices, smart TVs, Blu-ray device devices and the like.

In addition, the server described in the present specification refers to a digital device or system that supplies data to or receives data from the above-described digital device, that is, a client, and is also referred to as a processor. The server may include a portal server for providing a web page, a web content or a web service, an advertising server for providing advertising data, A content server providing content, an SNS server providing a social network service (SNS), a service server provided by a manufacturer, a video on demand (VoD) service or a streaming service And a service server that provides a Multichannel Video Programming Distributor (MVPD) and a pay service, for example.

In addition, in the following description for convenience of explanation, only the application is described in the context of the present invention, and the meaning may include not only the application but also the service based on the context and the like.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating a digital device according to an exemplary embodiment of the present invention.

The digital device 200 includes a network interface 201, a TCP / IP manager 202, a service delivery manager 203, an SI decoder 204, A demultiplexer (demux or demultiplexer) 205, an audio decoder 206, a video decoder 207, a display A / V and OSD module 208, a service management manager 209, a service discovery manager 210, an SI & metadata DB 211, a metadata manager 212, a service manager 213, A UI manager 214, and the like.

The network interface unit 201 receives the IP packet (s) (IP packet (s)) or the IP datagram (s) ) Is transmitted / received. For example, the network interface unit 201 can receive services, applications, content, and the like from the service provider 20 of FIG. 1 through a network.

The TCP / IP manager 202 determines whether the IP packets received by the digital device 200 and the IP packets transmitted by the digital device 200 are packet delivery (i.e., packet delivery) between a source and a destination packet delivery). The service discovery manager 210, the service control manager 209, the meta data manager 212, the service discovery manager 210, the service control manager 209, and the metadata manager 212. The TCP / IP manager 202 classifies the received packet (s) ) Or the like.

The service delivery manager 203 is responsible for controlling the received service data. For example, the service delivery manager 203 may use RTP / RTCP when controlling real-time streaming data. When the real-time streaming data is transmitted using the RTP, the service delivery manager 203 parses the received data packet according to the RTP and transmits the packet to the demultiplexing unit 205 or the control of the service manager 213 In the SI & meta data database 211. [ Then, the service delivery manager 203 feedbacks the network reception information to the server providing the service using RTCP.

The demultiplexer 205 demultiplexes the received packets into audio, video, SI (System Information) data, and transmits them to the audio / video decoder 206/207 and the SI decoder 204, respectively.

The SI decoder 204 decodes the demultiplexed SI data, that is, Program Specific Information (PSI), Program and System Information Protocol (PSIP), Digital Video Broadcasting Service Information (DVB-SI), Digital Television Terrestrial Multimedia Broadcasting / Coding Mobile Multimedia Broadcasting). Also, the SI decoder 204 may store the decoded service information in the SI & meta data database 211. The stored service information can be read out and used by the corresponding configuration, for example, by a user's request.

The audio / video decoder 206/207 decodes each demultiplexed audio data and video data. The decoded audio data and video data are provided to the user through the display unit 208. [

The application manager may include, for example, the UI manager 214 and the service manager 213 and may perform the functions of the controller of the digital device 200. [ In other words, the application manager can manage the overall state of the digital device 200, provide a user interface (UI), and manage other managers.

The UI manager 214 provides a GUI (Graphic User Interface) / UI for a user using an OSD (On Screen Display) or the like, and receives a key input from a user to perform a device operation according to the input. For example, the UI manager 214 receives the key input regarding the channel selection from the user, and transmits the key input signal to the service manager 213.

The service manager 213 controls the manager associated with the service such as the service delivery manager 203, the service discovery manager 210, the service control manager 209, and the metadata manager 212.

In addition, the service manager 213 generates a channel map and controls the selection of a channel using the generated channel map according to a key input received from the UI manager 214. [ The service manager 213 receives the service information from the SI decoder 204 and sets an audio / video PID (Packet Identifier) of the selected channel in the demultiplexer 205. The PID thus set can be used in the demultiplexing process described above. Accordingly, the demultiplexer 205 filters (PID or section) audio data, video data, and SI data using the PID.

The service discovery manager 210 provides information necessary for selecting a service provider providing the service. Upon receiving a signal regarding channel selection from the service manager 213, the service discovery manager 210 searches for the service using the information.

The service control manager 209 is responsible for selection and control of services. For example, the service control manager 209 uses IGMP or RTSP when a user selects a live broadcasting service such as an existing broadcasting system, and uses RTSP when selecting a service such as VOD Service selection and control. The RTSP protocol may provide a trick mode for real-time streaming. Also, the service control manager 209 can initialize and manage a session through the IMS gateway 250 using an IP Multimedia Subsystem (IMS) and a Session Initiation Protocol (SIP). The protocols are one embodiment, and other protocols may be used, depending on the implementation.

The metadata manager 212 manages the metadata associated with the service and stores the metadata in the SI & metadata database 211.

The SI & meta data database 211 stores the service information decoded by the SI decoder 204, the meta data managed by the meta data manager 212, and the information necessary for selecting a service provider provided by the service discovery manager 210 do. In addition, the SI & meta data database 211 may store set-up data for the system and the like.

The SI & meta data database 211 may be implemented using a non-volatile RAM (NVRAM) or a flash memory.

Meanwhile, the IMS gateway 250 is a gateway that collects functions necessary for accessing the IMS-based IPTV service.

2 is a block diagram illustrating a digital device according to another embodiment of the present invention.

If FIG. 1 described above illustrates a fixed device as one embodiment of a digital device, FIG. 2 illustrates a mobile device as another embodiment of a digital device.

2, the mobile device 300 includes a wireless communication unit 310, an A / V input unit 320, a user input unit 330, a sensing unit 340, an output unit 350, A memory 360, an interface unit 370, a control unit 380, a power supply unit 390, and the like.

Hereinafter, each component will be described in detail.

The wireless communication unit 310 may include one or more modules that enable wireless communication between the mobile device 300 and the wireless communication system or between the mobile device and the network in which the mobile device is located. For example, the wireless communication unit 310 may include a broadcast receiving module 311, a mobile communication module 312, a wireless Internet module 313, a short range communication module 314, and a location information module 315 .

The broadcast receiving module 311 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 312.

The broadcast-related information may exist in various forms, for example, in the form of an EPG (Electronic Program Guide) or an ESG (Electronic Service Guide).

The broadcast receiving module 311 may be, for example, an ATSC, a Digital Video Broadcasting-Terrestrial (DVB-T), a Satellite (DVB-S), a Media Forward Link Only And Integrated Services Digital Broadcast-Terrestrial (DRS). Of course, the broadcast receiving module 311 may be adapted to not only the above-described digital broadcasting system but also other broadcasting systems.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 311 may be stored in the memory 360.

The mobile communication module 312 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 313 may be embedded or external to the mobile device 300, including a module for wireless Internet access. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 314 is a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IRDA), Ultra Wideband (UWB), ZigBee, RS-232 and RS-485 are used as short range communication technology. .

The position information module 315 is a module for acquiring position information of the mobile device 300, and may be a GPS (Global Position System) module.

The A / V input unit 320 is for inputting audio and / or video signals. The A / V input unit 320 may include a camera 321, a microphone 322, and the like. The camera 321 processes an image frame such as a still image or moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display section 351. [

The image frame processed by the camera 321 may be stored in the memory 360 or transmitted to the outside via the wireless communication unit 310. [ At least two cameras 321 may be provided depending on the use environment.

The microphone 322 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 312 in the case of the communication mode, and output. The microphone 322 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 330 generates input data for a user to control the operation of the terminal. The user input unit 330 may include a key pad, a dome switch, a touch pad (static pressure / static electricity), a jog wheel, a jog switch, and the like.

The sensing unit 340 senses the current state of the mobile device 300 such as the open / closed state of the mobile device 300, the position of the mobile device 300, the user's contact, the orientation of the mobile device, And generates a sensing signal for controlling the operation of the mobile device 300. For example, when the mobile device 300 is moved or tilted, it may sense the position, slope, etc. of the mobile device. It is also possible to sense whether power is supplied to the power supply unit 390, whether the interface unit 370 is connected to an external device, and the like. Meanwhile, the sensing unit 240 may include a proximity sensor 341 including NFC (Near Field Communication).

The output unit 350 may include a display unit 351, an acoustic output module 352, an alarm unit 353, and a haptic module 354 for generating output related to visual, auditory, have.

The display unit 351 displays (outputs) information processed by the mobile device 300. [ For example, if the mobile device is in call mode, it displays a UI or GUI associated with the call. When the mobile device 300 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 351 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) flexible display, and a three-dimensional display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display portion 351 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 351 of the terminal body.

There may be two or more display units 351 depending on the implementation of the mobile device 300. [ For example, in the mobile device 300, the plurality of display portions may be spaced apart or integrally arranged on one surface, and may be disposed on different surfaces, respectively.

(Hereinafter, referred to as a 'touch screen') in which a display unit 351 and a sensor (hereinafter, referred to as 'touch sensor') for sensing a touch operation form a mutual layer structure It can also be used as a device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display portion 351 or a capacitance generated in a specific portion of the display portion 351 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits corresponding data to the controller 380. Thus, the control unit 380 can know which area of the display unit 351 is touched or the like.

A proximity sensor 341 may be disposed in the interior area of the mobile device or in proximity to the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 352 can output audio data received from the wireless communication unit 310 or stored in the memory 360 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 352 also outputs sound signals associated with functions performed on the mobile device 300 (e.g., call signal receive tones, message receive tones, etc.). The sound output module 352 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 353 outputs a signal for notifying the occurrence of an event of the mobile device 300. [ Examples of events that occur in the mobile device include receiving a call signal, receiving a message, inputting a key signal, and touch input. The alarm unit 353 may output a signal for informing occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 351 or the audio output module 352 so that they may be classified as a part of the alarm unit 353.

The haptic module 354 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 354 is vibration. The intensity and pattern of the vibration generated by the haptic module 354 are controllable. For example, different vibrations may be synthesized and output or sequentially output. In addition to the vibration, the haptic module 354 may be arranged in a variety of ways, such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a spit on the skin surface, contact with an electrode, Various effects such as an effect of heat generation and an effect of reproducing a cool / warm feeling using a heat absorbing or heatable element can be generated. The haptic module 354 can be implemented not only to transmit the tactile effect through direct contact but also to allow the user to feel the tactile effect through the muscular sensation of a finger or an arm. More than one haptic module 354 may be provided according to the configuration of the mobile device 300.

The memory 360 may store a program for the operation of the control unit 380 and temporarily store input / output data (e.g., phone book, message, still image, moving picture, etc.). The memory 360 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 360 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) A magnetic disk, and / or an optical disk. The mobile device 300 may operate in association with a web storage that performs storage functions of the memory 360 on the Internet.

The interface unit 370 serves as a pathway to all the external devices connected to the mobile device 300. The interface unit 370 receives data from an external device or receives power from the external device and transfers the data to each component in the mobile device 300 or transmits data in the mobile device 300 to an external device. For example, it may be provided with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port connecting a device with an identification module, an audio I / O port, A video I / O port, an earphone port, and the like may be included in the interface unit 370.

The identification module is a chip for storing various information for authenticating the usage right of the mobile device 300 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. A device having an identification module (hereinafter referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 200 through the port.

The interface unit 370 may be a communication path through which the power from the cradle is supplied to the mobile device 300 when the mobile device 300 is connected to an external cradle, A command signal may be the path through which it is communicated to the mobile device. The various command signals or the power supply input from the cradle may be operated with a signal for recognizing that the mobile device is correctly mounted on the cradle.

The control unit 380 typically controls the overall operation of the mobile device 300. The control unit 380 performs related control and processing, for example, for voice call, data communication, video call, and the like. The control unit 380 may include a multimedia module 381 for multimedia playback. The multimedia module 381 may be implemented in the control unit 380 or separately from the control unit 380. The control unit 380 can perform pattern recognition processing for recognizing handwriting input or drawing input performed on the touch-screen as characters and images, respectively.

The power supply unit 390 receives external power and internal power under the control of the controller 380 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, a controller, micro-controllers, microprocessors, and an electrical unit for performing other functions. In some cases, the implementation described herein Examples may be implemented by the control unit 380 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Here, the software code is stored in the memory 360 and can be executed by the control unit 380. [

3 is a block diagram showing an image processing apparatus of a digital device according to the present invention.

3, the image processing apparatus of the digital device may include an illumination unit 510, a light receiving unit 520, an image processing unit 530, an image implementing unit 540, and a control unit 550.

In some cases, the image processing apparatus of the digital device may further include a storage unit 570, a timer 580, and an external luminance sensing unit 590.

Here, the illuminating unit 510 can emit color light corresponding to the visible region of the optical spectrum and infrared light corresponding to the infrared region of the optical spectrum.

For example, the illumination unit 510 includes a color light source including a red light source for emitting red light of a red wavelength band, a green light source for emitting green light of a green wavelength band, and a blue light source for emitting blue light of a blue wavelength band, And may include an infrared light source.

Here, the red light source, the green light source, the blue light source, and the infrared light source may use a light emitting diode (LED) or a laser diode (LD).

The illuminating unit 510 can simultaneously emit red light, green light, and blue light for a first time, and emit infrared light for a second time, wherein the first time and the second time may be different from each other.

For example, the second time for emitting the infrared light may be longer than the first time for simultaneously emitting the red light, the green light, and the blue light.

This is because, if the emission time of the infrared light is short, the luminance of the acquired image is lowered, and the luminance of the image of the object is low, so that the identification may be difficult.

In particular, when the external environment is at night, the brightness of the acquired image is significantly lowered, so that if the emission time of infrared light is increased, an image with improved brightness can be obtained.

In some cases, the second time for emitting infrared light and the first time for emitting red light, green light, and blue light at the same time may be the same.

This is because, when the external environment is low, the luminance of the acquired image is improved rather than the nighttime, so that a clear image can be obtained without increasing the emission time of the infrared light.

Further, the illumination unit 510 may emit red light, green light, blue light, and infrared light at the same time.

Here, the illuminating unit 510 can simultaneously emit red light, green light, blue light, and infrared light for the same period of time.

In other cases, the illuminating unit 510 emits red light for a first time, emits green light for a second time, emits blue light for a third time, and emits infrared light for a fourth time It is possible.

Here, the fourth time for emitting infrared light may be different from a first time for emitting red light, a second time for emitting green light, and a third time for emitting blue light.

At this time, a first time for emitting red light, a second time for emitting green light, and a third time for emitting blue light may be the same.

For example, the fourth time for emitting red light may be longer than any one of a first time for emitting red light, a second time for emitting green light, and a third time for emitting blue light.

This is because, if the emission time of the infrared light is short, the luminance of the acquired image is lowered, and the luminance of the image of the object is low, so that the identification may be difficult.

In particular, when the external environment is at night, the brightness of the acquired image is significantly lowered, so that if the emission time of infrared light is increased, an image with improved brightness can be obtained.

Optionally, the fourth time for emitting the infrared light may be the same as the first time for emitting red light, the second time for emitting green light, and the third time for emitting blue light.

This is because, when the external environment is low, the luminance of the acquired image is improved rather than the nighttime, so that a clear image can be obtained without increasing the emission time of the infrared light.

Meanwhile, the light receiving unit 520 may include a lens unit, a filter unit, and a sensing unit.

Here, the lens unit can transmit and focus color light and infrared light reflected from the subject.

For example, in order to obtain color information of light reflected from a subject, the lens unit may use a broadband coated lens capable of transmitting color light of a color wavelength band and infrared light of an infrared wavelength band.

Further, the lens portion can use a lens having wide-band focusing performance capable of focusing color light and infrared light.

The filter unit may be a dual band pass filter that simultaneously transmits color light of red, green, and blue wavelengths transmitted through the lens unit and infrared light of an infrared wavelength band.

Therefore, the filter unit can block light in the UV wavelength band, light in the wavelength band between the red, green, blue wavelength band and infrared wavelength band, and light having the wavelength band in the infrared wavelength band or more.

Next, the sensing unit may sense the color light and the infrared light at the same time, or detect the color light and the infrared light at different time zones, respectively.

Here, the sensing unit for simultaneously sensing the color light and the infrared light may include a first pixel that simultaneously detects red light of a red wavelength band and infrared light of an infrared wavelength band, a second pixel that simultaneously detects green light of a green wavelength band and infrared light of an infrared wavelength band, And a third pixel that simultaneously detects the blue light of the blue wavelength band and the infrared light of the infrared wavelength band.

For example, the first pixel of the sensing unit may include a first filter that transmits red light of a red wavelength band and infrared light of an infrared wavelength band, and blocks light of other wavelength band.

The second pixel of the sensing unit may include a second filter that transmits red light in the green wavelength band and infrared light in the infrared wavelength band and blocks light in the other wavelength band.

The third pixel of the sensing unit may include a third filter that transmits the blue light of the blue wavelength band and the infrared light of the infrared wavelength band and blocks the light of the other wavelength band.

The sensing unit for sensing the color light and the infrared light at different time zones may include a first pixel for sensing red light in the red wavelength range, a second pixel for sensing green light in the green wavelength range, a third pixel for sensing blue light in the blue wavelength range, And a fourth pixel for sensing infrared light of an infrared wavelength band.

Next, the image processing unit 530 includes a first image processing unit for extracting color information of the image from the color light sensed by the sensing unit of the light receiving unit 520, and a second image processing unit for extracting luminance information of the image from the infrared light sensed by the sensing unit And a second image processing unit.

Here, when the sensing unit of the light receiving unit 520 simultaneously senses the color light and the infrared light, the image processor 530 extracts the color information of the image from the color light and extracts the luminance information of the image from the infrared light Operation can be performed simultaneously.

That is, the operation of extracting the color information of the first image processing unit and the operation of extracting the brightness information of the second image processing unit can be performed simultaneously.

The image processing unit 530 may include a first image processing unit for extracting color information of the image from the color light sensed by the sensing unit of the light receiving unit 520 during the first time, And a second image processing unit for extracting luminance information of the image from the infrared light sensed by the sensing unit of the image sensing unit.

Here, when the sensing unit of the light receiving unit 520 detects the color light and the infrared light at different time zones, the image processor 530 extracts the color information of the image from the color light, The operation of extracting information can be performed at different time zones.

That is, the operation of extracting the color information of the first image processing unit and the operation of extracting the brightness information of the second image processing unit may be performed at different time zones.

The first image processing unit includes a first detecting unit that detects the amount of color light detected by the sensing unit, a first converting unit that converts the light amount of the detected color light into an electrical signal, And a first image information extracting unit.

The second image processing unit includes a second detecting unit that detects the amount of infrared light detected by the sensing unit, a second converting unit that converts the amount of the detected infrared light into an electrical signal, And a second image information extracting unit for extracting the second image information.

On the other hand, the control unit 550 can turn on the illumination unit 510 at the start time of one frame of the video information, and turn off the illumination unit 510 before the end time of one frame.

In addition, the control unit 550 may control the color light output time and the infrared light output time of the illuminating unit 510 according to the external luminance.

For example, when the external luminance value is greater than the predetermined reference value, the control unit 550 increases the color light output time of the illumination unit 510 more than the reference time, and if the external luminance value is smaller than the predetermined reference value, It is possible to increase the infrared light emission time of the light source 510 more than the reference time.

Next, the control unit 550 can control the illumination unit 510 and the image processing unit 530 at the same time.

The timer 580 can measure the driving time of the illumination unit 510 in accordance with the control signal of the control unit 550. [

Next, the storage unit 570 can store the image information extracted from the image processing unit 530.

In addition, the external luminance sensing unit 590 may sense an external luminance according to a control signal of the control unit 550. [

FIG. 4 is a block diagram showing the illumination unit of FIG. 3, and FIGS. 5 to 7 are driving waveform diagrams illustrating a driving method of the illumination unit.

As shown in Fig. 4, the illuminating unit 510 can emit color light corresponding to the visible region of the optical spectrum and infrared light corresponding to the infrared region of the optical spectrum.

Here, the illumination unit 510 may include a color light source 512 that emits color light and an infrared light source 514 that emits infrared light.

At this time, the color light source 512 includes a red light source 512a for emitting red light of a red wavelength band, a green light source 512b for emitting green light of a green wavelength band, and a blue light source 512c for emitting blue light of a blue wavelength band .

For example, the red light source 512a, the green light source 512b, the blue light source 512c, and the infrared light source 514 may use a light emitting diode (LED) or a laser diode (LD).

The illuminating unit 510 may emit color light and infrared light at the same time, and may emit color light and infrared light at different time zones, respectively.

As shown in FIG. 5, the illuminating unit 510 can emit color light for a first time of one frame and emit infrared light for a second time of another frame, The infrared light may be emitted later, the infrared light may be emitted first, and the color light may be emitted later.

Here, the infrared light and the color light can be alternately emitted alternately.

For example, the illuminating unit 510 emits red light, green light, and blue light simultaneously for a first time (0 - t1) of one frame, and for a second time (0 - t2) The first time and the second time may be different from each other.

That is, the second time (0 - t2) for emitting the infrared light may be longer than the first time (0 - t1) for simultaneously emitting the red light, the green light and the blue light.

This is because, if the emission time of the infrared light is short, the luminance of the acquired image is lowered, and the luminance of the image of the object is low, so that the identification may be difficult.

In particular, when the external environment is at night, the brightness of the acquired image is significantly lowered, so that if the emission time of infrared light is increased, an image with improved brightness can be obtained.

In some cases, the second time (0 - t2) for emitting infrared light and the first time (0 - t1) for emitting red light, green light and blue light at the same time may be the same.

This is because, when the external environment is low, the luminance of the acquired image is improved rather than the nighttime, so that a clear image can be obtained without increasing the emission time of the infrared light.

Then, the light receiving unit can receive color light for one frame time, and receive infrared light for another frame.

In this case, if the emission time of the color light and the infrared light are the same, the amount of color light and the amount of infrared light received may be equal to each other.

In some cases, the color light amount and the infrared light amount received may be different from each other even when the color light and the infrared light have the same output time, depending on the external environment.

In other cases, if the emission times of the color light and the infrared light are different from each other, the amount of color light to be received and the amount of infrared light may be different from each other.

However, depending on the circumstances, depending on the external environment, the amount of color light and the amount of infrared light received may be equal to each other, even if the output time of the color light and the infrared light is different.

6, the illuminating unit 510 may emit color light and infrared light at the same time.

Here, the illuminating unit 510 can simultaneously emit red light, green light, blue light, and infrared light for each frame for the same period of time.

For example, red light, green light, blue light, and infrared light are emitted at the same time during a first time (0 - t1) of one frame, and red light, green light, , It is possible to emit infrared light, wherein the first time and the second time may be equal to each other.

Then, the light receiving unit can receive color light and infrared light every frame.

In this case, the amount of color light to be received and the amount of infrared light may be equal to each other.

However, in some cases, the amount of color light and the amount of infrared light received may differ from each other depending on the external environment.

Next, as shown in Fig. 7, the illuminating unit 510 emits red light for a first time (0 - t1), emits green light for a second time (0 - t2) Blue light may be emitted for a period of time (0 - t3), and infrared light may be emitted for a fourth time (0 - t4).

Here, the fourth time (0 - t4) of one frame for emitting infrared light is a first time (0 - t1) of one frame for emitting red light, a second time ) And a third time (0 - t3) of one frame for emitting blue light.

At this time, the first time (0 - t1) for emitting red light, the second time (0 - t2) for emitting green light, and the third time (0 - t3) for emitting blue light may be the same.

For example, the fourth time (0 - t4) of one frame for emitting red light is a first time (0 - t1) of one frame for emitting red light, a second time , And the third time (0 - t3) of one frame for emitting blue light.

This is because, if the emission time of the infrared light is short, the luminance of the acquired image is lowered, and the luminance of the image of the object is low, so that the identification may be difficult.

In particular, when the external environment is at night, the brightness of the acquired image is significantly lowered, so that if the emission time of infrared light is increased, an image with improved brightness can be obtained.

Optionally, the fourth time of one frame for emitting infrared light may be a first time of one frame for emitting red light, a second time of one frame for emitting green light, a third time of one frame for emitting blue light, They may be the same.

This is because, when the external environment is low, the luminance of the acquired image is improved rather than the nighttime, so that a clear image can be obtained without increasing the emission time of the infrared light.

The light receiving section receives red light for one frame time, receives green light for another frame, receives blue light for another frame, and receives infrared light for another frame.

In this case, if the emission times of red light, green light, blue light, and infrared light are the same, the amount of color light and the amount of infrared light received may be equal to each other.

In some cases, the color light amount and the infrared light amount received may be different from each other even when the color light and the infrared light have the same output time, depending on the external environment.

In other cases, if the emission times of the red light, the green light, the blue light, and the infrared light are different from each other, the amount of color light received and the amount of infrared light may be different from each other.

However, depending on the circumstances, depending on the external environment, the amount of color light and the amount of infrared light received may be equal to each other, even if the output time of the color light and the infrared light is different.

In addition, the illumination unit 510 may be turned on at the start time of one frame of the image information, and may be turned off before the end time of one frame, in accordance with the control signal of the control unit.

In addition, the illuminating unit 510 can adjust the color light output time and the infrared light output time according to the brightness of the outside.

For example, if the luminance value of the external light is greater than a predetermined reference value, the illumination unit 510 increases the color light emission time more than the reference time, and if the external luminance value is smaller than the predetermined reference value, Time can be increased.

Therefore, according to the present invention, a variety of color images and clear images can be obtained by adjusting the illumination time according to external environmental conditions.

FIG. 8 is a view showing a light receiving unit of FIG. 3, and FIGS. 9 and 10 are views showing a sensing unit of a light receiving unit.

8, the light receiving unit 520 may include a lens unit 522, a filter unit 524, and a sensing unit 526. [

Here, the lens section 522 can transmit and focus the color light and infrared light reflected from the subject.

For example, in order to obtain color information of light reflected from a subject, the lens unit 522 may use a wide band coating lens capable of transmitting color light of a color wavelength band and infrared light of an infrared wavelength band.

Further, the lens portion 522 can use a lens having a wide-band focusing performance capable of focusing color light and infrared light.

The filter unit 524 may be a dual band pass filter that simultaneously transmits color light of red, green, and blue wavelengths transmitted through the lens unit 522 and infrared light of an infrared wavelength band.

Therefore, the filter unit 524 can block light in the UV wavelength band, light in the wavelength band between the red, green, blue wavelength band, and infrared wavelength band, and light having the wavelength band in the infrared wavelength band or more.

Next, the sensing unit 526 may simultaneously sense the color light and the infrared light, or may sense the color light and the infrared light at different time zones, respectively.

9, the sensing unit 526 for simultaneously sensing the color light and the infrared light includes a first pixel 526a for simultaneously sensing the red light of the red wavelength band and the infrared light of the infrared wavelength band, A second pixel 526b for simultaneously sensing the red light and the infrared light of the infrared wavelength band, and a third pixel 526c for simultaneously sensing the blue light of the blue wavelength band and the infrared light of the infrared wavelength band.

For example, the first pixel 526a of the sensing unit may include a first filter that transmits red light of a red wavelength band and infrared light of an infrared wavelength band, and blocks light of other wavelength band.

The second pixel 526b of the sensing unit may include a second filter that transmits the red light of the green wavelength band and the infrared light of the infrared wavelength band and blocks the light of the other wavelength band.

The third pixel 526c of the sensing unit may include a third filter that transmits blue light of the blue wavelength band and infrared light of the infrared wavelength band and blocks light of the other wavelength band.

As shown in FIG. 10, the sensing unit 526 for sensing the color light and the infrared light at different time zones respectively includes a first pixel 526a for sensing red light of a red wavelength band, A third pixel 526c for sensing blue light of a blue wavelength band, and a fourth pixel 526d for sensing infrared light of an infrared wavelength band.

Accordingly, the control unit may control the illumination unit 510 (not shown) so that the illumination unit 510 emits color light and infrared light at the same time or emits color light and infrared light at different time zones, respectively, in accordance with the sensing unit 526 type of the light- Can be controlled.

FIG. 11 is a block diagram illustrating the image processing unit of FIG. 3, FIG. 12 is a block diagram illustrating a first image processing unit of FIG. 11, and FIG. 13 is a block diagram illustrating a second image processing unit of FIG.

As shown in FIG. 11, the image processor 530 may include a first image processor 532 and a second image processor 534.

Here, the first image processor 532 extracts the color information of the image from the color light sensed by the sensing unit of the light receiving unit, and the second image processor 534 extracts the luminance information of the image from the infrared light sensed by the sensing unit Can be extracted.

When the sensing unit of the light receiving unit simultaneously detects the color light and the infrared light, the image processing unit 530 simultaneously performs an operation of extracting color information of the image from the color light and an operation of extracting luminance information of the image from the infrared light .

That is, the operation of extracting the color information of the first image processor 532 and the operation of extracting the brightness information of the second image processor 534 can be performed simultaneously.

The first image processor 532 may extract the color information of the image from the color light sensed by the sensing unit of the light receiving unit during the first time and the second image processor 534 may extract the color information of the image, The luminance information of the image can be extracted from the infrared light sensed by the sensing unit of the light receiving unit.

Here, the image processor 530 extracts the color information of the image from the color light and extracts the luminance information of the image from the infrared light when the sensing unit of the light receiving unit senses the color light and the infrared light at different time zones, respectively Can be performed at different time zones.

That is, the operation of extracting the color information of the first image processor 532 and the operation of extracting the brightness information of the second image processor 534 may be performed at different time zones.

12, the first image processing unit 532 may include a first detecting unit 532a, a first converting unit 532b, and a first image information extracting unit 532c.

The first detecting unit 532a detects the amount of color light detected by the sensing unit, the first converting unit 532b converts the amount of detected color light into an electrical signal, the first image information extracting unit 532c, The color information of the image can be extracted from the color light.

13, the second image processing unit 534 may include a second detecting unit 534a, a second converting unit 534b, and a second image information extracting unit 534c.

The second detecting unit 534a detects the amount of infrared light detected by the sensing unit. The second converting unit 534b converts the amount of detected infrared light into an electrical signal. The second image information extracting unit 534c can extract the luminance information of the image from the infrared light.

14 and 15 are flowcharts for explaining a color image acquisition method of a digital device according to the present invention.

14 and 15, the illumination unit of the digital device emits color light corresponding to the visible region of the optical spectrum and infrared light corresponding to the infrared region of the optical spectrum (S20).

Here, the illumination unit of the digital device can emit color light for a first time, and emit infrared light for a second time.

At this time, the second time may be longer than the first time.

As another example, the illumination unit of the digital device may simultaneously emit color light and infrared light for the same period of time.

In another case, the lighting unit of the digital device emits red light for a first time, emits green light for a second time, emits blue light for a third time, and emits infrared light for a fourth time, You may.

Here, the fourth time may be longer than any one of the first, second, and third times.

The first, second and third times may be equal to each other.

As another example, the digital device may measure the luminance of the outside, determine the color light output time and the infrared light output time according to the measured external brightness, and then transmit the color light and the infrared light to each other It can be launched at a different time zone, or it can be launched at the same time.

As shown in FIG. 15, the digital device can measure an external luminance through an external luminance sensing unit when receiving a color image acquisition request from an external user (S11). (S12)

Then, the digital device confirms whether the measured external luminance value is smaller than a predetermined reference value. (S13)

If the measured external luminance value is smaller than the predetermined reference value, the external light output time is increased more than the reference time, and the color light output time is determined as the reference time. (S14)

However, if it is determined that the measured external luminance value is not smaller than the predetermined reference value, it is confirmed whether the measured external luminance value is larger than a predetermined reference value. (S15)

If the measured external luminance value is larger than the predetermined reference value, the color light output time is increased more than the reference time and the infrared light output time is determined as the reference time (S16)

Next, if it is determined that the measured external luminance value is not larger than the predetermined reference value, the color light output time and the infrared light output time are determined as the reference time (S17)

The digital device may emit color light and infrared light at different time periods or at the same time depending on the determined emission time.

Next, the light receiving portion of the digital device transmits and focuses the color light and the infrared light reflected from the predetermined object.

Then, the light receiving unit of the digital device filters the transmitted color light and infrared light, and transmits only the color light of red, green, and blue wavelength ranges and infrared light of the infrared wavelength band.

Then, the control unit of the digital device confirms whether the color light and the infrared light are output at the same time.

Next, if the color light and the infrared light are emitted at the same time, the sensing unit of the digital device simultaneously detects the filtered color light and the infrared light.

However, if the color light and the infrared light are not output at the same time, the sensing unit of the digital device senses the color light and the infrared light at different time zones, respectively.

The image processing unit of the digital device extracts the image information from the detected color light and infrared light.

Here, if the filtered color light and the infrared light are simultaneously detected, the image processing unit of the digital device can simultaneously extract the color information of the image from the color light and the luminance information of the image from the infrared light.

In some cases, the image processing unit of the digital device extracts the color information of the image from the color light during the first time when the color light and the infrared light are respectively detected at different time zones, Can be extracted.

Next, the image implementing section of the digital device can implement the color image of the subject based on the extracted image information.

As described above, according to the present invention, since both the color image and the infrared image are acquired and the color information is added to the infrared image, various information of the photographed person and wide information of the photographed subject can be obtained, Do.

Further, according to the present invention, various color images and clear images can be obtained by adjusting the illumination time according to external environmental conditions.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

510: illumination part 520:
530: Image processing unit 540:
550: control unit 570:
580: Timer 590: External luminance detection unit

Claims (20)

An illumination unit for emitting color light corresponding to a visible region of the optical spectrum and infrared light corresponding to the infrared region of the optical spectrum;
A light receiving unit for sensing the color light and infrared light reflected from a predetermined subject;
An image processing unit for extracting image information from the light receiving unit;
An image implementing unit for implementing an image of the subject based on the extracted image information; And,
And a control unit for controlling the illumination unit to emit the color light and the infrared light at the same time or emit the color light and the infrared light at different time zones according to the type of the light receiving unit,
And an external luminance sensing unit for sensing an external luminance according to a control signal of the control unit,
Wherein,
Wherein when the external luminance value detected by the external luminance sensing unit is greater than a predetermined reference value, the color light emission time of the illumination unit is further increased than the reference time,
And increases the infrared light emission time of the illumination unit more than the reference time if the external luminance value is smaller than a predetermined reference value. The illumination system according to claim 1,
A color light source including a red light source for emitting red light of a red wavelength band, a green light source for emitting green light of a green wavelength band, and a blue light source for emitting blue light of a blue wavelength band,
And an infrared light source for emitting the infrared light. The illumination system according to claim 2,
During the first time, the red light, the green light and the blue light are simultaneously emitted,
And emits the infrared light for a second time period. 4. The digital device according to claim 3, wherein the first time and the second time are different. The illumination system according to claim 2,
Wherein the red light, the green light, the blue light, and the infrared light are outputted at the same time. 6. The apparatus according to claim 5,
And simultaneously emits the red light, the green light, the blue light, and the infrared light for the same period of time. The illumination system according to claim 2,
During the first time, the red light is emitted,
During the second time, the green light is emitted,
During the third time, the blue light is emitted,
And emits the infrared light for a fourth time period. 8. The digital device as claimed in claim 7, wherein the fourth time is different from the first, second and third times. The light-emitting device according to claim 1,
A lens unit for transmitting and focusing the color light and infrared light;
A filter unit transmitting only color light of red, green and blue wavelengths transmitted through the lens unit and infrared light of an infrared wavelength band; And,
And a sensing unit for sensing the color light and the infrared light at the same time or sensing the color light and the infrared light at different time zones, respectively. The apparatus of claim 9,
A first pixel for simultaneously sensing the red light of the red wavelength band and the infrared light of the infrared wavelength band;
A second pixel for simultaneously sensing the green light of the green wavelength band and the infrared light of the infrared wavelength band; And,
And a third pixel for simultaneously sensing the blue light of the blue wavelength band and the infrared light of the infrared wavelength band. The liquid crystal display according to claim 10, wherein the first pixel includes a first filter that transmits red light of the red wavelength band and infrared light of the infrared wavelength band and blocks light of other wavelength band,
Wherein the second pixel includes a second filter that transmits red light of the green wavelength band and infrared light of the infrared wavelength band and blocks light of other wavelength band,
Wherein the third pixel includes a third filter that transmits blue light of the blue wavelength band and infrared light of the infrared wavelength band and blocks light of other wavelength band. The apparatus of claim 9,
A first pixel for sensing red light of the red wavelength band;
A second pixel for sensing green light of the green wavelength band;
A third pixel for sensing blue light of the blue wavelength band; And,
And a fourth pixel for sensing infrared light of the infrared wavelength band. The image processing apparatus according to claim 1,
A first image processing unit for extracting color information of an image from the color light detected from the light receiving unit during a first time,
And a second image processing unit for extracting luminance information of the image from the infrared light detected from the light receiving unit during a second time period. The apparatus of claim 1,
Wherein the illumination unit is turned on at a start time of one frame of the image information, and the illumination unit is turned off before the end time of the one frame. delete delete The apparatus of claim 1,
And controls the illumination unit and the image processing unit at the same time. The method according to claim 1,
And a timer for measuring a driving time of the illumination unit according to a control signal of the control unit. The method according to claim 1,
And a storage unit for storing image information extracted from the image processing unit. Emitting color light corresponding to the visible region of the optical spectrum and infrared light corresponding to the infrared region of the optical spectrum;
Transmitting and focusing color light and infrared light reflected from a predetermined subject;
Filtering the transmitted color light and infrared light to transmit only the red light, the green light, and the blue light and the infrared light of the infrared wavelength band;
Confirming whether the color light and the infrared light are emitted at the same time;
If the color light and the infrared light are emitted at the same time, the filtered color light and the infrared light are detected at the same time, and if the color light and the infrared light are not simultaneously emitted, the color light and the infrared light are detected at different time zones step;
Extracting image information from the sensed color light and infrared light; And,
And implementing a color image of the subject based on the extracted image information,
When the color light and the infrared light are emitted,
And when the detected external luminance value is greater than a predetermined reference value, the color light output time is further increased than the reference time,
When the luminance value of the outside is smaller than a predetermined reference value, the emitting time of the infrared light of the illuminating unit is further increased than the reference time.

Images