KR20170097469A - Display apparatus using a three-dimensional image sensor, AND method of power saving thereof - Google Patents
Display apparatus using a three-dimensional image sensor, AND method of power saving thereof Download PDFInfo
- Publication number
- KR20170097469A KR20170097469A KR1020160019264A KR20160019264A KR20170097469A KR 20170097469 A KR20170097469 A KR 20170097469A KR 1020160019264 A KR1020160019264 A KR 1020160019264A KR 20160019264 A KR20160019264 A KR 20160019264A KR 20170097469 A KR20170097469 A KR 20170097469A
- Authority
- KR
- South Korea
- Prior art keywords
- display unit
- power
- pixel
- turning
- person
- Prior art date
Links
Images
Classifications
-
- H04N5/23241—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42201—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
- H04N5/2226—Determination of depth image, e.g. for foreground/background separation
-
- H04N5/23219—
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Chemical & Material Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Analytical Chemistry (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Neurosurgery (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
BACKGROUND OF THE
The global smart TV market is growing rapidly. In particular, in Korea, smart TV purchases have risen sharply every year.
Smart TV is a multi-function TV that can combine Internet access with TV and various apps to utilize various functions such as web surfing, VOD watching, SNS, and games. It can download contents in real time on the Internet, and acts as a communication center for instantly checking news, weather, and e-mail.
The use area and usage pattern of TV are changed, and it is getting out of the classical area to see when it is needed for a while. In fact, many households already tend to turn on for a long time without using TV. A survey of 6,042 household members aged 13 or older residing in 3,427 households nationwide by the Korea Communications Commission in 2014 revealed that 51.7% of smartphone users and 12.4% of PC users were watching TV while watching TV in general households .
Therefore, it is expected that the power consumption will be more than the actual viewing time. Especially when the latest appliances are widely used, analysis of power supply and demand of the KPX according to the year shows that power consumption and waste are a problem. Demand for electricity has increased by an annual average of 4.6% as the economy has grown steadily over the past decade. This is lower than that of China, which has a 12.4% annual average growth rate, but it is higher than that of OECD countries, which have an annual growth rate of 1-2%. However, the idea of electricity conservation remains at a level that appeals to habits such as meeting the room temperature of 28 degrees in a public place, removing the outlet after use, and so on.
Currently, the idea of power saving is the main method of hardware solution. Typically, there are a power-saving outlet and a brightness controller using a timer.
For example, a power-saving outlet is a power-up or power-up switch. A far infrared ray sensor for human body is attached and shoots the light. When it is reflected, it recognizes that there is a person and turns on the power. If it does not come back, it turns off the power. However, this outlet can not be used for electronic devices that share the plug by turning off the power on a per-plug basis.
In the case of TV, there is a case where a separate recording device is connected to collect images. However, when the power saving method is adopted, the power of the TV is completely turned off and recording is impossible.
The present invention provides a display device and a power saving method that can efficiently perform a power saving function using a depth image and a color image collected from a three-dimensional image sensor.
According to an embodiment of the present invention, there is provided a three-dimensional image sensor for capturing a depth image using infrared rays and a color image; The depth image is processed to separate an object and a background, an object recognition process for recognizing an object, and a pixel process for grasping the motion of the object based on a pixel difference value between a previous frame and a current frame of the color image An operation control unit configured; And a display unit in which the power is turned on and turned off according to whether or not the object is recognized in the operation control unit.
In addition, the operation control unit turns on the power of the display unit when at least one shape of the person is detected in the object recognition process.
The operation control unit turns on the power of the display unit when at least one shape of the person is detected in the object recognition process and the pixel difference value exceeds the reference value in the pixel process do.
The operation control unit may maintain the current power state of the display unit when at least one shape of the person is detected in the object recognition process and the pixel difference value does not exceed the reference value in the pixel process .
The operation control unit turns off the power of the display unit when at least one shape of the person is not detected in the object recognition process.
According to another embodiment of the present invention, there is provided a method of processing a depth image using infrared rays, the method comprising: performing an object recognition process of recognizing an object by separating an object and a background from each other; Performing pixel processing for grasping the motion of the object based on a pixel difference value between a previous frame and a current frame of the color image; And a step of turning the display unit on and off according to whether or not the object recognizing process and the pixel process recognize the object, and a power saving method of the display device using the three-dimensional image sensor, do.
The turning on and turning off the display unit may turn on the power of the display unit when at least one shape of the person is detected in the object recognition process do.
The turning on and turning off of the display unit may include detecting at least one shape of a person in the object recognition process and, when the pixel difference value exceeds the reference value in the pixel process, And turning on the power of the display unit.
In addition, turning on and turning off the display unit may include detecting at least one shape of a person in the object recognition process, and when the pixel difference value does not exceed the reference value , And the current power state of the display unit is maintained.
The turning on and turning off the display unit may turn off the power of the display unit when at least one shape of the person is not detected in the object recognition process .
A display device using a three-dimensional image sensor and a power saving method thereof according to an embodiment of the present invention,
It is possible to automatically turn on (turn off) and turn off (turn off) the power of the display unit such as a smart television after detecting the presence of an object (person) by using the depth image using infrared rays and the color image simultaneously, Power consumption can be reduced.
In addition, since the depth image using infrared rays and the color image are simultaneously used to perform the power saving function, the recognition rate of the object (person) is very high, and the reliability of the power saving function is increased by the high recognition rate.
1 is a configuration diagram of a display device using a three-dimensional image sensor according to an embodiment of the present invention.
2 is a view showing an object recognition process using a depth image.
3 is a diagram illustrating a pixel processing process using a color image.
4 is a flowchart illustrating a power saving method of a display device using a three-dimensional image sensor according to an embodiment of the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, in order to facilitate a person skilled in the art to easily carry out the technical idea of the present invention.
1 is a configuration diagram of a
The
Referring to FIG. 1, a
Here, the three-
The detailed configuration and main operation of the
The three-
The infrared
The
The
Meanwhile, the
In addition, the
A detailed description of the object recognition process and the pixel process performed by the
The
Turning the power on or off in this embodiment means that the screen of the
That is, the power supplied to the
2 is a view showing an object recognition process using a depth image.
Referring to FIG. 2, the first drawing 11 of FIG. 2 shows a general color image, and the
That is, the
Therefore, the depth image can provide position data of 20 main skeletons constituting the human body, and information of the body part corresponding to the skeleton can be easily obtained by using the corresponding joint point. Therefore, it is possible to detect whether a person (object) is located in front of the
Since the object recognition process (object recognition) uses an infrared sensor, the object can be easily tracked even in a dark environment where the light is weak.
3 is a diagram illustrating a pixel processing process using a color image.
Referring to FIG. 3, a
The
That is, since the pixel values of the previous frame and the current frame of the color image can not be completely equal due to the influence of illumination or the like, for example, about 0.2% to 1% of 640 * 480 pixels have different color information It can be judged that the object has moved. At this time, only when the difference in color value of each pixel (RGB) is 50 or more, it is counted that it has different color information. - Assume that each color value of RGB has a range from 0 to 255 -
Pixel processing distinguishes the movement of the object with the color difference value. Therefore, the change of the color value due to illumination or wind can be discriminated from the similar color and excluded from the power saving operation.
Basically, the
When at least one shape of a person is detected in the object recognition process and the pixel difference value exceeds the reference value in the pixel processing at the same time, the
The
That is, when at least one shape of a person is detected in the object recognizing process while the
When at least one shape of a person is detected in the object recognizing process while the
In addition, the
For reference, the
In addition, when the
4 is a flowchart illustrating a power saving method of a display device using a three-dimensional image sensor according to an embodiment of the present invention.
Referring to the flowchart of FIG. 4, the process of the power saving method of the
A power saving method of a display device using a three-
First, a depth image using infrared rays is processed to separate an object and a background, and an object recognition process for recognizing an object is performed (S10, S20).
Next, a step S30 and step S40 of performing pixel processing for grasping the movement of the object based on the pixel difference value between the previous frame and the current frame of the color image are performed.
Next, steps S50, S60, and S70 for turning on and off the display unit according to whether the object is recognized by the object recognition process and the pixel process are performed.
An example of the process of the power saving method of the display device will be described as follows.
First, in a state in which the
If at least one object (person) is not recognized in the process of processing the depth image, the
In this case, when one or more objects (persons) are recognized, the color image processing is performed. If the difference between the pixel values exceeds the reference value, the person is recognized as a state using the moving state- TURN ON) state is maintained. On the other hand, even if the pixel value difference does not exceed the reference value, since the person is recognized, the turn-on state is maintained.
Next, in a state in which the
If at least one object (person) is not recognized in the process of processing the depth image, the
In this case, when one or more objects (persons) are recognized, the color image processing is performed. When the difference between the pixel values exceeds the reference value, the person is recognized as a state using the moving state-
For reference, the step of TURN ON and TURN OFF of the display unit may proceed to TURN ON the power of the display unit when at least one shape of a person is detected in the object recognizing process .
In the step of turning the display unit on and turning off the display unit, at least one shape of a person is detected in the object recognition process. When the pixel difference value exceeds the reference value in the pixel processing, (TURN ON).
The step of TURN ON and TURN OFF of the display unit may be such that at least one shape of a person is detected in the object recognition process and if the pixel difference value in the pixel processing does not exceed the reference value, And may be operative to maintain the current power state.
The step of turning on and off the display unit may be operated to turn off the power of the display unit when at least one shape of the person is not detected in the object recognition process have.
Table 1 shows the recognition rate according to the brightness, and Table 2 shows the recognition rate according to the distance.
In Table 1, brightness was divided into three ranges, and each experiment was performed 50 times. The distance was set at 2m, and the time it took to recognize was limited to 10 seconds.
Table 2 shows that the distance was divided into four ranges and each experiment was performed 50 times. The time it takes to recognize is limited to 10 seconds.
The
On the other hand, the
That is, it is possible to judge whether the person is in the sleep state by judging the length and posture of the body part of the person, and to control the power supply of the
For example, when the person is lying down, the sleep state may be determined by taking into consideration the time for measuring the angle between the head, the waist, the hip, the knee and the foot and maintaining the angle.
A display device using a three-dimensional image sensor and a power saving method thereof according to an embodiment of the present invention,
It is possible to automatically turn on (turn off) and turn off (turn off) the power of the display unit such as a smart television after detecting the presence of an object (person) by using the depth image using infrared rays and the color image simultaneously, Power consumption can be reduced.
In addition, since the depth image using infrared rays and the color image are simultaneously used to perform the power saving function, the recognition rate of the object (person) is very high, and the reliability of the power saving function is increased by the high recognition rate.
Thus, those skilled in the art will appreciate that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the embodiments described above are to be considered in all respects only as illustrative and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.
100: 3D image sensor
111, 112: Infrared depth sensor
120: Video camera
200:
300:
Claims (10)
The depth image is processed to separate an object and a background, an object recognition process for recognizing an object, and a pixel process for grasping the motion of the object based on a pixel difference value between a previous frame and a current frame of the color image An operation control unit configured; And
Wherein the power is turned on (TURN ON) and turned off (TURN OFF) according to whether the object is recognized in the operation control unit
And a display device using the three-dimensional image sensor.
The operation control unit,
And turns on the power of the display unit when at least one shape of the person is detected in the object recognition process.
The operation control unit,
Wherein at least one shape of a human being is detected in the object recognition process and the power source of the display unit is turned on when the pixel difference value exceeds a reference value in the pixel processing Display device.
The operation control unit,
Wherein at least one shape of a person is detected in the object recognition process and the current power state of the display unit is maintained when the pixel difference value does not exceed the reference value in the pixel processing Device.
The operation control unit,
And turns off the power of the display unit when at least one shape of the person is not detected in the object recognizing process.
Performing pixel processing for grasping the motion of the object based on a pixel difference value between a previous frame and a current frame of the color image; And
Turning on (TURN ON) and turning off (TURN OFF) the display unit according to whether the object recognizing process and the pixel process recognize the object;
Wherein the display device is a three-dimensional image sensor.
The turning on and turning off the display unit may comprise:
Wherein the power of the display unit is turned on when at least one shape of a person is detected in the object recognition process.
The turning on and turning off the display unit may comprise:
Wherein at least one shape of a human being is detected in the object recognition process and the power source of the display unit is turned on when the pixel difference value exceeds a reference value in the pixel processing A method of power saving a display device.
The turning on and turning off the display unit may comprise:
Wherein at least one shape of a person is detected in the object recognition process and the current power state of the display unit is maintained when the pixel difference value does not exceed the reference value in the pixel processing Power saving method of the device.
The turning on and turning off the display unit may comprise:
And turning off the power of the display unit when at least one shape of the person is not detected in the object recognizing process.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160019264A KR20170097469A (en) | 2016-02-18 | 2016-02-18 | Display apparatus using a three-dimensional image sensor, AND method of power saving thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160019264A KR20170097469A (en) | 2016-02-18 | 2016-02-18 | Display apparatus using a three-dimensional image sensor, AND method of power saving thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20170097469A true KR20170097469A (en) | 2017-08-28 |
Family
ID=59759704
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020160019264A KR20170097469A (en) | 2016-02-18 | 2016-02-18 | Display apparatus using a three-dimensional image sensor, AND method of power saving thereof |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20170097469A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20200087400A (en) * | 2019-01-11 | 2020-07-21 | 엘지전자 주식회사 | Camera device, and electronic apparatus including the same |
US12033306B2 (en) | 2019-01-11 | 2024-07-09 | Lg Electronics Inc. | Camera device and electronic apparatus including the same |
-
2016
- 2016-02-18 KR KR1020160019264A patent/KR20170097469A/en unknown
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20200087400A (en) * | 2019-01-11 | 2020-07-21 | 엘지전자 주식회사 | Camera device, and electronic apparatus including the same |
US12033306B2 (en) | 2019-01-11 | 2024-07-09 | Lg Electronics Inc. | Camera device and electronic apparatus including the same |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9836639B2 (en) | Systems and methods of light modulation in eye tracking devices | |
CN103729981B (en) | A kind of child sitting gesture monitoring intelligent terminal | |
EP3102907B1 (en) | Environment-dependent active illumination for stereo matching | |
EP2430886B1 (en) | Method and system for controlling lighting | |
WO2018161289A1 (en) | Depth-based control method, depth-based control device and electronic device | |
CN105023552B (en) | Display and brightness adjusting method thereof | |
CN103839054B (en) | Multi-functional mobile intelligent terminal sensor supporting iris recognition | |
CN106878780A (en) | It is capable of the intelligent TV set and its control system and control method of Intelligent adjustment brightness | |
JP5823480B2 (en) | Power saving transparent display | |
US20150317516A1 (en) | Method and system for remote controlling | |
US9098243B2 (en) | Display device and method for adjusting observation distances thereof | |
US20160088711A1 (en) | Adaptable lighting system | |
JP2005269891A (en) | Control and management of electric power of electronic equipment utilizing detection of eye | |
CN106919359A (en) | A kind of display screen font size automatic adjustment system | |
CN107635099B (en) | Human body induction double-optical network camera and security monitoring system | |
CN109257483B (en) | Method for adjusting opening and closing angles of display screens and multi-screen terminal | |
US8022981B2 (en) | Apparatus and method for automatically controlling power of video appliance | |
Ma et al. | Automatic brightness control of the handheld device display with low illumination | |
CN106304533A (en) | A kind of lamplight scene intelligence control system | |
CN102025945A (en) | Electronic device and control method thereof | |
CN106488629A (en) | A kind of projection control type intelligence lamp system | |
CN106534731A (en) | Television smart control method, device, equipment and system | |
CN206657346U (en) | A kind of display screen font size automatic adjustment system | |
CN109697422B (en) | Optical motion capture method and optical motion capture camera | |
TWI638334B (en) | Image processing method and electronic apparatus for foreground image extraction |