JP5399880B2 - Power control apparatus, power control method, and computer-executable program - Google Patents

Description

The present invention relates to a power control device, a power control method, and a computer-executable program. Specifically, a power control device, a power control method, and a computer that perform power saving control of an information processing device equipped with a camera module. It relates to an executable program.

  Conventionally, in an information processing apparatus such as a computer, various power saving controls are performed in order to reduce power consumption. Recently, an information processing apparatus equipped with a camera has become widespread, and a power control method has been proposed in which a camera is used to recognize whether there is a user and perform power control.

  For example, in Patent Document 1, based on video information input by a camera, the situation around the computer (whether a person approaches or leaves the system, faces the front of the system, etc.) is recognized, and based on the recognition result. Thus, a technology for performing control such as turning on / off a power source of a computer and a display unit is disclosed.

  Further, in Patent Document 2, a computer system is analyzed by analyzing an image captured by a camera and extracting a face image to determine whether or not the user is present and whether the face and eyes of the user are facing the display screen. The power supply is suspended or resumed when the computer system is not in use, and the power supply is suspended or resumed when it is in use. A technique for performing the control is disclosed.

  FIG. 5 is a flowchart for explaining the prior art of backlight ON / OFF control of a liquid crystal display by face recognition using a camera. In FIG. 5, it is first determined whether or not a face has been detected in the face recognition process (step S1). If a face is detected (“Yes” in step S1), the backlight is turned on (step S2). If no face is detected ("No" in step S1), the backlight is turned off (step S3).

  FIG. 6 is a diagram showing an example of a timing chart of the backlight ON / OFF control of FIG. In the figure, (A) is a user's action (seating (sitting in front of the camera), leaving (seating from the front of the camera)), (B) is an input of HID (human interface device), (C ) Indicates the detection result of the face recognition process (“1”: detection, “0”: non-detection), and (D) indicates ON / OFF of the backlight.

  First, while the user is away (T1-T2, T5-T6), the detection result of the face recognition process is “0: non-detection”, so the backlight is turned off. While the user is seated (T2 to T5), the detection result of the face recognition process is “1: detection”, so the backlight is turned on. While the backlight is on, T2 to T5 are performing face recognition processing regardless of the HID input state (Idle, Busy).

  However, in the prior art, when it is determined that a person is looking at the display, the display is turned on, and during that time, the camera and the image processing system are always operating for the face recognition process. There is a problem that the effect cannot be obtained.

JP 7-271482 A JP 2001-5550 A

  The present invention has been made in view of the above, and a power control device capable of further reducing power consumption when performing power saving control by recognizing a user based on a captured image of a camera, An object is to provide a power control method and a computer-executable program.

  In order to solve the above-described problems and achieve the object, the present invention is a power control apparatus that performs power saving control of an information processing apparatus including at least a human interface device and a display, and images a subject with a camera. Then, based on the captured subject image, a camera module that executes a face / line of sight recognition process for recognizing a user's face or line of sight in front of the display, and based on a detection result of the face / line of sight recognition process, Power control means for performing power saving control of the information processing apparatus; and input state detection means for detecting an input state of the human interface device, wherein the power control means is detected by the input state detection means. Performs power saving control of the camera module based on the input state of the human interface device. And wherein the door.

  Also, according to a preferred aspect of the present invention, the power control means turns on the power of the display and turns the user's face or line of sight when the user's face or line of sight is detected in the face / gaze recognition process. When the power is not detected, the power of the display is turned off, and the power saving control of the camera module is performed when the idle state of the human interface device is not equal to or greater than a first threshold by the input state detection unit. desirable.

  Further, according to a preferred aspect of the present invention, the power control means shifts to a suspend state when the display power OFF time is equal to or greater than a second threshold value to save power of the camera module. It is desirable to control.

  According to a preferred aspect of the present invention, it is desirable that the power saving control of the camera module is a process of stopping power supply or shifting to an idle state for a part or all of the camera module.

  In order to solve the above-described problems and achieve the object, the present invention provides a power control method for an information processing apparatus including at least a human interface device and a display. Based on the detection result of the face / gaze recognition process, the step of performing a face / gaze recognition process of recognizing the face or gaze of the user in front of the display based on the captured subject image A power control step for performing power saving control of the information processing apparatus; and an input state detection step for detecting an input state of the human interface device, wherein the power control step is detected in the input state detection step. Based on the input status of the human interface device, power saving control of the camera module is performed. And wherein the Ukoto.

  In order to solve the above-described problems and achieve the object, the present invention is a program mounted on an information processing apparatus including at least a human interface device and a display, and is imaged by a camera in a camera module. A step of executing a face / gaze recognition process for recognizing the face or line of sight of the user in front of the display based on the captured subject image, and a detection result of the face / gaze recognition process. A power control step for performing power saving control and an input state detection step for detecting an input state of the human interface device are executed by a computer. In the power control step, the human detected in the input state detection step Based on the input status of the interface device, the camera module And performing power control.

  According to the present invention, there is provided a power control apparatus that performs power saving control of an information processing apparatus including at least a human interface device and a display, the subject is captured by a camera, and the display is based on the captured subject image. A camera module that executes a face / line of sight recognition process for recognizing the face or line of sight of a user in front of the user, and a power control unit that performs power saving control of the information processing apparatus based on a detection result of the face / line of sight recognition process And input state detection means for detecting an input state of the human interface device, and the power control means is based on the input state of the human interface device detected by the input state detection means. Since it was decided to perform power saving control of the camera module, it was based on the captured image of the camera. When performing recognition to the power saving controlling user Te, an effect that it is possible to provide a power control device capable of reducing power consumption more.

FIG. 1 is a schematic external view of a notebook PC to which a power control apparatus according to an embodiment of the present invention is applied. FIG. 2 is a diagram showing a schematic configuration example of the notebook PC of FIG. FIG. 3 is a flowchart illustrating the power saving control of the camera module by the embedded controller. FIG. 4 is a diagram illustrating an example of a timing chart of the power saving control of the camera module by the embedded controller. FIG. 5 is a flowchart for explaining the prior art of backlight ON / OFF control of a liquid crystal display by face recognition using a camera. FIG. 6 is a diagram showing an example of a timing chart for explaining a conventional technique of backlight ON / OFF control of a liquid crystal display by face recognition using a camera.

  Hereinafter, a power control device, a power control method, and a portable computer that can be executed by a computer will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiments. In addition, constituent elements in the following embodiments include those that can be easily assumed by those skilled in the art or that are substantially the same. Although the components of the present invention are generally illustrated in the drawings herein, it can be readily understood that they may be arranged and designed in a wide variety of configurations with various configurations. Accordingly, the following more detailed description of the apparatus, method, and program embodiments of the present invention is not intended to limit the scope of the invention as set forth in the claims, but merely to the selected embodiments of the invention. By way of example only, selected embodiments of the device, apparatus and method are merely shown consistent with the invention as set forth in the claims herein. Those skilled in the art will appreciate that the present invention may be practiced without one or more of the specific details or with other methods, components, or materials.

  FIG. 1 is a schematic external view of a notebook PC to which a power control apparatus according to an embodiment of the present invention is applied. As shown in the figure, the notebook PC 1 includes a main body side housing 2 and a display side housing 3 which are substantially rectangular parallelepipeds. The main body side housing 2 includes an HID (Human Interface Device) having a keyboard 41, a slice pad (pointing device) 42, a microphone 43, and the like. The display-side housing 3 includes a liquid crystal display 5 and a camera unit 616 that is disposed at a substantially upper center on the display surface side of the liquid crystal display 5 and can image a subject in front.

  Further, the main body side housing 2 and the display side housing 3 are connected to each other by a pair of left and right connecting portions (hinge portions) 7a and 7b at the respective end portions, and the connecting portions 7a and 7b are connected to these housings. Is supported to be openable and closable.

  In the figure, when a user is photographed by the camera unit 61 and the user is detected by the camera processing unit based on the photographed image, the liquid crystal display 5 is turned on when there is a user, and when there is no user. When performing power saving control with the power off, the configuration in which the user is always detected by the camera unit 61 or the camera processing unit regardless of the input state of the HID while the liquid crystal display 5 is turned on has a sufficient power saving effect. Can't get. Therefore, in the present embodiment, while there is an input operation by HID, naturally, since the person is using the notebook PC 1, the camera unit 61 and the camera processing unit are put into a power saving state, and the power corresponding to that is used. To save money.

  FIG. 2 is a diagram showing a schematic configuration example of the notebook PC 1 of FIG. The notebook PC 1 shown in the figure is compliant with ACPI. As shown in the figure, the notebook PC 1 includes a CPU 11, a ROM 12, a memory 13, an HDD (hard disk) 14, an HID 4, a liquid crystal display 5, a camera module 6, a graphic adapter 15, and an embedded controller 16. And a power supply circuit 17, and each part is connected directly or indirectly via a bus.

  The CPU 11 controls the entire notebook PC 1 by the OS 14 a stored in the HDD 14 connected via the bus, and controls the function of executing processing based on various programs stored in the HDD 14. The ROM 12 stores a BIOS (Basic Input / Output System: basic input / output system) 12a, data, and the like.

  The memory 13 is composed of a cache memory and a RAM, and is a writable memory used as a work area for writing processing data of the execution program as a read area for the execution program of the CPU 11.

  The HDD (hard disk) 14 includes, for example, an OS 14a for controlling the notebook PC 1 as a whole, such as Windows (registered trademark) XP, Vista, 7 and the like, a display driver for operating a peripheral device, a camera driver, and the like. It has a function of storing various drivers 14b, applications 14c directed to specific tasks, and the like.

  The graphic adapter 15 converts display information into a video signal under the control of the CPU 11 and outputs the converted video signal to the liquid crystal display 5 for display.

  The liquid crystal display 5 includes an LCD panel 51 and a backlight 52. The LCD panel 51 is a transmissive or transflective liquid crystal panel, and has a function of displaying various types of information under the control of the CPU 11. The backlight 52 is composed of an LED or a reflector and illuminates the LCD panel 51. The ON / OFF of the backlight 52 and the brightness thereof are controlled by the embedded controller 16. In this embodiment, a liquid crystal display is used as a display. However, the present invention is not limited to this, and another display such as an organic EL display or a CRT may be used. .

  The embedded controller 16 includes an MPU, a memory, a ROM storing a program, an A / D converter, a D / A converter, timers 16a and 16b, and the like. The embedded controller 16 is connected to the HID 4, the liquid crystal display 5, the camera module 6, and the power supply circuit 17, and controls the operation of the HID 4 and the power supply circuit 21 and also controls the power of the liquid crystal display 5 and the camera module 6. The embedded controller 18 controls power supply to each device by the power supply circuit 17 and performs power supply control according to the system state (ACPI state).

  The system states are defined as six states S0 to S5, where S0 is a full operation state, S1 is a low power consumption state (however, both the processor and chipset are powered on), and S2 is a low power consumption state (however, the processor And the cache are powered off, the chipset is powered on), S3 is in a suspended state, S4 is in a dormant state, and S5 is powered off by software.

The timer 16a is for counting the idle time t _{idle of} HID4, and the embedded controller 16 resets the idle time t _idle when the operation of HID4 is detected. The timer 16b is for counting the backlight OFF time _{tBLOFF in} which the backlight 52 of the liquid crystal display 5 is OFF, and the embedded controller 16 has the backlight OFF time t when the backlight 52 is turned ON. Reset _BLOFF .

Further, the embedded controller 16 sets the camera module 6 to the power saving state when the idle time t _idle is not equal to or greater than the predetermined value, that is, while the HID 4 is being operated, and performs the face / gaze detection process of the camera processing unit 64. Stop. Here, to set the camera module 6 to the power saving state is to cut off the power supply from the power supply circuit 17 or to shift to the idle state for one or both of the camera unit 61 and the camera processing unit 64 of the camera module 6. This means that the power consumption of the camera module 6 is reduced compared to the normal state regardless of the method. Although the embedded controller 16 performs power control, the CPU 11 may execute a program to perform power control.

  HID4 is a human user interface for a user to perform an input operation, and includes a keyboard 41 composed of various keys for inputting characters, commands, etc., and a slice for moving a cursor on the screen and selecting various menus. A pad 42, a microphone 43 for inputting voice, and the like are provided. The HID of the present invention is not limited to these input devices, and includes other devices used for user input such as a mouse and a touch panel.

  The power supply circuit 17 includes an AC adapter, an intelligent battery, a charger for charging the intelligent battery, a DC / DC converter, and the like.

  The camera module 6 includes a camera unit 61 and a camera processing unit 64. The camera unit 61 includes a lens 62 and an imaging unit (camera) 63. The lens 62 images subject light. The imaging unit 63 includes an imaging element such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide Semiconductor), an RGB color filter, and the like, and converts subject light captured by the lens 62 into an electrical signal. The image signal is output to the camera processing unit 64 as R, G, B image signals.

  The camera processing unit 64 includes an A / D converter, an image processing LSI, a memory, and the like, performs drive timing of the image sensor, exposure control, and the like, and performs various processing on the RGB image signals obtained by the image capturing unit 63. Perform signal processing, perform face / gaze recognition processing based on the image signal obtained by the imaging unit 63, detect the user's face or gaze, detect the user, and detect the detection result (for example, use "1" when the user's face or line of sight is detected, and "0" when the user's face or line of sight cannot be detected are output to the embedded controller 16. Note that a technique for recognizing and detecting a face or line of sight based on a captured image is well known, and detailed description thereof is omitted.

  FIG. 3 is a flowchart for explaining the power saving control of the camera module 6 by the embedded controller 16.

In FIG. 3, the embedded controller 16 first determines whether or not the idle time t _idle of the HID 4 counted by the timer 16a is equal to or greater than a first threshold value (step S11). If the idle time t _{idle of} HID4 is not equal to or greater than the first threshold (“No” in step S11), the embedded controller 16 sets the camera module 6 to the power saving state and performs the face / gaze detection process of the camera processing unit 64. While stopping (step S15), the backlight 52 of the liquid crystal display 5 is turned ON (step S16), and the process returns to step S11.

On the other hand, when the idle time t _{idle of} HID4 is equal to or greater than the first threshold (“Yes” in step S11), the embedded controller 16 sets the camera module 6 in the normal state and detects the face / gaze in the camera processing unit 64. The process is executed (step S12), and it is determined whether a face or line of sight has been detected (step S13). When a face or line of sight is detected (“Yes” in step S13), the embedded controller 16 turns on the backlight 52 of the liquid crystal display 5 (step S14) and returns to step S11 while detecting the face or line of sight. If not ("No" in step S13), the backlight 52 of the liquid crystal display 5 is turned off (step S17). Then, the embedded controller 16 determines whether or not the backlight OFF time t _BLOFF counted by the timer 16b is equal to or greater than the second threshold (step S18). If the backlight OFF time t _BLOFF is not equal to or greater than the second threshold (“No” in step S18), the embedded controller 16 returns to step S11 while the backlight OFF time t _BLOFF is _equal to or greater than the second threshold. In such a case (“Yes” in step S18), the process proceeds to the suspended state (step S19), and the camera module 6 is controlled to save power. When returning from the suspended state by an operation such as HID4, the process returns to step S11.

  FIG. 4 shows an example of a timing chart of the power saving control of the camera module 6 by the embedded controller 16. In the figure, (A) is a user's action (sitting (sitting in front of the camera), leaving (sitting from the front of the camera)), (B) is an input of HID, (C) is a face recognition engine The detection result (“1”: user detection, “0”: user non-detection), (D) indicates ON / OFF of the backlight.

First, while the user is away (T1 to T2), the detection result of the face / gaze recognition process is “0”, so the backlight 52 of the liquid crystal display 5 is turned off. When the user is seated (T2), the detection result of the face / gaze recognition process is “1”, so the backlight 52 is turned on. When the user operates HID4 and the idle time t _{idle of} HID4 is not equal to or greater than the first threshold (T3), the face / gaze recognition processing is turned off. When the idle time t _{idle of} HID4 is equal to or greater than the first threshold (T4), the face / gaze recognition process is turned on. Thereafter, when the user is seated (T5), the detection result of the face / gaze recognition processing is “0”, and thus the backlight 52 is turned off.

  As described above, according to the present embodiment, the face / gaze recognition process is performed in which the subject is imaged by the camera and the user's face or line of sight in front of the liquid crystal display 5 is recognized based on the captured subject image. The camera module 6 to be executed and an embedded controller 16 that performs power saving control of the notebook PC 1 based on the detection result of the face / gaze recognition process. The embedded controller 16 detects the input state of the HID 4 and detects the detection. Since the power saving control of the camera module 6 is performed based on the result, the power consumption can be further reduced when the user is recognized based on the captured image of the camera and the power saving control is performed. Become.

Further, according to the present embodiment, when the embedded controller 16 detects the user's face or line of sight in the face / gaze recognition process, the backlight 52 is turned on and the user's face or line of sight cannot be detected. In this case, the power saving control of the camera module 6 is performed when the backlight 52 is turned off and the idle time t _idle of the HID 4 is not greater than or equal to the first threshold value. Therefore, while the backlight 52 is turned on, the HID 4 When there is an input, it is possible to reduce the power consumption of the camera module 6 by controlling the camera module 6 to save power.

Further, according to the present embodiment, when the backlight OFF time t _BLOFF is equal to or longer than the second threshold, the embedded controller 16 shifts to the suspend state and performs power saving control on the camera module 6. Therefore, the power consumption of the camera module 6 can be further reduced.

  In the above embodiment, the notebook type PC has been described as an example of the information processing apparatus according to the present invention. However, the information processing apparatus according to the present invention is not limited to the notebook type PC and includes a camera. Any configuration may be used, and the present invention can be applied to various information processing apparatuses such as a desktop PC, a mobile phone, and a PDA.

  The power control device, the power control method, and the computer-executable program according to the present invention are useful for reducing the power consumption of the camera module.

1 Notebook PC
2 Body side housing 3 Display side housing 4 HID
5 Liquid crystal display 51 LCD panel 52 Backlight 6 Camera module 7a, 7b Connecting part (hinge part)
61 Camera Unit 62 Lens 63 Imaging Unit 64 Camera Processing Unit 11 CPU
12 ROM
12a BIOS
13 Memory 14 HDD (Hard Disk)
14a OS
14b Driver 14c Application 15 Graphic adapter 16 Embedded controller 17 Power supply circuit

Claims (6)

At least a power control apparatus that performs power saving control of an information processing apparatus including a human interface device and a display,
A camera module that captures a subject with a camera and executes face / line-of-sight recognition processing for recognizing a user's face or line of sight in front of the display based on the captured subject image;
Power control means for performing power saving control of the information processing device based on the detection result of the face / gaze recognition processing;
Input state detecting means for detecting an input state of the human interface device;
With
The power control unit, based on the input state of the human interface device to be detected by the input state detecting means, have rows power saving control of the camera module, while there is an input operation of the human interface devices A power control apparatus for controlling the camera module to save power . The power control means includes
When the user's face or line of sight is detected in the face / line of sight recognition process, the display power is turned on, and when the user's face or line of sight cannot be detected, the display is turned off,
2. The power control apparatus according to claim 1, wherein power saving control of the camera module is performed when the idle state of the human interface device is not equal to or greater than a first threshold by the input state detection unit.   The power control means shifts to a suspend state and performs power saving control of the camera module when the power OFF time of the display exceeds a second threshold value. The power control device described in 1.   The power saving control of the camera module is a process of stopping power supply or shifting to an idle state for a part or all of the camera module. The power control apparatus according to one. A power control method for an information processing apparatus including at least a human interface device and a display,
In the camera module, performing a face / gaze recognition process for recognizing a user's face or line of sight in front of the display based on the image of the object captured by the camera and the captured object image;
A power control step for performing power saving control of the information processing device based on the detection result of the face / gaze recognition processing;
An input state detection step of detecting an input state of the human interface device;
Including
Wherein the power control step, based on the input state of the human interface device to be detected by the input state detecting step, have rows power saving control of the camera module, while there is an input operation of the human interface devices A power control method for controlling the camera module to save power . At least a program installed in an information processing apparatus having a human interface device and a display,
In the camera module, executing a face / line-of-sight recognition process for recognizing a user's face or line of sight in front of the display based on a subject image captured by the camera;
A power control step for performing power saving control of the information processing device based on the detection result of the face / gaze recognition processing;
An input state detection step of detecting an input state of the human interface device;
To the computer,
In the power control process, based on the input state of the human interface device to be detected by the input state detecting step, have rows power saving control of the camera module, while there is an input operation of the human interface devices A computer-executable program for controlling the camera module to save power .

Images