JP2005115521A - Equipment control system and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an equipment control system and an equipment control method by which the use or nonuse of equipment is efficiently detected. <P>SOLUTION: Detection is made whether or not the face of a human is included in an input picture. Power supply to the equipment is controlled on the basis of the detection result. The picture is input by means of a CCD, a television camera, and the like. Thus, no input with user's awareness is required. Furthermore, the face of the human is detected from the picture by using picture processing, or the like. Thus, the possibility of mistaking the picture for an item except the human face is less. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a device control system and a device control method for controlling supply of power to a device.

In various devices such as a computer and a television, when the device is not used, it may be automatically shifted to a power saving mode.
Whether or not the device is in use is determined, for example, by monitoring keyboard input (determined that the keyboard is not used when no input operation is performed for a certain period of time), detection by a human sensor, or the like. By switching between the normal mode and the power saving mode according to the use or non-use of the device, the power consumption when not in use is reduced.
A technique for recognizing a face image has been disclosed (see Patent Documents 1 and 2).
JP 2001-256696 A JP 2002-191044 A

However, the conventional device use detection means tend to be troublesome and uncertain.
For example, in monitoring keyboard input, some operation must be performed with a keyboard or the like when returning from the power saving mode. In addition, human sensors may react to things other than humans.
In view of the above, an object of the present invention is to provide a device control system and a device control method capable of efficiently detecting the use and non-use of a device.

A. In order to achieve the above object, an apparatus control system according to the present invention includes an image input unit that inputs an image, and face detection that detects whether a human face is included in the image input by the image input unit. And a power supply control unit that controls supply of power to the device based on a detection result by the face detection unit.
Whether or not a human face is included in the input image is detected, and power supply to the device is controlled based on the detection result. Since an image can be input with a CCD, a TV camera, etc., there is no need for the user to consciously input. In addition, since the detection of a human face from an image can be performed using image processing or the like, there is little risk of misidentification as something other than a person.

1. Here, the device control system registers a face, a correspondence determination unit that determines whether the face detected by the face detection unit corresponds to the face registered by the face registration unit, And the power supply control unit may control power supply to the device based on a determination result by the correspondence determination unit.
Since power supply is controlled according to whether or not the detected face is registered, the risk of unauthorized use by outsiders or the like can be reduced.

2. The power supply control unit can switch between a first control state in which power is supplied to the device and a second control state in which power is supplied to the device that is smaller than the power in the first control state. There may be.
The power supply control by the power supply control unit can be divided into first and second control states. The first and second control states can be positioned as a normal state in which power for use in a normal state is supplied to the device and a power saving mode in which power supply to the device is restricted. . However, it is sufficient that the power supply is positioned as two different states regardless of the correspondence.
In addition, there may be third and fourth control states.

(1) The device control system may further include a face registration unit that registers the face detected by the face detection unit when the power supply control unit is in the first control state.
The face detected when the power supply control unit is in the first control state is registered as the user's face.

(2) When a face is not detected by the face detection unit, the power supply control unit may switch to the second control state.
When no face is detected from the image, the supply of power to the device is reduced as the absence of the user.
This switching can also be performed when a face is not detected by the face detection unit for a predetermined time.

(3) When the face detected by the face detection unit corresponds to the face registered by the face registration unit, the power supply control unit may switch to the first control state.
By increasing the power supplied to the device when the detected face corresponds to the registered face, unauthorized use of the device by an unregistered person can be prevented.

B. An image input step for inputting an image, a face detection step for detecting whether or not a human face is included in the image input in the image input step, and a detection result in the face detection step, to the device And a power supply control step for controlling the supply of power.
Whether or not a human face is included in the input image is detected, and power supply to the device is controlled based on the detection result. Since an image can be input with a CCD, a TV camera, etc., there is no need for the user to consciously input. In addition, since the detection of a person's face from an image can be performed using image processing or the like, there is little risk of misidentification as something other than a person.

  ADVANTAGE OF THE INVENTION According to this invention, the apparatus control system and apparatus control method which can detect the use and non-use of an apparatus efficiently can be provided.

  In the device control system according to the embodiment of the present invention described below, the user of the device can detect the presence of a human face in the image by inputting an image in the vicinity of the device. It is judged whether it exists in the inside (within the user existence range) (and use or non-use of the equipment). When the user is not present, the device is shifted to the power saving mode, and when the user is present, the device is returned to the normal mode. In addition to the presence of a face, the face may be compared with a registered face to determine whether or not to return to the normal mode depending on the presence or absence of registration.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram showing a device control system 10 according to the first embodiment of the present invention. The device control system 10 can be used to control various devices, for example, a video device such as a television and a video, a computer, an entertainment device, and the like. In addition, the present invention can be used for systems and devices in general, and in particular, for systems and devices that are used in front of a person and face to face in a certain direction (for example, a screen).
The device control system 10 includes an image input unit 20, a face detection unit 30, a power control unit 40, a power supply unit 50, and a device main body 60.

The image input unit 20 is, for example, a CCD or a television camera, and inputs an image in the vicinity of the device control system 10 (particularly, within a range where a user who uses the device is normally present (within a user presence range)). For example, when the device main body 60 is a personal computer (PC), the image input unit 20 (camera etc.) is installed in a place where it can be easily attached such as the upper side of the screen so that the user's face can be detected within the field of view. .
The image input by the image input unit 20 is repeated continuously or intermittently.

  The face detection unit 30 detects whether an image (face image) corresponding to a human face is included in the image input by the image input unit 20. This detection is performed, for example, by extracting a contour in the image by image processing such as binarization processing, and elements (for example, the entire face, eyes, nose, mouth, etc.) constituting the human face in the extracted contour. This can be done depending on whether it exists. Elements constituting a human face can be registered as an image, for example, and it can be determined whether or not an element constituting the human face exists in the input image based on the degree of coincidence with the element.

  The power control unit 40 controls the supply of power from the power supply unit 50 to the device main body 60 according to the determination result by the face detection unit 30. For example, when a state in which the face is not present in the input image by the face detection unit 30 has elapsed for a predetermined period, the power supply from the power supply unit 50 is limited as “no user” (power saving mode). When the face detection unit 30 determines that a face is present in the input image, the restriction on power supply from the power supply unit 50 is canceled as “user presence” (normal mode). Thus, the power control unit 40 has a plurality of control modes.

The power supply unit 50 is a so-called power source that supplies power to the device main body 60, and has a plurality of operation modes corresponding to the control mode of the power control unit 40. For example, there are a power saving mode in which power supply to the device main body 60 is restricted and a normal mode in which power supply to the device main body 60 is not restricted.
This power supply limitation can be performed by directly limiting the power supply itself. It is also possible to divide the device main body 60 into several sections and stop the supply of power to each section individually. Depending on the importance of each section, power can be supplied and stopped individually.
However, if the power consumption of the entire device main body 60 is reduced, the power saving mode can be set.
In addition to these two operation modes, there may be other modes having different power consumption.

  The device main body 60 may be anything that operates by receiving power supplied from the power supply unit 50. Various devices such as video devices such as televisions and videos, computers, and entertainment devices can be used as the device main body 60.

(Operation of device control system 10)
FIG. 2 is a flowchart showing an operation procedure of the device control system 10. Hereinafter, the operation procedure of the device control system 10 will be described with reference to FIG.
(1) The operation of the device control system 10 is started (step S11). This operation is started, for example, when the user turns on the power of the device control system 10.
After the operation starts, the device control system 10 enters the normal mode (step S12). The transition to the normal mode may be performed automatically or may be performed by an operation by the user (for example, log-in to the computer).

(2) Image input by the image input unit 20 is repeated (for example, at regular intervals) (step S13), and the face detection unit 30 determines whether a human face exists in the input image. (Step S14).
That is, face detection processing is performed. For example, while the user is in front of the computer, a face is detected and determined as “user present”. Further, when the user leaves the seat, no face is detected and it is determined that the user is absent.
Even when there are a plurality of users, it can be determined that the user is absent because the face is not detected from the input image. In this case, as the user leaves the seat, the number of faces detected in the image (for example, within the camera field of view) decreases, and the face is not detected when the last person leaves the seat. At this time, the face detection unit 30 can detect and include the number of faces and perform processing according to the number of faces. However, “user absent” can be determined without detecting the number.

(3) When a human face is present in the input image, the normal mode is continued (step S17).
If no human face is present in the input image, it is determined whether or not the face has not been detected for a predetermined time (step S15). If this determination is "Yes", the power saving mode is entered. Transition is made (step S16). This mode transition can be performed by sending mode switching command information for instructing the power control unit 40 to switch to the power saving mode from the face detection unit 30.
Note that the shift to the power saving mode is not performed by recognizing that a person is absent for a certain period of time, but may be performed immediately after recognizing the absence of a person.
(4) Even during the power saving mode, the presence of the face is repeatedly determined by the face detection unit 30, and when the human face is detected again, the power saving mode is canceled (step S17).
This mode transition can be performed by sending mode switching command information for instructing the power control unit 40 to switch to the normal mode from the face detection unit 30.

  As described above, the device control system 10 according to the present embodiment automatically recognizes the presence / absence of the user within the field of view of the image input unit using the face detection technology, and changes to the normal mode according to the recognition result. The power saving mode can be switched. Moreover, even if there are a plurality of users, if the user becomes unattended, it is possible to shift to the power saving mode.

(Second Embodiment)
FIG. 3 is a block diagram showing the device control system 110 according to the first embodiment of the present invention. The device control system 110 can be used to control various devices, for example, a video device such as a television and a video, a computer, an entertainment device, and the like. In addition, the present invention can be used for systems and devices in general, and in particular, for systems and devices that are used in front of a person and face to face in a certain direction (for example, a screen).

  The device control system 110 includes an image input unit 20, a face detection unit 30, a face feature extraction unit 71, a face registration unit 72, a face collation unit 73, a face data storage unit 74, a power control unit 40, a power supply unit 50, and a device main body. 60.

The face feature extraction unit 71 extracts data representing facial features (for example, the shape of the face outline, eyes, nose, ears, etc.) from the face image included in the input image. The feature data may be extracted by digitizing the facial features, or the feature portion may be extracted as an image. That is, the feature data may be either image data or quantity data.
The face registration unit 72 stores the face feature data extracted by the face feature extraction unit 71 in the face data storage unit 74.
The face collation unit 73 collates the feature data extracted by the face feature extraction unit 71 with the feature data stored in the face data storage unit 74, and determines whether these correspond. For example, the similarity between the two feature data is quantified, and whether or not a response is made is determined by whether or not the quantity exceeds a predetermined value.
The face data storage unit 74 includes a storage device such as a computer memory or a hard disk, and stores feature data of a plurality of registered human faces.
The image input unit 20, the face detection unit 30, the power control unit 40, the power supply unit 50, and the device main body 60 are not essentially different from those in the first embodiment, and thus the description thereof is omitted.

(Operation of device control system 10)
FIG. 4 is a flowchart showing an operation procedure of the device control system 110. Hereinafter, the operation procedure of the device control system 110 will be described with reference to FIG.
(1) The operation of the device control system 110 is started (step S21). This operation is started, for example, when the user turns on the power of the device control system 110.
After the operation starts, the device control system 110 enters the normal mode (step S22). The transition to the normal mode may be performed automatically or may be performed by an operation by the user (for example, log-in to the computer).

(2) Image input by the image input unit 20 is repeatedly performed (for example, at regular intervals) (step S23), and the face detection unit 30 determines whether a human face exists in the input image. (Step S24).
That is, face detection processing is performed. For example, while the user is in front of the computer, a face is detected and determined as “user present”. Further, when the user leaves the seat, no face is detected and it is determined that the user is absent.
Even when there are a plurality of users, it can be determined that the user is absent because the face is not detected from the input image. In this case, as the user leaves the seat, the number of faces detected in the image (for example, within the camera field of view) decreases, and the face is not detected when the last person leaves the seat. At this time, the face detection unit 30 can detect and include the number of faces and perform processing according to the number of faces. However, “user absent” can be determined without detecting the number.

(3) When a human face exists in the input image, the face feature extraction unit 71 performs feature extraction from the face image (step S25).
The face collation unit 73 determines whether or not the face image from which the feature has been extracted corresponds to the face stored in the face data storage unit 74 (step S26). When this determination is Yes, the face image from which the feature has been extracted is stored in the face data storage unit 74, and when this determination is No, the process returns to step S23 to input the image. Feature information is extracted from the detected face image and stored as registration data. That is, the user's face is registered when the device control system 110 is in the normal mode.
Here, a plurality of faces can be registered. At this time, an identification number for identifying each face data is added to the registration data. This is convenient when the device main body 60 assumes a plurality of users such as servers.

(4) When it is determined in step S24 that no human face exists in the input image, it is determined whether or not a face has not been detected for a predetermined time (step S31). "", The mode is shifted to the power saving mode (step S32). This mode transition can be performed by sending mode switching command information for instructing the power control unit 40 to switch to the power saving mode from the face detection unit 30.
Note that the shift to the power saving mode is not performed by recognizing that a person is absent for a certain period of time, but may be performed immediately after recognizing the absence of a person.

(5) The image input unit 20 repeatedly inputs an image even during the power saving mode (step S33), and the face detection unit 30 determines whether or not a human face exists in the input image (step S34). ).
When a human face exists in the input image, the face feature extraction unit 71 performs feature extraction from the image (step S35), and the extracted face feature is added to the face stored in the face data storage unit 74. It is judged by the face collation part 73 whether it respond | corresponds (step S36).
When this determination is “Yes”, the power saving mode is canceled (step S37), and when this determination is “No”, the process returns to step S33 to input an image. This mode can be canceled by sending mode switching command information for instructing the power control unit 40 to switch to the normal mode from the face detection unit 30.

The cancellation of the power saving mode in step S36 can be performed by the detected face corresponding to one of the registered faces, but some priority may be given to the registered faces. As the priority, the order of leaving can be given. For example, a user who has just left his / her seat is distinguished from other users, and if the user has just left his / her seat, the user is returned to the current screen. Can be displayed.
For this purpose, the latest detection information indicating the latest detection may be stored in the face data storage unit 74 in association with the facial feature data. For example, the latest detection information is updated when returning from step S26 to step S23.

As described above, in the device control system 110 according to the present embodiment, in addition to the face detection technique, the face matching technique is used to automatically recognize and use the presence / absence of the user within the field of view of the image input unit. The normal mode and the power saving mode can be switched according to the presence or absence of a person.
Security can be improved by registering the feature data of the user's face and switching from the power saving mode to the normal mode when the registered face is detected.
Moreover, even if there are a plurality of users, if the user becomes unattended, it is possible to shift to the power saving mode.

(Other embodiments)
Embodiments of the present invention are not limited to the above-described embodiments, and can be expanded and modified. The expanded and modified embodiments are also included in the technical scope of the present invention.
The device is not limited to a video system and a computer, and may be any device that has a plurality of operating states that use different power.
Registration of a face in the face data storage unit can be performed separately from use of the device. The registration data stored in the face data storage unit may be deleted when the device control system is powered off, but may be stored as it is and used when the power is turned on next time.

It is a block diagram showing the equipment control system concerning a 1st embodiment of the present invention. It is a flowchart showing an example of the operation | movement procedure of the apparatus control system which concerns on 1st Embodiment of this invention. It is a block diagram showing the apparatus control system which concerns on 2nd Embodiment of this invention. It is a flowchart showing an example of the operation | movement procedure of the apparatus control system which concerns on 2nd Embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Device control system, 20 ... Image input part, 30 ... Face detection part, 40 ... Power control part, 50 ... Electric power supply part, 60 ... Equipment main body

Claims (8)

An image input unit for inputting an image;
A face detection unit that detects whether a human face is included in the image input by the image input unit;
A power supply control unit that controls supply of power to the device based on a detection result by the face detection unit;
A device control system comprising: A face registration unit for registering a face;
A correspondence determination unit that determines whether or not the face detected by the face detection unit corresponds to the face registered by the face registration unit;
The device control system according to claim 1, wherein the power supply control unit controls supply of power to the device based on a determination result by the correspondence determination unit. The power supply control unit can switch between a first control state in which power is supplied to the device and a second control state in which power is supplied to the device that is smaller than the power in the first control state. is there,
The apparatus control system according to claim 1. A face registration unit for registering a face detected by the face detection unit when the power supply control unit is in the first control state;
The apparatus control system according to claim 3, further comprising: When the face is not detected by the face detection unit, the power supply control unit switches to the second control state.
The device control system according to claim 3. When the state in which the face is not detected by the face detection unit continues for a predetermined time, the power supply control unit switches to the second control state;
The apparatus control system according to claim 5, wherein When the face detected by the face detection unit corresponds to the face registered by the face registration unit, the power supply control unit switches to the first control state;
The device control system according to claim 3. An image input step for inputting an image;
A face detection step for detecting whether or not a human face is included in the image input in the image input step;
A power supply control step for controlling power supply to the device based on the detection result in the face detection step;
The apparatus control method characterized by comprising.

Images