JP2011048179A - Display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display device for performing ON/OFF control of a display screen that does not give an operator uncomfortable feeling. <P>SOLUTION: The display device includes a photographing means for photographing the operator, a sight line detection part for detecting the sight line direction of the operator based on an image photographed by the photographing means, a display control part for controlling the ON/OFF of the display screen, and a backlight control part for controlling the ON/OFF of a backlight. When the sight line detection part determines that the operator faces the display screen, the display control part puts the display screen into the ON state, and the backlight control part puts the backlight into the ON state. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a display device that automatically performs ON / OFF control of a display screen.

  In recent years, an image forming apparatus such as a copying machine has a display screen using a touch panel that receives an operation input from an operator. However, the operator does not always work while watching this display screen. In particular, in a copying machine or the like, the display screen is required only when the print setting is made, so that the operator does not need the display screen for most of the time during the work. In view of power saving and the like, the display screen may be displayed only when the operator needs it.

  Therefore, in Patent Document 1, by analyzing the operator's line of sight using a camera, it is determined whether the operator is looking at the display screen, and the brightness of the display screen is determined according to whether the operator is looking at the display screen. A method of increasing or decreasing is disclosed.

  However, the method disclosed in Patent Document 1 controls the brightness of the display screen when the operator's line of sight remains at the target position for a longer time than the predetermined time. When this method is applied and ON / OFF control of the display screen is performed, the display state is turned on after a while after the operator looks at the screen. In this case, there is a time difference from when the operator sees the screen until the display is turned on, and the operator feels uncomfortable.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a display device that performs ON / OFF control of a display screen that does not make the operator feel uncomfortable.

  In order to solve the above problems, a display device according to the present invention includes an imaging unit that images an operator, a line-of-sight detection unit that detects the line-of-sight direction of the operator based on an image captured by the imaging unit, and a display screen. A display control unit that performs ON / OFF control and a backlight control unit that performs backlight ON / OFF control, and the line-of-sight detection unit has the operator facing the display screen. The display control unit turns on the display screen and the backlight control unit turns on the backlight.

  According to the present invention, it is possible to perform ON / OFF control of a display screen that does not give the operator a sense of incongruity.

It is a figure which shows the structure of the display apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of the display apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of the display apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of the display apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of the display apparatus which concerns on embodiment of this invention.

  Next, embodiments for carrying out the invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing a configuration of a display device according to an embodiment of the present invention. The digital camera 1, the timing control unit 2, the image processing unit 3, the line-of-sight detection unit 4, the display control unit 5, the display unit 6, the backlight control unit 7, and the backlight unit 8 are configured.

  The digital camera 1 is photographing means for photographing the periphery of the display screen of the display unit 6. For example, the digital camera 1 is preferably configured to mainly photograph the front surface. The timing control unit 2 controls the digital camera 1 so that the digital camera 1 captures images at predetermined time intervals by a timer interrupt or the like. The predetermined time interval is preferably about 200 ms. This 200 ms is a time interval sufficiently fast with respect to the human operating speed.

  The image processing unit 3 processes an image photographed by the digital camera 1 and converts the photographed operator's characteristics into image data that can be easily extracted. For example, the contrast may be enhanced so that the face and the hair portion can be easily distinguished.

  The line-of-sight detection unit 4 detects which direction the operator is facing the digital camera 1 based on the image data converted by the image processing unit 3. For example, a known pattern recognition technique is applied to extract main parts such as the mouth, nose, and eyes, and the face orientation is determined from the positional relationship of these main parts. In this way, the rough posture (face orientation) of the operator is determined. For example, if both eyes of the operator can be detected, it is determined that the operator is facing the display screen. When it is determined that the operator is facing the display screen, a signal for turning on the display is sent to the display control unit 5 and the backlight control unit 7.

  When receiving a display ON signal from the line-of-sight detection unit 4, the display control unit 5 turns on the display screen of the display unit 6. Similarly, when the backlight control unit 7 receives a display ON signal from the line-of-sight detection unit 4, the backlight control unit 7 turns on the backlight unit 8.

  By doing in this way, a display will be in an ON state only for the required time zone, and there exists an energy saving effect. Moreover, since the operator does not control the display to be turned on after viewing the operation screen, the operator feels uncomfortable, such as flicker due to a difference between the timing when the screen is turned on by the on / off control of the screen and the timing when the operator views the screen. Can be eliminated.

  After the operator's line of sight is off the screen, the display unit 6 and the backlight unit 8 may be turned off after a certain time has elapsed. By doing so, it is possible to eliminate an uncomfortable feeling of the operator such as flicker due to a difference between the ON / OFF control of the screen and the timing when the operator views the screen.

  The determination that the operator's line of sight has deviated from the screen may be performed by the line-of-sight detection unit 4. For example, the line-of-sight detection unit 4 may determine that the operator's line of sight has deviated from the screen when both eyes of the operator cannot be detected. Then, after making this determination, a signal for turning off the display may be sent to the display control unit 5 and the backlight control unit 7 after a certain time has elapsed.

  FIG. 2 is a diagram showing the configuration of the display device according to the embodiment of the present invention. The configuration in FIG. 2 is obtained by changing the line-of-sight detection unit 4 in the configuration in FIG. 1 to a line-of-sight trend prediction unit 21.

  The line-of-sight trend prediction unit 21 uses the image data converted by the image processing unit 3 to determine that the line of sight of the operator is facing the screen direction. For example, as in the case of the line-of-sight detection unit 4, after the operator's eyes are not looking at the screen at all, after determining the operator's rough posture (face orientation), the operator's eyes can be detected. The distance between the detected eyes is detected. When the distance between the eyes gradually increases, it is determined that the operator's line of sight is facing the screen direction. By doing so, it is possible to predict the situation in which the operator wants to see the screen. When it is determined that the operator is turning the display screen, a signal for turning on the display is sent to the display control unit 5 and the backlight control unit 7.

  Even in this configuration, the display is turned on only during a necessary time period, and there is an energy saving effect, and it is possible to eliminate an uncomfortable feeling of the operator such as flicker due to a difference between the timing when the operator turns on and the timing when the operator views the screen.

  FIG. 3 is a diagram showing a configuration of the display device according to the embodiment of the present invention. 3 includes a plurality of (N) digital cameras 11, 12,..., 1N, and a plurality of image processing units 3 in the configuration of FIG. N) image processing units 31, 32,..., 3N.

  In this configuration, the timing control unit 2 controls the plurality of digital cameras 11, 12,..., 1N so as to capture images at a predetermined time interval by a timer interrupt or the like. The image processing units 31, 32,..., 3N process the images captured by the corresponding digital cameras 11, 12,..., 1N, respectively, and convert the captured operator characteristics into image data that can be easily extracted. . There may be only one image processing unit instead of a plurality, and processing of images taken by all the digital cameras 11, 12,..., 1N may be performed by this one image processing unit.

  Thus, by using a plurality of digital cameras, it is possible to reliably detect the orientation of the head for every posture of the operator. The plurality of digital cameras are arranged at positions where images that complement each other's blind spots can be taken. With this configuration, the operator's line of sight can be detected more reliably. Therefore, it is possible to further eliminate the operator's uncomfortable feeling such as flicker due to a difference between the timing when the operator turns on and the timing when the operator views the screen.

  Further, by using a plurality of digital cameras, it is possible to detect that the orientation of the operator's head is completely off the screen. Therefore, if control is performed so that the operator's head is completely off the operation screen and then shifts to the OFF state after a certain period of time, flickering due to a shift in the timing when the operator looks at the screen, etc. This makes it possible to eliminate the uncomfortable feeling of the operator.

  FIG. 4 is a diagram showing the configuration of the display device according to the embodiment of the present invention. The configuration of FIG. 4 is obtained by changing the line-of-sight detection unit 4 of the configuration of FIG.

  The posture trend prediction unit 41 analyzes the operation and posture of the operator using the image data converted by the image processing unit 3, and determines that the operator's line of sight is directed in the screen direction. The posture trend prediction unit 41 predicts that the operator will see the screen in the future not only from the operator's head but also from operations such as “stand up” and “walk”. When it is determined that the operator is turning the display screen, a signal for turning on the display is sent to the display control unit 5 and the backlight control unit 7.

  In this way, not only the orientation of the operator's head but also the posture trend prediction unit 41 predicts that the operator will see the screen in the future from operations such as “rise” and “walk”, and the backlight and Since the control of the display unit is turned on, it is possible to further eliminate the operator's uncomfortable feeling such as flicker due to a difference between the ON control timing by the screen ON / OFF control and the timing at which the operator views the screen.

  FIG. 5 is a diagram showing the configuration of the display device according to the embodiment of the present invention. The configuration of FIG. 5 is obtained by adding an image registration processing unit 51 and a verification processing unit 52 to the configuration of FIG.

  In the image registration processing unit 51, an image obtained by photographing the face and body features with the digital camera 1 is registered in advance by the operator.

  The collation processing unit 52 is an image registered by the image registration processing unit 51 in which the operator's image captured in the image data captured by the digital camera 1 controlled by the timing control unit 2 and converted by the image processing unit 3 is registered. The operator is determined to be a registered operator.

  As in the configuration of FIG. 1, the line-of-sight detection unit 4 determines that the operator is facing the display screen. In this configuration, the operator is facing the display screen. Only when the collation processor 52 determines that the operator is a registered operator, a signal for turning on the display is sent to the display controller 5 and the backlight controller 7.

  By doing so, it is possible to turn on the backlight and the display unit only when a specific operator wants to see the operation screen. Therefore, security can be ensured.

  In addition, when the collation processing unit 52 determines that the operator image shown in the image data is a registered operator, the display control unit 5 and the backlight control unit 7 regardless of the orientation of the operator. A signal for turning on the display may be sent to the terminal.

  In this way, since the backlight and the display unit can be turned on only when a specific operator is in a place where the screen can be seen, security can be ensured and the screen can be turned on / off. It is possible to eliminate an uncomfortable feeling of the operator such as flicker due to a difference between the timing of the ON control by the OFF control and the timing when the operator views the screen.

  The present invention has been described above by the preferred embodiments of the present invention. While the invention has been described with reference to specific embodiments thereof, various modifications and changes can be made to these embodiments without departing from the broader spirit and scope of the invention as defined in the claims. is there.

  The display device according to the present invention further includes an image processing unit that converts an image captured by the imaging unit into image data from which the features of the operator can be easily extracted, and the line-of-sight detection unit is configured by the image processing unit. The operator's line-of-sight direction may be detected based on the converted image data.

  In addition, the display device according to the present invention may include a timing control unit that performs control so that photographing by the photographing unit is performed at predetermined time intervals.

  Further, the display device according to the present invention has a line-of-sight trend prediction unit that analyzes the distance between the eyes of the operator based on the image data converted by the image processing unit and predicts the direction of movement of the line of sight of the operator, The line-of-sight trend prediction unit turns on the display screen by the display control unit and turns on the backlight by the backlight control unit when it is determined that the operator is turning the display screen. You may make it do.

  In addition, the display device according to the present invention includes a posture trend prediction unit that predicts a moving direction of the line of sight of the operator by analyzing the operation and posture of the operator based on the image data converted by the image processing unit. The attitude trend prediction unit turns on the display screen by the display control unit and turns on the backlight by the backlight control unit when it is determined that the operator is turning the display screen. You may make it be in a state.

  Further, in the display device according to the present invention, there are a plurality of the photographing units, the plurality of image processing units, and each of the plurality of image processing units captures images captured by the plurality of photographing units. The operator's characteristics may be converted into image data that can be easily extracted, and the line-of-sight detection unit may detect the line-of-sight direction of the operator based on the image data converted by the plurality of image processing units.

  Further, the display device according to the present invention includes an image registration processing unit that registers an operator's image in advance, and a verification processing unit that collates whether the operator's image captured by the imaging unit is registered in the image registration processing unit, The line-of-sight detection unit determines that the operator is registered in the image registration processing unit by the collation processing unit, and determines that the operator is facing the display screen. Only in some cases, the display screen may be turned on by the display control unit, and the backlight may be turned on by the backlight control unit.

  Further, in the display device according to the present invention, the line-of-sight detection unit determines that the operator is registered in the image registration processing unit by the collation processing unit, and the operator can see the display screen. Only when it is determined that the display is on, the display control unit may turn on the display screen, and the backlight control unit may turn on the backlight.

  In the display device according to the present invention, the line-of-sight detection unit may cause the display control unit to display the display screen after a predetermined time has elapsed after determining that the operator is not facing the display screen. The backlight may be turned off by the backlight control unit.

DESCRIPTION OF SYMBOLS 1 Digital camera 2 Timing control part 3 Image processing part 4 Eye-gaze detection part 5 Display control part 6 Display part 7 Backlight control part 8 Backlight part 11 Digital camera 12 Digital camera 1N Digital camera 21 Eye-gaze trend part 31 Image processing part 32 Image Processing unit 3N Image processing unit 41 Attitude trend unit 51 Image registration processing unit 52 Collation processing unit

JP 2006-219000 A

Claims (9)

Photographing means for photographing the operator;
A line-of-sight detection unit that detects the line-of-sight direction of the operator based on the image photographed by the photographing unit;
A display control unit for controlling ON / OFF of the display screen;
A backlight control unit that performs ON / OFF control of the backlight, and
The line-of-sight detection unit turns on the display screen by the display control unit and turns on the backlight by the backlight control unit when the operator determines that the operator is facing the display screen. A display device characterized by that. An image processing unit that converts an image photographed by the photographing means into image data from which the characteristics of the operator can be easily extracted;
The display device according to claim 1, wherein the line-of-sight detection unit detects the line-of-sight direction of the operator based on the image data converted by the image processing unit.   The display device according to claim 1, further comprising a timing control unit that performs control so that photographing by the photographing unit is performed at predetermined time intervals. Based on the image data converted by the image processing unit, analyzing the interval between the eyes of the operator, and having a line-of-sight trend prediction unit that predicts the direction of movement of the line of sight of the operator,
The line-of-sight trend prediction unit turns on the display screen by the display control unit and turns on the backlight by the backlight control unit when it is determined that the operator is turning the display screen. The display device according to claim 2, wherein the display device is a display device. Based on the image data converted by the image processing unit, by analyzing the operation and posture of the operator, it has a posture trend prediction unit that predicts the direction of movement of the line of sight of the operator,
The posture trend prediction unit turns on the display screen by the display control unit and turns on the backlight by the backlight control unit when the operator judges that the direction of the display screen is being turned. The display device according to claim 2, wherein the display device is a display device. There are a plurality of the photographing means,
The image processing unit is plural,
Each of the plurality of image processing units converts the image captured by each of the plurality of imaging units into image data from which the features of the operator can be easily extracted,
The display device according to claim 1, wherein the line-of-sight detection unit detects the line-of-sight direction of the operator based on the image data converted by the plurality of image processing units. . An image registration processing unit for registering an operator image in advance;
A collation processing unit that collates whether or not an image of an operator photographed by the photographing unit is registered in the image registration processing unit,
The line-of-sight detection unit is determined only when the collation processing unit determines that the operator is registered in the image registration processing unit and the operator determines that the display screen is facing the direction. 4. The display device according to claim 1, wherein the display screen is turned on by the display control unit, and the backlight is turned on by the backlight control unit. 5.   The line-of-sight detection unit is determined only when the collation processing unit determines that the operator is registered in the image registration processing unit and the operator is in a place where the display screen can be seen. The display device according to claim 7, wherein the display screen is turned on by the display control unit, and the backlight is turned on by the backlight control unit.   The line-of-sight detection unit turns off the display screen by the display control unit after a predetermined time has elapsed after determining that the operator is not facing the display screen, and the backlight control unit The display device according to claim 1, wherein the backlight is turned off by the operation.

Images