JP3431806B2 - Automatic display adjustment device for display device - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an automatic adjustment device for display density and brightness of a display device in information terminal equipment such as a personal computer and a word processor.

[0002]

2. Description of the Related Art In a display device of an information terminal device such as a personal computer or a word processor, a user who views the display device manually adjusts the display density and the brightness so that the user can easily see the display device.

The following proposals have been made for means for automatically adjusting the brightness and density of a display device. Japanese Patent Laid-Open No. 5-807
In Japanese Patent Laid-Open No. 35-35, the light detection means detects the ambient brightness, the density detection means detects the display density of the display device, and the control means controls the brightness and the density of the display device based on this value.

However, in this conventional technique, although the automatic display adjustment corresponding to the ambient brightness is performed, the user who sees the display screen cannot adjust the optimum display according to the angle at which the display screen is seen, and the user cannot see the display screen. It is not possible to automatically adjust to the optimal display state according to the difference in the angle at which the user views the display screen, such as when the posture of viewing the screen is changed or when the user who views the display screen changes. .

Further, in JP-A-8-320677,
In an electronic device equipped with a display device and an imaging device such as a CCD, the relative positional relationship between the display device and the user is checked, the position and orientation of the display device are controlled, and the user who is imaged is recognized. Then, attributes such as brightness, contrast, hue, and volume are automatically set to the user's preferred state.However, this conventional technique requires a control device for controlling the position and orientation of the display device. In addition, the user needs to set attributes such as brightness, contrast, hue, and volume in advance, and only the person who has completed this setting will be limited by the adjusting mechanism, which limits the user.

[0006]

SUMMARY OF THE INVENTION The present invention is to solve the above-mentioned problems, and when the user changes the posture of looking at the display screen, when the user looking at the display screen changes, etc. In addition, by enabling the user to automatically adjust to the optimal display state according to the difference in the viewing angle of the display screen, it is possible to always maintain the optimal display state without limiting the user It is an object of the present invention to provide an automatic display adjustment device for a display device.

Particularly in a display device such as a liquid crystal display, the display density and brightness must be adjusted each time the visible range (directivity) is narrow and the position at which the display screen is viewed is changed. When looking at the device, not only the visibility is deteriorated, but also the eyes of the user are tired.

In order to solve the above problems, it is desired that power consumption and processing capability are not impaired particularly in equipment mainly driven by a battery such as a small portable terminal.

[0009]

Automatic display adjustment device for a display device according to claim 1, wherein Means for Solving the Problems] is a display device of an information terminal device for displaying various data such as symbols and figures, such as a CCD camera from the display device side Output means for photographing the user by the digital image processing means and outputting the image data and the measured distance data between the user and the CCD camera, and the angle at which the user views the display screen based on the image data and the measured distance data. Automatic display adjustment that calculates and determines the set values of the display density and display brightness from a table in which the display density and display brightness corresponding to the angle and direction in which the user views the display screen are registered in advance according to the calculated value. It is an automatic display adjusting device for a display device, which is provided with means.

According to another aspect of the present invention, there is provided an automatic display adjusting device for a display device, wherein the automatic display adjusting means sets an optimum visible range for viewing the display screen, and an angle and a direction in which the user looks at the display screen are set. It is characterized by notifying the user through a display device or the like when it is out of the visible range.

According to another aspect of the present invention, there is provided an automatic display adjustment device for a display device, wherein the automatic display adjustment means sets a table in which display densities and display luminosities used for automatic display adjustment are registered within a normally used range. It is characterized in that the set value of is set more finely.

According to another aspect of the present invention, in the automatic display adjusting device for a display device, the automatic display adjusting means normally stops the automatic display adjusting function by operating the automatic display adjusting means at regular intervals. And

According to a fifth aspect of the present invention, in the automatic display adjusting device for a display device, the automatic display adjusting means normally stops the automatic display adjusting function by operating the automatic display adjusting means only when an application is started. And

According to another aspect of the present invention, there is provided an automatic display adjusting device for a display device, wherein the automatic display adjusting means detects a vibration of the display device and a device including the display device when the display device is moved and outputs data. It is characterized in that processing for operating the automatic display adjusting means is performed.

According to another aspect of the present invention, there is provided an automatic display adjustment device for a display device, wherein the automatic display adjustment means mounts a digital image processing means such as a CCD camera used for the automatic display adjustment in a central portion of the display device. Characterize.

According to the automatic display adjustment device of the display device of claim 1, the optimum display density and brightness adjustment values corresponding to the angle and direction of the eyes of the user who views the display screen are set in advance in a table. , It is possible to perform automatic display adjustment of display density and brightness to set values according to the angle at which the user views the display screen.

According to the automatic display adjusting device of the display device of the second aspect, when the angle and direction in which the user sees the display screen is out of the adjustment range, the means for making an announcement to the user through the display device, It is possible to always view in the optimal display state.

According to the automatic display adjustment device of the display device of claim 3, when the automatic display adjustment is performed, the display state within the angle at which the user generally looks at the display screen is finely adjusted. As a result, it becomes possible to perform optimum display settings according to the angle at which the user views the display screen.

According to the automatic display adjustment device of the display device of the fourth aspect, the automatic display adjustment is activated at regular intervals and normally stopped so that the automatic display adjustment is always activated. It is possible to reduce the power consumption and increase the capacity of the arithmetic processing function.

According to the automatic display adjusting device of the display device of claim 5, the automatic display adjusting means is operated only when the application is started, and normally the automatic display adjusting function is stopped. It is possible to reduce the power consumption and increase the capability of the arithmetic processing function as compared with the case where the automatic display adjustment is always activated.

According to another aspect of the present invention, there is provided an automatic display adjusting device for a display device, which detects vibrations of a display device and equipment including the display device when the device is moved, and operates the automatic display adjusting device. Normally, the automatic display adjusting means is stopped, and the automatic display adjusting device can be operated only when the device is moved. Further, normally, by stopping the automatic display adjustment means, it becomes possible to reduce the power consumption and increase the capability of the arithmetic processing function as compared with the case where the automatic display adjustment is always operated.

According to the automatic display adjustment device for a display device of claim 7, in the automatic display adjustment means, the angle calculation process for the user to see the display screen is simplified,
It is possible to reduce the power consumption and increase the capability of the arithmetic processing function as compared with the case where the automatic display adjustment is always activated.

[0023]

BEST MODE FOR CARRYING OUT THE INVENTION An automatic display adjusting device for a display device of an information terminal device according to an embodiment of the present invention will be described below with reference to FIG.
4 to FIG. 4 will be described.

(First Embodiment) FIG. 1 is an external view of an information terminal device equipped with an automatic display adjustment device for a display device according to an embodiment of the present invention. In FIG. 1, reference numeral 1 denotes an information terminal device, which is an information terminal device including a display device such as a personal computer or a word processor. An embodiment of the present invention will be described by taking a notebook type personal computer as an example.

In FIG. 1, 2 is a CCD camera,
This is a means for photographing the user from the display device side, converting the image data and the measured distance data between the user and the CCD camera into digital data and outputting it. The measuring distance means between the user and the CCD camera is a technique already used in an autofocus camera or the like. In FIG. 1, a display device 3 is a device for displaying various data such as symbols and figures in various information terminal devices.

FIG. 2 is a block diagram of a control circuit of the information terminal equipment according to the embodiment of the present invention. As mentioned above,
2 is a CCD camera, 3 is a display device, and 4 is a display control circuit. Reference numeral 4 controls the display drive voltage based on the display control signal output from the CPU 5 to control the display device.

Reference numeral 5 denotes a CPU, which calculates the angle and direction of the eyes of the user who looks at the display screen by performing image processing, and the display density / prestored in the memory 6 in advance.
A setting in which the display density and brightness setting values corresponding to the angle and direction of the eyes of the user looking at the display screen are searched from the brightness setting table, the display setting values are confirmed, and the display setting data stored in the memory 6 is confirmed. Update the value. The CPU 6 also generates a digital signal representing the determined display density and brightness setting value, and outputs the digital signal to the display control circuit 4.

Reference numeral 6 denotes a memory, which stores in advance the display density corresponding to the angle and direction of the eyes of the user who looks at the display screen, and a table in which the brightness is set and the density and brightness setting data of the display device.

Reference numeral 7 is a vibration detecting means, which uses a piezoelectric element which generates a voltage when a force is applied as a conventional technique, and detects the voltage generated by the piezoelectric element by vibrating the piezoelectric element. This is a means for detecting vibration.

FIG. 3 is an operation flowchart of the automatic display adjusting device for a display device according to the embodiment of the present invention.

Step B-1: Power-on When a terminal device such as a personal computer or a word processor equipped with a display device is turned on, the display device automatic adjustment subroutine is automatically called.

The display device automatic adjustment subroutine is as follows.

Step B-2: CCD camera photographing The CCD camera 2 photographs the user, and the image data and focal length data thereof are transmitted to the CPU 5.

Step B-3: Angle / direction calculation of eyeball The CPU 5 calculates the angle and direction of the eye of the user who looks at the display screen by image processing. For this purpose, the range of the distance between the information terminal device and the user when the user operates the terminal device is set, and it is determined whether or not the focal length falls within this range. Details of step B-3 will be described later.

Step B-4: In the display setting data calculation CPU 5, the display density stored in the memory 6 corresponding to the angle and direction value of the eyes of the user who looks at the display screen in advance, and the brightness setting table are set. The value calculated in the eyeball angle / direction calculation step B-3 is searched from the inside.

B-5 step: Confirmation of display setting data In accordance with step B-4 of the display setting data calculation value step, the display density and the luminance setting value are confirmed.

Step B-6: Display setting value update At step B-5 of the display setting data confirmation data, the display setting value stored in the memory 6 is updated.

Step B-7: Display drive signal output The CPU 5 generates a digital signal representing the determined display density and brightness setting value and outputs it to the display control circuit 4.
The display control circuit 4 controls the display drive voltage by the digital signal and controls the display density and brightness.

FIG. 4 shows an example of a table which is stored in the memory 6 in advance and which shows the display density and the brightness setting value corresponding to the angle and direction values of the eyes of the user who looks at the display screen. When the display setting value is out of the range in the display setting table, the B-6 step of the display setting value is processed as the standard value. The angular pitch is finer around.

As to the details of step B-3, as described above, the CPU 5 performs image processing to calculate the angle and direction of the eyes of the user who looks at the display screen. In addition to determining the range of the distance between the information terminal device and the user when operating the, and determining whether the focal length is within this range, the focus position is not limited to the center of the screen but to the left and right. Also set up and down. In FIG. 6, a total of 9 points are set in the center, left and right and up and down.
If the focal length does not fall within the above range at the center, the focus position is moved to the left, right, top and bottom positions. If it does not fit, do not adjust automatically. This is the standard value.

If it falls within this range, it is determined that the user exists, and the face area is extracted from the image of the user and the eye portion is extracted. If the face area cannot be extracted, and if the eye area cannot be extracted even if the face area can be extracted, automatic adjustment is not performed.
Set to standard value.

8 to 11 are examples of user images. Regarding the extraction of the face area, Katsuhiro Matsuno and Saburo Tsuji, "Searching for Face Area from Arbitrary Background and Recognizing Facial Expressions" are known documents
(IEICE Technical Report, IE94-38
P. 17-22 (1994-07), a method of extracting a human face area from an image with an arbitrary background is shown.

According to this technique, in order to realize automatic facial expression recognition, a face consisting of three layers is searched and positioned by using the potential field (visual guidance field), the subspace, and the edge addition projection of the slit. . Put the initial net in the potential field created from the face image, deform the net,
A face candidate is selected using the modified feature. Next, the selected face candidate is mapped to the subspace constituted by the orthonormal basis net obtained by expanding the net sample set KL representing the face, and the true face is determined. Finally, the edge-added projection of the slit is used to determine the exact position and size of the face.

Further, as a method for extracting the eye and mouth regions from the face region, as publicly known documents, Yasuo Wang, Hideo Kuroda, Makoto Fujimura and Akira Nakamura, “Eye and mouth regions from a black and white face image by fuzzy technique” Automatic Extraction ", (IEICE
"Technical Report" IE94-38P. 23-30 (19
94-07)).

According to this technique, the brightness information is used to cut out a virtual area where an eye and a mouth are supposed to be. And
First, rough region segmentation is used, and then the eye and mouth regions are correctly extracted. As a method of automatic extraction of eyes and mouth, a fuzzy membership function, which represents the similarity between neighboring pixel values, is used to perform coarse region segmentation using neighboring pixels and luminance value similarity. Parameter values are set using the fuzzy c-means method, data weighting is performed, and the eyes and mouth are defined using the brightness values.

The method for obtaining the focal length is described in JP-A-7-7741.
It is based on publicly known technology such as publication No. 0 (published on Mar. 20, 1995 “distance measuring method and device”). That is, when the focus is out of focus, the high frequency component is small, so the defocus amount is obtained based on the high frequency component, and this is taken out as a focus voltage for focusing.

In Japanese Unexamined Patent Publication No. 6-105217 (published on Apr. 15, 1994 “Video camera and its photometric method and focusing control method”), the distance to a subject is obtained using a distance measuring sensor. There is.

FIG. 12 shows how to determine the angle of the eyes with respect to the screen.
Will be described with reference to FIG. The origin is a point where a straight line extending from the center of the finder of the CCD camera 2 and a plane in focus intersect with each other, and coordinates of a focused position are (x1,
y1) and the coordinates of the position of the eyeball are (x1, y2).

In FIG. 12, m: X coordinate of the camera position y1: Y coordinate of the focused position y2: Y coordinate of eye position θy1: Angle at the focused position θy2: Angle of eye position Is.

Further, in FIG. n: camera position x1: X coordinate of the focused position x2: Y coordinate of eye position θx1: Angle at the focused position θx2: Angle of eye position Is.

First, the angle θy1 in the Y coordinate direction of the focused position is obtained from sin θy1 = y1 / f.

M = f cos θy1 The distance m to the user is calculated.

The angle θy2 of the eyeball position in the Y coordinate direction is obtained from tan θy2 = y2 / m (the Y coordinate does not depend on the magnitude relation of y1y2).

Similarly, the angle θ of the eyeball position in the X coordinate direction
x2 is obtained (the X coordinate does not depend on the magnitude relationship of x1x2).

The table value is obtained by actual measurement. At this time, the value may be determined based on the angle of either the left or right eyeball, or may be determined based on the center positions of both eyes.

As described above, in an information terminal device such as a personal computer or a word processor, a display device of the information terminal device for displaying various data such as symbols and figures, and a CCD camera or the like from the display device side. The digital image processing means photographs the user and outputs the image data and the measured distance data between the user and the CCD camera. A table in which the angle at which the user looks at the display screen is calculated from the measured distance data, and the display density and the display brightness corresponding to the angle and direction at which the user looks at the display screen is registered in advance according to the calculated value (FIG. 4). ), The automatic display adjusting means for determining the set values of the display density and the display brightness is provided. Thus, an automatic display adjustment device for a display device is provided.

(Second Embodiment) A second embodiment will be described with reference to FIGS. 1, 2, 4, and 5. 1 of FIG.
The functions from 6 to 6 are as described in the first embodiment.

The means for converting the image data of the CCD camera 2 and the measured distance data between the user and the CCD camera into digital data and outputting the digital data are as described in the first embodiment. In the second embodiment, C
The CD camera 2 is arranged in the upper part and the center of the display device.

The vibration detector 7 of FIG. 2 is means for detecting a slight vibration when the display device 2 or various information terminal devices including the display device 2 is moved and outputting a signal to the CPU 3.

In FIG. 2, the functions 1 to 6 are as described in the first embodiment. Figure 5 (A)
(E) is a flowchart of 2nd Embodiment.

Steps B-1 to B-6 are the first
This is as described in the embodiment.

Step C-1 of FIG. 5D: Judge whether the calculated values of angle and direction are within the table setting range. After searching the data from the display setting table of FIG. 4 in step B-4, the user displays the display screen. It is determined whether or not the angle and direction of the eye to be viewed exceed the setting range of the display setting table of FIG. 4, and if not, the process proceeds to B-5 step display setting data determination.

Step C-2 in FIG. 5D: When the range of the message output setting from the display device is out of the range, a message or symbol indicating that the position where the user is looking at the screen from the display device is not appropriate is displayed. In order to display, the CPU 5 outputs a control signal therefor to the display control circuit 4 and returns.

Step C-3 in FIG. 5B: Judgment as to whether or not the timer set time has been reached. The time interval for automatic display adjustment is stored in the memory 6 in advance, and the current time is set to the set time registered in the memory 6. It is determined whether it has reached. When the time is reached, the display automatic adjustment routine is called by an interrupt.

Step C-4 in FIG. 5C: When a new application program is loaded, the display device automatic adjustment subroutine is called and the process returns to the application.

Step C-41 of FIG. 5 (E): Judge whether the used application has changed Register the name of the application currently used in the memory 6 or use the application registered in the memory 6 and the current application. Determine whether the applications are the same. If not, the display device automatic adjustment routine is called by an interrupt.

Step C-5 in FIG. 5B: Vibration detection Normally, the automatic display adjustment routine of the first embodiment is stopped and the vibration is detected by the vibration detecting means 7. When the vibration is detected, after the vibration is converged, the display device automatic adjustment subroutine is called and the image is taken by the CCD camera.

As described above, the automatic display adjusting means sets the optimum visible range for viewing the display screen, and uses it through the display device or the like when the angle and direction in which the user views the display screen deviates from the visible range. Notify the person.

Further, the automatic display adjusting means more finely sets the set value within the range where the table in which the display density and the display brightness used in the automatic display adjustment are registered is normally used.

The automatic display adjustment means normally stops the automatic display adjustment function by operating the automatic display adjustment means at regular intervals.

The automatic display adjusting means operates the automatic display adjusting means only when the application is started,
Normally, the automatic display adjustment function is stopped.

The automatic display adjusting means performs a process of operating the automatic display adjusting device by means for detecting the vibration when the display device and the equipment including the display device are moved and outputting data.

Further, in the automatic display adjusting means, a digital image processing means such as a CCD camera used for the automatic display adjusting is attached to the central portion of the display device.

Besides, the present invention is not limited to the embodiments described above and shown in the drawings, and it is needless to say that the present invention can be appropriately modified and implemented without departing from the scope of the invention.

[0075]

According to the automatic display adjustment device of the display device of the first aspect, the display adjustment can be performed according to the angle and direction of the eyes of the user who sees the display screen, and the user can always optimize the display screen. It becomes possible to see in the state.

In the automatic display adjustment device of the display device according to the second aspect, when the position of the user's eyes is outside the display adjustment range preset in the table, it is possible to display a message from the display device. It is possible to urge the user to adjust the viewing position of the display screen or the display device to adjust the viewing angle of the display screen.

In the automatic display adjustment device for a display device according to claim 3, in the display setting data calculation step,
The display state can be finely adjusted within the angle range where the user generally sees well, and the user can always see the display screen in the optimum state, which alleviates the burden on the user's eyes.

In addition, since the fine adjustment is not performed when the angle is less used, C is set in the display setting data calculation step.
The processing performed by the PU is simplified.

In the automatic display adjusting device of the display device according to the fourth aspect, the automatic display adjusting means is operated only when the device is started, and thereafter, the automatic display is automatically displayed only when the set time is reached by judging whether the timer set time is reached or not. It is possible to operate the adjustment means and normally keep the automatic display adjustment means stopped. Therefore, the processing performed by the CPU is simplified, and the CPU can perform other arithmetic processing as compared with the case where the automatic display adjustment is always activated, so that the power consumption can be reduced and the processing capacity can be increased.

In the automatic display adjusting device of the display device according to the fifth aspect, the automatic display adjusting means is operated only when the device is activated, and thereafter, the automatic display adjustment is made only when the set time is reached by judging whether the application used has changed. It is possible to operate the means and normally keep the automatic display adjustment means stopped. Therefore, the processing performed by the CPU is simplified, and the CPU can perform other arithmetic processing as compared with the case where the automatic display adjustment is always activated, so that the power consumption can be reduced and the processing capacity can be increased.

In the automatic display adjustment device for a display device according to claim 6, the automatic display adjustment device is operated only when the device is activated, and then the display device or a terminal device including the display device is moved. It is possible to normally operate the automatic display adjustment means and stop the automatic display adjustment means. Therefore C
Compared to the case where the processing performed by the PU is simplified and the automatic automatic display adjustment is always activated, the CPU can perform other arithmetic processing, which makes it possible to reduce power consumption and increase processing capacity.

In the automatic display adjusting device for a display device according to claim 7, the CCD camera is arranged above the display device.
By arranging in the center, the means for calculating the angle of the eyes of the display screen is simplified as compared with the case of arranging left and right, so that the CPU can perform other arithmetic processing and reduce power consumption. Also, the processing capacity can be increased.

[Brief description of drawings]

FIG. 1 is an external view of a display device according to a first embodiment of the present invention.

FIG. 2 is a block diagram of a control circuit of the automatic display adjustment device of the display device according to the first embodiment of the present invention.

FIG. 3 is a flowchart of an automatic display adjustment device for a display device according to the first embodiment of the present invention.

FIG. 4 is a diagram of a display setting table of the automatic display adjustment device of the display device according to the first embodiment of the present invention.

FIG. 5 is a flowchart of an automatic display adjustment device for a display device according to a second embodiment of the present invention.

FIG. 6 is a diagram showing a focusing position according to the present invention.

FIG. 7 is a diagram showing a positional relationship.

FIG. 8 is a diagram showing an example of a user image of the present invention.

FIG. 9 is a diagram showing an example of a user image of the present invention.

FIG. 10 is a diagram showing an example of a user image of the present invention.

FIG. 11 is a diagram showing an example of a user image of the present invention.

FIG. 12 is a diagram showing a Y coordinate of the present invention.

FIG. 13 is a diagram showing an X coordinate of the present invention.

[Explanation of symbols]

1: Terminal equipment 2: CCD camera 3: Display device 4: Display control circuit 5: CPU 6: Memory 7: Vibration detection circuit

Front page continuation (58) Fields surveyed (Int.Cl. ⁷ , DB name) G09G 5/00-5/42 G01B 11/00 G06T 1/00 G06T 7/00-7/60 H04N 7/18

Claims (7)

(57) [Claims] 1. In a display device of an information terminal device for displaying various data such as symbols and graphics , a user is photographed by a digital image processing means such as a CCD camera from the display device side, and the image data and the user are taken. An output unit for outputting measurement distance data between CCD cameras, and an angle at which the user looks at the display screen is calculated from the image data and the measurement distance data, and the user views the display screen in advance according to the calculated value. An automatic display adjusting device for a display device, comprising automatic display adjusting means for determining a set value of the display density and the display brightness from a table in which the display density and the display brightness corresponding to the angle and the direction are registered. 2. The automatic display adjusting means sets an optimum view range for viewing the display screen, and uses it through a display device or the like when the angle and direction in which the user views the display screen deviates from the view range. The automatic display adjustment device for a display device according to claim 1, wherein the automatic display adjustment device notifies the person. 3. The automatic display adjustment means finely sets a set value within a normally used range in a table in which display density and display brightness used for automatic display adjustment are registered. An automatic display adjustment device for a display device according to claim 1. 4. The automatic display of the display device according to claim 1, wherein the automatic display adjustment means normally stops the automatic display adjustment function by operating the automatic display adjustment means at regular intervals. Adjustment device. 5. The automatic display of the display device according to claim 1, wherein the automatic display adjustment means normally stops the automatic display adjustment function by operating the automatic display adjustment means only when an application is started. Adjustment device. 6. The automatic display adjusting means performs a process of operating the automatic display adjusting means by means of detecting vibration of the display device and a device including the display device when the display device and equipment including the display device are moved and outputting data. An automatic display adjustment device for a display device according to claim 1. 7. The automatic display apparatus according to claim 1, wherein the automatic display adjustment means is provided with a digital image processing means such as a CCD camera used for the automatic display adjustment in a central portion of the display apparatus. Display adjustment device.