JPH09190325A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device whose operation is easy even if the hands are disabled and which display related information by providing a sight line detection means, a picture pattern selection means and an information selection means. SOLUTION: Plural picture patterns A-P being choices are displayed on a display 11. Line of sight 13 which a user gives to the picture patterns A-P are detected by sight line angle detector 14. The residence time in the respective picture patterns A-P is measured, the lengths are compared and the intended picture pattern is selected. The pattern selection means makes the picture patterns corresponding to the line of sight and the information selection means obtains information whose order is lower than information corresponding to the selected picture pattern by one from a data base means. Then, the picture pattern of a lower concept related to the selected picture pattern is displays and the similar operation is repeated.

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a display device for displaying related information.

[0002]

2. Description of the Related Art Conventionally, as a display device for displaying related information, a CRT display or a liquid crystal display,
There is a combination of a capacitive touch panel and infrared scanning.

[0003]

However, in the above-mentioned conventional example, the hand cannot be used because the position is specified by the finger, the pressure is applied, the position is specified by the specific pen, or the pressure is applied. It was difficult to operate when in a state or handicapped.

Therefore, it is an object of the present invention to provide a display device which is easy to operate even if the hand is inconvenient and displays related information.

[0005]

In order to achieve the above object, a display device according to the present invention has the following features, that is, a display device for displaying related information, wherein the related information is ranked. Database means to be stored in advance, image forming means for displaying the related information as an image pattern on a display screen of the display device, line-of-sight detecting means for detecting the line-of-sight of the user of the display device, and the image An image pattern selection means for associating a pattern with the line of sight, and information selection means for obtaining from the database means information that is one rank lower than the information corresponding to the image pattern selected by the image pattern selection means. And repeating these means. This realizes a man-machine interface that expands the screen of the display device into a tree structure and expands from a higher concept to a lower concept.

Further, the image pattern selecting means may measure and compare the time when the line of sight is directed on the image pattern, and select at least one image pattern corresponding to the longest measurement time. Characterize.
Utilizes that the user's line of sight is long directed toward the intended option.

Further, in the image forming means, the rank is 1
It is characterized in that the image pattern corresponding to the subordinate information and the selected image pattern are displayed at the same time. This allows the user to confirm the progress of selection.

Further, it is characterized by further comprising storage means for storing the information sequentially selected by the information selection means, and / or communication means for communicating with an external device. As a result, the use of the selection result, the user's preference, and the tendency of selection are captured by the external device.

[0009]

An embodiment of the present invention will be described below in detail with reference to the drawings.

First, the structure of a display device to which the present invention is applied will be described.

FIG. 1 is a block diagram of a display device as an embodiment of the present invention.

In the figure, 11 is a display panel, 14 is a line-of-sight angle detector, 15 is a line-of-sight angle range detector, 16 is an input signal changeover switch to the panel 11, 21 is a trigger button for starting the entire apparatus, and 22 is A master control for controlling the operation timing of the entire apparatus, 23 is a gate circuit which is turned "ON" only while the line-of-sight angle detector 14 is operating effectively, and 24, 26, 28 are gate circuits whose gate 23 is "O".
A time measuring circuit for measuring the time of N ", 25,
27 and 29 are the longest time detection circuits for detecting the longest time among the times measured by 24, 26 and 28, 31 is the primary display pattern generation circuit started by the master control 22, and 32 is the pattern generation circuit 31. A primary image frame memory for selecting and storing a pattern from a plurality of generated patterns in accordance with the output of the longest time detection circuit 25, and 33 for generating a plurality of image patterns depending on the contents of the primary image frame memory 32. A secondary display pattern generation circuit 34 that is generated, a secondary image frame memory 34 that selects and stores a pattern from the output of the pattern generation circuit 33 according to the output of the longest time detection circuit 27, and 35 is a secondary image frame A third display pattern generation circuit that generates a plurality of image patterns according to the stored contents of the memory 34, and 36 outputs a pattern according to the output of the longest time detection circuit 29. Select a pattern in accordance with the output of the circuit 35, a third Tsugiga frame memory for storing. 3 of the above
When forming a display image, the one display pattern generating circuit refers to a tree structure of options corresponding to each image pattern stored in advance in the database 49. Reference numeral 41 calculates the correlation between the outputs of the longest time detection circuits 25, 27, 29, and determines whether the secondary display pattern or the tertiary display pattern is in line with the movement of the eyeball 12 of the user. A correlation calculation circuit for checking and a circuit 42 for determining the final display image based on the output of the correlation calculation circuit 41.

FIG. 2 is a diagram showing the relationship between the display and the line of sight of the user as an embodiment of the present invention.

In the figure, 12 is the eyeball of the user, and 13 is the line of sight. In the angle formed by the line of sight 13, θ is a horizontal plane angle,
φ is the vertical in-plane angle.

Next, the operation of the display device will be described with reference to FIGS.

FIG. 3 (FIGS. 3A to 3D) is a flowchart showing the processing of the display device according to the embodiment of the present invention.

<Primary Process> In the above structure, when the trigger button 21 is pressed, the primary display pattern generating circuit 31 is started by a command from the master control 22, and the display panel 11 displays, for example, A, B, C,
16 patterns of P are displayed (state of the display panel 11 in FIG. 2) (step S1).

Each pattern of A, B, C, ... P is, for example, as daily life information, A: getting up, B: sleeping, C: weather,
D: Transportation, E: Washbasin, F: Makeup / Barber / Changing clothes, G: Information gathering, H: Drink, I: Meal, J: Medication, K: Break,
L: Work / Learning, M: Exercise, N: Entertainment, O: Bathing, P:
It is assumed that other items are set.

Next, after the user looks at the display panel 11 and confirms that the line-of-sight 13 exists in the range of the frames A to P by the line-of-sight angle range detector 15 (step S2), the gate 23 is turned on. Start "ON" and "OFF" (step S3).

The time measuring circuit 24 enters the time t1A when the line of sight 13 is in the frame range of the image pattern A, the time t1B when it is in the frame range of the image pattern B, and the time t1B when it is in the frame range of the image pattern C. Time t1C, ... Time t1P within the frame of the image pattern P is measured (step S4), the output of the longest time detection circuit 25 is monitored by the longest time monitor circuit 47, and time t1A It is judged whether or not there is one from t1P shorter than a predetermined shortest time (step S).
5). In the case of YES, the master control 22 is reset by the operation of the reset circuit 46, and the series of operations from the primary process is redone. If NO, then the detection circuit 2
In step 5, it is determined whether any of the times t1A to t1P is longer than a predetermined maximum time (step S6). YES
In the case of, the detected time is substituted for the longest time t1MAX (step S7), and the process proceeds to step S9. In the case of NO, the longest time t1MAX among the times t1A to t1P is detected by the longest time detection circuit 25 (step S8), and one of the image patterns (patterns A, B, C, ... P) corresponding to t1MAX is detected. Are stored in the primary image frame memory 32 (step S).
9). Now, for example, if the time t1I is detected as the longest,
The pattern I (meal) is stored in the primary image frame memory 32. In addition, at this point, the gate circuit 23 becomes “O”.
FF ″. The above image processing process is called a primary process.

<Second Process> When the first process is completed, the secondary display pattern generating circuit 33 operates according to a command from the master control 22. At this time, the output screen generated by the secondary display pattern generation circuit 33 and displayed on the display panel 11 is, for example, as shown in FIG. 4 (step S10).

FIG. 4 shows a second embodiment of the present invention.
It is a figure which shows the example of a following display pattern.

In the figure, the selection pattern I in the first step
Is enlarged and displayed in the central part, and patterns A ′, B ′, C ′, ..., P ′, which are subordinate concepts related to I (meal), are displayed in the periphery.
Is displayed (for example, A ': Japanese food, B': Western food,
C ': Chinese, D': Other dishes, E ': Noodles (Udon), H': Noodles (soba), I ': Noodles (ramen),
L ': noodles (other), M': dessert (confectionery),
N ': dessert (fruit), O': dessert (other),
P ': Others).

Next, let the user look at the display panel 11, and look at the line of sight 13 in the range of the frame of the patterns A'to P '.
Is detected by the line-of-sight angle range detector 15 (step S11), and the gate circuit 23 turns “ON” and “O”.
The FF "operation starts (step S12). The time measuring circuit 26 causes the time t2A 'when the line of sight 13 is within the frame range of the image pattern A', and the time t2B within which the line of sight 13 is within the frame range of the image pattern B '. ', The time t2C' within the frame of the image pattern C '... The time t2P' within the frame of the image pattern P'is measured (step S13), and the longest time is detected. The output of the circuit 27 is monitored by the longest time monitor circuit 47, and it is determined whether or not there is any one of the times t2A 'to t2P' that is shorter than a predetermined shortest time (step S14). Reset master control 22, step S
Repeat a series of operations from 10. In the case of NO, the detection circuit 27 further determines whether or not any of the times t2A 'to t2P' is longer than a predetermined maximum time (step S1).
5). If YES, the detected time is the maximum time t2MAX
(Step S16) and the process proceeds to step S18.
In the case of NO, the longest time t2M among the times t2A 'to t2P'
AX is detected by the longest time detection circuit 27 (step S1
7), an image pattern corresponding to t2MAX (pattern A '...
One of D ', E', M ', I', L ', M'-P') is stored in the secondary image frame memory 34 (step S2).
0). However, the correlation between the image pattern corresponding to t2MAX detected in step S17 and the image pattern stored in step S9 is calculated by the correlation calculation circuit 41 (step S18), and it is determined whether the correlation is equal to or more than a predetermined correlation value. A judgment is made (step S19). If YES, the image pattern corresponding to t2MAX is stored in the secondary image frame memory 34.
If NO, the process returns to step S10. By this process, the operation of the secondary display pattern generating circuit 33 (whether or not the subordinate concept pattern of the contents of the primary image frame memory 32 is normally generated) can be confirmed. Now, for example, time t2
If A'is detected to be the longest, the pattern A '
(Japanese food) is stored in the secondary image frame memory 34. Also,
At this point, the gate circuit 23 is turned off. The above image processing process is called a secondary process.

<Third Process> When the second process is completed, the third display pattern generating circuit 35 operates according to a command from the master control 22. At this time, the output screen generated by the third display pattern generation circuit 35 and displayed on the display panel 11 is as shown in FIG. 5, for example (step S21).

FIG. 5 shows a third embodiment of the present invention.
It is a figure which shows the example of a following display pattern.

In the figure, the output pattern I in the primary process and the output pattern A'in the secondary process are enlarged and displayed in the central part, and the pattern A which is a subordinate concept of A '(Japanese food) is displayed above and below. Display "~ D", M "~ P" (for example, A ":
Vegetables, B ": fish, C": meat, D ": other ingredients,
M ": raw, N": boiled, O ": grilled, P": tempura, etc.).

Next, let the user see the panel 11,
It is confirmed by the line-of-sight angle range detector 15 that the line-of-sight 13 exists in the range of the frame A ″ to P ″ (step S22),
The "ON" and "OFF" operations of the gate 23 start (step S23). The time measuring circuit 28 calculates the time t3A ", at which the line of sight 13 is within the frame of the image pattern A",
... Time t3D "within the frame of image pattern D", time t3 within the frame of image pattern M "
The time t3P "within the frame of the image pattern P" is measured (step S24), the output of the longest time detection circuit 29 is monitored by the longest time monitor circuit 47, and the time t3A " .About.t3P "is determined to be shorter than a predetermined shortest time (step S25). If YES, the master control 22 is reset by the operation of the reset circuit 46, and the series of operations is repeated from step S21. If NO, the detection circuit 29 further detects the time t.
It is determined whether or not there is any one of 3A "to t3P" longer than a predetermined maximum time (step S26). If YES, the detected time is substituted for the longest time t3MAX (step S27).
Then, the process proceeds to step S29. If NO, time t3A "
.About.t3D "and times t3M" to t3P ", the longest times t3MAX and t3MAX" are detected by the longest time detection circuit 29 (step S28), and the image patterns (patterns A "to D" corresponding to t3MAX are detected. 1)) and an image pattern corresponding to t3MAX "(one of patterns M" to P ") are stored in the third image frame memory 36 (step S31), provided that t3MAX detected in step S28. , T3MAX "
For the image pattern corresponding to (1), the correlation calculation circuit 41 calculates the correlation with the image patterns stored in steps S9 and S20 (step S29), and determines whether the correlation is equal to or more than a predetermined correlation value (step S30). . If YES, the second image pattern corresponding to t3MAX, t3MAX "
It is stored in the next image frame memory 34. If NO, the process returns to step S21. If, for example, the times t3C "and t3D" are detected to be the longest, the pattern B "(fish) and the pattern N" (boiled food) are stored in the tertiary image frame memory 36.
At this point, the gate circuit 23 is turned off.
The above image processing process is called the third process.

<Fourth Process> When the third process is completed, the fourth display pattern generating circuit 37 operates according to a command from the master control 22. At this time, the output screen generated by the fourth display pattern generation circuit 37 and displayed on the display panel 11 is as shown in FIG. 6, for example (step S32).

FIG. 6 shows a fourth embodiment of the present invention.
It is a figure which shows the example of a following display pattern.

In the figure, the output pattern I (meal) in the first step, the output pattern A '(Japanese food) in the second step, the third
Output pattern B "(fish), output pattern N" in the next process
(Simmered food) is displayed.

Next, the correlation of the four contents of the fourth display pattern is calculated by the correlation calculation circuit 41 (step S3
3) It is determined whether the correlation value is equal to or more than a predetermined correlation value (step S34). If the correlation value is equal to or greater than the predetermined value, the image fixing unit 42 fixes the image displayed on the display panel 11 and continues the display (step S35). At the same time, the user's name code generation circuit 17, the event code generation circuit 38 for the display image, and the output data such as the date, time, and the like, which are the outputs of the clock 45, are output to the temporal change memory device 43.
The data is stored in the memory card 44 and / or output to the external device (not shown) by the input / output interface 48 via communication (step S36). The memory card 44 is removable from the time-varying memory device 43,
By referring to another reading device, it is possible to grasp the selection process, preference, and life pattern of the user. The same applies when the output data of the input / output interface 48 is received by an external device (not shown).

On the other hand, in step S34, the correlation of the four contents of the fourth display pattern is calculated by the correlation detector 41, and when the correlation between the four images is less than or equal to a predetermined value,
A reset pulse is generated, the master control 22 is reset by the operation of the reset circuit 46, and a series of operations from the above-described primary process is redone.

The display panel 11 may be fixed to a wall, a table or the like, or a so-called HMD.
It may be in the form of being fixed with the head or the face as a reference like a (head mounted display).

Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of one device. Further, it goes without saying that the present invention can be applied to the case where it is implemented by supplying a program to a system or an apparatus. In this case, the storage medium storing the program according to the present invention constitutes the present invention. Then, by reading the program from the storage medium to the system or device, the system or device operates in a predetermined manner.

<Effects of this Embodiment> (1) The user's selection operation is realized without using a hand by measuring the gaze time for a specific pattern among many display patterns. (2) By expanding the display pattern from a superordinate concept to a subordinate concept like a so-called tree structure, the user's selection operation of choices is facilitated. The number of patterns to be simultaneously displayed in parallel spatially is reduced, and the required resolution of the display device is reduced accordingly, which is economical. (3) When the pattern of the subordinate concept is displayed, the pattern of the superordinate concept that has already been selected is displayed at the same time, so that the user can check the progress of the selection by himself, and further the user's selection process can be performed by a third party. Presented to. (4) The final display pattern and other data are stored in the memory card 44, and / or the input / output interface 4
By communicating with an external device (not shown) at 8, specific information about the user can be extracted.

[0037]

As described above, according to the present invention,
It is possible to provide a display device that is easy to operate even if the hand is inconvenient and that displays related information.

[0038]

[Brief description of the drawings]

FIG. 1 is a block configuration diagram of a display device as an embodiment of the present invention.

FIG. 2 is a diagram showing a relationship between a display and a user's line of sight as one embodiment of the present invention.

FIG. 3A is a flowchart showing processing of a display device as an embodiment of the present invention.

FIG. 3B is a flowchart showing a process of the display device according to the embodiment of the present invention.

FIG. 3C is a flowchart showing a process of the display device according to the embodiment of the present invention.

FIG. 3D is a flowchart showing a process of the display device according to the embodiment of the present invention.

FIG. 4 is a diagram showing an example of a secondary display pattern as an embodiment of the present invention.

FIG. 5 is a diagram showing an example of a tertiary display pattern as an embodiment of the present invention.

FIG. 6 is a diagram showing an example of a fourth display pattern according to the embodiment of the present invention.

[Explanation of symbols]

 11 Display Panel 12 User's Eye 13 Line of Sight 14 Line of Sight Angle Detector 15 Line of Sight Angle Range Detection Circuit 16 Input Signal Changeover Switch 17 Personal Name Code Generation Circuit 21 Trigger Button 22 Master Control Unit 23 Gate Circuit 24, 26, 28 Time Measurement Circuits 25, 27, 29 Longest time detection circuit 31 Primary display pattern generation circuit 33 Secondary display pattern generation circuit 35 Third display pattern generation circuit 37 Fourth display pattern generation circuit 32 Primary image frame memory 34 Secondary image frame memory 36 Third image frame memory 38 Event code generation circuit 41 Correlation calculation circuit 42 Image fixing circuit 43 Time-varying memory device 44 Memory card 45 Clock 46 Master control / reset circuit 47 Longest-time detection monitor 48 Input Output interface 49 Database

Claims (5)

[Claims] 1. A display device for displaying related information, wherein a database means for ranking and previously storing the related information, and displaying the related information as an image pattern on a display screen of the display device. Image forming unit, a line-of-sight detecting unit that detects the line of sight of the user of the display device, an image pattern selecting unit that associates the image pattern with the line of sight, and an image selected by the image pattern selecting unit A display device comprising: information selecting means for obtaining from the database means information having a rank lower by one than the information corresponding to the pattern, and repeating these means. 2. The image pattern selecting means measures and compares the time when the line of sight is directed on the image pattern, respectively, and selects at least one image pattern corresponding to the longest measurement time. The display device according to claim 1, wherein the display device is a display device. 3. The image forming means displays the image pattern corresponding to the information one order lower in order and the selected image pattern at the same time.
The display device according to the above. 4. The display device according to claim 1, further comprising a storage unit that stores information sequentially selected by the information selection unit. 5. The display device according to claim 1, further comprising communication means for communicating information sequentially selected by the information selection means to an external device.