JPH0651902A - Information processing method - Google Patents

Abstract

PURPOSE:To prevent eyes from further getting fatigue by observing display information changed by the state of glances by deciding the display information corresponding to the result of comparing the positions of pupils of an operator detected by a photosensor with the previously decided reference values of the positions of the pupils. CONSTITUTION:OA spectacles 4 are provided with far infrared sensors and always chase the movement of the pupils of the operator. When the pupils move in a range to chase the picture of a display device 2, the directional angles of the light emitting elements of the spectacles are adjusted so as not to get reflected light. The keys of a keyboard 3 are provided with functions to detect the change of a psychological state by using a heat sensitive sensor, pulse sensor, further, blood pressure sensor and sensor to detect pressure or the like, and communication is enabled by speaking from a machine corresponding to frequency while counting the number of times of increasing the pressure or correcting the key. Thus, since the positions of glances are indicated to the operator, the unclear state of the operator itself can be recognized, and the display is made clear by narrowing down the display information corresponding to the reference values.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing method.

[0002]

2. Description of the Related Art In recent years, office automation equipment (hereinafter, simply referred to as OA equipment) has advanced to various fields, and the degree thereof has been increasing. With the second industrial revolution, the importance of MMI (Man Machine Interface) is understood, and the demand for it is increasing.

The MMI asks what the machine looks like to humans, and generally places the highest priority on user friendliness.

However, the second industrial revolution is an innovation centered on a computer that replaces part of the human brain, particularly a microcomputer that is a high-performance semiconductor computer. In a certain sense, machines are superior to humans in some sense, and it is the present state of MMI that it is inevitable that humans are fooled by intelligent machines.

[0005]

[Problems to be Solved by the Invention] In the olden days, too much of the First Industrial Revolution in which machines replaced human limbs created human alienation. The “Modern Times” of chupatsu pudding is cynically satirized. We are obliged to create a human-like MMI to prevent the Second Modern Times.

Now, the intelligentization of machines, represented by microcomputers, has produced serious human alienation that cannot be compared with the first industrial revolution. Today's computer-centered innovations have undergone a dramatic change in quality and quantity from computer rooms to OA, FA (factor automation), HA (home automation), and are widely used in households rather than factories. Has penetrated into.
However, this is still a pioneering wave from a global perspective. Right now, it can be said that this big wave is about to cover you from above. Among them, there are many people who become stressed and become neuroses due to the feeling of alienation due to the fact that they are made intelligent and do not adapt to machines. Now that the third industrial revolution represented by the fifth generation computer is about to rise,
Reaching for this is a new scientific and technological revolution that society as a whole demands.

For example, in a recent information processing apparatus,
By operating an icon on the display screen with a mouse (one of coordinate input devices) to select a desired menu or process, it has become easy for humans to understand.

However, since the keyboard and the mouse are used separately, the mouse and the icon are deceptive and not definitive (ultimate). It is where the other party is a machine and cannot interact with humans. In other words, human beings are originally instinctively directed to interact with living things including humans, but unfortunately, current information processing devices have not reached that point.

Another problem arises from the fact that human beings are used in machines. Therefore, if you have a partner, human beings can become familiar, the goal is to get close to humans and living things, ultimately cyborgs and high-performance robots, but anthropomorphicization of various information devices and personalization are a big step.

[0010]

SUMMARY OF THE INVENTION The present invention is based on these human psychological tendencies, and introduces a familiar character as a second-generation icon into information equipment and software, so that MMI can be used for PMI (Personalized Machine Interface). ACE) to provide an improved information processing device.

PMI is intended to improve MMI, and personalization has the meaning of both personalization and personalization.

Therefore, according to the present invention, the user who enables individual correspondence is identified and the desired MMI is selected.
Is automatically selected.

Skill level correspondence Selection according to the total use time, frequency, preference and achievement.

PMI monitor Must have hardware and OS to realize these.

The hardware configuration comprises means for realizing PMI and means for controlling equipment, and is within an appropriate cost range.

Since it corresponds to the user's psychology, only the amount of information necessary to cause the association of the other party is required. Therefore, it is not necessary to have full-screen, high-definition, full-color images.

Without imposing a heavy load on the equipment, the machine status is shown to the user to show the user's psychology about the state of the equipment, the type of operation, self, failure diagnosis, and understanding and response to commands. Thing.

Under the above problems, the present invention enables the operator to know his / her own state by displaying the position of the line of sight that is difficult for the operator to understand.
Also, instead of constantly updating and displaying the position of the line of sight, a reference value is provided and the information selected to some extent is displayed based on the comparison result, so that the eyes are further tired by seeing the display information that changes depending on the state of the line of sight. The present invention aims to provide an information processing method that realizes the prevention of such a situation.

[0019]

In order to solve this problem, the information processing method of the present invention comprises the following steps. That is, the position of the operator's pupil is detected by an optical sensor, the detected position of the pupil is compared with a predetermined reference value of the position of the pupil, and display information is determined according to the comparison result. Controlling display according to the determined display information.

[0020]

In the process of the present invention, the detected position of the operator's pupil is compared with a predetermined reference value of the position of the pupil, display information is determined according to the comparison result, and the display information is determined. Control the display according to.

[0021]

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

At present, a voice input device is actively proposed as a simple MMI method. However, this is a degree free from the troublesomeness of the user's key input, and is not decisive. In particular, speech recognition of unspecified speakers is technically difficult.

The feature of the present proposal is that the machine reads the psychological trend of the operator as the user, and the machine asks the person for the comical coordination as described above.

Here, the machine responds by voice,
Whether or not the machine is used by humans is detected by detecting the approaching or stationary state of the machine, and the machine waits for set-up (power ON, initialization). The method of communication has already been disclosed. But this is M
PMI is not realized unless it is outside the MI range and is simply within the range where the interface with the machine is simplified and the psychological state of the operator is not accessed from the machine side.

In this embodiment, the information processing device is a PC.
An example applied to a (personal computer) or WP (word processor) will be described.

Normally, the operator operates the keyboard while looking at the CRT (display device), but how should the machine read the psychological state of the operator?

One is the ID. It is conceivable to input personality, blood type, etc. to the machine together with No (recognition number). The second method is to check the psychological state of the person from the operator's eyes movement, body temperature, room temperature, pulse, blood pressure, and input error by a sensor from the machine. This is only to catch a very common event that is universal, but rather than this, the machine grasps the character and psychological state of the person and more comfortably treats the message as if to contact a close friend. The announcement may be made on a part of the screen or by voice.
In addition to this, due to the elapsed working time of the operator,
It can be detected to some extent.

An example of detection of the ecological information is shown in FIG. FIG. 1 shows a state in which the operator 1 is operating an OA device (for example, a word processor). In the figure, 2 is a display device, 3 is a keyboard, and 4 is OA glasses.

Now, the psychological state of the operator 1 described above is detected. First, the OA glasses 4 will be described.

A far-infrared sensor is attached to the OA spectacles 4 so that the movement of Hitomi of the operator 1 can be followed without chasing. In reality, a weak far-infrared light emitting element is placed at one end of the OA glasses 4 and projected onto Hitomi. Of course, human Hitomi cannot get (or decrease) reflected light from black. When it deviates from Hitomi, reflected light enters the light receiving element. When Hitomi is moving within the range of tracking the screen of the display device 2, no reflected light can be obtained.
The orientation of the light emitting element may be adjusted again as shown in FIG. In FIG. 3, the amount of movement to see the keyboard 3 and the amount of movement to see the screen can be identified. If the operator 1 is out of this range or if the frequency is out of this range, it is judged that the operator 1 is getting tired too much, or that the operator is easily distracted.
Or, an image the operator likes is displayed on a part of the screen. This is shown in FIG. In FIG. 4, the operator's favorite landscape image can be displayed on a part of the screen, and at the same time, the operator's favorite BGM (back ground music) can be played. Therefore, the displayed image and BGM naturally have different preferences for each individual, so that the ID. It is necessary to inform the device of No. As a result, the device has its ID. If the mental state of the operator is judged based on the data corresponding to No, it becomes possible to grasp with a higher probability.

Now, in order to detect the psychological state of the operator, it is not limited to the OA glasses described here. As described above, the environment (for example, room temperature and humidity) when the operator is using the device, the operator's body temperature and pulse,
From the blood pressure and the error rate at the time of input, it is possible to check the psychological state of the person. Therefore, in this embodiment, some keys of the keyboard 3 (a frequently used carriage return key or space key is preferable).
In addition, it is possible to detect a change in the psychological state with a temperature sensor, a pulse sensor, a blood pressure sensor, a sensor that detects a pressing pressure, and the like. The number of times the keyboard 3 with which these functions are provided hits the keyboard 3 higher than usual, or the number of corrections by pressing the wrong key is counted, and the machine speaks according to the frequency, and the interaction between human and machine is counted. It is possible to take comunication while interacting with each other.

In this way, the degree of fatigue is read by sensing information from the machine, reading the information indicating the psychological state of the operator such as the movement of Hitomi, the frequency of mistakes at the time of input, changes in pulse rate, body temperature, and blood pressure. The machine learns and can speak to the situation.

FIG. 5 shows the architecture of the controller that constitutes the OA equipment according to the present proposal, which can be constructed in one chip due to the remarkable progress of semiconductor process technology in recent years. The feature of FIG. 5 is that, in addition to the CPU, a co-processor (COP) for controlling an actual task is formed into a plurality of channels as needed. Therefore, C
The PU may concentrate on executing the OS (Operating System) that manages this COP. It is similar to AI (artificial intelligence) that the machine has the process of learning by grasping the human psychological state as in the present embodiment. Therefore, it is desirable to have a high-speed processor capable of parallel processing.

In the figure, layer 2 has a built-in microprogram enabling the CPU to execute at high speed. The purpose is to execute complex programs at high speed in order to understand the person through interaction with the person.

The rater 3 is a group of coprocessors, and usually 10 to 16 channel processors can independently operate in parallel. Here, since it deviates from the gist of the present invention, details thereof will be omitted.

Layer 4 is a timer / counter array, which can be accessed by the CPU and COP. The COP has its own 16-bit timer counter, 14 channels each. DP
RAM is a dual port RAM, CPU and COP, or C
Used for exchanging data among OP comrades. RAM is a normal two-clad RAM, and can be accessed by COP and CPU. Layer 5 is a bus line used for interface with the outside (outside the controller).
The bus is a system bus and is used for expansion of external memory and I / O.

The I bus is a bus dedicated to the ICE, and when the system is debugged, the contents of the register RAM (not shown) can be taken out from this dedicated bus and viewed.

The O bus is a bus dedicated to I / O and can be used for expansion of I / O elements.

The LAN is a serial I / O interface and a predetermined protocol is configured by a program.
P is assigned for serial communication.

FIG. 6 shows tasks and OS layers for realizing the information processing apparatus of this embodiment. As described above, in this embodiment, a plurality of Cs that can be executed in parallel based on the CPU are used.
There is an OP, and some of these COPs can be assigned to PMI control. This OS includes a normal machine control OS and a PMI OS. OS for PMI
As mentioned above, you can think of it as an OS with AI-like functions for understanding and understanding the habits and personality of a person gradually through interaction with the person and strengthening the understanding. There is a COP group on the outer surface of the COP group, and the tasks 0 to 15 are handled and processed in parallel.

Of the tasks 0 to 15 for the PMI task,
Which is to be P-signed may be determined by the software configuration. Further, the COP may be increased or decreased depending on the degree and the amount of work.

In order to perform the processing described above, it is hoped that its own OS (operating system) is required. In addition, AI-like PMI- that has a learning function
A high-speed parallel processing processor is required to operate the OS, and this architecture is considered to be a system that meets this requirement.

FIG. 7 shows an example of the configuration when this system is installed in an OA device. As a configuration for PMI, a biometric information sensor 6 and a display 2 are provided with a speaker 7 for displaying PMI at one end and for notifying by voice. In addition, 5 is a controller for controlling the entire apparatus,
There is provided a basic data storage section 5a which internally stores basic information for each operator (data indicating personality and data indicating preference).

With such a configuration, a PMI which is one dimension higher than the conventional man-machine interface (MMI) can be easily realized at low cost.

FIG. 8 is a diagram showing PMI messages and announcements over time in this embodiment. In this figure, for example, when the power is turned “ON” to the OA device,
First of all, "Good morning" is displayed, and it is output by voice. When the power is on, it is not always in the morning, so greeting information may be output according to the time. Next time you need a password or ID. Enter No. Here, ID. When No is input, the device knows who the operator is, and when detecting a subsequent mental state and outputting a message, the device outputs optimal output information. For example, in Fig. 8, there is a message "Why not make tea?" At "Tay time" (10:00 and 3:00), but if that person's favorite drink is coffee. You can change this message to "Why not make coffee?" Further, at this time, since the output video also varies from person to person, the video output to the display device is not always constant. For example, images of mountains, the sea, popular singers, idols, Buddha statues, etc. may be output according to the operator's preference, and the sound may be the classical music, poppylar, chirping of birds, or rippling waves of the sea. The resting image and sound are output. Therefore, ID. Inputting No means selecting basic information for each individual that the apparatus itself has in advance, and the content of the output message can be changed as necessary. Of course, ID. If there is no concept of No, general output information may be output.

As described above, according to the present embodiment, mutual understanding between a machine and a human is possible, a mental illness such as neurosis is released, and a dialogue with the machine can be carried out smoothly.

Also, since this is an epoch-making method in which the machine detects biometric information and the machine accesses the operator, the affinity with the machine naturally increases, and the machine is suitable for the user at that time. It is possible to reduce the number of errors by making a call according to the condition of.

Further, if the apparatus side is provided with the basic information for each operator, it becomes possible to output a more appropriate message output.

[0049]

As described above, according to the present invention, by displaying the position of the line of sight to the operator, it becomes possible for the operator to know his / her own condition which is difficult to understand. Further, it is possible to make the display easy to see by narrowing down the display information based on the reference value.

[0050]

[Brief description of drawings]

FIG. 1 is a diagram showing a state in which an operator is using the information processing apparatus of this embodiment.

FIG. 2 is a diagram showing a state where the OA glasses of the embodiment are carried,

FIG. 3 is a diagram showing a range of movement of an operator's pupil with the OA glasses of FIG.

FIG. 4 is a diagram showing an example of output information in the present embodiment.

FIG. 5 is a diagram showing the architecture of a controller that constitutes the information processing apparatus according to the present embodiment.

FIG. 6 is a diagram showing an outline of tasks and an operating system in the present embodiment.

FIG. 7 is a basic configuration diagram of an information processing apparatus of this embodiment.

FIG. 8 is a diagram showing an operating state over time in the present embodiment.

[Explanation of symbols]

 1 Operator 2 Display Device 3 Keyboard 4 OA Glasses 5 Controller 5a Basic Data Storage 6 Biometric Sensor 7 Speaker

Claims (1)

[Claims] 1. A position of an operator's pupil is detected by an optical sensor, the detected position of the pupil is compared with a predetermined reference value of the position of the pupil, and display information is displayed according to the comparison result. And controlling the display in accordance with the determined display information.