JPH0887380A - Operating body adaptive console panel device - Google Patents

Abstract

PURPOSE: To facilitate operation corresponding to features of a person who operates the device. CONSTITUTION: The console panel device is provided with an optical sensor unit 2 on the top surface of the screen 11 of its CRT 1 so that the screen can be viewed, and allows input operation with the screen pressed and has a display enlargement part 3 which selectively enlarges a display at an operation input position, a detection enlargement part 4 which enlarges the detection range of the optical sensor unit 2, a judgement part 5 which judges whether or not they should be put in operation, and a controller 6 which performs control according to its judgement so that the display and detection enlargement parts enlargement part are placed in operation. The judgement part 5 has a 2nd optical sensor unit 51 which detects the size of a finger and a comparator 52 which compares the detected size with a specific value. Consequently, nonenlargement input and input operation wherein display and detection are enlarged are enabled corresponding to the size of the operating body and input in other operation modes can be done even if the display and detection are enlarged unless the operation can not be done.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention provides an operation input detecting section on the surface of an operation input position display surface for displaying a plurality of operation input positions so that the operation input position display surface can be visually observed. The present invention relates to an operation panel device in which an operation input is performed by bringing an operation tool close to a display surface.

[0002]

2. Description of the Related Art As an operation panel device, for example, a CR
2. Description of the Related Art There is a touch panel type operation panel device in which an operation input detection unit configured by a touch panel is provided on an operation input position display surface in which operation switches are graphically displayed on the screen of T, and the operation switches are operated via the touch panel. In such an operation panel device, normally, the display position of the operation switch is set to a predetermined position by a program, and even if the number is large, the display pitch initially determined is maintained and changed later. There is no. That is, all these positions are determined at the time of designing the operation screen by the software design of the touch panel, and cannot be changed at the subsequent practical stage. As a result, if the screen design is such that one switch section is narrow due to the large number of operation switches, the target operation switch cannot be pressed accurately, resulting in input failure or erroneous input. Let

In order to prevent such an operation error, a keyboard device has been proposed in which keys to be operated are enlarged (see Japanese Patent Laid-Open No. 2-153415). With this keyboard device, when a finger approaches the key display unit,
The plane position of the finger with respect to the screen is detected, and the keys in the vicinity of this position are enlarged. However, if the screen is suddenly enlarged when the finger is brought close enough to detect the position of the finger as described above, the operation may be difficult due to a change in the screen immediately before the operation. In addition, depending on the person who operates, the person's finger may be small, or the person may be dexterous, so that erroneous operation may not occur even on a small screen. Even in such a case, if the screen is always enlarged, the operation becomes rather difficult. On the contrary, when a person with a handicapped person operates it, there may be a case where it cannot be dealt with only by enlarging the screen.

[0004]

SUMMARY OF THE INVENTION It is an object of the present invention to solve the above problems in the prior art and to provide an operation panel device corresponding to an operating body, which facilitates the operation according to the characteristics of an operator. And

[0005]

In order to solve the above-mentioned problems, the present invention according to claim 1 provides an operation input position display surface on a surface of an operation input position display surface for displaying a plurality of operation input positions. A display for selectively enlarging the display of the operation input position in the operation panel device in which the operation input is provided so that the operation input can be visually recognized and the operation input is executed by bringing the operation body close to the operation input position display surface. Expansion means,
Detecting and enlarging means for enlarging the detection range of the operation input detecting section, determining means for deciding whether or not to activate the display enlarging means and the detecting and enlarging means, and the display enlarging means and the detecting by the decision of the judging means. The invention according to claim 2 is characterized in that, in addition to the above, the judgment means is a size detection means for detecting the size of the operating body. And a size comparison means for comparing the size detected by the size detection means with a predetermined value. The invention according to claim 3 is characterized in that, in addition to the features of the invention according to claim 1, An erroneous input detecting means for detecting an erroneous input at the time of operation and an erroneous input comparing means for comparing the erroneous input detected by the erroneous input detecting means with a predetermined value. Invention of Claim 1 In addition to the features, the determining means is characterized by having an object detecting means for detecting this when the object approaches within a predetermined distance with respect to the display surface.

[0006]

According to the invention of claim 1, since the display enlarging means for selectively enlarging the display of the operation input position and the detection enlarging means for enlarging the operation input detecting portion are provided, the display is made easy to see and the operation is performed. Can be made easier. Since the display enlarging means and the detecting and enlarging means are operated to determine whether or not to activate them and the control means to activate them based on the determination of the determining means, the display section and the The detection unit can be enlarged. Therefore, it is possible to perform the optimum operation corresponding to the characteristics of the operator.

According to the second aspect of the present invention, the judging means has the size detecting means and the size comparing means for comparing the detected size with a predetermined value. Therefore, whether the display and detection range should be expanded depending on the size of the operating body. Can be determined. Therefore, for example, in a case where an operator having a finger having a thickness larger than the normal thickness may make an operation error in relation to the size of the display section, the size of the normal human finger is set to a predetermined value. By doing so, when a person with a thick finger operates, the display and detection unit is enlarged, so that an erroneous operation is prevented.
On the other hand, when the operator's finger has a normal thickness, the display is not enlarged because there is no risk of erroneous operation even without enlargement. As a result, the screen does not change unnecessarily, and smooth and quick operation can be performed.

Further, even if the display and detection categories are large to some extent, if the operator has a hand disorder, the operation cannot be performed with one finger, and an operation error occurs by using a plurality of fingers. However, by making the predetermined value large and enlarging the display and detection unit, such an operation error can be prevented. Furthermore, the predetermined value is set to two levels, and it is determined that the detected size is abnormally large, for example, when the entire hand is brought close to it. At this time, it is determined that the operation is impossible even if the display is enlarged, The control means can also be controlled to change to another operation mode.

According to the third aspect of the invention, the judging means has the erroneous input detecting means and the erroneous input comparing means for comparing the detected erroneous input with a predetermined value. Therefore, only when a certain erroneous input or more occurs. The display is enlarged so that input can be performed without causing operation mistakes, and smooth and quick operation can be performed without enlargement of the display in an operation that is close to normal without many erroneous operations. As the erroneous input, the number of times and the erroneous input rate are detected.

According to the fourth aspect of the present invention, the judging means has an object detecting means for detecting that an object approaches the display surface within a predetermined distance. When the face is brought closer to see the object closely, the object detection unit detects and outputs it, and the control unit enlarges the display and detection unit to facilitate the operation by the operator.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows the overall construction of an operation panel device of an embodiment. This device is provided with an optical sensor unit 2 as an operation input detection unit on the surface of a screen 11 of a CRT 1 which is an example of an operation input position display surface for displaying a plurality of operation input positions so that the screen can be viewed. The display enlarging unit 3 is a touch panel type device in which an operation input is performed by bringing an operation body such as a finger of an operator close to the screen 11, and is a display enlarging unit 3 as a display enlarging unit that selectively enlarges the display of the operation input position.
A detection magnifying section 4 as a detection magnifying means for expanding the detection range of the optical sensor unit 2, a judging section 5 as a judging means for judging whether to activate the display and detection magnifying sections 3 and 4, and its judgment. And a control device 6 as control means for controlling the display and detection enlargement unit to operate.

The operation switch is graphically displayed on the screen 11 of the CRT 1, and the operator can press the operation switch with the same feeling as operating an actual operation button by looking at this display. As the operation input position display surface, CR
Besides T, a liquid crystal panel or the like can be used.

The optical sensor unit 2 is operated by the operator using his / her finger or the like.
When the target operation switch among the operation switches displayed on the RT screen 11 is pressed, the position is detected and the processing unit 2-
1 and the processing unit 2-1 outputs an operation signal as if the operation switch at that position was pressed. That is, in the optical sensor unit 2, as shown in FIG. 2, a large number of light beams (for example, n light beams) such as laser beams are provided from one side in the X and Y directions orthogonal to each other to surround the screen of the CRT toward the other side. ) It is fired, and this is received by the other side, but when the light is blocked by the operation body such as a finger by the operation of pressing the switch, the sensor of coordinates (i, j), for example, detects the finger etc. as its position, The operation switch K corresponding to the coordinates is detected,
It is output as if this switch was pressed. However,
As a plurality of adjacent coordinates, for example, (h, i), (i,
When at least one of h), (h, h), and (i, i) is detected, one operation switch K can be output as if it was pressed. By increasing the number of detection points in one switch in this way, the detection unit can be enlarged at a fine pitch.

When an operation signal is transmitted from the operation switch K in this way, a drive unit such as a mechanical device (not shown) operates in response to the switch being turned on. When the operation mode is sequentially changed by the sequence operation, the operation switch corresponding to the next operation mode is displayed on the CRT screen. As the operation input detection unit, in addition to the one using an optical sensor, a touch switch that forms an electric circuit in the X and Y directions and operates with a pressing force of a finger or the like, or a sensor that detects infrared rays or electrostatic capacitance is used. be able to.

The display enlarging section 3 is provided in the CRT 1 and enlarges the screen near the operated switch on the CRT screen to a predetermined magnification. The detection enlarging unit 4 constitutes a part of the processing unit 2-1, and when an operation body such as a finger is detected within the section of the operation switch on the enlarged screen, the operation switch is output by the optical sensor unit 2. The operation signal is output as if was pressed.

The judgment unit 5 judges from the various conditions whether or not enlarged display and detection are necessary. Such conditions include the size of the operating body such as a finger, the presence / absence of an operation error, the number of operation errors, the error rate, whether the operator brings his / her face close to the CRT screen, and the movement of the operator's finger. There is stability (expansion because the operator cannot press the section of the operation switch accurately because the operator is clumsy and his fingers are not stable). In the present embodiment, the determination unit 5 is the second optical sensor unit 51 as a size detection unit that detects the size of the operating body such as the finger of the operator.
And a comparator 52 as a size comparing means for comparing the size detected thereby with a predetermined value.

The second optical sensor unit 51 is similar to the optical sensor unit 2 shown in FIG. 2, but has a finer sensor pitch than the optical sensor unit 2 and has X as the size of an operating body such as a finger. The approximate size in the Y direction can be detected. For example, if sensors from i-2 to i + 1 detect an object in the X direction, this object has a size of (i + 1)-(i-2) + 1 = 4 sensor pitches in the X direction. However, the detection accuracy may be improved by using an optical sensor capable of continuous scanning in the X and Y directions.
When the optical sensor unit 2 has a relatively fine detection pitch, the optical sensor unit 2 can also be used as the second optical sensor unit 51.

The comparator 52 compares the detected size of the operating body with a predetermined value. The predetermined value is, for example, about ½ of the size of the operation switch on the CRT screen so that an erroneous operation does not occur even if it is not enlarged. Furthermore, the size of about three times the size of a normal human finger is set as the second predetermined value. By doing this, if the operation switches on the CRT screen are small, or if the operator's fingers are thicker than normal people and cannot press the switches correctly, or if there are multiple people with handicap, etc. It is possible to discriminate the case where the user tries to operate it with his finger or palm.

As a result of the comparison by the comparator 52, the control device 6 does not operate the enlarging portions 3 and 4 when the detected size is smaller than the predetermined size, and is larger than the predetermined size but about three times as large as a human finger. When the size is smaller than the size, an operation signal is given to the enlargement units 3 and 4, and when the detected size is 3 times or more, the enlargement unit is not operated and the state is notified or other means such as voice input means is used. When the input means is provided, it is controlled to switch to it. With such control,
According to the characteristics of the operator, it is possible to prevent erroneous operation and expand the operation switch only when it is effective to enable quick and optimal operation.

FIG. 3 shows an example of operation when operating with such an operation panel device. In this example, the screen 11 of the CRT 1
The upper operation switch panel is displayed (S-1), and when the operator presses a specific operation switch on this panel, the size T of the operating body such as a finger or the like and its outline are displayed on the second optical sensor unit 51. The position is detected (S-2), and it is determined whether or not the dimension of T is within a first predetermined value which is, for example, about three times as large as a human finger (S-3). It is judged whether or not it is larger than the second predetermined value, which is slightly larger than the size of the human finger (S-4), and if it is larger, it is expected that an operation error will occur with the size of the displayed operation switch. Therefore, the predetermined position on the screen is enlarged by a predetermined magnification (S-5).

The predetermined position is, for example, the position of the operation switch in the approximate position portion of the operating body detected in (S-2) and the operation switch adjacent thereto, and the predetermined magnification is about 2 times. In this case, the detection range of the optical sensor unit 2 is also expanded at the same expansion ratio corresponding to the expansion ratio of the operation switch on the screen. When the enlarged switch to be operated is pressed correctly, the position is detected by the optical sensor unit 2 (S-6), and this is taken in as an input (S-).
7) One operation is completed.

When the dimension of T is larger than the first predetermined value, it is judged that the input by the operation switch panel is impossible,
Change the operation mode and input by voice (S-8,
9). If T is not larger than the second predetermined value, there is no risk of an operation error. Therefore, in the state of the screen as it is, the position of the pressed operation switch is detected in the same manner as in the normal operation, and the process is taken in as an input (S). -6, 7).

Even when the second optical sensor unit 51 is not provided and the optical sensor unit 2 is provided with the function, the above operation is possible. Further, in the above, the screen enlargement ratio is fixed, but the enlargement ratio is calculated in relation to the size of the finger and the size of the operation switch, and whether the display is enlarged or the input mode is changed according to the result. May be determined. Furthermore, whether or not there is an input error may be added as a factor for determining whether or not to enlarge.

FIG. 4 shows an operation example in the above case. In this example, an operation switch panel for a certain operation is displayed on the screen 11 of the CRT 1 (S-1), and when the operator presses a specific operation switch on this panel, it is determined whether there is an input reception error ( S-2), if there is an error, the size T of the operation body such as a finger is detected by the optical sensor unit 2.
Is detected to calculate the enlargement ratio (S-3), it is judged whether the enlargement ratio is within a predetermined reference value (S-4), and if it is within the reference value, an enlarged display is performed (S-5). ), The position is detected by the optical sensor unit 2 after waiting for re-input for this display (S-6, 7), and this is input-processed (S-8). If there is no input reception error, the operation position is detected as it is without being enlarged, and input processing is performed (S-7, 8). If the enlargement ratio is greater than or equal to the reference value, the operation mode is changed and input is made by voice or the like (S-9, 10).

FIG. 5 shows a method of using the initial input when calculating the enlargement ratio as described above. In the case of a series of input operations started from the initial input mode, the number of switches at the time of initial input is usually small, so it is difficult for operation mistakes to occur at this time, so the initial input is used to determine the finger size. To determine the enlargement ratio.

When the initial input mode is displayed (S-
1) Detecting the size T of a specific operator's finger as an operating body and determining whether this is within a reference value (S-2,
3) If it is within the reference value, the enlargement ratio A that is as large as possible is determined (S-4), and thereafter, the display is automatically enlarged at this enlargement ratio, and input processing is performed after waiting for input (S-5, 6). ,
7). If T is not within the reference value, the enlargement ratio corresponding to the size of T is calculated (S-8), and it is determined whether this is within the enlargement ratio A (S-9). Is enlarged (S-5), and if it is larger than that, it is impossible to enlarge and the mode is changed to input by voice or the like (S-10, 1).
1).

FIG. 6 shows another embodiment. For example, when an operating body such as a finger to be operated does not enter the detection range of the operation switch k shown in FIG. 2 and two or more lights are detected in either or both of the X and Y directions, it is an erroneous operation. . Also, if one switch is configured to detect multiple lights, it is normal operation if any one of them or only multiple lights are detected when it is operated. If there is another switch and the light of that switch is also detected at the same time, it will be an erroneous operation. In this example, the determination unit 5 as the determination unit is the same as the erroneous input detection unit 53 provided in the processing unit 2-1 of the optical sensor unit 2 as the erroneous input detection unit that detects an erroneous input during such an operation. , And a calculation comparator 54 as an erroneous input comparison means for comparing the detected erroneous input with a predetermined value. Upon receiving the erroneous input signal, the calculation comparator 54 calculates the number of times the erroneous input is received in succession, calculates the ratio of the erroneous input in all the inputs, and compares this with a predetermined value. The result is output to the control device 6. The control device 6 performs control such as enlarging the display or switching to another input mode according to the comparison result.

FIG. 7 also shows another example of the judging means. Judgment part 5
Has an object detection sensor 55 as an object detection means for detecting an object approaching the display surface within a predetermined distance. In this embodiment, the sensors 55 are provided at the four corners of the optical sensor unit 2, and a reflection type photo sensor, an infrared sensor or the like is used. When the operation switch on the CRT screen is small, the operator with weak eyesight cannot clearly see the range, and therefore the face is brought closer to the normal screen.
In such a case, the screen is enlarged to facilitate the operation.

[0029]

As described above, according to the present invention, input is performed as it is, input is performed after the display and detection are enlarged to facilitate the operation, or the operation panel is informed of the inability to operate, or another operation mode is selected. Since it is possible to change the input to, and input, it is possible to achieve prompt input and prevention of operation error according to the characteristics of the operator.

[Brief description of drawings]

FIG. 1 is an explanatory diagram showing an overall configuration of an operation panel device of an embodiment.

FIG. 2 is an explanatory diagram of an optical sensor unit of the operation panel device.

FIG. 3 is a flowchart showing an example of an operation of the operation panel device of the embodiment.

FIG. 4 is a flowchart showing another operation example.

FIG. 5 is a flowchart showing still another operation example.

FIG. 6 is an explanatory diagram showing an overall configuration of an operation panel device of another embodiment.

FIG. 7 is an explanatory diagram showing an overall configuration of an operation panel device of still another embodiment.

[Explanation of symbols]

 2 Optical Sensor Unit (Operation Input Detecting Section) 3 Display Enlarging Section (Display Enlarging Means) 4 Detection Enlarging Section (Detecting Enlarging Means) 5 Judgment Section (Judgment Means) 6 Control Device (Control Means) 11 CRT Screen (Operation Input Position) Display surface 51 Second optical sensor unit (size detection means) 52 Comparator (size comparison means) 53 False input detection unit (wrong input detection means) 54 Calculation comparator (wrong input comparison means) 55 Object detection sensor (object detection) means)

Claims (4)

[Claims] 1. An operation input detection unit is provided on the surface of an operation input position display surface for displaying a plurality of operation input positions so that the operation input position display surface can be viewed, and an operation body is provided on the operation input position display surface. In an operation panel device in which an operation input is executed by bringing them close to each other, a display enlarging means for selectively enlarging a display of the operation input position, a detection enlarging means for enlarging a detection range of the operation input detection unit, and the display. And a determination means for determining whether to activate the enlargement means and the detection and enlargement means, and a control means for controlling the display enlargement means and the detection and enlargement means to operate according to the determination of the determination means. Characteristic operation panel device. 2. The determining means comprises size detecting means for detecting the size of the operating body, and size comparing means for comparing the size detected by the size detecting means with a predetermined value. The operation panel device according to item 1. 3. The erroneous input detecting means for detecting an erroneous input during operation, and an erroneous input comparing means for comparing the erroneous input detected by the erroneous input detecting means with a predetermined value. The operation panel device according to claim 1, which is characterized in that. 4. The operation panel device according to claim 1, wherein the judging means has an object detecting means for detecting an object approaching the display surface within a predetermined distance.