JP5132028B2 - User interface device - Google Patents

Description

  The present invention relates to operability of a user interface device, particularly a user interface device having a liquid crystal panel or the like that can variably display numeric keys, operation buttons, and the like as a display unit.

  For example, as represented by ATM (Automatic Teller Machine), a user interface device in which a touch panel is provided on the surface of a display such as a liquid crystal panel has been put into practical use. This user interface device can change a key image or the like displayed on the liquid crystal panel according to a user operation. In recent years, a user interface device provided with a touch panel has been used as an operation means for small devices such as a mobile phone.

  However, when this type of interface device is applied to a small device such as a mobile phone, the operation area is inevitably narrowed. Therefore, if an equivalent number of operation buttons is displayed, the size of each operation button is reduced. Will be relatively small. Then, since this type of user interface cannot be provided with unevenness unlike a physical operation button or the like, the user cannot confirm the presence of a key to be operated by touch. For this reason, it becomes easy to invite an erroneous operation.

  In order to reduce such erroneous operations, conventionally, data input is facilitated by expanding a key or a key input reception area that is operated or is supposed to be operated when a user operation is detected. Input devices have been proposed (for example, Patent Documents 1 and 2).

JP-A-5-73196 JP 2002-91677 A

  However, in Patent Document 1, when the boundary of the key image is pressed, the key input reception area is enlarged and changed in order to reduce input mistakes after the next time, but the display of the key itself is not changed. In addition, since the input is confirmed without changing the display form of the key operated in response to one operation of “pressing”, there may be a case where the user does not notice that the operation is wrong.

  On the other hand, in Patent Document 2, when a key is selected, the selected key and its surrounding keys are enlarged and displayed, so that the user can easily confirm the selected key. Furthermore, since the user can select again by moving his / her finger when the selected key is wrong, it can be considered that the user is user-friendly at first glance. However, in Patent Document 2, even when it is desired to cancel the input after the enlarged display, the input is unconditionally determined by the key at the position where the finger is released from the touch panel, and thus it is not necessarily easy to use.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide a user interface device that is more suitable for preventing erroneous operations.

The user interface device according to the present invention includes a first display unit in which a user operation area for displaying an operation item operated by a user is set, and a second display unit in which the display area is set in proximity to the first display unit. And a detecting means for detecting a first user access to the user operation area and detecting a second user access to the user operation area with a further movement in the direction of the user operation area than the first user access. Control means for determining the second user access detected by the detection means as a confirming operation by a user, display control means for controlling a display form of operation items displayed on the first display means, and the detection A position specifying hand for specifying the first user access position on the user operation area when the first user access is detected by the means; The control means specifies an operation item corresponding to the first user access position specified by the position specifying means, and the display control means allows the first user access by the detection means. when it is detected, that only identified operation item to set the display area or in enlarging the image on the second display means by said control means in accordance with the elapsed time from the first user access detection time It is.

Further, the control means collates the reaction area set corresponding to each operation item to be displayed with the first user access position specified by the position specifying means, so that the first user access position is determined. When the operation item corresponding to the first user access is detected by the detection unit, the operation item is set corresponding to the operation item corresponding to the first user access position specified by the position specifying unit. The size of the reaction area is larger than the size of the operation item .

  According to the present invention, it is configured to detect two-stage user access of first and second, and the second user access is not performed until the second user access is performed following the first user access. Is determined as an input confirmation operation, so that an erroneous operation can be effectively prevented.

  In addition, since the display mode of the operation item is changed so that the operation item operated at the time of the first user access detection can be visually confirmed, the user operation can be easily confirmed, and an erroneous operation can be performed. Prevention can be achieved.

  In addition, the operation item corresponding to the first user access position is displayed in an enlarged manner, and information indicating the contents of the operation item is displayed at a position shifted from the operation part in the enlarged operation item display area. Therefore, the user can easily confirm which operation item is being operated.

  In addition, since the size of the reaction area set corresponding to the operation item is expanded in accordance with the enlarged display of the operation item, erroneous operation can be prevented more effectively.

  In addition, since the notification means is provided, it is possible to notify the user that the user is operating a part other than the operation item.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

Embodiment 1 FIG.
FIG. 1 is a schematic configuration diagram of a mobile phone to which an embodiment of a user interface device according to the present invention is applied. Two liquid crystal screens 2 and 3 are formed on the mobile phone 1 in the present embodiment. On the liquid crystal screen 2, a display area for displaying a telephone number or the like as a guide is formed. The liquid crystal screen 3 is formed with a user operation area that displays operation items and accepts an input operation by a user. In the present embodiment, the buttons 4 such as menus displayed on the liquid crystal screen 3 and operated by the user, numeric keys, and the like are collectively referred to as “operation items”. However, in the following description, “button” is used as a representative for convenience.

  FIG. 2 is a schematic diagram showing a structure when the liquid crystal screen portion on which the user operation area of the mobile phone 1 is formed is viewed from the side. As shown in FIG. 2A, the liquid crystal screen 3 is formed as a liquid crystal touch panel in which a touch panel 5, a liquid crystal panel 6, and a switch 7 are stacked inside the casing of the mobile phone 1. The operation on the liquid crystal screen 3 is performed by bringing a fingertip or a pen tip into contact with the touch panel 5. The touch panel 5 detects the contact operation and the contact position by the user. Note that the cellular phone 1 is usually operated with a button with a finger, and therefore in this embodiment, the user operation is performed with the fingertip. The liquid crystal panel 6 displays a button image in accordance with display control in the mobile phone 1 in the user operation area. The switch 7 is an on / off switch that detects that the liquid crystal screen 3 has been pressed. The switch 7 is arranged with a gap from the liquid crystal panel 6, and electrically detects a contact with the liquid crystal panel 6 or detects a pressure generated by the contact with the liquid crystal panel 6. 3 is detected.

  The liquid crystal screen 3 is attached to the mobile phone 1 so as to be movable toward the inside of the housing using a known mechanism, and has a structure that is pushed into the inside of the housing when the touch panel 5 is pressed by the user. ing. That is, the structure of the liquid crystal screen portion will be described with reference to FIG. 2. The user can select any button (not shown) displayed in the user operation area of the liquid crystal screen 3 as shown in FIG. When the button is pressed, the fingertip is moved closer to the liquid crystal screen 3. The fingertip will eventually come into contact with the liquid crystal screen 3 by the movement. The touch on the liquid crystal screen 3 is detected by the touch panel 5. Subsequently, when the user further presses the liquid crystal screen 3, the liquid crystal screen 3 is pushed toward the inside of the housing. In FIG. 2B, this depressed state is indicated by a gap 8 between the touch panel 5 and the casing of the mobile phone 1. The switch 7 detects a user operation of pressing that is subsequently performed after touching the touch panel. When the fingertip is released, the liquid crystal screen 3 returns to the original position shown in FIG.

  The liquid crystal screen 3 in the present embodiment has the above-described structure, but in the present embodiment, the touch operation to the touch panel 5 as described above, and the direction in which the touch panel 5 is further pushed after the touch is performed. It is configured to detect a two-stage user operation of a fingertip movement, that is, a pressing operation. Then, if the first contact operation detected by the touch panel 5 is referred to as first user access and the pressing operation after the first contact detected by the switch 7 is referred to as second user access, in the present embodiment, The second user access performed after the first user access is regarded as a confirmation operation by the user. In other words, in the present embodiment, a user interface of a two-step operation or a two-press operation of further pressing after touching the liquid crystal screen 3 is provided, and the second-step (second press) operation is determined as a confirmation operation by the user. It is characterized by doing so.

  FIG. 3 is a block diagram of the user interface device according to the present embodiment. 3 shows a display unit 10, a display control unit 11, a position specifying unit 12, a first operation detection unit 13, a second operation detection unit 14, a control unit 15, and a notification unit 16. The display unit 10 is realized by the liquid crystal panel 6 described above. The display control unit 11 displays operation items such as buttons operated by the user in the user operation area set in the display unit 10 based on display data sent from the display control function of the mobile phone body. The display data includes data necessary for display such as the shape, display position, and color of each operation item displayed on the liquid crystal panel 6. Moreover, although mentioned later for details, the display control part 11 performs display control of changing the display form of an operation item according to user operation. The detection unit 17 includes a first operation detection unit 13 that detects a first user access to the user operation area, and a second operation detection unit 14 that detects a second user access to the user operation area after the first user access. And have. The first user access detected by the first operation detection unit 13 corresponds to the touch operation on the touch panel 5 exemplified above, and is realized by the touch panel 5. On the other hand, the second operation detection unit 14 corresponds to a pressing operation on the touch panel 5 and is realized by the switch 7.

  The position specifying unit 12 specifies the position where the first user access is made on the user operation area when the first user access is detected. More specifically, an electrical signal that can specify the position on the touch panel 5 that is touched by the user's fingertip is output. The position specifying unit 12 is realized by the touch panel 5. The control unit 15 obtains the coordinate data of the user contact position obtained based on the signal data sent from the position specifying unit 12 and the display position of each button specified from the display data acquired via the display control unit 11. The button 4 operated by the user by comparison is identified. The control unit 15 also performs operation control of the entire other user interface device. The notification unit 16 notifies the user when the control unit 15 cannot identify the button corresponding to the first user access position.

  In addition, although the component required for description of the user interface apparatus in this Embodiment was shown in FIG. 3, these components can be implement | achieved by suitably incorporating in the existing component which a mobile telephone has. For example, the processing functions of the control unit 15 and the display control unit 11 can be realized by being incorporated in a control circuit mounted on the mobile phone 1. The notification unit 16 can be realized by a speaker or the like.

  Next, the operation in the present embodiment will be described using the transition diagram of the screen display example shown in FIG.

  As shown in FIG. 4A, character input buttons from “A” to “L” are displayed in the user operation area of the liquid crystal screen 3. Here, it is assumed that the user selects to input “B”. In order to input the “B” button displayed on the liquid crystal screen 3, the user touches the touch panel 5 of the liquid crystal screen 3 with the fingertip aligned with the “B” button. The first operation detection unit 13 detects the contact of the fingertip, and at the same time, the position specifying unit 12 specifies the contact position in the user operation area. Based on the user contact position specified by the position specifying unit 12, the control unit 15 specifies the button that the user intends to operate as follows.

  The control unit 15 obtains display data to be displayed in the user operation area from the display control unit 11, thereby grasping the display area of each button in the user operation area as position coordinate data. Then, the display area of each button is projected onto a separately prepared area having the same size as the user operation area. As a result, region information for comparison with the user contact position is generated. The area information for comparison with the position operated by the user is referred to as “reaction area”. The reaction area is coordinate data generated for each button and used by the control unit 15 to identify the button operated by the user. This is different from the display data used by the display control unit 11 for display. The reaction area is designated by the coordinate data, but the control unit 15 obtains the position coordinate data obtained based on the user contact position specified by the position specifying unit 12 and the reaction area corresponding to each displayed button. Are compared to specify which reaction region the user contact position is included in. And it determines with the button corresponding to the identified reaction area | region being the button operated by the user. According to the processing in the control unit 15, according to the example shown in FIG. 4, it can be specified that the “B” button has been operated.

  By the way, information indicating the contents of each button as shown in FIG. 4A, in this case, characters “A” to “L” are usually displayed on the button. In the case of a small device such as the cellular phone 1, especially when the button is operated with a finger, characters displayed on the button are covered with the fingertip and cannot be visually recognized. Therefore, in the present embodiment, when the control unit 15 specifies that the “B” button is operated in the first user access as described above, the display control unit 11 is shown in FIG. As shown, the corresponding “B” button is enlarged and displayed. In FIG. 4B, the “A” button is enlarged so as to be hidden. However, since the “A” button is not selected, it is considered that there is no problem even if it is hidden. Then, the display control unit 11 displays the character “B” on the enlarged “B” button at a position shifted from the fingertip. Thereby, the user can easily visually recognize that the operated button is the “B” button.

  The enlargement size or enlargement ratio of the button may be set in advance as a fixed value. However, since the position of the user's fingertip can be specified, the character is determined from the position and the size of the estimated operation part (in this example, the fingertip) The display position of “B” can be obtained by calculation. Therefore, the “B” button may be enlarged and displayed so as to include the display position of the character “B”. Thereby, the user can always visually recognize the character “B”.

  Furthermore, in the case of a small device, since the button itself is small, the characters displayed on the button are also small. Therefore, as illustrated in FIG. 4B, it is preferable for the user to display the characters themselves together with the buttons. Note that the magnification of the characters and buttons may be the same or different.

  When the user touches the touch panel 5, the screen shown in FIG. 4B is displayed as described above. When it is confirmed that the user can operate the “B” button to be input, the user presses the “B” button. When the switch 7, that is, the second operation detection unit 14 detects this pressing operation, the control unit 15 determines that the pressing operation on the “B” button is a confirmation operation by the user. Note that “Pi!” In FIG. 4C indicates a sound for informing the user that it has been confirmed by the pressing operation. The same applies to the other drawings.

  As described above, according to the present embodiment, the user can confirm which button is being operated by, for example, enlarging and displaying the button by a contact operation (first user access) with respect to the user operation area. The input is confirmed by a pressing operation (second user access) on the user operation area performed following the contact operation. From the viewpoint of the user, since the button to be pressed is enlarged when the button is touched before the input is confirmed by pressing, an erroneous input can be prevented. If it is visually confirmed that an incorrect button is to be operated before the button is pressed, that is, when the user touches the user operation area, the operation may be performed again. Even if the fingertip moves away from the liquid crystal screen 3 at this time, this operation is not regarded as an input confirmation operation.

  As described above, the present embodiment provides a user interface by a two-step operation (double-pressing operation) for confirming a button by an enlarged display of the button or the like and confirming an input. However, it does not force the user to perform a two-step operation. That is, when the user performs a pressing operation for confirmation, the contact operation is always performed before the pressing operation, so the user does not need to consciously execute the two-stage operation. . From the user's point of view, a series of operations may be performed, and the interface device according to the present embodiment processes as a two-stage operation in the internal processing described above. Of course, the user may not perform further push-in operation when the user makes a conscious contact operation. In this case, the enlarged display of the button is maintained.

  FIG. 5 is a transition diagram of a screen display example corresponding to the modification of FIG. In the above description, as shown in FIG. 4, the buttons are enlarged and displayed within the display range of the liquid crystal screen 3 on which the user operation area is formed. On the other hand, in FIG. 5, the buttons are displayed by enlarging the liquid crystal screen 2 on which the guide display area is formed. Thus, the button may be enlarged and displayed without being limited to the user operation area.

  6 to 9 are transition diagrams showing further different screen display examples. In FIG. 4, when a touch operation is performed, the display mode of the operated button is displayed differently from that before the operation. However, it may be possible to identify whether the button is operated by changing the display form of buttons other than the operated button. FIG. 6 shows an example in which buttons other than the operated “B” button are displayed lightly. In this way, it is possible to make the operated button stand out by dimming the display of the button that has not been operated, deleting it, or changing the color, thereby improving the effect of preventing erroneous input. be able to.

  FIG. 7 shows an example in which the button display form is determined according to the distance from the operated button. That is, according to the display example shown in FIG. 7B, the user operates the “B” button, but if it is an erroneous operation, the button to be correctly selected is considered to be around the “B” button. It is done. Therefore, the operated “B” button is enlarged and displayed in the same manner as described above, but the “A” and “C” buttons adjacent to the “B” button are also enlarged to indicate the existence of the button to the user. However, the degree of enlargement is slightly reduced so that it can be distinguished from the operated “B” button. Further, the “D” to “F” buttons located in the lower part of the “B” button are displayed in a reduced size. This is because the probability that a correct button exists among the “D” to “F” buttons is lower than those of the “A” and “C” buttons. Further, the “G” to “I” buttons located in the lower row are displayed lightly. This is because the probability that the correct button exists among the “G” to “I” buttons is lower than that of the “D” to “F” buttons. That is, the importance is further reduced. Actually, it is considered that it is not usually wrong to push a position shifted by two steps, so that it is not necessary to display it.

  The present embodiment is characterized in that the display form is changed in accordance with the distance from the position of the operated button. For example, the “E” button directly below the “B” button is “A”. The buttons “D” to “F” may be enlarged and displayed because they are located around the “B” button.

  FIG. 8 shows an example in which a button operated in the same manner as in FIG. 4 or the like is displayed in an enlarged manner, but the button is displayed so as to gradually expand in accordance with the elapsed time from the detection time of the contact operation. Yes. Thereby, confirmation operation can be alerted to a user. As an example of changing the display form of the button, the case where the size of the button is changed is shown in FIG. 8, but other display forms such as the display color may be changed.

  As described above, in the present embodiment, it is possible to notify the user which button is being operated by changing the display form of the operated button. In order to change the button display form, the operated button must be specified. This operated button generates a reaction area for each button from the display data indicating the button layout, and It is specified by comparing each generated reaction area with the user contact position. This process has been described above. However, the user contact position may not be included in any reaction region. As described above, when the button corresponding to the user contact position cannot be specified, the control unit 15 causes the display control unit 11 to enlarge and display the button near the user contact position. An example of the screen display at this time is shown in FIG. As shown in FIG. 9A, when neither button is operated above the “A” button and the “B” button, the control unit 15 is in the vicinity of the contact position from the user contact position. Specify the “A” and “B” buttons. Then, the display control unit 11 enlarges and displays the specified “A” and “B” buttons as illustrated in FIG. 9B. As a result, the user confirms the input by pressing the “A” button to be selected as shown in FIG. In FIG. 9B, the finger as the operation part is omitted from the drawing in order to clearly show the enlarged button.

  According to the present embodiment, when a user touches a user operation area where no button is displayed, it is estimated which button is to be operated based on the user contact position, and the button is enlarged and displayed. As a result, button operation is facilitated, which is effective in preventing erroneous operation. In this example, two buttons are enlarged and displayed, but the number of buttons to be enlarged is determined by the contact position of the user. For example, in the upper left of the “A” button, only the “A” button is enlarged and displayed. In addition, four buttons are enlarged and displayed between the “A”, “B”, “D”, and “E” buttons.

  Further, the control unit 15 issues a notification instruction to the notification unit 16 when the user touches a user operation area in which no button is displayed. The notification unit 16 notifies the user to that effect by a predetermined method in accordance with an instruction from the control unit 15. For example, in the case of the mobile phone 1 as in the present embodiment, the predetermined method may be sound output, or may be driven to vibrate and vibrate. Moreover, you may make it notify through a user's five senses by other methods, such as light emission. In the case of the touch panel 5, even if a part other than the button is touched, this is not transmitted as a tactile sense. Therefore, it is effective to provide the notification unit 16 to notify the user of that fact.

  By the way, the button accessed by the user (contact, pressed) is not by comparing the coordinate data of the position operated by the user with the display area of the button obtained from the display data, but by projecting the display area of each button. As described above, it is specified in comparison with each reaction region generated. When the reaction area is generated by projecting the display area of each button as described above, the display area of each button and the size of the reaction area match. For this reason, the user can actually perform the button operation by operating the display position of the button. As described with reference to FIG. 4 to FIG. 8, when it is confirmed that the correct button is operated by the enlarged display of the button, the user performs a pressing operation at that position without moving the fingertip from the contact position. Can be guessed. Therefore, it is not always necessary to enlarge the reaction area in conjunction with the enlarged display of the button. However, it may be convenient if the reaction area is expanded in conjunction with the increase in button size. For example, as shown in FIG. 9, after touching a place other than the button, the position of the fingertip must be moved. In such a case, if the reaction area is generated with the same size as the enlarged display of the “A” and “B” buttons and the display area (display size), an erroneous operation can be effectively prevented. Regarding the generation of the reaction region, when the display form is changed by the display control unit 11 as described above, the control unit 15 can acquire the display data from the display control unit 11 and regenerate the reaction region. That's fine.

  The generation of the reaction region is not limited to FIG. 9, but can be applied to the display as shown in FIG. 8 in which the size of the button changes with time. The reaction area corresponding to FIG. 8 is shown in FIG. 10, but as is clear from FIG. 10, by regenerating the reaction area according to the change in the size of the button, the display area of the button and the size of the reaction area are shown. Can always be matched.

  Furthermore, the size of the reaction area does not necessarily have to coincide with the display area of the button. For example, the reaction area may be generated so as to be wider than the display area. In a small-sized device in which a liquid crystal screen such as a mobile phone exemplified in this embodiment and a remote control or an in-vehicle information device is used as an input interface and the operation buttons to be displayed must be made small, the probability of an input error is inevitably It will be high. In particular, in a mobile phone that is not stationary, such as when riding, or a mobile phone that is frequently input with a single hand, the fingertip may be displaced from the button during the investigation. If the size of the reaction area is made larger than the display area, a slight shift in the operation position can be allowed, so that the user interface provided by this embodiment is particularly effective in preventing erroneous operations.

  In this embodiment, a user interface called a two-stage operation (pressed twice) is provided as an input method, thereby facilitating confirmation of the operation and preventing an erroneous operation. In the above example, the button is enlarged and displayed by the touch operation (first user access) to the user operation area in the two-stage operation, and input is performed by the pressing operation (second user access) performed subsequently to the user operation area. Although it is determined, for example, when the first user access is detected, each user access may be associated with other processing such as displaying the information assigned to the button on the screen.

  In the present embodiment, the switch 7 is disposed below the liquid crystal panel 6 to detect the second user access. However, the present invention is not limited to this configuration. For example, the second user access may be detected by other means such as detecting a gap 8 between the casing of the mobile phone 1 and the touch panel 5.

Embodiment 2. FIG.
In the first embodiment, a user interface of a type in which an input is confirmed by pressing the liquid crystal screen 3, that is, a push switch type user interface is shown. Each embodiment to be described below provides an interface of a type different from that of the first embodiment. Since the display form is the same as that of the first embodiment, the description thereof will be omitted, and only the structure of the liquid crystal screen 3 part incorporated in the mobile phone 1 will be described.

  FIG. 11 is a conceptual diagram when the liquid crystal screen 3 according to the present embodiment is viewed from the front side. FIG. 12 is a schematic diagram showing a structure when the liquid crystal screen 3 portion of the mobile phone 1 is viewed from the side, and corresponds to FIG. 2 used for the description of the first embodiment.

  The liquid crystal screen 3 in the present embodiment is formed by a touch panel 5 and a liquid crystal panel 6. Then, the light emitting element 20 that emits the infrared light 22 and the light receiving element 21 that receives the infrared light are combined and arranged on the surface side of the liquid crystal screen 3. The light emitting element 20 is configured to always emit the infrared light 22 while the mobile phone 1 is in use, and to detect a fingertip that tries to touch the touch panel 5 when the infrared light 22 is blocked.

  That is, in the first embodiment, the touch operation on the touch panel 5 is detected as the first user access. However, in the present embodiment, as shown in FIG. Detect as. Then, the configuration is such that the detection of the object by the infrared sensor means including a set of a large number of light emitting elements 20 and light receiving elements 21 is detected as the second user access as shown in FIG. It is said.

  The block configuration of the apparatus in the present embodiment can be represented in FIG. However, in the case of the present embodiment, the first operation detection unit 13 and the position specifying unit 12 are realized by infrared sensor means including the light emitting element 20 and the light receiving element 21, and the second operation detection unit 14 is realized by the touch panel 5. Is done.

  Since the operation in the present embodiment is basically the same as that in the first embodiment, the description thereof will be omitted. However, when detecting the first user access, it is necessary to specify the detection position of the user's fingertip. In consideration of the size of 3 and the like, the number of infrared rays irradiated vertically and horizontally is adjusted. When detecting the first user access, at least one infrared ray is cut off by the fingertips in the vertical and horizontal directions, so that the control unit 15 identifies the user access position by detecting the light receiving state of each light receiving element 21. Can do.

Embodiment 3 FIG.
FIG. 13 is a schematic view showing the structure of the mobile phone 1 according to the present embodiment when the liquid crystal screen 3 is viewed from the side, and corresponds to FIG. 2 used in the description of the first embodiment. The liquid crystal screen 3 in the present embodiment is formed by a touch panel 5 and a liquid crystal panel 6. When the touch panel 5 is pressed with the fingertip, the size of the contact surface of the fingertip with the touch panel 5 changes. Explaining in more detail using FIG. 13, the contact surface 30 of the fingertip when touching the touch panel 5 as shown in FIG. 13A is small as shown in FIG. 13B. When the user presses down the touch panel 5 as shown in FIG. 13 (c), the contact surface 31 of the fingertip when touching the touch panel 5 is touched as shown in FIG. 13 (d). The area of the contact surface 30 becomes larger.

That is, in the present embodiment, the contact operation when the fingertip first touches the touch panel 5 is detected as the first user access. This is the same as in the first embodiment. However, in the present embodiment, the contact operation when the contact area with respect to the touch panel 5 increases to a predetermined reference value or more with respect to the contact area with respect to the touch panel 5 at the time of the first user access is the second user access. Detected as. When the contact area on the touch panel 5 increases beyond a predetermined reference value, the contact area at the time of the second user access exceeds the reference value (mm ² ), or at the time of the first user access. When the installation area at the time of the second user access is increased to a reference value (increase rate (%)) or more with respect to the contact area obtained in step (b).

  The block configuration of the apparatus in the present embodiment can be represented in FIG. However, in the case of the present embodiment, the second operation detection unit 14, the first operation detection unit 13, and the position specifying unit 12 are realized by the touch panel 5, but the determination of the detection time of the second user access is detected. This is done by the control unit 15 in accordance with a predetermined reference value based on an electrical signal from the touch panel 5 as means.

Embodiment 4 FIG.
FIG. 14 is a schematic view showing a structure of the liquid crystal screen 3 portion of the mobile phone 1 according to the present embodiment when viewed from the side, and corresponds to FIG. 2 used in the description of the first embodiment. The liquid crystal screen 3 in the present embodiment is formed by the touch panel 40 and the liquid crystal panel 6, but the touch panel 40 in the present embodiment is an electrostatic type touch panel, and is electrostatic when the fingertip approaches even if it is not touched. The capacity changes.

  That is, in the present embodiment, as shown in FIG. 14A, when a fingertip approaching and touching the touch panel 40 is detected due to a change in capacitance, the non-contact operation to be touched is detected. Is detected as the first user access. And as shown in FIG.14 (b), when a fingertip approaches further the touch panel 40 and contacts the touch panel 40, this contact operation is detected as a 2nd user access. This second user access detection is the same as in the second embodiment.

  The block configuration of the apparatus in the present embodiment can be represented in FIG. However, in the case of the present embodiment, the second operation detection unit 14, the first operation detection unit 13, and the position specifying unit 12 are realized by the touch panel 40.

  As described above, the four types of user interfaces have been described in the respective embodiments. For the switch type shown in the first embodiment, the user operation area itself of the liquid crystal screen 3 moves together with the fingertip. In either type, the fingertip further moves from the first user access detection position to the liquid crystal screen. An operation involving movement in the direction 3 of the user operation area was detected as the second user access. In this way, the user interface directed to the liquid crystal screen 3 is detected in two stages, the operation content is confirmed in the first stage, and the input is confirmed in the second stage. It can be made easy and erroneous operation can be prevented.

  In the above description, four types of user interfaces have been described. However, the present invention is not limited to the above four types. For example, a temperature-sensitive type that detects a temperature change of the touch panel due to a fingertip contact is employed in the present invention. Various detection means can be applied.

1 is a schematic configuration diagram of a mobile phone to which an embodiment of a user interface device according to the present invention is applied. It is the schematic which showed the structure when the liquid crystal screen part in which the user operation area | region of the mobile telephone in Embodiment 1 is formed is seen from the side. 1 is a block configuration diagram of a user interface device according to Embodiment 1. FIG. 6 is a diagram illustrating transition of a screen display example when the mobile phone in Embodiment 1 is operated. FIG. FIG. 10 is a diagram showing transition of another screen display example when the mobile phone in the first embodiment is operated. FIG. 10 is a diagram showing transition of another screen display example when the mobile phone in the first embodiment is operated. 6 is a diagram illustrating transition of a screen display example when the mobile phone in Embodiment 1 is operated. FIG. 6 is a diagram illustrating transition of a screen display example when the mobile phone in Embodiment 1 is operated. FIG. 6 is a diagram illustrating transition of a screen display example when the mobile phone in Embodiment 1 is operated. FIG. 3 is a diagram showing a reaction area for recognizing an operation on a mobile phone in the first embodiment. FIG. It is the schematic when the liquid crystal screen part in which the user operation area | region of the mobile telephone in Embodiment 2 is formed is seen from the outside. It is the schematic which showed the structure when the liquid crystal screen part in which the user operation area | region of the mobile telephone in Embodiment 2 is formed was seen from the side. FIG. 10 is a schematic diagram showing a structure when a liquid crystal screen portion on which a user operation area of a mobile phone in Embodiment 3 is formed is viewed from the side. FIG. 10 is a schematic diagram showing a structure when a liquid crystal screen portion on which a user operation area of a mobile phone in Embodiment 4 is formed is viewed from the side.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Mobile phone, 2,3 Liquid crystal screen, 4 buttons, 5,40 Touch panel, 6 Liquid crystal panel, 7 Switch, 8 Gap, 10 Display part, 11 Display control part, 12 Position specification part, 13 1st operation detection part, 14 2nd operation detection part, 15 control part, 16 notification part, 17 detection means, 20 light emitting element, 21 light receiving element, 22 infrared rays, 30 contact surface, 31 contact surface.

Claims (2)

First display means in which a user operation area for displaying operation items operated by a user is set;
A second display means in proximity to the first display means and having a display area set;
Detecting means for detecting a first user access to the user operation area, and detecting a second user access to the user operation area accompanied by movement in the direction of the user operation area further than the first user access;
Control means for determining the second user access detected by the detection means as a confirmation operation by the user;
Display control means for controlling the display mode of the operation items displayed on the first display means;
A position specifying means for specifying a first user access position on the user operation area when a first user access is detected by the detecting means;
Have
The control means specifies an operation item corresponding to the first user access position specified by the position specifying means,
When the first user access is detected by the detection unit, the display control unit displays only the operation item specified by the control unit according to the elapsed time from the first user access detection time . user interface device, characterized in that the display area is set to the display means or in enlarging the image.   The control means corresponds to the first user access position by comparing the reaction area set corresponding to each displayed operation item with the first user access position specified by the position specifying means. In the case of specifying the operated item, the reaction area set in correspondence with the operation item corresponding to the first user access position specified by the position specifying unit when the first user access is detected by the detecting unit The user interface device according to claim 1, wherein the size of is larger than the size of the operation item.

Images