JP2017215698A - User interface device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a user interface device capable of preventing consumption of electric power during not in use by a user, wearing of elastic surface and poor in storability.SOLUTION: The user interface device for detecting a depression input made by a user, includes: an input part having an elastic surface which is deformably formed of an elastic member; deformation means that deforms the elastic surface; depression operation detection means that detects a depression operation made on the input part; and a user usage state detection means that detects usage state by the user. The elastic surface is configured to be deformed in a shape other than a convex shape on the basis of a piece of information from the user usage state detection means.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a user interface device, and more particularly, to a user interface device with touch detection.

  Conventionally, in an information display / input device in which a so-called touch panel is arranged on a display such as a liquid crystal panel, for example, an image of a virtual button or the like is displayed on the display screen. In this state, when the user touches the touch panel area corresponding to the display position of the virtual key with the fingertip or the stylus pen tip, the information assigned to the virtual button may be input or selected. Made possible. Since such a touch panel is substantially flat and relies on visual guidance for user input, it is difficult to distinguish adjacent buttons by touch and it is essentially difficult to input data accurately.

  Therefore, user interfaces that can provide tactile guidance have been proposed.

  Patent Document 1 discloses a user interface that allows a user to be given tactile guidance by deforming a partial region of the surface by expanding a cavity below the surface layer.

  Patent Document 2 discloses a user interface expansion system for attaching a sheet that provides tactile guidance to an electronic device such as a portable terminal via an attachment member.

Special table 2011-508935 gazette Special table 2012-532384 gazette

  However, in the prior art disclosed in the above-mentioned patent document, there is only a description in Patent Document 2 that activates a partial region of the elastic member when the mounting member is driven. There is no description on how to control the shape. Therefore, if the elastic surface of the user interface is maintained in a convex shape when the user is not in use, power consumption for maintaining the convex shape is started, and the elastic surface of the convex tip portion is worn and the storage property is reduced. .

  SUMMARY OF THE INVENTION An object of the present invention is to provide a user interface device that can prevent waste of power when the user is not in use, wear of an elastic surface, and deterioration of storage performance.

In order to achieve the above object, a user interface device according to the present invention provides:
In a user interface device that detects a pressing input by a user, an input unit having an elastic surface that is deformable by an elastic member, a deformation unit that deforms the elastic surface, and a pressing operation that detects a pressing operation on the input unit The elastic surface is deformed into a non-convex shape based on information from a detection unit, a user usage state detection unit that detects a user usage state, and the user usage state detection unit.

  ADVANTAGE OF THE INVENTION According to this invention, the user interface apparatus which enabled it to prevent the waste of electric power at the time of non-use of a user, abrasion of an elastic surface, and the fall of storage property can be provided.

1 is a configuration diagram of a user interface device according to a first embodiment. Cross-sectional configuration diagram of the tactile sense UI of each button in the first embodiment The figure which shows the relationship between the central processing part in Example 1, each detection means, and a tank part. The schematic diagram of the user non-use state in Example 1 The schematic diagram of the user non-use state in Example 1 Flow chart showing flow of user non-use state detection and elastic surface deformation in embodiment 1 Schematic diagram of a user non-use state in the second embodiment Schematic diagram of a user non-use state in the second embodiment Flow chart showing flow of user non-use state detection and elastic surface deformation in embodiment 2 Schematic diagram of the user non-use state in the third embodiment Flowchart showing flow of user non-use state detection and elastic surface deformation in embodiment 3

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  Hereinafter, a user interface device according to a first embodiment of the present invention will be described with reference to FIGS. In the present embodiment, a user interface of a keyboard of a tablet terminal will be described as an example of a user interface device.

  FIG. 1 shows the configuration of a user interface apparatus according to the first embodiment of the present invention.

  The user interface device according to the present embodiment is a user interface provided in the tablet terminal 1 and further having a keyboard function of the tablet terminal 1.

  The tablet terminal 1 has a display screen 10, and the display screen 10 has a character / number button group 11. The character / number button group 11 is displayed with numerals “0” to “9”, Roman letters, hiragana, Enter, Alt, Ctrl, Shift, Delete, symbols of four arithmetic operations, and the like. Part. Further, the tablet terminal 1 has a tank unit 12 connected to the character / number button group 11.

  The tablet terminal 1 has various functions, and the display screen 10 performs various displays or input detections according to the functions. In addition, the display screen 10 has a generally flat surface. However, in order to give a tactile guidance to the user, a display area (input portion) that can be deformed into a convex or concave shape (input) Tactile user interface: hereinafter also referred to as a tactile UI). When used as a keyboard as in the present embodiment, the elastic surface of each button of the character / number button group 11 is deformed into a convex or concave shape by a tactile sense UI.

  As shown in FIG. 1, the tablet terminal 1 includes incident light detection means 13 and a central processing unit 14 that detect incident light on the surface of the user interface. The incident light detection means 13 is, for example, an optical sensor or a camera.

  FIG. 2 is a diagram showing a cross-sectional configuration of the tactile sense UI of each button. FIG. 2A shows a state where the tactile UI is flat. FIGS. 2B and 2C are views showing a state in which the tactile UI is deformed into a convex shape and a concave shape, respectively, in order to give a tactile guidance to the user.

  The tactile sense UI includes a transparent sheet 101, a transparent substrate 102, a cavity 103, a touch sensor 104, a display 105, and a pump 110.

  The transparent sheet 101 is formed of a stretchable transparent elastomer material or the like. It is provided on the surface of the display screen 10 and is arranged so as to cover substantially the entire surface of the display screen 10. Further, the transparent sheet 101 is formed by an elastic member so as to be deformable, and a partial region of the transparent sheet 101 is configured as an elastic surface, deforms when the cavity 103 expands, and deforms when the cavity 103 contracts, in a normal planar state or concave shape It functions to deform.

  The transparent substrate 102 functions to support the transparent sheet 101 and partially define the cavity 103. The transparent substrate 102 is preferably hard.

  As shown in FIGS. 2A, 2B, and 2C, the cavity 103 functions to hold the fluid and change the volume state by contraction and expansion. The fluid is preferably a liquid, but may be a gas or other material. The cavity 103 is connected to the pump 110 via a flow path.

  The pump 110 functions to change the volume of the fluid in the cavity 103, expands the cavity 103 from the contracted volume state to the expanded volume state, and finally, a partial region (cavity) of the transparent sheet 101. The upper part of the part is deformed. The volume in the cavity 103 is changed by adding (inflowing) and removing (outflowing) the fluid from the pump 110. Therefore, the expansion amount of the volume of the cavity 103 can be changed by controlling the additional amount of the fluid. That is, the shape of the elastic surface of the tactile UI can be controlled.

  FIG. 2A shows a state where the transparent sheet 101 is flat. FIG. 2B shows a state in which the cavity 103 is expanded and the transparent sheet 101 is deformed into a convex shape. FIG. 2C shows a state in which the cavity 103 is contracted and the transparent sheet 101 is deformed into a concave shape.

  The touch sensor 104 is, for example, a conventional capacitive touch sensor, and detects a user input to the button based on a change in capacitance caused by the proximity of a fingertip or a stylus pen tip.

  Display 105 functions to interface with the user in a visual manner, such as a conventional liquid crystal display.

  As described above, the tactile UI can form a convex or concave shape on the display screen 10, and is used in combination with a graphic for guiding the input displayed on the display 105, thereby informing the input position on the touch sensor 104. Function as.

  FIG. 3 is a diagram illustrating a relationship among the central processing unit, each detection unit, and the tank unit in the first embodiment.

  As shown in FIG. 3, the central processing unit 14 includes a user usage state detection unit 15 that detects a user usage state and a time detection unit 16 that performs time measurement.

  Based on information from the touch sensor 104, incident light detection means 13, and time detection means 16, the central processing unit 14 detects the user use state in the user use state detection means 15, and controls the pump 110 to display the display screen. Control the shape of each of the 10 buttons.

  In this embodiment, the positions of the character / number button group 11, the tank unit 12, the incident light detection unit 13, the central processing unit 14, and the time detection unit 16 are arranged as shown in FIGS. 1 and 3, but the present invention is not limited thereto. It is not limited. For example, the incident light detection unit 13 may be disposed on the display screen 10 and the time detection unit 16 may be disposed outside the central processing unit 14.

  With reference to FIGS. 4 and 5, a method for detecting a non-use state of the user and a method for controlling the shape of the elastic surface of the user interface device will be described.

  FIG. 4A is a schematic diagram of the user non-use state when the display screen 10 of the tablet terminal 1 is placed on the external surface 21 such as a floor or a desk downward. In this case, a plurality of convex letter / number button groups 11 are pushed in simultaneously by the weight of the tablet terminal 1. If the pressed character / number button group 11 does not change after a certain period of time, the user determines that the character / numeral button group 11 is not in use, and as shown in FIG. The number button group 11 is deformed into a non-convex shape. Here, the non-convex shape refers to a state in which the transparent sheet 101 is deformed into a flat or concave shape as shown in FIGS. As a result, it is possible to prevent waste of power when the user is not in use, wear of the elastic surface at the tip of the convex shape, and deterioration of the storage property of the tablet terminal 1.

  On the other hand, FIG. 5A shows a case where the display screen 10 of the tablet-type terminal 1 is placed on the external surface 21 such as a floor or a desk, and a relatively heavy object 22 is placed on the display screen 10. It is a schematic diagram of a user non-use state. In this case, due to the weight of the relatively heavy object 22, a plurality of convex letter / number button groups 11 are pushed in at the same time. If the pressed character / number button group 11 does not change after a certain period of time, it is determined that the user is not in use, and the character / number button group 11 on the elastic surface is shown in FIG. Is transformed into a non-convex shape. As a result, it is possible to prevent waste of power when the user is not in use, wear of the elastic surface at the tip of the convex shape, and deterioration of the storage property of the tablet terminal 1.

  FIG. 6 is a flowchart showing a method for detecting a non-use state of the user and a method for controlling the shape of the elastic surface of the user interface device in the present embodiment.

  In step S10, it is determined whether two or more convex letter / number button groups 11 have been pressed simultaneously. In this case, in step S11, an allowable time To for the pressing of the character / number button group 11 is set. The larger the number of convex-shaped letter / number buttons 11 that are pushed in at the same time, the more limited the user usage situation. Therefore, it is effective to set the allowable time To short. For example, the allowable time To may be set to 5 seconds in the case of two at the same time, 3 seconds in the case of three, 0.5 seconds in the case of four or more. Here, the allowable time To is an example, and the present invention is not limited to this.

  In step S <b> 12, the time detection means 16 detects the elapsed time T from the start to the end of pressing into the convex-shaped character / number button group 11.

  In step S13, the user use state detection means 15 compares the elapsed time T measured in step S12 with the allowable time To set in step S11. If the elapsed time T is less than or equal to the allowable time To, it is determined in step S16 that the user is in use. Furthermore, the elapsed time T is initialized to zero in step S17.

  On the other hand, if the elapsed time T exceeds the allowable time To, it is determined in step S14 that the user is not in use, and in step S15, the character / number buttons 11 on the elastic surface are transformed into a non-convex shape. .

  From the above, it is possible to prevent waste of electric power when the user is not in use, wear of the elastic surface, and deterioration of storage property.

  Further, in the present embodiment, the tablet type terminal is taken as an example of the user interface device, and further, the keyboard of the tablet type terminal is taken as an example, but the present invention is not limited to this. Other devices and functions may be used as long as the interface accepts user input.

  In the present embodiment, the example in which the fluid flows into the cavity is described as the configuration for changing the shape of the tactile UI, but the present invention is not limited to this. Any configuration can be used as long as the shape of the surface can be changed to provide tactile guidance to the user.

  Furthermore, although the example which comprises a capacitive touch sensor as a structure which detects a user's input was demonstrated in the present Example, this invention is not limited to this. For example, a piezoelectric sensor may be configured in the hollow portion, a change in pressure in the hollow portion due to the user pushing the elastic surface may be detected, and the user's pushing operation may be detected.

  Hereinafter, a user interface device according to a second embodiment of the present invention will be described with reference to FIGS.

  In the present embodiment, an example of controlling the shape of the elastic surface of the user interface device when the user is not in use when the incident light detection means 13 is used as the means for detecting the non-use state of the user will be described. Since the configuration of the user interface device according to the second embodiment of the present invention is the same as that of the first embodiment, description thereof is omitted.

  7 and 8, a method for detecting a user's non-use state and a method for controlling the shape of the elastic surface of the user interface device will be described.

  FIG. 7A is a schematic diagram of the user non-use state when the display screen 10 of the tablet terminal 1 is placed downward on the external surface 21 such as a floor or a desk, as in FIG. 4A. . In this case, unlike FIG. 4A, since the tablet terminal 1 is light, a plurality of convex letter / number button groups 11 are not pushed in at the same time. Further, in this case, as shown in FIG. 7A, the letter / number button group 11 on the display screen 11 is in contact with the external surface 21, so that the light from the light source 31 does not enter the incident light detection means 13. Is shown.

  Here, if a certain level of incident light cannot be detected by the incident light detection means 13 even after a certain period of time has elapsed, it is determined that the user is not in use, as shown in FIG. The letter / number button group 11 on the elastic surface is deformed into a non-convex shape. Here, the non-convex shape refers to a state in which the transparent sheet 101 is deformed into a flat or concave shape as shown in FIGS. As a result, it is possible to prevent waste of power when the user is not in use, wear of the elastic surface at the tip of the convex shape, and deterioration of the storage property of the tablet terminal 1.

  On the other hand, FIG. 8A shows that the display screen 10 of the tablet-type terminal 1 is placed on an external surface 21 such as a floor or a desk, and a relatively light object 23 such as a leather cover is placed on the display screen 10. It is a schematic diagram of a user non-use state at the time. In this case, the plurality of convex letter / number button groups 11 are not pushed in at the same time. Here, if the incident light detection means 13 cannot detect a certain level of incident light even after a certain period of time has elapsed, it is determined that the user is not in use, as shown in FIG. 8B. The letter / number button group 11 on the elastic surface is deformed into a non-convex shape. As a result, it is possible to prevent waste of power when the user is not in use, wear of the elastic surface at the tip of the convex shape, and deterioration of the storage property of the tablet terminal 1.

  FIG. 9 is a flowchart illustrating a method for detecting a non-use state of a user and a method for controlling the shape of the elastic surface of the user interface device according to this embodiment.

  In step S20, it is determined whether or not light is incident on the incident light detection means 13. In that case, in step S21, an allowable time To for a state in which no light is incident on the incident light detection means 13 is set. For example, the allowable time To may be set to 10 seconds. Here, the allowable time To is an example, and the present invention is not limited to this.

  In step S <b> 22, the time detection unit 16 detects the elapsed time T from the start to the end of the state where no light enters the incident light detection unit 13.

  In step S23, the elapsed time T measured in step S22 and the allowable time To set in step S21 are compared by the user use state detection means 15. Steps S14 to S17 are the same as in FIG.

  As described above, even when there is no deformation of the convex shape of the elastic surface due to an external object, it is possible to determine the non-use state of the user, so that power consumption when the user is not using, wear of the elastic surface, and deterioration of storage properties are further improved. It becomes possible to prevent well.

  Hereinafter, a user interface device according to a third embodiment of the present invention will be described with reference to FIGS.

  In the present embodiment, an example of controlling the shape of the elastic surface of the user interface device when the user is not in use when the time detection unit 16 is used as the user non-use state detection unit will be described. Since the configuration of the user interface device according to the third embodiment of the present invention is the same as that of the first embodiment, the description thereof is omitted.

  With reference to FIG. 10, a method for detecting a user's non-use state and a method for controlling the shape of the elastic surface of the user interface device will be described.

  FIG. 10A is a schematic diagram of the user non-use state when the display screen 10 of the tablet terminal 1 is placed on the external surface 21 such as a floor or a desk upward. In this case, a plurality of convex letter / number buttons 11 are not pushed in at the same time, and incident light on the display screen 10 is not blocked. Here, if a user input to the letter / number button group 11 is not detected even after a certain period of time has passed, it is determined that the user is in an unused state, and the elastic surface is shown in FIG. 10 (b). The letter / number button group 11 is transformed into a non-convex shape. Here, the non-convex shape refers to a state in which the transparent sheet 101 is deformed into a flat or concave shape as shown in FIGS. As a result, it is possible to prevent waste of power when the user is not in use, wear of the elastic surface at the tip of the convex shape, and deterioration of the storage property of the tablet terminal 1.

  FIG. 11 is a flowchart illustrating a method for detecting a non-use state of the user and a method for controlling the shape of the elastic surface of the user interface device according to this embodiment.

  In step S30, it is determined whether there is no user input to the character / number button group 11. In this case, in step S31, an allowable time To for a state where there is no user input to the character / number button group 11 is set. For example, the allowable time To may be set to 60 seconds. Here, the allowable time To is an example, and the present invention is not limited to this.

  In step S 32, the time detection means 16 detects the elapsed time T from the start to the end when there is no user input to the character / number button group 11.

  In step S33, the user use state detection means 15 compares the elapsed time T measured in step S32 with the allowable time To set in step S31. Steps S14 to S17 are the same as in FIG.

  From the above, even when there is no deformation of the convex shape of the elastic surface due to an external object or shielding of incident light on the display screen, it is possible to determine the user's non-use state, further reducing power consumption when the user is not using it. It becomes possible to prevent with high accuracy.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

1 tablet-type terminal, 10 display screen, 11 character / number buttons,
12 tank part, 13 incident light detection means, 14 central processing part,
15 user usage state detection means, 16 hour detection means, 21 external surface,
22 relatively heavy object, 23 relatively light object, 31 light source, 101 transparent sheet,
102 transparent substrate, 103 cavity, 104 touch sensor, 105 display,
110 pump

Claims (10)

A user interface device for detecting a pressing input by a user,
An input portion having an elastic surface formed to be deformable by an elastic member;
Deformation means for deforming the elastic surface;
A pressing operation detecting means for detecting a pressing operation on the input unit;
User usage state detection means for detecting a user usage state;
A user interface device, wherein the shape of the elastic surface is controlled based on information from the user use state detecting means. And a user interface device state detecting unit for detecting a state of the user interface device, wherein the user use state detecting unit detects a user use state based on information from the user interface device state detecting unit. The user interface device according to claim 1. The elastic surface is deformed by the deformation means so as to be convex or concave with respect to the surface other than the input unit, and when the user use state detection means detects that the user is not in use, the elastic surface The user interface device according to claim 1, wherein the elastic surface is deformed by the deforming unit into a non-convex shape. 4. The user interface device according to claim 1, further comprising a time detection unit that performs time measurement, wherein the user interface device state detection unit is the time detection unit. 5. . The user interface device state detection means is a shape detection means for detecting a plurality of convex deformations of the elastic surface, and is not used by a user when the plurality of convex shapes of the elastic surface are pushed in simultaneously for a certain period of time. The user interface device according to claim 4, wherein the user interface device is determined to be in a state. The user interface device state detecting means is incident light detecting means for detecting incident light on the surface of the user interface device, and the user is not in use when there is no incident light on the surface for a certain period of time. The user interface device according to claim 4, wherein the determination is made. 5. The user interface device according to claim 4, wherein the user is determined not to be used when there is no input information to the input unit for a predetermined time. The user interface device according to any one of claims 1 to 7, wherein the pressing operation detection unit detects a pressing operation on the input unit based on a change in capacitance. The said deformation | transformation means is a means to deform | transform the said elastic surface with the pressure of a fluid, The said detection means detects pressing-down operation with respect to the said input part based on the change of the pressure of the said fluid. Item 8. The user interface device according to any one of Items 7 to 9. The user interface device according to claim 1, wherein the input unit is configured on a display screen of a display device.