JP5484618B2 - User interface device capable of executing various operations while touching finger, input operation determination method, and program - Google Patents

Description

  The present invention relates to a user interface device including a display that displays an image including an object to be operated and a touch panel as a user interface.

  2. Description of the Related Art Conventionally, user interface devices equipped with a touch panel that perform an input operation by touching a screen with a finger, a stylus, or the like have been widely used. In particular, in recent years, user interface devices such as smartphones, tablet computers, electronic books, PDAs (Personal Digital Assistants), so-called portable information devices, have actively adopted touch panels as user interfaces that accept finger operations. .

  Portable information devices need to be miniaturized in order to improve portability. For this reason, when physical input keys are employed as the user interface, the sizes of the input keys themselves must be reduced, and there is a concern that the operability may deteriorate. On the other hand, when the touch panel is adopted, the size of the virtual button can be appropriately changed according to the function of the application, and the operability can be improved.

  On the other hand, when a touch panel is used, an erroneous input operation tends to occur more easily than a physical key. Specifically, an input operation occurs even when the user unintentionally touches the touch panel, or even if the user performs an input operation, a desired function is not activated and a redo operation is required.

  For example, Patent Document 1 discloses a technique for changing the detection cycle of the touch panel after detecting a touch operation as a measure for dealing with the problem of erroneous input. According to this technique, a case where the touch panel is touched instantaneously in a very short time is distinguished from a case where the operator performs scrolling with a finger placed on the touch panel.

  Further, Patent Document 2 discloses a technique in which when a touch panel is touched with a finger, a part of a plurality of displayed selection buttons is enlarged and rearranged to facilitate button selection. Furthermore, Patent Document 3 discloses a technique for allowing a user to confirm that a predetermined input operation has been performed by vibrating a multi-touch panel that can detect a plurality of simultaneous contacts.

  There is also a technique for detecting a pressure on a touch panel including two conductive surface facing portions and detecting the magnitude of the pressure (see Patent Document 4). Furthermore, there is a technology that includes two touch panels and can recognize the degree of pressing force at the time of touch input based on the sense of depth of the displayed image (see Patent Document 5).

JP 2007-10645 A JP 2008-77272 A JP 2010-55282 A JP 2000-194506 A JP 2007-148617 A

  Usually, many portable information devices are held with one hand and operated with a finger of this one hand. This finger is actually a thumb not related to holding. Therefore, the types of operations that can be reliably performed with such a finger are still limited even if the above-described countermeasures against erroneous input are taken.

  For example, conventionally, an operation for moving the entire displayed image is a drag operation. The drag operation is a contact operation of a finger on the touch panel and a subsequent movement operation (contact and movement operation) while being in contact with each other.

  As described above, the contact and movement operations, which are one of the basic operations, have been defined only as a drag operation, so that when the operation is performed with the finger of one hand holding the device, the finger must eventually perform the operation. The types of operations that can be performed are limited. Currently, various functions can be activated in portable information devices. Accordingly, it is required that more types of operations can be performed, but this requirement cannot be met under the limitations described above.

  In addition, such a problem can be completely solved even by using a technique that does not assume an operation of moving the entire image in accordance with the movement of the contact position of the finger, for example, the techniques disclosed in Patent Documents 1 to 5. It is not something.

  Therefore, an object of the present invention is to provide a user interface device, an input operation determination method, and a program capable of executing various operations by touching a finger when inputting a finger on a touch panel.

According to the present invention, an image display unit that displays an image including an object that is an operation target on a screen and a touch panel that sequentially outputs a finger contact position as time elapses are provided. In the user interface device defined as the movement of the contact position of
A pressure detection unit that detects pressure applied to the touch panel by the finger;
Contact time determination means for determining whether the contact position of the finger has not changed continuously for a predetermined time; and
When the contact time determination means makes a true determination, it is not a mode in which a drag operation is performed, but a “touch focus” mode in which the contact position of the finger is monitored in a fixed state without moving the entire image including the object When the finger that was in contact moves regardless of whether or not it is within the display position range of the object and moves again while touching, cancel the `` touch focus '' mode and perform the drag operation Mode operating means for operating the mode to be enabled;
Contact position determination means for determining whether or not the contact position of the finger is superimposed on the display position range of the object when the “touch focus” mode is activated;
A pressing force determining means for determining whether the pressing force is equal to or greater than a predetermined threshold;
When the contact position determination means makes a true determination, it is determined that a “focus” operation indicating that the object has been selected by the user has been performed, a corresponding action is activated, and the contact position determination means When a true determination is made and the pressing force determination means makes a true determination, an operation for determining that a “click” operation for pushing the display position range of the object with the finger is performed and activating the function of the object A user interface device having a determination control means is provided.

According to another embodiment of the user interface device according to the present invention, the mode operation means is viewed from the user's operation,
If the finger is moved immediately after the finger touches the touch panel, a “drag” mode is performed in which a drag operation is performed to move the entire image,
It is also preferable to operate the “touch focus” mode when the finger is brought into contact with the touch panel and the contact position is maintained for at least a predetermined time.

According to another embodiment of a user interface device according to the present invention,
A tactile response mechanism that gives a tactile response to the finger touching the touch panel;
It is also preferable to further include a tactile response control unit that controls the tactile response mechanism unit to give a tactile response to the finger via the touch panel when the operation determination unit determines that the operation is a “focus” operation. . Also in this case
It is further preferable that the tactile response control means controls the tactile response mechanism unit so as to give a vibration that makes the finger feel the presence of a physical push button.

  According to another embodiment of the user interface device according to the present invention, the predetermined time is, on average, from the time when the finger touches when the user intends to perform the drag operation to the time when the next movement starts. It is also preferable that the time is set to be longer than the time required and shorter than the time required on average from the time when the finger touches when the operation of selecting the object is intended to start the next movement.

According to the present invention, an image display unit that displays an image including an object that is an operation target on a screen and a touch panel that sequentially outputs a finger contact position as time elapses are provided. In the program installed in the user interface device that regulates the movement of the contact position of
The user interface device includes a pressing force detection unit that detects a pressing force applied to the touch panel by the finger,
The program is
Contact time determination means for determining whether the contact position of the finger has not changed continuously for a predetermined time; and
When the contact time determination means makes a true determination, it is not a mode in which a drag operation is performed, but a “touch focus” mode in which the contact position of the finger is monitored in a fixed state without moving the entire image including the object When the finger that was in contact moves regardless of whether or not it is within the display position range of the object and moves again while touching, cancel the `` touch focus '' mode and perform the drag operation Mode operating means for operating the mode to be enabled;
Contact position determination means for determining whether or not the contact position of the finger is superimposed on the display position range of the object when the “touch focus” mode is activated;
A pressing force determining means for determining whether the pressing force is equal to or greater than a predetermined threshold;
When the contact position determination means makes a true determination, it is determined that a “focus” operation indicating that the object has been selected by the user has been performed, a corresponding action is activated, and the contact position determination means When a true determination is made and the pressing force determination means makes a true determination, an operation for determining that a “click” operation for pushing the display position range of the object with the finger is performed and activating the function of the object There is provided a program for a user interface device that causes a computer to function as determination control means.

According to the present invention, an image display unit that displays an image including an object that is an operation target on a screen and a touch panel that sequentially outputs a finger contact position as time elapses are provided. In the input operation determination method in the user interface device that defines the movement of the contact position of
The user interface device includes a pressing force detection unit that detects a pressing force applied to the touch panel by the finger,
A first step of determining whether the contact position of the finger has not changed continuously for a predetermined time; and
When the true determination is made in the first step, not the mode in which the drag operation is performed, but the “touch focus” mode in which the contact position of the finger is monitored in a fixed state without moving the entire image including the object When the finger that was in contact moves regardless of whether or not it is within the display position range of the object and moves again while touching, cancel the `` touch focus '' mode and perform the drag operation A second step of operating the enabling mode;
A third step of determining whether or not the touch position of the finger is superimposed on the display position range of the object when the “touch focus” mode is set;
A fourth step of determining whether the pressing force is equal to or greater than a predetermined threshold;
When the true determination is made in the third step, it is determined that the “focus” operation indicating that the object has been selected by the user has been performed, the corresponding action is activated, and in the third step, When the true determination is made and the true determination is made in the fourth step, it is determined that the “click” operation for pushing the display position range of the object with the finger is performed, and the function of the object is activated. An input operation determination method having a fifth step is provided.

  According to the user interface device, the input operation determination method, and the program of the present invention, various operations can be performed while the finger is kept in contact with the finger when inputting to the touch panel.

FIG. 2 is a front view of a portable information device and a schematic diagram of an operation with a finger for explaining a “touch focus” mode. FIG. 2 is a front view of a portable information device and a schematic diagram of an operation with a finger for explaining a “click” operation. FIG. 3 is a front view of a portable information device and a schematic diagram of an operation with a finger for explaining a “drag” mode. 1 is a perspective view schematically showing a configuration of a portable information device according to the present invention, and a flowchart showing an embodiment of an input operation determination method according to the present invention. It is a functional block diagram which shows one Embodiment of the portable information device by this invention. It is an external view which shows other embodiment of the user interface apparatus by this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  In the user interface device targeted by the present invention, information is input by the user's finger touching the touch panel. Therefore, most of the devices are portable information devices such as smartphones and tablet computers that can be carried and operated by hand. Therefore, hereinafter, a portable information device will be described as an embodiment of the present invention.

In the portable information device according to the present invention, when the finger touches the touch panel and the subsequent movement operation (contact and movement operation) while being in contact is received, various operations can be performed without simply authorizing as a drag operation. Set possible input modes. Specifically, either the “touch focus” mode or the “drag” mode is operated depending on whether or not the finger contact position on the touch panel has not changed for a predetermined time or longer. Each input mode is as follows.
(1) “Touch focus” mode: A mode in which the touch position of a finger is monitored in a state where the entire displayed image is fixed without being moved.
(2) “Drag” mode: A mode in which the entire displayed image is moved.
The feature of the present invention is to determine the time that the finger has been in contact without changing the position, and to determine and operate each input mode based on the determination result.

  Here, the “entire image” is a portion to be moved (including scrolling) among all the images displayed on the display screen. Of course, it can also be the entire displayed image. For example, information that does not fit on one screen has a portion hidden (assumed) outside the screen. When this portion is displayed, the portion where this information is displayed becomes a movement target.

  FIG. 1 is a front view of a portable information device for explaining the “touch focus” mode, and a schematic diagram of an operation with a finger.

  FIG. 1A is a front view of the portable information device 1. According to this front view, an image including a plurality of icons (objects) 104 is displayed on the screen of the display 101. The icon 104 is an operation target for the user, is selected by a predetermined operation described later, and further activates its function. Further, on the screen of the display 101, a touch panel 100 that sequentially outputs a finger contact position as time passes is arranged.

  Hereinafter, the “touch focus” mode will be described with reference to FIG. According to FIG. 1A, after the user's finger contacts the touch panel 100 and maintains the contact position for a predetermined time or more, the user's finger moves (slides) while tracing the touch panel 100 while maintaining the contact. However, unlike the conventional drag operation, the entire image including the icon 104 does not move despite the movement of the finger and is in a fixed state.

  Therefore, the user can touch the icons 104 whose positions are fixed sequentially by moving the fingers while keeping them in contact with each other. Further, the contact position determination unit 122 (FIG. 5) described later determines whether or not the finger contact position and the display position range of the icon 104 are overlapped even while the finger is moving. A mode in which the finger contact position is monitored in a fixed state without moving the entire image in this way is the “touch focus” mode.

  In the “touch focus” mode, for example, when the desired icon 104 exists in the displayed image, the display position is moved while the finger is brought into contact with the vicinity of the display position range, and then the contact position of the finger is moved. It works when you want to make sure that it overlaps the range. Also, the operation is performed when a finger is brought into contact with the display position range of the icon 104 and the icon 104 is immediately selected. Further, while tracing the surface of the touch panel 100 (displayed image) with a finger and checking whether or not the desired icon 104 exists in the displayed image, the finger is surely moved to the display position range of the desired icon 104. Also works if you want to go to.

FIG. 1B is a schematic diagram of an operation with a finger for explaining conditions for operating the above-described “touch focus” mode. According to this schematic diagram, first, the finger contacts the touch panel 100. This time to _{t 0 (t = t 0)} . Next, the finger starts moving (sliding) from the state where the finger is kept in contact without changing the contact position to the upper side (left side in FIG. 1B) while keeping the same contact. The time for starting this movement is defined as t _S2 (t = t _S2 ). In this case, the contact position of the finger does not change continuously for the time (t _S2 −t ₀ ).

When this time (t _S2 −t ₀ ) is equal to or longer than the predetermined time t _TH ((t _S2 −t ₀ ) ≧ t _TH ), the mode operation unit 124 (FIG. 5) described later operates in the “touch focus” mode. Let Thereafter, the entire image including the icon 104 is fixed without moving despite the movement of the finger. If the above-described condition of t _S2 −t ₀ ≧ t _TH is satisfied, the “touch focus” mode operates even when the finger contact position does not continue to move thereafter.

  Similarly, as shown in FIG. 1B, the user moves his / her finger while tracing the displayed image. Thereafter, a desired icon 104 is searched and the finger is advanced within the display position range. The operation of superimposing the finger contact position on the display position range of the icon 104 under the operation of the “touch focus” mode is hereinafter referred to as “focus” operation.

Note that the operation of bringing the finger into contact with the display position range of the icon 104 and continuously superimposing the finger contact position on the display position range after the predetermined time t _TH is also included in the “focus” operation. The “focus” operation is an operation in which the user selects the icon 104, and plays a role as a preparatory operation for surely performing an operation that activates the function of the icon 104 thereafter.

  When the contact position of the finger is superimposed on the display position range of the icon 104, the tactile response mechanism unit 102 (FIG. 4), which will be described later, gives a vibration that makes the finger feel the presence of a physical push button. Can do. Accordingly, the user can confirm that the “focus” operation has been accepted, and can obtain a stable and reliable operational feeling.

  Here, examples of vibrations that make the user feel the presence of a physical push button include the following. First, height information is given to each point in the display position range of the icon 104 as if the icon 104 had a height (thickness in a direction perpendicular to the screen). Thereafter, after the finger reaches the display position range of the icon 104 and enters the range, vibration with a strength corresponding to the magnitude of the gradient calculated from the height information is given to the finger. As a result, the finger feels like tracing a pressed button that has popped out.

  Further, the “touch focus” mode (“focus” operation) is preferably canceled by releasing the finger from the touch panel 100.

As described above, according to the present invention, the input mode is determined by determining whether or not the finger contact position has not changed continuously for the predetermined time _tTH . As a result, it is possible to easily operate the “touch focus” mode instead of the drag operation even by the finger contact and movement operation. Further, in this “touch focus” mode, the finger can be moved so as to trace on the touch panel 100 without moving the entire image, so that the “focus” operation for selecting the desired icon 104 can be surely executed. it can.

  FIG. 2 is a front view of the portable information device for explaining the “click” operation, and a schematic diagram of the operation by the finger.

  FIG. 2A is a front view of the portable information device 1. According to the front view, the finger moves while tracing the touch panel 100 while being in contact with each other under the operation of the “touch focus” mode. Thereafter, the finger advances to the position of the desired icon 104, and as a result, the contact position of the finger is superimposed on the display position range of the icon 104. From this state, when the user presses the finger more strongly, the function of the icon 104 is activated. Hereinafter, an operation of pressing the icon 104 (touch panel 100) with a finger to activate the function of the icon 104 is referred to as a “click” operation.

FIG. 2B is a schematic diagram of an operation with a finger for explaining a condition determined as a “click” operation. According to this schematic diagram, under the operation of the “touch focus” mode, the finger moves so as to trace on the touch panel 100, and the contact position of the finger is superimposed on the display position range of the desired icon 104. That is, a “focus” operation is performed. At this time, as described above, the tactile response mechanism unit 102 (FIG. 4), which will be described later, can also apply a vibration v ₁ that makes the finger feel the presence of a physical push button.

Next, from this state, when the user presses the finger more strongly and the pressing force p _C by the finger is equal to or greater than a predetermined pressing force threshold value p _TH (p _C ≧ p _TH ), it is determined that the “click” operation has been performed. The function of the icon 104 is activated. As described above, the pressing force p _C being _{equal to} or greater than the pressing force threshold value p _TH is a condition for determining the “click” operation. The measurement of the pressing force p _C is performed by a pressing force detector 103 (FIG. 4) described later.

Further, the haptic feedback arrangement 102, which will be described later (FIG. 4) is, the finger can also provide a vibration v ₂ of imparting a feeling as if actually pressed the physical push button. That is, when the user performs the “focus” operation, the user feels the presence of the physical push button by receiving the vibration v _1, and when performing the “click” operation with certainty based on this feeling, the user vibrates the vibration v _2. Receive. Thereby, a feeling as if the virtual push button was actually pressed is obtained. As a result, the user can obtain a stable and reliable operational feeling that the user has actually operated the physical push button in spite of the operation on the touch panel.

  FIG. 3 is a front view of the portable information device for explaining the “drag” mode, and a schematic diagram of an operation with a finger.

  FIG. 3A is a front view of the portable information device 1. The “drag” mode will be described using this front view. According to FIG. 3A, immediately after the user's finger touches the touch panel 100, the user's finger moves (slides) upward while maintaining the contact. As the finger moves, the entire image including the icon 104 moves upward by the amount of the finger movement, and several icons 104 appear on the screen from the lower side. A mode that enables an operation of moving the entire image with such a finger, a so-called drag operation, is a “drag” mode.

  The “drag” mode is used when, for example, a desired icon is not visually recognized in the displayed image and the entire image is moved to display the desired icon, or a document in which only a part of the image is displayed on the screen. This is set when you want to view the rest of the information.

FIG. 3B is a schematic diagram of an operation with a finger for explaining a condition for operating the above-described “drag” mode. According to this schematic diagram, first, the finger contacts the touch panel 100. This time to _{t 0 (t = t 0)} . Next, the finger starts moving (sliding) from the state where the finger is kept in contact without changing the contact position to the upper side (left side in FIG. 3B) while keeping the same contact. The time for starting this movement is set to t _S1 (t = t _S1 ). In this case, the contact position of the finger does not change continuously for the time (t _S1 −t ₀ ). When this time (t _S1 -t ₀ ) is less than the predetermined time t _TH ((t _S1 -t ₀ ) <t _TH ), the mode operation unit 124 (FIG. 5) described later operates the “drag” mode. . Thereafter, the entire image including the icon 104 moves as the finger moves.

  Here, the movement amount of the entire image may coincide with the movement amount of the finger, or may be an appropriate function value of the finger movement amount, such as a constant multiple of the finger movement amount. Of course, the direction of movement of the finger is not limited to the upper side. For example, a finger is moved in an arbitrary direction on the surface of the touch panel 100, and the entire image is moved in any of the upper, lower, left, right, and diagonal directions corresponding to the direction of movement of the finger. Can be possible.

In addition, the above-described predetermined time t _TH is set to be longer than the time t _AV1 that is required on average from the time when the finger touches when the user intends to perform the drag operation to the next start of movement as viewed from the user's operation. . For example, by causing a large number of users to perform an operation intended to move an image, the time when the contact position has not changed continuously is measured, and a value sufficiently larger than the average value t _{AV1 of the} measured values is measured. And a predetermined time t _TH .

Furthermore, the predetermined time t _TH is set shorter than the time t _AV2 that is _averagely required from the time when the finger touches when the user selects the object to start moving, as viewed from the user's operation. Is done. For example, by causing many users to perform an operation of selecting an object, the time when the contact position has not changed continuously is measured, and a value sufficiently smaller than the average value t _{AV2 of the} measured values is set to a predetermined time t. _TH .

Here, when the times t _AV1 and t _AV2 are used, the predetermined time t _TH is determined so that the condition of t _AV1 <t _TH <t _AV2 is satisfied. As an _{example, t TH} value can be set to 200 msec.

  FIG. 4 is a perspective view schematically showing the configuration of the portable information device according to the present invention, and a flowchart showing an embodiment of the input operation determination method according to the present invention. FIG. 5 is a functional configuration diagram showing an embodiment of a portable information device according to the present invention.

  According to FIG. 4, the portable information device 1 includes a touch panel 100, a display 101, a tactile response mechanism unit 102, a pressing force detection unit 103, and a processor memory. Here, the processor memory realizes its function by executing a program.

  The display 101 displays an image including an icon (object) 104 that is an operation target. Moreover, the touch panel 100 is arrange | positioned on the screen of the display 100, and outputs the contact position of a user's finger | toe sequentially according to progress of time. As the touch panel 100, a projected capacitive touch panel, a surface capacitive touch panel, a resistive touch panel, an ultrasonic surface acoustic wave touch panel, an infrared scanning touch panel, or the like can be employed.

The tactile response mechanism unit 102 gives a tactile response to the finger touching the touch panel 100 by vibrating the touch panel 100. For example, when a “focus” operation is performed on the touch panel 100, a vibration v ₁ (FIG. 2B) that makes the user feel the presence of a physical push button is applied to the finger. Further, when the “click” operation is performed, for example, a vibration v ₂ (FIG. 2B) that gives a feeling that the push button is actually pressed is given to the finger. The tactile response mechanism 102 can be a piezoelectric actuator formed using a piezoelectric material such as PZT (lead zirconate titanate).

The pressing force detection unit 103 detects a pressing force p _{C applied} to the touch panel 100 by a finger. Pressing force detection unit 103 is, for example, are placed under the four corners of the touch panel 100, the touch panel 100 deflected slightly pressed the finger the total pressing on itself, is detected as the pressing force p _C. When the pressing force p _C detected by the pressing force detection unit 103 is equal to or greater than a predetermined pressing force threshold value p _TH (p _C ≧ p _TH ), it is determined that the “click” operation has been performed. The pressing force detection unit 103 can be, for example, a piezoelectric sensor formed using a piezoelectric material such as PZT. Further, instead of providing the tactile response mechanism unit 102 formed of a piezoelectric actuator, or at the same time, the pressing force detector 103 can be used as a tactile response mechanism unit.

  The processor memory inputs a finger contact position signal output from the touch panel 100 and a pressing force signal output from the pressing force detection unit 103, operates an input mode based on these signals, and further performs an input operation. And the corresponding operation is executed. Here, the functional configuration of the processor memory will be described with reference to FIG.

  According to FIG. 5, the processor memory includes a contact time determination unit 121, a contact position determination unit 122, a pressing force determination unit 123, a mode operation unit 124, an operation determination control unit 125, and a tactile response control unit 126. And a display control unit 111 and an application processing unit 112.

The contact time determination unit 121 receives a finger contact position signal output from the touch panel 100, determines whether the finger contact position has not changed continuously for a predetermined time _tTH, and determines the determination result. Output to the mode operation unit 124. The contact position determination unit 121 determines whether or not the finger contact position overlaps the display position range of the icon 104, and outputs the determination result to the operation determination control unit 125. The pressing force determination unit 123 receives the pressing force signal output from the pressing force detection unit 103, determines whether or not the pressing force by the finger is _{equal to} or greater than a predetermined pressing force threshold value _pTH , and operates the determination result. The result is output to the determination control unit 125.

  The mode operation unit 124 determines and operates either the “touch focus” mode or the “drag” mode as the input mode based on the determination result from the contact time determination unit 121. The operation determination control unit 125 determines whether the operation is the “focus” operation based on the determination result from the contact position determination unit 122 during the operation in the “touch focus” mode, and executes the corresponding operation. Further, similarly, during the operation in the “touch focus” mode, it is determined whether or not the operation is a “click” operation based on the determination result from the pressing force determination unit 123, and the corresponding operation is executed. The tactile response control unit 126 controls the tactile response mechanism unit 102 to give a corresponding tactile response to the finger based on the operation determination result output from the operation determination control unit 125.

  The display control unit 111 inputs the application processing information from the application processing unit 112 and causes the display 101 to display an image corresponding to the execution of the application. In addition, the display control unit 111 inputs instruction information for operating the “touch focus” mode or the “drag” mode output from the mode operation unit 124, and causes the display 101 to display an image corresponding to the instructed input mode. . Further, the display control unit 111 inputs instruction information for performing an input operation output from the operation determination control unit 125 and causes the display 101 to display an image corresponding to the instructed input operation.

  Next, an embodiment of the input operation determination method implemented in the processor memory will be described using the flowchart shown in FIG.

According to FIG. 4, first, the touch panel 100 detects a finger contact (step S401). Next, the contact time determination unit 121 determines whether or not the finger contact position has changed for a predetermined time t _TH or more (step S402). Here, the contact position of the finger is expressed as one coordinate (x, y) using an xy coordinate system set on the surface (contact surface) of the touch panel 100. In some cases, the finger contact is detected as a contact surface having a predetermined area. In this case, the coordinate (center coordinate) of the position of the center of the contact surface can be used as the contact position.

  The finger contact position may vary slightly due to finger tremors that normally occur when the finger touches the touch panel 100. Even in such a case, the change in the coordinates of the contact position can be removed by correction. Further, as another aspect, it is assumed that the fluctuation range of the coordinate of the contact position due to the trembling of the finger at the time of pressing is predicted in advance, and the coordinate change within this fluctuation range is not regarded as the change of the finger contact position. You can also In any case, the influence of fluctuation due to the trembling of the finger can be excluded from the determination of whether or not the finger contact position has continuously changed. That is, it is possible to stably and reliably determine an operation in accordance with the user's intention.

When the contact time determination unit 121 performs a true determination, that is, a determination that the finger contact position has not changed for a predetermined time t _TH or longer, the mode operation unit 124 sets the “touch focus” mode. Operate (step S404). Specifically, the entire image including the icon 104 is fixed without being moved, and the finger contact position (finger contact position signal output from the touch panel 100) is monitored (monitored).

On the other hand, when the contact time determination unit 121 makes a false determination, that is, a determination that the finger contact position has changed within the predetermined time t _TH , the mode operation unit 124 operates the “drag” mode. (Step S403). Specifically, the entire image including the icon 104 can be moved in the direction specified by the drag operation with the finger.

When the above steps are viewed from the user's operation, the mode operation unit 124 operates the “drag” mode when the finger is moved immediately after the finger touches the touch panel, causes the finger to touch the touch panel, and at least When the contact position is maintained for a predetermined time t _TH , the “touch focus” mode is activated.

  Next, when the “touch focus” mode is activated, the contact position determination unit 122 determines whether the contact position of the finger is superimposed on the display position range of the icon 104 (step S405). When the contact position determination unit 122 performs a true determination, that is, a determination that the contact position of the finger is superimposed on the display position range of the icon 104, the operation determination control unit 125 performs the “focus” operation. Determination is made and the corresponding operation is executed (step S406). Specifically, the icon 104 on which the finger contact position is superimposed is selected. At this time, it is also preferable that the tactile response control unit 126 gives a touch response to the finger via the tactile response mechanism unit 102. In addition, the operation determination control unit 125 can cause the display 101 to highlight the selected icon 104 via the display control unit 111.

Next, the pressing force detection unit 103 detects the pressing force p _C applied by the finger that has touched the touch panel 100 (step S407). Next, the pressing force determination unit 112 determines whether or not the pressing force p _C detected by the pressing force detection unit 103 is _{equal to} or greater than a predetermined pressing force threshold p _TH (step S408).

Next, the operation determination control unit 114 performs the determination that the contact position determination unit 110 is true and the pressing force determination unit 112 is true, that is, the determination that the pressing force p _C is _{equal to} or greater than the pressing force threshold p _TH. Only when it is performed, it is determined that the “click” operation has been performed, and the corresponding operation is executed (step S409). Specifically, the function of the icon 104, for example, activation of an application is activated.

In the present invention, as described above, it is determined whether or not the finger contact position has continuously changed for the predetermined time t _TH or longer, and based on the determination result, any one of the “touch focus” mode and the “drag” mode is determined. To make it work. Accordingly, the “focus” operation, the “click” operation under the “touch focus” mode operation, and the drag operation under the “drag” mode operation are reliably distinguished from each other and easily executed. That is, various operations can be reliably distinguished and executed also by finger contact and movement.

  FIG. 6 is an external view showing another embodiment of the user interface device according to the present invention.

  FIG. 6A is a perspective view of a notebook personal computer 2 as a user interface device of the present invention. In the notebook type personal computer 2, a web browser for browsing a web page is activated, and an image displayed on the display 201 includes a plurality of links (objects) 204.

When the user wants to browse a portion of the web page that is not displayed, if the finger is moved immediately after touching the touch panel 200, the “drag” mode is activated and the drag operation is executed. At this time, moving the finger before the predetermined time t _TH elapses after the contact with the finger is a point for operating the “drag” mode.

On the other hand, when confirming whether or not the desired link 204 exists in the displayed portion of the web page, the finger is brought into contact with the touch panel 200 for the time being and the contact position is maintained for at least the predetermined time t _TH . Thereby, the “touch focus” mode operates. Next, a “focus” operation is performed in which the finger is moved while being touched, and the finger contact position is superimposed on the desired display position range of the link 204. Thereafter, by performing a “click” operation in which a finger is pressed against the touch panel 200 with a pressing force equal to or greater than a predetermined pressing force threshold value p _TH , the function of the link 204 is activated, and a desired link destination document or image is browsed. Can do.

  FIG. 6B is a perspective view of the digital photo printer 3 as the user interface device of the present invention. The digital photo printer 3 receives a large number of digital photo data via the input adapter 305, and the display 301 displays a large number of thumbnails (objects) 304 corresponding to the captured digital photo data. ing.

When the user wants to browse the thumbnail 304 that is not displayed on the display 301, if the finger is moved immediately after touching the touch panel 300, the “drag” mode is activated and the drag operation is executed. At this time, moving the finger before the predetermined time t _TH elapses after the contact with the finger is a point for operating the “drag” mode.

On the other hand, when confirming whether or not the desired thumbnail 304 is displayed on the display, the finger is first brought into contact with the touch panel 300, and the contact position is maintained for at least the predetermined time _tTH . Thereby, the “touch focus” mode operates. Next, a “focus” operation is performed in which the finger is moved while being touched, and the touch position of the finger is superimposed on the desired display position range of the thumbnail 304. After that, by performing a “click” operation in which a finger is pressed against the touch panel 300 with a pressing force _{equal to} or greater than a predetermined pressing force threshold value p _TH , a setting is made such that the thumbnail 304 is selected and, for example, the corresponding digital photo data is printed. Made.

6A and 6B, a large number of links 204 or thumbnails 304 are displayed on the display 201 or 301, and a finger is brought out of the display position range of the links 204 or thumbnails 304. May be difficult. Even in this case, according to the present invention, the input mode is determined by determining whether or not the finger contact position has not changed continuously for the predetermined time _tTH . As a result, the “drag” mode can be easily operated regardless of the initial contact position of the finger, and the drag operation can be reliably executed.

Further, in each of the embodiments shown in FIGS. 6A and 6B, the finger is first placed outside the display position range of the desired link 204 or thumbnail 304 being displayed (the display position range of another link 204 or thumbnail 304). (Including the inside) may also be considered. Even in this case, according to the present invention, the input mode is determined by determining whether or not the finger contact position has not changed continuously for the predetermined time _tTH . As a result, regardless of the initial contact position of the finger, the “touch focus” mode can be easily operated, and then the “focus” operation for selecting the desired link 204 or thumbnail 304 can be reliably performed.

  As described above in detail, according to the user interface device, the input operation determination method, and the program of the present invention, various operations can be performed while keeping the finger in contact with the finger when inputting to the touch panel.

  In addition, according to the user interface device, the input operation determination method, and the program of the present invention, a desired object can be selected while tracing a displayed image with a finger when a finger inputs to the touch panel.

  Various changes, modifications, and omissions of the above-described various embodiments of the present invention can be easily made by those skilled in the art. The above description is merely an example, and is not intended to be restrictive. The invention is limited only as defined in the following claims and the equivalents thereto.

1 Portable information device (user interface device)
100, 200, 300 Touch panel 101, 201, 301 Display 102 Tactile response mechanism unit 103 Pressing force detection unit 104 Icon (object)
DESCRIPTION OF SYMBOLS 111 Display control part 112 Application processing part 121 Contact time determination part 122 Contact position determination part 123 Pressing force determination part 124 Mode operation part 125 Operation determination control part 126 Tactile response control part 2 Notebook type personal computer (user interface device)
204 Link (object)
3 Digital photo printer (user interface device)
304 Thumbnail (object)
305 Input adapter

Claims (7)

An image display unit that displays an image including an object to be operated on the screen, and a touch panel that sequentially outputs a finger contact position as time passes, and a drag operation is performed as movement of the finger contact position. In the user interface device to be defined,
A pressure detection unit that detects pressure applied to the touch panel by the finger;
Contact time determination means for determining whether the contact position of the finger has not changed continuously for a predetermined time; and
When the contact time determination means makes a true determination, the touch position of the finger is monitored in a fixed state without moving the entire image including the object, instead of the mode in which the drag operation is performed. ”Mode is activated, and when the finger touching regardless of whether or not it is within the display position range of the object moves while touching again after being separated, the“ touch focus ”mode is canceled. Mode operating means for operating a mode enabling the drag operation;
Contact position determination means for determining whether the contact position of the finger is superimposed on the display position range of the object when the “touch focus” mode is operated;
A pressing force determining means for determining whether the pressing force is equal to or greater than a predetermined threshold;
When the contact position determination means makes a true determination, it is determined that a “focus” operation indicating that the object has been selected by the user has been performed, a corresponding action is activated, and the contact position determination When the means performs true determination and the pressing force determination means performs true determination, it is determined that a “click” operation for pushing the display position range of the object by the finger is performed, and the function of the object is determined. A user interface device, comprising: an operation determination control unit that is activated. The mode operation means is viewed from the user operation,
If the finger is moved immediately after the finger touches the touch panel, a “drag” mode is performed in which a drag operation is performed to move the entire image,
2. The user interface device according to claim 1, wherein the “touch focus” mode is operated when the finger is brought into contact with the touch panel and the contact position is maintained for at least the predetermined time. A tactile response mechanism that gives a tactile response to the finger touching the touch panel;
Tactile response control means for controlling the tactile response mechanism unit to give a tactile response to the finger via the touch panel when the operation determining means determines that the operation is the “focus” operation. The user interface device according to claim 1, wherein the user interface device is provided.   The user interface device according to claim 3, wherein the tactile response control unit controls the tactile response mechanism unit so as to apply vibration that makes the finger feel the presence of a physical push button.   The predetermined time is set longer than the average time required from the time when the finger is touched when the user intends to perform the drag operation to the next start of movement, and the object is selected. 5. The method according to claim 1, wherein when the operation is intended to be performed, the time is set to be shorter than an average time required until the next movement starts after the finger touches. 5. User interface device. An image display unit that displays an image including an object to be operated on the screen, and a touch panel that sequentially outputs a finger contact position as time passes, and a drag operation is performed as movement of the finger contact position. In the program installed in the specified user interface device,
The user interface device includes a pressing force detection unit that detects a pressing force applied to the touch panel by the finger,
The program is
Contact time determination means for determining whether the contact position of the finger has not changed continuously for a predetermined time; and
When the contact time determination means makes a true determination, the touch position of the finger is monitored in a fixed state without moving the entire image including the object, instead of the mode in which the drag operation is performed. ”Mode is activated, and when the finger touching regardless of whether or not it is within the display position range of the object moves while touching again after being separated, the“ touch focus ”mode is canceled. Mode operating means for operating a mode enabling the drag operation;
Contact position determination means for determining whether the contact position of the finger is superimposed on the display position range of the object when the “touch focus” mode is operated;
A pressing force determining means for determining whether or not the pressing force is equal to or greater than a predetermined threshold;
When the contact position determination means makes a true determination, it is determined that a “focus” operation indicating that the object has been selected by the user has been performed, a corresponding action is activated, and the contact position determination When the means performs true determination and the pressing force determination means performs true determination, it is determined that a “click” operation for pushing the display position range of the object by the finger is performed, and the function of the object is determined. A program for a user interface device, which causes a computer to function as operation determination control means to be activated. An image display unit that displays an image including an object to be operated on the screen, and a touch panel that sequentially outputs a finger contact position as time passes, and a drag operation is performed as movement of the finger contact position. In the input operation determination method in the specified user interface device,
The user interface device includes a pressing force detection unit that detects a pressing force applied to the touch panel by the finger,
A first step of determining whether the contact position of the finger has not changed continuously for a predetermined time; and
When the true determination is made in the first step, not the mode in which the drag operation is performed, but “touch focus” in which the contact position of the finger is monitored in a fixed state without moving the entire image including the object. The mode is operated, and when the finger touching regardless of whether or not it is within the display position range of the object moves while touching again after being separated, the “touch focus” mode is canceled and the finger is moved. A second step of operating a mode enabling a drag operation;
A third step of determining whether or not the touch position of the finger is superimposed on the display position range of the object when the “touch focus” mode is activated;
A fourth step of determining whether or not the pressing force is equal to or greater than a predetermined threshold;
When the true determination is made in the third step, it is determined that the “focus” operation indicating that the object has been selected by the user has been performed, the corresponding action is activated, and in the third step, When the true determination is made and the true determination is made in the fourth step, it is determined that the “click” operation for pushing the display position range of the object with the finger is performed, and the function of the object is activated. And an input operation determination method comprising: a fifth step.

Images