JP2015191259A - Input interface, control method therefor, control program therefor, information terminal having input interface, control method therefor, and control program therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform a selecting operation close in an operational feeling to an intuitive operation without releasing the finger when first touch selection becomes unstable in an input interface using a touch panel.SOLUTION: The input interface includes: floating window means 50 for displaying a floating window for performing the enlarged display of the periphery of a touch position 2 when touch selection is not determined; and means for displaying a pointer 3 in the floating window. This pointer 3 is displayed such that a relative positional relation between a selection object 1 in the floating window and the pointer 3 becomes similar to a positional relation between the original selection object 1 and the touch position 2. Then, the input interface includes pointer input determination means 70 for determining the selection of the selection object 1 on the basis of the change of a touch state after the display of the pointer 3.

Description

  The present invention relates to an input interface, a control method thereof, a control program thereof, an information terminal having an input interface, a control method thereof, and a control program thereof.

  It is assumed that a Web page created on the assumption that browsing with a personal computer is displayed on a display dedicated to the personal computer (for example, 15 to 17 inches). When the Web page is viewed with a device having a display area smaller than that of a personal computer such as a tablet or a smartphone, an anchor or an icon for performing an operation on the Web page is displayed small.

  The mainstream of personal computers is to operate a Web page by moving the cursor position on the screen using a mouse provided. On the other hand, tablets and smartphones are mainly operated by touching the screen with a fingertip.

When an operation on a Web page is performed with a human fingertip, for example, in a case where a plurality of icons smaller than the surface area where the fingertip touches the screen are arranged, even if the user originally intends to select the icon to be selected, In some cases, the icon is selected.
A browser (Google Chrome, registered trademark) provided by Google Inc. avoids this problem by displaying a corresponding portion as a floating window and allowing the user to select it again when a plurality of icons are selected at the same time. In this method, however, the target object to be operated must be touched, and once removed from the screen to display the floating window, the selection operation must be performed again with the fingertip.

  For example, Patent Document 1 discloses a method for performing a selection operation without releasing a finger. In this technique, a floating window is displayed with a finger in contact, and selection is possible by flicking the finger in the direction of the option to be selected from a plurality of options displayed in the floating window. Here, the flick operation is an operation of sliding a finger without releasing it from the touch panel. If this technique is used, selection operation can be performed without releasing a finger.

Japanese Patent Laid-Open No. 2014-04391

  However, the technique disclosed in Patent Document 1 has a problem in that the actual operation does not match the intuitive operation feeling because the position where the finger is actually touched is distant from the display of the floating window.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide a method for bringing an actual operation close to an intuitive operation feeling.

  In order to solve the above-described problem, an input interface according to the present invention includes a selection object display unit that displays a selection object, a touch panel provided corresponding to the selection object display unit, and a touch position where the touch panel is touched. Touch position measuring means for measuring, touch selection determining means for determining whether or not to select the selected object according to the position touched on the touch panel, and enlargement of the display around the touch position when the touch selection is not confirmed The floating window display means for displaying the floating window to be displayed, and the relative positional relationship between the selected object and the pointer in the floating window are the same as the positional relationship between the original selected object and the touch position. Show pointer Pointer display means, pointer input determination means for confirming selection of the selected object based on a change in touch state after the pointer display, and control means for performing processing corresponding to selection of the selected object. ing.

  The effect of the present invention is that even when the first touch selection using the touch panel becomes indefinite, the selection operation can be performed with an operation feeling close to an intuitive operation without releasing the finger.

It is a block diagram which shows the 1st Embodiment of this invention. It is a top view which shows the 2nd Embodiment of this invention. It is a top view which shows operation | movement of the 2nd Embodiment of this invention. It is a flowchart which shows the operation | movement of the 2nd Embodiment of this invention. It is a top view which shows the example of the display concerning the 3rd Embodiment of this invention. It is a top view which shows the procedure of the 3rd Embodiment of this invention. It is a top view which shows another procedure of the 3rd Embodiment of this invention. It is a top view which shows the 4th Embodiment of this invention. It is a top view which shows the 5th Embodiment of this invention. It is a top view which shows the 6th Embodiment of this invention.

Hereinafter, the present invention will be described in detail with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram showing a first embodiment of the present invention. The input interface 100 according to the present embodiment includes a selected object display unit 10 that displays the selected object 1 and a touch panel 20 that is provided corresponding to the selected object display unit 10. The touch position measuring unit 30 that measures the touch position touched by the touch panel 20 and the touch selection determining unit 40 that determines whether or not the selection of the selected object is determined based on the position touched by the touch panel 20 are provided. ing. Furthermore, there is a floating window display means 50 for displaying a floating window for enlarging and displaying the display around the touch position 2 when the touch selection is not confirmed. Then, a floating window pointer display means 60 for displaying the pointer 3 in the displayed floating window is provided. This floating window pointer display means 60 displays the pointer so that the relative positional relationship between the selected object 1 and the pointer 3 in the floating window is the same as the positional relationship between the original selected object 1 and the touch position 2. . And it has the pointer input determination means 70 which confirms selection of the selection object 1 based on the change of the touch state after the pointer 3 display, and the control means 80 which performs the process corresponding to selection 1 of the selection object. .

With the above configuration, even when the selection cannot be confirmed by the first touch, reselection can be performed without removing the finger or the touch input device from the touch panel. This is because by displaying the pointer where the relative position with respect to the selected object is the same as the original touch position, it can be felt as if the selection operation is being performed with the pointer.
(Second Embodiment)
FIG. 2 is a plan view showing an information terminal 200 using the input interface 100.

  The information terminal 200 has the input interface 100 of the first embodiment. The selected object display means 10 of the input interface 100 of the present embodiment is, for example, a flat panel display such as a liquid crystal display or an organic EL display, and the touch panel 20 is provided so as to overlap the selected object display means 10. For this reason, both are depicted in an indivisible form in FIG. Although not shown, the information terminal 200 may include communication means, information processing means, storage means, a web browser, and other application programs. Specifically, the information terminal 200 is a mobile phone, a smartphone, a tablet PC, or the like. Hereinafter, the selected object display means 10 may be referred to as a display.

  A plurality of selected objects 1 are displayed on the selected object display means 10 (display). The selection object 1 is, for example, a link to Web content, a folder, a file, an icon for starting an application, or the like. When the selected object 1 is touched, the selected object 1 corresponding to the touch position 2 is selected, and processing corresponding to the selected object 1 is executed. Since such a touch input method is a generally well-known technique, a detailed description of its operation is omitted. The touch panel 20 includes a resistance change detection method, a capacitance change detection method, a pressure change detection method, an optical detection method, and the like, but this embodiment can be applied regardless of the difference between these methods.

  Here, returning to FIG. 2, the present embodiment will be described. In selecting the selected object 1, a predetermined threshold value is determined in advance to determine the range within which the display of the selected object 1 is touched to determine selection. If the touch position 2 is within this range, there is no problem because the selection can be confirmed. However, when the touch position 2 is out of the predetermined range, it may be impossible to determine which of the plurality of selected objects 1 can be selected. For example, it is a case where a plurality of icons smaller than the surface area where the fingertip touches the screen are arranged. FIG. 2 shows an operation example of the present embodiment in such a case. The operation will be described below using the example of FIG.

  First, the user touches an area between the “object, specification document” and “member list” that are the selected objects 1. Then, the floating window 300 is raised, the display around the touch position 2 is enlarged, and the selected object 1 is displayed as the enlarged selected object 301. Further, the pointer 3 is displayed so that the position corresponding to the current touch position 2 in the floating window 300 becomes the pointer indication position 4. When the finger (or input means) at the current touch position 2 is moved, the pointer 3 moves in the floating window 300 in conjunction with it. Then, the selection object 1 in the direction in which the pointer instruction position 4 is moved is selected. A predetermined value is determined in advance as to how much the touch position 2 moves to confirm the selection. With the above operation, even when selection by touch becomes ambiguous, reselection can be performed without releasing a finger or the like from the touch panel 20 by an intuitive selection operation.

  FIG. 3 is a plan view showing a state in which this operation is extracted. First, as shown in FIG. 3A, it is assumed that the touch position 2 is in the middle of “material, specification document” and “member list”. Then, the floating window 300 is displayed, and “documents and specification documents” and “member list” are enlarged and displayed. At the same time, the pointer 3 is displayed. At this time, the position corresponding to the touch position 2 in the floating window 300 is the pointer instruction position 4. Although a finger image is used as the pointer here, the pointer image is not limited to this, and an arbitrary image can be used.

  Next, the user moves the touch position 2 in the direction of the selected object 1 to be selected while touching the finger. When this movement is detected by the pointer input determination means 70 and the movement amount exceeds a predetermined threshold, it is determined that the selection is confirmed. FIG. 3B shows an example in which the pointer 3 has moved upward in the drawing and “documents and specification documents” have been selected, and FIG. 3C shows an example in which the pointer 3 has moved down and “member list” has been selected. , Respectively.

  In the above operation, the user can perform the selection operation as if the user is operating the pointer 3 even though the user actually moves his / her finger on the touch panel 20.

  Next, details of the above operation will be described. FIG. 4 is a flowchart showing this operation. First, a finger (or input means such as a pen) touches the touch panel to detect a touch position 2 (S1). At this time, if the touch position 2 is within the range for selecting and confirming the selected object 1 (S2_yes), the selection is confirmed (S7). If it is not within the selection and confirmation range (S2_no), the floating window 300 is displayed (S3). At this time, the first touch position is stored in at least one of the floating window display means 50, the floating window pointer display means 60, the pointer input determination means 70, and the control means 80. It is used for the display of the floating window 300, the display of the pointer 3, and the pointer input determination. Next, the pointer 3 is displayed in the floating window 300 (S4). At this time, the pointer 3 is displayed so that the positional relationship between the selected object 1 and the pointer indication position 4 in the floating window 300 is substantially the same as the body relationship between the selected object 1 and the touch position 2 in the original display. Next, when the user moves his / her finger for selection, the touch position moves, but the pointer 3 moves in the floating window 300 in conjunction with the movement of the touch position 2 (S5). By this operation, the user can obtain an operational feeling as if the pointer is moved directly. If the movement amount exceeds the threshold value (S6_yes), the pointer input determination means 70 confirms the selection (S7). If the movement amount does not exceed the threshold value, the movement of the pointer associated with the touch position 2 is continued (S6_no).

  If the movement amount does not exceed the threshold for a predetermined time, a timeout may be set. When a time-out occurs, the next operation may be controlled such as closing the floating window 300 or executing an operation for prompting selection such as displaying an alarm or generating an alarm sound.

Further, the example in which one selection object 1 is selected from two selection objects 1 has been described so far, but the same applies to the case where one selection object 1 is selected when there are three or more selection objects 1. This embodiment mode can be applied. Further, where the floating window 300 is displayed in the display is arbitrary, but it is desirable to display it at a position above the position of the touched finger from the viewpoint of visibility. In addition, if there is not enough display area on the left side of the touched finger, it will be displayed on the lower side if there is not enough display area on the left side, and on the right side if there is not enough display area on the lower side. It is good to keep in order.
(Third embodiment)
In the present embodiment, a method for determining a range for selecting the selected object 1 and a method for determining a movement amount threshold value for the touch position 2 for confirming selection when the floating window 300 is displayed will be described.

  FIG. 5 is a plan view showing a display when there are two selected objects 1. In the drawing, the horizontal direction is the x-axis and the vertical direction is y. “Materials and specification documents” are also expressed as 1a and “Member list” as 1b.

  First, a description will be given of whether the selection is confirmed or the floating window 300 is displayed when the coordinates of the first touch position 2 are (Xn, Yn).

FIG. 6 is a plan view showing the selected object 1 and the touch position 2 (Xn, Yn). Here, it is assumed that the Y coordinate of the display range of the “document, specification document” 1a is Y0 to Y1, and the Y coordinate of the display range of the “member list” 1b is Y1 to Y2. A position above the display height Y1-Y0 by a predetermined ratio N from the lower end of 1a is defined as Yb, and a position below the display height Y2-Y1 from the upper end of Ya, 1b by a predetermined ratio N is defined as Yb. N is, for example, 10%. Then, the next operation is determined as follows depending on which range the touch position 2 (Xn, Yn) is in.
(1) If Yn <Ya <Yb, “material, specification document” 1a is selected and confirmed.
(2) If Ya <Yb <Yn, “member list” 1b is selected and confirmed.
(3) If Ya <Yn <Yb, it is determined that the selection is ambiguous and the floating window 300 is displayed. Then, the reselection operation as in the second embodiment is performed. The procedure will be described below. Here, it is assumed that the coordinates of the movement destination of the touch position 2 in the reselection operation are (Xn + 1, Yn + 1).

The following two methods are exemplified as a method for confirming selection of the selected object 1 by reselection.
(A) Detecting and determining the moving direction After moving by a predetermined distance L from the first touch position 2, the direction is determined as a selection operation. FIG. 6 illustrates this concept. When the first touch position 2 is moved by L, that is, when Yn−Yn + 1> L, 1a is selected, and when Yn−Yn + 1 <−L, 1b is confirmed. If the predetermined distance L is too large, the reaction becomes dull, and if it is too small, an unintended selection may be determined, so an appropriate value is set. The user may be able to customize the settings.
(B) Detecting and determining the movement destination As in the first selection, the selection can be confirmed when the movement destination falls within a predetermined range. FIG. 7 illustrates this concept. Here, it is assumed that the Y coordinate that is higher by a predetermined ratio M of the display height from the lower end of the display object 1a is Yc, and the Y coordinate that is lower by the predetermined ratio M from the upper end of 1b is Yd. In the coordinates (Xn + 1, Yn + 1) of the touch movement destination,
When Yn + 1 <Yc, 1a is selected, and when Yn + 1> Yd, 1b is selected. The predetermined ratio M may be the same as N or a different value.

As described above, by setting a predetermined threshold value, it is possible to determine whether or not to confirm the selection by the first touch and a specific procedure for reselection using the floating window. Here, the example in which the selection objects 1 are arranged vertically is described, but it goes without saying that the same method can be applied to the case where the selection objects 1 are arranged horizontally.
(Fourth embodiment)
In the third embodiment, the operation when selecting one of the two selection objects 1 has been described. However, even when there are three or more selection objects 1, for example, four, the selection confirmation and reselection are performed in the same manner. The action can be performed.

  FIG. 8 is a plan view showing a case where there are four selected objects 1. Four icons 1a, 1b, 1c, 1d are displayed. Here, the upper end of the upper icon is Y0, the lower end is Y1, and the lower end of the lower icon is Y2. The left end of the left icon is X0, the right end is X1, and the right end of the right icon is X2. Further, the lower limit of the X coordinate for distinguishing whether or not the selection is confirmed is Xa, the upper limit is Xb, the lower limit of the Y coordinate is Ya, and the upper limit is Yb.

  Also in this case, the reselection operation using the floating window 300 and the pointer 3 can be performed by the same procedure as in the third embodiment. That is, using the threshold coordinates, it is determined whether the selection is confirmed by the first touch or the floating window 300 is displayed. When the floating window 300 is displayed, the selection is confirmed by the movement of the touch position 2 after the display.

Depending on the first touch position (Xn, Yn), the following operation is performed.
(1) When X0 <Xn <Xa and Y0 <Yn <Ya, the selection of 1a is confirmed.
(2) When X0 <Xn <Xa and Yb <Yn <Y2, the selection of 1b is confirmed.
(3) When Xb <Xn <X2 and Y0 <Yn <Ya, the selection of 1c is confirmed.
(4) When Xb <Xn <X2 and Yb <Yn <Y2, the selection of 1d is confirmed.
(5) When Xa <Xn <Xb or Ya <Yn <Yb, the floating window 300 and the pointer 3 are displayed.

  In the case of (5), as in the third embodiment, when the moving direction of the touch position after displaying the pointer 3 or the coordinate after the movement exceeds the threshold value, the selection of the corresponding selection object 1 is confirmed.

  If the selection is not confirmed by the first touch, if there are two selection objects 1 for determination, for example, if the touch position 2 is between 1a and 1b, the selection objects 1 to be enlarged are only 1a and 1b. It is possible to adopt either a method of selecting two options or a method of displaying four enlarged selection objects 301 and selecting four options.

As described above, when the present embodiment is used, the present invention can be applied even when there are four selection objects 1.
(Fifth embodiment)
The present embodiment is an example where there are more than four selection objects 1 related to selection. FIG. 9 is a plan view showing a fifth embodiment of the present invention. There are eight selected objects 1 and the center is empty. For example, this may be the case when the icons are not aligned.

  In this case as well, the present invention can be applied by setting the selection threshold 5 in accordance with the number of selection objects 1 to be selected. In the example of FIG. 9, a selection threshold 5 is used such that the coordinates form an octagon. The selection and re-selection procedure using the floating window 300 is the same as the procedure described above, and the description thereof will be omitted.

As described above, according to the present embodiment, the present invention can be applied even when there are more than four selected objects.
(Sixth embodiment)
FIG. 10 is a conceptual diagram showing a reselection method when the pressure-sensitive touch panel 20 is used. First, touch the position where selection cannot be confirmed. Then, the floating window 300 is displayed as in the other embodiments. Here, pressure is applied in the direction desired to be selected with a finger (or input means) in the direction desired to be selected. In the example of FIG. 10, the pressing direction 6 is downward and “member list” is selected. The threshold value for determining the amount of pressure to be applied is preferably set as appropriate for convenience.

  As described above, according to the present embodiment, when the pressure-sensitive touch panel 20 is used, reselection using pressure detection can be executed.

DESCRIPTION OF SYMBOLS 1 Selected object 2 Touch position 3 Pointer 4 Pointer indication position 5 Selection threshold 6 Pressure direction 10 Selected object display means 20 Touch panel 30 Touch position measurement means 40 Touch selection determination means 50 Floating window display means 60 Floating window pointer display means 70 Pointer Input determining means 80 Control means 100 Input interface 200 Information terminal 300 Floating window L Predetermined distance M, N Predetermined ratio

Claims (10)

  Selected object display means for displaying a selected object, a touch panel provided corresponding to the selected object display means, touch position measurement means for measuring a touch position touched by the touch panel, and a position touched by the touch panel Touch selection determining means for determining whether or not to confirm the selection of the selected object, floating window display means for displaying a floating window for enlarging the display around the touch position when the touch selection is not confirmed, and the floating Pointer display means for displaying the pointer so that the relative positional relationship between the selected object and the pointer in the window is the same as the positional relationship between the original selected object and the touch position; and touch after the pointer display Change of state Input interface, characterized in that it comprises a control means for performing a pointer input determination means for determining the selection of the selected object, a process corresponding to selection of the selected object on the basis of.   The input interface according to claim 1, wherein the change in the touch state is a movement of a predetermined distance.   The input interface according to claim 1, wherein the change in the touch state is movement of a predetermined distance with respect to the display area of the selected object.   The input interface according to claim 1, wherein the touch panel is a pressure-sensitive touch panel, and the change in the touch state is a change in a pressing direction.   An information terminal comprising the input interface according to any one of claims 1 to 4.   Selected object display means for displaying a selected object, a touch panel provided corresponding to the selected object display means, touch position measurement means for measuring a touch position touched by the touch panel, and a position touched by the touch panel Touch selection determining means for determining whether or not to confirm the selection of the selected object, floating window display means for displaying a floating window for enlarging the display around the touch position when the touch selection is not confirmed, and the floating Pointer display means for displaying the pointer so that the relative positional relationship between the selected object and the pointer in the window is the same as the positional relationship between the original selected object and the touch position; and touch after the pointer display Change of state And a control means for performing a process corresponding to the selection of the selected object, when the touch selection is not confirmed. The floating window displaying an enlarged display around the touch position is displayed, and the relative positional relationship between the selected object and the pointer in the floating window is the same as the positional relationship between the original selected object and the touch position. The input interface control method, wherein the pointer is displayed so that the selection of the selected object is confirmed based on a change in the touch state after the pointer display.   The input interface control method according to claim 6, wherein the change in the touch state is a movement of a predetermined distance.   Selected object display means for displaying a selected object, a touch panel provided corresponding to the selected object display means, touch position measurement means for measuring a touch position touched by the touch panel, and a position touched by the touch panel Touch selection determining means for determining whether or not to confirm the selection of the selected object, floating window display means for displaying a floating window for enlarging the display around the touch position when the touch selection is not confirmed, and the floating Pointer display means for displaying the pointer so that the relative positional relationship between the selected object and the pointer in the window is the same as the positional relationship between the original selected object and the touch position; and touch after the pointer display Change of state A control method for an information terminal having an input interface having pointer input determination means for confirming selection of the selected object on the basis of, and control means for performing processing corresponding to the selection of the selected object. The floating window is displayed to enlarge the display around the touch position when not fixed, and the relative positional relationship between the selected object and the pointer in the floating window is the position of the original selected object and the touch position. An information terminal characterized by displaying the pointer so as to be similar to a relationship, confirming selection of the selected object based on a change in touch state after the pointer is displayed, and executing a selected process Control method.   Selected object display means for displaying a selected object, a touch panel provided corresponding to the selected object display means, touch position measurement means for measuring a touch position touched by the touch panel, and a position touched by the touch panel Touch selection determining means for determining whether or not to confirm the selection of the selected object, floating window display means for displaying a floating window for enlarging the display around the touch position when the touch selection is not confirmed, and the floating Pointer display means for displaying the pointer so that the relative positional relationship between the selected object and the pointer in the window is the same as the positional relationship between the original selected object and the touch position; and touch after the pointer display Change of state A control program for an input interface having pointer input determination means for confirming selection of the selected object and control means for performing processing corresponding to selection of the selected object, when touch selection is not confirmed A step of displaying the floating window for enlarging the display around the touch position, and a relative positional relationship between the selected object and the pointer in the floating window is a positional relationship between the selected object and the touch position. An input interface control program comprising: displaying the pointer so as to be similar; and confirming selection of the selected object based on a change in a touch state after the pointer is displayed.   Selected object display means for displaying a selected object, a touch panel provided corresponding to the selected object display means, touch position measurement means for measuring a touch position touched by the touch panel, and a position touched by the touch panel Touch selection determining means for determining whether or not to confirm the selection of the selected object, floating window display means for displaying a floating window for enlarging the display around the touch position when the touch selection is not confirmed, and the floating Pointer display means for displaying the pointer so that the relative positional relationship between the selected object and the pointer in the window is the same as the positional relationship between the original selected object and the touch position; and touch after the pointer display Change of state A control program for an information terminal having an input interface having pointer input determination means for confirming selection of the selected object on the basis of, and control means for performing processing corresponding to selection of the selected object, wherein touch selection is performed Displaying the floating window in which the display around the touch position is enlarged when not confirmed, and the relative positional relationship between the selected object and the pointer in the floating window is the original selected object and the touch position. The step of displaying the pointer so as to be the same as the positional relationship, the step of confirming the selection of the selected object based on the change of the touch state after the pointer display, the step of executing the selected process, Of an information terminal characterized by having Your program.

Images