JP2013016127A - Portable device, touch position adjustment method, object selection method, selected position determination method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a user to easily specify a position on a touch panel display.SOLUTION: A portable device 10 includes: a touch panel display 20; an icon display unit 111 for displaying plural icons on the touch panel display 20; a touch position acquisition unit 110 for acquiring a touch position touched by a user on the touch panel display; an icon specification unit 112 for selecting an icon to be selected in accordance with the touch position; a motion sensor 30 for detecting the motion of the portable device 10; and an icon specification change unit 113 for selecting another icon different from the icon to be selected in accordance with the inclination of the portable device 10.

Description

  The present invention relates to a portable device, a touch position adjustment method, an object selection method, a selection position determination method, and a program.

  In recent years, portable devices such as smartphones and tablet terminals equipped with large touch panel displays have become widespread. In such a portable device, content is displayed in response to a finger touch on the touch panel display. For example, Patent Document 1 discloses a technique for performing a prescribed operation in response to a gesture on a touch screen display.

Special table 2010-503126 gazette

  However, a lot of information is displayed on the touch panel display of the portable device, and it may be difficult to select what the user intended.

  The present invention has been made in view of such a background, and a portable device, a touch position adjustment method, an object selection method, and a selection position determination that can make it easy for a user to specify a position on a touch panel display. An object is to provide a method and a program.

  A main invention of the present invention for solving the above problems is a portable device, a touch panel display, a touch position acquisition unit that acquires a touch position that is a position on the touch panel display touched by a user, A movement detection unit that detects the movement of the portable device and an adjustment unit that adjusts the touch position according to the movement of the portable device are provided.

  In the portable device of the present invention, the motion detection unit detects a change in the speed of movement of the portable device, and the adjustment unit adjusts the touch position according to the change in the speed. May be.

  In the portable device of the present invention, the motion detection unit may detect an inclination of the portable device, and the adjustment unit may adjust the touch position according to the inclination.

  In the portable device of the present invention, the motion detection unit detects at least one of the direction of the tilt and the acceleration of the tilt, and the adjustment unit has at least one of the direction of the tilt and the acceleration of the tilt. The touch position may be adjusted accordingly.

  In the portable device of the present invention, after the adjustment unit adjusts the touch position, the motion detection unit detects the movement of the portable device, and the adjustment unit responds to the movement of the portable device. The touch position may be adjusted.

  Another aspect of the present invention is a portable device, which is a touch panel display, an information display unit that displays a plurality of objects on the touch panel display, and a touch that is a position on the touch panel display touched by a user. A touch position acquisition unit that acquires a position; an object selection unit that selects the first object according to the touch position; a motion detection unit that detects a movement of the portable device; and a movement of the portable device. Accordingly, an adjustment unit that selects the second object different from the first object is provided.

  In the portable device of the present invention, the motion detection unit detects a change in speed of the portable device, and the adjustment unit selects the second object according to the change in speed. May be.

  In the portable device of the present invention, the motion detection unit may detect an inclination of the portable device, and the adjustment unit may select the second object according to the inclination.

  In the portable device of the present invention, the motion detection unit detects at least one of the direction of the tilt and the acceleration of the tilt, and the adjustment unit has at least one of the direction of the tilt and the acceleration of the tilt. The second object may be selected accordingly.

  In the portable device of the present invention, after the adjustment unit selects the second object, the motion detection unit detects the movement of the portable device, and the adjustment unit moves the movement of the portable device. Depending on the, the third object different from the second object may be selected.

  In the portable device of the present invention, the motion detection unit detects the direction of the motion, and the adjustment unit detects the second object displayed in the direction of the motion from the first object. You may make it select.

  In the portable device of the present invention, the motion detection unit further detects the amount of the motion, and the adjustment unit detects the other object displayed in the direction of the motion from the first object. Of these, the second object may be selected according to the amount of movement.

  In the portable device of the present invention, the motion detection unit further detects the acceleration of the motion, and the adjustment unit detects other objects displayed in the direction of the motion from the first object. Of these, the second object may be selected according to the acceleration of the movement.

  In the portable device of the present invention, the information display unit may display the object in a list or grid display on the touch panel display.

  Another aspect of the present invention is a portable device that includes a touch panel display, an information display unit that displays information on the touch panel display, and a touch position that is a position on the touch panel display touched by a user. A touch position acquisition unit to acquire; a selection position determination unit that determines a selection position that is a position selected by the user in the information according to the touch position; and a motion detection unit that detects the movement of the portable device; And an adjusting unit that adjusts the selected position in accordance with the movement of the portable device.

  In the portable device of the present invention, the motion detection unit may detect a change in the speed of the portable device, and the adjustment unit may adjust the selection position according to the change in the speed. Good.

  In the portable device of the present invention, the motion detection unit may detect an inclination of the portable device, and the adjustment unit may adjust the selection position according to the inclination.

  In the portable device of the present invention, the motion detection unit detects at least one of the direction of the tilt and the acceleration of the tilt, and the adjustment unit has at least one of the direction of the tilt and the acceleration of the tilt. The selection position may be adjusted according to the above.

  In the portable device of the present invention, after the adjusting unit adjusts the selected position, the motion detecting unit detects the movement of the portable device, and the adjusting unit responds to the movement of the portable device. The selection position may be adjusted.

  In the portable device of the present invention, the touch position acquisition unit acquires the first and second touch positions, and the selection position is a start position and an end position of a range for selecting a part of the information. And the selection position determination unit determines the start position and the end position according to the first and second touch positions, and the movement is performed while both the first and second touch positions are touched. Is detected, one of the start position and the end position is adjusted, and when the movement is detected while only one of the first or second touch positions is touched, the start position The other of the end positions may be adjusted.

  In the portable device of the present invention, the information displayed by the information display unit may be text information, and the selection position may be a caret position in the text information.

  Another aspect of the present invention is a touch position adjustment method, in which a portable device including a touch panel display acquires a touch position that is a position on the touch panel display touched by a user, and the portable device is provided. It is assumed that the touch position is adjusted according to the movement of the portable device.

  Another aspect of the present invention is an object selection method in which a portable device including a touch panel display displays a plurality of objects on the touch panel display and is a position on the touch panel display touched by a user. A touch position is acquired, the first object is selected according to the touch position, the movement of the portable device is detected, and the first object different from the first object is detected according to the movement of the portable device. The two objects are selected.

  Another aspect of the present invention is a selection position adjustment method, in which a portable device including a touch panel display displays information on the touch panel display and is a touch on the touch panel display touched by a user. Acquire a position, determine a selected position that is the position selected by the user in the information according to the touch position, detect a movement of the portable device, and select the selection according to the movement of the portable device The position will be adjusted.

  According to another aspect of the present invention, there is provided a program, the step of acquiring a touch position, which is a position on the touch panel display touched by a user, on a computer including a touch panel display, and the movement of the portable device. The step of detecting and the step of adjusting the touch position according to the movement of the portable device are executed.

  Another aspect of the present invention is a program, the step of displaying a plurality of objects on the touch panel display on a computer having a touch panel display, and a touch position that is a position on the touch panel display touched by a user. , Selecting the first object according to the touch position, detecting the movement of the portable device, and according to the movement of the portable device, the first object And selecting the second object different from the above.

  According to another aspect of the present invention, there is provided a program for displaying information on the touch panel display on a computer including a touch panel display, and obtaining a touch position that is a position on the touch panel display touched by a user. According to the touch position, determining a selected position that is the position selected by the user in the information, detecting the movement of the portable device, and depending on the movement of the portable device. And adjusting the selected position.

  Other problems and solutions to be disclosed by the present application will be made clear by the embodiments of the invention and the drawings.

  According to the present invention, a user can easily specify a position on a touch panel display.

2 is a diagram illustrating an example of an appearance of a portable device 10. FIG. 2 is a diagram illustrating a hardware configuration example of a portable device 10. FIG. It is a figure explaining the inclination of the portable device. 3 is a diagram illustrating an example of a software configuration of a portable device 10. FIG. 4 is a diagram illustrating an example of a state in which icons are displayed on the touch panel display 20. FIG. It is a figure which shows the flow of the process which changes a selection icon by inclination. It is a figure explaining the flow of the change process of the selection icon according to the inclination of a vertical direction. It is a figure explaining the flow of the change process of the selection icon according to the inclination of a horizontal direction. It is a figure which shows the flow of the process which determines a shake. It is a figure which shows the example of a screen as which data 41, such as a thumbnail of an image, was output in the grid form. It is a figure which shows the example of a screen where the table data 420 comprised by the cell 42 was output. It is a figure which shows the example of a screen where the list | wrist 430 which arranged items 43, such as an address book, was output. It is a figure which shows the example of a screen where the graph 440 by which the node 44 is connected by the link 441 was output. It is a figure which shows the example of a screen as which objects 45, such as a figure and a text, were output to arbitrary places. It is a figure which shows the example of a screen as which the text data 51 was output. It is a figure which shows the example of a screen where the text data 52 was output. It is a figure which shows the flow of the change process of the selection node in a graph. It is a figure which shows the flow of the determination process of a movement destination node. It is a figure which shows the flow of the change process of the selection object in case an object is displayed on arbitrary positions.

  FIG. 1 is a diagram showing an example of the appearance of a portable device 10 according to an embodiment of the present invention. The portable device 10 according to the present embodiment is a computer such as a smartphone or a tablet computer including a touch panel display 20 and performs various processes according to a tap on the touch panel display 20 by a user's finger.

  The tap is completed when the touch panel display 20 is released after the finger is touched. Objects that are displayed according to touch, such as displayed icons, images, shapes, lists, cells, etc., text input position (called caret position), text selection range, and objects selected according to release Processing according to the caret position and selection range is performed. For example, an application program corresponding to the selected icon is activated.

  In the portable device 10 of the present embodiment, the touch position can be finely adjusted by moving the portable device 10 from touch to release. In the present embodiment, as the movement of the portable device 10 (also referred to as a gesture), it is detected that the portable device is tilted or that the portable device is shaken (referred to as a shake).

  FIG. 2 is a diagram illustrating a hardware configuration example of the portable device 10. The portable device 10 includes a touch panel display 20, a motion sensor 30, a CPU 101, a memory 102, a flash memory 103, and a display controller 104.

  The motion sensor 30 can be, for example, an acceleration sensor, a gyro sensor, or a combination thereof, and detects the movement of the portable device 10. In the present embodiment, as shown in FIG. 3, the motion sensor 30 is configured to rotate the portable device 10 around a rotation 31 around the X axis, a rotation 32 around the Y axis, and a rotation 33 around the Z axis. About each, the angle and acceleration which rotated in the predetermined unit time are acquirable. In this embodiment, for the sake of simplicity of explanation, an angle of rotation about the X axis (hereinafter referred to as a beta angle) and an acceleration (hereinafter referred to as beta acceleration), and an angle of the rotation about the Y axis. Only the acceleration (hereinafter referred to as gamma angle) and acceleration (hereinafter referred to as gamma acceleration) are measured. Note that the beta angle is a value between −180 degrees and less than 180 degrees, and the gamma angle is a value between −90 degrees and less than 90 degrees. The beta acceleration and the gamma acceleration may be measured by a sensor that detects angular acceleration, or the acceleration of each axis may be detected by a triaxial acceleration sensor.

  The flash memory 103 is a storage device that stores various data and programs. In the present embodiment, it is assumed that the flash memory 103 stores one or more application programs and a control program that controls the application programs. Instead of the flash memory 103, a storage device such as a hard disk drive or a solid state drive may be employed. The CPU 101 implements various functions by reading the control program and application program stored in the flash memory 103 into the memory 102 and executing them. The display controller 104 detects information displayed on the touch panel display 20 and a finger touch on the touch panel display 20.

  FIG. 4 is a diagram illustrating a software configuration example of the portable device 10. The portable device 10 includes a touch position acquisition unit 110, an icon display unit 111, an icon designation unit 112, an icon designation change unit 113, an application activation unit 114, a data output unit 121, a data designation unit 122, a data designation change unit 123, and a caret. A position designation unit 124, a caret position change unit 125, a selection range designation unit 126, a selection range adjustment unit 127, and a data processing unit 128 are provided. Each of these functional units is realized by the CPU 101 included in the portable device 10 reading out the control program and application program stored in the flash memory 103 to the memory 102 and executing them.

  The touch position acquisition unit 110 acquires a position where a finger is touched on the touch panel display 20. In the present embodiment, the touch position can be acquired such that x increases in the right direction and y increases in the downward direction with the upper left corner of the touch panel display 20 shown in FIG. 1 as a reference point. In addition, the touch position acquisition part 110 shall acquire the touch position in the touch panel display 20 by a well-known method.

  The icon display unit 111 displays icons on the touch panel display 20. In the present embodiment, it is assumed that an application program is activated when an icon is tapped on the touch panel display 20. FIG. 5 is a diagram illustrating an example of a state in which icons are displayed on the touch panel display 20. In the present embodiment, it is assumed that the icons 21 are displayed in a grid shape as shown in FIG. In the example of FIG. 5, four icons 21 can be displayed in the short direction and four in the long direction. It is assumed that the icon 21 can be specified by coordinates (x, y) (x = 0 to 4, y = 0 to 5) on the upper left of the touch panel display 20 as a reference. It should be noted that the number of icons 21 that can be arranged is not limited to these numbers in the matrix and can be any number.

  The icon designation unit 112 accepts designation of an icon (hereinafter referred to as a selection icon) selected by the user from the icons displayed on the touch panel display 20. The icon designating unit 112 detects that the touch panel display 20 has been touched, and using this as an opportunity, sets one icon 21 as a selection icon according to the touch position. In the example of FIG. 5, the icon 211 of (1, 1) is selected as the selection icon. Normally, the icon designating unit 112 uses an icon whose touch position is included in the display area as a selection icon. For example, an icon closest to a predetermined base point such as an upper left coordinate of the icon 21 may be used as the selection icon. .

  The icon designation changing unit 113 can be used according to the inclination and acceleration of the portable device 10 measured by the motion sensor 30 until the touch panel display 20 is released after the finger is touched (while the touch is continued). When at least one of tilt and shake of the portable device 10 is detected, and the tilt or shake of the portable device 10 is detected, the selection icon is changed.

  FIG. 6 is a diagram illustrating a flow of processing for changing the selection icon depending on the tilt of the portable device 10.

  First, the icon designation changing unit 113 performs a selection icon changing process corresponding to the vertical inclination shown in FIG. 7 (S301).

  When the absolute value of the beta angle is equal to or greater than a threshold value βo (for example, an arbitrary positive value less than 180 degrees such as 5 degrees or 10 degrees) (S311: YES), the icon designation changing unit 113 has a beta acceleration of If it is greater than or equal to the threshold value βr (eg, an arbitrary positive value such as 9.8) (S312: YES), Δy is set to 2 (S313), otherwise (S312: NO), Δy Is set to 1 (S314). If the absolute value of the beta angle is less than the threshold βo (S311: NO), the icon designation changing unit 113 sets Δy to 0 (S315).

  If the beta angle is a positive value (including 0) (S316: YES), the icon designation changing unit 113 adds Δy to y (S317), and if the beta angle is a negative value (S316: NO), Δy is subtracted from y (S318). The icon designation changing unit 113 sets y to 0 when y is less than 0, sets y to 4 when y exceeds 4, and sets the number of lines of the icon 21 on which y is displayed. If exceeded, the last line displayed is y.

  Next, the icon designation changing unit 113 performs a selection icon changing process corresponding to the horizontal inclination shown in FIG. 8 (S302).

  If the absolute value of the gamma angle is greater than or equal to a threshold value γo (for example, an arbitrary positive value less than 90 degrees, such as 5 degrees or 10 degrees) (S321: YES), the icon designation changing unit 113 determines that the gamma angular velocity is If it is greater than or equal to the threshold value γr (for example, an arbitrary positive value such as 9.8) (S322: YES), Δx is set to 2 (S323), otherwise (S322: NO), Δx 1 is set (S324). If the absolute value of the gamma angle is less than the threshold value γo (S321: NO), 0 is set to Δx (S325).

  When the gamma angle is a positive value (including 0) (S326: YES), the icon designation changing unit 113 adds Δx to x (S327), and when the gamma angle is a negative value (S326: NO), Δx is subtracted from x (S328). The icon designation changing unit 113 sets x to 0 when x is less than 0, sets x to 3 when x exceeds 3, and exceeds the number of columns of the icon 21 on which x is displayed. In this case, let x be the last column displayed.

  If the icon 21 of (x, y) set as described above exists (S303: YES), the last icon designation changing unit 113 selects the icon of (x, y) as the selection icon (S304). If it does not exist (S303: NO), the icon 21 closest to (x, y) is selected as the selection icon (S305).

  As described above, when the tilt of the portable device 10 is detected, the icon 21 (x, y) selected by the icon designating unit 112 is changed according to the tilt of the portable device 10. For example, in the example of FIG. 5, when the (1, 1) icon 211 is selected, the portable device 10 is tilted to the back side (upward) so as to rotate in the direction of the arrow 212 around the x axis. The (1,0) icon 213 becomes the selection icon. When the portable device 10 is tilted to the right so as to rotate about the y-axis in the direction of the arrow 214, the icon (215) of (2, 1) becomes the selection icon, and when the acceleration exceeds the threshold, the right further The (3, 1) icon 216 becomes a selection icon.

  As described above, in the present embodiment, the icon designation changing unit 113 has eight directions (upper, upper right, right, lower right, lower, lower left, left, When the acceleration exceeds a predetermined threshold value (βr, γr), the closest icon 21 displayed in any one of the upper left) is selected again, and the second closest icon 21 is selected. It can be reselected as a selection icon.

  6 to 8 can be repeatedly performed until a finger is released from the touch panel display 20. In this case, since the selection of the icon 21 can be finely adjusted by tilting the portable device 10, the user can surely select the intended icon 21.

  FIG. 9 is a diagram showing a flow of processing for determining a shake. The icon designation changing unit 113 acquires the beta acceleration and the gamma acceleration from the motion sensor 30 and sets them as βv0 and γv0 (S331), respectively, after a predetermined time (for example, an arbitrary time such as 1 ms can be set) ( S332), beta acceleration and gamma acceleration are again obtained from the motion sensor 30 to be βv1 and γv1, respectively (S333), and after a predetermined time has passed (S334), beta acceleration and gamma acceleration are obtained from the motion sensor 30 to obtain βv2 respectively. , Γv2 (S335). The icon designation changing unit 113 calculates the changes βΔv0 and γΔv0 of the beta acceleration and the gamma acceleration in the first predetermined time as the absolute value of the difference between βv0 and βv1 and the absolute value of the difference between γv0 and γv1, respectively ( S336) The beta acceleration and gamma acceleration changes βΔv1 and γΔv1 in the second predetermined time are calculated as the absolute value of the difference between βv1 and βv2 and the absolute value of the difference between γv1 and γv2, respectively (S337). If the first beta acceleration change amount βΔv0 is equal to or greater than the threshold value βr0 and the second beta acceleration change amount βΔv1 is equal to or greater than the threshold value βr1 (S338: YES), the icon designation changing unit 113 is portable. It is determined that 10 has been shaken (S339). Even when the beta acceleration change amount βΔv0 or βΔv1 is less than the threshold value βr0 or βr1 (S338: NO), the icon designation changing unit 113 has the first gamma acceleration change amount γΔv0 equal to or greater than the threshold value γr0, and If the second change amount γΔv1 of the gamma acceleration is greater than or equal to the threshold value γr1 (S340: YES), the process proceeds to step S339, and it is determined that the portable device 10 has been shaken.

  As described above, for example, when the portable device 10 is moved in the first predetermined time and the movement stops in the second predetermined time (for example, βv0 = 0, βv1 = 10, When βv2 = 0, or when the portable device 10 is moved in the first predetermined time and further increased in the second predetermined time (for example, βv0 = 0, βv1 = 10, βv2 = 20) In such a case, it can be determined that the portable device 10 has been shaken.

  When the icon designation changing unit 113 detects a shake of the portable device 10, the icon designation changing unit 113 sets the next icon as a selection icon in a predetermined order (hereinafter, referred to as an adjustment order). For example, in the screen example of FIG. 5, the adjustment order is in the horizontal direction from the upper left to the lower right, that is, (0, 0) (0, 1) (2, 0) (3, 0) (1, 0) ( In this order, if the icon 211 of (1, 1) is selected, the icon 215 of (2, 1) becomes the selection icon. In addition, when the user shakes without releasing the finger after the (2, 1) icon 215 becomes the selection icon, the (3, 1) icon 216 becomes the selection icon.

  As described above, in this embodiment, the icon designation changing unit 113 selects the icon 21 by touching the finger and, when it detects a shake before the release, releases the icon one right (the selected icon is the most right). In the case of the right, the icon 21 at the bottom leftmost) can be selected again as a selection icon. Therefore, if the icon selected when the touch panel display 20 is touched is not intended, the user can change the icon selection by shaking the portable device 10 while touching.

  The application activation unit 114 activates an application program corresponding to the selected icon 21. The application activation unit 114 detects that the finger has been released, and activates the application program corresponding to the selected icon in response to this detection.

  It is assumed that the icon display unit 111, the icon designation unit 112, the icon designation change unit 113, and the application activation unit 114 described above are realized as functions of the operating system of the portable device 10. The following data output unit 121, data specification unit 122, data specification change unit 123, caret position specification unit 124, caret position change unit 125, selection range specification unit 126, selection range adjustment unit 127, and data processing unit 128 are an operating system. It is assumed that the above is realized by executing the application program.

  The data output unit 121 outputs various data such as text data, images, and graphics to the touch panel display 20. The data output unit 121 may output data such as images and figures in a grid shape (table shape), list shape, graph shape, or the like, or a display area provided in at least a part of the touch panel display 20 Text data may be output on one side. Further, the data output unit 121 may output data to an arbitrary place on the touch panel display 20.

  10 to 16 are diagrams illustrating examples of screens on which data is output by the data output unit 121. FIG. 10 is a diagram showing an example of a screen on which data 41 such as image thumbnails is output in a grid shape. FIG. 11 is a diagram illustrating an example of a screen on which the table data 420 configured by the cells 42 is output. FIG. 12 is a diagram showing an example of a screen on which a list 430 in which items 43 such as an address book are arranged is output. FIG. 13 is a diagram illustrating an example of a screen on which a graph 440 in which the node 44 is connected by the link 441 is output. FIG. 14 is a diagram showing an example of a screen on which an object 45 such as a graphic or text in presentation data is output at an arbitrary location. 15 and 16 are diagrams showing examples of screens on which text data 51 and 52 are output.

  The data designation unit 122 accepts designation of data selected by the user from the plurality of data (hereinafter referred to as selection data). The data specifying unit 122 detects that the touch panel display 20 is touched, and determines selection data according to the detected touch position.

  For example, the thumbnail 411 is selected as the selection data in the example of FIG. 10, and the cell 421 is selected as the selection data in the example of FIG. In the example of FIG. 12, the item 431 is selected as the selection data, and in the example of FIG. 13, the node 442 is selected as the selection data. In the example of FIG. 14, the object 451 is selected as selection data.

  The data designation changing unit 123 determines at least the tilt and shake of the portable device 10 according to the tilt and acceleration of the portable device 10 measured by the motion sensor 30 before being released after the finger touches the touch panel display 20. If any of them is detected and a tilt or shake of the portable device 10 is detected, the selection data is changed. The data designation changing unit 123 determines the shake of the portable device 10 by a process similar to the process by the icon designation changing unit 113 shown in FIG. When the data designation changing unit 123 detects a shake, the data designation changing unit 123 changes the selected data to other data with a predetermined adjustment order. When the data designation changing unit 123 detects the tilt of the portable device 10, the selection data is used as a reference, the closest data among the data displayed in the tilt direction is set as the selection data, and the acceleration has a predetermined threshold value. If it exceeds, the second closest data is selected.

  When the inclination of the portable device 10 is detected for the data (x, y) in the grid (table) form shown in FIG. 10 and FIG. By performing the same processing as the processing by the icon designation changing unit 113, the data displayed in one of the eight directions on the basis of the selected data is moved 1 or 2 in the x direction or 1 or 2 in the y direction. Data (x + Δx, y + Δy) displayed at the place can be selected again as selection data. That is, in the example of FIG. 10, when the portable device 10 is tilted to the right so as to rotate in the direction of the arrow 412 around the y axis, the selection data is changed to the thumbnail 413. In the example of FIG. 11, when the portable device 10 is tilted to the near side so as to rotate in the direction of the arrow 422 around the x axis, the selection data is changed from the cell 421 to the cell 423. When the data designation changing unit 123 detects a shake of the portable device 10, the data designation changing unit 123 can also change the selection data for the data (x, y) on the grid with a predetermined adjustment order.

  The data designation changing unit 123 processes only the direction in which the items 43 are arranged in the list 430 when the inclination of the portable device 10 is detected for the data in the list 430 as shown in FIG. In the example of 12, by performing steps S22, S24, S25 of FIG. 6 only in the vertical (y) direction and only the processing of FIG. 8, either before or after the selection data is selected as selection data according to the inclination. If the acceleration is equal to or higher than a predetermined threshold value, the data before or after the selection data can be selected again as the selection data. For example, in the example of FIG. 12, when the portable device 10 is tilted rearward so as to rotate in the direction of the arrow 432 about the x axis, the selection data is changed from the item 431 to the item 433. In the example of FIG. 12, the adjustment orders are in order from top to bottom, and when the data designation changing unit 123 detects a shake of the portable device 10, the selection data is from the item 431. The item is changed to the item 434 below.

  In the graph 440 shown in FIG. 13, the data designation changing unit 123 can change the selected data to another node 44 in a predetermined adjustment order when the shake of the portable device 10 is detected.

  In addition, when the inclination of the portable device 10 is detected, the data designation changing unit 123 performs a selection data changing process shown in FIG. The data designation changing unit 123 adds the vector in the beta angle direction of the magnitude of the beta acceleration and the vector in the gamma angle direction of the magnitude of the gamma acceleration to create the vector S (S611). The data designation changing unit 123 determines a destination node shown in FIG. 18 using a node designated as selection data (hereinafter referred to as a selection node) and a vector (0, 0) having a size of 0 as arguments. A process is called (S613).

  In the movement destination node determination process, the data designation changing unit 123 sets the node specified as the first argument as the reference node (S621), and sets the vector specified as the second argument as the movement vector (S622). The data designation changing unit 123 creates, for each link 441 connected to the reference node, a vector L to the center of the previous node connected by the link 441 using the center of the reference node as a reference point (S623). Then, the angle θ between the vector S and each vector L is calculated (S624), and the other node 44 connected to the reference node by the link 441 having the smallest angle θ is set as the movement destination node (S625).

  In the data designation changing unit 123, the smallest angle θ is set in advance as a threshold value for determining that the direction of the inclination and the direction of the link 441 are substantially the same, such as a predetermined maximum angle (for example, 10 degrees or 30 degrees). (S626: NO), the process ends with the reference node as the movement destination node (S627).

When the smallest angle θ is equal to or smaller than the maximum angle (S626: YES), the data designation changing unit 123 sets the vector obtained by adding the vector L having the smallest angle θ and the movement vector as a movement vector (S628), If the size of S exceeds the size of the movement vector (S629: YES), the destination node determination process is recursively called with the destination node and the movement vector as arguments (S630).
The destination node is determined as described above.

  Returning to FIG. 17, the data designation changing unit 123 changes the selected node to the destination node determined as described above (S614).

  As described above, by tilting the portable device 10, fine adjustment can be performed so that another node that has followed the link 441 from the selected node becomes the selected node according to the tilt of the portable device 10.

  For example, in the example of FIG. 13, with the selection node 442 being touched, the portable device 10 is tilted to the back side (upward in FIG. 13) about the x axis in the direction of the arrow 443, thereby selecting the node 442 To node 444.

  In the processing of FIGS. 17 and 18, the link 441 is sequentially traced from the selected node until the magnitude of the sum of the vector indicated by the beta angle and beta acceleration and the vector indicated by the gamma angle and gamma acceleration is exceeded. Can do. Therefore, even when a large number of nodes are displayed, the selected node can be easily changed by adjusting the direction and degree of inclination.

  17 and 18 may be repeated until the finger is released from the touch panel display 20. Thereby, the selected node can be finely adjusted while adjusting the direction and degree of inclination.

  As shown in FIG. 14, when the object 45 is displayed at an arbitrary position on the screen and the shake of the portable device 10 is detected, the data designation changing unit 123 selects the selected data with a predetermined adjustment order. Can be changed to another object 45. When the data designation changing unit 123 detects the tilt of the portable device 10, the data designation changing unit 123 performs a selection data changing process shown in FIG. 19.

  The data designation changing unit 123 creates a beta angle vector B having a magnitude of beta acceleration (S641), creates a gamma angle vector G having a magnitude of gamma acceleration (S642), and adds the vectors B and G. The vector L is created (S643).

  For each object 45 displayed on the touch panel display 20, the data designation changing unit 123 passes a vector L based on the center of an object 45 designated as selection data (hereinafter referred to as a selection object). It is determined whether or not (S644).

  When there is an object through which the vector L passes (hereinafter referred to as a candidate object) (S645: YES), the data designation changing unit 123 determines that the size of the vector L is equal to or greater than a predetermined threshold (S646: YES). ) If the candidate object is the second closest to the selected object as the selected object (S647), and the large tree bond of the vector L is less than the predetermined threshold (S646: NO), the candidate object is closest to the selected object An object is selected as the selected object (S648). The distance between the two objects can be, for example, a distance between reference points such as the center and the center of gravity of each object.

  As described above, even when the object 45 is displayed at an arbitrary position on the touch panel display 20, the selected object can be changed according to the inclination of the portable device 10. For example, in the example of FIG. 14, when the portable device 10 is rotated in the direction of the arrow 452 around the x axis and tilted so as to rotate in the direction of the arrow 453 around the y axis, the selection object 451 When the vector L452 is drawn with the center as the reference point, the object 454 through which the vector L452 passes is newly selected as the selected object.

  When the data output unit 121 outputs text data, the caret position designation unit 124 accepts designation of the caret position of the text data. The caret position designation unit 124 detects that the touch panel display 20 has been touched, and uses this as a trigger to determine the caret position according to the detected touch position.

  For example, the caret position specifying unit 124 can determine the position between two character data closest to the touch position as the caret position. When the text data 52 is composed of n characters, the caret position is 0 (before the first character) or more and n (after the last character) or less. In the example of FIG. 15, the caret 521 is located behind the last character of the text data 52.

  The caret position changing unit 125 is at least one of the tilt and shake of the portable device 10 according to the tilt and acceleration of the portable device 10 measured by the motion sensor 30 before being released after the touch panel display 20 is touched. And the caret position is changed when the tilt or shake of the portable device 10 is detected. The caret position changing unit 125 determines the shake of the portable device 10 by the same processing as the processing by the icon designation changing unit 113 shown in FIG. The caret position changing unit 125 changes the caret position in a predetermined direction (hereinafter referred to as an adjustment direction) when a shake is detected. When detecting the tilt of the portable device 10, the caret position changing unit 125 detects any of the eight tilt directions and changes the caret position in the same manner as the icon designation changing unit 123 described above. In this case, in the process shown in FIGS. 6 to 8, the caret position between two characters is adjusted instead of the icon 21.

  For example, in the example of FIG. 15, when the portable device 10 is tilted so as to rotate in the direction of the arrow 512 about the x axis, the caret 511 moves to the caret position on one line. When the beta acceleration is equal to or higher than the predetermined threshold value βr, the two-line caret position is moved. In the example of FIG. 15, the adjustment direction is the right direction (text description direction), the caret position is set to the position of the caret 513, and the caret position changing unit 125 shakes the portable device 10. If detected, the caret position is changed to the caret 514 position.

  When the data output unit 121 outputs text data, the selection range designation unit 126 accepts designation of a selection range of at least a part of the text data. For example, the selection range designation unit 126 may detect that the finger has been slid on the touch panel display 20, and may determine the slid range as the selection range, or may determine the start position and end position of the selection range. You may make it receive designation | designated of two positions. In the example of FIG. 16, the selection range 523 is designated by sliding the finger on the touch panel display 20 from the start position 521 to the end position 522 of the text data 52.

  The selection range adjustment unit 127 is at least one of the tilt and shake of the portable device 10 according to the tilt and acceleration of the portable device 10 measured by the motion sensor 30 before being released after the touch panel display 20 is touched. And the selection range is changed when the tilt or shake of the portable device 10 is detected. The selection range adjustment unit 127 moves the start position 521 or the end position 522 in accordance with the sliding of the handle displayed at the start position 521 or the end position 522 in the same manner as the caret position designation unit 124 described above. Let Furthermore, when the portable device 10 is tilted before the finger is released, the selection range adjustment unit 127 moves the start position 421 or the end position 422 according to the direction and amount of tilt. In addition, the selection range adjustment unit 127 can also move the start position 421 or the end position 422 in a predetermined adjustment direction when detecting a shake of the portable device 10 before the finger is released.

  For example, in the example of FIG. 16, when the portable device 10 is tilted to rotate in the direction of the arrow 524 around the x axis while the handle at the end position 522 is touched, the end position 522 is the handle. It is moved to the position 525, and the selection range 523 is expanded by the frame line 526. Similarly, when the portable device 10 is tilted while the handle of the start position 521 is touched, the start position 521 is changed according to the tilt. In this way, the selection range adjustment unit 127 can change the start position 521 and the end position 522 of the selection range 523 according to the inclination of the portable device 10. Therefore, the user can easily adjust the selection range of the text data 42 on the touch panel display 20.

  The data processing unit 128 performs processing according to the selection data. For example, the data processing unit 128 enlarges and displays a selected image (hereinafter referred to as a selected image), transmits the selected image attached to an e-mail, and inputs a text at the caret position. Or copy the text in the selected area (hereinafter referred to as selected text) to the clipboard. Note that the processing performed by the data processing unit 128 is not limited to these, and various types of data processing on selection data that is performed when the touch panel display 20 is tapped on a general smartphone or tablet computer can be performed.

As described above, according to the portable device 10 of the present embodiment, the user touches the touch panel display 20 to display the icons 21 and the data (the grid-displayed image 41, the cell 42 of the table 420, the item 43 of the list 430). , Node 444 of graph 440, object 45 displayed at an arbitrary position, etc.), and if an unintended one has been selected, move portable device 10 (tilt or shake) Can be fine-tuned so that the intended one is selected. Therefore, the user can easily select the intended icon and activate the intended application program, and can ensure that data processing on the intended data is performed. Further, for example, it is possible to improve usability in a small touch panel display 20 or an operating system in which small icons are displayed. In this embodiment, it is assumed that the touch on the touch panel display 20 is performed with a finger, but the stylus It is also possible to detect touches by tools such as.

  In this embodiment, touch is used as a trigger for selection start and release is a trigger for selection end. However, the present invention is not limited to this. For example, selection is started by single tap or double tap, and selection is performed by double tap or triple tap. It can also be terminated. That is, the selected object or position may be changed according to the inclination between the event of starting selection of the object or position and the event of end of selection.

  Further, in the present embodiment, the inclination is determined according to the rotation angle of the X axis and the Y axis, and the selection icon, the selection data, the caret position, and the start position and the end position of the selection range are changed according to the acceleration. However, the present invention is not limited to this, and the tilt may be determined by combining both the rotation angle and the acceleration, or the tilt may be determined only from the acceleration. Further, the amount by which the selection icon or the like is changed according to the rotation angle may be determined.

  Further, in this embodiment, the acceleration increase value in two periods is obtained from the acceleration at three time points, and the shake is determined based on this, but the acceleration increase in one time period from the acceleration at two time points. The shake may be determined based on whether or not the increase value exceeds a threshold value, or the shake may be determined based on whether or not at least one of beta acceleration and gamma acceleration at a certain time point exceeds a predetermined value. You may make it determine. The shake may be determined based on both the rotation angle and the acceleration. In addition, a general process used for determining a shake gesture of the portable device can also be used.

  In the present embodiment, when a shake is detected, the icon, object, caret position, and selection range are adjusted with a predetermined adjustment order. For example, when the motion sensor 30 is a three-axis acceleration sensor or the like. Alternatively, the direction in which the portable device 10 is shaken may be determined, and adjustment may be performed in the determined direction.

  In the present embodiment, the selected object or position is adjusted when the portable device 10 is tilted or shaken. However, the present invention is not limited to this, and various portable devices are used. The selection position of the icon or object, the input position of the text, the selection range, and the like can be adjusted according to the 10 movements. For example, the icon designation changing unit 113, the data designation changing unit 123, the caret position changing unit 125, and the selection range adjusting unit 127 detect that the portable device 10 has been translated without being tilted, or have been shaken. Or the like, the selection position of the icon or object, the input position of the text, the selection range, etc. may be adjusted in the direction of translation or shake.

  Further, although the icon display unit 111 of the present embodiment displays the icons 21 in a grid shape, the icon 21 is displayed at an arbitrary position, and the icon designation changing unit 113 can perform the processing by the process of FIG. Another icon 21 can be selected according to the inclination of the carrying device 10.

  Further, the icon designation changing unit 113 according to the present embodiment selects eight-direction icons based on the selected icon. However, the present invention is not limited to this. For example, the process of FIG. Another icon 21 may be selected as a selection icon according to the acceleration.

  In addition, the icon designation changing unit 113 and the data designation changing unit 123 according to the present embodiment move the selection position depending on whether the absolute value of the beta angle and the absolute value of the gamma angle exceed the threshold value. Not only this but you may make it move according to whether beta acceleration or gamma acceleration exceeded the threshold value. In this case, when the beta acceleration or the gamma acceleration exceeds the first threshold, one selected position is moved, and when the second threshold larger than the first threshold is exceeded, the two selected positions are moved. You can make it. Further, it may be determined whether the selected position is moved by combining the beta angle and the gamma angle with the beta acceleration and the gamma acceleration.

In the present embodiment, the selected position is moved in the direction of inclination. However, the selected position may be moved in a predetermined direction according to beta acceleration or gamma acceleration. in this case,
Further, the icon designation changing unit 113 and the data designation changing unit 123 according to the present embodiment have one or two of at least one of the x direction and the y direction depending on whether the beta acceleration and the gamma acceleration are equal to or greater than a predetermined threshold. Although the selected position is moved, the present invention is not limited to this, and a position moved at an arbitrary distance according to beta acceleration or gamma acceleration or an icon or data displayed at the position may be selected.

  In the portable device 10 of the present embodiment, the angle and acceleration related to rotation about the x-axis and the y-axis are measured. However, the angle and acceleration related to rotation about the z-axis are measured. May be. In this case, the selection position or the selection data can be moved in a direction corresponding to an angle of rotation about the z-axis (hereinafter referred to as alpha angle) and its acceleration (hereinafter referred to as alpha acceleration). Further, the shake may be determined based on the alpha angle or the alpha acceleration.

  In addition, the selection range specifying unit 126 of the present embodiment is configured such that the selection range 523 is specified by sliding a finger on the touch panel display 20. However, the present invention is not limited to this. By touching, the designation of the start position 521 and the end position 522 may be accepted.

  In the portable device 10 of the present embodiment, the selection of the icon and data and the caret position and selection range in the text data are changed. However, the present invention is not limited to this, and the touch position may be adjusted. In this case, after changing the touch position, the changed touch position is notified to the application program. Thereby, the fine adjustment function of a touch position can be given to an application program, without modifying an existing application program.

  Although the present embodiment has been described above, the above embodiment is intended to facilitate understanding of the present invention and is not intended to limit the present invention. The present invention can be changed and improved without departing from the gist thereof, and the present invention includes equivalents thereof.

DESCRIPTION OF SYMBOLS 10 Portable device 20 Touch panel display 30 Motion sensor 101 CPU
DESCRIPTION OF SYMBOLS 102 Memory 103 Flash memory 104 Display controller 111 Icon display part 112 Icon designation part 113 Icon designation change part 114 Application starting part 121 Data output part 122 Data designation part 123 Data designation change part 124 Caret position designation part 125 Caret position change part 126 Selection Range designation unit 127 Selection range adjustment unit 128 Data processing unit 31 Rotation 32 Rotation 33 Rotation 21 Icon 211 Icon 212 Arrow 213 Icon 214 Arrow 215 Icon 216 Icon 41 Data 411 Thumbnail 412 Arrow 413 Thumbnail 42 Cell 420 Table data 421 Cell 422 Arrow 423 Cell 43 Item 430 List 431 Item 432 Arrow 433 Item 44 440 graph 441 link 442 node 443 arrow 444 node 45 object 451 object 452 vector L
452 Arrow 453 Arrow 454 Object 51 Text data 511 Caret 512 Arrow 513 Caret 52 Text data 521 Start position 522 End position 523 Selection range 524 Arrow 525 Handle 526 Frame line

Claims (27)

A portable device,
A touch panel display;
A touch position acquisition unit that acquires a touch position that is a position on the touch panel display touched by the user;
A motion detector for detecting the movement of the portable device;
An adjustment unit for adjusting the touch position according to the movement of the portable device;
A portable device comprising: The portable device according to claim 1,
The motion detection unit detects a change in the speed of motion of the portable device,
The adjusting unit adjusts the touch position according to a change in the speed;
A portable device characterized by. The portable device according to claim 1,
The motion detection unit detects the tilt of the portable device,
The adjusting unit adjusts the touch position according to the inclination;
A portable device characterized by. The portable device according to claim 3,
The motion detection unit detects at least one of the direction of the tilt and the acceleration of the tilt,
The adjustment unit adjusts the touch position according to at least one of the direction of the inclination and the acceleration of the inclination;
A portable device characterized by. The portable device according to any one of claims 1 to 4,
After the adjustment unit adjusts the touch position, the movement detection unit detects the movement of the portable device, and the adjustment unit adjusts the touch position according to the movement of the portable device;
A portable device characterized by. A portable device,
A touch panel display;
An information display unit for displaying a plurality of objects on the touch panel display;
A touch position acquisition unit that acquires a touch position that is a position on the touch panel display touched by the user;
An object selection unit that selects the first object according to the touch position;
A motion detector for detecting the movement of the portable device;
An adjustment unit that selects the second object different from the first object in accordance with the movement of the portable device;
A portable device comprising: The portable device according to claim 6,
The motion detection unit detects a change in speed of the portable device,
The adjusting unit selects the second object according to the change in the speed;
A portable device characterized by. The portable device according to claim 6,
The motion detection unit detects the tilt of the portable device,
The adjustment unit selects the second object according to the inclination;
A portable device characterized by. The portable device according to claim 8, wherein
The motion detection unit detects at least one of the direction of the tilt and the acceleration of the tilt,
The adjusting unit selects the second object according to at least one of the direction of the inclination and the acceleration of the inclination;
A portable device characterized by. The portable device according to any one of claims 6 to 9,
After the adjustment unit selects the second object, the motion detection unit detects the movement of the portable device, and the adjustment unit is the second object according to the movement of the portable device. Selecting a different third said object;
A portable device characterized by. The portable device according to claim 6,
The motion detection unit detects the direction of the motion,
The adjustment unit selects the second object displayed in the direction of movement from the first object;
A portable device characterized by. The portable device according to claim 11,
The movement detection unit further detects the amount of movement,
The adjustment unit selects the second object according to the amount of the movement from the other objects displayed in the direction of the movement from the first object,
A portable device characterized by. The portable device according to claim 11,
The motion detection unit further detects acceleration of the motion,
The adjustment unit selects the second object according to the acceleration of the movement among the other objects displayed in the direction of the movement from the first object,
A portable device characterized by. The portable device according to any one of claims 6 to 13,
The information display unit displays the object in a list or grid display on the touch panel display,
A portable device characterized by. A portable device,
A touch panel display;
An information display unit for displaying information on the touch panel display;
A touch position acquisition unit that acquires a touch position that is a position on the touch panel display touched by the user;
A selection position determination unit that determines a selection position that is a position selected by the user in the information according to the touch position;
A motion detector for detecting the movement of the portable device;
An adjustment unit for adjusting the selected position according to the movement of the portable device;
A portable device comprising: The portable device according to claim 15, wherein
The motion detection unit detects a change in speed of the portable device,
The adjusting unit adjusts the selected position according to a change in the speed;
A portable device characterized by. The portable device according to claim 15, wherein
The motion detection unit detects the tilt of the portable device,
The adjusting unit adjusts the selection position according to the inclination;
A portable device characterized by. The portable device according to claim 17, wherein
The motion detection unit detects at least one of the direction of the tilt and the acceleration of the tilt,
The adjusting unit adjusts the selection position according to at least one of the direction of the inclination and the acceleration of the inclination;
A portable device characterized by. The portable device according to any one of claims 15 to 18, comprising:
After the adjustment unit adjusts the selection position, the motion detection unit detects the movement of the portable device, and the adjustment unit adjusts the selection position according to the movement of the portable device;
A portable device characterized by. The portable device according to claim 15, wherein
The touch position acquisition unit acquires the first and second touch positions,
The selection position includes a start position and an end position of a range for selecting a part of the information,
The selection position determination unit
Determining the start position and the end position according to the first and second touch positions;
When the movement is detected while both the first and second touch positions are touched, one of the start position and the end position is adjusted,
If the movement is detected while only one of the first or second touch positions is touched, adjusting the other of the start position and the end position;
A portable device characterized by. The portable device according to any one of claims 15 to 20,
The information displayed by the information display unit is text information,
The selected position is a caret position in the text information;
A portable device characterized by. A portable device with a touch panel display
Obtaining a touch position which is a position on the touch panel display touched by the user;
Detecting the movement of the portable device;
Adjusting the touch position according to the movement of the portable device;
The touch position adjustment method characterized by this. A portable device with a touch panel display
Displaying a plurality of objects on the touch panel display;
Obtaining a touch position which is a position on the touch panel display touched by the user;
Selecting the first object according to the touch position;
Detecting the movement of the portable device;
Selecting the second object different from the first object according to the movement of the portable device;
Object selection method characterized by A portable device with a touch panel display
Displaying information on the touch panel display;
Obtaining a touch position which is a position on the touch panel display touched by the user;
According to the touch position, a selection position that is a position selected by the user in the information is determined;
Detecting the movement of the portable device;
Adjusting the selected position according to the movement of the portable device;
A selection position adjusting method characterized by the above. To a computer with a touch panel display,
Obtaining a touch position which is a position on the touch panel display touched by a user;
Detecting the movement of the portable device;
Adjusting the touch position according to the movement of the portable device;
A program for running To a computer with a touch panel display,
Displaying a plurality of objects on the touch panel display;
Obtaining a touch position which is a position on the touch panel display touched by a user;
Selecting the first object according to the touch position;
Detecting the movement of the portable device;
Selecting a second object different from the first object in response to movement of the portable device;
A program for running To a computer with a touch panel display,
Displaying information on the touch panel display;
Obtaining a touch position which is a position on the touch panel display touched by a user;
Determining a selected position that is a position selected by the user in the information according to the touch position;
Detecting the movement of the portable device;
Adjusting the selected position according to the movement of the portable device;
A program for running

Images