JPH1185398A - Command input device for touch panel display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent the map display area from decreasing and to make a map display easy to see, by executing a command corresponding to a line drawing made by touching with finger. SOLUTION: The touch panel display serves as a part of an input device 32 and the whole display device 48. The line drawing that a user makes by touching the touch panel display with finger is recognized and the command corresponding to the recognized line drawing is executed. Consequently, a display of command buttons or the like is eliminated to make the map display or the like easy to see. For the line drawing recognition, what the line drawing is, recognized and discriminated from, for example, the number of the vertexes and a simple figure such as a rectangle is assigned to the command. It is free what command is assigned to the line drawing and, for example, a command for enlarging the map display in the rectangle to the entire screen is assigned. A mountain shape is assigned as a command for scrolling the screen in the direction of the vector drawn from the center point between both ends to a vertex by the size of the vector.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a command input device for a touch panel display provided in, for example, a car navigation device, and more particularly to a command input device for a touch panel display having an improved input system.

[0002]

2. Description of the Related Art FIG. 7 shows a screen 12 of a touch panel display 10. On the screen 12 of the map display mode, a scroll button 14 for scrolling the screen up, down, left, and right with the map as a background is displayed at the center of each side of up, down, left, and right, and a table of contents screen, a search screen, a previous page, etc. A command button (including an icon) 16 for switching to another screen, enlarging the map, or displaying the entire map is displayed. The user touches a predetermined scroll button 14 or command button 16 on the screen 12 with a finger to input a command.

[0003]

Since the scroll button 14 and the command button 16 are displayed on the map display while hiding the map display below, when the number of the scroll buttons 14 and the command buttons 16 increases, the scroll button It is hidden by the command button 14 and the command button 16, so that the map display area is reduced and the map display becomes difficult to see.

An object of the present invention is to provide a command input device for a touch panel display which can overcome the above-mentioned problems.

[0005]

A command input device for a touch panel display (10) according to the present invention has the following (a) and (b). (A) Line drawing recognizing means for recognizing a line drawing drawn by a user touching a touch panel display (10) with a finger (b) Command executing means for executing a command corresponding to a line drawing recognized by the line drawing recognizing means

[0006] Touch panel display of the present invention (10)
The command input device for use can be applied to not only a car navigation device (20) but also any machine equipped with a touch panel display (10), such as a game machine or a cash dispenser. The line drawing is, for example, a triangle, a rectangle, a circle, a line segment, and a chevron shape. When the user touches the touch panel display (1
The line drawing drawn in (0) is normally transparent and does not leave a trajectory, but is displayed in a predetermined color on the touch panel display (10) for a predetermined time or a predetermined timing for user confirmation or the like. You may. A line drawing is usually drawn by one continuous touch, but for example, a line drawing drawn by a plurality of touches within a predetermined time may be regarded as one line drawing. For example, there is a case where one triangle is drawn with three touches, one side at a time.

The line image recognition means recognizes the transparent or colored line image, and the command execution means executes a command corresponding to the line image recognized by the line image recognition means. Since the user does not need to display command buttons or the like on the touch panel display (10) in order to input commands, the original display of the map or the like is hidden by the command buttons or the like, making it difficult to see or reducing the display area. Evil effects can be prevented.

[0008] Touch panel display of the present invention (10)
According to the command input device for line, the line drawing recognizing means recognizes a line drawing drawn by the user with one continuous touch as one line drawing.

[0009] By allowing the user to recognize a line image drawn by one continuous touch as one line image, the end of writing of the line image by the user can be easily detected without inputting a special end instruction.

[0010] Touch panel display (10) of the present invention
According to the command input device, the line drawing recognition means recognizes what the line drawing is from the number of vertices.

For example, simple figures such as line segments, triangles, and rectangles can be identified by the number of vertices of a line drawing. The line drawing recognition means can easily identify a line drawing as a command from the number of vertices by assigning such a simple figure to a command.

The touch panel display of the present invention (10)
According to the command input device, the line drawing recognizing means recognizes what the line drawing is from the angle of at least one vertex of the line drawing.

The vertex at which the line drawing recognition means detects the angle may be one or more selected vertices of the line drawing, or all vertices. The reliability of recognition increases as the number of vertices for detecting angles increases.

Simple figures such as triangles and rectangles and five or more regular polygons drawn by the user on the touch panel display (10) have different vertexes at different angles, and can be distinguished from the angles. Line drawing recognition means,
By assigning such a simple figure to a command, a line drawing as a command can be easily identified from the angle of a vertex.

[0015] Touch panel display (10) of the present invention
According to the command input device for command, the command executing means, when the line drawing drawn by the user is substantially rectangular, the range detecting means for detecting the rectangular range, and expanding the range detected by the range detecting means to expand the touch panel display ( And 10) an enlarged display means for displaying.

The range detecting means detects a substantially rectangular range drawn by the user, and the enlarged display means displays the rectangular range detected by the range detecting means on, for example, a touch panel display (1).
0) Enlarge and display the entire image. In the normal enlarged display, the user needs to perform a plurality of operations such as selection of an enlarged command, designation of an enlarged range, and execution (end of input), but the user can streamline the enlarged operation.

[0017] Touch panel display (10) of the present invention
According to the command input device for use, the command execution means includes a scroll means for scrolling the screen of the touch panel display (10) substantially in the direction of the mountain shape when the line drawing drawn by the user has the mountain shape.

By drawing the chevron in a desired direction, the user can scroll the screen (12) in that direction. The direction of the chevron can be drawn in any direction of 360 °, but 360 ° can be drawn, for example, up, down, left and right,
Further, the scroll direction can be approximated to eight or more angular ranges including the oblique direction, and the direction of the chevron shape drawn by the user can be approximated to the closest one of the four directions or the eight directions. In this way, a large number of scroll buttons indicating the respective scroll directions are arranged on the screen (12), thereby preventing the background of the screen (12) from being difficult to see.

The touch panel display of the present invention (10)
According to the command input device, when the line drawing drawn by the user has a chevron shape, the scroll means includes a height detecting means for detecting a height equivalent amount of the chevron shape, and a height detected by the height detecting means. The screen of the touch panel display (10) is scrolled by a considerable amount.

The user can easily set the scroll amount of the screen (12) by the height of the chevron shape drawn on the touch panel display (10), and can streamline the input operation of the scroll amount. In the conventional touch panel display (10), the scroll amount is fixed to, for example, one screen, a half screen, or a predetermined value set by customization by the user, so that the scroll amount cannot be appropriately changed. Was.

[0021] Touch panel display (10) of the present invention
According to the command input device, when the line drawing drawn by the user has a chevron shape, the command execution means obtains a vector obtained by subtracting a midpoint between both ends of the chevron shape to a vertex of the chevron shape,
Scroll means for scrolling the screen of the touch panel display (10) in the direction of the vector and by the size of the vector is included.

The direction of the vector is substantially equal to the direction of the chevron. The magnitude of the vector is substantially equal to the height of the chevron. In this way, the user can scroll the screen (12) in the desired direction by drawing the chevron shape in the desired direction, and reduce the scroll amount of the screen (12) by:
It can be easily set by the height of the chevron shape drawn on the touch panel display (10). A large number of scroll buttons indicating each scroll direction are arranged on the screen (12), and the amount of scrolling of the screen (12) can be reduced on the touch panel display (10) while preventing the background of the screen (12) from being difficult to see. The scroll amount can be appropriately changed and the input operation can be efficiently performed by easily setting according to the height of the chevron shape to be drawn.

[0023]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 6 is a block diagram of the car navigation device 20. 22 is a main controller composed of a microcomputer or the like, 24 is a vehicle position processing device, 26 is a map database composed of a CD-ROM or the like, 28
Is a recording medium reading device including a CD-ROM drive or the like, 30 is a main memory including a RAM or the like, 32 is an input device,
34 is a video processing device, and 36 is an audio output device. The own-vehicle position processing device 24 further includes an autonomous navigation sensor 38 including an angular velocity sensor for detecting the rotational angular velocity of the own vehicle and a distance sensor for detecting a traveling distance of the own vehicle, and positioning the current position and current direction of the vehicle by satellite navigation. A GPS receiver 40 and an own-vehicle position calculating device 42 for calculating the own-vehicle position based on inputs from the autonomous navigation sensor 38 and the GPS receiver 40 are provided. The recording medium reading device 28 reads map data from the map database 26 and outputs the map data to the main controller 22. The main controller 22 includes the unit data of the road network from the recording medium reading device 28 and the vehicle position processing device.
The main memory 30 stores the present location data of the own vehicle from 24 and the position data relating to, for example, the departure place and the destination of the own vehicle input from the input device 32 by the user. Main controller
22 calculates recommended route guidance data and the like based on the data read from the main memory 30, and calculates the recommended route guidance data,
The map data of the area including the own vehicle position, the own vehicle position data, and the like are output to the video processing device 34. Also the main controller
22 sends the data to the audio output device 36,
36 informs the user of the information as appropriate. The video processing device 34 includes a graphic controller in addition to the display device 48.
44 and a video RAM 46, a graphics controller
The recommended route guidance data is stored in the video RAM 46 by 44, and the read and read recommended route guidance data is output from the video RAM 46 to the display device 48 for display. The touch panel display 10 serves as a part of the input device 32 and the entire display device 48.

FIGS. 3 to 5 show a touch panel display 10.
Shows various line drawings (hereinafter, referred to as “gesture commands”) input by the user as commands. In FIGS. 3, 4, and 5, a rectangle, a chevron, and a circle are drawn by the user, respectively. In FIGS. 3 to 5, the trajectory touched by the user with the finger on the screen 12 is displayed as a black line, but is actually transparent and no trajectory remains. The user is promised to draw a rectangle, chevron, and circle as gesture commands in one continuous touch. In addition, rectangle,
Regarding the chevron shape and the circle, the moving direction of the finger on the screen 12 (the clockwise direction in the figure) is indicated by an arrow, but the same line drawing will be apparent as will be described later with reference to the flowchart of FIG. Is recognized regardless of the moving direction of the finger. Although any command can be freely assigned to each gesture command, the contents of each gesture command are exemplified. The gesture command of the rectangle is assigned, for example, as a command for enlarging the map display in the rectangle to the entire screen 12. The chevron shape is assigned, for example, as a command to scroll the screen 12 by the size of the vector in the direction of the vector drawn from the midpoint of both ends to the vertex. Since the chevron shape in FIG. 4 is a rightward chevron shape, the screen is scrolled to the right. The circle is assigned as a command for displaying additional information such as a telephone number of an object such as a building in the circle on a screen.

FIG. 1 is a flowchart of a gesture command input process. Touch panel display 10
Has a function of detecting coordinates (x, y) touched by the user's finger. The data calculated in this flowchart is temporarily stored in the buffer of the main memory 30 (FIG. 6). In S82, the process waits for the user to start touching the touch panel display 10 with a finger, and the touch is started or S50 is executed. S50
Then, the current touch position (x, y) is set to the 0th vertex coordinate (x0, y0), that is, the starting point (x0, y0) of the line drawing that the user intends to draw, and the moving direction vector (dx, dy) Is substituted for the initial value (0,0). S
At 52, it is determined whether or not the finger has been released. If YES, the process proceeds to S72, and if NO, the process proceeds to S54. S5
In step 4, the touch position (x, y) is captured. In S56,
(Xx-x) is added to the 0th movement direction vector (dx0, dy0).
0, y-y0). In S58, 0 is substituted for n.

In S60, the current touch position (x, y)
To the previous touch position (xp,
yp). In S62, it is determined whether or not the finger has left the touch panel display 10. If YES, the process proceeds to S72. If NO, the process proceeds to S64. S6
In step 4, the current touch position (x, y) is captured. S66
Then, in the moving direction vector (dx, dy), (x−xp,
y-yp) is substituted to update the moving direction vector.
In S68, “dx and dxn have the same sign” and “dy, d
yn is the same sign "is satisfied, and YE is determined.
If S, the process returns to S60; if NO, the process proceeds to S70. dxn and dyn when n = 0 are defined in S56, and dxn and dyn when n ≧ 1 are defined in S70 described later. “Dx and dxn have the same sign” indicates that there is no change in the moving direction of the finger in the x-axis direction (the horizontal direction of the screen 12), and “dy and dyn have the same sign”.
This indicates that the moving direction of the finger in the y-axis direction (the vertical direction of the screen 12) does not change. Therefore, the determination of S68 being YES means that the moving direction of the finger does not change in both the x-axis direction and the y-axis direction, and NO means that the moving direction of the finger is in the x-axis direction and the y-axis direction. Means reversed in any of the directions. In S70, dxn,
After substituting the values of dx and dy calculated in S66 for dyn, n is incremented by one, and then
The n-th vertex coordinates (xn, yn) obtained in S60 (x
(p, yp), and then returns to S60.

In S72, after n is incremented by 1, the current touch position (x,
Let y) be the n-th vertex coordinates (xn, yn), that is, the end (xn, yn) of the line drawing finished by the user. In S74, the absolute values of the distance in the x-axis direction and the y-axis direction between the first vertex coordinates (x1, y1) and the zeroth vertex coordinates (x0, y0) are dx and dy, respectively. In S76, it is determined whether or not dx and dy obtained in S74 are smaller than thresholds Cx1 and Cy1, respectively. If YES, the process proceeds to S78, and if NO, the process proceeds to S80. Cx1 and Cy1 are usually the same value, but may be set to different values. The condition of S76 is YE
S means input of a push command without finger movement, such as when the user touches the command button 16 (FIG. 7), and NO indicates that the user writes a line drawing on the touch panel display 10. This means drawing, that is, inputting a gesture command. In S78, normal processing such as screen switching corresponding to the push command is performed, and then the process proceeds to S82. In S80, a process of collating and executing a gesture pattern is performed.
Proceed to. In S82, the process waits until the user touches the touch panel display 10 with a finger next time.

FIG. 2 is a detailed flowchart of the gesture pattern collation and execution process in S80 of FIG. S9
0, dx and dy are | xn-x0 | and | yn, respectively.
−y0 |. The subscript n of x and y is S in FIG.
The value at the time when n = n + 1 of 70 is last executed is input, and the number of vertices of the line drawing drawn by the user on the touch panel display 10 (here, the start and end of the line drawing are counted as one vertex, respectively). Is less than 1). In S92, “dx <Cx2” & “dy <Cy2”
(Cx2 and Cy2 are thresholds, and even if Cx2 = Cy2,
Even if Cx2 ≠ Cy2, Cx1, Cx in S76 of FIG.
Even if Cx2 = Cx1 and Cy2 = Cx1 with respect to y1, Cx2
≠ Cx1, Cy2 ≠ Cy1. It is determined whether or not the condition of ()) is satisfied. If YES, the process proceeds to S96 and N
If O, proceed to S94. If the determination in S92 is YES, the start of the line image drawn by the user with one continuous touch (x
(0, y0) and the end (xn, yn) mean that they are almost at the same position, and NO means that the start (x0, y0) and the end (xn, yn) of the line drawing are sufficiently separated. Means In S94, the value of n is checked, and n = 3, n = 4, n ≧
For S5, the process proceeds to S102, S106, and S110, respectively. In S96, as in S94, the value of n is checked, and n =
S98, S1 for 1, n = 2, n ≠ 1, 2 respectively
00, proceed to S114.

In S98, it is determined that the gesture is a line segment, and a corresponding command is executed. That is, the execution of S98 means that the start (x0, y0) and the end (xn, yn) of the line drawing drawn by the user are sufficiently separated, and the number of vertices (the start and end are also counted as vertices) Are two, and thus can be determined as a line segment. After S98, the process proceeds to S114. In S100, the gesture is recognized as having a chevron shape (FIG. 4), and the beginning of the line drawing (x0, y0)
And the average value (xm, ym) of the end (xn, yn), and further, the scroll amount xs in the x-axis direction and the scroll amount ys in the y-axis are x1-xm and y1-ym, respectively. And
Touch the screen 12 of the touch panel display 10 in the x-axis direction and y
Scroll in the axial direction by xs and ys, respectively. xs,
Since ys takes a continuous amount within a predetermined range, the screen 12
Would theoretically scroll in any direction of 360 °. However, the magnitude relationship between | xs | and | ys | is examined, and scrolling in which the smaller absolute value is 0, that is, if | xs | ≧ | ys |, ys = 0, and depending on the sign of xs, , Right scroll and left scroll, and if | ys |> | xs |, xs = 0 is set, and scrolling up and down according to the sign of ys is limited to a total of four directions of scrolling. It is also possible. After execution of S100, the process proceeds to S114.

In S102, for m = 0, 1, the vector (dxm, dym) and the vector (dxm + 1, dym + 1)
Is determined to be an obtuse angle. Note that the vector (dxm, dym) is equal to dxm in S70 of FIG.
It is calculated as n, dyn. As can be understood from the drawing of a rectangle by one continuous touch in FIG. 2, the vector (dxm, dym) and the vector (dxm + 1, dym +)
1) The angle made by the user means that the touch panel display 1
It means the outside angle of the adjacent side of the diagram drawn in 0. If the angles (outer angles) are obtuse angles with respect to all pairs of adjacent sides, the gesture command is recognized as a triangle in S104, and the corresponding command is executed. S
If it is determined at 94 that n = 3, this means that the total of the starting point, the vertex, and the ending point is four, so that
The determination of n = 3 in S94 and the determination of the obtuse angle in S102 overlap with the determination of gesture = triangle, but the reliability of recognition is increased by the overlapping check.

In S106, for m = 0, 1, 2
Vector (dxm, dym) and vector (dxm + 1, dym)
+1) is determined to be almost a right angle.
Vector (dxm, dym) and vector (dxm + 1, dym)
+1) is the angle the user makes on the touch panel display.
It means the outside angle of the adjacent side of the diagram drawn in 10. If the corners (outer angles) of all the sets of adjacent sides are substantially right angles, in S108, the gesture command is recognized as a rectangle, and the corresponding command, for example, the enlarged display of the map in the rectangle is performed. Execute. In S94,
If it is determined that n = 4, this means that the total of the starting end, the vertex, and the end is five. Therefore, the determination of n = 4 in S94 and the determination of a substantially right angle in S102 are as follows.
Gesture = Rectangle judgment is duplicated, but the duplication check increases the reliability of recognition.

At S110, m = 0, 1,..., N
For (n ≧ 5), it is determined whether the angles formed by the vector (dxm, dym) and the vector (dxm + 1, dym + 1) are both acute angles. The angle between the vector (dxm, dym) and the vector (dxm + 1, dym + 1) means the outer angle of the adjacent side of the diagram drawn on the touch panel display 10 by the user. If the corners (outer angles) are acute angles with respect to all pairs of adjacent sides, in S112, the gesture command is recognized as a circle, and the corresponding command
For example, a telephone number of a building in a circle is displayed. Since there are only line segments, chevron shapes, triangles, squares, and circles in the gesture commands of the touch panel display 10, if it is determined in step S94 that n ≧ 5, the gesture can be recognized as a circle, and in S110, the gesture is approximately a right angle. The judgment is duplicated for the gesture = circle judgment, but the duplication check increases the reliability of recognition.

In S114, the buffer that stores data relating to the line drawing drawn on the touch panel display 10 by the user is cleared.

[Brief description of the drawings]

FIG. 1 is a flowchart of a gesture command input process.

FIG. 2 is a detailed flowchart of steps of a gesture pattern collation and execution process in FIG. 1;

FIG. 3 is a diagram showing a first line drawing example input as a command by a user on a touch panel display.

FIG. 4 is a diagram showing a second line drawing example input as a command by a user on the touch panel display.

FIG. 5 is a diagram showing a third line drawing example input as a command by a user on the touch panel display.

FIG. 6 is a block diagram of a car navigation device.

FIG. 7 is a diagram showing a screen of a touch panel display.

[Explanation of symbols]

 10 Touch panel display 12 screen

Claims (8)

[Claims] 1. A line drawing recognizing means for recognizing a line drawing drawn by a user touching a touch panel display with a finger, and (b) executing a command corresponding to the line drawing recognized by the line drawing recognizing means. Command execution means,
A command input device for a touch panel display, comprising: 2. The command input device for a touch panel display according to claim 1, wherein said line drawing recognition means recognizes a line drawing drawn by a user with one continuous touch as one line drawing. 3. The command input device for a touch panel display according to claim 1, wherein the line drawing recognition means recognizes what the line drawing is based on the number of vertices. 4. The command input device for a touch panel display according to claim 1, wherein said line drawing recognition means recognizes what the line drawing is from an angle of at least one vertex of the line drawing. 5. The command executing means includes: a range detecting means for detecting a rectangular area when a line drawing drawn by a user is substantially rectangular; and a touch-panel display for enlarging a range detected by the range detecting means. 2. An enlarged display means for displaying in (10).
The command input device for a touch panel display according to any one of claims 1 to 4. 6. The command execution means includes a scroll means for scrolling the screen of the touch panel display (10) substantially in the direction of the chevron when the line drawing drawn by the user has a chevron shape. The command input device for a touch panel display according to claim 1. 7. A height detecting means for detecting an amount of height of the chevron when the line drawing drawn by the user has a chevron, and a scroll corresponding to the height detected by the height detecting means. The command input device for a touch panel display according to claim 6, wherein the screen of the touch panel display (10) is scrolled by an amount corresponding to the amount. 8. When the line drawing drawn by the user has a chevron shape, the command executing means obtains a vector obtained by subtracting a midpoint between both ends of the chevron shape to a vertex of the chevron shape. The command input device for a touch panel display according to any one of claims 1 to 5, further comprising a scroll unit for scrolling a screen of the touch panel display (10) by a size of (1).