JP5482549B2 - Display device, display method, and display program - Google Patents

Description

  The present invention relates to a display device for displaying electronic data and a method for displaying electronic data.

  In recent years, devices that can be used for displaying electronic data, such as mobile phone terminals, personal digital assistants (PDAs), and mobile PCs (Personal Computers), have been widely used. In these devices, downsizing has been attempted in order to make it easy for a user to carry. Therefore, a touch panel is often used for the purpose of reducing the number of input devices such as keys.

  The input by the touch panel may be performed using a pointing device such as a stylus, but is often performed by the user bringing a finger into contact with the touch panel. In the latter case, selection of a display position, an icon, and the like, and selection of a character string such as an anchor are also performed by the user touching a position where a target to be selected is displayed. Therefore, if the size of the icon or character displayed on the screen is small, the user touches not only the icon to be selected but also the position where the icon that the user does not intend to select is displayed, and the user's There was a problem that the input was complicated.

  Therefore, in order to make it easy for the user to perform an input operation, a system has been devised that displays a pointer that can be used for selection input. When detecting that the fingertip in contact with the touch panel has not moved for a predetermined time or longer, the apparatus according to this system transitions to the point mode and displays a pointer on the display unit. In the point mode, the user can select an anchor or the like using the displayed pointer. In addition, when the user's fingertip moves away from the touch panel and a certain time elapses during operation in the point mode, the display of the pointer is interrupted and the mode is changed to the scroll mode. In the scroll mode, when the user's finger touching the touch panel moves up and down within a predetermined time, the display position of the displayed image moves up and down in accordance with the movement of the contact position.

JP 2009-245239 A

  In a system in which a pointer is displayed when the fingertip touching the touch panel has not moved for a predetermined time or longer, the user selects an anchor or the like by scrolling the display screen if the predetermined time or longer has not passed. I can't. Then, even if the user displays the anchor to be selected on the screen by scrolling the screen, the user cannot select the anchor unless the fingertip is moved until the pointer is displayed. End up. Accordingly, there is a problem that it is difficult to use because a waiting time is generated until the pointer is displayed. If this predetermined time is set short, it is easy to make a transition to the pointer mode, and it is difficult for the user to scroll the screen.

  An object of the present invention is to allow a user to easily perform both a scroll operation and a selection operation.

  The display device according to the embodiment includes a display unit, a touch panel, a detection unit, a scroll control unit, and a cursor control unit. The display unit displays a part of the electronic data on the screen. The touch panel inputs a position on the screen. The detection unit detects a first touch operation on the touch panel and a second touch operation started while the first touch operation continues. The scroll control unit scrolls and displays the electronic data based on a first movement pattern representing a movement pattern of the position input by the first touch operation. The cursor control unit moves the display position of the cursor used for selecting the information displayed on the screen based on the second movement pattern representing the movement pattern of the position input by the second touch operation. .

  By allowing the user to easily perform both the scroll operation and the selection operation, the operability of the touch panel device can be improved.

It is a figure which shows the example of a display of the display apparatus which concerns on embodiment. It is a figure which shows the example of the hardware constitutions of the display apparatus which concerns on embodiment. It is a figure which shows the example of a structure of a control part. It is a figure which shows the example of the relationship between the display area displayed on a screen, and a web page. It is a figure explaining the example of the method of matching the input coordinate and touch operation. It is a figure which shows the example of the database memorize | stored in the coordinate memory | storage part. It is a figure explaining the example of the method of matching the input coordinate and touch operation. It is a figure explaining the example of the scroll display of a screen. It is a flowchart explaining the example of the operation | movement performed by scroll display. It is a figure explaining the example of the movement process of a cursor. It is a flowchart explaining the example of the operation | movement performed by the movement process of a cursor. It is a figure which shows the example of a display of the display apparatus which concerns on embodiment. It is a figure which shows the example of the database memorize | stored in the coordinate memory | storage part. It is a flowchart explaining the example of operation | movement of a display apparatus. It is a flowchart explaining the example of operation | movement of a display apparatus.

Hereinafter, the present embodiment will be described in detail with reference to the drawings.
FIG. 1 is a diagram illustrating a display example of the display device according to the embodiment. The display device according to the embodiment includes a display unit 13 and can display electronic data such as a web page. When the display size of the electronic data is large and the entire electronic data cannot be displayed on the display unit 13, the display device can display a part of the web page as shown in FIG. 1A, for example. .

  Further, the display device detects a touch operation on the touch panel 10 (see FIG. 2) provided so as to overlap the display unit 13. Here, it is assumed that one touch operation starts when a certain finger touches the touch panel 10 and ends when the finger leaves the touch panel 10. For example, it is one touch operation from when the finger A touches the touch panel 10 until the finger A leaves the touch panel 10. When the finger A completes the first touch operation and leaves the touch panel 10 and then touches the touch panel 10 again, the display device recognizes that the second touch operation has started. The number of touch operations detected by the display device at a time can be any number of one or more. In the following description, a case where two operations of a touch operation with the finger A and a touch operation with the finger B are detected will be described. Further, in the following description, among the fingers whose positions are input to the touch panel 10, the finger that first inputs the touch panel 10 is referred to as a finger A. Further, it is assumed that the finger B touches the touch panel 10 after the finger A contacts the touch panel 10 and before the finger A leaves the touch panel 10. In the following description, a touch operation with the finger A is a first touch operation, and a touch operation with the finger B is a second touch operation. Furthermore, the time from when the finger A comes into contact with the touch panel 10 to when the finger A leaves the touch panel 10 may be described as “the time during which the touch operation with the finger A continues”. That is, the second touch operation is a touch operation that is started while the first touch operation is continued.

  The display device scrolls and displays the web page based on the movement pattern (first movement pattern) of the input position by the first touch operation. For example, as shown in FIG. 1A, it is assumed that the user performs a first touch operation with the finger A from right to left. Then, the display device changes the display position of the information displayed on the screen of the display unit 13 in FIG. 1A from the left, and displays it as shown in FIG. When the user further continues the first touch operation, the display device scrolls the screen as shown in FIG.

  When the user touches the touch panel with the finger B while continuing the first touch operation, the display device detects the second touch operation. When the display device detects that the second touch operation has been performed, the display device 13 displays the cursor 71 on the display unit 13. Further, the display device moves the display position of the cursor 71 on the screen according to the movement pattern (second movement pattern) of the finger B. That is, the user can change the position on the screen where the cursor 71 is displayed by changing the position where the finger B is input. Further, the user can use the cursor 71 to select information such as an anchor or a character string displayed on the display unit 13. Therefore, according to the display device according to the embodiment, the user can select a character string, an icon, or the like displayed on the web page using the cursor 71 while scrolling the screen.

<Device configuration>
FIG. 2 is a diagram illustrating an example of a hardware configuration of the display device 1 according to the embodiment. In the following description, a case where the display device 1 is a mobile phone terminal provided with a touch panel will be described as an example, but the display device 1 is not limited to a mobile phone terminal. The display device 1 can be any device that can be used to display electronic data, including, for example, a PDA, a mobile PC, and the like. In the following description, a case where the user inputs information specifying the position on the screen of the display unit 13 by touching the touch panel 10 with a finger will be described as an example.

  The display device 1 includes a touch panel 10, an antenna 11, a wireless communication unit 12, a display unit 13, a microphone 14, a speaker 15, a voice input / output unit 16, a storage unit 20, and a processor 30. The storage unit 20 includes a read only memory (ROM) and a random access memory (RAM) 23, and includes a program storage unit 21 and a data storage unit 22 in the ROM.

  The touch panel 10 is provided so as to overlap the display unit 13. Further, the touch panel 10 detects an input from the user and specifies coordinates representing a position input by the user. The touch panel 10 outputs the specified coordinates to the processor 30. It is assumed that the touch panel 10 used in the present embodiment can detect a plurality of arbitrary touch operations at the same time. In the following description, a case where the touch panel 10 detects two touch operations will be described as an example.

  The display unit 13 is a liquid crystal display or the like, and displays data such as images and characters on the screen. For example, when the display device 1 is accessing the Internet or the like via the wireless communication unit 12, the display unit 13 can display a web page published on the Internet on the screen. Moreover, the display part 13 can display a part of web page according to the magnitude | size set about the web page of display object. The display unit 13 can also display image data, character data, and the like stored in the storage unit 20 on a screen provided in the display unit 13.

  The wireless communication unit 12 transmits / receives data to / from the base station via the antenna 11. The voice input / output unit 16 controls voice input from the microphone 14 and voice data output to the speaker 15.

  The program storage unit 21 stores a program used for processing by the processor 30. The data storage unit 22 stores data and a database used in the display device 1. The RAM 23 also stores data used for processing by the processor 30. For example, in the mobile phone terminal according to the embodiment, the RAM 23 includes the coordinate storage unit 24 (24a, 24b). Further, the RAM 23 may be used as a work area for the processor 30.

  The coordinate storage unit 24 stores the coordinates specified by the touch panel 10. The coordinate storage unit 24 can store coordinates for each touch operation in which an input from the coordinates is detected. For example, the coordinates input by the first touch operation with the finger A are stored in the coordinate storage unit 24a, and the coordinates input by the second touch operation with the finger B are stored in the coordinate storage unit 24b. In the example of FIG. 2, two coordinate storage units 24 a and 24 b are illustrated, but the number of coordinate storage units 24 is arbitrarily changed according to the mounting of the display device 1. The coordinate storage unit 24 will be described in detail later.

  FIG. 3 is a diagram illustrating an example of a configuration of a control unit corresponding to the processor 30. The processor 30 operates as the control unit 40 by executing a program stored in the program storage unit 21. The control unit 40 includes, for example, a wireless control unit 41, a call control unit 42, a browser unit 43, a display control unit 44, a touch panel control unit 50, and an input control unit 60. The touch panel control unit 50 includes a detection unit 51. The input control unit 60 includes a determination unit 61, a movement pattern specifying unit 62, a scroll control unit 63, and a cursor control unit 64.

  The wireless control unit 41 controls wireless communication between the mobile phone terminal and the base station. The call control unit 42 controls voice communication performed at the mobile phone terminal. The browser unit 43 acquires a HyperText Markup Language (HTML) file, an image file, web page layout information, and the like from the Internet via the antenna 11 and the wireless communication unit 12. The browser unit 43 outputs a web page obtained based on the acquired information to the display control unit 44.

  Upon receiving the web page data from the browser unit 43, the display control unit 44 displays the web page on the screen of the display unit 13. When the size of the web page is larger than the size that can be displayed on the screen, the display control unit 44 selects an area (display area) to be displayed on the screen from the web page and displays it on the screen. After the display area is displayed on the screen, the position of the display area on the web page is changed in response to a request from the scroll control unit 63.

  The touch panel control unit 50 outputs data input via the touch panel 10 to the input control unit 60 or the like. The detection unit 51 detects a touch operation on the touch panel 10 performed by the user on the screen of the display unit 13. Furthermore, the detection unit 51 acquires the coordinates of the position input by the detected touch operation. The detection unit 51 outputs the acquired coordinates to the determination unit 61 together with information specifying the time when the coordinates are detected. Note that the detection unit 51 outputs the same number of coordinates as the number of touch operations detected at the same time to the determination unit 61.

  When the number of coordinates detected by the detection unit 51 at one time is one, the determination unit 61 determines that the notified coordinates are input by the first touch operation. Therefore, the determination unit 61 stores the input coordinates in the coordinate storage unit 24a in association with the time when the coordinates are detected.

  On the other hand, when the detection unit 51 detects a plurality of coordinates at the same time, the determination unit 61 compares each input coordinate with the prediction result based on the movement pattern to identify the touch operation that has input the coordinate. To do. For example, a case will be described in which the coordinates input by the second touch operation are detected for the first time, and two coordinates are detected by the detection unit 51 at the same time. In this case, the coordinate storage unit 24 stores the coordinates input by the first touch operation and the time when the coordinates are input, but does not store the data by the second touch operation. Therefore, the determination unit 61 obtains the locus of the first touch operation based on the data stored in the coordinate storage unit 24a, and predicts the coordinate input by the first touch operation. The determination unit 61 determines that the coordinates close to the prediction result based on the trajectory of the first touch operation among the coordinates input from the detection unit 51 are the coordinates input by the first touch operation. The determination unit 61 stores the coordinates determined as the coordinates input by the first touch operation in the coordinate storage unit 24a, and associates the coordinates at a position far from the prediction result coordinates with the second touch operation to the coordinate storage unit 24b. Save to.

  Further, when the coordinates input by the second touch operation are stored in the coordinate storage unit 24b, the determination unit 61 can also predict the coordinates input by the second touch operation. In this case, the determination unit 61 predicts the input coordinates for each of the first and second touch operations, and each coordinate is determined according to the comparison result between the coordinates notified from the detection unit 51 and the prediction results. Whether the first touch operation or the second touch operation is input is determined. The determination performed by the determination unit 61 will be described in detail later. In addition, the determination unit 61 stores the coordinates input by the first touch operation in the coordinate storage unit 24a and the coordinates input by the second touch operation in the coordinate storage unit 24b.

  Further, the determination unit 61 notifies the cursor control unit 64 of the start or end of the display of the cursor 71 by comparing the number of coordinates acquired from the detection unit 51 with the number of coordinates previously notified from the detection unit 51. To do. For example, when the number of coordinates acquired from the detection unit 51 is two and the number of coordinates notified from the previous detection unit 51 is one, the determination unit 61 determines that the second touch operation has started, The cursor control unit 64 is requested to start displaying the cursor 71. On the other hand, when the number of coordinates acquired from the detection unit 51 is one and the number of coordinates notified last time is two, the determination unit 61 determines that either the first or second touch operation has ended. Then, the cursor control unit 64 is requested to interrupt the display of the cursor 71.

  The movement pattern specifying unit 62 calculates a first movement pattern using the coordinates stored in the coordinate storage unit 24a. Here, since the coordinates input by the first touch operation are recorded in the coordinate storage unit 24a, the first movement pattern represents the locus of the coordinates input by the first touch operation. Moreover, the movement pattern specific | specification part 62 calculates a 2nd movement pattern using the coordinate currently recorded on the coordinate memory | storage part 24b. Since the coordinates input by the second touch operation are recorded in the coordinate storage unit 24b, the second movement pattern becomes a locus of the coordinates input by the second touch operation.

  The movement pattern specifying unit 62 outputs the first movement pattern to the scroll control unit 63. The scroll control unit 63 outputs an instruction for scroll-displaying the web page on the screen to the display control unit 44 according to the first movement pattern. Further, the movement pattern specifying unit 62 outputs the second movement pattern to the cursor control unit 64.

  The cursor control unit 64 starts and stops displaying the cursor 71 on the screen in response to a request from the determination unit 61. Further, the cursor control unit 64 outputs an instruction for moving the display position of the cursor 71 to the display control unit 44 in accordance with the second movement pattern.

<Embodiment>
FIG. 4 shows an example of the relationship between the display area 72 displayed on the screen of the display unit 13 and the web page 70. With reference to FIG. 4, the coordinates used to determine the position input by the user and the area to be displayed on the screen will be described.

  For example, it is assumed that the web page 70 input from the browser unit 43 has a size of W + 1 pixels in the vertical direction and U + 1 pixels in the horizontal direction, as shown in FIG. On the other hand, it is assumed that the screen of the display unit 13 is smaller than the size of the web page 70 and has a size of H + 1 pixels in the vertical direction and G + 1 pixels in the horizontal direction, as shown in FIG. Here, H is a positive number smaller than W, and G is a positive number smaller than U. Further, in the following description, when the position on the web page 70 or the like is expressed, it is expressed by coordinates with the upper left corner of the web page 70 as the origin, the horizontal axis as the L axis, and the vertical axis as the K axis. On the other hand, the position on the screen in the display area 72 displayed on the display unit 13 is expressed by xy coordinates with the upper left corner as the origin.

  The display control unit 44 selects a display area 72 having a size of H + 1 pixels in the vertical direction and G + 1 pixels in the horizontal direction from the web page 70 in accordance with the size of the screen of the display unit 13. For example, in the example shown in FIG. 4C, the display control unit 44 uses (L1, K1) of the web page 70 as the origin of the display area 72, and is an area for G + 1 pixels in the horizontal direction and H + 1 pixels in the vertical direction. Character data and image data included in the are displayed on the screen.

  Hereinafter, the case where the web page 70 is displayed as shown in FIG. 1A as a result of the selection of the display area 72 will be described as an example. As shown in FIGS. 1A to 1C, when input is performed with the finger A and the finger B, positions input from the respective fingers are stored in the coordinate storage units 24a and 24b.

  FIG. 5 is a diagram illustrating an example of a method of associating input coordinates with a touch operation. FIG. 5 shows an example of coordinates specified for each fixed measurement period. The measurement cycle can be arbitrarily set according to the processing capabilities of the input control unit 60 and the touch panel control unit 50. For example, the measurement cycle can be set to 70 msec. White squares indicate positions input by the finger A at times t1 to t7. White circles indicate positions input by the finger B at times t6 and t7. The alphabet of the label indicating the position corresponds to the finger that input the position, and the number indicates the time when the position is input. For example, Ai (i = 1, 2, 3, 4, 5, 6, 7) indicates the position input by the finger A at time ti.

  When there is one input coordinate, the determination unit 61 determines that the coordinate is input by the first touch operation. For example, at time t1, the determination unit 61 acquires the coordinates of A1, but does not acquire other coordinates. In this case, the determination unit 61 determines that the coordinates of A1 are input by the finger A, and stores the obtained coordinates in the coordinate storage unit 24a in association with the time t1. Similarly, when the input coordinates are acquired one by one from time t2 to time t5, the determination unit 61 stores the obtained coordinates in the coordinate storage unit 24a in association with the time at which the coordinates were detected. To do. The coordinate storage unit 24 can record the coordinates using an arbitrary database structure such as a table or a linear list.

  FIG. 6 is a diagram illustrating an example of a database stored in the coordinate storage unit 24. In the following example, the database includes numbers for identifying data as shown in the leftmost column of FIGS. 6A and 6B. FIG. 6A is a coordinate database (database A) on the screen of the position input by the first touch operation stored in the coordinate storage unit 24a. Here, the coordinates of the detected position are expressed by xy coordinates with the upper left corner of the screen of the display unit 13 as the origin, for example. In the example of FIG. 6A, at time t1 to t5, as shown in FIGS. 1A and 1B, a touch operation with only the finger A is observed.

  Next, as illustrated in FIG. 1C, an operation performed by the determination unit 61 when associating input coordinates and touch operations when a plurality of touch operations are detected in one measurement will be described. When a plurality of touch operations are detected in one measurement, coordinates specifying the position input by each touch operation are detected. The detection unit 51 notifies the determination unit 61 of the detected coordinates. For example, at time t6 in FIG. 5, the touch operation with the finger B is detected simultaneously with the touch operation with the finger A. It is assumed that the coordinates of two locations of position A6 (xa6, ya6) and B6 (xb6, yb6) are notified to the determination unit 61 by detecting these touch operations.

  The determination unit 61 calculates the distance from the latest coordinate recorded in the database A for each notified coordinate, and determines that the coordinate with the shorter distance is input by the finger A. When the data acquired at time t6 is processed, the latest coordinates recorded in the database A are the position A5 (xa5, ya5). The determination unit 61 calculates the distance from (xa6, ya6) to (xa5, ya5). Further, the determination unit 61 calculates the distance from (xb6, yb6) to (xa5, ya5). As shown in FIG. 5, it is assumed that the distance from (xa6, ya6) to (xa5, ya5) is shorter than the distance from (xb6, yb6) to (xa5, ya5). Then, the determination unit 61 determines that (xa6, ya6) is input with the finger A. Further, the determination unit 61 determines that (xb6, yb6) is input with a finger different from the finger A, and records the input in the coordinate storage unit 24b. FIG. 6B is an example of a database (database B) recorded in the coordinate storage unit 24b.

  At time t7, the determination unit 61 obtains two coordinates of the position A7 (xa7, ya7) and B7 (xb7, yb7). In this case, the determination unit 61 compares the distance between the latest coordinates of the databases A and B and the input coordinates. For example, the latest coordinates of the databases A and B are A6 (xa6, ya6) and B6 (xb6, yb6). Therefore, the determination unit 61 compares the distance from the input coordinates A7 (xa7, ya7) to A6 with the distance to B6. In this case, the distance between A7 and A6 is shorter than the distance between A7 and B6. Therefore, it is determined that A7 is input from the finger A. With respect to B7, it is determined that the input is made with the finger B by the same processing. According to the determination, the coordinates of A7 are stored in database A, and the coordinates of B7 are stored in database B.

  Next, with reference to FIG. 7, the association between the coordinates input at time t8 and the touch operation will be described. At time t8, the determination unit 61 acquires the coordinates of two positions of position A8 (xa8, ya8) and B8 (xb8, yb8). When the data detected at time t8 is processed, the coordinates obtained by two measurements at times t6 and t7 are recorded in the database B. Further, the database A records coordinates obtained from time t1 to t7. Therefore, based on the data recorded in the database B, the determination unit 61 obtains the predicted position Bcalc of the coordinates input at time t8 with the finger B. Further, the predicted position Acalc is obtained using the data of the database A. The method for obtaining the predicted position can be obtained using an arbitrary approximation method. As an example, a method for obtaining the predicted position using the least square method will be described.

  Here, in both the first and second touch operations, the locus of the touch operation is approximated by a straight line. Thus, the x coordinate of the position input by the touch operation can be expressed by the following equation using the parameters qx and rx.

Here, t is a variable representing time. Further, the y-coordinate of the position input by the touch operation can be expressed by the following equation using the parameters qy and ry.

  The parameters qx, rx, qy, and ry are obtained as follows. Note that n represents the number of data used for position prediction, and is an integer of 2 or more. n is the number of data contained in the database used for calculation of each parameter. i corresponds to a data number and is a positive integer of n + 1 or less.

  The determination unit 61 substitutes the parameters obtained by the equations (3) to (6) into the equations (1) and (2) using the seven data recorded in the database A, and at the time t8. Calculate predicted values for x and y coordinates. The coordinates of the obtained predicted value are the coordinates of Acalc. Similarly, the determination unit 61 obtains Bcalc using data at t6 and t7 recorded in the database B. For example, it is assumed that the positions of Acalc and Bcalc are as shown by black circles and black squares in FIG.

  The determination unit 61 obtains the distance from Acalc and the distance from Bcalc for each of the input coordinates. The determination unit 61 further compares the obtained two distances, and associates the input coordinates with the touch operation in which the position used for calculating the predicted coordinates having the shorter distance is input. For example, for A8, when comparing the distance from the coordinates of Acalc and the distance from the coordinates of Bcalc, the distance between A8 and Acalc is shorter than the distance between A8 and Bcalc. Therefore, it is determined that the coordinate A8 is input by the finger A. On the other hand, the distance between B8 and Bcalc is shorter than the distance between B8 and Acalc. Therefore, it is determined that the coordinate B8 is input by the finger B. The coordinates detected at times t9 to t11 are also stored in the database A or B by the same processing.

  When each of the coordinates detected by the detection unit 51 is stored, scroll display is performed using the data stored in the database A, and the display position of the cursor is changed using the data stored in the database B.

  FIG. 8 is a diagram illustrating an example of scroll display on the screen. It is assumed that the display area 72a of the web page 70 is displayed on the screen of the display unit 13 as shown in FIG. When the user performs the first touch operation as indicated by the arrow 81, the coordinates input by the first touch operation are recorded in the database A as described with reference to FIGS. Then, the movement pattern specifying unit 62 refers to the database A to obtain the first movement pattern. The movement pattern specifying unit 62 outputs the first movement pattern to the scroll control unit 63.

  When acquiring the first movement pattern, the scroll control unit 63 changes the position of the display area 72 on the web page 70 according to the displacement of the touch position notified by the first movement pattern. For example, the scroll control unit 63 moves the position of the origin of the display area 72 on the web page 70 according to the first movement pattern. For example, in the first movement pattern, the x coordinate changes by +10 and the y coordinate changes by +5. In this case, the scroll control unit 63 moves the coordinates of the origin of the display area 72a by −10 in the L-axis direction and −5 in the K-axis direction. In the example shown in FIG. 8B, the scroll controller 63 changes the position of the origin of the display area 72 from (L2, K2) to (L3, K3) as shown by the arrow 82 in accordance with the first movement pattern. Move to. That is, the scroll control unit 63 moves the position of the display area from 72a to 72b. The scroll control unit 63 notifies the display control unit 44 of an area to be displayed on the screen. As a result, the content displayed on the screen of the display unit 13 is changed from FIG. 8A to FIG.

  FIG. 9 is a flowchart illustrating an example of an operation performed in scroll display. FIG. 9 shows an example of the operation performed in the scroll display. For example, a modification such as performing step S2 before step S1 may be added. The scroll control unit 63 obtains the coordinates of the origin of the display area 72 by using the coordinates when the coordinates are expressed using the upper left corner of the web page 70 as the origin (step S1). At this time, the scroll control unit 63 can access the display control unit 44 as appropriate. Based on the database A, the movement pattern specifying unit 62 obtains a first movement pattern (step S2). The scroll control unit 63 changes the coordinates of the origin of the display region 72 according to the first movement pattern, and notifies the display control unit 44 of the changed display region 72 (step S3). In the example described with reference to FIG. 8, the coordinates of the origin of the display area 72 are changed on the web page 70 by −1 times the difference value of the coordinates observed in the first movement pattern. The ratio between the difference value and the movement amount of the origin of the display area 72 can be an arbitrary value. For example, the scroll control unit 63 can also set −3 times the coordinate difference value as the movement amount of the origin of the display area 72.

  FIG. 10 is a diagram illustrating an example of cursor movement processing. The coordinates input by the second touch operation are recorded in the database B as described with reference to FIGS. In addition, when the notification requesting the display of the cursor 71 from the determination unit 61 is received, the cursor control unit 64 displays the cursor at the position 71a. Thereafter, the cursor control unit 64 moves the display position of the cursor 71 on the screen in accordance with the displacement of the touch position notified by the second movement pattern. For example, it is assumed that the second touch operation is performed as indicated by an arrow 83 between times t6 and t8. Then, the cursor 71 moves from 71a to 71b in response to the second touch operation from time t6 to t7 shown in FIG. 6B, and in response to the second touch operation from time t7 to t8. 71b to 71c.

  Note that the ratio between the coordinate difference value observed in the second movement pattern and the movement amount of the cursor display position can be set to an arbitrary value. For example, in the second movement pattern, the x coordinate changes by +10 and the y coordinate changes by +5. In this case, for example, the cursor control unit 64 can move the coordinates of the tip of the cursor 71 by +2 in the L-axis direction and +1 in the K-axis direction. In addition, the cursor control unit 64 may be set so that twice the coordinate difference value is the amount of movement of the coordinate of the tip of the cursor 71.

  FIG. 11 is a flowchart illustrating an example of an operation performed in the cursor movement process. FIG. 11 shows an example of cursor movement processing. For example, modification such as performing step S12 before step S11 is possible. The cursor control unit 64 appropriately accesses the display control unit 44 and the like, and acquires the coordinates where the cursor 71 is displayed on the screen (step S11). Based on the database B, the movement pattern specifying unit 62 obtains a second movement pattern (step S12). The cursor control unit 64 changes the position where the cursor 71 is displayed according to the second movement pattern (step S13).

  A display example when the above-described operation is performed will be described with reference to FIGS. For example, when the scroll control unit 63 moves the display area 72 in accordance with the coordinates input from the finger A at times t1 to t5, the screen display of the display unit 13 is changed from FIG. 1 (a) to FIG. 1 (b). It is changed as follows. Next, at time t6 to t11, scroll processing is performed based on the touch operation with the finger A, and the display on the screen of the display unit 13 is changed from FIG. 1 (b) to FIG. 1 (c). Further, at time t6, the touch operation with the finger B is recognized. Therefore, when the touch operation with the finger B is recognized, the cursor control unit 64 displays the cursor 71 on the screen of the display unit 13. Furthermore, the cursor control unit 64 changes the position where the cursor 71 is displayed in accordance with the input made from the finger B at times t6 to t11.

  In this way, by changing the plurality of coordinates input to the touch panel 10 into data used for scrolling the screen and data used for moving the cursor 71, the cursor display position can be changed and the screen scrolled independently. Is called. Therefore, in the display device 1 according to the present embodiment, for example, the cursor 71 can be displayed without detecting that the movement of the finger touching the touch panel 10 has stopped for a certain time or more. Therefore, in the display device 1 according to the present embodiment, the user's operation is easier than the system described in the background art. Furthermore, since the cursor 71 is not displayed until the second finger touches the touch panel 10, the cursor 71 is not displayed below the position of the finger scrolling the screen, and the user can easily view the cursor 71. .

  Next, a process when one finger leaves the touch panel 10 after a touch operation is performed with both the finger A and the finger B will be described. When the number of touch operations becomes one, the touch panel 10 can use coordinates input by the touch operations for screen scroll processing.

  FIG. 12 is a diagram illustrating a display example of the display device according to the embodiment. For example, it is assumed that the user performs a touch operation with fingers A and B as shown in FIG. At this time, as shown in FIG. 1 and the like, the scroll process is performed according to the first touch operation with the finger A, and the cursor is moved according to the second touch operation with the finger B. For each of the input coordinates detected by the detection unit 51, the determination unit 61 associates the input coordinates with the touch operation by the method described with reference to FIG.

  It is assumed that one of the fingers that the user is making contact with the touch panel 10 is released from the touch panel 10 at time t12. Although the case where the user releases the finger A will be described here, the same processing is performed when the user releases the finger B from the touch panel 10.

  When the user removes the finger A from the touch panel 10, the detection unit 51 cannot detect an input from the finger A. Therefore, the number of coordinates notified from the detection unit 51 to the determination unit 61 is one. When the determination unit 61 recognizes that the number of coordinates previously notified from the detection unit 51 is two and the number of coordinates notified this time is one, the determination unit 61 interrupts the cursor control unit 64 to stop displaying the cursor 71. Request. The cursor control unit 64 interrupts the display of the cursor 71 in response to a request from the determination unit 61. Accordingly, as shown in FIG. 12B, when the finger A moves away from the touch panel 10, the display of the cursor 71 is interrupted.

  Further, when the determination unit 61 recognizes that the number of coordinates notified last time from the detection unit 51 is two and the number of coordinates notified this time is one, the determination unit 61 accesses the coordinate storage unit 24, and the database B And the data stored in the database A are erased. That is, data from time t1 to t11 stored in the database A is erased. As described with reference to FIGS. 5 and 6, when there is one coordinate detected by one measurement, the determination unit 61 determines that the coordinate is input by the first touch operation. To do. Therefore, even if the input is from the finger B, if there is one coordinate detected in one measurement, the determination unit 61 determines that the coordinate is input by the first touch operation, and saves it in the database A. To do. Therefore, as shown in FIG. 13, the coordinates input by the finger B after the time t12 are stored in the database A.

  The movement pattern specifying unit 62 obtains a first movement pattern based on the database A and outputs the first movement pattern to the scroll control unit 63. Here, since the database B is deleted, the movement pattern specifying unit 62 cannot generate the second movement pattern. Accordingly, the output of the second movement pattern to the cursor control unit 64 is stopped.

  If the finger B continues the touch operation between times t12 and t16, the coordinates input by the finger B are stored in the database A as shown in FIG. The scroll control unit 63 scrolls and displays the screen according to the locus of the position input by the finger B. For example, the display of the screen is changed by the process of the scroll control unit 63 as shown in FIGS. 12B to 12C.

  Therefore, in the display device 1 according to the present embodiment, when the user is inputting to the touch panel 10 with two fingers, the display of the cursor 71 can be interrupted by interrupting the input from one finger. it can. In addition, the user can perform scroll processing regardless of whether the cursor 71 is displayed. Therefore, by using the display device according to the present embodiment, the user can easily perform both the scroll process and the selection by the cursor 71.

  14A and 14B are flowcharts for explaining an example of the operation of the display device 1. Step S21 in FIG. 14 is an operation by the detection unit 51. Steps S22 to S24, S26, S27, S29 to S31, S33 to S35, S37, and S39 to S41 are operations performed by the determination unit 61. Steps S25 and S38 are performed by the scroll control unit 63, and steps S28, S32, and S36 are performed by the cursor control unit 64.

  With reference to FIG. 14A, an example of an operation when one coordinate is detected by the measurement of the detection unit 51 will be described. The operation illustrated in FIG. 14A is an example, and the operation of the display device 1 may be changed, for example, the order of operations in steps S28 to S30 may be arbitrarily changed.

  The detection unit 51 detects a touch operation on the touch panel 10 and acquires the coordinates of the input position. Furthermore, the detection unit 51 notifies the determination unit 61 of the acquired coordinates (step S21). Then, the determination part 61 confirms whether the database A is memorize | stored with reference to the coordinate memory | storage part 24a (step S22). When the database A does not exist in the coordinate storage unit 24a, the determination unit 61 generates the database A in the coordinate storage unit 24a and stores the notified coordinates (steps S23 and S24). For example, it is assumed that the coordinates (xa1, ya1) of A1 are notified at time t1. Since the database A does not exist when the data detected at time t1 is processed, the determination unit 61 generates the database A and stores the notified coordinates. The coordinates stored in the database A are used for scroll display of the screen by the scroll control unit 63 (step S25). When the process of step S25 ends, the processes after step S21 are repeated.

  On the other hand, when it is determined in step S22 that the database A exists in the coordinate storage unit 24a, the determination unit 61 confirms whether a plurality of coordinates are detected in one measurement (step S26). The process when a plurality of coordinates are notified will be described later with reference to FIG. 14B. When there is one notified coordinate, the determination unit 61 confirms whether two coordinates are detected in the previous measurement (step S27). The determination unit 61 can confirm, for example, whether the database B exists in order to confirm whether two coordinates have been detected in the previous measurement. If two coordinates have been detected in the previous measurement, it means that either the first touch operation or the second touch operation has ended after the first and second touch operations have been performed simultaneously. To do. Accordingly, the determination unit 61 requests the cursor control unit 64 to interrupt the display of the cursor 71. The cursor control unit 64 interrupts the display of the cursor 71 in accordance with the request from the determination unit 61 (step S28). The determination unit 61 deletes the database B, and further deletes the data stored in the database A (steps S29 and S30). The determination part 61 preserve | saves the coordinate notified from the detection part 51 to the database A after the process of step S29 (step S24). Then, the process after step S25 is performed. For example, as described with reference to FIGS. 12 and 13, when the data detected at time t12 is processed, the databases A and B exist, but the detection unit 51 detects only the input by the finger B. . Therefore, the determination unit 61 deletes the database B and deletes the data in the database A. Thereafter, the determination unit 61 stores the data detected at time t12 in the database A.

  On the other hand, when determining that the two coordinates are not detected in the previous measurement, the determination unit 61 stores the coordinates notified from the detection unit 51 in the database A (No in step S27, step S24). Therefore, for example, when the input of coordinates only by the finger A is continued at times t2 to t5, or when the input of coordinates only by the finger B is continued at times t13 to t16, the determination unit 61 stores the notified coordinates in the database A.

  Next, a process when two coordinates are detected in one measurement will be described with reference to FIG. 14B. Note that the operation in FIG. 14B is an example, and for example, a change such as switching the order of steps S32 and S33 may be added.

  In step S26, when a plurality of coordinates are detected in one measurement, the determination unit 61 accesses the coordinate storage unit 24b and confirms whether the database B exists (step S31). When two coordinates are detected by the detection unit 51 but the database B does not exist, the second touch operation is started, and thus the determination unit 61 requests the cursor control unit 64 to display the cursor 71. . The cursor control unit 64 starts displaying the cursor 71 in response to a request from the determination unit 61 (step S32). When it is determined in step S31 that the database B does not exist, the determination unit 61 generates the database B in the coordinate storage unit 24b (step S33). For example, at time t6, in addition to the coordinates of the position input by the first touch operation, the coordinates of the position input by the second touch operation are notified. Since the second touch operation starts at time t6, the database B does not exist, so the determination unit 61 generates the database B.

  Next, the determination unit 61 calculates the distance from the latest coordinate recorded in the database A for each of the notified two coordinates, and compares the obtained values (step S34). The determination unit 61 determines that the coordinate having the shorter distance between the latest coordinate recorded in the database A and the notified coordinate is the position input by the first touch operation. Therefore, the determination unit 61 stores, in the database A, coordinates close to the latest coordinates recorded in the database A among the notified coordinates (steps S34 and S37). The coordinates stored in the database A are used for scroll display of the screen by the scroll control unit 63 (step S38). When the process of step S38 is completed, the processes after step S21 are repeated.

  Further, of the two notified coordinates, the determination unit 61 determines that the coordinate that is not recorded in the database A in step S37 is input by the second touch operation and stores it in the database B (step S34, S35). For example, for A6 and B6 input at time t6, the distances from the respective coordinates to the coordinates of A5 are compared in the process of step S34. As described with reference to FIG. 5, the distance between A6 and A5 is shorter than the distance between B6 and A5. Therefore, the determination unit 61 stores the coordinates of A6 in the database A and the coordinates of B6 in the database B. The data stored in the database B is used for the cursor control unit 64 to adjust the position where the cursor 71 is displayed (step S36). When the process of step S36 is completed, the processes after step S21 are repeated.

  In step S31, when the database B exists, the determination part 61 confirms whether the data more than the data number decided beforehand are contained in the database B (step S39). When data exceeding the predetermined number of data is included, the determination unit 61 predicts input coordinates by the first and second touch operations using the databases A and B. (Step S40). The predetermined number of data can be any number that can predict the coordinates of Bcalc using the database B. For example, as described in the example of FIG. 7, the determination unit 61 can predict input coordinates when two or more data are stored in the database B. The determination unit 61 compares each notified coordinate with Acalc and Bcalc (step S41). The determination unit 61 stores, in the database A, coordinates closer to the position of Acalc than the position of Bcalc among the notified coordinates (steps S41 and S37). On the other hand, the determination unit 61 stores the coordinates closer to the Bcalc position than the Acalc position in the database B (steps S41 and S35). For example, from time t8 to t11, based on the result of comparing the predicted coordinates using the data in the databases A and B with the notified coordinates, the determination unit 61 determines which touch for each of the notified coordinates. It is determined whether or not it has been input by an operation.

  On the other hand, if it is determined in step S39 that no more data than the predetermined number is included, the processes in steps S34 to S38 are performed. For example, at time t7, since the number of data stored in the database B is one, the processes of steps S34 to S38 are performed.

  Next, a method for predicting coordinates based on the equations (1) to (6) when the touch operation with two fingers is resumed after the database A shown in FIG. 13 is generated will be described. In the process of step S40, the coordinates stored in the database A are handled as the coordinates input by the first touch operation. For example, it is assumed that after time t12, the touch operation with the finger C is started while the touch operation with the finger B is continued. In this case, in the database A shown in FIG. 13, the processes in steps S40 and S41 are performed as the coordinates input by the first touch operation. In the prediction of coordinates using the equations (1) to (6), No. 1 in FIG. Can be used as the value of the variable i corresponding to the data. For example, data at time t12 can be used as i = 1 data, and data at t13 can be used as i = 2 data.

<Others>
The embodiment is not limited to the above, and can be variously modified. Some examples are described below.

  The operation of the cursor control unit 64 can be changed so that the cursor 71 is displayed even when the second touch operation is not detected. In this case, it is assumed that the cursor 71 is displayed at a certain position on the screen such as the center of the screen or the upper right corner of the screen until the second touch operation is detected. When the second touch operation is detected, the cursor control unit 64 changes the display position of the cursor 71 in accordance with the second touch operation. When the first or second touch operation ends, the cursor control unit 64 stops the movement of the cursor 71 and returns it to the certain position.

  Furthermore, the method of associating the coordinates and the touch operation performed by the determination unit 61 can be changed to a method other than the method described with reference to FIGS. 14A and 14B. For example, the determination unit 61 does not depend on the number of data stored in the coordinate storage unit 24, and the input coordinates and the latest coordinates stored in the coordinate storage unit 24 as described with reference to FIG. 5. Can be associated with the touch operation. Further, as described with reference to FIG. 7, the calculation method for obtaining the predicted coordinates may be changed depending on the implementation.

  The display device 1 can be any device that can be used to display electronic data, including a PDA, a mobile PC, and the like. In this case, the computer mounted on the mobile PC or PDA operates as the control unit 40 by executing the program recorded in the memory.

DESCRIPTION OF SYMBOLS 1 Display apparatus 10 Touch panel 11 Antenna 12 Wireless communication part 13 Display part 14 Microphone 15 Speaker 16 Voice input / output part 20 Storage part 21 Program storage part 22 Data storage part 23 RAM
24a, 24b Coordinate storage unit 30 Processor 40 Control unit 41 Wireless control unit 42 Call control unit 43 Browser unit 44 Display control unit 50 Touch panel control unit 51 Detection unit 60 Input control unit 61 Determination unit 62 Movement pattern specification unit 63 Scroll control unit 64 Cursor control unit 70 Web page 71 Cursor 72 Display area

Claims (6)

A display device comprising: a display unit that displays a part of electronic data on a screen; and a touch panel that inputs a position on the screen.
A detection unit that detects a first touch operation on the touch panel and a second touch operation that is started while the first touch operation continues;
A scroll control unit that scrolls and displays the electronic data based on a first movement pattern representing a movement pattern of a position input by the first touch operation;
A cursor control unit that moves a display position of a cursor used for selection of information displayed on the screen based on a second movement pattern representing a movement pattern of a position input by the second touch operation;
A display device comprising: When the first and second touch operations are detected, the first and second movement patterns are specified, and the first movement pattern is output to the scroll control unit, and the second movement pattern is output. A movement pattern is output to the cursor control unit, and when the first touch operation is completed while the second touch operation is continued, the second movement pattern is output to the scroll control unit. And a movement pattern specifying unit for interrupting the output of the second movement pattern to the cursor control unit,
The scroll control unit scrolls and displays the electronic data based on the first or second movement pattern input from the movement pattern specifying unit,
The display device according to claim 1, wherein when the input of the second movement pattern is interrupted, the cursor control unit interrupts the movement of the display position of the cursor. A first predicted position representing a predicted result of a position input by the first touch operation is obtained using the first movement pattern, and a first predicted position of the position input by the second touch operation is obtained. Two predicted positions are obtained based on the second movement pattern, and the first and second predicted positions are compared with the input positions input by the touch operation detected by the detection unit. Further includes a determination unit that determines which of the first touch operation and the second touch operation is input,
The display device according to claim 2, wherein the movement pattern specification unit specifies the first or second movement pattern using a determination result of the determination unit. The cursor control unit displays the cursor at a certain position on the screen,
When the second movement pattern is input, the cursor control unit moves the display position of the cursor based on the second movement pattern, and when the input of the second movement pattern is interrupted, The display device according to claim 1, wherein the display position of the cursor is returned to the certain position. Computer
Display part of the electronic data on the screen,
Detecting a first touch operation on the touch panel for inputting a position on the screen and a second touch operation started while the first touch operation is continued;
Scrolling the electronic data based on a first movement pattern representing a movement pattern of a position input by the first touch operation;
The display position of the cursor used for selecting the information displayed on the screen is moved based on the second movement pattern representing the movement pattern of the position input by the second touch operation. Display method. On the computer,
Displaying a portion of the electronic data on the screen;
Detecting a first touch operation on the touch panel for inputting a position on the screen, and a second touch operation started while the first touch operation continues;
Scrolling the electronic data based on a first movement pattern representing a movement pattern of a position input by the first touch operation;
Moving the display position of the cursor used for selecting the information displayed on the screen based on the second movement pattern representing the movement pattern of the position input by the second touch operation. A display program characterized by that.

Images