JP5919995B2 - Display device, display method, and display program - Google Patents

Description

  The present invention relates to a display device that performs scroll display, a display method, and a display program.

  In recent years, communication devices such as mobile phones, smartphones, PDAs (Personal Digital Assistants), and mobile PCs (Personal Computers) that can display documents on a display and can be easily carried by users have become widespread. All of these communication devices have been attempted to be miniaturized so that the user can easily carry them. For example, a touch panel has been conventionally employed for the purpose of reducing the number of input devices such as keys. The touch panel is provided so as to overlap the display, and can perform a drag operation for moving the fingertip in a state of being in contact with the display screen.

  Further, in a conventional communication device in which a touch panel is provided on a display, it is possible to scroll and display a document, a web page, or the like having a display area larger than the display size by a drag operation. The scroll display by such a drag operation is started when the touch operation on the touch panel is detected, that is, when the processor detects the contact coordinates output from the touch panel, and ends when the fingertip leaves the touch panel. To do.

JP2012-33118A

  However, in the related art that performs scroll display triggered by detection of contact coordinates output from the touch panel, the time required for display processing and the coordinate output cycle of the touch panel are not the same. Therefore, in the processor, there is a time for waiting for coordinate output of the touch panel when the display process is repeated during scroll display. The time required for the display process is not constant depending on the area of the display area to be newly displayed according to the amount of change in coordinates, the number of data in the display area, the time for loading the data, and the like. . Therefore, the time for waiting for the coordinate output of the touch panel varies within the period during which the drag operation is performed.

  For example, if the time required for display processing is longer than the coordinate output cycle of the touch panel due to fluctuations in the time to wait for coordinate output, the processor performs display processing using the input contact coordinates, The waiting time can be eliminated. However, if the drag operation is continued in such a case, there is a problem that the shift between the contact coordinates and the scroll display coordinates gradually increases, and the scroll display appears to be delayed.

  In order to solve the problem of delay in scroll display, the processor discards the contact coordinates when the display processing for the previous contact coordinates is not completed at the time of coordinate output of the touch panel. As a result, the processor can always obtain the latest contact coordinates and perform display processing so that there is no delay. However, when the contact coordinates are discarded as described above, there is a problem that the processor waits for the next coordinate output.

  In addition, the load on the processor greatly fluctuates due to the time for waiting for coordinate output and the fluctuation of the time. For example, when the load on the processor is small, the time delay from the input of contact coordinates from the touch panel to the completion of the display process is small, but when the load is large, the above time delay is also large. There has also been a problem that the variation of the time delay due to the variation of the processor load causes the shift of the scroll display coordinates.

  That is, in the conventional technology that performs scroll display triggered by detection of contact coordinates output from the touch panel, there are cases where smooth scroll display cannot be performed because of the time waiting for coordinate output and the fluctuation of the time.

  The disclosed technology has been made in view of the above, and an object thereof is to provide a display device capable of realizing smooth scroll display.

  In one aspect, a display device disclosed in the present application scrolls a display image according to contact coordinates detected by a drag operation on a touch panel provided on a display surface of a display. The input control unit detects contact coordinates periodically input by a drag operation on the touch panel, and records the contact coordinates in a memory in association with an acquisition time of the contact coordinates. The display control unit calculates contact coordinates at a predetermined time before the current time based on the contact coordinates recorded in the memory and the acquisition time associated with the contact coordinates. Then, the display control unit performs display control on the display using the obtained contact coordinates as display coordinates.

  According to one aspect of the display device disclosed in the present application, there is an effect that smooth scrolling display can be performed.

FIG. 1 is a diagram illustrating a hardware configuration example of a display device. FIG. 2 is a diagram illustrating an example of a functional block configuration of the display device. FIG. 3 is a flowchart showing the processing of the input control unit. FIG. 4 is a flowchart showing processing of the display control unit. FIG. 5 is a diagram showing an outline of the operation input process associated with the drag operation. FIG. 6 is a diagram illustrating a drag operation viewed from the side. FIG. 7 is a diagram showing an overview of the display coordinate generation process. FIG. 8 is a diagram showing a graph when the x-coordinates of the contact coordinates recorded in the RAM are plotted in time series. FIG. 9 is a diagram showing a graph when the y-coordinates of the contact coordinates recorded in the RAM are plotted in time series. FIG. 10 is a diagram illustrating a state where display coordinates at time Ts are obtained.

  Hereinafter, embodiments of a display device, a display method, and a display program disclosed in the present application will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiments.

  FIG. 1 is a diagram illustrating a hardware configuration example of the display device according to the present embodiment. In FIG. 1, a display device 1 includes a processor 11 that is a CPU (Central Processing Unit) or an FPGA (Field Programmable Gate Array). The display device 1 includes a storage unit 12 including various memories such as a ROM (Read Only Memory) 13 and a RAM (Random Access Memory) 14, a timer 15, a display unit 16 including a display 17 and a touch panel 18. Have.

  The processor 11 controls the entire apparatus by connecting to various hardware in the display apparatus 1 and executes the display program of this embodiment. In the storage unit 12, the ROM 13 stores various programs such as the display program of this embodiment. Further, the RAM 14 stores the contact coordinates and the acquisition time of the contact coordinates obtained from the timer signal output from the timer 15 in association with each other as data obtained in the process. The processor 11 reads the display program of this embodiment from the ROM 13 and executes scroll display. Note that the timer 15 outputs a timer signal indicating the time with high accuracy from the time when the processor 11 detects the drag operation, for example, at the start of the drag operation.

  In the display unit 16, the display 17 performs screen display processing under the control of the processor 11. The touch panel 18 is provided on the display surface of the display 17 and periodically outputs a touch panel signal including contact coordinates indicating a contact position in accordance with a drag operation by a fingertip or the like.

  The display device 1 of this embodiment is used for portable information terminals such as mobile phones, smartphones, PDAs, and mobile PCs, and computers such as desktop personal computers and notebook personal computers.

  Moreover, FIG. 2 is a figure which shows an example of the functional block structure of the display apparatus of a present Example. The processor 11 operates as the control unit 21 by executing the display program of this embodiment. In FIG. 2, the control unit 21 includes an input control unit 22 and a display control unit 23.

  When the input control unit 22 detects the touch panel signal at a constant cycle during the drag operation to the touch panel 18, the input control unit 22 extracts the contact coordinates included in the touch panel signal each time. Then, the input control unit 22 stores the contact coordinates in association with the contact coordinate acquisition time obtained from the timer signal in the RAM 14.

  The display control unit 23 sets a display area such as a document or web page to be displayed on the display 17, extracts a partial image in the display area, and causes the display 17 to display the partial image on the entire screen. Further, the display control unit 23 changes the display coordinates in accordance with the drag operation, and performs a partial image trimming process so that the partial image in the display area is displayed on the full screen on the display 17 even after the display coordinates are changed. Do. Specifically, during the drag operation, the display control unit 23 obtains a new display coordinate from the combination of the contact coordinate stored in the RAM 14 and the acquisition time of the coordinate, and the display control to the obtained display coordinate. Is repeatedly executed every time the display processing of the partial image at the obtained display coordinates is completed.

  Note that the hardware configuration and functional block configuration of the display device 1 according to the present embodiment list the configurations related to the scroll display processing for convenience of explanation, and do not represent all the functions of the display device 1.

  Next, scroll display processing by the control unit 21, that is, processing by the display program of this embodiment will be described in detail with reference to the drawings. FIG. 3 is a flowchart showing the processing of the input control unit 22, and FIG. 4 is a flowchart showing the processing of the display control unit 23. In the present embodiment, the input control unit 22 and the display control unit 23 operate independently without cooperation, thereby realizing a smooth scroll display process. In the present embodiment, it is assumed that the partial image of the document is displayed on the full screen on the display 17 under the control of the display control unit 23 (S11) and the touch operation on the touch panel 18 is not performed. .

  In the initial state, the input control unit 22 waits for a drag operation on the touch panel 18 (S1, S2, No). When a drag operation is detected after touch panel signal input (S1, S2, Yes), the input control unit 22 starts the timer 15 (S3).

  Next, the input control unit 22 executes a predetermined operation input process (S4). Here, the input control unit 22 extracts the contact coordinates included in the touch panel signal when the drag operation is detected. Furthermore, the input control unit 22 stores the contact coordinates in association with the contact coordinate acquisition time obtained from the timer signal in the RAM 14.

  Thereafter, the input control unit 22 waits for an input of a touch panel signal sent at a constant cycle during the drag operation. When the touch panel signal is input (S5, S6, No), the input control unit 22 extracts the contact coordinates included in the touch panel signal, and the contact coordinates obtained from the extracted contact coordinates and the timer signal. Are recorded in the RAM 14 in association with each other (S4).

  Thereafter, the input control unit 22 receives the touch panel signal sent at a constant cycle during the drag operation (S6, No), and performs the operation input process of step S4, that is, the acquisition of the contact coordinates and the coordinates. A process of recording the time in the RAM 14 is performed. When the end of the drag operation is detected (S6, Yes), the input control unit 22 proceeds to a process of waiting for the next drag operation (S1, S2).

  On the other hand, the display control unit 23 that operates separately without cooperating with the input control unit 22 waits for the elapse of time: Td from the start of the timer 15 (S12). Note that time: Td is a fixed parameter, details of which will be described later. And the display control part 23 performs a predetermined display coordinate production | generation process at the time of time: Td having passed from the start of the timer 15 (S13). Here, based on the contact coordinates recorded in the RAM 14 and the acquisition time associated with the contact coordinates, the display control unit 23 subtracts time: Td from the current time: Tc: Ts (Ts = Tc− The contact coordinates of Td) are calculated.

  Next, the display control unit 23 uses the obtained contact coordinates at time Ts as display coordinates, and performs control for displaying the document at the display coordinates (S14).

  Thereafter, the display control unit 23 repeatedly executes the processing of step S13 and step S14 for each time when the display control of the document is completed in the period during which the drag operation is performed (S15, No).

  Then, when the drag operation is finished (S15, Yes), the display control unit 23 sets the contact coordinates at that time as the last display coordinates, and performs control for displaying the document at the display coordinates (S16). Further, after the display control of the document is completed, the display control unit 23 stops the timer 15 (S17) and shifts to a process of monitoring the restart of the timer 15 (S12).

  Subsequently, the operation input process of S4 will be described in detail with reference to the drawings. FIG. 5 is a diagram showing an outline of the operation input process associated with the drag operation, and FIG. 6 is a diagram showing a state where the drag operation is viewed from the side. The touch panel signal is output at the time of sampling the coordinates during the drag operation, and the sampling cycle is constant, for example, several milliseconds to several tens of milliseconds. For example, when the display update rate is set to 60 fps (frame per second: the number of frames of an image displayed per second), the sampling period is about 17 milliseconds.

  As shown in FIGS. 5 and 6, when a drag operation is performed on the touch panel 18, the input control unit 22 extracts contact coordinates (x, y) from the touch panel signal input at each sampling period. To do. Here, the contact coordinates (x, y) represent the total number of pixels (sometimes referred to as resolution) used for display, such as 1280 × 768, as coordinates.

  Further, the input control unit 22 stores the contact coordinates (x, y) extracted from the touch panel signal and the acquisition time: Tin of the contact coordinates (x, y) obtained from the timer signal in the RAM 14 in association with each other. In FIG. 5, for example, the contact coordinates included in the first touch panel signal when the drag operation is detected is (200, 300), and the acquisition time of the coordinates: Tin is 0 (milliseconds). Further, the contact coordinates included in the next touch panel signal is (205, 308), and the acquisition time of the coordinates: Tin is 10 milliseconds. Hereinafter, during the drag operation, the contact coordinates (x, y) and the acquisition time Tin of the coordinates are recorded in the RAM 14 every 10 milliseconds.

  Next, the display coordinate generation process of S13 will be described in detail with reference to the drawings. FIG. 7 is a diagram showing an overview of the display coordinate generation process.

  The display control unit 23 starts the display coordinate generation process when the time Td has elapsed from the start of the timer 15 without interlocking with the input control unit 22. In this display coordinate generation process, the display control unit 23 calculates the time: Td from the current time: Tc based on the contact coordinates (x, y) recorded in the RAM 14 and the acquisition time: Tin associated with the coordinates. The contact coordinates at the time of subtraction: Ts (Ts = Tc−Td) are calculated.

  Here, the principle of calculating the contact coordinates at time Ts will be described. 8 is a diagram showing a graph when the x coordinate of the contact coordinates recorded in the RAM 14 is plotted in time series, and FIG. 9 is a case where the y coordinate of the contact coordinates recorded in the RAM 14 is plotted in time series. It is a figure which shows these graphs. For example, in the state where the x coordinate of the contact coordinates is plotted for each acquisition time: Tin, if an interpolation line connecting each point (see the circle in FIG. 8) is drawn, this interpolation line causes x at an arbitrary time: T. Coordinate values can be obtained. Similarly, when the y coordinate of the contact coordinate is plotted for each acquisition time: Tin, when an interpolation line connecting each point (see the circle in FIG. 9) is drawn, this interpolation line allows the arbitrary time: T The y coordinate value can be obtained. That is, the contact coordinates (x, y) at time Ts can be obtained by piecewise linear interpolation (primary spline interpolation, so-called line graph).

When the above principle is generalized, the contact coordinates (x, y) at time: Ts is that the time: Ts is between the acquisition times: _Tn-1 and _Tn, and the contact at acquisition time: _Tn-1 When the coordinates are (x _n−1 , y _n−1 ) and the contact coordinates of the acquisition time: T _n are (x _n , y _n ), they can be obtained by the following equation (1).

  The display control unit 23 obtains the contact coordinates at time Ts from the above equation (1), and performs display control on the display 17 using these coordinates as display coordinates. The display control unit 23 scrolls the document displayed on the display 17 by repeatedly executing such control until the drag operation ends. FIG. 10 is a diagram illustrating a state where display coordinates (y coordinates) at time Ts are obtained.

  Finally, an example of how to determine time: Td will be described. Time: Td is a fixed value, for example, a value larger than the sampling period of the contact coordinates during the drag operation. Further, as shown in FIGS. 3 and 4, the time: Td is a delay time from the start of the drag operation to the start of the display process, and is preferably as small as possible. For example, when the sampling cycle is about 17 milliseconds, the time: Td takes into account a certain margin due to the stability of the touch panel device, the accuracy of the timer 15, the processing speed of the processor 11, the load resistance of the entire apparatus, etc. The value is greater than 17 milliseconds. Thereby, the display control unit 23 can stably set the coordinates at the time before the contact coordinates by time: Td as the display coordinates for the period during which the drag operation is performed.

  As described above, in the display device 1 according to the present embodiment, the input control unit 22 detects a touch panel signal input at a constant cycle by a drag operation, and obtains the contact coordinates extracted from the touch panel signal. It is recorded in the RAM 14 in association with the time. Further, the display control unit 23 calculates the contact coordinates at a time that is a fixed time: Td before the current time based on the contact coordinates recorded in the RAM 14 and the acquisition time of the coordinates. Then, display control is performed on the display 17 using the obtained contact coordinates as display coordinates. After that, the display control unit 23 finishes the drag operation for the process of calculating the contact coordinates at a fixed time: Td before the current time and the display control using the obtained contact coordinates as the display coordinates. It was decided to repeat until.

  Accordingly, display control can be performed without waiting for coordinate output from the touch panel 18, and even when the drag operation is continued, the time difference between the contact coordinates and the display coordinates is constant, so that the scroll display is delayed. It doesn't seem to be. Further, since the time difference between the contact coordinates and the display coordinates is constant, the coordinates are not discarded. In addition, since the load on the processor becomes constant by eliminating the time for waiting for the coordinate output of the touch panel and the change in the waiting time, the time delay until the display process is completed is also constant. From the above, in the display device 1 of the present embodiment, the scroll display in the drag operation on the touch panel 18 is smooth so as to stick to the fingertip. In addition, since the scroll display becomes smooth, the visibility of the display contents is greatly improved.

  In this embodiment, when determining the contact coordinates at time: Ts, primary spline interpolation is used as an example. However, the present invention is not limited to this, and the interpolation line is a cubic expressed by a continuous curve. Spline interpolation may be used.

DESCRIPTION OF SYMBOLS 1 Display apparatus 11 Processor 12 Memory | storage part 13 ROM
14 RAM
15 Timer 16 Display Unit 17 Display 18 Touch Panel 21 Control Unit 22 Input Control Unit 23 Display Control Unit

Claims (7)

In a display device that scrolls a display image based on contact coordinates detected by a drag operation to a touch panel provided on a display surface of a display,
An input control unit that detects contact coordinates periodically input by a drag operation on the touch panel and records the contact coordinates in a memory in association with an acquisition time of the contact coordinates;
Based on the contact coordinates recorded in the memory and the acquisition time associated with the contact coordinates, the contact coordinates at a predetermined time before the current time are calculated by interpolation using the contact coordinates for each acquisition time. A display control unit that performs display control on the display using the touched coordinates as display coordinates,
A display device comprising: The display control unit repeatedly executes the calculation processing of the contact coordinates and the display control using the obtained contact coordinates as display coordinates, with the time when the display control is completed as the current time.
The display device according to claim 1. A timer for the input control unit and the display control unit to obtain time;
Have
The input control unit starts a timer at the start of a drag operation,
The display control unit starts a process of calculating contact coordinates at a time that is a predetermined time before the current time when the predetermined time has elapsed from the start of the timer. To stop,
The display device according to claim 1, wherein the display device is a display device. The predetermined time is a fixed value,
The display device according to any one of claims 1 to 3 . In a display method of scrolling a display image based on contact coordinates detected by a drag operation to a touch panel provided on a display surface of a display,
Detecting contact coordinates periodically input by a drag operation on the touch panel, and recording the contact coordinates in a memory in association with the acquisition time of the contact coordinates;
Based on the contact coordinates recorded in the memory and the acquisition time associated with the contact coordinates, the contact coordinates at a predetermined time before the current time are calculated by interpolation using the contact coordinates for each acquisition time ,
Display control on the display using the obtained contact coordinates as display coordinates,
A display method characterized by that. At the start of the drag operation, start a timer to get the time,
When the predetermined time has elapsed from the start of the timer, a process of calculating contact coordinates at a time before the current time is started, and the timer is stopped when the drag operation is completed.
The display method according to claim 5 , wherein: Detecting contact coordinates periodically input by a drag operation to a touch panel provided on a display surface of the display, and recording the contact coordinates in a memory in association with an acquisition time of the contact coordinates;
Based on the contact coordinates recorded in the memory and the acquisition time associated with the contact coordinates, the contact coordinates at a predetermined time before the current time are calculated by interpolation using the contact coordinates for each acquisition time ,
Scroll the display image by performing display control on the display using the obtained contact coordinates as display coordinates,
A display program for causing a computer to execute processing.

Images