JP6579088B2 - Display device, information processing device - Google Patents

Description

  The present invention relates to a display device and an information processing device including the display device.

  In general, an information processing apparatus such as a smartphone, a tablet PC (Personal Computer), or a notebook PC includes a display panel that displays information and an operation panel that can detect a multi-touch operation.

  For example, the smartphone and the tablet PC include a touch panel unit that serves as the display panel and the operation panel. In many cases, the notebook PC includes a touch pad which is an example of the operation panel.

  Further, when the display device detects a slide operation on the operation panel, the display device scrolls the display screen of the display panel in the direction of the slide operation. At that time, the display device often controls the scroll amount of the display screen in accordance with the operation amount of the slide operation.

  Further, it is known that the display device performs inertial scroll control (see, for example, Patent Document 1). The inertial scroll control is a control for scrolling the display screen of the display panel with a vector corresponding to the operation vector of the immediately preceding slide operation when the slide operation on the operation panel is no longer detected.

Japanese Patent Laid-Open No. 10-161628

  By the way, when the scroll amount of the display screen is determined according to the operation vector of the slide operation, it is necessary to perform the slide operation many times with a large gesture until the target information is displayed on the display panel. There is a possibility. Thus, it is troublesome for the user to perform the slide operation many times with a large gesture.

  The objective of this invention is providing the display apparatus which can control the scroll of the display screen in a display panel according to simple operation with respect to an operation panel, and an information processing apparatus provided with the same.

  A display device according to one aspect of the present invention includes a display panel, a first operation detection unit, a second operation detection unit, and a display control unit. The display panel is a device that displays information. The operation panel is a device capable of detecting a multi-touch operation. The first operation detection unit detects a first operation that is a long press operation on the operation panel. The second operation detection unit detects a second operation that is a touch operation on the operation panel during a long press period in which the first operation is continuously detected. The display control unit sets a scroll control direction according to a relative position of the second operation with respect to the position of the first operation, and scrolls the display screen of the display panel in the scroll control direction.

  An information processing apparatus according to another aspect of the present invention includes the display device according to one aspect of the present invention.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide the display apparatus which can control the scroll of the display screen in a display panel by simple operation with respect to an operation panel, and an information processing apparatus provided with the same.

FIG. 1 is a block diagram of an information processing apparatus including a display device according to an embodiment. FIG. 2 is a flowchart illustrating an example of a scroll control procedure in the display device according to the embodiment. FIG. 3 is a diagram illustrating an example of the touch panel unit in which the first operation is performed in the display device according to the embodiment. FIG. 4 is a diagram illustrating a relative position vector and a deviation vector when the second operation is performed in the display device according to the embodiment. FIG. 5 is a diagram illustrating an example of a touch panel unit in which a small vector second operation is performed in the display device according to the embodiment. FIG. 6 is a diagram illustrating an example of a touch panel unit in which a second operation of a large vector is performed in the display device according to the embodiment. FIG. 7 is a diagram illustrating an example of the touch panel unit in which the second operation on the downstream side in the scroll direction is performed in the display device according to the embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In addition, the following embodiment is an example which actualized this invention, Comprising: It does not have the character which limits the technical scope of this invention.

[Configuration of Information Processing Apparatus 10]
The information processing apparatus 10 including the display device 100 according to the embodiment is, for example, a smartphone, a tablet PC, or a notebook PC.

  As illustrated in FIG. 1, the information processing apparatus 10 includes a TPU (Touch Panel Unit) 1x, a secondary storage unit 4, a control unit 5, a wireless communication unit 6, and the like.

  The TPU 1x includes an operation panel 1 and a display panel 2 that are integrally formed, and an operation detection unit 3. The control unit 5 includes a CPU (Central Processing Unit) 51 and a RAM (Random Access Memory) 52.

  The operation panel 1 is a panel that can detect a multi-touch operation. For example, it is conceivable that a capacitance type, resistance type or optical type operation panel 1 is adopted. The display panel 2 is a panel-like display device such as a liquid crystal panel. The display panel 2 can display a screen including various information.

  The operation detection unit 3 is a device that detects various operations such as a one-touch operation, a long-press operation, a continuous touch operation, and a slide operation on the operation panel 1. For example, the operation detection unit 3 may be a processor such as a DSP (Digital Signal Processor) or MPU (Micro Processing Unit) or a circuit such as an ASIC (Application Specific Integrated Circuit).

  The secondary storage unit 4 is a non-transitory and computer-readable storage device. For example, a hard disk drive or a flash memory is employed as the secondary storage unit 4. For example, the secondary storage unit 4 stores a program executed by the CPU 51 or data referred to by the CPU 51 in advance.

  In the control unit 5, the CPU 51 executes various calculations, data processing, and various electronic devices included in the information processing apparatus 10. The RAM 52 temporarily stores various programs executed by the CPU 51. The CPU 51 executes the program developed in the RAM 52.

  For example, the CPU 51 controls the screen display of the display panel 2 by executing a display control program 4 a stored in advance in the secondary storage unit 4. At that time, the CPU 51 causes the display panel 2 to display a screen based on the screen data 4 b stored in advance in the secondary storage unit 4. When the operation detection unit 3 detects a scroll operation on the operation panel 1, the CPU 51 scrolls the display screen of the display panel 2 in a direction corresponding to the content of the scroll operation.

  The CPU 51 can exchange data and control signals with the TPU 1x, the secondary storage unit 4, and the wireless communication unit 6 through the bus 7.

  The wireless communication unit 6 is a communication interface that performs wireless communication with other devices. For example, the wireless communication unit 6 transfers data received from the other device to the CPU 51. The wireless communication unit 6 transmits the data transferred from the CPU 51 to the other device in accordance with a transmission command from the CPU 51.

  In the present embodiment, the display device 100 includes a TPU 1x, a secondary storage unit 4 that stores the display control program 4a, a CPU 51 that executes the display control program 4a, and a RAM 52.

  In the conventional general information processing apparatus, the scroll amount of the display screen is often determined according to the operation vector of the slide operation. In this case, it may be necessary to perform the slide operation many times with a large gesture until the target information is displayed on the display panel 2. Thus, it is troublesome for the user to perform the slide operation many times with a large gesture.

  On the other hand, in the display device 100, the CPU 51 executes scroll control described later. Thereby, the display device 100 can control scrolling of the display screen on the display panel 2 in accordance with a simple operation on the operation panel 1.

  For example, the CPU 51 executes the scroll control in a state where the window screen g0 is displayed on the display panel 2 (see FIG. 3). The window screen g0 includes an information display area g1 and a scroll operation area g2. The window screen g0 is an example of a display screen.

  The information display area g1 is an area where a display target included in the screen data 4b is displayed. The display target includes one or more of a character, an image, and an image. The display target displayed in the information display area g1 is a scroll target in the scroll control.

  The scroll operation area g2 is an area for receiving the scroll operation on the display panel 2. In the present embodiment, the scroll operation area g2 includes a vertical scroll operation area g21 and a horizontal scroll operation area g22.

  The vertical scroll operation area g21 is an area for receiving an operation for scrolling the display target in the information display area g1 in the vertical direction. The horizontal scroll operation area g22 is an area for receiving an operation for scrolling the display target in the information display area g1 in the horizontal direction. The vertical direction and the horizontal direction are the Y-axis direction and the X-axis direction in the coordinates of the display area of the display panel 2, respectively.

  In the scroll control, it is assumed that the scroll operation is performed with three fingers F1 to F3 of one hand. The three fingers F1 to F3 include a primary finger F1, and a secondary finger F2 and a tertiary finger F3 located on both sides of the primary finger F1.

  For example, it is conceivable that the primary finger F1 is an index finger, the secondary finger F2 is a thumb, and the tertiary finger F3 is a middle finger. It is also conceivable that the primary finger F1 is the middle finger, the secondary finger F2 is the index finger, and the tertiary finger F3 is the ring finger.

  Of course, the scrolling operation may be performed by a finger other than the three fingers F1 to F3 of one hand or a stylus pen.

[Scroll control]
Hereinafter, an example of the procedure of the scroll control will be described with reference to the flowchart shown in FIG. In the following description, S1, S2,... Represent identification codes of processes executed in the scroll control.

<Process S1>
In the scroll control, the operation detection unit 3 executes a process for detecting the first operation. The first operation is a long press operation on the scroll operation area g2 on the operation panel 1. The operation detection unit 3 that executes the process S1 is an example of a first operation detection unit.

  The long press operation is an operation in which the same position on the operation panel 1 is continuously touched for a predetermined time or longer. The first operation is performed, for example, with the primary finger F1. FIG. 3 shows an example of the touch panel unit 1x in which the first operation is performed in the vertical scroll operation area g21 by the primary finger F1.

  The operation detection unit 3 repeats the process S1 until the first operation is detected. Moreover, the operation detection part 3 will transfer a process to process S2, if the said 1st operation is detected.

  In the following description, one of the vertical scroll operation area g21 and the horizontal scroll operation area g22 where the first operation is detected in step S1 is referred to as a detection area. The position of the first operation on the operation panel 1 is referred to as a first operation position P1. The operation detection unit 3 temporarily stores the first operation position P1 when detecting the first operation.

<Process S2>
When detecting the first operation, the operation detection unit 3 notifies the CPU 51 of the detection result of the first operation, and the CPU 51 displays the standby mark g3 on the display panel 2 in response to the notification (see FIG. 3). . The detection result of the first operation includes information on the first operation position P1 which is the detection position of the first operation on the display panel 2.

  The display device 100 notifies the user of the transition to the mode for waiting for the second operation for starting the scrolling of the display screen by displaying the standby mark g3. In the example shown in FIG. 3, the standby mark g3 is a mark indicating a scroll direction candidate.

<Step S3>
Subsequently, the operation detection unit 3 executes processing for detecting the second operation. The second operation is a touch operation on the operation panel 1 during a period in which the first operation is continuously detected. The operation detection unit 3 that executes the process of step S3 is an example of a second operation detection unit.

  5 and 6 show an example of the touch panel unit 1x in which the second operation is performed with the secondary finger F2. In the following description, a period in which the first operation is continuously detected is referred to as a long press period.

  When the second operation is not detected, the operation detection unit 3 shifts the process to step S9 described later. On the other hand, when the second operation is detected, the operation detection unit 3 moves the process to the next step S4.

<Step S4>
When detecting the second operation, the operation detection unit 3 notifies the CPU 51 of the detection result of the second operation, and the CPU 51 calculates the deviation vector V0 based on the detection results of the first operation and the second operation. (See FIG. 4). The detection result of the second operation includes information on the second operation position P2, which is the detection position of the second operation on the display panel 2.

  As shown in FIG. 4, the relative position vector V00 representing the relative position of the second operation position P2 with respect to the first operation position P1 is a vertical deviation vector Vy0 that is a component in the Y-axis direction and a component in the X-axis direction. It can be decomposed into a lateral deviation vector Vx0.

  The CPU 51 first determines whether the detection area is the vertical scroll operation area g21 or the horizontal scroll operation area g22 based on the first operation position P1.

  When the CPU 51 determines that the detection area is the vertical scroll operation area g21, the CPU 51 calculates the vertical deviation vector Vy0 as the deviation vector V0. On the other hand, when the CPU 51 determines that the detection area is the horizontal scroll operation area g22, the CPU 51 calculates the horizontal deviation vector Vx0 as the deviation vector V0.

  FIG. 5 shows an example of the touch panel unit 1x in which the second operation with a small deviation vector V0 is performed by the secondary finger F2. FIG. 6 shows an example of the touch panel unit 1x in which the second operation having a large deviation vector V0 is performed by the secondary finger F2.

<Step S5>
Further, the CPU 51 sets a direction opposite to the direction of the deviation vector V0 as the scroll control direction D0 (see FIGS. 5 and 6). As will be described later, the scroll control direction is a direction in which the CPU 51 scrolls the window screen g0 on the display panel 2.

<Step S6>
Further, the CPU 51 sets the scroll speed according to the magnitude of the deviation vector V0. At this time, the CPU 51 sets the scroll speed faster when the deviation vector V0 is larger than when the deviation vector V0 is small. Note that the magnitude of the deviation vector V0 corresponds to the size of the interval between the first operation position P1 and the second operation position P2.

  For example, the CPU 51 determines which of a plurality of numerical ranges in which the magnitude of the deviation vector V0 is associated with a plurality of speed candidates in advance. In this case, the CPU 51 sets the speed candidate corresponding to the numerical range to which the magnitude of the deviation vector V0 belongs as the scroll speed. It is also conceivable that the CPU 51 sets the scroll speed proportional to the magnitude of the deviation vector V0.

<Step S7>
Then, the CPU 51 scrolls the window screen g0 on the display panel 2 in the scroll control direction D0 set in step S5 at the scroll speed set in step S6.

<Step S8>
Further, the CPU 51 displays a scroll mark g4 on the display panel 2 instead of the standby mark g3 (see FIGS. 5 and 6). The scroll mark g4 is a mark indicating the upstream direction of scrolling.

  For example, the CPU 51 causes the display panel 2 to display a scroll mark g4 that can identify whether the scroll control speed is low or high. FIG. 5 shows a low-speed scroll mark g41 displayed when the scroll control speed is low. FIG. 6 also shows a high-speed scroll mark g42 displayed when the scroll control speed is high.

  The processes in steps S4 to S6 described above are processes performed when the first second operation in the long press period is detected. Hereinafter, processes in steps S4 to S6 when the second operation after the second time is detected in the long press period will be described.

  When the second operation after the second time in the long press period is detected, in step S4, the CPU 51 determines the deviation based on the detection results of the first operation and the current second operation in the same manner as the first time. A vector V0 is calculated (see FIG. 4). At that time, the CPU 51 stores the deviation vector V0 corresponding to the previous second operation in the RAM 52, for example.

  In the following description, the deviation vector V0 corresponding to the previous second operation is referred to as the previous deviation vector V0 (-1), and the deviation vector V0 corresponding to the current second operation is the current deviation vector V0. This is referred to as (0) (see FIG. 7).

  FIG. 7 shows a position above the first operation position P1 after the second operation at a position below the first operation position P1 is performed following the first operation on the vertical scroll operation area g21. The example in which said 2nd operation was performed in is shown. In FIG. 7, the first operation is performed with the primary finger F1, the previous second operation is performed with the secondary finger F2, and the current second operation is performed with the tertiary finger F3. An example is shown.

  Next, in steps S5 and S6, when the current deviation vector V0 (0) is in the opposite direction to the previous deviation vector V0 (-1), the CPU 51 maintains the setting of the previous scroll control direction D0. The scroll speed of this time is decelerated from the previous time.

  The fact that the current deviation vector V0 (0) is opposite to the previous deviation vector V0 (-1) means that the position of the second operation this time is the first direction in the previous scroll control direction D0. This means that the position is on the opposite side of the previous second operation position with respect to the operation position.

  For example, when the current deviation vector V0 (0) is in the opposite direction to the previous deviation vector V0 (−1), the CPU 51 sets the current scroll speed to a predetermined minimum speed. In this case, it is conceivable that the ultra-low speed is lower than all the scroll speed candidates that can be adopted when the first second operation is detected.

  When the scroll speed is already set to the minimum speed, the CPU 51 determines that the current deviation vector V0 (0) is the same as the first time in steps S5 and S6, regardless of the previous deviation vector V0 (−1). ) To set the current scroll control direction D0 and the current scroll speed.

  When the current deviation vector V0 (0) is in the same direction as the previous deviation vector V0 (-1), in steps S5 and S6, the CPU 51 determines that the current deviation vector V0 (0) is the same as the first time. Based on this, the current scroll control direction D0 and the current scroll speed are set.

  Even when the second operation after the second time in the long press period is detected, in step S7, the CPU 51 moves to the scroll control direction D0 set in step S5 at the scroll speed set in step S6. Scroll.

  FIG. 7 shows an example of the lowest speed scroll mark g40 that is displayed on the display panel 2 when the CPU 51 scrolls the window screen g0 at the lowest speed.

<Step S9>
The process of step S9 is executed by the operation detection unit 3 as needed after the first operation is detected in step S1. For convenience, FIG. 2 shows that the second operation is not detected in step S3, or is executed after the processes of steps S4 to S8.

  In step S9, the operation detection unit 3 determines whether or not the first operation is continuously detected. If the operation detection unit 3 determines that the first operation is continuously detected, the operation detection unit 3 shifts the process to step S3. Thereby, the operation detection part 3 performs the process which detects the said 2nd operation continuously.

  On the other hand, if the operation detection unit 3 determines that the first operation has not been continuously detected, the operation detection unit 3 notifies the CPU 51 that the first operation has ended, and shifts the process to step S10.

<Step S10>
When the CPU 51 receives notification from the operation detection unit 3 that the first operation has been completed, the CPU 51 stops scrolling the window screen g0 on the display panel 2. Thereafter, the CPU 51 shifts the process to step S1. Thereby, the operation detection part 3 performs the process which detects the said 1st operation again.

  The CPU 51 realizes the processes of steps S4 to S8 and S10 by executing the display control program 4a. The CPU 51 that executes the display control program 4a is an example of a display control unit.

  As described above, the CPU 51 sets the scroll control direction D0 according to the relative position of the second operation position P2 with respect to the first operation position P1, and scrolls the display screen of the display panel 2 in the scroll control direction D0. (S5, S7). The deviation vector V0 represents the relative position of the second operation position P2 with respect to the first operation position P1.

  In the display device 100, the user can scroll the window screen g0 in the intended direction until the target information appears on the display panel 2 simply by performing the second operation following the first operation. In this case, the user does not need to perform the slide operation many times with a large gesture until the target information is displayed on the display panel 2.

  Accordingly, the display device 100 can control scrolling of the display screen on the display panel 2 in accordance with a simple operation on the operation panel 1.

  Further, the CPU 51 scrolls the display screen of the display panel 2 after the second operation is detected until the first operation is not detected (S3 to S7, S10). Therefore, scrolling of the display screen can be continued with a simpler operation without repeating the second operation.

  In addition, a plurality of times of the second operation is detected in the long press period, and the current second operation position P2 in the previous scroll control direction D0 is determined based on the first operation position P1. The case where it is a position on the opposite side with respect to the position P2 can be considered. In this case, the CPU 51 reduces the scroll speed of the window screen g0 on the display panel 2 while maintaining the previous scroll control direction D0 (S6). Thereby, the user can adjust the scroll speed by an intuitive operation.

  Further, the CPU 51 controls the scroll speed of the window screen g0 according to the magnitude of the deviation vector V0, that is, the distance between the first operation position P1 and the second operation position P2 (S4, S6). Thereby, the user can adjust the scroll speed by an intuitive operation.

[First application example]
In the display device 100 shown above, the operation detection unit 3 may detect a continuous touch operation as the second operation in step S3. The continuous touch operation is the second operation performed on the operation panel 1 within a predetermined time interval and within a predetermined position shift range.

  In the case of this application example, the operation detection unit 3 detects the number of continuous touches in addition to the position of the continuous touch operation in step S3. The continuous touch operation is the number of times the second operation is performed in the continuous touch operation.

  In step S6, the CPU 51 can control the scroll speed of the window screen g0 on the display panel 2 in accordance with the number of continuous touches. For example, the CPU 51 sets a higher scroll speed as the number of continuous touches increases. Even when this application example is adopted, the same effect as that obtained when the above-described embodiment is adopted can be obtained.

[Second application example]
It is also conceivable that the CPU 51 sets the direction of the deviation vector V0 as the scroll control direction D0 in step S5.

[Third application example]
In the display device 100, the operation panel 1 may be a touch pad configured independently of the display panel 2.

  The display device and the information processing device according to the present invention can be freely combined within the scope of the invention described in each claim, or can be appropriately combined with the above-described embodiment and application examples. It is also possible to configure by deforming or omitting a part.

1x: Touch panel unit 1: Operation panel 2: Display panel 3: Operation detection unit 4: Secondary storage unit 4a: Display control program 4b: Screen data 5: Control unit 6: Wireless communication unit 7: Bus 10: Information processing device 51 : CPU
52: RAM
100: display device D0: scroll control direction F1: primary finger F2: secondary finger F3: tertiary finger P1: first operation position P2: second operation position V0: deviation vector V00: relative position vector Vx0: lateral deviation vector Vy0: Vertical deviation vector g0: Window screen (display screen)
g1: Information display area g2: Scroll operation area g21: Vertical scroll operation area g22: Horizontal scroll operation area g3: Standby mark g4: Scroll mark g40: Minimum speed scroll mark g41: Low speed scroll mark g42: High speed scroll mark

Claims (4)

A display panel for displaying information;
An operation panel capable of detecting multi-touch operations;
A first operation detection unit that detects a first operation that is a long press operation on the operation panel;
A second operation detection unit that detects a second operation that is a touch operation on the operation panel during a long press period in which the first operation is continuously detected;
A display control unit that sets a scroll control direction according to a relative position of the second operation with respect to the position of the first operation, and scrolls the display screen of the display panel in the scroll control direction ;
The display control unit
When the first operation is detected, a standby mark indicating a scroll direction candidate of the display screen of the display panel is displayed on the display panel,
When the second operation is detected, the scroll speed of the display screen of the display panel is controlled according to the size of the interval between the position of the first operation and the position of the second operation, and Instead of the standby mark, a scroll mark is displayed on the display panel,
The display device , wherein the scroll mark is a mark that indicates the scroll control direction and that can identify whether the scroll speed is low speed or high speed .   The display device according to claim 1, wherein the display control unit scrolls the display screen of the display panel until the first operation is not detected after the second operation is detected.   A plurality of times of the second operation is detected in the long press period, and the position of the second operation of the current time in the previous scroll control direction is determined based on the position of the first operation. The display control unit reduces the scroll speed of the display screen of the display panel while maintaining the previous scroll control direction when the position is opposite to the operation position. 2. The display device according to 2. An information processing apparatus comprising the display device according to any one of claims 1 to 3 .

Images