JP5552632B2 - Information processing apparatus and input method - Google Patents

Description

  Embodiments described herein relate generally to an information processing apparatus including a touch panel display and an input method used in the apparatus.

  In recent years, various information processing apparatuses such as portable personal computers and PDAs have been developed. Many information processing apparatuses have a pointing device such as a touch pad. The user can move the position of the cursor on the screen by, for example, tracing the touch pad with a finger.

  Recently, portable personal computers, PDAs, and the like having a touch screen display such as a touch panel have been developed. For example, the user can activate a function associated with the display object by touching a display object (for example, a button or an icon) on the touch screen display with a fingertip or a pen.

  Furthermore, in this field, the touch detection area is also used as a keyboard. As a method for using the touch detection area as a keyboard, for example, there is a method using a keyboard sheet attached to the touch detection area. When one of a plurality of character keys on the keyboard sheet is touched with a pen, a character corresponding to the touched character key is input.

JP 2007-234053 A

  By the way, in a conventional information processing apparatus provided with a touch screen display, the touch screen display is usually used to allow a user to specify one of display objects on the screen of the touch screen display. For this reason, in the conventional information processing apparatus, in order to move the cursor on the screen, it is necessary to further provide a pointing device (relative pointing device) such as a touch pad in addition to the touch screen display.

  The present invention has been made in consideration of the above-described circumstances, and an object thereof is to provide an information processing apparatus and an input method that can easily move a cursor using a touch screen display.

According to the embodiment, the information processing apparatus includes a display, a touch screen display, a detection unit, and an output unit. The detecting means detects a touch position on the touch screen display. The output means displays a virtual keyboard on a screen of the touch screen display, and first data indicating the touch position on the touch screen display for inputting code data of a virtual key corresponding to the touch position. Is output. The output means temporarily operates in a touch pad mode while two adjacent touch positions corresponding to two fingers are moving on the screen of the touch screen display on which the virtual keyboard is displayed. In the touch pad mode, in order to move the cursor on the screen of the display with the virtual keyboard displayed , the two data on the screen of the touch screen display are used instead of the first data . Second data corresponding to the movement direction and movement amount of the two fingers is output in accordance with the movement of the finger .

FIG. 2 is a perspective view illustrating an appearance of the information processing apparatus according to the embodiment. 2 is an exemplary diagram showing an example of a virtual keyboard displayed on the touch screen display of the information processing apparatus of the embodiment. FIG. The figure for demonstrating the touch panel mode and touch pad mode of the information processing apparatus of the embodiment. The figure for demonstrating the operation | movement performed while the information processing apparatus of the embodiment is a touchpad mode. The figure for demonstrating the multi-touch position detection operation performed by the information processing apparatus of the embodiment. 2 is an exemplary block diagram showing the system configuration of the information processing apparatus of the embodiment. FIG. 2 is an exemplary block diagram showing the configuration of an input control program used in the information processing apparatus of the embodiment. FIG. 6 is an exemplary flowchart illustrating a procedure of input processing executed by the information processing apparatus of the embodiment.

Hereinafter, embodiments will be described with reference to the drawings.
First, the configuration of an information processing apparatus according to an embodiment will be described with reference to FIG. This information processing apparatus is realized as, for example, a battery-driven portable personal computer 10.

  FIG. 1 is a perspective view of the computer 10 with the display unit opened. The computer 10 includes a computer main body 11 and a display unit 12. A display device composed of a liquid crystal display device (LCD) 13 is incorporated on the upper surface of the display unit 12, and the display screen of the LCD 13 is positioned substantially at the center of the display unit 12.

  The display unit 12 has a thin box-shaped housing, and the display unit 12 is rotatably attached to the computer main body 11 via a hinge portion 14. The hinge portion 14 is a connecting portion that connects the display unit 12 to the computer main body 11. That is, the lower end portion of the display unit 12 is supported by the hinge portion 14 at the rear end portion of the computer main body 11. The display unit 12 is attached to the computer main body 11 so as to be rotatable between an open position where the upper surface of the computer main body 11 is exposed and a closed position where the upper surface of the computer main body 11 is covered by the display unit 12. A power button 16 for powering on or off the computer 10 is provided at a predetermined position on the upper surface of the display unit 12, for example, on the right side of the LCD 13.

  The computer main body 11 is a base unit having a thin box-shaped housing, and a liquid crystal display device (LCD) 15 that functions as a touch screen display is incorporated on the upper surface thereof. The display screen of the LCD 15 is the display screen of the computer main body 11. It is located at the center. A transparent touch panel is disposed on the upper surface of the LCD 15, and a touch screen display is realized by the LCD 15 and the transparent touch panel. This touch screen display can detect a touch position on a display screen touched by a pen or a finger. The LCD 15 on the computer main body 11 is a display independent of the LCD 13 of the display unit 12. These LCDs 13 and 15 can be used as a multi-display for realizing a virtual screen environment. In this case, the virtual screen managed by the operating system of the computer 10 includes a first screen area displayed on the LCD 13 and a second screen area displayed on the LCD 15. Arbitrary application windows, arbitrary objects, etc. can be displayed in each of the first screen area and the second screen area.

  In the present embodiment, the LCD 15 (touch screen display) provided on the upper surface of the main body 11 may be used for presenting a virtual keyboard (also referred to as a software keyboard) 151 as shown in FIG. . For example, the virtual keyboard 151 may be displayed in the full screen mode on the entire display screen of the LCD 15. The virtual keyboard 151 includes a plurality of virtual keys (a plurality of numeric keys, a plurality of alphabet keys, a plurality of arrow keys, a plurality of auxiliary keys, a plurality of function keys, etc.) for inputting a plurality of key codes (code data). )including. More specifically, the virtual keyboard 151 includes a plurality of buttons (software buttons) corresponding to the plurality of virtual keys.

  On the other hand, the LCD 13 in the display unit 12 can be used as a main display for displaying various application windows and the like as shown in FIG. The user inputs various code data (key code, character code, command, etc.) to the application window or the like displayed on the LCD 13 by touching the virtual keyboard 151 displayed on the touch screen display 15. I can do it. The LCD 13 may also be realized as a touch screen display.

  Two button switches 17 and 18 are provided at predetermined positions on the upper surface of the computer main body 11, for example, on both sides of the LCD 15. An arbitrary function can be assigned to each of these button switches 17 and 18. For example, the button switch 17 can be used as a button switch for starting a key input program that is an application program for controlling a key input operation using the virtual keyboard 151. When the button switch 17 is pressed by the user, a key input program is activated. The key input program displays the virtual keyboard 151 on the touch screen display 15.

  In the present embodiment, the LCD 15 (touch screen display) provided on the upper surface of the main body 11 can also be used as a touch pad that is a relative pointing device for moving the cursor on the screen of the LCD 13. For example, an input control program for inputting data using a touch screen display is preinstalled in the computer 10 of the present embodiment. This input control program can emulate the operation of the touch pad using the touch position detection function of the touch screen display (touch panel). This input control program has two operation modes of a touch panel mode and a touch pad mode, and operates in one of these two operation modes. In the touch panel mode, the input control program is a data indicating a touch position on the touch screen display in order to activate a function associated with the touched display object (button, icon, virtual key, etc.) on the touch screen display. Is output to an operating system or an application program. The touch position is represented by, for example, absolute coordinates. In the touch pad mode, the input control program moves the cursor on the screen of the display (LCD 13 or LCD 15), and moves the cursor according to the movement of the touch position on the touch screen display. Coordinate values, that is, data indicating the moving direction and moving amount of the touch position are calculated, and the calculated data is output to an operating system or an application program. As described above, in the touch pad mode, data indicating the moving direction and moving amount of the touch position is output instead of the data indicating the touch position on the touch screen display.

  The input control program also has a function of detecting the number of touch positions on the touch screen display, for example, in order to seamlessly switch the operation mode between the touch panel mode and the touch pad mode. In this case, on the condition that a plurality of positions on the touch screen display are touched, the operation mode of the input control program may be automatically switched from the touch panel mode to the touch pad mode. Further, the operation mode of the input control program may be automatically switched from the touch panel mode to the touch pad mode on condition that a plurality of adjacent positions on the touch screen display are touched. For example, the user may touch two display objects such as two virtual keys on the virtual keyboard 151 at the same time. Therefore, the method of switching the operation mode of the input control program to the touch pad mode on condition that a plurality of adjacent positions on the touch screen display are touched may cause the operation mode to be erroneously switched to the touch pad mode. Can be reduced.

  While the user touches the touch screen display with one finger, the input control program operates in the touch panel mode. When the user touches two adjacent positions on the touch screen display with two fingers, the operation mode of the input control program is switched from the touch panel mode to the touch pad mode.

  In addition, the input control program operates in the touch pad mode while a plurality of adjacent touch positions are moving as in the case where the user traces on the touch screen display with two fingers. During the period, the input control program may operate in the touch panel mode.

  FIG. 3 shows examples of usage patterns in the touch pad mode and the touch panel mode. The left part of FIG. 3 is an example of a usage pattern in the touchpad mode. The input control program detects the movement of the touch position on the LCD 15 (touch screen display), and based on the detection result, the relative coordinate value for designating the movement destination position of the cursor, that is, the movement direction and movement of the touch position. Data indicating the amount is output to an operating system or an application program. Therefore, in the touch pad mode, the user can move a cursor (mouse cursor) on the screen of the LCD 13 by tracing the LCD 15 (touch screen display) with a finger. The cursor may be displayed on the LCD 15 (touch screen display). The cursor may be moved to any position on the virtual screen including the LCD 13 and the LCD 15.

  The right part of FIG. 3 is an example of the usage pattern in the touch panel mode. Here, it is assumed that the virtual keyboards 151A and 151B displayed on the LCD 15 (touch screen display) are touch-operated. The virtual keyboard 151A is a part of the virtual keyboard described above, and the virtual keyboard 151B is a remaining part of the virtual keyboard described above. The input control program outputs an absolute coordinate value indicating a position (touch position) on the LCD 15 (touch screen display) touched by the user to the key input program. The key input program selects a virtual key located at a touch position indicated by absolute coordinates from a plurality of virtual keys, and outputs a key code associated with the selected virtual key. Thereby, for example, a character string “ABC” or the like is displayed on the screen of the LCD 13.

  Note that the operation mode of the input control program may be changed from the touch panel mode to the touch pad mode without changing the screen image on the LCD 15 (touch screen display) in the touch panel mode.

  FIG. 4 shows an example of an operation executed when the screen of the LCD 15 (touch screen display) is traced with two fingers while the user is inputting characters using the virtual keyboards 151A and 151B. ing. When the screen of the LCD 15 (touch screen display) is touched with two fingers, the input control program shifts to the touch pad mode while maintaining the current screen image. Then, instead of the absolute coordinate value indicating the touch position, the input control program stores data indicating the moving direction and moving amount of the touch position according to the movement of two fingers on the screen of the LCD 15 (touch screen display). Output. In this case, even if any of the fingertips is positioned on a display object (here, a virtual key) of the LCD 15 (touch screen display), the function associated with the display object is not executed.

  When the touch state of the touch screen display is released, that is, when two fingers are released from the screen of the LCD 15 (touch screen display), the operation mode of the input control program returns from the touch pad mode to the touch panel mode. The user can input characters by touching the virtual keyboards 151A and 151B.

  In this way, the input control program may operate in the touch pad mode only when a plurality of positions on the touch screen display are touched and the plurality of touch positions are moved. As a result, the touch panel mode and the touch pad mode can be switched seamlessly without the user performing a dedicated operation for mode switching. As described above, the operation mode of the input control program may be switched to the touch pad mode only on the condition that a plurality of positions on the touch screen display are touched. In this case, after the operation mode of the input control program is switched to the touch pad mode, the user can move the position of the cursor by, for example, tracing the screen of the touch screen display with one finger.

  Next, an operation for detecting a plurality of touch positions will be described with reference to FIG. FIG. 5 shows the relationship between the touch position on the screen of the touch screen display and the touch intensity. The horizontal axis (x axis) in FIG. 5 indicates the horizontal position on the screen of the touch screen display, and the vertical axis (y axis) in FIG. 5 indicates the vertical position on the screen of the touch screen display. In FIG. 5, a black part represents a part detected as being touched more strongly, a dark gray part represents a part with a medium touch intensity, and a light gray part represents a part with a low touch intensity. Represents. When the touch screen display is touched with two fingers, touch intensity peaks appear at two locations P1 and P2 (black portions) as shown in FIG. The input control program detects these two places P1 and P2 as touch positions, respectively.

  Next, the system configuration of the computer 10 will be described with reference to FIG. Here, it is assumed that both LCDs 13 and 15 are realized as touch screen displays.

  The computer 10 includes a CPU 111, a north bridge 112, a main memory 113, a graphics controller 114, a south bridge 115, a BIOS-ROM 116, a hard disk drive (HDD) 117, an embedded controller 118, and the like.

  The CPU 111 is a processor provided to control the operation of the computer 10 and executes an operating system (OS), various application programs, and the like loaded from the HDD 117 to the main memory 113. The application program includes an input control program 201. As described above, the input control program 201 uses the touch position detection function of the touch screen display (touch panel) to emulate the operation of the touch pad. The CPU 111 also executes a system BIOS (Basic Input Output System) stored in the BIOS-ROM 116. The system BIOS is a program for hardware control.

  The north bridge 112 is a bridge device that connects the local bus of the CPU 111 and the south bridge 115. The north bridge 112 also includes a memory controller that controls access to the main memory 115. The graphics controller 114 is a display controller that controls the two LCDs 13 and 15 respectively used as a display monitor of the computer 10. The graphics controller 114 executes display processing (graphics calculation processing) for drawing display data in a video memory (VRAM) based on a drawing request received from the CPU 111 via the north bridge 112. A storage area for storing display data corresponding to the screen image displayed on the LCD 13 and a storage area for storing display data corresponding to the screen image displayed on the LCD 15 are allocated to the video memory. A transparent touch panel 13 </ b> A is disposed on the LCD 13. Similarly, a transparent touch panel 15 </ b> A is disposed on the LCD 15. Each of the touch panels 13A and 15A is configured to detect a touch position on the touch panel (touch screen display) using, for example, a resistance film method or a capacitance method. Further, as each of the touch panels 13A and 15A, a multi-touch panel capable of simultaneously detecting a plurality of touch positions may be used.

  The south bridge 115 incorporates an IDE (Integrated Drive Electronics) controller and a Serial ATA controller for controlling the HDD 121. The embedded controller (EC) 118 has a function of powering on / off the computer 10 in accordance with the operation of the power button switch 16 by the user.

Next, the configuration of the input control program 201 will be described with reference to FIG.
The input control program 201 includes a touch position number detection unit 211, a positional relationship detection unit 212, a control unit 213, and an output unit 214. The touch position number detection unit 211 detects the number of touch positions on the touch screen display. When the touch position number detection unit 211 detects that a plurality of positions on the touch screen display are touched, the positional relationship detection unit 212 detects the positional relationship between the touch positions, and the touch positions are adjacent to each other. It is determined whether or not. The control unit 213 controls the operation of the output unit 214 based on the detection results of the touch position number detection unit 211 and the positional relationship detection unit 212.

  The output unit 214 outputs data (absolute coordinate values) indicating a touch position on the touch screen display in order to activate a function associated with the touched display object on the touch screen display. Further, the output unit 214 switches to the tablet mode when the control unit 213 instructs to shift to the tablet mode, in other words, for example, when a plurality of adjacent positions on the touch screen display are touched. Transition. In the tablet mode, the output unit 214 outputs data indicating the moving direction and moving amount of the touch position instead of the data indicating the touch position on the touch screen display in order to move the cursor on the screen of the display.

  The output unit 214 includes an absolute coordinate output unit 214A and a relative coordinate output unit 215B. The absolute coordinate output unit 214A is configured to operate in a touch panel mode, and outputs data (absolute coordinate values) indicating a touch position on the touch screen display to an operating system or an application program. On the other hand, the relative coordinate output unit 215B is configured to operate in the touch pad mode, and outputs data indicating the moving direction and moving amount of the touch position on the touch screen display to an operating system or an application program.

  Next, the procedure of input processing executed by the input control program 201 will be described with reference to the flowchart of FIG.

  The input control program 201 receives the touch position detection information from the touch panel 15A, and determines whether or not the touch screen display is touched based on the touch position detection information. If the screen on the touch screen display is touched (YES in step S11), the input control program 201 determines whether or not a plurality of positions (for example, two positions) on the screen of the touch screen display are touched. (Step S12). If a plurality of positions on the screen of the touch screen display are touched (YES in step S12), the input control program 201 determines whether the touched positions are adjacent to each other, for example, touched 2 It is determined whether or not the distance between the two positions is shorter than the threshold distance (step S13).

  When a plurality of positions are not touched (NO in step S12), or when a plurality of touched positions are not adjacent (NO in step S13), the input control program 201 operates in the touch panel mode, and the touch position Are output to the operating system, application program, or the like.

  If the plurality of touched positions are adjacent to each other (YES in step S13), the input control program 201 starts an operation in the touch pad mode (step S15). Then, the input control program 201 detects the movement of the touch position on the screen of the touch screen display, and in accordance with the detection result, instead of the first data described above, the second indicating the movement direction and the movement amount of the touch position. Is output to the operating system or application program (step S15).

  If the non-touch state of the touch screen display continues for longer than the threshold time (YES in step S16), the input control program 201 once exits the touch pad mode. Then, the input control program 201 returns to step S11.

  As described above, according to the present embodiment, normally, data indicating the touch position on the touch screen display is output, but when it is detected that a plurality of positions on the touch screen display are touched. In order to move the cursor on the screen of the display, the second data indicating the moving direction and the moving amount of the touch position on the touch screen display is used instead of the first data indicating the touch position on the touch screen display. Data is output. For this reason, a cursor can be easily moved using a touch screen display without providing a dedicated touch pad. In addition, since the user can use the touch screen display as a touch pad simply by touching the touch screen display with a plurality of fingers, for example, the user can seamlessly touch the touch screen without performing a dedicated operation for mode switching. Mode and touchpad mode can be switched.

  Although the computer 10 of the present embodiment includes the main body 11 and the display unit 12, almost all of the components constituting the system of the computer 10 are not necessarily provided in the main body 11. For example, one of the components A part or almost all may be provided in the display unit 12. In this sense, it can be said that the main body 11 and the display unit 12 are substantially equivalent units. Therefore, the main body 11 can also be considered as a display unit, and the display unit 12 can also be considered as a main body.

  In addition to the touch screen display, the computer 10 of this embodiment includes a display (LCD 13). However, the computer 10 may include only a touch screen display and no display (LCD 13).

  Further, since the key input function of the present embodiment is realized by a computer program, the computer program is simply installed on a computer having a touch screen display and executed through a computer-readable storage medium storing the computer program. Thus, the same effect as in the present embodiment can be easily obtained.

  Further, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine a component suitably in different embodiment.

  DESCRIPTION OF SYMBOLS 10 ... Computer, 11 ... Main body, 12 ... Display unit, 13, 15 ... LCD, 13A, 15A ... Touch panel, 111 ... CPU, 201 ... Input control program, 211 ... Touch position number detection part, 212 ... Position relation detection part, 213: Control unit, 214: Output unit.

Claims (8)

Display,
Touch screen display,
Detecting means for detecting a touch position on the touch screen display;
Output means for outputting first data indicating the touch position on the touch screen display;
Output means for displaying a virtual keyboard on the screen of the touch screen display and outputting first data indicating the touch position on the touch screen display in order to input code data of a virtual key corresponding to the touch position And
The output means temporarily operates in a touch pad mode while two adjacent touch positions corresponding to two fingers are moving on the screen of the touch screen display on which the virtual keyboard is displayed. In the touch pad mode, in order to move the cursor on the screen of the display with the virtual keyboard displayed , the two data on the screen of the touch screen display are used instead of the first data . An information processing apparatus that outputs second data corresponding to a movement direction and a movement amount of the two fingers in accordance with the movement of the finger .   The information processing apparatus according to claim 1, wherein the first data is an absolute coordinate value indicating the touch position on the touch screen display. The information processing apparatus according to claim 1, wherein the second data is a relative coordinate value of a movement destination position of the cursor. An input method applied to an information processing apparatus including a display and a touch screen display,
Detecting a touch position on the touch screen display;
Displaying a virtual keyboard on the screen of the touch screen display, and outputting first data indicating the touch position on the touch screen display to input code data of a virtual key corresponding to the touch position;
The touch pad mode temporarily operates while two adjacent touch positions corresponding to two fingers are moving on the touch screen display on which the virtual keyboard is displayed, and the touch pad mode In response to the movement of the two fingers on the screen of the touch screen display instead of the first data in order to move the cursor on the screen of the display with the virtual keyboard displayed. An input method for outputting second data corresponding to the moving direction and moving amount of the two fingers . In a computer with a display and a touch screen display,
Detecting a touch position on the touch screen display;
Displaying a virtual keyboard on the screen of the touch screen display and outputting first data indicating the touch position on the touch screen display in order to input code data of a virtual key corresponding to the touch position; ,
The touch pad mode temporarily operates while two adjacent touch positions corresponding to two fingers are moving on the touch screen display on which the virtual keyboard is displayed, and the touch pad mode In response to the movement of the two fingers on the screen of the touch screen display instead of the first data in order to move the cursor on the screen of the display with the virtual keyboard displayed. And a procedure for outputting second data corresponding to the movement direction and movement amount of the two fingers . Touch screen display,
Detecting means for detecting a touch position on the touch screen display;
An output means for displaying a virtual keyboard on the touch screen display and outputting first data indicating the touch position on the touch screen display for inputting code data of a virtual key corresponding to the touch position; Equipped,
The output means temporarily operates in a touch pad mode while two adjacent touch positions corresponding to two fingers are moving on the screen of the touch screen display on which the virtual keyboard is displayed. In the touch pad mode, in order to move the cursor on the screen of the touch screen display while the virtual keyboard is displayed , the second data on the screen of the touch screen display is used instead of the first data. An information processing apparatus that outputs second data corresponding to a movement direction and a movement amount of the two fingers in accordance with the movement of the two fingers . An input method applied to an information processing apparatus including a touch screen display,
Detecting a touch position on the touch screen display;
Displaying a virtual keyboard on the touch screen display and outputting first data indicating the touch position on the touch screen display for inputting code data of a virtual key corresponding to the touch position;
The touch pad mode temporarily operates while two adjacent touch positions corresponding to two fingers are moving on the touch screen display on which the virtual keyboard is displayed, and the touch pad mode Moving the two fingers on the screen of the touch screen display instead of the first data to move the cursor on the screen of the touch screen display with the virtual keyboard displayed An input method of outputting second data corresponding to the moving direction and the moving amount of the two fingers according to . For computers with touch screen displays,
Detecting a touch position on the touch screen display;
Displaying a virtual keyboard on the touch screen display and outputting first data indicating the touch position on the touch screen display to input code data of a virtual key corresponding to the touch position;
The touch pad mode temporarily operates while two adjacent touch positions corresponding to two fingers are moving on the touch screen display on which the virtual keyboard is displayed, and the touch pad mode Moving the two fingers on the screen of the touch screen display instead of the first data to move the cursor on the screen of the touch screen display with the virtual keyboard displayed A program for causing the computer to execute a procedure for outputting second data corresponding to the moving direction and the moving amount of the two fingers according to .

Images