WO2013176230A1

WO2013176230A1 - Touch panel input device

Info

Publication number: WO2013176230A1
Application number: PCT/JP2013/064402
Authority: WO
Inventors: 安島　弘美; 松村　隆司
Original assignee: 京セラ株式会社
Priority date: 2012-05-24
Filing date: 2013-05-23
Publication date: 2013-11-28
Also published as: JP5951012B2; JPWO2013176230A1

Abstract

This touch panel input device is provided with a touch panel for displaying a keyboard and performing input, and a display controller for displaying the keys on the touch panel. The display controller displays a confirmation keyboard, which is separate from the input keyboard, and displays in a highlighted manner the position on the confirmation keyboard corresponding to the position of an object above the input keyboard.

Description

Touch panel type input device

The present invention relates to a touch panel type input device that performs input by displaying a keyboard or a numeric keypad on a touch panel.

Conventionally, touch-panel input devices such as mobile phones, smartphones, PDAs (Personal Digital Assistants), and ATMs (Automated Teller Machines) have been provided. The touch panel is a touch panel in which a resistive film type or a capacitance type touch sensor is superimposed on a display panel such as liquid crystal or organic EL (Electro Luminescence). As a general example, when a virtual button or key is displayed on the display panel and it is detected that the position is touched (tapped) by the contact sensor, the button or key is operated as if it was pressed. The term touch panel originally means only a contact sensor (pointing device), but here, the display panel and the contact sensor are collectively referred to as a touch panel.

In recent years, there has been a tendency for the display area to increase with the main purpose of widening application screens for web browsers and games, and a touch panel is often laid out on almost the entire surface of the housing. However, even if the touch panel is enlarged, it is about 3 to 4 inches diagonal in a portable terminal such as a mobile phone, and about 7 to 10 inches diagonal in a tablet type terminal. Further, due to the effect of higher resolution, there is a problem that keys and buttons displayed on the touch panel become smaller, making it difficult to press the keys. This problem is particularly noticeable when a full keyboard is displayed on the touch panel.

“It is generally recognized that when a key becomes small, it becomes difficult to press the key because the finger touches not only the key to be pressed but also the adjacent key. For this reason, in an example of a device driver for a touch panel, a process is performed in which an average center of a region where contact is detected is recognized as a touched coordinate. However, with this alone, a small and dense keyboard still frequently mistypes. Further examination of this point reveals that when the finger is brought closer, the key to be pressed and the adjacent key are both hidden behind the finger and cannot be seen, so the area around the key to be pressed cannot be touched. Can be mentioned.

Japanese Patent Laid-Open No. 02-153415 proposes a keyboard device that enlarges a key on the screen when a finger is brought close to it. Specifically, it is described that a key display control unit, a touch sensor unit, and a finger sensor unit that detects the position of a finger when the finger approaches the key display control unit are displayed to enlarge and display a key close to the finger position. Yes. Thereby, the keyboard device can be reduced in size without reducing the operability and without reducing the number of keys. The improvement in convenience by this configuration is thought to be due to the fact that the area of the key to be pressed increases and the adjacent key is not hidden by the finger.

However, according to the configuration of Japanese Patent Laid-Open No. 02-153415, the key that is about to be pressed is still hidden by the finger. Therefore, although it is considered that a mistake in pressing is less likely to occur, there is a problem that it is difficult to obtain a certainty as to whether or not the user can confirm the input (whether or not to release the finger). For this reason, there is a problem in that it is difficult for an unfamiliar user to input without hesitation and it is difficult to perform reliable and high-speed continuous input.

Therefore, the present invention has an object of enabling easy and reliable continuous high-speed input by making it possible to visually recognize a key to be operated in a touch panel type input device that performs input by displaying a keyboard or a numeric keypad on a touch panel. Yes.

From the above viewpoint, the touch panel type input device according to the present invention includes a touch panel that displays a keyboard and performs input, and a display control unit that displays keys on the touch panel, and the display control unit includes an input keyboard. A confirmation keyboard separate from the input keyboard is displayed, and the position on the confirmation keyboard corresponding to the position of the object above the input keyboard is highlighted.

The touch panel type input device includes a three-dimensional sensor that detects a position of an object that comes in contact with the touch panel and a distance from the touch panel, and the display control unit detects an object that the three-dimensional sensor approaches. Sometimes, the confirmation keyboard may be displayed and the position on the confirmation keyboard may be highlighted.

In the touch panel type input device, the display control unit may display a confirmation keyboard that is the same size as the input keyboard and highlight the position on the confirmation keyboard.

The display control unit displays a confirmation keyboard enlarged from the input keyboard, fixes a highlighted position at a predetermined position on the touch panel, and corresponds to the position of an object above the input keyboard. The display position of the confirmation keyboard may be adjusted so that the position on the confirmation keyboard is highlighted.

In the touch panel type input device, the display control unit may display a mark at the position on the confirmation keyboard corresponding to the position of the object above the input keyboard.

In the touch panel type input device, the display control unit may display at least two adjacent keys on the input keyboard on the confirmation keyboard.

In the touch panel type input device, the display control unit may display on the confirmation keyboard before the object contacts the touch panel.

ADVANTAGE OF THE INVENTION According to this invention, in the touchscreen type input device which displays by inputting a keyboard or a numeric keypad on a touchscreen, it can operate while visually recognizing a key, and it enables easy and reliable continuous high-speed input. it can.

FIG. 1A is a diagram illustrating a configuration of a mobile terminal as an example of a touch panel type input device, and FIG. 1B is a diagram illustrating a three-dimensional sensor. FIGS. 2A and 2B show examples of screens when a confirmation keyboard and marks are displayed. 3A and 3B show examples of screens when a confirmation keyboard and marks are displayed.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The dimensions, materials, and other specific numerical values shown in the embodiments are merely examples for facilitating understanding of the invention, and do not limit the present invention unless otherwise specified. In the present specification and drawings, elements having substantially the same function and configuration are denoted by the same reference numerals, and redundant description is omitted, and elements not directly related to the present invention are not illustrated. To do.

FIG. 1 is a diagram illustrating a configuration of a mobile terminal as an example of a touch panel type input device according to the present embodiment. FIG. 1A is a diagram illustrating a configuration of a mobile terminal, and FIG. 1B is a diagram illustrating a three-dimensional sensor. The touch panel type input device can be applied to any touch panel type input device such as a smartphone, a PHS (Personal Handy-phone System), a PDA, and an ATM in addition to the mobile terminal.

1A is provided with a touch panel 110 that occupies most of its area on the front surface. The touch panel 110 is formed by superposing a resistive film type or capacitive type contact sensor on a display panel such as a liquid crystal or an organic EL. On the touch panel 110, a text input unit 112 (application operation screen) and an input keyboard 114 (front-end processor operation screen) are displayed. The user can change the position of the caret by touching the text input unit 112 or input by touching the input keyboard 114. Instead of the input keyboard 114, a numeric keypad, a command key, a character string with a link, or the like may be displayed.

The front-end processor 120 (displayed as FEP in the figure) is a program that performs preprocessing for character input to an arbitrary application 130, and accepts an input operation from the user, and is a character string that is fixed for the application 130 It has a function to send out. The front end processor 120 includes a display control unit 122, a contact detection unit 124, and an input determination unit 126.

The display control unit 122 displays an alphanumeric full keyboard or an input keyboard 114 such as a numeric keypad on the touch panel 110. When the user's finger 190 (see FIG. 1B) contacts, the touch panel 110 sends the coordinates of the contacted area to the contact detection unit 124. The contact detection unit 124 calculates, for example, the coordinates of the center of the area from the area received from the touch panel 110, and detects the position where the finger 190 is in contact. The input determination unit 126 compares the displayed position of the input keyboard 114 with the touched position to determine the input key.

The three-

dimensional sensors

140 and 142 detect the position of the finger 190 that touches the touch panel 110 and the distance from the touch panel 110. As the three-

dimensional sensors

140 and 142, for example, two imaging devices can be used. In the example shown in FIG. 1A and FIG. 1B, a pair of imaging devices are arranged facing each other on the upper end and the lower end of the touch panel 110. When the finger 190 approaches, the contour of the finger is extracted based on a known object detection algorithm. The horizontal position of the finger 190 with respect to the touch panel 110 and the distance of the finger 190 from the touch panel 110 can be obtained from the contour of one imaging device. The position of the finger 190 in the vertical direction with respect to the touch panel 110 can be obtained from the difference (ratio) between the sizes of the fingers in the two imaging devices. Note that the three-dimensional sensor is not limited to one using two image sensors, and any sensor that can detect an object in a non-contact state may be used.

Here, as a feature of the present embodiment, the display control unit 122 displays a confirmation keyboard separately from the input keyboard 114 described above, and overlaps the confirmation keyboard to correspond to the position of the finger on the input keyboard 114. A mark is displayed at the position. In particular, since the mobile terminal 100 according to the present embodiment includes the three-

dimensional sensors

140 and 142, the display control unit 122 displays a confirmation keyboard and mark when the three-

dimensional sensors

140 and 142 detect the approach of a finger. .

2 and 3 show examples of screens when the confirmation keyboard and mark are displayed. As described above, when the finger 190 is not approaching, the text input unit 112 and the input keyboard 114 are displayed on the touch panel 110 (see FIG. 1A). When the approach of the finger 190 is detected by the three-

dimensional sensors

140 and 142, as shown in FIGS. 2 and 3, a confirmation keyboard 116 a or a confirmation keyboard different from the input keyboard 114 on the touch panel 110. 116b is displayed.

FIG. 2 illustrates the input keyboard 114 and the same confirmation keyboard 116a. When the approach of the finger 190 is detected by the three-

dimensional sensors

140 and 142 as described above, the display control unit 122 displays the confirmation keyboard 116a that is the same size as the input keyboard 114 as shown in FIG. . At this time, the finger 190 is positioned in the vicinity of the “J” key on the input keyboard 114. Therefore, the display control unit 122 displays the mark 118 in an overlapping manner on the confirmation keyboard 116a at a position corresponding to the position (the position of the “J” key).

When the user moves his / her finger from the position shown in FIG. 2A, for example, when the finger 190 is moved to the key position “T”, as shown in FIG. The mark 118 is moved in conjunction with the movement of the user's finger 190, and the mark 118 is displayed superimposed on the position of the “T” key on the confirmation keyboard 116a. That is, the mark 118 is a pointer and indicates where the finger 190 is located on the input keyboard 114. Thus, the user can operate while suitably viewing the area hidden by the finger on the input keyboard 114, and which character is input when touching (contacting) at the position where his / her finger 190 is currently located. It is possible to determine at a glance whether or not it is performed.

On the other hand, FIG. 3 illustrates a confirmation keyboard 116b enlarged from the input keyboard 114. As described above, when the approach of the finger 190 is detected by the three-

dimensional sensors

140 and 142, the display control unit 122 displays the confirmation keyboard 116b enlarged from the input keyboard 114 as shown in FIG. Also good. At this time, a mark 118 is arranged near the center of the confirmation keyboard 116b. Further, the enlarged confirmation keyboard 116b may display at least two adjacent keys among the keys on the input keyboard.

Here, since the confirmation keyboard 116a shown in FIG. 2A is the same size as the input keyboard 114, the mark 118 is positioned at the same position as the finger 190 on the input keyboard 114 on the confirmation keyboard 116a. Be placed. On the other hand, in the confirmation keyboard 116b of FIG. 3A, the position of the mark 118 is fixed near the center (predetermined position) of the confirmation keyboard 116b. Then, a key displayed within a predetermined range around the finger 190 when the position where the finger 190 is located in the input keyboard 114 is centered, and the position of the finger 190 and the position of the mark 118 are associated with each other. Use to zoom in. That is, the confirmation keyboard 116b shown in FIG. 3A has a key within a predetermined range centered on a position where the finger 190 is located, and a key where the finger 190 is located below the mark 118 on the input keyboard 114. It is a keyboard that is enlarged and displayed like a circle.

When the user moves his / her finger from the position shown in FIG. 3A, for example, when the finger 190 is moved to the position of the key “C”, as shown in FIG. The display range of the confirmation keyboard 116b is moved in conjunction with the movement of the user's finger 190 so that the "C" key of the confirmation keyboard 116b and the position of the mark 118 overlap (the position of the confirmation keyboard 116b is adjusted). ). Even with such a configuration, since the user can visually recognize the key hidden by his / her finger 190, the user can accurately input characters and prevent erroneous input.

In this embodiment, the case where the position (predetermined position) where the mark 118 is fixed is set to the vicinity of the center of the confirmation keyboard 116b is exemplified, but fixing the mark 118 to another position is not excluded. Further, the enlargement range (enlargement magnification) of the input keyboard 114, that is, the enlargement display area of the confirmation keyboard 116b is not limited to this, and can be set as appropriate. Further, the enlargement range (enlargement magnification) of the input keyboard does not necessarily need to be fixed uniformly, and the enlargement range is changed according to the position of the finger 190 detected by the three-

dimensional sensors

140 and 142 and the distance from the touch panel 110. Alternatively, the enlargement rate may be different for each type of keyboard or application.

The display control unit 122 is not limited to highlighting with the mark 118, but highlights the key at the position corresponding to the position of the finger on the input keyboard 114 by reverse display, bordering, highlighting, enlargement, or the like. Also good. Also by this, it is possible to obtain the same effect as described above.

Further, the display control unit 122 sets a predetermined threshold for the position of the finger 190 detected by the three-

dimensional sensors

140 and 142 and the distance of the finger 190 from the touch panel 110, and the

confirmation keyboard

116a, 116b and mark 118 may be displayed. As a result, it is possible to prevent the

confirmation keyboards

116a and 116b from being displayed carelessly and to prevent the user from feeling unstable.

In this embodiment, two imaging devices are exemplified as the three-

dimensional sensors

140 and 142. However, the present invention is not limited to this, and in addition to using an imaging device, an ultrasonic sensor, a microwave sensor, or the like can be used. You may implement | achieve by the object detection using reflection. Alternatively, the three-

dimensional sensors

140 and 142 may not be provided, and the

confirmation keyboards

116a and 116b and the mark 118 may be displayed when the touch (touch) of the finger 190 with the touch panel 110 is detected.

The preferred embodiments of the present invention have been described above with reference to the accompanying drawings, but it goes without saying that the present invention is not limited to such examples. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present invention. Understood.

Although the present invention has been described in detail and with reference to specific embodiments, it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the invention.
This application is based on Japanese Patent Application No. 2012-118684 filed on May 24, 2012, the contents of which are incorporated herein by reference.

The present invention can be used as a touch panel type input device that performs input by displaying a keyboard or a numeric keypad on a touch panel.

DESCRIPTION OF SYMBOLS 100 ... Portable terminal, 110 ... Touch panel, 112 ... Text input part, 114 ... Input keyboard, 116a ... Confirmation keyboard, 116b ... Confirmation keyboard, 118 ... Mark, 120 ... Front end processor, 122 ... Display control part, 124 ... Contact detection unit, 126 ... Input determination unit, 130 ... Application, 140 ... 3D sensor, 142 ... 3D sensor, 190 ... Finger

Claims

A touch panel that displays a keyboard and performs input; and a display control unit that displays keys on the touch panel; and the display control unit displays a confirmation keyboard that is separate from the input keyboard. A touch panel type input device that highlights a position on the confirmation keyboard corresponding to the position of an upper object.
A three-dimensional sensor that detects a position of an object that is separated from or touching the touch panel and a distance from the touch panel; and the display control unit detects the confirmation keyboard when the three-dimensional sensor detects an approaching object. The touch panel type input device according to claim 1, wherein the touch panel type input device displays and highlights the position on the confirmation keyboard.
The touch panel type input device according to claim 1, wherein the display control unit displays a confirmation keyboard of the same size as the input keyboard and highlights the position on the confirmation keyboard.
The display control unit displays a confirmation keyboard enlarged from the input keyboard, fixes a highlighted position at a predetermined position on the touch panel, and corresponds to the position of an object above the input keyboard. The touch panel type input device according to claim 1, wherein the display position of the confirmation keyboard is adjusted so that the position on the confirmation keyboard is highlighted.
The touch panel type input device according to claim 1, wherein the display control unit displays a mark at the position on the confirmation keyboard corresponding to the position of the object above the input keyboard.
The touch panel type input device according to claim 1, wherein the display control unit displays at least two adjacent keys on the input keyboard on the confirmation keyboard.
The touch panel type input device according to claim 1, wherein the display control unit displays the object on the confirmation keyboard before the object contacts the touch panel.