JP2006085218A - Touch panel operating device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a touch panel operating device for varying a display size of an operation image displayed on a display screen in response to an operation means to contact with the display screen. <P>SOLUTION: A control means 8 of a touch panel operating device 1 detects the operation image displayed at a display position on the display screen corresponding to a position of the tip of the operating means when a distance of the tip thereof detected by a distance detection means 7 is within a predetermined distance from the display screen, compares a display range of the detected operation image and a contact range stored in a contact range storage means 4, and controls an image processing means 3 so as to perform the magnified display of the operation image displayed on the display screen when the contact range is larger than the display range. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a touch panel operation device capable of changing a display size of an operation image displayed on a display in accordance with an operation unit.

  In recent electronic devices such as a car navigation system and a PDA, an operation button, an icon, etc. (operation image) displayed on a display unit such as a display can be displayed by an operator with a finger or a stylus pen (operation means). Many touch panel operation devices capable of performing an operation process by touching (contacting) are employed.

  In a touch panel operation device, when an operator touches a display screen to operate an electronic device, if many operation buttons are displayed on the display, the display area (touchable area) of the operation buttons is reduced. As a result, another operation button in the vicinity of the desired operation button may be pressed, leading to an erroneous operation.

For this reason, in today's touch panel operation devices, the detection means detects the distance between the operator's finger, stylus pen, etc. and the display screen, and if the finger etc. is close to the display screen by a predetermined distance or more, the position of the finger etc. Have been proposed (see, for example, Patent Document 1 and Patent Document 2).
Japanese Patent Laid-Open No. 10-269022 Japanese Patent Laid-Open No. 11-65769

  However, the operation buttons displayed on the display screen are not all displayed in the same size for a plurality of operation screens, but the size displayed for each operation screen or for each role of the operation button. Since they are different, there is a risk that the operability may be reduced when the display on the display is enlarged uniformly.

  Moreover, since the area of the part which contacts a display differs in the case where the thing which touches a display is an operator's finger, for example, and the case where it is a stylus pen, in the case of a stylus pen, it does not need to expand. Although the operation button can be pressed without any erroneous operation, there has been a problem that when the finger is used, an erroneous operation may be caused unless it is enlarged.

  The present invention has been made in view of the above problems, and provides a touch panel operation device capable of changing the display size of an operation image displayed on a display screen in accordance with an operation unit that touches the display screen. The issue is to provide.

  In order to solve the above problems, a touch panel operation device according to the present invention includes a display unit that displays an operation image on a display screen, an image information storage unit that stores a plurality of operation images to be displayed on the display screen, Image processing means for extracting a specific operation image from a plurality of operation images stored in the image information storage means and creating a display image for display on the display screen; and an operation in contact with the display screen Contact state determination means for determining the presence or absence of means, contact position detection means for detecting a contact position and a contact range on the display screen that the operation means has contacted when the operation means is in contact with the display screen; Contact range storage means for preliminarily storing the contact range of the operation means detected by the contact position detection means, and the operation image at the tip of the operation means located in front of the display screen A distance detection unit that detects a distance and a position from the display unit, and a distance of the tip of the operation unit detected by the distance detection unit is within a predetermined distance from the display screen, the position of the tip of the operation unit The operation image displayed at the display position on the display screen corresponding to is detected, the display range of the detected operation image is compared with the contact range stored in the contact range storage means, When the contact range is larger than the display range, the image processing unit includes control means for controlling the image processing means so as to enlarge and display the operation image displayed on the display screen.

  According to the touch panel operation device according to the present invention, the display range of the operation image is compared with the contact range of the operation unit, and the operation image is enlarged only when the contact range is larger than the display range of the operation image. Thus, even if a plurality of operation images are arranged and each operation image is displayed small on the display screen, the operator is less likely to make an erroneous operation. Further, when the display range of the operation image is larger than the contact range of the operation means, the operation image is not displayed in an enlarged manner, and other operation images are hidden by the enlarged operation image. Therefore, it is possible to maintain good operability without impairing the visibility of the operation image.

  Hereinafter, a touch panel operating device according to the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of the touch panel operating device 1. The touch panel operating device 1 includes a display unit (display unit) 2, an image processing unit (image processing unit) 3, a storage unit (image information storage unit, contact range storage unit) 4, and a touch-type input unit (contact state). A determination unit) 5, a touch position detection unit (contact position detection unit) 6, an ultrasonic sensor (distance detection unit) 7, and a CPU (control unit) 8.

  The display unit 2 is controlled by the image processing unit 3, and displays a display image 2b as shown in FIG. 2 on the display screen (display screen) 2a based on the image information received from the image processing unit 3, for example. . The display image 2b displayed on the display screen 2a is composed of a plurality of operation images such as operation buttons and icons 2c required when the operator performs an operation using an operation means such as a finger or a stylus pen. Composed.

  The storage unit 4 stores operation images such as operation buttons and other image data necessary for creating a display image, and the operation buttons and the like are the same image having a different size for each operation button and the like. Specifically, image data of a normal size operation button or the like and an enlarged size operation button or the like are stored. Further, the storage unit 4 can store in advance the contact area (contact range) of the tip of the operation means such as the operator's finger or stylus pen.

  The image processing unit 3 extracts image data such as specific operation buttons and icons from a plurality of operation images stored in the storage unit 4 in accordance with an instruction from the CPU 8, and considers the size and arrangement of the operation buttons. A display image to be displayed on the display screen 2a is created. The image processing unit 3 grasps the arrangement positions of operation buttons, icons, and the like of the created display image.

  When a finger or a stylus pen touches the display screen 2a, the input unit 5 detects the contact position on the display screen 2a as coordinate information and outputs it to the touch position detection unit 6. The input unit 5 may be of a type that is disposed below the display screen 2a and detects a contact position by detecting a change in pressure, and covers the surface of the display screen with a dedicated transparent screen. It may be of a type that detects a contact position by sensing pressure change (pressure sensitive) or sensing an electric signal due to static electricity (electrostatic).

  The touch position detection unit 6 obtains the touched position on the display screen 2a based on the coordinate information received from the input unit 5 when the input unit 5 detects contact with a finger or a stylus pen, The area (contact range) is calculated. The calculated position information and area information are transmitted to the CPU 8.

  As shown in FIG. 3, the ultrasonic sensor 7 has a plurality of ultrasonic emission sources 7a that are arranged in a grid pattern on the back surface of the display screen 2a and emit ultrasonic waves perpendicular to the display screen 2a. An object approaching the display screen 2a is detected by the ultrasonic wave 7b emitted from the ultrasonic wave emission source 7a, and the approach distance is detected. Although only six ultrasonic emission sources 7a are shown in FIG. 3 for the sake of convenience, a large number of ultrasonic waves 7b are actually installed so as to be emitted from the entire surface of the display screen 2a.

  The CPU 8 has a role of performing various controls of the touch panel operating device 1, and includes a distance change of a proximity object detected by the ultrasonic sensor 7, position information and area information detected by the touch position detection unit 6, and image processing. The information about the arrangement position situation of the operation buttons and the like and the allocation processing contents of each operation button and the like in the display image created by the unit 3 is received. The CPU 8 instructs the image processing unit 3 to change the operation buttons and the like displayed on the display unit 2 based on the received various information, and changes the size and the like of the operation buttons and the like displayed on the display unit 2. .

  Below, the process by CPU8 is demonstrated using a flowchart.

  FIG. 4 is a flowchart showing processing at the time of initial setting of the system.

  The initial setting process of the system is a process that is executed when the contact area information of the tip of the operation means is not stored in the storage unit 4 of the touch panel operation device 1 or when the operator changes the contact area information. .

  In the initial setting process of the system, the CPU 8 causes the image processing unit 3 to create an initial setting screen as shown in FIG. 5 and display it on the display unit 2 (step S.1). On the initial setting screen, a contact area 2d for bringing the operator's finger or the tip of an operation means such as a stylus pen into contact is displayed.

  When the operator operates the operation means to bring the tip of the operation means into contact with the contact area 2d of the display screen 2a, the input unit 5 detects the coordinate information of the contact position of the operation means, and the touch position detection unit 6 is specific. The position information and area information are calculated and transmitted to the CPU 8.

  CPU8 memorize | stores the received area information in the memory | storage part 4 as contact area information of the front-end | tip of an operating means, when position information and area information are received from the touch position detection part 6 (in the case of YES of step S.2) ( Step S.3), the system initial setting process is terminated. When the position information and the area information are not received from the touch position detection unit 6 (NO in step S.2), the CPU continues to display the initial setting screen (step S.1).

  Next, processing of the CPU 8 in normal touch panel operation will be described using the flowchart shown in FIG.

  First, the CPU 8 causes the image processing unit 3 to create a display image to be displayed on the display unit 2 and display it on the display screen 2a (step S.10). The display image created first is created using a normal size operation button or the like.

  When the operator brings the operating means closer to the display screen 2a and the distance from the display screen 2a to the tip of the operating means is within a certain distance, the ultrasonic sensor 7 detects the presence of the operating means, and the approach distance Is transmitted to the CPU 8.

  When the approach distance is received from the ultrasonic sensor 7 (in the case of YES at step S.11), the CPU 8 determines whether or not the approach distance received from the ultrasonic sensor 7 is equal to or less than a predetermined threshold value. (Step S.12). This threshold value can be set to a different value depending on the application for which the touch panel operating device 1 is used. If the approach distance is equal to or greater than the threshold (if the distance is greater than the threshold) (NO in step S.12), the CPU 8 continues to display the display image created using the normal size operation button or the like. The image processing unit 3 is controlled so as to be displayed on the unit 2 (step S.13).

  When the approach distance is equal to or smaller than the threshold value (when approaching the threshold value) (in the case of YES at step S.12), the CPU 8 has arranged the positions of the operation means detected by the ultrasonic sensor 7 in a grid pattern. Judgment is made from the installation position of the ultrasonic emission source 7a (installation position information for each sensor number assigned to each emission source 7a) (step S.14). Then, the CPU 8 calculates the position on the display screen 2a corresponding to the detected position of the operation means (step S.15), and the display area of the operation buttons and the like displayed on the calculated display screen 2a is large. And the size of the contact area of the operating means stored in the storage unit 4 is compared (step S.16).

  When the display area of the operation button or the like is larger than the contact area (YES in step S.16), the CPU 8 continues to display the display image created using the normal size operation button or the like on the display unit 2. In this manner, the image processing unit 3 is controlled (step S.13). For example, in the display image shown in the left diagram of FIG. 7A, when the operator's finger 11 approaches the operation button 9a on the display screen 2a to a distance equal to or less than the threshold, the CPU 8 indicates that the display area of the operation button 9a is It is determined that the contact area is larger than 11, and the display image continues to be displayed as it is (display image created using a normal size operation button) as shown in the right diagram of FIG.

  On the other hand, when the display area of the operation button or the like is smaller than the contact area (NO in step S.16), the CPU 8 replaces the operation button at the position on the corresponding display screen 2a with an operation button of an enlarged size or the like. The image processing unit 3 is controlled to display the displayed image on the display unit 2 (step S.17). For example, when the operator's finger 11 approaches the operation button 9b or the like 9b on the display screen 2a to a distance equal to or less than the threshold on the display screen shown in the left diagram of FIG. Therefore, the operation button 9b is enlarged and displayed as shown in the right figure of FIG.

  Thereafter, when the operation means comes into contact with the display screen 2b (in the case of YES at step S18), the CPU 8 receives the contact position of the operation means as position information through the input unit 5 and the touch position detection unit 6, and receives the received position information. An operation button or the like displayed at the coordinate position is specified from the coordinate position on the display screen 2a obtained more (step S.19), and processing assigned to the operation button or the like is executed (step S.20). When an operation button or the like is displayed in an enlarged manner, an operation button or the like corresponding to the contact position is obtained based on a display image created by an operation button or the like of an enlarged size and assigned to the corresponding operation button or the like. Execute the process. If the operating means has not touched the display screen 2b (NO in step S18), the CPU 8 repeatedly determines whether or not an approach distance has been received from the ultrasonic sensor 7 (step S.11).

  In this way, by comparing the display area of the operation button and the contact area of the operation means, the operation button is enlarged and displayed only when the contact area is larger than the display area of the operation button, etc. Even when a plurality of buttons are arranged and the operation buttons are displayed in a small size, the operator is less likely to perform an erroneous operation. Further, when the display area of the operation button is larger than the contact area of the operation means, the operation button or the like is not displayed in an enlarged manner, so that the other operation button or the like is hidden by the enlarged operation button or the like. Inconveniences such as these can be avoided, and good operability can be maintained without impairing the visibility of the operation buttons and the like.

  In addition, when the size of the operation button, etc. is displayed larger than other operation buttons according to the importance of the processing assigned to the operation button, etc., the operation with a small display size and low importance The corresponding operation button is enlarged and displayed only when the operation means approaches the button, etc., and other small operation buttons are not enlarged, so there is no possibility that a plurality of small operation buttons will be inadvertently enlarged, and the importance is high. It becomes possible to maintain the saliency of the operation buttons and the like.

  Although the touch panel operation device according to the present invention has been described with reference to the drawings, the touch panel operation device according to the present invention is not limited to the above-described one. For example, in the above-described embodiment, the approaching state of the operation unit is detected using the ultrasonic sensor 7, but a sensor other than the ultrasonic sensor 7 is used as long as the sensor can sense the approach of the operation unit. May be.

  For example, as shown in FIG. 8, an infrared sensor 10 may be installed in front of the display screen 2a in parallel to the panel surface, and the infrared sensor 10 may be run from the infrared sensor 10 on the display front surface 2a in a grid pattern. . With this configuration, it is possible to detect that the operating means (the operator's finger 11 shown in FIG. 8) has approached the infrared sensor installation position by blocking infrared rays, and further, the operating means. It is possible to specify the approaching position.

It is the block diagram which showed schematic structure of the touchscreen operating device which concerns on this invention. It is the figure which showed the display image produced with the image for operation. It is the figure which showed typically the installation condition of the ultrasonic sensor provided in a display part. It is the flowchart which showed the process which CPU performs at the time of the initial installation of a system. It is the figure which showed the initial setting screen of the system. It is the flowchart which showed the process which CPU performs in normal touch panel operation. It is the figure which showed the display screen displayed according to an operator's finger | toe's approach, Comprising: (a) shows the state as which the display screen produced using the operation button of normal size is displayed as it is, (b) Shows a state of being changed and displayed on the display screen created using the enlarged size operation button. It is the side view which showed the display part in which the infrared sensor was provided.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Touch panel scanning device 2 Display part (display means)
3 Image processing unit (image processing means)
4 storage unit (image information storage means, contact range storage means)
5 Input part (contact state judgment means)
6 Touch position detection unit (contact position detection means)
7 Ultrasonic sensor (distance detection means)
8 CPU (control means)

Claims (1)

Display means for displaying an operation image on a display screen;
Image information storage means for storing a plurality of operation images to be displayed on the display screen;
Image processing means for extracting a specific operation image from a plurality of operation images stored in the image information storage means and creating a display image for display on the display screen;
Contact state determination means for determining the presence or absence of an operation means in contact with the display screen;
A contact position detection unit that detects a contact position and a contact range on the display screen that the operation unit is in contact with when the operation unit is in contact with the display screen;
Contact range storage means for preliminarily storing the contact range of the operation means detected by the contact position detection means;
Distance detecting means for detecting the distance and position of the tip of the operating means located in front of the display screen to the display screen;
When the distance of the tip of the operation means detected by the distance detection means is within a predetermined distance from the display screen, it is displayed at the display position on the display screen corresponding to the position of the tip of the operation means. A display range of the detected operation image is compared with the contact range stored in the contact range storage means, and when the contact range is larger than the display range, A touch panel operating device comprising: control means for controlling the image processing means so as to enlarge and display the operation image displayed on the display screen.

Images