JP2019185160A - Touch panel controller - Google Patents

Abstract

To provide a touch panel controller that enables a plurality of screens to be operated with one touch panel.SOLUTION: When a detection part 42 detects multiple touches, an arithmetic part 43 outputs relative coordinate data to a computer 2, and an offset to be used for a single touch is determined based upon a touch-off position of a cursor in the multiple touches, so the cursor is moved from a screen set as reference of absolute coordinate data to the other screen through the multiple touches, and the cursor can be operated on the other screen with the single touch.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a touch panel controller.

  Since an intuitive operation can be performed while checking the display on the screen, a touch panel is used for various purposes as an input means. A tablet terminal or a smart phone can be operated only with a touch panel without having other input devices such as a keyboard and a mouse. In recent years, a multi-display environment in which a plurality of displays are connected to a computer is also used.

  Patent Document 1 discloses the use of two LCDs as a multi-display. Patent Document 2 discloses that a large-screen display device is operated by a portable terminal device incorporating a touch panel.

JP 2013-47975 A Japanese Patent No. 6177482

  In a tablet terminal or a smart phone, the touch panel and the display screen are paired. Therefore, the operation of the touch panel is limited to the display screen to which the touch panel is connected. In a multi-display environment, screens can be assigned, but the number of screens that can be operated with one touch panel is one. Therefore, in a multi-display environment, a touch panel is required for each screen. Alternatively, it is necessary to operate a screen to which a touch panel is not connected using other input means such as a keyboard and a mouse.

  An object of the present invention is to provide a touch panel controller capable of operating a plurality of screens with one touch panel.

  In order to achieve the above object, a touch panel controller disclosed in the specification is a touch panel controller connected to an information processing apparatus connected to a plurality of displays and a touch panel, and detects single touch and multi touch. And an offset corresponding to the display screen including the cursor when the screen of the display including the cursor at the time of multi-touch touch-off is different from the screen set as a reference of absolute coordinate data, The offset setting means for erasing the offset when the screen of the display including the cursor at the time of multi-touch touch-off is the same as the screen set as the reference of the absolute coordinate data, and the multi-touch is detected If the multita Calculating the absolute coordinate data of the middle point of the H, calculating relative coordinate data from the difference between the calculated absolute coordinate data and the previous absolute coordinate data, outputting the relative coordinate data to the information processing device, and the offset Is deleted and the single touch is detected, the absolute coordinate data corresponding to the single touch is output to the information processing apparatus, the offset is set, and the single touch is detected, Computation output means for adding the offset to the absolute coordinate data corresponding to the single touch and outputting the absolute coordinate data to which the offset is added to the information processing apparatus is provided.

  According to the present invention, it is possible to operate a plurality of screens with one touch panel.

It is a lineblock diagram of a system provided with a touch panel controller concerning a 1st embodiment. It is a figure which shows an example of the display arrangement | positioning of a multi-display environment. It is a figure which shows the relationship between operation on a touch panel, and movement of a cursor. It is a figure which shows the relationship between operation on a touch panel, and movement of a cursor. It is a figure which shows the relationship between operation on a touch panel, and movement of a cursor. It is a flowchart which shows the process performed with a touch panel driver. It is a flowchart which shows the process performed with a touchscreen controller. It is a flowchart which shows the interruption process performed with a touchscreen controller. It is a figure which shows the relationship between operation on the touchscreen and movement of an operation screen which concern on 2nd Embodiment. It is a flowchart which shows the process performed with a touchscreen controller.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 is a configuration diagram of a system including a touch panel controller according to the first embodiment.

  The system 1 in FIG. 1 includes a computer 2, a touch panel 3 that supports multi-touch, a touch panel controller 4, and displays 5-7. The touch panel 3 is installed on the display 5. Note that the number of displays is not limited to three, but may be plural. The touch panel 3 is installed on the display 5, but may not be installed on the display 5, or may be installed on the display 6 or 7.

  The computer 2 includes a CPU 21 that controls the overall operation of the computer 2, a RAM 22 that functions as a working area, a ROM 23 that stores various data, an OS (Operating System) 27, a touch panel driver 28, and a hard disk that stores various data. A drive (HDD) 24, a serial interface (IF) 25, and a video IF 26 are provided. The serial IF 25 is a COM port, a PS / 2 port, or a USB (Universal Serial Bus) port, and is connected to the touch panel controller 4 via a cable. The video IF 26 is connected to the displays 5 to 7 through a video cable.

  The touch panel controller 4 is connected to the touch panel 3. The touch panel controller 4 controls the voltage applied to the electrodes arranged on the touch panel 3, detects the voltage at the pressed position of the touch panel 3 by A / D conversion, and performs a single operation. A detection unit 42 that detects touch or multi-touch, a calculation unit 43 that calculates coordinate data from the voltage detected by the detection unit 42, and a storage unit 44 that stores various setting values are provided. The detection unit 42 functions as a detection unit, and the calculation unit 43 functions as an offset setting unit, a calculation output unit, and an acquisition unit.

  FIG. 2 is a diagram illustrating an example of a display arrangement in a multi-display environment.

  The screen sizes (resolutions) of the displays 5 to 7 are (x1, y1), (x2, y1), and (x3, y2), respectively, and the reference points of the screens of the displays 5 to 7 are (0, 0) and (x1), respectively. , 0) and (x1, y1). Further, screen numbers are assigned by the OS 27 to the respective screens of the displays 5 to 7.

  The touch panel driver 28 acquires screen information indicating the screen number, the screen size, and the screen reference point of each display from the OS 27 and transmits the screen information to the touch panel controller 4. The storage unit 44 of the touch panel controller 4 stores the screen information transmitted from the touch panel driver 28.

  When the cursor is included in the screen of the display 6 at the time of touch-off, the calculation unit 43 sets the reference point (x1, 0) of the screen of the display 6 as an offset. When the cursor is included in the screen of the display 7 at the time of touch-off, the calculation unit 43 sets the reference point (x1, y1) of the screen of the display 7 as an offset. When the cursor is included in the screen of the display 5 at the time of touch-off, the calculation unit 43 clears (erases) the offset and sets the reference point of the screen to (0, 0). In the present embodiment, the offset means the distance from the reference point on the screen of the display 5 to the reference point on the screen of the display 6 or 7.

  In the present embodiment, when a single touch input operation is performed, that is, when the detection unit 42 detects a single touch, the calculation unit 43 outputs the absolute coordinate data of the touch position to the computer 2. On the other hand, when a multi-touch input operation is performed, that is, when the detection unit 42 detects multi-touch, the calculation unit 43 calculates absolute coordinate data of the midpoints of the plurality of touch positions, and the calculated absolute coordinate data Relative coordinate data is calculated from the difference between the absolute coordinate data and the previous absolute coordinate data, and the relative coordinate data is output to the computer 2. By using relative coordinate data, the cursor can be operated regardless of the touch position, and therefore, movement and operation to another screen can be performed in a multi-display environment.

  In the present embodiment, the absolute coordinate data is coordinate data representing a position by the distance from the reference point (0, 0) on the screen of the display 5. It is not limited to. The relative coordinate data is coordinate data representing a position in a relative relationship with a specific point.

  3-5 is a figure which shows the relationship between operation on the touch panel 3 and movement of a cursor.

  As shown in FIG. 3, when a moving operation is performed as indicated by an arrow 30 on the touch panel 3 with a single touch in the absence of an offset, the calculation unit 43 outputs absolute coordinate data corresponding to the moving operation to the computer 2. The cursor moves in the screen of the display 5 as indicated by an arrow 30a.

  As shown in FIG. 4, when the moving operation is performed on the touch panel 3 as indicated by the arrow 31 as shown in FIG. 4, the calculation unit 43 outputs the relative coordinate data to the computer 2, so that the cursor moves as indicated by the arrow 31a. Enter the screen. When the touch-off is performed, the calculation unit 43 acquires the screen offset of the display 6 based on the cursor position at the time of the touch-off. Subsequently, when a moving operation is performed on the touch panel 3 as indicated by an arrow 32 by multi-touch, the calculation unit 43 outputs relative coordinate data to the computer 2, so that the cursor moves as indicated by an arrow 32 a and moves within the screen of the display 7. to go into. When the touch-off is performed, the calculation unit 43 acquires the screen offset of the display 7 based on the position of the cursor at the time of the touch-off. As described above, in the case of multi-touch, the calculation unit 43 outputs relative coordinate data to the computer 2 without using the acquired offset, so that the cursor can move between the screens.

  As shown in FIG. 5, when a moving operation is performed on the touch panel 3 as indicated by an arrow 33 as shown in FIG. 5, the calculation unit 43 outputs relative coordinate data to the computer 2, so that the cursor moves as indicated by an arrow 33a and the display 6 Enter the screen. When the touch-off is performed, the calculation unit 43 acquires the screen offset of the display 6 based on the cursor position at the time of the touch-off. Subsequently, when a moving operation is performed on the touch panel 3 as indicated by an arrow 34 by single touch, the calculation unit 43 outputs absolute coordinate data to which an offset is added to the computer 2, so that the cursor moves within the screen of the display 6 using the arrow 34 a. Move like. As described above, when a movement operation is performed by multi-touch, that is, when the detection unit 42 detects multi-touch, the calculation unit 43 outputs relative coordinate data to the computer 2 and the cursor at the time of multi-touch touch-off is output. Since the offset used for single touch is determined based on the position, a plurality of screens can be operated with one touch panel 3.

  When the position of the cursor at the time of touch-off is included in the screen of the display 5, the calculation unit 43 clears the offset. Therefore, in the subsequent single touch operation, the calculation unit 43 uses the absolute coordinate data without the offset to the computer 2. Output to.

  FIG. 6 is a flowchart showing processing executed by the touch panel driver 28. This process is realized by the CPU 21 that activates the touch panel driver 28.

  The touch panel driver 28 acquires screen information indicating a screen number, a screen size, and a screen reference point of each display from the OS 27 at the time of activation (S1), and transmits the screen information to the touch panel controller 4 (S2).

  The touch panel driver 28 determines whether or not there is a change in the screen setting due to a change, addition or deletion of the display arrangement (S3). If there is a change in the screen settings (YES in S3), the procedure returns to S1, and the touch panel driver 28 reacquires screen information. On the other hand, when there is no change in the screen settings (NO in S3), the touch panel driver 28 determines whether the data received from the touch panel controller 4 includes coordinate data (S4). If the data received from the touch panel controller 4 does not include coordinate data (NO in S4), the procedure returns to S3.

  If the data received from the touch panel controller 4 includes coordinate data (YES in S4), the touch panel driver 28 determines whether the data received from the touch panel controller 4 includes touch-off data indicating touch-off (S5). . When the data received from the touch panel controller 4 includes touch-off data (YES in S5), the touch panel driver 28 notifies the touch panel controller 4 of the screen number including the cursor at the time of touch-off (S6), and the coordinate data. Is notified to the OS 27 (S7). After S7, the procedure returns to S3. If the data received from the touch panel controller 4 does not include touch-off data (NO in S5), the coordinate data is notified to the OS 27 because the touch is being continued (S7). Thereafter, the procedure returns to S3.

  FIG. 7 is a flowchart showing processing executed by the touch panel controller 4, and FIG. 8 is a flowchart showing interrupt processing executed by the touch panel controller 4. The interrupt process in FIG. 8 is executed when the screen number of the screen including the cursor is notified from the touch panel driver 28 at the time of touch-off (see S6 in FIG. 6).

  In FIG. 7, the detection unit 42 determines whether or not touch detection has been performed (S11). If there is touch detection (YES in S11), the calculation unit 43 measures the coordinates of the detected touch position (S12) and creates coordinate data (S13). In the case of multi-touch, coordinate data of the midpoints of a plurality of touch positions is created.

  The detection unit 42 determines whether a single touch is detected (S14). When multi-touch is detected (NO in S14), the calculation unit 43 calculates absolute coordinate data of the midpoints of the plurality of touch positions, and the relative value is calculated based on the difference between the calculated absolute coordinate data and the previous absolute coordinate data. The coordinate data is calculated (S17), and the relative coordinate data is output to the computer 2 (S18).

  When single touch is detected (YES in S14), the calculation unit 43 determines whether an offset is set (S15). When the offset is set (YES in S15), the calculation unit 43 adds the offset to the absolute coordinate data corresponding to the single touch (S16), and outputs the absolute coordinate data to which the offset is added to the computer 2 (S16). S18). When the offset is not set (NO in S15), the calculation unit 43 outputs absolute coordinate data corresponding to single touch to the computer 2 (S18).

  If there is no touch detection (NO in S11), the detection unit 42 determines whether or not the previous touch-on of multi-touch has been detected (S19). In S19, it is determined whether or not it is immediately after multi-touch touch-off. When touch-on is detected last time (YES in S19), the calculation unit 43 outputs absolute coordinate data and touch-off data at the time of touch-off to the computer 2 (S18). If no previous touch-on has been detected (NO in S19), no operation has been performed on the touch panel 3, and thus this process is terminated.

  In FIG. 8, the calculation unit 43 acquires the screen number of the screen including the cursor from the touch panel driver 28 at the time of multi-touch touch-off (S20). The computing unit 43 determines whether or not the acquired screen number is the same as the screen number of the display 5 (S21). The comparison target with the acquired screen number is the screen number of the screen set as a reference for the absolute coordinate data, and is the screen number of the display 5 in this embodiment, but is not limited to this.

  If the acquired screen number is the same as the screen number of the display 5 (YES in S21), the calculation unit 43 clears the offset (S22) and ends this interrupt process. On the other hand, when the acquired screen number is different from the screen number of the display 5 (NO in S21), the calculation unit 43 sets an offset corresponding to the acquired screen number (S23), and ends this interrupt processing.

  As described above, according to the present embodiment, when multi-touch is detected, the calculation unit 43 outputs the relative coordinate data to the computer 2, and based on the position of the cursor at the time of multi-touch touch-off. Since the offset used for touch is determined, it is possible to move the cursor from the screen set as the reference of absolute coordinate data to another screen by multi-touch and operate the cursor on the other screen by single touch. it can. Accordingly, a plurality of screens can be operated with one touch panel 3.

(Second Embodiment)
In the first embodiment, the operation screen is switched according to the screen including the cursor at the time of multi-touch touch-off. However, in the second embodiment, the operation screen is switched by performing a multi-touch continuous touch. The configuration of the system according to the second embodiment is the same as the configuration of the system according to the first embodiment.

  FIG. 9 is a diagram showing the relationship between the operation on the touch panel 3 and the movement of the operation screen.

  As shown in FIG. 9, when a continuous touch such as a double click is performed on the touch panel 3 by multi-touch, the operation screen is switched. Assume that the operation screen in the initial state is the screen of the display 5. For example, when the continuous touch 51 is performed on the touch panel 3, the operation screen is switched from the screen of the display 5 to the screen of the display 6. Next, when the continuous touch 52 is performed on the touch panel 3, the operation screen is switched from the screen of the display 6 to the screen of the display 7. Further, when the continuous touch 53 is performed on the touch panel 3, the operation screen is switched from the screen of the display 7 to the screen of the display 5. That is, the operation screen is switched according to the number of multi-touch continuous touches, and when the operation screen is switched to the screen of the display 7, the screen of the display 5 is returned again. At the time of touch-off of continuous touch, the calculation unit 43 acquires a corresponding screen offset. However, when the operation screen becomes the screen of the display 5, the calculation unit 43 clears the offset.

  When the operation screen becomes the screen of the display 6 or 7 and an operation is performed by a single touch, the calculation unit 43 adds absolute coordinate data corresponding to the single touch operation to which the corresponding offset is added to the computer 2. Output.

  In the above example, the operation screen is switched according to the number of multi-touch continuous touches. However, every time a multi-touch is detected, that is, the operation screen is switched according to the number of multi-touches. Also good.

  FIG. 10 is a flowchart showing processing executed by the touch panel controller 4.

  The detection unit 42 determines whether touch detection has been performed (S31). When there is touch detection (YES in S31), the calculation unit 43 measures the coordinates of the detected touch position (S32) and creates coordinate data (S33). In the case of multi-touch, coordinate data of the midpoints of a plurality of touch positions is created.

  The detection unit 42 determines whether a single touch has been detected (S34). When multi-touch is detected (NO in S34), the computing unit 43 sets a screen switching flag (S35). On the other hand, when a single touch is detected (YES in S34), the calculation unit 43 clears the screen switching flag (S36). Next, the calculation unit 43 determines whether an offset is set (S37). When the offset is set (YES in S37), the calculation unit 43 adds the offset to the absolute coordinate data (S38), and outputs the absolute coordinate data with the offset added to the computer 2 (S39). If no offset is set (NO in S37), the calculation unit 43 outputs absolute coordinate data without an offset to the computer 2 (S39).

  If there is no touch detection (NO in S31), the detection unit 42 determines whether or not a previous touch-on was detected (S40). In S40, it is determined whether or not it is immediately after touch-off. If the previous touch-on was detected (YES in S40), the calculation unit 43 determines whether or not a screen switching flag is set (S41). When the screen switching flag is set (YES in S41), the calculation unit 43 determines whether or not the number of multi-touch continuous touches is zero or matches the number of screens (S42). In S42, it is determined whether to switch the operation screen according to the number of multi-touch continuous touches.

  When the number of multi-touch continuous touches is 0 or matches the number of screens (YES in S42), the operation screen becomes the screen of the display 5, and the calculation unit 43 clears the offset (S43). 43 outputs the absolute coordinate data and touch-off data at the time of touch-off to the computer 2 (S39).

  When the number of multi-touch continuous touches is 0 or does not match the number of screens (NO in S42), the operation screen becomes the screen of the display 6 or 7, and the calculation unit 43 increments the offset (S44). Here, since the operation screen shifts from the screen of the display 5 or 6 to the screen of the display 6 or 7, the offset is changed to the offset value of the corresponding screen. Thereafter, the calculation unit 43 outputs the absolute coordinate data and the touch-off data at the time of touch-off to the computer 2 (S39).

  As described above, according to the present embodiment, since the offset used for single touch is determined based on the number of multi-touches, the operation screen can be switched based on the number of multi-touches.

  The present invention is not limited to the above-described embodiment, and can be implemented with various modifications within a range not departing from the gist thereof.

DESCRIPTION OF SYMBOLS 1 System 2 Computer 3 Touch panel 4 Touch panel controller 5-7 Display 41 Panel control part 42 Detection part 43 Calculation part 44 Storage part

Claims (4)

An information processing apparatus connected to a plurality of displays and a touch panel controller connected to a touch panel,
Detection means for detecting single touch and multi-touch;
When the display screen including the cursor at the time of multi-touch touch-off is different from the screen set as a reference of absolute coordinate data, an offset corresponding to the display screen including the cursor is set, and the multi-touch An offset setting means for erasing the offset when the screen of the display including the cursor at the time of touch-off is the same as the screen set as a reference for the absolute coordinate data;
When the multi-touch is detected, the absolute coordinate data of the midpoint of the multi-touch is calculated, the relative coordinate data is calculated from the difference between the calculated absolute coordinate data and the previous absolute coordinate data, and the relative touch Outputting coordinate data to the information processing apparatus;
When the offset is erased and the single touch is detected, absolute coordinate data corresponding to the single touch is output to the information processing apparatus,
When the offset is set and the single touch is detected, the offset is added to the absolute coordinate data corresponding to the single touch, and the absolute coordinate data with the offset is output to the information processing apparatus A touch panel controller comprising an output means. Obtaining means for obtaining an identifier of a display screen including the cursor from the information processing apparatus at the time of multi-touch touch-off,
The offset setting means sets an offset corresponding to the acquired identifier when the acquired identifier does not match the identifier of the screen set as a reference of the absolute coordinate data, and the acquired identifier is the absolute identifier 2. The touch panel controller according to claim 1, wherein the offset is deleted when the identifier matches a screen identifier set as a reference of coordinate data. An information processing apparatus connected to a plurality of displays and a touch panel controller connected to a touch panel,
Detection means for detecting single touch and multi-touch;
An offset setting means for setting or erasing an offset from the reference of the absolute coordinate data according to the number of times of the multi-touch;
When the offset is erased and the single touch is detected, absolute coordinate data corresponding to the single touch is output to the information processing apparatus,
When the offset is set and the single touch is detected, the offset is added to the absolute coordinate data corresponding to the single touch, and the absolute coordinate data with the offset is output to the information processing apparatus A touch panel controller comprising an output means. The offset setting means erases the offset when the number of multi-touches is zero or matches the number of screens of the plurality of displays, and the number of multi-touches is zero or the number of screens of the plurality of displays. 4. The touch panel controller according to claim 3, wherein an offset corresponding to the number of multi-touches is set when the number does not match.

Images