JP2022064084A - Touch input system - Google Patents

Abstract

To provide a touch input system with which it is possible to make a touch input at a distant position of a touch panel with high accuracy.SOLUTION: In a touch input system 100, a first reference coordinate assessment unit 250 assesses a first reference coordinate Rc on the basis of the inclination of an input device 300 relative to a display screen 200s having been detected by an inclination detection unit 240 in a hover state where the input device 300 is floating over the touch panel 220. When the input device 300 has transitioned from the hover state to a touch state where it is in contact with the touch panel 220, an input assessment unit 260 assesses the input based on the touch input operation detected by the touch panel 220 in the touch state, with the first reference coordinate Rc assessed by the first reference coordinate assessment unit 250 in the hover state used as a point of reference.SELECTED DRAWING: Figure 4

Description

The present invention relates to a touch input system.

Conventionally, a touch input system that performs a touch input operation on a touch panel with a pen-type input device has been known. In a general touch input system, it is possible to perform a touch input operation at a position where the pen-type input device operated by the operator can reach, but it is not possible to perform a touch input operation at a position where the pen-type input device cannot reach. Can not.

Therefore, it is also considered to operate the display device from a position away from the display device (see Patent Document 1). In Patent Document 1, in order to select or operate an object having 3D information displayed in 2D, a magnetic field generation source is fixed on the display, and then the 3D position and tilt of the pen tip are measured and input. It is described to be used as information.

Japanese Patent Application Laid-Open No. 2003-855590

However, in the operation method of Patent Document 1, the operation is input remotely using a magnetic field, and it is difficult to perform the operation with high accuracy. In particular, when performing a writing input operation on the display screen, even if the operator attempts to move the pen tip spatially for writing input, it is difficult to detect the movement of the pen tip with high accuracy, and the operation is performed on the display screen. Information not intended by the person may be entered.

The present invention has been made in view of the above problems, and an object of the present invention is to provide a touch input system capable of high-precision touch input operation at a remote position of a touch panel.

The touch input system according to the present invention includes a display panel that displays an image on a display screen, a touch panel that detects a touch input operation on the display screen, an input device that performs the touch input operation on the touch panel, and the input. The tilt detection unit that detects the tilt of the device with respect to the display screen, the first reference coordinate determination unit that determines the first reference coordinates on the display screen, the input determination unit that determines the input on the display screen, and the display screen. It is provided with a display control unit for controlling the display of an image in the above. The first reference coordinate determination unit determines the first reference coordinates based on the inclination of the input device with respect to the display screen detected by the inclination detection unit in a hover state in which the input device floats with respect to the touch panel. .. The input determination unit uses the first reference coordinates determined by the first reference coordinate determination unit in the hover state as a reference when the input device transitions from the hover state to the touch state in which the input device touches the touch panel. As the position, the input based on the touch input operation detected by the touch panel in the touch state is determined.

According to the present invention, a touch input operation can be performed with high accuracy at a remote position of the touch panel.

It is a schematic perspective view of the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment. It is a schematic perspective view of the touch input system of this embodiment. It is a schematic perspective view of the touch input system of this embodiment. It is a schematic perspective view of the touch input system of this embodiment. It is a block diagram of the touch input system of this embodiment. It is a schematic perspective view of the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment. It is a block diagram of the touch input system of this embodiment. It is a schematic perspective view for demonstrating the reference position in the touch input system of this embodiment. It is a schematic perspective view for demonstrating the reference position in the touch input system of this embodiment. It is a schematic perspective view for demonstrating the reference position in the touch input system of this embodiment. It is a block diagram of the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment. It is a schematic perspective view for demonstrating the touch input operation in the touch input system of this embodiment.

Hereinafter, embodiments of the touch input system according to the present invention will be described with reference to the drawings. In the figure, the same or corresponding parts are designated by the same reference numerals and the description is not repeated.

First, the touch input system 100 of the present embodiment will be described with reference to FIG. FIG. 1 is a schematic perspective view of the touch input system 100.

As shown in FIG. 1, the touch input system 100 includes a display device 200 and an input device 300. The display device 200 displays an image. The input device 300 inputs an operation for the display device 200. By inputting an operation to the display device 200 using the input device 300, the image displayed by the display device 200 changes.

The display device 200 has a display screen 200s. An image is displayed on the display screen 200s. Typically, the display screen 200s has a rectangular shape. However, the display screen 200s does not have to be rectangular.

The input device 300 has a rod shape extending in the longitudinal direction. For example, one end of the input device 300 is tapered and elongated, and the central portion and the other end of the input device 300 are cylindrical. The input device 300 may have a pen shape.

The display device 200 includes a display panel 210 and a touch panel 220. The display panel 210 displays an image on the display screen 200s. For example, the display panel 210 includes a liquid crystal display or an organic EL display.

The display panel 210 has a plurality of pixels arranged in a matrix consisting of a plurality of rows and a plurality of columns. Coordinates are assigned to a plurality of pixels according to rows and columns.

The touch panel 220 detects a touch input operation by the input device 300. The touch panel 220 detects the position where the touch input operation by the input device 300 is performed and the operation content. The touch panel 220 has a plurality of detection elements arranged in a matrix composed of a plurality of rows and a plurality of columns. Coordinates are assigned to the plurality of detection elements according to the rows and columns.

Typically, the touch panel 220 is of a capacitive type. However, the method of the touch panel 220 is not particularly limited. The touch panel 220 may detect the touch input operation by any one of a capacitance method, an ultrasonic method, a resistance film method, an infrared method, or a combination thereof.

The touch panel 220 is arranged on the display panel 210. Alternatively, the touch panel 220 has a structure integrated with the display panel 210. Typically, the touch panel 220 is transparent. Therefore, the image of the display panel 210 can be visually recognized via the touch panel 220.

As described above, the touch panel 220 accepts a touch input operation by the input device 300. For example, the touch panel 220 accepts the timing, touched position, and / or touch input operation touched by the input device 300. The touch panel 220 may be capable of accepting a touch input operation by a device other than the input device 300. For example, the touch panel 220 may be capable of accepting a touch input operation by the operator's finger.

The input device 300 performs a touch input operation on the touch panel 220. Typically, the input device 300 can perform a touch input operation on the display device 200 by contacting the display device 200.

The input device 300 may be capable of input operation to the touch panel 220 by being close to the display device 200. Such an input operation is also called a hover operation.

When the input device 300 is located in a predetermined area with respect to the display device 200, the input device 300 is in a hover state with respect to the display device 200. When the input device 300 is in a hover state with respect to the display device 200, the display device 200 determines the reference coordinates based on the inclination of the input device 300 with respect to the display screen 200s of the display device 200. The display device 200 may display a specific image at the reference coordinates. Further, an object (for example, an icon) located at the reference coordinates can be selected by input from the input device 300.

Next, the touch input system 100 of the present embodiment will be described with reference to FIGS. 1 to 2C. Here, the touch input operation in the touch input system 100 will be described mainly with reference to FIGS. 2A to 2C. 2A to 2C are schematic perspective views for explaining a touch input operation in the touch input system 100.

As shown in FIG. 2A, when the input device 300 is located away from the display device 200, the input device 300 does not perform a touch input operation on the touch panel 220. Further, the image of the display device 200 does not change regardless of the orientation of the input device 300.

As shown in FIG. 2B, when the input device 300 touches the touch panel 220, the display device 200 transitions to the touch state. At this time, the input device 300 performs a touch input operation on the touch panel 220. As an example, when the input device 300 taps a predetermined area of the touch panel 220, an object (for example, an icon) displayed in the tapped area of the touch panel 220 can be selected on the display panel 210. In this case, the software program corresponding to the selected object may be started. Alternatively, the folder corresponding to the selected object may be opened.

The touch input operation of the input device 300 for the touch panel 220 is not limited to the tap operation. The touch input operation of the input device 300 for the touch panel 220 may be a double tap operation. Alternatively, the touch input operation of the input device 300 for the touch panel 220 may be a writing input operation for drawing an image by writing on the display screen 200s.

As shown in FIG. 2C, the input device 300 moves on the touch panel 220 while touching the touch panel 220, so that the touch input operation can be performed on the display device 200. For example, when the input device 300 moves to write the character "A" while touching the touch panel 220, the display panel 210 displays the character "A". In this way, by writing on the display screen 200s in the touch input operation of the input device 300 for the touch panel 220, the writing input operation for drawing an image can be performed.

Next, the touch input system 100 of the present embodiment will be described with reference to FIGS. 1 to 3C. Here, the hover state in the touch input system 100 will be described mainly with reference to FIGS. 3A to 3C. 3A-3C are schematic perspective views of the touch input system 100.

As shown in FIG. 3A, a hover region HB is formed on the entire surface of the display device 200. When the input device 300 is located in the hover region HB, the display device 200 detects the input device 300. The display device 200 may detect an input operation by the input device 300. On the other hand, if the input device 300 is not located in the hover region HB, the display device 200 cannot detect the input device 300. For example, the hover region HB is formed substantially evenly on the entire surface of the display screen 200s of the display device 200.

For example, the hover region HB is formed by the radio signal output from the display device 200. In this case, the wireless signal is output substantially evenly from the entire surface of the display screen 200s of the display device 200. The wireless signal transmission unit that outputs the wireless signal may be arranged on the display panel 210 or the touch panel 220.

In the present specification, the input device 300 is referred to as a hover state when the input device 300 is located in the hover area HB without touching the display device 200 and the input device 300 is detected by the display device 200. In this case, the input device 300 floats with respect to the touch panel 220.

As shown in FIG. 3B, when the input device 300 is in the hover state, the display device 200 detects the input device 300. Here, the input device 300 is slightly tilted with respect to the display screen 200s of the display device 200.

Although not shown in FIG. 3B, the display device 200 may display a pointer cursor according to the input device 300. For example, the display device 200 may display a pointer cursor directly under the input device 300. Alternatively, since the input device 300 is tilted with respect to the display screen 200s of the display device 200, the pointer cursor may be displayed in the direction toward the end of the input device 300.

As shown in FIG. 3C, when the input device 300 is tilted with respect to the display screen 200s in the hover state, the display device 200 displays a predetermined image corresponding to the tilt of the input device 300 with respect to the display screen 200s.

The display device 200 determines the reference coordinate Rc based on the inclination of the input device 300 with respect to the display screen 200s, and displays a predetermined image at the position of the reference coordinate Rc. Here, the display device 200 displays the pointer cursor Pc as a predetermined image. The pointer cursor Pc is located at a position corresponding to the tilt of the input device 300 with respect to the display screen 200s. For example, the pointer cursor Pc moves according to the tilt of the input device 300 with respect to the display screen 200s.

Next, the touch input system 100 of the present embodiment will be described with reference to FIGS. 1 to 4. FIG. 4 is a block diagram of the touch input system 100.

As shown in FIG. 4, in the touch input system 100, in addition to the display panel 210 and the touch panel 220, the display device 200 includes a housing 202, a display device side communication unit 230, an inclination detection unit 240, and a first reference. It further has a coordinate determination unit 250, an input determination unit 260, and a display control unit 270.

The display device 200 includes a processor and a memory. The processor is a hardware circuit composed of a central processing unit (CPU), an integrated circuit for a specific application (Application Specific Integrated Circuit: ASIC), or the like. The housing 202 accommodates a display panel 210, a touch panel 220, a display device-side communication unit 230, a processor, and a memory. The processor controls the display panel 210, the touch panel 220, and the communication unit 230 on the display device side by reading and executing the control program stored in the memory. Further, the processor functions as a tilt detection unit 240, a first reference coordinate determination unit 250, an input determination unit 260, and a display control unit 270 by reading and executing a control program stored in the memory.

The display device side communication unit 230 communicates with the input device 300. The display device side communication unit 230 transmits a specific signal to the input device 300. Further, the communication unit 230 on the display device side receives another signal from the input device 300. For example, the display device side communication unit 230 receives a signal from the input device 300 indicating the inclination of the input device 300 with respect to the display screen 200s.

Further, the communication unit 230 on the display device side outputs a signal for confirming whether or not the input device 300 is in the hover state. For example, the communication unit 230 on the display device side outputs a wireless signal and receives the wireless signal. Typically, when the input device 300 is in the hover state, the signal output from the display device side communication unit 230 changes according to the presence of the input device 300. As a result, the display device 200 can detect whether or not the input device 300 is in the hover state. When the input device 300 is in the hover state, the signal output from the display device side communication unit 230 is received by the input device 300, and the input device 300 sends a signal indicating reception of the signal to the display device side communication unit 230. You may send it.

The tilt detection unit 240 detects the tilt of the input device 300 with respect to the display screen 200s. The communication unit 230 on the display device side receives a signal that changes according to the posture of the input device 300, and the tilt detection unit 240 detects the tilt of the input device 300 with respect to the display screen 200s based on this signal.

The tilt itself of the input device 300 with respect to the display screen 200s may be acquired by the input device 300 or may be acquired by the display device 200. For example, when the display device side communication unit 230 receives a signal from the input device 300 that changes according to the attitude of the input device 300 with respect to the display screen 200s, the tilt detection unit 240 receives the signal with respect to the display screen 200s based on this signal. The inclination of the input device 300 may be acquired. Alternatively, the input device 300 may acquire the tilt itself of the input device 300 with respect to the display screen 200s, and the input device 300 may transmit a signal indicating the tilt of the input device 300 with respect to the display screen 200s to the display device side communication unit 230. good. In this case, the tilt detection unit 240 detects the tilt of the input device 300 with respect to the display screen 200s based on the signal generated by the input device 300 and received via the display device side communication unit 230.

The first reference coordinate determination unit 250 determines the reference coordinate Rc on the display screen 200s. The first reference coordinate determination unit 250 determines the reference coordinate Rc based on the inclination of the input device 300 detected by the inclination detection unit 240 with respect to the display screen 200s in the hover state in which the input device 300 floats with respect to the touch panel 220. In the present specification, the reference coordinate Rc may be referred to as the first reference coordinate.

The input determination unit 260 determines the input on the display screen 200s. When the input determination unit 260 transitions from the hover state to the touch state in which the input device 300 touches the touch panel 220, the input determination unit 260 touches the reference coordinate Rc determined by the first reference coordinate determination unit 250 in the hover state as a reference position. The input based on the touch input operation detected by the touch panel 220 in the state is determined. When the input device 300 performs a touch input operation on the touch panel 220, the input determination unit 260 determines the input from the input device 300 to the display screen 200s.

For example, the input device 300 can select an object (for example, an icon) located at the reference coordinate Rc by tapping the touch panel 220. In this case, the software program corresponding to the selected object may be started. Alternatively, the folder corresponding to the selected object may be opened.

Further, by moving the input device 300 on the touch panel 220 while touching the touch panel 220, the touch input operation can be performed on the display device 200. For example, when the input device 300 moves to write the character "A" while touching the touch panel 220, the display panel 210 displays the character "A" in the reference coordinate Rc. In this way, by writing on the display screen 200s in the touch input operation of the input device 300 for the touch panel 220, the writing input operation for drawing an image at the reference coordinate Rc can be performed.

The display control unit 270 controls the display panel 210. The display control unit 270 controls the image displayed on the display panel 210 based on the determination result in the input determination unit 260.

The input device 300 has a housing 302, a tip portion 310, and an input device side communication unit 320. The housing 302 accommodates the tip 310 and the input device-side communication unit 320. The housing 302 extends in the longitudinal direction. The housing 302 has a portion formed in a substantially cylindrical shape for the user to hold by hand. For example, the housing 302 is made of an insulating material.

The tip portion 310 is arranged at the tip of the housing 302. When the touch panel 220 is of the capacitance type, the tip portion 310 is made of a conductive material. When the tip portion 310 comes into contact with the display device 200, the charge distribution near the contact position on the touch panel 220 changes. Therefore, the touch panel 220 can acquire the touch position.

The communication unit 320 on the input device side communicates with the display device 200. The input device side communication unit 320 receives the signal transmitted from the display device side communication unit 230. Further, the display device side communication unit 230 transmits another signal to the display device side communication unit 230. For example, the input device-side communication unit 320 may transmit a signal that changes according to the posture of the input device 300 to the display device-side communication unit 230. Further, the input device-side communication unit 320 may transmit a signal indicating identification information of the input device 300 and / or information regarding pen pressure to the display device-side communication unit 230.

The communication unit 230 on the display device side may output a so-called Uplink signal. Further, the communication unit 320 on the input device side may output a so-called Downlink signal. Typically, the signal reach of the Uplink signal is longer than the signal reach of the Downlink signal. For example, the signal reach of the Uplink signal is 5 cm or more and 1 m or less, and the signal reach of the Downlink signal is 1 cm or more and 20 cm or less.

Alternatively, the input device-side communication unit 320 may transmit a signal conforming to the short-range wireless communication standard as a response signal to the display device-side communication unit 230. In one example, the input device side communication unit 320 transmits a signal conforming to Bluetooth (registered trademark) to the display device side communication unit 230 as a response signal.

Next, an example of tilt detection in the touch input system 100 of the present embodiment will be described with reference to FIGS. 1 to 5. FIG. 5 is a schematic perspective view of the touch input system 100.

As shown in FIG. 5, in the input device 300, the input device side communication unit 320 has a first transmission unit 320a and a second transmission unit 320b. The first transmission unit 320a is located near the tip portion 310, and the second transmission unit 320b is located farther from the tip portion 310 than the first transmission unit 320a.

The first transmission unit 320a and the second transmission unit 320b each output a signal. Further, information indicating the output source is added to the signals output from the first transmission unit 320a and the second transmission unit 320b, respectively. The signals output from the first transmission unit 320a and the second transmission unit 320b are received by the display device side communication unit 230 arranged over the entire surface of the display screen 200s.

As shown in FIG. 5, the signal output from the first transmission unit 320a is received directly under the first transmission unit 320a, and the signal output from the second transmission unit 320b is directly under the second transmission unit 320b. Received. When the input device 300 is tilted with respect to the display screen 200s, the reception position of the signal output from the first transmission unit 320a, the reception position of the signal output from the second transmission unit 320b, and the first transmission unit 320a. From the information on the distance between the second transmission unit 320b and the second transmission unit 320b, the tilt detection unit 240 can acquire the tilt of the input device 300 with respect to the display screen 200s by the trigonometric ratio.

Here, with reference to FIG. 5, an example in which the tilt detecting unit 240 detects the tilt of the input device 300 with respect to the display screen 200s has been described, but the present embodiment is not limited to this.

When the input device 300 acquires the tilt of the input device 300 with respect to the display screen 200s of the fixed display device 200, the input device 300 may include an acceleration sensor. In this case, the input device side communication unit 320 transmits a signal indicating the measurement result of the acceleration sensor to the display device side communication unit 230. The tilt detection unit 240 can detect the tilt of the input device 300 with respect to the display screen 200s based on the signal received by the communication unit 230 on the display device side.

Next, the touch input system 100 of the present embodiment will be described with reference to FIGS. 1 to 6D. 6A to 6D are schematic perspective views of the touch input system 100.

As shown in FIG. 6A, the input device 300 is located outside the hover region HB with respect to the display device 200.

As shown in FIG. 6B, the input device 300 enters the hover region HB in a state of being tilted with respect to the display device 200 and enters the hover state. In this case, the display device side communication unit 230 acquires a signal indicating the inclination of the input device 300 with respect to the display screen 200s by communicating with the input device side communication unit 320. The tilt detection unit 240 detects the tilt of the input device 300 with respect to the display screen 200s.

The first reference coordinate determination unit 250 determines the reference coordinate Rc based on the inclination of the input device 300 detected by the inclination detection unit 240 with respect to the display screen 200s in the hover state in which the input device 300 floats with respect to the touch panel 220. The display control unit 270 displays the pointer cursor Pc as a predetermined image for displaying the reference coordinates Rc on the display screen 200s in the hover state.

As shown in FIG. 6C, the input device 300 approaches the display screen 200s of the display device 200 and touches the touch panel 220 at the coordinates Tc. Here, the input device 300 linearly approaches the display screen 200s from the position where the reference coordinate Rc is determined, and comes into contact with the coordinate Tc of the touch panel 220.

At this time, the position of the pointer cursor Pc remains the reference coordinate Rc. When the input device 300 comes into contact with the coordinates Tc of the touch panel 220, a touch input operation is performed on the reference coordinates Rc on the touch panel 220. Here, although the input device 300 is touching the coordinate Tc of the touch panel 220, the touch input operation is performed in the same manner as when the reference coordinate Rc is touched.

As an example, the input device 300 can select an object (for example, an icon) located at the reference coordinate Rc by tapping the coordinate Tc of the touch panel 220. In this case, the software program corresponding to the object located at the reference coordinate Rc may be started. Alternatively, the folder corresponding to the object located at the reference coordinate Rc may be opened.

As shown in FIG. 6D, a writing input operation may be performed as a touch input operation of the input device 300 for the touch panel 220. Here, the touch input operation is a writing input operation for drawing an image by writing with the coordinate Tc of the touch panel 220 as the start position. In this case, the input determination unit 260 determines the writing input based on the writing input operation detected by the touch panel 220 in the touch state, with the reference coordinate Rc determined by the first reference coordinate determination unit 250 in the hover state as the start position of the writing input. do. The display control unit 270 displays an image corresponding to the written input determined by the input determination unit 260 on the display screen 200s.

According to the touch input system 100 of the present embodiment, the input device 300 comes into contact with the touch panel 220 at the coordinates Tc, but the input operation by the input device 300 is a touch input operation at the reference coordinates Rc. Therefore, in the touch input system 100, the input device 300 can be used to perform a touch input operation at a remote position of the touch panel 220 with high accuracy.

As described above, the reference coordinates Rc are determined according to the inclination of the input device 300 with respect to the display screen 200s. The reference coordinates for determining the reference coordinates Rc may be set in advance. Alternatively, the reference coordinates for determining the reference coordinates Rc may be set according to the posture of the input device 300.

Next, the reference coordinate Rd, which is a reference when determining the reference coordinate Rc, will be described with reference to FIGS. 1 to 8. FIG. 7 is a block diagram of the touch input system 100. The block diagram of FIG. 7 has the same configuration as the block diagram of the touch input system 100 described above with reference to FIG. 4, except that the input device 300 further includes a second reference coordinate determination unit 252. , The description of duplication is omitted for the purpose of avoiding redundancy.

As shown in FIG. 7, in the touch input system 100, the input device 300 further includes a second reference coordinate determination unit 252. The second reference coordinate determination unit 252 determines the reference coordinate Rd, which is the reference when determining the reference coordinate Rc on the display screen 200s. In the present specification, the reference coordinate Rd may be referred to as a second reference coordinate. The reference coordinates Rd may be set in advance. Alternatively, the reference coordinates Rd may be set according to the posture of the input device 300.

The first reference coordinate determination unit 250 determines the reference coordinate Rc on the display screen 200s based on the reference coordinate Rd. The first reference coordinate determination unit 250 determines the reference coordinate Rc with reference to the reference coordinate Rd based on the inclination of the input device 300 with respect to the display screen 200s. For example, when the input device 300 is tilted in the lower right diagonal direction with respect to the display screen 200s, the first reference coordinate determination unit 250 determines the reference coordinate Rc located in the lower right diagonal direction with reference to the reference coordinate Rd.

Next, the reference coordinate Rd, which is a reference when determining the reference coordinate Rc, will be described with reference to FIGS. 1 to 8C. 8A to 8C are schematic perspective views for explaining the reference coordinates Rd in the touch input system 100 of the present embodiment.

As shown in FIG. 8A, the reference coordinate Rd is set in advance, and the reference coordinate Rd is located at the center of the display screen 200s. It is preferable that a specific image is displayed on the reference coordinate Rd of the display screen 200s. For example, it is preferable that the reference image Rg is displayed on the reference coordinates Rd of the display screen 200s.

At this time, the second reference coordinate determination unit 252 determines the reference coordinate Rd before determining the reference coordinate Rc on the display screen 200s, and the first reference coordinate determination unit 250 uses the reference coordinate Rd as the second reference coordinate. .. Here, the reference coordinate Rd indicates a preset position on the display screen 200s. The display control unit 270 may control the display panel 210 so that the pointer cursor Pc is displayed so as to overlap the reference image Rg displayed in the reference coordinates Rd.

As shown in FIG. 8B, when the input device 300 is tilted in the hover region HB with respect to the display screen 200s, the reference coordinate Rc is determined as a position corresponding to the tilt of the input device 300 with respect to the reference coordinate Rd, and the reference coordinate is determined. The pointer cursor Pc is displayed on Rc.

Specifically, when the tilt detection unit 240 detects the tilt of the input device 300 with respect to the display screen 200s, the first reference coordinate determination unit 250 uses the reference coordinate Rd on the display screen 200s as a reference for the display screen 200s of the input device 300. The coordinates obtained by moving the input device 300 in the direction of the inclination corresponding to the magnitude of the inclination with respect to the display screen 200s of the input device 300 are determined as the reference coordinates Rc. Here, the reference coordinate Rc is located in the direction facing the end of the input device 300. The display control unit 270 controls the display panel 210 so that the pointer cursor Pc is displayed at the reference coordinate Rc.

After that, the input determination unit 260 determines the input on the display screen 200s. As described above with reference to FIG. 6C, the input determination unit 260 has the first reference coordinate determination unit 250 in the hover state when the input device 300 transitions from the hover state to the touch state in which the input device 300 touches the touch panel 220. With the determined reference coordinate Rc as the reference position, the input based on the touch input operation detected by the touch panel 220 in the touch state is determined.

In FIG. 8B, the reference coordinates Rc are located in the direction toward the end of the input device 300, but the present embodiment is not limited to this. The reference coordinate Rc does not have to be located in the direction facing the end of the input device 300. For example, the position of the reference coordinate Rc may move beyond the direction in which the end of the input device 300 faces.

As shown in FIG. 8C, when the input device 300 is tilted in the hover region HB with respect to the display screen 200s, the reference coordinate Rc is determined as a position corresponding to the tilt of the input device 300 with respect to the reference coordinate Rd, and the reference coordinate is determined. The pointer cursor Pc is displayed on Rc.

Specifically, the tilt detection unit 240 detects the tilt of the input device 300 with respect to the display screen 200s. The first reference coordinate determination unit 250 determines the reference coordinate Rc based on the inclination of the input device 300 with respect to the display screen 200s with reference to the reference coordinate Rd on the display screen 200s. Here, the reference coordinate Rc moves in the direction in which the direction of the end of the input device 300 has changed, exceeding the amount in which the direction of the input device 300 has changed. The display control unit 270 controls the display panel 210 so that the reference image Rg is displayed at the reference coordinates Rd.

After that, the input determination unit 260 determines the input on the display screen 200s. As described above with reference to FIG. 6C, when the input determination unit 260 transitions from the hover state to the touch state, the input determination unit 260 touches the reference coordinate Rc determined by the first reference coordinate determination unit 250 in the hover state as a reference position. The input based on the touch input operation detected by the touch panel 220 in the state is determined.

As described above, the reference coordinate Rd for determining the reference coordinate Rc may be set in advance. Thereby, the reference coordinate Rc can be determined with reference to a predetermined position. The reference coordinate Rd for determining the reference coordinate Rc may be set according to the posture of the input device 300.

Next, the touch input system 100 of the present embodiment will be described with reference to FIGS. 1 to 10C. FIG. 9 is a block diagram of the touch input system 100. The block diagram of FIG. 9 has the same configuration as the block diagram of the touch input system 100 described above with reference to FIG. 4, except that the input device 300 further includes a setting operation unit 330, and is redundant. The description of duplication is omitted for the purpose of avoiding it.

As shown in FIG. 9, in the touch input system 100, the input device 300 further includes a setting operation unit 330. The setting operation unit 330 can perform a setting operation for selecting and setting one of the valid state and the invalid state of the determination of the reference coordinate Rc.

The setting operation unit 330 may include a button provided on the housing 302. For example, the operator may perform an operation of determining the reference coordinate Rc while pressing the button. In this case, the operator can perform a normal input operation without pressing the button. For example, in a normal input operation, when the input device 300 is in the hover state, the reference coordinates may be located directly under the input device 300. In FIG. 9, the hover coordinates Hc indicate the position directly below the input device 300 on the display screen 200s in the hover state.

Alternatively, the operator may perform an input operation for determining the reference coordinate Rc while sliding the button to one side. In this case, the operator can perform a normal input operation by sliding the button to the other side. The input device side communication unit 320 transmits a signal indicating this setting operation to the display device side communication unit 230.

The first reference coordinate determination unit 250 changes the presence / absence of determination of the reference coordinate Rc according to the setting of the setting operation unit 330. Specifically, the first reference coordinate determination unit 250 determines the reference coordinate Rc when the valid state of the determination of the reference coordinate Rc is set in the setting operation unit 330. On the other hand, the first reference coordinate determination unit 250 does not determine the reference coordinate Rc when the setting operation unit 330 sets the invalid state of the determination of the reference coordinate Rc. At this time, the first reference coordinate determination unit 250 may determine the hover coordinate Hc. As described above, the validity and invalidity of the reference coordinates Rc may be selectable according to the setting of the setting operation unit 330.

Next, the reference coordinate Rd, which is a reference when determining the reference coordinate Rc, will be described with reference to FIGS. 1 to 10D. 10A to 10D are schematic perspective views for explaining the reference coordinates Rd in the touch input system 100 of the present embodiment. Here, the reference for determining the hover coordinate Hc as the reference coordinate Rc is set according to the input device 300.

As shown in FIG. 10A, a hover region HB is formed on the entire surface of the display device 200. If the input device 300 is not located in the hover area HB, the display device 200 cannot detect the input device 300.

As shown in FIG. 10B, when the input device 300 is in the hover state, the display device 200 detects the input device 300. Here, the input device 300 is tilted with respect to the display screen 200s of the display device 200.

For example, when the setting operation unit 330 invalidates the determination of the reference coordinate Rc, the touch panel 220 detects the hover coordinate Hc of the input device 300. The hover coordinates Hc indicate the position directly below the input device 300 on the display screen 200s in the hover state. In this case, the display device 200 displays the pointer cursor Pc as a predetermined image at the hover coordinates Hc.

For example, since the wireless signal output from the display device 200 changes due to the presence of the input device 300, the position of the input device 300 can be specified by the signal received by the communication unit 230 on the display device side. Therefore, the display panel 210 can display a predetermined image at the hover coordinates Hc directly below the input device 300.

As shown in FIG. 10C, when the determination of the reference coordinate Rc is switched from invalid to valid in the setting operation unit 330, the display device 200 moves the pointer cursor Pc corresponding to the inclination of the input device 300 with respect to the display screen 200s. To display.

The display device 200 determines the reference coordinate Rc based on the inclination of the input device 300 with respect to the display screen 200s, and displays the pointer cursor Pc at the position of the reference coordinate Rc. The pointer cursor Pc is located at a position corresponding to the tilt of the input device 300 with respect to the display screen 200s. The pointer cursor Pc moves according to the tilt of the input device 300 with respect to the display screen 200s.

The first reference coordinate determination unit 250 determines the reference coordinate Rc based on the inclination of the input device 300 detected by the inclination detection unit 240 with respect to the display screen 200s in the hover state in which the input device 300 floats with respect to the touch panel 220. The display control unit 270 displays the pointer cursor Pc as a predetermined image for displaying the reference coordinates Rc on the display screen 200s in the hover state.

As shown in FIG. 10D, the input device 300 approaches the display screen 200s of the display device 200 and touches the touch panel 220 at the coordinates Tc. Here, the input device 300 linearly approaches the display screen 200s from the position where the reference coordinate Rc is determined, and comes into contact with the coordinate Tc of the touch panel 220.

At this time, the position of the pointer cursor Pc remains the reference coordinate Rc. When the input device 300 comes into contact with the coordinates Tc of the touch panel 220, a touch input operation is performed on the reference coordinates Rc on the touch panel 220.

As an example, the input device 300 can select an object (for example, an icon) located at the reference coordinate Rc by tapping the coordinate Tc of the touch panel 220. In this case, the software program corresponding to the object located at the reference coordinate Rc may be started. Alternatively, the folder corresponding to the object located at the reference coordinate Rc may be opened.

The embodiment of the present invention has been described above with reference to the drawings. However, the present invention is not limited to the above embodiment, and can be implemented as an embodiment in various embodiments without departing from the gist thereof. In addition, various inventions can be formed by appropriately combining the plurality of components disclosed in the above embodiments. For example, some components may be removed from all the components shown in the embodiments. In order to make the drawings easier to understand, each component is schematically shown, and the number of each component shown may differ from the actual one due to the convenience of drawing. Further, each component shown in the above embodiment is an example, and is not particularly limited, and various modifications can be made without substantially deviating from the effect of the present invention.

The present invention is useful in the field of touch input systems.

100 Touch input system 200 Display device 210 Display panel 220 Touch panel 230 Display device side communication unit 240 Tilt detection unit 250 First reference coordinate judgment unit 260 Input judgment unit 270 Display control unit 300 Input device 320 Input device side communication unit

Claims (7)

A display panel that displays images on the display screen, and
A touch panel that detects touch input operations on the display screen, and
An input device that performs the touch input operation on the touch panel, and
A tilt detection unit that detects the tilt of the input device with respect to the display screen, and
The first reference coordinate determination unit that determines the first reference coordinates on the display screen,
An input determination unit that determines input on the display screen,
A display control unit that controls the display of images on the display screen,
It is a touch input system equipped with
The first reference coordinate determination unit determines the first reference coordinates based on the inclination of the input device with respect to the display screen detected by the inclination detection unit in a hover state in which the input device floats with respect to the touch panel. ,
The input determination unit uses the first reference coordinates determined by the first reference coordinate determination unit in the hover state as a reference when the input device transitions from the hover state to the touch state in which the input device touches the touch panel. As a position, a touch input system that determines an input based on the touch input operation detected by the touch panel in the touch state. The touch input system according to claim 1, wherein the display control unit displays a predetermined image displaying the first reference coordinates on the display screen in the hover state. The touch input operation is a writing input operation for drawing an image by writing on the display screen.
The input determination unit uses the first reference coordinate determined by the first reference coordinate determination unit in the hover state as a start position for writing input, and the writing input based on the writing input operation detected by the touch panel in the touch state. Judging,
The touch input system according to claim 1 or 2, wherein the display control unit displays an image corresponding to the writing input determined by the input determination unit on the display screen. The first reference coordinate determination unit moves in the direction of inclination of the input device with respect to the display screen with reference to the second reference coordinates on the display screen, corresponding to the magnitude of the inclination of the input device with respect to the display screen. The touch input system according to any one of claims 1 to 3, wherein the coordinates moved by the amount are determined as the first reference coordinates. The touch input system according to claim 4, wherein the first reference coordinate determination unit uses a preset position on the display screen as the second reference coordinate. The touch panel detects the hover coordinates of the input device, which is a position directly below the input device on the display screen in the hover state.
The touch input system according to claim 4, wherein the first reference coordinate determination unit uses the hover coordinates of the input device detected by the touch panel as the second reference coordinates. The input device is a setting operation unit that performs a setting operation for selecting and setting either a valid state or an invalid state of the determination of the first reference coordinate, and an input for transmitting information of the setting operation to the display device. It has a communication unit on the device side and has
The display device further includes a display device-side communication unit that communicates with the input device-side communication unit.
The first reference coordinate determination unit is
When the valid state is set, the determination of the first reference coordinate is performed.
The touch input system according to any one of claims 1 to 6, wherein the determination of the first reference coordinate is not performed when the invalid state is set.

Images