JP6818258B2 - Instruction device, reading method, program and touch sensor system - Google Patents

Description

The present invention relates to instruction devices, reading methods, programs and touch sensor systems.

Conventionally, as a touch panel capable of detecting a plurality of simultaneous touch inputs, a capacitance method for reading a change in electric charge of sensors arranged in a matrix is known (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2011-138469

In the conventional touch panel technology, it is assumed that the touch panel is touched by a human finger, and the reading of the conductive pattern using a floating conductive material or the like is not assumed. Therefore, the inventor has considered placing this instruction device on the touch panel by using an instruction device having a conductive pattern such as a floating conductive material.

However, it is necessary to detect the change in capacitance on the touch panel side based on the floating conductive material, but since the amount of change in capacitance based on the floating conductive material is small, the amount of change is distinguished from the amount of change due to noise. It is difficult to do. Further, considering the ghost touch or the ghost point, an instruction device having a simple configuration has not been realized. Therefore, it has been difficult to realize an instruction device having a conductive pattern with a simple configuration.

Therefore, one of the objects of the present invention is to provide a novel system having a simple configuration and capable of appropriately detecting a change in capacitance.

The touch sensor system according to the present invention is an electrode having an area including two or more and a predetermined number or less of intersections of a plurality of drive lines and a plurality of sense lines included in a capacitive touch panel. When an instruction device having one or more on at least one surface is mounted on the touch panel, an increase in capacitance based on the electrode is applied to the adjacent intersections under the instruction device. Based on the position of the detection unit that detects through the sense line, the comparison unit that compares the detected increase in capacitance and the threshold, and the position of the intersection that has the increase in capacitance that is greater than or equal to the threshold. A reading unit for reading a pattern formed from the electrodes is provided.

According to the present invention, it is possible to provide a novel system having a simple configuration and capable of appropriately detecting a change in capacitance.

It is a conceptual diagram which shows an example of the touch sensor system in an embodiment. It is a figure which shows typically the example of the partial plane composition of the touch panel in embodiment. (A) is an equivalent circuit diagram of a capacitance type touch sensor system, and (B) is an equivalent circuit diagram for explaining a capacitance detection method by finger touch. (A) is an equivalent circuit diagram showing a case where the drive signal applied to the drive line is a low voltage, and (B) is an equivalent circuit diagram showing a case where the drive signal applied to the drive line is a high voltage. It is a figure for demonstrating the predetermined size of an electrode. It is a figure which shows an example of the increase of a capacitance C according to the size of an electrode. (A) shows a case where no finger or indicating device 20 is placed on the intersection (sensor), (B) shows an example in which a positive peak appears in noise, and (C) shows an example. Is a diagram showing an example in which an electrode is read, (D) is a diagram showing a more specific data output example 1, and (E) is a diagram showing a more specific data output example 2. It is a figure which shows the example of data when a finger touches from the top of an instruction device. (A) shows Example 1 of the conductive pattern in the indicating device, (A) shows Example 2 of the conductive pattern in the indicating device, and (A) shows Example 3 of the conductive pattern in the indicating device. It is a figure. It is a figure which shows an example of the layout of a conductive pattern. It is a figure which shows an example of the code information by the electrode arranged on the circumference. It is a figure which shows an example of the whole structure of the touch sensor system in embodiment. It is a figure which shows an example of the functional structure of the control part shown in FIG. It is a figure which shows an example of the functional structure of the generation part shown in FIG. It is a figure which shows an example of the functional structure of the processing terminal in an embodiment. It is a figure for demonstrating an example in which a character is appropriately displayed by the position and angle of an instruction device. It is a figure for demonstrating an example of recognizing a unique ID of an instruction device. It is a figure for demonstrating the recognition of an instruction device and interlocking with a touch panel. (A) shows an example of a card-shaped instruction device, and (B) is a diagram showing an example of a rectangular parallelepiped instruction device. It is a flowchart which shows an example of the processing of the control part in an embodiment. It is a flowchart which shows an example of the reading process in Embodiment. It is a flowchart which shows an example of the touch process in Embodiment. It is a flowchart which shows an example of the display control processing in embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are merely examples, and there is no intention of excluding the application of various modifications and techniques not specified below. That is, the present invention can be implemented with various modifications (combining each embodiment, etc.) without departing from the spirit of the present invention. Further, in the description of the following drawings, the same or similar parts are represented by the same or similar reference numerals. The drawings are schematic and do not necessarily match the actual dimensions and ratios. Even between drawings, parts with different dimensional relationships and ratios may be included.

[Embodiment]
Hereinafter, the touch sensor system according to the embodiment of the present invention will be described with reference to the drawings.

<Overview of touch sensor system>
FIG. 1 is a conceptual diagram showing an example of the touch sensor system 1 in the embodiment. In the example shown in FIG. 1, the touch sensor system 1 includes a touch panel 10, and an instruction device 20 is placed so as to face the screen of the touch panel 10. The touch sensor system 1 may or may not include the instruction device 20 as a separate configuration.

The instruction device 20 has a conductive pattern (hereinafter, also simply referred to as “pattern”) 22 having a predetermined shape that can be arranged so as to face the screen of the touch panel 10. For example, when the instruction device 20 is brought into contact with or brought close to the screen of the touch panel 10 of the touch sensor system 1 that enables a position input operation of an indicator such as a finger, the touch sensor system 1 is set as described later. The conductive pattern 22 of the shape can be read.

The conductive pattern 22 is formed based on the positions of one or more electrodes. For example, as this electrode, a transparent electrode such as ITO (Indium Tin Oxide) as a conductive material may be used, or a solid electrode such as aluminum may be used.

From the viewpoint of security, the conductive pattern 22 may be made invisible from the outside by using a transparent electrode as the conductive material. When a material other than the transparent electrode is used as the conductive material of the conductive pattern 22, the surface of the conductive pattern 22 may be coated with an opaque member (resin or the like) so that it cannot be seen from the outside. Good.

Further, the conductive pattern 22 has various patterns formed by interspersing the electrodes as a plan view shape from the surface of the touch panel 10. The shape of the conductive pattern 22 represents code information such as unique ID information for identifying a user or an instruction device 20 and installation information indicating a position or an angle. By expressing the unique ID information or the like by using the difference in the shape of the conductive pattern 22, it is possible to identify whether or not the conductive pattern 22 is present by the change of the signal read from the sensor of the touch panel 10.

Further, it is desirable that the instruction device 20 has the surface side on which the conductive pattern 22 is formed placed on the sensor screen of the touch panel 10. This makes it easier to read the shape seen from the sensor screen of the touch panel 10. The conductive pattern 22 may be arranged on one surface of the indicating device 20 as a tangible member such as a flat surface or a three-dimensional object.

Next, the configuration of a partial plane of the touch panel 10 will be described. FIG. 2 is a diagram schematically showing a partial planar configuration example of the touch panel 10. In the example shown in FIG. 2, in the capacitance type touch panel 10, an AC signal called a drive signal is applied to a plurality of drive lines L11 to 14 arranged substantially parallel to the Y direction. Further, the plurality of sense lines L21 to 24 arranged substantially parallel to the X direction intersect with each drive line at a substantially right angle, and a change in the current signal waveform of each intersection (each sensor) P is detected. That is, a change in the capacitance C is detected at each location of each intersection P.

At this time, the current signal waveform at the corresponding intersection increases or decreases when no indicator (including a finger equivalent) is placed on the sensor surface of the touch panel 10 and when the indicator is placed. To do. The touch sensor system 1 reads the increase / decrease in the waveform and uses this amount of change as the amount of change in the capacitance C. The drive lines L11 to 14 and the sense lines L21 to 24 may be inverted, and the line to which the drive signal is applied and the line to be sensed may be alternately exchanged.

(Capacity detection by finger touch)
FIG. 3A is an equivalent circuit diagram corresponding to each intersection of the capacitive touch sensor system 1. FIG. 3B is an equivalent circuit diagram for explaining the capacitance detection method by finger touch.

In the example shown in FIG. 3A, the capacitance type touch sensor system 1 applies a drive voltage to the drive line, detects the current I at the sense line, and the detected current I changes (change in capacitance C). ) Reads the touch position. In this case, when the user's finger touches the sensor surface of the touch panel 10, it can be regarded as being grounded in parallel at both ends of the capacitance C via the capacitances C1 and C2, as shown in FIG. 3B. ..

Compared to the state where nothing is placed on the sensor surface of the touch panel 10 of the touch sensor system 1, as shown in FIG. 3 (B), an indicator 5 such as a user's finger is placed on the sensor surface. In the state, the touch sensor system 1 is grounded at both ends of the capacitance C via the capacitances C1 and C2 in parallel. Therefore, the current I2 flowing through the ammeter A is smaller than the current I by the amount of the current I1 as compared with the state in which the indicator 5 is not placed. Due to this decrease in current, the capacitance C also decreases. Therefore, the touch sensor system 1 can determine that the finger touch is made at the position of the intersection where the capacitance C is reduced.

(Capacity detection by touch of instruction device 10)
FIG. 4 is an equivalent circuit diagram in a state where the instruction device 20 is placed at one intersection (sensor) on the sensor screen of the touch panel 10 of the capacitive touch sensor system 1. FIG. 4A is an equivalent circuit diagram showing a case where the drive signal applied to the drive line is a low voltage. FIG. 4B is an equivalent circuit diagram showing a case where the drive signal applied to the drive line is a high voltage.

As shown in FIGS. 4A and 4B, when the indicating device 20 having the conductive pattern 22 is placed on the touch panel 10 of the capacitive touch sensor system 1, the touch sensor system 1 The circuit is equivalent to the state in which the stray capacitance C3 is inserted in parallel with the drive line and the sense line of the drive. In this state, when the AC drive signal to the drive line is inverted from low voltage to high voltage and from high voltage to low voltage, a current flows in the parallel circuit of the capacitance C and the stray capacitance C3, and the charged capacitance is charged. The electric charge of C and the floating capacitance C3 flows from the indicating device 20 side to the touch sensor system 1, and the electric charge for charging the capacitance C and the floating capacitance C3 flows from the touch sensor system 1 side to the indicating device side. Therefore, the current flowing through the ammeter A via the sense line increases. It is judged that this has increased the capacitance.

That is, when the touch panel 10 is touched with a finger, a current flows to the finger side and the sensed current I decreases. Due to this decrease in current, the capacitance C also decreases. Utilizing this phenomenon, the touch sensor system 1 determines that the finger touch is performed at the position where the capacitance C is reduced.

On the other hand, in the case of the instruction device 20, a current flows from the instruction device 20 side, and the sensed current I increases. As a result, the touch sensor system 1 determines that the capacitance has increased.

In this way, when the touch panel 10 is touched with a finger, the capacitance C at the intersection (sensor) changes in the decreasing direction, and when the indicating device 20 having the conductive pattern 22 touches the touch panel 10, the intersection The capacitance C in the above changes in the increasing direction.

In the embodiment, attention is paid to an increase in capacitance C due to the indicating device 20. When the size of the electrode provided in the indicating device 20 is examined, the size tends to be reduced as much as possible in order to increase the variation of the code information represented by the electrode pattern in the limited space. Therefore, it is conceivable that the electrode has a size of the smallest unit including one intersection and not two intersections.

However, the inventor does not make the electrodes the smallest unit size, but by using electrodes of a predetermined size that are larger than the smallest unit, the static sense is sensed using interference between adjacent sensors that are normally avoided. Increase the amount of change in the capacitance C. The inventor has found that the value of the capacitance C can be detected by using the phenomenon that the amount of change in the capacitance C due to the interference between the adjacent sensors increases.

<Relationship between electrode size and capacitance>
Next, it will be described with reference to FIGS. 5 and 6 that the capacitance corresponding to the electrode can be suitably detected in the electrode of a predetermined size used in the embodiment. FIG. 5 is a diagram for explaining a predetermined size of the electrode. FIG. 6 is a diagram showing an example of an increase in capacitance C according to the size of the electrode.

The electrode E10 shown in FIG. 5 indicates, for example, an electrode having a size of the smallest unit that includes one intersection (sensor) P11. FIG. 6A shows a change in the capacitance of the intersection P11 located under the placement of the electrode E10 shown in FIG. As shown in FIG. 6A, a current flows from the electrode E10 side, the sensed current increases, and the capacitance increases, but since the amount of stray capacitance C3 is small, the amount of increase is small. is there. Therefore, it is difficult to distinguish this increase amount from white noise and the like.

Next, the electrode E12 shown in FIG. 5 indicates an electrode of a predetermined size used in the embodiment. The predetermined size means a size including two or more and a predetermined number or less of intersections of the touch panel 10. The predetermined number may vary depending on the performance of the touch panel, but is, for example, 9. Further, the predetermined size may be a size including an intersection of 2 × 2 or more and 3 × 3 or less or less than. The size including the intersection of 2 × 2 or more and 3 × 3 or less means the size based on the intersection of 2 × 2, 2 × 3, 3 × 2, or 3 × 3. With this size, the adjacent intersections P21 and P22 located under the placement of the electrode E10 cause current transfer due to interference between adjacent sensors, and the current flowing through these intersections P21 and P22 increases. Occurs (hereinafter also referred to as the "bridge effect"). Interference between adjacent sensors means that stray capacitance is generated between the electrodes on the upper part of the sensor and the electrodes on the upper part of the sensor in addition to the electrodes on the upper part of the predetermined sensor, and the current flowing through the sensor increases due to the stray capacitance. In addition to the increase in stray capacitance, another factor that increases the current flowing through the sensor is that charge exchange occurs due to the potential difference between the bridged sensors. Therefore, the inventor increases the amount of change in the capacitance C of these intersections P21 and P22 to the extent that they can be distinguished from noise, so that the touch sensor system 1 has electrodes E12 at the positions of the intersections P21 and P22. I found that I could read that.

FIG. 6B shows the change in capacitance of the intersections P21 and P22 located under the placement of the electrode E12 shown in FIG. As shown in FIG. 6B, a current flows from the electrode E12 side, and the capacitance C at the intersections P21 and P22 increases. At this time, as described above, since the adjacent intersections P21 and P22 are connected by the bridge effect, the amount of current flowing through each other increases more than the amount of current shown in FIG. 6A. Therefore, if the threshold Th1 is appropriately set, the touch sensor system 1 can detect this increase amount and can read that the electrodes E12 are located at the intersections P21 and P22.

Finally, the electrode E14 shown in FIG. 5 shows an electrode of a size that is too large for use in the embodiment. The size that is too large refers to a size that includes, for example, 5 × 5 or more intersections of the touch panel 10. Intersections P31 to 35 are located under the placement of the electrode E14, and the change in capacitance C at each of these intersections is shown in FIG. 6 (C).

FIG. 6C shows the change in capacitance of the intersections P31 to 35 located under the placement of the electrode E14 shown in FIG. As shown in FIG. 6C, at the size of the electrode E14 shown in FIG. 5, the amount of increase in capacitance is less than the threshold Th1 at the central intersection P33 or the like, so that the touch sensor system 1 is appropriately one. It cannot be recognized that it is a pattern. This is because the central portion of the electrode E14 has the same effect as virtual grounding by the flat antenna and is canceled in the direction in which the current value becomes smaller, so that the detected current value becomes smaller and the sensor such as the intersection P33 This is because the sensitivity is lowered and the change in the capacitance C cannot be detected appropriately.

On the other hand, the intersections P31 and P35 at the ends of the electrodes E14 exceed the threshold Th1 and are recognized by the touch sensor system 1 because the amount of change in the capacitance C increases due to the bridge effect described above. Therefore, while the electrode E14 is one electrode E14, the touch sensor system 1 detects it at two positions (intersections P31 and P35), so that an appropriate pattern cannot be read. Therefore, in the embodiment, since the electrode is detected using the threshold value Th1 shown in FIG. 6, the size of the electrode E14 shown in FIG. 5 is too large, and the touch sensor system 1 appropriately detects the electrode E14. I can't.

<Example of data detected by touch sensor system 1>
Next, an example of data detected by the touch sensor system 1 will be described. FIG. 7 is a diagram for explaining each example of data detected by the touch sensor system 1. In the example shown in FIG. 7, for simplicity, white noise is indicated by plus or minus 30. Further, in the example shown in FIG. 7, since the size (area) of the electrode is known, it is assumed that the size is used for determining the electrode.

(When there is nothing on the sensor)
FIG. 7A shows a case where neither a finger nor an instruction device 20 is placed on the intersection (sensor). As shown in FIG. 7A, a minute amount of white noise is output from the sensor.

(When a positive peak appears in the noise)
The electrode used in the embodiment has a predetermined size as described with reference to the electrode E12 shown in FIG. Therefore, the sensor value (hereinafter, also referred to as “data”) not only simply exceeds the threshold Th1 shown in FIG. 6, but also includes data exceeding the threshold (hereinafter, also referred to as “peak”) in the adjacent region. The contact or proximity of the indicating device 20 is also recognized using the area. The adjacent region means an region in which the positions of these sensors are combined if the positions of the sensors that have detected peaks are adjacent to each other. The touch sensor system 1 recognizes the contact or proximity by the indicating device 20 by comparing the sensed capacity with the threshold value or using the size of the area of the adjacent region.

FIG. 7B is a diagram showing an example in which a positive peak appears in the noise. In the example shown in FIG. 7B, the capacity threshold Th1 is 300, and the area threshold Th2 is the area of the region formed from the four intersections. Regarding the area, the touch sensor system 1 may recognize that the position of the sensor indicating the capacity of the threshold Th1 or more is 2 × 2 or more.

According to the example shown in FIG. 7B, since the peak is one point and the area of the adjacent region is not the size formed from at least four intersections, the touch sensor system 1 recognizes this peak as noise. To do.

Regarding the area, similarly to the lower limit, the touch sensor system 1 excludes the case where the area is too large as a result of disturbance. Since the electrode size (code size) is known, both the upper limit and the lower limit can be set. The upper limit is, for example, the area of the region formed from a 3 × 3 intersection.

(When the electrode is read)
FIG. 7C is a diagram showing an example in which the electrode E is read. In the example shown in FIG. 7C, it is assumed that the electrode E is placed in the central 2 × 2 region. As shown in FIG. 7C, since the peak has an adjacent region of 2 × 2 or more, the touch sensor system 1 reads this portion as a part of the electrode of the pattern. The touch sensor system 1 can read the position of the electrode more accurately by obtaining the position of the center of gravity of the output data belonging to the peak.

(More specific data output example 1)
FIG. 7D is a diagram showing a more specific data output example 1. In the example shown in FIG. 7 (D), it is assumed that the electrode E is placed in the central 2 × 2 region. As a specific data output tendency in this case, the value of the portion around the outside of the electrode decreases due to the effect of virtual grounding. Also, if the electrodes are only slightly mounted on the sensor, or if the electrodes are in the vicinity of the sensor (within the radiation range due to the alternating current of the drive circuit), the effect of virtual grounding is stronger than the bridge effect, so the data data As for the output, it is considered that the value tends to decrease. For example, the position of -100 corresponds to the outer edge. Even if the indicating device 20 is not directly placed on the intersection (sensor), it may be affected only by being in the vicinity.

It should be noted that so-called ghost touches or ghost points (hereinafter, also referred to as "ghosts") tend to appear at the four corners where the effects of the grounding of the indicating device 20 intersect. It is well known that this ghost appears at the reaction intersection. Further, depending on the positional relationship between the electrodes of the indicating device 20 and the intersection (sensor), or the degree of overlap, the peaks do not appear in a beautiful 2 × 2, and the shapes and sizes may differ. Therefore, as described above, the touch sensor system 1 performs peak detection by determining the threshold value of the data and determining the area of the adjacent region. As a result, the position of the electrode can be appropriately recognized.

(When the hand touches the instruction device 20 mounted on the touch panel 10)
FIG. 7 (E) is a diagram showing a more specific data output example 2. In the example shown in FIG. 7 (E), the indicator device 20 including the electrode E is placed at the positions of the second and third columns from the right and the third and fourth rows from the top, and this position is set from above the indicator device 20. Suppose the user touches with a hand (eg, a finger). At this time, in the existing touch reaction (reaction sensed as a negative value region) by the human body, a region that is relatively upwardly convex appears due to the influence of the stray capacitance of the electrode described above. This is because when the values in the 3rd or 4th row from the top are signal-arranged, an upwardly convex region appears in the graph that is generally downwardly convex, that is, there is at least one maximum value and the minimum value. The signal array is such that the number of values> the number of maximum values. It should be noted that this condition is determined within a predetermined range affected by the touch of the hand. This signal arrangement will be described with reference to FIG. Also, the sensor is affected more extensively by hand touch than by electrode placement, and the change in capacitance is significantly greater by hand touch than by electrode placement. Therefore, in the touch sensor system 1, when there is an intersection (sensor) having a predetermined increase amount in the amount of change in capacitance equal to or less than a predetermined negative value, the position based on the intersection is determined from above the indicating device. It may be determined that the touch is made by the hand of.

FIG. 8 is a diagram showing an example of data when a hand touches the instruction device 20 from above. For example, the value (data) of the capacitance C shown in FIG. 8 shows the data in the third row from the top shown in FIG. 7 (E). The position of the intersection P41 shown in FIG. 8 represents the position of the data in the third row from the top and the second column from the right shown in FIG. 7 (E). As shown in FIG. 8, when the indicating device 20 is touched by a hand, the graph has at least one maximum value and satisfies the condition of the number of minimum values> the number of maximum values.

As a result, the detection filter A for the conductive pattern 22 and the detection filter B for touching by hand or the like use the property that the change in capacitance by hand is concave and the change in capacitance by electrodes is convex. By properly using the two types of filters, the touch sensor system 1 can detect the code input and the touch input independently. The detection filter A obtains a positive peak in the direction opposite to that of a normal touch sensor. The detection filter B obtains a negative peak in the same manner as a normal touch sensor. If a human directly touches the conductive pattern 22, the conductive pattern 22 and the human are electrically connected and integrated with each other. Therefore, a "gap" that prevents the human from directly touching the conductive pattern 22. It is preferable to provide the indicator device 20 with an insulating member such as "thickness of the base material".

The shape of the electrode is preferably circular in consideration of the appearance of so-called ghosts and the determination of the center of gravity, and stable position detection is performed regardless of the rotation of the indicating device 20 or the like.

<Example of conductive pattern 22>
Next, an example of the conductive pattern 22 having a plurality of electrodes described above will be described. FIG. 9A is a diagram showing Example 1 of the conductive pattern 22 in the indicating device. In the example shown in FIG. 9A, the indicating device 20A has a rectangular shape such as a rectangle, and the conductive pattern 22 is composed of a pattern to which a plurality of circular electrodes E are attached.

FIG. 9B is a diagram showing Example 2 of the conductive pattern 22 in the indicating device. In the example shown in FIG. 9B, the indicating device 20B has a rectangular shape such as a square, and the conductive pattern 22 is composed of a pattern to which a plurality of circular electrodes E are attached.

FIG. 9C is a diagram showing Example 3 of the conductive pattern 22 in the indicating device. In the example shown in FIG. 9C, the indicating device 20C has a circular shape, and the conductive pattern 22 is composed of a pattern to which a plurality of circular electrodes E are attached.

By using the conductive pattern 22 as described above, each electrode of a predetermined size causes a current to flow into an adjacent sensor due to the bridge effect, and the amount of change in capacitance increases to distinguish it from noise. It becomes easier to detect. Therefore, the conductive pattern 22 can be appropriately read, and the touch sensor system 1 can appropriately recognize the code information. Further, by using the conductive pattern 22 in the embodiment, it is possible to provide a novel instruction device having a simple configuration and capable of appropriately detecting a change in capacitance.

<Pattern shape>
Even if the above-mentioned electrodes are used, there may be a layout in which code recognition is not stable. The reason for this is that the inventor's experiment has shown that when a plurality of electrodes are arranged on the same drive line / sense line, the sensitivity decreases toward the end. This is not a problem if it has a large capacitance such as the human body, but if it is a stray capacitance, the capacitance is small, so this layout will have an adverse effect. Therefore, the layout is adjusted so that many electrodes do not line up on the same line and on orthogonal lines.

FIG. 10 is a diagram showing an example of the layout of the conductive pattern 22. FIG. 10A is a diagram showing layout 1. The indicator device 20D shown in FIG. 10 (A) has a square shape, and each electrode is arranged so that the number of electrodes arranged on the same line and orthogonal lines is a certain number or less. As a result, it has been confirmed that even if the device 20D is placed so that the electrodes are lined up on the drive line / sense line, the required sensitivity is ensured and the code recognition is stable.

FIG. 10B is a diagram showing layout 2 of the conductive pattern 22. The indicator device 20E has a circular shape, and since the electrodes are arranged on the circumference so that the electrodes are dispersed in each line, only two electrodes can be lined up on the same line and the orthogonal lines at the maximum. This has been confirmed to stabilize code recognition. In the layout shown in FIGS. 10A and 10B, each electrode is arranged on the circumference.

As described above, since the conductive pattern 22 can be provided in a plane, the conductive pattern 22 can be formed on the thin card-shaped indicating device 20.

<Example of code information>
Next, the code information represented by the conductive pattern 22 will be described. FIG. 11 is a diagram showing an example of code information by electrodes arranged on the circumference.

The electrodes E21 to 23 are for recognizing the position (x, y) and orientation (angle: θ) of the indicating device 20. The position and orientation of the indicating device 20 can be determined based on the position and orientation of the triangle formed from the electrodes E21 to 23.

Further, the electrode E31 is a bit for parity check. Electrodes E41 to 46 are ID bits. The ID bit for the ID can be used to represent the ID of the instruction device 20, the ID of the user, and the like.

<Overall configuration example of touch sensor system>
FIG. 12 is a diagram showing an example of the overall configuration of the touch sensor system 1 according to the embodiment. In the example shown in FIG. 12, the touch sensor system 1 includes a display device 2 including a touch panel 10, a control board 4 including a control unit 6, and a processing terminal 8. The touch panel 10 is connected to the control board 4 by a flexible printed circuit board (FPC) or the like. The control unit 6 is connected to the processing terminal 8 by using a connection cable connected via the control board 4. The processing terminal 8 is connected to the display device 2.

The display device 2 has a display screen for displaying an image, and a touch panel 10 is provided on the display screen. As the display device 2, for example, in addition to a liquid crystal display, a plasma display, an organic EL display, an electrolytic discharge display, and the like, any display device 2 may be used as long as it is displayed on the display screen.

The touch panel 10 is provided parallel to each other along the touch panel surface, has a plurality of drive lines to which drive signals are given, and is further parallel to each other along the touch panel surface so as to intersect the plurality of drive lines. It has a plurality of provided sense lines. "Cross" refers to grade separation and includes vertical crossings and crossings at other angles.

The touch panel 10 outputs an output signal according to a change in capacitance due to a contact or proximity indicator (finger or touch pen) or the indicator device 20. The plurality of output signals from the plurality of sense lines are signals that are output via the intersection of the drive line and the sense line in the touch panel surface or a portion in the vicinity thereof by driving the drive line.

If the finger or the indicating device 20 is in contact with or close to the touch panel surface, the signal from the sense line changes. That is, the signal obtained by this sense line is the position coordinates (x, y) of the two-dimensional instruction detection area indicating the presence or absence of contact or proximity to the instruction detection area (touch panel area), and the finger or the instruction device 20. It becomes a signal which shows the three-dimensional coordinate information which shows the information (w) of the capacitance by. The smaller the W value of the capacitance information (w), the smaller the signal level indicating the capacitance value.

In this regard, as described above, when the finger touches or approaches the touch panel (including the case where the finger touches or approaches the touch panel 20 from above), the W value of the capacitance information (w) becomes a negative value. On the other hand, when the indicating device 20 is in contact with or close to the indicating device 20, the W value of the capacitance information (w) becomes a positive value. As described above, the touch sensor system 1 can independently detect the code input and the touch input by properly using two types of filters, a filter for the conductive pattern 22 and a filter for touching with a finger or the like. ..

The control unit 6 is, for example, a processor or the like, and drives each drive line and processes signals from each sense line to detect a contact position (conducting pattern detection region) of the instruction device 20 or the like on the touch panel surface. To do.

The processing terminal 8 is, for example, a personal computer or the like, and controls the control unit 6 via a connection cable, and also provides information on the position coordinates (x, y) and capacitance (w) of the instruction device 20 detected by the control unit 6. ), The display of the image displayed on the display screen of the display device 2 can be controlled.

Further, the processing terminal 8 connected to the touch sensor system 1 may be provided on the server side like a cloud service, and the touch sensor system 1 itself may be provided with the function of the processing terminal 8 to control the display. It is possible.

<< Configuration of control unit 6 >>
FIG. 13 is a diagram showing an example of the functional configuration of the control unit 6 shown in FIG. In the example shown in FIG. 13, the control unit 6 includes a drive unit 102, an amplification unit 104, a signal acquisition unit 106, a conversion unit 108, a processing unit 110, a setting unit 112, and a generation unit 114. The drive unit 102 sequentially applies to the drive line to drive the unit.

The amplification unit 104 amplifies each of the plurality of output signals output from the plurality of sense lines, and outputs each amplified output signal.

The signal acquisition unit 106 acquires each output signal amplified by the amplification unit 104 and outputs an analog signal by time division.

The conversion unit 108 converts the analog signal output by the signal acquisition unit 106 into a digital signal, and outputs the converted digital signal.

The processing unit 110 obtains the distribution of the amount of change in capacitance in the surface (detection surface) of the touch panel 10 based on the digital signal converted by the conversion unit 108, and outputs this distribution.

The setting unit 112 has a capacitance threshold Th1 used when detecting position information (x, y) indicating a contact position of a finger or the like in the surface of the touch panel 10 and position information (x, y) of a detection region of a conductive pattern. And the area threshold Th2 are set in advance.

Based on each threshold value, the generation unit 114 provides position information indicating the contact position of a finger or the like and the position information of the conductive pattern 22 of the instruction device 20 with respect to the distribution of the change in capacitance obtained by the processing unit 110. Generate.

FIG. 14 is a diagram showing an example of the functional configuration of the generation unit 114 shown in FIG. The generation unit 114 shown in FIG. 14 includes a detection unit 1142, a comparison unit 1144, a reading unit 1146, and a determination unit 1148.

The detection unit 1142 is, for example, 2 × 2 or more and less than 3 × 3 (2 × 2, 2 × 3, or 3 × 2) among a plurality of intersections of a plurality of drive lines and a plurality of sense lines included in the touch panel 10. At an intersection located under the indicating device 20 having one or more electrodes having an area including the intersection of the above, changes in capacitance based on the electrodes are detected via a sense line having the intersection. The detection unit 1142 detects, for example, a change in capacitance at each intersection from the distribution of the amount of change in capacitance acquired from the processing unit 110.

The comparison unit 1144 compares the amount of change in capacitance detected by the detection unit 1142 with the threshold value. For example, when the capacitance C increases, the comparison unit 1144 compares the amount of change in the increased capacitance with the threshold Th1.

As a result of comparison, the reading unit 1146 reads a pattern formed from one or more electrodes based on an intersection having a change in capacitance that is equal to or higher than the threshold Th1. For example, the reading unit 1146 reads the conductive pattern 22 based on the positions of one or a plurality of electrodes having a threshold value Th1 or more. As a result, the conductive pattern 22 can be appropriately read with a simple configuration.

The determination unit 1148 determines whether or not there is an intersection having a predetermined increase amount within a predetermined negative value or less with respect to the change amount of the capacitance detected in the plurality of sense lines located around the indicating device 20. Is determined. Further, the determination unit 1148 has at least one maximum value and the number of minimum values> the maximum value in the two-dimensional distribution representing the amount of change in capacitance detected in the plurality of sense lines under the indicating device 20. Determine if there is a number of regions. For example, the determination unit 1148 determines whether or not a region that is convex upward is included in the graph that is convex downward (concave shape) as a whole, as shown in FIG.

The determination unit 1148 has a positive determination result (there is a sensor showing a predetermined increase amount within a predetermined negative value or less, or at least one maximum value and the number of minimum values> the number of maximum values). If there is an area), it may be determined that the user is touching the position based on this maximum value. As a result, even when the user touches the instruction device 20 with a finger, it can be detected. Further, as for the touch of the finger on the touch panel 10, if the amount of change in the capacitance is a negative value and is equal to or less than a predetermined threshold value by using a known technique, the touch by the finger can be detected.

Further, the comparison unit 1144 may read the electrode pattern based on the size of the region connecting the adjacent intersections when the intersections having a change in capacitance equal to or more than the threshold value are adjacent to each other. As a result, noise and the like can be removed, and the conductive pattern 22 can be read more appropriately.

<< Configuration of processing terminal 8 >>
Next, the functional configuration of the processing terminal 8 will be described. FIG. 15 is a diagram showing an example of the functional configuration of the processing terminal 8 in the embodiment. The processing terminal 8 shown in FIG. 15 includes a pattern acquisition unit 202, a code recognition unit 204, a display control unit 206, and an operation control unit 208. Each part of the processing terminal 8 can be implemented by a processor, RAM as a work memory, or the like.

The pattern acquisition unit 202 acquires the conductive pattern 22 output by the control unit 6 of the control board 4, and outputs the acquired conductive pattern 22.

The code recognition unit 204 recognizes the code information based on the conductive pattern 22 acquired from the pattern acquisition unit 202. The code recognition unit 204 holds in advance various patterns and a corresponding table of code information corresponding to the patterns. The code recognition unit 204 collates the acquired conductive pattern with the pattern in the corresponding table, and as a result of the collation, recognizes the code information corresponding to the matched pattern.

Further, the code recognition unit 204 recognizes the position and orientation (angle) of the instruction device 20 by the conductive pattern 22. The code recognition unit 204 outputs the recognized information to the display control unit 206. The code information may include the unique ID, position, and angle of the instruction device 20.

The display control unit 206 performs display control on the display screen of the display device 2 based on the code information recognized by the code recognition unit 204. For example, the display control unit 206 keeps the code information and the display information associated with each other, and controls the display information corresponding to the acquired code information to be displayed at a position related to the contact position of the instruction device 20.

More specifically, the display control unit 206 controls the character corresponding to the code information to be displayed in the instruction device 20 based on the position and orientation of the instruction device 20. At this time, it is preferable that a transparent electrode such as ITO is used for the conductive pattern 22, and a transparent device is also used for the indicating device 20.

Further, the display control unit 206 controls to display the operation menu, the operation button, and the like on the display screen based on the position of the instruction device 20. Further, since the touch from the instruction device 20 can be detected, the display control unit 206 may control to display an operation button or the like within the area of the instruction device.

The operation control unit 208 performs operation control based on the touch of the user's finger or the like on the touch panel 10. For example, when the operation menu or operation button related to the instruction device 20 is operated, the operation control unit 208 performs control corresponding to the operation. For example, in a game or the like, the operation control unit 208 controls the progress of the game based on the operation buttons.

Further, the display control unit 206 controls the display object displayed on the display screen based on the operation control by the operation control unit 208. For example, the display control unit 206 displays the game execution screen on the display screen, and controls the game execution screen based on the pressing of the operation button displayed via the touch panel 10.

<Specific example of the game>
Next, the game using the touch sensor system 1 described above will be described with reference to FIGS. 16 to 18. Here, it is assumed that the soccer field is displayed on the display screen and the character is displayed in the area of the instruction device 20. Further, it is assumed that the indicating device 20 is a transparent member or a transparent member, and the conductive pattern is also formed by a transparent electrode such as ITO. Here, "transparent" and "transparent" also include a degree of transparency in which the previous object can be visually recognized through the member.

FIG. 16 is a diagram for explaining an example in which a character is appropriately displayed depending on the position and angle of the instruction device 20. In the example shown in FIG. 16, based on the position and angle of the instruction device 20 recognized by the code recognition unit 204 and the unique ID, the display control unit 206 arranges the instruction device 20 of the touch panel 10 in the vicinity of the area. The character corresponding to the unique ID can be displayed in a direction fixed relative to the instruction device 20. For example, even if the orientation of the instruction device 20 is changed, the displayed character is displayed in the instruction device 20 following the change in the orientation.

Further, the display control unit 206 displays a predetermined character corresponding to the ID or the like of the instruction device in each instruction device 20 even when a plurality of instruction devices 20 are placed on the touch panel 10. Can be done.

FIG. 17 is a diagram for explaining an example of recognizing the unique ID of the instruction device 20. First, the code recognition unit 204 acquires code information based on the recognized shape of the conductive pattern 22. The code information is, for example, a unique ID of the instruction device 20. As a result, the code recognition unit 204 can acquire a unique ID for each instruction device 20.

In the example shown in FIG. 17, unique IDs (101 to 103) corresponding to each instruction device 20 are displayed in the area where the instruction device 20 of the touch panel 10 is arranged. Actually, the display control unit 206 can control the character corresponding to this unique ID to be displayed at the mounting position of the instruction device 20 on the display screen (see, for example, FIG. 16).

FIG. 18 is a diagram for explaining the recognition of the instruction device 20 and the interlocking with the touch panel 20. In the touch sensor system 1 of the embodiment, not only the code input by the instruction device 20 but also the touch input by a finger or the like is possible. Therefore, as shown in FIG. 18, the display control unit 206 may display the operation menu M10 or the operation button B10 in the area related to the position of the instruction device 20 based on the position and angle of the instruction device 20. In the example shown in FIG. 18, the operation of the displayed operation menu M10 and the operation button B10 is detected by using the touch panel 10, and the display control unit 206 performs display control according to the detected content.

As a result, in the embodiment, as compared with the non-transparent instruction device 20, a display object such as a character can be displayed in the area of the instruction device 20, and the display content is not obstructed by the instruction device 20, so that the display screen is displayed. It can be used entirely.

In particular, it is advantageous that the display control unit 206 can display at least a display object under the conductive pattern 22 of the instruction device 20 mounted on the touch panel 10. As a result, the user can visually recognize the display object displayed on the display screen through the transparent conductive pattern 22.

It is also possible to change the display of the character corresponding to the unique ID of the instruction device 20 according to the progress of the game. For example, by associating the game status information with the unique ID, the display control unit 206 can change the display of the character according to the status information.

Further, since the position of the instruction device 20 is detected even if the instruction device 20 is not transparent and the user cannot visually recognize the display object displayed under the instruction device 20, the display control unit 206 may perform the instruction device 20. It is also possible to display the display object displayed below in association with the position of the instruction device 20. The display control unit 206 can also control the display so that the moving object bypasses the area of the indicating device 20 when the route of the displayed moving object is predicted to pass under the indicating device 20.

As another example, the touch sensor system 1 in the embodiment can be applied to a puzzle display or the like. For example, the display control unit 206 displays puzzle pieces in the area below the instruction device 20 placed on the touch panel 10, aligns the positions and orientations of the plurality of instruction devices 20, and arranges them side by side on the touch panel 10. It can be made into one pattern.

At this time, even with the same instruction device 20, the user can enjoy puzzles with different completed patterns by changing the pattern associated with the unique ID.

<Example of shape of instruction device>
Next, a shape example of the instruction device 20 will be described. FIG. 19 is a diagram showing a shape example of the instruction device 20 used in the embodiment. FIG. 19A is a diagram showing an example of a card-shaped indicating device 20. In the example shown in FIG. 19A, the pattern of the transparent electrode E is provided on the positive surface (outer surface) of the indicating device 20 in the Z direction. Further, the pattern of the transparent electrode E may be provided on the negative surface (inner side surface) of the indicating device 20 in the Z direction.

FIG. 19B is a diagram showing an example of a rectangular parallelepiped indicating device 20. In the example shown in FIG. 19B, the pattern of the transparent electrode E is provided on the positive surface (outer surface) of the indicating device 20 in the Z direction. When the outer surface is placed so as to face the touch panel 10, a half mirror or a half prism is used inside the rectangular parallelepiped, and the display object displayed under the instruction device 20 is inside or above the instruction device 10. A display object (for example, a character) may appear (image) on the screen.

Further, by providing a multi-faceted half mirror or a half prism inside the rectangular parallelepiped, it is possible to display a display object that can be seen three-dimensionally from each direction of 360 degrees. At that time, the display control unit 106 sets the display object corresponding to each of the display objects to be displayed in the area under each surface inside the rectangular parallelepiped indicating device 20. For example, the front surface, right side surface, back surface, left side surface, etc. of the character are displayed and controlled at positions displayed according to the half mirrors and half prisms of the respective surfaces.

The instruction device 20 may also be a cylinder, a cone, a polygonal prism, a polygonal pyramid, a stuffed animal, a doll, or the like.

<Operation>
Next, the operation of the touch sensor system 1 in the embodiment will be described. FIG. 20 is a flowchart showing an example of the processing of the control unit 6 in the embodiment. In step S102 shown in FIG. 20, the control unit 6 detects a change in capacitance at each intersection (each sensor) of the touch panel 10.

In step S104, the control unit 6 reads the conductive pattern 22 of the instruction device 20. This reading process will be described later with reference to FIG.

In step S106, the control unit 6 performs a process of determining a touch with a finger or the like. This touch process will be described later with reference to FIG.

As described above, in the embodiment, since the pattern reading process and the touch process can be implemented by different algorithms, the threshold value and the like for each process can be appropriately set, and therefore each process can be appropriately executed. ..

FIG. 21 is a flowchart showing an example of the reading process in the embodiment. In step S202 shown in FIG. 21, the comparison unit 1144 determines whether or not the amount of change in the capacitance of a certain sensor detected by the detection unit 1142 is equal to or greater than the threshold Th1. If the amount of change is the threshold Th1 or more (step S202-YES), the process proceeds to step S204, and if the amount of change is less than the threshold Th1 (step S202-NO), the process proceeds to step S206.

In step S204, the generation unit 114 specifies the position of the sensor (hereinafter, this position is also referred to as “specific position”) that becomes the threshold value Th1 or more.

In step S206, the generation unit 114 determines whether or not the sensors in the entire area of the touch panel 10 have been processed. If the sensors in the entire area are processed (step S206-YES), the process proceeds to step S208, and if the sensors in the entire area are not processed (step S206-NO), the process returns to step S202 and another process is performed. The process of step S202 is performed in the change of the capacitance by the sensor.

In step S208, the comparison unit 1144 acquires a specific position.

In step S210, the comparison unit 1144 determines whether or not the position adjacent to the acquired specific position is also another specific position. If the adjacent position is a specific position (step S210-YES), the process proceeds to step S212, and if the adjacent position is not a specific position (step S210-NO), the process proceeds to step S218.

In step S212, the comparison unit 1144 makes a region in which a certain specific position and an adjacent position are connected.

In step S214, the comparison unit 1144 determines whether or not the size of the connecting region is the threshold Th2 or more. The threshold Th2 is a region formed from a 2 × 2 intersection. If the size of the connection region is the threshold Th2 or more (step S214-YES), the process proceeds to step S216, and if the size of the connection region is less than the threshold Th2 (step S214-NO), the process proceeds to step S218. Since the size of the electrode is known, the upper limit of the size of the connecting region may be set.

In step S216, the reading unit 1146 reads the position with respect to this connecting region as the position of the individual electrodes forming the conductive pattern.

In step S218, the generation unit 114 determines whether or not the processing has been performed at all the specific positions. If the processing is performed at all specific positions (step S218-YES), the processing is completed, and if the processing is not performed at all specific positions (step S218-NO), step S208 so that other specific positions are acquired. Return to.

As a result, the position of the electrode forming the conductive pattern can be appropriately read by obtaining a positive peak in the direction opposite to that of the normal touch sensor. The read electrode positions are transmitted to the processing terminal 8.

FIG. 22 is a flowchart showing an example of touch processing in the embodiment. In step S302 shown in FIG. 22, in the two-dimensional distribution represented by the amount of change in capacitance, the determination unit 1148 has at least one maximum value and a region where the number of minimum values> the number of maximum values. Determine if it exists. If the determination result is affirmative (step S302-YES), the process proceeds to step S304, and if the determination result is negative (step S302-NO), the process ends. The determination unit 1148 may determine whether or not there is an intersection having a predetermined increase amount within a predetermined negative value with respect to the change amount of the capacitance.

In step S304, the determination unit 1148 determines whether or not the region where the determination result is affirmative is within the predetermined size. For example, the predetermined size is determined based on the size of the indicating device 20. If the determination result is affirmative (step S304-YES), the process proceeds to step S306, and if the determination result is negative (step S304-NO), the process ends.

In step S306, the determination unit 1148 determines that it is a touch on the instruction device 20. This makes it possible to detect a touch on the instruction device 20, which has been difficult in the past. The touch on the touch panel 10 can be detected by using a known technique.

FIG. 23 is a flowchart showing an example of the display control process in the embodiment. In step S402 shown in FIG. 23, the pattern acquisition unit 202 of the processing terminal 8 acquires the conductive pattern 22.

In step S404, the code recognition unit 204 identifies the position and angle of the indicating device 20, the unique ID, and the like based on the position and shape of the conductive pattern.

In step S406, the display control unit 206 determines an image (display object) corresponding to the specified unique ID.

In step S408, the display control unit 206 controls to display the determined image in a related area such as under the instruction device 20 based on the specified position and angle.

Thereby, the display on the display screen can be controlled based on the conductive pattern 22 read by the instruction device 20. Further, as described above, the display control unit 206 can display an operation menu or the like and control the display based on the operation content.

The processing steps included in the processing flow described with reference to FIGS. 20 to 23 can be arbitrarily changed in order or executed in parallel as long as the processing contents do not conflict with each other, and each processing step. Other steps may be added in between. Further, the steps described as one step for convenience can be executed by being divided into a plurality of steps, while those described as one step can be grasped as one step for convenience.

Although the embodiment of the technique disclosed in the present application has been described above, the technique disclosed in the present application is not limited to the above example.

For example, in the above-described embodiment, the mutual capacity type touch panel has been described, but the above-mentioned instruction device can also be applied to the self-capacity type touch panel. In the self-capacitance type touch panel, the capacitance works in the direction of increasing by touching the human body. However, since there is a large difference in the amount of increase between the human body touch and the floating, it is possible to distinguish the difference by appropriately setting the threshold Th1. Therefore, even with a self-capacity touch panel, touch recognition by the above-mentioned instruction device becomes possible.

In the present invention, the "part", "means", "device", and "system" do not simply mean physical means, but the "part", "means", "device", and "system". Including the case where the function of "" is realized by software. Further, even if the functions of one "part", "means", "device", or "system" are realized by two or more physical means or devices, two or more "parts" or "means", The functions of "device" and "system" may be realized by one physical means or device.

1 Touch sensor system 2 Display device 4 Control board 6 Control unit 8 Processing terminal 10 Touch panel 20 Instruction device 22 Conductive pattern 114 Generation unit 202 Pattern acquisition unit 204 Code recognition unit 206 Display control unit 208 Operation control unit 1142 Detection unit 1144 Comparison unit 1146 Reading unit 1148 Judgment unit

Claims (3)

An instruction device on which each electrode is arranged is placed on a touch panel, the instruction device is detected by a capacitance type touch sensor, the position of the instruction device is specified based on the position of each electrode, and the position of each electrode is determined. the character corresponding to the identification information recognized by the pattern displayed on the touch panel, front SL according to the game status information associated with the identification information, the display of the character corresponding to the identification information is changed, and , The game system in which the character is displayed transparently through the instruction device or is displayed in association with the position of the device. The game system according to claim 1, further specifying the orientation of the indicating device based on the orientation of the shape formed from each of the electrodes. The game system according to claim 1 or 2, wherein the indicating device is a transparent member or a transparent member, and each transparent electrode, which is each of the electrodes, forms a conductive pattern of the pattern.

Images