CN112486347B - Touch display device, touch pen, touch display system and touch detection method thereof - Google Patents
Touch display device, touch pen, touch display system and touch detection method thereof Download PDFInfo
- Publication number
- CN112486347B CN112486347B CN201910865836.0A CN201910865836A CN112486347B CN 112486347 B CN112486347 B CN 112486347B CN 201910865836 A CN201910865836 A CN 201910865836A CN 112486347 B CN112486347 B CN 112486347B
- Authority
- CN
- China
- Prior art keywords
- touch
- modulation
- signal
- light source
- infrared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0412—Digitisers structurally integrated in a display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a touch display device, a touch pen, a touch display system and a touch detection method thereof, wherein when the touch pen contacts the display surface of the touch display device, the touch pen receives modulated light waves emitted by the touch display device; the touch control pen analyzes the modulation signal carried by the modulation light wave and sends the analyzed modulation signal to a processor of the touch control display device; the processor starts the infrared component corresponding to the corresponding modulation light source in the illumination area of the display surface according to the received modulation signal; and the processor determines the position of the current touch point according to the detection result of the infrared assembly. The touch display device of the touch display system emits the modulated light wave, and the touch pen can detect the modulated signal of the modulated light wave, so that the processor can quickly position the touch point in the illumination area corresponding to the modulated light source which sends out the modulated signal. The problems of high time delay and low precision of the existing infrared touch detection technology are solved.
Description
Technical Field
The present invention relates to the field of display technologies, and in particular, to a touch display device, a touch pen, a touch display system, and a touch detection method thereof.
Background
The smart television is a television product which is based on an internet application technology, has an open operating system and an open application platform, can realize a bidirectional man-machine interaction function, integrates various functions such as audio and video, entertainment, data and the like, and meets the diversified and personalized requirements of users. At present, compared with a smart television controlled by a remote controller, a smart television with a touch function is more and more popular with users. The infrared touch technology is a widely used technology.
The basic principle of the infrared touch technology is as follows: the method comprises the steps that infrared transmitting elements and receiving elements are arranged on the periphery of a touch screen, the infrared transmitting elements transmit infrared light, whether touch points and touch positions exist on the screen or not is confirmed by judging whether the receiving elements receive the infrared light, and the process needs that all the infrared transmitting and receiving elements on the periphery of the touch screen are continuously subjected to cyclic detection according to a certain sequence until the touch positions are confirmed. The larger the size of the touch screen is, the more infrared transmitting and receiving elements are required, the longer the time consumption of the whole cyclic detection process is, and the longer the touch delay is caused.
Disclosure of Invention
The invention provides a touch display device, a touch pen, a touch display system and a touch detection method thereof, which are used for improving infrared touch precision and reducing response delay.
In a first aspect, the present invention provides a touch display device, including a backlight module, a display panel located at a light exit side of the backlight module, a plurality of infrared components located at a side of the display panel away from the backlight module, and a processor electrically connected to the plurality of infrared components;
wherein, backlight unit includes: a plurality of light sources arranged in an array; at least part of the light sources are modulated light sources;
the modulation light source is used for emitting modulation light waves so that a matched touch control pen receives the modulation light waves when contacting a display surface of the touch control display device and analyzes modulation signals carried by the modulation light waves; the modulated light wave carries a modulated signal, and the modulated signal is used for uniquely identifying a modulated light source;
the processor is configured to turn on the infrared component corresponding to the modulated light source corresponding to the modulated signal in the illumination area of the display surface, and determine the position of the current touch point according to a detection result of the infrared component.
In a possible implementation manner, in the touch display device provided by the invention, in a minimum quadrilateral formed by four modulated light sources, two modulated light sources on any diagonal line are tangent or intersect in an illumination area of the display surface.
In a possible implementation manner, in the touch display device provided by the present invention, the modulation signal is a digital signal formed by modulating a light source to flicker at a set frequency; the set frequency is greater than 200MHz.
In a second aspect, the present invention provides a stylus comprising: the photoelectric converter and the microprocessor connected with the photoelectric converter;
the photoelectric converter is used for receiving modulated light waves emitted by the touch display device when the touch pen is in contact with a display surface of the touch display device used in a matched manner, and converting the received modulated light waves into electric signals; the modulated light wave carries a modulated signal, and the modulated signal is used for uniquely identifying a modulated light source;
and the microprocessor is used for analyzing the modulation signal carried by the modulation light wave according to the electric signal so as to enable a processor of the touch display device which is used in a matched mode to start an infrared assembly, corresponding to the modulation light source, of the modulation signal, in the illumination area of the display surface, and determining the position of the current touch point according to the detection result of the infrared assembly.
In a third aspect, the present invention provides a touch display system, including any one of the touch display devices and any one of the touch pens.
In a fourth aspect, the present invention provides a touch detection method based on the touch display system, including:
when a touch pen is contacted with a display surface of a touch display device, the touch pen receives modulated light waves emitted by the touch display device;
the touch control pen analyzes the modulation signal carried by the modulation light wave and sends the analyzed modulation signal to a processor;
the processor starts the corresponding infrared component of the modulation light source corresponding to the illumination area of the display surface according to the received modulation signal;
and the processor determines the position of the current touch point according to the detection result of the infrared assembly.
In a possible implementation manner, in the foregoing method provided by the present invention, the sending, by the stylus, the resolved modulation signal to a processor includes:
the stylus pen sends the analyzed modulation signal carrying the identification information of the stylus pen to the processor; the identification information of the stylus is used for uniquely identifying the stylus.
In a possible implementation manner, in the foregoing method provided by the present invention, the turning on, by the processor, an infrared component corresponding to an illumination area of the display surface by a corresponding modulated light source according to the received modulation signal includes:
judging whether the received identification information is unique;
when the number of the identification information is determined to be 1, turning on an infrared assembly corresponding to a modulation light source corresponding to a modulation signal of the touch pen in an illumination area of the display surface according to the identification information;
and when the number of the identification information is determined to be larger than 1, respectively starting the infrared assemblies corresponding to the modulation light sources corresponding to the modulation signals of the touch pens in the illumination areas of the display surface according to the identification information.
In one possible implementation, the processor performs the following operations for the modulated signal of each stylus:
judging whether the received modulation signal is unique;
when the number of the modulation signals is determined to be 1, turning on infrared components corresponding to the modulation light sources corresponding to the modulation signals in the illumination area of the display surface;
and when the number of the modulation signals is determined to be larger than 1, starting an infrared assembly corresponding to the modulation light source corresponding to any one modulation signal in the illumination area of the display surface.
In a possible implementation manner, in the foregoing method provided by the present invention, the turning on of the infrared component corresponding to the illumination area of the display surface by the modulated light source corresponding to any one of the modulated signals is performed by using a binary digital signal, and the method includes:
and turning on the infrared component corresponding to the modulation light source corresponding to the minimum modulation signal in the illumination area of the display surface.
The invention has the following beneficial effects:
the invention provides a touch display device, a touch pen, a touch display system and a touch detection method thereof, wherein when the touch pen contacts a display surface of the touch display device, the touch pen receives modulated light waves emitted by the touch display device; the touch control pen analyzes the modulation signal carried by the modulation light wave and sends the analyzed modulation signal to a processor of the touch control display device; the processor starts the corresponding infrared component of the modulation light source corresponding to the illumination area of the display surface according to the received modulation signal; and the processor determines the position of the current touch point according to the detection result of the infrared assembly. By the method, the rough range where the touch point is located is determined quickly, and then the position of the touch point is accurately positioned in the rough range, so that the touch time delay is reduced, and the touch positioning accuracy is improved.
Drawings
Fig. 1 is a schematic cross-sectional view illustrating a touch display device according to an embodiment of the invention;
fig. 2 is a schematic top view of a light source array according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a modulated light source array arranged at a maximum pitch according to an embodiment of the present invention;
FIG. 4 is a waveform diagram of a modulation signal indicating coordinates (3, 4) of a modulated light source according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a corresponding relationship between an infrared module and a modulated light source in an illumination area in a display surface according to an embodiment of the present invention;
fig. 6 is a second schematic cross-sectional view illustrating a touch display device according to an embodiment of the invention;
fig. 7 is a schematic structural diagram of a stylus according to an embodiment of the present invention;
fig. 8 is a data protocol for data transmission between a stylus and a touch display device according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a touch display system according to an embodiment of the present invention;
fig. 10 is a flowchart of a touch detection method of a touch detection system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
The touch display device, the touch pen, the touch display system and the touch detection method thereof according to the embodiments of the present invention are described in detail below with reference to the accompanying drawings.
In a first aspect of an embodiment of the present invention, a touch display device is provided, and fig. 1 is a schematic cross-sectional structure diagram of the touch display device provided in the embodiment of the present invention, as shown in fig. 1, the touch display device includes: the backlight module 100, the display panel 200 located at the light-emitting side of the backlight module 100, the plurality of infrared components 300 located around the display panel 200, and the processor 400 electrically connected with the infrared components 300. The infrared components 300 are used for infrared touch detection. The backlight module 100 includes a plurality of light sources 11 arranged in an array, and at least some of the light sources are modulated light sources 11'. Fig. 2 is a schematic diagram of a top view structure of the backlight module 100 in fig. 1, wherein the modulated light source 11' is used for emitting a modulated light wave, so that a touch pen used in cooperation receives the modulated light wave when contacting a display surface of the display device, and analyzes a modulation signal carried by the modulated light wave, and transmits an analysis result to the processor 400. Then, the processor 400 turns on the infrared component corresponding to the modulated light source corresponding to the modulated signal in the illumination area of the display surface, and determines the position of the current touch point according to the detection result of the infrared component.
In the existing infrared touch detection technology, all infrared components around the touch display device need to be continuously circularly detected according to a certain sequence until the touch position is confirmed, and the detection period is long. The touch control point is quickly positioned in the illumination area of the modulated light source corresponding to the modulated light wave received by the touch control pen, and the position of the current touch control point is detected only by starting the infrared assembly in the illumination area, so that the touch control detection time is shortened. The saved time can be used for optimizing a touch detection algorithm and improving the touch detection precision.
Preferably, in order to make the stylus receive at least one modulated light wave at any position contacting the display surface, the illumination area of the modulated light source 11' on the display surface should cover the whole display surface. It is therefore necessary to set the spacing between the modulated light sources 11' appropriately. Fig. 3 is a schematic diagram illustrating a maximum pitch distribution of a modulated light source array according to an embodiment of the present invention. As shown in fig. 3, the illumination area of each modulated light source 11 'on the display surface is indicated by a dashed circle, and the modulated light sources intersected by two adjacent rows and two adjacent columns in the array of modulated light sources 11' form a minimum quadrangle. The illumination areas of the two modulated light sources 11' on the diagonals of the quadrilateral are tangent. Since the rows and columns of the array in fig. 3 are perpendicular to each other, the quadrilateral is a rectangle. The pitch of the modulated light sources 11' may also be set smaller than the pitch shown in fig. 3, when the illumination areas intersect. Both spacing methods achieve the purpose of modulating the illumination area of the light source 11' on the display surface to cover the entire display surface. On the basis, the touch control pen which is used in a matched mode can receive at least one modulated light wave when being contacted with any position of the contact display surface, and therefore the infrared component corresponding to the modulated light source emitting the modulated light wave is started to conduct accurate infrared touch control detection.
In practical implementation, the modulation signal carried by the modulated light wave in the embodiment of the present invention may be a digital signal. Specifically, all the modulated light sources 11 'may be numbered, and for example, when the modulated light sources are arranged in an array in the manner shown in fig. 3, the position of one modulated light source 11' may be uniquely represented by coordinates (a, b). Wherein, a represents that the modulated light source is positioned in the second row of the array, and b represents that the modulated light source is positioned in the second column of the array. The coordinates (a, b) are then uniquely represented by a whole piece of binary code, for example, the first four bits of an eight-bit binary code represent a, and the second four bits represent b. As another example, an odd bit of an eight-bit binary code is used to represent a and an even bit is used to represent b. In addition, the coordinates (a, b) may be represented by ten-bit or twelve-bit binary codes, which are not limited herein. As long as the code uniquely identifies a modulated light source. After the binary code is formed, the binary code may be formed by flashing at a set frequency, so that the modulation signal is formed in a digital modulation manner, and the modulation signal uniquely identifies the modulated light source 11' emitting the modulated light wave. In practice, it should be considered that the binary code has a number of bits that ensures that the maximum number of rows and columns of the array of modulated light sources 11' can be encoded. Fig. 4 is a waveform diagram of a modulation signal indicating coordinates (3, 4) of a modulated light source according to an embodiment of the present invention. The first four bits of the eight-bit binary code shown in fig. 4 are used to represent the row coordinate a and the last four bits are used to represent the column coordinate b. The first four bits 0011 are the binary code of the number 3 and the last four bits 0100 are the binary code of the number 4. The whole section of 8-bit binary code 00110100 represents the modulated light source in the third and fourth rows. A specific modulation method of binary code is: turning off the modulated light source to make it not emit light and represent code element 0; and turning on the modulation light source to enable the modulation light source to normally emit light, representing the code element 1, turning on/off the modulation light source at a preset frequency according to a specific code, and emitting a modulation light wave carrying the binary code modulation signal.
After receiving a light signal, the human eye briefly maintains the visual effect generated by the brain for a period of time, the period of time is called the integration time of the human eye, and the inverse of the integration time is called the integration frequency of the human eye. If the time interval between two times of flickers of the modulated light source is longer than the integration time of human eyes, the human eyes can perceive the flickers, so that inconvenience is brought to the use of the touch display device. In practical applications, the modulation frequency must therefore be greater than the integration frequency of the human eye. Preferably, in order to improve the response speed of the system and reduce the touch delay, the modulation frequency of the modulation signal may also be set to be greater than 200MHz, that is, the maximum duration of the symbol 0 or 1 is 5ns. The modulation frequency of the signal is 200MHz as shown in fig. 4. Of course, the specific encoding scheme may be varied, for example, the binary code of coordinates (3, 4) may be represented by 00100010, which represents the decimal number 34. The invention is not limited to which particular encoding scheme is used.
Referring to fig. 5, a schematic diagram of a corresponding relationship between an infrared component 300 and an illumination area of a modulation light source 11' in a display surface according to an embodiment of the present invention is shown. The infrared module 300 includes infrared emitting elements A1 to Am disposed on the first side of the display surface, infrared receiving elements A1 to Am disposed on the second side of the display surface and corresponding to the infrared emitting elements A1 to Am, infrared emitting elements B1 to Bn disposed on the third side of the display surface, and infrared receiving elements B1 to Bn disposed on the fourth side of the display surface and corresponding to the infrared emitting elements B1 to Bn. The infrared transmitting elements and the infrared receiving elements are in one-to-one correspondence, and infrared signals transmitted by the infrared transmitting elements can be received by the corresponding infrared receiving elements. As shown in fig. 5, the infrared receiving element A1 may receive the infrared light wave emitted by the infrared emitting element A1, the infrared receiving element B1 may receive the infrared light wave emitted by the infrared emitting element B1, and so on. Generally, the connecting line of the corresponding set of infrared transmitting/receiving elements is parallel to one side of the display surface. Each modulated light source 11' corresponds to a part of the infrared transmitting/receiving element pair, and the area surrounded by the infrared rays emitted by the part of the infrared transmitting/receiving element pair must completely cover the illumination area of the modulated light source on the display surface. One possible implementation, for example, shown in fig. 5, is: the circle indicated by the thick dotted line in fig. 5 is an illumination area of the modulated light source (2, 3), and its corresponding infrared emitting element includes A9 to a15 at the first side and B5 to B10 at the third side, and its corresponding infrared receiving element includes A9 to a15 at the second side and B5 to B10 at the fourth side. By using the corresponding relation, when the matched touch pen detects the modulated light waves emitted by the modulated light sources (2, 3) when contacting the display surface, and performs information transmission with the processor 400, the processor 400 turns on the infrared emitting elements A9 to a15, B5 to B10 and the infrared receiving elements A9 to a15, B5 to B10, so as to perform touch detection in the range. If the stylus detects modulated light waves emitted by a plurality of modulated light sources at the same time, after information transmission is performed with the processor 400, the processor 400 turns on infrared emitting/receiving elements corresponding to the detected plurality of modulated light sources for touch detection. Or, preferably, one of the plurality of modulated light sources, for example, the smaller one of the binary codes, may be selected, and the infrared emitting/receiving element pair corresponding to the modulated light source is turned on for touch detection. Thus, time consumption of touch detection can be saved. The saved time can be used for optimizing the detection algorithm to improve the detection accuracy.
Fig. 6 is a schematic cross-sectional structure diagram of a touch display device according to a second embodiment of the present invention. As shown in fig. 6, the backlight module 100 further includes an optical film 12. The optical film 12 is usually made of a reflective sheet, a brightness enhancement film, a diffusion plate, a prism sheet, a bonding film, or other commonly used films, and the optical film 12 is properly arranged to change parameters such as the emitting angle, transmittance, and polarization of the modulated light wave, so as to improve the signal-to-noise ratio of the touch pen in use, improve the accuracy of analyzing the modulated signal, and reduce the probability of misjudging the touch point by the touch display device.
In a second aspect of the embodiments of the present invention, a touch pen is provided. The touch pen is matched with the touch display device for use, so that the position of a touch point is positioned. Fig. 7 is a schematic structural diagram of a stylus according to an embodiment of the invention. As shown in fig. 7, the stylus pen 500 includes a photoelectric converter 51 and a microprocessor 52 connected to the photoelectric converter 51. When the stylus pen 500 touches the display surface of the touch display device, the photoelectric converter 51 converts the modulated light wave emitted from the touch display device into an electrical signal, and the modulated signal carried in the modulated light wave is also included in the electrical signal. The microprocessor 52 determines the modulated light source emitting the modulated light wave by analyzing the electrical signal, so that the processor 400 of the touch display device used in cooperation starts the infrared components in the area corresponding to the modulated light source, and determines the position of the current touch point according to the detection result of the infrared components. The method reduces the time length of touch detection, saves time, can be used for optimizing a touch detection algorithm, and improves the touch detection precision.
In order to further improve the detection sensitivity, an amplifier connected to the photoelectric converter 51 and the microprocessor 52 may be provided in the stylus pen 500 to amplify the electric signal.
In addition, the photoelectric receiving frequency of the photoelectric converter 51 cannot be less than the modulation frequency of the modulation signal, otherwise, signal distortion may be caused, and in practical applications, the photoelectric converter 51 may employ an element such as a photodiode, and the receiving frequency thereof is not less than 200MHz. In order to allow the modulated light wave to pass through the stylus 500 and excite the photoelectric converter 51, the tip of the stylus is made of a material with high visible light transmittance. The stylus 500 may further include a communication module, which may transmit the result of the analysis by the microprocessor to the processor 400 of the touch display device in a wired or wireless manner, so that the touch display device further operates according to the result.
In some application scenarios, multiple touch pens are required to be used simultaneously, such as in educational applications, office discussions, and the like. When multiple touch pens are used together, each touch pen is provided with unique identification information, for example, a binary code is used as the identification information. The stylus may use a data protocol as shown in fig. 8 for information transmission with the processor 400. As shown in fig. 8, the signals transmitted from the stylus to the processor 400 at least include a start signal 601, stylus identification information 602, a first response signal 603, a modulated signal 604 for modulating the light source, a second response signal 605, and an end signal 606. Therein, the start signal 601 and the end signal 606 mark the start and the end of signal encoding, respectively. The first reply signal 603 marks the end of the stylus identification information 602 and the second reply signal 605 marks the end of the modulated signal 604. Thus, after receiving the signal sent by the stylus, the processor 400 can determine from which stylus the received signal came and the rough location where the touch point of the stylus is currently located.
A third aspect of the embodiment of the invention provides a touch display system, please refer to fig. 9, which is a schematic structural diagram of the touch display system provided in the embodiment of the invention. As shown in fig. 9, the touch display system includes any one of the touch display devices and one or more of the touch pens 500. The touch display device may be a display device such as a liquid crystal panel, a liquid crystal display, a liquid crystal television, or a mobile device such as a mobile phone, a tablet computer, and an electronic album, which is not limited herein.
When the touch pen 500 contacts the display surface of the touch display device, the modulated light source 11' in the backlight module radiates modulated light waves to the display surface. After receiving the modulated light wave, the stylus 500 analyzes the modulated signal carried by the modulated light wave and sends the modulated signal to the processor 400. The communication between stylus 300 and processor 400 may be by wired data transmission or wireless data transmission. The processor 400 determines the modulated light source emitting the modulated light wave according to the analysis result, and turns on the infrared component corresponding to the illumination area of the modulated light source on the display surface for infrared touch detection, thereby determining the contact position between the stylus pen 300 and the display surface. The working principle of the touch display device and the touch pen in the touch display system can be referred to the above embodiments, and repeated descriptions are omitted. The touch display system provided by the embodiment of the invention reduces the time length of touch detection, saves time, and can be used for optimizing a touch detection algorithm and improving the touch detection precision.
After the touch point position when the touch pen touches the display device is determined, the touch interaction function can be realized by responding according to the method and steps specified by the system. The touch interactive functions include, but are not limited to, writing and drawing, rotational and translational movement, selection determination, and other interactive functions that can be realized by existing touch technologies.
A fourth aspect of the embodiment of the invention provides a touch detection method based on the touch display system, please refer to fig. 10, which is a flowchart of the touch detection method of the touch detection system according to the embodiment of the invention. As shown in fig. 10, the touch detection method may include:
and S01, when the touch pen is contacted with the display surface of the touch display device, the touch pen receives modulated light waves emitted by the touch display device.
S02, the touch pen analyzes the modulation signal carried by the modulated light wave and sends the analyzed modulation signal to a processor of the touch display device;
s03, the processor starts the corresponding infrared component of the modulation light source corresponding to the illumination area of the display surface according to the received modulation signal;
and S04, the processor determines the position of the current touch point according to the detection result of the infrared assembly.
The touch display device comprises a plurality of modulated light sources which are arranged in an array. Preferably, the illumination area of the modulated light sources on the display surface of the touch display device completely covers the whole display surface. When the stylus is in contact with the display surface, the stylus receives at least one light wave emitted by the modulated light source, regardless of the location of the point of contact. The light wave is modulated and carries modulation information, and a signal source, namely a modulation light source for emitting the light wave, can be uniquely determined according to the modulation information. One possible solution is: each modulated light source can be uniquely represented by coordinates (a, b), wherein a and b are respectively a row number and a column number of the modulated light source in the array, and a and b can be represented by a section of binary digit, and the binary digit signal is modulated into an optical signal and is emitted by the modulated light source.
When the stylus receives the modulated light wave from the modulated light source, the stylus includes a photoelectric converter that first converts the modulated light wave received by the stylus into an electrical signal. The electrical signal includes the modulated signal, and a microprocessor included in the stylus pen can send the modulated signal to a processor of the touch display device according to a set transmission protocol, and a specific encoding example is shown in fig. 8. However, due to the possible attenuation difference of the modulated light wave during the transmission process or the irradiation angle difference of each modulated light source at the touch position, the high level of the electrical signal may be uneven. Or the low level is influenced by the noise of the dark current of the photoelectric converter and deviates from the low level value, and one of the functions of the microprocessor is to process the electric signal into a standard digital signal. The microprocessor also functions to re-encode the digital signal according to a data transmission protocol with the processor, including adding signal start and end flags. And finally, the stylus transmits the analyzed modulation signal to the processor in a wired or wireless transmission mode.
After receiving the modulation signal, the processor may determine which modulation light source the modulation signal corresponds to, and an irradiation range of the modulation light source on the display surface, at this time, the processor may control the infrared components around the display surface corresponding to the irradiation range, and the position of the touch point may be determined by scanning of the infrared components.
Compared with the existing infrared touch detection, the touch detection method provided by the embodiment of the invention only needs to start the infrared components in the determined modulated light source irradiation area and perform local scanning detection on a small-range area, and does not need to start all the infrared components of the whole display panel to perform cyclic scanning in the whole range, so that the scanning period can be shortened, and the power consumption of the device can be reduced. The touch detection method provided by the embodiment of the invention is particularly suitable for large-size display devices, and the larger the size of the touch display device is, the more time can be saved. By using the saved time, the touch algorithm can be optimized, and the touch detection precision is further improved.
In some cases, there may be more than one stylus operating on the same touch display device, for example, in office discussions, teaching, and other cases, there may be a usage scenario where multiple styli operate the touch display device simultaneously. In order to distinguish the touch pens and detect the touch point of each touch pen, in step S02, the method for sending the analyzed modulation signal to the processor of the touch display device by the touch pen may specifically include:
the stylus pen sends the analyzed modulation signal carrying the identification information of the stylus pen to the processor; wherein the identification information of the stylus is used to uniquely identify the stylus.
In practical applications, the identification information of the stylus pen may be sent to the processor together with the modulated signal analyzed by the stylus pen, and the identification information may also be transmitted by using the same transmission protocol, and the specific format is shown in fig. 8.
Correspondingly, when the processor executes step S03, the following sub-steps may be specifically included:
judging whether the received identification information is unique;
when the number of the identification information is determined to be 1, turning on an infrared component corresponding to a modulation light source corresponding to a modulation signal of the touch pen in an illumination area of a display surface according to the identification information;
and when the number of the identification information is determined to be larger than 1, respectively starting the infrared assemblies corresponding to the modulation light sources corresponding to the modulation signals of the touch pens in the illumination areas of the display surface according to the identification information.
In this way, when the number of the received identification information is 1, it indicates that only one stylus operates the touch display device currently, and the processor only needs to perform touch detection on the stylus. And when the number of the received identification information is larger than 1, indicating that a plurality of touch pens simultaneously operate the touch display device at present. The processor can distinguish the multiple touch pens according to the identification information, so that the information sent by each touch pen can be distinguished, the touch point of each touch pen can be positioned, and the use occasion of the touch display system is expanded.
After the processor determines the number of styli, the following is performed for each stylus' modulated signal:
judging whether the received modulation signal is unique;
when the number of the modulation signals is determined to be 1, turning on an infrared assembly corresponding to a modulation light source corresponding to the modulation signals in an illumination area of the display surface;
and when the number of the modulation signals is determined to be larger than 1, turning on the infrared component corresponding to the modulation light source corresponding to any modulation signal in the illumination area of the display surface.
It can be understood that when the touch point of the stylus is located in the overlapping portion of the illumination areas of the two or more modulated light sources, the modulated light wave received by the stylus originates from the two or more modulated light sources, and then the resolved modulation signal is also greater than two or more; and when the touch point position of the touch pen is not in the overlapping area, only one modulation signal is analyzed. The stylus pen sends the analyzed modulation signals to the processor, and when the processor determines that the number of the modulation signals is larger than 1, the processor only needs to start the infrared component corresponding to the modulation light source corresponding to any one modulation signal in the modulation signals and corresponding to the illumination area of the display surface for detection, so that the range of touch detection can be reduced, and the detection efficiency is improved.
Specifically, the modulation signal may be a binary digital signal, and then in the foregoing step, turning on an infrared component corresponding to a modulated light source corresponding to any one of the modulation signals in an illumination area of the display surface may include:
and turning on an infrared component corresponding to the modulation light source corresponding to the minimum modulation signal in the illumination area of the display surface.
In addition, the maximum modulation signal may be selected from the plurality of modulation signals, or a modulation signal at an intermediate value may be selected, which is not limited herein. This alternative is only for illustration and different alternatives do not produce obvious variations in technical effect.
According to the touch display device, the touch pen, the touch display system and the touch detection method thereof provided by the embodiment of the invention, when the touch pen contacts the display surface of the touch display device, the touch pen receives modulated light waves emitted by the touch display device; the touch control pen analyzes the modulation signal carried by the modulation light wave and sends the analyzed modulation signal to a processor of the touch control display device; the processor starts the corresponding infrared component of the modulation light source corresponding to the illumination area of the display surface according to the received modulation signal; and the processor determines the position of the current touch point according to the detection result of the infrared assembly. By the method, the rough range where the touch point is located is determined quickly, and then the position of the touch point is accurately positioned in the rough range, so that the touch time delay is reduced, and the touch positioning accuracy is improved.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (7)
1. A touch display system is characterized by comprising a touch display device and a touch pen;
the touch display device comprises a backlight module, a display panel positioned on the light-emitting side of the backlight module, a plurality of infrared assemblies positioned on one side of the display panel, which is far away from the backlight module, and a processor electrically connected with the infrared assemblies; wherein, backlight unit includes: a plurality of light sources arranged in an array; at least part of the light sources are modulated light sources; the modulation light source is used for emitting modulation light waves, the modulation light waves carry modulation signals, and the modulation signals are used for uniquely identifying the modulation light source;
the touch control pen comprises a photoelectric converter and a microprocessor connected with the photoelectric converter; the photoelectric converter is used for receiving modulated light waves emitted by the touch display device when the touch pen is contacted with a display surface of the touch display device which is used in a matched mode, and converting the received modulated light waves into electric signals; the microprocessor is used for analyzing the modulation signal carried by the modulated light wave according to the electric signal and sending the analyzed modulation signal carrying the identification information of the touch pen to the processor, wherein the identification information of the touch pen is used for uniquely identifying the touch pen; the signals sent by the touch control pen to the processor at least comprise a starting signal, touch control pen identification information, a first response signal, a modulation signal for modulating a light source, a second response signal and a termination signal;
the processor is configured to turn on the infrared component corresponding to the modulated light source corresponding to the modulated signal in the illumination area of the display surface, and determine the position of the current touch point according to a detection result of the infrared component.
2. The touch display system of claim 1, wherein two of the modulated light sources on any diagonal in a smallest quadrilateral formed by four of the modulated light sources intersect or intersect at an illumination area of the display surface.
3. The touch display system of claim 1, wherein the modulation signal is a digital signal formed by flashing the modulated light source at a set frequency; the set frequency is greater than 200MHz.
4. A touch detection method based on the touch display system of any one of claims 1 to 3, comprising:
when a touch pen contacts a display surface of a touch display device, the touch pen receives modulated light waves emitted by the touch display device;
the touch control pen analyzes the modulation signal carried by the modulation light wave and sends the analyzed modulation signal carrying the identification information of the touch control pen to the processor; the identification information of the touch pen is used for uniquely identifying the touch pen, and the signals sent by the touch pen to the processor at least comprise a starting signal, the touch pen identification information, a first response signal, a modulation signal for modulating a light source, a second response signal and a termination signal;
the processor starts the corresponding infrared component of the modulation light source corresponding to the illumination area of the display surface according to the received modulation signal;
and the processor determines the position of the current touch point according to the detection result of the infrared assembly.
5. The method of claim 4, wherein the processor turns on the corresponding infrared component of the corresponding modulated light source in the illuminated area of the display surface according to the received modulated signal, comprising:
judging whether the received identification information is unique;
when the number of the identification information is determined to be 1, turning on an infrared assembly corresponding to a modulation light source corresponding to a modulation signal of the touch pen in an illumination area of the display surface according to the identification information;
and when the number of the identification information is determined to be larger than 1, respectively starting the infrared assemblies corresponding to the modulation light sources corresponding to the modulation signals of the touch pens in the illumination areas of the display surface according to the identification information.
6. The method of claim 5, wherein the processor performs the following for the modulated signal of each stylus:
judging whether the received modulation signal is unique;
when the number of the modulation signals is determined to be 1, turning on infrared components corresponding to the modulation light sources corresponding to the modulation signals in the illumination area of the display surface;
and when the number of the modulation signals is determined to be larger than 1, starting an infrared assembly corresponding to the modulation light source corresponding to any one modulation signal in the illumination area of the display surface.
7. The method of claim 6, wherein the modulation signal is a binary digital signal, and the turning on of the infrared component corresponding to the illumination area of the display surface of the modulated light source corresponding to any one of the modulation signals comprises:
and turning on an infrared component corresponding to the modulation light source corresponding to the minimum modulation signal in the illumination area of the display surface.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910865836.0A CN112486347B (en) | 2019-09-12 | 2019-09-12 | Touch display device, touch pen, touch display system and touch detection method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910865836.0A CN112486347B (en) | 2019-09-12 | 2019-09-12 | Touch display device, touch pen, touch display system and touch detection method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112486347A CN112486347A (en) | 2021-03-12 |
| CN112486347B true CN112486347B (en) | 2023-04-11 |
Family
ID=74920890
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910865836.0A Active CN112486347B (en) | 2019-09-12 | 2019-09-12 | Touch display device, touch pen, touch display system and touch detection method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112486347B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102016771A (en) * | 2008-05-09 | 2011-04-13 | 智能技术无限责任公司 | Interactive input system with controlled lighting |
| CN103649879A (en) * | 2011-07-14 | 2014-03-19 | 3M创新有限公司 | Digitizer using position-unique optical signals |
| CN104813259A (en) * | 2012-11-29 | 2015-07-29 | 3M创新有限公司 | Multi-mode stylus and digitizer system |
| CN107077226A (en) * | 2015-03-02 | 2017-08-18 | 株式会社和冠 | Active electrostatic stylus, sensor controller, the system and the method by these execution for possessing these |
| CN107102781A (en) * | 2017-04-17 | 2017-08-29 | 华东师范大学 | A kind of tagging stylus and multipoint touch interactive system |
| CN109062453A (en) * | 2018-07-28 | 2018-12-21 | 贵州华宁科技股份有限公司 | A kind of transmitting tube Scan Architecture for infrared touch screen |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180239445A1 (en) * | 2017-02-20 | 2018-08-23 | Microsoft Technology Licensing, Llc | Device and method for communicating with a stylus |
-
2019
- 2019-09-12 CN CN201910865836.0A patent/CN112486347B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102016771A (en) * | 2008-05-09 | 2011-04-13 | 智能技术无限责任公司 | Interactive input system with controlled lighting |
| CN103649879A (en) * | 2011-07-14 | 2014-03-19 | 3M创新有限公司 | Digitizer using position-unique optical signals |
| CN104813259A (en) * | 2012-11-29 | 2015-07-29 | 3M创新有限公司 | Multi-mode stylus and digitizer system |
| CN107077226A (en) * | 2015-03-02 | 2017-08-18 | 株式会社和冠 | Active electrostatic stylus, sensor controller, the system and the method by these execution for possessing these |
| CN107102781A (en) * | 2017-04-17 | 2017-08-29 | 华东师范大学 | A kind of tagging stylus and multipoint touch interactive system |
| CN109062453A (en) * | 2018-07-28 | 2018-12-21 | 贵州华宁科技股份有限公司 | A kind of transmitting tube Scan Architecture for infrared touch screen |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112486347A (en) | 2021-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10802596B2 (en) | Display device, self-luminous display panel and gesture recognition method | |
| CN105389148B (en) | Data transmission method, data receiving method, related equipment and system | |
| CN108664895B (en) | Display device and fingerprint identification method thereof | |
| KR100684252B1 (en) | Display device having optical input function | |
| JP2020504974A (en) | Display screen state control method and control apparatus | |
| US20090141001A1 (en) | Display apparatus, liquid crystal display apparatus, position detection system and position detection method | |
| CN107911554B (en) | Electronic device and control method thereof | |
| CN110299943B (en) | Data transmission control method and related product | |
| US9971921B2 (en) | Fingerprint image sensor and method for optical wireless communications using the same | |
| CN107566628B (en) | Display module, display method thereof and terminal | |
| KR20110014145A (en) | System and method for using pixels of a display device to communicate optical information over a communications link | |
| TW201027936A (en) | Light emitting device, light receiving device, data transmission system and data transmission method using the same | |
| US20170315623A1 (en) | Keyboard device with built-in sensor and light source module | |
| US20150195042A1 (en) | Transmitting data to a rolling shutter sensor array via a light emitter array | |
| CN112486347B (en) | Touch display device, touch pen, touch display system and touch detection method thereof | |
| US11169626B2 (en) | Transmitter, touch sensitive processing apparatus and processing method thereof and electronic system | |
| CN102340332B (en) | Apparatus, equipment and method for transmitting data in touch mode | |
| US20060124851A1 (en) | Omnidirectional photodetector | |
| CN108064387B (en) | Display module, biological characteristic information sensing method thereof and electronic equipment | |
| CN202257528U (en) | Screen input system | |
| CN105786177A (en) | Gesture recognition device and method | |
| KR20140065938A (en) | Method of communicatioin between display devices and display devices applied the method | |
| KR101512082B1 (en) | system and method for mode switching of electronic pen | |
| CN105657187A (en) | Visible light communication method and system and equipment | |
| CN111444841B (en) | Display assembly and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |