CN112130689A - Touch display device, touch pen, touch display system and touch detection method thereof - Google Patents
Touch display device, touch pen, touch display system and touch detection method thereof Download PDFInfo
- Publication number
- CN112130689A CN112130689A CN201910550901.0A CN201910550901A CN112130689A CN 112130689 A CN112130689 A CN 112130689A CN 201910550901 A CN201910550901 A CN 201910550901A CN 112130689 A CN112130689 A CN 112130689A
- Authority
- CN
- China
- Prior art keywords
- modulated light
- touch
- display device
- phase difference
- light source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 25
- 241001422033 Thestylus Species 0.000 claims description 44
- 230000001133 acceleration Effects 0.000 claims description 12
- 238000000034 method Methods 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 8
- 230000033001 locomotion Effects 0.000 claims description 6
- 239000012788 optical film Substances 0.000 claims description 5
- 239000011159 matrix material Substances 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 18
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000003993 interaction Effects 0.000 description 3
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0412—Digitisers structurally integrated in a display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03542—Light pens for emitting or receiving light
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a touch display device, a touch pen, a touch display system and a touch detection method thereof, wherein when the touch pen contacts the display surface of the touch display device, modulated light waves emitted by the touch display device are received; determining the phase difference of a modulation light source adjacent to the touch point position at the touch point according to the identification information carried by the received modulation light wave, the phase of the modulation light wave and the phase of the reference signal; and determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference. The touch display device of the touch display system emits the modulated light waves, the touch pen can detect the phase, and touch detection is realized by adopting a mode of determining the touch position based on the phase difference. The touch control element specially used for detecting touch control is not required to be added any more, and even if the touch control element is applied to large-screen display equipment with the size of a television, the problems of heavy overall machine, high cost and the like can not be caused.
Description
Technical Field
The invention relates to the technical field of display, in particular to a touch display device, a touch pen, a touch display system and a touch detection method thereof.
Background
The smart television is a television product which is based on an internet application technology, has an open operating system and an open application platform, can realize a bidirectional man-machine interaction function, integrates various functions such as audio and video, entertainment, data and the like, and meets the diversified and personalized requirements of users. At present, compared with an intelligent television controlled by a remote controller, the intelligent television with the touch function is more and more popular with users.
Compared with a mobile terminal, the size of the smart television is much larger, and the touch control product at the current television size level mainly applies infrared matrix detection and mutual capacitance detection, and structures (an infrared light emitting diode transmitting and receiving array, a surface-attached touch control screen and the like) are required to be added outside a display module to fix touch control elements, so that the appearance is heavy, the cost is high, and the application of a touch control function on the television product is limited.
Disclosure of Invention
The invention provides a touch display device, a touch pen, a touch display system and a touch detection method thereof.
In a first aspect, the present invention provides a touch display device, including: the display panel is positioned on the light emitting side of the backlight module;
wherein, backlight unit includes: a plurality of light sources arranged in an array;
at least part of the light sources are modulated light sources, and the modulated light sources are used for emitting modulated light waves, so that a matched touch control pen receives the modulated light waves when contacting a display surface of the display device, and the position of a touch control point is determined according to the phase difference of adjacent modulated light sources at the touch control point;
the wavelength of the modulated light wave emitted by the modulated light source is greater than that of the light wave emitted by the light source; the modulated light wave carries identification information for uniquely identifying the modulated light source emitting the modulated light wave.
In a possible implementation manner, in the touch display device provided by the invention, the wavelength of the modulated light source is greater than the length of a diagonal line of a quadrangle formed by four adjacent modulated light sources.
In a possible implementation manner, in the touch display device provided by the present invention, the frequencies of the identification information in the modulated light waves emitted by the modulated light sources are different from each other.
In a possible implementation manner, in the touch display device provided by the present invention, the length of the identification information in the modulated light wave is an integer multiple of the period of the modulated light wave.
In a possible implementation manner, in the touch display device provided by the present invention, the backlight module further includes: and the optical film is positioned on the light-emitting side of the light source.
In a second aspect, the present invention provides a stylus comprising: the photoelectric receiver, a processor connected with the photoelectric receiver, and a reference signal generator connected with the processor;
the reference signal generator is used for generating a reference signal with the same phase as the phase of the modulated light wave emitted by the matched touch display device;
the photoelectric receiver is used for receiving modulated light waves emitted by the touch display device when the touch pen is in contact with a display surface of the touch display device;
and the processor is used for determining the phase difference of a modulated light source adjacent to the touch point position in the touch display device at the touch point according to the received modulated light wave and the reference signal so as to determine the position of the touch point.
In a possible implementation manner, in the above stylus pen provided by the present invention, the number of the photoelectric receivers is at least 3, and a plurality of the photoelectric receivers are arranged in a matrix or a ring.
In a possible implementation manner, in the above stylus provided by the present invention, the stylus further includes: an accelerometer and a gyroscope connected to the processor;
the accelerometer is used for detecting the acceleration of the stylus;
the gyroscope is used for detecting the angular acceleration of the stylus;
and the processor is used for determining the motion trail of the touch control pen according to the detected acceleration and the angular acceleration.
In a possible implementation manner, in the above stylus provided by the present invention, the stylus further includes: a pressure sensor coupled to the processor;
the pressure sensor is used for detecting the contact pressure between the stylus and the display surface of the touch display device;
the processor is further configured to send the pressure signal detected by the pressure sensor to the touch display device, so that the touch display device executes a corresponding operation.
In a possible implementation manner, in the above stylus provided by the present invention, the stylus further includes: at least one function key and a communication interface for connecting communication equipment;
the processor is further configured to send a trigger signal of a corresponding function to the touch display device when the function key is pressed, so that the touch display device executes a corresponding operation.
In a third aspect, the present invention provides a touch display system, including any one of the touch display devices and any one of the touch pens.
In a fourth aspect, the present invention provides a touch detection method based on the touch display system, including:
when a touch pen is contacted with a display surface of a touch display device, receiving modulated light waves emitted by the touch display device;
determining the phase difference of a modulated light source adjacent to the touch point position at the touch point according to the identification information carried by the received modulated light wave, the phase of the modulated light wave and the phase of the reference signal;
and determining the position of the touch point according to the phase difference and the position of the modulation light source corresponding to the phase difference.
In a possible implementation manner, in the foregoing method provided by the present invention, the determining, according to the identification information carried by the received modulated light wave, the phase of the modulated light wave, and the phase of the reference signal, a phase difference at the touch point of a modulated light source adjacent to the touch point position includes:
determining the phase of the modulated light wave emitted by each modulated light source to the touch point according to the phase of the reference signal and the received identification information of the modulated light wave;
determining the positions of at least three modulated light sources adjacent to the touch point according to the phase from the modulated light waves emitted by each modulated light source to the touch point;
and determining the phase difference from the modulated light waves emitted by every two modulated light sources in the three modulated light sources adjacent to the touch point.
In a possible implementation manner, in the method provided by the present invention, the determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference includes:
respectively taking two different phase differences and the positions of the modulation light sources corresponding to the phase differences as parameters, and simulating two hyperbolic functions;
determining the intersection point position of the two hyperbolic functions in the area enclosed by the modulated light source as the position of the touch point;
and the phase difference is taken as a parameter of a horizontal axis of the hyperbolic function, and the position of the modulation light source corresponding to the phase difference is taken as a focus parameter of the hyperbolic function.
In a possible implementation manner, in the method provided by the present invention, when it is determined that the number of the modulated light sources adjacent to the touch point is 4 according to the phase of the modulated light wave emitted from each modulated light source to the touch point, the determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference includes:
respectively simulating three groups of hyperbolic functions to determine three intersection point positions;
and taking the position of the mass center of the three intersection positions as the position of the touch point.
In a possible implementation manner, in the method provided by the present invention, the determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference includes:
determining the relative position of the touch point relative to the modulation light source according to the phase difference and the position of the modulation light source corresponding to the phase difference;
and determining the position of the touch point in the display surface of the touch display device according to the relative position of the touch point relative to the modulated light source and the position of the modulated light source in the display surface of the touch display device.
The invention has the following beneficial effects:
the invention provides a touch display device, a touch pen, a touch display system and a touch detection method thereof, wherein when the touch pen contacts a display surface of the touch display device, modulated light waves emitted by the touch display device are received; determining the phase difference of a modulation light source adjacent to the touch point position at the touch point according to the identification information carried by the received modulation light wave, the phase of the modulation light wave and the phase of the reference signal; and determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference. The touch display device of the touch display system emits the modulated light waves, the touch pen can detect the phase, and touch detection is realized by adopting a mode of determining the touch position based on the phase difference. The touch control element specially used for detecting touch control is not required to be added any more, and even if the touch control element is applied to large-screen display equipment with the size of a television, the problems of heavy overall machine, high cost and the like can not be caused.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments of the present invention will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic cross-sectional view illustrating a touch display device according to an embodiment of the invention;
fig. 2 is a schematic top view of a light source array according to an embodiment of the present invention;
fig. 3a is a waveform diagram of a carrier wave emitted from a light source according to an embodiment of the present invention;
FIG. 3b is a waveform diagram of a modulation signal generated by a microcontroller according to an embodiment of the present invention;
FIG. 3c is a waveform diagram of a modulated light wave according to an embodiment of the present invention;
FIG. 4 is a waveform diagram of a modulated light wave carrying identification information according to an embodiment of the present invention;
fig. 5 is a second schematic cross-sectional view illustrating a touch display device according to an embodiment of the invention;
fig. 6 is a schematic structural diagram of a stylus according to an embodiment of the invention;
fig. 7 is a schematic diagram illustrating a principle of receiving a modulated light wave by a stylus according to an embodiment of the present invention;
fig. 8 is a schematic diagram illustrating an optimized optical path design of a photoelectric receiver according to an embodiment of the present invention;
fig. 9 is a second schematic structural diagram of a stylus according to an embodiment of the invention;
fig. 10 is a flowchart of a touch detection method of a touch display system according to an embodiment of the present invention;
FIG. 11 is a schematic diagram illustrating a phase difference principle provided by an embodiment of the present invention;
FIG. 12 is a schematic diagram of an equal phase difference circle according to an embodiment of the present invention;
FIG. 13 is a second schematic diagram of an equal phase difference circle according to an embodiment of the present invention;
FIG. 14 is a schematic diagram of a hyperbolic tuft provided in accordance with an embodiment of the present invention;
fig. 15 is a schematic diagram of relative positions of touch points according to an embodiment of the invention;
fig. 16 is a second schematic diagram illustrating relative positions of touch points according to the embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The touch display device, the touch pen, the touch display system and the touch detection method thereof according to the embodiments of the present invention are described in detail below with reference to the accompanying drawings.
In a first aspect of an embodiment of the present invention, a touch display device is provided, and fig. 1 is a schematic cross-sectional structure diagram of the touch display device provided in the embodiment of the present invention, as shown in fig. 1, the touch display device includes: a backlight module 100 and a display panel 200 located at the light-emitting side of the backlight module 100. Fig. 2 is a schematic top view of the backlight module, as shown in fig. 2, the backlight module includes: a plurality of light sources 11 arranged in an array; at least part of the light sources are modulation light sources 11 ', 11' and are used for emitting modulation light waves, so that a matched touch control pen receives the modulation light waves when contacting a display surface of the display device, and the position of a touch control point is determined according to the phase difference of adjacent modulation light sources at the touch control point.
The touch display device provided by the embodiment of the invention is matched with a touch pen capable of detecting the phase, and the touch detection is realized by adopting a mode of determining the touch position based on the phase difference. The touch control element specially used for detecting touch control is not required to be added any more, and even if the touch control element is applied to large-screen display equipment with the size of a television, the problems of heavy overall machine, high cost and the like can not be caused.
In specific implementation, the number of the modulated light sources can be determined according to the number of the light sources in the backlight module. When the number of the light sources in the backlight module is large, part of the light sources can be selected as modulation light sources, and when the number of the light sources in the backlight module is small, all the light sources can be used as modulation light sources. The light emitted by the modulated light sources needs to cover the whole area of the display surface of the touch display device, and the light emitted by two adjacent modulated light sources needs to have an overlapping area when being projected on the display surface. Therefore, when the touch pen is in contact with the touch display surface, the phase difference when the emergent light waves of the two adjacent modulated light sources reach the touch point position can be detected, and the position of the touch point is calculated according to the phase difference.
The optical signal has the characteristics of high frequency and high speed, and in order to realize the detection of the phase difference signal, the emergent light wave of the light source needs to be modulatedcThe waveform diagram of the carrier wave is shown in fig. 3 a; then, a Micro Controller Unit (MCU) is used to generate a modulation signal uΩThe waveform of the modulation signal is shown in FIG. 3b, and the generated modulation signal is used as the radiation wave of the modulated light source to modulate the modulated light wave u emitted from the light sourceAMIs shown in fig. 3 c. The wavelength of the modulated light wave is a periodic wavelength formed by the envelope of the dashed line in fig. 3 c. The formula for the modulated light wave is:
uAM(t)＝(Ucm+kaUΩmcosΩt)cosωct；
the amplitude modulation principle of the light emitted by the light source provided by the embodiment of the invention is the same as that in the prior art, and is not described herein again. It can be seen that the wavelength of the modulated light wave emitted from the modulated light source 11' is greater than the wavelength of the light wave emitted from the light source 11, which is more favorable for detecting the phase of the light wave. In addition, the modulated light wave carries identification information for uniquely identifying the modulated light source emitting the modulated light wave. Fig. 4 is a waveform example of a modulated light wave carrying identification information, as shown in fig. 4, a square wave part ID in the waveform diagram is identification information for identifying the modulated light source, and a sine wave part a in the waveform diagram is the modulated light wave emitted by the modulated light source. In order to facilitate the calculation of the phase difference, the wavelength frequencies of the modulated light waves emitted by the modulated light sources 11' in the embodiment of the present invention are all the same, and a piece of identification information for uniquely identifying the modulated light sources is inserted at intervals. The identification information for distinguishing the modulated light sources may be a section of square wave as shown in fig. 4, or may be other forms of waves, which is not limited herein. However, in order to distinguish between the modulated light sources, it is necessary to set the frequencies of the waveforms corresponding to the identification information to be different from each other, so that when the waveform corresponding to the identification information is detected, which modulated light source the currently received light wave comes from can be determined. In specific implementation, the length of the identification information in the modulated light wave can be set to be integral multiple of the period of the modulated light wave, so that the period where the identification information is located can be skipped when the identification information is detected, the phase difference of the modulated light source can be calculated from the next period, and the phase difference calculation error caused by disorder of the counting period due to the inserted identification information is avoided.
In the embodiment of the present invention, the position selection of the modulated light source 11' and the wavelength of the emitted modulated light wave need to meet certain principles. The positions of adjacent modulation light sources cannot be too close to each other, so that the touch control pen is prevented from receiving too many modulation light waves of the modulation light sources at the same time; the positions of adjacent modulated light sources can not be too far away from each other, so that the stylus can not receive modulated light waves of the modulated light sources in some areas. In addition, there is a certain precision requirement for modulating the wavelength of the light wave. If the wavelength of the modulated light wave is too small, a plurality of phases with a difference of 2 pi can be detected at the same time, so that the positions of the touch points are not unique, and if the wavelength of the modulated light wave is too large, the situation of the touch points which cannot be detected can be caused. Therefore, in the embodiment of the invention, the wavelength of the modulated light source is set to be larger than the length of the diagonal line of the quadrangle formed by the adjacent four modulated light sources.
In practical applications, as shown in fig. 5, the backlight module further includes: in order to reduce signal attenuation when the modulated light waves emitted from the modulated light source reach the stylus, as shown in fig. 5, an optical film 13 may be disposed on the light emitting side of the light source 11 of the backlight module, and the lamp panel formed by the light sources 11 is disposed on the back frame 12. The Light source 11 may be a Light Emitting Diode (LED), and the Light signal attenuation of the modulated Light reaching the stylus pen after a series of refraction is less by controlling the Light radiation angle of the lens on the Light Emitting side of the LED, the distance between the LED and the optical film, and the diffusion degree of the optical film.
In a second aspect of the embodiment of the present invention, there is provided a touch pen, as shown in fig. 6, a touch pen 300 according to an embodiment of the present invention includes: a photoelectric receiver 31, a processor 32 connected to the photoelectric receiver 31, and a reference signal generator 33 connected to the processor 32; the reference signal generator 33 is configured to generate a reference signal having the same phase as the modulated light wave emitted by the touch display device; the photoelectric receiver 31 is configured to receive a modulated light wave emitted by the touch display device when the touch pen contacts a display surface of the touch display device; and the processor 32 is configured to determine a phase difference at the touch point of a modulated light source adjacent to the touch point position in the touch display device according to the received modulated light wave and the reference signal, so as to determine the position of the touch point.
The touch pen provided by the embodiment of the invention is used in cooperation with the touch display device, and can receive modulated light waves emitted by a plurality of modulated light sources adjacent to the touch point position in the touch display device when the touch pen contacts the display surface of the touch display device, and determine the position of the touch point according to the phase difference by calculating the phase difference from the modulated light waves emitted by the plurality of modulated light sources to the touch point position, so that touch detection can be realized without adding equipment specially used for detecting touch on the touch display device.
In order to detect modulated light waves from a plurality of modulated light sources, and to receive light within 360 ° around a contact point between the stylus and a display surface of the touch display device, at least 3 photoelectric receivers are disposed in the stylus, and the photoelectric receivers are arranged in a matrix or a ring. The number of the photo-receivers 31 to be arranged may be determined according to the number of the modulated light sources to be positioned. For example, when the positions of 3 modulated light sources are required to locate the position of the touch point, at least 3 photoelectric receivers may be provided; when the positions of the 4 modulated light sources are required to be adopted to position the positions of the touch points, at least 4 photoelectric receivers can be arranged, and the specific arrangement number of the photoelectric receivers is not limited in the embodiment of the invention.
As shown in fig. 7, in some application scenarios, the stylus 300 is not vertically contacted with the display surface of the touch display device, the emergent light of the modulated light source 11' in the touch display device is not vertically incident on the photoelectric receiver of the stylus 300, and the emergent light of the light source is radial, so that the effective signal entering the photoelectric receiver is weak. Therefore, a certain convergent light path needs to be designed to increase the signal intensity entering the photoelectric receiver. As shown in fig. 8, a light collection module 301 and a light convergence module 302 may be disposed in front of the optical path of the photoelectric receiver 31. The light collection module 301 is configured to collect light incident around the stylus, so that the light can be incident toward the light convergence module 302, and the light is incident on the photoelectric receiver 31 after being converged, thereby increasing the intensity of light incident on the photoelectric receiver 31.
In specific implementation, as shown in fig. 9, the stylus 300 according to the embodiment of the present invention further includes: a pressure sensor 34 connected to the processor 32; a pressure sensor 34 for detecting a contact pressure between the stylus and a display surface of the touch display device; and the processor 32 is further configured to send the pressure signal detected by the pressure sensor 34 to the touch display device, so that the touch display device performs a corresponding operation. In practical applications, the pressure sensor 34 may measure a contact pressure between the stylus 300 and a display surface of the touch display device, and output a corresponding signal for handwriting adjustment and other related functions, which is not limited herein.
As shown in fig. 9, the stylus 300 according to the embodiment of the present invention further includes: an accelerometer 35 and a gyroscope 36 connected to the processor 32; the accelerometer 35 is used for detecting the acceleration of the stylus; a gyroscope 36 for detecting angular acceleration of the stylus; and a processor 32 for determining the motion trajectory of the stylus 300 according to the detected acceleration and angular acceleration. The motion and rotation of the touch pen can be measured by sensors such as an accelerometer, a gyroscope and the like arranged in the touch pen, so that the touch display device can realize various corresponding functions according to the motion or placement form of the touch pen.
In addition, as shown in fig. 9, the stylus pen 300 provided by the embodiment of the present invention further includes one or more function keys 37, and a communication interface 38 for connecting to a communication device; and the processor 32 is further configured to send a trigger signal of a corresponding function to the touch display device when the function key 37 is pressed, so that the touch display device performs a corresponding operation. The function button 37 can be used for positioning and correcting the touch pen or expanding the touch interaction function; the information obtained by the components in the stylus can be transmitted in two-way communication with the background processing module through the communication interface 38.
In a third aspect of the embodiments of the invention, a touch display system is provided, as shown in fig. 10, the touch display system includes any one of the touch display devices and any one of the touch pens 300. The touch display device may be a display device such as a liquid crystal panel, a liquid crystal display, a liquid crystal television, or a mobile device such as a mobile phone, a tablet computer, and an electronic album, which is not limited herein.
When the stylus pen 300 contacts the display surface of the display panel 200, the modulated light source 11' in the backlight module radiates modulated light waves to the display surface. After receiving the modulated light waves, the stylus pen 300 compares the phases of the modulated light waves of the modulated light sources to determine the adjacent modulated light sources and the areas where the adjacent modulated light sources are located. The relative position of the touch pen 300 in the area determined by the adjacent modulated light sources can be determined according to the phase difference of the modulated light waves emitted by the adjacent modulated light sources at the touch point position detected by the touch pen, and the relative position of the touch pen 300 is restored to the position in the display surface of the touch display device by methods such as triangulation positioning and proportional calculation, so that the touch point position can be obtained.
The modulated light waves emitted by the different modulated light sources 11 will have different phases measured at different positions of the detection plane, and the difference reflects the distance relationship between the detection position and the modulated light source. The modulation wavelength of the embodiment of the invention satisfies the condition that the modulation wavelength is longer than the length of a quadrilateral diagonal line formed by four adjacent modulation light sources, so that the phase repetition phenomenon caused by the periodicity of light waves can be avoided, and the proper modulation light wavelength is selected to ensure that the phase difference of the light wavelength in the detection plane area between the adjacent modulation light sources changes in a phase period, thereby establishing the corresponding relation between the phase difference and the position of the touch point, and further calculating the position of the touch point in the range of the reference modulation light sources. Each modulated light source has unique identification information, and the two-dimensional plane formed by the modulated light sources is parallel to the display surface, and the positions of the two-dimensional plane can be mutually corresponding. The phase difference relative to the touch point can be calculated between any two adjacent modulated light sources, the relative position of the touch point is calculated according to the phase difference, and the relative position is restored into a coordinate system of the display surface, so that the positioning of the touch point can be realized.
After the position of the touch point when the touch pen touches the display device is determined, the touch interaction function can be realized by responding according to the method and the steps specified by the system. The touch interactive functions include, but are not limited to, writing and drawing, rotational and translational movement, selection determination, and other interactive functions that can be realized by existing touch technologies.
In a third aspect of the embodiments of the present invention, a touch detection method based on the touch display system is provided, as shown in fig. 11, the touch detection method may include:
s10, when the touch pen contacts the display surface of the touch display device, receiving the modulated light wave emitted by the touch display device;
s20, determining the phase difference of the modulated light source adjacent to the touch point position at the touch point according to the identification information carried by the received modulated light wave, the phase of the modulated light wave and the phase of the reference signal;
and S30, determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference.
Specifically, a schematic view of a touch scene of the touch display system provided in the embodiment of the present invention is shown in fig. 12, in the embodiment of the present invention, light sources serving as modulated light sources 11 'are numbered first, and coordinates of each modulated light source 11' in a plane of a lamp panel are determined, where the plane of the lamp panel is parallel to a display surface of the touch display device, so that the coordinates in the two planes may correspond to each other.
As shown in FIG. 12, the stylus 300 receives modulated light waves from two modulated light sources L1 and L2, and the reference signal generated by the stylus is the same as the phase of each modulated light source, so that the phase of the received modulated light waves at the location of the stylus can be determined by comparing the phase of the received modulated light waves with the phase of the reference signal. The modulated light waves carry identification information for identifying the modulated light source emitting the modulated light waves, so that the phase difference phi generated by the modulated light source adjacent to the touch pen in one period is determined. As shown in fig. 12, if the phase difference of the positions of the touch points is obtained by subtracting the phase of the modulated light wave emitted from the modulated light source L1 from the phase of the modulated light wave emitted from the modulated light source L2 and reaching the touch points, Φ is less than 0 when the touch point position of the stylus is at B, Φ is 0 when the touch point position is at a, and Φ is greater than 0 when the touch point position is at C.
In the step S20, determining the phase difference at the touch point of the modulated light source adjacent to the touch point position according to the identification information carried by the received modulated light wave, the phase of the modulated light wave, and the phase of the reference signal, which may specifically include:
determining the phase of the modulated light waves emitted by each modulated light source to a touch point according to the phase of the reference signal and the received identification information of the modulated light waves;
determining the positions of at least three modulated light sources adjacent to the touch point according to the phase of the modulated light waves emitted by each modulated light source to the touch point;
and determining the phase difference from the modulated light waves emitted by every two modulated light sources in the three modulated light sources adjacent to the touch point.
As shown in fig. 13, two modulated light sources L1 and L2 arranged in the horizontal direction, L1 and L2 generate modulated signals continuously, the phase difference of each two adjacent ring waves generated by each modulated light source is the same, assuming that the phase difference is θ 0, the phase difference between L1 and L2 is intersected to form a series of intersection points with the same phase difference, and as shown in fig. 13, the phase difference Δ θ of the black intersection point j0 in the middle of the straight line is 0; four filling intersections (± j1 and ± j2) located on both sides of the black intersection are intersections corresponding to the phase difference ± Δ θ ═ 2 θ 0 and the phase difference ± Δ θ ═ 4 θ 0, respectively. When the intersection point is located on the left side of the black intersection point j0, i.e., the intersection point is closer to L1, the phase difference is positive; when the intersection point is located on the right side of the black intersection point j0, that is, the intersection point is closer to L2, the phase difference takes a negative value. All the equal phase difference intersection points are distributed in an axisymmetric manner by a perpendicular bisector of a connecting line of L1 and L2. Therefore, if the position of the touch point is determined only by the phase difference of the two modulated light sources, the position of the touch point is not unique. Therefore, in the embodiment of the present invention, the position of the touch point can be determined by using the phase difference generated between at least three modulated light sources in two directions. As shown in fig. 14, the phase difference between two adjacent ring waves generated by two modulated light sources L1 and L3 arranged in the vertical direction, L1 and L3 continuously generate modulated signals, and each modulated light source generates the same phase difference, and similarly, assuming that the phase difference is θ 0, the L1 and the wave with different phase of L3 intersect to form a series of intersection points with the same phase difference, and as shown in fig. 14, the phase difference Δ θ of the black intersection point j 0' located in the middle and arranged in a straight line is 0; four filling intersections (± j1 'and ± j 2') arranged in a curved line on both sides of the black intersection are intersections corresponding to the phase difference ± Δ θ ═ 2 θ 0 and the phase difference ± Δ θ ═ 4 θ 0, respectively. When the intersection point is located on the lower side of the black intersection point j 0', that is, the intersection point is closer to L3, the phase difference becomes positive; when the intersection point is located on the upper side of the black intersection point j 0', that is, the intersection point is closer to L1, the phase difference takes a negative value. All the equal phase difference intersection points are distributed in an axisymmetric way by a connecting line of L1 and L2. In the present embodiment, the wavelength of the outgoing light wave of the modulated light source is greater than the length of the diagonal line of the rectangle formed by L1-L4, so in the rectangular region formed by L1-L4, only the intersection point satisfying the measured phase difference between L1 and L2 and the measured phase difference between L1 and L3 is the relative position of the touch point.
In step S30, the determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference may specifically include:
respectively taking two different phase differences and the positions of the modulation light sources corresponding to the phase differences as parameters, and simulating two hyperbolic functions;
determining the intersection point position of two hyperbolic functions in a region enclosed by the modulated light source as the position of a touch point;
the phase difference is taken as a parameter of a horizontal axis of the hyperbolic function, and the position of the modulation light source corresponding to the phase difference is taken as a focus parameter of the hyperbolic function.
Mathematically verified that the intersection points of equal phase difference of the same fill in fig. 13 and 14 can be modeled as a hyperbolic function as follows:
wherein a represents the parameter a of the horizontal axis of the hyperbola, b represents the parameter a of the vertical axis of the hyperbola, and c represents the focus of the hyperbola. If the positions of L1 and L2 are taken as the positions of the focal parameter c, then all the distributions of the curves of equal phase difference points formed between L1 and L2 can be simulated by the cluster of hyperbolas in FIG. 15, which have the same focal parameter c and different parameters a and b of the longitudinal and transverse axes.
When the stylus pen detects the phase difference value Δ θ from L1 and L2, the horizontal axis parameter a of the hyperbola is obtained due to the phase difference determined corresponding to the position determined between the connecting lines of L1 and L2, and the vertical axis parameter b is also obtained when the focal point c is fixed. Thus, a specific hyperbola is determined, that is, a hyperbola formed by focusing on the L1 and L2 positions when the stylus pen detects a phase difference between L1 and L2. Similarly, a hyperbola with the L1 and L3 positions as the focal points can be obtained.
As shown in fig. 15, when the stylus pen obtains the phase difference from L1 and L2 in a rectangular area formed by four modulated light sources L1-L4 to determine that y1 is f1(x, y) in fig. 15, and obtains the phase difference from L1 and L3 to determine that y2 is f2(x, y) in fig. 15, the intersection point J (a, b) of the two hyperbolas in the rectangular area is the relative position of the stylus pen.
In order to obtain higher positioning accuracy, the relative position of the touch point can be calculated according to the phase difference of the adjacent four modulated light sources. When it is determined that the number of the modulated light sources adjacent to the touch point is 4 according to the phase of the modulated light wave emitted by each modulated light source to the touch point, in the step S30, the determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference may specifically include:
respectively simulating three groups of hyperbolic functions to determine three intersection point positions;
and taking the position of the mass center of the three intersection positions as the position of the touch point.
Taking the rectangular area formed by the four modulated light sources L1-L4 shown in fig. 15 as an example, the hyperbolic curve determined by L1, L2 and L3 can obtain the positioning point J1(a1, b 1); the hyperbola determined according to L1, L2 and L3 can obtain a positioning point J2; the hyperbola determined from L2, L3 and L4 can result in the localization point J3. Under the condition that J1, J2 and J3 are known, the final positioning coordinate J0(a0 and b0) is obtained as the relative position of the touch point by means of averaging the positioning point coordinates, calculating the center of mass and the like.
After obtaining the relative position of the touch point, in step S30, determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference may specifically include:
determining the relative position of the touch point relative to the modulation light source according to the phase difference and the position of the modulation light source corresponding to the phase difference;
and determining the position of the touch point in the display surface of the touch display device according to the relative position of the touch point relative to the modulated light source and the position of the modulated light source in the display surface of the touch display device.
The relative position of the touch point calculated as above is the relative position of the touch point in a rectangular area formed by four modulated light sources, and the coordinate system of each modulated light source corresponding to the display surface has a unique absolute position, so the absolute position of the touch point in the display surface can be obtained through coordinate conversion. Therefore, the position of the touch point can be determined through the phase difference of the touch point relative to different modulation light sources, and touch detection is realized.
According to the touch display device, the touch pen, the touch display system and the touch detection method thereof provided by the embodiment of the invention, when the touch pen contacts the display surface of the touch display device, the modulated light waves emitted by the touch display device are received; determining the phase difference of a modulation light source adjacent to the touch point position at the touch point according to the identification information carried by the received modulation light wave, the phase of the modulation light wave and the phase of the reference signal; and determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference. The touch display device of the touch display system emits the modulated light waves, the touch pen can detect the phase, and touch detection is realized by adopting a mode of determining the touch position based on the phase difference. The touch control element specially used for detecting touch control is not required to be added any more, and even if the touch control element is applied to large-screen display equipment with the size of a television, the problems of heavy overall machine, high cost and the like can not be caused.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (16)
1. A touch display device, comprising: the display panel is positioned on the light emitting side of the backlight module;
wherein, backlight unit includes: a plurality of light sources arranged in an array;
at least part of the light sources are modulated light sources, and the modulated light sources are used for emitting modulated light waves, so that a matched touch control pen receives the modulated light waves when contacting a display surface of the display device, and the position of a touch control point is determined according to the phase difference of adjacent modulated light sources at the touch control point;
the wavelength of the modulated light wave emitted by the modulated light source is greater than that of the light wave emitted by the light source; the modulated light wave carries identification information for uniquely identifying the modulated light source emitting the modulated light wave.
2. The touch display device of claim 1, wherein the wavelength of the modulated light source is greater than the length of a diagonal of a quadrilateral formed by four adjacent modulated light sources.
3. The touch display device of claim 1, wherein the frequencies of the identification information in the modulated light waves emitted by the modulated light sources are different.
4. The touch display device of claim 1, wherein the length of the identification information in the modulated light wave is an integer multiple of the period of the modulated light wave.
5. The touch display device of claim 1, wherein the backlight module further comprises: and the optical film is positioned on the light-emitting side of the light source.
6. A stylus, comprising: the photoelectric receiver, a processor connected with the photoelectric receiver, and a reference signal generator connected with the processor;
the reference signal generator is used for generating a reference signal with the same phase as the phase of the modulated light wave emitted by the matched touch display device;
the photoelectric receiver is used for receiving modulated light waves emitted by the touch display device when the touch pen is in contact with a display surface of the touch display device;
and the processor is used for determining the phase difference of a modulated light source adjacent to the touch point position in the touch display device at the touch point according to the received modulated light wave and the reference signal so as to determine the position of the touch point.
7. The stylus according to claim 6, wherein the number of the photoelectric receivers is at least 3, and a plurality of the photoelectric receivers are arranged in a matrix or a ring.
8. The stylus of claim 6, wherein the stylus further comprises: an accelerometer and a gyroscope connected to the processor;
the accelerometer is used for detecting the acceleration of the stylus;
the gyroscope is used for detecting the angular acceleration of the stylus;
and the processor is used for determining the motion trail of the touch control pen according to the detected acceleration and the angular acceleration.
9. The stylus of claim 6, wherein the stylus further comprises: a pressure sensor coupled to the processor;
the pressure sensor is used for detecting the contact pressure between the stylus and the display surface of the touch display device;
the processor is further configured to send the pressure signal detected by the pressure sensor to the touch display device, so that the touch display device executes a corresponding operation.
10. The stylus of claim 6, wherein the stylus further comprises: at least one function key and a communication interface for connecting communication equipment;
the processor is further configured to send a trigger signal of a corresponding function to the touch display device when the function key is pressed, so that the touch display device executes a corresponding operation.
11. A touch display system comprising the touch display device according to any one of claims 1 to 5 and the stylus according to any one of claims 6 to 10.
12. The touch detection method of the touch display system according to claim 11, comprising:
when a touch pen is contacted with a display surface of a touch display device, receiving modulated light waves emitted by the touch display device;
determining the phase difference of a modulated light source adjacent to the touch point position at the touch point according to the identification information carried by the received modulated light wave, the phase of the modulated light wave and the phase of the reference signal;
and determining the position of the touch point according to the phase difference and the position of the modulation light source corresponding to the phase difference.
13. The method of claim 12, wherein determining a phase difference at the touch point of a modulated light source adjacent to the touch point position according to the identification information carried by the received modulated light wave, the phase of the modulated light wave, and the phase of the reference signal comprises:
determining the phase of the modulated light wave emitted by each modulated light source to the touch point according to the phase of the reference signal and the received identification information of the modulated light wave;
determining the positions of at least three modulated light sources adjacent to the touch point according to the phase from the modulated light waves emitted by each modulated light source to the touch point;
and determining the phase difference from the modulated light waves emitted by every two modulated light sources in the three modulated light sources adjacent to the touch point.
14. The method of claim 13, wherein determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference comprises:
respectively taking two different phase differences and the positions of the modulation light sources corresponding to the phase differences as parameters, and simulating two hyperbolic functions;
determining the intersection point position of the two hyperbolic functions in the area enclosed by the modulated light source as the position of the touch point;
and the phase difference is taken as a parameter of a horizontal axis of the hyperbolic function, and the position of the modulation light source corresponding to the phase difference is taken as a focus parameter of the hyperbolic function.
15. The method as claimed in claim 14, wherein when it is determined that the number of the modulated light sources adjacent to the touch point is 4 according to the phase of the modulated light wave emitted from each modulated light source to the touch point, the determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference comprises:
respectively simulating three groups of hyperbolic functions to determine three intersection point positions;
and taking the position of the mass center of the three intersection positions as the position of the touch point.
16. The method according to any one of claims 12-15, wherein the determining the position of the touch point according to the phase difference and the position of the modulated light source corresponding to the phase difference comprises:
determining the relative position of the touch point relative to the modulation light source according to the phase difference and the position of the modulation light source corresponding to the phase difference;
and determining the position of the touch point in the display surface of the touch display device according to the relative position of the touch point relative to the modulated light source and the position of the modulated light source in the display surface of the touch display device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910550901.0A CN112130689A (en) | 2019-06-24 | 2019-06-24 | Touch display device, touch pen, touch display system and touch detection method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910550901.0A CN112130689A (en) | 2019-06-24 | 2019-06-24 | Touch display device, touch pen, touch display system and touch detection method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112130689A true CN112130689A (en) | 2020-12-25 |
Family
ID=73849934
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910550901.0A Pending CN112130689A (en) | 2019-06-24 | 2019-06-24 | Touch display device, touch pen, touch display system and touch detection method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112130689A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130016071A1 (en) * | 2011-07-14 | 2013-01-17 | 3M Innovative Properties Company | Digitizer using position-unique optical signals |
| CN103593093A (en) * | 2012-08-16 | 2014-02-19 | 北京京东方光电科技有限公司 | Touch display device and touch display realization method |
| CN103649879A (en) * | 2011-07-14 | 2014-03-19 | 3M创新有限公司 | Digitizer using position-unique optical signals |
| CN105807990A (en) * | 2016-03-01 | 2016-07-27 | 京东方科技集团股份有限公司 | Display screen, touch pen and display module |
| CN109062453A (en) * | 2018-07-28 | 2018-12-21 | 贵州华宁科技股份有限公司 | A kind of transmitting tube Scan Architecture for infrared touch screen |
-
2019
- 2019-06-24 CN CN201910550901.0A patent/CN112130689A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130016071A1 (en) * | 2011-07-14 | 2013-01-17 | 3M Innovative Properties Company | Digitizer using position-unique optical signals |
| CN103649879A (en) * | 2011-07-14 | 2014-03-19 | 3M创新有限公司 | Digitizer using position-unique optical signals |
| CN103593093A (en) * | 2012-08-16 | 2014-02-19 | 北京京东方光电科技有限公司 | Touch display device and touch display realization method |
| CN105807990A (en) * | 2016-03-01 | 2016-07-27 | 京东方科技集团股份有限公司 | Display screen, touch pen and display module |
| CN109062453A (en) * | 2018-07-28 | 2018-12-21 | 贵州华宁科技股份有限公司 | A kind of transmitting tube Scan Architecture for infrared touch screen |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10437391B2 (en) | Optical touch sensing for displays and other applications | |
| US8872800B2 (en) | Optical tablet stylus and indoor navigation system | |
| CN102169394B (en) | Multiple-input touch panel and method for gesture recognition | |
| US8803845B2 (en) | Optical touch input system and method of establishing reference in the same | |
| US20030095708A1 (en) | Capturing hand motion | |
| US20100328267A1 (en) | Optical touch device | |
| US20110261016A1 (en) | Optical touch screen system and method for recognizing a relative distance of objects | |
| CN101208738A (en) | Automatic projection calibration | |
| KR20140016987A (en) | Method and electronic device for virtual handwritten input | |
| CN102799318A (en) | Human-machine interaction method and system based on binocular stereoscopic vision | |
| CN102063230B (en) | Optical imaging touch sensing system and imaging method | |
| CN108089772B (en) | Projection touch method and device | |
| CN104423721A (en) | Frameless multipoint touch man-machine interaction method and system based on radar eye | |
| US20120218225A1 (en) | Optical scanning type touch apparatus and operation method thereof | |
| CN102314264B (en) | Optical touch screen | |
| JP2001142643A (en) | Device for inputting/detecting coordinates | |
| CN103092357A (en) | Implementation method of scanning and locating and projected keyboard device | |
| CN112130689A (en) | Touch display device, touch pen, touch display system and touch detection method thereof | |
| CN101866247A (en) | Side detection-type multipoint touch screen based on frustrated total internal reflection | |
| CN203606780U (en) | Multi-touch and gesture recognition fusion system | |
| CN204066012U (en) | A kind of projection arrangement | |
| US9652081B2 (en) | Optical touch system, method of touch detection, and computer program product | |
| US20120075234A1 (en) | Method and system for detecting one or more objects | |
| CN109287124B (en) | Optical touch sensing for displays and other applications | |
| JP2000330717A (en) | Pen type input device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |