WO2023082722A1 - Stylus, touch positioning method and apparatus, system, and storage medium - Google Patents

Abstract

The present application relates to a stylus, a touch positioning method and apparatus, a touch control system, and a storage medium. The stylus comprises a main body 100 having a first end portion and a second end portion opposite thereto, and, disposed in the main body 100: a light acquisition assembly 102, located at the first end portion, an input end of the light acquisition assembly 102 being used to acquire a touch object, and an output end of the light acquisition assembly 102 being used to output acquired light; a light on/off assembly 104, an input end of the light on/off assembly 104 being connected to the output end of the light acquisition assembly 102, so as to control connection and disconnection of an optical path of light; a photosensitive module 106, an input end of the photosensitive module 106 being connected to an output end of the light on/off assembly 104, used to convert received light into an electrical signal; and a data processing module, an input end of the data processing module 108 being connected to an output end of the photosensitive module 106, used to encode the electrical signal and then output an encoded electrical signal.

Description

Stylus, touch positioning method, device, system and storage medium

Cross References to Related Applications

This application claims the priority of the Chinese patent application with the application number 2021227432536 and the title of the invention "stylus and touch system" filed with the China Patent Office on November 10, 2021 and the Chinese patent filed on November 10, 2021 The priority of the Chinese patent application with application number 2021113271919 and the title of the invention is "touch positioning method, device, touch interaction system and storage medium", the entire content of which is incorporated in this application by reference.

technical field

The present application relates to the technical field of touch interaction, and in particular to a stylus, a touch system, a touch positioning method, a device, a touch interaction system and a storage medium.

Background technique

For LED (Light-Emitting Diode, light-emitting diode) display screens with hundreds of inches, the lowest cost way to realize touch control is to use infrared touch frame. Including infrared touch frame and stylus, the method is to use a series of infrared probes placed on the edge of the screen, and the probes will shine on the tip of the stylus to generate reflection. By detecting the reflected light of different probes, the exact coordinates of the current landing point can be calculated. However, in the infrared touch frame method, when the emitted light is blocked, the touch function will be lost, and the touch sensitivity at the edge of the screen is low. The position of the probe erected on the edge of the screen is also difficult to ignore, and the big black border on the edge of the screen cannot be avoided.

Other display touch solutions, including capacitive, vector pressure sensing, surface acoustic wave, metal mesh, piezoresistive, and infrared, are generally limited by the contradiction between cost and full-scale control, and it is difficult to Full-scale touchscreen control with low latency at a lower cost. In the process of implementation, it is found that there are at least the following problems in the traditional technology: the current touch method has the problems of high cost and high delay.

Contents of the invention

According to various embodiments disclosed in the present application, a stylus, a touch system, a touch positioning method, a device, a touch interaction system, and a storage medium are provided.

In the first aspect, the embodiment of the present application provides a stylus, including a main body with a first end and an opposite second end, and disposed in the main body:

A lighting component located at the first end; the input end of the lighting component is used to collect the touch object, and the output end of the lighting component is used to output the collected light;

Optical on-off component; the input end of the optical on-off component is connected to the output end of the lighting component to control the on-off of the optical path of the light;

Photosensitive module; the input end of the photosensitive module is connected to the output end of the light on-off component, which is used to convert the received light into an electrical signal;

A data processing module; the input end of the data processing module is connected to the output end of the photosensitive module, and is used for encoding the electrical signal and then outputting it.

In one of the embodiments, it further includes a data sending module disposed in the main body and located at the second end;

The input end of the data sending module is connected to the data processing module, and the output end of the data sending module is used to connect to the interactive system.

In one of the embodiments, it also includes a memory and a power supply in the main body;

The memory is respectively connected to the photosensitive module and the data processing module;

The power supply is connected between the data sending module and the data processing module.

In one of the embodiments, it further includes connecting the main body and a writing tip located at the first end.

In one of the embodiments, it also includes an optical branching module disposed in the main body; the optical branching module includes at least one input terminal and a plurality of output terminals;

The input end of the optical splitting module is connected to the output end of the optical on-off component;

The photosensitive module includes a plurality of photosensitive modules; the input end of each photosensitive module is respectively connected to an output end of the optical splitting module.

In one of the embodiments, the light splitting module is a dichroic refractor.

In one of these embodiments,

The lighting component is a lighting lens; the input end of the lighting lens is used to collect the lamp beads in the touch screen to output the light of the lamp beads;

The light on-off component is an exposure valve whose on-off clock is the same as the refresh clock of the touch screen; wherein, the exposure valve is opened when light enters.

In one embodiment, the photosensitive module is a photosensitive sensor.

In a second aspect, the embodiment of the present application further provides a touch control system, including a touch display screen, the above-mentioned stylus pen, and an interaction system connected between the touch display screen and the stylus pen.

In one of the embodiments, the touch display screen is an LED display screen.

In the third aspect, the embodiment of the present application also provides a touch positioning method, including:

Receive the touch position information transmitted by the stylus; the touch position information includes the lamp bead data obtained by collecting and encoding the touch object using the corresponding refresh mode through the stylus; the lamp bead data includes the working time of the lamp bead and the working status of the lamp bead;

Identifying the touch position information to determine the current contact position of the stylus.

In one of the embodiments, the refresh mode includes the current refresh content confirmed by the touch object based on the refresh strategy; the refresh strategy includes the refresh order of the refresh content;

Also includes steps:

If the current contact position does not meet the positioning end condition, output a display command; the display command is used to instruct the touch object to call the corresponding display area to display the next refresh content in the refresh order; The positioning end condition includes that the current contact position includes the precise position of the lamp bead.

In one of the embodiments, before the step of receiving the touch position information transmitted by the stylus, the step further includes:

receiving a refresh position coordinate request transmitted by the stylus; the refresh position coordinate request is output by the stylus during the first touch operation on the touch object;

Based on the refresh position coordinate request, output a full-screen display instruction; the full-screen display instruction is used to instruct the touch object to display the first refresh content in the refresh order by traversing the entire screen within a preset period of time; The first refresh content includes the rough position of the lamp bead.

In one of the embodiments, the working time of the lamp bead includes the lighting time of the lamp bead on each time slot in one frame; the working state of the lamp bead includes the on-off state of the lamp bead on each time slot in one frame;

The precise position of the lamp bead is the coordinate of the lamp bead; the rough position of the lamp bead includes the serial number of the module to which the lamp bead belongs.

In one of the embodiments, the refresh content at the end of the refresh order includes the coordinates of the lamp bead; the rough position of the lamp bead also includes the number of the display area to which the module belongs; the refresh order includes the sorting of the module numbers to which the lamp bead belongs Greater than the number of the display area to which the module belongs, and the order of the number of the display area to which the module belongs is greater than that of the lamp bead coordinates.

In one of the embodiments, the positioning end condition further includes that the current contact position includes an increment compared with the reference coordinate; the refresh content at the end of the refresh order includes the increment;

The reference coordinate is determined based on the precise position of the lamp bead; the increment includes an offset compared to the reference coordinate; the offset includes an offset along the predicted movement direction of the stylus. shift angle and offset distance.

In a fourth aspect, the present application also provides a touch positioning device, including:

The receiving module is used to receive the touch position information transmitted by the stylus; the touch position information includes the lamp bead data acquired and coded by the stylus through the touch object using the corresponding refresh mode; the lamp bead data Including the working time of the lamp bead and the working status of the lamp bead;

An identification module, configured to identify the touch position information, and determine the current contact position of the stylus.

In the fifth aspect, the present application also provides a touch interaction system, including a display screen, a driving device, and a stylus;

Wherein, the stylus is used to use the display screen as a touch object; the driving device is used to execute the steps of any one of the methods described above.

In one of the embodiments, the display screen is an LED display screen.

In a sixth aspect, the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method described in any one of the above items are implemented.

One of the above technical solutions has the following advantages and beneficial effects:

The stylus of the present application includes a lighting component, a light on-off component, a photosensitive module, and a data processing module. The channel is transmitted to the photosensitive module, and then the photosensitive module converts the light into an electrical signal and transmits it to the data processing module. The data processing module can encode the electrical signal and output it. The cost of each device in the stylus of the present application is low, and the stylus can monitor the on-off state of the touch object (for example, a display screen) at a relatively high frequency, and convert it into a readable data stream for Interaction system processing; this application uses the high-speed refresh capability of the touch object and the low frame rate difference of the video source to realize low-latency touch interaction on the screen.

The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below. Other features and advantages of the application will be apparent from the description, drawings, and claims.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or the traditional technology. Obviously, the accompanying drawings in the following description are only the present invention For some embodiments of the application, those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is an application environment diagram of a stylus according to one or more embodiments.

Fig. 2 is a schematic structural diagram of a light bead stylus according to one or more embodiments.

Fig. 3 is a schematic structural diagram of a lamp bead stylus in another embodiment.

FIG. 4 is a schematic structural diagram of a pixel stylus according to one or more embodiments.

FIG. 5 is a schematic structural diagram of a pixel stylus in another embodiment.

FIG. 6 is a schematic structural diagram of a pixel stylus in another embodiment.

Fig. 7 is a schematic flowchart of a touch positioning method according to one or more embodiments.

FIG. 8 is a schematic flowchart of a touch positioning method in another embodiment.

FIG. 9 is a schematic flowchart of a touch positioning method in another embodiment.

Fig. 10 is a structural block diagram of a touch positioning device according to one or more embodiments.

Detailed ways

In order to facilitate the understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. Embodiments of the application are given in the drawings. However, the present application can be embodied in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of this application more thorough and comprehensive.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terms used herein in the specification of the application are only for the purpose of describing specific embodiments, and are not intended to limit the application.

It can be understood that the terms "first", "second" and the like used in this application may be used to describe various elements herein, but these elements are not limited by these terms. These terms are only used to distinguish one element from another element.

Spatial terms such as "below", "below", "below", "under", "on", "above", etc., in This may be used to describe the relationship of one element or feature to other elements or features shown in the figures. It will be understood that the spatially relative terms encompass different orientations of the device in use and operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements or features described as "below" or "beneath" or "beneath" other elements or features would then be oriented "above" the other elements or features. Thus, the exemplary terms "below" and "beneath" can encompass both an orientation of above and below. In addition, the device may be otherwise oriented (eg, rotated 90 degrees or at other orientations) and the spatial descriptors used herein interpreted accordingly.

It should be noted that when an element is considered to be "connected" to another element, it may be directly connected to the other element, or connected to the other element through an intervening element. In addition, "connection" in the following embodiments should be understood as "electrical connection", "communication connection" and the like if there is transmission of electrical signals or data between the connected objects.

When used herein, the singular forms "a", "an" and "the/the" may also include the plural forms unless the context clearly dictates otherwise. It should also be understood that the terms "comprising/comprising" or "having" etc. specify the presence of stated features, integers, steps, operations, components, parts or combinations thereof, but do not exclude the presence or addition of one or more The possibility of other features, integers, steps, operations, components, parts or combinations thereof. Meanwhile, the term "and/or" used in this specification includes any and all combinations of the related listed items.

The screen touch of the LED display has been mainly limited by three problems. The first is to realize full-size LED display screen touch, which requires a lot of hardware cost, and the control of these hardware takes up a lot of memory in the system. The second is that the touch control of a large-size display should maintain a low delay, that is, the time required to complete a touch interaction should be extremely low. The third is the arrangement and concealment of touch sensors to reduce the gaps that appear on the surface of the screen and the possible impact on the display quality of the display.

At present, the solution of external infrared frame is to set up an infrared sensor on the edge of the screen, and use infrared light and reflection to detect the touch input position on the screen surface. But there are at least the following problems: ① A certain position must be reserved at the edge of the screen for the placement of the infrared tube sensor and its module, and the screen will always have a black border. ②At the edge of the screen, due to the small difference between the outgoing light and the incident light, the touch sensitivity is lower than that in the middle, and the sensitivity is not consistent across the entire screen. ③Under different construction environments, it may happen that after the infrared light is blocked and reflected back, the touch requirements behind it are blocked.

In other traditional solutions, using vector pressure sensors, that is, fine strain gauges to feedback screen touch coordinates, many strain gauges need to be erected on the entire screen; metal grids are used, and the grids are attached to the surface of the screen. It will cause occlusion of the screen; it is difficult to achieve low-latency interaction with capacitive control. Various screen touch methods have defects on the LED display. For touch interaction, the core work is to determine the coordinates of the touch point relative to the screen. The method of determining the coordinates of the touch point is the primary problem to be solved in touch interaction, and it is also the key point for LED display to realize touch interaction. main issue. In addition, the processing technology of the packaging structure of the high-resolution LED display has extremely high requirements on consistency. Easily changing the characteristics of its internal components can easily reduce the display quality of the screen.

This application utilizes the high-speed dynamic refresh feature of the screen, cooperates with a stylus that can collect refresh features, and realizes the collection of current touch position information with a relatively high sampling frequency. Further, the collected information is fed back to the control system (for example, an interactive system), so that the content interaction of the display screen can be realized.

In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

The stylus provided in this application can be applied in the application environment shown in FIG. 1 . Wherein, the interactive system is used for touch interaction of the display screen. The screen continuously refreshes the display screen at a very high refresh rate, and the stylus obtains screen information at a very high sampling frequency. Specifically, the display screen keeps refreshing at a high speed, and the refreshed content can be divided into two parts, one part is display content, and the other part is interactive information. However, the stylus of this application can record the working status of the display screen in each refresh time segment at a very high sampling rate, and obtain the information used for interaction, such as lamp beads, through direct or indirect feature recognition. Coordinates, offset distance, moving speed, etc. That is, the present application utilizes the high-speed refresh capability of the display screen and the low frame rate difference of the video source to realize low-latency touch interaction on the screen.

It should be noted that the touch object in this application may include a display screen; the display screen may be a liquid crystal display screen or an electronic ink display screen; in some embodiments, the display screen may be an LED display screen. Further, this application can be realized based on the existing miniLED, microLED (micron light-emitting diode) or SMD (Surface Mounted Devices, surface mount device) packaged LED (that is, surface mount package structure LED) that has undergone surface strengthening treatment. A touch positioning method, which does not require significant changes to the screen structure, and only needs to follow the corresponding refresh strategy to realize screen touch interaction under the operation of the stylus, with low cost and low delay.

In one embodiment, as shown in FIG. 2 , a stylus is provided. The application of the stylus in the application scene shown in FIG. The main body 100 at the end, and located in the main body 100:

The lighting assembly 102 located at the first end; the input end of the lighting assembly 102 is used to collect the touch object, and the output end of the lighting assembly 102 is used to output the collected light;

The light on-off component 104; the input end of the light on-off component 104 is connected to the output end of the lighting component 102, to control the on-off of the light path of the light;

A photosensitive module 106; the input end of the photosensitive module 106 is connected to the output end of the optical on-off assembly 104, for converting the received light into an electrical signal;

Data processing module 108; the input end of the data processing module 108 is connected to the output end of the photosensitive module 106, and is used for encoding the electrical signal and outputting it.

As shown in FIG. 2, the stylus of the present application may include a lighting component 102, a light on-off component 104, a photosensitive module 106, and a data processing module 108. The lighting component 102 can collect the light of the touch object, and The collected light is transmitted to the photosensitive module 106 through the optical path formed by the optical on-off component 104, and then the photosensitive module 106 converts the light into an electrical signal and transmits it to the data processing module 108. The data processing module 108 can process the electrical signal output after encoding.

The lighting component 102 in this application can complete the data sampling of the touch object (for example, the display screen), and the data may be the light of the lamp beads in the display screen. The data sampling of the stylus in this application is actually to monitor the on-off state of the display screen at a relatively high frequency. That is to say, this application realizes screen touch by detecting the on-off state of the lamp bead.

It should be noted that, taking the display screen as an example of an LED screen, when the LED screen displays the content of the screen, it does not realize the content display through the constant light change of the lamp beads, but through the high-frequency on-off transition of the lamp beads. , to reflect the differences of different contents, and this display feature is called dynamic scanning, which is an important display feature of LED display. Under the driving of dynamic scanning, for a single lamp bead, it will not maintain a constant on state, but will change at a very high frequency, and realize different content display during the alternating on and off. The light effect displayed by the lamp beads through high-frequency alternating on and off is progressive from on to off, and the final effect is called gray scale. There are usually 256 gray scales used by LED lamp beads from on to off, and there are 3 lamp beads on a single pixel, which are red light, green light and blue light. The 3 lamp beads achieve different color display through different brightness ratios. Therefore, when the LED display screen displays the picture, for a single lamp bead, it mainly relies on grayscale refresh to achieve.

In order to ensure uniform and stable color and brightness changes, the LED display screen will increase the refresh rate of the screen grayscale as much as possible. Usually, an LED display screen can achieve a screen refresh rate of 3840HZ, which means that when a 60HZ display screen is played, each frame of the screen displayed will be reflected by 64 refreshes of the LED display screen. And these 64 refreshes are grayscale refreshes. It can be seen that the screen refresh capability of the LED display is much higher than that of the video source information.

In this regard, after the lighting component 102 collects the touch object and outputs the collected light, it can be sequentially processed by the light on-off component 104, the photosensitive module 106 and the data processing module 108, and then converted into a readable data streams for the interactive system to process. For example, the display screen refreshes 3840 times per second, and the stylus of the present application realizes data sampling at least 3840 times per second. Process and analyze the sampled data, obtain accurate coordinates or reference offsets during motion, and feed them back to the interactive system to update the display data of the next frame. Wherein, the present application does not limit the specific numerical value.

In one of the embodiments, the lighting assembly 102 can be a lighting lens; the input end of the lighting lens is used to collect the light beads in the touch screen to output light from the light beads;

The main function of the stylus in this application is to sample a single lamp bead and/or perform high-frequency sampling on a single pixel. Wherein, the lighting assembly 102 may be a lens for collecting light from a target lamp bead. In this application, the collection of light from the lamp beads in the display screen can be completed through the lighting lens, thereby laying a foundation for subsequent processing.

Further, the input end of the light on-off assembly 104 is connected to the output end of the daylighting assembly 102 to control the on-off of the light path of the light, and the input end of the photosensitive module 106 is connected to the output end of the light on-off assembly 104 for receiving The received light is converted into an electrical signal. In some embodiments, the light on-off component 104 can be turned on when light enters, so that the light can enter the photosensitive module 106; wherein, the light on-off component 104 can refer to a device used to control the time when the light irradiates the photosensitive element In other words, the on-off clock of the light on-off component 104 may be consistent with the refresh clock of the touch object (for example, a display screen).

The stylus in this application is designed based on the dynamic refresh touch of the display screen (eg, LED display screen). The stylus has a high sampling rate and simple sampling content. It can collect the working status of a single lamp bead in different time slots with a high clock frequency. Specifically, it can record two indicators, one is whether the lamp bead emits light, The other is time to shine. In addition, the sampling frequency of the stylus can correspond to the display refresh frequency of the LED display. For the lamp bead, within the time of one frame, for example, every refresh of the time slot will be recorded by the stylus. For the state and time when the lamp bead is on in this time slot, the corresponding digital signal code is output for processing by the corresponding system, and the data content, including the coordinates of the lamp bead, which is helpful for screen interaction, is extracted from it.

In one embodiment, the light on-off component 104 may be an exposure valve whose on-off clock is the same as the refresh clock of the touch screen; wherein, the exposure valve is opened when light enters.

Taking the touch object as an example of an LED display, the exposure valve is used to open when light enters, so that light can enter the photosensitive module 106 , and the on-off clock of the exposure valve is consistent with the refresh clock of the LED display.

The photosensitive module 106 in this application is used to convert the received light into electrical signals. That is, the photosensitive module 106 can be used to sense light, and then determine the working status of the lamp bead; in some embodiments, the photosensitive module 106 can be a photosensitive sensor. In some embodiments, the photosensitive module 106 can be a photosensitive sensor, so as to output the received light as a digital signal; the sampling frequency and output frequency of the photosensitive sensor in this application are particularly high, and it can collect light and dark changes from the screen information. It should be noted that, when the photosensitive module 106 includes multiple photosensitive modules, the photosensitive modules may all be photosensitive sensors.

Further, the input end of the data processing module 108 is connected to the output end of the photosensitive module 106 for encoding the electrical signal and outputting it. In some embodiments, the data processing module 108 encodes the data, and then transmits it to a corresponding control system, so as to realize the entire interactive process. That is, the present application can monitor the on-off state of the touch object (for example, a display screen), and convert it into a readable data stream for processing by the interactive system.

In one embodiment, as shown in FIG. 3 , the stylus may further include a data sending module 110 disposed in the main body 100 and located at the second end;

The input end of the data sending module 110 is connected to the data processing module 108, and the output end of the data sending module 110 is used to connect to the interactive system.

In some embodiments, the stylus can include a lighting assembly 102 (i.e. a lighting head, a lighting lens), a light on-off assembly 104 (i.e. an exposure valve), a photosensitive module 106 (i.e. a photosensitive sensor), a data processing module 108 and a data processing module 108. sending module 110.

Wherein, taking the touch object as an example of an LED display, the lighting head may be a lens for collecting light from a target lamp bead. The exposure valve is used to open when light enters, so that the light can enter the photosensitive sensor, and the on-off clock of the exposure valve is consistent with the refresh clock of the LED display. The photosensitive sensor is used to sense light and judge the working state of the lamp bead, so as to output it as a digital signal, and transmit it to the data processing module synchronously, encode the data, and send it to the corresponding control system through the data sending module, so as to realize the whole complete interaction process. In this application, the sampling frequency and output frequency of the photosensitive sensor are particularly high, which can collect the light-dark transformation information from the screen.

In one of the embodiments, as shown in FIG. 3 , the stylus may further include a memory and a power supply 112 disposed in the main body 100;

The memory is respectively connected to the photosensitive module 106 and the data processing module 108;

The power supply 112 is connected between the data sending module 110 and the data processing module 108 .

In some embodiments, the photosensitive module 106 (for example, a photosensitive sensor) can be used to sense light and determine the working state of the lamp bead, thereby outputting it as a digital signal, transmitting it to the memory, and synchronously transmitting it to the data processing module 108 ; The data is encoded by the data processing module 108 and sent to the corresponding control system through the data sending module 110 ;

In one embodiment, as shown in FIG. 3 , the stylus may further include a writing tip 114 connected to the main body 100 and located at the first end.

In some embodiments, the stylus of the present application may further include a writing tip 114; the writing tip 114 is used for direct touch and friction with the screen, so as to provide users with damping experience during interaction.

In order to further illustrate the solution of the lamp bead stylus in this application, an example is used below to illustrate: the collection range of the lamp bead stylus in this application is a single lamp bead, and the stylus can judge the brightness of a single lamp bead. Off to collect the current coordinates of the lamp bead. The working state of the lamp bead is on and off. When refreshing a frame, the working cycle of the lamp bead will be divided into 64 time segments, and the on and off status will be refreshed in these 64 time segments. This situation can be regarded as the limited accuracy of the stylus for pixel collection, unable to recognize the brightness status of the three lamp beads on a single pixel point, but turning on and off the entire pixel point as a whole lamp bead Judgment; it can also be regarded as a high-quality display screen, the arrangement of lamp beads on it is extremely fine, and the concept of pixel is composed of any three lamp beads of different colors.

Among them, the data read by the stylus is the status data of a single lamp bead within these 64 time segments. That is, the information read by the stylus at one time is a time segment of a lamp bead in one frame time; and the structure of the stylus can directly apply the structure of the lamp bead stylus exemplified above.

Above, this application proposes a stylus for sampling a single lamp bead (referred to as a lamp bead stylus for short), which has a high sampling rate and simple sampling content, and can sample a single lamp at a high clock frequency. The working status of the beads in different time slots; among them, the sampling frequency of the stylus corresponds to the display refresh frequency of the LED display. It will be recorded by the stylus. For the status and time of the lamp bead lighting in this time slot, the corresponding digital signal code is output for processing by the display system, and the information that is helpful for screen interaction, including the lamp bead, is extracted from it. Data content such as coordinates. This application utilizes the high-speed refresh capability of the touch object and the low frame rate difference of the video source to realize low-latency touch interaction on the screen.

In one embodiment, as shown in FIG. 4, a stylus is provided. The application of the stylus in the application scene shown in FIG. The main body 200 at the end, and located in the main body 200:

The lighting assembly 202 located at the first end; the input end of the lighting assembly 202 is used to collect the touch object, and the output end of the lighting assembly 202 is used to output the collected light;

The light on-off component 204; the input end of the light on-off component 204 is connected to the output end of the lighting component 202, to control the on-off of the light path of the light;

Optical splitting module 206; Optical splitting module 206 includes at least one input terminal and a plurality of output ends; The input end of optical splitting module 206 is connected to the output end of optical on-off assembly 204;

The photosensitive module 208; the photosensitive module 208 includes a plurality of photosensitive modules; the input end of each photosensitive module is respectively connected to an output end of the optical branching module 206, and the photosensitive module is used to convert the received light into an electrical signal;

Data processing module 210; the input end of the data processing module 210 is connected to the output end of each photosensitive module, and is used for encoding the electrical signal and outputting it.

In some embodiments, as shown in FIG. 4 , the stylus of the present application may include a lighting assembly 202, a light on-off assembly 204, an optical branching module 206, a photosensitive module 208, and a data processing module 210. The lighting assembly 202 The light of the touch object can be collected, and the collected light can be transmitted to the optical branch module 206 through the optical path formed by the optical on-off component 204, and then the light branch module 206 can divide the light into red, green and blue light, The light is respectively irradiated into multiple photosensitive modules contained in the photosensitive module 208, and then the photosensitive module 208 converts the light into an electrical signal and transmits it to the data processing module 210. The data processing module 210 can encode the electrical signal and output it.

Among them, through the optical splitting module 206, the optical splitting module 206 will divide the light into red, green, and blue light, and shoot them to the three photosensitive modules respectively, so that the one-time exposure detection of the light on-off component 204 can detect a single pixel at the same time. The on-off status of the three lamp beads on the screen realizes more efficient lamp bead detection.

The present application implements a stylus that performs high-frequency sampling on a single pixel (referred to as a pixel stylus for short). The main function of the stylus is to convert the state of each time slot within a frame time into a digital signal within the preset range of the display area, and process it to analyze the corresponding coordinates or the offset relative to the reference reference quantity.

The stylus of this application is used to detect the on-off state of the lamp bead to realize screen touch; taking the touch object as an example of an LED display, when the lamp bead displays a frame of picture, it will be realized by 64 high-speed refreshes The content of the screen is displayed, so as to achieve the required gray scale, and the output displays the required brightness. These 64 high-speed refreshes can be subdivided into 64 time segments. The stylus in this application can convert the status of the lamp beads in these 64 time segments into digital signals and send them back to the corresponding system.

In one of the embodiments, the light splitting module 206 may be a dichroic refractor.

On the basis of the aforementioned lamp bead stylus, a dichroic refraction lens can be further added, and at the same time, three photosensitive sensors (that is, a photosensitive module, which can be a photosensitive sensor) can be used. When the light enters through the exposure valve, it will first pass through the dichroic refraction lens. The lens will divide the light into red, green and blue light, and shoot them to the three photosensitive sensors respectively, so that one exposure detection can detect three pixels on a single pixel at the same time. The light on and off of the lamp bead can realize more efficient lamp bead detection.

It should be noted that for the relevant functions and implementation methods of the lighting assembly 202, the light on-off assembly 204, the photosensitive module 208, and the data processing module 210 in this application, you can refer to the previous description of the lighting assembly 102, the light on-off assembly 104, and the photosensitive module. The description of the module 106 and the data processing module 108 will not be repeated here.

Further, in one of the embodiments, as shown in FIG. 5 , the stylus may further include a data sending module 212 disposed in the main body 200 and located at the second end;

The input end of the data sending module 212 is connected to the data processing module 210, and the output end of the data sending module 212 is used to connect to the interactive system.

In some embodiments, the stylus can include a lighting assembly 202 (i.e., a lighting head, a lighting lens), a light on-off assembly 204 (i.e., an exposure valve), an optical splitting module 206 (i.e., a light-splitting refractor), and a photosensitive module 208 (that is, a plurality of photosensitive sensors), a data processing module 210 and a data sending module 212 .

Wherein, taking the touch object as an example of an LED display, the lighting head may be a lens for collecting light from a target lamp bead. The exposure valve is used to open when there is light entering, so that the light can enter the dichroic refractor; when the light enters through the exposure valve, it will first pass through the dichroic refractor lens, and the lens will divide the light into red, green, and blue light, which are respectively emitted to the on 3 photosensitive sensors. The photosensitive sensor can be a photosensitive sensor. The photosensitive sensor is used to detect light and determine the working state of the lamp bead, so as to output it as a digital signal, and transmit it to the data processing module synchronously, encode the data, and send it to the corresponding control unit through the data sending module. In the system, the entire interactive process is realized. In this application, the sampling frequency and output frequency of the photosensitive sensor are particularly high, which can collect the light-dark transformation information from the screen.

In one of the embodiments, as shown in FIG. 5 , the stylus may further include a memory and a power supply 214 disposed in the main body 200;

The memory is respectively connected to multiple photosensitive modules in the photosensitive module 208 and the data processing module 210;

The power supply 214 is connected between the data sending module 212 and the data processing module 210 .

The photosensitive module (for example, photosensitive sensor) in the photosensitive module 208 can be used for photosensitive, judges the working state of lamp bead, thereby it is output as digital signal, transmits on this memory, and synchronously transmits to data processing module 210; The data processing module 210 encodes the data and sends it to the corresponding control system through the data sending module 212 .

In one embodiment, as shown in FIG. 5 , the stylus may further include a writing tip 216 connected to the main body 200 and located at the first end.

Optionally, the stylus of the present application may further include a writing tip 216; the writing tip 216 is used for direct touch and friction with the screen, so as to provide the user with a damping experience during the interaction.

In addition, in order to further explain the solution of the pixel stylus in this application, an example is used below to illustrate: the collection range of the pixel stylus in this application is a single pixel point, and the stylus can judge the The light bead is turned on and off to collect the coordinates of the current pixel. There are 3 lamp beads on a pixel, which are red, green and blue lights. In this way, when the stylus stays directly above a pixel, it can collect the light of the red, green, and blue lamp beads in the pixel.

These 3 LEDs will be refreshed 64 times when refreshing a frame of video. This is not simply turning on and off 64 times, but can be understood as the working time of the LEDs in this frame, that is, within 16.67ms. It is divided into 64 working segments, and each working segment has a corresponding working state (on, off). 3 lamp beads correspond to 192 working segments at the same time. The data read by the stylus is the status data of the 3 lamp beads in these 64 time segments. In some embodiments, the information read by the stylus at one time is a combination of three time segments of the three lamp beads refreshed in the same frame.

The pixel stylus in this application can sample three lamp beads in a single pixel at one time, as shown in Figure 6, the light entering along the light path provided by the exposure valve is used as the incident light, the stylus in this application can A dichroic refractor is used to refract red, green, and blue light to three photosensitive sensors respectively, and divide the signals into three channels, which are respectively output to the processing system of the stylus. Furthermore, the stylus can read 3 frames of picture data within one frame of picture information.

As mentioned above, this application proposes a stylus (pixel stylus) that performs high-frequency sampling on a single pixel, so that one exposure detection can simultaneously detect the on and off conditions of the three lamp beads on a single pixel, and realize more For efficient lamp bead detection. The stylus can collect the state of each time slot within a frame within a preset range of display area, convert it into a digital signal, and process it to analyze the corresponding coordinate or the offset relative to the reference reference. Furthermore, the actual refresh gap between the screen and the displayed content is truly utilized to achieve low-latency control.

In one embodiment, a touch control system is provided, including a touch display screen, the above-mentioned stylus pen, and an interaction system connected between the touch display screen and the stylus pen.

In one of the embodiments, the touch display screen can be an LED display screen.

As mentioned above, the stylus in this application can record the working status of the display screen in each refresh time segment at a very high sampling rate, and obtain the information used for interaction through direct or indirect feature recognition. Such as lamp bead coordinates, offset distance, moving speed, etc.

In some embodiments, the present application provides two kinds of pens suitable for LED display screen touch, one is a stylus for sampling a single lamp bead, and the other is a stylus for sampling a single pixel at high frequency Control the pen. The main function of the stylus in this application is to collect a single lamp bead, or the state of each time slot within a frame within a preset range of display area, convert it into a digital signal, and process it to analyze the corresponding Coordinates or offsets relative to the reference datum. The above two stylus are used to detect the on-off state of the lamp bead to realize screen touch. The stylus in this application can display 64 time segments (the lamp bead will display the content of the screen through 64 high-speed refreshes when displaying a frame, so as to achieve the required gray scale and output the required brightness. 64 high-speed refreshes can be subdivided into 64 time segments) of the lamp bead status, converted into digital signals and sent back to the display system, thereby realizing the precise positioning of the stylus.

The above two stylus correspond to different scenarios. In terms of time scale, when the screen refreshes a frame of video, it will be refreshed in 64 time segments. For the lamp bead stylus, the information read by the stylus at one time is a time segment of one lamp bead within one frame time; for the pixel stylus, the information read by the stylus at one time is three lights A combination of three time slices of beads refreshed at the same frame.

In one embodiment, the present application provides a touch positioning method. The touch positioning method proposed in the present application does not require obvious changes in the screen structure, but only needs to follow the corresponding refresh strategy. The screen touch interaction under the operation of the stylus is low-cost and low-latency. This application can be based on the existing packaging form of the display screen, is suitable for LED display screens, can realize display touch control, and the cost is extremely low, and the sensitivity of full-size touch control is consistent.

In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

The touch positioning method provided in this application can be applied to the application environment shown in FIG. 1 . Further, using the high-speed dynamic refresh feature of the screen, the data required for interaction, such as the reference coordinate position, etc., is inserted into the screen to be refreshed on the screen, occupying part of the screen refresh time of the screen to refresh the position information of the reference coordinate. At the same time, with a stylus that can collect and refresh features, the current touch position information can be collected with a high sampling frequency. The collected information is sent back to the interactive system to realize the content interaction of the display screen.

The interactive system in Figure 1 can be an independent driving system, which is used to configure a corresponding refresh strategy (for example, refresh mode) for the display screen and interact with the stylus; in some examples, the interactive system can also include The display device of the screen and the driving device and the system of the stylus, and then the stylus interacts with the driving device in the display device. In addition, the driving device can be set independently of the screen, or can belong to the display device together with the screen. The driving device can be used to configure a corresponding refresh policy (for example, refresh mode) for the display screen, and interact with the stylus.

In one embodiment, as shown in FIG. 7 , a touch positioning method is provided. The application of the method to the interactive system in FIG. 1 is used as an example for illustration, including the following steps:

Step 702, receiving the touch position information transmitted by the stylus;

Among them, the touch position information includes the lamp bead data collected and coded by the stylus through the touch object using the corresponding refresh mode; the lamp bead data includes the working time and the working state of the lamp bead.

A stylus may refer to a device used for touch interaction with a touch object. In some examples, the stylus can be a pen-shaped tool, which is used to input instructions to devices with touch screens such as computer screens, mobile devices, and graphics tablets. Users can click on the touch screen with the stylus to select files or draw. It should be noted that the stylus is only for the purpose of illustration. This application can also be realized by using a high-speed sampling device capable of touch interaction with the touch object. The high-speed sampling device can be, for example, a stylus, a lens, etc. .

Further, the touch position information can be obtained via the stylus and transmitted to the interactive system (for example, the driving device in the display device), and the touch position information includes the touch object using the corresponding refresh mode and the code collected by the stylus. The obtained lamp bead data; the lamp bead data includes the working time of the lamp bead and the working state of the lamp bead.

In some embodiments, the touch object (for example, a display screen) performs data sampling through the stylus, and the data may be the light of the lamp beads in the display screen. In some examples, the data sampling may be obtained by monitoring the on-off state of the display screen at a relatively high frequency through the stylus. That is, this application realizes screen touch by detecting the on-off state of the lamp bead. It should be noted that, taking the display screen as an example of an LED screen, when the LED screen displays the content of the screen, it does not realize the content display through the constant light change of the lamp beads, but through the high-frequency on-off transition of the lamp beads. , to reflect the difference of different content, and this display feature is called dynamic scanning, which is an important display feature of LED display. Under the dynamic scanning drive, for a single lamp bead, it will not keep a constant on state, but will change at a very high frequency, and realize different content display during the turn on and off. The light effect displayed by the lamp beads through high-frequency alternating on and off is progressive from on to off, and the final effect is called gray scale. There are usually 256 gray scales used by LED lamp beads from on to off, and there are 3 lamp beads on a single pixel, which are red light, green light and blue light. The 3 lamp beads achieve different color display through different brightness ratios. Therefore, when the LED display screen displays the picture, for a single lamp bead, it mainly relies on grayscale refresh to achieve.

In order to ensure uniform and stable color and brightness changes, the LED display screen will increase the refresh rate of the screen grayscale as much as possible. Usually, an LED display screen can achieve a screen refresh rate of 3840HZ, which means that when a 60HZ display screen is played, each frame of the screen displayed will be reflected by 64 refreshes of the LED display screen. And these 64 refreshes are grayscale refreshes. It can be seen that the screen refresh capability of the LED display is much higher than that of the video source information.

In one of the embodiments, the working time of the lamp bead may include the lighting time of the lamp bead on each time slot in a frame; the working state of the lamp bead may include the on-off state of the lamp bead on each time slot in a frame.

The interactive system can perform feature recognition on the lamp bead data acquired by the stylus, laying the foundation for subsequent determination of the current contact position of the stylus. The above-mentioned one frame is only an example, and the present application can use the on-off transformation of the lamp bead in a time segment of one frame or multiple frames to realize the output of the coordinate content.

Among them, the lamp bead data can be obtained through the following methods: the lighting component in the stylus collects the touch object, and after obtaining the light of the lamp bead, it can be obtained through the light on-off component, the photosensitive module and the stylus. The data processing module etc. process it sequentially, and then convert it into a readable data stream for processing by the interactive system. For example, the display refreshes 3840 times per second, and the stylus achieves at least 3840 data samples per second. Process and analyze the sampled data, obtain accurate coordinates or reference offsets during motion, and feed them back to the interactive system to update the display data of the next frame. Wherein, the specific numerical value is not limited.

Further, the lamp bead data in this application may be obtained by sampling a single lamp bead and/or a single pixel through a stylus. The light on-off component in the stylus can be turned on when light enters, so that light can enter the photosensitive module; wherein, the light on-off component can refer to a device used to control the time when light illuminates the photosensitive element, and the light on-off The on-off clock of the component may coincide with the refresh clock of the touch object (eg, display screen). In some examples, the lighting assembly can be implemented using a lighting lens, the light on-off assembly can be implemented using an exposure valve, and the photosensitive module can be implemented using a photosensitive module, that is, a photosensitive sensor (for example, a photosensitive sensor); and when collecting a single pixel At the same time, the photosensitive module can include multiple photosensitive sensors, and the stylus can include an optical branching module connected between the light on-off component and the photosensitive module, and the optical branching module divides the light into red, green, and blue light, They are respectively injected into the multiple photosensitive modules contained in the photosensitive module, so that the one-time exposure detection of the light on-off component can simultaneously detect the on-off status of the three lamp beads on a single pixel, and the lamp bead detection is more efficient. In some examples, the light splitting module can be realized by using a dichroic refraction lens. In addition, the stylus can also include a data sending module for communicating with the interactive system.

The interactive system realizes the touch interaction with the stylus based on the dynamic refresh of the display screen (for example, LED display screen). Among them, the working status of a single lamp bead in different time slots can include the following two indicators: one is whether the lamp bead emits light, and the other is the time of light emission, both of which can be recorded by the stylus. In addition, the sampling frequency of the stylus can correspond to the display refresh frequency of the LED display. For the lamp bead, within the time of one frame, for example, every refresh of the time slot will be recorded by the stylus. For the state and time when the lamp bead is on in this time slot, the corresponding digital signal code is output for processing by the corresponding system, and the data content, including the coordinates of the lamp bead, which is helpful for screen interaction, is extracted from it.

It should be noted that the present application has no limitation on the specific structure of the stylus, and any stylus capable of obtaining the touch position information of the touch object at a relatively high sampling rate may be used. In some examples, the stylus can be implemented by using a bead stylus and/or a pixel stylus.

The lamp bead stylus is used to sample a single lamp bead, that is, the on and off of a single lamp bead can be judged by the stylus, and then the current coordinates of the lamp bead are collected. The working state of the lamp bead is on and off. When refreshing a frame, the working cycle of the lamp bead will be divided into 64 time segments, and the on and off status will be refreshed in these 64 time segments. This situation can be regarded as the limited accuracy of the stylus for pixel collection, unable to recognize the brightness status of the three lamp beads on a single pixel point, but turning on and off the entire pixel point as a whole lamp bead Judgment; it can also be regarded as a high-quality display screen, the arrangement of lamp beads on it is extremely fine, and the concept of pixel is composed of any three lamp beads of different colors. Among them, the data read by the stylus can be the status data of a single lamp bead within these 64 time segments. That is, the information read by the stylus at one time is a time segment of a lamp bead in one frame time; and the structure of the stylus can be applied to the structure of the lamp bead stylus (including the lighting lens, exposure valve, photosensitive sensor, data processing module and data sending module, etc.).

The collection range of the pixel stylus is a single pixel point, that is, the on and off of the lamp bead on a single pixel point is judged by the stylus pen, and then the coordinates of the current pixel are collected. There are 3 lamp beads on a pixel, which are red, green and blue lights. In this way, when the stylus stays directly above a pixel, it can collect the light of the red, green, and blue lamp beads in the pixel. These 3 LEDs will be refreshed 64 times when refreshing a frame of video. This is not simply turning on and off 64 times, but can be understood as the working time of the LEDs in this frame, that is, within 16.67ms. It is divided into 64 working segments, and each working segment has a corresponding working state (on, off). 3 lamp beads correspond to 192 working segments at the same time. The data read by the stylus is the status data of the 3 lamp beads in these 64 time segments. Optionally, the information read by the stylus at one time is a combination of the three time segments of the three lamp beads refreshed in the same frame.

Furthermore, the pixel stylus can sample three lamp beads in a single pixel at a time, and take the light entering along the light path provided by the exposure valve as the incident light. , blue light are respectively refracted to the three photosensitive sensors, divided into three signals, and output to the processing system of the stylus respectively. Furthermore, the stylus can read 3 frames of picture data within one frame of picture information. That is to say, the structure of the pixel stylus can be based on the above-mentioned lamp bead stylus, further adding a dichroic refraction lens, and at the same time, three photosensitive sensors can be used.

In addition, the touch object adopts a corresponding refresh mode, which can mean that the touch object sends high-speed data in the form of light on and off for a corresponding length of time through high-speed refresh based on the refresh strategy (for example, driving strategy) provided by the interactive system. information to convey location information. Furthermore, the position information can be collected through the stylus to obtain touch position information. In some examples, the refresh mode may be a multi-level refresh, that is, refresh after sorting the rough positions of the light beads and the precise positions of the light beads (positioning and grading).

Step 704, identifying the touch position information, and determining the current touch position of the stylus.

In this embodiment, after the interaction system acquires the touch position information, it can identify it to determine the current touch point position of the stylus. The recognition can refer to the characteristic recognition of the lamp bead data, reading the information to be conveyed by the display screen in the corresponding refresh mode, and then determining the current contact position of the stylus.

As mentioned above, this application uses the high-speed refresh capability of the display screen to insert the data required for interaction, such as coordinate positions, etc., into the screen to be refreshed on the screen, occupying part of the screen refresh time of the screen to refresh the position information of the coordinates, and at the same time , in conjunction with the stylus that collects and refreshes features, realizes the collection of current touch position information with a high sampling frequency, and then realizes low-latency touch interaction of display screen content based on the collected information. The present application can realize display touch control based on the existing packaging form of the display screen, and the cost is extremely low, and the sensitivity of full-size touch control is consistent.

In one embodiment, as shown in FIG. 8 , a touch positioning method is provided. The application of the method to the interactive system in FIG. 1 is used as an example for illustration, including the following steps:

Step 802, receiving touch position information transmitted by the stylus;

Among them, the touch position information includes the lamp bead data collected and coded by the stylus through the touch object using the corresponding refresh mode; the lamp bead data includes the working time and the working state of the lamp bead.

Step 804, identifying the touch position information, and determining the current contact position of the stylus;

Wherein, the refresh mode includes the current refresh content confirmed by the touch object based on the refresh strategy; the refresh strategy includes the refresh order of the refresh content.

Step 806, if the current contact position does not meet the positioning end condition, output a display command; the display command is used to instruct the touch object to call the corresponding display area to display the next refresh content in the refresh sequence; the positioning end condition includes the current contact point The position contains the precise position of the lamp bead.

Take the touch object as an example of an LED display; the size of the LED display is very large, usually reaching hundreds of inches. On such a large-sized display screen, this application proposes to classify the coordinates of the lamp beads to realize full-scale touch control, thereby avoiding the problem of large data redundancy caused by point-by-point calibration, so that this application can be achieved through a simple The lamp bead is on and off to express the complete data.

For a single lamp bead or single pixel on the LED display, the touch position information collected by the stylus can be the lamp bead position information refreshed step by step, and the main form of expressing this information is It is 64 refreshes of the display screen within one frame time, and these 64 times of on-off transitions can cover the above-mentioned information. On the one hand, in the process of transmitting the position data, the impact on the normal display quality of the display screen should be as small as possible. On the other hand, the delay in the process of refreshing the position data, until the precise coordinates are obtained, and then the interactive system refreshes the next frame based on the precise coordinates based on the feedback and displays them should be as small as possible.

Since the position coordinate information of each pixel is fixed, the content to be displayed is not fixed. That is, when a pixel is displaying content, its on-off state within a frame time is irrelevant to the position coordinates of the current pixel. Therefore, there may be the following situation, that is, the current pixel needs to display the content, and the time slot of the indicator bead is only on once in this frame time segment. The coordinates of the lamp bead need to be refreshed, and this position coordinate not only allows the lamp bead to be turned on and off only once in a frame time, but to be turned on and off at least several times in order to express a value normally. Similarly, if within this frame time, the display content needs to be on for 50 times, and the lamp bead needs to refresh the coordinates, it does not need to be on so many times as many as 50 times, but as little as possible, alternately on, and then transmits A meaningful binary number. That is to say, the sent data should not have too many 0s or too many 1s, but the two numbers should be balanced. In short, if the lamp beads want to refresh the position coordinates of the display screen in this way, the originally dark areas will be brightened, and the bright areas will be darkened, at least for a certain period of time, it has the bad effect of reducing the dynamic range of the screen. In this case, if you let the lamp bead refresh its position coordinates at a fixed time interval, for example, refresh the position coordinates every 10 frames, when refreshing the position coordinates this time, regardless of the display content of the screen itself, so that It will greatly reduce the dynamic range of the screen and affect the display quality of the screen.

In this regard, the screen refresh strategy proposed in this application can refresh the position coordinates of the lamp beads step by step from coarse to fine with higher efficiency and lower delay without affecting the display quality. Stylus. The refresh mode in this application includes the current refresh content confirmed by the touch object based on the refresh strategy; the refresh strategy includes the refresh order of the refresh content. In some examples, the refresh policy may be the driving policy of the interactive system output. The refresh content in this application may include the rough position of the lamp bead and the precise position of the lamp bead. In some examples, the refresh mode can be a multi-level refresh, that is, the rough position of the lamp bead and the precise position of the lamp bead are sorted and then refreshed (positioning classification), wherein the sorting of the rough position of the lamp bead in the refresh order is greater than the precise position of the lamp bead The sorting, that is, the rough position of the lamp bead is refreshed first, so that the touch object can gradually reduce the display area, and gradually locate the coordinates of the lamp bead where the contact position of the stylus is located.

Furthermore, this application proposes the optimization of the refresh strategy of the screen, which can refresh the position coordinates of the lamp beads step by step from coarse to fine with higher efficiency and lower delay without affecting the display quality Give the stylus. In the hierarchical touch mode, the refreshing of the screen can be divided into rough coordinates (the rough position of the lamp bead) and precise coordinates (the precise position of the lamp bead). The content to be expressed in rough coordinates is simple, such as a simple number, the division of left and right ranges, etc., that is, the amount of data occupied by rough coordinates is small, and the refresh cycle is short. The refreshing of precise coordinates involves the specific position coordinates of each lamp bead in a certain area. In some examples, the precise position of the lamp bead can be the coordinates of the lamp bead, and the rough position of the lamp bead can include the number of the module to which the lamp bead belongs and/or the number of the display area to which the module belongs, and the refresh content at the end of the refresh order can include the lamp bead coordinate.

In step 806, the present application proposes that after the current contact position of the stylus is determined, it is confirmed whether the current contact position satisfies the positioning end condition, and the positioning end condition includes that the current contact position includes the precise position of the lamp bead. That is, if the current contact position includes the precise position of the lamp bead, it can be confirmed that in the current refresh, the touch object has passed the coordinates of the lamp bead through the lamp bead data (the current refresh content in the refresh sequence is the precise position of the lamp bead), Then the positioning can be stopped. If the current contact position does not include the precise position of the lamp bead (the current refresh content in the refresh sequence is the rough position of the lamp bead), you can confirm that in the current refresh, the touch object has not passed the coordinates of the lamp bead, and you can inform the touch object Display the next refresh content in the refresh sequence.

In one of the embodiments, the refresh content at the end of the refresh order may include the coordinates of the lamp bead; and the refresh order includes that the order of the module numbers to which the lamp beads belong is greater than the display area numbers to which the modules belong, and the order of the display area numbers to which the modules belong The sorting is greater than the lamp bead coordinates. It should be noted that, for the specific implementation process of steps 802 to 804, reference may be made to the description of steps 702 to 704 above, and details will not be repeated here.

In one of the embodiments, before the step of receiving the touch position information transmitted by the stylus, the step may further include:

Receive the refresh position coordinate request transmitted by the stylus; the refresh position coordinate request is output by the stylus during the first touch operation on the touch object;

Based on the refresh location coordinate request, a full-screen display command is output; the full-screen display command is used to instruct the touch object to display the first refresh content in the refresh order by traversing the entire screen within a preset period of time; the first refresh content includes the rough position of the lamp bead.

The stylus can output touch position information to the interactive system during the first touch operation on the touch object, and then the interactive system outputs the full-screen display command to the display screen, that is, when the stylus touches the screen, the stylus The screen can be told to "start refreshing location coordinates".

The above process does not immediately obtain precise coordinates. Since the stylus has not received the first precise coordinate refreshed by the touch object before, the stylus cannot determine the position of the main body relative to the touch object, and the touch object does not know the exact position of the stylus. At this time, when the touch object receives the "full-screen display command", it can traverse the position coordinates of the entire screen, that is, display the first refresh content in the refresh order by traversing the entire screen within a preset period of time; and the first refresh The content can include the rough position of the lamp bead.

Obviously, if you refresh the precise coordinates of every lamp bead or pixel on the entire screen every time you refresh, first of all, you don’t have such a large encoding capability, and second, it will take a lot of time and affect the display quality. However, the present application proposes a hierarchical refreshing refresh strategy, which informs the current position coordinates of the stylus with sub-accuracy.

For example, the P1 display module has 320 lamp beads in the horizontal direction and 160 lamp beads in the vertical direction. If there are 100 modules on one screen, take the upper left corner as the coordinate origin and code these pixels one by one. Then the coordinates of the lamp bead in the lower right corner are (32000, 16000). When each lamp bead reports its own lamp bead coordinates, it must accurately explain its coordinates. Its X-axis coordinates and Y-axis coordinates require at least 5 bits of data representation space. It is necessary to express this without affecting the display quality of the lamp bead. A data feature is very difficult, and the stylus needs to touch and interact on the screen with a very low delay, and it will take a long time to process the data.

Taking the touch object as the display screen, the first refresh content is the rough position of the lamp bead, and the rough position of the lamp bead includes the module number of the lamp bead as an example; it is also a P1 display module, and there are still 100 modules on the screen , number each module. When reading the precise coordinates of the pixels, first determine the number of the module, so that you can distinguish which lamp bead on the module. The identification of the precise position of the lamp bead is further limited to a single module. At this time, the precise coordinates of a module can be simplified to the module number + coordinates on the module. The maximum coordinates on the module are only (320,160), and its X-axis coordinates and Y-axis coordinates are simplified to 3-digit data. Compared with the previous scheme, it has been simplified to a certain extent, and then the coordinate classification is realized.

In this application, there are at least the following three methods for positioning and grading the position coordinates of the lamp beads: ①Module number + precise coordinates of the lamp bead on the module; ②Module number + display area number on the module + precise coordinates in the display area; ③The offset direction compared with the reference + the offset distance compared with the reference. Among them, the reference can refer to the approximate position (initial position). For example, when the touch position information fed back by the stylus is the module number, the approximate position of the stylus can be determined, and then the subsequent screen refresh will be It is mainly based on the increment, offset or prediction of the initial position, so that there is no need to refresh the coordinates of the lamp beads on the entire screen.

In one of the embodiments, the positioning end condition may also include that the current contact position contains an increment compared with the reference coordinate; the refresh content at the end of the refresh sequence includes the increment;

The reference coordinate is determined based on the precise position of the lamp bead; the increment includes an offset compared to the reference coordinate; the offset includes an offset angle and an offset distance along the predicted moving direction of the stylus.

After the precise position of the lamp bead (for example, the coordinates of the lamp bead) is obtained, the offset of the touch object output along the predicted moving direction of the stylus can be controlled. The reference coordinates may be determined based on the precise positions of the lamp beads, for example, the reference coordinates may be the coordinates of the lamp beads.

In some examples, after the stylus determines the precise coordinates of the lamp bead, it can instruct the screen to continue to perform the following events: ① Predict the moving direction of the pen, and refresh the precise coordinates in the possible direction; ② Predict the movement direction of the pen Move the direction, and refresh the offset compared to the precise coordinates in the possible direction; ③Predict the moving direction of the pen, and refresh the offset angle and offset distance compared with the reference in the possible direction.

In order to further explain the solution of the present application, an example is given below. The present application does not limit the complete touch interaction form between the screen and the stylus, and the following is only one of various implementations. In the low-latency touch positioning method implemented in this application, after confirming the sampling method of the stylus and the refreshing method of the screen, there may be various specific interaction forms. One of the touch processes can be shown in Figure 9: when the stylus touches the screen, the stylus sends a coordinate refresh request (and start refresh command) to the screen through the interactive system, and then the full-screen lamp beads or pixels are in a certain position. Its position information will be refreshed within a certain period of time until the next step of the stylus feedback. And this refresh does not refresh the exact coordinates of each lamp bead on the full screen in one step, but refreshes the module number first, then refreshes the area, and then refreshes the exact coordinates, which can reduce the impact on display quality. Among them, when the stylus feedbacks the module number, the approximate position of the stylus can be determined, and the subsequent screen refresh can be based on the increment, offset or prediction of the initial position. Refresh the lamp bead coordinates.

As mentioned above, this application combines the touch control of the display screen with the display feature of the dynamic refresh of the display screen, so that by using the dynamic refresh of the display screen, it is possible to use the on-off transformation of the lamp beads in a time segment of one frame or multiple frames to realize Realize the output of coordinate content. This application proposes a high-precision, low-latency lamp bead coordinate refresh mode, and proposes a typical interactive application scenario between a stylus and a display screen, including multi-level position positioning, which is suitable for low-latency writing. Taking the LED display screen as an example, this application aims at the design of the existing LED display screen, that is, no structural and system changes are required for the existing LED display screen, by optimizing the screen refresh strategy and cooperating with high-speed sampling equipment, such as a stylus , lens, etc., you can realize the touch interaction of the screen. And it is not affected by the size of the screen, and can achieve smooth writing on the screen with low latency and multi-precision effects.

It should be understood that although the various steps in the flow charts of FIGS. 7-9 are shown sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in Figures 7-9 may include a plurality of sub-steps or stages, these sub-steps or stages are not necessarily performed at the same time, but may be performed at different times, these sub-steps or stages The order of execution is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

In one embodiment, as shown in FIG. 10 , a touch positioning device is provided, including:

The receiving module 1010 is used to receive the touch position information transmitted by the stylus; the touch position information includes the lamp bead data obtained by collecting and encoding the touch object using the corresponding refresh mode through the stylus; the lamp bead data includes the working time of the lamp bead and the working status of the lamp bead;

The identification module 1020 is configured to identify the touch position information and determine the current contact position of the stylus.

In one of the embodiments, the refresh mode includes the current refresh content confirmed by the touch object based on the refresh strategy; the refresh strategy includes the refresh order of the refresh content;

Also includes:

The command output module is used to output a display command if the current contact position does not meet the positioning end condition; the display command is used to instruct the touch object to call the corresponding display area to display the next refresh content in the refresh sequence; the positioning end condition includes The current contact position includes the precise position of the lamp bead.

In one of the embodiments, the receiving module 1010 is also configured to receive a request for refreshing position coordinates transmitted by the stylus; the request for refreshing position coordinates is output by the stylus during the first touch operation on the touch object;

The command output module is also used to output a full-screen display instruction based on the refresh position coordinate request; the full-screen display instruction is used to instruct the touch object to display the first refresh content in the refresh sequence by traversing the entire screen within a preset period of time; the first refresh The content includes the rough position of the lamp bead.

In one of the embodiments, the working time of the lamp bead includes the luminous time of the lamp bead on each time slot in one frame; the working state of the lamp bead includes the on-off state of the lamp bead on each time slot in one frame; the precise position of the lamp bead is Bead coordinates; the rough position of the lamp bead includes the module number to which the lamp bead belongs.

In one of the embodiments, the refresh content at the end of the refresh order includes the coordinates of the lamp bead; the rough position of the lamp bead also includes the number of the display area to which the module belongs; The order of the area number and the display area number to which the module belongs is greater than that of the lamp bead coordinates.

In one of the embodiments, the positioning end condition also includes that the current contact position contains an increment compared with the reference coordinate; the refresh content at the end of the refresh sequence includes the increment; An offset compared to the reference coordinates; the offset includes an offset angle and an offset distance along the predicted moving direction of the stylus.

For specific limitations on the touch positioning device, please refer to the above definition on the touch positioning method, which will not be repeated here. Each module in the above-mentioned touch positioning device can be fully or partially realized by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules. It should be noted that the division of modules in the embodiment of the present application is schematic, and is only a logical function division, and there may be other division methods in actual implementation.

In one embodiment, a touch interaction system is provided, including a display screen, a driving device, and a stylus;

Wherein, the stylus is used to use the display screen as a touch object; the driving device is used to execute the steps of the above-mentioned touch positioning method.

Optionally, in this application, the stylus can interact with the driving device, so as to realize low-latency, low-cost touch interaction of display screen content. The driving device and the display screen can be set independently, or integrated into a display device.

In one of the embodiments, the display screen can be an LED display screen.

In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned touch positioning method are implemented.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above-mentioned embodiments can be completed by instructing related hardware through computer programs, and the computer programs can be stored in a non-volatile computer-readable memory In the medium, when the computer program is executed, it may include the processes of the embodiments of the above-mentioned methods. Wherein, any references to memory, storage, database or other media used in the various embodiments provided in the present application may include at least one of non-volatile memory and volatile memory. Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM).

In the description of this specification, descriptions referring to the terms "some embodiments", "other embodiments", "ideal embodiments" and the like mean that specific features, structures, materials, or characteristics described in connection with the embodiments or examples are included in this specification. In at least one embodiment or example of the application. In this specification, schematic descriptions of the above terms do not necessarily refer to the same embodiment or example.

The technical features of the above embodiments can be combined arbitrarily. To make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered to be within the range described in this specification.

The above-mentioned embodiments only express several implementation modes of the present application, and the description thereof is relatively specific and detailed, but it should not be construed as limiting the scope of the utility model patent. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the scope of protection of the patent application should be based on the appended claims.

Claims (20)

1. A stylus comprising a body having a first end and an opposite second end, and disposed within the body:

   A lighting assembly located at the first end; the input end of the lighting assembly is used to collect the touch object, and the output end of the lighting assembly is used to output the collected light;

   A light on-off component; the input end of the light on-off component is connected to the output end of the lighting component to control the on-off of the light path of the light;

   A photosensitive module; the input end of the photosensitive module is connected to the output end of the light on-off component for converting the received light into an electrical signal;

   A data processing module; the input end of the data processing module is connected to the output end of the photosensitive module for encoding the electrical signal and then outputting it.
2. The stylus according to claim 1, further comprising a data sending module disposed in the main body and located at the second end;

   The input end of the data sending module is connected to the data processing module, and the output end of the data sending module is used to connect to an interactive system.
3. The stylus according to claim 2, further comprising a memory and a power supply disposed in the main body;

   The memory is respectively connected to the photosensitive module and the data processing module;

   The power supply is connected between the data sending module and the data processing module.
4. The stylus according to claim 1, further comprising a writing tip connected to said body and located at said first end.
5. The stylus according to claim 1, further comprising an optical branching module disposed in the main body; the optical branching module includes at least one input terminal and a plurality of output terminals;

   The input end of the optical splitting module is connected to the output end of the optical on-off component;

   The photosensitive module group includes a plurality of photosensitive modules; the input end of each photosensitive module is respectively connected to an output end of the optical splitting module.
6. According to the stylus according to claim 5, the optical branching module is a dichroic refractor.
7. The stylus according to any one of claims 1 to 6,

   The lighting component is a lighting lens; the input end of the lighting lens is used to collect the light beads in the touch display screen, so as to output the light of the light beads;

   The light on-off component is an exposure valve whose on-off clock is the same as the refresh clock of the touch display screen; wherein, the exposure valve is opened when the light enters.
8. The stylus according to claim 7, wherein the photosensitive module is a photosensitive sensor.
9. A touch control system, comprising a touch display screen and the stylus according to any one of claims 1 to 8, and an interaction system connected between the touch display screen and the stylus.
10. According to the touch control system according to claim 9, the touch display screen is an LED display screen.
11. A touch positioning method, comprising:

    Receive the touch position information transmitted by the stylus; the touch position information includes the lamp bead data obtained by collecting and encoding the touch object using the corresponding refresh mode through the stylus; the lamp bead data includes the working time of the lamp bead and the working status of the lamp bead;

    Identifying the touch position information to determine the current contact position of the stylus.
12. According to the touch positioning method according to claim 11, the refresh mode includes the current refresh content confirmed by the touch object based on the refresh strategy; the refresh strategy includes the refresh order of the refresh content;

    Also includes steps:

    If the current contact position does not meet the positioning end condition, output a display command; the display command is used to instruct the touch object to call the corresponding display area to display the next refresh content in the refresh order; The positioning end condition includes that the current contact position includes the precise position of the lamp bead.
13. According to the touch positioning method according to claim 12, before the step of receiving the touch position information transmitted by the stylus, further comprising the steps of:

    receiving a refresh position coordinate request transmitted by the stylus; the refresh position coordinate request is output by the stylus during the first touch operation on the touch object;

    Based on the refresh position coordinate request, output a full-screen display instruction; the full-screen display instruction is used to instruct the touch object to display the first refresh content in the refresh order by traversing the entire screen within a preset period of time; The first refresh content includes the rough position of the lamp bead.
14. According to the touch positioning method according to claim 13, the working time of the lamp bead includes the light-emitting time of the lamp bead on each time slot in one frame; off state;

    The precise position of the lamp bead is the coordinate of the lamp bead; the rough position of the lamp bead includes the serial number of the module to which the lamp bead belongs.
15. According to the touch positioning method according to any one of claims 12 to 14, the last refresh content in the refresh order includes the coordinates of the lamp bead; the rough position of the lamp bead also includes the number of the display area to which the module belongs; the refresh order Including that the sequence of the module numbers to which the lamp beads belong is greater than the display area numbers to which the modules belong, and the sequence of the display area numbers to which the modules belong is greater than the coordinates of the lamp beads.
16. According to the touch positioning method according to any one of claims 12 to 14, the positioning end condition further includes that the current contact position includes an increment compared with the reference coordinates; the refresh content at the end of the refresh sequence includes the said increment;

    The reference coordinate is determined based on the precise position of the lamp bead; the increment includes an offset compared to the reference coordinate; the offset includes an offset along the predicted movement direction of the stylus. shift angle and offset distance.
17. A touch positioning device, comprising:

    The receiving module is used to receive the touch position information transmitted by the stylus; the touch position information includes the lamp bead data acquired and coded by the stylus through the touch object using the corresponding refresh mode; the lamp bead data Including the working time of the lamp bead and the working status of the lamp bead;

    An identification module, configured to identify the touch position information, and determine the current contact position of the stylus.
18. A touch interaction system, including a display screen, a driving device and a stylus;

    Wherein, the stylus is used to use the display screen as a touch object; the driving device is used to execute the steps of the method described in any one of claims 11-16.
19. According to the touch interaction system according to claim 18, the display screen is an LED display screen.
20. A computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the method according to any one of claims 11 to 16 are realized.

Images