CN114047841A

CN114047841A - Screen refreshing positioning method and device, display equipment and storage medium

Info

Publication number: CN114047841A
Application number: CN202111327220.1A
Authority: CN
Inventors: 王朝; 朱卫强
Original assignee: Shenzhen Zhouming Technology Co Ltd
Current assignee: Shenzhen Zhouming Technology Co Ltd
Priority date: 2021-11-10
Filing date: 2021-11-10
Publication date: 2022-02-15

Abstract

The application relates to a screen refreshing positioning method and device, a display device and a storage medium. The screen refreshing positioning method comprises the following steps: acquiring touch position information; the touch position information is acquired by the touch pen through lamp bead data displayed by the touch object based on the refreshing strategy; the refreshing strategy comprises a driving instruction for indicating that the current display content of the touch object comprises the position of the lamp bead; the lamp bead data comprises low-ash data used for expressing the position of the lamp bead; and analyzing the touch position information to obtain a refreshing sequence of the low-gray data in the lamp bead data, and determining the current touch point position of the touch pen based on the refreshing sequence. According to the method and the device, the low-delay interactive touch of the screen can be realized on the premise of not influencing the display quality.

Description

Screen refreshing positioning method and device, display equipment and storage medium

Technical Field

The present application relates to the field of touch interaction technologies, and in particular, to a method and an apparatus for screen refresh positioning, a display device, and a storage medium.

Background

For a few hundred inch LED (Light-Emitting Diode) display screen, touch control is implemented, and the lowest cost implementation method of the display screen is to use an infrared touch frame. The touch screen comprises an infrared touch frame and a touch pen, and is characterized in that a series of infrared probes are arranged at the edge of the screen, and the probes can irradiate a pen point of the touch pen to generate light reflection. And calculating the accurate coordinates of the current drop point by detecting the reflected light of different probes. However, in the infrared touch frame mode, when the emitted light is blocked, the touch function is lost, and in addition, the touch sensitivity of the edge position of the screen is low. The position of a probe erected on the edge part of the screen is difficult to ignore, and a large black edge on the edge of the screen cannot be avoided.

Other touch schemes of display screens, including capacitive type, vector pressure sensing type, surface acoustic wave type, metal grid type, piezoresistor type, infrared type and the like, are generally limited by contradictions between cost and full-size control, and it is difficult to realize full-size touch screen control with low delay under the condition of low cost. Namely, in the implementation process, at least the following problems are found in the conventional technology: the current touch control mode has the problem of higher time delay.

Disclosure of Invention

In view of the foregoing, it is desirable to provide a screen refresh positioning method, device, display device and storage medium capable of reducing latency.

In order to achieve the above object, in one aspect, an embodiment of the present application provides a screen refresh positioning method, including:

acquiring touch position information; the touch position information is acquired by the touch pen through lamp bead data displayed by the touch object based on the refreshing strategy; the refreshing strategy comprises a driving instruction for indicating that the current display content of the touch object comprises the position of the lamp bead; the lamp bead data comprises low-ash data used for expressing the position of the lamp bead;

and analyzing the touch position information to obtain a refreshing sequence of the low-gray data in the lamp bead data, and determining the current touch point position of the touch pen based on the refreshing sequence.

In one embodiment, the position of the lamp bead comprises the precise position of the lamp bead; the lamp bead data is the lamp bead working state on each time slot in a frame; the low-ash data is data that the lamp bead working state is low-ash;

analyzing the touch position information to obtain a refreshing sequence of the low-gray data in the lamp bead data, and determining the current touch point position of the touch pen based on the refreshing sequence, wherein the step comprises the following steps:

analyzing values corresponding to the working states of the lamp beads on each time slot in one frame in sequence by adopting a binary rule, and determining the arrangement of the values as a refreshing sequence;

and obtaining the accurate positions of the lamp beads corresponding to the refreshing sequence, and taking the accurate positions of the lamp beads as the current contact positions.

In one embodiment, the step of obtaining the accurate positions of the lamp beads corresponding to the refreshing sequence includes:

and comparing the calibration sequence with the refreshing sequence, and obtaining the accurate position of the lamp bead according to the comparison result.

In one embodiment, the working states of the lamp beads further comprise normal brightness and normal darkness; the normal light and the normal dark in the calibration sequence are refreshed alternately, and the normal light and the normal dark are in the sequence before the low gray.

In one embodiment, the precise position of the lamp bead comprises the coordinates of the lamp bead; the calibration sequence is used for corresponding to the origin coordinates; the number of the low gray data is 2, which are the first low gray data and the second low gray data, respectively;

comparing the calibration sequence with the refreshing sequence, and obtaining the accurate position of the lamp bead according to the comparison result, wherein the step comprises the following steps:

if the comparison result is that the calibration sequence is the same as the refreshing sequence, determining the coordinates of the lamp beads as original coordinates;

if the comparison result is that the calibration order is different from the refreshing order, respectively detecting a first position of the first low-gray data in the refreshing order and a second position of the second low-gray data in the refreshing order; and acquiring a first offset of the first position relative to the position of the first low-ash data in the calibration sequence and a second offset of the second position relative to the position of the second low-ash data in the calibration sequence, and acquiring an X-axis coordinate value of the lamp bead coordinate according to the first offset and an Y-axis coordinate value of the lamp bead coordinate according to the second offset.

In one embodiment, the precise position of the lamp bead comprises the coordinates of the lamp bead; the calibration sequence corresponds to the gray level of the lamp beads in one frame, and the gray level of the lamp beads is determined according to the driving instruction;

and if the comparison result shows that the calibration sequence is different from the refreshing sequence, acquiring the deviation of the calibration sequence and the refreshing sequence, and determining the coordinates of the lamp beads according to the deviation.

In one embodiment, the refresh policy further includes a current display area identified based on previous display content; the last display content comprises the rough position of the lamp bead.

A screen refresh location device, comprising:

the information acquisition module is used for acquiring touch position information; the touch position information is acquired by the touch pen through lamp bead data displayed by the touch object based on the refreshing strategy; the refreshing strategy comprises a driving instruction for indicating that the current display content of the touch object comprises the position of the lamp bead; the lamp bead data comprises low-ash data used for expressing the position of the lamp bead;

and the analysis positioning module is used for analyzing the touch position information to obtain a refreshing sequence of the low-gray data in the lamp bead data, and determining the current contact position of the touch pen based on the refreshing sequence.

A display device comprises a display screen and a driving device;

the display screen is used as a touch object of the touch pen; the drive means are adapted to perform the steps of the method described above.

A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.

One of the above technical solutions has the following advantages and beneficial effects:

the touch position information acquired by the application is acquired by a touch pen for lamp bead data displayed on the touch object based on a refreshing strategy; the refreshing strategy comprises a driving instruction for indicating that the current display content of the touch object comprises a lamp bead position, and meanwhile, the lamp bead data comprises low-gray data for expressing the lamp bead position, so that the current touch point position of the touch pen can be determined based on the refreshing sequence of the low-gray data in the lamp bead data. The refreshing of the positioning position is hidden in the low-gray display, and then the position refreshing is carried out by utilizing the low-gray refreshing segment of the lamp bead, wherein the sequence of the time slot of the low-gray refreshing of the touch object in the whole frame of display picture is used for expressing the corresponding position information. According to the method and the device, the low-delay interactive touch of the screen can be realized on the premise of not influencing the display quality.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments or the conventional technologies of the present application, the drawings used in the descriptions of the embodiments or the conventional technologies will be briefly introduced below, it is obvious that the drawings in the following descriptions are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a diagram of an application environment of a screen refresh location method in one embodiment;

FIG. 2 is a flow chart illustrating a screen refresh location method according to an embodiment;

FIG. 3 is a schematic diagram of low gray refresh in one embodiment;

FIG. 4 is a flowchart illustrating a screen refresh location method according to another embodiment;

FIG. 5 is a diagram illustrating low-gray out-of-order offset refresh in one embodiment

FIG. 6 is a block diagram of a screen refresh location device in an embodiment.

Detailed Description

To facilitate an understanding of the present application, the present application will now be described more fully with reference to the accompanying drawings. Embodiments of the present application are set forth in the accompanying drawings. This application may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.

It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another.

Spatial relational terms, such as "under," "below," "under," "over," and the like may be used herein to describe one element or feature's relationship to another element or feature as illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements or features described as "below" or "beneath" other elements or features would then be oriented "above" the other elements or features. Thus, the exemplary terms "under" and "under" can encompass both an orientation of above and below. In addition, the device may also include additional orientations (e.g., rotated 90 degrees or other orientations) and the spatial descriptors used herein interpreted accordingly.

It will be understood that when an element is referred to as being "connected" to another element, it can be directly connected to the other element or be connected to the other element through intervening elements. Further, "connection" in the following embodiments is understood to mean "electrical connection", "communication connection", or the like, if there is a transfer of electrical signals or data between the connected objects.

As used herein, the singular forms "a", "an" and "the" may include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises/comprising," "includes" or "including," etc., specify the presence of stated features, integers, steps, operations, components, parts, or combinations thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof. Also, as used in this specification, the term "and/or" includes any and all combinations of the associated listed items.

The screen touch of LED display screens has been mainly limited by three problems. The first is to realize the screen touch of the full-size LED display screen, which requires a large hardware cost, and the control of the hardware occupies a large memory of the system. Secondly, the touch control of the large-size display screen needs to maintain lower delay, namely, the time for completing one touch control interaction is extremely short. And thirdly, the touch sensors are arranged and hidden, so that gaps on the surface of the screen and possible influences on the display quality of the display screen are reduced.

The traditional scheme of externally connecting an infrared frame is that an infrared pair tube sensor is erected at the edge of a screen, and the touch input position on the surface of the screen is detected by utilizing infrared light and reflected light. However, there are at least the following problems: the edge position of the screen must be reserved with a certain position for placing the infrared geminate transistor sensor and the infrared geminate transistor sensor module, and the screen always has a black boundary. Secondly, the edge part of the screen has smaller difference between emergent light and incident light, so that the touch sensitivity is lower relatively in the middle and is not the sensitivity consistent with the full screen. And thirdly, in different building environments, the situation that the touch control requirement behind the infrared ray is shielded after the infrared ray is shielded and reflected back may occur.

In other conventional schemes, a vector pressure sensor, namely a fine strain gauge is used for feeding back the touch coordinates of the screen, so that a great number of strain gauges need to be erected on the whole screen; the metal grids are adopted, and the grids are attached to the surface of the screen to cause the shielding of the screen; low delay interaction is difficult to achieve with capacitive control. Various screen touch methods have drawbacks on LED display screens. For touch interaction, the core work is to determine the position coordinates of a touch point relative to a screen, and a method for determining the coordinates of the touch point is the primary problem to be solved by the touch interaction and is also the primary problem to be realized by the current LED display screen. In addition, the processing technology of the packaging structure of the LED display screen with high resolution has extremely high requirement on consistency. The characteristics of the internal components are easily changed, and the display quality of the screen is easily reduced.

Therefore, a touch positioning scheme is proposed at present, the screen touch interaction under the operation of a touch pen is realized only according to a corresponding refreshing strategy without obviously changing the screen structure, and the touch positioning scheme is low in cost and low in time delay. The scheme can be based on the existing display screen packaging form, is suitable for the LED display screen, can realize display touch, and is extremely low in cost and consistent in full-size touch sensitivity. According to the touch positioning scheme, data required for interaction, such as reference coordinate positions and the like, are inserted into a picture to be refreshed on the screen by utilizing the high-speed dynamic refreshing characteristic of the screen, so that partial picture refreshing time of the screen is occupied, and the position information of the reference coordinate is refreshed. Meanwhile, the collection of the current touch position information is realized by matching with a touch pen capable of collecting refreshing characteristics at a higher sampling frequency, and the collected information is sent back to an interaction system, so that the content interaction of the display screen is realized.

However, in the above touch positioning scheme, the refresh mode adopted by the touch object is multi-level refresh, for example, the position coordinates of the lamp beads are refreshed step by step from coarse to fine to be refreshed step by step to the touch pen, that is, the coarse coordinates of the lamp beads and the precise coordinates of the lamp beads are refreshed after being sorted in a grading manner (positioning grading). The refreshing sequence of the rough coordinates of the lamp beads is superior to the precise coordinates of the lamp beads, namely the rough coordinates of the lamp beads are preferentially refreshed, so that the touch object can gradually reduce the display area and gradually position the coordinates of the lamp beads at the contact positions of the touch pen. For example, the above scheme can include the following modes for positioning and grading the position coordinates of the lamp beads: firstly, module numbering and accurate coordinates of lamp beads on the module; the module number, the number of the display area on the module and the accurate coordinate in the display area.

However, in the hierarchical touch format, the refreshing of the screen is divided into coarse coordinates and fine coordinates. The contents to be expressed by the rough coordinates are simple, such as a simple number, division of left and right ranges, and the like. Therefore, the data size occupied by the rough coordinates is small, and the refreshing period is short. However, the refreshing of the precise coordinates relates to the specific position coordinates of each lamp bead in a certain area. Along with the movement of the touch pen, the position coordinate changes in real time, the data volume is large, the refreshing period is long, the reaction time reserved for each pixel point is very short, and the delayed interaction of the display screen is easily caused.

In contrast, the present application provides a screen refresh positioning scheme with a low gray sequence, which uses the sequence of the low gray refresh time slots of the display screen in the display frame of the whole frame to express a corresponding coordinate information. The amount of information that can be covered varies according to the format. According to the method and the device, the refreshing of the positioning coordinates is hidden in the low-gray display, so that the low-delay interactive touch of the screen can be realized on the premise of not influencing the display quality, and the screen has higher efficient data transmission efficiency. In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

The screen refresh positioning method provided by the application can be applied to the application environment shown in fig. 1. The interactive system is used for touch interaction of the display screen. The screen continuously refreshes the display picture at a very high refresh rate, and the touch pen acquires picture information at a corresponding sampling frequency. Specifically, the display screen keeps high-speed refreshing, and the refreshed content can be divided into two partial characteristics, wherein one part is display content, and the other part is interactive information. And the stylus records the working state of the display screen in each refreshing time segment at a certain sampling rate, and obtains information used for interaction, such as coordinates, offset distance, moving speed and the like of a lamp bead through direct or indirect feature recognition. Namely, the low-delay touch interaction of the screen can be realized by utilizing the high-speed refreshing capability of the display screen and the low frame rate difference of the video source.

The interactive system in fig. 1 may be a stand-alone control system configured to configure a display screen with a corresponding refresh policy (e.g., control command) and interact with a stylus; in some examples, the interactive system may also be a system including a display device including a screen and a control device, and a stylus, where the stylus interacts with the control device in the display device, and the control device may be provided independently of the screen or belong to the display device together with the screen, and the control device may be configured to configure a corresponding refresh policy (e.g., a control command) for the display screen and interact with the stylus. The screen refreshing positioning method can be applied to an interactive system, a control device and a touch pen (touch pen collects and analyzes touch position information, feeds back corresponding refreshing strategies and the like, namely, the touch pen interacts with a screen and simultaneously executes touch control and operation).

It should be noted that the touch object may include a display screen; the display screen can be a liquid crystal display screen or an electronic ink display screen; in some embodiments, the display screen may be an LED display screen. Further, the display screen can be implemented based on the existing miniLED, micro LED (micro light emitting diode) or SMD (Surface Mounted device) packaged LED (Surface Mounted device) with Surface strengthening treatment (i.e. Surface Mounted LED), and the structure of the screen is not required to be obviously changed.

In one embodiment, as shown in fig. 2, a screen refresh positioning method is provided, which is exemplified by the application of the method to the interactive system or the stylus in fig. 1, and includes the following steps:

step 202, touch position information is acquired.

The touch position information is acquired by the touch pen through lamp bead data displayed by the touch object based on the refreshing strategy; the refreshing strategy comprises a driving instruction for indicating that the current display content of the touch object comprises the position of the lamp bead; the lamp bead data includes low-ash data for expressing a position of the lamp bead.

In particular, a stylus may refer to a device for touch interaction with a touch object. In some examples, the stylus may be a pen-shaped tool used to input instructions to a computer screen, mobile device, drawing pad, or other device having a touch screen through which a user may tap to select a document or drawing. It should be noted that the stylus is only for illustrative purposes, and in practical applications, the high-speed sampling device capable of performing touch interaction with a touch object may also be implemented, and the high-speed sampling device may be, for example, a stylus, a lens, or the like.

A touch object (e.g., a display screen) samples data via a stylus, which may be light from a lamp bead in the display screen. In some examples, the data sampling may be that the on-off state of the display screen is monitored at a higher frequency by a stylus, that is, screen touch is implemented by detecting the on-off state of the lamp bead. It should be noted that, taking the display screen as an LED screen as an example, when the LED screen displays the picture content, the content display is realized not by the constant on/off change of the lamp beads, but by the high-frequency on/off change of the lamp beads, different content differences are reflected, and this display characteristic is called dynamic scanning and is an important display characteristic of the LED display screen. Under the dynamic scanning driving, for a single lamp bead, the lamp bead does not keep a normally bright state, but is converted at a very high frequency, and different content display is realized in the alternation of on and off. The lamp beads display the lighting effect alternately by the high-frequency on-off, the lighting effect is gradually increased layer by layer from on to off, and the finally expressed effect is called as gray level. The gray scale of LED lamp pearl from bright to going out used usually has 256 levels, has 3 lamp pearls on the single pixel, is red lamp, green lamp and blue lamp respectively. And 3 lamp beads realize different color display through different brightness ratios. Therefore, when the LED display screen displays a picture, for a single lamp bead, the single lamp bead is realized mainly by means of gray level refreshing.

In order to ensure the uniformity and stability of color and brightness variation, the LED display screen can increase the rate of screen gray scale refreshing as much as possible. Generally, a screen refresh rate of 3840HZ can be realized by one LED display screen, which means that when a display screen of 60HZ is played, each frame of the display is realized by 64 times of refreshing of the LED display screen. And the 64 refreshes are the refreshes of the gray scale. The screen refreshing capability of the visible LED display screen is far higher than that of video source information.

Wherein, lamp pearl data can be obtained through following mode: the lighting assembly in the touch pen collects the touch object, and after the light of the lamp bead is obtained, the light can be processed in sequence through the light on-off assembly, the photosensitive module, the data processing module and the like in the touch pen, and then the light can be converted into readable data stream for the interactive system to handle. For example, the display screen refreshes 3840 times per second, and the stylus achieves at least 3840 data samples per second. And processing and analyzing the sampled data to obtain accurate coordinates or reference offset in the motion process, feeding the coordinates or reference offset back to the interactive system, and updating the display data of the next frame. Wherein the specific numerical values are not limited.

Further, the lamp bead data can be obtained by sampling a single lamp bead and/or a single pixel through a touch control pen. The light on-off component in the touch pen can be opened when light enters, so that light can enter the photosensitive module; the light on-off component may refer to a device for controlling the time for which light irradiates the photosensitive element, and an on-off clock of the light on-off component may be consistent with a refresh clock of a touch object (e.g., a display screen). In some examples, the lighting assembly may be implemented by a lighting lens, the light on-off assembly may be implemented by an exposure valve, and the photosensitive module may be implemented by a photosensitive module, i.e., a photosensitive sensor (e.g., a photosensor); and when gathering single pixel, the sensitization module can contain a plurality of sensitization sensors, and this touch-control pen can be including connecting the optical branching module between light break-make subassembly and sensitization module, and the optical branching module falls into red, green, blue light with light, launches respectively in a plurality of sensitization modules that the sensitization module contains for the light break-make subassembly once expose and detect, can detect the bright circumstances of going out of three lamp pearls on the single pixel simultaneously, and the lamp pearl detects more high-efficiently. In some examples, the optical splitting module may be implemented using a beam splitting refractive lens. In addition, the stylus may further include a data transmission module for communicating with the interactive system.

The interactive system enables touch interaction with a stylus based on dynamic refreshing of a display screen (e.g., an LED display screen). Wherein, the operating condition of single lamp pearl at different time slots specifically can include following two indexs: one is whether the lamp bead emits light or not, and the other is the light-emitting time, which can be recorded by the touch control pen. In addition, the sampling frequency of the touch pen can correspond to the display refreshing frequency of the LED display screen, for the lamp beads, in the time of one frame for example, refreshing of each time slot can be recorded by the touch pen, and for the state and time of the lamp beads in the time slot, corresponding digital signal codes are output to be processed by a corresponding system, and data contents which are beneficial to realizing screen interaction and comprise lamp bead coordinates and the like are extracted from the digital signal codes.

It should be noted that, the specific structure of the stylus is not limited in the present application, and the stylus capable of acquiring the touch position information of the touch object at a higher sampling rate may be used. In some examples, the stylus may be implemented using a bead stylus and/or a pixel stylus.

The lamp bead touch control pen is used for sampling a single lamp bead, namely the on and off of the single lamp bead can be judged through the touch control pen, and then the current coordinate of the lamp bead is collected. The working states of the lamp beads are on and off, when a frame of picture is refreshed, the working period of the lamp beads is divided into 64 time segments, and the on-off states are refreshed in the 64 time segments. The condition can be regarded as that the precision of the touch control pen for collecting the pixel points is limited, the brightness states of three lamp beads on a single pixel point cannot be identified, and the whole pixel point is used as a whole lamp bead to carry out on-off judgment; the display screen can also be regarded as a display screen with extremely high quality, the lamp beads on the display screen are arranged and fine, and the concept of the pixel is formed by any three lamp beads with different colors. The data read by the stylus may be status data of a single lamp bead in the 64 time slices. Namely, the information read by the touch control pen at one time is a time segment of one lamp bead in one frame time; the structure style of the touch pen can be applied to the structure (including a lighting lens, an exposure valve, a photosensitive sensor, a data processing module, a data sending module, and the like) of the lamp bead touch pen in the above examples.

The acquisition range of the pixel touch pen is a single pixel point, namely, the on and off of the lamp beads on the single pixel point are judged by the touch pen, and then the coordinates of the current pixel are acquired. One pixel point is provided with 3 lamp beads which are respectively red, green and blue lamps. Therefore, when the touch control pen stays right above one pixel point, the light of the red, green and blue lamp beads in the pixel can be collected. The 3 lamp beads can be refreshed 64 times when refreshing a frame of video picture, but the lamp beads are not simply turned on and off 64 times, but can be understood as being divided into 64 working segments within the working time of the frame, namely 16.67ms, and each working segment has a corresponding working state (on and off). 192 working segments are correspondingly arranged on 3 lamp beads in the same time. The data read by the stylus is the state data of 3 lamp beads in the 64 time slices. Specifically, the information read by the stylus at one time is a combination of three time segments of three lamp beads refreshed in the same frame

Furthermore, the pixel touch pen can sample three lamp beads in a single pixel at a time, light entering along a light path provided by the exposure valve is used as incident light, the touch pen can adopt a light splitting refractor to respectively reflect red, green and blue light to the 3 photosensitive sensors, and 3 paths of signals are respectively output to a processing system of the touch pen. Further, the stylus can read the 3-frame picture data within the one-frame picture information. The structure of the pixel touch pen can be based on the lamp bead touch pen, a light splitting refraction lens is further added, and meanwhile, three photosensitive sensors can be adopted.

Further, touch position information in this application is obtained for touch object through the touch-control pen collection based on the lamp pearl data that the strategy of refreshing shows, and should refresh the strategy and can contain the drive command that is used for instructing touch object's present display content to contain the lamp pearl position, and simultaneously, lamp pearl data can include the low grey data that are used for expressing the lamp pearl position.

Regarding the low gray data in the present application, the following examples can be used for illustration: the lamp beads refresh determined gray levels within a frame time, and need to be controlled by a PWM (Pulse width modulation) signal and an OE (Output Enable) signal together; the PWM signal lights or extinguishes the lamp bead in a pulse mode, the OE signal controls the lamp bead to be capable of or incapable of lighting after receiving the PWM signal, and the two clocks are synchronous. Taking 64 time segments (time slots) in a frame as an example, the concept is derived from the PWM signal, and actually, the specific number of pulses of the PWM signal received by the lamp bead within the time range of a frame is determined by the clock and the pulse width of the PWM signal. The narrower the pulse width, the faster the clock, and the greater the number of refreshes. As long as the lamp beads display enough gray scales within one frame time, the number of refreshing and the pulse width are not particularly limited, that is, more than 64 times of refreshing within one frame time can be performed.

Taking 65 refreshes as an example, the brightness of the lamp bead can be understood as being the same each time the lamp bead is lighted by the PWM signal pulse. Through the cooperation of OE enable, the lamp pearl is different in the duration that once PWM pulse was lighted to realize lower grey level and show. The lamp bead will carry out 65 refreshes in the time of a frame, wherein 63 refreshes, enable is not worked, and the remaining 2 refreshes enable is worked. The final appearance of this total of 65 refreshes is the grayscale output of the lamp bead in the time slice (time slot) of this frame.

Specifically, for the lamp beads, the gray level of one frame is refreshed, and the control can be performed by a 16-bit binary number (or 8-bit or 12-bit binary number, and the cutting is started from the 16-bit high order, and the main difference is that the minimum gray level is different); in the relation between the 16-bit binary number and the refresh time slot, the highest 1 corresponds to the refresh of 32 time slots, the second highest 1 corresponds to the refresh of 16 time slots, and the specific refresh of the lamp bead is controlled by the control signal until the 7 th bit. And starting from the 7 th position, the lamp bead is acted by the control signal and also acted by the enabling signal, namely, the lamp bead is acted by the control signal, and is normally bright in a time slot, and is also acted by the enabling signal, so that the lamp bead is normally bright in a specific time segment of the time slot and is ineffective, and therefore, the lamp bead is only bright for a part of time and dark for a part of time in the time slot, and low-gray-scale display is realized.

And because the access of the enabling signal, the lamp bead can not realize that 64 'normally-on' displays are completed in 64 time slots. In particular, it can be understood that the 64 th slot is divided indefinitely due to the enabled joining. If the control signal has 16 bits, starting with bit 7, the following control signal records the last divided slot. Each division of the last time slot occupies one time slot, so that the time slots of the lamp beads refreshed in the whole frame time are increased. The latter control command has 10 bits, that is, the brightness of the last time slot is divided by 10 times, and the lamp bead needs to add 10 time slots for refreshing the low gray in the whole frame time, namely 63+10 is 73 time slots. Of these 73 timeslots, the first 63 timeslots are controlled by the first 6 control signals and the next 10 low gray timeslots are controlled by the next 10 control signals. And subsequent low gray refresh, only one specific low gray per frame, i.e., only one bright 1/2 slot per frame, and one bright 1/4 slot per frame.

In the application, when the lamp is not in work, the lamp bead is lighted, which is called as 'normally on'; the lamp bead is extinguished, which is called as "normally dark". After the lamp bead is enabled to work, the working state of the lamp bead is judged to be low ash. When the lamp beads are in a normally-on state, the brightness and the duration are consistent. In the "low gray state," the main manifestation is inconsistent duration. Because the lamp beads are always in a normally bright state, and in a low-gray state, the displayed brightness can be ignored for naked eyes, but the brightness can be clearly monitored by a photosensitive device. In contrast, the refreshing of the positioning coordinates is hidden in the low-gray display, so that the interactive touch of the screen can be realized on the premise of not influencing the display quality. The application provides a method for refreshing the position of a contact by using a low-ash refreshing segment of a lamp bead.

In some examples, the refresh policy in the present application may include a driving instruction output by the interactive system, where the driving instruction is used to indicate that the currently displayed content of the touch object includes a bead position (when the touch object displays the content, the bead position is doped, that is, an order of time slots of low-gray refresh of the touch object in a display frame of the whole frame is used to express corresponding bead position information). In one of the embodiments, the position of the lamp bead may include the accurate position of the lamp bead, that is, the application is applied to the case where the display content includes the accurate position of the lamp bead.

In one embodiment, the refresh policy further includes a current display area identified based on previous display content; the last display content comprises the rough position of the lamp bead. Specifically, in a scene that the rough positions and the precise positions of the lamp beads are refreshed (positioned and graded) after being graded and ordered, the display sequence of the rough positions of the lamp beads is prior to that of the precise positions of the lamp beads; after the rough position of the lamp bead is preferentially displayed, the touch object can gradually reduce the display area and gradually refresh the accurate position of the lamp bead where the current contact of the touch pen is located. In some examples, the precise location of the lamp bead may be a lamp bead coordinate, and the rough location of the lamp bead may include a module number to which the lamp bead belongs and/or a display area number to which the module belongs.

In one embodiment, the lamp bead data is a lamp bead operating state in each time slot in a frame, and the low-gray data is data in which the lamp bead operating state is low-gray. In some embodiments, the lamp bead working state may further include normally bright and normally dark. In other embodiments, the number of the low gray data may be 2, which are the first low gray data and the second low gray data, respectively.

Specifically, different touch objects (e.g., display screens) have different gray scales, and are divided according to weights, which may be 8 bits, 12 bits, 16 bits, and the like; even if the refresh accuracy of the signal is enabled, the higher the number of bits, the higher the enabled refresh accuracy, and further more accurate display effect can be controlled. When the three weights refresh the same gray scale, the main difference is in precision, and the high order is the same.

If the highest bit 1 represents "normally on" for refreshing 32 slots, the next highest bit 1 represents "normally on" for refreshing 16 slots, and so on, starting from the 6 th bit, the following 1 represents the result of the operation of different enable signals. Wherein 8 bits correspond to 2 enable signals, 12 bits represent 6 enable signals, and 16 bits represent 10 enable signals. The foregoing exemplary 65 refreshes are the result of the gray scale control driving under 8-bit weight, and the corresponding last two refreshes are 2 different enable signals. In this regard, the present application proposes that the difference of the last 2 gray signals can be applied to achieve data storage.

Further, the weight may be a specific driving command according to which the lamp bead refreshes a gray level, and each bit on the driving command corresponds to the PWM output. The gray scale expression of the lamp bead in one frame time is the sum of the brightness expressed in the 65 time slots, and the insertion of the enable signal is equivalent to the fact that a highlight label is marked in the 65 time slots. The two enable signals are 1/2 enable and 1/4 enable, so that the lamp bead is distinguished from normal lighting.

In one frame, the possible operation states of the lamp bead include "normally bright", "normally dark", "1/2 low-gray enable" and "1/4 low-gray enable", wherein two kinds of low-gray occupy a time slot respectively, and the remaining time slot is occupied by "normally bright" and "normally dark" (the two kinds of low-gray data can correspond to the first low-gray data and the second low-gray data respectively). When the display content is refreshed, the lamp beads can break up the time slots corresponding to the states, and the time slots are mutually alternated, the normal brightness and the normal darkness are alternated, and the low ash is randomly doped in the time slots, so that the effect of uniform display is achieved.

The lamp beads are in a time segment of a frame, and the refreshing pattern can be as shown in fig. 3. The lamp beads can refresh two working grays within one frame time, and other time can be switched between a normally on state and a normally off state; the wrong order in this application can indicate the refresh order of the grey scale that enables work, corresponds with the accurate coordinate of lamp pearl.

And 204, analyzing the touch position information to obtain a refreshing sequence of the low-gray data in the lamp bead data, and determining the current touch point position of the touch pen based on the refreshing sequence.

Specifically, the current touch point position of the touch pen can be determined based on the refreshing sequence of the low-gray data in the lamp bead data. For example, each refresh sequence corresponds to a respective contact location; in another example, the refresh sequences are compared to corresponding criteria, and the location of each refresh sequence is identified based on the differences compared.

In one embodiment, the step of analyzing the touch position information to obtain a refresh order of the low-gray data in the lamp bead data, and determining the current touch point position of the stylus based on the refresh order may include:

Specifically, the working states of the lamp beads can comprise normal brightness, normal darkness and low ash; the application provides that binary rules are adopted to sequentially analyze the numerical values corresponding to the working states of the lamp beads on each time slot in one frame, for example, when the working states of the lamp beads are detected and judged to be ' normally dark ', 00 ' is output; when the working state of the lamp bead is detected and judged to be 'normally on', outputting '11'; when the detection result shows that the working state of the lamp bead is '1/2 low-ash', outputting '10'; when the detection judges that the working state of the lamp bead is '1/4 low-ash', outputting '01'; furthermore, after the lamp bead refreshes the frame, a 128-bit binary number (i.e. a refreshing sequence) can be obtained.

Of the binary numbers, "10" and "01" respectively occupy only one bit class, and "00" and "11" respectively occupy 63 classes. Therefore, the scheme of staggered refreshing and gray level hiding is provided, the refreshing sequence of the four states of the lamp bead under the gray level of 256 levels can be defined, for example, the lamp bead is defined to be in the states of normally on and normally off preferentially, and finally, the two needed gray levels are refreshed one by one. The method and the device combine the refreshing sequence with the accurate coordinates of the lamp beads, and determine the accurate coordinates of the lamp beads by changing the refreshing sequence of the lamp beads. Taking "1/2 low gray" and "1/4 low gray" as examples, the present application, by way of permutation and combination, can have n different results with these two different low gray during the frame time. Corresponding to an exact coordinate, the corresponding 'low-gray' refreshing sequence can be sorted according to the position of the lamp bead, and then the accurate position of the current touch point of the touch pen is determined.

It should be noted that when the lamp bead refreshes a frame of picture, for the sampling stylus, the sampling frequency can be consistent with the screen; meanwhile, at least one timestamp for recording the on-off time length can be arranged on the photosensitive sensor of the touch pen to judge whether the whole segment is fully illuminated on the one-time refreshing segment or not, so that the normal illumination, 1/2 low-ash and 1/4 low-ash are distinguished.

In the screen refreshing and positioning method, refreshing of the positioning position is hidden in low-gray display, and then position refreshing is carried out by utilizing a low-gray refreshing segment of a lamp bead, wherein the sequence of the low-gray refreshing time slot of the touch object in the whole frame of display picture is used for expressing a corresponding position information. According to the method and the device, the low-delay interactive touch of the screen can be realized on the premise of not influencing the display quality.

In one embodiment, as shown in fig. 4, a screen refresh positioning method is provided, which is exemplified by the application of the method to the interactive system or the stylus in fig. 1, and includes the following steps:

step 402, touch position information is acquired.

And step 404, analyzing the touch position information to obtain a refreshing sequence of the low-ash data in the lamp bead data, comparing the calibration sequence with the refreshing sequence, and determining the obtained accurate position of the lamp bead as the current touch position according to the comparison result.

Specifically, on the basis of the foregoing steps 202 to 204, in order to calibrate the correspondence and difference between the refresh sequence and the contact position, the precise position of the lamp bead is determined by a standard refresh sequence (i.e., calibration sequence). It should be noted that, in the present application, specific implementation manners related to analyzing the touch position information to obtain the refresh order of the low-gray data in the bead data in steps 402 and 404 may refer to the related descriptions of steps 202 to 204 in the foregoing, and details are not described here.

The step of obtaining the accurate position of the lamp bead corresponding to the refreshing sequence in the application can include: and comparing the calibration sequence with the refreshing sequence, and obtaining the accurate position of the lamp bead according to the comparison result. In one embodiment, the normal light and the normal dark in the calibration order are refreshed alternately, and the normal light and the normal dark are in the order of the normal light and the normal dark prior to the low gray.

Specifically, for example, a lamp bead with coordinates (1, 1) is included in the module, and the driving command can instruct the touch object to display the content in a low-gray refresh sequence corresponding to the lamp bead (that is, the refresh sequence is defined in advance to correspond to the coordinates of the lamp bead).

Where the standard refresh sequence (i.e., the calibration sequence) may first be an on-off alternate refresh, for example, a total of 63 alternate "11", "00" outputs on the stylus followed by "10", "01" outputs. And then can compare the calibration order with the order of refreshing to the difference that compares is as the basis of distinguishing the accurate position of lamp pearl. For example, taking the calibration order for the corresponding origin coordinates (0, 0) as an example, the refreshing of the coordinates (1, 1) may be performed randomly according to a predetermined refreshing order, so that both the screen and the stylus are acquired, and further, when the refreshing order is performed, the coordinates (1, 1) are represented. For another example, a total of 63 alternate "11" and "00" are output on the stylus, then the grayish refresh sequence is reversed, first "01" is output, then "10" is output, and a refresh sequence completely different from the previous calibration sequence is obtained, and the output binary numbers are also completely different. When the screen detects this refresh order, the current lamp bead coordinates may be determined to be (1, 1).

In one embodiment, the precise location of the lamp bead may include the coordinates of the lamp bead; the calibration order may be used to correspond to the origin coordinates; the number of the low gray data is 2, which are the first low gray data and the second low gray data, respectively;

comparing the calibration sequence with the refreshing sequence, and obtaining the accurate position of the lamp bead according to the comparison result, which may include:

Specifically, for example, the module includes a lamp bead with coordinates (1, 1), the calibration order may correspond to the coordinates (0, 0), that is, when the stylus pen is detected to output the binary numbers (i.e., the calibration order is the same as the refresh order), the lamp bead is determined to be the coordinates (0, 0).

Further, if the calibration order is different from the refresh order, it is required to detect a first low-gray data (e.g., 1/2 low gray) at a first position in the refresh order and a second low-gray data (e.g., 1/4 low gray) at a second position in the refresh order; and acquiring a first offset of the first position relative to the position of the first low-ash data in the calibration sequence and a second offset of the second position relative to the position of the second low-ash data in the calibration sequence, and acquiring an X-axis coordinate value of the lamp bead coordinate according to the first offset and an Y-axis coordinate value of the lamp bead coordinate according to the second offset. Specifically, as shown in fig. 5, the coordinates of the lamp bead may be determined by determining the relationship between the coordinates of the lamp bead and the coordinates of the origin (0, 0). For example, coordinate (1, 1) is increased by one unit in the X-axis and one unit in the Y-axis compared to the origin coordinate; "1/2 Low Grey" may be associated with the X-axis, and "1/4 Low Grey" may be associated with the Y-axis, with the refresh order of the two grays being related to the offset of the two coordinates.

In one embodiment, the precise location of the lamp bead may include the coordinates of the lamp bead; the calibration sequence corresponds to the gray level of the lamp beads in one frame, and the gray level of the lamp beads is determined according to the driving instruction;

Specifically, when the lamp beads refresh each level of gray scale, the lamp beads may correspond to a standard refresh order (i.e., a calibration order), and then the stylus may obtain the corresponding refresh order by looking up a table, so as to solve a difference (e.g., a deviation) between the current lamp bead refresh order and the refresh order (i.e., the calibration order) under the current gray scale standard. In some examples, each distinction corresponds to an exact coordinate.

In the above, the refreshing of the positioning position is hidden in the low-gray display, and then the low-gray refreshing segment of the lamp bead is used for position refreshing, wherein the sequence of the time slot of the low-gray refreshing of the touch object in the whole frame of the display picture is used for expressing a corresponding position information, and the specific position coordinate can be obtained by comparing the difference between the sequence and the calibration sequence. According to the method and the device, the low-delay interactive touch of the screen can be realized on the premise of not influencing the display quality.

It should be understood that although the steps in the flowcharts of fig. 2 and 4 are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2 and 4 may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least some of the sub-steps or stages of other steps.

In one embodiment, as shown in fig. 6, there is provided a screen refresh positioning device, including:

an information obtaining module 610, configured to obtain touch position information; the touch position information is acquired by the touch pen through lamp bead data displayed by the touch object based on the refreshing strategy; the refreshing strategy comprises a driving instruction for indicating that the current display content of the touch object comprises the position of the lamp bead; the lamp bead data comprises low-ash data used for expressing the position of the lamp bead;

and the analysis positioning module 620 is configured to analyze the touch position information to obtain a refresh order of the low-gray data in the lamp bead data, and determine a current touch point position of the stylus based on the refresh order.

the analyzing and positioning module 620 is configured to sequentially analyze values corresponding to the operating states of the lamp beads on each time slot in one frame by using a binary rule, and determine the arrangement of the values as a refresh order; and obtaining the accurate positions of the lamp beads corresponding to the refreshing sequence, and taking the accurate positions of the lamp beads as the current contact positions.

In one embodiment, the parsing and positioning module 620 is further configured to compare the calibration order with the refresh order, and obtain the accurate position of the lamp bead according to the comparison result.

the analysis positioning module 620 is further configured to determine the coordinates of the lamp beads as original coordinates if the comparison result is that the calibration order is the same as the refresh order; if the comparison result is that the calibration order is different from the refreshing order, respectively detecting a first position of the first low-gray data in the refreshing order and a second position of the second low-gray data in the refreshing order; and acquiring a first offset of the first position relative to the position of the first low-ash data in the calibration sequence and a second offset of the second position relative to the position of the second low-ash data in the calibration sequence, and acquiring an X-axis coordinate value of the lamp bead coordinate according to the first offset and an Y-axis coordinate value of the lamp bead coordinate according to the second offset.

the parsing and positioning module 620 is further configured to, if the comparison result is that the calibration order is different from the refresh order, obtain a deviation between the calibration order and the refresh order, and determine the coordinates of the lamp bead according to the deviation.

For the specific definition of the screen refresh positioning device, reference may be made to the above definition of the screen refresh positioning method, which is not described herein again. The modules in the screen refresh positioning device can be wholly or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.

In one embodiment, there is provided a display device including a display screen and a driving apparatus;

the display screen is used as a touch object of the touch pen; the driving device is used for executing the steps of the screen refreshing and positioning method.

In one embodiment, the display screen may be an LED display screen.

Specifically, the touch pen can interact with the display screen through the driving device in the application, so that low-delay screen refreshing positioning without influencing the display effect is achieved. And the driving device may be separately provided from the display screen or integrated into the display apparatus. In addition, the touch pen may also be used to perform the steps of the screen refresh positioning method.

In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, which when executed by a processor implements the steps in the screen refresh positioning method described above. It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.

In the description herein, references to the description of "some embodiments," "other embodiments," "desired embodiments," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, a schematic description of the above terminology may not necessarily refer to the same embodiment or example.

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A screen refresh positioning method is characterized by comprising the following steps:

acquiring touch position information; the touch position information is acquired by the touch pen through lamp bead data displayed by the touch object based on the refreshing strategy; the refreshing strategy comprises a driving instruction for indicating that the current display content of the touch object comprises a lamp bead position; the lamp bead data comprises low-gray data used for expressing the position of the lamp bead;

2. The screen refresh positioning method of claim 1, wherein the lamp bead position comprises a lamp bead precise position; the lamp bead data is the lamp bead working state on each time slot in one frame; the low-ash data is data that the working state of the lamp bead is low ash;

the step of analyzing the touch position information to obtain a refreshing sequence of the low-gray data in the lamp bead data, and determining the current touch point position of the touch pen based on the refreshing sequence comprises the following steps:

analyzing numerical values corresponding to the working states of the lamp beads on the time slots in the frame in sequence by adopting a binary rule, and determining the arrangement of the numerical values as the refreshing sequence;

3. The screen refreshing positioning method according to claim 2, wherein the step of obtaining the accurate positions of the lamp beads corresponding to the refreshing sequence comprises:

4. The screen refreshing positioning method according to claim 3, wherein the lamp bead working states further include normal light and normal dark; the normal light and the normal dark in the calibration sequence are refreshed alternately, and the normal light and the normal dark are in the sequence before the low gray.

5. The screen refreshing positioning method according to claim 3 or 4, wherein the accurate position of the lamp bead comprises coordinates of the lamp bead; the calibration sequence is used for corresponding to the origin coordinates; the number of the low gray data is 2, and the low gray data is respectively a first low gray data and a second low gray data;

the step of comparing the calibration sequence with the refreshing sequence and obtaining the accurate position of the lamp bead according to the comparison result comprises the following steps:

if the comparison result is that the calibration sequence is the same as the refreshing sequence, determining the coordinates of the lamp beads as the coordinates of the original point;

if the comparison result is that the calibration order is different from the refresh order, respectively detecting a first position of the first low-gray data in the refresh order and a second position of the second low-gray data in the refresh order; and acquiring a first offset of the first position compared with the position of the first low-ash data in the calibration sequence and a second offset of the second position compared with the position of the second low-ash data in the calibration sequence, and acquiring an X-axis coordinate value of the lamp bead coordinate according to the first offset and an Y-axis coordinate value of the lamp bead coordinate according to the second offset.

6. The screen refreshing positioning method according to claim 3 or 4, wherein the accurate position of the lamp bead comprises coordinates of the lamp bead; the calibration sequence corresponds to the gray level of the lamp beads in one frame, and the gray level of the lamp beads is determined according to the driving instruction;

7. The screen refresh positioning method of claim 1, wherein the refresh policy further comprises a current display area confirmed based on a previous display content; the last display content comprises the rough position of the lamp bead.

8. A screen refresh positioning device, comprising:

the information acquisition module is used for acquiring touch position information; the touch position information is acquired by the touch pen through lamp bead data displayed by the touch object based on the refreshing strategy; the refreshing strategy comprises a driving instruction for indicating that the current display content of the touch object comprises a lamp bead position; the lamp bead data comprises low-gray data used for expressing the position of the lamp bead;

9. A display device, characterized in that the display device comprises a display screen and a driving means;

the display screen is used as a touch object of a touch pen; the drive means is adapted to perform the steps of the method of any one of claims 1 to 7.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.