CN113534977B - Display method and display device capable of identifying external laser - Google Patents
Display method and display device capable of identifying external laser Download PDFInfo
- Publication number
- CN113534977B CN113534977B CN202010291727.5A CN202010291727A CN113534977B CN 113534977 B CN113534977 B CN 113534977B CN 202010291727 A CN202010291727 A CN 202010291727A CN 113534977 B CN113534977 B CN 113534977B
- Authority
- CN
- China
- Prior art keywords
- laser
- signal distribution
- electric signal
- distribution
- light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/13338—Input devices, e.g. touch panels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/037—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor using the raster scan of a cathode-ray tube [CRT] for detecting the position of the member, e.g. light pens cooperating with CRT monitors
Abstract
The invention discloses a display method and a display device capable of identifying external laser, wherein the display method comprises the following steps: receiving laser light and ambient light irradiated onto a display panel, and converting optical signal distribution of the laser light and the ambient light into electrical signal distribution; obtaining the position coordinates of the laser according to the electric signal distribution; converting the position coordinates of the laser into a display command for controlling the display panel; and obtaining pixel matrix information comprising laser positions according to the display command, and displaying the pixel matrix information on a display panel. The display method and the display device can convert the laser distribution irradiated on the display panel into the electric signal distribution, and obtain the position information of the laser according to the electric signal distribution, so that the display state of the pixels at the laser irradiation position is changed, the laser position is easy to identify, and the demonstration effect is improved.
Description
Technical Field
The invention belongs to the technical field of liquid crystal display, and particularly relates to a display method and a display device capable of identifying external laser.
Background
The laser indicator, also called laser pen, is a pen-type emitter which is designed to be portable, easy to hold by hand and processed by a laser module (light emitting diode), and is widely applied to electronic teaching, presentation, report lecture and the like at present.
Conventional laser pens are typically used only on a curtain or wall projected by a projector. Laser pens may also be sometimes required when reporting or teaching with a display screen. When the laser pen is used for projection onto the screen of the display screen, the ambient light can be projected onto the screen, and as most of the light intensity of the laser pen can be absorbed by the polaroid, the reflection and scattering of the surface of the laser redisplay screen can be greatly weakened, and the influence of the ambient light can greatly reduce the influence of the ambient light, so that the laser intensity of the laser pen reflected to the human eyes is weak, and is basically invisible, the human eyes can only see the ambient light, the position of the laser cannot be distinguished, and the demonstration effect is seriously influenced.
Disclosure of Invention
In order to solve the above problems in the prior art, the present invention provides a display method and a display device capable of recognizing external laser light. The technical problems to be solved by the invention are realized by the following technical scheme:
one aspect of the present invention provides a display method capable of recognizing an external laser, including:
s1: receiving laser light and ambient light irradiated onto a display panel, and converting optical signal distribution of the laser light and the ambient light into electrical signal distribution;
s2: obtaining the position coordinates of the laser according to the electric signal distribution;
s3: converting the position coordinates of the laser into a display command for controlling the display panel;
s4: and obtaining pixel matrix information comprising laser positions according to the display command, and displaying the pixel matrix information on a display panel.
In one embodiment of the present invention, the S1 includes:
the method comprises the steps of receiving laser and ambient light irradiated onto a display panel by using a light sensing matrix paved on the display panel, and converting light signal distribution of the laser and the ambient light on the light sensing matrix into electric signal distribution.
In one embodiment of the present invention, the S2 includes:
s21: respectively obtaining electric signal distribution of a subsequent N frames from the current frame on the light sensation matrix, wherein N is more than or equal to 1;
s22: sequentially calculating the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames, judging whether the maximum value in the difference distribution is larger than or equal to a preset threshold, executing step S23 if the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames is larger than or equal to the preset threshold, and executing step S24 if the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames is smaller than the preset threshold;
s23: selecting the size of the laser irradiation area at the position of the maximum value in the difference distribution as the position of the laser;
s24: and filtering medium-low frequency signals lower than a preset frequency in the electric signal distribution of the current frame by using a moving average method to obtain filtered electric signal distribution, and selecting the laser irradiation area size at the position of the maximum value in the filtered electric signal distribution as the laser position.
In one embodiment of the present invention, the S23 specifically includes:
and selecting a region with the laser irradiation area size at the position of the maximum value in the difference distribution by using a Gaussian filter function for frequency enhancement, and taking the region as the position of the laser.
In one embodiment of the present invention, the S3 includes:
s31: transmitting the position coordinate information of the laser to a time sequence controller;
s32: transmitting the position coordinate information to a frame buffer through the timing controller;
s33: and converting the position coordinate information into indication information of a pixel matrix by using the frame buffer, wherein the indication information comprises the color, the brightness and the shape of the pixel matrix.
In one embodiment of the present invention, the S4 includes:
s41: transmitting indication information of the pixel matrix to the time sequence controller;
s42: the timing controller controls voltage outputs of the scan driver and the data driver according to the indication information to display a position of the laser on the display panel.
Another aspect of the present invention provides a display device capable of recognizing external laser light, adapted to perform the display method capable of recognizing external laser light according to any one of the above embodiments, the display device comprising:
the light sensing matrix is paved on the display panel and is used for receiving laser and ambient light irradiated on the display panel and converting light signal distribution of the laser and the ambient light on the light sensing matrix into electric signal distribution;
the light sensing controller is used for obtaining the position coordinates of the laser according to the electric signal distribution;
the time sequence controller is used for converting the position coordinates of the laser into display commands of the display panel;
and a driving unit for obtaining a pixel matrix including position information of the external laser according to the display command, and displaying output on a display panel.
In one embodiment of the present invention, the light sensing controller includes a receiving module, a calculating module, a processing module, and a preset module, wherein,
the receiving module is used for respectively obtaining the electric signal distribution of the following N frames from the current frame on the light sensation matrix, wherein N is more than or equal to 1;
the calculation module is used for sequentially calculating the difference value distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames;
the processing module is used for judging whether the maximum value in the difference distribution is larger than or equal to a preset threshold value, if the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent nth frame is larger than or equal to the preset threshold value, selecting the laser irradiation area size at the position of the maximum value in the difference distribution as the position of the laser, and if the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent nth frame is smaller than the preset threshold value, filtering medium-low frequency signals lower than the preset frequency in the electric signal distribution of the current frame by using a moving average method to obtain filtered electric signal distribution, and then selecting the laser irradiation area size at the position of the maximum value in the filtered electric signal distribution as the position of the laser, wherein N is more than or equal to N is more than or equal to 1;
the preset module is used for presetting and storing the preset threshold value, the preset frequency and the N value.
In one embodiment of the present invention, the timing controller includes a frame buffer for receiving the position coordinate information from the timing controller, converting the position coordinate information into indication information of a pixel matrix, wherein the indication information includes a color, a brightness, and a shape of the pixel matrix.
In one embodiment of the present invention, the driving unit includes a data driver connected to the pixel matrix through a plurality of data lines and a scan driver connected to the pixel matrix through a plurality of scan lines.
Compared with the prior art, the invention has the beneficial effects that:
1. the display method and the display device capable of identifying the external laser can convert the laser distribution irradiated on the display panel into the electric signal distribution, and obtain the position information of the laser according to the electric signal distribution, so that the display state of the pixels at the laser irradiation position is changed, the laser position is easy to identify, and the demonstration effect is improved.
2. The display method and the display device can eliminate the position confirmation error caused by external laser jitter by comparing and processing the electric signal distribution of the current frame with the electric signal distribution of the subsequent N frames, so that the laser positioning result is more accurate.
The present invention will be described in further detail with reference to the accompanying drawings and examples.
Drawings
FIG. 1 is a flowchart of a display method capable of identifying external laser according to an embodiment of the present invention;
FIG. 2 is a flowchart of another method for displaying identifiable external laser according to an embodiment of the present invention;
fig. 3a and 3b schematically show laser and ambient light illumination diagrams of a current frame and a next frame, respectively, on a display panel;
FIG. 4 is a schematic diagram of the electrical signal distribution corresponding to the current frame optical signal shown in FIG. 3 a;
FIG. 5 is a schematic diagram illustrating the distribution of electrical signals corresponding to the next frame of optical signals shown in FIG. 3 b;
FIG. 6 is a simulated schematic diagram of the electrical signal difference distribution of the current frame electrical signal distribution of FIG. 4 and the next frame electrical signal distribution of FIG. 5;
FIG. 7 is a schematic diagram of the electrical signal difference distribution of FIG. 6 after frequency amplification by a Gaussian filter function;
FIG. 8 is another simulated schematic diagram of the electrical signal difference distribution of the current frame electrical signal distribution of FIG. 4 and the next frame electrical signal distribution of FIG. 5;
FIG. 9 is a schematic diagram of the current frame electrical signal distribution of FIG. 4 after moving average filtering;
FIG. 10 is a schematic diagram of the moving average filtered electrical signal distribution of FIG. 9 after frequency amplification by a Gaussian filter function;
FIG. 11 is a schematic diagram of a display device capable of recognizing external laser according to an embodiment of the present invention;
fig. 12 is a schematic structural diagram of another display device capable of recognizing external laser according to an embodiment of the present invention.
Detailed Description
In order to further describe the technical means and effects adopted by the invention to achieve the preset aim, the following describes in detail a display method and a display device capable of identifying external laser according to the invention with reference to the attached drawings and the detailed description.
The foregoing and other features, aspects, and advantages of the present invention will become more apparent from the following detailed description of the preferred embodiments when taken in conjunction with the accompanying drawings. The technical means and effects adopted by the present invention to achieve the intended purpose can be more deeply and specifically understood through the description of the specific embodiments, however, the attached drawings are provided for reference and description only, and are not intended to limit the technical scheme of the present invention.
It should be noted that in this document relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that an article or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in an article or apparatus that comprises the element.
Example 1
Referring to fig. 1, fig. 1 is a flowchart of a display method capable of identifying external lasers according to an embodiment of the invention. The display method comprises the following steps:
s1: receiving laser light and ambient light irradiated onto a display panel, and converting optical signal distribution of the laser light and the ambient light into electrical signal distribution;
in this embodiment, a light sensing matrix laid on a display panel is used to receive laser light and ambient light irradiated onto the display panel, and light signal distribution of the laser light and the ambient light on the light sensing matrix is converted into electric signal distribution. The light sensing matrix is an instrument capable of converting a received light signal into an electrical signal.
In general, a display panel includes a plurality of columns of data lines and a plurality of rows of scan lines, each of which is parallel to the other; the data lines and the scanning lines of a plurality of columns are mutually perpendicular and are crossed to form X rows and Y columns of pixel units which are arranged in a matrix mode, and X and Y are positive integers. The light sensing matrix of the embodiment is arranged above the pixel units of X rows and Y columns arranged in a matrix mode, and completely covers the pixel units of X rows and Y columns.
Specifically, when laser irradiates on the display panel, the light sensing matrix receives signals of the laser pen, and meanwhile, surrounding ambient light inevitably irradiates on the display panel and is received by the light sensing matrix, and the light sensing matrix receives the laser and the ambient light and converts the distribution of the laser and the ambient light on the light sensing matrix into electric signal distribution so as to carry out signal transmission in the form of electric signals.
S2: obtaining the position coordinates of the laser according to the electric signal distribution;
the external laser and the ambient light are converted into electric signal distribution by a light sensing matrix, the electric signal distribution is transmitted to a light sensing controller in the form of an electric signal, the light sensing controller firstly subtracts the electric signal of the current frame from the electric signal of the following nth frame (n is more than or equal to 1) through an algorithm, and if the subtracted signal is more than or equal to a preset threshold value, the laser irradiation area size is selected at the position of the maximum value in the difference signal as the position of the laser; if the light sensing controller subtracts the signals in the electric signals of the current frame and the following nth frame through an algorithm (n is more than or equal to 1), and the subtracted signals are smaller than a preset threshold value, only the low frequency in the electric signal of the current frame is needed to be removed, only the high frequency signal is left, and then the position of the maximum value in the electric signal distribution after filtering is used as the position of the laser.
It should be noted that, the preset threshold in the present embodiment is required to be set, which is related to the gray level value of the pixel unit.
Specifically, the S2 includes:
s21: respectively obtaining electric signal distribution of a subsequent N frames from the current frame on the light sensation matrix, wherein N is more than or equal to 1;
that is, the light sensing controller of the present embodiment sequentially acquires the electrical signal distribution of the subsequent N frames from the current frame electrical signal distribution from the light sensing matrix.
S22: sequentially calculating the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames, judging whether the maximum value in the difference distribution is larger than or equal to a preset threshold, executing step S23 if the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames is larger than or equal to the preset threshold, and executing step S24 if the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames is smaller than the preset threshold;
as described above, the preset threshold is required to be set, which is related to the gray-scale value of the pixel unit. In this embodiment, the preset threshold may be 0. If the difference between the electric signal distribution of the current frame and the electric signal distribution of the following (N is more than or equal to N is more than or equal to 1) frame is 0, the electric signal distribution of the two frames of data is identical.
S23: selecting the size of the laser irradiation area at the position of the maximum value in the difference distribution as the position of the laser;
specifically, if the maximum value in the difference value distribution of the electric signal distribution of the current frame and the electric signal distribution of the following (N is greater than or equal to 1) frame is greater than or equal to a preset threshold value, the brightness of the laser is generally higher compared with that of the ambient light, so that the position of the maximum value in the difference value distribution can be considered as the position of the laser. Further, since the laser beam irradiated on the display panel has a certain diameter, a region of the laser irradiation area size is selected here with the maximum value in the difference distribution as the center as the position and size of the laser.
Preferably, in order to better obtain the position information of the laser, when the maximum value in the difference distribution is obtained, a gaussian filter function is used to select a region with the size of the laser irradiation area at the position of the maximum value in the difference distribution for frequency enhancement, and the region is used as the position of the laser. By performing frequency enhancement, the frequency signal here can be amplified to be distinguished from the surrounding signal, thereby more accurately obtaining the position of the laser light.
S24: and filtering medium-low frequency signals lower than a preset frequency in the electric signal distribution of the current frame by using a moving average method to obtain filtered electric signal distribution, and selecting the laser irradiation area size at the position of the maximum value in the filtered electric signal distribution as the laser position.
Further, if the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames are smaller than the preset threshold, it is indicated that the laser position cannot be confirmed by subtracting the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames, at this time, the middle-low frequency signal lower than the preset frequency in the electric signal distribution of the current frame is filtered by using a moving average method, the filtered electric signal distribution is obtained, and then the laser irradiation area size at the position of the maximum value in the filtered electric signal distribution is selected as the laser position. Similarly, in order to better obtain the position information of the laser, when the filtered electric signal distribution is obtained, a Gaussian filter function is utilized to select a region with the size of the laser irradiation area from the filtered electric signal distribution for frequency enhancement, and the region is used as the position of the laser. By performing frequency enhancement, the frequency signal here can be amplified to be distinguished from the surrounding signal, thereby more accurately obtaining the position of the laser light.
Specifically, if the maximum value of the difference value distribution between the electric signal distribution of the current frame and the electric signal distribution of the following nth (n≡n≡1) frame is smaller than a preset threshold value (for example, the maximum value of the difference value is equal to 0), it is indicated that the electric signal distribution of the two frames of data is identical. At this time, the middle-low frequency signal lower than the preset frequency in the electric signal distribution of the current frame is filtered by using a moving average method, and the filtered electric signal distribution is obtained. It should be noted that, the moving average method is to average the frequencies of different wavebands with a smaller matrix, gradually average the frequencies to a relatively close waveband, and finally only the frequency of the laser is the highest, and then enhance the frequency of the laser pen by a filtering function to obtain the coordinate of the highest value.
Since the laser may have jitter in irradiation and the electrical signal may have signal delay in receiving and transmitting processes, the display method of the embodiment can eliminate the position confirmation error caused by external laser jitter by comparing and processing the electrical signal distribution of the current frame with the electrical signal distribution of the subsequent N frames, so that the laser positioning result is more accurate.
S3: converting the position coordinates of the laser into a display command for controlling the display panel;
specifically, transmitting the position coordinate information of the laser to a timing controller; transmitting the position coordinate information to a frame buffer through the timing controller; the position coordinate information is converted into indication information of a pixel matrix by using a frame buffer, wherein the indication information comprises the color, the brightness and the shape of the pixel matrix.
In this embodiment, the light-sensing controller transmits the obtained positional coordinate information of the laser light to the timing controller, which modifies the positional coordinate information into specific color, brightness, shape, and other indication information in a Frame buffer (Frame buffer).
S4: and obtaining pixel matrix information comprising laser positions according to the display command, and displaying the pixel matrix information on a display panel.
Specifically, transmitting indication information of the pixel matrix to the timing controller; the timing controller controls voltage outputs of the scan driver and the data driver according to the indication information to display a position of the laser on the display panel.
Illustratively, the timing controller may control the voltage outputs of the scan driver and the data driver according to the indication information to adjust the pixel gray level or color of the sub-pixels of the laser irradiation area. Illustratively, the gray scale of the sub-pixels of the laser irradiation area and the adjacent sub-pixels or pixels in the small area are increased to increase the display brightness of the area to form a contrast, for example, the sub-pixels of the laser irradiation area and the adjacent sub-pixels thereof are displayed with 255 gray scales, that is, a white point appears here, so that the difference from other areas is displayed in brightness, so that the human eye can more easily find the laser irradiation position. Alternatively, the laser irradiation area sub-pixels and their neighboring sub-pixels may be displayed in red, green, or other colors, so that the human eye can more easily find the irradiation position.
The display method of the embodiment can convert the laser distribution irradiated on the display panel into the electric signal distribution, and obtain the position information of the laser according to the electric signal distribution, so that the display state of the pixels at the laser irradiation position is changed, the laser position is easy to identify, and the demonstration effect is improved. In addition, the display method of the embodiment can eliminate the position confirmation error caused by external laser jitter by comparing and processing the electric signal distribution of the current frame with the electric signal distribution of the subsequent N frames, so that the laser positioning result is more accurate.
Example two
On the basis of the above embodiments, the present embodiment provides another display method capable of identifying external lasers. Referring to fig. 2, 3a and 3b, fig. 2 is a flowchart of another display method capable of identifying external lasers according to an embodiment of the present invention, and fig. 3a and 3b schematically show laser and ambient light irradiation diagrams of a current frame and a next frame on a display panel, respectively. In this embodiment, the display method according to the embodiment of the present invention is illustrated by using the illumination conditions of the display panel shown in fig. 3a and 3b, where the illumination positions of the laser pen and the ambient light on the display panel are respectively marked by arrows.
Specifically, the display method of the present embodiment includes:
step 1: receiving the laser externally irradiated to the display panel and the light of the ambient light by utilizing the light sensing matrix, and converting the laser and the light into electric signal distribution;
referring to fig. 4 and fig. 5, fig. 4 is a schematic diagram illustrating a simulation of an electrical signal distribution corresponding to the current frame optical signal shown in fig. 3 a; fig. 5 is a schematic diagram of the simulation of the distribution of the electrical signal corresponding to the optical signal of the next frame shown in fig. 3b, wherein the ordinate can reflect the frequency size distribution in the electrical signal of the current frame, that is, the brightness distribution of the optical signal, such as the laser and ambient light distribution shown by the arrow in the figure.
Step 2: the light sensation controller receives the electric signal distribution of the light sensation matrix;
step 3: subtracting the current frame of electric signal from the next frame of electric signal, judging whether the difference distribution is larger than or equal to a preset threshold value, if so, selecting the laser irradiation area size at the position of the maximum value in the difference distribution for frequency segment reinforcement, and taking the position as the position of the laser; if not, filtering medium-low frequency signals lower than the preset frequency in the electric signal distribution of the current frame by using a moving average method to obtain filtered electric signal distribution, selecting the size of a laser irradiation area at the position of the maximum value in the filtered electric signal distribution for frequency segment reinforcement, and taking the position as the position of the laser;
in this embodiment, the electrical signal of the current frame is selected and compared with the electrical signal of the next frame, and the laser position is obtained according to the comparison result, so that the position confirmation error caused by the shake of the external laser can be eliminated, and the laser positioning result is more accurate.
Referring to fig. 6 and 7, fig. 6 is a schematic diagram illustrating a simulation of the electrical signal difference distribution between the current frame electrical signal distribution of fig. 4 and the next frame electrical signal distribution of fig. 5; fig. 7 is a schematic diagram of the electric signal difference distribution of fig. 6 after frequency amplification by a gaussian filter function. As shown in fig. 6, if the difference between the current frame electrical signal and the next frame electrical signal is equal to or greater than a preset threshold, the positions of the current frame laser and the next frame laser are respectively displayed, because the user may shake when using the laser pen to irradiate, so that the laser positions of the current frame and the next frame do not completely coincide, and thus the current frame and the next frame cannot be completely neutralized during the subtraction process, and the ambient light does not generally have shake as a problem, and cancel each other during the subtraction process, thereby displaying the positions of the lasers. Next, referring to fig. 7, the present embodiment performs frequency enhancement on the difference signal distribution shown in fig. 6 through a gaussian filter function, that is, further enhances the frequency signal of the laser, so as to distinguish and identify the position of the laser more easily.
Next, referring to fig. 8 to 10, fig. 8 is another simulation diagram of the electrical signal difference distribution between the current frame electrical signal distribution of fig. 4 and the next frame electrical signal distribution of fig. 5; FIG. 9 is a schematic diagram of the current frame electrical signal distribution of FIG. 4 after moving average filtering; fig. 10 is a schematic diagram of the moving average filtered electric signal distribution of fig. 9 after frequency amplification by a gaussian filter function. As shown in fig. 8, the difference between the current frame electrical signal and the next frame electrical signal is smaller than the preset threshold, that is, the laser signals of the two frames are almost completely cancelled, and the laser position cannot be distinguished from the difference distribution diagram. At this time, the electric signal distribution of the current frame is re-acquired, as shown in fig. 4, the middle-low frequency signal lower than the preset frequency in the electric signal distribution of the current frame is filtered by using a moving average method, the filtered electric signal distribution is obtained, as shown in fig. 9, the size of the laser irradiation area is selected at the position of the maximum value in the filtered electric signal distribution for frequency segment reinforcement, and the position is used as the position of the laser, as shown in fig. 10.
Step 4: transmitting the position coordinate information of the laser to a time sequence controller;
step 5: the time schedule controller modifies the position coordinate information into indication information of special color, brightness, shape and the like in a Frame buffer (Frame buffer);
step 6: the timing controller may control voltage outputs of the scan driver and the data driver according to the indication information to adjust pixel gray scales of sub-pixels of the laser irradiation area.
The display method of the embodiment can eliminate the position confirmation error caused by external laser jitter by comparing and processing the electric signal distribution of the current frame with the electric signal distribution of the next frame, so that the laser positioning result is more accurate.
Example III
On the basis of the above embodiments, the present embodiment provides a display device capable of identifying external lasers, which is suitable for executing the display method capable of identifying external lasers described in the first embodiment and the second embodiment. Referring to fig. 11, fig. 11 is a schematic structural diagram of a display device capable of recognizing external laser according to an embodiment of the invention. The display device of the present embodiment includes a light-sensing matrix 10, a light-sensing controller 20, a timing controller 30, and a driving unit 40 electrically connected in this order. The light sensing matrix 10 is laid on the display panel, and is used for receiving the laser and the ambient light irradiated on the display panel and converting the light signal distribution of the laser and the ambient light on the light sensing matrix 10 into electric signal distribution; a light-sensing controller 20 for obtaining the position coordinates of the laser light according to the electric signal distribution; a timing controller 30 for converting the position coordinates of the laser light into a display command of the display panel; a driving unit 40 for obtaining a pixel matrix including position information of external laser light according to a display command and displaying an output on a display panel.
Further, referring to fig. 12, fig. 12 is a schematic structural diagram of another display device capable of recognizing external laser according to an embodiment of the invention. The light sensation controller 20 of the embodiment comprises a receiving module 201, a calculating module 202, a processing module 203 and a preset module 204, wherein the receiving module 201 is used for respectively obtaining electric signal distribution of a subsequent N frames from a current frame on the light sensation matrix 10, and N is more than or equal to 1; the calculation module 201 is configured to sequentially calculate a difference distribution between an electrical signal distribution of a current frame and an electrical signal distribution of a subsequent N frames; the processing module 203 is configured to determine whether a maximum value in the difference distribution is greater than or equal to a preset threshold, if the difference distribution of the electrical signal distribution of the current frame and the electrical signal distribution of the subsequent N (N is greater than or equal to the preset threshold, select the laser irradiation area size at the position where the maximum value in the difference distribution is located as the position of the laser, and if the difference distribution of the electrical signal distribution of the current frame and the electrical signal distribution of the subsequent N is less than the preset threshold, filter the middle-low frequency signal of the electrical signal distribution of the current frame and lower than the preset frequency by using a moving average method to obtain a filtered electrical signal distribution, and then select the laser irradiation area size at the position where the maximum value in the filtered electrical signal distribution is located as the position of the laser; the preset module 204 is configured to preset and store a preset threshold value, a preset frequency, and an N value.
Further, the timing controller 30 includes a frame buffer 301, and the frame buffer 301 is configured to receive the position coordinate information from the timing controller 30, and convert the position coordinate information into indication information of the pixel matrix, where the indication information includes color, brightness, and shape of the pixel matrix.
Further, the driving unit 40 includes a data driver 401 and a scan driver 402, wherein the data driver 401 is connected to the pixel matrix through a plurality of data lines, and the scan driver 402 is connected to the pixel matrix through a plurality of scan lines.
Specifically, in a specific operation process, the light sensing matrix 10 receives laser light and ambient light externally irradiated onto the display panel, and converts the laser light and the ambient light into electrical signal distribution; the light sensing controller 20 receives the electric signal distribution of the light sensing matrix 10, obtains the position coordinates of the laser according to the electric signal distribution and transmits the position coordinates to the time sequence controller 30, and then the time sequence controller 30 calculates and modifies the indication information into the indication information of special color, brightness, shape and the like in the frame buffer 301, and the indication information is transmitted back to the time sequence controller 30; subsequently, the timing controller 30 may control the voltage outputs of the scan driver 402 and the data driver 401 according to the instruction information to adjust the pixel gray level of the sub-pixel of the laser irradiation area. For example, the gray scale of the sub-pixel of the laser irradiation area and the adjacent sub-pixel or the pixels in the small area are increased to increase the display brightness of the area to form a bright-dark contrast, for example, the sub-pixel of the designated area and the adjacent sub-pixel thereof can be displayed with 255 gray scales, that is, a white point appears here, so that the difference from other areas is displayed in brightness, so that the human eye can easily find the laser irradiation position. Alternatively, the detection region sub-pixels and their neighboring sub-pixels may be displayed in red, green, or other colors, so that the human eye can more easily find the irradiation position.
The display device of the embodiment can convert the laser distribution irradiated on the display panel into the electric signal distribution, and obtain the position information of the laser according to the electric signal distribution, so that the display state of the pixels at the laser irradiation position is changed, the laser position is easy to identify, and the demonstration effect is improved.
The foregoing is a further detailed description of the invention in connection with the preferred embodiments, and it is not intended that the invention be limited to the specific embodiments described. It will be apparent to those skilled in the art that several simple deductions or substitutions may be made without departing from the spirit of the invention, and these should be considered to be within the scope of the invention.
Claims (8)
1. A display method capable of recognizing external laser light, comprising:
s1: receiving laser light and ambient light irradiated onto a display panel by using a light sensing matrix laid on the display panel, and converting light signal distribution of the laser light and the ambient light into electric signal distribution, wherein the light sensing matrix is arranged above X rows and Y columns of pixel units arranged in a matrix manner and completely covers the X rows and Y columns of pixel units;
s2: obtaining the position coordinates of the laser according to the electric signal distribution;
s3: converting the position coordinates of the laser into a display command for controlling the display panel;
s4: obtaining pixel matrix information including laser positions according to the display command, and displaying the pixel matrix information on a display panel,
wherein, the S2 includes:
s21: respectively obtaining electric signal distribution of a subsequent N frames from the current frame on the light sensation matrix, wherein N is more than or equal to 1;
s22: sequentially calculating the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames, judging whether the maximum value in the difference distribution is larger than or equal to a preset threshold, executing step S23 if the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames is larger than or equal to the preset threshold, and executing step S24 if the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames is smaller than the preset threshold;
s23: selecting the size of the laser irradiation area at the position of the maximum value in the difference distribution as the position of the laser;
s24: filtering medium-low frequency signals lower than a preset frequency in the electric signal distribution of the current frame by using a moving average method to obtain filtered electric signal distribution, and selecting the laser irradiation area size at the position of the maximum value in the filtered electric signal distribution as the laser position;
further, the step S23 specifically includes:
and selecting a region with the laser irradiation area size at the position of the maximum value in the difference distribution by using a Gaussian filter function for frequency enhancement, and taking the region as the position of the laser.
2. The display method of identifiable external laser light according to claim 1, wherein S1 comprises:
the method comprises the steps of receiving laser and ambient light irradiated onto a display panel by using a light sensing matrix paved on the display panel, and converting light signal distribution of the laser and the ambient light on the light sensing matrix into electric signal distribution.
3. The method for displaying identifiable external laser light according to claim 1, wherein S3 comprises:
s31: transmitting the position coordinate information of the laser to a time sequence controller;
s32: transmitting the position coordinate information to a frame buffer through the timing controller;
s33: and converting the position coordinate information into indication information of a pixel matrix by using the frame buffer, wherein the indication information comprises the color, the brightness and the shape of the pixel matrix.
4. A method of displaying an identifiable external laser according to claim 3, wherein S4 comprises:
s41: transmitting indication information of the pixel matrix to the time sequence controller;
s42: the timing controller controls voltage outputs of the scan driver and the data driver according to the indication information to display a position of the laser on the display panel.
5. A display device capable of recognizing external lasers, characterized by being adapted to perform the display method capable of recognizing external lasers according to any one of claims 1 to 4, the display device comprising:
a light sensing matrix (10) laid on the display panel for receiving laser light and ambient light irradiated onto the display panel and converting light signal distribution of the laser light and the ambient light on the light sensing matrix (10) into electric signal distribution;
a light-sensitive controller (20) for obtaining the position coordinates of the laser according to the electric signal distribution;
a timing controller (30) for converting the position coordinates of the laser light into a display command of a display panel;
and a driving unit (40) for obtaining a pixel matrix including position information of the external laser light according to the display command, and displaying an output on a display panel.
6. The display device capable of recognizing external laser light according to claim 5, the light sensing controller (20) comprises a receiving module (201), a calculating module (202), a processing module (203) and a preset module (204), wherein,
the receiving module (201) is used for respectively obtaining electric signal distribution of a subsequent N frames from a current frame on the light sensing matrix (10), wherein N is more than or equal to 1;
the calculation module (202) is used for sequentially calculating the difference distribution of the electric signal distribution of the current frame and the electric signal distribution of the subsequent N frames;
the processing module (203) is configured to determine whether a maximum value in the difference distribution is greater than or equal to a preset threshold, if the difference distribution of the electrical signal distribution of the current frame and the electrical signal distribution of the subsequent nth frame is greater than or equal to the preset threshold, select a laser irradiation area size at a position where the maximum value is located in the difference distribution as the position of the laser, and if the difference distribution of the electrical signal distribution of the current frame and the electrical signal distribution of the subsequent nth frame is less than the preset threshold, filter medium-low frequency signals of the electrical signal distribution of the current frame and lower than a preset frequency by using a moving average method to obtain filtered electrical signal distribution, and then select the laser irradiation area size at the position where the maximum value is located in the filtered electrical signal distribution as the position of the laser, where N is greater than or equal to 1;
the preset module (204) is configured to preset and store the preset threshold, the preset frequency and the N value.
7. The display device of claim 6, wherein the timing controller (30) comprises a frame buffer (301), the frame buffer (301) being configured to receive the position coordinate information from the timing controller (30) and to convert the position coordinate information into indication information of a pixel matrix, wherein the indication information comprises a color, a brightness, and a shape of the pixel matrix.
8. The display device that can recognize external laser light according to claim 7, wherein the driving unit (40) includes a data driver (401) and a scan driver (402), wherein the data driver (401) is connected to a pixel matrix through a plurality of data lines, and the scan driver (402) is connected to the pixel matrix through a plurality of scan lines.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010291727.5A CN113534977B (en) | 2020-04-14 | 2020-04-14 | Display method and display device capable of identifying external laser |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010291727.5A CN113534977B (en) | 2020-04-14 | 2020-04-14 | Display method and display device capable of identifying external laser |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113534977A CN113534977A (en) | 2021-10-22 |
| CN113534977B true CN113534977B (en) | 2023-09-19 |
Family
ID=78120030
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010291727.5A Active CN113534977B (en) | 2020-04-14 | 2020-04-14 | Display method and display device capable of identifying external laser |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113534977B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5214413A (en) * | 1987-06-23 | 1993-05-25 | Nissan Motor Company, Limited | Head-up display apparatus for vehicular display |
| KR100844776B1 (en) * | 2007-02-23 | 2008-07-07 | 삼성에스디아이 주식회사 | Organic light emitting display device and dirving method thereof |
| CN102646392A (en) * | 2011-02-21 | 2012-08-22 | 联咏科技股份有限公司 | Bi-stable display control method, time sequence controller and bi-stable display device |
| CN107180853A (en) * | 2017-07-10 | 2017-09-19 | 京东方科技集团股份有限公司 | A kind of OLED display panel and its control method, display device |
| CN110599968A (en) * | 2018-06-13 | 2019-12-20 | 咸阳彩虹光电科技有限公司 | Low color cast pixel matrix display method and device |
-
2020
- 2020-04-14 CN CN202010291727.5A patent/CN113534977B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5214413A (en) * | 1987-06-23 | 1993-05-25 | Nissan Motor Company, Limited | Head-up display apparatus for vehicular display |
| KR100844776B1 (en) * | 2007-02-23 | 2008-07-07 | 삼성에스디아이 주식회사 | Organic light emitting display device and dirving method thereof |
| CN102646392A (en) * | 2011-02-21 | 2012-08-22 | 联咏科技股份有限公司 | Bi-stable display control method, time sequence controller and bi-stable display device |
| CN107180853A (en) * | 2017-07-10 | 2017-09-19 | 京东方科技集团股份有限公司 | A kind of OLED display panel and its control method, display device |
| CN110599968A (en) * | 2018-06-13 | 2019-12-20 | 咸阳彩虹光电科技有限公司 | Low color cast pixel matrix display method and device |
Non-Patent Citations (4)
| Title |
|---|
| Patrick Fiala ; Dominik Auth ; Christoph Weber ; Quentin Gaimard ; Abderrahim Ramdane ; Stefan Breuer.Self-Injected Optical Frequency Comb Quantum Dash Lasers.《IEEE》.2019,全文. * |
| 基于STM32的超多路阵列信号采集技术的设计与实现;刘意;王午鑫;马凯;;仪器仪表用户(第04期);全文 * |
| 基于摄像机的多投影屏幕激光笔跟随演示方法;李伟仙;;应用光学(第01期);全文 * |
| 精密PSD微位移在线测量系统;宋殿友;刘铁根;丁小昆;李志宏;;天津大学学报(第02期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113534977A (en) | 2021-10-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100644211B1 (en) | Image processing system, projector, information storage medium and image processing method | |
| CN100435551C (en) | Image processing system, projector, and image processing method | |
| TWI442286B (en) | Touch control input method and apparatus thereof | |
| US7631974B2 (en) | Image display method and image display device | |
| US8797306B2 (en) | Display device with optical sensors | |
| CN105023552B (en) | Display and brightness adjusting method thereof | |
| US8274531B2 (en) | Display apparatus for projecting overlapping windows with light modulation valves | |
| CN110703904B (en) | Visual line tracking-based augmented virtual reality projection method and system | |
| US9913349B2 (en) | Display apparatus and method for controlling region for luminance reduction | |
| CN105374340B (en) | A kind of brightness correcting method, device and display device | |
| EP1087327A2 (en) | Interactive display presentation system | |
| KR102142624B1 (en) | Display device | |
| CN104660946B (en) | Projector and its control method | |
| JP2007512557A (en) | Method and apparatus for visual masking of defects in matrix displays by using characteristics of the human visual system | |
| CN104658462B (en) | The control method of projector and projector | |
| EP3571976A1 (en) | Endoscope apparatus | |
| KR20180063611A (en) | Display device and image data processing method of the same | |
| US20100177062A1 (en) | Light compensation method | |
| CN109814770B (en) | Cursor positioning method, interactive projection device and education system | |
| CN113534977B (en) | Display method and display device capable of identifying external laser | |
| CN114071094A (en) | Projection apparatus and projection method | |
| JP2017219837A (en) | Transparent display device and drive method of the same | |
| US20210137378A1 (en) | Gaze detection apparatus, gaze detection method, and gaze detection program | |
| CN110873961B (en) | Optical fiber scanning display device, optical fiber scanning display equipment and optical fiber scanning method | |
| US10055026B2 (en) | Interactive projector and method of controlling interactive projector |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |