CN111128046A - Lens-free imaging device and method of LED display screen - Google Patents
Lens-free imaging device and method of LED display screen Download PDFInfo
- Publication number
- CN111128046A CN111128046A CN202010047168.3A CN202010047168A CN111128046A CN 111128046 A CN111128046 A CN 111128046A CN 202010047168 A CN202010047168 A CN 202010047168A CN 111128046 A CN111128046 A CN 111128046A
- Authority
- CN
- China
- Prior art keywords
- led
- module
- light
- display screen
- dot matrix
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
- G09F9/30—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements
- G09F9/33—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements being semiconductor devices, e.g. diodes
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
- G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
Abstract
The invention discloses a lens-free imaging device and method of an LED display screen. A layer of diffuser is arranged in front of the LED display screen, light on an object is scattered by the diffuser and then projected on the LED display screen, meanwhile, the LEDs on the display screen are additionally provided with a photoelectric sensing function and a corresponding receiving circuit besides a light-emitting function, when the LEDs are in a photoelectric sensing receiving state, the light intensity of the external object projected on the screen can be sensed on the LEDs, and light sensing information of all the LEDs is collected to obtain light signal distribution on the surface of the whole screen; the acquired information is transmitted to image information recovery processing equipment through a communication bus to perform image recovery through imaging calculation, so that the imaging of the object can be realized. The invention reserves the display function of the LED display screen, simultaneously enables the screen to have the capability of lens-free imaging, and can also be matched with other unit boards only having the display function to obtain the display screen integrating display and imaging.
Description
Technical Field
The present invention relates to a lens-free imaging method and device, and more particularly, to a lens-free imaging device and method for an LED display screen.
Background
With the development of the technology, the LED display is greatly applied to the aspect of large screens by utilizing the splicing mode of the unit boards, and the advertising boards, outdoor huge screens, stage background screens of concerts and activities which are visible everywhere are spliced by utilizing the LED screens. On the other hand, with the application of the OLED display screen in the display screen of the mobile phone, the miniaturization of the LED is also in the research stage, the LED has a higher color gamut than the OLED, and has a great potential in the field of small screen display in the future, and the micro-LED display technology is considered as a possible technology of the next generation of mobile phone screen.
In addition, the traditional imaging mode needs to carry a lens device with a large size and high cost in front of the sensing equipment, and the lens-free imaging method based on the diffuser replaces the lens with a thin and transparent diffuser film to realize imaging, and after an initial image of the sensing equipment is received, the image can be realized only by recovering the image through an algorithm. The imaging technology applied to the mobile phone is also developing toward miniaturization and ultra-thinness, especially the development of the full-screen and under-screen technology of the front part of the mobile phone, and the front camera is expected to be completely integrated under the screen of the mobile phone.
On the other hand, the LED has not only the light emitting characteristic but also the photovoltaic sensing characteristic due to the nature of the LED, so that the screen surface light source can be directly acquired. By building the optical sensing circuit, the optical information on a single pixel point can be acquired. The pixels of the display screen can thus in fact serve as light-sensing elements or even as basic units for imaging. Lens imaging, which is used as imaging sensing for the whole screen, is not practical, but if a lens-free imaging technology is combined, direct imaging by using an LED large screen or a future LED-based mobile phone display screen can be realized without an additional camera. The method does not need additional imaging equipment, does not change the appearance and the basic function of the screen, is convenient to apply, has a simple structure and low cost, but does not see relevant reports at present.
Disclosure of Invention
The invention provides a lens-free imaging device and a lens-free imaging method of an LED display screen, which are used for solving the problems in the background art.
The technical scheme adopted by the invention is as follows:
a lens-free imaging device of an LED display screen.
The LED display screen comprises an object, a diffuser, an LED display screen formed by splicing display unit plates and image information recovery processing equipment, wherein adjacent display unit plates are interconnected through a communication bus, and the display unit plates are connected to the image information recovery processing equipment through the communication bus for communication; a diffuser is arranged on the surface of the LED display screen and is not in contact with the surface of the LED display screen, and objects are arranged in front of the diffuser and the LED display screen;
the display unit board comprises a driving and optical imaging circuit board and an LED dot matrix module. The LED lattice module is connected with the driving and optical imaging circuit board through the circuit board and the lattice module connecting line set;
the driving and optical imaging circuit board comprises a microprocessor, a communication bus, a power supply module, a driving module and a screen optical signal receiving module, wherein the driving output of the driving module is connected to the LED dot matrix module for display driving; the microprocessor realizes the multiplexing of the display and light sensing functions of the LED dot matrix module through the tristate door control driving module and the screen light signal receiving module, and a communication function pin of the microprocessor is connected to an edge interface of the driving and light imaging circuit board to form a communication bus; the power supply module is connected with an external power supply to provide power for the microprocessor, the driving module and the screen light signal receiving module.
The output end of the tri-state gate comprises three states of high level, low level and high resistance, the high level and the low level correspond to the normal working state of the driving module, and the high resistance corresponds to the high resistance state of the driving module.
The LED lattice module is of an N multiplied by M LED lattice arrangement structure, and each LED in the LED lattice module is full-color three-primary-color, double-primary-color or single-color; the LED lattice module comprises a full-color three-primary-color lattice module, a two-primary-color lattice module or a single-color lattice module; the full-color three-primary-color lattice module or the two-primary-color lattice module comprises N common-anode VCC pins and K multiplied by L (equal to M) common-cathode pins, wherein N and M are positive integers more than or equal to 1; the single-color lattice module comprises N common-anode VCC pins and M common-cathode pins, wherein N and M are positive integers more than or equal to 1.
The display unit board has both a display function and a light sensing function; when the optical sensing function is carried out, the microprocessor controls the three-state gate to enable the output port of the driving module to be in a high-impedance state, the driving module is disconnected with the LED dot matrix module, the LED dot matrix module is logically connected to the screen optical signal receiving module only, and the microprocessor acquires an optical sensor image on the surface of the LED dot matrix module through the screen optical signal receiving module; when the display function is carried out, the microprocessor controls the tri-state gate to enable the output port of the driving module to be in a normal state, the LED dot matrix module normally executes the display function, and at the moment, the screen light signal receiving module stops working; the display function and the optical sensing function are carried out step by step in time, and independent optical sensing and display are completed; or the display function and the light sensing function are switched at a high speed, so that the simultaneous light sensing and display based on the persistence of vision effect are realized. Each display unit board on the LED display screen can be in different functional states.
The optical sensor images of the LED dot matrix modules are spliced to form a complete optical sensor image received by the LED display screen and used as a measured value of the optical sensor without lens imaging, and the optical sensing function does not need to introduce an additional sensor, so that the screen has the optical sensing function only while the display function of the LED display screen is kept.
The object is actively illuminated or illuminated by a light source.
The image information recovery processing device is a computer or other microcomputer system that performs communication and processes signals in real time.
The communication bus adopts a universal serial port communication mode of a microprocessor, such as UART/I2C/SPI/RS232/USB and the like, is used for finishing the downloading of display signals and the uploading of optical sensor images acquired by each display unit board, and realizes the communication between the image information recovery processing equipment and the LED display screen and the interconnection communication between the display unit boards inside the LED display screen.
The diffuser should be kept at a suitable distance from the LED display screen, which distance is related to the focal length, while the object should be kept at a suitable object distance from the diffuser. The diffuser is a transparent film and does not influence the execution and viewing effect of the display function.
The LED display screen is an X multiplied by Y infinitely extended unit board matrix formed by splicing display unit boards, wherein X and Y are positive integers larger than or equal to 1, or other shapes with interconnection property formed by splicing the display unit boards.
Second, non-lens imaging method of LED display screen according to the device
The method comprises the following steps:
step 1): calibration: firstly, burning a corresponding execution program to a microprocessor through a communication bus, thereby having the functions of display and optical sensing; then replacing the object with a point light source, wherein the position of the point light source is the same as that of the object before replacement, simultaneously switching the LED display screen to have a light sensing function, scattered light of the point light source, which is irradiated to the surface of the display unit plate through the diffuser, generates a photovoltaic special effect in the LED to generate a light signal, collecting the light signal of each LED on each LED dot matrix module to obtain a local light sensor image, converging the information of the LED dot matrix modules to image information recovery processing equipment through a communication bus, and then integrating to obtain a complete light sensor image;
then, the distance between the point light source or the diffuser and the LED display screen is adjusted to enable the image information recovery processing equipment to obtain a clear light sensor image, so that calibration is completed, the calibration process is called point spread function measurement, and the clear light sensor image corresponding to the point light source is a Point Spread Function (PSF) for lens-free imaging;
step 2): shooting and displaying: the light sensing process and the display process of the LED display screen in shooting are carried out step by step in time, so that the independent execution of the display function is realized; or the display function and the light sensing function of the display unit board are switched at a high speed, so that the display process and the light sensing process in shooting are simultaneously executed;
the shooting process specifically comprises the following steps: placing an object at the point light source position calibrated in the step 1), enabling the output end of the driving module to be in a high-resistance state by the microprocessor through the three-state gate, enabling the display unit board to be in a light sensing function state, obtaining a light sensor image corresponding to the surface of the LED dot matrix module by using a light signal generated by the photovoltaic effect of the LED, converging the information of the LED dot matrix modules to image information recovery processing equipment through a communication bus, and obtaining a complete light sensor image through integration, namely obtaining the light sensor image for lens-free imaging;
the display process specifically comprises the following steps: when the output end of the driving module is in a normal state through the three-state gate, the display unit board is in a display function state, and the LED display screen realizes the display of images;
step 3): and (3) image reconstruction: inputting the point spread function obtained in the step 1) and the optical sensor image obtained in the step 2) into an image information recovery processing device, and executing a lens-free imaging image reconstruction algorithm on the optical sensor image obtained in the step 2) by the image information recovery processing device according to the point spread function, thereby recovering the image of the object and realizing the imaging process of the object.
The image reconstruction algorithm of the lens-free imaging comprises an alternating direction multiplier method ADMM or an improved method based on the ADMM, such as Le-ADMM, Le-ADMM-U and other lens-free imaging methods.
The optical signal is an analog optical voltage signal generated by a photovoltaic effect and represents light intensity information in a certain frequency range.
For an LED dot matrix module using a monochromatic LED or when LED color sensing is not considered, the imaging result of an object is a black-and-white gray image; for an LED lattice module using a full-color three-primary-color LED, three different light intensity information can be obtained, the detection of the light intensity of three RGB color channels can be further realized, and the imaging result of an object is a color image.
The invention has the beneficial effects that:
1) the invention utilizes the sensing characteristic of the display pixels, so that an additional sensor or a camera is not needed, namely, one access device is directly reduced, and the LED display screen is changed into a device with two functions of display and imaging. The cost is reduced, meanwhile, the LED display screen can be directly and conveniently used for finishing imaging, and the functions of the screen are expanded.
2) The invention only adds a layer of transparent diffuser film on the appearance, and only modifies the drive circuit of the LED dot matrix screen without changing the appearance and the display method, thereby hardly influencing the display effect and the use of the LED display screen, and being applicable to various occasions needing display and imaging, and having wide application range.
3) The invention can be matched with other unit boards only having display function for use, and a display screen integrating display and imaging is obtained, thereby realizing new interactive experience.
Drawings
FIG. 1 is a block diagram of a method of implementing lensless imaging in accordance with the present invention.
Fig. 2 is a schematic view of the overall structure of the device of the present invention.
Fig. 3 is a schematic structural view of a display unit panel.
Fig. 4 is an internal structural view of the driving and photo imaging circuit board.
Fig. 5 is a structural view of an LED dot matrix screen.
Fig. 6 is a lens-free imaging flow diagram of the present invention.
In the figure: 1. the LED display device comprises an object, 2, a diffuser, 3, a display unit board, 4, an LED display screen, 5, image information recovery processing equipment, 6, a communication bus, 7, a driving and optical imaging circuit board, 8, an LED dot matrix module, 9, pixels, 10, a microprocessor, 11, a power supply module, 12, a driving module, 13, a screen optical signal receiving module, 14, a circuit board and dot matrix module connecting line group and 15, a tristate gate.
Detailed Description
The present invention is further illustrated by the following specific examples.
As shown in fig. 1 and 2, the method of the present invention is to place a layer of diffuser 2 in front of the LED display screen 4, and the object 1 which is actively illuminated or irradiated by the light source emits the reflected light or self-emitted light of the object, and the light is irradiated on the diffuser to form scattering, but not cause reflections, the light is scattered and then passes through the diffuser to impinge on the LED display screen 4, meanwhile, the LED pixel units LED on the LED display screen 4 are added with a photoelectric sensing function and a corresponding receiving circuit besides a light-emitting function, when in a photoelectric sensing receiving state, light signals can be generated on the LED pixels, each display unit plate 3 of the LED display screen 4 collects partial images on the own unit plate, then the image information is transmitted to the image information recovery processing device 5 through the communication bus 6, the image of the whole screen is collected, and the imaging of the object can be realized through the image recovery through the imaging calculation. The LED display screen 4 may continue to perform the display function while performing the imaging function.
As shown in fig. 2, the present invention includes an object 1, a diffuser 2, an LED display screen 4 formed by splicing display unit boards 3, and an image information recovery processing device 5, wherein adjacent display unit boards 2 are interconnected through a communication bus 6, and are connected to the external or internal image information recovery processing device 5 through the communication bus 6 for communication; the diffuser 2 is placed on the surface of the LED display screen 4 and the object 1 is placed in front of the diffuser 2 and the LED display screen 4 at a distance.
In the specific implementation, the distance between the object 1 and the diffuser 2 is determined according to the point light source distance during calibration, and the distance between the diffuser 2 and the LED display screen 4 is determined according to the point spread function image with the best effect obtained finally during calibration.
As shown in fig. 3, the display unit panel 2 of the present invention includes a driving and photo-imaging circuit board 7 and an LED dot matrix module 8. The LED dot matrix module 8 is directly connected with the driving and light imaging circuit board 7 through a circuit board and dot matrix module connecting line group 14.
As shown in fig. 4, the driving and light imaging circuit board 7 of the present invention includes a microprocessor 10, a communication bus 6, a power supply module 11, a driving module 12, and a screen light signal receiving module 13. The driving output of the driving module 12 is directly connected to the LED dot matrix module 8 for display driving. The microprocessor 10 is connected with a driving module 12 and a screen light signal receiving module 13 respectively. The driving module 12 is a driving circuit module with a tri-state gate 15, and the microprocessor 10 controls the driving module 12 and the screen light signal receiving module 13 through the tri-state gate 15 to realize multiplexing of the display and light sensing functions of the LED pixels 9. The communication function pin of the microprocessor 10 is connected to the edge interface of the driving and light imaging circuit board 7 to form a communication bus 6; the power supply module supplies power to the microprocessor 10, the driving module 12 and the screen light signal receiving module 13 through connection with an external power supply.
In specific implementation, the microprocessor 10 in the display unit board 3 adopts an ATmega2560 chip having 16 analog input ports and 8-bit microcontroller, the main chip of the driving module 12 includes an eight-way positive phase three-state driver 74ACT244 with the function of the three-state gate 15, a dedicated 8 × 8 full-color RGB-LED dot matrix screen driving chip DM163, the main chip of the screen light signal receiving module 13 is a four-operational amplifier LM324, and the voltage of the power supply module 11 is 5V.
In a specific embodiment, as shown in fig. 5, the LED dot matrix module 8 used in the present invention has an 8 × 8 full color LED dot matrix arrangement structure. For each pixel 9, each pair of three-primary-color LEDs are integrated in the same chip, the adopted dot matrix screen model is GTM2088ARGB, and the model of each three-primary-color LED is 5050 RGB.
In the specific embodiment, 16 display unit boards 3 form a 4 × 4 LED display screen 4, the communication between the display unit boards 3 is realized by I2C, and the communication mode between the LED display screen 4 and the image information recovery processing device 5 is a UART.
In a concrete implementation, the image information restoration processing apparatus 5 uses a general-purpose computer.
The working principle of the invention is as follows:
first, in acquiring an initial sensor image on the LED display screen 4: when each display unit board 3 in the LED display screen 4 is ready for use, it will be connected to a computer through a communication bus 6 to burn a program, and the function of the program includes two parts: on one hand, the display function is realized, the program drives one line of LEDs at each display moment through the traditional dynamic scanning display method to realize the display function, and after all lines are driven to display for one time through quick switching, the display of one frame can be completed. The scanning speed is more than 30 frames, and normal display of a frame of picture can be realized by using the persistence of vision effect of human eyes; on the other hand, the LED has a light sensing function, and has a photoelectric effect when the LED is biased to 0 (the anode and cathode voltages are equal) or reversely biased (the anode voltage is lower than the cathode voltage), so that the LED can detect the light intensity information of an external light source to the LED. In practice, after the tri-state function 15 isolates the influence of the driving module 12, the screen light signal receiving module 13 can be used to detect the light intensity on each pixel 9 of the LED display screen 4. After sampling and integration by the microprocessor 10, local image information on the LED dot matrix module of one display unit board 3 can be obtained in each display unit board 3. After transmission over the communication bus 6, the photosensor image of the entire LED display screen 4 is available at the image information recovery processing device 5. Therefore, the process is equivalent to completing the process of acquiring images by the light sensing array in the camera.
Secondly, the imaging principle aspect of lens-free imaging:
because no lens is used, the photosensor image captured within the LED display screen 4 is not an image of the object 1 or scene, but is an initial blurred image, referred to herein as the photosensor image. In order to recover the actual image of the object 1 or scene from the photosensor image, an algorithm for lens-less imaging is required to calculate the image of the object 1 or scene.
If the object 1 or scene is replaced by a single point source, a high contrast aggressive pattern is produced on the light sensor, which is the Point Spread Function (PSF) of the system: h. if a scene is modeled as a set of point sources with different colors and intensities, and assuming all points are incoherent, the light sensor image b of the scene is described as:
b(x，y)＝crop[h(x，y)*x(x，y)]＝CHx ①
where the image of the object 1 or scene is x, (x, y) are the coordinates in the light sensor, C, H, x are abbreviations crop [ ], h (x, y), x (x, y), respectively. The crop operation crop [ ] limits the output to the physical sensor size. Our goal is to recover scene x from measurement b.
In the case where the point spread function PSF is known, the restoration of the object 1 or scene can be written as:
where Ψ is a sparse transform and τ is an adjustment parameter to adjust sparsity. By calculating
The image of the object 1, i.e. the scene, can be obtained, and the lens-free imaging is realized.
The implementation of the invention is as follows (as shown in fig. 6):
step 1): and (6) calibrating. Firstly, a corresponding execution program is burnt into the microprocessor 10 through the communication bus 6, so that the display unit board 3 has the functions of display and light detection; then, a point light source is replaced at the same distance from the object 1 in front of the screen, the point light source is a 1w white LED, the LED display screen 4 only works in a light sensing function at the moment, the light intensity irradiated on each pixel on the LED display screen 4 can be sensed and collected, the working mode of the LED specifically adopts a reverse-biased photoconductive mode, and the sensitivity of the collected light signal is 20 mV/lum. After the local image on the screen is collected by the display unit board 3, the local image is transmitted to a selected host unit board through the I2C, and then the host unit board is transmitted to the image information recovery processing device 5 through the UART, so that the computer can obtain the image of the whole LED display screen, wherein the image pixel size of the image is 32 x 32. At this time, the image is the Point Spread Function (PSF) h (x, y) for lensless imaging.
Step 2): a light sensor image of an object is captured. Placing the object 1 to be imaged at the point light source position in step 1), then, in a specific implementation, the LED display screen 4 still works only under the light sensing function, the microprocessor 10 sends an enable signal to control the three-state enable switch 74ACT244 in the driving module 12 to open, the connection between the driving module 12 and the LED dot matrix module 8 is disconnected, the LM324 in the screen light signal receiving module 13 performs amplification and filtering processing after receiving the light sensing information on the LED dot matrix module 8, and then sends the light sensing information to the microprocessor 10 for sampling, which is the same as step 1), and finally, an image on the whole LED display screen is obtained and transmitted to the image information recovery processing device 5 through the communication bus UART, and the obtained image is the light sensor image b (x, y) for lens-free imaging.
Step 3): and (5) reconstructing an image. At this time, the point spread function h (x, y) when the point light source irradiation has been acquired in step 1) and step 2) and the photosensor image b (x, y) when the object 1 is placed have been stored in the image information recovery processing apparatus 5, and these pieces of information are stored in the image information recovery processing apparatus 5.
The image information recovery processing equipment (5) executes a lens-free imaging image reconstruction algorithm on the optical sensor image in the step 2) according to the point spread function, thereby recovering the image of the object and realizing the imaging process of the object (1), wherein the specific process is as follows:
in case the point spread function PSF is known, the recovery of the object 1 can be written as:
where Ψ is a sparse transformation, τ is an adjustment parameter for adjusting the sparsity; x 'is the image of the object 1 obtained in the last iteration, and x' in the initial iteration process is the photo sensor image b; C. h, x 'are abbreviations for crop [ ], h (x, y), x' (x, y), respectively, (x, y) are coordinates in the LED display screen 4, and the cropping operation crop [ ] limits the output to the size of the LED display screen 4.
Calculated by an iterative optimization algorithm
That is, the final restored image of the object 1 is obtained, and the lens-free imaging is realized, specifically, the following operations are performed:
further conversion according to equation ② yields:
s.t.v＝Hx′，u＝Ψx′，w＝x’ ③
then obtaining the final recovery image of the object 1 by an iterative optimization algorithm
xk+1←(μ1HTH+μ2ΨTΨ+μ3I)-1rk
Wherein the content of the first and second substances,
α1，α2，α3is a Lagrange multiplier representing the dual variable of u, v, w; mu.s1，μ2，μ3Is a penalty parameter;
is the parameter tau/mu2The vector threshold of (2); x is the number ofk、xk+1The values are the same as those of x', the values all represent the last iteration result, and k is the current iteration number; .
In a specific embodiment, only a single primary color LED, i.e. a red LED, of the full-color LEDs is used as a sensor, so that imaging of a black-and-white image is finally achieved.
Claims (9)
1. A lens-free imaging device of an LED display screen is characterized in that: the LED display screen comprises an object (1), a diffuser (2), an LED display screen (4) formed by splicing display unit boards (3) and image information recovery processing equipment (5), wherein adjacent display unit boards (2) are interconnected through a communication bus (6), and the display unit boards (2) are connected to the image information recovery processing equipment (5) through the communication bus (6) for communication; the diffuser (2) is placed on the surface of the LED display screen (4), the diffuser (2) is not in contact with the surface of the LED display screen (4), and the object (1) is placed in front of the diffuser (2) and the LED display screen (4);
the display unit board (2) comprises a driving and light imaging circuit board (7) and an LED dot matrix module (8). The LED dot matrix module (8) is connected with the driving and light imaging circuit board (7) through a circuit board and a dot matrix module connecting wire group (14);
the driving and light imaging circuit board (7) comprises a microprocessor (10), a communication bus (6), a power supply module (11), a driving module (12) and a screen light signal receiving module (13), the driving output of the driving module (12) is connected to the LED dot matrix module (8) for display driving, the microprocessor (10) is respectively connected with the driving module (12) and the screen light signal receiving module (13), the driving module (12) is a driving circuit module comprising a tri-state gate (15), and the output end of the tri-state gate (15) and the screen light signal receiving module (13) are connected with the LED dot matrix module (8) through a circuit board and dot matrix module connecting wire group (14); the microprocessor (10) controls the driving module (12) and the screen light signal receiving module (13) through the three-state gate (15) to realize multiplexing of the display and light sensing functions of the LED dot matrix module (8), and a communication function pin of the microprocessor (10) is connected to an edge interface of the driving and light imaging circuit board (7) to form a communication bus (6); the power supply module is connected with an external power supply to supply power to the microprocessor (10), the driving module (12) and the screen light signal receiving module (13).
2. The lens-free imaging device of the LED display screen of claim 1, wherein: the output end of the tri-state gate (15) comprises three states of high level, low level and high resistance, the high level and the low level correspond to the normal working state of the driving module (12), and the high resistance corresponds to the high resistance state of the driving module (12).
3. The lens-free imaging device of the LED display screen of claim 1, wherein: the LED lattice module (8) is an N multiplied by M LED lattice arrangement structure, and each LED in the LED lattice module (8) is full-color three primary colors, double primary colors or single color.
4. The lens-free imaging device of the LED display screen of claim 1, wherein: the display unit board (3) has both a display function and a light sensing function; when the optical sensing function is carried out, the microprocessor (10) controls the tri-state gate (15) to enable the output port of the driving module (12) to be in a high-impedance state, the driving module (12) is disconnected with the LED dot matrix module (8), the LED dot matrix module (8) is logically connected to the screen optical signal receiving module (13) only, and the microprocessor (10) acquires an optical sensor image on the surface of the LED dot matrix module (8) through the screen optical signal receiving module (13); when the display function is performed, the microprocessor (10) controls the tri-state gate (15) to enable the output port of the driving module (12) to be in a normal state, and the LED dot matrix module (8) normally executes the display function; the display function and the optical sensing function are carried out step by step in time, and independent optical sensing and display are completed; or the display function and the light sensing function are switched at a high speed, so that the simultaneous light sensing and display based on the persistence of vision effect are realized.
5. The lens-free imaging device of the LED display screen of claim 4, wherein: and the optical sensor images of the LED dot matrix modules (8) are spliced to form a complete optical sensor image received by the LED display screen (4).
6. The lens-free imaging device of the LED display screen of claim 1, wherein: the object (1) is actively illuminated or illuminated by a light source.
7. A method of lensless imaging of an LED display screen according to any of claims 1-6, comprising the steps of:
step 1): calibration: the method comprises the steps that an object (1) is replaced by a point light source, the position of the point light source is the same as that of the object (1) before replacement, an LED display screen (4) is switched to have a light sensing function, scattered light of the point light source, which is irradiated to the surface of a display unit plate (3) through a diffuser (2), generates a photovoltaic special effect in LEDs to generate light signals, the light signals of the LEDs on each LED dot matrix module (8) are collected to obtain a local light sensor image, and information of the LED dot matrix modules (8) is converged to an image information recovery processing device (5) through a communication bus (6) to obtain a complete light sensor image through integration;
then, the distance between the point light source or the diffuser (2) and the LED display screen (4) is adjusted to enable the image information recovery processing equipment (5) to obtain a clear light sensor image, so that calibration is completed, the calibration process is called point spread function measurement, and the clear light sensor image corresponding to the point light source is a point spread function for lens-free imaging;
step 2): shooting and displaying: the light sensing process and the display process of the LED display screen (4) in shooting are carried out step by step in time, so that the independent execution of the display function is realized; or the display function and the light sensing function of the display unit board (2) are switched at high speed, so that the display process and the light sensing process in shooting are simultaneously executed;
the shooting process specifically comprises the following steps: placing an object (1) at the point light source position calibrated in the step 1), enabling the output end of a driving module (12) to be in a high-resistance state by a microprocessor (10) through a three-state gate (15), enabling a display unit board (2) to be in a light sensing function state, obtaining a light sensor image corresponding to the surface of an LED dot matrix module (8) by using a light signal generated by the photovoltaic effect of an LED, converging the information of a plurality of LED dot matrix modules (8) to an image information recovery processing device (5) through a communication bus (6), and obtaining a complete light sensor image through integration, namely obtaining the light sensor image for lens-free imaging;
the display process specifically comprises the following steps: when the microprocessor (10) enables the output end of the driving module (12) to be in a normal state through the tri-state gate (15), the display unit board (3) is in a display function state, and the LED display screen (4) realizes the display of images;
step 3): and (3) image reconstruction: inputting the point spread function obtained in the step 1) and the optical sensor image obtained in the step 2) into an image information recovery processing device (5), and executing an image reconstruction algorithm of lens-free imaging on the optical sensor image in the step 2) by the image information recovery processing device (5) according to the point spread function, thereby recovering the image of the object and realizing the imaging process of the object (1).
8. The method of claim 7, wherein the image reconstruction algorithm for lens-free imaging comprises an Alternative Direction Multiplier Method (ADMM) or an improved method based on ADMM, such as Le-ADMM, Le-ADMM-U.
9. The lens-free imaging method of the LED display screen according to claim 7, characterized in that, for the LED dot matrix module (8) using monochromatic LEDs, the imaging result of the object (1) is a black and white gray image; for an LED dot matrix module (8) using full color three primary LEDs, the imaging result of the object (1) is a color image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010047168.3A CN111128046B (en) | 2020-01-16 | 2020-01-16 | Lens-free imaging device and method of LED display screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010047168.3A CN111128046B (en) | 2020-01-16 | 2020-01-16 | Lens-free imaging device and method of LED display screen |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111128046A true CN111128046A (en) | 2020-05-08 |
| CN111128046B CN111128046B (en) | 2021-04-27 |
Family
ID=70489501
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010047168.3A Active CN111128046B (en) | 2020-01-16 | 2020-01-16 | Lens-free imaging device and method of LED display screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111128046B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114866696A (en) * | 2022-04-29 | 2022-08-05 | 京东方科技集团股份有限公司 | Display panel, preparation method thereof and display device |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1810046A (en) * | 2003-05-23 | 2006-07-26 | 彼得·博尔 | Method and device for three-dimensionally depicting images |
| CN1963290A (en) * | 2005-11-10 | 2007-05-16 | 吴完镐 | The luminous device using light emitting diodes |
| WO2010113987A1 (en) * | 2009-03-30 | 2010-10-07 | Ricoh Company, Ltd. | Spectral characteristic obtaining apparatus, image evaluation apparatus and image forming apparatus |
| CN101971123A (en) * | 2008-02-29 | 2011-02-09 | 微软公司 | Interactive surface computer with switchable diffuser |
| JP2011049001A (en) * | 2009-08-26 | 2011-03-10 | Hibino Kk | Lighting device |
| CN102301276A (en) * | 2009-02-02 | 2011-12-28 | 微软公司 | diffusing screen |
| CN102592514A (en) * | 2011-01-10 | 2012-07-18 | 三星电子株式会社 | Organic light emitting diode (OLED) display apparatus having light sensing function |
| CN106125316A (en) * | 2016-06-24 | 2016-11-16 | 西安电子科技大学 | Energy-conservation nothing based on grating waveguide redirects the integrated imaging display device of image |
| CN107895543A (en) * | 2017-11-27 | 2018-04-10 | 福州大学 | A kind of high-integrated semiconductor display system |
| CN108463667A (en) * | 2015-11-13 | 2018-08-28 | 瑞尔D斯帕克有限责任公司 | Wide-angle image directional backlight |
| CN108629269A (en) * | 2017-03-16 | 2018-10-09 | 原子能和替代能源委员会 | Optical imaging apparatus |
| US20180357462A1 (en) * | 2017-06-12 | 2018-12-13 | Synaptics Incorporated | Systems and methods for reducing unwanted reflections in display systems incorporating an under display biometric sensor |
| CN109712559A (en) * | 2019-01-14 | 2019-05-03 | 浙江大学 | It is a kind of to show interactive device and method without sensing LED dot matrix screen |
| CN109901326A (en) * | 2008-01-08 | 2019-06-18 | 杜比实验室特许公司 | Parallax reduces |
| WO2019124106A1 (en) * | 2017-12-22 | 2019-06-27 | ソニー株式会社 | Imaging device, imaging method, and imaging element |
| WO2019147649A1 (en) * | 2018-01-23 | 2019-08-01 | Clearink Displays, Inc. | Method, system and apparatus for color saturation in reflective image displays |
| US20190378445A1 (en) * | 2017-12-21 | 2019-12-12 | X Development Llc | Directional light emitters and electronic displays featuring the same |
-
2020
- 2020-01-16 CN CN202010047168.3A patent/CN111128046B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1810046A (en) * | 2003-05-23 | 2006-07-26 | 彼得·博尔 | Method and device for three-dimensionally depicting images |
| CN1963290A (en) * | 2005-11-10 | 2007-05-16 | 吴完镐 | The luminous device using light emitting diodes |
| CN109901326A (en) * | 2008-01-08 | 2019-06-18 | 杜比实验室特许公司 | Parallax reduces |
| CN101971123A (en) * | 2008-02-29 | 2011-02-09 | 微软公司 | Interactive surface computer with switchable diffuser |
| CN102301276A (en) * | 2009-02-02 | 2011-12-28 | 微软公司 | diffusing screen |
| WO2010113987A1 (en) * | 2009-03-30 | 2010-10-07 | Ricoh Company, Ltd. | Spectral characteristic obtaining apparatus, image evaluation apparatus and image forming apparatus |
| JP2011049001A (en) * | 2009-08-26 | 2011-03-10 | Hibino Kk | Lighting device |
| CN102592514A (en) * | 2011-01-10 | 2012-07-18 | 三星电子株式会社 | Organic light emitting diode (OLED) display apparatus having light sensing function |
| CN108463667A (en) * | 2015-11-13 | 2018-08-28 | 瑞尔D斯帕克有限责任公司 | Wide-angle image directional backlight |
| CN106125316A (en) * | 2016-06-24 | 2016-11-16 | 西安电子科技大学 | Energy-conservation nothing based on grating waveguide redirects the integrated imaging display device of image |
| CN108629269A (en) * | 2017-03-16 | 2018-10-09 | 原子能和替代能源委员会 | Optical imaging apparatus |
| US20180357462A1 (en) * | 2017-06-12 | 2018-12-13 | Synaptics Incorporated | Systems and methods for reducing unwanted reflections in display systems incorporating an under display biometric sensor |
| CN107895543A (en) * | 2017-11-27 | 2018-04-10 | 福州大学 | A kind of high-integrated semiconductor display system |
| US20190378445A1 (en) * | 2017-12-21 | 2019-12-12 | X Development Llc | Directional light emitters and electronic displays featuring the same |
| WO2019124106A1 (en) * | 2017-12-22 | 2019-06-27 | ソニー株式会社 | Imaging device, imaging method, and imaging element |
| WO2019147649A1 (en) * | 2018-01-23 | 2019-08-01 | Clearink Displays, Inc. | Method, system and apparatus for color saturation in reflective image displays |
| CN109712559A (en) * | 2019-01-14 | 2019-05-03 | 浙江大学 | It is a kind of to show interactive device and method without sensing LED dot matrix screen |
Non-Patent Citations (2)
| Title |
|---|
| WALTER HARM: ""lensless imaging through thin diffusive media"", 《OPTICS EXPRESS》 * |
| 冯思悦: ""LED微投影系统设计与红光LED微显示阵列的制作研究"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114866696A (en) * | 2022-04-29 | 2022-08-05 | 京东方科技集团股份有限公司 | Display panel, preparation method thereof and display device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111128046B (en) | 2021-04-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11049476B2 (en) | Minimal-latency tracking and display for matching real and virtual worlds in head-worn displays | |
| WO2022001321A1 (en) | Gamma debugging method and gamma debugging device | |
| CN104079904A (en) | Color image generating method and device | |
| CN104981864A (en) | Image processing method and apparatus for display devices | |
| CN102314259A (en) | Method for detecting objects in display area and equipment | |
| CN104883504A (en) | Method and device for opening HDR (high-dynamic range) function on intelligent terminal | |
| CN107222664A (en) | Camera module and electronic installation | |
| CN103512655B (en) | Information processor and method and photoelectric conversion device | |
| CN106782264A (en) | Module color spot prosthetic device and method based on PCGPU | |
| CN112840636A (en) | Image processing method and device | |
| CN111128046B (en) | Lens-free imaging device and method of LED display screen | |
| US7965884B2 (en) | System and method for testing LEDs on a motherboard | |
| KR20140075042A (en) | Apparatus for inspecting of display panel and method thereof | |
| JP5634005B2 (en) | Display device, display control method, and electronic device | |
| CN109712559B (en) | Non-sensing LED dot matrix screen display interaction device and method | |
| KR20220060966A (en) | Data pre-processing for cross sensor automatic white balance | |
| WO2023240898A1 (en) | Display apparatus and under-display photographing processing method | |
| WO2020155072A1 (en) | Mixed layer processing method and apparatus | |
| CN116309873A (en) | Acquisition system, method, computing device and storage medium for line-of-sight data samples | |
| CN110867159B (en) | Object recognition device and method for LED display screen | |
| CN114862846A (en) | Screening method, device, equipment and storage medium | |
| CN114463221A (en) | Self-supervision color correction method for multi-device domain AWB enhancement | |
| US9591276B2 (en) | Display device, electronic apparatus, and method for driving display device | |
| CN110361165B (en) | Manufacturing method for liquid crystal screen blue light component detection and analysis equipment and equipment manufactured by same | |
| CN106131517A (en) | A kind of coloured image acquisition methods |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |