CN112595496B - Method, device, equipment and storage medium for detecting faults of near-eye display equipment - Google Patents
Method, device, equipment and storage medium for detecting faults of near-eye display equipment Download PDFInfo
- Publication number
- CN112595496B CN112595496B CN202011645405.2A CN202011645405A CN112595496B CN 112595496 B CN112595496 B CN 112595496B CN 202011645405 A CN202011645405 A CN 202011645405A CN 112595496 B CN112595496 B CN 112595496B
- Authority
- CN
- China
- Prior art keywords
- eye display
- display device
- different test
- test surfaces
- focusing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M11/00—Testing of optical apparatus; Testing structures by optical methods not otherwise provided for
- G01M11/02—Testing optical properties
- G01M11/0242—Testing optical properties by measuring geometrical properties or aberrations
- G01M11/0257—Testing optical properties by measuring geometrical properties or aberrations by analyzing the image formed by the object to be tested
Abstract
The invention relates to the technical field of near-eye display, and discloses a method, a device, equipment and a storage medium for detecting the defects of near-eye display equipment, wherein the method comprises the following steps: acquiring image pictures of different test surfaces of near-eye display equipment, wherein the different test surfaces comprise imaging surfaces and lens surfaces of the near-eye display equipment; processing the image frames of the different test surfaces to obtain image information of the different test surfaces; and outputting a poor judgment result of the near-eye display device according to the image information. According to the invention, different test pictures of the near-eye display equipment are obtained, the different test pictures are processed, corresponding image information is obtained, and the poor judgment result is output according to the image information, so that compared with the prior art, the poor detection efficiency and accuracy of the near-eye display equipment can be effectively improved by utilizing manual detection.
Description
Technical Field
The present invention relates to the field of near-eye display technologies, and in particular, to a method, an apparatus, a device, and a storage medium for detecting defects of a near-eye display device.
Background
The near-to-eye display industry is developed at a high speed, and the delivery volume of various devices including virtual reality and augmented reality is continuously increased, however, the detection mode of the near-to-eye display industry has a lot of defects, such as inaccurate bad detection results, the bad detection of the traditional flat panel display usually only has one test surface, and a user only needs to care whether the bad phenomenon exists on the display surface. However, for the near-eye display industry, the nature is a three-dimensional display, and compared with the flat panel display detection, a detection dimension is increased, namely, a plurality of test surfaces need to be detected, so that the detection difficulty is also increased. Currently, when detecting whether the near-eye display device is bad, the detection method is performed manually, but the manual detection mode can only detect whether the imaging surface of the near-eye display device is bad. However, if other testing surfaces (such as other lens surfaces) of the near-eye display device are bad, the use experience of the user is greatly affected; at present, no good mode exists for detecting multiple test surfaces manually, and the detection efficiency of near-eye display is low and the error is large.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present invention and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The invention mainly aims to provide a method, a device, equipment and a storage medium for detecting the defects of near-eye display equipment, and aims to solve the technical problem that the efficiency and the accuracy of detecting the defects of the near-eye display equipment cannot be effectively improved.
In order to achieve the above object, the present invention provides a defect detection method of a near-eye display device, the defect detection method of the near-eye display device comprising the steps of:
acquiring image pictures of different test surfaces of near-eye display equipment, wherein the different test surfaces comprise imaging surfaces and lens surfaces of the near-eye display equipment;
processing the image frames of the different test surfaces to obtain image information of the different test surfaces;
and outputting a poor judgment result of the near-eye display device according to the image information.
Optionally, before the step of acquiring the image frames of different test surfaces of the near-eye display device, the method further includes:
and focusing the different testing surfaces of the photographing device and the near-eye display device.
Optionally, the number of the photographing devices is 1, and the step of focusing on different test surfaces of the photographing device and the near-eye display device specifically includes:
acquiring a target focal length and a current focal length of the photographic equipment;
and adjusting the current focal length of the photographic equipment to the target focal length.
Optionally, the number of the photographing devices is 1, and the step of focusing on different test surfaces of the photographing device and the near-eye display device specifically includes:
keeping the focal length of the camera lens unchanged, and adjusting the distance between the lens and the different test surfaces;
processing the image picture of the test surface acquired by the photographic equipment in real time;
and stopping adjusting the distance between the lens and the test surface to realize focusing if the image frame reaches the preset definition.
Optionally, the number of the photographing devices is 1, and the step of focusing on different test surfaces of the photographing device and the near-eye display device specifically includes:
keeping the focal length of the camera lens unchanged, and acquiring a target diopter of the near-eye display device;
the current diopter of the near-eye display device is adjusted to the target diopter.
Optionally, the number of the photographing devices is the same as the number of the test surfaces of the near-eye display device, and the step of focusing on different test surfaces of the photographing device and the near-eye display device specifically includes:
acquiring a target position of the near-eye display device;
and moving the near-eye display device to the target position through a sliding rail so that the photographing device can focus one test surface of the near-eye display device respectively.
Optionally, the step of outputting the poor judgment result of the near-eye display device specifically includes:
whether the near-eye display device is bad, and the type, position and size of the bad information when the near-eye display device is bad.
In addition, in order to achieve the above object, the present invention also proposes a failure detection apparatus of a near-eye display device, the failure detection apparatus of a near-eye display device comprising:
the acquisition module is used for acquiring image pictures of different test surfaces of the near-eye display device, wherein the different test surfaces comprise imaging surfaces and lens surfaces of the near-eye display device;
the imaging processing module is used for processing the image frames of the different test surfaces to obtain image information of the different test surfaces;
and the output module is used for outputting the bad judgment result of the near-eye display equipment according to the image information.
In addition, in order to achieve the above object, the present invention also proposes a failure detection apparatus of a near-eye display apparatus, the failure detection apparatus of the near-eye display apparatus comprising: the system comprises a memory, a processor and a defect detection program of the near-eye display device stored on the memory and capable of running on the processor, wherein the defect detection program of the near-eye display device is configured to realize the steps of the defect detection method of the near-eye display device.
In addition, in order to achieve the above object, the present invention also proposes a storage medium having stored thereon a failure detection program of a near-eye display device, which when executed by a processor, implements the steps of the failure detection method of a near-eye display device as described above.
According to the defect detection method of the near-eye display device, image pictures of different test surfaces of the near-eye display device are obtained, wherein the different test surfaces comprise imaging surfaces and lens surfaces of the near-eye display device; processing the image frames of the different test surfaces to obtain image information of the different test surfaces; and outputting a poor judgment result of the near-eye display device according to the image information. According to the invention, different test pictures of the near-eye display equipment are obtained, the different test pictures are processed, corresponding image information is obtained, and the poor judgment result is output according to the image information, so that the poor detection efficiency and accuracy of the near-eye display equipment can be effectively improved.
Drawings
FIG. 1 is a schematic diagram of a configuration of a defect detection device of a near-to-eye display device of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart of a first embodiment of a method for detecting defects in a near-to-eye display device according to the present invention;
FIG. 3 is a flowchart of a second embodiment of a method for detecting defects in a near-to-eye display device according to the present invention;
FIG. 4 is a first schematic diagram of a focusing process implemented by a defect detecting device of a near-eye display apparatus according to the present invention;
FIG. 5 is a second schematic diagram of a focusing process implemented by the defect detecting device of the near-eye display apparatus according to the present invention;
FIG. 6 is a third schematic diagram of a defect detection device of a near-eye display apparatus for implementing focusing process according to the present invention;
fig. 7 is a schematic functional block diagram of a first embodiment of a defect detecting device of a near-eye display apparatus according to the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic diagram of a failure detection device of a near-eye display device in a hardware running environment according to an embodiment of the present invention.
As shown in fig. 1, the defect detection device of the near-eye display device may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a WIreless interface (e.g., a WIreless-FIdelity (WI-FI) interface). The Memory 1005 may be a high-speed random access Memory (Random Access Memory, RAM) Memory or a stable nonvolatile Memory (NVM), such as a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 does not constitute a limitation of the defect detection device of the near-eye display device, and may include more or fewer components than shown, or may combine certain components, or may be arranged in different components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a malfunction detection program of the near-eye display device may be included in the memory 1005 as one storage medium.
In the defect detection device of the near-eye display device shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the defect detection device of the near-eye display device of the present invention may be disposed in the defect detection device of the near-eye display device, and the defect detection device of the near-eye display device invokes the defect detection program of the near-eye display device stored in the memory 1005 through the processor 1001, and executes the defect detection method of the near-eye display device provided by the embodiment of the present invention.
Based on the above hardware structure, the embodiment of the method for detecting the defect of the near-eye display device is provided.
Referring to fig. 2, fig. 2 is a flowchart illustrating a first embodiment of a defect detection method of a near-eye display device according to the present invention.
In a first embodiment, the defect detection method of the near-eye display device includes the steps of:
step S10, obtaining image frames of different testing surfaces of the near-eye display device, wherein the different testing surfaces comprise imaging surfaces of the near-eye display device, surfaces of various lenses, a display screen and the like.
It should be noted that, the execution body of the embodiment may be a failure detection device of the near-eye display device, or may be other devices that can implement the same or similar functions, and this embodiment is not limited thereto.
It should be understood that different test surfaces of the near-eye display device, referring to a plurality of different surfaces to be tested in the near-eye display device, may include, for example, an imaging surface of the near-eye display device, respective lens surfaces, and a display screen. In this step, different test surfaces can be photographed by a photographing device to obtain image frames corresponding to the different test surfaces, and the purpose of the method is that: and performing image processing through the image frames corresponding to different test surfaces to judge whether a bad test surface exists or not.
It can be understood that the cause of the defect on the test surface of the near-eye display device is more numerous, for example, the near-eye display device is faulty or has dirt, hair, lens dead spots, black lines and the like, and may be caused by the cause of the near-eye display screen, for example, cracks occur or the near-eye display screen cannot be seen clearly due to dirt, so that when the near-eye display is poor, all the causes of the defect of the near-eye display device need to be checked one by one, and the checking mode is to obtain the poor image picture of the near-eye display device first, and separately detect each image picture.
It should be appreciated that the near-eye display device may be a VR device, an AR device, a HUD device, an MR device, or the like.
And step S20, processing the image frames of the different test surfaces to obtain image information of the different test surfaces.
It should be understood that, the processing of the image frames of the different test planes refers to the imaging processing of the image frames of the different test planes by a preset image processing system, which refers to a system for pixelating the image, the preset image processing system determines a specific implementation mode according to the technical field of use, for example, in the medical technical field, the preset image processing system is mainly computer tomography, in the military technical field, mainly simulating three-dimensional geography and relief images, and the preset image processing includes: modern image processing and graphic processing are both based on raster scanning pixels, the same system can realize two types of processing, and the two types of processing can be combined to perform stereoscopic imaging.
It can be understood that the imaging process refers to a process of performing image enhancement by combining an image processing technology and an analysis tool, and changing the enhanced image into corresponding image information, where the image processing technology can be classified into gray-scale image processing and color image processing from an image format, and common image processing and analysis tools include: histogram tools, filtering operations, morphological operations, contour advances, geometric transformations, color space transformations, etc., from an output relationship perspective, the basic image preprocessing algorithm is divided into: after obtaining image frames of different test surfaces of near-eye display equipment, the point transformation algorithm and the field operation algorithm process and analyze the image frames of the different test surfaces through a processing and analyzing tool in a preset image processing system to obtain image information of the different test surfaces.
And step S30, outputting a bad judgment result of the near-eye display device according to the image information.
It should be understood that the outputting the poor judgment result of the near-eye display device includes: and if the near-eye display device is bad, the bad information such as the type, the position and the size of the bad information is bad. For example, the poor near-to-eye display is caused by dirt, namely, point A, point B and point C, and the specific positions and sizes of the point A, the point B and the point C. For example, if the poor image frame of the near-eye display device is the front side, the back side and the screen surface of the first lens, the point a and the point B are on the front side, and the point C is on the screen surface, the back side has no dirty stain, and then the specific poor position of the near-eye display device can be clarified.
It is understood that, for example, the output results show 0 and 1, the output result and the test surface relation mapping table obtain 0 to represent the front surface, 1 to represent the back surface, and 2 to represent the screen surface, so that the dirt is known on the front surface and the back surface, and thus, the bad position of the near-eye display device can be obtained, and thus, the bad position detection of the near-eye display device is realized.
In the embodiment, by acquiring image frames of different test surfaces of the near-eye display device, the different test surfaces comprise an imaging surface and each lens surface of the near-eye display device; processing the image frames of the different test surfaces to obtain image information of the different test surfaces; and outputting a poor judgment result of the near-eye display device according to the image information. According to the invention, different test pictures of the near-eye display equipment are obtained, the different test pictures are processed, corresponding image information is obtained, and the poor judgment result is output according to the image information, so that the poor detection efficiency and accuracy of the near-eye display equipment can be effectively improved.
In an embodiment, as shown in fig. 3, a second embodiment of the method for detecting a defect of a near-eye display device according to the present invention is provided based on the first embodiment, and before the step S10, the method further includes:
and S01, focusing processing is carried out on different testing surfaces of the photographic equipment and the near-eye display equipment.
It will be appreciated that the focusing process refers to a process of changing the position between the object distance and the separation to achieve a clear imaging of the subject. The focusing process can adjust the camera device and also adjust the near-eye display device in four ways, as will be described in detail later. The camera device may preferably be a wide-angle high-definition camera.
This can be achieved by focusing or zooming when adjusting the camera device. The focusing mode is classified into an automatic focusing mode, a manual focusing mode, and a multiple focusing mode. The automatic focusing mode adopts a visual ranging mode, the camera emits infrared rays or other rays, the distance of the shot object is determined according to the reflection of the shot object, and then the lens combination is adjusted according to the measured result to realize automatic focusing; the manual focusing mode is a focusing mode which enables a shot photo to be clear by manually rotating a focusing ring, and the mode depends on the judgment of human eyes on an image on a focusing screen to a great extent, and the proficiency of a photographer and even the eyesight of the photographer; the multi-focusing mode is that when the focusing center is not set in the center of the picture, multi-point focusing or multi-focusing can be used. Besides setting the position of the focusing point, the focusing range can be set, so that the imaging of the photographed object is clear.
In the first manner, when the number of the photographing devices is 1 and focusing is achieved by adjusting the photographing devices, if a zooming manner is adopted, when focusing is performed on different test surfaces displayed by the photographing devices and the near-eye display device, a target focal length and a current focal length of the photographing devices may be obtained, and the current focal length of the photographing devices is adjusted to the target focal length, so that focusing is performed on different test surfaces of the photographing devices and the near-eye display device, see fig. 4.
It is understood that the focal length refers to a measure of the concentration or divergence of light in an optical system, and refers to the distance from the optical center of a lens to the focal point of light concentration when parallel light is incident, and an optical system with a short focal length has better light concentration capability than an optical system with a long focal length, simply the focal length is the distance between the focal point and the center point of a mirror, and imaging is performed when this condition is satisfied in a camera, where the condition is that the focal length < the image distance < twice the focal length. The focusing control of the beam of light or particle flow to converge it to one point as much as possible is to obtain image pictures of different test surfaces of the near-eye display device in this embodiment.
It should be understood that, the adjusting the current focal length of the camera device may obtain an information adjustment operation by obtaining a preset information adjustment instruction, according to the preset information adjustment instruction, adjust the current focal length of the camera device by the information adjustment operation, obtain focal length information of a lens first before adjustment, and continuously adjust the focal length of the camera device until the focal length is adjusted to a target focal length by the information adjustment operation. The preset information adjusting instruction refers to an instruction for adjusting the state of the running device, the instruction refers to a command for executing an operation, in this embodiment, the operation is a command for obtaining an information adjusting operation, the instruction is composed of a string of binary numbers, each instruction is generally composed of two parts, and each instruction is respectively an operation code and an address code, the operation code is used for indicating the type or property of the operation to be completed by the instruction, such as fetching, adding or outputting data, and the address code is used for indicating the content of an operation object or the address of a storage unit where the operation object is located.
In the second mode, when the number of the photographing devices is 1 and focusing is achieved by adjusting the photographing devices, if a focusing mode is adopted, when focusing treatment is performed on different test surfaces displayed by the photographing devices and the near-eye display device, the focal length of a lens of the photographing devices can be kept unchanged, the distance between the lens and the different test surfaces is adjusted, an image picture of the test surface obtained by the photographing devices is obtained and processed in real time in the adjusting process, and if the image picture reaches a preset clear picture, the adjustment of the distance between the lens and the test surface is stopped, so that focusing is achieved, and the purpose of focusing treatment on the different test surfaces of the photographing devices and the near-eye display device is achieved, see fig. 4.
In the third mode, when the number of the photographing devices is 1 and focusing is achieved by adjusting the near-eye display devices, the focal length of the lens of the photographing devices can be kept unchanged, the target diopter of the near-eye display devices is obtained, the current diopter of the near-eye display devices is adjusted to the target diopter, and the purpose of achieving focusing processing of different test surfaces of the photographing devices and the near-eye display devices is achieved. The target diopter may be issued by a preset information adjustment instruction, see fig. 5.
It should be understood that the refractive power refers to the unit of the power, denoted by D, that is, the parallel rays of light pass through the refractive material, with the refractive power of the refractive material being 1 diopter or 1D at a focal point of 1m, for example, the lens power, for example, at a focal point of 1m for a lens, with the refractive power of the lens being 1D diopter and the focal point or response.
In a fourth mode, when the number of the photographing devices is the same as the number of the test surfaces of the near-eye display device and the focusing process is implemented by adjusting the positions of the near-eye display device, the target positions of the near-eye display device may be acquired; and the near-eye display device is moved to the target position through the sliding rail, so that the photographing device can focus one test surface of the near-eye display device respectively, and the purpose of realizing focusing treatment of different test surfaces of the photographing device and the near-eye display device is achieved, and the purpose is seen in fig. 6.
It should be understood that the moving of the near-eye display device to the target position by the slide rail may be performed by acquiring a multi-camera movement operation adjustment command according to which the near-eye display device is moved to the target position by the slide rail so that the cameras may focus one test surface of the near-eye display device, for example, the current position of the near-eye display device is 3mm away from the camera device, at which time one test surface cannot be obtained, and by moving to a distance of 1mm away from the camera device, just one of the cameras may be made to focus one test surface of the near-eye display device. The multi-camera mobile operation adjustment instruction refers to a system strategy formed by adopting a preset number of cameras, light sources and storage devices, the number of the cameras is also different according to different requirements, for example, in the case of requirement A, the number of the cameras is 6, in the case of requirement B, the number of the cameras is 8, and different array construction modes such as a double camera, an 8-camera parallel array, a 32-camera annular array, a 64-camera spherical array and the like can be selected according to different multi-camera strategy applications.
It is understood that if the near-eye display device is defective, and when the near-eye display device is defective, the type, location, and size of the defective information may be, for example, a case where the near-eye display device is defective may be caused by a black line in the near-eye display device, the length of the inner wall black line is 0.01mm, and the type is a line type, and the location is inside the near-eye display device.
It should be understood that after the detection is finished, if it is determined that the near-eye display defect is not caused by dirt according to the detection result, at this time, current display information of a testing surface of the near-eye display screen is captured, the current display information is detected, whether the near-eye display screen is damaged, for example, a black spot or a crack of the near-eye display screen is determined, and if the near-eye display screen is damaged, the defective position information of the near-eye display device is determined to be a screen.
In addition, the embodiment of the invention also provides a storage medium, wherein the storage medium stores a defect detection program of the near-eye display device, and the defect detection program of the near-eye display device realizes the steps of the defect detection method of the near-eye display device when being executed by a processor.
Because the storage medium adopts all the technical schemes of all the embodiments, the storage medium has at least all the beneficial effects brought by the technical schemes of the embodiments, and the description is omitted here.
In addition, referring to fig. 7, an embodiment of the present invention further provides a defect detection apparatus of a near-eye display device, where the defect detection apparatus of the near-eye display device includes:
the acquisition module 10 is configured to acquire image frames of different test surfaces of the near-eye display device, where the different test surfaces include an imaging surface and respective lens surfaces of the near-eye display device.
It should be understood that different test surfaces of the near-eye display device, referring to a plurality of different surfaces to be tested in the near-eye display device, may include, for example, an imaging surface of the near-eye display device, respective lens surfaces, and a display screen. In this step, different test surfaces can be photographed by a photographing device to obtain image frames corresponding to the different test surfaces, and the purpose of the method is that: and performing image processing through the image frames corresponding to different test surfaces to judge whether a bad test surface exists or not.
It can be understood that the cause of the defect on the test surface of the near-eye display device is more numerous, for example, the near-eye display device is faulty or has dirt, hair, lens dead spots, black lines and the like, and may be caused by the cause of the near-eye display screen, for example, cracks occur or the near-eye display screen cannot be seen clearly due to dirt, so that when the near-eye display is poor, all the causes of the defect of the near-eye display device need to be checked one by one, and the checking mode is to obtain the poor image picture of the near-eye display device first, and separately detect each image picture.
It should be appreciated that the near-eye display device may be a VR device, an AR device, a HUD device, an MR device, or the like.
And the imaging processing module 20 is used for processing the image frames of the different test planes to obtain the image information of the different test planes.
It should be understood that, the processing of the image frames of the different test planes refers to the imaging processing of the image frames of the different test planes by a preset image processing system, which refers to a system for pixelating the image, the preset image processing system determines a specific implementation mode according to the technical field of use, for example, in the medical technical field, the preset image processing system is mainly computer tomography, in the military technical field, mainly simulating three-dimensional geography and relief images, and the preset image processing includes: modern image processing and graphic processing are both based on raster scanning pixels, the same system can realize two types of processing, and the two types of processing can be combined to perform stereoscopic imaging.
It can be understood that the imaging process refers to a process of performing image enhancement by combining an image processing technology and an analysis tool, and changing the enhanced image into corresponding image information, where the image processing technology can be classified into gray-scale image processing and color image processing from an image format, and common image processing and analysis tools include: histogram tools, filtering operations, morphological operations, contour advances, geometric transformations, color space transformations, etc., from an output relationship perspective, the basic image preprocessing algorithm is divided into: after obtaining image frames of different test surfaces of near-eye display equipment, the point transformation algorithm and the field operation algorithm process and analyze the image frames of the different test surfaces through a processing and analyzing tool in a preset image processing system to obtain image information of the different test surfaces.
And an output module 30, configured to output a failure determination result of the near-eye display device according to the image information.
It should be understood that the outputting the poor judgment result of the near-eye display device includes: and if the near-eye display device is bad, the bad information such as the type, the position and the size of the bad information is bad. For example, the poor near-to-eye display is caused by dirt, namely, point A, point B and point C, and the specific positions and sizes of the point A, the point B and the point C. For example, if the poor image frame of the near-eye display device is the front side, the back side and the screen surface of the first lens, the point a and the point B are on the front side, and the point C is on the screen surface, the back side has no dirty stain, and then the specific poor position of the near-eye display device can be clarified.
It is understood that, for example, the output results show 0 and 1, the output result and the test surface relation mapping table obtain 0 to represent the front surface, 1 to represent the back surface, and 2 to represent the screen surface, so that the dirt is known on the front surface and the back surface, and thus, the bad position of the near-eye display device can be obtained, and thus, the bad position detection of the near-eye display device is realized.
According to the defect detection device of the near-eye display equipment, the image pictures of different test surfaces of the near-eye display equipment are obtained, and the different test surfaces comprise the imaging surface and the surfaces of each lens of the near-eye display equipment; processing the image frames of the different test surfaces to obtain image information of the different test surfaces; and outputting a poor judgment result of the near-eye display device according to the image information. According to the invention, different test pictures of the near-eye display equipment are obtained, the different test pictures are processed, corresponding image information is obtained, and the poor judgment result is output according to the image information, so that the poor detection efficiency and accuracy of the near-eye display equipment can be effectively improved.
It should be appreciated that the acquisition module 10 may be a camera device, such as a wide angle high definition camera. Before the acquiring module 10 acquires the image frames of different test surfaces of the near-eye display device, focusing processing needs to be performed on the different test surfaces of the photo-camera device and the near-eye display device. Focusing refers to the process of changing the position between the object distance and the distance to achieve clear imaging of the photographed object. The focusing process can adjust the photographing device and the near-eye display device in four ways, see fig. 4-6.
Referring to fig. 4, fig. 4 is a first schematic view showing that the defect detecting means of the near-eye display device of the present invention implements the focusing process, and fig. 4 shows that the focusing process is implemented by adjusting the photographing device. Specifically, there are two acquisition modes, specifically:
when the number of the photographing devices is 1 and focusing is realized by adjusting the photographing devices, if a focusing mode is adopted, when focusing treatment is carried out on different test surfaces displayed by the photographing devices and the near-to-eye display device, the focal length of a lens of the photographing devices can be kept unchanged, the distance between the lens and the different test surfaces is adjusted, the image picture of the test surface obtained by the photographing devices is obtained and processed in real time in the adjusting process, and if the image picture reaches a preset clear picture, the adjustment of the distance between the lens and the test surface is stopped, so that focusing is realized, and the image picture of the different test surfaces is obtained. If the zooming mode is adopted, when the focusing processing is performed on different test surfaces displayed by the photographing device and the near-eye display device, the target focal length and the current focal length of the photographing device can be obtained, and the current focal length of the photographing device is adjusted to the target focal length, so that the focusing processing of the different test surfaces of the photographing device and the near-eye display device is realized.
Referring to fig. 5, fig. 5 is a second schematic view showing that the defect detecting means of the near-eye display device of the present invention implements the focusing process, and fig. 5 shows that the focusing process is implemented by adjusting the diopter of the near-eye display device. The specific method is as follows: when the number of the photographing devices is 1 and focusing is realized by adjusting the near-eye display devices, the focal length of the lens of the photographing devices can be kept unchanged, the target diopter of the near-eye display devices is obtained, and the current diopter of the near-eye display devices is adjusted to the target diopter, so that the purpose of realizing focusing treatment of different test surfaces of the photographing devices and the near-eye display devices is achieved. The target diopter can be issued by a preset information adjustment instruction.
Referring to fig. 6, fig. 6 is a third schematic view showing that the defect detecting means of the near-eye display device of the present invention implements the focusing process, and fig. 6 shows that the focusing process is implemented by adjusting the position of the near-eye display device. The specific method is as follows: when the number of the photographing devices is the same as the number of the test surfaces of the near-eye display device and focusing is realized by adjusting the positions of the near-eye display device, the target positions of the near-eye display device can be acquired; and moving the near-eye display device to the target position through the sliding rail, so that the photographing device can focus one test surface of the near-eye display device respectively, and further, image pictures of different test surfaces are obtained.
In this embodiment, the camera device and the near-eye display device are subjected to focusing treatment on different test surfaces, so that the camera device can obtain clear image frames of the near-eye display device on different test surfaces, and the poor detection efficiency and accuracy of the near-eye display device can be effectively improved.
It should be noted that the above-described working procedure is merely illustrative, and does not limit the scope of the present invention, and in practical application, a person skilled in the art may select part or all of them according to actual needs to achieve the purpose of the embodiment, which is not limited herein.
In addition, technical details not described in detail in the present embodiment may refer to the method for detecting the defect of the near-eye display device provided in any embodiment of the present invention, which is not described herein again.
In an embodiment, the output module 30 is further configured to determine whether the near-eye display device is defective, and when the near-eye display device is defective, the type, position, and size of the defective information are different.
Other embodiments of the defect detection device or the implementation method of the near-eye display device of the present invention can refer to the above method embodiments, and are not repeated here.
Furthermore, it should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. Read Only Memory)/RAM, magnetic disk, optical disk) and including several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (7)
1. A method for detecting a defect of a near-eye display device, the method comprising the steps of:
acquiring image pictures of different test surfaces of near-eye display equipment, wherein the different test surfaces comprise imaging surfaces and lens surfaces of the near-eye display equipment;
processing the image frames of the different test surfaces, and processing and analyzing the image frames of the different test surfaces through a processing and analyzing tool in a preset image processing system to obtain image information of the different test surfaces;
outputting a poor judgment result of the near-eye display device according to the image information, wherein the poor judgment result comprises poor information of the type, the position and the size of the poor when the near-eye display device is poor, and the poor information comprises that the near-eye display device is faulty or dirty, hair, a lens dead point, a black point and a black line exist, and a near-eye display screen cannot be seen due to the occurrence of cracks or dirty;
before the step of obtaining the image frames of different test surfaces of the near-eye display device, the method further comprises the following steps: focusing different test surfaces of the photographic device and the near-eye display device, wherein the focusing the different test surfaces of the photographic device and the near-eye display device comprises the following steps: when the number of the photographing devices is 1 and focusing is achieved by adjusting the near-eye display devices, keeping the focal length of the photographing device lens unchanged, acquiring the target diopter of the near-eye display devices, adjusting the current diopter of the near-eye display devices to the target diopter, and issuing the target diopter through a preset information adjusting instruction.
2. The method for detecting defects in a near-eye display device according to claim 1, wherein the number of photographic devices is 1, and the step of focusing the photographic devices on different test surfaces of the near-eye display device specifically comprises:
acquiring a target focal length and a current focal length of the photographic equipment;
and adjusting the current focal length of the photographic equipment to the target focal length.
3. The method for detecting defects in a near-eye display device according to claim 1, wherein the number of photographic devices is 1, and the step of focusing the photographic devices on different test surfaces of the near-eye display device specifically comprises:
keeping the focal length of the camera lens unchanged, and adjusting the distance between the lens and the different test surfaces;
processing the image picture of the test surface acquired by the photographic equipment in real time;
and stopping adjusting the distance between the lens and the test surface to realize focusing if the image frame reaches the preset definition.
4. The method for detecting defects in a near-eye display device according to claim 1, wherein the number of photographic devices is equal to the number of test surfaces of the near-eye display device, and the step of focusing the photographic devices on different test surfaces of the near-eye display device specifically comprises:
acquiring a target position of the near-eye display device;
and moving the near-eye display device to the target position through a sliding rail so that the photographing device can focus one test surface of the near-eye display device respectively.
5. A defect detecting device for a near-eye display apparatus, comprising:
the acquisition module is used for acquiring image pictures of different test surfaces of the near-eye display device, wherein the different test surfaces comprise imaging surfaces and lens surfaces of the near-eye display device;
the imaging processing module is used for processing the image frames of the different test surfaces, and processing and analyzing the image frames of the different test surfaces through a processing and analyzing tool in a preset image processing system to obtain image information of the different test surfaces;
the output module is used for outputting a poor judgment result of the near-eye display device according to the image information, wherein the poor judgment result comprises poor information of the type, the position and the size of the poor when the near-eye display device is poor, and the poor information comprises that the near-eye display device is faulty or dirty, hair, a lens dead point, black points and black lines exist, and a near-eye display screen cannot be seen due to cracks or dirty;
the acquisition module is further configured to perform focusing processing on different test surfaces of the photographing device and the near-eye display device, and perform focusing processing on different test surfaces of the photographing device and the near-eye display device, where the acquisition module includes: when the number of the photographing devices is 1 and focusing is achieved by adjusting the near-eye display devices, keeping the focal length of the photographing device lens unchanged, acquiring the target diopter of the near-eye display devices, adjusting the current diopter of the near-eye display devices to the target diopter, and issuing the target diopter through a preset information adjusting instruction.
6. A defect detection device of a near-eye display device, characterized in that the defect detection device of the near-eye display device comprises: a memory, a processor, and a malfunction detection program of a near-eye display device stored on the memory and executable on the processor, the malfunction detection program of the near-eye display device being configured with steps to implement the malfunction detection method of the near-eye display device according to any one of claims 1 to 4.
7. A storage medium having stored thereon a defect detection program of a near-eye display device, which when executed by a processor, implements the steps of the defect detection method of a near-eye display device according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011645405.2A CN112595496B (en) | 2020-12-31 | 2020-12-31 | Method, device, equipment and storage medium for detecting faults of near-eye display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011645405.2A CN112595496B (en) | 2020-12-31 | 2020-12-31 | Method, device, equipment and storage medium for detecting faults of near-eye display equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112595496A CN112595496A (en) | 2021-04-02 |
| CN112595496B true CN112595496B (en) | 2023-04-21 |
Family
ID=75206793
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011645405.2A Active CN112595496B (en) | 2020-12-31 | 2020-12-31 | Method, device, equipment and storage medium for detecting faults of near-eye display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112595496B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113834637A (en) * | 2021-08-30 | 2021-12-24 | 歌尔光学科技有限公司 | Optical performance test system and method of optical module |
| CN115183989B (en) * | 2022-09-13 | 2023-01-10 | 武汉精立电子技术有限公司 | Near-to-eye display module detection method and detection system |
| CN115855454A (en) * | 2023-02-10 | 2023-03-28 | 武汉加特林光学仪器有限公司 | Detection device and method for near-to-eye display products adaptive to different diopters |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106526867A (en) * | 2017-01-22 | 2017-03-22 | 网易（杭州）网络有限公司 | Image picture display control method, image picture display control device and head wearing type display equipment |
| CN206301085U (en) * | 2016-12-30 | 2017-07-04 | 北京七鑫易维信息技术有限公司 | A kind of head-mounted display apparatus and portable set |
| TW201800804A (en) * | 2016-06-15 | 2018-01-01 | 威亞視覺科技股份有限公司 | Head-mounted personal multimedia systems and visual assistance devices thereof |
| CN109597210A (en) * | 2017-09-20 | 2019-04-09 | 天马日本株式会社 | Display device |
| CN110325895A (en) * | 2017-02-21 | 2019-10-11 | 脸谱科技有限责任公司 | It focuses and adjusts more plane head-mounted displays |
| CN111856749A (en) * | 2019-04-28 | 2020-10-30 | 云谷（固安）科技有限公司 | Display device and method |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102590221A (en) * | 2012-02-24 | 2012-07-18 | 深圳大学 | Apparent defect detecting system and detecting method of polarizer |
| CN104914575B (en) * | 2014-09-29 | 2017-11-14 | 北京蚁视科技有限公司 | Microlens array formula near-to-eye with diopter detection means |
| TWI697692B (en) * | 2017-08-01 | 2020-07-01 | 緯創資通股份有限公司 | Near eye display system and operation method thereof |
| CN208285458U (en) * | 2018-06-08 | 2018-12-25 | 深圳惠牛科技有限公司 | The detection device of display module image quality |
| CN110967166B (en) * | 2018-09-28 | 2022-07-01 | 舜宇光学（浙江）研究院有限公司 | Detection method, detection device and detection system of near-eye display optical system |
| CN109584226B (en) * | 2018-11-26 | 2021-02-05 | 浙江瑞度新材料科技有限公司 | Quality inspection system and method |
| CN109752168A (en) * | 2019-01-03 | 2019-05-14 | 深圳市亿境虚拟现实技术有限公司 | A kind of optical mirror slip detection device for virtual reality device |
| CN109856157A (en) * | 2019-01-24 | 2019-06-07 | 武汉精立电子技术有限公司 | It is a kind of based on the LCD panel defect inspection method adaptively focused |
| CN109752394B (en) * | 2019-01-28 | 2021-10-29 | 凌云光技术股份有限公司 | High-precision detection method and system for defects of display screen |
| CN109919933B (en) * | 2019-03-08 | 2023-08-29 | 歌尔光学科技有限公司 | VR device, picture detection method and device thereof, and computer-readable storage medium |
| CN109870293B (en) * | 2019-03-15 | 2022-06-07 | 合肥鑫晟光电科技有限公司 | Detection method and detection device for display panel |
| CN109978864A (en) * | 2019-03-28 | 2019-07-05 | 惠科股份有限公司 | Display panel detection system, method, apparatus and storage medium |
| US10825163B1 (en) * | 2019-06-13 | 2020-11-03 | Viavi Solutions Inc. | Automatically executing a test to inspect an end face of an optical fiber when an image is in focus |
| CN110351530A (en) * | 2019-07-31 | 2019-10-18 | Tcl王牌电器(惠州)有限公司 | Polyphaser realizes method, system and the computer readable storage medium of screen detection |
| CN111524102B (en) * | 2020-04-10 | 2024-04-16 | 京东方科技集团股份有限公司 | Screen dirt detection method and device of liquid crystal display |
| CN111638227B (en) * | 2020-05-18 | 2023-11-24 | 歌尔光学科技有限公司 | VR optical module picture defect detection method and device |
-
2020
- 2020-12-31 CN CN202011645405.2A patent/CN112595496B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW201800804A (en) * | 2016-06-15 | 2018-01-01 | 威亞視覺科技股份有限公司 | Head-mounted personal multimedia systems and visual assistance devices thereof |
| CN206301085U (en) * | 2016-12-30 | 2017-07-04 | 北京七鑫易维信息技术有限公司 | A kind of head-mounted display apparatus and portable set |
| CN106526867A (en) * | 2017-01-22 | 2017-03-22 | 网易（杭州）网络有限公司 | Image picture display control method, image picture display control device and head wearing type display equipment |
| CN110325895A (en) * | 2017-02-21 | 2019-10-11 | 脸谱科技有限责任公司 | It focuses and adjusts more plane head-mounted displays |
| CN109597210A (en) * | 2017-09-20 | 2019-04-09 | 天马日本株式会社 | Display device |
| CN111856749A (en) * | 2019-04-28 | 2020-10-30 | 云谷（固安）科技有限公司 | Display device and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112595496A (en) | 2021-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112595496B (en) | Method, device, equipment and storage medium for detecting faults of near-eye display equipment | |
| US10444486B2 (en) | Systems and methods for detection of blank fields in digital microscopes | |
| JP6319329B2 (en) | Surface attribute estimation using plenoptic camera | |
| CN110967166B (en) | Detection method, detection device and detection system of near-eye display optical system | |
| TWI752905B (en) | Image processing device and image processing method | |
| CN107452031A (en) | Virtual ray tracking and light field dynamic refocusing display system | |
| CN102595178B (en) | Field stitching three dimensional rendered images corrective system and bearing calibration | |
| CN111044262A (en) | Near-to-eye display optical-mechanical module detection device | |
| JP2022533848A (en) | Systems and methods for determining if camera components are damaged | |
| CN116524022B (en) | Offset data calculation method, image fusion device and electronic equipment | |
| JP2016208438A (en) | Image processing apparatus and image processing method | |
| WO2016175045A1 (en) | Image processing device and image processing method | |
| CN107534729B (en) | Image processing apparatus, image processing method, and program | |
| CN114219758A (en) | Defect detection method, system, electronic device and computer readable storage medium | |
| CN111489384B (en) | Method, device, system and medium for evaluating shielding based on mutual viewing angle | |
| US10736504B2 (en) | Method for determining the pupil diameter of an eye with high accuracy, and corresponding apparatus | |
| US20220398803A1 (en) | Method for forming an image of an object, computer program product and image forming system for carrying out the method | |
| CN211696890U (en) | Near-to-eye display optical-mechanical module detection device | |
| CN109671075A (en) | Defect inspection method, device, equipment and storage medium | |
| KR102491420B1 (en) | Vision inspection method for vision inspection using dynamic plate based on artificial intelligence learning | |
| CN112730449B (en) | Microscopic three-dimensional detection optical method for auto-focusing liquid crystal module | |
| CN116642670B (en) | Optical imaging method and device for micro display detection | |
| JP2005216191A (en) | Stereo image processing apparatus and method | |
| US20220412727A1 (en) | Shape reconstruction method and image measurement device | |
| WO2021212342A1 (en) | Image processing method, camera device, movable platform and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |