CN112595496A - Method, device and equipment for detecting defects of near-eye display equipment and storage medium - Google Patents

Method, device and equipment for detecting defects of near-eye display equipment and storage medium Download PDF

Info

Publication number
CN112595496A
CN112595496A CN202011645405.2A CN202011645405A CN112595496A CN 112595496 A CN112595496 A CN 112595496A CN 202011645405 A CN202011645405 A CN 202011645405A CN 112595496 A CN112595496 A CN 112595496A
Authority
CN
China
Prior art keywords
eye display
display device
different test
test surfaces
equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011645405.2A
Other languages
Chinese (zh)
Other versions
CN112595496B (en
Inventor
李潇
朱建雄
张韦韪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Huynew Technology Co ltd
Original Assignee
Shenzhen Huynew Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Huynew Technology Co ltd filed Critical Shenzhen Huynew Technology Co ltd
Priority to CN202011645405.2A priority Critical patent/CN112595496B/en
Publication of CN112595496A publication Critical patent/CN112595496A/en
Application granted granted Critical
Publication of CN112595496B publication Critical patent/CN112595496B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M11/00Testing of optical apparatus; Testing structures by optical methods not otherwise provided for
    • G01M11/02Testing optical properties
    • G01M11/0242Testing optical properties by measuring geometrical properties or aberrations
    • G01M11/0257Testing optical properties by measuring geometrical properties or aberrations by analyzing the image formed by the object to be tested

Abstract

The invention relates to the technical field of near-eye display, and discloses a method, a device, equipment and a storage medium for detecting defects of near-eye display equipment, wherein the method comprises the following steps: acquiring image pictures of different test surfaces of near-eye display equipment, wherein the different test surfaces comprise an imaging surface and each lens surface of the near-eye display equipment; processing the image pictures of the different test surfaces to obtain the image information of the different test surfaces; and outputting a poor judgment result of the near-eye display equipment according to the image information. According to the method and the device, different test pictures of the near-eye display device are obtained and processed to obtain corresponding image information, and the defect judgment result is output according to the image information.

Description

Method, device and equipment for detecting defects of near-eye display equipment and storage medium
Technical Field
The present invention relates to the field of near-eye display technologies, and in particular, to a method, an apparatus, a device, and a storage medium for detecting a defect of a near-eye display device.
Background
The near-eye display industry is developing at a high speed, the goods output of various equipment including virtual reality and augmented reality is continuously rising, however, the detection mode of the near-eye display industry has many defects, for example, the poor detection result is inaccurate, the poor detection of the traditional flat panel display is only one test surface, and a user only needs to care whether the display surface has a poor phenomenon. However, for the near-eye display industry, the essence is three-dimensional display, and compared with flat panel display detection, one detection dimension is increased, that is, a plurality of test surfaces need to be detected, so that the detection difficulty is increased. Currently, when detecting whether the near-eye display device is bad, the adopted detection method is to perform detection manually, but the manual detection mode often only can detect whether the imaging surface of the near-eye display device is bad. But poor other test surfaces (such as other lens surfaces) of the near-eye display device can also greatly affect the user experience; at present, manual detection on multiple test surfaces does not have a good mode, and the near-to-eye display detection efficiency is low and the error is large.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide a method, a device, equipment and a storage medium for detecting defects of near-eye display equipment, and aims to solve the technical problem that the defect detection efficiency and accuracy of the near-eye display equipment cannot be effectively improved.
In order to achieve the above object, the present invention provides a method for detecting a defect of a near-eye display device, including the steps of:
acquiring image pictures of different test surfaces of near-eye display equipment, wherein the different test surfaces comprise an imaging surface and each lens surface of the near-eye display equipment;
processing the image pictures of the different test surfaces to obtain the image information of the different test surfaces;
and outputting a poor judgment result of the near-eye display equipment according to the image information.
Optionally, before the step of acquiring image frames of different test surfaces of the near-eye display device, the method further includes:
and carrying out focusing treatment on different test surfaces of the contrast equipment and the near-eye display equipment.
Optionally, the number of the camera devices is 1, and the step of performing focusing processing on different test surfaces of the camera device and the near-eye display device specifically includes:
acquiring a target focal length and a current focal length of the photographic equipment;
adjusting a current focal length of the camera device to the target focal length.
Optionally, the number of the camera devices is 1, and the step of performing focusing processing on different test surfaces of the camera device and the near-eye display device specifically includes:
keeping the focal length of the lens of the photographic equipment unchanged, and adjusting the distance between the lens and the different test surfaces;
processing the image picture of the test surface acquired by the photographic equipment in real time;
and if the image picture reaches the preset definition, stopping adjusting the distance between the lens and the test surface to realize focusing.
Optionally, the number of the camera devices is 1, and the step of performing focusing processing on different test surfaces of the camera device and the near-eye display device specifically includes:
keeping the focal length of the lens of the photographic equipment unchanged, and acquiring the target diopter of the near-to-eye display equipment;
adjusting a current diopter of the near-eye display device to the target diopter.
Optionally, the number of the photographing devices is the same as the number of the test surfaces of the near-eye display device, and the step of performing focusing processing on different test surfaces of the photographing device and the near-eye display device specifically includes:
acquiring a target position of the near-eye display device;
and moving the near-eye display device to the target position through a sliding rail, so that the camera device can focus on one test surface of the near-eye display device respectively.
Optionally, the step of outputting the poor judgment result of the near-eye display device specifically includes:
whether near-eye display device is bad or not, and when the near-eye display device is bad, the type, position and size of the bad information.
Further, in order to achieve the above object, the present invention also proposes a defect detection apparatus for a near-eye display device, comprising:
the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring image pictures of different test surfaces of the near-eye display equipment, and the different test surfaces comprise an imaging surface and each lens surface of the near-eye display equipment;
the imaging processing module is used for processing the image pictures of the different test surfaces to obtain the image information of the different test surfaces;
and the output module is used for outputting the poor judgment result of the near-eye display equipment according to the image information.
Further, to achieve the above object, the present invention also proposes a malfunction detection apparatus of a near-eye display apparatus, comprising: a memory, a processor and a defect detection program for a near-eye display device stored on the memory and executable on the processor, the defect detection program for a near-eye display device being configured to implement the steps of the defect detection method for a near-eye display device as described above.
Further, in order to achieve the above object, the present invention also proposes a storage medium having stored thereon a defect detection program for a near-eye display apparatus, which when executed by a processor, realizes the steps of the defect detection method for a near-eye display apparatus as described above.
The invention provides a method for detecting the defect of near-eye display equipment, which comprises the steps of obtaining image pictures of different test surfaces of the near-eye display equipment, wherein the different test surfaces comprise an imaging surface of the near-eye display equipment and surfaces of all lenses; processing the image pictures of the different test surfaces to obtain the image information of the different test surfaces; and outputting a poor judgment result of the near-eye display equipment according to the image information. According to the invention, different test pictures of the near-eye display device are obtained and processed to obtain corresponding image information, and the defect judgment result is output according to the image information, so that the defect detection efficiency and accuracy of the near-eye display device can be effectively improved.
Drawings
Fig. 1 is a schematic structural diagram of a defect detection device of a near-eye display device in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for detecting defects of a near-eye display device according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for detecting defects of a near-eye display device according to a second embodiment of the present invention;
FIG. 4 is a first schematic diagram of a defect detection apparatus of a near-eye display device according to the present invention for performing a focusing process;
FIG. 5 is a second schematic diagram illustrating a focusing process performed by the defect detection apparatus of the near-eye display device according to the present invention;
FIG. 6 is a third schematic diagram illustrating a focusing operation performed by the defect detection apparatus of the near-eye display device according to the present invention;
fig. 7 is a functional block diagram of a defect detection apparatus of a near-eye display device according to a first embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a defect detection device of a near-eye display device in a hardware operating environment according to an embodiment of the present invention.
As shown in fig. 1, the defect detection apparatus of the near-eye display apparatus may include: a processor 1001, such as a Central Processing Unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a WIreless interface (e.g., a WIreless-FIdelity (WI-FI) interface). The Memory 1005 may be a Random Access Memory (RAM) Memory, or may be a Non-Volatile Memory (NVM), such as a disk Memory. The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the configuration shown in fig. 1 does not constitute a limitation of a near-eye display device failure detection device, and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a storage medium, may include therein a failure detection program of an operating system, a network communication module, a user interface module, and a near-eye display device.
In the defect detection device of the near-eye display device shown in fig. 1, the network interface 1004 is mainly used for data communication with a network server; the user interface 1003 is mainly used for data interaction with a user; the processor 1001 and the memory 1005 in the defect detection apparatus of the near-eye display apparatus of the present invention may be provided in the defect detection apparatus of the near-eye display apparatus, and the defect detection apparatus of the near-eye display apparatus calls the defect detection program of the near-eye display apparatus stored in the memory 1005 through the processor 1001 and executes the defect detection method of the near-eye display apparatus provided by the embodiment of the present invention.
Based on the hardware structure, the embodiment of the method for detecting the defect of the near-eye display device is provided.
Referring to fig. 2, fig. 2 is a flowchart illustrating a method for detecting a defect of a near-eye display device according to a first embodiment of the present invention.
In a first embodiment, the method for detecting a defect of a near-eye display device includes the steps of:
step S10, acquiring image frames of different test surfaces of the near-eye display device, where the different test surfaces include an imaging surface, respective lens surfaces, and a display screen of the near-eye display device.
It should be noted that the execution subject of the present embodiment may be a defect detection device of the near-eye display device, and may also be other devices that can implement the same or similar functions.
It should be understood that different test faces of a near-eye display device refer to a plurality of different faces to be tested in the near-eye display device, which may include, for example, an imaging face, respective lens surfaces, and a display screen of the near-eye display device. In this step, different test surfaces can be photographed by the camera device to obtain image frames corresponding to the different test surfaces, and the purpose of this step is as follows: and carrying out image processing through the image pictures corresponding to different test surfaces to judge whether a poor test surface exists.
It can be understood that there are many reasons causing the defect of the test surface of the near-eye display device, for example, the near-eye display device fails or has dirt, hair, lens defect, black dot, black line, etc., and may also be caused by reasons of the near-eye display screen, for example, a crack or dirt occurs to cause the near-eye display screen to be invisible, so when the near-eye display defect occurs, all the reasons causing the defect of the near-eye display device need to be checked one by one, the checking mode is to obtain the defective image picture of the near-eye display device first, and then each image picture is separately detected.
It should be understood that the near-eye display device may be a VR device, an AR device, a HUD device, an MR device, or the like.
And step S20, processing the image pictures of the different test surfaces to obtain the image information of the different test surfaces.
It should be understood that the processing of the image frames of the different test surfaces refers to the imaging processing of the image frames of the different test surfaces by a preset image processing system, the preset image processing system refers to a system for pixelizing images, the preset image processing system determines a specific implementation according to the technical field of use, such as in the medical technical field, the preset image processing system is mainly computer tomography, in the military technical field, the preset image processing system is mainly used for simulating three-dimensional geography and topographic map, and the preset image processing includes: modern image processing and graphic processing, both of which are based on raster-scanned pixels, can realize two types of processing in the same system, and can perform stereo imaging by combining the two types of processing.
It is understood that the image processing refers to a process of enhancing an image by combining an image processing technology and an analysis tool, and converting the enhanced image into corresponding image information, the image processing technology can be divided into a gray image processing and a color image processing from an image format, and the common image processing and analysis tool includes: histogram tool, filtering operation, morphological operation, contour advance, geometric transformation, color space transformation, and the like, from the perspective of output relationship, the basic image preprocessing algorithm is divided into: and after the image pictures of different testing surfaces of the near-eye display equipment are obtained, processing and analyzing the image pictures of the different testing surfaces by a processing and analyzing tool in a preset image processing system to obtain the image information of the different testing surfaces.
Step S30, outputting a failure determination result of the near-eye display device based on the image information.
It is to be understood that the outputting of the poor determination result of the near-eye display device includes: whether the near-eye display device is defective or not, and when the near-eye display device is defective, defective information such as the type, position, size, and the like of the defective information. For example, the reason for the occurrence of the near-eye display failure is contamination, i.e., a point a, a point B, and a point C, and the specific positions and sizes of the point a, the point B, and the point C. For example, if the poor image frames of the near-eye display device are respectively the front surface, the back surface and the screen surface of the first lens, the points a and B are on the front surface, and the point C is on the screen surface, the back surface has no dirty spots, and then the specific location of the poor image of the near-eye display device can be determined.
It can be understood that, for example, the output result shows 0 and 1, and according to the output result and the test surface relational mapping table, 0 is obtained to represent the front surface, 1 represents the back surface, and 2 represents the screen surface, so that it is known that the dirt is on the front surface and the back surface, and therefore, the defective position of the near-eye display device can be obtained, thereby realizing the defective position detection of the near-eye display device.
In the embodiment, image frames of different test surfaces of a near-eye display device are obtained, wherein the different test surfaces comprise an imaging surface and each lens surface of the near-eye display device; processing the image pictures of the different test surfaces to obtain the image information of the different test surfaces; and outputting a poor judgment result of the near-eye display equipment according to the image information. According to the invention, different test pictures of the near-eye display device are obtained and processed to obtain corresponding image information, and the defect judgment result is output according to the image information, so that the defect detection efficiency and accuracy of the near-eye display device can be effectively improved.
In an embodiment, as shown in fig. 3, a second embodiment of the method for detecting defects of a near-eye display device according to the present invention is proposed based on the first embodiment, where before the step S10, the method further includes:
and step S01, carrying out focusing processing on different test surfaces of the contrast equipment and the near-eye display equipment.
It can be understood that the focusing process refers to a process of changing the object distance and the position between the object distances to achieve imaging clarity of the shot object. The focusing process may adjust the camera device as well as the near-eye display device in four ways, which will be described in detail later. The camera device may preferably be a wide-angle high-definition camera.
When the camera device is adjusted, focusing or zooming can be realized. The focusing methods are classified into auto focusing, manual focusing, and multiple focusing methods. The automatic focusing mode is a visual range finding mode, a camera emits infrared rays or other rays, the distance of a shot object is determined according to the reflection of the shot object, then the lens combination is adjusted according to the measured result, and the automatic focusing is realized, wherein the automatic focusing mode is direct, high in speed, easy to realize and low in cost, but sometimes errors occur (for example, when other objects such as glass exist between the camera and the shot object, the automatic focusing cannot be realized, or under the condition of insufficient light), the precision is poor; the manual focusing mode is a focusing mode which adjusts a camera lens by manually rotating a focusing ring so as to make a shot picture clear, and the mode depends on the discrimination of human eyes on an image on a focusing screen, the proficiency of a photographer and even the eyesight of the photographer to a great extent; the multiple focusing method is to use multi-point focusing or multiple focusing when the focusing center is not set in the center of the picture. Besides the position of the focusing point, the focusing range can be set, so that the shot object can be imaged clearly.
In the first way, when the number of the camera devices is 1 and focusing is achieved by adjusting the camera devices, if a zoom method is adopted, when focusing processing is performed on different test surfaces displayed by the camera devices and the near-eye display devices, a target focal length and a current focal length of the camera devices may be acquired, and the current focal length of the camera devices may be adjusted to the target focal length, so as to achieve focusing processing on different test surfaces of the camera devices and the near-eye display devices, as shown in fig. 4.
It is understood that the focal length refers to a measure of the concentration or divergence of light in an optical system, and refers to the distance from the optical center of a lens to the focal point of the light concentration when parallel light is incident, and an optical system with a short focal length has better capability of collecting light than an optical system with a long focal length, and simply the focal length is the distance from the focal point to the central point of a mirror, and imaging can be performed in a camera when the condition is satisfied, and the condition is that the focal length is < image distance < double focal length. The focusing controls the process of converging a beam of light or particle flow to a point as much as possible, in this embodiment, obtaining image frames of different test surfaces of the near-eye display device.
It should be understood that the adjusting of the current focal length of the camera device may be performed by obtaining a preset information adjusting instruction, obtaining an information adjusting operation according to the preset information adjusting instruction, adjusting the current focal length of the camera device through the information adjusting operation, first obtaining focal length information of a lens before the adjusting, and continuously focusing the lens of the camera device to a target focal length through the information adjusting operation. The preset information adjusting instruction refers to an instruction for adjusting a state of a running device, where the instruction refers to a command for executing a certain operation, and in this embodiment, the certain operation is a command for obtaining an information adjusting operation, the instruction is composed of a string of binary codes, each instruction is generally composed of two parts, namely an operation code and an address code, the operation code is used for indicating a type or a property of an operation to be performed by the instruction, such as a number fetch, an addition, or output data, and the address code is used for indicating a content of an operation object or an address of a memory cell where the operation object is located.
In a second manner, when the number of the photographing devices is 1 and focusing is achieved by adjusting the photographing devices, if a focusing manner is adopted, when focusing processing is performed on different test surfaces displayed by the photographing devices and the near-eye display devices, the focal length of a lens of the photographing device can be kept unchanged, the distance between the lens and the different test surfaces is adjusted, an image picture of the test surface acquired by the photographing devices is acquired and processed in real time in the adjusting process, and if the image picture reaches a preset clear image, the adjustment of the distance between the lens and the test surface is stopped to achieve focusing, so that the purpose of achieving the focusing processing of the different test surfaces of the photographing devices and the near-eye display devices is achieved, see fig. 4.
In a third mode, when the number of the photographic devices is 1 and focusing is realized by adjusting the near-eye display device, the focal length of the lens of the photographic device can be kept unchanged, the target diopter of the near-eye display device is acquired, and the current diopter of the near-eye display device is adjusted to the target diopter, so that the purpose of realizing focusing processing of different test surfaces of the photographic device and the near-eye display device is achieved. The target diopter can be issued through a preset information adjusting instruction, see fig. 5.
It should be understood that diopter refers to the unit of the magnitude of the refractive power, and is expressed by D, that is, parallel light rays pass through the refractive material, the refractive power of the refractive material is 1 diopter or 1D when the focal point is 1m, and the unit of the lens power is taken as an example of a lens, for example, when the focal length of a lens is 1m, the refractive power of the lens is 1D diopter and the focal length or the reaction is obtained.
In a fourth mode, when the number of the photographing devices is the same as that of the test surfaces of the near-eye display device and focusing processing is realized by adjusting the position of the near-eye display device, the target position of the near-eye display device can be acquired; the near-eye display device is moved to the target position through the slide rail, so that the photographing device can focus on one test surface of the near-eye display device respectively, and the purpose of focusing processing of different test surfaces of the photographing device and the near-eye display device is achieved, and the purpose is shown in fig. 6.
It should be understood that, the moving of the near-eye display device to the target position by the slide rail may be performed by obtaining a multi-camera moving operation adjustment instruction, and moving the near-eye display device to the target position by the slide rail according to the adjustment instruction, so that the cameras may focus on one test surface of the near-eye display device, for example, when the current position of the near-eye display device is 3mm away from the camera device, a test surface cannot be obtained, and moving to 1mm away from the camera device by the moving operation may just enable one of the cameras to focus on one test surface of the near-eye display device. The multi-camera moving operation adjustment instruction refers to a system strategy composed of a preset number of cameras, light sources and storage devices, the number of the cameras is different according to different requirements, for example, the number of the cameras is 6 in the case of a requirement a, the number of the cameras is 8 in the case of a requirement B, and different array construction modes such as a dual camera, an 8-camera parallel array, a 32-camera annular array and a 64-camera spherical array can be selected according to different application of the multi-camera strategy.
It is understood that, whether the near-eye display device is defective or not, and when the near-eye display device is defective, the type, position and size of the defective information, for example, the defect of the near-eye display device may be caused by a black line in the near-eye display device, the length of the inner wall black line is 0.01mm, the type is a line type, and the position is inside the near-eye display device.
It should be understood that, after the detection is finished, if it is determined that the near-eye display defect is not caused by dirt according to the detection result, the current display information of the test surface of the near-eye display screen is captured, the current display information is detected, whether the near-eye display screen is damaged or not is determined, for example, whether a near-eye display screen is a black dot or a crack is detected, and if the near-eye display screen is damaged or not, the defect position information of the near-eye display device is determined to be a screen.
Furthermore, an embodiment of the present invention also provides a storage medium having a defect detection program for a near-eye display device stored thereon, where the defect detection program for the near-eye display device, when executed by a processor, implements the steps of the defect detection method for the near-eye display device as described above.
Since the storage medium adopts all technical solutions of all the embodiments, at least all the beneficial effects brought by the technical solutions of the embodiments are achieved, and no further description is given here.
In addition, referring to fig. 7, an embodiment of the present invention further provides a defect detection apparatus for a near-eye display device, where the defect detection apparatus for a near-eye display device includes:
the acquiring module 10 is configured to acquire image frames of different test surfaces of the near-eye display device, where the different test surfaces include an imaging surface and each lens surface of the near-eye display device.
It should be understood that different test faces of a near-eye display device refer to a plurality of different faces to be tested in the near-eye display device, which may include, for example, an imaging face, respective lens surfaces, and a display screen of the near-eye display device. In this step, different test surfaces can be photographed by the camera device to obtain image frames corresponding to the different test surfaces, and the purpose of this step is as follows: and carrying out image processing through the image pictures corresponding to different test surfaces to judge whether a poor test surface exists.
It can be understood that there are many reasons causing the defect of the test surface of the near-eye display device, for example, the near-eye display device fails or has dirt, hair, lens defect, black dot, black line, etc., and may also be caused by reasons of the near-eye display screen, for example, a crack or dirt occurs to cause the near-eye display screen to be invisible, so when the near-eye display defect occurs, all the reasons causing the defect of the near-eye display device need to be checked one by one, the checking mode is to obtain the defective image picture of the near-eye display device first, and then each image picture is separately detected.
It should be understood that the near-eye display device may be a VR device, an AR device, a HUD device, an MR device, or the like.
And the imaging processing module 20 is configured to process the image frames of the different test surfaces to obtain image information of the different test surfaces.
It should be understood that the processing of the image frames of the different test surfaces refers to the imaging processing of the image frames of the different test surfaces by a preset image processing system, the preset image processing system refers to a system for pixelizing images, the preset image processing system determines a specific implementation according to the technical field of use, such as in the medical technical field, the preset image processing system is mainly computer tomography, in the military technical field, the preset image processing system is mainly used for simulating three-dimensional geography and topographic map, and the preset image processing includes: modern image processing and graphic processing, both of which are based on raster-scanned pixels, can realize two types of processing in the same system, and can perform stereo imaging by combining the two types of processing.
It is understood that the image processing refers to a process of enhancing an image by combining an image processing technology and an analysis tool, and converting the enhanced image into corresponding image information, the image processing technology can be divided into a gray image processing and a color image processing from an image format, and the common image processing and analysis tool includes: histogram tool, filtering operation, morphological operation, contour advance, geometric transformation, color space transformation, and the like, from the perspective of output relationship, the basic image preprocessing algorithm is divided into: and after the image pictures of different testing surfaces of the near-eye display equipment are obtained, processing and analyzing the image pictures of the different testing surfaces by a processing and analyzing tool in a preset image processing system to obtain the image information of the different testing surfaces.
And an output module 30, configured to output a poor determination result of the near-eye display device according to the image information.
It is to be understood that the outputting of the poor determination result of the near-eye display device includes: whether the near-eye display device is defective or not, and when the near-eye display device is defective, defective information such as the type, position, size, and the like of the defective information. For example, the reason for the occurrence of the near-eye display failure is contamination, i.e., a point a, a point B, and a point C, and the specific positions and sizes of the point a, the point B, and the point C. For example, if the poor image frames of the near-eye display device are respectively the front surface, the back surface and the screen surface of the first lens, the points a and B are on the front surface, and the point C is on the screen surface, the back surface has no dirty spots, and then the specific location of the poor image of the near-eye display device can be determined.
It can be understood that, for example, the output result shows 0 and 1, and according to the output result and the test surface relational mapping table, 0 is obtained to represent the front surface, 1 represents the back surface, and 2 represents the screen surface, so that it is known that the dirt is on the front surface and the back surface, and therefore, the defective position of the near-eye display device can be obtained, thereby realizing the defective position detection of the near-eye display device.
According to the defect detection device of the near-eye display equipment, the image pictures of different test surfaces of the near-eye display equipment are obtained, wherein the different test surfaces comprise the imaging surface of the near-eye display equipment and the surfaces of all lenses; processing the image pictures of the different test surfaces to obtain the image information of the different test surfaces; and outputting a poor judgment result of the near-eye display equipment according to the image information. According to the invention, different test pictures of the near-eye display device are obtained and processed to obtain corresponding image information, and the defect judgment result is output according to the image information, so that the defect detection efficiency and accuracy of the near-eye display device can be effectively improved.
It should be understood that the acquisition module 10 may be a camera device, such as a wide-angle high-definition camera. Before the obtaining module 10 obtains the image frames of the different test surfaces of the near-eye display device, it is further required to perform focusing processing on the different test surfaces of the contrast device and the near-eye display device. The focusing process refers to a process of changing the object distance and the position between the object distances so as to achieve clear imaging of the shot object. The focusing process can be performed in four ways, i.e., by adjusting the camera device and the near-eye display device, as shown in fig. 4 to 6.
Referring to fig. 4, fig. 4 is a first schematic diagram of the poor detection device of the near-eye display device of the present invention for implementing the focusing process, and fig. 4 shows the focusing process implemented by adjusting the camera device. Specifically, there are two acquisition modes, specifically:
when the number of the photographic equipment is 1 and focusing is realized by adjusting the photographic equipment, if a focusing mode is adopted, when different test surfaces displayed by the photographic equipment and the near-eye display equipment are focused, the focal length of a lens of the photographic equipment can be kept unchanged, the distance between the lens and the different test surfaces is adjusted, an image picture of the test surface acquired by the photographic equipment is acquired and processed in real time in the adjusting process, and if the image picture reaches a preset clear image, the adjustment of the distance between the lens and the test surface is stopped, so that focusing is realized, and the image pictures of the different test surfaces are acquired. If a zooming mode is adopted, when different test surfaces displayed by the photographic equipment and the near-eye display equipment are focused, the target focal length and the current focal length of the photographic equipment can be acquired, and the current focal length of the photographic equipment is adjusted to the target focal length, so that the focusing processing of the different test surfaces of the photographic equipment and the near-eye display equipment is realized.
Referring to fig. 5, fig. 5 is a second schematic diagram of the defect detection apparatus of the near-eye display device according to the present invention for performing the focusing process, and fig. 5 illustrates the focusing process performed by adjusting the diopter of the near-eye display device. The concrete mode is as follows: when the number of the photographic equipment is 1 and focusing is realized by adjusting the near-eye display equipment, the focal length of the lens of the photographic equipment can be kept unchanged, the target diopter of the near-eye display equipment is obtained, the current diopter of the near-eye display equipment is adjusted to the target diopter, and the purpose of realizing focusing processing of different test surfaces of the photographic equipment and the near-eye display equipment is achieved. The target diopter can be issued through a preset information adjusting instruction.
Referring to fig. 6, fig. 6 is a third schematic diagram of the defect detection apparatus of the near-eye display device according to the present invention for implementing the focusing process, and fig. 6 shows the implementation of the focusing process by adjusting the position of the near-eye display device. The concrete mode is as follows: when the number of the photographing devices is the same as that of the test surfaces of the near-eye display device and focusing is realized by adjusting the position of the near-eye display device, the target position of the near-eye display device can be acquired; and moving the near-eye display device to the target position through a sliding rail, so that the photographic device can focus one test surface of the near-eye display device respectively, and image pictures of different test surfaces are obtained.
In this embodiment, the different test surfaces of the camera device and the near-eye display device are focused, so that the camera device can acquire clear image frames of the different test surfaces of the near-eye display device, and the poor detection efficiency and accuracy of the near-eye display device can be effectively improved.
It should be noted that the above-described work flows are only exemplary, and do not limit the scope of the present invention, and in practical applications, a person skilled in the art may select some or all of them to achieve the purpose of the solution of the embodiment according to actual needs, and the present invention is not limited herein.
In addition, technical details that are not described in detail in this embodiment may be referred to a method for detecting a defect of a near-eye display device according to any embodiment of the present invention, and are not described herein again.
In an embodiment, the output module 30 is further configured to determine whether the near-eye display device is defective, and when the near-eye display device is defective, the type, the position, and the size of the defective information.
Other embodiments or implementations of the defect detection apparatus for a near-eye display device according to the present invention can refer to the above embodiments of the method, and are not intended to be exhaustive.
Further, it is to be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention or portions thereof that contribute to the prior art may be embodied in the form of a software product, where the computer software product is stored in a storage medium (e.g. Read Only Memory (ROM)/RAM, magnetic disk, optical disk), and includes several instructions for enabling a terminal device (e.g. a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. A method for detecting a defect of a near-eye display device, the method comprising:
acquiring image pictures of different test surfaces of near-eye display equipment, wherein the different test surfaces comprise an imaging surface and each lens surface of the near-eye display equipment;
processing the image pictures of the different test surfaces to obtain the image information of the different test surfaces;
and outputting a poor judgment result of the near-eye display equipment according to the image information.
2. The method for detecting defects of a near-eye display device according to claim 1, wherein the step of acquiring image frames of different test surfaces of the near-eye display device is preceded by the step of:
and carrying out focusing treatment on different test surfaces of the contrast equipment and the near-eye display equipment.
3. The method for detecting the defect of the near-eye display device according to claim 2, wherein the number of the camera devices is 1, and the step of performing the focusing process on the different test surfaces of the camera device and the near-eye display device specifically comprises:
acquiring a target focal length and a current focal length of the photographic equipment;
adjusting a current focal length of the camera device to the target focal length.
4. The method for detecting the defect of the near-eye display device according to claim 2, wherein the number of the camera devices is 1, and the step of performing the focusing process on the different test surfaces of the camera device and the near-eye display device specifically comprises:
keeping the focal length of the lens of the photographic equipment unchanged, and adjusting the distance between the lens and the different test surfaces;
processing the image picture of the test surface acquired by the photographic equipment in real time;
and if the image picture reaches the preset definition, stopping adjusting the distance between the lens and the test surface to realize focusing.
5. The method for detecting the defect of the near-eye display device according to claim 2, wherein the number of the camera devices is 1, and the step of performing the focusing process on the different test surfaces of the camera device and the near-eye display device specifically comprises:
keeping the focal length of the lens of the photographic equipment unchanged, and acquiring the target diopter of the near-to-eye display equipment;
adjusting a current diopter of the near-eye display device to the target diopter.
6. The method for detecting defects of a near-eye display device according to claim 2, wherein the number of the photographing devices is the same as the number of the test surfaces of the near-eye display device, and the step of performing the focusing process on the different test surfaces of the photographing device and the near-eye display device specifically comprises:
acquiring a target position of the near-eye display device;
and moving the near-eye display device to the target position through a sliding rail, so that the camera device can focus on one test surface of the near-eye display device respectively.
7. The method for detecting a defect of a near-eye display device according to any one of claims 1 to 6, wherein the step of outputting a result of the defect determination of the near-eye display device specifically includes:
whether near-eye display device is bad or not, and when the near-eye display device is bad, the type, position and size of the bad information.
8. A defect detection apparatus for a near-eye display device, comprising:
the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring image pictures of different test surfaces of the near-eye display equipment, and the different test surfaces comprise an imaging surface and each lens surface of the near-eye display equipment;
the imaging processing module is used for processing the image pictures of the different test surfaces to obtain the image information of the different test surfaces;
and the output module is used for outputting the poor judgment result of the near-eye display equipment according to the image information.
9. A malfunction detection apparatus of a near-eye display apparatus, characterized in that the malfunction detection apparatus of the near-eye display apparatus comprises: a memory, a processor, and a defect detection program for a near-eye display device stored on the memory and executable on the processor, the defect detection program for a near-eye display device being configured with steps to implement a defect detection method for a near-eye display device according to any one of claims 1 to 7.
10. A storage medium characterized in that the storage medium has stored thereon a malfunction detection program for a near-eye display apparatus, which when executed by a processor implements the steps of the malfunction detection method for a near-eye display apparatus according to any one of claims 1 to 7.
CN202011645405.2A 2020-12-31 2020-12-31 Method, device, equipment and storage medium for detecting faults of near-eye display equipment Active CN112595496B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011645405.2A CN112595496B (en) 2020-12-31 2020-12-31 Method, device, equipment and storage medium for detecting faults of near-eye display equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011645405.2A CN112595496B (en) 2020-12-31 2020-12-31 Method, device, equipment and storage medium for detecting faults of near-eye display equipment

Publications (2)

Publication Number Publication Date
CN112595496A true CN112595496A (en) 2021-04-02
CN112595496B CN112595496B (en) 2023-04-21

Family

ID=75206793

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011645405.2A Active CN112595496B (en) 2020-12-31 2020-12-31 Method, device, equipment and storage medium for detecting faults of near-eye display equipment

Country Status (1)

Country Link
CN (1) CN112595496B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113834637A (en) * 2021-08-30 2021-12-24 歌尔光学科技有限公司 Optical performance test system and method of optical module
CN115183989A (en) * 2022-09-13 2022-10-14 武汉精立电子技术有限公司 Near-to-eye display module detection method and detection system
CN115855454A (en) * 2023-02-10 2023-03-28 武汉加特林光学仪器有限公司 Detection device and method for near-to-eye display products adaptive to different diopters

Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102590221A (en) * 2012-02-24 2012-07-18 深圳大学 Apparent defect detecting system and detecting method of polarizer
CN104914575A (en) * 2014-09-29 2015-09-16 北京蚁视科技有限公司 Microlens-array-type near-eye display with diopter detection device
CN106526867A (en) * 2017-01-22 2017-03-22 网易(杭州)网络有限公司 Image picture display control method, image picture display control device and head wearing type display equipment
CN206301085U (en) * 2016-12-30 2017-07-04 北京七鑫易维信息技术有限公司 A kind of head-mounted display apparatus and portable set
TW201800804A (en) * 2016-06-15 2018-01-01 威亞視覺科技股份有限公司 Head-mounted personal multimedia systems and visual assistance devices thereof
CN208285458U (en) * 2018-06-08 2018-12-25 深圳惠牛科技有限公司 The detection device of display module image quality
US20190041643A1 (en) * 2017-08-01 2019-02-07 Wistron Corporation Near eye display system and operation method thereof
CN109584226A (en) * 2018-11-26 2019-04-05 深圳龙图腾创新设计有限公司 A kind of quality inspection system and method
CN109597210A (en) * 2017-09-20 2019-04-09 天马日本株式会社 Display device
CN109752394A (en) * 2019-01-28 2019-05-14 凌云光技术集团有限责任公司 A kind of display screen defect high-precision detecting method and system
CN109752168A (en) * 2019-01-03 2019-05-14 深圳市亿境虚拟现实技术有限公司 A kind of optical mirror slip detection device for virtual reality device
CN109856157A (en) * 2019-01-24 2019-06-07 武汉精立电子技术有限公司 It is a kind of based on the LCD panel defect inspection method adaptively focused
CN109870293A (en) * 2019-03-15 2019-06-11 合肥鑫晟光电科技有限公司 The detection method and detection device of display panel
CN109919933A (en) * 2019-03-08 2019-06-21 歌尔股份有限公司 VR equipment and its picture detection method, device, computer readable storage medium
CN109978864A (en) * 2019-03-28 2019-07-05 惠科股份有限公司 Display panel detection system, method, apparatus and storage medium
CN110325895A (en) * 2017-02-21 2019-10-11 脸谱科技有限责任公司 It focuses and adjusts more plane head-mounted displays
CN110351530A (en) * 2019-07-31 2019-10-18 Tcl王牌电器(惠州)有限公司 Polyphaser realizes method, system and the computer readable storage medium of screen detection
CN110967166A (en) * 2018-09-28 2020-04-07 舜宇光学(浙江)研究院有限公司 Detection method, detection device and detection system of near-eye display optical system
CN111524102A (en) * 2020-04-10 2020-08-11 京东方科技集团股份有限公司 Method and device for detecting screen contamination of liquid crystal display
CN111638227A (en) * 2020-05-18 2020-09-08 歌尔光学科技有限公司 VR optical module image defect detection method and device
CN111856749A (en) * 2019-04-28 2020-10-30 云谷(固安)科技有限公司 Display device and method
US10825163B1 (en) * 2019-06-13 2020-11-03 Viavi Solutions Inc. Automatically executing a test to inspect an end face of an optical fiber when an image is in focus

Patent Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102590221A (en) * 2012-02-24 2012-07-18 深圳大学 Apparent defect detecting system and detecting method of polarizer
CN104914575A (en) * 2014-09-29 2015-09-16 北京蚁视科技有限公司 Microlens-array-type near-eye display with diopter detection device
TW201800804A (en) * 2016-06-15 2018-01-01 威亞視覺科技股份有限公司 Head-mounted personal multimedia systems and visual assistance devices thereof
CN206301085U (en) * 2016-12-30 2017-07-04 北京七鑫易维信息技术有限公司 A kind of head-mounted display apparatus and portable set
CN106526867A (en) * 2017-01-22 2017-03-22 网易(杭州)网络有限公司 Image picture display control method, image picture display control device and head wearing type display equipment
CN110325895A (en) * 2017-02-21 2019-10-11 脸谱科技有限责任公司 It focuses and adjusts more plane head-mounted displays
US20190041643A1 (en) * 2017-08-01 2019-02-07 Wistron Corporation Near eye display system and operation method thereof
CN109597210A (en) * 2017-09-20 2019-04-09 天马日本株式会社 Display device
CN208285458U (en) * 2018-06-08 2018-12-25 深圳惠牛科技有限公司 The detection device of display module image quality
CN110967166A (en) * 2018-09-28 2020-04-07 舜宇光学(浙江)研究院有限公司 Detection method, detection device and detection system of near-eye display optical system
CN109584226A (en) * 2018-11-26 2019-04-05 深圳龙图腾创新设计有限公司 A kind of quality inspection system and method
CN109752168A (en) * 2019-01-03 2019-05-14 深圳市亿境虚拟现实技术有限公司 A kind of optical mirror slip detection device for virtual reality device
CN109856157A (en) * 2019-01-24 2019-06-07 武汉精立电子技术有限公司 It is a kind of based on the LCD panel defect inspection method adaptively focused
CN109752394A (en) * 2019-01-28 2019-05-14 凌云光技术集团有限责任公司 A kind of display screen defect high-precision detecting method and system
CN109919933A (en) * 2019-03-08 2019-06-21 歌尔股份有限公司 VR equipment and its picture detection method, device, computer readable storage medium
CN109870293A (en) * 2019-03-15 2019-06-11 合肥鑫晟光电科技有限公司 The detection method and detection device of display panel
CN109978864A (en) * 2019-03-28 2019-07-05 惠科股份有限公司 Display panel detection system, method, apparatus and storage medium
CN111856749A (en) * 2019-04-28 2020-10-30 云谷(固安)科技有限公司 Display device and method
US10825163B1 (en) * 2019-06-13 2020-11-03 Viavi Solutions Inc. Automatically executing a test to inspect an end face of an optical fiber when an image is in focus
CN110351530A (en) * 2019-07-31 2019-10-18 Tcl王牌电器(惠州)有限公司 Polyphaser realizes method, system and the computer readable storage medium of screen detection
CN111524102A (en) * 2020-04-10 2020-08-11 京东方科技集团股份有限公司 Method and device for detecting screen contamination of liquid crystal display
CN111638227A (en) * 2020-05-18 2020-09-08 歌尔光学科技有限公司 VR optical module image defect detection method and device

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
张建国等: "基于机器视觉的手机屏幕表面划痕检测研究", 《应用光学》 *
杨立峰等: "激光扫描声学显微镜层析成像技术研究", 《压电与声光》 *
简川霞等: "手机玻璃屏表面缺陷视觉检测方法研究", 《包装工程》 *
肖翱等: "针对虚拟现实眼镜的近/远视反卷积矫正算法", 《计算机辅助设计与图形学学报》 *
赵文宏等: "基于形态学玻璃屏幕表面划痕检测方法研究", 《浙江工业大学学报》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113834637A (en) * 2021-08-30 2021-12-24 歌尔光学科技有限公司 Optical performance test system and method of optical module
CN115183989A (en) * 2022-09-13 2022-10-14 武汉精立电子技术有限公司 Near-to-eye display module detection method and detection system
CN115183989B (en) * 2022-09-13 2023-01-10 武汉精立电子技术有限公司 Near-to-eye display module detection method and detection system
WO2024055662A1 (en) * 2022-09-13 2024-03-21 武汉精测电子集团股份有限公司 Near-eye display module inspection method and inspection system
CN115855454A (en) * 2023-02-10 2023-03-28 武汉加特林光学仪器有限公司 Detection device and method for near-to-eye display products adaptive to different diopters

Also Published As

Publication number Publication date
CN112595496B (en) 2023-04-21

Similar Documents

Publication Publication Date Title
CN112595496B (en) Method, device, equipment and storage medium for detecting faults of near-eye display equipment
US10997696B2 (en) Image processing method, apparatus and device
US10444486B2 (en) Systems and methods for detection of blank fields in digital microscopes
CN110967166B (en) Detection method, detection device and detection system of near-eye display optical system
CN112219226A (en) Multi-stage camera calibration
CN111947894B (en) Measuring method, system, device and terminal equipment
CN109883391B (en) Monocular distance measurement method based on digital imaging of microlens array
CN111595554A (en) Measuring method, system, device and terminal equipment
CN111044262A (en) Near-to-eye display optical-mechanical module detection device
CN113781414A (en) Lens resolving power testing method and device and electronic equipment
CN116524022B (en) Offset data calculation method, image fusion device and electronic equipment
US20230328400A1 (en) Auxiliary focusing method, apparatus, and system
CN111656247B (en) Cell image processing system, cell image processing method, automatic film reading device and storage medium
CN110581977A (en) video image output method and device and three-eye camera
CN112730449B (en) Microscopic three-dimensional detection optical method for auto-focusing liquid crystal module
CN114219758A (en) Defect detection method, system, electronic device and computer readable storage medium
CN107534729B (en) Image processing apparatus, image processing method, and program
CN114998980A (en) Iris detection method and device, electronic equipment and storage medium
CN114581403A (en) Cleanliness detection method, device and system and storage medium
JP7343336B2 (en) Inspection support device and inspection support method
CN111489384B (en) Method, device, system and medium for evaluating shielding based on mutual viewing angle
CN106101542A (en) A kind of image processing method and terminal
US20220398803A1 (en) Method for forming an image of an object, computer program product and image forming system for carrying out the method
US20200100671A1 (en) Method for Determining the Pupil Diameter of an Eye with High Accuracy, and Corresponding Apparatus
Muhammad et al. Calculating accurate window size for shape-from-focus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant