CN113052781B - Image detection method, device, equipment, system and storage medium - Google Patents
Image detection method, device, equipment, system and storage medium Download PDFInfo
- Publication number
- CN113052781B CN113052781B CN201911366664.9A CN201911366664A CN113052781B CN 113052781 B CN113052781 B CN 113052781B CN 201911366664 A CN201911366664 A CN 201911366664A CN 113052781 B CN113052781 B CN 113052781B
- Authority
- CN
- China
- Prior art keywords
- image
- display screen
- subtracted
- optical lens
- color
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 121
- 230000003287 optical effect Effects 0.000 claims abstract description 66
- 238000003384 imaging method Methods 0.000 claims abstract description 59
- 238000000034 method Methods 0.000 claims abstract description 35
- 238000004590 computer program Methods 0.000 claims description 6
- 230000008030 elimination Effects 0.000 claims description 6
- 238000003379 elimination reaction Methods 0.000 claims description 6
- 239000007787 solid Substances 0.000 claims description 6
- 239000000758 substrate Substances 0.000 claims 2
- 238000012545 processing Methods 0.000 description 11
- 238000013461 design Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 239000003086 colorant Substances 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0018—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for preventing ghost images
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20224—Image subtraction
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The embodiment of the application provides an image detection method, an image detection device, an image detection system and a computer readable storage medium for VR display equipment, which can effectively detect ghosts. The VR display device includes a display screen and an optical lens positioned on a light-emitting side of the display screen, the method comprising: acquiring a basic image which is taken at an imaging position and is presented after the display screen passes through the optical lens when the display screen displays a solid-color image with a first color, wherein the optical lens is positioned between the display screen and the imaging position; acquiring an image to be subtracted presented by the display screen taken at an imaging position after passing through the optical lens when the display screen displays an image with a pattern, the image with the pattern having a background color of a first color and a pattern with a second color; and subtracting the image to be subtracted from the basic image to obtain a detection image.
Description
Technical Field
The present disclosure relates to the field of virtual reality technologies, and in particular, to an image detection method, apparatus, device, system, and computer readable storage medium for VR display devices.
Background
Virtual Reality (VR) technology is to simulate a Virtual environment by using computer technology, so that a user obtains an immersive experience of "being in the scene".
Currently, VR display devices (such as VR glasses) may exhibit "ghosting" during a display process, where one or more images similar to an image point exist near the image point imaged by the VR display device, and other images except for the image point are called ghosting, where the ghosting affects normal display, and there is currently no method for effectively detecting the ghosting.
Disclosure of Invention
The technical scheme of the application provides an image detection method, an image detection device, an image detection system and a computer readable storage medium for VR display equipment, and ghosts can be effectively detected.
In a first aspect, a technical solution of the present application provides an image detection method for a VR display device, where the VR display device includes a display screen and an optical lens located on a light emitting side of the display screen, and the method includes:
acquiring a basic image which is taken at an imaging position and is presented after the display screen passes through the optical lens when the display screen displays a solid-color image with a first color, wherein the optical lens is positioned between the display screen and the imaging position;
acquiring an image to be subtracted presented by the display screen taken at an imaging position after passing through the optical lens when the display screen displays an image with a pattern, the image with the pattern having a background color of a first color and a pattern with a second color;
and subtracting the image to be subtracted from the basic image to obtain a detection image.
The method comprises the steps of obtaining a basic image shot at the moment when a display screen displays a solid-color image, obtaining a to-be-subtracted image shot at the moment when the display screen displays a pattern, subtracting the to-be-subtracted image from the basic image to obtain a detection image, thereby removing the interference of the VR display device environment to shooting, obtaining an imaging pattern after removing the interference as the detection image, and judging and analyzing the ghost image more accurately according to the detection image, namely realizing the effective detection of the ghost image.
In one possible design, the process of acquiring the image to be subtracted presented by the display screen taken at the imaging position after passing through the optical lens when the display screen displays the image with the pattern includes:
when the display screen displays an image of the pattern at a first position, acquiring a first position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
when the display screen displays an image of the pattern at a second position, acquiring a second position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
the process of obtaining the detection image by enabling the image to be subtracted and the basic image comprises the following steps:
subtracting the first position to-be-subtracted image from the basic image to obtain a first detection image;
and subtracting the second position to-be-subtracted image from the basic image to obtain a second detection image.
By shooting different images to be subtracted when the pattern is positioned at different positions, the ghost image of the pattern at different positions can be obtained, thereby being more beneficial to judging and analyzing the ghost image.
In one possible design, the pixels of the display screen are arranged in n rows, wherein n is more than or equal to 2;
the display screen displays different images frame by frame in n frames, in the same frame, the displayed images of the display screen are provided with 1 row of second color pixels and n-1 rows of first color pixels, and in any different frame, the second color pixels are positioned in different rows;
the process of acquiring the image to be subtracted presented by the display screen photographed at an imaging position after passing through the optical lens when the display screen displays an image having a pattern includes:
in the ith frame of the n frames, acquiring an ith frame to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens, wherein the value of i is 1, 2, 3, … and n;
the process of obtaining the detection image by enabling the image to be subtracted and the basic image comprises the following steps:
and subtracting the i frame to-be-subtracted image from the basic image to obtain an i frame detection image, wherein the value of i is 1, 2, 3, … and n.
In one possible design, the pattern is a dot or line.
In one possible design, the first color is black and the second color is white. On one hand, the pattern and the background have higher contrast, so that the pattern can be conveniently judged and analyzed; on the other hand, the proportion of pixels occupied by the pattern is smaller relative to the proportion occupied by the background, so that the black matrix white lines are less likely to be ignored relative to the white black lines, namely, the pattern in the pattern is easier to judge and analyze; on the other hand, the image is formed by two basic colors of black and white, and in the processes of analysis, image subtraction and the like, the influence of different colors is not required to be considered, so that the implementation mode is simpler.
In a second aspect, the present application provides an image detection apparatus for a VR display device, where the VR display device includes a display screen and an optical lens located on a light emitting side of the display screen, and the apparatus includes:
a first image acquisition unit configured to acquire a basic image presented by the display screen taken at an imaging position after passing through the optical lens, the optical lens being located between the display screen and the imaging position, when the display screen displays a solid image having a first color;
a second image acquisition unit configured to acquire an image to be subtracted presented after the display screen captured at an imaging position passes through the optical lens, when the display screen displays an image having a pattern, the image having a background color of a first color and a pattern having a second color;
and the interference elimination unit is used for subtracting the image to be subtracted from the basic image to obtain a detection image.
In one possible design, the second image acquisition unit is specifically configured to:
when the display screen displays an image of the pattern at a first position, acquiring a first position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
when the display screen displays an image of the pattern at a second position, acquiring a second position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
the interference elimination unit is specifically used for:
subtracting the first position to-be-subtracted image from the basic image to obtain a first detection image;
and subtracting the second position to-be-subtracted image from the basic image to obtain a second detection image.
In one possible design, the pixels of the display screen are arranged in n rows, wherein n is more than or equal to 2;
the display screen displays different images frame by frame in n frames, in the same frame, the displayed images of the display screen are provided with 1 row of second color pixels and n-1 rows of first color pixels, and in any different frame, the second color pixels are positioned in different rows;
the second image obtaining unit is specifically configured to obtain, in an ith frame of the n frames, an i frame to be subtracted image that is presented after the display screen shot at the imaging position passes through the optical lens, where the value of i is 1, 2, 3, …, and n;
the interference elimination unit is specifically configured to subtract the i frame to-be-subtracted image from the base image to obtain an i frame detection image, where the i has values of 1, 2, 3, … and n.
In one possible design, the pattern is a dot or line.
In one possible design, the first color is black and the second color is white.
In a third aspect, the present application provides an image detection apparatus for a VR display apparatus, including: a processor and a memory for storing at least one instruction which when loaded and executed by the processor implements the method described above.
In a fourth aspect, the present application provides an image detection system for a VR display device, including:
VR display device, camera and above-mentioned image detection device;
the VR display device comprises a display screen and an optical lens positioned on the light emitting side of the display screen;
the optical lens is located between the display screen and the camera.
In a fifth aspect, the present application provides a computer readable storage medium having a computer program stored therein, which when run on a computer causes the computer to perform the above-described method.
Drawings
Fig. 1 is a schematic structural diagram of an image detection system for a VR display device according to an embodiment of the present application;
FIG. 2 is a schematic illustration of an image displayed on the display screen of FIG. 1;
FIG. 3 is a schematic view of an image captured by the camera of FIG. 1;
fig. 4 is a flowchart of an image detection method for a VR display device in an embodiment of the present application;
fig. 5 is a flowchart of another image detection method for a VR display device in an embodiment of the present application;
fig. 6 is a block diagram of an image detection apparatus for VR display device according to an embodiment of the present application;
fig. 7 is a block diagram of an image detection device for a VR display device in an embodiment of the present application.
Detailed Description
The terminology used in the description section of the present application is for the purpose of describing particular embodiments of the present application only and is not intended to be limiting of the present application.
As shown in fig. 1, fig. 2, fig. 3, and fig. 4, fig. 1 is a schematic structural diagram of an image detection system for a VR display device in an embodiment of the present application, fig. 2 is a schematic diagram of an image displayed on a display screen in fig. 1, fig. 3 is a schematic diagram of an image captured by a camera in fig. 1, fig. 4 is a flowchart of an image detection method for a VR display device in an embodiment of the present application, and the embodiment of the present application provides an image detection method for a VR display device, where the VR display device 1 includes a display screen 11 and an optical lens 12 located on an outgoing side of the display screen 11, the outgoing side of the display screen 11 is a side for displaying a picture, in the structure shown in fig. 1, the outgoing side is a right side of the display screen 11, and the number of the optical lenses 12 may be one or more, and only one is illustrated in fig. 1. The optical lens 12 is located between the imaging position and the display screen 11, and the picture displayed on the display screen 11 is imaged at the imaging position after passing through the optical lens 12, so that when the VR display device is used by a user, the human eye is located at the imaging position to obtain imaging at the changed position. In the image detection system, the camera 2 is located at an imaging position for simulating imaging of the human eye photographing display screen 11 at the imaging position. For example, fig. 2 shows the image currently displayed on the display 11, the camera 2 shoots the image displayed on the display 11, the obtained image is shown in fig. 3,
the principle of generating ghosts in VR display devices is that light rays when displayed on the display screen 11 are irradiated to the optical lens 12, wherein a part of the light rays are normal light rays, pass through the optical lens 12 and reach an imaging position to form a normal image; the other part is the ghost rays, which are reflected back onto the display screen 11 at the optical lens 12, and then reflected again and pass through the optical lens 12 to the imaging position, forming a ghost image. For example, the pattern displayed on the display screen in fig. 2 is a line segment, and the pattern captured by the camera 2 in this case includes, as shown in fig. 3, another line segment, that is, a ghost formed by the ghost light, in addition to the line segment formed by the normal light.
The image detection method comprises the following steps:
step 101, when the display screen 11 displays a solid-color image with a first color, acquiring a basic image which is displayed after the display screen 11 shot at an imaging position passes through the optical lens 12, wherein the optical lens 12 is positioned between the display screen 11 and the imaging position, and when the display screen 11 displays a background image such as pure black, the basic image shot by the camera 2 is also a pure black image due to no pattern even if a ghost problem exists;
step 102, when the display screen 11 displays an image having a pattern, acquiring a to-be-subtracted image which is presented after the display screen 11 photographed at an imaging position passes through the optical lens 12, the image having the pattern having a background color of a first color and the pattern having a second color, when the display screen 11 displays an image having a pattern, such as an image as shown in fig. 2, if there is no problem of ghosting, the to-be-subtracted image photographed by the camera 2 is the same as the image shown in fig. 2, and if there is a problem of ghosting, the to-be-subtracted image photographed by the camera 2 is, for example, as shown in fig. 3, in addition to the pattern shown in fig. 2;
in step 103, subtraction is performed on the image to be subtracted and the base image to obtain a detection image, the subtraction is performed on pixels corresponding to the two images, so that a difference between the two images can be obtained, if the image captured in step 102 has no ghost, only the normal pattern shown in fig. 2 remains after the subtraction of the image to be subtracted and the base image, and if the image captured in step 102 has ghost, the normal pattern and the ghost pattern shown in fig. 3 remain after the subtraction of the image to be subtracted and the base image, so that the ghost pattern can be further measured and analyzed, so as to further determine the cause of the ghost.
Specifically, in VR display devices, for example, VR glasses, there may be some positions where light is emitted, so if analysis is simply performed according to a picture with a pattern captured by the camera 2, ghosting therein is not easy to be identified, in this embodiment of the present application, a corresponding image is captured when the display screen 11 displays a solid background, and a corresponding image is captured again when the display screen 11 displays a pattern, where the two images have the same environmental interference, so after subtracting the two images, a pattern with the environmental interference removed can be obtained, so that ghosting can be more accurately identified and analyzed.
It should be noted that, in the embodiment of the present application, the execution sequence between the step 101 and the step 102 is not limited, and in other realizable embodiments, the step 102 may be executed first and then the step 101 may be executed.
According to the image detection method for the VR display device, the basic image shot at the moment is acquired when the display screen displays the solid-color image, the image to be subtracted shot at the moment is acquired when the display screen displays the pattern, and the image to be subtracted and the basic image are subtracted to obtain the detection image, so that the interference of the VR display device environment to shooting can be removed, the imaging pattern after the interference is removed is obtained to serve as the detection image, and according to the detection image, the ghost can be judged and analyzed more accurately, namely, the effective detection of the ghost is realized.
Optionally, as shown in fig. 5, fig. 5 is a flowchart of another image detection method for a VR display device in the embodiment of the present application, where, when the display screen 11 displays an image with a pattern, a process of acquiring a to-be-subtracted image, which is presented after the display screen 11 shot at an imaging position passes through the optical lens 12, includes:
step 201, when the display screen 11 displays an image with a pattern at a first position, acquiring a first position to-be-subtracted image of the display screen 11 taken at the imaging position after passing through the optical lens 12, for example, the pattern displayed by the display screen 11 is a line segment, and the line segment is taken when the image is uppermost, so as to obtain the first position to-be-subtracted image;
step 202, when the display screen 11 displays an image with a pattern at a second position, acquiring a second position to-be-subtracted image which is displayed after the display screen 11 shot at the imaging position passes through the optical lens 12, for example, the first position is the uppermost part of the image, and the second position is the middle of the image, that is, shooting is performed when the same line segment is positioned in the middle of the image, so as to obtain the second position to-be-subtracted image;
step 103, the process of obtaining the detection image by using the image to be subtracted and the base image includes:
step 301, subtracting the image to be subtracted at the first position from the basic image to obtain a first detection image, namely obtaining a detection image corresponding to the line segment when the line segment is at the uppermost position;
and 302, subtracting the image to be subtracted at the second position from the basic image to obtain a second detection image, namely obtaining a detection image corresponding to the line segment positioned in the middle.
Specifically, by shooting different images to be subtracted when the pattern is positioned at different positions, the ghost of the pattern at different positions can be obtained, so that the judgment and analysis of the ghost are more facilitated. In the steps shown in fig. 5, it is only illustrated that when the pattern is located at the first position and the second position, the corresponding first detection image and the second detection image are obtained through shooting, and in other possible embodiments, the pattern may be located at other more positions, further, the images to be subtracted corresponding to other positions are obtained, and other detection images are obtained through subtracting the images to be subtracted corresponding to other positions from the base image.
Optionally, the pixels of the display screen are arranged in n rows, where n is greater than or equal to 2, for example, a horizontal direction in fig. 1 may be defined as a row direction, a vertical direction may be defined as a column direction, and a vertical direction in fig. 1 may be defined as a row direction, where the definition of the row direction and the column direction is not limited in the embodiment of the present application; the display screen 11 displays different images frame by frame in n frames, in the same frame, the image displayed by the display screen 11 has 1 row of second color pixels and n-1 rows of first color pixels, and in any different frame, the second color pixels are located in different rows;
the step 102, when the display screen 11 displays an image with a pattern, the process of acquiring the image to be subtracted presented after the display screen 11 photographed at the imaging position passes through the optical lens 12 includes:
in the ith frame of n frames, acquiring an ith frame to-be-subtracted image which is presented after the display screen 11 shot at an imaging position passes through the optical lens 12, wherein the value of i is 1, 2, 3, … and n;
for example, in the 1 st frame, in the image displayed on the display screen 11, the 1 st row of pixels is white, and the other rows of pixels are black, that is, white straight lines are displayed at the 1 st row position under the black background, and at this time, the camera 2 shoots to obtain a corresponding 1 st frame to be subtracted image; in the 2 nd frame, in the image displayed on the display screen 11, the 2 nd line of pixels are white, and the other lines of pixels are black, namely, white straight lines are displayed at the 2 nd line position under the black background, and at the moment, the camera 2 shoots to obtain a corresponding 2 nd frame image to be subtracted; in the 3 rd frame, in the image displayed on the display screen 11, the 3 rd line of pixels is white, and the other lines of pixels are black, namely, white straight lines are displayed at the 3 rd line position under the black background, and at the moment, the camera 2 shoots to obtain a corresponding 3 rd frame image to be subtracted; and so on until in the nth frame, in the image displayed by the display screen 11, the nth row of pixels are white, and the other rows of pixels are black, namely, white straight lines are displayed at the nth row position under the black background, and at the moment, the camera 2 shoots to obtain the corresponding nth frame to be subtracted image. The method realizes the line-by-line display of white straight lines and the shooting of corresponding images to be subtracted.
Step 103, the process of obtaining the detection image by using the image to be subtracted and the base image includes: and subtracting the i frame to-be-subtracted image from the basic image to obtain an i frame detection image, wherein the values of i are 1, 2, 3, … and n.
For example, subtracting the 1 st frame to-be-subtracted image from the base image to obtain a 1 st frame detection image, wherein the 1 st frame detection image is used for reflecting the ghost of the white straight line in the 1 st row; subtracting the 2 nd frame to-be-subtracted image from the basic image to obtain a 2 nd frame detection image, wherein the 2 nd frame detection image is used for reflecting the ghost of the white straight line positioned in the 2 nd line; subtracting the to-be-detected image of the 3 rd frame from the basic image to obtain a detection image of the 3 rd frame, wherein the detection image of the 3 rd frame is used for reflecting the ghost of the white straight line positioned in the 3 rd line; and analogically, until the nth frame of to-be-detected image is subtracted from the basic image, an nth frame of detection image is obtained, and the nth frame of detection image is used for reflecting the ghost of the white straight line positioned in the nth row.
In addition, in the step 102 and the step 103, after all the steps 102 are executed, the step 103 may be executed, or may be executed together with the steps, for example, in the 1 st frame, in the image displayed on the display screen 11, the 1 st line of pixels are white, and the other lines of pixels are black, at this time, the camera 2 shoots to obtain the corresponding 1 st frame to be subtracted image, and subtracts the 1 st frame to be subtracted image from the base image to obtain the 1 st frame detection image; then entering a 2 nd frame, wherein in the image displayed by the display screen 11, the 2 nd line pixels are white, and the other line pixels are black, at the moment, the camera 2 shoots to obtain a corresponding 2 nd frame image to be subtracted, and the 2 nd frame image to be subtracted is subtracted from the basic image to obtain a 2 nd frame detection image; and the like, until the nth frame is displayed in the display screen 11, the pixels of the nth row are white, and the pixels of the other rows are black, at this time, the camera 2 shoots to obtain the corresponding nth frame to-be-subtracted image, and subtracts the nth frame to-be-subtracted image from the base image to obtain the nth frame detection image, thus completing the whole steps 102 and 103.
Optionally, the pattern is a dot or a line.
Specifically, for example, when the pattern is a dot, the dot may be a pixel dot corresponding to one pixel, or may be a dot composed of a plurality of adjacent pixels, in the step 102, the display screen 11 displays the dot at different positions, and at the same time, when the dot is at a different position, different images to be subtracted captured by the camera 2 are respectively acquired, and in the step 103, each image to be subtracted and the base image are respectively subtracted to obtain a corresponding detection image for respectively reflecting ghosts of the dot at the different positions. When the pattern is a line, the line may be a straight line corresponding to one row of pixels or one column of pixels, a straight line composed of adjacent rows of pixels, or a straight line composed of adjacent columns of pixels. The pattern is set as the point or the line, the accurate coordinates of different parts in the pattern are easier to determine, and the pattern can be set by traversing all positions in the image, so that the ghost images at different positions can be analyzed in a whole. It will be appreciated that in other embodiments, other shapes of patterns may be provided.
Optionally, the first color is black, and the second color is white.
Specifically, the first color is background color, and the second color is pattern color, so that on one hand, the pattern and the background have higher contrast ratio, and the pattern can be conveniently judged and analyzed; on the other hand, the proportion of pixels occupied by the pattern is smaller relative to the proportion occupied by the background, so that the black matrix white lines are less likely to be ignored relative to the white black lines, namely, the pattern in the pattern is easier to judge and analyze; on the other hand, the image is formed by two basic colors of black and white, and in the processes of analysis, image subtraction and the like, the influence of different colors is not required to be considered, so that the implementation mode is simpler. It will be appreciated that in other possible embodiments, other colors than black may be set for the first color, and other colors than white may be set for the second color, so long as the first color and the second color are different, so as to distinguish the patterns in the background.
As shown in fig. 1 to 6, fig. 6 is a block diagram of an image detection apparatus for a VR display device in an embodiment of the present application, where the embodiment of the present application further provides an image detection apparatus for a VR display device, and the VR display device includes a display screen 11 and an optical lens 12 located on a light emitting side of the display screen 11, where the apparatus includes: a first image acquisition unit 31 for acquiring a basic image presented after the display screen photographed at the imaging position passes through an optical lens, the optical lens being located between the display screen and the imaging position, when the display screen displays a solid image having a first color; a second image acquisition unit 32 for acquiring an image to be subtracted presented after the display screen photographed at the imaging position passes through the optical lens when the display screen displays an image having a pattern, the image having a background color of a first color and a pattern having a second color; and a de-interference unit 33, configured to subtract the image to be subtracted from the base image, so as to obtain a detection image.
Specifically, the image detection device for VR display device may be applied to the image detection method in the above embodiment and the VR display device, and specific working processes and principles may be the same as those described in the above embodiment, which are not repeated herein.
According to the image detection device for the VR display device, the basic image shot at the moment is acquired when the display screen displays the solid-color image, the image to be subtracted shot at the moment is acquired when the display screen displays the pattern, the image to be subtracted and the basic image are subtracted to obtain the detection image, so that the interference of the VR display device environment to shooting can be removed, the imaging pattern after the interference is removed is obtained to serve as the detection image, and according to the detection image, the ghost can be judged and analyzed more accurately, namely, the effective detection of the ghost is realized.
Alternatively, the second image acquisition unit 32 is specifically configured to: when the display screen displays an image of the pattern at a first position, acquiring a first position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens; when the display screen displays the image of the pattern at the second position, acquiring a second position to-be-subtracted image which is displayed after the display screen shot at the imaging position passes through the optical lens; the interference removing unit 33 specifically is configured to: subtracting the first position to-be-subtracted image from the basic image to obtain a first detection image; and subtracting the base image from the image to be subtracted at the second position to obtain a second detection image.
Optionally, the pixels of the display screen are arranged in n rows, wherein n is more than or equal to 2; the display screen displays different images frame by frame in n frames, in the same frame, the displayed images of the display screen are provided with 1 row of second color pixels and n-1 rows of first color pixels, and in any different frame, the second color pixels are positioned in different rows; the second image obtaining unit 32 is specifically configured to obtain, in an i-th frame of n frames, an i-th frame to be subtracted image that is presented after the display screen captured at the imaging position passes through the optical lens, where the i has values of 1, 2, 3, …, and n; the interference removing unit 33 is specifically configured to subtract the i frame to-be-subtracted image from the base image to obtain an i frame detection image, where i has values of 1, 2, 3, …, and n.
Optionally, the pattern is a dot or a line.
Optionally, the first color is black and the second color is white.
It should be understood that the above division of the modules of the image detection apparatus shown in fig. 6 is merely a division of a logic function, and may be fully or partially integrated into a physical entity or may be physically separated. And these modules may all be implemented in software in the form of calls by the processing element; or can be realized in hardware; it is also possible that part of the modules are implemented in the form of software called by the processing element and part of the modules are implemented in the form of hardware. For example, the determining module may be a processing element that is set up separately, may be implemented in a chip of an image detection device, such as a terminal, or may be stored in a memory of the image detection device in a program form, and the functions of the above modules may be called and executed by a processing element of the communication device. The implementation of the other modules is similar. In addition, all or part of the modules can be integrated together or can be independently implemented. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in a software form.
For example, the modules above may be one or more integrated circuits configured to implement the methods above, such as: one or more specific integrated circuits (Application Specific Integrated Circuit, ASIC), or one or more microprocessors (digital singnal processor, DSP), or one or more field programmable gate arrays (Field Programmable Gate Array, FPGA), or the like. For another example, when a module above is implemented in the form of a processing element scheduler, the processing element may be a general purpose processor, such as a central processing unit (Central Processing Unit, CPU) or other processor that may invoke the program. For another example, the modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
As shown in fig. 7, fig. 7 is a block diagram of an image detection device for a VR display device according to an embodiment of the present application, where the embodiment of the present application further provides an image detection device for a VR display device, including: a processor 41 and a memory 42, the memory 42 being adapted to store at least one instruction which, when loaded and executed by the processor 41, is adapted to carry out the image detection method as in the above-described embodiments.
The number of processors 41 may be one or more, and in fig. 7, one processor 41 is taken as an example, and the processor 41 and the memory 42 may be connected by a bus or other manner.
The memory 42 is used as a non-transitory computer readable storage medium for storing non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the image detection method in the embodiments of the present application. The processor 41 executes various functional applications and data processing, i.e. implements the methods of any of the method embodiments described above, by running non-transitory software programs, instructions, and modules stored in the memory 42.
Memory 42 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; and necessary data, etc. In addition, memory 42 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device.
The image detection device may be, for example, a computer.
According to the image detection device for the VR display device, the basic image shot at the moment is acquired when the display screen displays the solid-color image, the image to be subtracted shot at the moment is acquired when the display screen displays the pattern, the image to be subtracted and the basic image are subtracted to obtain the detection image, so that the interference of the VR display device environment to shooting can be removed, the imaging pattern after the interference is removed is obtained to serve as the detection image, and according to the detection image, the ghost can be judged and analyzed more accurately, namely, the effective detection of the ghost is realized.
As shown in fig. 1, an embodiment of the present application further provides an image detection system, including: VR display device 1, camera 2, and the above-described image detection device (not shown in fig. 1); the VR display device 1 includes a display screen 11 and an optical lens 12 positioned on the light exit side of the display screen 11; an optical lens 12 is located between the display screen 11 and the camera 2.
The image detection device may control the display screen 11 of the VR display device 1 while performing image detection, for example, the image detection device may be electrically connected to the display screen 11 and the camera 2, and then in implementing the above image detection method, first, provide image data required to be displayed for the display screen 11, control the display screen 11 to display a corresponding solid-color image or an image with a pattern, and control the camera 2 to capture while controlling the display screen 11 to display a corresponding image, so as to obtain a corresponding basic image or an image to be subtracted.
According to the image detection system for the VR display device, the basic image shot at the moment is acquired when the display screen displays the solid-color image, the image to be subtracted shot at the moment is acquired when the display screen displays the pattern, the image to be subtracted and the basic image are subtracted to obtain the detection image, so that the interference of the VR display device environment to shooting can be removed, the imaging pattern after the interference is removed is obtained to serve as the detection image, and according to the detection image, the ghost can be judged and analyzed more accurately, namely, the effective detection of the ghost is realized.
The present application also provides a computer-readable storage medium having stored therein a computer program which, when run on a computer, causes the computer to execute the image detection method of the above-described embodiments.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk), etc.
In the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "and/or", describes an association relation of association objects, and indicates that there may be three kinds of relations, for example, a and/or B, and may indicate that a alone exists, a and B together, and B alone exists. Wherein A, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of the following" and the like means any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or plural.
The foregoing is merely a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and variations may be made to the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.
Claims (13)
1. An image detection method for VR display device, characterized in that,
the VR display device includes a display screen and an optical lens positioned on a light-emitting side of the display screen, the method comprising:
acquiring a basic image which is taken at an imaging position and is presented after the display screen passes through the optical lens when the display screen displays a solid-color image with a first color, wherein the optical lens is positioned between the display screen and the imaging position;
acquiring an image to be subtracted presented by the display screen taken at an imaging position after passing through the optical lens when the display screen displays an image with a pattern, the image with the pattern having a background color of a first color and a pattern with a second color;
and subtracting the image to be subtracted from the basic image to obtain a detection image.
2. The method of claim 1, wherein the step of determining the position of the substrate comprises,
the process of acquiring the image to be subtracted presented by the display screen photographed at an imaging position after passing through the optical lens when the display screen displays an image having a pattern includes:
when the display screen displays an image of the pattern at a first position, acquiring a first position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
when the display screen displays an image of the pattern at a second position, acquiring a second position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
the process of subtracting the image to be subtracted from the base image to obtain a detection image comprises the following steps:
subtracting the first position to-be-subtracted image from the basic image to obtain a first detection image;
and subtracting the second position to-be-subtracted image from the basic image to obtain a second detection image.
3. The method of claim 1, wherein the step of determining the position of the substrate comprises,
the pixels of the display screen are arranged in n rows, and n is more than or equal to 2;
the display screen displays different images frame by frame in n frames, in the same frame, the displayed images of the display screen are provided with 1 row of second color pixels and n-1 rows of first color pixels, and in any different frame, the second color pixels are positioned in different rows;
the process of acquiring the image to be subtracted presented by the display screen photographed at an imaging position after passing through the optical lens when the display screen displays an image having a pattern includes:
in the ith frame of the n frames, acquiring an ith frame to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens, wherein the value of i is 1, 2, 3, … and n;
the process of subtracting the image to be subtracted from the base image to obtain a detection image comprises the following steps:
and subtracting the i-th frame to-be-subtracted image from the basic image to obtain an i-th frame detection image, wherein the i is 1, 2, 3, … and n.
4. A method according to claim 1 or 2, characterized in that,
the pattern is a dot or a line.
5. A method according to any one of claims 1 to 3,
the first color is black and the second color is white.
6. An image detection apparatus for VR display device, characterized in that,
the VR display device includes a display screen and an optical lens positioned on the light-emitting side of the display screen, the apparatus comprising:
a first image acquisition unit configured to acquire a basic image presented by the display screen taken at an imaging position after passing through the optical lens, the optical lens being located between the display screen and the imaging position, when the display screen displays a solid image having a first color;
a second image acquisition unit configured to acquire an image to be subtracted presented after the display screen captured at an imaging position passes through the optical lens, when the display screen displays an image having a pattern, the image having a background color of a first color and a pattern having a second color;
and the interference elimination unit is used for subtracting the image to be subtracted from the basic image to obtain a detection image.
7. The apparatus of claim 6, wherein the device comprises a plurality of sensors,
the second image acquisition unit is specifically configured to:
when the display screen displays an image of the pattern at a first position, acquiring a first position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
when the display screen displays an image of the pattern at a second position, acquiring a second position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
the interference elimination unit is specifically used for:
subtracting the first position to-be-subtracted image from the basic image to obtain a first detection image;
and subtracting the second position to-be-subtracted image from the basic image to obtain a second detection image.
8. The apparatus of claim 6, wherein the device comprises a plurality of sensors,
the pixels of the display screen are arranged in n rows, and n is more than or equal to 2;
the display screen displays different images frame by frame in n frames, in the same frame, the displayed images of the display screen are provided with 1 row of second color pixels and n-1 rows of first color pixels, and in any different frame, the second color pixels are positioned in different rows;
the second image obtaining unit is specifically configured to obtain, in an ith frame of the n frames, an i frame to be subtracted image that is presented after the display screen shot at the imaging position passes through the optical lens, where the value of i is 1, 2, 3, …, and n;
the interference elimination unit is specifically configured to subtract the image to be subtracted from the base image to obtain an i frame detection image, where the i has values of 1, 2, 3, … and n.
9. The apparatus according to claim 6 or 7, wherein,
the pattern is a dot or a line.
10. The device according to any one of claims 6 to 8, wherein,
the first color is black and the second color is white.
11. An image detection device for a VR display device, comprising:
a processor and a memory for storing at least one instruction which, when loaded and executed by the processor, implements the method of any one of claims 1 to 5.
12. An image detection system for a VR display device, comprising:
VR display device, camera and image detection device as claimed in claim 11;
the VR display device comprises a display screen and an optical lens positioned on the light emitting side of the display screen;
the optical lens is located between the display screen and the camera.
13. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when run on a computer, causes the computer to perform the method according to any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911366664.9A CN113052781B (en) | 2019-12-26 | 2019-12-26 | Image detection method, device, equipment, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911366664.9A CN113052781B (en) | 2019-12-26 | 2019-12-26 | Image detection method, device, equipment, system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113052781A CN113052781A (en) | 2021-06-29 |
| CN113052781B true CN113052781B (en) | 2024-04-12 |
Family
ID=76506510
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911366664.9A Active CN113052781B (en) | 2019-12-26 | 2019-12-26 | Image detection method, device, equipment, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113052781B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1258171A (en) * | 1998-12-16 | 2000-06-28 | 索尼公司 | Image synthesis apparatus and image processing apparatus |
| CN101848369A (en) * | 2009-12-04 | 2010-09-29 | 四川川大智胜软件股份有限公司 | Method for detecting video stop event based on self-adapting double-background model |
| JP2011205531A (en) * | 2010-03-26 | 2011-10-13 | Fujifilm Corp | Stereoscopic imaging apparatus, ghost image processing apparatus and ghost image processing method |
| JPWO2011108207A1 (en) * | 2010-03-01 | 2013-06-20 | コニカミノルタ株式会社 | Ghost detection device, imaging device using the same, ghost detection method, and ghost removal method |
| CN109120862A (en) * | 2018-10-15 | 2019-01-01 | Oppo广东移动通信有限公司 | High-dynamic-range image acquisition method, device and mobile terminal |
| CN109119009A (en) * | 2017-06-26 | 2019-01-01 | 深圳回收宝科技有限公司 | Screen defect inspection method, detection device, system and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011108207A (en) * | 2009-11-20 | 2011-06-02 | Mitsumi Electric Co Ltd | Operation input device and operation input detecting device |
| KR20190110539A (en) * | 2016-12-13 | 2019-09-30 | 딥모션, 인크. | Enhanced Virtual Reality System Using Multiple Force Arrays for Solver |
-
2019
- 2019-12-26 CN CN201911366664.9A patent/CN113052781B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1258171A (en) * | 1998-12-16 | 2000-06-28 | 索尼公司 | Image synthesis apparatus and image processing apparatus |
| CN101848369A (en) * | 2009-12-04 | 2010-09-29 | 四川川大智胜软件股份有限公司 | Method for detecting video stop event based on self-adapting double-background model |
| JPWO2011108207A1 (en) * | 2010-03-01 | 2013-06-20 | コニカミノルタ株式会社 | Ghost detection device, imaging device using the same, ghost detection method, and ghost removal method |
| JP2011205531A (en) * | 2010-03-26 | 2011-10-13 | Fujifilm Corp | Stereoscopic imaging apparatus, ghost image processing apparatus and ghost image processing method |
| CN109119009A (en) * | 2017-06-26 | 2019-01-01 | 深圳回收宝科技有限公司 | Screen defect inspection method, detection device, system and storage medium |
| CN109120862A (en) * | 2018-10-15 | 2019-01-01 | Oppo广东移动通信有限公司 | High-dynamic-range image acquisition method, device and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113052781A (en) | 2021-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10547833B2 (en) | Camera calibration system, target, and process | |
| US20200389575A1 (en) | Under-display image sensor | |
| CN111345029B (en) | Target tracking method and device, movable platform and storage medium | |
| JP7337091B2 (en) | Reduced output behavior of time-of-flight cameras | |
| CN110519585B (en) | Imaging calibration method and device applied to image acquisition equipment | |
| WO2015112652A1 (en) | Image demosaicing | |
| JP6786225B2 (en) | Image processing equipment, imaging equipment and image processing programs | |
| US10178381B2 (en) | Depth-spatial frequency-response assessment | |
| US20180198994A1 (en) | Compressive sensing capturing device and method | |
| US20230230204A1 (en) | Image processing method and apparatus, and method and apparatus for training image processing model | |
| US20230410369A1 (en) | Method and apparatus for adjusting an image acquisition apparatus, compensation method of a display panel, device and medium | |
| JP7173763B2 (en) | Image generation device and image generation method | |
| US8929685B2 (en) | Device having image reconstructing function, method, and recording medium | |
| CN110879131B (en) | Imaging quality testing method and imaging quality testing device for visual optical system, and electronic apparatus | |
| CN110490196A (en) | Subject detection method and apparatus, electronic equipment, computer readable storage medium | |
| US20220237854A1 (en) | Adaptive virtual camera sensor | |
| US9147115B2 (en) | Method and device for detecting an object in an image | |
| Kuciš et al. | Simulation of camera features | |
| CN104184936B (en) | Image focusing processing method and system based on light field camera | |
| KR20200106854A (en) | Pixel correction | |
| CN107710741B (en) | Method for acquiring depth information and camera device | |
| TWI751869B (en) | Computation apparatus and method of detecting defects for near-eye display | |
| CN113052781B (en) | Image detection method, device, equipment, system and storage medium | |
| JP2007315777A (en) | Three-dimensional shape measurement system | |
| US8947649B2 (en) | Apparatus and method for determining optical center in camera module |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |