CN113052781A - Image detection method, device, equipment, system and storage medium - Google Patents
Image detection method, device, equipment, system and storage medium Download PDFInfo
- Publication number
- CN113052781A CN113052781A CN201911366664.9A CN201911366664A CN113052781A CN 113052781 A CN113052781 A CN 113052781A CN 201911366664 A CN201911366664 A CN 201911366664A CN 113052781 A CN113052781 A CN 113052781A
- Authority
- CN
- China
- Prior art keywords
- image
- display screen
- subtracted
- optical lens
- color
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 119
- 230000003287 optical effect Effects 0.000 claims abstract description 63
- 238000003384 imaging method Methods 0.000 claims abstract description 54
- 238000000034 method Methods 0.000 claims abstract description 31
- 239000007787 solid Substances 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 description 11
- 238000004458 analytical method Methods 0.000 description 8
- 238000013461 design Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 239000003086 colorant Substances 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000717 retained effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0018—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for preventing ghost images
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20224—Image subtraction
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The embodiment of the application provides an image detection method, an image detection device, image detection equipment, an image detection system and a computer-readable storage medium for VR display equipment, and ghost can be effectively detected. The VR display device includes a display screen and an optical lens positioned on a light exit side of the display screen, the method includes: when the display screen displays a pure-color image with a first color, acquiring a basic image presented by the display screen after the display screen shot at an imaging position passes through the optical lens, wherein the optical lens is positioned between the display screen and the imaging position; when the display screen displays an image with a pattern, acquiring an image to be subtracted, which is displayed after the display screen shot at an imaging position passes through the optical lens, wherein the image with the pattern has a background color of a first color and a pattern with a second color; and subtracting the basic image from the image to be subtracted to obtain a detection image.
Description
Technical Field
The present application relates to the field of virtual reality technologies, and in particular, to an image detection method, apparatus, device, system, and computer-readable storage medium for a VR display device.
Background
Virtual Reality (VR) technology simulates a Virtual environment using computer technology, and enables a user to obtain an immersive experience of "being personally on the scene".
At present, a VR display device (such as VR glasses) may have "ghost" during a display process, where ghost refers to the presence of one or more images similar to an image point near the image point imaged by the VR display device, and other images except the image point are called ghost, and the ghost affects normal display, and there is no effective method for detecting the ghost currently.
Disclosure of Invention
The technical scheme of the application provides an image detection method, device, equipment and system for VR display equipment and a computer readable storage medium, and ghost can be effectively detected.
In a first aspect, the present application provides an image detection method for a VR display apparatus, where the VR display apparatus includes a display screen and an optical lens located on a light exit side of the display screen, and the method includes:
when the display screen displays a pure-color image with a first color, acquiring a basic image presented by the display screen after the display screen shot at an imaging position passes through the optical lens, wherein the optical lens is positioned between the display screen and the imaging position;
when the display screen displays an image with a pattern, acquiring an image to be subtracted, which is displayed after the display screen shot at an imaging position passes through the optical lens, wherein the image with the pattern has a background color of a first color and a pattern with a second color;
and subtracting the basic image from the image to be subtracted to obtain a detection image.
The method comprises the steps of obtaining a basic image shot at the moment when a display screen displays a pure-color image, obtaining an image to be subtracted shot at the moment when the display screen displays a pattern, subtracting the image to be subtracted from the basic image to obtain a detection image, removing interference of the VR display equipment environment on shooting, obtaining an imaging pattern after the interference is removed as the detection image, and according to the detection image, judging and analyzing ghosts more accurately, namely, realizing effective detection of ghosts.
In one possible design, the process of acquiring the image to be subtracted presented by the display screen after passing through the optical lens and being taken at the imaging position when the display screen displays the image with the pattern comprises:
when the display screen displays an image with a pattern at a first position, acquiring a first position to-be-reduced image which is displayed after the display screen shot at an imaging position passes through the optical lens;
when the display screen displays an image with a pattern at a second position, acquiring a second position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
the process of obtaining the detection image by using the image to be subtracted and the basic image comprises the following steps:
subtracting the basic image from the image to be subtracted at the first position to obtain a first detection image;
and subtracting the basic image from the image to be subtracted at the second position to obtain a second detection image.
By shooting different images to be subtracted when the pattern is positioned at different positions, the ghost of the pattern at different positions can be obtained, and therefore judgment and analysis of the ghost are facilitated.
In one possible design, the pixels of the display screen are arranged in n rows, wherein n is more than or equal to 2;
the display screen displays different images frame by frame in n frames, the image displayed by the display screen has 1 line of second color pixels and n-1 lines of first color pixels in the same frame, and the second color pixels are positioned in different lines in any different frames;
when the display screen displays the image with the pattern, the process of acquiring the image to be subtracted presented after the display screen shot at the imaging position passes through the optical lens comprises the following steps:
in the ith frame of the n frames, acquiring an image to be subtracted of the ith frame displayed on the display screen shot at the imaging position after the display screen passes through the optical lens, wherein the value of i is 1, 2, 3, … and n;
the process of obtaining the detection image by using the image to be subtracted and the basic image comprises the following steps:
and subtracting the i frame image to be subtracted from the basic image to obtain an i frame detection image, wherein the value of i is 1, 2, 3, … and n.
In one possible design, the pattern is a dot or a line.
In one possible design, the first color is black and the second color is white. On one hand, the pattern and the background have higher contrast, so that the pattern is convenient to judge and analyze; on the other hand, the proportion of the pixel occupied by the pattern is smaller than that of the background, so that the black lines on the black background are less prone to be ignored than the white black lines, namely the pattern in the black lines is easier to judge and analyze; on the other hand, an image is formed by two basic colors of black and white, and the influence of different colors does not need to be considered in the processes of analysis, image subtraction and the like, so that the implementation mode is simpler.
In a second aspect, the present technical solution provides an image detection apparatus for a VR display device, where the VR display device includes a display screen and an optical lens located on a light emitting side of the display screen, the apparatus includes:
a first image acquiring unit configured to acquire a base image presented after the display screen passes through the optical lens, which is photographed at an imaging position, when the display screen displays a solid image having a first color, the optical lens being located between the display screen and the imaging position;
the second image acquisition unit is used for acquiring an image to be subtracted presented by the display screen after the display screen shot at an imaging position passes through the optical lens when the display screen displays the image with the pattern, wherein the image with the pattern has a background color of a first color and a pattern with a second color;
and the interference removing unit is used for subtracting the image to be subtracted from the basic image to obtain a detection image.
In one possible design, the second image capturing unit is specifically configured to:
when the display screen displays an image with a pattern at a first position, acquiring a first position to-be-reduced image which is displayed after the display screen shot at an imaging position passes through the optical lens;
when the display screen displays an image with a pattern at a second position, acquiring a second position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
the interference removing unit is specifically configured to:
subtracting the basic image from the image to be subtracted at the first position to obtain a first detection image;
and subtracting the basic image from the image to be subtracted at the second position to obtain a second detection image.
In one possible design, the pixels of the display screen are arranged in n rows, wherein n is more than or equal to 2;
the display screen displays different images frame by frame in n frames, the image displayed by the display screen has 1 line of second color pixels and n-1 lines of first color pixels in the same frame, and the second color pixels are positioned in different lines in any different frames;
the second image obtaining unit is specifically configured to obtain, in an ith frame of the n frames, an image to be subtracted in the ith frame, which is displayed on the display screen after passing through the optical lens and is shot at an imaging position, where a value of i is 1, 2, 3, …, and n;
the interference removing unit is specifically configured to subtract the i frame image to be subtracted from the base image to obtain an i-th frame detection image, where a value of i is 1, 2, 3, …, and n.
In one possible design, the pattern is a dot or a line.
In one possible design, the first color is black and the second color is white.
In a third aspect, an embodiment of the present application provides an image detection apparatus for a VR display apparatus, including: a processor and a memory for storing at least one instruction which is loaded and executed by the processor to implement the method described above.
In a fourth aspect, the present application provides an image detection system for a VR display device, including:
VR display equipment, a camera and the image detection equipment;
the VR display equipment comprises a display screen and an optical lens positioned on the light emitting side of the display screen;
the optical lens is positioned between the display screen and the camera.
In a fifth aspect, the present disclosure provides a computer-readable storage medium, in which a computer program is stored, and when the computer program runs on a computer, the computer is caused to execute the above method.
Drawings
Fig. 1 is a schematic structural diagram of an image detection system for a VR display device in an embodiment of the present application;
FIG. 2 is a schematic view of an image displayed on the display screen of FIG. 1;
FIG. 3 is a schematic view of an image taken by the camera of FIG. 1;
FIG. 4 is a flowchart of an image detection method for a VR display device according to an embodiment of the present disclosure;
FIG. 5 is a flowchart of another image detection method for a VR display device in accordance with embodiments of the present application;
fig. 6 is a block diagram illustrating an image detection apparatus for a VR display device according to an embodiment of the present disclosure;
fig. 7 is a block diagram of an image detection apparatus for a VR display apparatus in an embodiment of the present application.
Detailed Description
The terminology used in the description of the embodiments section of the present application is for the purpose of describing particular embodiments of the present application only and is not intended to be limiting of the present application.
As shown in fig. 1, fig. 2, fig. 3, and fig. 4, fig. 1 is a schematic structural diagram of an image detection system for a VR display device in an embodiment of the present application, fig. 2 is a schematic structural diagram of an image displayed on a display screen in fig. 1, fig. 3 is a schematic structural diagram of an image captured by a camera in fig. 1, and fig. 4 is a flowchart of an image detection method for a VR display device in an embodiment of the present application. The optical lens 12 is located between the imaging position and the display screen 11, a picture displayed on the display screen 11 is imaged at the imaging position after passing through the optical lens 12, and when a user uses the VR display device, human eyes are located at the imaging position to obtain an image at a modified position. In the image detection system, the camera 2 is located at an imaging position for simulating human eyes to shoot an image of the display screen 11 at the imaging position. For example, fig. 2 shows an image currently displayed on the display screen 11, and the image displayed on the display screen 11 is captured by the camera 2, and the obtained image is shown in fig. 3,
the principle of generating ghost in the VR display device is that light rays emitted by the display screen 11 during display are irradiated to the optical lens 12, and a part of the light rays is normal light rays, and the light rays pass through the optical lens 12 to reach an imaging position to form a normal image; the other part is ghost light, which is reflected back to the display screen 11 at the optical lens 12, and then reflected again and passes through the optical lens 12 to the imaging position, forming a ghost image. For example, the pattern displayed on the display screen in fig. 2 is a line segment, and the pattern captured by the camera 2 includes another line segment, i.e., a ghost image formed by ghost light, in addition to the line segment formed by normal light, as shown in fig. 3.
The image detection method comprises the following steps:
Specifically, in VR display equipment, for example, VR glasses, there are some light-emitting positions themselves, and therefore, if analysis is performed simply according to a picture with a pattern captured by the camera 2, ghost therein is not easily recognized, and therefore in the embodiment of the present application, a corresponding image is captured when the display screen 11 displays a solid background, and a corresponding image is captured when the display screen 11 displays the pattern, and both images have the same environmental interference, and therefore, after subtracting the two images, the pattern from which the environmental interference is removed can be obtained, and thus ghost can be recognized and analyzed more accurately.
It should be noted that, in the embodiment of the present application, the execution sequence between step 101 and step 102 is not limited, and in other realizable implementations, step 102 may be executed first and then step 101 may be executed.
According to the image detection method for the VR display device, the basic image shot at the moment is obtained when the display screen displays the pure color image, the image to be subtracted shot at the moment is obtained when the display screen displays the pattern, the image to be subtracted and the basic image are subtracted to obtain the detection image, therefore, the interference of the VR display device environment to the shooting can be removed, the imaging pattern after the interference is removed is obtained and serves as the detection image, ghost can be judged and analyzed more accurately according to the detection image, and therefore the effective detection of the ghost is achieved.
Alternatively, as shown in fig. 5, fig. 5 is a flowchart of another image detection method for a VR display apparatus in this embodiment, and the step 102 of acquiring, when the display screen 11 displays an image with a pattern, an image to be subtracted presented after the display screen 11 captured at the imaging position passes through the optical lens 12 includes:
the step 103 of obtaining the detection image from the image to be subtracted and the base image includes:
and 302, subtracting the basic image from the image to be subtracted at the second position to obtain a second detection image, namely, obtaining a detection image corresponding to the line segment positioned in the middle.
Specifically, by shooting different images to be subtracted when the pattern is located at different positions, the ghost of the pattern at different positions can be obtained, so that the judgment and analysis of the ghost are facilitated. In the step shown in fig. 5, it is only illustrated that the first detection image and the second detection image are obtained by shooting when the pattern is located at the first position and the second position, respectively, in other realizable embodiments, the pattern may be located at other more positions, and further the to-be-subtracted image corresponding to the other positions is obtained, and the to-be-subtracted image corresponding to the other positions and the base image are subtracted to obtain other detection images.
Optionally, the pixels of the display screen are arranged in n rows, where n is greater than or equal to 2, for example, the horizontal direction in fig. 1 may be defined as a row direction, and the vertical direction in fig. 1 may be defined as a column direction, or the vertical direction in fig. 1 may be defined as a row direction, and the vertical direction is defined as a column direction, which is not limited in the embodiments of the present application; the display screen 11 displays different images frame by frame in n frames, in the same frame, the image displayed by the display screen 11 has 1 line of second color pixels and n-1 lines of first color pixels, and in any different frame, the second color pixels are positioned in different lines;
the step 102, when the display screen 11 displays the image with the pattern, acquiring the image to be subtracted displayed after the display screen 11 photographed at the imaging position passes through the optical lens 12, includes:
in the ith frame of the n frames, acquiring an image to be subtracted of the ith frame displayed after a display screen 11 shot at an imaging position passes through an optical lens 12, wherein the value of i is 1, 2, 3, … and n;
for example, in the 1 st frame, in the image displayed on the display screen 11, the pixels in the 1 st line are white, and the pixels in the other lines are black, that is, a white straight line is displayed at the position of the 1 st line under the black background, and at this time, the camera 2 captures the corresponding 1 st frame image to be subtracted; in the frame 2, in the image displayed on the display screen 11, the pixels in the row 2 are white, and the pixels in the other rows are black, that is, a white straight line is displayed at the position of the row 2 under the black background, and at this time, the camera 2 shoots the corresponding frame 2 to-be-subtracted image; in the 3 rd frame, in the image displayed on the display screen 11, the 3 rd line of pixels is white, and the other lines of pixels are black, that is, a white straight line is displayed at the 3 rd line under the black background, and at this time, the camera 2 shoots the corresponding 3 rd frame of image to be subtracted; and analogizing in sequence until in the nth frame, in the image displayed by the display screen 11, the nth line of pixels is white, and the other lines of pixels are black, that is, a white straight line is displayed at the nth line under the black background, and at this time, the camera 2 shoots and obtains the corresponding nth frame image to be subtracted. Namely, the white straight lines are displayed line by line and the corresponding image to be subtracted is obtained by shooting.
The step 103 of obtaining the detection image from the image to be subtracted and the base image includes: and subtracting the i frame image to be subtracted from the basic image to obtain an i frame detection image, wherein the value of i is 1, 2, 3, … and n.
For example, subtracting the image to be subtracted from the base image in the 1 st frame to obtain a detection image in the 1 st frame, wherein the detection image in the 1 st frame is used for reflecting a ghost when a white straight line is located in the 1 st line; subtracting the 2 nd frame image to be subtracted from the basic image to obtain a 2 nd frame detection image, wherein the 2 nd frame detection image is used for reflecting a ghost when the white straight line is positioned on the 2 nd line; subtracting the 3 rd frame image to be detected from the basic image to obtain a 3 rd frame detection image, wherein the 3 rd frame detection image is used for reflecting a ghost when the white straight line is positioned in the 3 rd line; and repeating the steps until the n frame of image to be detected and the basic image are subtracted to obtain an n frame of detection image, wherein the n frame of detection image is used for reflecting the ghost when the white straight line is positioned on the n row.
In addition, in the above step 102 and step 103, step 103 may be executed after step 102 is executed completely, or both steps may be executed together, for example, in the 1 st frame, in the image displayed on the display screen 11, the 1 st line of pixels is white, and the other lines of pixels are black, at this time, the camera 2 captures the corresponding 1 st frame to-be-subtracted image, and subtracts the 1 st frame to-be-subtracted image from the base image to obtain the 1 st frame detection image; then, the 2 nd frame is entered, pixels in the 2 nd line in the image displayed by the display screen 11 are white, and pixels in other lines are black, at the moment, the camera 2 shoots the corresponding 2 nd frame to-be-subtracted image, and the 2 nd frame to-be-subtracted image and the basic image are subtracted to obtain a 2 nd frame detection image; in the same way, until the nth row of pixels in the image displayed on the display screen 11 in the nth frame is white and the other rows of pixels are black, the camera 2 obtains the corresponding nth frame of image to be subtracted by shooting, and subtracts the nth frame of image to be subtracted from the basic image to obtain the nth frame of detection image, that is, the whole steps 102 and 103 are completed.
Optionally, the pattern is a dot or a line.
Specifically, for example, when the pattern is a dot, the dot may be a pixel point corresponding to one pixel, or may be a dot composed of a plurality of adjacent pixels, in step 102, the display screen 11 displays the dot at different positions, and at the same time, when the dot is located at different positions, different images to be subtracted captured by the camera 2 are respectively obtained, and in step 103, each image to be subtracted is subtracted from the base image to obtain corresponding detection images, which are used for respectively reflecting ghost images of the dot when the dot is located at different positions. When the pattern is a line, the line may be a straight line corresponding to one row of pixels or one column of pixels, a straight line composed of adjacent rows of pixels, or a straight line composed of adjacent columns of pixels. The patterns are set to be points or lines, so that the accurate coordinates of different parts in the patterns can be determined more easily, and the patterns can be set by traversing all positions in the images, so that the ghosting at different positions can be analyzed integrally. It will be appreciated that in other implementations, other shaped patterns may be provided.
Optionally, the first color is black, and the second color is white.
Specifically, the first color is a background color, and the second color is a pattern color, so that on one hand, the pattern and the background have higher contrast, and the pattern is convenient to judge and analyze; on the other hand, the proportion of the pixel occupied by the pattern is smaller than that of the background, so that the black lines on the black background are less prone to be ignored than the white black lines, namely the pattern in the black lines is easier to judge and analyze; on the other hand, an image is formed by two basic colors of black and white, and the influence of different colors does not need to be considered in the processes of analysis, image subtraction and the like, so that the implementation mode is simpler. It is understood that in other possible embodiments, the first color may be set to be other than black, and the second color may be set to be other than white, as long as the first color and the second color are different, so as to distinguish the patterns in the background.
As shown in fig. 1 to 6, fig. 6 is a block diagram of an image detection apparatus for a VR display device in an embodiment of the present application, and the embodiment of the present application further provides an image detection apparatus for a VR display device, where the VR display device includes a display screen 11 and an optical lens 12 located on a light emitting side of the display screen 11, and the apparatus includes: a first image acquiring unit 31 for acquiring a base image presented after the display screen photographed at the imaging position passes through an optical lens located between the display screen and the imaging position when the display screen displays a solid image having a first color; a second image obtaining unit 32, configured to obtain, when the display screen displays an image with a pattern, an image to be subtracted that is presented after the display screen captured at the imaging position passes through the optical lens, where the image with the pattern has a background color of the first color and a pattern with a second color; and an interference removing unit 33, configured to subtract the to-be-subtracted image from the base image to obtain a detection image.
Specifically, the image detection method and the VR display device in the above embodiment may be applied to the image detection apparatus for VR display device, and the specific working process and principle may be the same as those described in the above embodiment, and are not described again here.
An image detection device for VR display device in the embodiment of this application, the basic image of shooing this moment is acquireed when the display screen shows pure color image, the image of waiting to subtract of shooing this moment is acquireed when the display screen shows the pattern, make and wait to subtract image and basic image and subtract, obtain the detection image, thereby can get rid of the interference of VR display device environment to shooing, obtain the formation of image pattern after getting rid of the interference as the detection image, according to the detection image, judgement and analysis ghost that can be more accurate, the effective detection to the ghost has been realized promptly.
Optionally, the second image acquiring unit 32 is specifically configured to: when the display screen displays an image with a pattern at a first position, acquiring a first position to-be-subtracted image which is displayed after the display screen shot at the imaging position passes through the optical lens; when the display screen displays the image with the pattern at the second position, acquiring a second position to-be-subtracted image which is displayed after the display screen shot at the imaging position passes through the optical lens; the interference removing unit 33 is specifically configured to: subtracting the basic image from the image to be subtracted at the first position to obtain a first detection image; and subtracting the basic image from the image to be subtracted at the second position to obtain a second detection image.
Optionally, the pixels of the display screen are arranged in n rows, wherein n is more than or equal to 2; the display screen displays different images frame by frame in n frames, the image displayed by the display screen has 1 line of second color pixels and n-1 lines of first color pixels in the same frame, and the second color pixels are positioned in different lines in any different frames; the second image obtaining unit 32 is specifically configured to, in an ith frame of the n frames, obtain an image to be subtracted of the ith frame, which is displayed on the display screen captured at the imaging position after passing through the optical lens, where a value of i is 1, 2, 3, …, and n; the interference removing unit 33 is specifically configured to subtract the i-frame image to be subtracted from the base image to obtain an i-th frame detection image, where a value of i is 1, 2, 3, …, and n.
Optionally, the pattern is a dot or a line.
Optionally, the first color is black and the second color is white.
It should be understood that the division of the modules of the image detection apparatus shown in fig. 6 is merely a logical division, and the actual implementation may be wholly or partially integrated into one physical entity or may be physically separated. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling by the processing element in software, and part of the modules can be realized in the form of hardware. For example, the determining module may be a processing element separately set up, or may be implemented by being integrated in a certain chip of the image detection apparatus, such as a terminal, or may be stored in a memory of the image detection apparatus in the form of a program, and the certain processing element of the communication apparatus calls and executes the functions of the above modules. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.
For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), among others. As another example, when one of the above modules is implemented in the form of a Processing element scheduler, the Processing element may be a general purpose processor, such as a Central Processing Unit (CPU) or other processor capable of invoking programs. As another example, these modules may be integrated together, implemented in the form of a system-on-a-chip (SOC).
As shown in fig. 7, fig. 7 is a block diagram of an image detection apparatus for a VR display apparatus in an embodiment of the present application, and the embodiment of the present application further provides an image detection apparatus for a VR display apparatus, including: a processor 41 and a memory 42, the memory 42 being configured to store at least one instruction which is loaded and executed by the processor 41 to implement the image detection method as in the above embodiments.
The number of the processors 41 may be one or more, and in fig. 7, one processor 41 is taken as an example, and the processor 41 and the memory 42 may be connected by a bus or other means.
The memory 42, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the image detection method in the embodiments of the present application. The processor 41 executes various functional applications and data processing, i.e. implements the methods in any of the above-described method embodiments, by running non-transitory software programs, instructions and modules stored in the memory 42.
The memory 42 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; and necessary data, etc. Further, the memory 42 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device.
The image detection device may be a computer, for example.
An image detection equipment for VR display device in this application embodiment, obtain the basic image of shooing this moment when the display screen shows pure color image, obtain the image of waiting to subtract of shooing this moment when the display screen shows the pattern, make and wait to subtract image and basic image and subtract, obtain the detection image, thereby can get rid of the interference of VR display device environment to shooing, obtain the formation of image pattern after getting rid of the interference as the detection image, according to the detection image, judgement and analysis ghost that can be more accurate, the effective detection to the ghost has been realized promptly.
As shown in fig. 1, an embodiment of the present application further provides an image detection system, including: a VR display device 1, a camera 2, and the above-described image detection device (not shown in fig. 1); the VR display device 1 comprises a display screen 11 and an optical lens 12 positioned on the light emitting side of the display screen 11; the optical lens 12 is located between the display screen 11 and the camera head 2.
The image detection device can control the display screen 11 of the VR display device 1 while performing image detection, for example, the image detection device can be electrically connected to the display screen 11 and the camera 2, and then in the process of implementing the image detection method, firstly, image data required to be displayed is provided to the display screen 11, the display screen 11 is controlled to display a corresponding solid image or an image with a pattern, and the camera 2 is controlled to shoot while the display screen 11 is controlled to display a corresponding image, so as to obtain a corresponding basic image or an image to be subtracted.
An image detection system for VR display device in the embodiment of this application, the basic image of shooing this moment is obtained when the display screen shows pure color image, the image of waiting to subtract of shooing this moment is obtained when the display screen shows the pattern, make and wait to subtract image and basic image and subtract, obtain the detection image, thereby can get rid of the interference of VR display device environment to shooing, obtain the formation of image pattern after getting rid of the interference as the detection image, according to the detection image, judgement and analysis ghost that can be more accurate, the effective detection to the ghost has been realized promptly.
An embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program runs on a computer, the computer is caused to execute the image detection method of the above embodiment.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions described in accordance with the present application are generated, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (e.g., coaxial cable, fiber optic, digital subscriber line) or wirelessly (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk), among others.
In the embodiments of the present application, "at least one" means one or more, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, and means that there may be three relationships, for example, a and/or B, and may mean that a exists alone, a and B exist simultaneously, and B exists alone. Wherein A and B can be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or multiple.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (13)
1. An image detection method for a VR display device,
the VR display device includes a display screen and an optical lens positioned on a light exit side of the display screen, the method includes:
when the display screen displays a pure-color image with a first color, acquiring a basic image presented by the display screen after the display screen shot at an imaging position passes through the optical lens, wherein the optical lens is positioned between the display screen and the imaging position;
when the display screen displays an image with a pattern, acquiring an image to be subtracted, which is displayed after the display screen shot at an imaging position passes through the optical lens, wherein the image with the pattern has a background color of a first color and a pattern with a second color;
and subtracting the basic image from the image to be subtracted to obtain a detection image.
2. The method of claim 1,
when the display screen displays the image with the pattern, the process of acquiring the image to be subtracted presented after the display screen shot at the imaging position passes through the optical lens comprises the following steps:
when the display screen displays an image with a pattern at a first position, acquiring a first position to-be-reduced image which is displayed after the display screen shot at an imaging position passes through the optical lens;
when the display screen displays an image with a pattern at a second position, acquiring a second position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
the process of obtaining the detection image by using the image to be subtracted and the basic image comprises the following steps:
subtracting the basic image from the image to be subtracted at the first position to obtain a first detection image;
and subtracting the basic image from the image to be subtracted at the second position to obtain a second detection image.
3. The method of claim 1,
the pixels of the display screen are arranged in n rows, wherein n is more than or equal to 2;
the display screen displays different images frame by frame in n frames, the image displayed by the display screen has 1 line of second color pixels and n-1 lines of first color pixels in the same frame, and the second color pixels are positioned in different lines in any different frames;
when the display screen displays the image with the pattern, the process of acquiring the image to be subtracted presented after the display screen shot at the imaging position passes through the optical lens comprises the following steps:
in the ith frame of the n frames, acquiring an image to be subtracted of the ith frame displayed on the display screen shot at the imaging position after the display screen passes through the optical lens, wherein the value of i is 1, 2, 3, … and n;
the process of obtaining the detection image by using the image to be subtracted and the basic image comprises the following steps:
and subtracting the i frame image to be subtracted from the basic image to obtain an i frame detection image, wherein the value of i is 1, 2, 3, … and n.
4. The method according to claim 1 or 2,
the pattern is a dot or a line.
5. The method according to any one of claims 1 to 3,
the first color is black and the second color is white.
6. An image detection apparatus for a VR display device,
VR display device includes the display screen and is located the optical lens of display screen light-emitting side, the device includes:
a first image acquiring unit configured to acquire a base image presented after the display screen passes through the optical lens, which is photographed at an imaging position, when the display screen displays a solid image having a first color, the optical lens being located between the display screen and the imaging position;
the second image acquisition unit is used for acquiring an image to be subtracted presented by the display screen after the display screen shot at an imaging position passes through the optical lens when the display screen displays the image with the pattern, wherein the image with the pattern has a background color of a first color and a pattern with a second color;
and the interference removing unit is used for subtracting the image to be subtracted from the basic image to obtain a detection image.
7. The apparatus of claim 6,
the second image acquisition unit is specifically configured to:
when the display screen displays an image with a pattern at a first position, acquiring a first position to-be-reduced image which is displayed after the display screen shot at an imaging position passes through the optical lens;
when the display screen displays an image with a pattern at a second position, acquiring a second position to-be-subtracted image which is displayed after the display screen shot at an imaging position passes through the optical lens;
the interference removing unit is specifically configured to:
subtracting the basic image from the image to be subtracted at the first position to obtain a first detection image;
and subtracting the basic image from the image to be subtracted at the second position to obtain a second detection image.
8. The apparatus of claim 6,
the pixels of the display screen are arranged in n rows, wherein n is more than or equal to 2;
the display screen displays different images frame by frame in n frames, the image displayed by the display screen has 1 line of second color pixels and n-1 lines of first color pixels in the same frame, and the second color pixels are positioned in different lines in any different frames;
the second image obtaining unit is specifically configured to obtain, in an ith frame of the n frames, an image to be subtracted in the ith frame, which is displayed on the display screen after passing through the optical lens and is shot at an imaging position, where a value of i is 1, 2, 3, …, and n;
the interference removing unit is specifically configured to subtract the i frame image to be subtracted from the base image to obtain an i-th frame detection image, where a value of i is 1, 2, 3, …, and n.
9. The apparatus according to claim 6 or 7,
the pattern is a dot or a line.
10. The apparatus according to any one of claims 5 to 8,
the first color is black and the second color is white.
11. An image detection apparatus for a VR display apparatus, comprising:
a processor and a memory for storing at least one instruction which is loaded and executed by the processor to implement the method of any one of claims 1 to 5.
12. An image detection system for a VR display device comprising:
a VR display device, a camera and an image detection device as claimed in claim 11;
the VR display equipment comprises a display screen and an optical lens positioned on the light emitting side of the display screen;
the optical lens is positioned between the display screen and the camera.
13. A computer-readable storage medium, in which a computer program is stored which, when run on a computer, causes the computer to carry out the method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911366664.9A CN113052781B (en) | 2019-12-26 | 2019-12-26 | Image detection method, device, equipment, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911366664.9A CN113052781B (en) | 2019-12-26 | 2019-12-26 | Image detection method, device, equipment, system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113052781A true CN113052781A (en) | 2021-06-29 |
| CN113052781B CN113052781B (en) | 2024-04-12 |
Family
ID=76506510
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911366664.9A Active CN113052781B (en) | 2019-12-26 | 2019-12-26 | Image detection method, device, equipment, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113052781B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1258171A (en) * | 1998-12-16 | 2000-06-28 | 索尼公司 | Image synthesis apparatus and image processing apparatus |
| CN101848369A (en) * | 2009-12-04 | 2010-09-29 | 四川川大智胜软件股份有限公司 | Method for detecting video stop event based on self-adapting double-background model |
| JP2011108207A (en) * | 2009-11-20 | 2011-06-02 | Mitsumi Electric Co Ltd | Operation input device and operation input detecting device |
| JP2011205531A (en) * | 2010-03-26 | 2011-10-13 | Fujifilm Corp | Stereoscopic imaging apparatus, ghost image processing apparatus and ghost image processing method |
| US20180165864A1 (en) * | 2016-12-13 | 2018-06-14 | DeepMotion, Inc. | Virtual reality system using multiple force arrays for a solver |
| CN109119009A (en) * | 2017-06-26 | 2019-01-01 | 深圳回收宝科技有限公司 | Screen defect inspection method, detection device, system and storage medium |
| CN109120862A (en) * | 2018-10-15 | 2019-01-01 | Oppo广东移动通信有限公司 | High-dynamic-range image acquisition method, device and mobile terminal |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9020281B2 (en) * | 2010-03-01 | 2015-04-28 | Konika Minolta Advanced Layers, Inc. | Ghost detection device and imaging device using the same, ghost detection method and ghost removal method |
-
2019
- 2019-12-26 CN CN201911366664.9A patent/CN113052781B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1258171A (en) * | 1998-12-16 | 2000-06-28 | 索尼公司 | Image synthesis apparatus and image processing apparatus |
| JP2011108207A (en) * | 2009-11-20 | 2011-06-02 | Mitsumi Electric Co Ltd | Operation input device and operation input detecting device |
| CN101848369A (en) * | 2009-12-04 | 2010-09-29 | 四川川大智胜软件股份有限公司 | Method for detecting video stop event based on self-adapting double-background model |
| JP2011205531A (en) * | 2010-03-26 | 2011-10-13 | Fujifilm Corp | Stereoscopic imaging apparatus, ghost image processing apparatus and ghost image processing method |
| US20180165864A1 (en) * | 2016-12-13 | 2018-06-14 | DeepMotion, Inc. | Virtual reality system using multiple force arrays for a solver |
| CN109119009A (en) * | 2017-06-26 | 2019-01-01 | 深圳回收宝科技有限公司 | Screen defect inspection method, detection device, system and storage medium |
| CN109120862A (en) * | 2018-10-15 | 2019-01-01 | Oppo广东移动通信有限公司 | High-dynamic-range image acquisition method, device and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113052781B (en) | 2024-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11516374B2 (en) | Under-display image sensor | |
| JP7151805B2 (en) | LEARNING DATA GENERATION DEVICE, LEARNING DATA GENERATION METHOD, AND PROGRAM | |
| JP7337091B2 (en) | Reduced output behavior of time-of-flight cameras | |
| US9785234B2 (en) | Analysis of ambient light for gaze tracking | |
| WO2018026586A1 (en) | Combining images aligned to reference frame | |
| CN110519585B (en) | Imaging calibration method and device applied to image acquisition equipment | |
| CN107533765B (en) | Apparatus, method and system for tracking optical objects | |
| CN110572636B (en) | Camera contamination detection method and device, storage medium and electronic equipment | |
| US20180198994A1 (en) | Compressive sensing capturing device and method | |
| US6434271B1 (en) | Technique for locating objects within an image | |
| US8929685B2 (en) | Device having image reconstructing function, method, and recording medium | |
| US20200279400A1 (en) | Information processing device, information processing method and recording medium | |
| CN108040244B (en) | Snapshot method and device based on light field video stream and storage medium | |
| CN106331460A (en) | Image processing method and device, and terminal | |
| US20220237854A1 (en) | Adaptive virtual camera sensor | |
| TWI751869B (en) | Computation apparatus and method of detecting defects for near-eye display | |
| CN113052781B (en) | Image detection method, device, equipment, system and storage medium | |
| US11556006B2 (en) | Method and device for detecting a shadow in a head mounted device | |
| JP2007315777A (en) | Three-dimensional shape measurement system | |
| CN110708537B (en) | Image sensor performance testing method and device and storage medium | |
| CN110020624B (en) | Image recognition method, terminal device and storage medium | |
| JP2018081378A (en) | Image processing apparatus, imaging device, image processing method, and image processing program | |
| JP2013232757A (en) | Imaging apparatus, image processing apparatus, image processing method, and program | |
| TW201809671A (en) | An optical flow speed measuring module and the method thereof | |
| CN111263065A (en) | Eyeball detection prompting method, computer device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |