CN111540060B - Display calibration method and device of augmented reality equipment and electronic equipment - Google Patents
Display calibration method and device of augmented reality equipment and electronic equipment Download PDFInfo
- Publication number
- CN111540060B CN111540060B CN202010216201.0A CN202010216201A CN111540060B CN 111540060 B CN111540060 B CN 111540060B CN 202010216201 A CN202010216201 A CN 202010216201A CN 111540060 B CN111540060 B CN 111540060B
- Authority
- CN
- China
- Prior art keywords
- calibration
- marker
- scene
- sample image
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 80
- 238000000034 method Methods 0.000 title claims abstract description 46
- 239000003550 marker Substances 0.000 claims abstract description 209
- 238000012545 processing Methods 0.000 claims description 42
- 238000004590 computer program Methods 0.000 claims description 24
- 238000010586 diagram Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 238000013519 translation Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Architecture (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application relates to a display calibration method and device of augmented reality equipment and electronic equipment. The method comprises the following steps: acquiring a calibration scene for display calibration; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene; receiving an input adjustment instruction; and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped. By adopting the method, the accuracy of the display of the AR equipment and the superposition of the real scene can be improved.
Description
Technical Field
The present disclosure relates to the field of display technologies of augmented reality devices, and in particular, to a display calibration method, apparatus, computer device, and storage medium for an augmented reality device.
Background
Augmented reality (Augmented Reality, AR) technology is a technology that augments the user's perception of the real world by information provided by a computer system, and superimposes computer-generated virtual objects, scenes, or system cues into the real scene, thereby achieving "augmentation" of reality.
With the continuous development of AR technology, AR devices are beginning to be widely used in various fields, such as face recognition, article recognition, and the like. The AR equipment superimposes the displayed information with the real scene, so that the display is more visual. However, in the current AR display technology, the display of AR scenes is realized by rendering the pictures captured by the camera, and the AR device has the problem of inaccurate superposition of the display and the real scenes.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a display calibration method, apparatus, electronic device, and storage medium for an augmented reality device, which can improve the accuracy of AR device display and real scene superposition.
A display calibration method of an augmented reality device, the method comprising:
acquiring a calibration scene for display calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker;
receiving an input adjustment instruction;
and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
In one embodiment, before the acquiring the calibration scene for display calibration, the method further comprises:
receiving a calibration instruction for displaying calibration, wherein the calibration instruction carries a scene identifier;
and determining a calibration scene according to the scene identification.
In one embodiment, before the determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker, the method further comprises:
acquiring color data of the calibration scene;
performing color processing on the sample image according to the color data of the calibration scene;
and when the difference value between the color data of the sample image and the color data of the calibration scene after the color processing is equal to a preset difference value, executing the step of determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene.
In one embodiment, the adjustment instruction is an image adjustment instruction, and the performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker overlap includes:
and adjusting the sample image according to the image adjustment instruction until the first marker and the second marker coincide.
In one embodiment, the image adjustment instructions include at least one of a zoom instruction, a pan instruction, and a shear instruction.
In one embodiment, the method further comprises:
when the first marker and the second marker are detected to be overlapped, acquiring calibration data and equipment information of the augmented reality equipment and corresponding user information;
and associating the device information and the calibration data with user information.
In one embodiment, the method further comprises:
and storing the associated device information, the calibration data and the user information in a memory of the augmented reality device. A display calibration apparatus of an augmented reality device, the apparatus comprising:
the acquisition module is used for acquiring a calibration scene for display calibration;
the first determining module is used for determining a sample image to be displayed on the display screen of the augmented reality device according to the calibration scene;
a second determining module, configured to determine a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene;
the receiving module is used for receiving an input adjustment instruction;
and the calibration module is used for carrying out display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
An electronic device comprising a memory storing a computer program and a processor that when executing the computer program performs the steps of:
acquiring a calibration scene for display calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker;
receiving an input adjustment instruction;
and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
A computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of:
acquiring a calibration scene for display calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker;
receiving an input adjustment instruction;
and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
The display calibration method, the display calibration device, the electronic equipment and the storage medium of the augmented reality equipment are used for acquiring a calibration scene for display calibration; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene; receiving an input adjustment instruction; and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped. The first marker of the sample image and the second marker of the calibration scene are adjusted and determined through the input adjusting instruction, so that the first marker of the sample image and the second marker of the calibration scene are completely overlapped, deviation between the position of the content displayed by the AR display and the actual scene is avoided, and the accuracy of the display of the AR device and the superposition of the actual scene is improved.
Drawings
FIG. 1 is a flow diagram of a display calibration method of an augmented reality device in one embodiment;
FIG. 2a is a schematic diagram of a calibration scenario in a display calibration method of an augmented reality device according to one embodiment;
FIG. 2b is a schematic diagram of a calibration scenario in a display calibration method of an augmented reality device according to another embodiment;
FIG. 3 is a flow chart of a display calibration method of an augmented reality device according to another embodiment;
FIG. 4 is a schematic diagram of the effects of an augmented reality device before and after display calibration in one embodiment;
FIG. 5 is a flow diagram of display calibration steps of an augmented reality device in one embodiment;
FIG. 6 is a block diagram of a display calibration device of an augmented reality apparatus in one embodiment;
FIG. 7 is a block diagram of a display calibration device of an augmented reality apparatus in another embodiment;
fig. 8 is an internal structural diagram of an electronic device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
In one embodiment, as shown in fig. 1, a display calibration method of an augmented reality device is provided, where the method is applied to a terminal to illustrate the method, it is understood that the method may also be applied to a server, and may also be applied to a system including the terminal and the server, and implemented through interaction between the terminal and the server. In this embodiment, the method includes the steps of:
step 102, acquiring a calibration scene for display calibration.
The calibration scene is used for displaying and calibrating the augmented reality equipment, comprises a marker different from the background of the scene, and at least comprises one marker; the calibration scene may be a real scene or a printed calibration pattern. For example, as shown in fig. 2a, the calibration scene may be selected from a wall with a marker such as a painting or a door or window as the calibration scene of the augmented reality device; as shown in fig. 2b, a calibration scene is printed, and the calibration scene includes 5 markers distributed at four corners and a center of the calibration scene.
Specifically, after the user wears the augmented reality device, the augmented reality device enters a display calibration mode after receiving a calibration instruction, a calibration scene for display calibration is obtained, and the augmented reality device is adjusted by the user to ensure that the augmented display device and the calibration scene are in a parallel state. The calibration command may be generated by a touch button or a voice command control on the user operation interface.
And 104, determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene.
The sample image is acquired from a calibration scene by a camera, and the sample image comprises a marker corresponding to the calibration scene; the shooting visual angle of the camera and the observation visual angle of the AR equipment wearer can be the same or can form a fixed angle; the camera may be, but is not limited to being, mounted on the AR device.
Specifically, after determining the calibration scene, the AR device acquires a sample image for display calibration acquired by the camera from the calibration scene.
Step 106, determining a first marker in the sample image and a second marker in the calibration scene corresponding to the first marker.
Specifically, after determining the calibration scene and the sample image, the user is prompted to determine a first marker in the sample image and a second marker of the first marker in the calibration scene. Alternatively, the number of the first markers and the positions of the markers in the sample image are not limited, and the number of the markers may be 1, 2, 3, 4, or the like; the markers may be text, objects, etc.
Step 108, receiving an input adjustment instruction.
Specifically, the AR device displays a prompt message, prompts a user to observe whether a first marker in the displayed sample image can be overlapped with a second marker in the calibration scene, and inputs a corresponding adjustment instruction according to the overlapping condition of the first marker in the sample image and the second marker in the calibration scene. The adjustment instruction can be input through a human-computer interaction interface of the AR equipment, and can be generated through voice control; the adjustment instructions include, but are not limited to, position adjustment instructions and image adjustment instructions.
And 110, performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped.
Specifically, according to the superposition condition of the first marker in the sample image and the second marker in the calibration scene, receiving an adjustment instruction corresponding to input, and according to the adjustment instruction, until the first marker of the sample image displayed on the AR device is completely superposed with the second marker in the calibration scene. Optionally, when the first marker in the sample image is a window on a wall, according to the adjustment instruction, until a boundary line of the window and the wall in the sample image displayed on the AR device completely coincides with a boundary line of the window and the wall in the calibration scene.
In the display calibration method of the augmented reality device, a calibration scene for display calibration is acquired; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene; receiving an input adjustment instruction; and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped. The first marker of the sample image and the second marker of the calibration scene are adjusted and determined through the input adjusting instruction, so that the first marker of the sample image and the second marker of the calibration scene are completely overlapped, deviation between the position of the content displayed by the AR display and the actual scene is avoided, and the accuracy of the display of the AR device and the superposition of the actual scene is improved.
In another embodiment, as shown in fig. 3, there is provided a display calibration method of an augmented reality device, where the method is applied to a terminal for illustration, and the method includes the following steps:
step 302, a calibration instruction for displaying calibration is received, wherein the calibration instruction carries a scene identifier.
Wherein, the scene identifier is a mark for distinguishing different scenes, and the scene identifier can be a character string of a combination of numbers, letters and the like. The calibration instructions may be generated by touch user interface buttons or by voice control.
Step 304, determining a calibration scene according to the scene identification.
Specifically, when the AR equipment receives a display calibration instruction, a corresponding calibration scene is determined according to a scene identifier carried by the calibration instruction.
Step 306, determining a sample image to be displayed on the display screen of the augmented reality device according to the calibration scene.
In step 308, color data of the calibration scene is acquired.
Wherein the color data is an RGB value, a color brightness, etc. that may include an image, where R represents red (red), G represents green (green), and B represents blue (blue). The AR device can identify the calibration scene through a built-in identification algorithm, and RGB values of the calibration scene are obtained.
Step 310, performing color processing on the sample image according to the color data of the calibration scene.
The color processing refers to processing the RGB values of the image so that the RGB values of the processed image are different from the RGB values of the image before processing. The color processing may be an inverse color processing of the sample image, the inverse color processing being an inversion of R, G, B values of the image, by which the contrast of the image to the sample image may be increased. For example, if the quantization level of the color is 256, the R, G, B value of the image after the inverse processing is 255 minus R, G, B value of the original image.
Specifically, color processing is performed on the sample image according to the RGB value of the calibration scene and a preset difference value, so that an RGB difference exists between the RGB value of the calibration scene and the RGB value of the sample image after color processing.
In step 312, when the difference value between the color data of the sample image after the color processing and the color data of the calibration scene is equal to the preset difference value, the first marker in the sample image and the second marker corresponding to the first marker in the calibration scene are determined.
The preset difference value is a color data difference value between the preset color data of the sample image and the color data of the calibration scene.
Specifically, color processing is performed on the sample image according to the color data of the calibration scene, and when the difference value between the color data of the sample image after the color processing and the color data of the calibration scene is equal to a preset difference value, a user is prompted to determine a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene.
In one embodiment, before determining a first marker in a sample image and a second marker corresponding to the first marker in a calibration scene, an edge distortion correction process is performed on the sample image by adopting a built-in recognition algorithm, and edge distortion caused by a camera is eliminated by performing distortion correction on the sample image, so that the accuracy of AR equipment display and real scene superposition is improved.
Step 314, an input adjustment instruction is received.
The adjusting instruction is used for adjusting the display position of the sample image on the display screen of the AR device and the display size of the sample image. The adjustment instruction may be, but is not limited to, an image adjustment instruction; the image adjustment instruction comprises a translation instruction and a scaling instruction, wherein the translation instruction can be used for translating a plurality of pixels in the horizontal direction of the image and also can be used for translating a plurality of pixels in the vertical direction of the image.
In one embodiment, the adjustment instruction is an image adjustment instruction, and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker overlap comprises: and adjusting the sample image according to the image adjustment instruction until the first marker and the second marker coincide.
Specifically, the AR device generates a prompt message to prompt a user to observe whether a first marker in a sample image on a display screen of the AR device is completely coincident with a second marker in a calibration scene, and when the second marker in the calibration scene is observed to be not coincident with the first marker in the sample image, an input image adjustment instruction is received, and the sample image is adjusted according to the image adjustment instruction until the first marker and the second marker are coincident. The image adjustment instructions may be, but are not limited to, a zoom instruction, a pan instruction, and a shear instruction. And the display size and the display position of the sample image are adjusted through the image adjustment instruction, so that the superposition of the first marker and the second marker is ensured, and the accuracy of AR equipment calibration is improved.
Optionally, before receiving the adjustment instruction, the AR device generates prompt information, where the prompt information is used to prompt a user to observe whether second markers in a calibration scene corresponding to the first markers in the sample image are all displayed on the AR device display screen, and when the number of the second markers in the calibration scene is observed to be less than the number of the first markers in the sample image on the AR device display screen, prompt the user to adjust the position of the AR device by moving back and forth until the second markers in the calibration scene corresponding to the first markers in the sample image on the AR device display screen are all displayed on the AR device display screen; and receiving an input image adjustment instruction, and adjusting the display size and the display position of the sample image on the display screen according to the image adjustment instruction until the first marker and the second marker are overlapped. The second markers corresponding to the first markers can be completely displayed in the AR display calibration scene through the back-and-forth movement of the user, the calibration accuracy of the AR display screen is improved, the markers between the display screen displaying the sample image and the calibration scene are adjusted through the image adjustment instruction, the second markers corresponding to the first markers can be completely overlapped, and the accuracy of displaying the real scene superposition in the AR device is improved.
And step 316, performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped.
Specifically, display calibration is performed on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped, corresponding calibration data are obtained, and the AR equipment superimposes information to be displayed and a real scene according to the calibration data and displays the information on a display screen of the AR equipment.
In one embodiment, when the first marker and the second marker are detected to be coincident, calibration data and device information of the augmented reality device and corresponding user information are acquired; the device information and calibration data are associated with user information.
The calibration data comprise data such as the amplification factor of a sample image, the offset of the image and the like; the offset includes a horizontal offset and a vertical offset. The device information may be, but is not limited to, the model number of the device. The user information is data that may include the name, gender, age, etc. of the wearer of the AR device.
Specifically, when the first marker and the second marker are overlapped, calibration data and device information of the augmented reality device and corresponding user information are acquired, and the calibration data and the device information and the corresponding user information data are associated. The number of times of display calibration of the AR device can be reduced and the calibration efficiency of the AR device can be improved by associating the user information, the calibration data and the device information.
In one embodiment, the associated device information and calibration data and user information are stored in a memory of the augmented reality device.
Specifically, by storing the associated device information, calibration data and user information in the memory, corresponding calibration data and device information can be accurately obtained from the memory according to the user information, so that the number of times of display calibration of the AR device is reduced and the calibration efficiency of the AR device is improved. Alternatively, the memory may be, but is not limited to being, a non-volatile memory.
Optionally, in the following embodiment, the effect comparison graph before and after display calibration of the augmented reality device is shown in fig. 4, the AR device is worn on the user, there is a positional deviation between a display screen and a calibration scene seen by the AR device before display calibration, a sample image of the display screen includes 5 markers, 4 markers exist in the calibration scene, and the number of markers in the calibration scene is the same as that in the display screen by prompting the user to move back and forth; the size and the position of the sample image in the display screen are adjusted through the translation instruction and the scaling instruction, and the first marker in the sample image can be seen to be overlapped with the second marker in the calibration scene through the display screen.
In the display calibration method of the augmented reality equipment, the calibration instruction for display calibration is received, and the calibration instruction carries the scene identifier; determining a calibration scene according to the scene identification; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; acquiring color data of a calibration scene; performing color processing on the sample image according to the color data of the calibration scene; when the difference value between the color data of the sample image after the color processing and the color data of the calibration scene is equal to a preset difference value, determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene; and receiving an input adjustment instruction, and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped. The contrast of the sample image and the calibration scene is increased by performing color processing on the sample image, and the sample image is displayed and calibrated according to the input adjustment instruction until the first marker and the second marker are overlapped, so that the accuracy of overlapping the AR equipment and the real scene is improved.
In one embodiment, as shown in fig. 5, there is provided a display calibration step of an augmented reality device, where the method is applied to a terminal for illustration, and the step includes the following steps:
step 502, a calibration scene for display calibration is acquired.
Specifically, the AR equipment receives a calibration instruction, enters a calibration mode, and acquires a calibration scene for displaying calibration; the calibration scene can be obtained from a database according to a scene identifier carried by the calibration instruction, and a user can select a proper calibration scene according to actual requirements.
Step 504, a sample image to be displayed on a display screen of an augmented reality device is determined.
Specifically, after acquiring the calibration scene, the AR device acquires a sample image for display calibration acquired by the camera from the calibration scene.
Step 506, performing color processing on the sample image to determine a first marker in the sample image and a second marker in the calibration scene.
Specifically, color data of a calibration scene is obtained, color processing is performed on the sample image according to the color data of the calibration data, and when a difference value between the color data of the sample image after the color processing and the color data of the calibration scene is equal to a preset difference value, a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene are determined.
Step 508, receiving an input adjustment instruction.
Specifically, after performing color processing on a sample image, the AR equipment determines a first marker in the sample image and a second marker corresponding to the first marker in a calibration scene; and receiving an input adjustment instruction to display and calibrate the sample image. The adjustment instruction may be, but is not limited to, an image adjustment instruction.
Step 510, determining whether the first marker coincides with the second marker, if yes, executing step 512, otherwise executing step 508.
Step 512, save calibration data.
Specifically, when the first marker and the second marker are detected to be coincident, calibration data of the augmented reality device is acquired, and the calibration data is saved in a database.
The display calibration step of the augmented reality equipment comprises the steps of receiving a calibration instruction for display calibration, wherein the calibration instruction carries a scene identifier; determining a calibration scene according to the scene identification; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; acquiring color data of a calibration scene; performing color processing on the sample image according to the color data of the calibration scene; when the difference value between the color data of the sample image after the color processing and the color data of the calibration scene is equal to a preset difference value, determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene; and receiving an input adjustment instruction, performing display calibration on the sample image according to the adjustment instruction, acquiring calibration data of the augmented reality device until the first marker and the second marker are overlapped, and storing the calibration data in a database. The method can improve the accuracy of AR equipment calibration and reduce the calibration times of AR equipment by storing calibration data, and is convenient for user operation.
It should be understood that, although the steps in the flowcharts of fig. 1, 3, and 5 are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least a portion of the steps in fig. 1, 3, and 5 may include a plurality of steps or stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of the execution of the steps or stages is not necessarily sequential, but may be performed in turn or alternately with at least a portion of the steps or stages in other steps or others.
In one embodiment, as shown in fig. 6, there is provided a display calibration apparatus of an augmented reality device, including: an acquisition module 602, a first determination module 604, a second determination module 606, a receiving module 608, and a calibration module 610, wherein:
an acquisition module 602 is configured to acquire a calibration scene for display calibration.
A first determining module 604 is configured to determine a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene.
A second determining module 606 is configured to determine a first marker in the sample image and a corresponding second marker of the first marker in the calibration scene.
The receiving module 608 is configured to receive an input adjustment instruction.
And the calibration module 610 is configured to perform display calibration on the sample image according to the adjustment instruction until the first marker and the second marker overlap.
In the display calibration device of the augmented reality equipment, a calibration scene for display calibration is acquired; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene; receiving an input adjustment instruction; and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped. The first marker of the sample image and the second marker of the calibration scene are adjusted and determined through the input adjusting instruction, so that the first marker of the sample image and the second marker of the calibration scene are completely overlapped, deviation between the position of the content displayed by the AR display and the actual scene is avoided, and the display accuracy of the AR device is improved.
In another embodiment, as shown in fig. 7, there is provided a display calibration apparatus of an augmented reality device, which includes, in addition to an acquisition module 602, a first determination module 604, a second determination module 606, a receiving module 608, and a calibration module 610, a color processing module 612, an association module 614, and a storage module 616, wherein:
a color processing module 612, configured to obtain color data of the calibration scene; performing color processing on the sample image according to the color data of the calibration scene; when the difference value between the color data of the sample image after the color processing and the color data of the calibration scene is equal to the preset difference value, the step of determining the first marker in the sample image and the second marker corresponding to the first marker in the calibration scene is performed.
In one embodiment, the calibration module 610 is further configured to adjust the sample image according to the image adjustment instruction until the first marker and the second marker coincide; the image adjustment instructions include at least one of a zoom instruction, a pan instruction, and a shear instruction.
An association module 614, configured to acquire calibration data and device information of the augmented reality device and corresponding user information when the first marker and the second marker are detected to be coincident; the device information and calibration data are associated with user information.
A storage module 616 for storing the associated device information and calibration data and user information in a memory of the augmented reality device.
In one embodiment, the calibration instruction carries a scene identifier by receiving a calibration instruction displaying calibration; determining a calibration scene according to the scene identification; determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene; acquiring color data of a calibration scene; performing color processing on the sample image according to the color data of the calibration scene; when the difference value between the color data of the sample image after the color processing and the color data of the calibration scene is equal to a preset difference value, determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene; receiving an input adjustment instruction, and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide; when the first marker and the second marker are detected to be overlapped, acquiring calibration data and equipment information of the augmented reality equipment and corresponding user information; the device information and calibration data are associated with user information. The contrast of the sample image and the calibration scene is increased by performing color processing on the sample image, and the sample image is displayed and calibrated according to the input adjustment instruction until the first marker and the second marker coincide, so that the accuracy of AR equipment calibration is improved. By associating and storing the calibration data, the equipment information and the user information, when different users use the device, the calibration data corresponding to the user information can be read from the memory according to the user information, the calibration time is shortened, and the calibration efficiency and accuracy are improved.
For specific limitations on the display calibration means of the augmented reality device, reference may be made to the above limitations on the display calibration method of the augmented reality device, and no further description is given here. The respective modules in the display calibration device of the above-described augmented reality apparatus may be implemented in whole or in part by software, hardware, and a combination thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
In one embodiment, an electronic device is provided, which may be a terminal, and an internal structure diagram thereof may be as shown in fig. 8. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless mode can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program, when executed by a processor, implements a display calibration method for an augmented reality device. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, can also be keys, a track ball or a touch pad arranged on the shell of the computer equipment, and can also be an external keyboard, a touch pad or a mouse and the like.
It will be appreciated by those skilled in the art that the structure shown in fig. 8 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided comprising a memory and a processor, the memory having stored therein a computer program, the processor when executing the computer program performing the steps of:
acquiring a calibration scene for display calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene;
receiving an input adjustment instruction;
and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped.
In one embodiment, the processor when executing the computer program further performs the steps of:
receiving a calibration instruction for displaying calibration, wherein the calibration instruction carries a scene identifier;
and determining a calibration scene according to the scene identification.
In one embodiment, the processor when executing the computer program further performs the steps of:
acquiring color data of a calibration scene;
performing color processing on the sample image according to the color data of the calibration scene;
when the difference value between the color data of the sample image after the color processing and the color data of the calibration scene is equal to the preset difference value, the step of determining the first marker in the sample image and the second marker corresponding to the first marker in the calibration scene is performed.
In one embodiment, the processor when executing the computer program further performs the steps of:
the adjusting instruction is an image adjusting instruction, and the displaying and calibrating of the sample image are carried out according to the adjusting instruction until the first marker and the second marker are overlapped, and the method comprises the following steps:
and adjusting the sample image according to the image adjustment instruction until the first marker and the second marker coincide.
In one embodiment, the processor when executing the computer program further performs the steps of:
the image adjustment instructions include at least one of a zoom instruction, a pan instruction, and a shear instruction.
In one embodiment, the processor when executing the computer program further performs the steps of:
when the first marker and the second marker are detected to be overlapped, acquiring calibration data and equipment information of the augmented reality equipment and corresponding user information;
and associating the device information and the calibration data with user information.
In one embodiment, the processor when executing the computer program further performs the steps of:
and storing the associated device information, the calibration data and the user information in a memory of the augmented reality device.
In one embodiment, a computer readable storage medium is provided having a computer program stored thereon, which when executed by a processor, performs the steps of:
acquiring a calibration scene for display calibration;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
determining a first marker in the sample image and a second marker corresponding to the first marker in the calibration scene;
receiving an input adjustment instruction;
and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker are overlapped.
In one embodiment, the computer program when executed by the processor further performs the steps of:
receiving a calibration instruction for displaying calibration, wherein the calibration instruction carries a scene identifier;
and determining a calibration scene according to the scene identification.
In one embodiment, the computer program when executed by the processor further performs the steps of:
acquiring color data of a calibration scene;
performing color processing on the sample image according to the color data of the calibration scene;
when the difference value between the color data of the sample image after the color processing and the color data of the calibration scene is equal to the preset difference value, the step of determining the first marker in the sample image and the second marker corresponding to the first marker in the calibration scene is performed.
In one embodiment, the computer program when executed by the processor further performs the steps of:
the adjusting instruction is an image adjusting instruction, and the displaying and calibrating of the sample image are carried out according to the adjusting instruction until the first marker and the second marker are overlapped, and the method comprises the following steps:
and adjusting the sample image according to the image adjustment instruction until the first marker and the second marker coincide.
In one embodiment, the computer program when executed by the processor further performs the steps of:
the image adjustment instructions include at least one of a zoom instruction, a pan instruction, and a shear instruction.
In one embodiment, the computer program when executed by the processor further performs the steps of:
when the first marker and the second marker are detected to be overlapped, acquiring calibration data and equipment information of the augmented reality equipment and corresponding user information;
the device information and calibration data are associated with user information.
In one embodiment, the computer program when executed by the processor further performs the steps of:
the associated device information and calibration data and user information are stored in a memory of the augmented reality device.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, or the like. Volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory. By way of illustration, and not limitation, RAM can be in the form of a variety of forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), and the like.
The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.
Claims (7)
1. A display calibration method of an augmented reality device, the method comprising:
receiving a calibration instruction for displaying calibration; the calibration instruction carries a scene identifier and is generated through control of a touch button or a voice instruction on a user operation interface; the scene identifier is a character string of a number or letter combination and is used for distinguishing different scenes;
determining a calibration scene for display calibration according to the scene identification; the calibration scene is a real scene or a printed calibration graph;
acquiring the calibration scene;
determining a sample image to be displayed on a display screen of the augmented reality device according to the calibration scene;
acquiring color data of the calibration scene;
performing color processing on the sample image according to the color data of the calibration scene; wherein the color processing includes a reverse color processing;
determining a first marker in the color-processed sample image and a second marker corresponding to the first marker in the calibration scene;
generating prompt information; the prompting information is used for prompting a user to adjust the position of the augmented reality equipment through back and forth movement so that the second marker is displayed on a display screen of the augmented reality equipment;
receiving an input adjustment instruction;
and performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
2. The method of claim 1, wherein the adjustment instruction is an image adjustment instruction, and wherein the performing display calibration on the sample image according to the adjustment instruction until the first marker and the second marker overlap comprises:
and adjusting the sample image according to the image adjustment instruction until the first marker and the second marker coincide.
3. The method of claim 2, wherein the image adjustment instructions comprise at least one of a zoom instruction, a pan instruction, and a shear instruction.
4. The method according to claim 1, wherein the method further comprises:
when the first marker and the second marker are detected to be overlapped, acquiring calibration data and equipment information of the augmented reality equipment and corresponding user information;
and associating the device information and the calibration data with user information.
5. The method according to claim 4, characterized in that the method comprises:
and storing the associated device information, the calibration data and the user information in a memory of the augmented reality device.
6. A display calibration apparatus for an augmented reality device, the apparatus comprising:
the acquisition module is used for receiving a calibration instruction for display calibration; the calibration instruction carries a scene identifier and is generated through control of a touch button or a voice instruction on a user operation interface; the scene identifier is a character string of a number or letter combination and is used for distinguishing different scenes; determining a calibration scene for display calibration according to the scene identification; the calibration scene is a real scene or a printed calibration graph; acquiring a calibration scene for display calibration;
the first determining module is used for determining a sample image to be displayed on the display screen of the augmented reality device according to the calibration scene;
the color processing module is used for acquiring color data of the calibration scene;
performing color processing on the sample image according to the color data of the calibration scene; wherein the color processing includes a reverse color processing;
a second determining module, configured to determine a first marker in the color-processed sample image and a second marker corresponding to the first marker in the calibration scene;
the receiving module is used for receiving an adjustment instruction input by the user interface; before the receiving the adjustment instruction input by the user interface, the receiving module is further used for generating prompt information; the prompting information is used for prompting a user to adjust the position of the augmented reality equipment through back and forth movement so that the second marker is displayed on a display screen of the augmented reality equipment;
and the calibration module is used for carrying out display calibration on the sample image according to the adjustment instruction until the first marker and the second marker coincide.
7. An electronic device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any one of claims 1 to 5 when the computer program is executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010216201.0A CN111540060B (en) | 2020-03-25 | 2020-03-25 | Display calibration method and device of augmented reality equipment and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010216201.0A CN111540060B (en) | 2020-03-25 | 2020-03-25 | Display calibration method and device of augmented reality equipment and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111540060A CN111540060A (en) | 2020-08-14 |
| CN111540060B true CN111540060B (en) | 2024-03-08 |
Family
ID=71978756
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010216201.0A Active CN111540060B (en) | 2020-03-25 | 2020-03-25 | Display calibration method and device of augmented reality equipment and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111540060B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107341827A (en) * | 2017-07-27 | 2017-11-10 | 腾讯科技（深圳）有限公司 | A kind of method for processing video frequency, device and storage medium |
| CN107911621A (en) * | 2017-12-28 | 2018-04-13 | 深圳市酷开网络科技有限公司 | A kind of image pickup method of panoramic picture, terminal device and storage medium |
| CN108955723A (en) * | 2017-11-08 | 2018-12-07 | 北京市燃气集团有限责任公司 | The calibration method of augmented reality city planting ductwork |
| CN109272454A (en) * | 2018-07-27 | 2019-01-25 | 阿里巴巴集团控股有限公司 | A kind of the coordinate system calibration method and device of augmented reality equipment |
| CN110412765A (en) * | 2019-07-11 | 2019-11-05 | Oppo广东移动通信有限公司 | Augmented reality image capturing method, device, storage medium and augmented reality equipment |
| CN110807413A (en) * | 2019-10-30 | 2020-02-18 | 浙江大华技术股份有限公司 | Target display method and related device |
-
2020
- 2020-03-25 CN CN202010216201.0A patent/CN111540060B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107341827A (en) * | 2017-07-27 | 2017-11-10 | 腾讯科技（深圳）有限公司 | A kind of method for processing video frequency, device and storage medium |
| CN108955723A (en) * | 2017-11-08 | 2018-12-07 | 北京市燃气集团有限责任公司 | The calibration method of augmented reality city planting ductwork |
| CN107911621A (en) * | 2017-12-28 | 2018-04-13 | 深圳市酷开网络科技有限公司 | A kind of image pickup method of panoramic picture, terminal device and storage medium |
| CN109272454A (en) * | 2018-07-27 | 2019-01-25 | 阿里巴巴集团控股有限公司 | A kind of the coordinate system calibration method and device of augmented reality equipment |
| CN110412765A (en) * | 2019-07-11 | 2019-11-05 | Oppo广东移动通信有限公司 | Augmented reality image capturing method, device, storage medium and augmented reality equipment |
| CN110807413A (en) * | 2019-10-30 | 2020-02-18 | 浙江大华技术股份有限公司 | Target display method and related device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111540060A (en) | 2020-08-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109726647B (en) | Point cloud labeling method and device, computer equipment and storage medium | |
| WO2021169307A1 (en) | Makeup try-on processing method and apparatus for face image, computer device, and storage medium | |
| CN108776970A (en) | Image processing method and device | |
| CN110675310A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN112348968B (en) | Display method and device in augmented reality scene, electronic equipment and storage medium | |
| US10437420B2 (en) | Method and apparatus for setting background picture of unlocking interface of application, and electronic device | |
| EP3333844A1 (en) | Display operation method and apparatus, computer program and recording medium | |
| CN110062157B (en) | Method and device for rendering image, electronic equipment and computer readable storage medium | |
| EP3822757A1 (en) | Method and apparatus for setting background of ui control | |
| EP2975574A2 (en) | Method, apparatus and terminal for image retargeting | |
| US8830251B2 (en) | Method and system for creating an image | |
| CN105678296B (en) | Method and device for determining character inclination angle | |
| CN109981989B (en) | Method and device for rendering image, electronic equipment and computer readable storage medium | |
| WO2017215156A1 (en) | Wallpaper processing method and device | |
| CN113920083A (en) | Image-based size measurement method and device, electronic equipment and storage medium | |
| CN114067085A (en) | Virtual object display method and device, electronic equipment and storage medium | |
| CN109934168B (en) | Face image mapping method and device | |
| KR20140030444A (en) | Apparatus for providing marker-less augmented reality service and photographing postion estimating method therefor | |
| CN111540060B (en) | Display calibration method and device of augmented reality equipment and electronic equipment | |
| CN112511890A (en) | Video image processing method and device and electronic equipment | |
| CN110047126B (en) | Method, apparatus, electronic device, and computer-readable storage medium for rendering image | |
| CN115100253A (en) | Image comparison method, device, electronic equipment and storage medium | |
| CN111784772B (en) | Attitude estimation model training method and device based on domain randomization | |
| CN113747076A (en) | Shooting method and device and electronic equipment | |
| CN107742275B (en) | Information processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |