CN112348888B - Positioning method and device of display device, display device and computer storage medium - Google Patents
Positioning method and device of display device, display device and computer storage medium Download PDFInfo
- Publication number
- CN112348888B CN112348888B CN202010942876.3A CN202010942876A CN112348888B CN 112348888 B CN112348888 B CN 112348888B CN 202010942876 A CN202010942876 A CN 202010942876A CN 112348888 B CN112348888 B CN 112348888B
- Authority
- CN
- China
- Prior art keywords
- display device
- attribute information
- positioning
- determining
- illumination intensity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The embodiment of the application provides a positioning method and device of a display device, the display device and a computer readable storage medium, wherein the method comprises the following steps: acquiring first attribute information of a detection object in the moving process of the display equipment; monitoring the change of the attribute information of the detection object under the condition that the display equipment is determined to have a positioning fault based on the first attribute information, and obtaining changed second attribute information; and under the condition that the trigger condition for repositioning is met based on the second attribute information, repositioning the display equipment, so that the display effect of the AR image can be improved.
Description
Technical Field
The embodiment of the application relates to the technical field of augmented reality, and relates to a positioning method, a positioning device, positioning equipment and a computer storage medium of display equipment.
Background
The augmented reality (Augmented Reality, AR) technology captures a real world by a camera attached to a display device and places a virtual object in the real world, and when placing the virtual object in the real world, it is necessary to align the coordinate system of the virtual object with the coordinate system of the real world, and the virtual object and the real world are simultaneously presented by the display device, but in actual use, there are many factors that cause the alignment failure of the coordinate system of the virtual object and the coordinate system of the real world, and affect the display effect of an AR image.
Disclosure of Invention
The embodiment of the application provides a positioning method, a positioning device, positioning equipment and a computer storage medium of display equipment.
The technical scheme of the embodiment of the application is realized as follows:
the embodiment of the application provides a positioning method of display equipment, which comprises the following steps:
acquiring first attribute information of a detection object in the moving process of the display equipment;
monitoring the change of the attribute information of the detection object under the condition that the display equipment is determined to have a positioning fault based on the first attribute information, and obtaining changed second attribute information;
and repositioning the display device if the trigger condition for repositioning is determined to be met based on the second attribute information.
In some embodiments, the detection object includes the display device, the first attribute information includes a network state, and the determining that the display device has a positioning failure based on the first attribute information includes:
determining whether the network state of the display device is unconnected based on the first attribute information; and under the condition that the network state of the display equipment is unconnected, determining that the display equipment has positioning faults.
In some embodiments, the second attribute information includes a changed network state, and the determining that the trigger condition for relocation is satisfied based on the second attribute information includes:
and determining that the triggering condition for repositioning is met under the condition that the changed network state is connected.
In some embodiments, the detection object includes illumination in a real scene, the first attribute information includes a first illumination intensity, and acquiring the first attribute information of the detection object during movement of the display device includes:
acquiring a first image of a real scene in the moving process of the display equipment;
a first illumination intensity of illumination in the real scene is determined based on the first image.
In some embodiments, the determining that the display device has a positioning failure based on the first attribute information includes:
determining the magnitude relation between the first illumination intensity and an illumination intensity threshold value;
and under the condition that the first illumination intensity is smaller than the illumination intensity threshold value, determining that the display equipment has positioning faults.
In some embodiments, the second attribute information is a changed second illumination intensity, and the determining, based on the second attribute information, that a trigger condition for repositioning is satisfied includes:
And under the condition that the changed second illumination intensity is larger than or equal to the illumination intensity threshold value, determining that a trigger condition for repositioning is met.
In some embodiments, the detection object is a target object in a real scene, the first attribute information includes first identification information of the target object, and the acquiring the first attribute information of the detection object in a process of moving the display device includes:
acquiring a second image of the real scene in the process of moving the display device;
first identification information of a target object in the real scene is determined based on the second image.
In some embodiments, the determining that the display device has a positioning failure based on the first attribute information includes:
and under the condition that the first identification information comprises the target identification, determining that the display equipment has positioning faults.
In some embodiments, the second attribute information includes second identification information of the target object, and the determining that the trigger condition for repositioning is satisfied based on the second attribute information includes:
and under the condition that the second identification information does not comprise the target identification, determining that a trigger condition for repositioning is met.
The embodiment of the application provides a positioning device of a display device, including:
the acquisition module is used for acquiring first attribute information of the detection object in the moving process of the display equipment;
the monitoring module is used for monitoring the change of the attribute information of the detection object to obtain changed second attribute information under the condition that the display equipment is determined to have a positioning fault based on the first attribute information;
and the positioning module is used for positioning the display equipment again under the condition that the triggering condition for positioning again is determined to be met based on the second attribute information.
In some embodiments, the detection object includes the display device, the first attribute information includes a network state, and the monitoring module includes:
a first determining unit configured to determine, based on the first attribute information, whether a network state of the display device is unconnected;
and the second determining unit is used for determining that the display equipment has a positioning fault under the condition that the network state of the display equipment is unconnected.
In some embodiments, the second attribute information includes a changed network state, and the positioning module includes:
And a third determining unit, configured to determine that a trigger condition for relocation is satisfied, when the changed network state is connected.
In some embodiments, the detection object includes illumination in a real scene, the first attribute information includes a first illumination intensity, and the obtaining module includes:
the first acquisition unit is used for acquiring a first image of a real scene in the moving process of the display equipment;
and a fourth determining unit configured to determine a first illumination intensity of illumination in the real scene based on the first image.
In some embodiments, the monitoring module comprises:
a fifth determining unit, configured to determine a magnitude relation between the first illumination intensity and an illumination intensity threshold;
and a sixth determining unit, configured to determine that a positioning fault exists in the display device when it is determined that the first illumination intensity is less than the illumination intensity threshold.
In some embodiments, the second attribute information is a changed second illumination intensity, and the positioning module includes:
a seventh determining unit, configured to determine that a trigger condition for repositioning is satisfied, when it is determined that the changed second illumination intensity is greater than or equal to the illumination intensity threshold.
In some embodiments, the detection object is a target object in a real scene, the first attribute information includes first identification information of the target object, and the obtaining module includes:
the second acquisition unit is used for acquiring a second image of the real scene in the moving process of the display equipment;
an eighth determination unit is configured to determine first identification information of a target object in the real scene based on the second image.
In some embodiments, the monitoring module comprises:
and a ninth determining unit configured to determine that a positioning failure exists in the display device, in a case where it is determined that the target identifier is included in the first identifier information.
In some embodiments, the second attribute information includes second identification information of the target object, and the positioning module includes:
a tenth determination unit configured to determine that a trigger condition for relocation is satisfied, in a case where it is determined that the target identifier is not included in the second identifier information.
An embodiment of the present application provides a display device, including at least:
a processor;
a memory for storing a computer program executable on the processor; wherein the computer program when executed by a processor implements the steps of the method of positioning the display device.
Embodiments of the present application provide a computer storage medium having stored therein computer-executable instructions configured to perform steps of the method for positioning a display device.
The embodiment of the application provides a positioning method, a device, a display device and a computer storage medium of a display device, wherein in the moving process of the display device, detection objects (such as illumination of a real scene, network state of the display device and the like) are detected, when the presence of positioning faults of the display device is determined based on first attribute information of the detection objects, the change of the attribute information of the detection objects is monitored, and when the changed second attribute information meets a repositioning triggering condition, the display device is repositioned, so that a coordinate system of a virtual world and a coordinate system of the real world are realigned, and an AR image is displayed or the display effect of the AR image is improved.
Drawings
In the drawings (which are not necessarily drawn to scale), like numerals may describe similar components in different views. The drawings illustrate generally, by way of example and not by way of limitation, various embodiments discussed herein.
Fig. 1 is a schematic implementation flow chart of a positioning method of a display device according to an embodiment of the present application;
fig. 2 is a schematic implementation flow chart of another positioning method of a display device according to an embodiment of the present application;
fig. 3 is a schematic implementation flow chart of a positioning method of another display device according to an embodiment of the present application;
fig. 4 is a schematic implementation flow chart of a positioning method of another display device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a positioning device of a display apparatus according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a display device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the present application will be described in further detail with reference to the accompanying drawings, and the described embodiments should not be construed as limiting the present application, and all other embodiments obtained by those skilled in the art without making any inventive effort are within the scope of the present application.
In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is to be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments and can be combined with one another without conflict.
If a similar description of "first\second\third" appears in the application document, the following description is added, in which the terms "first\second\third" are merely distinguishing between similar objects and do not represent a particular ordering of the objects, it being understood that the "first\second\third" may be interchanged in a particular order or precedence, where allowed, so that the embodiments of the application described herein can be implemented in an order other than that illustrated or described herein.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the present application.
The embodiment of the application provides a positioning method of a display device, which is applied to the display device. The display device may be any electronic device capable of supporting an AR function, including but not limited to AR glasses, a tablet computer, a smart phone, a display screen with an AR function, etc., and the method provided in this embodiment may be implemented by a computer program, where the computer program completes each step in the method provided in this embodiment when executed. In some embodiments, the computer program may be executed by a processor in a display device. Fig. 1 is a schematic implementation flow chart of a positioning method of a display device according to an embodiment of the present application, as shown in fig. 1, where the method includes:
Step S101, during the movement of the display device, the first attribute information of the detection object is acquired.
In the embodiment of the application, the display device can be arranged on the preset sliding track, and the display device can be moved along the track through external force. In some embodiments, the display device may also be moved by the movement of the user while the user is carrying the display device.
In this embodiment of the present application, the detection object may be any one of the following: display device, illumination in a real scene, target object in a real scene. The first attribute information of the detection object may be a network state of the display device, or may be first illumination intensity of illumination in a real scene, or may be first identification information of a target object in the real scene, and exemplary target objects may include: elevator, escalator, building, stairway, etc., and correspondingly, the first identification information includes: elevator identification, escalator identification, building identification, stair identification, etc.
In this embodiment of the present application, when the first attribute information of the detection object is any one of first illumination intensity of illumination in a real scene or identification information of a target object in the real scene, an image of the real scene may be acquired by an image acquisition module disposed on a display device, and the first illumination intensity of illumination in the real scene is determined based on the acquired image of the real scene; and/or determining first identification information of the target object based on the acquired image of the real scene. The image acquisition module can be a camera, and can be arranged on one side of the display equipment, which is away from the display screen, can also be arranged on the side of the display equipment, where the screen of the display equipment is located, and can also be arranged on the adjacent side of the screen of the display equipment. The real scene may be a scene of a presentation of items, a mall use scene. When the attribute information of the detection object is the network state of the display device, the network state of the display device may be directly acquired.
Step S102, in the case that it is determined that the display device has a positioning fault based on the first attribute information, monitoring a change of the attribute information of the detection object, and obtaining second attribute information after the change.
In this embodiment of the present application, whether a positioning fault exists in the display device may be determined through the first attribute information, and in this embodiment of the present application, the positioning fault may be that a positioning function cannot be started, or may be that accuracy of a positioning result is lower. When the first attribute information includes a network state, it may be determined whether the network state of the display device is unconnected based on the first attribute information; and under the condition that the network state of the display equipment is unconnected, determining that the display equipment has positioning faults.
In some embodiments, the detection object includes illumination in a real scene, the first attribute information includes a first illumination intensity, and a magnitude relation between the first illumination intensity and an illumination intensity threshold can be determined; and under the condition that the first illumination intensity is smaller than the illumination intensity threshold value, determining that the display equipment has positioning faults.
In some embodiments, the detection object is a target object in a real scene, the first attribute information includes first identification information of the target object, and if it is determined that the first identification information includes the target identification, it is determined that a positioning fault exists in the display device. In this embodiment of the present application, the target identifier may be preset by the user, for example, in order to ensure the safety of using the display device by the user, when the user takes the escalator or goes upstairs or downstairs through the stairs, the display device stops displaying the AR image, so that the display device stops displaying the AR image when the escalator identifier and the stair identifier exist, and the positioning function is not started because the display device stops displaying the AR image.
In this embodiment of the present application, when it is determined that a positioning fault exists in the display device, the change of the attribute information of the detection object is monitored, and when monitoring, the attribute information of the detection object may be monitored in real time, or the attribute information of the detection object may be monitored in a preset period, for example, the attribute information of the detection object may be monitored in a preset period of 3 seconds.
In this embodiment of the present application, when detecting a change in the attribute information of the detection object, changed second attribute information is obtained.
And step S103, positioning the display equipment again under the condition that the triggering condition for positioning again is met based on the second attribute information.
In this embodiment of the present application, whether the relocation trigger condition is satisfied may be determined based on the second attribute information, and when the second attribute information includes a changed network state, and when the changed network state is connected, the relocation trigger condition is determined to be satisfied.
When the second attribute information is changed second illumination intensity, determining that a trigger condition for repositioning is met under the condition that the changed second illumination intensity is larger than or equal to the illumination intensity threshold value.
When the second attribute information includes second identification information of the target object, determining that a trigger condition for relocation is satisfied in a case where it is determined that the target identification is not included in the second identification information.
In this embodiment of the present application, when the trigger condition for repositioning is satisfied, repositioning the display device may be performed by acquiring position information of the display device, and after the position information of the display device is acquired, realigning the real world coordinate system and the virtual world coordinate system based on the position information and the acquired image.
The embodiment of the application provides a positioning method of display equipment, which is used for detecting a detection object (such as illumination of a real scene, a network of the display equipment and the like) in the moving process of the display equipment, monitoring the change of attribute information of the detection object when determining that the display equipment has a positioning fault based on first attribute information of the detection object, and repositioning the display equipment when the changed second attribute information meets a repositioning triggering condition, so that a coordinate system of a virtual world and a coordinate system of the real world are realigned to display an AR image or improve the display effect of the AR image.
An embodiment of the present application further provides a method for positioning a display device, where the detection object includes the display device, the first attribute information includes a network state, and fig. 2 is a schematic implementation flow diagram of another method for positioning a display device provided in the embodiment of the present application, as shown in fig. 2, and the method includes:
step S201, during the movement of the display device, acquires the network status of the display device.
In the embodiment of the application, the network connection state of the display device can be directly acquired. In the embodiment of the present application, the network status includes: unconnected and connected.
Step S202, determining whether the network state of the display device is unconnected based on the first attribute information.
In this embodiment, when it is determined that the network state of the display device is unconnected based on the first attribute information, step S203 is performed. When it is determined that the network connection of the display device is connected based on the first attribute information, step S206 is performed.
Step S203, determining that the display device has a positioning failure.
In the embodiment of the application, the real world coordinate system needs to be acquired by networking of the display device, and because the network state of the display device is unconnected, the existence of the positioning fault can be considered. In some embodiments, a correspondence relationship between the network state of the display device and whether to locate the fault may be preset, for example, the preset network state requirement of the display device is that no locating fault exists when connected, and the preset network state requirement of the display device is that no locating fault exists when connected. And if the network state of the display equipment is unconnected, a positioning fault exists. In the embodiment of the application, the positioning fault may be that the positioning function cannot be started, or the positioning result has lower precision, and the like.
Step S204, monitoring the change of the attribute information of the network state to obtain the changed network state.
Step S205, when the changed network state is connected, determining that a trigger condition for repositioning is satisfied, and repositioning the display device.
Step S206, positioning the display device again in a preset period.
In the embodiment of the present application, in the process of displaying the AR image by the display device, under the normal use condition, the coordinate system of the virtual world and the coordinate system of the real world may deviate based on time, so that the display device is repositioned in a preset period to ensure the display effect of the AR image.
According to the positioning method of the display device, when the display device is in a moving process, the display device can not be connected with a network, so that the alignment failure of a virtual coordinate system and a real coordinate system is caused, and the effect of an AR image displayed by the display device is affected.
An embodiment of the present application provides a method for positioning a display device, where the detected object includes illumination in a real scene, the first attribute information includes first illumination intensity, and fig. 3 is a schematic implementation flow diagram of another method for positioning a display device, as shown in fig. 3, where the method for positioning a display device includes:
step S301, during the movement of the display device, a first image of a real scene is acquired.
In this embodiment of the present application, the first image of the real scene may be acquired by an image acquisition module on the display device, where the image acquisition module may be a camera.
Step S302, determining a first illumination intensity of illumination in the real scene based on the first image.
In the embodiment of the application, the first image may be input into a pre-trained recognition model, and the illumination intensity of illumination in the real scene is determined. When determining the pre-trained recognition model, the initial model may be trained based on a sample image that is labeled with illumination and corresponding illumination intensity. The initial model can be a neural network model, and training is carried out on the initial model based on a sample image to obtain a trained recognition model. And after the trained recognition model is obtained, determining the first illumination intensity of illumination in the real scene based on the trained recognition model.
In some embodiments, similarity calculation may be further performed on the first image and a reference image in a preset image library, where the reference image in the preset image library is pre-labeled with illumination intensity, whether the similarity between the first image and the reference image in the preset image library is greater than a similarity threshold is determined, and when the similarity between the first image and a target reference image in the preset image library is greater than the similarity threshold, the first illumination intensity of illumination in a real scene may be determined.
Step S303, determining whether the first illumination intensity is smaller than an illumination intensity threshold.
In this embodiment of the present application, after obtaining the first illumination intensity of illumination in the real scene, the first illumination intensity may be compared with an illumination intensity threshold set in the system of the display device itself, so as to determine a magnitude relationship between the first illumination intensity and the illumination intensity threshold. In this embodiment of the present application, the illumination intensity threshold may be set according to a use condition, and may be an illumination intensity value representing that the illumination intensity is weaker, and when the first illumination intensity is smaller than the illumination intensity threshold, it is indicated that the illumination intensity is small, and the display device cannot identify the target object in the first image, that is, cannot align the coordinate system of the virtual world with the coordinate system of the real world. When the first illumination intensity is smaller than the illumination intensity threshold, step S304 is performed. When the first illumination intensity is greater than the illumination intensity threshold, step S308 is performed.
Step S304, determining that the display equipment has positioning faults.
Step S305, monitoring the change of the illumination intensity of the illumination, and obtaining a second illumination intensity after the change.
In this embodiment of the present application, when monitoring the illumination intensity change of the illumination, a third image of the real scene may be acquired, and the change of the illumination intensity is determined based on the third image, and the changed second illumination intensity is obtained.
Step S306, determining whether the second illumination intensity is greater than or equal to an illumination intensity threshold.
In this embodiment, when the second illumination intensity is less than the illumination intensity threshold, step S304 is performed, and when the second illumination intensity is greater than or equal to the illumination intensity threshold, step S307 is performed.
Step S307, determining that the triggering condition for repositioning is satisfied, and repositioning the display device.
Step S308, the display device is repositioned at a preset period.
According to the positioning method of the display device, when the illumination intensity of illumination in a real scene is smaller than the illumination threshold value in the moving process of the display device, the display device cannot identify a target object and cannot align a virtual coordinate system with a real coordinate system, so that the display device cannot display a virtual effect corresponding to the target object, at the moment, positioning faults are determined to exist in the display device, and when the change of the monitored illumination intensity is larger than the illumination intensity threshold value, the display device is triggered to be repositioned, so that the coordinate system of the virtual world and the coordinate system of the real world are realigned to display AR images, that is, when the target object cannot be identified, the display device is not positioned, and when the illumination is strong enough, the target image cannot be identified, the positioning failure rate can be reduced, and the power consumption of the display device can be reduced.
The embodiment of the present application further provides a method for positioning a display device, where the detection object is a target object in a real scene, the first attribute information includes first identification information of the target object, and fig. 4 is a schematic implementation flow chart of another method for positioning a display device provided in the embodiment of the present application, as shown in fig. 4, and the method includes:
step S401, collecting a second image of the real scene during the movement of the display device.
In this embodiment of the present application, the second image of the real scene may be acquired by a camera of the display device.
Step S402, determining first identification information of a target object in the real scene based on the second image.
In this embodiment of the present application, the second image may be input into a pre-trained recognition model, to determine the first identification information of the target object in the real scene. In the embodiment of the present application, the target object may be any entity in a real scene.
Step S403, determining whether the first identification information includes a target identification.
In this embodiment of the present application, it may be preset that the AR image is not displayed when the target identifier exists in the real scene. In an exemplary use scenario of a mall, an escalator exists in the mall, and in order to ensure the safety of a user, the display device stops displaying an AR image when identifying the escalator, wherein the target identifier is the escalator identifier.
In this embodiment of the present application, after the first identification information of the target object is identified, the first identification information may be compared with the target identification, when the target identification exists in the first identification information, step S404 is executed, and when the target identification does not exist in the first identification information, step S408 is executed.
Step S404, determining that the display device has a positioning fault.
With the above example in mind, since the display device stops displaying the AR image, the display device does not align the virtual world coordinate system with the real world coordinate system, i.e., there is a positioning failure. With the above example, when the escalator identification is included in the first identification information, it is determined that the display device has a positioning failure.
Step S405, monitoring a change of the identification information of the target object, to obtain second changed identification information.
In this embodiment of the present application, when the change of the identification information of the target object is checked, a fourth image of the real scene may be acquired, the change of the identification information is determined based on the fourth image, and the changed second identification information is obtained.
Step S406, determining whether the second identification information includes a target identification.
In the embodiment of the present application, when the second identification information includes the target identification, step S404 is continuously performed. In the case where the target identifier is not included in the second identifier information, step S407 is performed.
Step S407, determining that the triggering condition for repositioning is satisfied, and repositioning the display device.
With the above example, when the escalator identification is not included in the second identification information, it is determined that the trigger condition for relocation is satisfied.
In step S408, the display device is repositioned at a preset period.
According to the positioning method of the display device, in the moving process of the display device, when the first identification information of the target object in the real scene is collected and comprises the target identification (for example, the target identification can be the escalator identification and the stair identification), the situation that if the AR image is continuously displayed, potential safety hazards are possibly brought to a user is indicated, therefore, the display device is determined to have positioning faults, the AR image is stopped being displayed, when the second identification information is identified to not comprise the target identification, the user is indicated to be in a relatively safe environment, and at the moment, the display device is triggered to be positioned again, so that the coordinate system of the virtual world and the coordinate system of the real world are realigned, the AR image is displayed, and the safety of using the display device can be ensured.
The embodiment of the application provides a positioning method of display equipment, which can be realized by the following steps:
Mode one: detecting the network state of the display equipment, determining that repositioning is required when the network state does not meet the system requirement, and repositioning the display equipment when the network state meets the system requirement.
Because the real world coordinate system needs to be acquired by the display device in the networking state, in this embodiment, the system requirement may be that the network state is connected, so when the network state of the display device is unconnected, it indicates that the network state does not meet the system requirement, at this time, the change of the network state may be monitored, and when the network state changes to be connected, it indicates that the network state meets the system requirement, at this time, the display device is repositioned.
Mode two: detecting the collected images according to a set period or in real time, and determining whether repositioning is carried out according to the detection result of the images. In this embodiment of the present application, the image detection may be detecting illumination in a real scene and/or a target identifier of a target object in a real scene.
Taking illumination in a real scene as an example, the display device receives an RGB image shot by the camera, performs image recognition to recognize illumination intensity of illumination in the real scene, needs to be repositioned when the illumination intensity does not meet the system requirement (same as the illumination intensity threshold value in the above embodiments), and repositions the display device when the illumination intensity is detected to meet the system requirement.
Taking the identification of the target object in the real scene as an example, when the target identification exists, such as an elevator identification, the display device stops displaying the AR image in order to ensure the safety of the user. When there is no target identification, relocation is performed. The display device may receive the RGB image captured by the camera, perform image recognition to detect whether a target identifier exists in the display scene, and need to be repositioned when the target identifier is not detected.
Mode three: the virtual coordinate system and the real coordinate system are detected according to a set period or in real time, and when the deviation between the positions of the virtual coordinate system and the real coordinate system is larger than a deviation threshold value, the position of the display device is repositioned.
After the display device aligns the virtual coordinate system and the real coordinate system, a first reference point is determined in the real coordinate system, a second reference point corresponding to the first reference point in the virtual coordinate system is determined, a deviation value between the positions of the first reference point and the second reference point is obtained in the moving process of the display device, and when the deviation value is larger than a deviation threshold value, the position of the display device is repositioned.
Based on the foregoing embodiments, the embodiments of the present application provide a positioning apparatus for a display device, where each module included in the apparatus and each unit included in each module may be implemented by a processor in a computer device; of course, the method can also be realized by a specific logic circuit; in practice, the processor may be a central processing unit (CPU, central Processing Unit), a microprocessor (MPU, microprocessor Unit), a digital signal processor (DSP, digital Signal Processing), or a field programmable gate array (FPGA, field Programmable Gate Array), or the like.
An embodiment of the present application provides a positioning device of a display apparatus, and fig. 5 is a schematic structural diagram of the positioning device of the display apparatus provided in the embodiment of the present application, as shown in fig. 5, a positioning device 500 of the display apparatus includes:
an obtaining module 501, configured to obtain first attribute information of a detection object during a movement process of a display device;
a monitoring module 502, configured to monitor a change in attribute information of the detection object to obtain changed second attribute information when it is determined that a positioning fault exists in the display device based on the first attribute information;
and a positioning module 503, configured to reposition the display device if it is determined that the triggering condition for repositioning is met based on the second attribute information.
In some embodiments, the detection object includes the display device, the first attribute information includes a network state, and the monitoring module 502 includes:
a first determining unit configured to determine, based on the first attribute information, whether a network state of the display device is unconnected;
and the second determining unit is used for determining that the display equipment has a positioning fault under the condition that the network state of the display equipment is unconnected.
In some embodiments, the second attribute information includes a changed network state, and the positioning module 503 includes:
and a third determining unit, configured to determine that a trigger condition for relocation is satisfied, when the changed network state is connected.
In some embodiments, the detection object includes illumination in a real scene, the first attribute information includes a first illumination intensity, and the obtaining module 501 includes:
the first acquisition unit is used for acquiring a first image of a real scene in the moving process of the display equipment;
and a fourth determining unit configured to determine a first illumination intensity of illumination in the real scene based on the first image.
In some embodiments, the monitoring module 502 includes:
a fifth determining unit, configured to determine a magnitude relation between the first illumination intensity and an illumination intensity threshold;
and a sixth determining unit, configured to determine that a positioning fault exists in the display device when it is determined that the first illumination intensity is less than the illumination intensity threshold.
In some embodiments, the second attribute information is a changed second illumination intensity, and the positioning module 503 includes:
a seventh determining unit, configured to determine that a trigger condition for repositioning is satisfied, when it is determined that the changed second illumination intensity is greater than or equal to the illumination intensity threshold.
In some embodiments, the detection object is a target object in a real scene, the first attribute information includes first identification information of the target object, and the obtaining module 501 includes:
the second acquisition unit is used for acquiring a second image of the real scene in the moving process of the display equipment;
an eighth determination unit is configured to determine first identification information of a target object in the real scene based on the second image.
In some embodiments, the monitoring module 502 includes:
and a ninth determining unit configured to determine that a positioning failure exists in the display device, in a case where it is determined that the target identifier is included in the first identifier information.
In some embodiments, the second attribute information includes second identification information of the target object, and the positioning module includes:
a tenth determination unit configured to determine that a trigger condition for relocation is satisfied, in a case where it is determined that the target identifier is not included in the second identifier information.
It should be noted that, in the embodiment of the present application, if the positioning method of the display device is implemented in the form of a software functional module, and sold or used as a separate product, the positioning method may also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partly contributing to the prior art, and the computer software product may be stored in a storage medium, and include several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a magnetic disk, an optical disk, or other various media capable of storing program codes. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.
Accordingly, an embodiment of the present application provides a computer storage medium having a computer program stored thereon, wherein the computer program when executed by a processor implements the steps in the positioning method of a display device provided in the above embodiment.
An embodiment of the present application provides a positioning device of a display device, fig. 6 is a schematic structural diagram of the display device provided in the embodiment of the present application, as shown in fig. 6, a positioning device 600 of the display device includes: a processor 601, at least one communication bus 602, a user interface 603, at least one external communication interface 604 and a memory 605. Wherein the communication bus 602 is configured to enable connected communication between these components. The user interface 603 may include a display screen, and the external communication interface 604 may include a standard wired interface and a wireless interface, among others. Wherein the processor 601 is configured to execute a program of a positioning method of a display device stored in a memory to implement the steps in the positioning method of a display device provided in the above-described embodiment.
The above description of the positioning device and the storage medium embodiments of the display device is similar to the description of the method embodiments described above, with similar advantageous effects as the method embodiments. For technical details not disclosed in the embodiments of the computer apparatus and the storage medium of the present application, please refer to the description of the method embodiments of the present application.
It should be noted here that: the description of the storage medium and apparatus embodiments above is similar to that of the method embodiments described above, with similar benefits as the method embodiments. For technical details not disclosed in the embodiments of the storage medium and the apparatus of the present application, please refer to the description of the method embodiments of the present application for understanding.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in various embodiments of the present application, the sequence numbers of the foregoing processes do not mean the order of execution, and the order of execution of the processes should be determined by the functions and internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present application. The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above described device embodiments are only illustrative, e.g. the division of the units is only one logical function division, and there may be other divisions in practice, such as: multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or not performed. In addition, the various components shown or discussed may be coupled or directly coupled or communicatively coupled to each other via some interface, whether indirectly coupled or communicatively coupled to devices or units, whether electrically, mechanically, or otherwise.
The units described above as separate components may or may not be physically separate, and components shown as units may or may not be physical units; can be located in one place or distributed to a plurality of network units; some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may be separately used as one unit, or two or more units may be integrated in one unit; the integrated units may be implemented in hardware or in hardware plus software functional units.
Those of ordinary skill in the art will appreciate that: all or part of the steps for implementing the above method embodiments may be implemented by hardware related to program instructions, and the foregoing program may be stored in a computer readable storage medium, where the program, when executed, performs steps including the above method embodiments; and the aforementioned storage medium includes: a mobile storage device, a Read Only Memory (ROM), a magnetic disk or an optical disk, or the like, which can store program codes.
Alternatively, the integrated units described above may be stored in a computer readable storage medium if implemented in the form of software functional modules and sold or used as a stand-alone product. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or partly contributing to the prior art, embodied in the form of a software product stored in a storage medium, comprising several instructions for causing a controller to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a removable storage device, a ROM, a magnetic disk, or an optical disk.
The foregoing is merely an embodiment of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes and substitutions are intended to be covered in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A method of positioning a display device, the method comprising:
Acquiring first attribute information of a detection object in the moving process of the display equipment;
monitoring the change of the attribute information of the detection object under the condition that the display equipment is determined to have a positioning fault based on the first attribute information, and obtaining changed second attribute information;
repositioning the display device if it is determined that a trigger condition for repositioning is satisfied based on the second attribute information;
wherein the detection object is a target object in a real scene; the first attribute information comprises first identification information of the target object; the second attribute information comprises second identification information of the target object;
the determining that the display device has a positioning fault based on the first attribute information includes:
determining that the display equipment has a positioning fault under the condition that the first identification information comprises a preset target identification;
the determining, based on the second attribute information, that a trigger condition for repositioning is satisfied includes:
and under the condition that the second identification information does not comprise the target identification, determining that a trigger condition for repositioning is met.
2. The method of claim 1, wherein the detection object further comprises the display device, wherein the first attribute information further comprises a network status, wherein the determining that a positioning failure exists for the display device based on the first attribute information comprises:
determining whether the network state of the display device is unconnected based on the first attribute information;
and under the condition that the network state of the display equipment is unconnected, determining that the display equipment has positioning faults.
3. The method of claim 2, wherein the second attribute information further comprises a changed network state, wherein the determining that a trigger condition for relocation is satisfied based on the second attribute information comprises:
and determining that the triggering condition for repositioning is met under the condition that the changed network state is connected.
4. The method of claim 1, the detection object further comprising illumination in a real scene, the first attribute information further comprising a first illumination intensity, the acquiring the first attribute information of the detection object during movement of the display device comprising:
acquiring a first image of a real scene in the moving process of the display equipment;
A first illumination intensity of illumination in the real scene is determined based on the first image.
5. The method of claim 4, wherein the determining that a location fault exists for the display device based on the first attribute information comprises:
determining the magnitude relation between the first illumination intensity and an illumination intensity threshold value;
and under the condition that the first illumination intensity is smaller than the illumination intensity threshold value, determining that the display equipment has positioning faults.
6. The method of claim 5, the second attribute information further comprising a changed second illumination intensity, the determining that a trigger condition for repositioning is satisfied based on the second attribute information comprising:
and under the condition that the changed second illumination intensity is larger than or equal to the illumination intensity threshold value, determining that a trigger condition for repositioning is met.
7. The method of claim 1, wherein the acquiring the first attribute information of the detection object during the movement of the display device includes:
acquiring a second image of the real scene in the process of moving the display device;
first identification information of a target object in the real scene is determined based on the second image.
8. A positioning apparatus of a display device, characterized in that the positioning apparatus of the display device comprises:
the acquisition module is used for acquiring first attribute information of the detection object in the moving process of the display equipment;
the monitoring module is used for monitoring the change of the attribute information of the detection object to obtain changed second attribute information under the condition that the display equipment is determined to have a positioning fault based on the first attribute information;
the positioning module is used for positioning the display equipment again under the condition that the triggering condition for positioning again is met based on the second attribute information;
wherein the detection object is a target object in a real scene; the first attribute information comprises first identification information of a target object; the second attribute information comprises second identification information of the target object;
the monitoring module includes: a ninth determining unit, configured to determine that a positioning fault exists in the display device when it is determined that the first identification information includes a preset target identification;
the positioning module comprises: a tenth determination unit configured to determine that a trigger condition for relocation is satisfied, in a case where it is determined that the target identifier is not included in the second identifier information.
9. A display device, the display device comprising at least:
a processor;
a memory for storing a computer program executable on the processor;
wherein the computer program when executed by a processor carries out the steps of the method for positioning a display device according to any of claims 1 to 7.
10. A computer storage medium having stored therein computer executable instructions configured to perform the steps of the method of positioning a display device according to any of the preceding claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010942876.3A CN112348888B (en) | 2020-09-09 | 2020-09-09 | Positioning method and device of display device, display device and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010942876.3A CN112348888B (en) | 2020-09-09 | 2020-09-09 | Positioning method and device of display device, display device and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112348888A CN112348888A (en) | 2021-02-09 |
| CN112348888B true CN112348888B (en) | 2023-06-20 |
Family
ID=74357775
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010942876.3A Active CN112348888B (en) | 2020-09-09 | 2020-09-09 | Positioning method and device of display device, display device and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112348888B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111640183A (en) * | 2020-06-04 | 2020-09-08 | 上海商汤智能科技有限公司 | AR data display control method and device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5244012B2 (en) * | 2009-03-31 | 2013-07-24 | 株式会社エヌ・ティ・ティ・ドコモ | Terminal device, augmented reality system, and terminal screen display method |
| CN102958009B (en) * | 2011-08-26 | 2017-09-08 | 中兴通讯股份有限公司 | The transmission method and mobile augmented reality server of augmented reality information |
| US9619911B2 (en) * | 2012-11-13 | 2017-04-11 | Qualcomm Incorporated | Modifying virtual object display properties |
| CN103116451B (en) * | 2013-01-25 | 2018-10-26 | 腾讯科技（深圳）有限公司 | A kind of virtual character interactive of intelligent terminal, device and system |
| CN108615247B (en) * | 2018-04-27 | 2021-09-14 | 深圳市腾讯计算机系统有限公司 | Method, device and equipment for relocating camera attitude tracking process and storage medium |
| CN108596976B (en) * | 2018-04-27 | 2022-02-22 | 腾讯科技（深圳）有限公司 | Method, device and equipment for relocating camera attitude tracking process and storage medium |
| CN111583343B (en) * | 2020-06-17 | 2023-11-07 | 深圳市商汤科技有限公司 | Visual positioning method, related device, equipment and storage medium |
-
2020
- 2020-09-09 CN CN202010942876.3A patent/CN112348888B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111640183A (en) * | 2020-06-04 | 2020-09-08 | 上海商汤智能科技有限公司 | AR data display control method and device |
Non-Patent Citations (1)
| Title |
|---|
| 大差异复杂设备下的物联网故障容差性定位方法研究;程杰;周湘贞;姚青山;;计算机测量与控制(第04期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112348888A (en) | 2021-02-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180247361A1 (en) | Information processing apparatus, information processing method, wearable terminal, and program | |
| US20190163966A1 (en) | Suspicious person detection device, suspicious person detection method, and program | |
| CN102750709B (en) | Video is utilized to detect the method and apparatus of behavior of fighting | |
| EP3099061A1 (en) | Image search system and image search method | |
| CN111127508B (en) | Target tracking method and device based on video | |
| US11380140B2 (en) | Inspection assistance device, inspection assistance method, and recording medium | |
| CN112001886A (en) | Temperature detection method, device, terminal and readable storage medium | |
| CN103608761A (en) | Input device, input method and recording medium | |
| CN111179340A (en) | Object positioning method and device and computer system | |
| CN112990057A (en) | Human body posture recognition method and device and electronic equipment | |
| CN105530319A (en) | Detection method for queuing state information, system and server terminal having the system | |
| CN114663390A (en) | Intelligent anti-pinch method, device, equipment and storage medium for automatic door | |
| CN103442197A (en) | Device and method for recording road test of driver-training car | |
| CN113011280A (en) | Method and device for detecting person contact distance, computer equipment and storage medium | |
| US9070021B2 (en) | Monitoring method and camera | |
| CN112348888B (en) | Positioning method and device of display device, display device and computer storage medium | |
| CN110826646A (en) | Robot vision testing method and device, storage medium and terminal equipment | |
| CN113723276A (en) | Health code management method based on vein recognition and related device | |
| CN110264522B (en) | Article operator detection method, apparatus, device and storage medium | |
| CN113591713A (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN110705447B (en) | Hand image detection method and device and electronic equipment | |
| CN113076845A (en) | Parking space acquisition method, parking space determination device, vehicle and readable storage medium | |
| CN113509136A (en) | Detection method, vision detection method, device, electronic equipment and storage medium | |
| CN113780077A (en) | Target detection-based operation behavior specification detection method and device and terminal equipment | |
| CN109005357B (en) | Photographing method, photographing device and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |