CN115268749B - Control method of augmented reality equipment, mobile terminal and shielding prevention system - Google Patents
Control method of augmented reality equipment, mobile terminal and shielding prevention system Download PDFInfo
- Publication number
- CN115268749B CN115268749B CN202210862223.3A CN202210862223A CN115268749B CN 115268749 B CN115268749 B CN 115268749B CN 202210862223 A CN202210862223 A CN 202210862223A CN 115268749 B CN115268749 B CN 115268749B
- Authority
- CN
- China
- Prior art keywords
- angle
- augmented reality
- preset angle
- preset
- mobile terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 103
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000002265 prevention Effects 0.000 title description 2
- 230000004438 eyesight Effects 0.000 claims abstract description 6
- 230000001133 acceleration Effects 0.000 claims description 39
- 238000003860 storage Methods 0.000 claims description 19
- 238000010791 quenching Methods 0.000 claims description 13
- 230000000171 quenching effect Effects 0.000 claims description 13
- 239000011521 glass Substances 0.000 claims description 11
- 230000002452 interceptive effect Effects 0.000 claims description 8
- 238000004891 communication Methods 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000000903 blocking effect Effects 0.000 description 3
- 208000004350 Strabismus Diseases 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Abstract
The application provides a control method of augmented reality equipment, a mobile terminal and an anti-shielding system, wherein the method comprises the steps of obtaining a first angle sensed by the augmented reality equipment, wherein the first angle is an included angle between a human eye sight line of a user wearing the augmented reality equipment and a horizontal line; acquiring a second angle sensed by the mobile terminal, wherein the second angle is an included angle between a display interface of the mobile terminal and a horizontal plane; according to first angle and second angle, confirm whether control augmented reality equipment and put out the screen, first angle that the augmented reality equipment sensed and the second angle that mobile terminal sensed through acquireing, can judge whether wear the user of augmented reality equipment and go low to look over mobile terminal, thereby confirm whether control augmented reality equipment and put out the screen, prevent when the user wants to look over mobile terminal, the content that the augmented reality equipment shows shelters from user's sight, and then solved current scheme and need the user initiative to initiate in order to avoid preventing AR from sheltering from the problem of cell-phone picture.
Description
Technical Field
The application relates to the technical field of augmented reality equipment, in particular to a control method of augmented reality equipment, a mobile terminal, an anti-shielding system, a computer readable storage medium and a processor.
Background
When the AR content is in an automatic follow mode (i.e., the content is always followed and stays in front of the user's line of sight regardless of where the user looks), there is a problem of content occlusion when the user picks up the cell phone to see. The usual solutions fall into the following categories: performing screen quenching operation through active interaction; strabismus through a gap below the glasses; and taking off the glasses. At present, all the modes need to be actively initiated by a user, and the user experience is not friendly in most scenes.
Disclosure of Invention
The main objective of the present application is to provide a control method for an augmented reality device, a mobile terminal, an anti-occlusion system, a computer readable storage medium and a processor, so as to solve the problem that the existing scheme needs to be actively initiated by a user to avoid the AR from occluding a mobile phone picture.
In order to achieve the above object, according to one aspect of the present application, there is provided a control method of an augmented reality device, the method comprising: acquiring a first angle sensed by augmented reality equipment, wherein the first angle is an included angle between a human eye sight line of a user wearing the augmented reality equipment and a horizontal line; acquiring a second angle sensed by a mobile terminal, wherein the second angle is an included angle between a display interface of the mobile terminal and a horizontal plane; and determining whether to control the augmented reality device to turn off the screen according to the first angle and the second angle.
Further, determining whether to control the augmented reality device to turn off the screen according to the first angle and the second angle includes: acquiring a first preset angle and a second preset angle; acquiring the magnitude relation between the first angle and the first preset angle; acquiring the magnitude relation between the second angle and the second preset angle; and determining whether to control the screen quenching of the augmented reality equipment according to the magnitude relation between the first angle and the first preset angle and the magnitude relation between the second angle and the second preset angle.
Further, according to the magnitude relation between the first angle and the first preset angle and the magnitude relation between the second angle and the second preset angle, determining whether to control the augmented reality device to extinguish the screen includes: determining to control the augmented reality device to turn off the screen when the first angle is greater than or equal to the first preset angle and the second angle is greater than or equal to the second preset angle; and determining to keep the augmented reality device bright screen under the condition that the first angle is smaller than the first preset angle or the second angle is smaller than the second preset angle.
Further, the method further comprises: acquiring a third preset angle and a fourth preset angle, wherein the third preset angle is smaller than the first preset angle, and the fourth preset angle is smaller than the second preset angle; acquiring the magnitude relation between the first angle and the third preset angle; acquiring the magnitude relation between the second angle and the fourth preset angle; and determining whether to output early warning information according to the magnitude relation between the first angle and the third preset angle and the magnitude relation between the second angle and the fourth preset angle.
Further, determining whether to output the early warning information according to the magnitude relation between the first angle and the third preset angle and the magnitude relation between the second angle and the fourth preset angle includes: and under the condition that the first angle is equal to the third preset angle and the second angle is equal to the fourth preset angle, determining to output the early warning information.
Further, obtaining the second angle sensed by the mobile terminal includes: acquiring angular velocity data acquired by a gyroscope of the mobile terminal and acceleration data acquired by an acceleration sensor of the mobile terminal; and determining the second angle according to the angular velocity data and the acceleration data.
Further, determining the second angle from the angular velocity data and the acceleration data includes: acquiring a vector difference between an acceleration component in the vertical direction in the acceleration vector acquired at the current time and an acceleration component in the vertical direction in the acceleration vector acquired at the last time; compensating the angular velocity data according to the vector difference to obtain a compensation result; updating the quaternion of the compensation result to obtain an updated quaternion; and converting the updated quaternion into an Euler angle, and determining the second angle.
Further, the method further comprises: controlling the augmented reality device to display an interactive interface at the central position of the FOV region; and controlling the augmented reality device to generate a target object in the 3D virtual scene in response to a predetermined operation, wherein the predetermined operation is an operation acting on the interactive interface.
According to another aspect of the application, there is provided a mobile terminal, which includes a first acquiring unit, a second acquiring unit and a control unit, where the first acquiring unit is configured to acquire a first angle sensed by an augmented reality device, where the first angle is an angle between a human eye line of sight of a user wearing the augmented reality device and a horizontal line; the second acquisition unit is used for acquiring a second angle sensed by the mobile terminal, wherein the second angle is an included angle between a display interface of the mobile terminal and a horizontal plane; and the control unit is used for determining whether to control the augmented reality equipment to turn off the screen according to the first angle and the second angle.
According to another aspect of the present application, there is provided an anti-occlusion system comprising AR glasses in communication with a mobile terminal comprising an inertial sensor, and a mobile terminal for performing any of the methods described above.
According to another aspect of the present application, there is provided a computer readable storage medium, the computer readable storage medium including a stored program, wherein the program when run controls a device in which the computer readable storage medium is located to perform any one of the methods described above.
According to another aspect of the present application, there is provided a processor for running a program, wherein the program when run performs any one of the methods described above.
By the aid of the technical scheme, whether a user wearing the augmented reality device is low in head or not can be judged to check the mobile terminal by acquiring the first angle sensed by the augmented reality device and the second angle sensed by the mobile terminal, whether the augmented reality device is controlled to be out of screen is determined, the situation that the user wants to check the mobile terminal is prevented that the content displayed by the augmented reality device shields the user's sight, and the problem that the user needs to actively initiate to avoid AR shielding of a mobile phone picture is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:
fig. 1 shows a flow diagram of a control method of an augmented reality device according to an embodiment of the invention;
FIG. 2 shows a schematic diagram of an AR conventional usage scenario in accordance with an embodiment of the present invention;
FIG. 3 illustrates a schematic view of a scenario when a mobile terminal is viewed in AR use, according to an embodiment of the present invention;
FIG. 4 illustrates a schematic view of a first angle and a second angle scene according to an embodiment of the invention;
FIG. 5 illustrates another first angle and second angle scene schematic according to an embodiment of the invention;
fig. 6 shows a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.
Detailed Description
In order to make the present application solution better understood by those skilled in the art, the following description will be made in detail and with reference to the accompanying drawings in the embodiments of the present application, it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present application.
When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims.
It should be noted that the terms "first," "second," and the like in the description and claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Furthermore, in the description of the present application, unless otherwise indicated, "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.
For convenience of description, the following will describe some terms or terms related to the embodiments of the present application:
FOV: the AR interactively feeds back the Field angle (fieldofview) Of the glasses.
When the AR content is in an automatic follow mode (i.e., the content is always followed and stays in front of the user's line of sight regardless of where the user looks), there is a problem of content occlusion when the user picks up the cell phone to see. The usual solutions fall into the following categories: performing screen quenching operation through active interaction; strabismus through a gap below the glasses; and taking off the glasses. At present, all the modes need to be actively initiated by a user, and the user experience is not friendly in most scenes.
In order to solve the above problems, the application provides a control method of an augmented reality device, a mobile terminal, an anti-blocking system, a computer readable storage medium and a processor, so as to solve the problem that the prior art needs to be actively initiated by a user to avoid blocking a mobile phone picture by AR.
Example 1
According to an embodiment of the present invention, there is provided a control method embodiment of an augmented reality device, it being noted that the steps shown in the flowchart of the drawings may be performed in a computer system such as a set of computer executable instructions, and that although a logical order is shown in the flowchart, in some cases the steps shown or described may be performed in an order different from that herein.
Fig. 1 is a flowchart of a control method of an augmented reality device according to an embodiment of the invention, as shown in fig. 1, the method includes the following steps:
step S101, acquiring a first angle sensed by augmented reality equipment, wherein the first angle is an included angle between a human eye sight line of a user wearing the augmented reality equipment and a horizontal line;
step S102, obtaining a second angle sensed by the mobile terminal, wherein the second angle is an included angle between a display interface of the mobile terminal and a horizontal plane;
step S103, determining whether to control the augmented reality device to turn off the screen according to the first angle and the second angle.
In the above steps, by obtaining the first angle sensed by the augmented reality device and the second angle sensed by the mobile terminal, it is determined whether the user wearing the augmented reality device is low to check the mobile terminal, thereby determining whether to control the screen quenching of the augmented reality device, preventing the content displayed by the augmented reality device from shielding the user's sight when the user wants to check the mobile terminal, further solving the problem that the user needs to actively initiate to avoid shielding the mobile phone picture by the AR in the prior art, the augmented reality device can be the AR, the mobile terminal can be a smart phone, solving the pain point that the user wants to acquire the mobile phone information without obstacle when wearing AR glasses, and the user does not need to actively operate the screen quenching or take off the glasses, thereby saving the time of the user and improving the user experience. Meanwhile, the method fully utilizes the existing sensor, and does not need to increase the hardware cost additionally.
Optionally, determining whether to control the augmented reality device to turn off the screen according to the first angle and the second angle includes: acquiring a first preset angle and a second preset angle; acquiring the magnitude relation between the first angle and the first preset angle; acquiring the magnitude relation between the second angle and the second preset angle; determining whether to control the screen quenching of the augmented reality device according to the size relation between the first angle and the first preset angle and the size relation between the first angle and the second preset angle, and judging whether a user wearing the augmented reality device is low in head or not to check the mobile terminal according to the size relation between the first angle and the first preset angle and the size relation between the second angle and the second preset angle, so as to determine whether to control the screen quenching of the augmented reality device.
Optionally, determining whether to control the screen quenching of the augmented reality device according to the magnitude relation between the first angle and the first preset angle and the magnitude relation between the second angle and the second preset angle includes: determining to control the augmented reality device to turn off the screen when the first angle is greater than or equal to the first preset angle and the second angle is greater than or equal to the second preset angle; determining to keep the augmented reality device on the screen when the first angle is smaller than the first preset angle or the second angle is smaller than the second preset angle, determining to control the augmented reality device to turn off the screen when the first angle is larger than or equal to the first preset angle and the second angle is larger than or equal to the second preset angle, judging that a user wearing the augmented reality device is looking at the mobile terminal at a low head, preventing the content displayed by the augmented reality device from blocking the user's sight when the user wants to look at the mobile terminal, fig. 2 is a schematic diagram of a conventional use scenario of AR according to an embodiment of the present invention, as shown in fig. 2, the AR does not block a mobile phone picture when the AR is used conventionally, the user can experience AR, fig. 3 is a schematic view of a scene when the mobile terminal is viewed during use of the AR according to an embodiment of the present invention, as shown in fig. 3, it can be seen that the AR is also turned down along with the user when the user is low, and thus a situation that the AR blocks a display screen of the mobile terminal may occur, fig. 4 is a schematic view of a scene according to an embodiment of the present invention, for example, a first preset angle is 15 °, a second preset angle is 20 °, and when the first angle is 25 °, the second angle is 30 °, and because the first angle is greater than the first preset angle and the second angle is greater than the second preset angle, the augmented reality device is controlled to turn off the screen, and fig. 5 is another schematic view of a scene according to another first angle and the second angle according to an embodiment of the present invention, as shown in fig. 5, and also the augmented reality device is controlled to turn off the screen when the first angle is 0 °, and the second angle is 80 °.
In a specific embodiment, acquiring a first angle sensed by the augmented reality device through an inertial sensor of the augmented reality device, wherein the first angle is an included angle between a human eye line of sight of a user wearing the augmented reality device and a horizontal line; the inertial sensor of the mobile device obtains a second angle sensed by the mobile terminal, wherein the second angle is an included angle between a display interface of the mobile terminal and a horizontal plane; the inertial sensor of the augmented reality device sends a first angle to the mobile device, and the mobile device determines whether to control the screen quenching of the augmented reality device according to the first angle and a second angle, for example, the first preset angle is 15 degrees, the second preset angle is 20 degrees, when the first angle is 25 degrees, the second angle is 30 degrees, and the screen quenching of the augmented reality device is controlled because the first angle is larger than the first preset angle and the second angle is larger than the second preset angle.
Optionally, the method further comprises: acquiring a third preset angle and a fourth preset angle, wherein the third preset angle is smaller than the first preset angle, and the fourth preset angle is smaller than the second preset angle; acquiring the magnitude relation between the first angle and the third preset angle; acquiring the magnitude relation between the second angle and the fourth preset angle; and determining whether to output early warning information according to the magnitude relation between the first angle and the third preset angle and the magnitude relation between the second angle and the fourth preset angle, and informing a user to continuously lower the head and/or continuously lift the smart phone by outputting the early warning information, so that the augmented reality equipment is extinguished.
Optionally, determining whether to output the early warning information according to the magnitude relation between the first angle and the third preset angle and the magnitude relation between the second angle and the fourth preset angle includes: and under the condition that the first angle is equal to the third preset angle and the second angle is equal to the fourth preset angle, determining to output the early warning information and giving a prompt effect to a user, so that the experience effect of the user is improved, for example, the first preset angle is 15 degrees, the second preset angle is 20 degrees, the third preset angle is 12 degrees, the fourth preset angle is 17 degrees, and under the condition that the first angle is 12 degrees and the second angle is 17 degrees, outputting the early warning information to remind the user.
Optionally, acquiring the second angle sensed by the mobile terminal includes: acquiring angular velocity data acquired by a gyroscope of the mobile terminal and acceleration data acquired by an acceleration sensor of the mobile terminal; and determining the second angle according to the angular velocity data and the acceleration data, so that the second angle can be rapidly and accurately acquired.
Optionally, determining the second angle according to the angular velocity data and the acceleration data includes: acquiring a vector difference between the acceleration component in the vertical direction in the acceleration vector acquired at the current time and the acceleration component in the vertical direction in the acceleration vector acquired at the last time; compensating the angular velocity data according to the vector difference to obtain a compensation result; updating the quaternion of the compensation result to obtain an updated quaternion; and converting the updated quaternion into an Euler angle, and determining the second angle, so that the second angle can be acquired rapidly and accurately.
A specific embodiment, the vector difference between the acceleration component in the vertical direction in the above-described acceleration vector and the acceleration component in the vertical direction in the last-acquired acceleration vector is represented by the product of the acceleration component in the vertical direction in the above-described acceleration vector and the acceleration component in the vertical direction in the last-acquired acceleration vector, specifically, according to the formula: gyrout=gyro+ (Gain) wherein gyrout is angular velocity data after calibration, gyro is original angular velocity data, gain is calibration Gain, compensation effect is adjusted by setting the magnitude of Gain, and gerror is a quantized form of vector error, and quaternion refers to a result after quaternion calculation update of the compensation result, according to the formula: q (t+t) =q (T) +t Ω (T) ×q (T), where q (t+t) is an updated quaternion, representing that the quaternion is updated from time T to time (t+t), T is time, representing that time T has elapsed from time T to time (t+t), q (T) is a quaternion at time T, and Ω (T) is an angular velocity increment at time T, that is, an increment at time T of the calibrated angular velocity data.
Optionally, the method further comprises: controlling the augmented reality device to display an interactive interface at the central position of the FOV region; and controlling the augmented reality device to generate a target object in the 3D virtual scene in response to a predetermined operation, wherein the predetermined operation is an operation acting on the interactive interface.
Example 2
According to the embodiment of the present invention, a mobile terminal is provided, which can execute the control method of the augmented reality device provided in the embodiment 1, and the specific implementation manner and the preferred application scenario are the same as those of the embodiment 1, and are not repeated here.
Fig. 6 is a schematic structural view of a mobile terminal according to an embodiment of the present invention, and as shown in fig. 6, the mobile terminal includes a first acquiring unit 10, a second acquiring unit 20, and a control unit 30;
the first obtaining unit 10 is configured to obtain a first angle sensed by the augmented reality device, where the first angle is an angle between a line of sight of a human eye of a user wearing the augmented reality device and a horizontal line; the second obtaining unit 20 is configured to obtain a second angle sensed by the mobile terminal, where the second angle is an included angle between a display interface of the mobile terminal and a horizontal plane; the control unit 30 is configured to determine whether to control the augmented reality device to turn off the screen according to the first angle and the second angle.
According to the mobile terminal, the first angle sensed by the augmented reality device and the second angle sensed by the mobile terminal are acquired through the first acquisition unit and the second acquisition unit, whether a user wearing the augmented reality device is low in head or not can be judged to check the mobile terminal, whether the augmented reality device is controlled to be out of screen is determined through the control unit, the situation that the content displayed by the augmented reality device blocks the user sight when the user wants to check the mobile terminal is prevented, and the problem that the user needs to actively initiate to avoid AR blocking a mobile phone picture is solved.
Optionally, the control unit includes a first acquisition module, a second acquisition module, a third acquisition module, and a control module; the first acquisition module is used for acquiring a first preset angle and a second preset angle; the second acquisition module is used for acquiring the magnitude relation between the first angle and the first preset angle; the third acquisition module is used for acquiring the magnitude relation between the second angle and the second preset angle; the control module is used for determining whether to control the screen quenching of the augmented reality device according to the magnitude relation between the first angle and the first preset angle and the magnitude relation between the second angle and the second preset angle, and judging whether a user wearing the augmented reality device is low in head or not to check the mobile terminal according to the magnitude relation between the first angle and the first preset angle and the magnitude relation between the second angle and the second preset angle, so that whether to control the screen quenching of the augmented reality device is determined.
Optionally, the first control module includes a first control sub-module and a second control sub-module, where the first control sub-module is configured to determine to control the augmented reality device to turn off the screen when the first angle is greater than or equal to the first preset angle and the second angle is greater than or equal to the second preset angle; the second control submodule is used for determining to keep the augmented reality device on the screen when the first angle is smaller than the first preset angle or the second angle is smaller than the second preset angle, and determining to control the augmented reality device to turn off the screen when the first angle is larger than or equal to the first preset angle and the second angle is larger than or equal to the second preset angle so as to judge that a user wearing the augmented reality device looks at the mobile terminal at a low head, so that the content displayed by the augmented reality device is prevented from shielding the user's vision when the user wants to look at the mobile terminal.
Optionally, the mobile terminal further includes a third acquiring unit, a fourth acquiring unit, a fifth acquiring unit and an alarm unit, where the third acquiring unit is configured to acquire a third preset angle and a fourth preset angle, the third preset angle is smaller than the first preset angle, and the fourth preset angle is smaller than the second preset angle; the fourth acquisition unit is used for acquiring the magnitude relation between the first angle and the third preset angle; the fifth acquisition unit is used for acquiring the magnitude relation between the second angle and the fourth preset angle; the alarm unit is used for determining whether to output early warning information according to the magnitude relation between the first angle and the third preset angle and the magnitude relation between the second angle and the fourth preset angle, and informing a user to continuously lower the head and/or continuously lift the smart phone by outputting the early warning information, so that the augmented reality equipment can be extinguished.
Optionally, the alarm unit includes a second control module, where the second control module determines to output the early warning information and gives the user a prompt effect when the first angle is equal to the third preset angle and the second angle is equal to the fourth preset angle, so that the experience effect of the user is improved.
Optionally, the second obtaining unit includes a fourth obtaining module and a determining module, where the fourth obtaining module is configured to obtain angular velocity data collected by a gyroscope of the mobile terminal and acceleration data collected by an acceleration sensor of the mobile terminal; the determining module is used for determining the second angle according to the angular speed data and the acceleration data, so that the second angle can be rapidly and accurately obtained.
Optionally, the determining module includes an acquiring sub-module, a compensating sub-module, an updating sub-module and a determining sub-module, where the acquiring sub-module is configured to acquire a vector difference between an acceleration component in a vertical direction in an acceleration vector acquired at the present time and an acceleration component in a vertical direction in an acceleration vector acquired at the last time; the compensation sub-module is used for compensating the angular velocity data according to the vector difference to obtain a compensation result; the updating sub-module is used for carrying out quaternion updating on the compensation result to obtain an updated quaternion; the determining sub-module is used for converting the updated quaternion into an Euler angle, determining the second angle and rapidly and accurately acquiring the second angle.
Optionally, the mobile terminal further includes a first command unit and a second command unit, where the first command unit is configured to control the augmented reality device to display an interactive interface at a central position of the FOV area; the second volatilizing unit is used for responding to a preset operation, wherein the preset operation is an operation acting on the interactive interface, and the preset operation is used for controlling the augmented reality device to generate a target object in the 3D virtual scene.
Example 3
According to another aspect of the present application, there is provided an anti-occlusion system, the anti-occlusion system including AR glasses and a mobile terminal, the AR glasses being in communication with the mobile terminal, the mobile terminal including an inertial sensor, the mobile terminal being configured to perform the steps of the control method of the augmented reality device in embodiment 1.
Example 4
The present embodiment also provides a computer storage medium, which may store a plurality of programs adapted to be loaded by a processor and to execute the steps of the control method of the augmented reality device in embodiment 1.
The device on which the storage medium is located may be a mobile terminal.
Example 5
According to another aspect of the present application, there is provided a processor for running a program, wherein the program runs to execute the steps of the control method of the augmented reality device in embodiment 1.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises an element.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.
Claims (10)
1. A method of controlling an augmented reality device, the method comprising:
acquiring a first angle sensed by augmented reality equipment, wherein the first angle is an included angle between a human eye sight line of a user wearing the augmented reality equipment and a horizontal line;
acquiring a second angle sensed by a mobile terminal, wherein the second angle is an included angle between a display interface of the mobile terminal and a horizontal plane;
determining whether to control the augmented reality device to turn off the screen according to the first angle and the second angle;
wherein determining whether to control the augmented reality device to turn off the screen according to the first angle and the second angle comprises: acquiring a first preset angle and a second preset angle; acquiring the magnitude relation between the first angle and the first preset angle; acquiring the magnitude relation between the second angle and the second preset angle; determining whether to control the screen quenching of the augmented reality device according to the magnitude relation between the first angle and the first preset angle and the magnitude relation between the first angle and the second angle;
wherein, according to the magnitude relation between the first angle and the first preset angle, and the magnitude relation between the second angle and the second preset angle, determining whether to control the augmented reality device to turn off the screen comprises: determining to control the augmented reality device to turn off the screen when the first angle is greater than or equal to the first preset angle and the second angle is greater than or equal to the second preset angle; and determining to keep the augmented reality device bright screen under the condition that the first angle is smaller than the first preset angle or the second angle is smaller than the second preset angle.
2. The method according to claim 1, wherein the method further comprises:
acquiring a third preset angle and a fourth preset angle, wherein the third preset angle is smaller than the first preset angle, and the fourth preset angle is smaller than the second preset angle;
acquiring the magnitude relation between the first angle and the third preset angle;
acquiring the magnitude relation between the second angle and the fourth preset angle;
and determining whether to output early warning information according to the magnitude relation between the first angle and the third preset angle and the magnitude relation between the second angle and the fourth preset angle.
3. The method of claim 2, wherein determining whether to output the pre-warning information based on the magnitude relation of the first angle and the third preset angle and the magnitude relation of the second angle and the fourth preset angle comprises:
and under the condition that the first angle is equal to the third preset angle and the second angle is equal to the fourth preset angle, determining to output the early warning information.
4. The method of claim 1, wherein obtaining the second angle sensed by the mobile terminal comprises:
acquiring angular velocity data acquired by a gyroscope of the mobile terminal and acceleration data acquired by an acceleration sensor of the mobile terminal;
and determining the second angle according to the angular velocity data and the acceleration data.
5. The method of claim 4, wherein determining the second angle from the angular velocity data and the acceleration data comprises:
acquiring a vector difference between an acceleration component in the vertical direction in the acceleration vector acquired at the current time and an acceleration component in the vertical direction in the acceleration vector acquired at the last time;
compensating the angular velocity data according to the vector difference to obtain a compensation result;
updating the quaternion of the compensation result to obtain an updated quaternion;
and converting the updated quaternion into an Euler angle, and determining the second angle.
6. The method according to claim 1, wherein the method further comprises:
controlling the augmented reality device to display an interactive interface at the central position of the FOV region;
and controlling the augmented reality device to generate a target object in the 3D virtual scene in response to a predetermined operation, wherein the predetermined operation is an operation acting on the interactive interface.
7. A mobile terminal, comprising:
the first acquisition unit is used for acquiring a first angle sensed by the augmented reality equipment, wherein the first angle is an included angle between the eye sight line of a user wearing the augmented reality equipment and a horizontal line;
the second acquisition unit is used for acquiring a second angle sensed by the mobile terminal, wherein the second angle is an included angle between a display interface of the mobile terminal and a horizontal plane;
the control unit is used for determining whether to control the augmented reality equipment to turn off the screen according to the first angle and the second angle;
the control unit further comprises a first acquisition module, a second acquisition module, a third acquisition module and a control module, wherein the first acquisition module is used for acquiring a first preset angle and a second preset angle; the second acquisition module is used for acquiring the magnitude relation between the first angle and the first preset angle; the third acquisition module is used for acquiring the magnitude relation between the second angle and the second preset angle; the control module is used for determining whether to control the augmented reality equipment to turn off the screen according to the magnitude relation between the first angle and the first preset angle and the magnitude relation between the second angle and the second preset angle;
the control module comprises a first control submodule and a second control submodule, wherein the first control submodule is used for determining to control the augmented reality equipment to turn off the screen when the first angle is larger than or equal to the first preset angle and the second angle is larger than or equal to the second preset angle; the second control submodule is used for determining to keep the augmented reality device on the screen when the first angle is smaller than the first preset angle or the second angle is smaller than the second preset angle.
8. An anti-occlusion system comprising AR glasses in communication with a mobile terminal comprising an inertial sensor, the mobile terminal being adapted to perform the method of any of claims 1 to 6.
9. A computer readable storage medium, characterized in that the computer readable storage medium comprises a stored program, wherein the program when run controls a device in which the computer readable storage medium is located to perform the method according to any one of claims 1 to 6.
10. A processor for running a program, wherein the program when run performs the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210862223.3A CN115268749B (en) | 2022-07-20 | 2022-07-20 | Control method of augmented reality equipment, mobile terminal and shielding prevention system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210862223.3A CN115268749B (en) | 2022-07-20 | 2022-07-20 | Control method of augmented reality equipment, mobile terminal and shielding prevention system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115268749A CN115268749A (en) | 2022-11-01 |
| CN115268749B true CN115268749B (en) | 2024-04-09 |
Family
ID=83766098
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210862223.3A Active CN115268749B (en) | 2022-07-20 | 2022-07-20 | Control method of augmented reality equipment, mobile terminal and shielding prevention system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115268749B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108462986A (en) * | 2018-02-05 | 2018-08-28 | 广东欧珀移动通信有限公司 | The screen control method and device of terminal, readable storage medium storing program for executing, terminal |
| CN110401773A (en) * | 2019-07-22 | 2019-11-01 | Oppo广东移动通信有限公司 | The control method and relevant apparatus of screen state |
| WO2020115576A1 (en) * | 2018-12-04 | 2020-06-11 | Eden Immersive Limited | A virtual reality or augmented reality headset accessory |
| CN111542802A (en) * | 2018-09-21 | 2020-08-14 | 华为技术有限公司 | Method for shielding touch event and electronic equipment |
| WO2021031755A1 (en) * | 2019-08-19 | 2021-02-25 | Oppo广东移动通信有限公司 | Interactive method and system based on augmented reality device, electronic device, and computer readable medium |
| CN113407053A (en) * | 2019-10-15 | 2021-09-17 | 荣耀终端有限公司 | Touch screen, electronic equipment and display control method |
| CN114356082A (en) * | 2021-12-20 | 2022-04-15 | 歌尔光学科技有限公司 | Image optimization method and device of augmented reality equipment, electronic equipment and system |
| CN114527864A (en) * | 2020-11-19 | 2022-05-24 | 京东方科技集团股份有限公司 | Augmented reality text display system, method, device, and medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20210327571A1 (en) * | 2020-04-16 | 2021-10-21 | At&T Intellectual Property I, L.P. | Facilitation of augmented reality for well-being assessments |
-
2022
- 2022-07-20 CN CN202210862223.3A patent/CN115268749B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108462986A (en) * | 2018-02-05 | 2018-08-28 | 广东欧珀移动通信有限公司 | The screen control method and device of terminal, readable storage medium storing program for executing, terminal |
| CN111542802A (en) * | 2018-09-21 | 2020-08-14 | 华为技术有限公司 | Method for shielding touch event and electronic equipment |
| WO2020115576A1 (en) * | 2018-12-04 | 2020-06-11 | Eden Immersive Limited | A virtual reality or augmented reality headset accessory |
| CN110401773A (en) * | 2019-07-22 | 2019-11-01 | Oppo广东移动通信有限公司 | The control method and relevant apparatus of screen state |
| WO2021031755A1 (en) * | 2019-08-19 | 2021-02-25 | Oppo广东移动通信有限公司 | Interactive method and system based on augmented reality device, electronic device, and computer readable medium |
| CN113407053A (en) * | 2019-10-15 | 2021-09-17 | 荣耀终端有限公司 | Touch screen, electronic equipment and display control method |
| CN114527864A (en) * | 2020-11-19 | 2022-05-24 | 京东方科技集团股份有限公司 | Augmented reality text display system, method, device, and medium |
| CN114356082A (en) * | 2021-12-20 | 2022-04-15 | 歌尔光学科技有限公司 | Image optimization method and device of augmented reality equipment, electronic equipment and system |
Non-Patent Citations (2)
| Title |
|---|
| 基于Android光线传感器的实现及数据优化算法;李永壮;李昌兴;王欢;;西安邮电学院学报(第04期);81-84 * |
| 基于视线跟踪的增强现实交互;赵新灿;左洪福;徐兴民;;光电工程(第04期);139-143 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115268749A (en) | 2022-11-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180077409A1 (en) | Method, storage medium, and electronic device for displaying images | |
| CN110478901B (en) | Interaction method and system based on augmented reality equipment | |
| KR102499139B1 (en) | Electronic device for displaying image and method for controlling thereof | |
| CN109218598B (en) | Camera switching method and device and unmanned aerial vehicle | |
| CN103414844A (en) | Video dithering correction method and device | |
| WO2016157833A1 (en) | Information processing apparatus, information processing method, and program | |
| EP3828832A1 (en) | Display control method, display control device and computer-readable storage medium | |
| CN107037957A (en) | A kind of display methods and device | |
| CN104102367B (en) | A kind of information processing method and device | |
| CN106970734B (en) | Task starting method and device of display equipment | |
| CN115268749B (en) | Control method of augmented reality equipment, mobile terminal and shielding prevention system | |
| CN112965773A (en) | Method, apparatus, device and storage medium for information display | |
| CN106371552B (en) | Control method and device for media display at mobile terminal | |
| CN110647368A (en) | Method and device for controlling application program to execute operation and electronic equipment | |
| US10965930B2 (en) | Graphical user interface for indicating off-screen points of interest | |
| CN107958478B (en) | Rendering method of object in virtual reality scene and virtual reality head-mounted equipment | |
| CN112528107A (en) | Content data display method and device and server | |
| CN117891330A (en) | Screen display control method and device of intelligent glasses, computer equipment and medium | |
| CN116540252B (en) | Laser radar-based speed determination method, device, equipment and storage medium | |
| CN115022611B (en) | VR picture display method, electronic device and readable storage medium | |
| US20230042920A1 (en) | Motion blur compensation through eye tracking | |
| CN117912426A (en) | Screen brightness adjusting method and device of intelligent glasses, computer equipment and medium | |
| CN115562495A (en) | Driving information display method and device and electronic equipment | |
| CN115186026A (en) | Map display method and device, storage medium and electronic equipment | |
| CN115599331A (en) | Rendering picture updating method and device, augmented reality equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |