CN110320994B - Early warning method of augmented reality glasses based on game field - Google Patents
Early warning method of augmented reality glasses based on game field Download PDFInfo
- Publication number
- CN110320994B CN110320994B CN201810278412.XA CN201810278412A CN110320994B CN 110320994 B CN110320994 B CN 110320994B CN 201810278412 A CN201810278412 A CN 201810278412A CN 110320994 B CN110320994 B CN 110320994B
- Authority
- CN
- China
- Prior art keywords
- information
- processing unit
- central processing
- glasses
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000011521 glass Substances 0.000 title claims abstract description 127
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 75
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000012545 processing Methods 0.000 claims abstract description 92
- 208000033748 Device issues Diseases 0.000 claims 1
- 238000004891 communication Methods 0.000 description 15
- 238000006073 displacement reaction Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 208000027418 Wounds and injury Diseases 0.000 description 2
- 230000006378 damage Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 208000014674 injury Diseases 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Human Computer Interaction (AREA)
- Optics & Photonics (AREA)
- Emergency Alarm Devices (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
An early warning method of augmented reality glasses based on a game field comprises the following steps: when a user walks into a game field, the first positioning device can collect glasses position information of the augmented reality glasses, the first positioning device can collect glasses orientation information of the augmented reality glasses, through the two information, the central processing unit can judge the watching position and the watching angle of the user, and the central processing unit can judge a preset image which the image acquisition terminal should receive and corresponding characteristic parameters obtained after analyzing the preset image, and can judge whether obstacles exist in front of the augmented reality glasses or not by comparing whether the preset image and the real image are different or not and whether the characteristic parameters are different or not. When an obstacle is found, the central processing unit can send different instructions according to the information of the obstacle, and command the alarm device to send out alarms of different degrees.
Description
Technical Field
The invention relates to the field of head-mounted display equipment, in particular to an early warning method of augmented reality glasses based on a game field.
Background
The augmented reality technology, that is, the AR, is a new technology of integrating real world information and virtual world information in a seamless manner, and is to apply virtual information to the real world and perceived by human senses through simulation and superposition of the virtual information by scientific technologies such as a computer and the like so as to achieve sensory experience exceeding reality, wherein the physical information (visual information, sound, taste, touch and the like) is difficult to experience in a certain time space range of the real world. Real environment and virtual object are superimposed on the same picture or space in real time and exist at the same time. However, when people use the AR device, the AR device is easily isolated from the outside, so that the brain is easily deceived, and people cannot correctly sense things outside, thereby causing accidents. To solve such a problem, patent CN 201710065737.5 discloses a head-mounted virtual reality device and a safety protection method for the head-mounted virtual reality device, the head-mounted virtual reality device including a displacement detection module, a judgment module, and an alarm module, the displacement detection module being configured to detect a movement displacement of a user; the judging module is used for judging whether the user is in a safety range according to the initial position and the movement displacement of the user; the alarm module is set to give an alarm to prompt the user when the judging result of the judging module is negative. Therefore, through real-time monitoring of the mobile displacement of the user, the user can be ensured to be in a safe range, the safety of the user can be protected, and the problems of personal injury to the user caused by the collision between the user and surrounding objects are prevented. However, the device can only judge whether the user is in an area, and the area needs to have no obstacle, and the protection method is too simple to cope with the sudden danger in time and does not meet the actual protection requirement.
Disclosure of Invention
The invention aims to provide an early warning method of augmented reality glasses based on a game field, which can reflect the condition of external things and give an alarm.
An early warning method of augmented reality glasses based on a game field comprises the following steps:
s1: manually inputting three-dimensional structure information of a game field to a central processing unit;
s2: the central processing unit establishes a three-dimensional model of a game field according to the three-dimensional structure information;
s3: when a user walks into a game field, the first positioning device collects glasses position information of the positions of the augmented reality glasses worn by the user and transmits the glasses position information to the central processing unit;
s4: the first orientation device collects glasses orientation information of the augmented reality glasses and transmits the glasses orientation information to the central processing unit;
s5: the image acquisition terminal collects distance information between an object in front of the augmented reality glasses and the azimuth of the object and sends the distance information and the azimuth information to the central processing unit;
s6: the central processing unit compares the three-dimensional model, the glasses position information, the glasses orientation information and the distance information and the azimuth information which are collected by the image acquisition terminal, judges whether an object which is not originally arranged exists in the game field, marks the object as an obstacle if the object exists in the game field, and executes the step S7, otherwise, does not continue to execute the operation;
s7, the central processing unit sends out a corresponding instruction to the alarm device according to the information of the obstacle;
s8: the alarm device gives out alarms of different degrees according to the instruction.
The augmented reality glasses, including the body of augmented reality glasses, the body includes glasses frame, transparent lens, central processing unit and miniature projector, still including being used for acquireing the image acquisition terminal of glasses place ahead object and glasses distance and position, sending out the alarm device of different alarms according to different circumstances, be used for acquireing the first positioner of glasses orientation information and being used for the first positioner of location body position, central processing unit respectively with miniature projector, image acquisition terminal, alarm device, first positioner signal connection, image acquisition terminal, alarm device, first positioner set up on the body. The first orientation device may be a gyroscopic sensor or other device that may obtain information about the orientation of the glasses. The first positioning device may be a GPS device, or other device capable of acquiring glasses position information. The image collection terminal may be a device such as a depth camera that can collect image location and depth information.
The alarm device also comprises an acoustic alarm device for giving an alarm through sound. The sound alarm device can be a device capable of playing sound, such as a loudspeaker, a broadcaster and the like.
The alarm device comprises a plurality of flashing alarm devices for alarming by emitting flashing light, and the flashing alarm devices are arranged on the glasses frame and surround the periphery of the lenses. The flashing alarm device can be a device such as an LED lamp which can emit mild and gentle light.
The alarm device further comprises a vibration alarm device which is arranged at two sides of the glasses frame. The vibration alarm device can be a single vibration motor or a combination of multiple vibration motors, and the eccentric blocks of different vibration motors are different in weight, size and shape, and different vibration effects are achieved by arranging different eccentric blocks.
The augmented reality glasses also include infrared sensors, through which the augmented reality glasses sense the temperature of the object. The infrared sensor is in signal connection with the central processing unit.
The body is also provided with a radar sensing device for sensing objects at two sides, and the radar sensing device is in signal connection with the central processing unit.
The body is provided with a first wireless communication device which is in signal connection with the central processing unit.
The game field is provided with a cloud processor and a second wireless communication device, and the cloud processor is in signal connection with the second wireless communication device.
The game field is also provided with a plurality of displacement sensors.
There is an immovable infrastructure and movable items in the playground. The movable object of the game field is provided with a second positioning device and a second azimuth device, wherein the second positioning device is used for collecting the position information of the movable object, and the second azimuth device is used for collecting the azimuth information of the movable object facing the azimuth.
When the game field is established, three-dimensional structure information of the game field is recorded, the three-dimensional structure information is input into the central processing unit, then the central processing unit establishes a game field three-dimensional model according to the received three-dimensional structure information, then parameters of the image acquisition terminal are input into the central processing unit, and the three-dimensional structure model is corrected by repeatedly entering the game field by a tester, collecting information acquired by the image acquisition terminal, glasses orientation information and glasses position information, and calculating and presuming preset scenes, characteristic parameters such as height, color, position, depth of field and the like which can be shot by the image acquisition terminal, the sense of realism of an augmented reality phantom projected by the augmented reality glasses is improved, errors are reduced, and a large number of preset images and characteristic parameters of different position orientations acquired by the image acquisition terminal are obtained and corrected through testing.
When a user walks into a game field, the first positioning device can collect glasses position information of the augmented reality glasses, the first positioning device can collect glasses orientation information of the augmented reality glasses, through the two information, the central processing unit can judge the position and the viewing angle of the user, and the central processing unit can judge a preset image which the image acquisition terminal should receive and corresponding characteristic parameters obtained after analyzing the preset image, and can judge whether obstacles exist in front of the augmented reality glasses or not by comparing whether the preset image and the real image are different or not and whether the characteristic parameters are different or not.
When an obstacle is found, the central processing unit can send different instructions according to the information of the obstacle, and command the alarm device to send out alarms of different degrees.
The central processing unit can predict and obtain a preset image which the camera should receive by collecting the position information of the glasses, the orientation information of the glasses and the three-dimensional model, and can know whether an obstacle exists in front by comparing the real image collected by the camera with the characteristic parameters. The image acquisition terminal is adopted, so that when the obstacle appears, the distance between the obstacle and the object and the azimuth of the obstacle can be directly acquired, more position relation information is provided, and the central processing unit can conveniently and accurately send out an instruction in time to control the alarm device to send out an alarm. In addition, by sending out alarms of different degrees, the user can intuitively feel the real external conditions and avoid dangers in time, if the alarm degree is light, the player does not need to take off the glasses, the augmented reality glasses can be continuously used, the alarm degree is high, and the player can take off the glasses and deal with the problems in time.
The alarm includes a flashing alarm, an audible alarm, and a vibratory alarm.
By setting various alarm modes according to the danger to be appeared, the user can know the type of the danger according to the alarm mode and make corresponding countermeasures in time.
In the step S8, the alarm device gives an alarm in the corresponding direction of the augmented reality glasses according to the positional relationship between the obstacle and the augmented reality glasses.
The alarm is sent out in the corresponding direction of the augmented reality glasses, so that the user can know the direction of the obstacle in time, take action to leave the obstacle, and avoid falling down when touching the underground obstacle or directly bumping into the obstacle, thereby causing personal injury.
The method further comprises the steps that at step S6, the central processing unit uploads the three-dimensional model of the game field, the glasses position information, the glasses orientation information, the distance information between the object and the glasses and the azimuth information to the cloud processor through the wireless communication equipment, the cloud processor compares the information, if the object which is not arranged on the original game field is found, the object is marked as an obstacle, and the position and the shape information of the obstacle are sent to the central processing unit through the wireless communication equipment.
By uploading the information to the cloud processor, the situation that the central processing unit is limited in processing capacity, the position of an obstacle cannot be effectively and timely analyzed, alarm delay or inaccuracy is caused, and accidents of users are caused is avoided. The wireless communication device is used for connecting the central processing unit and the cloud processor to the Internet or a local area network to exchange information with each other. Of course, if the gaming floor is small, a wired communication device may suffice.
The method further includes the cloud processor sending location information of all users to the central processing unit of all users through the network.
The users in the game field are prevented from colliding with each other, so that the cloud processor can timely feed back the position information of the users to the central processing units of other users when the position information of the users is collected, and the users can timely find the other users.
The method further comprises, at step S6: the second positioning device provided with the object in the game field collects the object position information of the position of the object and transmits the object position information to the cloud processor, the second azimuth device provided with the object collects the object orientation information of the object and transmits the object orientation information to the cloud processor, and the cloud processor modifies the three-dimensional model of the game field according to the collected object position information and the object orientation information and transmits the three-dimensional model to the central processing unit.
The movable objects of the game field in the method are provided with the second positioning device and the second azimuth device, through the two devices, the cloud processor can judge the placed position and the direction of the objects in time, and can build a new three-dimensional model according to the original three-dimensional model, and the three-dimensional model can correctly reflect the existing object position information and the object direction information of the objects, so that the central processing unit can be prevented from giving false alarms to users according to the original three-dimensional model.
At step S8, the flashing frequency of the flashing alarm emitted by the alarm device is higher as the distance between the obstacle and the augmented reality glasses is closer.
Because the mode of sound alarm or vibration alarm is difficult to show comparatively specific azimuth information on tiny augmented reality glasses, so through setting up flash alarm device on the glasses frame, surround around the lens, appear in corresponding azimuth when the obstacle, flash alarm device sends the flash of flashing in corresponding position. And when the distance between the two is closer, the flash with higher flash frequency is emitted, so that the user can judge the positions of the obstacle and the augmented reality glasses according to the flash frequency and the flash position, and find the obstacle in the augmented reality of the augmented reality glasses, and the obstacle cannot be regarded as a virtual object.
The method further comprises the step that the central processing unit calculates the moving speed of the obstacle relative to the ground of the game field when the step S6 is carried out, and if the moving speed of the obstacle is greater than 5m/S, the central processing unit sends out an instruction to enable the alarm device to send out an audible alarm to remind the obstacle moving fast in front when the step S7 is carried out.
Since the user is immersed in the illusion of augmented reality, it is not clear whether the object seen in the eye is real or illusive, and thus when the object flies to the user at a high speed, the user cannot distinguish whether it is real or illusive, and accidents easily occur. The user can timely find the moving obstacle from the worn augmented reality glasses and avoid the moving obstacle by reminding the user of the position of the fast moving obstacle through voice.
The method further comprises the steps that when the step S6 is carried out, the infrared sensor collects temperature information of the obstacle in front of the augmented reality glasses and sends the information to the central processing unit, and when the temperature of the obstacle in front is higher than 40 ℃ or lower than 0 ℃ in the step S7, the central processing unit sends out an instruction to enable the alarm device to send out an audible alarm.
Since in the augmented reality phantom the user would see flames or ice cubes, but if an object in reality burns to generate sparks, the user would burn the user with touching for this virtual phantom, in order to avoid this, the infrared sensor would collect the temperature information of the obstacle and feed back to the central processing unit, and a reminder would be given when the temperature of the obstacle is too high or too low.
The method further comprises the steps that when the step S6 is carried out, the radar device collects position information and speed information of obstacles around the augmented reality glasses and sends the position information and the speed information to the central processing unit, the central processing unit analyzes whether the moving speed of the obstacles is greater than or equal to 10m/S and the distance between the moving speed of the obstacles and the augmented reality glasses is smaller than 100m, and if yes, when the step S7 is carried out, the central processing unit sends out an instruction to enable the alarm device to send out vibration alarms in the corresponding directions.
Since the augmented reality glasses also make a sound to enhance the sense of reality of the augmented reality when the user is immersed in the phantom, but also cause the user to be unable to notice surrounding sound information, it is easy for the object to fly out of the way to the user quickly without the user being aware of it. Therefore, the method collects the position information and the moving speed of the obstacles around the glasses by arranging the radar device. The obstacle is considered to hurt the user when the moving speed reaches 10m/s so as to give a reminder, and if the obstacle moves rapidly at a place outside 100m, the central processing unit does not consider that the obstacle hurts the user, so that an alarm is not given.
Compared with the prior art, the invention has the advantages that:
(1) According to the invention, by comparing the preset three-dimensional model with the collected external information, the obstacle which is not found in the original game field is discovered, so that the user is reminded in time, and the user is prevented from falling down due to the fact that the user touches the obstacle.
(2) According to the invention, by setting various alarm modes, a user can know the type of the danger according to the alarm modes and timely make corresponding countermeasures.
(3) The infrared sensor can also collect temperature information of the obstacle in front of the augmented reality glasses and send the information to the central processing unit, so that the situation that a user cannot know whether flame is real or fictive is avoided, and burn is caused by touching the user with the hands.
Drawings
Fig. 1 is a schematic flow chart of the present invention.
Fig. 2 is a schematic structural view of augmented reality glasses.
Fig. 3 is a schematic diagram of the structure of the augmented reality glasses after being unfolded.
Fig. 4 is a schematic diagram of internal information transfer of augmented reality glasses.
The marks in the figure are as follows: 1. a body; 2. a lens; 3. a miniature projector; 4. a depth camera; 5. a radar sensing device; 6. an acoustic alarm device; 7. a flashing alarm device; 8. a vibration alarm device; 9. a central processing unit; 10. a first positioning device; 11. a first wireless communication device; 12. an infrared sensor; 13. a first orientation device; 14. a cloud processor; 15. a second wireless communication device; 16. rotating the camera; 17 second positioning means; 18. and a second orientation means.
Detailed Description
The invention will be further illustrated with reference to specific examples. It is to be understood that these examples are illustrative of the present invention and are not intended to limit the scope of the present invention. Further, it is understood that various changes and modifications may be made by those skilled in the art after reading the teachings of the present invention, and such equivalents are intended to fall within the scope of the claims appended hereto.
An early warning method of augmented reality glasses based on a game field comprises the following steps:
s1: manually inputting three-dimensional structure information of the game field to the central processing unit 9;
s2: the central processing unit 9 establishes a three-dimensional model of a game field according to the three-dimensional structure information;
s3: when the user walks into the game field, the first positioning device 10 collects glasses position information of the positions of the augmented reality glasses worn by the user and transmits the glasses position information to the central processing unit 9;
s4: the first orientation means 13 collects the glasses orientation information of the augmented reality glasses and transmits the glasses orientation information to the central processing unit 9;
s5: the image acquisition terminal collects distance information between the object in front of the augmented reality glasses and the azimuth of the object and sends the distance information and the azimuth information to the central processing unit 9;
s6: the central processing unit 9 compares the three-dimensional model, the glasses position information, the glasses orientation information and the distance information and the azimuth information collected by the image acquisition terminal, judges whether an object which is not originally arranged exists in the game field, marks the object as an obstacle if the object exists in the game field, and executes the step S7, otherwise, does not continue to execute the operation;
s7, the central processing unit 9 sends a corresponding instruction to the alarm device according to the information of the obstacle;
s8: the alarm device gives out alarms of different degrees according to the instruction.
The augmented reality glasses, including the body 1 of augmented reality glasses, body 1 includes glasses frame, transparent lens 2, central processing unit 9 and miniature projector 3, still including being used for acquireing the image acquisition terminal of glasses place ahead object and glasses distance and position, sending out the alarm device of different alarms according to different circumstances, be used for acquireing the first positioner 13 of glasses orientation information and be used for the first positioner 10 of location body 1 position, central processing unit 9 respectively with miniature projector 3, image acquisition terminal, alarm device, first positioner 13 and first positioner 10 signal connection, image acquisition terminal, alarm device, first positioner 13 set up on body 1. The first orientation device 13 may be a gyroscopic sensor or other device capable of acquiring information about the orientation of the glasses. The first positioning device 10 may be a GPS device, or other device that may obtain information about the position of the glasses. The image collection terminal may be a device such as a depth camera 4 that may collect location and depth information.
The alarm device further comprises an audible alarm device 6 for sounding an alarm.
The alarm device comprises a plurality of flashing alarm devices 7 which emit flashing light, wherein the flashing alarm devices 7 are arranged on the glasses frame and surround the periphery of the lens 2.
The alarm device further comprises a vibration alarm device 8, the vibration alarm device 8 being arranged on both sides of the spectacle frame.
The augmented reality glasses further include an infrared sensor 12, and the augmented reality glasses sense the temperature of the object through the infrared sensor 12. The infrared sensor 12 is in signal connection with the central processing unit 9.
The body 1 is also provided with a radar sensing device 5 for sensing objects at two sides, and the radar sensing device 5 is in signal connection with a central processing unit 9.
The body 1 is provided with a first wireless communication device 11, and the first wireless communication device 11 is in signal connection with the central processing unit 9.
The game field is provided with a cloud processor 14 and a second wireless communication device 15, and the cloud processor 14 is in signal connection with the second wireless communication device 15.
The game field is also provided with a plurality of displacement sensors. The displacement sensor is in signal connection with the cloud processor 14.
There is an immovable infrastructure and movable items in the playground. The movable object of the game field is provided with a second positioning device 17 and a second azimuth device 18, wherein the second positioning device 17 is used for collecting object position information of the position of the movable object, and the second azimuth device 18 is used for collecting object azimuth information of the orientation of the movable object.
The movable objects of the game field in the method are provided with the second positioning device 17 and the second azimuth device 18, through the two devices, the cloud processor 14 can judge the placed position and the direction of the objects in time, and can build a new three-dimensional model according to the original three-dimensional model, and the three-dimensional model can correctly reflect the existing position information and the direction information of the objects, so that the central processing unit 9 can be prevented from giving false alarms to users according to the original three-dimensional model. A rotating camera 16 is also provided in the playground for capturing the status of the user.
The alarm includes a flashing alarm, an audible alarm, and a vibratory alarm.
By setting various alarm modes according to the danger to be appeared, the user can know the type of the danger according to the alarm mode and make corresponding countermeasures in time.
In the step S8, the alarm device gives an alarm in the corresponding direction of the augmented reality glasses according to the positional relationship between the obstacle and the augmented reality glasses.
Example 1
After the central processing unit 9 analyzes and compares the three-dimensional model, the glasses position information, the glasses orientation information and the distance information and the azimuth information collected by the image acquisition terminal, the central processing unit 9 can analyze the azimuth and the distance of the obstacle, according to the azimuth information, the flash alarm device 7 emits flashing soft light at the corresponding position, along with the fact that the distance between the augmented reality glasses and the obstacle is more and more close, the frequency of the flashing light is higher, and a user can timely discover real objects in the augmented reality phantom according to the flashing frequency and the azimuth of the light, so that mutual collision is avoided.
As described above, the flash alarm device 7 of the present embodiment is applicable to other embodiments.
Example 2:
the method further comprises the steps that when the central processing unit 9 finds that the front of the augmented reality glasses has an obstacle, the central processing unit 9 calculates the moving speed of the obstacle relative to the ground of the game through the image data, the glasses position information and the glasses orientation information collected by the image collecting terminal, if the moving speed of the obstacle is greater than 5m/S, when the step S7 is carried out, the central processing unit 9 sends out an instruction to enable the alarm device to send out an audible alarm to remind that the front of the obstacle moves fast, and at the moment, the flashing alarm device 7 also sends out flashing soft light at the corresponding position, and the flashing frequency of the light is higher as the distance between the augmented reality glasses and the obstacle is closer, so that the user is prevented from touching the obstacle in front.
As described above, the alarm method in the present embodiment is applicable to other embodiments.
Example 3
The method further comprises the step that the infrared sensor 12 collects the temperature information of the obstacle in front of the augmented reality glasses and sends the information to the central processing unit 9, and the central processing unit 9 sends out an instruction to make the alarm device sound an alarm when the temperature of the obstacle in front is higher than 40 ℃ or lower than 0 ℃ in step S7.
As described above, the alarm method in the present embodiment is applicable to other embodiments.
Example 4
Since it is difficult to pay attention to the environment other than the phantom when the user is immersed in the phantom of the augmented reality and the external sound information is easily ignored, the method further includes collecting the position information and the speed information of the obstacle around the augmented reality glasses by the radar device and transmitting them to the central processing unit 9 at step S6, the central processing unit 9 analyzing whether the moving speed of the obstacle is 10m/S or more and the distance from the augmented reality glasses is less than 100m, and if so, the central processing unit 9 gives an instruction to make the vibration alarm device 8 vibrate at the corresponding position of the glasses frame at step S7.
Example 5
In order to avoid that the processing capacity of the central processing unit 9 is too large, the method further comprises that at step S6, the central processing unit 9 uploads the three-dimensional model of the game field, the position information, the orientation information, and the distance information and the azimuth information of the object and the glasses to the cloud processor 14 through the wireless communication device, the cloud processor 14 compares the information, marks the object which is not arranged on the original game field as an obstacle if the object is found, and sends the position and the shape information of the obstacle to the central processing unit 9 through the wireless communication device.
The cloud processor 14 is also included to send location information of all users to the central processing unit 9 of all users through the network.
Further comprising, at step S6: the second positioning device 17 carried by the object in the game field collects the object position information of the position of the object and transmits the object position information to the cloud processor 14, the second azimuth device 18 carried by the object collects the object orientation information of the object and transmits the object orientation information to the cloud processor 14, and the cloud processor 14 modifies the three-dimensional model of the game field according to the collected object position information and the object orientation information and transmits the three-dimensional model to the central processing unit 9.
As described above, in this embodiment, the three-dimensional model, the position information, the orientation information, the distance information between the object and the glasses, and the azimuth information of the game field are uploaded to the cloud processor 14, so that other embodiments can be applied to the cloud processor 14 to assist in processing the information.
It is to be understood that the above examples of the present invention are provided by way of illustration only and not by way of limitation of the embodiments of the present invention. Other variations or modifications of the above teachings will be apparent to those of ordinary skill in the art. It is not necessary here nor is it exhaustive of all embodiments. Any modification, equivalent replacement, improvement, etc. which come within the spirit and principles of the invention are desired to be protected by the following claims.
Claims (10)
1. Provided is an early warning method of augmented reality glasses based on a game field: the method is characterized by comprising the following steps of:
s1: manually inputting three-dimensional structure information of a game field to a central processing unit;
s2: the central processing unit establishes a three-dimensional model of a game field according to the three-dimensional structure information; acquiring preset images and characteristic parameters of different positions and orientations through an image acquisition terminal;
s3: the first positioning device collects glasses position information of the positions of the augmented reality glasses worn by the user and transmits the glasses position information to the central processing unit;
s4: the first orientation device collects glasses orientation information of the augmented reality glasses and transmits the glasses orientation information to the central processing unit;
s5: the image acquisition terminal collects distance information between an object in front of the augmented reality glasses and the augmented reality glasses, and transmits the distance information and the azimuth information to the central processing unit;
s6: the central processing unit compares the three-dimensional model, the glasses position information, the glasses orientation information and the distance information and the azimuth information which are collected by the image acquisition terminal, judges whether an object which is not originally arranged exists in the game field, marks the object as an obstacle if the object exists in the game field, and executes the step S7, otherwise, does not continue to execute the operation; the method comprises the following steps: the central processing unit predicts a preset image which the image acquisition terminal should receive through the glasses position information, the glasses orientation information and the three-dimensional model, and judges whether an obstacle exists in front by comparing the preset image with a real image collected by the image acquisition terminal and comparing the real image with characteristic parameters;
s7, the central processing unit sends out a corresponding instruction to the alarm device according to the information of the obstacle;
s8: the alarm device gives out alarms of different degrees according to the instruction.
2. The method of claim 1, wherein the alert comprises a flashing alert, a sound alert, and a vibration alert.
3. The method according to claim 1, wherein the warning device issues a warning in the direction corresponding to the augmented reality glasses according to the positional relationship between the obstacle and the augmented reality glasses in the step S8.
4. The method according to claim 1, further comprising the step of uploading the three-dimensional model of the game field, the glasses position information, the glasses orientation information, and the distance information and the azimuth information of the object and the glasses to a cloud processor by the central processing unit at step S6, wherein the cloud processor compares the information, marks the object as an obstacle if the object which is not originally arranged on the game field is found, and transmits the position and the shape information of the obstacle to the central processing unit through the network.
5. The method for pre-warning augmented reality glasses based on a playground according to claim 4, further comprising the cloud processor transmitting the location information of all users to the central processing unit of all users through a network.
6. The method for pre-warning augmented reality glasses based on a playground according to claim 4, further comprising, at step S6: the second positioning device arranged on the movable object in the game field collects the object position information of the position of the movable object and transmits the movable object position information to the cloud processor, the second azimuth device arranged on the movable object collects the object orientation information of the movable object and transmits the object orientation information to the cloud processor, and the cloud processor modifies a three-dimensional model of the game field according to the collected object position information and the object orientation information and transmits the three-dimensional model to the central processing unit.
7. The method according to claim 2, wherein in step S8, the flashing frequency of the flashing alarm generated by the alarm device is higher as the distance between the obstacle and the augmented reality glasses is closer.
8. The method according to claim 2, further comprising, at step S6, the central processing unit calculating a movement speed of the obstacle with respect to the ground of the game, and if the movement speed of the obstacle is greater than 5m/S, at step S7, the central processing unit issuing a command to the alarm device to sound an alarm to alert the front of the obstacle for rapid movement.
9. The method for pre-warning augmented reality glasses based on a playground according to claim 2, further comprising: in step S6, the infrared sensor collects temperature information of the obstacle in front of the augmented reality glasses and sends the information to the central processing unit, and in step S7, when the temperature of the obstacle in front is greater than 40 ℃ or less than 0 ℃, the central processing unit sends out an instruction to make the alarm device sound an alarm.
10. The method according to claim 2, further comprising the step of collecting position information and speed information of obstacles around the augmented reality glasses by the radar device and transmitting the information to the central processing unit, wherein the central processing unit analyzes whether the moving speed of the obstacles is greater than or equal to 10m/S and the distance from the augmented reality glasses is smaller than 100m, and if yes, the central processing unit sends out an instruction to make the alarm device send out a vibration alarm in the corresponding direction in step S7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810278412.XA CN110320994B (en) | 2018-03-31 | 2018-03-31 | Early warning method of augmented reality glasses based on game field |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810278412.XA CN110320994B (en) | 2018-03-31 | 2018-03-31 | Early warning method of augmented reality glasses based on game field |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110320994A CN110320994A (en) | 2019-10-11 |
| CN110320994B true CN110320994B (en) | 2023-12-22 |
Family
ID=68111945
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810278412.XA Active CN110320994B (en) | 2018-03-31 | 2018-03-31 | Early warning method of augmented reality glasses based on game field |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110320994B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111442758A (en) * | 2020-03-27 | 2020-07-24 | 云南电网有限责任公司玉溪供电局 | Laser speed and distance measuring device and method with distance increasing and telescoping functions |
| CN112669578B (en) * | 2020-12-18 | 2022-04-19 | 上海影创信息科技有限公司 | Interested object warning method and system based on sound source in afterglow area |
| CN114838763B (en) * | 2022-04-20 | 2023-11-17 | 青岛虚拟现实研究院有限公司 | Obstacle detection method, VR glasses and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105357490A (en) * | 2015-12-01 | 2016-02-24 | 国家电网公司 | Visual monitoring and target tracking method and system based on real-time three-dimensional model of transformer substation |
| CN106295581A (en) * | 2016-08-15 | 2017-01-04 | 联想(北京)有限公司 | Obstacle detection method, device and virtual reality device |
| CN107122702A (en) * | 2017-03-13 | 2017-09-01 | 北京集创北方科技股份有限公司 | Safety device and safety method |
-
2018
- 2018-03-31 CN CN201810278412.XA patent/CN110320994B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105357490A (en) * | 2015-12-01 | 2016-02-24 | 国家电网公司 | Visual monitoring and target tracking method and system based on real-time three-dimensional model of transformer substation |
| CN106295581A (en) * | 2016-08-15 | 2017-01-04 | 联想(北京)有限公司 | Obstacle detection method, device and virtual reality device |
| CN107122702A (en) * | 2017-03-13 | 2017-09-01 | 北京集创北方科技股份有限公司 | Safety device and safety method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110320994A (en) | 2019-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11765331B2 (en) | Immersive display and method of operating immersive display for real-world object alert | |
| JP5580855B2 (en) | Obstacle avoidance device and obstacle avoidance method | |
| CN110320994B (en) | Early warning method of augmented reality glasses based on game field | |
| CN107015638B (en) | Method and apparatus for alerting a head mounted display user | |
| US20130286004A1 (en) | Displaying a collision between real and virtual objects | |
| US20130328762A1 (en) | Controlling a virtual object with a real controller device | |
| WO2016025697A1 (en) | Visualization of physical interactions in augmented reality | |
| CN109358754B (en) | Mixed reality head-mounted display system | |
| CN110969905A (en) | Remote teaching interaction and teaching aid interaction system for mixed reality and interaction method thereof | |
| EP3163407A1 (en) | Method and apparatus for alerting to head mounted display user | |
| US20180089893A1 (en) | Virtual guard rails | |
| KR102267840B1 (en) | Drone Monitoring System | |
| CN107436491A (en) | The threat caution system and its threat alarming method for power of virtual reality display device | |
| JP5971466B2 (en) | Flight path display system, method and program | |
| KR20200067286A (en) | 3D scan and VR inspection system of exposed pipe using drone | |
| KR20200071560A (en) | Farm Experience Safety Management System | |
| KR20170014480A (en) | A method of guiding a road using an unmanned aerial vehicle | |
| CN112269472A (en) | Method and system for constructing virtual boundary object and VR glasses thereof | |
| CN110322669B (en) | Early warning method based on reality projection game field | |
| JP2019164216A (en) | Instruction position transmission system and instruction position transmission method | |
| CN114445945A (en) | A place intelligent system for sports ground | |
| KR101430723B1 (en) | Virtual golf simulation system and method | |
| CN112579029A (en) | Display control method and system of VR glasses | |
| JP2020057399A (en) | Simulation control device and simulation control program | |
| EP4130936A1 (en) | Positioning apparatus and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 510000 unit 6, room 701, radio and television science and technology building, No. 163, xipingyun Road, Huangpu Avenue, Tianhe District, Guangzhou, Guangdong Province Applicant after: Hantang Media Co.,Ltd. Address before: 510000 unit 6, room 701, radio and television science and technology building, No. 163, xipingyun Road, Huangpu Avenue, Tianhe District, Guangzhou, Guangdong Province Applicant before: HANTANG MEDIUM Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20231126 Address after: 510000 rooms 1812, 1813, 1814, 1815, 18th floor, No. 165, qiaozhong Middle Road, Liwan District, Guangzhou, Guangdong Province (office only) Applicant after: Guangzhou zhongtianxin Electronic Technology Co.,Ltd. Address before: 510000 unit 6, room 701, radio and television science and technology building, No. 163, xipingyun Road, Huangpu Avenue, Tianhe District, Guangzhou, Guangdong Province Applicant before: Hantang Media Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |