Disclosure of Invention
The invention aims to provide an early warning method of augmented reality glasses based on a game field, which can reflect the condition of external things and give an alarm.
An early warning method of augmented reality glasses based on a game field comprises the following steps:
s1: manually inputting three-dimensional structure information of a game field to a central processing unit;
s2: the central processing unit establishes a three-dimensional model of a game field according to the three-dimensional structure information;
s3: when a user walks into a game field, the first positioning device collects glasses position information of the positions of the augmented reality glasses worn by the user and transmits the glasses position information to the central processing unit;
s4: the first orientation device collects glasses orientation information of the augmented reality glasses and transmits the glasses orientation information to the central processing unit;
s5: the image acquisition terminal collects distance information between an object in front of the augmented reality glasses and the azimuth of the object and sends the distance information and the azimuth information to the central processing unit;
s6: the central processing unit compares the three-dimensional model, the glasses position information, the glasses orientation information and the distance information and the azimuth information which are collected by the image acquisition terminal, judges whether an object which is not originally arranged exists in the game field, marks the object as an obstacle if the object exists in the game field, and executes the step S7, otherwise, does not continue to execute the operation;
s7, the central processing unit sends out a corresponding instruction to the alarm device according to the information of the obstacle;
s8: the alarm device gives out alarms of different degrees according to the instruction.
The augmented reality glasses, including the body of augmented reality glasses, the body includes glasses frame, transparent lens, central processing unit and miniature projector, still including being used for acquireing the image acquisition terminal of glasses place ahead object and glasses distance and position, sending out the alarm device of different alarms according to different circumstances, be used for acquireing the first positioner of glasses orientation information and being used for the first positioner of location body position, central processing unit respectively with miniature projector, image acquisition terminal, alarm device, first positioner signal connection, image acquisition terminal, alarm device, first positioner set up on the body. The first orientation device may be a gyroscopic sensor or other device that may obtain information about the orientation of the glasses. The first positioning device may be a GPS device, or other device capable of acquiring glasses position information. The image collection terminal may be a device such as a depth camera that can collect image location and depth information.
The alarm device also comprises an acoustic alarm device for giving an alarm through sound. The sound alarm device can be a device capable of playing sound, such as a loudspeaker, a broadcaster and the like.
The alarm device comprises a plurality of flashing alarm devices for alarming by emitting flashing light, and the flashing alarm devices are arranged on the glasses frame and surround the periphery of the lenses. The flashing alarm device can be a device such as an LED lamp which can emit mild and gentle light.
The alarm device further comprises a vibration alarm device which is arranged at two sides of the glasses frame. The vibration alarm device can be a single vibration motor or a combination of multiple vibration motors, and the eccentric blocks of different vibration motors are different in weight, size and shape, and different vibration effects are achieved by arranging different eccentric blocks.
The augmented reality glasses also include infrared sensors, through which the augmented reality glasses sense the temperature of the object. The infrared sensor is in signal connection with the central processing unit.
The body is also provided with a radar sensing device for sensing objects at two sides, and the radar sensing device is in signal connection with the central processing unit.
The body is provided with a first wireless communication device which is in signal connection with the central processing unit.
The game field is provided with a cloud processor and a second wireless communication device, and the cloud processor is in signal connection with the second wireless communication device.
The game field is also provided with a plurality of displacement sensors.
There is an immovable infrastructure and movable items in the playground. The movable object of the game field is provided with a second positioning device and a second azimuth device, wherein the second positioning device is used for collecting the position information of the movable object, and the second azimuth device is used for collecting the azimuth information of the movable object facing the azimuth.
When the game field is established, three-dimensional structure information of the game field is recorded, the three-dimensional structure information is input into the central processing unit, then the central processing unit establishes a game field three-dimensional model according to the received three-dimensional structure information, then parameters of the image acquisition terminal are input into the central processing unit, and the three-dimensional structure model is corrected by repeatedly entering the game field by a tester, collecting information acquired by the image acquisition terminal, glasses orientation information and glasses position information, and calculating and presuming preset scenes, characteristic parameters such as height, color, position, depth of field and the like which can be shot by the image acquisition terminal, the sense of realism of an augmented reality phantom projected by the augmented reality glasses is improved, errors are reduced, and a large number of preset images and characteristic parameters of different position orientations acquired by the image acquisition terminal are obtained and corrected through testing.
When a user walks into a game field, the first positioning device can collect glasses position information of the augmented reality glasses, the first positioning device can collect glasses orientation information of the augmented reality glasses, through the two information, the central processing unit can judge the position and the viewing angle of the user, and the central processing unit can judge a preset image which the image acquisition terminal should receive and corresponding characteristic parameters obtained after analyzing the preset image, and can judge whether obstacles exist in front of the augmented reality glasses or not by comparing whether the preset image and the real image are different or not and whether the characteristic parameters are different or not.
When an obstacle is found, the central processing unit can send different instructions according to the information of the obstacle, and command the alarm device to send out alarms of different degrees.
The central processing unit can predict and obtain a preset image which the camera should receive by collecting the position information of the glasses, the orientation information of the glasses and the three-dimensional model, and can know whether an obstacle exists in front by comparing the real image collected by the camera with the characteristic parameters. The image acquisition terminal is adopted, so that when the obstacle appears, the distance between the obstacle and the object and the azimuth of the obstacle can be directly acquired, more position relation information is provided, and the central processing unit can conveniently and accurately send out an instruction in time to control the alarm device to send out an alarm. In addition, by sending out alarms of different degrees, the user can intuitively feel the real external conditions and avoid dangers in time, if the alarm degree is light, the player does not need to take off the glasses, the augmented reality glasses can be continuously used, the alarm degree is high, and the player can take off the glasses and deal with the problems in time.
The alarm includes a flashing alarm, an audible alarm, and a vibratory alarm.
By setting various alarm modes according to the danger to be appeared, the user can know the type of the danger according to the alarm mode and make corresponding countermeasures in time.
In the step S8, the alarm device gives an alarm in the corresponding direction of the augmented reality glasses according to the positional relationship between the obstacle and the augmented reality glasses.
The alarm is sent out in the corresponding direction of the augmented reality glasses, so that the user can know the direction of the obstacle in time, take action to leave the obstacle, and avoid falling down when touching the underground obstacle or directly bumping into the obstacle, thereby causing personal injury.
The method further comprises the steps that at step S6, the central processing unit uploads the three-dimensional model of the game field, the glasses position information, the glasses orientation information, the distance information between the object and the glasses and the azimuth information to the cloud processor through the wireless communication equipment, the cloud processor compares the information, if the object which is not arranged on the original game field is found, the object is marked as an obstacle, and the position and the shape information of the obstacle are sent to the central processing unit through the wireless communication equipment.
By uploading the information to the cloud processor, the situation that the central processing unit is limited in processing capacity, the position of an obstacle cannot be effectively and timely analyzed, alarm delay or inaccuracy is caused, and accidents of users are caused is avoided. The wireless communication device is used for connecting the central processing unit and the cloud processor to the Internet or a local area network to exchange information with each other. Of course, if the gaming floor is small, a wired communication device may suffice.
The method further includes the cloud processor sending location information of all users to the central processing unit of all users through the network.
The users in the game field are prevented from colliding with each other, so that the cloud processor can timely feed back the position information of the users to the central processing units of other users when the position information of the users is collected, and the users can timely find the other users.
The method further comprises, at step S6: the second positioning device provided with the object in the game field collects the object position information of the position of the object and transmits the object position information to the cloud processor, the second azimuth device provided with the object collects the object orientation information of the object and transmits the object orientation information to the cloud processor, and the cloud processor modifies the three-dimensional model of the game field according to the collected object position information and the object orientation information and transmits the three-dimensional model to the central processing unit.
The movable objects of the game field in the method are provided with the second positioning device and the second azimuth device, through the two devices, the cloud processor can judge the placed position and the direction of the objects in time, and can build a new three-dimensional model according to the original three-dimensional model, and the three-dimensional model can correctly reflect the existing object position information and the object direction information of the objects, so that the central processing unit can be prevented from giving false alarms to users according to the original three-dimensional model.
At step S8, the flashing frequency of the flashing alarm emitted by the alarm device is higher as the distance between the obstacle and the augmented reality glasses is closer.
Because the mode of sound alarm or vibration alarm is difficult to show comparatively specific azimuth information on tiny augmented reality glasses, so through setting up flash alarm device on the glasses frame, surround around the lens, appear in corresponding azimuth when the obstacle, flash alarm device sends the flash of flashing in corresponding position. And when the distance between the two is closer, the flash with higher flash frequency is emitted, so that the user can judge the positions of the obstacle and the augmented reality glasses according to the flash frequency and the flash position, and find the obstacle in the augmented reality of the augmented reality glasses, and the obstacle cannot be regarded as a virtual object.
The method further comprises the step that the central processing unit calculates the moving speed of the obstacle relative to the ground of the game field when the step S6 is carried out, and if the moving speed of the obstacle is greater than 5m/S, the central processing unit sends out an instruction to enable the alarm device to send out an audible alarm to remind the obstacle moving fast in front when the step S7 is carried out.
Since the user is immersed in the illusion of augmented reality, it is not clear whether the object seen in the eye is real or illusive, and thus when the object flies to the user at a high speed, the user cannot distinguish whether it is real or illusive, and accidents easily occur. The user can timely find the moving obstacle from the worn augmented reality glasses and avoid the moving obstacle by reminding the user of the position of the fast moving obstacle through voice.
The method further comprises the steps that when the step S6 is carried out, the infrared sensor collects temperature information of the obstacle in front of the augmented reality glasses and sends the information to the central processing unit, and when the temperature of the obstacle in front is higher than 40 ℃ or lower than 0 ℃ in the step S7, the central processing unit sends out an instruction to enable the alarm device to send out an audible alarm.
Since in the augmented reality phantom the user would see flames or ice cubes, but if an object in reality burns to generate sparks, the user would burn the user with touching for this virtual phantom, in order to avoid this, the infrared sensor would collect the temperature information of the obstacle and feed back to the central processing unit, and a reminder would be given when the temperature of the obstacle is too high or too low.
The method further comprises the steps that when the step S6 is carried out, the radar device collects position information and speed information of obstacles around the augmented reality glasses and sends the position information and the speed information to the central processing unit, the central processing unit analyzes whether the moving speed of the obstacles is greater than or equal to 10m/S and the distance between the moving speed of the obstacles and the augmented reality glasses is smaller than 100m, and if yes, when the step S7 is carried out, the central processing unit sends out an instruction to enable the alarm device to send out vibration alarms in the corresponding directions.
Since the augmented reality glasses also make a sound to enhance the sense of reality of the augmented reality when the user is immersed in the phantom, but also cause the user to be unable to notice surrounding sound information, it is easy for the object to fly out of the way to the user quickly without the user being aware of it. Therefore, the method collects the position information and the moving speed of the obstacles around the glasses by arranging the radar device. The obstacle is considered to hurt the user when the moving speed reaches 10m/s so as to give a reminder, and if the obstacle moves rapidly at a place outside 100m, the central processing unit does not consider that the obstacle hurts the user, so that an alarm is not given.
Compared with the prior art, the invention has the advantages that:
(1) According to the invention, by comparing the preset three-dimensional model with the collected external information, the obstacle which is not found in the original game field is discovered, so that the user is reminded in time, and the user is prevented from falling down due to the fact that the user touches the obstacle.
(2) According to the invention, by setting various alarm modes, a user can know the type of the danger according to the alarm modes and timely make corresponding countermeasures.
(3) The infrared sensor can also collect temperature information of the obstacle in front of the augmented reality glasses and send the information to the central processing unit, so that the situation that a user cannot know whether flame is real or fictive is avoided, and burn is caused by touching the user with the hands.
Detailed Description
The invention will be further illustrated with reference to specific examples. It is to be understood that these examples are illustrative of the present invention and are not intended to limit the scope of the present invention. Further, it is understood that various changes and modifications may be made by those skilled in the art after reading the teachings of the present invention, and such equivalents are intended to fall within the scope of the claims appended hereto.
An early warning method of augmented reality glasses based on a game field comprises the following steps:
s1: manually inputting three-dimensional structure information of the game field to the central processing unit 9;
s2: the central processing unit 9 establishes a three-dimensional model of a game field according to the three-dimensional structure information;
s3: when the user walks into the game field, the first positioning device 10 collects glasses position information of the positions of the augmented reality glasses worn by the user and transmits the glasses position information to the central processing unit 9;
s4: the first orientation means 13 collects the glasses orientation information of the augmented reality glasses and transmits the glasses orientation information to the central processing unit 9;
s5: the image acquisition terminal collects distance information between the object in front of the augmented reality glasses and the azimuth of the object and sends the distance information and the azimuth information to the central processing unit 9;
s6: the central processing unit 9 compares the three-dimensional model, the glasses position information, the glasses orientation information and the distance information and the azimuth information collected by the image acquisition terminal, judges whether an object which is not originally arranged exists in the game field, marks the object as an obstacle if the object exists in the game field, and executes the step S7, otherwise, does not continue to execute the operation;
s7, the central processing unit 9 sends a corresponding instruction to the alarm device according to the information of the obstacle;
s8: the alarm device gives out alarms of different degrees according to the instruction.
The augmented reality glasses, including the body 1 of augmented reality glasses, body 1 includes glasses frame, transparent lens 2, central processing unit 9 and miniature projector 3, still including being used for acquireing the image acquisition terminal of glasses place ahead object and glasses distance and position, sending out the alarm device of different alarms according to different circumstances, be used for acquireing the first positioner 13 of glasses orientation information and be used for the first positioner 10 of location body 1 position, central processing unit 9 respectively with miniature projector 3, image acquisition terminal, alarm device, first positioner 13 and first positioner 10 signal connection, image acquisition terminal, alarm device, first positioner 13 set up on body 1. The first orientation device 13 may be a gyroscopic sensor or other device capable of acquiring information about the orientation of the glasses. The first positioning device 10 may be a GPS device, or other device that may obtain information about the position of the glasses. The image collection terminal may be a device such as a depth camera 4 that may collect location and depth information.
The alarm device further comprises an audible alarm device 6 for sounding an alarm.
The alarm device comprises a plurality of flashing alarm devices 7 which emit flashing light, wherein the flashing alarm devices 7 are arranged on the glasses frame and surround the periphery of the lens 2.
The alarm device further comprises a vibration alarm device 8, the vibration alarm device 8 being arranged on both sides of the spectacle frame.
The augmented reality glasses further include an infrared sensor 12, and the augmented reality glasses sense the temperature of the object through the infrared sensor 12. The infrared sensor 12 is in signal connection with the central processing unit 9.
The body 1 is also provided with a radar sensing device 5 for sensing objects at two sides, and the radar sensing device 5 is in signal connection with a central processing unit 9.
The body 1 is provided with a first wireless communication device 11, and the first wireless communication device 11 is in signal connection with the central processing unit 9.
The game field is provided with a cloud processor 14 and a second wireless communication device 15, and the cloud processor 14 is in signal connection with the second wireless communication device 15.
The game field is also provided with a plurality of displacement sensors. The displacement sensor is in signal connection with the cloud processor 14.
There is an immovable infrastructure and movable items in the playground. The movable object of the game field is provided with a second positioning device 17 and a second azimuth device 18, wherein the second positioning device 17 is used for collecting object position information of the position of the movable object, and the second azimuth device 18 is used for collecting object azimuth information of the orientation of the movable object.
The movable objects of the game field in the method are provided with the second positioning device 17 and the second azimuth device 18, through the two devices, the cloud processor 14 can judge the placed position and the direction of the objects in time, and can build a new three-dimensional model according to the original three-dimensional model, and the three-dimensional model can correctly reflect the existing position information and the direction information of the objects, so that the central processing unit 9 can be prevented from giving false alarms to users according to the original three-dimensional model. A rotating camera 16 is also provided in the playground for capturing the status of the user.
The alarm includes a flashing alarm, an audible alarm, and a vibratory alarm.
By setting various alarm modes according to the danger to be appeared, the user can know the type of the danger according to the alarm mode and make corresponding countermeasures in time.
In the step S8, the alarm device gives an alarm in the corresponding direction of the augmented reality glasses according to the positional relationship between the obstacle and the augmented reality glasses.
Example 1
After the central processing unit 9 analyzes and compares the three-dimensional model, the glasses position information, the glasses orientation information and the distance information and the azimuth information collected by the image acquisition terminal, the central processing unit 9 can analyze the azimuth and the distance of the obstacle, according to the azimuth information, the flash alarm device 7 emits flashing soft light at the corresponding position, along with the fact that the distance between the augmented reality glasses and the obstacle is more and more close, the frequency of the flashing light is higher, and a user can timely discover real objects in the augmented reality phantom according to the flashing frequency and the azimuth of the light, so that mutual collision is avoided.
As described above, the flash alarm device 7 of the present embodiment is applicable to other embodiments.
Example 2:
the method further comprises the steps that when the central processing unit 9 finds that the front of the augmented reality glasses has an obstacle, the central processing unit 9 calculates the moving speed of the obstacle relative to the ground of the game through the image data, the glasses position information and the glasses orientation information collected by the image collecting terminal, if the moving speed of the obstacle is greater than 5m/S, when the step S7 is carried out, the central processing unit 9 sends out an instruction to enable the alarm device to send out an audible alarm to remind that the front of the obstacle moves fast, and at the moment, the flashing alarm device 7 also sends out flashing soft light at the corresponding position, and the flashing frequency of the light is higher as the distance between the augmented reality glasses and the obstacle is closer, so that the user is prevented from touching the obstacle in front.
As described above, the alarm method in the present embodiment is applicable to other embodiments.
Example 3
The method further comprises the step that the infrared sensor 12 collects the temperature information of the obstacle in front of the augmented reality glasses and sends the information to the central processing unit 9, and the central processing unit 9 sends out an instruction to make the alarm device sound an alarm when the temperature of the obstacle in front is higher than 40 ℃ or lower than 0 ℃ in step S7.
As described above, the alarm method in the present embodiment is applicable to other embodiments.
Example 4
Since it is difficult to pay attention to the environment other than the phantom when the user is immersed in the phantom of the augmented reality and the external sound information is easily ignored, the method further includes collecting the position information and the speed information of the obstacle around the augmented reality glasses by the radar device and transmitting them to the central processing unit 9 at step S6, the central processing unit 9 analyzing whether the moving speed of the obstacle is 10m/S or more and the distance from the augmented reality glasses is less than 100m, and if so, the central processing unit 9 gives an instruction to make the vibration alarm device 8 vibrate at the corresponding position of the glasses frame at step S7.
Example 5
In order to avoid that the processing capacity of the central processing unit 9 is too large, the method further comprises that at step S6, the central processing unit 9 uploads the three-dimensional model of the game field, the position information, the orientation information, and the distance information and the azimuth information of the object and the glasses to the cloud processor 14 through the wireless communication device, the cloud processor 14 compares the information, marks the object which is not arranged on the original game field as an obstacle if the object is found, and sends the position and the shape information of the obstacle to the central processing unit 9 through the wireless communication device.
The cloud processor 14 is also included to send location information of all users to the central processing unit 9 of all users through the network.
Further comprising, at step S6: the second positioning device 17 carried by the object in the game field collects the object position information of the position of the object and transmits the object position information to the cloud processor 14, the second azimuth device 18 carried by the object collects the object orientation information of the object and transmits the object orientation information to the cloud processor 14, and the cloud processor 14 modifies the three-dimensional model of the game field according to the collected object position information and the object orientation information and transmits the three-dimensional model to the central processing unit 9.
As described above, in this embodiment, the three-dimensional model, the position information, the orientation information, the distance information between the object and the glasses, and the azimuth information of the game field are uploaded to the cloud processor 14, so that other embodiments can be applied to the cloud processor 14 to assist in processing the information.
It is to be understood that the above examples of the present invention are provided by way of illustration only and not by way of limitation of the embodiments of the present invention. Other variations or modifications of the above teachings will be apparent to those of ordinary skill in the art. It is not necessary here nor is it exhaustive of all embodiments. Any modification, equivalent replacement, improvement, etc. which come within the spirit and principles of the invention are desired to be protected by the following claims.