AR-based skiing blind area display system and control method thereof
Technical Field
The invention relates to the technical field of ski field safety guidance, in particular to a skiing blind area display system based on AR and a control method thereof.
Background
Most of the time, the injury from the impact between skiers is much greater than the injury from the skier's wrestling, and any form of injury may occur. In addition to mastering the correct wrestling posture, it is more important how to avoid colliding with others.
Firstly, it is important to have adequate observation during skating, especially when the skating speed is slow or when traversing a snow track, to pay attention to the observation of the upper side of a hill, and secondly, to observe the distance between the other person and the wearer, the relative speed of the wearer and the other person, and the skating trajectory.
The single plate has a visual field of almost 360 degrees due to the sliding of the front and rear blades, which is beneficial to the observation of the surrounding environment of the snow road, and the double plates have a blind area with a large angle behind the single plate due to the visual field facing the mountain.
In the sliding process, a skier needs to master the sliding speed of a wearer, the safety distance between the wearer and a skier ahead and pre-judge the movement mode of the skier ahead, and prepares for overtaking or braking at any time; meanwhile, the speed, the distance from the skier to the wearer and the sliding track of the skier above the back are kept in mind, and the skier is ready to release or throw away at any time; the left side and the right side pay attention to the position occupied by the wearer and the running mode of the other side, so that the blind areas are prevented from colliding, and the large and small rotary lines are prevented from being mutually alternated.
In the case of high-speed skating, the skier can pay more attention to the control of speed and body posture, and can hardly notice the skating speed and the skating track of the skier in the rear blind area. Since the skier in front of the road has higher priority for selecting the route, during the sliding process, the skier behind the road is tense due to insufficient sliding skill and personal experience, and cannot adjust the route in time, when the skier behind and the skier in front collide, the skier in front often does not have enough time to change the route and adjust the direction, at this moment, collision and falling are often generated, and the collision is often serious and any type of collision injury under the condition of high speed.
The slideways on the boundaries of the left side and the right side of the ski field are not smooth and have a lot of bulges, a skier can easily fly out of the slideways and lose control when encountering the bulged ground in the process of high-speed sliding, and a skier with poor technology can easily lose control and fall down at the boundaries of the ski field, so that great potential safety hazards exist.
The skiing method has the advantages that some skiers sliding from the mountain to wait for queuing to take towing or cable cars are often arranged at the boundary of the deceleration area under the mountain of the skiing field, the queue is very long in peak time, and great potential safety hazards exist for the 'beginners' sliding from the mountain to the mountain, which often cannot brake well to decelerate and are easy to rush into the queued crowds.
The patent 'skiing blind area safety prompting system and control method thereof' obtains image information on the back of a wearer in real time through a camera device, and displays and reminds the position, speed and movement track information of a rear skier relative to the wearer, wherein the rear skier possibly collides with the wearer in the image. The mode of collecting the image behind the body through the camera is that in the turning process of the wearer, the image information shot by the camera rotates along with the rotation of the body direction of the wearer, and the image information collected behind the body is unstable and difficult to process.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to solve the technical problems that: the method comprises the steps of acquiring information of skiers around a snow track where a wearer is located in real time, and evaluating, displaying and reminding the position, the moving speed and the moving track of the skier, relative to the wearer, which may collide with the wearer, so that the visual field of the wearer is expanded, the wearer has sufficient time to adjust the direction and change the track, the collision with the surrounding skiers is avoided, and the skiing safety is improved.
The invention is realized by adopting the following technical scheme, and the AR-based skiing blind area display system designed according to the purpose comprises: a plurality of mobile terminals and a server.
The mobile terminal includes: the device comprises a position detection unit, a first storage unit, a first wireless communication unit, a main control module, a power management unit, a lithium battery, a driving unit, a display unit and a vibration unit.
The position detection unit includes: the system comprises a geomagnetic sensor, a gyroscope, an acceleration sensor and a global positioning system receiver; the position detection unit detects the current spatial position, moving direction, moving speed, and acceleration information of the wearer based on the characteristics of the various sensors.
A first storage unit: and storing the map information of the ski field, the boundary of the ski field and the mark of the boundary of the deceleration area around the ski field in the map.
The first wireless communication unit: and the wireless communication is carried out with the server through infrared, Bluetooth, WiFI or Zigbee.
The main control module: the method is used for data operation processing.
A power management unit: the method is used for charging management of the lithium battery.
A drive unit: for driving the display unit and the vibration unit.
A display unit: and displaying the boundary information of the ski field, the boundary information of the deceleration zone around the ski field, and the position information and the color information of the wearer and the skiers around the ski field in a preset first distance area through VR glasses.
A vibration unit: the vibration prompt is carried out on the wearer in a vibration mode of the vibration motor.
The server includes: the device comprises a second wireless communication unit, a distance detection unit, a boundary detection unit, a labeling unit, a comparison unit, a second storage unit and a pushing unit; the method is used for data receiving, sending and arithmetic processing.
A distance detection unit: and calculating the distance between the wearer and the adjacent skiers in real time according to the spatial position information of the current wearer.
A boundary detection unit: and calculating the distance between the wearer and the boundary of the ski field, and calculating the distance between the wearer and the boundary of the ski field deceleration zone.
Labeling unit: automatically or manually identifying and mapping the boundary of the ski field and the boundary of the deceleration zone around the ski field into a virtual coordinate system, and marking the boundary of the ski field and the boundary of the deceleration zone around the ski field in a map; and mapping the spatial position information of all the wearers into a virtual coordinate system, and labeling the dynamic positions of all the wearers in the map.
A comparison unit:
comparing the distance between the wearer and the adjacent skier with the first safe distance, and if the distance between the wearer and the adjacent skier is not more than the first safe distance, changing the color marked in the map by the wearer and the adjacent skier.
And comparing the distance between the wearer and the boundary of the ski field with the second safe distance, and if the distance between the wearer and the boundary of the ski field is not more than the second safe distance, changing the color marked in the map by the wearer, and displaying the boundary information of the ski field by the VR glasses.
And comparing the distance between the wearer and the boundary of the ski field deceleration zone with the third safe distance, if the distance between the wearer and the boundary of the ski field deceleration zone is not more than the third safe distance, changing the color marked in the map by the wearer, and displaying the boundary information of the ski field deceleration zone by VR glasses.
A second storage unit: storing map information of the ski field, the boundary of the ski field and the mark of the boundary of the deceleration area around the ski field in the map; the location of the contact impact between the wearer and the adjacent skier, the glide trajectory before the impact, is recorded.
A pushing unit: the method comprises the steps of periodically summarizing the positions of contact collision between a wearer and an adjacent skier and the sliding tracks before the collision, marking the positions in a ski field map, and carrying out color deepening marking on the positions with high frequency of collision.
A skiing blind area display control method based on AR comprises the following steps:
the server acquires map information of the ski field, automatically or manually identifies the boundary of the ski field and the boundary of the deceleration zone around the ski field, maps the boundary of the ski field and the boundary of the deceleration zone around the ski field into a virtual coordinate system, and marks the boundary of the ski field and the boundary of the deceleration zone around the ski field in the map.
All wearers in the ski resort send current spatial position, direction of movement, speed of movement and acceleration information to the server in real time.
The server calculates the spatial positions of all the wearers in the ski field in real time, maps the spatial position information of all the wearers into a virtual coordinate system, and labels the dynamic positions of all the wearers in a map.
In a preset distance area, the server calculates the distance between each wearer and the adjacent skiers in real time, the distance between each wearer and the boundary of the ski field deceleration area and the safety distance, and the change of the color marked by each wearer and the adjacent skiers is judged by comparing the distance with the safety distance.
Respectively calculating the distance between each wearer and the adjacent skier in a preset first distance area, comparing the distance with the first safe distance, and if the distance between the wearer and the adjacent skier is greater than the first safe distance, keeping the colors marked in the map by the wearer and the adjacent skier unchanged; if the distance between the wearer and the adjacent skier is not greater than the first safe distance, the colors marked in the map by the wearer and the adjacent skier change.
Respectively calculating the distance between each wearer and the boundary of the ski field in a preset second distance area, comparing the distance with a second safety distance, and if the distance between the wearer and the boundary of the ski field is greater than the second safety distance, not changing the color marked in the map by the wearer; if the distance between the wearer and the boundary of the ski field is not more than the second safe distance, the color marked in the map by the wearer changes.
Respectively calculating the distance between each wearer and the boundary of the ski field deceleration zone in a preset third distance zone, comparing the distance with a third safety distance, and if the distance between the wearer and the boundary of the ski field deceleration zone is greater than the third safety distance, not changing the color marked in the map by the wearer; and if the distance between the wearer and the boundary of the ski field deceleration zone is not more than the third safe distance, the color marked in the map by the wearer is changed.
The server sends the spatial position information of the wearer, the spatial position information of other skiers in the preset first distance area and the color information to the wearer in real time.
And if the distance between the wearer and the boundary of the ski field is not greater than the second safety distance, the server sends the boundary display information of the ski field to the wearer.
And if the distance between the wearer and the boundary of the ski field deceleration zone is not greater than the third safety distance, the server sends the boundary display information of the ski field deceleration zone to the wearer.
Displaying the spatial position information of the wearer, the spatial position information and the color information of other skiers in a preset first distance area in real time through VR (virtual reality) glasses on the wearer; the vibration prompt is carried out on the wearer in a vibration mode of the vibration motor.
And if the distance between the wearer and the boundary of the ski field is not greater than the second safety distance, the VR glasses display the boundary information of the ski field.
And if the distance between the wearer and the boundary of the deceleration zone of the ski resort is not more than the third safety distance, the VR glasses display the boundary information of the deceleration zone of the ski resort.
The preset distance region includes: a first distance region, a second distance region, and a third distance region.
The preset first distance region: a square area centered on the wearer.
The preset second distance region: areas at a certain distance from the boundary of the ski field.
The preset third distance area: an area at a certain distance from the boundary of the deceleration zone of the ski field.
The safe distance includes: a first safe distance, a second safe distance, and a third safe distance.
The first safe distance is a safe distance between the wearer and an adjacent skier.
The second safe distance is a safe distance between the wearer and the boundary of the ski field.
The third safe distance is the safe distance between the wearer and the boundary of the deceleration zone of the ski field.
VR glasses of the wearer display position information, moving direction information, boundary information and color information, and an interactive interface is simplified.
If the wearer and the surrounding skiers are in contact collision, the system records the collision position and the sliding track before collision, periodically summarizes the contact collision position and the sliding track before collision between the wearer and the adjacent skiers, marks the positions in the ski field map, and carries out color deepening marking on the positions with high-frequency collision. The safety of the slide way of the ski field is fed back through a large amount of contact collision data, so that a large amount of data support is provided for the reconstruction of the slide way.
Drawings
FIG. 1 is a logic diagram of the present invention.
FIG. 2 is a diagram of a fourth scenario of a fourth skier, numbered 104, according to the present invention.
Fig. 3 shows a view of the fourth skier 104 in the scene of fig. 2 through VR glasses.
FIG. 4 is a schematic view of a second skier, numbered 102, according to the present invention.
Fig. 5 shows a view of the second skier 102 of the scene of fig. 4 through VR glasses.
FIG. 6 is a schematic view of a first skier, designated 101, according to the present invention.
Fig. 7 shows a view of the first skier 101 in the scene of fig. 6 through VR glasses.
FIG. 8 is a flowchart of the procedure of the present invention.
In fig. 2, 4 and 6, 101 is the first skier, 102 is the second skier, 103 is the third skier, 104 is the fourth skier, 105 is the fifth skier, 106 is the sixth skier.
11 is a preset first distance zone, i.e. a square zone centred on the wearer.
12 is a preset second distance area, i.e. an area at a certain distance from the boundary of the ski field.
13 is a preset third distance zone, i.e. a zone at a certain distance from the boundary of the deceleration zone of the ski field.
L1 is the first safe distance, i.e. the safe distance between the wearer and the adjacent skier.
L2 is the second safe distance, i.e. the safe distance of the wearer from the ski field boundary.
L3 is the third safety distance, i.e. the safety distance of the wearer from the boundary of the ski field deceleration zone.
S1 is the distance between the wearer and the adjacent skier.
S2 is the distance of the wearer from the ski field boundary.
S3 is the distance of the wearer from the boundary of the ski field deceleration zone.
Detailed Description
The invention is further illustrated with reference to the accompanying drawings and specific examples.
First embodiment
In fig. 2, all skiers wear a mobile terminal, and all the skiers in the ski park send the current spatial position, moving direction, moving speed and acceleration information to the server in real time through the first wireless communication unit.
The server acquires map information of the ski field, automatically or manually identifies the boundary of the ski field and the boundary of the deceleration zone around the ski field, maps the boundary of the ski field and the boundary of the deceleration zone around the ski field into a virtual coordinate system, and marks the boundary of the ski field and the boundary of the deceleration zone around the ski field in the map.
The server receives the spatial positions, the moving directions, the moving speeds and the acceleration information of all the wearers in the ski field in real time through the second wireless communication unit, calculates the spatial positions of all the wearers in the ski field in real time, maps the spatial position information of all the wearers into a virtual coordinate system, and marks the dynamic positions of all the wearers in a map.
Calculating 104 the distance between the fourth skier and the adjacent skier and comparing the calculated distance with the L1 first safety distance in a first distance area preset by 11 with the fourth skier as the center, wherein if the distance between the fourth skier and the adjacent skier 104 is greater than the L1 first safety distance, the color marked in the map by the fourth skier and the adjacent skier 104 is green; if 104 the distance between the fourth skier and the adjacent skiers is not greater than the first safety distance L1, then 104 the color marked in the map by the fourth skier and the adjacent skiers changes, and the color changes to red.
In fig. 2, 103 the third, 105 fifth and 106 sixth skiers are located in the 11 preset first distance area, 106 the distance between the sixth skier and 104 the fourth skier is greater than the L1 first safety distance, 106 the sixth skier is marked in the map with green color; the distance between the 103 third and 105 fifth skiers and the 104 fourth skier is no greater than the L1 first safety distance, the 103 third skier, the 104 fourth skier and the 105 fifth skier are marked red in the map.
Calculating 104 the distance between the fourth skier and the boundary of the ski field and comparing the distance with the second safety distance L2, if the distance between the fourth skier 104 and the boundary of the ski field is greater than the second safety distance L2, the color marked in the map by the fourth skier 104 is not changed; if 104 the fourth skier is not more than the second safe distance L2 from the ski field boundary, the color marked in the map by 104 the fourth skier changes.
In fig. 2, the distance between the 104 th skier and the boundary of the ski field is greater than the second safety distance L2, and the color marked on the map by the 104 th skier does not change.
Calculating 104 the distance between the fourth skier and the boundary of the deceleration zone of the ski field and comparing the distance with the third safe distance L3, and if the distance between the fourth skier 104 and the boundary of the deceleration zone of the ski field is greater than the third safe distance L3, the color marked in the map by the fourth skier 104 is not changed; if the distance between the fourth skier 104 and the boundary of the ski field deceleration zone is not greater than the third safe distance L3, the color marked in the map by the fourth skier 104 changes.
In fig. 2, the distance between the 104 th skier and the boundary of the ski field deceleration zone is greater than the third safety distance L3, and the color marked on the map by the 104 th skier does not change.
The server transmits the spatial position information and the color information of the other skiers in the first distance area preset by 11 to the fourth skier 104 in real time.
If 104 the fourth skier is not more than the second safe distance L2 from the ski field boundary, the server sends 104 the ski field boundary display to the fourth skier.
If the distance between the fourth skier 104 and the boundary of the ski field deceleration zone is not more than the third safe distance L3, the server sends 104 the display information of the boundary of the ski field deceleration zone to the fourth skier.
In fig. 2, the distance between the 104 fourth skier and the boundary of the ski field is greater than the L2 second safety distance and the distance between the 104 fourth skier and the boundary of the ski field deceleration zone is greater than the L3 third safety distance, the server does not transmit the ski field boundary display information and the ski field deceleration zone boundary display information to the 104 fourth skier.
In fig. 3, the spatial position information of the fourth skier, the spatial position information of the other skiers in the 11 preset first distance area, and the color information are displayed 104 in real time through VR glasses on the fourth skier 104.
106 the distance between the sixth skier and the fourth skier 104 is greater than the first safety distance L1, 106 the sixth skier is displayed green in color; the distance between the 103 third skier and 105 fifth skier and the 104 fourth skier is not more than the L1 first safety distance, the 103 third skier, the 104 fourth skier and the 105 fifth skier are displayed in red color, and the vibration motor gives a vibration indication.
104 the fourth skier is at a distance greater than the second safe distance L2 from the ski field boundary, the VR glasses do not display ski field boundary information.
104 the fourth skier is farther from the boundary of the ski field deceleration zone than the third safe distance L3, the VR glasses do not display ski field deceleration zone boundary information.
Second embodiment
In fig. 4, 104 the fourth skier is located in the 11 preset first distance area, the distance between 104 the fourth skier and 102 the second skier is greater than the L1 first safety distance, 104 the fourth skier is marked in the map with green color, and 102 the second skier is marked in the map with no change in color.
In fig. 4, the distance between the 102 second skier and the boundary of the ski field is not more than the second safety distance L2, the color marked on the map by the 102 second skier changes to red, and the server sends the boundary display information of the ski field to the 102 second skier.
In fig. 4, the distance between the 102 second skier and the boundary of the ski field deceleration zone is greater than the third safety distance L3, the color marked on the map by the 102 second skier does not change, and the server does not send the boundary display information of the ski field deceleration zone to the 102 second skier.
In fig. 5, the VR glasses of the second skier 102 displays the second skier's own spatial location information, the spatial location information and the color information of the other skiers in the 11 preset first distance area in real time, the distance between the fourth skier 104 and the second skier 102 is greater than the L1 first safety distance, and the fourth skier 104 is displayed in green color.
The distance between the 102 second skier and the boundary of the ski field is not more than the second safety distance L2, VR glasses display the boundary information of the ski field, the color marked by the 102 second skier in the map is changed into red, and the vibration motor carries out vibration prompt.
The distance between the 102 second skier and the boundary of the ski field deceleration zone is greater than the third safe distance L3, and the VR glasses do not display ski field deceleration zone boundary information.
Third embodiment
In fig. 6, none of the remaining skiers are located in the first distance area preset at 11, and 101 the color marked on the map by the first skier is not changed.
In fig. 6, the distance between 101 first skier and the ski field boundary is greater than the second safety distance L2, the color marked on the map by 101 first skier does not change, and the server does not send 101 first skier ski field boundary display information.
In fig. 6, the distance between 101 the first skier and the boundary of the ski area deceleration zone is not more than the third safety distance L3, the color marked on the map by 101 the first skier changes to red, and the server sends 101 the display information of the boundary of the ski area deceleration zone to 101 the first skier.
In fig. 7, the spatial position information of the first skier, the spatial position information of the other skiers in the 11 preset first distance area, and the color information are displayed in real time 101 through VR glasses on the first skier 101.
101 the first skier is at a distance greater than the second safe distance L2 from the ski field boundary and the VR glasses do not display ski field boundary information.
101 the distance between the first skier and the boundary of the deceleration zone of the ski field is not more than the third safe distance L3, VR glasses display the boundary information of the deceleration zone of the ski field, 101 the color marked by the first skier in the map is changed into red, and the vibration motor carries out vibration prompt.
Fourth embodiment
As shown in fig. 8: the program of the present invention flows to the flowchart.
Step S11: the server acquires map information of the ski field, automatically or manually identifies the boundary of the ski field and the boundary of the deceleration zone around the ski field, maps the boundary of the ski field and the boundary of the deceleration zone around the ski field into a virtual coordinate system, and marks the boundary of the ski field and the boundary of the deceleration zone around the ski field in the map.
Step S12: all wearers in the ski resort send the current spatial position, moving direction, moving speed and acceleration information to the server in real time through the first wireless communication unit.
Step S13: the server receives the spatial positions, the moving directions, the moving speeds and the acceleration information of all the wearers in the ski field in real time through the second wireless communication unit, calculates the spatial positions of all the wearers in the ski field in real time, maps the spatial position information of all the wearers into a virtual coordinate system, and marks the dynamic positions of all the wearers in a map.
Step S14: determining whether the distance between the wearer and the adjacent skier is greater than a first safety distance, and if the distance between the wearer and the adjacent skier is not greater than the first safety distance, performing S15; if the distance between the wearer and the adjacent skier is greater than the first safety distance, S16 is performed.
Step S15: the colors marked in the map by the wearer and the adjacent skiers change.
Step S16: the colors marked in the map by the wearer and the adjacent skiers do not change.
Step S17: judging whether the distance between the wearer and the boundary of the ski field is greater than a second safety distance or not, and if the distance between the wearer and the boundary of the ski field is not greater than the second safety distance, executing S18; if the wearer is located a distance from the ski field boundary greater than the second safe distance, S19 is performed.
Step S18: the color marked by the wearer in the map changes, and the VR glasses display the boundary information of the ski field.
Step S19: the color marked by the wearer in the map does not change, and the VR glasses do not display ski field boundary information.
Step S20: judging whether the distance between the wearer and the boundary of the ski field deceleration zone is greater than a third safety distance or not, and if the distance between the wearer and the boundary of the ski field deceleration zone is not greater than the third safety distance, executing S21; if the distance between the wearer and the boundary of the ski field deceleration zone is greater than the third safety distance, S22 is executed.
Step S21: the color marked by the wearer in the map changes, and the VR glasses display the boundary information of the deceleration zone of the ski resort.
Step S22: the color marked by the wearer in the map is not changed, and the VR glasses do not display the boundary information of the deceleration zone of the ski field.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention; all equivalent changes and modifications made according to the present invention are covered by the scope of the claims of the present invention.