Skiing blind area safety prompting system and control method thereof
Technical Field
The invention relates to the technical field of visual expansion of ski resort, in particular to a skiing blind area safety prompting system and a control method thereof.
Background
Most of the time, the injury from the impact between skiers is much greater than the injury from the skier wearer's wrestling, and any form of injury may occur. In addition to mastering the correct wrestling posture, it is more important how to avoid colliding with others.
Firstly, it is important to have adequate observation during skating, especially when the skating speed is slow or when traversing a snow track, to pay attention to the observation of the upper side of a hill, and secondly, to observe the distance between the other person and the wearer, the relative speed of the wearer and the other person, and the skating trajectory.
The single plate has a visual field of almost 360 degrees due to the sliding of the front and rear blades, which is beneficial to the observation of the surrounding environment of the snow road, and the double plates have a blind area with a large angle behind the single plate due to the visual field facing the mountain.
In the sliding process, a skier needs to master the sliding speed of a wearer, the safety distance between the wearer and a skier ahead and pre-judge the movement mode of the skier ahead, and prepares for overtaking or braking at any time; meanwhile, the speed, the distance from the skier to the wearer and the sliding track of the skier above the back are kept in mind, and the skier is ready to release or throw away at any time; the left side and the right side pay attention to the position occupied by the wearer and the running mode of the other side, so that the blind areas are prevented from colliding, and the large and small rotary lines are prevented from being mutually alternated.
In the case of high-speed skating, the skier can pay more attention to the control of speed and body posture, and can hardly notice the skating speed and the skating track of the skier in the rear blind area. Since the skier in front of the road has higher priority for selecting the route, during the sliding process, the skier behind the road is tense due to insufficient sliding skill and personal experience, and cannot adjust the route in time, when the skier behind and the skier in front collide, the skier in front often does not have enough time to change the route and adjust the direction, at this moment, collision and falling are often generated, and the collision is often serious and any type of collision injury under the condition of high speed.
In the prior art, no equipment for expanding the sense organ of the skier exists, when the skier slides, the image behind the wearer can be preferably obtained in real time, the position, the moving speed and the moving track of the skier, which possibly collides with the wearer, relative to the wearer in the image are evaluated, displayed and reminded, so that the visual field of the wearer is expanded, the wearer has sufficient time to adjust the direction and change the lane, the collision with the skier behind the body is avoided, and the skiing safety is improved.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to solve the technical problems that: the method comprises the steps of acquiring an image behind a wearer in real time, evaluating, displaying and reminding the position, moving speed and moving track of a skier possibly colliding with the wearer in the image relative to the wearer, so that the visual field of the wearer is expanded, the wearer has sufficient time to adjust the direction and change the lane, the collision with the skier behind is avoided, and the skiing safety is improved.
The invention is realized by adopting the following technical scheme, and the skiing blind area safety prompting system designed according to the purpose comprises: the device comprises an image acquisition unit, an image deformation processing unit, a skier detection unit, a direction detection unit, a distance detection unit, a relative speed detection unit, a track prediction unit, a wireless communication unit, a storage unit, a main control module, a power management unit, a lithium battery, a driving unit, a display unit and a vibration unit.
An image acquisition unit: a camera device is arranged on the back of a helmet or clothes, and continuous images with preset number are obtained in real time.
The image processing unit includes: an image deformation processing unit, a skier detection unit, a direction detection unit, a distance detection unit, a relative speed detection unit, and a trajectory prediction unit.
An image deformation processing unit: and carrying out deformation processing on the acquired continuous images of the preset number.
Skier detection unit: the shape of the skier is detected from the acquisition of a preset number of consecutive images.
A direction detection unit: if the skier detection unit detects the shape of the skier from acquiring a preset number of consecutive images, it is used to calculate the direction of the rear skier relative to the wearer.
A distance detection unit: if the skier detection unit detects the shape of the skier from acquiring a preset number of consecutive images, it is used to calculate the distance of the rear skier from the wearer.
The direction detection unit and the distance detection unit obtain position information of the rear skier relative to the wearer, and the position information comprises the direction and the distance of the rear skier relative to the wearer.
Relative speed detection unit: if the skier detection unit detects the shape of the skier from the acquisition of a preset number of continuous images, the distance detection unit calculates the change of the rear skier relative to the distance of the wearer in any two frames of images in real time, and the moving speed of the rear skier relative to the wearer is obtained by dividing the change of the rear skier relative to the distance of the wearer by the time for acquiring the two frames of images.
When the moving speed of the rear skier relative to the wearer is positive, the rear skier gradually accelerates toward the wearer.
When the moving speed of the rear skier relative to the wearer is negative, it means that the rear skier gradually decelerates away from the wearer.
When the moving speed of the rear skier relative to the wearer is 0, it indicates that the moving speeds of the rear skier and the wearer are the same.
A trajectory prediction unit: if the skier detection unit detects the shape of the skier from the acquisition of a preset number of continuous images, the movement track of the rear skier relative to the wearer is estimated by comparing the sliding posture of the rear skier with different sliding posture models of left turn, straight run and right turn stored in the storage unit.
And (4) estimating the movement track of a rear skier, and performing learning training through a large number of pictures by adopting a convolutional neural network to obtain a sliding posture model of turning left, going straight and turning right.
During training, 5000 pictures are respectively adopted to train different sliding posture models of a skier for left turning, straight running and right turning.
The wireless communication unit: wireless communication is performed through infrared, Bluetooth, WiFI or Zigbee.
A storage unit: different skating gesture models of a skier turning left, going straight and turning right are stored.
A power management unit: the method is used for charging management of the lithium battery.
A drive unit: for driving the display unit and the vibration unit.
A display unit: the position, speed and movement track information of the rear skier relative to the wearer are displayed through the AR glasses.
A vibration unit: the vibration prompting is carried out on the skier in a vibration mode of the vibration motor.
The method comprises the steps that a preset number of continuous images are obtained in real time through an image obtaining unit, the image deformation processing unit carries out deformation processing on the obtained preset number of continuous images, if a skier is detected from the obtained preset number of continuous images through a skier detecting unit, a direction detecting unit calculates the direction of a rear skier relative to a wearer, a distance detecting unit calculates the distance of the rear skier relative to the wearer, a relative speed detecting unit calculates the moving speed of the rear skier relative to the wearer, and a track predicting unit predicts the moving track of the rear skier relative to the wearer; the direction, distance, speed and moving track information of the rear skier, which possibly collides with the wearer in the image, relative to the wearer is displayed and reminded, so that the visual field of the wearer is expanded, the wearer has sufficient time to adjust the direction and change the track, the collision with the skier behind is avoided, and the skiing safety is improved.
If the distance of the rear skier relative to the wearer is larger than the safe distance corresponding to the moving speed of the rear skier relative to the wearer, the AR glasses perform low-brightness display on the position, speed and moving track information of the rear skier relative to the wearer; if the distance between the rear skier and the wearer is smaller than the safe distance corresponding to the moving speed of the rear skier and the wearer, the AR glasses process the position, the speed and the moving track of the rear skier and simultaneously perform vibration prompting by the vibration motor.
A safety prompt control method for a skiing blind area comprises the following steps: the method comprises the steps that image information on the back of a wearer is obtained in real time through a camera device, the position, the speed and the movement track information of a rear skier possibly colliding with the wearer in an image relative to the wearer are displayed and reminded, and if the distance of the rear skier relative to the wearer is larger than the safety distance corresponding to the movement speed of the rear skier relative to the wearer at the moment, AR glasses perform low-brightness display on the position, the speed and the movement track information of the rear skier relative to the wearer; if the distance between the rear skier and the wearer is smaller than the safe distance corresponding to the moving speed of the rear skier and the wearer, the AR glasses process the position, the speed and the moving track of the rear skier and simultaneously perform vibration prompting by the vibration motor.
In any two images, the speed of movement of the rear skier relative to the wearer is obtained by dividing the change in distance of the rear skier relative to the wearer by the time at which the two images were acquired.
The movement trajectory of the rear skier relative to the wearer is estimated by comparing the sliding posture of the rear skier with different sliding posture models of left turn, straight run and right turn stored in the storage unit.
A convolutional neural network is adopted, and learning training is carried out through a large number of pictures to obtain a left-turn, straight-going and right-turn sliding posture model. During training, 5000 pictures are respectively adopted to train different sliding posture models of a skier for left turning, straight running and right turning.
Drawings
FIG. 1 is a logic diagram of the present invention.
Fig. 2 is a safety distance relationship diagram corresponding to the moving speed of the rear skier relative to the wearer.
Fig. 3 is a schematic view of the working scenario of the present invention.
Fig. 4 is a view of the processed skiing scene in fig. 3 displayed through VR glasses.
FIG. 5 is a flowchart of the process of the present invention.
In fig. 3, 101 is the wearer, 102 is the second skier, 103 is the third skier, and 104 is the fourth skier.
Detailed Description
The invention is further illustrated with reference to the accompanying drawings and specific examples.
First embodiment
The movement trajectory of the rear skier relative to the wearer is estimated by comparing the sliding posture of the rear skier with different sliding posture models of left turn, straight run and right turn stored in the storage unit.
During the sliding process, the body posture of the skier changes slowly, the posture of the skier can be captured, after the posture of the skier changes, because the friction force between the snowboard and the contacted snow track is small, the change of the sliding direction of the skier and the change of the posture of the skier have certain hysteresis, and therefore the sliding track of the skier can be estimated according to the sliding posture of the skier.
In the sliding process, the change of the sliding direction of the skier can be obtained by capturing the posture change of the skier, and then the change of the sliding track direction of the skier is obtained, so that the sliding track of the skier is estimated.
A convolutional neural network is adopted, and learning training is carried out through a large number of pictures to obtain a left-turn, straight-going and right-turn sliding posture model. During training, 5000 pictures are respectively adopted to train different sliding posture models of a skier for left turning, straight running and right turning.
Second embodiment
As shown in fig. 1-4, fig. 3 and 4, 101 is the wearer, 102 is the second skier, 103 is the third skier, and 104 is the fourth skier.
A camera device is placed on the back of a helmet or clothes of a user 101, a preset number of continuous images are acquired in real time, and an image deformation processing unit carries out deformation processing on the acquired preset number of continuous images.
The skier detection unit detects three skiers, 102 a second skier, 103 a third skier, and 104 a fourth skier, respectively, from acquiring a preset number of consecutive images.
The direction detection unit calculates the directions of three rear skiers relative to the 101 wearer, 102 the second skier being located directly behind the 101 wearer, 103 the third skier being located to the left of the 101 wearer, and 103 the fourth skier being located to the right of the 101 wearer.
The distance detection unit calculates the current distances of the three rear skiers relative to the 101 wearer, the distance of the second skier 102 relative to the 101 wearer is S2, the distance of the third skier 103 relative to the 101 wearer is S3, and the distance of the fourth skier relative to the 101 wearer is S4.
The relative speed detection unit obtains the moving speed of the three skiers behind relative to the 101 wearer by dividing the change of the distance of the three skiers behind relative to the 101 wearer by the time of acquiring the two-frame image in any two-frame image, wherein the moving speed of the second skier 102 relative to the 101 wearer is set as V2, the moving speed of the third skier 103 relative to the 101 wearer is set as V3, and the moving speed of the fourth skier relative to the 101 wearer is set as V4.
The trajectory prediction unit predicts the movement trajectories of the three rear skiers with respect to the 101 wearer, compares the sliding postures of the three rear skiers with different sliding posture models of left turn, straight run and right turn stored in the storage unit, and obtains the movement trajectories of the three rear skiers with respect to the 101 wearer, 102 the second skier slides along the right front, 103 the third skier slides along the front, and the fourth skier slides along the left front.
According to the safety distance relationship diagram corresponding to the moving speed of the rear skier relative to the 101 wearer in fig. 2, a safety distance L2 corresponding to the moving speed V2 of the second skier relative to the 101 wearer, a safety distance L3 corresponding to the moving speed V3 of the third skier relative to the 101 wearer, and a safety distance L4 corresponding to the moving speed V4 of the fourth skier relative to the 101 wearer are calculated 102, 103, respectively.
Suppose that the distance S2 of the second skier 102 relative to the 101 wearer is currently less than the safety distance L2 corresponding to the moving speed V2 of the second skier 102 relative to the 101 wearer.
Suppose that the distance S3 of the third skier 103 relative to the 101 wearer is currently greater than the safety distance L3 corresponding to the moving speed V3 of the third skier relative to the 101 wearer.
Assume that the distance S4 of the fourth skier currently relative to the 101 wearer > the safety distance L4 corresponding to the moving speed V4 of the fourth skier relative to the 101 wearer.
The AR glasses perform low-brightness display of the position, speed, and movement trajectory information of the third and fourth skiers in the rear 103 with respect to the 101-wearer, and the display color is green.
The AR glasses process the position, speed and movement trajectory of the second skier on the rear 102 with respect to the 101 wearer with high brightness and color change, display the color red, and vibration prompt with the vibration motor.
Therefore, the direction, distance, speed and movement track information of a rear skier possibly colliding with the 101 wearer in the image relative to the 101 wearer is displayed and reminded, the visual field of the 101 wearer is expanded, the 101 wearer has sufficient time to adjust the direction and change the lane, the collision with the skier behind is avoided, and the skiing safety is improved.
Third embodiment
As shown in fig. 2, the safe distance relationship corresponding to the moving speed of the rear skier relative to the wearer is shown.
The horizontal axis represents the moving speed of the rear skier relative to the wearer, the vertical axis represents the safe distance, and different safe distances are corresponding to different moving speeds of the rear skier relative to the wearer.
The speed of movement of the rear skier relative to the wearer is positively correlated to the corresponding safe distance.
When the moving speed of the rear skier relative to the wearer is larger, the safety distance between the wearer and the rear skier is larger; when the moving speed of the rear skier relative to the wearer is small, the safety distance between the wearer and the rear skier is small; therefore, the wearer has enough time to adjust the direction and change the lane, and the collision with the skier behind the wearer is avoided.
Fourth embodiment
As shown in fig. 5: the program of the present invention flows to the flowchart.
Step S11: a preset number of consecutive images are acquired by an image acquisition unit.
Step S12: the image deformation processing unit performs deformation processing on the image.
Step S13: determining whether the skier detection unit detects a skier from acquiring a preset number of consecutive images, and if the skier detection unit detects a skier from acquiring the preset number of consecutive images, performing S14; if the skier detection unit does not detect a skier from acquiring a preset number of consecutive images, it returns to S11.
Step S14: the direction detection unit calculates the direction of the rear skier relative to the wearer, the distance detection unit calculates the distance of the rear skier relative to the wearer, and the direction detection unit and the distance detection unit obtain the position information of the rear skier relative to the wearer.
Step S15: in any two frames of images, the relative speed detection unit obtains the moving speed of the rear skier relative to the wearer by dividing the change in the distance of the rear skier relative to the wearer by the time at which the two frames of images are acquired.
Step S16: the trajectory prediction means predicts the movement trajectory of the rear skier with respect to the wearer by comparing the sliding posture of the rear skier with different sliding posture models of left turn, straight run, and right turn stored in the storage means.
Step S17: determining whether the distance from the rear skier to the wearer at the moment is greater than the safe distance corresponding to the moving speed of the rear skier to the wearer, and if the distance from the rear skier to the wearer at the moment is greater than the safe distance corresponding to the moving speed of the rear skier to the wearer, executing S18; if the distance between the rear skier and the wearer is not greater than the safety distance corresponding to the moving speed of the rear skier and the wearer, S19 is executed.
Step S18: the AR glasses perform low-brightness display of position, speed, and movement trajectory information of the rear skier with respect to the wearer.
Step S19: the AR glasses process the high brightness and color change of the position, speed and moving track of the rear skier relative to the wearer, and simultaneously the vibration motor carries out vibration prompt.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention; all equivalent changes and modifications made according to the present invention are covered by the scope of the claims of the present invention.