CN117695606A - 5G communication-based spinning virtual reality system and exercise method - Google Patents

Abstract

The invention belongs to the technical field of spinning, and particularly discloses a spinning virtual reality system and an exercise method based on 5G communication, comprising an unmanned vehicle provided with a panoramic camera and VR equipment, wherein the unmanned vehicle is used for collecting environment videos, and the VR equipment is used for playing virtual scene videos manufactured according to the environment videos; the spinning is provided with a speed measuring module which is connected with a computer module; the speed measuring module is used for detecting the wheel rotating speed of the spinning and transmitting the wheel rotating speed to the computer module; the computer module is used for calculating the speed of the vehicle according to the rotation speed of the wheels and setting the playing speed of the virtual scene video of the rider according to the speed of the vehicle; the computer module is connected with a vision camera module; the visual camera module is used for shooting riding videos including a rider and the spinning in real time and transmitting the riding videos to the computer module; the invention provides a 5G communication-based spinning virtual reality system and an exercise method capable of realizing face-to-face interactive communication of a plurality of people.

Description

5G communication-based spinning virtual reality system and exercise method

Technical Field

The invention belongs to the technical field of spinning, and particularly relates to a spinning virtual reality system and an exercise method based on 5G communication.

Background

With the rapid pace of social life and the rise of health consciousness, the demands of people for body building exercises are increasing. Spinning has become an important choice for daily exercise as a popular exercise tool. However, the conventional spinning has problems of tedious environment and lack of interactivity of the rider during the exercise, which makes the improvement of user experience an urgent need.

To address the current challenges, virtual reality technology is a very potential approach. Through carrying head-mounted display equipment, the rider can see virtual road surface environment in real time in the riding process, including mountain river, urban scene and the like. The environment simulation not only makes the sports interesting, but also improves the motion power and experience of the rider. The existing invention has been proposed to combine spinning and virtual reality, but has the defects in the aspects of self gesture display, multi-user face-to-face interactive communication, real-time display in a virtual environment according to the speed of a user, and the like, and cannot realize the functions of multi-user real-time video communication supervision, self motion state observation, and the like.

Disclosure of Invention

The invention aims to provide a 5G communication-based spinning virtual reality system and an exercise method capable of realizing face-to-face interaction communication of a plurality of people.

Based on the above purpose, the invention adopts the following technical scheme:

A5G communication-based spinning virtual reality system comprises an unmanned vehicle provided with a panoramic camera and VR equipment, wherein the unmanned vehicle is used for collecting an environment video, and the VR equipment is used for playing a virtual scene video manufactured according to the environment video; the spinning is provided with a speed measuring module which is connected with a computer module; the speed measuring module is used for detecting the wheel rotating speed of the spinning and transmitting the wheel rotating speed to the computer module; the computer module is used for calculating the speed of the vehicle according to the rotation speed of the wheels and setting the playing speed of the virtual scene video of the rider according to the speed of the vehicle; the computer module is connected with a vision camera module, and the vision camera module is arranged around the spinning; the visual camera module is used for shooting riding videos including a rider and the spinning in real time and transmitting the riding videos to the computer module; the computer module is used for transmitting the riding video and the vehicle speed to other computer modules; the computer module is used for adding the riding video to the virtual scene video.

Further, the computer module comprises a redundant information removing module and a picture information inserting module; the redundant information removing module is used for disassembling the riding video frame by frame into continuous riding images and removing environment redundant information except the riders and the spinning in the riding images; the picture information inserting module is used for calculating the number of frames of the interval between two adjacent riding images in the virtual scene video, and inserting the riding images into the virtual scene video according to the number of frames of the interval.

Further, an azimuth detection module and a sound detection module are arranged in the VR equipment; the position detection module is used for recording the real-time eye position of the rider and transmitting the real-time eye position to the computer module, and the computer module is used for matching the real-time eye position with the position of the panoramic camera on the unmanned vehicle; the sound detection module is used for recording the sound information of the rider and transmitting the sound information to the computer module, and the computer module is used for transmitting the sound information to other computer modules and transmitting the sound information of other riders to the VR equipment.

Further, the computer module is connected with a health detection module, and the health detection module is used for monitoring health information of a rider in real time and transmitting the health information to the computer module, wherein the health information comprises blood pressure, blood oxygen, heart rate, consumed heat, anaerobic exercise time and aerobic exercise time information; the computer module is used for transmitting the health information to other computer modules; the computer module is used for adding the health information to the virtual scene video.

Further, the computer module is connected with a 5G transmission and receiving module, and the computer module transmits and receives the speed, riding video, sound information and health information of the spinning through the 5G transmission and receiving module.

Further, the speed measuring module comprises a Hall speed measuring module arranged on the wheel of the spinning, the Hall speed measuring module effectively calculates the rotating speed of the wheel in unit time by using the Hall element, and the rotating speed information of the wheel is transmitted into the computer module, and the computer module calculates the vehicle speed according to the rotating speed of the wheel.

Furthermore, the computer module is matched with the road surface reached by the current rider in the virtual environment according to the road surface environment information acquired in advance, the bicycle fluctuation information is sent to the spinning, the road surface fluctuation condition is transmitted in real time, and the riding authenticity is improved.

A spinning virtual reality exercise method based on 5G communication comprises the following steps:

step 1, an unmanned vehicle collects an environment video as a virtual scene video;

step 2, shooting riding videos including a rider and a spinning in real time;

step 3, adding the riding video to the virtual scene video;

and 4, measuring and calculating the speed of the spinning, and setting the playing speed of the virtual scene video according to the speed.

Further, in step 3, firstly, the riding video information is disassembled into continuous riding images frame by frame, and the environment redundant information except the rider and the spinning is removed from the riding images; then, the number of frames of the inserted adjacent two riding images in the interval of the virtual scene video is calculated, and the riding images are sequentially inserted into the virtual scene video according to the number of frames of the interval.

Further, in step 3, the number of frames of the adjacent two riding images in the virtual scene video interval is calculated as follows:

wherein V is _ti Real-time speed of spinning for the ith rider, V ₀ The vehicle speed for acquiring the environment video for the unmanned vehicle is K, and the frame rate for acquiring the environment video for the unmanned vehicle is K.

Further, in step 3, the YOLO algorithm is used to remove the environmental redundant information in the riding image.

Further, in step 4, the method for calculating the vehicle speed of the spinning is as follows:

wherein V is _t The method comprises the steps of representing real-time speed of the spinning, m representing count value of a computer pulse counter at the moment T, d representing diameter of wheels of the spinning, T representing sampling time of computer speed pulse signals, and n representing number of Hall magnetic steel on the wheels of the spinning.

The virtual scene seen by the rider is video information acquired on the corresponding road by the unmanned vehicle running at a constant speed in advance and the panoramic camera mounted above the unmanned vehicle. The speed of the unmanned vehicle is set to be a constant V ₀ The roaming distance information in the video playing process, namely the distance which is passed by each frame of change, can be obtained, and the specific formula is as follows:

wherein R represents a roaming distance, V ₀ And K is the frame rate of shooting by the panoramic camera for the speed of the unmanned vehicle.

According to the real-time speed V of the spinning _t And the roaming distance R can obtain the playing speed of the video acquired by the unmanned vehicle in the VR equipment, namely the frame rate K':

setting a delay time t between frames:

and playing the environmental video information acquired by the unmanned vehicle in the head-mounted VR equipment according to the calculated frame rate K' and the delay time t, so as to realize the feeling of being on the scene.

Compared with the prior art, the invention has the following beneficial effects:

1. according to the invention, a rider can sense a virtual environment on the spinning in real time by introducing a virtual reality technology, the computer module calculates the speed of the spinning in real time according to the rotating speed of wheels, sets the video playing rate of a virtual scene according to the current speed, plays the picture seen by the rider on the head-mounted VR equipment in real time according to the playing rate, changes the video of the virtual scene according to the riding speed, and makes the rider feel more real and closer to outdoor training; the innovative design greatly stimulates the interest of the user in exercise, and compared with the traditional spinning, the user can maintain the participation degree for a long time more easily.

2. The 5G transmission and receiving module utilizes the low delay of 5G communication to transmit and receive the information of the position, speed, sound, picture, health and the like of the current rider and other matched users in real time, and sends the information to the head-mounted VR equipment through computer processing, so that barrier-free interaction of the users across areas is realized. Even if a plurality of users are not in the same room, the barrier-free voice communication can be realized by only using the spinning system and matching the same room number, and the positions of other users in the scene can be seen on the head-mounted VR equipment and the display screen through moving the head, so that the actual riding process is efficiently simulated, and the high interactivity and social experience are realized. The real-time interaction among multiple users is realized by adopting the 5G communication technology, and the user can see other riders in the virtual environment and conduct voice or text communication by transmitting the riding video and voice information in real time. The social interaction breaks through the limitation of the traditional single person exercise, and the spinning becomes a social platform, so that the participation feeling and social experience of the user are enhanced.

3. And when the computer module calculates that the blood pressure, the blood oxygen, the heart rate and the like of the rider detected by the health detection module are abnormal, warning is added in the virtual scene and the sound at the same time. Meanwhile, due to the safety consideration, part of important health information of a rider is used as part of transmission information of the 5G transmission and receiving module for observation and supervision of other users, so that accidents are effectively avoided. The health detection module monitors the health condition and exercise consumption of the user in real time and provides comprehensive health management for the user. The characteristics enable the spinning to be not only an entertainment tool, but also intelligent health auxiliary equipment, personalized sport advice and safety warning are provided for users, and the scientificity and sustainability of sports are improved.

By combining the above, the system can realize the functions of multi-user cross-region riding, communication and real-time health data detection in virtual reality, the virtual reality scene is completely consistent with the real scene, the seen scene can be changed along with the visual field change, the information of the position, the posture, the health condition and the like of the peer in the current scene can be seen, and the 5G communication is applied without delay and barrier.

Drawings

Fig. 1 is a schematic diagram of embodiment 1 of the present invention.

Detailed Description

Example 1

A5G communication-based dynamic bicycle module virtual reality system is shown in fig. 1, and comprises an unmanned bicycle and a head-mounted VR device, wherein a panoramic camera and a position sensor are arranged on the unmanned bicycle; the unmanned vehicle is used for collecting an environment video and recording road bump information, and the head-mounted VR equipment is used for playing a virtual scene video manufactured according to the environment video; the spinning module is provided with a speed measuring module which is connected with a computer module; the speed measuring module comprises a Hall speed measuring module arranged at the edge of the driving wheel of the spinning module, the Hall speed measuring module uses the Hall element to effectively calculate the rotating speed of the driving wheel in unit time, and the rotating speed of the driving wheel is transmitted to the computer module; the computer module is used for calculating the real-time speed of the spinning module according to the real-time rotating speed of the driving wheel, setting the playing speed of the virtual scene video of the rider according to the speed, and obtaining the current position information and the road surface fluctuation condition according to the played virtual scene video.

The computer module is connected with a visual camera module and a 5G transmission and receiving module; the visual camera module is arranged at the front end of the spinning module, and is used for shooting riding videos comprising the postures of a rider and the spinning module in real time and transmitting the riding videos to the computer module; the computer module is used for matching computer modules of other riders, the computer module receives the riding video from the vision camera module, and the computer module is used for adding the riding video into the virtual scene video. The computer module comprises a redundant information removing module and a picture information inserting module; the redundant information removing module is used for disassembling the riding video frame by frame into continuous riding images and removing environment redundant information outside the riding person and the spinning module in the riding images; the picture information inserting module is used for calculating the number of frames of the interval between two adjacent riding images in the virtual scene video, and inserting the riding images into the virtual scene video according to the number of frames of the interval. The computer module is used for transmitting the riding image and the vehicle speed to other matched computer modules through the 5G transmission and receiving module.

Furthermore, a position detection module and a sound detection module are installed in the head-mounted VR equipment, and the position detection module and the sound detection module are connected with a Bluetooth module; the position detection module is used for collecting the head position data of the rider, transmitting the head position data to the Bluetooth module and transmitting the head position data to the computer module by the Bluetooth module; the sound detection module is used for collecting the sound information of the rider and transmitting the sound information to the Bluetooth module, and then the sound information is transmitted to the computer module by the Bluetooth module; the computer module is used for matching the real-time position of the eyes with the azimuth of the panoramic camera on the unmanned vehicle; the computer module is used for transmitting sound information to other matched computer modules through the 5G transmission and receiving module, and is also used for transmitting received sound information of other riders to the head-mounted VR device.

Further, the computer module is connected with a health detection module, and the health detection module is worn on the wrist of the rider; the health detection module is used for monitoring health information of a rider in real time and transmitting the health information to the computer module; the health information includes blood pressure, blood oxygen, heart rate, heat consumption, anaerobic exercise time and aerobic exercise time information; the computer module is used for transmitting the health information to other matched computer modules through the 5G transmission and receiving module; the computer module is used for adding health information of other riders to the virtual scene video of the current rider.

The computer module is connected with the display screen module, and the computer module uniformly processes the received real-time riding video, sound information, vehicle speed and health information of the current rider, sends the processed riding video, sound information, vehicle speed and health information to the head-mounted VR equipment and the display screen module through the Bluetooth module, and transmits the position, riding video, sound information, vehicle speed and health information to other matched computer modules through the 5G transmission and receiving module.

Example 2

An exercise method using the 5G communication-based spinning module virtual reality system of embodiment 1, comprising the steps of:

and step 1, an unmanned vehicle collects an environment video as a virtual scene video. The method comprises the steps of using an unmanned vehicle to run on a road surface where environmental videos need to be collected at a constant speed, using a panoramic camera on the unmanned vehicle to shoot the environmental videos in the whole course, recording road surface bump information in real time by a position sensor, adding the bump information into shot video information, and using the environmental videos as virtual scene videos played during training. The speed of the unmanned vehicle when collecting the environment video information is controlled to be as small as possible, and the frame rate is as large as possible so as to ensure that the cross-frame insertion can be realized. The speed of the unmanned vehicle is set to be a constant V ₀ The roaming distance information in the video playing process, namely the distance which is passed by each frame of change, can be obtained, and the specific formula is as follows:

wherein R represents a roaming distance in meters per frame; v (V) ₀ The speed of the unmanned vehicle is in meters per second; k is the frame rate of panoramic camera shooting, and the unit isFrame/second.

Step 2, the visual camera module shoots riding videos comprising the postures of a rider and the spinning module in real time, and transmits the riding videos to the computer module; the position detection module collects the head position data of the rider, transmits the head position data to the Bluetooth module, and then transmits the head position data to the computer module through the Bluetooth module; the sound detection module collects the sound information of the rider and transmits the sound information to the Bluetooth module, and then the sound information is transmitted to the computer module by the Bluetooth module; the health detection module monitors health information of the rider in real time and transmits the health information to the computer module. The computer module matches the head real-time position with the azimuth of the unmanned vehicle panoramic camera, so that the virtual scene position seen by a user is the same as the corresponding position visual angle of the panoramic camera. When the computer module calculates that the health information of the rider is abnormal, warning is added in the virtual scene video and sound information, and the virtual scene video and sound are displayed on the head-mounted VR device and the display screen module. Meanwhile, due to safety, part of important health information of a rider can be used as part of transmission information of the 5G transmission and receiving module for observation and supervision of other users, so that accidents are effectively avoided.

And 3, adding the riding video to the virtual scene video. Firstly, the computer module disassembles riding video information into continuous riding images frame by frame, and removes environment redundant information except the riding person and the spinning module from the riding images by using a computer vision algorithm YOLO algorithm to obtain the riding images only comprising the riding person and the spinning module. And adding the health information detected by the health detection module into the riding image in real time to obtain a real-time picture and health condition of a user under the condition of using the spinning module. And calculating the number of frames of the inserted adjacent two riding images at intervals in the virtual scene video, and sequentially inserting the riding images into the virtual scene video according to the number of frames at intervals. And then taking the continuous riding image of the current rider as a small window to play video, and playing the video at the left lower corner of the head-mounted VR device and the display screen module of the current rider, so that the user can observe the riding state of the user in the virtual environment in real time in the head-mounted VR device, and other people can watch the video through the display screen module.

The computer module utilizes the 5G transmission and receiving module to transmit the processed continuous riding image and voice information added with the health information, the speed of the spinning module and other information to the 5G transmission and receiving module (6) of other matched riders; meanwhile, the 5G transmission and receiving module is used for receiving continuous riding image and voice information of other riders, speed information of the spinning module and the like, and the computer module is used for receiving information of the other riders received by the 5G transmission and receiving module. According to the speed information of the dynamic bicycle modules of different riders, the continuous riding images of other riders are inserted into the virtual scene video of the current rider in real time, the continuous riding images of the other riders are played at the road position in the virtual scene video, and then the combined final virtual environment video is played at the panoramic interfaces of the head-mounted VR equipment and the display screen module according to the Hall speed measuring module. Meanwhile, the computer module sends the received voice information to the head-mounted VR equipment of the current rider through the Bluetooth module, so that the rider can observe the real-time positions of other matched riders in the current scene through moving the head-mounted VR equipment in the riding process, voice and action communication is performed, and a video communication function is realized.

In order to embody the speed of the spinning module of different riders in the virtual scene video, the riding images are inserted into the appropriate frames at intervals in the virtual scene video according to the speed of the spinning module of different riders, so that the riding speeds of different riders can be embodied in the playing process of the virtual scene video. When the riding images are inserted into the virtual scene video, the riding images are inserted into the first frame of the virtual scene video, then the number of frames of the interval between two adjacent riding images in the virtual scene video is calculated according to the following mode, and the subsequent riding image frame insertion is carried out:

wherein V is _ti For the movement of the ith riderReal-time speed of bicycle sensing module, V ₀ The vehicle speed for acquiring the environment video for the unmanned vehicle is K, and the frame rate for acquiring the environment video for the unmanned vehicle is K. Every ΔK, starting from the first frame of the virtual scene video _i The frame inserts the riding image of the user and the bicycle added with the health information, and ensures that the inserted riding image is continuous and has no offensive feeling with the virtual environment.

And 4, measuring and calculating the speed of the spinning module, and setting the playing speed of the virtual scene video according to the speed. When the virtual scene video is played, the Hall speed measuring module effectively calculates the rotating speed of the driving wheel in unit time by using the Hall element and transmits the rotating speed into the computer module, and the computer module calculates the real-time speed of the spinning module, and the method comprises the following steps:

wherein V is _t The method comprises the steps of representing real-time vehicle speed of the spinning module, m representing the count value of a computer pulse counter at the moment T, d representing the diameter of wheels of the spinning module, T representing the sampling time of computer speed pulse signals, and n representing the number of Hall magnetic steel on the wheels of the spinning module.

According to the real-time speed V of the spinning module _t And a roaming distance R, a playing speed of the virtual scene video in the head-mounted VR device can be obtained, namely, a frame rate K':

a delay time t is set between frames in milliseconds/frame:

and playing the virtual scene video in the head-mounted VR equipment according to the calculated frame rate K' and the delay time t, so as to realize the feeling of being in the scene.

And when the virtual scene video is played, the computer module is matched with the road surface reached by the current rider in the virtual environment according to the road surface environment information acquired in advance, the bicycle fluctuation information is sent to the bicycle module, the road surface fluctuation condition is transmitted in real time, and the riding authenticity is improved.

In conclusion, the invention effectively overcomes the defects in the prior art and has high industrial utilization value. The above-described embodiments are provided to illustrate the gist of the present invention, but are not intended to limit the scope of the present invention. It will be understood by those skilled in the art that various modifications and equivalent substitutions may be made to the technical solution of the present invention without departing from the spirit and scope of the technical solution of the present invention.

Claims (9)

1. The spinning virtual reality system based on 5G communication is characterized by comprising an unmanned vehicle provided with a panoramic camera and VR equipment, wherein the unmanned vehicle is used for collecting environment videos, and the VR equipment is used for playing virtual scene videos manufactured according to the environment videos; the spinning is provided with a speed measuring module which is connected with a computer module; the speed measuring module is used for detecting the wheel rotating speed of the spinning and transmitting the wheel rotating speed to the computer module; the computer module is used for calculating the vehicle speed according to the wheel rotation speed and setting the playing speed of the virtual scene video of the rider according to the vehicle speed; the computer module is connected with a vision camera module; the visual camera module is used for shooting riding videos including a rider and a spinning in real time and transmitting the riding videos to the computer module; the computer module is used for transmitting the riding video and the vehicle speed to other computer modules; the computer module is used for adding the riding video to the virtual scene video.

2. The 5G communication based spinning virtual reality system of claim 1, wherein the computer module comprises a redundant information removal module and a picture information insertion module; the redundant information removing module is used for disassembling the riding video frame by frame into continuous riding images and removing environment redundant information except a rider and a spinning in the riding images; the picture information insertion module is used for calculating the number of frames of the inserted adjacent two riding images in the interval of the virtual scene video, and inserting the riding images into the virtual scene video according to the number of frames of the interval.

3. The 5G communication-based spinning virtual reality system of claim 2, wherein an azimuth detection module and a sound detection module are disposed in the VR device; the position detection module is used for recording the real-time eye position of the rider and transmitting the real-time eye position to the computer module, and the computer module is used for matching the real-time eye position with the position of the panoramic camera on the unmanned vehicle; the sound detection module is used for recording the sound information of the rider and transmitting the sound information to the computer module, and the computer module is used for transmitting the sound information to other computer modules and transmitting the sound information of other riders to the VR equipment.

4. The 5G communication-based spinning virtual reality system of claim 3, wherein the computer module is connected with a health detection module for monitoring health information of a rider in real time and transmitting the health information to the computer module, wherein the health information comprises blood pressure, blood oxygen, heart rate, consumed heat, anaerobic exercise time and aerobic exercise time information; the computer module is used for transmitting the health information to other computer modules; the computer module is used for adding the health information to the virtual scene video.

5. The 5G communication based spinning virtual reality system of claim 4, wherein the computer module is connected with a 5G transmission and reception module, and the computer module transmits and receives the speed, riding video, sound information and health information of the spinning through the 5G transmission and reception module.

6. A5G communication-based spinning virtual reality exercise method is characterized by comprising the following steps:

step 1, an unmanned vehicle collects an environment video as a virtual scene video;

step 2, shooting riding videos including a rider and a spinning in real time;

step 3, adding the riding video to the virtual scene video;

and 4, measuring and calculating the speed of the spinning, and setting the playing speed of the virtual scene video according to the speed.

7. The 5G communication-based virtual reality exercise method for spinning of claim 6, wherein in step 3, first, the riding video information is broken down into continuous riding images frame by frame, and environmental redundant information outside the rider and the spinning is removed from the riding images; then, the number of frames of the inserted adjacent two riding images in the interval of the virtual scene video is calculated, and the riding images are sequentially inserted into the virtual scene video according to the number of frames of the interval.

8. The 5G communication-based spinning virtual reality exercise method of claim 7, wherein in step 3, the number of frames of adjacent two riding images in a virtual scene video interval is calculated as follows:

wherein V is _ti Real-time speed of spinning for the ith rider, V ₀ The vehicle speed for acquiring the environment video for the unmanned vehicle is K, and the frame rate for acquiring the environment video for the unmanned vehicle is K.

9. The 5G communication based spinning virtual reality exercise method of claim 8, wherein in step 3, environmental redundant information in the riding image is removed using YOLO algorithm.