CN111131916A - Panoramic video interactive playing method based on treadmill - Google Patents

Panoramic video interactive playing method based on treadmill Download PDF

Info

Publication number
CN111131916A
CN111131916A CN202010051944.7A CN202010051944A CN111131916A CN 111131916 A CN111131916 A CN 111131916A CN 202010051944 A CN202010051944 A CN 202010051944A CN 111131916 A CN111131916 A CN 111131916A
Authority
CN
China
Prior art keywords
panoramic video
speed
video
playing
running platform
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010051944.7A
Other languages
Chinese (zh)
Inventor
李建微
叶成英
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fuzhou University
Original Assignee
Fuzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuzhou University filed Critical Fuzhou University
Priority to CN202010051944.7A priority Critical patent/CN111131916A/en
Publication of CN111131916A publication Critical patent/CN111131916A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • A63B2071/06363D visualisation
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • A63B2071/0638Displaying moving images of recorded environment, e.g. virtual environment
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • A63B2071/0638Displaying moving images of recorded environment, e.g. virtual environment
    • A63B2071/0644Displaying moving images of recorded environment, e.g. virtual environment with display speed of moving landscape controlled by the user's performance

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention provides a running platform-based panoramic video interactive playing method, which comprises the following steps of; step S1: shooting a panoramic video by using panoramic video shooting equipment; step S2: importing the shot panoramic video into a panoramic video playing system; step S3: when the panoramic video playing system plays a video, the watching space of a playing field is arranged on a running platform for video watching personnel to walk or run, and the panoramic video playing system is connected with the running platform through wireless communication equipment to obtain the current running speed of the watching personnel on the running platform; step S4: associating the panoramic video playing speed with the current running speed of the viewer, and synchronously adjusting the speed of the panoramic video playing speed along with the change of the current running speed of the viewer; the invention can realize better immersive experience, enhance the interactive effect and increase the healthy exercise amount of the user to a certain extent.

Description

Panoramic video interactive playing method based on treadmill
Technical Field
The invention relates to the technical field of panoramic video playing, in particular to a running platform-based panoramic video interactive playing method.
Background
At present, a method for roaming by using a panoramic technology is mainly three-dimensional panoramic image roaming, that is, several panoramic images are associated in a link mode, and a user can go to other images for tour by clicking other image links of the current panoramic image, but the method mainly uses static tour and has poor immersion.
In a further development, a panoramic video visiting mode is adopted, and a user watches the panoramic video shot by a fixed path, so that panoramic roaming of a plurality of scenes is realized. However, as the user watches the video which is shot according to the fixed path and speed, the user cannot control the browsing speed through the independent intention due to the pure video watching, and the interactivity is relatively poor.
In view of this, the interactive panoramic video playing method based on the human running speed data provided by the invention has the beneficial effects that: according to the panoramic video playing method provided by the invention, the user can control the playing speed of the panoramic video by adjusting the running speed of the user, so that the user can select a proper speed to visit or stay at the proper speed to watch carefully in the roaming process, better immersive experience can be realized, the interactive effect can be enhanced, the healthy exercise amount of the user can be increased to a certain extent, and the interactive mode can be applied to the playing of various videos later.
Disclosure of Invention
The invention provides a running platform-based panoramic video interactive playing method, which can realize better immersive experience, enhance interactive effect and increase the healthy exercise amount of a user to a certain extent.
The invention adopts the following technical scheme.
A panoramic video interactive playing method based on a treadmill comprises the following steps;
step S1: shooting a panoramic video by using panoramic video shooting equipment;
step S2: importing the shot panoramic video into a panoramic video playing system;
step S3: when the panoramic video playing system plays a video, the watching space of a playing field is arranged on a running platform for video watching personnel to walk or run, and the panoramic video playing system is connected with the running platform through wireless communication equipment to obtain the current running speed of the watching personnel on the running platform;
step S4: and associating the panoramic video playing speed with the current running speed of the viewer, and synchronously adjusting the speed of the panoramic video playing speed along with the change of the current running speed of the viewer.
And the viewer watches the video played by the panoramic video playing system through the head-mounted display.
When the head of a video viewer moves, the panoramic video playing system switches the video playing visual angle according to the orientation of the head-mounted display, so that the video viewer can browse scenes all around by means of the head-mounted display.
When the video viewer browses the scene by means of the head-mounted display, the panoramic video playing system can display the name of the scene or the name of the object currently displayed by the head-mounted display.
In step S1, the panoramic video photographing apparatus photographs a panoramic video at a preset path and a preset travel speed.
The step S2 includes the following steps;
step A1, creating a background sphere space which can be used as a panoramic video playing system to play video and setting the radius of the sphere;
a2, acquiring sequence frame images in the panoramic video playing process, and mapping the sequence frame images to a texture map which can be matched with the size of a sphere;
a3, attaching the texture map to the sphere, and creating a rendering script for the sphere, wherein the rendering script can enable the sphere to generate an internal and external double-sided mapping display effect;
step A4, when the panoramic video playing system plays the video, the camera position of the panoramic video playing system is arranged at the center of the sphere, so that the user can be positioned at the center of the sphere and watch the panoramic video through the camera view angle when watching the video;
and A5, making a jump interface and video target object labeling for the panoramic video playing system.
The step S3 includes the following steps;
step B1, connecting the wireless communication equipment to the computer;
step B2, placing the running platform at a playing place, enabling a video viewer to run or walk on the running platform, and pairing the wireless communication equipment with the running platform to acquire the current running speed of the viewer;
and step B3, acquiring the current running speed of the viewer from the wireless communication equipment by software preinstalled in the computer, and importing the running speed as the traveling speed data of the viewing point when the panoramic video is viewed into the panoramic video playing system.
The wireless communication equipment comprises an ANT + sensor worn by a video viewer; an ANT + equipment sensing area which can enable the running platform to be paired with the ANT + sensor is arranged at the running platform.
The ANT + sensor is an ANT + watch.
In step S4, after the panoramic video playing system receives the panoramic video viewing point travel speed data converted from the running speed, the panoramic video playing speed is associated with the panoramic video viewing point travel speed data, and the speed of the panoramic video playing speed, the pause and the start of the video playing are synchronously adjusted according to the change of the speed of the travel speed data.
The interactive panoramic video playing method based on the human running speed data has the beneficial effects that: according to the panoramic video playing method provided by the invention, the user can control the playing speed of the panoramic video by adjusting the running speed of the user, so that the user can select a proper speed to visit or stay at the proper speed to watch carefully in the roaming process, better immersive experience can be realized, the interactive effect can be enhanced, the healthy exercise amount of the user can be increased to a certain extent, and the interactive mode can be applied to the playing of various videos later.
Drawings
The invention is described in further detail below with reference to the following figures and detailed description:
FIG. 1 is a schematic diagram of an embodiment of the present invention;
FIG. 2 is a schematic flow diagram of the present invention;
FIG. 3 is another schematic flow diagram of the present invention;
in the figure: 1-running a platform; 2-ANT + device sensing area; 3-head mounted display.
Detailed Description
As shown in fig. 1-3, a panoramic video interactive playing method based on a treadmill includes the following steps;
step S1: shooting a panoramic video by using panoramic video shooting equipment;
step S2: importing the shot panoramic video into a panoramic video playing system;
step S3: when the panoramic video playing system plays a video, the watching space of a playing field is arranged on a running platform 1 for a video watching person to walk or run, and the panoramic video playing system is connected with the running platform through wireless communication equipment to obtain the current running speed of the watching person on the running platform;
step S4: and associating the panoramic video playing speed with the current running speed of the viewer, and synchronously adjusting the speed of the panoramic video playing speed along with the change of the current running speed of the viewer.
The viewer watches the video played by the panoramic video playing system through the head-mounted display 3.
When the head of a video viewer moves, the panoramic video playing system switches the video playing visual angle according to the orientation of the head-mounted display, so that the video viewer can browse scenes all around by means of the head-mounted display.
When the video viewer browses the scene by means of the head-mounted display, the panoramic video playing system can display the name of the scene or the name of the object currently displayed by the head-mounted display.
In step S1, the panoramic video photographing apparatus photographs a panoramic video at a preset path and a preset travel speed.
The step S2 includes the following steps;
step A1, creating a background sphere space which can be used as a panoramic video playing system to play video and setting the radius of the sphere;
a2, acquiring sequence frame images in the panoramic video playing process, and mapping the sequence frame images to a texture map which can be matched with the size of a sphere;
a3, attaching the texture map to the sphere, and creating a rendering script for the sphere, wherein the rendering script can enable the sphere to generate an internal and external double-sided mapping display effect;
step A4, when the panoramic video playing system plays the video, the camera position of the panoramic video playing system is arranged at the center of the sphere, so that the user can be positioned at the center of the sphere and watch the panoramic video through the camera view angle when watching the video;
and A5, making a jump interface and video target object labeling for the panoramic video playing system.
The step S3 includes the following steps;
step B1, connecting the wireless communication equipment to the computer;
step B2, placing the running platform at a playing place, enabling a video viewer to run or walk on the running platform, and pairing the wireless communication equipment with the running platform to acquire the current running speed of the viewer;
and step B3, acquiring the current running speed of the viewer from the wireless communication equipment by software preinstalled in the computer, and importing the running speed as the traveling speed data of the viewing point when the panoramic video is viewed into the panoramic video playing system.
The wireless communication equipment comprises an ANT + sensor worn by a video viewer; an ANT + equipment induction area 2 which can enable the running platform to be paired with an ANT + sensor is arranged at the running platform.
The ANT + sensor is an ANT + watch.
In step S4, after the panoramic video playing system receives the panoramic video viewing point travel speed data converted from the running speed, the panoramic video playing speed is associated with the panoramic video viewing point travel speed data, and the speed of the panoramic video playing speed, the pause and the start of the video playing are synchronously adjusted according to the change of the speed of the travel speed data.
In this example, the head mounted display is a VR headset.

Claims (10)

1. A panoramic video interactive playing method based on a treadmill is characterized by comprising the following steps: the playing method comprises the following steps;
step S1: shooting a panoramic video by using panoramic video shooting equipment;
step S2: importing the shot panoramic video into a panoramic video playing system;
step S3: when the panoramic video playing system plays a video, the watching space of a playing field is arranged on a running platform for video watching personnel to walk or run, and the panoramic video playing system is connected with the running platform through wireless communication equipment to obtain the current running speed of the watching personnel on the running platform;
step S4: and associating the panoramic video playing speed with the current running speed of the viewer, and synchronously adjusting the speed of the panoramic video playing speed along with the change of the current running speed of the viewer.
2. The running platform-based panoramic video interactive playing method according to claim 1, characterized in that: and the viewer watches the video played by the panoramic video playing system through the head-mounted display.
3. The running platform-based panoramic video interactive playing method according to claim 2, characterized in that: when the head of a video viewer moves, the panoramic video playing system switches the video playing visual angle according to the orientation of the head-mounted display, so that the video viewer can browse scenes all around by means of the head-mounted display.
4. The running platform-based panoramic video interactive playing method according to claim 3, characterized in that: when the video viewer browses the scene by means of the head-mounted display, the panoramic video playing system can display the name of the scene or the name of the object currently displayed by the head-mounted display.
5. The running platform-based panoramic video interactive playing method according to claim 1, characterized in that: in step S1, the panoramic video photographing apparatus photographs a panoramic video at a preset path and a preset travel speed.
6. The running platform-based panoramic video interactive playing method according to claim 1, characterized in that: the step S2 includes the following steps;
step A1, creating a background sphere space which can be used as a panoramic video playing system to play video and setting the radius of the sphere;
a2, acquiring sequence frame images in the panoramic video playing process, and mapping the sequence frame images to a texture map which can be matched with the size of a sphere;
a3, attaching the texture map to the sphere, and creating a rendering script for the sphere, wherein the rendering script can enable the sphere to generate an internal and external double-sided mapping display effect;
step A4, when the panoramic video playing system plays the video, the camera position of the panoramic video playing system is arranged at the center of the sphere, so that the user can be positioned at the center of the sphere and watch the panoramic video through the camera view angle when watching the video;
and A5, making a jump interface and video target object labeling for the panoramic video playing system.
7. The running platform-based panoramic video interactive playing method according to claim 1, characterized in that: the step S3 includes the following steps;
step B1, connecting the wireless communication equipment to the computer;
step B2, placing the running platform at a playing place, enabling a video viewer to run or walk on the running platform, and pairing the wireless communication equipment with the running platform to acquire the current running speed of the viewer;
and step B3, acquiring the current running speed of the viewer from the wireless communication equipment by software preinstalled in the computer, and importing the running speed as the traveling speed data of the viewing point when the panoramic video is viewed into the panoramic video playing system.
8. The running platform-based panoramic video interactive playing method according to claim 7, characterized in that: the wireless communication equipment comprises an ANT + sensor worn by a video viewer; an ANT + equipment sensing area which can enable the running platform to be paired with the ANT + sensor is arranged at the running platform.
9. The running platform-based panoramic video interactive playing method according to claim 8, characterized in that: the ANT + sensor is an ANT + watch.
10. The running platform-based panoramic video interactive playing method according to claim 7, characterized in that: in step S4, after the panoramic video playing system receives the panoramic video viewing point travel speed data converted from the running speed, the panoramic video playing speed is associated with the panoramic video viewing point travel speed data, and the speed of the panoramic video playing speed, the pause and the start of the video playing are synchronously adjusted according to the change of the speed of the travel speed data.
CN202010051944.7A 2020-01-17 2020-01-17 Panoramic video interactive playing method based on treadmill Pending CN111131916A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010051944.7A CN111131916A (en) 2020-01-17 2020-01-17 Panoramic video interactive playing method based on treadmill

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010051944.7A CN111131916A (en) 2020-01-17 2020-01-17 Panoramic video interactive playing method based on treadmill

Publications (1)

Publication Number Publication Date
CN111131916A true CN111131916A (en) 2020-05-08

Family

ID=70489629

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010051944.7A Pending CN111131916A (en) 2020-01-17 2020-01-17 Panoramic video interactive playing method based on treadmill

Country Status (1)

Country Link
CN (1) CN111131916A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018174441A1 (en) * 2017-03-24 2018-09-27 Samsung Electronics Co., Ltd. System and method for synchronizing tracking points
CN108762498A (en) * 2018-05-22 2018-11-06 重庆子元科技有限公司 The virtual reality system of human body walking gesture stability
CN109429057A (en) * 2017-07-12 2019-03-05 旺玖科技股份有限公司 Synchronous 3D panoramic video playing system
CN110109552A (en) * 2019-05-23 2019-08-09 重庆大学 Virtual driving scene modeling method based on true environment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018174441A1 (en) * 2017-03-24 2018-09-27 Samsung Electronics Co., Ltd. System and method for synchronizing tracking points
CN109429057A (en) * 2017-07-12 2019-03-05 旺玖科技股份有限公司 Synchronous 3D panoramic video playing system
CN108762498A (en) * 2018-05-22 2018-11-06 重庆子元科技有限公司 The virtual reality system of human body walking gesture stability
CN110109552A (en) * 2019-05-23 2019-08-09 重庆大学 Virtual driving scene modeling method based on true environment

Similar Documents

Publication Publication Date Title
US11586277B2 (en) Systems and methods for generating augmented and virtual reality images
US9838668B2 (en) Systems and methods for transferring a clip of video data to a user facility
US10691202B2 (en) Virtual reality system including social graph
TWI436646B (en) Device with displayed image capable of moving based on body state of exerciser and performing method thereof
CN105301771B (en) Head-mounted display device, detection device, control method, and computer program
JP6178524B2 (en) Panoramic video playback device, panoramic video editing device, panoramic video playback method, panoramic video playback program, panoramic video playback system, and panoramic video transmission device
KR101703924B1 (en) 3d virtual reality system using 3d-spectacles for virtual image display
US20120200667A1 (en) Systems and methods to facilitate interactions with virtual content
US10701426B1 (en) Virtual reality system including social graph
CN106133629A (en) Information processor, information processing method, program and imaging system
CN103543831A (en) Head-mounted panoramic player
US9390562B2 (en) Multiple perspective video system and method
JP6384131B2 (en) Head-mounted display device, control method therefor, and computer program
US20160379407A1 (en) Virtual Fantasy System and Method of Use
JP2016131782A (en) Head wearable display device, detection device, control method for head wearable display device, and computer program
CN105939497A (en) Media streaming system and media streaming method
KR20180040809A (en) 360VR Indoor Cycling with panoramic scenery control by means of pedaling speed
CN103248910A (en) Three-dimensional imaging system and image reproducing method thereof
CN111131916A (en) Panoramic video interactive playing method based on treadmill
KR102606116B1 (en) Head mounted display and, the controlling method thereof
US11931641B2 (en) Exercise apparatus with integrated holographic display
CN111131915A (en) Panoramic video interactive playing method based on laser radar
KR101766892B1 (en) Interworking device electric chair system including the same and method therefor
US10596446B2 (en) System and method of fitness training in virtual environment
CN111142261A (en) 360-degree panoramic video interaction experience method based on riding mode

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200508

RJ01 Rejection of invention patent application after publication