CN111131915A - Panoramic video interactive playing method based on laser radar - Google Patents

Panoramic video interactive playing method based on laser radar Download PDF

Info

Publication number
CN111131915A
CN111131915A CN202010051320.5A CN202010051320A CN111131915A CN 111131915 A CN111131915 A CN 111131915A CN 202010051320 A CN202010051320 A CN 202010051320A CN 111131915 A CN111131915 A CN 111131915A
Authority
CN
China
Prior art keywords
video
panoramic video
playing
laser radar
panoramic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010051320.5A
Other languages
Chinese (zh)
Inventor
李建微
叶成英
占家旺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fuzhou University
Original Assignee
Fuzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuzhou University filed Critical Fuzhou University
Priority to CN202010051320.5A priority Critical patent/CN111131915A/en
Publication of CN111131915A publication Critical patent/CN111131915A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a panoramic video interactive playing method based on a laser radar, which comprises the following steps of; step S1: shooting a panoramic video by using panoramic video shooting equipment; step S2: importing the shot panoramic video into a panoramic video playing system; step S3: when the panoramic video playing system plays a video, the watching space of a playing field can be used for video watching personnel to walk or step, and a laser radar is arranged at the playing field to acquire human body step frequency data of the video watching personnel in the playing field; step S4: associating the panoramic video playing speed with the human body frequency stepping data, and synchronously adjusting the speed of the panoramic video playing speed along with the speed change of the human body frequency stepping data; the invention can obtain better immersive experience, enhance the interactive effect and increase the healthy exercise amount of the user to a certain extent.

Description

Panoramic video interactive playing method based on laser radar
Technical Field
The invention relates to the technical field of panoramic video playing, in particular to a panoramic video interactive playing method based on a laser radar.
Background
At present, a method for roaming by using a panoramic technology is mainly three-dimensional panoramic image roaming, that is, several panoramic images are associated in a link mode, and a user can go to other images for tour by clicking other image links of the current panoramic image, but the method mainly uses static tour and has poor immersion.
In a further development, a panoramic video visiting mode is adopted, and a user watches the panoramic video shot by a fixed path, so that panoramic roaming of a plurality of scenes is realized. However, as the user watches the video which is shot according to the fixed path and speed, the user cannot control the browsing speed through the independent intention due to the pure video watching, and the interactivity is relatively poor.
Most of the existing panoramic interactive devices are based on a riding mode or other application device modes, the modes meet the requirements of most users, and the use barriers may exist for some old and young people who are not suitable for doing sports. The method provided by the invention controls the panoramic video to be played by acquiring the human body tread frequency data by the aid of the laser radar, is convenient and simple to operate, and can be used by users of all ages.
In view of this, the interactive panoramic video playing method based on the laser radar provided by the invention has the beneficial effects that: according to the panoramic video playing method provided by the invention, the user can control the playing speed of the panoramic video by adjusting the self frequency stepping speed, so that the user can select a proper speed to visit or stay at the proper speed to watch carefully in the roaming process, better immersive experience can be obtained, the interactive effect can be enhanced, the healthy exercise amount of the user can be increased to a certain extent, and the interactive mode can be applied to the subsequent playing of various videos.
Disclosure of Invention
The invention provides a panoramic video interactive playing method based on a laser radar, which can obtain better immersive experience, enhance the interactive effect and increase the healthy exercise amount of a user to a certain extent.
The invention adopts the following technical scheme.
A panoramic video interactive playing method based on a laser radar comprises the following steps;
step S1: shooting a panoramic video by using panoramic video shooting equipment;
step S2: importing the shot panoramic video into a panoramic video playing system;
step S3: when the panoramic video playing system plays a video, the watching space of a playing field can be used for video watching personnel to walk or step, and a laser radar is arranged at the playing field to acquire human body step frequency data of the video watching personnel in the playing field;
step S4: and associating the panoramic video playing speed with the human body frequency stepping data, and synchronously adjusting the panoramic video playing speed along with the change of the human body frequency stepping data.
And the viewer watches the video played by the panoramic video playing system through the head-mounted display.
When the head of a video viewer moves, the panoramic video playing system switches the video playing visual angle according to the orientation of the head-mounted display, so that the video viewer can browse scenes all around by means of the head-mounted display.
When the video viewer browses the scene by means of the head-mounted display, the panoramic video playing system can display the name of the scene or the name of the object currently displayed by the head-mounted display.
In step S1, the panoramic video photographing apparatus photographs a panoramic video at a preset path and a preset travel speed.
The step S2 includes the following steps;
step A1, creating a background sphere space which can be used as a panoramic video playing system to play video and setting the radius of the sphere;
a2, acquiring sequence frame images in the panoramic video playing process, and mapping the sequence frame images to a texture map which can be matched with the size of a sphere;
a3, attaching the texture map to the sphere, and creating a rendering script for the sphere, wherein the rendering script can enable the sphere to generate an internal and external double-sided mapping display effect;
step A4, when the panoramic video playing system plays the video, the camera position of the panoramic video playing system is arranged at the center of the sphere, so that the user can be positioned at the center of the sphere and watch the panoramic video through the camera view angle when watching the video;
and A5, making a jump interface and video target object labeling for the panoramic video playing system.
The step S3 includes the following steps;
step B1, connecting the sensor of the laser radar to a computer;
b2, placing the laser radar on the ground of the playing field, stepping or walking the video viewers in a certain range of the planned viewing space, and detecting by the laser radar to obtain stepping frequency data of the video viewers;
and step B3, converting the frequency stepping data acquired by the laser radar into the current movement traveling speed data of the video viewer or the simulated traveling speed data of the video viewer at the stepping frequency by software preinstalled in the computer, and importing the traveling speed data into the panoramic video playing system.
In the step B3, the horizontal scanning surface of the laser radar is adjacent to the ground; the specific conversion method comprises the following steps:
step C1, creating a data conversion coordinate system, wherein the vertical axis of the coordinate system is a reference line formed by the height of the horizontal scanning surface of the laser radar, and the horizontal axis of the coordinate system is the watching time of a video watching person;
step C2, when the foot lifting height of the video viewer reaches the height H of the horizontal scanning surface touching the laser radar, software preinstalled in the computer records foot lifting time T1 and T2; wherein T1 is the time point when the height of the first foot rises to 0 (i.e. the first foot is about to lift up when contacting the horizontal scanning surface) during the human body taking a step, and T2 is the time point when the height of the other foot of the human body falls to 0 (i.e. the other foot falls to contact the horizontal scanning surface); the time difference between T1 and T2 is T, which is the total time for the video viewer to lift the left foot and the right foot of the human body once, and is equivalent to the time for walking by one step;
and step C3, calculating the tread frequency data of the video viewer according to the time for walking by one step obtained in the step C2, and calculating the human body advancing speed data according to the preset step length.
In step S4, after the panoramic video playing system receives the traveling speed data of the video viewer converted from the step data, the panoramic video playing speed is associated with the traveling speed data of the video viewer, and the speed of the panoramic video playing speed, the pause and the start of the video playing are synchronously adjusted according to the change of the traveling speed data.
When a plurality of video watchers exist, the computer averages the treading frequency data of feet of the people in the playing field according to the number of the people so as to simulate the plurality of video watchers in the playing field as a travel group, simulate the group walking speed of the travel group and adjust the panoramic video playing according to the group walking speed.
According to the panoramic video playing method provided by the invention, the user can control the playing speed of the panoramic video by adjusting the self frequency stepping speed, so that the user can select a proper speed to visit or stay at the proper speed to watch carefully in the roaming process, better immersive experience can be obtained, the interactive effect can be enhanced, the healthy exercise amount of the user can be increased to a certain extent, and the interactive mode can be applied to the subsequent playing of various videos.
Drawings
The invention is described in further detail below with reference to the following figures and detailed description:
FIG. 1 is a schematic diagram of an embodiment of the present invention;
FIG. 2 is a schematic flow diagram of the present invention;
FIG. 3 is a schematic diagram of a data transformation coordinate system;
in the figure: 1-laser radar; 2-a computer; 3-head mounted display.
Detailed Description
As shown in fig. 1-3, a panoramic video interactive playing method based on a laser radar 1 includes the following steps;
step S1: shooting a panoramic video by using panoramic video shooting equipment;
step S2: importing the shot panoramic video into a panoramic video playing system;
step S3: when the panoramic video playing system plays a video, the watching space of a playing field can be used for video watching personnel to walk or step, and a laser radar is arranged at the playing field to acquire human body step frequency data of the video watching personnel in the playing field;
step S4: and associating the panoramic video playing speed with the human body frequency stepping data, and synchronously adjusting the panoramic video playing speed along with the change of the human body frequency stepping data.
The viewer watches the video played by the panoramic video playing system through the head-mounted display 3.
When the head of a video viewer moves, the panoramic video playing system switches the video playing visual angle according to the orientation of the head-mounted display, so that the video viewer can browse scenes all around by means of the head-mounted display.
When the video viewer browses the scene by means of the head-mounted display, the panoramic video playing system can display the name of the scene or the name of the object currently displayed by the head-mounted display.
In step S1, the panoramic video photographing apparatus photographs a panoramic video at a preset path and a preset travel speed.
The step S2 includes the following steps;
step A1, creating a background sphere space which can be used as a panoramic video playing system to play video and setting the radius of the sphere;
a2, acquiring sequence frame images in the panoramic video playing process, and mapping the sequence frame images to a texture map which can be matched with the size of a sphere;
a3, attaching the texture map to the sphere, and creating a rendering script for the sphere, wherein the rendering script can enable the sphere to generate an internal and external double-sided mapping display effect;
step A4, when the panoramic video playing system plays the video, the camera position of the panoramic video playing system is arranged at the center of the sphere, so that the user can be positioned at the center of the sphere and watch the panoramic video through the camera view angle when watching the video;
and A5, making a jump interface and video target object labeling for the panoramic video playing system.
The step S3 includes the following steps;
step B1, connecting the sensor of the laser radar to the computer 2;
b2, placing the laser radar on the ground of the playing field, stepping or walking the video viewers in a certain range of the planned viewing space, and detecting by the laser radar to obtain stepping frequency data of the video viewers;
and step B3, converting the frequency stepping data acquired by the laser radar into the current movement traveling speed data of the video viewer or the simulated traveling speed data of the video viewer at the stepping frequency by software preinstalled in the computer, and importing the traveling speed data into the panoramic video playing system.
In the step B3, the horizontal scanning surface of the laser radar is adjacent to the ground; the specific conversion method comprises the following steps:
step C1, creating a data conversion coordinate system, wherein the vertical axis of the coordinate system is a reference line formed by the height of the horizontal scanning surface of the laser radar, and the horizontal axis of the coordinate system is the watching time of a video watching person;
step C2, when the foot lifting height of the video viewer reaches the height H of the horizontal scanning surface touching the laser radar, software preinstalled in the computer records foot lifting time T1 and T2; wherein T1 is the time point when the height of the first foot rises to 0 (i.e. the first foot is about to lift up when contacting the horizontal scanning surface) during the human body taking a step, and T2 is the time point when the height of the other foot of the human body falls to 0 (i.e. the other foot falls to contact the horizontal scanning surface); the time difference between T1 and T2 is T, which is the total time for the video viewer to lift the left foot and the right foot of the human body once, and is equivalent to the time for walking by one step;
and step C3, calculating the tread frequency data of the video viewer according to the time for walking by one step obtained in the step C2, and calculating the human body advancing speed data according to the preset step length.
In step S4, after the panoramic video playing system receives the traveling speed data of the video viewer converted from the step data, the panoramic video playing speed is associated with the traveling speed data of the video viewer, and the speed of the panoramic video playing speed, the pause and the start of the video playing are synchronously adjusted according to the change of the traveling speed data.
When a plurality of video watchers exist, the computer averages the treading frequency data of feet of the people in the playing field according to the number of the people so as to simulate the plurality of video watchers in the playing field as a travel group, simulate the group walking speed of the travel group and adjust the panoramic video playing according to the group walking speed.

Claims (10)

1. A panoramic video interactive playing method based on laser radar is characterized in that: the playing method comprises the following steps;
step S1: shooting a panoramic video by using panoramic video shooting equipment;
step S2: importing the shot panoramic video into a panoramic video playing system;
step S3: when the panoramic video playing system plays a video, the watching space of a playing field can be used for video watching personnel to walk or step, and a laser radar is arranged at the playing field to acquire human body step frequency data of the video watching personnel in the playing field;
step S4: and associating the panoramic video playing speed with the human body frequency stepping data, and synchronously adjusting the panoramic video playing speed along with the change of the human body frequency stepping data.
2. The method for playing panoramic video interactively based on the laser radar as claimed in claim 1, wherein: and the viewer watches the video played by the panoramic video playing system through the head-mounted display.
3. The method for playing panoramic video interactively based on the laser radar as claimed in claim 2, wherein: when the head of a video viewer moves, the panoramic video playing system switches the video playing visual angle according to the orientation of the head-mounted display, so that the video viewer can browse scenes all around by means of the head-mounted display.
4. The panoramic video interactive playing method based on the laser radar as claimed in claim 3, wherein: when the video viewer browses the scene by means of the head-mounted display, the panoramic video playing system can display the name of the scene or the name of the object currently displayed by the head-mounted display.
5. The method for playing panoramic video interactively based on the laser radar as claimed in claim 1, wherein: in step S1, the panoramic video photographing apparatus photographs a panoramic video at a preset path and a preset travel speed.
6. The method for playing panoramic video interactively based on the laser radar as claimed in claim 1, wherein: the step S2 includes the following steps;
step A1, creating a background sphere space which can be used as a panoramic video playing system to play video and setting the radius of the sphere;
a2, acquiring sequence frame images in the panoramic video playing process, and mapping the sequence frame images to a texture map which can be matched with the size of a sphere;
a3, attaching the texture map to the sphere, and creating a rendering script for the sphere, wherein the rendering script can enable the sphere to generate an internal and external double-sided mapping display effect;
step A4, when the panoramic video playing system plays the video, the camera position of the panoramic video playing system is arranged at the center of the sphere, so that the user can be positioned at the center of the sphere and watch the panoramic video through the camera view angle when watching the video;
and A5, making a jump interface and video target object labeling for the panoramic video playing system.
7. The method for playing panoramic video interactively based on the laser radar as claimed in claim 1, wherein: the step S3 includes the following steps;
step B1, connecting the sensor of the laser radar to a computer;
b2, placing the laser radar on the ground of the playing field, stepping or walking the video viewers in a certain range of the planned viewing space, and detecting by the laser radar to obtain stepping frequency data of the video viewers;
and step B3, converting the frequency stepping data acquired by the laser radar into the current movement traveling speed data of the video viewer or the simulated traveling speed data of the video viewer at the stepping frequency by software preinstalled in the computer, and importing the traveling speed data into the panoramic video playing system.
8. The method of claim 7, wherein the method comprises the following steps: in the step B3, the horizontal scanning surface of the laser radar is adjacent to the ground; the specific conversion method comprises the following steps:
step C1, creating a data conversion coordinate system, wherein the vertical axis of the coordinate system is a reference line formed by the height of the horizontal scanning surface of the laser radar, and the horizontal axis of the coordinate system is the watching time of a video watching person;
step C2, when the foot lifting height of the video viewer reaches the height H of the horizontal scanning surface touching the laser radar, software preinstalled in the computer records foot lifting time T1 and T2; wherein T1 is the time point when the height of the first foot rises to 0 (i.e. the first foot is about to lift up when contacting the horizontal scanning surface) during the human body taking a step, and T2 is the time point when the height of the other foot of the human body falls to 0 (i.e. the other foot falls to contact the horizontal scanning surface); the time difference between T1 and T2 is T, which is the total time for the video viewer to lift the left foot and the right foot of the human body once, and is equivalent to the time for walking by one step;
and step C3, calculating the tread frequency data of the video viewer according to the time for walking by one step obtained in the step C2, and calculating the human body advancing speed data according to the preset step length.
9. The method of claim 7, wherein the method comprises the following steps: in step S4, after the panoramic video playing system receives the traveling speed data of the video viewer converted from the step data, the panoramic video playing speed is associated with the traveling speed data of the video viewer, and the speed of the panoramic video playing speed, the pause and the start of the video playing are synchronously adjusted according to the change of the traveling speed data.
10. The method of claim 7, wherein the method comprises the following steps: when a plurality of video watchers exist, the computer averages the treading frequency data of feet of the people in the playing field according to the number of the people so as to simulate the plurality of video watchers in the playing field as a travel group, simulate the group walking speed of the travel group and adjust the panoramic video playing according to the group walking speed.
CN202010051320.5A 2020-01-17 2020-01-17 Panoramic video interactive playing method based on laser radar Pending CN111131915A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010051320.5A CN111131915A (en) 2020-01-17 2020-01-17 Panoramic video interactive playing method based on laser radar

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010051320.5A CN111131915A (en) 2020-01-17 2020-01-17 Panoramic video interactive playing method based on laser radar

Publications (1)

Publication Number Publication Date
CN111131915A true CN111131915A (en) 2020-05-08

Family

ID=70489628

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010051320.5A Pending CN111131915A (en) 2020-01-17 2020-01-17 Panoramic video interactive playing method based on laser radar

Country Status (1)

Country Link
CN (1) CN111131915A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180275242A1 (en) * 2017-03-24 2018-09-27 Samsung Electronics Co., Ltd. System and method for synchronizing tracking points
CN108762498A (en) * 2018-05-22 2018-11-06 重庆子元科技有限公司 The virtual reality system of human body walking gesture stability
CN109429057A (en) * 2017-07-12 2019-03-05 旺玖科技股份有限公司 Synchronous 3D panoramic video playing system
CN110109552A (en) * 2019-05-23 2019-08-09 重庆大学 Virtual driving scene modeling method based on true environment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180275242A1 (en) * 2017-03-24 2018-09-27 Samsung Electronics Co., Ltd. System and method for synchronizing tracking points
CN109429057A (en) * 2017-07-12 2019-03-05 旺玖科技股份有限公司 Synchronous 3D panoramic video playing system
CN108762498A (en) * 2018-05-22 2018-11-06 重庆子元科技有限公司 The virtual reality system of human body walking gesture stability
CN110109552A (en) * 2019-05-23 2019-08-09 重庆大学 Virtual driving scene modeling method based on true environment

Similar Documents

Publication Publication Date Title
TWI436646B (en) Device with displayed image capable of moving based on body state of exerciser and performing method thereof
US11132533B2 (en) Systems and methods for creating target motion, capturing motion, analyzing motion, and improving motion
Waltemate et al. Realizing a low-latency virtual reality environment for motor learning
US10412467B2 (en) Personalized live media content
CN106131469B (en) Ball intelligent robot coach and judgment system based on machine vision
JP6332830B2 (en) Exercise support system, exercise support method, and exercise support program
US20180130373A1 (en) Exercise mangement system with body sensor
CN105797349A (en) Live-action running device, method and system
CN110221691B (en) Immersive virtual experience method, system and device
CN105943327B (en) Vision exercise health care system with anti-dizziness device
JP7060544B6 (en) Exercise equipment
CN110559632A (en) intelligent skiing fitness simulation simulator and control method thereof
WO2009053901A2 (en) Method and system for selecting the viewing configuration of a rendered figure
KR101221065B1 (en) Practicing method of golf swing motion using motion overlap and practicing system of golf swing motion using the same
CN109525806A (en) Portable display apparatus, image supply device, display system
CN111131915A (en) Panoramic video interactive playing method based on laser radar
CN210583568U (en) Wisdom skiing body-building simulator
US20120172177A1 (en) System for supporting a user to do exercises
CN111131916A (en) Panoramic video interactive playing method based on treadmill
US11931641B2 (en) Exercise apparatus with integrated holographic display
JP2009519539A (en) Method and system for creating event data and making it serviceable
CN111093036A (en) VR panoramic video interactive playing method based on limb recognition
KR102095647B1 (en) Comparison of operation using smart devices Comparison device and operation Comparison method through dance comparison method
WO2002104009A1 (en) Method and system for combining video with spatio-temporal alignment
CN111242069A (en) Data processing method and device based on multimedia dance room

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200508