CN114339192B - Virtual reality glasses playing method for WEB VR (virtual reality) content - Google Patents
Virtual reality glasses playing method for WEB VR (virtual reality) content Download PDFInfo
- Publication number
- CN114339192B CN114339192B CN202111619094.7A CN202111619094A CN114339192B CN 114339192 B CN114339192 B CN 114339192B CN 202111619094 A CN202111619094 A CN 202111619094A CN 114339192 B CN114339192 B CN 114339192B
- Authority
- CN
- China
- Prior art keywords
- data
- glasses
- web
- scene
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000011521 glass Substances 0.000 title claims abstract description 69
- 238000000034 method Methods 0.000 title claims abstract description 15
- 230000003993 interaction Effects 0.000 claims abstract description 18
- 238000006243 chemical reaction Methods 0.000 claims abstract description 6
- 230000009471 action Effects 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 claims description 2
- 238000013507 mapping Methods 0.000 claims 1
- 230000002452 interceptive effect Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- VYZAMTAEIAYCRO-UHFFFAOYSA-N Chromium Chemical compound [Cr] VYZAMTAEIAYCRO-UHFFFAOYSA-N 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Abstract
The invention relates to a virtual reality glasses playing method of WEB VR content, which comprises the following steps: the WEB VR player receives a request of a user wearing VR glasses for playing a certain WEB VR content; the WEB VR player is connected with the WEB VR server, and acquires VR scene data, VR hot spot data, VR global setting data, VR resource data and VR style data of the WEB VR content; performing coordinate conversion on the VR scene data, the VR resource data and the VR hot spot data, and converting the VR scene plane coordinate system into a VR scene spherical coordinate system with the spherical center of a scene ball of the VR glasses as an origin; according to the VR scene data, the VR global setting data and the VR style data, playing the VR resource data on the scene balls of the VR glasses; and the WEB VR player responds to the VR hotspot playing request and plays the VR hotspot data in the VR main view angle. The invention can realize that various interaction hot spots in the WEB VR resources can be effectively played in the VR glasses.
Description
Technical Field
The invention relates to a virtual reality glasses playing method of WEB VR (virtual reality) content, belonging to the technical field of immersive playing of interactive content.
Background
Virtual Reality (VR) technology is a computer simulation system that can generate a simulation environment to provide an immersive application experience for a user through three-dimensional dynamic views, physical behavior interactions, and the like. The WEB VR is VR on WEB, and is to present VR content in a webpage mode and realize interactive interaction. The WEB VR technology has been gradually developed along with the rapid development of the whole VR content technology in 2016, and in early 2018, W3C has issued a WEB VR2.0 draft, and the WEB VR technology is becoming more and more important.
At present, browsers such as Firefox and Google Chrome all push out WEB VR browsers, so that WEB VR contents can be experienced through the VR browsers in VR glasses, and immersive video watching experience is provided for users. However, the current VR browser has the following problems for playing in VR glasses of WEB VR content:
1) The WEB VR content has an incompatibility problem for different browsers and terminals.
2) Partial hot spot interaction information in VR content cannot be lost in the VR glasses mode, and especially hot spot interaction such as hot spot pictures, videos and audios are required to be played through popup windows.
3) In the VR glasses mode, the operation interaction only supports focusing aiming interaction of a cross cursor, and other VR glasses keys, handles and other operation functions are lost.
Applicant retrieves the findings: the Chinese patent with publication number CN106658212A discloses an VR on-line playing method, system and player based on HTML5, and solutions are provided mainly around the aspects of mobile phone end, HTML5 panoramic video playing and the like; the Chinese patent with publication number of CN106897108A discloses a method for realizing virtual reality panorama roaming based on Web VR, and mainly proposes a panorama roaming solution around terminals such as PC, mobile phone and the like. However, the above patent documents do not perform overall adaptation processing on scenes such as VR panoramic pictures, panoramic videos, VR animations and the like, do not perform adaptation processing on terminal aspects by combining display characteristics and interaction characteristics of VR glasses, and meanwhile, do not solve various interaction hot spots such as audio and video image-text models and the like in VR scenes.
Disclosure of Invention
The invention aims to solve the technical problems that: the virtual reality glasses playing method enables the user to better interact and experience the virtual reality content in the VR glasses, and can effectively play various interaction hot spots in WEB VR resources in the VR glasses.
In order to solve the technical problems, the technical scheme provided by the invention is as follows: a virtual reality glasses playing method of WEB VR content comprises the following steps:
step one, a WEB VR player receives a request of a user wearing VR glasses for playing a certain WEB VR content;
step two, a WEB VR player is connected with a WEB VR server to acquire VR scene data, VR hot spot data, VR global setting data, VR resource data and VR style data of the WEB VR content, wherein the VR scene data comprises panoramic pictures, panoramic videos and panoramic animations, the VR hot spot data comprises audio hot spots, video hot spots, picture hot spots, text hot spots, 3D model hot spots, jump hot spots and a UI, and the VR resource data comprises audio, video, pictures, texts and model animations;
thirdly, carrying out coordinate conversion on the VR scene data, the VR resource data with the position attribute and the VR hot spot data with the position attribute, and converting the VR scene plane coordinate system into a VR scene spherical coordinate system with the spherical center of a scene ball of the VR glasses as an origin;
fourthly, playing the VR resource data on the scene balls of the VR glasses according to the VR scene data, the VR global setting data and the VR style data; the WEB VR player responds to the VR hotspot playing request and plays the VR hotspot data in a VR main view angle; the VR main view angle coordinate system uses the sphere center of the scene sphere of the VR glasses as the origin, and is the same as the VR scene sphere coordinate system.
The beneficial effects brought by the invention are as follows: according to the invention, through carrying out coordinate conversion on VR scene data, VR resource data and VR hot spot data in real time, the VR scene plane coordinate system is converted into the VR scene spherical coordinate system with the spherical center of the scene sphere of the VR glasses as the origin, so that format analysis of WEB VR contents and immersive display and play in the VR glasses are solved, and the problem that the WEB VR contents are incompatible for different browsers and terminals is solved; meanwhile, the problem that part of hot spot interaction information in VR content cannot be lost in a VR glasses mode is solved, and especially, hot spots such as hot spot pictures, videos and audios need to be played through popup windows, so that various hot spots such as audio and video image-text models in WEB VR content can be effectively displayed and played in VR glasses. In addition, the invention not only improves the playing effect, but also reduces the processing time and hardware cost by uniformly processing various scene resources of VR scene data (including panoramic pictures, panoramic videos, panoramic animations and the like).
Drawings
The invention is further described below with reference to the accompanying drawings.
Fig. 1 is a schematic diagram of an initial position of a play window.
Fig. 2 is a distorted diagram of a playback window.
Fig. 3 is a schematic diagram of the correction of a play window.
Detailed Description
Examples
The virtual reality glasses playing method of the WEB VR content of the embodiment comprises the following steps:
step one, a user wears VR glasses, a WEB VR player is started, and the WEB VR player receives a request of the user wearing the VR glasses for playing a certain WEB VR content.
Step two, a WEB VR player is connected with a WEB VR server to acquire VR scene data, VR hot spot data, VR global setting data, VR resource data and VR style data of the WEB VR content, wherein the VR scene data comprises panoramic pictures, panoramic videos and panoramic animations, the VR hot spot data comprises audio hot spots, video hot spots, picture hot spots, text hot spots, 3D model hot spots, jump hot spots and a UI, and the VR resource data comprises audio, video, pictures, texts and model animations. And analyzing the VR scene data, the VR hotspot data, the VR global setting data, the VR resource data and the VR style data, and locally establishing a resource data index, so that the searching and the reference are facilitated.
And thirdly, performing coordinate conversion on the VR scene data, the VR resource data with the position attribute and the VR hot spot data with the position attribute, and converting the VR scene plane coordinate system into a VR scene spherical coordinate system with the spherical center of the scene ball of the VR glasses as an origin.
Taking a planar panoramic picture as an example, regarding a panoramic scene in a VR scene planar coordinate system in a material of VR scene data, the aspect ratio of the material is 2:1, therefore, the picture of the VR scene spherical coordinate system can be converted, that is, the planar panoramic picture is an expanded picture of the picture in the VR scene spherical coordinate system, and the specific conversion method is the prior art and can refer to related documents. For panoramic video and panoramic animation, the aspect ratio of each frame of the panoramic video is 2:1, converting a picture frame in a picture frame or an animation in a video from a VR scene plane coordinate system to a VR scene spherical coordinate system. Likewise, element coordinates having position attributes, such as VR hot spot data and VR resource data, are converted from a VR scene plane coordinate system to a VR scene spherical coordinate system.
Fourthly, playing the VR resource data on the scene balls of the VR glasses according to the VR scene data, the VR global setting data and the VR style data; the WEB VR player responds to a VR hotspot playing request of a player and plays the VR hotspot data in a VR main view angle; the VR main view angle coordinate system uses the sphere center of the scene sphere of the VR glasses as the origin, and is the same as the VR scene sphere coordinate system, that is, players experience with the VR main view angle, and can click the VR hot spot in the main view angle range to play.
For VR scene data, VR hot spot data, VR global setting data, VR resource data, VR style data and converted position coordinates, corresponding VR resource format files can be self-defined for organization and encapsulation, and related documents can be referred to.
And starting the VR resource player, and displaying the VR scene data, the VR hot spot data and the VR resource data in the VR glasses according to the information in the VR resource format file. Firstly, covering a panoramic picture, a panoramic video or a panoramic animation on a sphere of a scene sphere of VR glasses, and setting a picture to be displayed facing the sphere center so as to realize spherical presentation of VR scenes; and then displaying the VR resource data in the VR glasses, and playing and experiencing the VR hot spot in the VR main view angle range.
The present embodiment can also be modified as follows:
1) And step four, when VR hot spot data are displayed, creating a playing window for VR hot spot playing for each VR hot spot with a position attribute, wherein the playing window takes the position of the VR hot spot as an origin, and the coordinate system is kept parallel to the VR main visual angle coordinate system, so that VR hot spot resources are played on the corresponding playing window. And loading players of different VR hotspot types onto the playing window according to the types of the VR hotspots.
Therefore, the playing of the VR hot spot data can be conveniently controlled, such as a dynamic correction playing window, and if the VR hot spot data is not corrected, the coordinates of the VR playing window are fixedly set. If the coordinates of the playing window are not dynamically corrected, when the VR glasses gyroscope deflects at an angle, coordinate deviation occurs between the VR main view angle and the VR playing window, and distortion of the VR playing window occurs to the player view angle; for example, when the VR glasses deflect up and down around the X axis of the three-dimensional rectangular coordinate system of the VR scene, a deflection angle is generated on the Z axis, and at this time, the upper edge of the playing window stretches and the lower edge shortens, so that the playing picture is distorted, as shown in fig. 1, the initial position of the playing window is the initial position of the player, i.e. when the player clicks a hot spot to play in the VR main viewing angle, the playing window is initialized to be consistent with the VR main viewing angle coordinate; fig. 2 shows that when the VR main viewing angle is deflected from the XYZ position to the angle X ' Y ' Z ', the coordinates of the playing window are not deflected, so that the playing window is distorted.
The method for dynamically correcting the playing window comprises the following steps: when the VR hot spot with the position attribute is played on the corresponding playing window, the playing window is enabled to follow the gyroscope of the VR glasses, when the gyroscope of the VR glasses rotates along the Z axis, the main view angle of the VR will generate a Y-axis deflection angle, and at the moment, the playing window corresponding to the VR hot spot also rotates along the Z axis, so that the Y-axis generates the same deflection angle;
when the gyroscope of the VR glasses rotates along the Y axis, the VR scene data and the VR resource data with the position attribute generate a Z-axis deflection angle, and at the moment, the play window corresponding to the VR hot spot also rotates along the Y axis, so that the Z axis generates the same deflection angle;
when the gyroscope of the VR glasses rotates along the X axis, the VR scene data and the VR resource data with the position attribute generate a Z-axis deflection angle, and at the moment, the playing window corresponding to the VR hot spot also rotates along the X axis, so that the Z axis generates the same deflection angle.
In the existing VR glasses, the three-dimensional coordinate system of the VR scene is bound with the three-dimensional coordinate system of the VR glasses gyroscope, namely: when the eyes watch the scene, the head rotates to cause the VR glasses gyroscope to rotate, and the VR scene rotates along with the rotation.
After the distortion of the playing window in fig. 2 is dynamically corrected, the picture of the playing window is shown in fig. 3, the coordinates of the playing window are deflected along with the coordinates of the VR main viewing angle, and the coordinates of the playing window are deflected from the XYZ positions to the angles of X ' Y ' Z ', so that the playing window and the three-dimensional coordinate system of the VR scene are always kept parallel to deflect, the viewing angle is always perpendicular to the playing window, and the distortion problem of the picture played by the VR hot spot is solved. That is, the embodiment can follow-up adjust the coordinates of the play window by establishing the coordinate system of the play window, so that the coordinate system of the play window deviates along with the whole scene coordinate system, the purpose that the play window is always perpendicular to the viewing angle is achieved, and the distortion of the play window is avoided.
2) In the fourth step, when VR resource data and VR hot spot data are played, the interactive operation signals of the VR glasses are mapped to the operation control actions of the VR content, so that different VR glasses can be adapted.
The specific method comprises the following steps:
the WEB VR player automatically identifies the model of the VR glasses and automatically adapts to the SDK interface of the VR glasses;
the interactive operation signal of VR glasses includes: gaze, confirmation, return, direction, three degree of freedom handle movement, six degree of freedom handle movement, menu, volume, and touch down gamepad keys; the sensing input control signals of the gyroscope, the accelerometer and the magnetometer of the VR glasses, the external interactive operation signals and the like can be added according to the requirements.
The operation control action of the VR content includes: VR inter-scene switching, intra-scene roaming, intra-scene view angle adjustment, hot spot click interaction, UI click interaction, and space movement interaction.
Through the improvement, the problem that the WEB VR resources are immersively played in the VR glasses is solved, so that the depth matching of the WEB VR contents to the interaction peripheral equipment of the VR glasses is realized, and the effective playing experience of various interaction hot spots in the WEB VR resources in the VR glasses, such as VR scene roaming, scene jump, hot spot interaction and the like, is realized.
Claims (3)
1. A virtual reality glasses playing method of WEB VR content comprises the following steps:
step one, a WEB VR player receives a request of a user wearing VR glasses for playing a certain WEB VR content;
step two, a WEB VR player is connected with a WEB VR server to acquire VR scene data, VR hot spot data, VR global setting data, VR resource data and VR style data of the WEB VR content, wherein the VR scene data comprises panoramic pictures, panoramic videos and panoramic animations, the VR hot spot data comprises audio hot spots, video hot spots, picture hot spots, text hot spots, 3D model hot spots, jump hot spots and a UI, and the VR resource data comprises audio, video, pictures, texts and model animations;
thirdly, carrying out coordinate conversion on the VR scene data, the VR resource data with the position attribute and the VR hot spot data with the position attribute, and converting the VR scene plane coordinate system into a VR scene spherical coordinate system with the spherical center of a scene ball of the VR glasses as an origin;
fourthly, playing the VR resource data on the scene balls of the VR glasses according to the VR scene data, the VR global setting data and the VR style data; the WEB VR player responds to the VR hotspot playing request, plays VR hotspot data with a VR main view angle, creates a playing window for VR hotspot playing for each VR hotspot with position attribute, the playing window takes the position of the VR hotspot as an origin, and the coordinate system of the playing window is parallel to the coordinate system of the VR main view angle, so that the VR hotspot resource is played on the corresponding playing window, the VR main view angle changes along with deflection of a gyroscope of the VR glasses, and when the VR hotspot with the position attribute is played on the corresponding playing window, the playing window follows the gyroscope of the VR glasses; the VR main view angle coordinate system uses the sphere center of the scene sphere of the VR glasses as the origin, and is the same as the VR scene sphere coordinate system.
2. The virtual reality glasses playing method of WEB VR content according to claim 1, wherein: in the fourth step, when the gyroscope of the VR glasses rotates along the Z axis, the VR main viewing angle generates a Y axis deflection angle, and at this time, the play window corresponding to the VR hot spot also rotates along the Z axis, so that the Y axis generates the same deflection angle;
when the gyroscope of the VR glasses rotates along the Y axis, a Z-axis deflection angle is generated by the VR main visual angle, and at the moment, the play window corresponding to the VR hot spot also rotates along the Y axis, so that the same deflection angle is generated on the Z axis;
when the gyroscope of the VR glasses rotates along the X axis, the main view angle of the VR generates a Z-axis deflection angle, and at the moment, the playing window corresponding to the VR hot spot also rotates along the X axis, so that the Z axis generates the same deflection angle.
3. The virtual reality glasses playing method of the WEB VR content according to claim 1 or 2, wherein: in the fourth step, when VR resource data and VR hot spot data are played, mapping the interaction operation signals of the VR glasses to operation control actions of VR content correspondingly, so that different VR glasses can be adapted; the WEB VR player automatically identifies the model of the VR glasses and automatically adapts to the SDK interface of the VR glasses.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111619094.7A CN114339192B (en) | 2021-12-27 | 2021-12-27 | Virtual reality glasses playing method for WEB VR (virtual reality) content |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111619094.7A CN114339192B (en) | 2021-12-27 | 2021-12-27 | Virtual reality glasses playing method for WEB VR (virtual reality) content |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114339192A CN114339192A (en) | 2022-04-12 |
| CN114339192B true CN114339192B (en) | 2023-11-14 |
Family
ID=81015611
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111619094.7A Active CN114339192B (en) | 2021-12-27 | 2021-12-27 | Virtual reality glasses playing method for WEB VR (virtual reality) content |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114339192B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117173378B (en) * | 2023-11-03 | 2024-02-02 | 成都泰盟软件有限公司 | CAVE environment-based WebVR panoramic data display method, device, equipment and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106897108A (en) * | 2017-01-20 | 2017-06-27 | 华南理工大学 | A kind of implementation method of the virtual reality Panoramic Warping based on WebVR |
| WO2019036773A1 (en) * | 2017-08-24 | 2019-02-28 | Dream Channel Pty. Ltd. | Virtual reality interaction monitoring |
| CN110869888A (en) * | 2017-09-29 | 2020-03-06 | Eyexpo 科技有限公司 | Cloud-based system and method for creating virtual navigation |
| CN112702522A (en) * | 2020-12-25 | 2021-04-23 | 李灯 | Self-adaptive control playing method based on VR live broadcast system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160300392A1 (en) * | 2015-04-10 | 2016-10-13 | VR Global, Inc. | Systems, media, and methods for providing improved virtual reality tours and associated analytics |
| US20170084084A1 (en) * | 2015-09-22 | 2017-03-23 | Thrillbox, Inc | Mapping of user interaction within a virtual reality environment |
| US20210182918A1 (en) * | 2019-12-13 | 2021-06-17 | Social Nation, Inc. | Generating 360 degree interactive content |
-
2021
- 2021-12-27 CN CN202111619094.7A patent/CN114339192B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106897108A (en) * | 2017-01-20 | 2017-06-27 | 华南理工大学 | A kind of implementation method of the virtual reality Panoramic Warping based on WebVR |
| WO2019036773A1 (en) * | 2017-08-24 | 2019-02-28 | Dream Channel Pty. Ltd. | Virtual reality interaction monitoring |
| CN110869888A (en) * | 2017-09-29 | 2020-03-06 | Eyexpo 科技有限公司 | Cloud-based system and method for creating virtual navigation |
| CN112702522A (en) * | 2020-12-25 | 2021-04-23 | 李灯 | Self-adaptive control playing method based on VR live broadcast system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114339192A (en) | 2022-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10348795B2 (en) | Interactive control management for a live interactive video game stream | |
| US11403124B2 (en) | Remotely emulating computing devices | |
| JP7195426B2 (en) | Display page interaction control method and apparatus | |
| CN111541930B (en) | Live broadcast picture display method and device, terminal and storage medium | |
| CN114327700A (en) | Virtual reality equipment and screenshot picture playing method | |
| JP2022500795A (en) | Avatar animation | |
| CN114339192B (en) | Virtual reality glasses playing method for WEB VR (virtual reality) content | |
| CN108182249A (en) | Text query method, apparatus and computer readable storage medium | |
| US9497238B1 (en) | Application control translation | |
| US20220327748A1 (en) | Determining a change in position of displayed digital content in subsequent frames via graphics processing circuitry | |
| US11806625B2 (en) | Patch and bulk operations for a legacy game | |
| WO2020248682A1 (en) | Display device and virtual scene generation method | |
| US8732620B2 (en) | Method and system for a more realistic interaction experience using a stereoscopic cursor | |
| CN115129280A (en) | Virtual reality equipment and screen-casting media asset playing method | |
| JP7047168B1 (en) | Content provision system, content provision method, and content provision program | |
| US20230334790A1 (en) | Interactive reality computing experience using optical lenticular multi-perspective simulation | |
| US20230334791A1 (en) | Interactive reality computing experience using multi-layer projections to create an illusion of depth | |
| US20240098213A1 (en) | Modifying digital content transmitted to devices in real time via processing circuitry | |
| US20230334792A1 (en) | Interactive reality computing experience using optical lenticular multi-perspective simulation | |
| US11900136B2 (en) | AoT compiler for a legacy game | |
| US20230326094A1 (en) | Integrating overlaid content into displayed data via graphics processing circuitry and processing circuitry using a computing memory and an operating system memory | |
| US20220351327A1 (en) | Overlaying displayed digital content transmitted over a communication network via processing circuitry using a frame buffer | |
| US20220062767A1 (en) | Non-transitory medium and video game processing system | |
| WO2023205145A1 (en) | Interactive reality computing experience using multi-layer projections to create an illusion of depth | |
| WO2023215637A1 (en) | Interactive reality computing experience using optical lenticular multi-perspective simulation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |