CN106792151A - A kind of virtual reality panoramic video player method - Google Patents

A kind of virtual reality panoramic video player method Download PDF

Info

Publication number
CN106792151A
CN106792151A CN201611242227.2A CN201611242227A CN106792151A CN 106792151 A CN106792151 A CN 106792151A CN 201611242227 A CN201611242227 A CN 201611242227A CN 106792151 A CN106792151 A CN 106792151A
Authority
CN
China
Prior art keywords
panoramic video
plane
sphere
screen
grid
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611242227.2A
Other languages
Chinese (zh)
Inventor
龚剑锋
王雪峰
张瑛
施敏捷
王庆贺
胡立志
刘维
梁广磊
吴辉军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Float Network Technology Co Ltd
Original Assignee
Shanghai Float Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Float Network Technology Co Ltd filed Critical Shanghai Float Network Technology Co Ltd
Priority to CN201611242227.2A priority Critical patent/CN106792151A/en
Publication of CN106792151A publication Critical patent/CN106792151A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44012Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations

Abstract

Include the present invention relates to a kind of virtual reality panoramic video player method, the step of the method:Existing view is shot by capture apparatus obtains plane panoramic video stream;Plane panoramic video stream is obtained and decoded by panoramic video player for frame of video;Level according to taking lens sets up 2D spherical models with the vertical direction angle of visual field;Split by spherical angle and obtain 2D spherical models and generate sphere vertical array;All sphere summits are connected to form grid, and sets up the threedimensional model described by grid, set up visible grid set;The texture of the corresponding grid of textures;Terrace with edge hither plane, far plane and viewpoint and the api interface according to panoramic video player are set, screen viewport size is obtained;And according to the size and starting position coordinates of each split screen window in the split screen of left and right, the plane panoramic video stream is plotted on screen to realize that panoramic video is played.The present invention can make Virtual Reality equipment accurate and real-time display image.

Description

A kind of virtual reality panoramic video player method
Technical field
The present invention relates to panoramic video technical field, more particularly to a kind of virtual reality panoramic video player method.
Background technology
VR(Virtual Reality, i.e. virtual reality, abbreviation VR)Display Technique high speed development, occurs in that various Display device, user also more comes also high to the selection of display device requirement, and panoramic video has come into the popular visual field.
In order to realize the broadcasting to panoramic video, on the basis of traditional 2D video players, develop 360 degree it is virtual Real interactive player(VR equipment).The 360 degrees omnidirection real scene video that the equipment is stored by broadcasting with digital signal form, It is created that a kind of immersion virtual experience for having privacy and hommization concurrently.In order to improve Consumer's Experience, VR equipment is except can The scene of virtual reality is presented for user, video can also be played by video playback interface.At present, what is provided in VR equipment regards The size and location of frequency broadcast interface is fixed, and the user of VR equipment cannot be adjusted according to demand, reduce user Experience.
The content of the invention
A kind of VR video panorama player methods of virtual reality are the embodiment of the invention provides, in solving existing VR equipment The size and location at the video playback interface of offer is fixed, and the user of VR equipment cannot be adjusted according to demand.
In order to solve above-mentioned the deficiencies in the prior art, the present invention provides a kind of video of Virtual Reality equipment and broadcasts Method is put, being capable of accurate and real-time display image.
According to an aspect of the present invention, the step of a kind of VR panoramic videos player method, the method, includes:
Existing view is shot by capture apparatus obtains plane panoramic video stream;
The plane panoramic video stream is obtained by panoramic video player, and the plane panoramic video stream is decoded into video Frame;
The horizontal direction angle of visual field of the taking lens according to the capture apparatus sets up 2D spherical models with the vertical direction angle of visual field;
Split by spherical angle and obtain the 2D spherical models, and generate sphere vertical array;
The all sphere summits in the sphere vertical array are connected to form grid, and sets up the three-dimensional mould described by grid Type, and then set up visible grid set;
The texture of the corresponding grid in visible grid set described in textures;
Terrace with edge hither plane, far plane and viewpoint and the api interface according to the panoramic video player are set, obtain described The screen viewport size of panoramic video player;And
According to the size and starting position coordinates of each split screen window in the split screen of left and right, the plane panoramic video stream is plotted to On the screen of the panoramic video player, to realize that panoramic video is played.
According to an embodiment of the present invention, wherein, it is described split by spherical angle obtain the 2D spherical models, and The step of generation sphere vertical array, includes:With longitude 360, the 2D spherical models are divided into several spheres by latitude 180, And the sphere summit of each sphere is calculated, to generate the sphere vertical array.
According to an embodiment of the present invention, wherein, the corresponding grid in visible grid set described in the textures In texture the step of include:Video image is divided into the coordinate corresponding with the sphere vertical array, and is corresponded, covered The texture of the network is covered, the visible grid set of the threedimensional model is formed.
According to an embodiment of the present invention, wherein, the screen viewport size refer to screen width with height.
According to an embodiment of the present invention, wherein, the width of the screen viewport size is highly constant divided by 2, obtains The width and the starting position coordinates of each split screen window in the left and right split screen.
The player method of panoramic video provided in an embodiment of the present invention, is mapped to by spherical by plane video image Change the spherical pictures of 3D that mapping treatment is obtained, complete image rendering, the image for showing is accurate and real-time, and by spheroidization Mapping, when the visual field changes, image mapping distance keeps constant.
Brief description of the drawings
Fig. 1 is the flow chart of one embodiment panoramic video player method
Specific embodiment
Below according to accompanying drawing and specific embodiment a kind of VR virtual realities panoramic video player method of the invention is done into Elaborate to one step, in the hope of providing a clearer understanding of its working method and using step, but this can not be limited with this The protection domain of patent of invention.
With reference to Fig. 1, Fig. 1 is that a kind of flow of VR virtual realities panoramic video player method provided in an embodiment of the present invention is shown It is intended to.
As shown in figure 1, the step of virtual reality panoramic video player method, the method is as follows:
Step S101, is shot to existing view by capture apparatus and obtains plane panoramic video stream;
Step S102, the plane panoramic video stream is obtained by panoramic video player, and by the plane panoramic video stream Frame of video is decoded into, wherein, panoramic video player can be arranged on mobile terminal, PC ends, VR headset equipments or all-in-one On.Planar video stream is decoded into each two field picture by panoramic video player by decoding process.
Step S103, the horizontal direction angle of visual field and the vertical direction angle of visual field of the taking lens according to the capture apparatus are built Vertical 2D spherical models.
Step S104, is split by spherical angle and obtains the 2D spherical models, and generates sphere vertical array, wherein, Spherical angle segmentation is mainly divided into several rectangles according to spherical longitude and latitude, will hold and is divided into two triangles Shape, and calculate six coordinate values.
Step S105, connects all sphere summits in the sphere vertical array to form grid, and set up by grid The threedimensional model of description, and then set up visible grid set.
Step S106, the texture of the corresponding grid in visible grid set described in textures, wherein, each grid by The data texturing composition of each triangle.
Step S107, sets terrace with edge hither plane, far plane and viewpoint and the API according to the panoramic video player Interface, obtains the screen viewport size of the panoramic video player.Wherein, VR device As PI interfaces are different, the hardware of acquisition Device screen size is also different.
Step S108 is complete by the plane according to the size and starting position coordinates of each split screen window in the split screen of left and right Scape video flowing is plotted on the screen of the panoramic video player, to realize that panoramic video is played.In the present embodiment, mainly Refer to the width and height of screen.It should be noted that the width of screen viewport size is divided by 2, and it is highly constant, obtain left and right point Shield the width and starting position coordinates of each split screen.
It should be noted that step mentioned in the aforementioned embodiment, in addition to bright its order person is especially chatted, can be according to reality Applying needs to adjust its tandem, or even simultaneously or partially can perform simultaneously, and foregoing is only an embodiment, is not limited to this Invention.
Although the present invention is disclosed above with implementation method, so it is not limited to the present invention, and any this area tool is usual Skill, without departing from the spirit and scope of the present invention, when can be used for a variety of modifications and variations, therefore protection model of the invention Enclose to work as and be defined depending on the scope of which is defined in the appended claims.

Claims (5)

1. a kind of virtual reality panoramic video player method, it is characterised in that include the step of the method:
Existing view is shot by capture apparatus obtains plane panoramic video stream;
The plane panoramic video stream is obtained by panoramic video player, and the plane panoramic video stream is decoded into video Frame;
The horizontal direction angle of visual field of the taking lens according to the capture apparatus sets up 2D spherical models with the vertical direction angle of visual field;
Split by spherical angle and obtain the 2D spherical models, and generate sphere vertical array;
The all sphere summits in the sphere vertical array are connected to form grid, and sets up the three-dimensional mould described by grid Type, and then set up visible grid set;
The texture of the corresponding grid in visible grid set described in textures;
Terrace with edge hither plane, far plane and viewpoint and the api interface according to the panoramic video player are set, obtain described The screen viewport size of panoramic video player;And
According to the size and starting position coordinates of each split screen window in the split screen of left and right, the plane panoramic video stream is plotted to On the screen of the panoramic video player, to realize that panoramic video is played.
2. method according to claim 1, it is characterised in that it is described split by spherical angle obtain the 2D spherical molds Type, and include the step of generate sphere vertical array:With longitude 360, be divided into for the 2D spherical models several by latitude 180 Sphere, and the sphere summit of each sphere is calculated, to generate the sphere vertical array.
3. method according to claim 1, it is characterised in that corresponding described in visible grid set described in the textures The step of texture in grid, includes:Video image is divided into the coordinate corresponding with the sphere vertical array, and one a pair Should, the texture of the network is covered, form the visible grid set of the threedimensional model.
4. method according to claim 1, it is characterised in that the screen viewport size refer to the width of screen with it is high Degree.
5. method according to claim 1, it is characterised in that, divided by 2, height is or not the width of the screen viewport size Become, obtain the width and the starting position coordinates of each split screen window in the left and right split screen.
CN201611242227.2A 2016-12-29 2016-12-29 A kind of virtual reality panoramic video player method Pending CN106792151A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611242227.2A CN106792151A (en) 2016-12-29 2016-12-29 A kind of virtual reality panoramic video player method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611242227.2A CN106792151A (en) 2016-12-29 2016-12-29 A kind of virtual reality panoramic video player method

Publications (1)

Publication Number Publication Date
CN106792151A true CN106792151A (en) 2017-05-31

Family

ID=58924149

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611242227.2A Pending CN106792151A (en) 2016-12-29 2016-12-29 A kind of virtual reality panoramic video player method

Country Status (1)

Country Link
CN (1) CN106792151A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108765561A (en) * 2018-05-30 2018-11-06 链家网(北京)科技有限公司 Privacy information processing method and processing device in house virtual three-dimensional model generating process
CN109743892A (en) * 2017-07-04 2019-05-10 腾讯科技(深圳)有限公司 The display methods and device of virtual reality content
CN109872400A (en) * 2019-02-18 2019-06-11 上海电气集团股份有限公司 A kind of generation method of panoramic virtual reality scene
WO2019157923A1 (en) * 2018-02-13 2019-08-22 视辰信息科技(上海)有限公司 Environment mapping method and apparatus
CN111200750A (en) * 2018-11-16 2020-05-26 北京字节跳动网络技术有限公司 Multi-window playing method and device of panoramic video, electronic equipment and storage medium
CN111615832A (en) * 2018-01-22 2020-09-01 苹果公司 Method and apparatus for generating a composite reality reconstruction of planar video content
CN112672131A (en) * 2020-12-07 2021-04-16 聚好看科技股份有限公司 Panoramic video image display method and display equipment
CN112732089A (en) * 2021-01-18 2021-04-30 海信视像科技股份有限公司 Virtual reality equipment and quick interaction method
CN113542679A (en) * 2021-06-24 2021-10-22 海信视像科技股份有限公司 Image playing method and device
CN114584791A (en) * 2017-07-19 2022-06-03 联发科技股份有限公司 Method and device for processing 360-degree virtual reality image

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105245838A (en) * 2015-09-29 2016-01-13 成都虚拟世界科技有限公司 Panoramic video playing method and player
CN106101741A (en) * 2016-07-26 2016-11-09 武汉斗鱼网络科技有限公司 Internet video live broadcasting platform is watched the method and system of panoramic video
CN106127680A (en) * 2016-06-29 2016-11-16 深圳市优象计算技术有限公司 A kind of 720 degree of panoramic video fast browsing methods
CN106162203A (en) * 2016-07-05 2016-11-23 实野文化传媒(上海)有限公司 Panoramic video player method, player and wear-type virtual reality device
CN106254779A (en) * 2016-08-30 2016-12-21 上海乐欢软件有限公司 A kind of panoramic video processing method and server and client side

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105245838A (en) * 2015-09-29 2016-01-13 成都虚拟世界科技有限公司 Panoramic video playing method and player
CN106127680A (en) * 2016-06-29 2016-11-16 深圳市优象计算技术有限公司 A kind of 720 degree of panoramic video fast browsing methods
CN106162203A (en) * 2016-07-05 2016-11-23 实野文化传媒(上海)有限公司 Panoramic video player method, player and wear-type virtual reality device
CN106101741A (en) * 2016-07-26 2016-11-09 武汉斗鱼网络科技有限公司 Internet video live broadcasting platform is watched the method and system of panoramic video
CN106254779A (en) * 2016-08-30 2016-12-21 上海乐欢软件有限公司 A kind of panoramic video processing method and server and client side

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109743892A (en) * 2017-07-04 2019-05-10 腾讯科技(深圳)有限公司 The display methods and device of virtual reality content
CN109743892B (en) * 2017-07-04 2020-10-13 腾讯科技(深圳)有限公司 Virtual reality content display method and device
CN114584791A (en) * 2017-07-19 2022-06-03 联发科技股份有限公司 Method and device for processing 360-degree virtual reality image
CN111615832A (en) * 2018-01-22 2020-09-01 苹果公司 Method and apparatus for generating a composite reality reconstruction of planar video content
CN111615832B (en) * 2018-01-22 2022-10-25 苹果公司 Method and apparatus for generating a composite reality reconstruction of planar video content
WO2019157923A1 (en) * 2018-02-13 2019-08-22 视辰信息科技(上海)有限公司 Environment mapping method and apparatus
CN108765561A (en) * 2018-05-30 2018-11-06 链家网(北京)科技有限公司 Privacy information processing method and processing device in house virtual three-dimensional model generating process
CN111200750A (en) * 2018-11-16 2020-05-26 北京字节跳动网络技术有限公司 Multi-window playing method and device of panoramic video, electronic equipment and storage medium
CN111200750B (en) * 2018-11-16 2021-09-14 北京字节跳动网络技术有限公司 Multi-window playing method and device of panoramic video, electronic equipment and storage medium
CN109872400A (en) * 2019-02-18 2019-06-11 上海电气集团股份有限公司 A kind of generation method of panoramic virtual reality scene
CN109872400B (en) * 2019-02-18 2023-07-28 上海电气集团股份有限公司 Panoramic virtual reality scene generation method
CN112672131A (en) * 2020-12-07 2021-04-16 聚好看科技股份有限公司 Panoramic video image display method and display equipment
CN112672131B (en) * 2020-12-07 2024-02-06 聚好看科技股份有限公司 Panoramic video image display method and display device
CN112732089A (en) * 2021-01-18 2021-04-30 海信视像科技股份有限公司 Virtual reality equipment and quick interaction method
CN113542679A (en) * 2021-06-24 2021-10-22 海信视像科技股份有限公司 Image playing method and device

Similar Documents

Publication Publication Date Title
CN106792151A (en) A kind of virtual reality panoramic video player method
CN111279705B (en) Method, apparatus and stream for encoding and decoding volumetric video
CN111034201B (en) Method, apparatus and stream for encoding and decoding volumetric video
US10346950B2 (en) System and method of capturing and rendering a stereoscopic panorama using a depth buffer
WO2019041351A1 (en) Real-time aliasing rendering method for 3d vr video and virtual three-dimensional scene
US20180190007A1 (en) Stereoscopic rendering using raymarching and a virtual view broadcaster for such rendering
CN106101741B (en) Method and system for watching panoramic video on network video live broadcast platform
CN106527857A (en) Virtual reality-based panoramic video interaction method
TWI655608B (en) Method and apparatus for signaling region of interests
WO2017113681A1 (en) Video image processing method and apparatus based on virtual reality technology
CN110073662A (en) The suggestion viewport of panoramic video indicates
CN106165415A (en) Stereos copic viewing
CN107888987A (en) A kind of panoramic video player method and device
CN106210856B (en) The method and system of 3D panoramic video are watched on internet video live broadcasting platform
CN112702522B (en) Self-adaptive control playing method based on VR live broadcast system
CN101561988B (en) Method for exhibiting panoramagram
CN104740874A (en) Method and system for playing videos in two-dimension game scene
CN110060351A (en) A kind of dynamic 3 D personage reconstruction and live broadcasting method based on RGBD camera
CN106780759A (en) Method, device and the VR systems of scene stereoscopic full views figure are built based on picture
CN108174174A (en) VR image display methods, device and terminal
CN107005689B (en) Digital video rendering
CN108769648A (en) A kind of 3D scene rendering methods based on 720 degree of panorama VR
CN106604087B (en) A kind of rendering implementation method of panorama live streaming
CN102521876B (en) A kind of method and system realizing 3D user interface stereoeffect
CN108022204B (en) A kind of method that cylinder panorama video is converted to spherical panoramic video

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20170531