CN107315471A - A kind of interactive panoramic video implementation method and device based on virtual reality - Google Patents

A kind of interactive panoramic video implementation method and device based on virtual reality Download PDF

Info

Publication number
CN107315471A
CN107315471A CN201710435405.1A CN201710435405A CN107315471A CN 107315471 A CN107315471 A CN 107315471A CN 201710435405 A CN201710435405 A CN 201710435405A CN 107315471 A CN107315471 A CN 107315471A
Authority
CN
China
Prior art keywords
video
frequency band
dimension
cutting
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710435405.1A
Other languages
Chinese (zh)
Inventor
向桂香
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Zhiya Technology Co Ltd
Original Assignee
Chengdu Zhiya Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Zhiya Technology Co Ltd filed Critical Chengdu Zhiya Technology Co Ltd
Priority to CN201710435405.1A priority Critical patent/CN107315471A/en
Publication of CN107315471A publication Critical patent/CN107315471A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Image Processing (AREA)

Abstract

The application is related to field of virtual reality, more particularly to a kind of interactive panoramic video implementation method and device, and this method comprises the following steps:S1, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video;S2, catches the pupil information of user, generates current focus data;S3, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and the video-frequency band of closing on of the video-frequency band is preloaded;S4, corresponding interaction response is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on.By carrying out cutting type processing to panoramic video, the video-frequency band closed on user visual field focus only need to be loaded, it is achieved thereby that the on-demand loading of panoramic video, eventually reduces the occupancy to calculator memory resource.

Description

A kind of interactive panoramic video implementation method and device based on virtual reality
Technical field
The application is related to field of virtual reality, more particularly to a kind of interactive panoramic video implementation method and device.
Background technology
With making constant progress for scientific and technological information, with the continuous lifting of people's living standard, people are for things Understanding deepens continuously, and without only residing within hearsay and cumbersome word is illustrated and introduced above, but rises to In the aspect for reducing objective things style.Whether word description is consistent with hearing with actual environment, and we must not for this And know.But certainly panoramic video can answer this problem, the real actual environment of portrayal.Therefore, aphorama Frequency will even more the immense value and advantage of its own have been given play in fields in this respect.
Panoramic video is to be altered to link up by countless Zhang Quanjing pictures to constitute smooth clearly dynamic video image.But it is complete The shooting of scape video is then to tailor the video size of standard according to client's needs, demand and viewing platform.Current panorama The style of shooting of video is divided into two kinds:One kind is to take photo by plane.This requires that place, scene are open, and area is larger.And another is then Eyelevel shot on the ground, this shooting can clearly show many details of environment, and let us understands the specific position of environment Put, concrete shape, details etc..The purposes of two kinds of styles of shooting is different, and the former is intended to the assurance of integral macroscopic, and the latter is then It is to emphasize part and details.
The ways of presentation of panoramic video is mainly OPENGL technology combination spherical functions by calculating entirely in the prior art The panoramic video is mapped in virtual reality device by scape video rendering to spheroid inner surface, and by embedded module, final logical Man-machine interaction is realized in the click for crossing user.Above-mentioned interactive mode preferably realizes the bandwagon effect of panoramic video, there is very strong Immersion sense;But equally exist some problems, i.e. because the interaction of above-mentioned panoramic video is needed all angles of panoramic video Degree and the content of panoramic video All Time length are loaded, and panoramic video often have higher resolution ratio, it is longer when Between length, thereby result in a large amount of occupancy to calculator memory resource, therefore, need to be proposed that a kind of light-weighted video resource adds Carry and exchange method, to reduce the occupancy to calculator memory resource.
The content of the invention
A kind of interactive panoramic video implementation method, this method comprises the following steps:
S1, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video;
S2, catches the pupil information of user, generates current focus data;
S3, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and closing on for the video-frequency band is regarded Frequency range is preloaded;
S4, corresponding interaction response is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on.
As a preferred embodiment, the step S1 is specifically included:
S21, obtains panoramic video;
S22, to the panoramic video, temporally dimension and visual angle dimension carry out two-dimentional cutting;
S23, is numbered and is stored in the way of two-dimensional array to the video-frequency band after the cutting.
As a preferred embodiment, the step S2 also includes:User is caught using the grader in OpenCV Pupil information, and thus generation work as user's current focus data.
As a preferred embodiment, the step S3 is specifically included:According to the current focus data acquisition institute The video-frequency band after two dimension cutting is stated, and the video-frequency band that temporally dimension is closed on respectively and visual angle dimension is closed on is preloaded.
As a preferred embodiment, the step S3 also includes:Closed on and the visual angle for the time dimension Dimension closes on setting threshold value, to select and adjust the dimension and its threshold value.
The present invention proposes a kind of light-weighted video resource loading and exchange method, by being cut to panoramic video Formula is processed, and only the video-frequency band closed on user visual field focus need to be loaded, it is achieved thereby that the on-demand loading of panoramic video, most final decline The low occupancy to calculator memory resource.
As another embodiment, the present invention proposes that a kind of interactive panoramic video realizes device, and described device includes Following module:
Video cutting module, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video;
Focus generation module, catches the pupil information of user, generates current focus data;
Preloaded components, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and to the video-frequency band Video-frequency band of closing on preloaded;
Interactive module, corresponding interaction sound is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on Should.
As a preferred embodiment, the video cutting module is specifically included:
Obtain panoramic video;To the panoramic video, temporally dimension and visual angle dimension carry out two-dimentional cutting;After the cutting Video-frequency band be numbered and store in the way of two-dimensional array.
As a preferred embodiment, the focus generation module also includes:Caught using the grader in OpenCV The pupil information of user is caught, and thus user's current focus data are worked as in generation.
As a preferred embodiment, the preloaded components are specifically included:Obtained according to the current focus data The video-frequency band after the two dimension cutting is taken, and the video-frequency band that temporally dimension is closed on respectively and visual angle dimension is closed on carries out pre-add Carry.
As a preferred embodiment, the preloaded components also include:For the time dimension close on it is described Visual angle dimension closes on setting threshold value, to select and adjust the dimension and its threshold value.
The present invention proposes a kind of light-weighted video resource loading and exchange method and device, by entering to panoramic video Row cutting type is processed, and only need to load the video-frequency band closed on user visual field focus, it is achieved thereby that the on-demand loading of panoramic video, Eventually reduce the occupancy to calculator memory resource.
Brief description of the drawings
Fig. 1 is a kind of light-weighted video resource loading and the exchange method schematic flow sheet of the present invention.
Embodiment
Embodiments of the invention are further illustrated below in conjunction with accompanying drawing.
Embodiment one:
Fig. 1 is a kind of light-weighted video resource loading and the exchange method schematic flow sheet of the present invention, and this method includes as follows Step:
S1, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video.
Because OpenGL ES are a three-dimensional shape libraries, but three-dimensional image will show to pass through in two dimensional surface Certain projective transformation is crossed, three-dimensional space is included on two-dimensional screen in some way.In contrast, three-dimensional panorama The displaying of video needs three dimensions, and panoramic video is cut by two dimensions, is equally a kind of conversion side of projection Formula.
S2, catches the pupil information of user, generates current focus data.Panoramic video and user interact often by Eyes are come what is realized, and the focus of eyesight is usually as the important area for obtaining video interactive information, therefore, by catching user's Pupil information, and the current notice place of user is thus perceived, current focus data are ultimately generated, so as to be the pre- of video-frequency band Loading provides foundation.
As a preferred embodiment, the step S1 is specifically included:
S21, obtains panoramic video;
S22, to the panoramic video, temporally dimension and visual angle dimension carry out two-dimentional cutting;
S23, is numbered and is stored in the way of two-dimensional array to the video-frequency band after the cutting.
As a preferred embodiment, the step S2 also includes:User is caught using the grader in OpenCV Pupil information, and thus generation work as user's current focus data.
S3, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and the video-frequency band is faced Near-sighted frequency range is preloaded;
As a preferred embodiment, the step S3 is specifically included:Two according to the current focus data acquisition The video-frequency band after cutting is tieed up, and the video-frequency band that temporally dimension is closed on respectively and visual angle dimension is closed on is preloaded.
As a preferred embodiment, the step S3 also includes:Closed on and the visual angle for the time dimension Dimension closes on setting threshold value, to select and adjust the dimension and its threshold value.
S4, corresponding interaction response is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on.
The present invention proposes a kind of light-weighted video resource loading and exchange method, by being cut to panoramic video Formula is processed, and only the video-frequency band closed on user visual field focus need to be loaded, it is achieved thereby that the on-demand loading of panoramic video, most final decline The low occupancy to calculator memory resource.
Embodiment two:
As another embodiment, the present invention proposes that a kind of interactive panoramic video realizes device, and described device includes as follows Module:
Video cutting module, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video.
Because OpenGL ES are a three-dimensional shape libraries, but three-dimensional image will show to pass through in two dimensional surface Certain projective transformation is crossed, three-dimensional space is included on two-dimensional screen in some way.In contrast, three-dimensional panorama The displaying of video needs three dimensions, and panoramic video is cut by two dimensions, is equally a kind of conversion side of projection Formula.
Focus generation module, catches the pupil information of user, generates current focus data.Panoramic video is interacted with user's Realized often by eyes, therefore the focus of eyesight, passes through usually as the important area for obtaining video interactive information The pupil information of user is caught, and thus perceives the current notice place of user, current focus data are ultimately generated, so as to be The preloading of video-frequency band provides foundation.
As a preferred embodiment, the video cutting module is specifically included:Obtain panoramic video;To described complete Temporally dimension and visual angle dimension carry out two-dimentional cutting to scape video;Video-frequency band after the cutting is entered in the way of two-dimensional array Line number is simultaneously stored.
As a preferred embodiment, the focus generation module also includes:Caught using the grader in OpenCV The pupil information of user is caught, and thus user's current focus data are worked as in generation.
Preloaded components, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and regarded to described The video-frequency band of closing on of frequency range is preloaded;
As a preferred embodiment, the preloaded components are specifically included:According to the current focus data acquisition institute The video-frequency band after two dimension cutting is stated, and the video-frequency band that temporally dimension is closed on respectively and visual angle dimension is closed on is preloaded.
As a preferred embodiment, the preloaded components also include:For the time dimension close on it is described Visual angle dimension closes on setting threshold value, to select and adjust the dimension and its threshold value.
Interactive module, corresponding friendship is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on Mutually response.
The present invention proposes a kind of light-weighted video resource loading and exchange method and device, by entering to panoramic video Row cutting type is processed, and only need to load the video-frequency band closed on user visual field focus, it is achieved thereby that the on-demand loading of panoramic video, Eventually reduce the occupancy to calculator memory resource.
Embodiments of the invention are the foregoing is only, are not intended to limit the scope of the invention, it is every to utilize this hair Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills Art field, is included within the scope of the present invention.

Claims (10)

1. a kind of interactive panoramic video implementation method, it is characterised in that methods described comprises the following steps:
S1, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video;
S2, catches the pupil information of user, generates current focus data;
S3, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and closing on for the video-frequency band is regarded Frequency range is preloaded;
S4, corresponding interaction response is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on.
2. according to the method described in claim 1, it is characterised in that the step S1 is specifically included:
S21, obtains panoramic video;
S22, to the panoramic video, temporally dimension and visual angle dimension carry out two-dimentional cutting;
S23, is numbered and is stored in the way of two-dimensional array to the video-frequency band after the cutting.
3. according to the method described in claim 1, it is characterised in that the step S2 also includes:Use the classification in OpenCV Device catches the pupil information of user, and thus user's current focus data are worked as in generation.
4. method according to claim 2, it is characterised in that the step S3 is specifically included:According to the current focus Video-frequency band after two dimension cutting described in data acquisition, and the video-frequency band progress that temporally dimension is closed on respectively and visual angle dimension is closed on Preload.
5. method according to claim 4, it is characterised in that the step S3 also includes:Closed on for the time dimension Setting threshold value is closed on the visual angle dimension, to select and adjust the dimension and its threshold value.
6. a kind of interactive panoramic video realizes device, it is characterised in that described device includes following module:
Video cutting module, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video;
Focus generation module, catches the pupil information of user, generates current focus data;
Preloaded components, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and to the video-frequency band Video-frequency band of closing on preloaded;
Interactive module, corresponding interaction sound is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on Should.
7. device according to claim 6, it is characterised in that the video cutting module is specifically included:
Obtain panoramic video;To the panoramic video, temporally dimension and visual angle dimension carry out two-dimentional cutting;After the cutting Video-frequency band be numbered and store in the way of two-dimensional array.
8. device according to claim 6, it is characterised in that the focus generation module also includes:Using in OpenCV Grader catch user pupil information, and thus generation work as user's current focus data.
9. device according to claim 7, it is characterised in that the preloaded components are specifically included:According to described current Focus data obtains the video-frequency band after the two dimension cutting, and the video-frequency band that temporally dimension is closed on respectively and visual angle dimension is closed on Preloaded.
10. device according to claim 9, it is characterised in that the preloaded components also include:For the time dimension Close on and close on setting threshold value with the visual angle dimension, to select and adjust the dimension and its threshold value.
CN201710435405.1A 2017-06-11 2017-06-11 A kind of interactive panoramic video implementation method and device based on virtual reality Pending CN107315471A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710435405.1A CN107315471A (en) 2017-06-11 2017-06-11 A kind of interactive panoramic video implementation method and device based on virtual reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710435405.1A CN107315471A (en) 2017-06-11 2017-06-11 A kind of interactive panoramic video implementation method and device based on virtual reality

Publications (1)

Publication Number Publication Date
CN107315471A true CN107315471A (en) 2017-11-03

Family

ID=60183680

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710435405.1A Pending CN107315471A (en) 2017-06-11 2017-06-11 A kind of interactive panoramic video implementation method and device based on virtual reality

Country Status (1)

Country Link
CN (1) CN107315471A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107896333A (en) * 2017-11-29 2018-04-10 北京未来媒体科技股份有限公司 The method and device that a kind of remote control panoramic video based on intelligent terminal plays
CN108683874A (en) * 2018-05-16 2018-10-19 福州瑞芯微电子股份有限公司 The method and a kind of storage device of a kind of video conference attention focusing
CN108777809A (en) * 2018-04-11 2018-11-09 中国科学院信息工程研究所 A kind of panoramic video fragment mobile network caching method and system, panoramic video method for down loading
CN109587579A (en) * 2018-11-09 2019-04-05 深圳威尔视觉传媒有限公司 Multi-view code stream transmission method, device, equipment and storage medium based on CDN
CN115086629A (en) * 2022-06-10 2022-09-20 谭健 Sphere multi-lens real-time panoramic three-dimensional imaging system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3040850A1 (en) * 2014-12-30 2016-07-06 Nokia Technologies Oy Methods and apparatuses for directional view in panoramic content
CN105916060A (en) * 2016-04-26 2016-08-31 乐视控股(北京)有限公司 Method, apparatus and system for transmitting data
CN106254940A (en) * 2016-09-23 2016-12-21 北京疯景科技有限公司 Play the method and device of panorama content
CN106534882A (en) * 2016-12-29 2017-03-22 北京爱奇艺科技有限公司 Encoding and decoding method and device for virtual reality panoramic video

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3040850A1 (en) * 2014-12-30 2016-07-06 Nokia Technologies Oy Methods and apparatuses for directional view in panoramic content
CN105916060A (en) * 2016-04-26 2016-08-31 乐视控股(北京)有限公司 Method, apparatus and system for transmitting data
CN106254940A (en) * 2016-09-23 2016-12-21 北京疯景科技有限公司 Play the method and device of panorama content
CN106534882A (en) * 2016-12-29 2017-03-22 北京爱奇艺科技有限公司 Encoding and decoding method and device for virtual reality panoramic video

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107896333A (en) * 2017-11-29 2018-04-10 北京未来媒体科技股份有限公司 The method and device that a kind of remote control panoramic video based on intelligent terminal plays
CN108777809A (en) * 2018-04-11 2018-11-09 中国科学院信息工程研究所 A kind of panoramic video fragment mobile network caching method and system, panoramic video method for down loading
CN108777809B (en) * 2018-04-11 2020-08-21 中国科学院信息工程研究所 Panoramic video fragment mobile network caching method and system and panoramic video downloading method
CN108683874A (en) * 2018-05-16 2018-10-19 福州瑞芯微电子股份有限公司 The method and a kind of storage device of a kind of video conference attention focusing
CN108683874B (en) * 2018-05-16 2020-09-11 瑞芯微电子股份有限公司 Method for focusing attention of video conference and storage device
CN109587579A (en) * 2018-11-09 2019-04-05 深圳威尔视觉传媒有限公司 Multi-view code stream transmission method, device, equipment and storage medium based on CDN
CN115086629A (en) * 2022-06-10 2022-09-20 谭健 Sphere multi-lens real-time panoramic three-dimensional imaging system
CN115086629B (en) * 2022-06-10 2024-02-27 谭健 Real-time panoramic three-dimensional imaging system with multiple spherical lenses

Similar Documents

Publication Publication Date Title
CN107315471A (en) A kind of interactive panoramic video implementation method and device based on virtual reality
CN113038111B (en) Method, system and medium for image capture and processing
CN110910486B (en) Indoor scene illumination estimation model, method and device, storage medium and rendering method
US9137524B2 (en) System and method for generating 3-D plenoptic video images
US10410327B2 (en) Shallow depth of field rendering
US20150363905A1 (en) Improvements in and relating to image making
US10955911B2 (en) Gazed virtual object identification module, a system for implementing gaze translucency, and a related method
US20140009570A1 (en) Systems and methods for capture and display of flex-focus panoramas
US11562531B1 (en) Cascading shadow maps in areas of a three-dimensional environment
CN117115399A (en) Method and apparatus for presenting synthetic reality content in association with identified objects
US12039659B2 (en) Method and device for tailoring a synthesized reality experience to a physical setting
US20240112394A1 (en) AI Methods for Transforming a Text Prompt into an Immersive Volumetric Photo or Video
GB2554925A (en) Display of visual data with a virtual reality headset
US11956571B2 (en) Scene freezing and unfreezing
US20240037837A1 (en) Automatic graphics quality downgrading in a three-dimensional virtual environment
US20200344463A1 (en) Camera Projection Technique System and Method
US10891711B2 (en) Image processing method and apparatus
CN110870304A (en) Method and apparatus for providing information to a user for viewing multi-view content
CN108510433B (en) Space display method and device and terminal
KR20170044319A (en) Method for extending field of view of head mounted display
US11606498B1 (en) Exposure of panoramas
EP4150560B1 (en) Single image 3d photography with soft-layering and depth-aware inpainting
CN107316305A (en) A kind of interactive panoramic video scaling method and device based on virtual reality
US20240331264A1 (en) Systems, Devices, and Methods for Generating a Display
US11682164B1 (en) Sampling shadow maps at an offset

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20171103

WD01 Invention patent application deemed withdrawn after publication