CN107315471A - A kind of interactive panoramic video implementation method and device based on virtual reality - Google Patents
A kind of interactive panoramic video implementation method and device based on virtual reality Download PDFInfo
- Publication number
- CN107315471A CN107315471A CN201710435405.1A CN201710435405A CN107315471A CN 107315471 A CN107315471 A CN 107315471A CN 201710435405 A CN201710435405 A CN 201710435405A CN 107315471 A CN107315471 A CN 107315471A
- Authority
- CN
- China
- Prior art keywords
- video
- frequency band
- dimension
- cutting
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Abstract
The application is related to field of virtual reality, more particularly to a kind of interactive panoramic video implementation method and device, and this method comprises the following steps：S1, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video；S2, catches the pupil information of user, generates current focus data；S3, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and the video-frequency band of closing on of the video-frequency band is preloaded；S4, corresponding interaction response is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on.By carrying out cutting type processing to panoramic video, the video-frequency band closed on user visual field focus only need to be loaded, it is achieved thereby that the on-demand loading of panoramic video, eventually reduces the occupancy to calculator memory resource.
Description
Technical field
The application is related to field of virtual reality, more particularly to a kind of interactive panoramic video implementation method and device.
Background technology
With making constant progress for scientific and technological information, with the continuous lifting of people's living standard, people are for things
Understanding deepens continuously, and without only residing within hearsay and cumbersome word is illustrated and introduced above, but rises to
In the aspect for reducing objective things style.Whether word description is consistent with hearing with actual environment, and we must not for this
And know.But certainly panoramic video can answer this problem, the real actual environment of portrayal.Therefore, aphorama
Frequency will even more the immense value and advantage of its own have been given play in fields in this respect.
Panoramic video is to be altered to link up by countless Zhang Quanjing pictures to constitute smooth clearly dynamic video image.But it is complete
The shooting of scape video is then to tailor the video size of standard according to client's needs, demand and viewing platform.Current panorama
The style of shooting of video is divided into two kinds：One kind is to take photo by plane.This requires that place, scene are open, and area is larger.And another is then
Eyelevel shot on the ground, this shooting can clearly show many details of environment, and let us understands the specific position of environment
Put, concrete shape, details etc..The purposes of two kinds of styles of shooting is different, and the former is intended to the assurance of integral macroscopic, and the latter is then
It is to emphasize part and details.
The ways of presentation of panoramic video is mainly OPENGL technology combination spherical functions by calculating entirely in the prior art
The panoramic video is mapped in virtual reality device by scape video rendering to spheroid inner surface, and by embedded module, final logical
Man-machine interaction is realized in the click for crossing user.Above-mentioned interactive mode preferably realizes the bandwagon effect of panoramic video, there is very strong
Immersion sense；But equally exist some problems, i.e. because the interaction of above-mentioned panoramic video is needed all angles of panoramic video
Degree and the content of panoramic video All Time length are loaded, and panoramic video often have higher resolution ratio, it is longer when
Between length, thereby result in a large amount of occupancy to calculator memory resource, therefore, need to be proposed that a kind of light-weighted video resource adds
Carry and exchange method, to reduce the occupancy to calculator memory resource.
The content of the invention
A kind of interactive panoramic video implementation method, this method comprises the following steps：
S1, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video；
S2, catches the pupil information of user, generates current focus data；
S3, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and closing on for the video-frequency band is regarded
Frequency range is preloaded；
S4, corresponding interaction response is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on.
As a preferred embodiment, the step S1 is specifically included：
S21, obtains panoramic video；
S22, to the panoramic video, temporally dimension and visual angle dimension carry out two-dimentional cutting；
S23, is numbered and is stored in the way of two-dimensional array to the video-frequency band after the cutting.
As a preferred embodiment, the step S2 also includes：User is caught using the grader in OpenCV
Pupil information, and thus generation work as user's current focus data.
As a preferred embodiment, the step S3 is specifically included：According to the current focus data acquisition institute
The video-frequency band after two dimension cutting is stated, and the video-frequency band that temporally dimension is closed on respectively and visual angle dimension is closed on is preloaded.
As a preferred embodiment, the step S3 also includes：Closed on and the visual angle for the time dimension
Dimension closes on setting threshold value, to select and adjust the dimension and its threshold value.
The present invention proposes a kind of light-weighted video resource loading and exchange method, by being cut to panoramic video
Formula is processed, and only the video-frequency band closed on user visual field focus need to be loaded, it is achieved thereby that the on-demand loading of panoramic video, most final decline
The low occupancy to calculator memory resource.
As another embodiment, the present invention proposes that a kind of interactive panoramic video realizes device, and described device includes
Following module：
Video cutting module, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video；
Focus generation module, catches the pupil information of user, generates current focus data；
Preloaded components, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and to the video-frequency band
Video-frequency band of closing on preloaded；
Interactive module, corresponding interaction sound is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on
Should.
As a preferred embodiment, the video cutting module is specifically included：
Obtain panoramic video；To the panoramic video, temporally dimension and visual angle dimension carry out two-dimentional cutting；After the cutting
Video-frequency band be numbered and store in the way of two-dimensional array.
As a preferred embodiment, the focus generation module also includes：Caught using the grader in OpenCV
The pupil information of user is caught, and thus user's current focus data are worked as in generation.
As a preferred embodiment, the preloaded components are specifically included：Obtained according to the current focus data
The video-frequency band after the two dimension cutting is taken, and the video-frequency band that temporally dimension is closed on respectively and visual angle dimension is closed on carries out pre-add
Carry.
As a preferred embodiment, the preloaded components also include：For the time dimension close on it is described
Visual angle dimension closes on setting threshold value, to select and adjust the dimension and its threshold value.
The present invention proposes a kind of light-weighted video resource loading and exchange method and device, by entering to panoramic video
Row cutting type is processed, and only need to load the video-frequency band closed on user visual field focus, it is achieved thereby that the on-demand loading of panoramic video,
Eventually reduce the occupancy to calculator memory resource.
Brief description of the drawings
Fig. 1 is a kind of light-weighted video resource loading and the exchange method schematic flow sheet of the present invention.
Embodiment
Embodiments of the invention are further illustrated below in conjunction with accompanying drawing.
Embodiment one：
Fig. 1 is a kind of light-weighted video resource loading and the exchange method schematic flow sheet of the present invention, and this method includes as follows
Step：
S1, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video.
Because OpenGL ES are a three-dimensional shape libraries, but three-dimensional image will show to pass through in two dimensional surface
Certain projective transformation is crossed, three-dimensional space is included on two-dimensional screen in some way.In contrast, three-dimensional panorama
The displaying of video needs three dimensions, and panoramic video is cut by two dimensions, is equally a kind of conversion side of projection
Formula.
S2, catches the pupil information of user, generates current focus data.Panoramic video and user interact often by
Eyes are come what is realized, and the focus of eyesight is usually as the important area for obtaining video interactive information, therefore, by catching user's
Pupil information, and the current notice place of user is thus perceived, current focus data are ultimately generated, so as to be the pre- of video-frequency band
Loading provides foundation.
As a preferred embodiment, the step S1 is specifically included：
S21, obtains panoramic video；
S22, to the panoramic video, temporally dimension and visual angle dimension carry out two-dimentional cutting；
S23, is numbered and is stored in the way of two-dimensional array to the video-frequency band after the cutting.
As a preferred embodiment, the step S2 also includes：User is caught using the grader in OpenCV
Pupil information, and thus generation work as user's current focus data.
S3, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and the video-frequency band is faced
Near-sighted frequency range is preloaded；
As a preferred embodiment, the step S3 is specifically included：Two according to the current focus data acquisition
The video-frequency band after cutting is tieed up, and the video-frequency band that temporally dimension is closed on respectively and visual angle dimension is closed on is preloaded.
As a preferred embodiment, the step S3 also includes：Closed on and the visual angle for the time dimension
Dimension closes on setting threshold value, to select and adjust the dimension and its threshold value.
S4, corresponding interaction response is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on.
The present invention proposes a kind of light-weighted video resource loading and exchange method, by being cut to panoramic video
Formula is processed, and only the video-frequency band closed on user visual field focus need to be loaded, it is achieved thereby that the on-demand loading of panoramic video, most final decline
The low occupancy to calculator memory resource.
Embodiment two：
As another embodiment, the present invention proposes that a kind of interactive panoramic video realizes device, and described device includes as follows
Module：
Video cutting module, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video.
Because OpenGL ES are a three-dimensional shape libraries, but three-dimensional image will show to pass through in two dimensional surface
Certain projective transformation is crossed, three-dimensional space is included on two-dimensional screen in some way.In contrast, three-dimensional panorama
The displaying of video needs three dimensions, and panoramic video is cut by two dimensions, is equally a kind of conversion side of projection
Formula.
Focus generation module, catches the pupil information of user, generates current focus data.Panoramic video is interacted with user's
Realized often by eyes, therefore the focus of eyesight, passes through usually as the important area for obtaining video interactive information
The pupil information of user is caught, and thus perceives the current notice place of user, current focus data are ultimately generated, so as to be
The preloading of video-frequency band provides foundation.
As a preferred embodiment, the video cutting module is specifically included：Obtain panoramic video；To described complete
Temporally dimension and visual angle dimension carry out two-dimentional cutting to scape video；Video-frequency band after the cutting is entered in the way of two-dimensional array
Line number is simultaneously stored.
As a preferred embodiment, the focus generation module also includes：Caught using the grader in OpenCV
The pupil information of user is caught, and thus user's current focus data are worked as in generation.
Preloaded components, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and regarded to described
The video-frequency band of closing on of frequency range is preloaded；
As a preferred embodiment, the preloaded components are specifically included：According to the current focus data acquisition institute
The video-frequency band after two dimension cutting is stated, and the video-frequency band that temporally dimension is closed on respectively and visual angle dimension is closed on is preloaded.
As a preferred embodiment, the preloaded components also include：For the time dimension close on it is described
Visual angle dimension closes on setting threshold value, to select and adjust the dimension and its threshold value.
Interactive module, corresponding friendship is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on
Mutually response.
The present invention proposes a kind of light-weighted video resource loading and exchange method and device, by entering to panoramic video
Row cutting type is processed, and only need to load the video-frequency band closed on user visual field focus, it is achieved thereby that the on-demand loading of panoramic video,
Eventually reduce the occupancy to calculator memory resource.
Embodiments of the invention are the foregoing is only, are not intended to limit the scope of the invention, it is every to utilize this hair
Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of interactive panoramic video implementation method, it is characterised in that methods described comprises the following steps：
S1, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video；
S2, catches the pupil information of user, generates current focus data；
S3, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and closing on for the video-frequency band is regarded
Frequency range is preloaded；
S4, corresponding interaction response is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on.
2. according to the method described in claim 1, it is characterised in that the step S1 is specifically included：
S21, obtains panoramic video；
S22, to the panoramic video, temporally dimension and visual angle dimension carry out two-dimentional cutting；
S23, is numbered and is stored in the way of two-dimensional array to the video-frequency band after the cutting.
3. according to the method described in claim 1, it is characterised in that the step S2 also includes：Use the classification in OpenCV
Device catches the pupil information of user, and thus user's current focus data are worked as in generation.
4. method according to claim 2, it is characterised in that the step S3 is specifically included：According to the current focus
Video-frequency band after two dimension cutting described in data acquisition, and the video-frequency band progress that temporally dimension is closed on respectively and visual angle dimension is closed on
Preload.
5. method according to claim 4, it is characterised in that the step S3 also includes：Closed on for the time dimension
Setting threshold value is closed on the visual angle dimension, to select and adjust the dimension and its threshold value.
6. a kind of interactive panoramic video realizes device, it is characterised in that described device includes following module：
Video cutting module, obtains panoramic video, and two-dimentional cutting is carried out to the panoramic video；
Focus generation module, catches the pupil information of user, generates current focus data；
Preloaded components, the video-frequency band after the two dimension cutting according to the current focus data acquisition, and to the video-frequency band
Video-frequency band of closing on preloaded；
Interactive module, corresponding interaction sound is made according to the operational order of user, the video-frequency band and the video-frequency band of closing on
Should.
7. device according to claim 6, it is characterised in that the video cutting module is specifically included：
Obtain panoramic video；To the panoramic video, temporally dimension and visual angle dimension carry out two-dimentional cutting；After the cutting
Video-frequency band be numbered and store in the way of two-dimensional array.
8. device according to claim 6, it is characterised in that the focus generation module also includes：Using in OpenCV
Grader catch user pupil information, and thus generation work as user's current focus data.
9. device according to claim 7, it is characterised in that the preloaded components are specifically included：According to described current
Focus data obtains the video-frequency band after the two dimension cutting, and the video-frequency band that temporally dimension is closed on respectively and visual angle dimension is closed on
Preloaded.
10. device according to claim 9, it is characterised in that the preloaded components also include：For the time dimension
Close on and close on setting threshold value with the visual angle dimension, to select and adjust the dimension and its threshold value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710435405.1A CN107315471A (en) | 2017-06-11 | 2017-06-11 | A kind of interactive panoramic video implementation method and device based on virtual reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710435405.1A CN107315471A (en) | 2017-06-11 | 2017-06-11 | A kind of interactive panoramic video implementation method and device based on virtual reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107315471A true CN107315471A (en) | 2017-11-03 |
Family
ID=60183680
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710435405.1A Pending CN107315471A (en) | 2017-06-11 | 2017-06-11 | A kind of interactive panoramic video implementation method and device based on virtual reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107315471A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107896333A (en) * | 2017-11-29 | 2018-04-10 | 北京未来媒体科技股份有限公司 | The method and device that a kind of remote control panoramic video based on intelligent terminal plays |
| CN108683874A (en) * | 2018-05-16 | 2018-10-19 | 福州瑞芯微电子股份有限公司 | The method and a kind of storage device of a kind of video conference attention focusing |
| CN108777809A (en) * | 2018-04-11 | 2018-11-09 | 中国科学院信息工程研究所 | A kind of panoramic video fragment mobile network caching method and system, panoramic video method for down loading |
| CN109587579A (en) * | 2018-11-09 | 2019-04-05 | 深圳威尔视觉传媒有限公司 | Multi-view code stream transmission method, device, equipment and storage medium based on CDN |
| CN115086629A (en) * | 2022-06-10 | 2022-09-20 | 谭健 | Sphere multi-lens real-time panoramic three-dimensional imaging system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3040850A1 (en) * | 2014-12-30 | 2016-07-06 | Nokia Technologies Oy | Methods and apparatuses for directional view in panoramic content |
| CN105916060A (en) * | 2016-04-26 | 2016-08-31 | 乐视控股（北京）有限公司 | Method, apparatus and system for transmitting data |
| CN106254940A (en) * | 2016-09-23 | 2016-12-21 | 北京疯景科技有限公司 | Play the method and device of panorama content |
| CN106534882A (en) * | 2016-12-29 | 2017-03-22 | 北京爱奇艺科技有限公司 | Encoding and decoding method and device for virtual reality panoramic video |
-
2017
- 2017-06-11 CN CN201710435405.1A patent/CN107315471A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3040850A1 (en) * | 2014-12-30 | 2016-07-06 | Nokia Technologies Oy | Methods and apparatuses for directional view in panoramic content |
| CN105916060A (en) * | 2016-04-26 | 2016-08-31 | 乐视控股（北京）有限公司 | Method, apparatus and system for transmitting data |
| CN106254940A (en) * | 2016-09-23 | 2016-12-21 | 北京疯景科技有限公司 | Play the method and device of panorama content |
| CN106534882A (en) * | 2016-12-29 | 2017-03-22 | 北京爱奇艺科技有限公司 | Encoding and decoding method and device for virtual reality panoramic video |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107896333A (en) * | 2017-11-29 | 2018-04-10 | 北京未来媒体科技股份有限公司 | The method and device that a kind of remote control panoramic video based on intelligent terminal plays |
| CN108777809A (en) * | 2018-04-11 | 2018-11-09 | 中国科学院信息工程研究所 | A kind of panoramic video fragment mobile network caching method and system, panoramic video method for down loading |
| CN108777809B (en) * | 2018-04-11 | 2020-08-21 | 中国科学院信息工程研究所 | Panoramic video fragment mobile network caching method and system and panoramic video downloading method |
| CN108683874A (en) * | 2018-05-16 | 2018-10-19 | 福州瑞芯微电子股份有限公司 | The method and a kind of storage device of a kind of video conference attention focusing |
| CN108683874B (en) * | 2018-05-16 | 2020-09-11 | 瑞芯微电子股份有限公司 | Method for focusing attention of video conference and storage device |
| CN109587579A (en) * | 2018-11-09 | 2019-04-05 | 深圳威尔视觉传媒有限公司 | Multi-view code stream transmission method, device, equipment and storage medium based on CDN |
| CN115086629A (en) * | 2022-06-10 | 2022-09-20 | 谭健 | Sphere multi-lens real-time panoramic three-dimensional imaging system |
| CN115086629B (en) * | 2022-06-10 | 2024-02-27 | 谭健 | Real-time panoramic three-dimensional imaging system with multiple spherical lenses |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107315471A (en) | A kind of interactive panoramic video implementation method and device based on virtual reality | |
| CN113038111B (en) | Method, system and medium for image capture and processing | |
| CN110910486B (en) | Indoor scene illumination estimation model, method and device, storage medium and rendering method | |
| JP2021515446A (en) | Image display control by real-time compression in the image peripheral area | |
| KR20150090183A (en) | System and method for generating 3-d plenoptic video images | |
| US20180350043A1 (en) | Shallow Depth Of Field Rendering | |
| CN109255841A (en) | AR image presentation method, device, terminal and storage medium | |
| US20140009570A1 (en) | Systems and methods for capture and display of flex-focus panoramas | |
| US11562531B1 (en) | Cascading shadow maps in areas of a three-dimensional environment | |
| US10955911B2 (en) | Gazed virtual object identification module, a system for implementing gaze translucency, and a related method | |
| GB2554925A (en) | Display of visual data with a virtual reality headset | |
| US20230215079A1 (en) | Method and Device for Tailoring a Synthesized Reality Experience to a Physical Setting | |
| US20200344463A1 (en) | Camera Projection Technique System and Method | |
| US10891711B2 (en) | Image processing method and apparatus | |
| JP2014236238A (en) | Video display method and video display program | |
| US11593989B1 (en) | Efficient shadows for alpha-mapped models | |
| US20240037837A1 (en) | Automatic graphics quality downgrading in a three-dimensional virtual environment | |
| CN108510433B (en) | Space display method and device and terminal | |
| KR20170044319A (en) | Method for extending field of view of head mounted display | |
| EP4150560B1 (en) | Single image 3d photography with soft-layering and depth-aware inpainting | |
| CN107316305A (en) | A kind of interactive panoramic video scaling method and device based on virtual reality | |
| KR20230116765A (en) | Method and device for multi-camera hole filling | |
| US11606498B1 (en) | Exposure of panoramas | |
| US11823343B1 (en) | Method and device for modifying content according to various simulation characteristics | |
| US11956571B2 (en) | Scene freezing and unfreezing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20171103 |
|
| WD01 | Invention patent application deemed withdrawn after publication |