CN106131647B - A kind of more pictures based on virtual reality video viewing method simultaneously - Google Patents
A kind of more pictures based on virtual reality video viewing method simultaneously Download PDFInfo
- Publication number
- CN106131647B CN106131647B CN201610568947.1A CN201610568947A CN106131647B CN 106131647 B CN106131647 B CN 106131647B CN 201610568947 A CN201610568947 A CN 201610568947A CN 106131647 B CN106131647 B CN 106131647B
- Authority
- CN
- China
- Prior art keywords
- perspective
- user
- visual angle
- main perspective
- initial main
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
- H04N13/351—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of more pictures based on virtual reality video while viewing methods, include the following steps: to preset initial main perspective；When user perspective, which leaves, to be preset initial main perspective and be greater than the first predetermined angle difference between user perspective and initial main perspective, it is considered as and deviates visual angle state；When user perspective, which is in, deviates visual angle state, one piece of suspension region of interface display of user perspective, suspension region is initial main perspective picture, user is when using virtual reality glasses viewing panoramic video, change the existing mode that sub-fraction visual angle can only be paid close attention in synchronization, user can neatly using its interested visual angle as main perspective when, when user deviates main perspective and watches other interested visual angle pictures, main perspective will be presented in user perspective by suspension region, user can watch two interested pictures of main perspective and current visual angle simultaneously in this way.
Description
Technical field
The present invention relates to a kind of more pictures based on virtual reality video while viewing methods.
Background technique
User is when using virtual reality glasses viewing panoramic video, since the effect of virtual reality video is 360
Circulating type covering is spent, the visual angle of wherein sub-fraction can only be paid close attention to, therefore user can rotate visual angle often to watch different angle
Picture.
However, the visual angle with user rotates, user may picture to different angle it is all interested.In currently existing scheme
In, when user is when watching an interested picture, due to the interested picture presented in another angle be also can be with
Time shaft go ahead, such user often intelligently watches the picture of an angle interested at the same moment.
Summary of the invention
A kind of more pictures based on virtual reality video are provided it is an object of the invention to overcome in the prior art insufficient
Face while viewing method.
To achieve the above object, on the one hand, a kind of more pictures based on virtual reality video provided by the invention are seen simultaneously
It sees method, includes the following steps:
Preset initial main perspective；
Initial main perspective is preset and between user perspective and initial main perspective greater than the first preset angle when user perspective leaves
When spending difference, it is considered as and deviates visual angle state；
When user perspective, which is in, deviates visual angle state, one piece of suspension region of interface display of user perspective, suspension region
For initial main perspective picture.
Preferably, when user perspective is in deviation visual angle state and user perspective quiescent time is more than preset time value,
Current visual angle is then considered as new main perspective.
Preferably, when user perspective is in deviation visual angle state and user perspective returns back between initial main perspective
When angle difference is less than the second predetermined angle difference, user perspective, which is considered as to return to, presets initial main perspective.
Preferably, when user perspective is in deviation visual angle state and user perspective returns back to the angle between new main perspective
When spending difference less than the second predetermined angle difference, user perspective, which is considered as, returns to new main perspective.
Viewing method, user are using void to a kind of more pictures based on virtual reality video provided according to the present invention simultaneously
When quasi- Reality glasses viewing panoramic video, change the existing mode that sub-fraction visual angle can only be paid close attention in synchronization,
User can neatly using its interested visual angle as main perspective when, when user deviates main perspective and to watch other interested
When the picture of visual angle, main perspective will be presented in user perspective by suspension region, and such user can watch main view simultaneously
The two interested pictures in angle and current visual angle.
Specific embodiment
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include one or more of the features.In the description of the present invention, the meaning of " plurality " is two or more,
Unless otherwise specifically defined.
In the present invention unless specifically defined or limited otherwise, term " installation ", " connected ", " connection ", " fixation " etc.
Term shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or be integrally connected；It can be machine
Tool connection, is also possible to be electrically connected；It can be directly connected, two members can also be can be indirectly connected through an intermediary
Connection inside part.For the ordinary skill in the art, above-mentioned term can be understood in this hair as the case may be
Concrete meaning in bright.
One embodiment of the invention provides a kind of more pictures based on virtual reality video viewing method simultaneously, including as follows
Step:
Preset initial main perspective；
Initial main perspective is preset and between user perspective and initial main perspective greater than the first preset angle when user perspective leaves
When spending difference, it is considered as and deviates visual angle state；
When user perspective, which is in, deviates visual angle state, one piece of suspension region of interface display of user perspective, suspension region
For initial main perspective picture.
Specifically, the selection mode of main perspective is formulated first:
It is to preset initial main perspective that the visual angle for starting to play is defaulted at the beginning of film；
After user perspective rotates and is greater than the first predetermined angle difference between user perspective and initial main perspective (
It is 45 ° in the present embodiment), then it is assumed that the user perspective, which has had deviated from, presets initial main perspective；
Turn further back after user perspective is in deviation visual angle state and initial main perspective is preset in user perspective deviation,
Or turn toward direction until close to one circle of rotation always, if user perspective and presetting the differential seat angle between initial main perspective
When absolute value is less than the second predetermined angle difference (being in the present embodiment 45 °), then it is assumed that user perspective has returned to default initial
Main perspective；
Deviate visual angle state and user perspective when user perspective is in the quiescent time of a new view position and be more than
After preset time value (being in the present embodiment 5 minutes), then current user perspective is set to new main perspective.It is appreciated that
Preset time value is one of the adjusting parameter for user experience, in practical applications can flexible transformation.
Specifically, the rotation angle at visual angle is calculated by the data that gyroscope provides: first acquisition gyroscope and
The specific value of accelerometer, then using EKF algorithm, (Extended Kalman Filter's is write a Chinese character in simplified form, i.e., spreading kalman is filtered
Wave device) data of gyroscope and accelerometer are modified, according to algorithm acquired results, the rotation angle at visual angle can be calculated
The differential seat angle of degree, direction of rotation and opposite main perspective.
Generally, the value interval of the first predetermined angle difference and the second predetermined angle difference is between 30 °~180 °.
Specifically, when user perspective, which is in, deviates visual angle state, the interface display of user perspective is independent outstanding at one piece
On the domain of floating region (upper right corner that suspension region is in current visual angle in the present embodiment), the content shown in suspension region is default
The picture of initial main perspective or new main perspective.
Specifically, after user perspective, which is in, deviates visual angle state, initial main perspective or new can will be preset by OpenGL
Individually interception comes out the corresponding picture of main perspective from initial data frame, then the data frame that this picture is new as one piece
It is rendered on one piece of new Texture, this block Texture will be rendered on one piece of specific region and form floating zone above-mentioned
Domain, this block suspension region will be suspended on sphere.
Specifically, OpenGL can carry out spherical surface rendering to overall picture, and one is intercepted in overall picture using OpenGL
Split screen is rendered, the differential seat angle then got according to gyroscope above-mentioned, calculates interception part picture in total painting
Specific location in face, the image content that this is obtained, a frame data the newest are rendered on a new Texture, so
Texture is rendered into specified suspension region afterwards.
It is appreciated that suspension region may be set in any one position of user perspective, such as the upper right corner, the upper left corner,
As long as the experience of user's viewing will not excessively be influenced and be blocked.
Specifically, deviate visual angle state and user perspective when user perspective is in and preset initial main perspective or new in deviation
When rotating on other visual angles of main perspective, this spy will be remained at by presetting initial main perspective or the corresponding picture of new main perspective
On fixed suspension region, i.e., suspension region is static relative to user perspective, this mean that suspension region need with
The rotation at family visual angle and rotate, so, when rendering new suspension region, need the corresponding visual angle matrix in active user visual angle
In the display for calculating suspension region.
Specifically, initial main perspective or new main perspective and user perspective are preset in main view Angle Position when user perspective returns to
When stopping, the region of suspension will disappear automatically.
Specifically, when user perspective does not stop after having turned to return to for one week and having preset initial main perspective or new main perspective
Rotation, and be to maintain and rotate and leave again when preset initial main perspective or new main perspective, then it is assumed that user is not intended to again
Using original default initial main perspective or new main perspective as " main perspective ", then needing to remove original default initial main perspective
Or new main perspective, (determine to return in this process and preset initial main perspective or new at this point, the suspension region in the upper right corner will disappear automatically
The mode of main perspective is as hereinbefore).Later, it after presetting initial main perspective or new main perspective is removed, then needs again
Selection main perspective: it is selected as new " main perspective " (i.e. next new main perspective) in that visual angle when user perspective is stopped operating；
To sum up, pass through above method and step, so that it may allow users to the picture for watching two visual angles simultaneously, and also
It can be based on the principle idea, expand to while watching the picture (multiple suspension regions are set) at multiple visual angles.
Viewing method, user are watched entirely this more pictures based on virtual reality video using virtual reality glasses simultaneously
When scape video, change the existing mode that sub-fraction visual angle can only be paid close attention in synchronization, user can neatly with
When its interested visual angle is as main perspective, when user deviates main perspective and watches other interested visual angle pictures, main view
Angle will be presented in user perspective by suspension region, and such user can watch main perspective and current visual angle two simultaneously
Interested picture.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not
Centainly refer to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be any
One or more embodiment or examples in can be combined in any suitable manner.Although reality of the invention has been shown and described above
Apply example, it is to be understood that above-described embodiment is exemplary, and is not considered as limiting the invention, this field it is common
Technical staff without departing from the principle and spirit of the present invention within the scope of the invention can to above-described embodiment into
Row change, modification, replacement and modification.
Claims (4)
1. a kind of more pictures based on virtual reality video while viewing method, which comprises the steps of:
Preset initial main perspective；
It described preset initial main perspective when user perspective leaves and is greater than the between the user perspective and the initial main perspective
When one predetermined angle difference, it is considered as and deviates visual angle state；
When the user perspective, which is in, deviates visual angle state, initial main perspective picture will be preset from initial data by OpenGL
It is individually intercepted in frame, specific position of the initial main perspective picture in overall picture is calculated according to the differential seat angle that gyroscope obtains
It sets, and by the initial main perspective picture rendering on new Texture, the new Texture is in the interface of the user perspective
The middle specified region of one piece of rendering forms suspension region, and the suspension region is the initial main perspective picture；
The suspension region is static with respect to user perspective.
2. a kind of more pictures based on virtual reality video according to claim 1 while viewing method, which is characterized in that
When the user perspective is in deviation visual angle state and the user perspective quiescent time is more than preset time value, then will work as
Preceding visual angle is considered as new main perspective.
3. a kind of more pictures based on virtual reality video according to claim 1 while viewing method, which is characterized in that
When the user perspective is in deviation visual angle state and the user perspective returns back to the angle between the initial main perspective
When difference is less than the second predetermined angle difference, the user perspective, which is considered as to return to, described presets initial main perspective.
4. a kind of more pictures based on virtual reality video according to claim 2 while viewing method, which is characterized in that
When the user perspective is in deviation visual angle state and the user perspective returns back to the differential seat angle between the new main perspective
When value is less than the second predetermined angle difference, the user perspective, which is considered as, returns to the new main perspective.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610568947.1A CN106131647B (en) | 2016-07-18 | 2016-07-18 | A kind of more pictures based on virtual reality video viewing method simultaneously |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610568947.1A CN106131647B (en) | 2016-07-18 | 2016-07-18 | A kind of more pictures based on virtual reality video viewing method simultaneously |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106131647A CN106131647A (en) | 2016-11-16 |
| CN106131647B true CN106131647B (en) | 2019-03-19 |
Family
ID=57289855
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610568947.1A Active CN106131647B (en) | 2016-07-18 | 2016-07-18 | A kind of more pictures based on virtual reality video viewing method simultaneously |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106131647B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108632674B (en) * | 2017-03-23 | 2021-09-21 | 华为技术有限公司 | Panoramic video playing method and client |
| CN106980379B (en) | 2017-03-30 | 2020-05-19 | 联想(北京)有限公司 | Display method and terminal |
| TWI663868B (en) * | 2017-11-17 | 2019-06-21 | 宏碁股份有限公司 | Display system, content generator, computing device, and control method thereof |
| EP3741108A4 (en) * | 2018-01-17 | 2021-10-13 | Nokia Technologies Oy | An apparatus, a method and a computer program for omnidirectional video |
| CN117857723A (en) * | 2020-12-21 | 2024-04-09 | 维沃移动通信有限公司 | Picture processing method and device |
| CN114786061B (en) * | 2022-04-12 | 2023-08-22 | 杭州当虹科技股份有限公司 | Picture visual angle correction method based on VR equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203882013U (en) * | 2014-05-29 | 2014-10-15 | 孙立军 | Phantom field-of-view film projection device |
| CN204543523U (en) * | 2015-04-24 | 2015-08-12 | 吴展雄 | A kind of virtual reality wears display system |
| CN105103034A (en) * | 2013-03-25 | 2015-11-25 | 索尼电脑娱乐欧洲有限公司 | Display |
| CN105373249A (en) * | 2014-08-13 | 2016-03-02 | Lg电子株式会社 | Mobile terminal |
| WO2016050283A1 (en) * | 2014-09-30 | 2016-04-07 | Telefonaktiebolaget L M Ericsson (Publ) | Reduced bit rate immersive video |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7631261B2 (en) * | 2002-09-12 | 2009-12-08 | Inoue Technologies, LLC | Efficient method for creating a visual telepresence for large numbers of simultaneous users |
-
2016
- 2016-07-18 CN CN201610568947.1A patent/CN106131647B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105103034A (en) * | 2013-03-25 | 2015-11-25 | 索尼电脑娱乐欧洲有限公司 | Display |
| CN203882013U (en) * | 2014-05-29 | 2014-10-15 | 孙立军 | Phantom field-of-view film projection device |
| CN105373249A (en) * | 2014-08-13 | 2016-03-02 | Lg电子株式会社 | Mobile terminal |
| WO2016050283A1 (en) * | 2014-09-30 | 2016-04-07 | Telefonaktiebolaget L M Ericsson (Publ) | Reduced bit rate immersive video |
| CN204543523U (en) * | 2015-04-24 | 2015-08-12 | 吴展雄 | A kind of virtual reality wears display system |
Non-Patent Citations (1)
| Title |
|---|
| 一种面向多视频源的虚拟现实系统解决方案;魏发远;《计算机仿真》;20050915;全文 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106131647A (en) | 2016-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106131647B (en) | A kind of more pictures based on virtual reality video viewing method simultaneously | |
| US10955913B2 (en) | Adjusting content display orientation on a screen based on user orientation | |
| CN111670453B (en) | Gaze-dependent concave rendering device, method, computer program and system | |
| US9241155B2 (en) | 3-D rendering for a rotated viewer | |
| US9684946B2 (en) | Image making | |
| CN105872698B (en) | Playback method, play system and virtual reality terminal | |
| US20210104084A1 (en) | Systems and Methods for Utilizing a Device as a Marker for Augmented Reality Content | |
| CN105721703B (en) | A method of panorama positioning and direction are carried out using cell phone apparatus sensor | |
| US20080310018A1 (en) | Split Screen Discrete Viewing Apparatus and Method | |
| JP2005503611A (en) | Portable virtual reality system | |
| CN110378914A (en) | Rendering method and device, system, display equipment based on blinkpunkt information | |
| JP6147966B2 (en) | Information processing program, information processing apparatus, information processing system, and information processing method | |
| CN107844190A (en) | Image presentation method and device based on Virtual Reality equipment | |
| CN108319362A (en) | A kind of panoramic information display methods, electronic equipment and computer storage media | |
| CN101465116A (en) | Display equipment and control method thereof | |
| US20160148414A1 (en) | Method and apparatus for delivering and controlling multi-feed data | |
| CN107707901B (en) | It is a kind of for the display methods of naked eye 3D display screen, device and equipment | |
| CN106055299B (en) | The method of image Arbitrary Rotation is realized in multiple display equipment | |
| KR101745190B1 (en) | System and Method for setting a three-dimensional effect | |
| CN109901709B (en) | Method and device for adjusting display picture and VR equipment | |
| WO2012021129A1 (en) | 3d rendering for a rotated viewer | |
| CN109302640B (en) | Method and device for displaying barrage in virtual reality video | |
| CN106648365A (en) | Screen anti-shake method and device for three-dimensional image | |
| CN208795931U (en) | A kind of medical simple eye formula AR glasses | |
| CN108196805B (en) | Spliced wall display method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: 310000 A Block, 16th Floor, E Building, Paradise Software Park, No. 3 Xidoumen Road, Hangzhou City, Zhejiang Province Patentee after: Hangzhou Dang Hong Polytron Technologies Inc Address before: 310000 B2010, two floor, North (two), six and 368 Road, Binjiang District, Hangzhou, Zhejiang. Patentee before: HANGZHOU DANGHONG TECHNOLOGY CO., LTD. |
|
| CP03 | Change of name, title or address |